Differentiation

Total Page:16

File Type:pdf, Size:1020Kb

Differentiation Section 1.6 1.6 Vector Calculus 1 - Differentiation Calculus involving vectors is discussed in this section, rather intuitively at first and more formally toward the end of this section. 1.6.1 The Ordinary Calculus Consider a scalar-valued function of a scalar, for example the time-dependent density of a material (t) . The calculus of scalar valued functions of scalars is just the ordinary calculus. Some of the important concepts of the ordinary calculus are reviewed in Appendix B to this Chapter, §1.B.2. 1.6.2 Vector-valued Functions of a scalar Consider a vector-valued function of a scalar, for example the time-dependent displacement of a particle u u(t) . In this case, the derivative is defined in the usual way, du u(t t) u(t) lim , dt t0 t which turns out to be simply the derivative of the coefficients1, du du du du du 1 e 2 e 3 e i e dt dt 1 dt 2 dt 3 dt i Partial derivatives can also be defined in the usual way. For example, if u is a function of the coordinates, u(x1 , x2 , x3 ) , then u u(x x , x , x ) u(x , x , x ) lim 1 1 2 3 1 2 3 x1 0 x1 x1 Differentials of vectors are also defined in the usual way, so that when u1 , u2 , u3 undergo increments du1 u1, du2 u2 , du3 u3 , the differential of u is du du1e1 du2e 2 du3e3 and the differential and actual increment u approach one another as u1, u2 , u3 0 . 1 assuming that the base vectors do not depend on t Solid Mechanics Part III 30 Kelly Section 1.6 Space Curves The derivative of a vector can be interpreted geometrically as shown in Fig. 1.6.1: u is the increment in u consequent upon an increment t in t. As t changes, the end-point of the vector u(t) traces out the dotted curve shown – it is clear that as t 0 , u approaches the tangent to , so that du / dt is tangential to . The unit vector tangent to the curve is denoted by τ : du / dt τ (1.6.1) du / dt τ s s x u 2 ds du2 u(t) u(t t) du1 x1 (a) (b) Figure 1.6.1: a space curve; (a) the tangent vector, (b) increment in arc length Let s be a measure of the length of the curve , measured from some fixed point on . Let s be the increment in arc-length corresponding to increments in the coordinates, T u u1 , u2 , u3 , Fig. 1.6.1b. Then, from the ordinary calculus (see Appendix 1.B), 2 2 2 2 ds du1 du2 du3 so that 2 2 2 ds du du du 1 2 3 dt dt dt dt But du du du du 1 e 2 e 3 e dt dt 1 dt 2 dt 3 so that du ds (1.6.2) dt dt Solid Mechanics Part III 31 Kelly Section 1.6 Thus the unit vector tangent to the curve can be written as du / dt du τ (1.6.3) ds / dt ds If u is interpreted as the position vector of a particle and t is interpreted as time, then v du / dt is the velocity vector of the particle as it moves with speed ds / dt along . Example (of particle motion) 2 2 A particle moves along a curve whose parametric equations are x1 2t , x2 t 4t , x3 3t 5 where t is time. Find the component of the velocity at time t 1 in the direction a e1 3e 2 2e3 . Solution The velocity is dr d v 2t 2e t 2 4t e 3t 5 e dt dt 1 2 3 4e1 2e 2 3e3 at t 1 The component in the given direction is v aˆ , where aˆ is a unit vector in the direction of a, giving 8 14 / 7 . ■ Curvature The scalar curvature (s) of a space curve is defined to be the magnitude of the rate of change of the unit tangent vector: dτ d 2u (s) (1.6.4) ds ds 2 Note that τ is in a direction perpendicular to τ , Fig. 1.6.2. In fact, this can be proved as follows: since τ is a unit vector, τ τ is a constant ( 1), and so dτ τ/ ds 0 , but also, d dτ τ τ 2τ ds ds and so τ and dτ / ds are perpendicular. The unit vector defined in this way is called the principal normal vector: Solid Mechanics Part III 32 Kelly Section 1.6 1 dτ ν (1.6.5) ds 1 s R (s) ν(s) ν(s ds) s τ(s) τ τ(s ds) Figure 1.6.2: the curvature This can be seen geometrically in Fig. 1.6.2: from Eqn. 1.6.5, τ is a vector of magnitude s in the direction of the vector normal to τ . The radius of curvature R is defined as the reciprocal of the curvature; it is the radius of the circle which just touches the curve at s, Fig. 1.6.2. Finally, the unit vector perpendicular to both the tangent vector and the principal normal vector is called the unit binormal vector: b τ ν (1.6.6) The planes defined by these vectors are shown in Fig. 1.6.3; they are called the rectifying plane, the normal plane and the osculating plane. ν Osculating Normal plane plane τ Rectifying plane b Figure 1.6.3: the unit tangent, principal normal and binormal vectors and associated planes Solid Mechanics Part III 33 Kelly Section 1.6 Rules of Differentiation The derivative of a vector is also a vector and the usual rules of differentiation apply, d du dv u v dt dt dt (1.6.7) d dv d (t)v v dt dt dt Also, it is straight forward to show that {▲Problem 2} d da dv d da dv v a v a v a v a (1.6.8) dt dt dt dt dt dt (The order of the terms in the cross-product expression is important here.) 1.6.3 Fields In many applications of vector calculus, a scalar or vector can be associated with each point in space x. In this case they are called scalar or vector fields. For example (x) temperature a scalar field (a scalar-valued function of position) v(x) velocity a vector field (a vector valued function of position) These quantities will in general depend also on time, so that one writes (x,t) or v(x,t) . Partial differentiation of scalar and vector fields with respect to the variable t is symbolised by / t . On the other hand, partial differentiation with respect to the coordinates is symbolised by / xi . The notation can be made more compact by introducing the subscript comma to denote partial differentiation with respect to the 2 coordinate variables, in which case ,i / xi , ui, jk ui / x j xk , and so on. 1.6.4 The Gradient of a Scalar Field Let (x) be a scalar field. The gradient of is a vector field defined by (see Fig. 1.6.4) e1 e 2 e3 x1 x2 x3 ei Gradient of a Scalar Field (1.6.9) xi x The gradient is of considerable importance because if one takes the dot product of with dx , it gives the increment in : Solid Mechanics Part III 34 Kelly Section 1.6 dx ei dx j e j xi dxi (1.6.10) xi d (x dx) (dx) dx x Figure 1.6.4: the gradient of a vector If one writes dx as dxe dxe , where e is a unit vector in the direction of dx, then dd e (1.6.11) dx in e direction dn This quantity is called the directional derivative of , in the direction of e, and will be discussed further in §1.6.11. The gradient of a scalar field is also called the scalar gradient, to distinguish it from the vector gradient (see later)2, and is also denoted by grad (1.6.12) Example (of the Gradient of a Scalar Field) 2 2 Consider a two-dimensional temperature field x1 x2 . Then 2x1e1 2x2e 2 For example, at (1,0) , 1, 2e1 and at (1,1) , 2 , 2e1 2e2 , Fig. 1.6.5. Note the following: (i) points in the direction normal to the curve const. (ii) the direction of maximum rate of change of is in the direction of 2 in this context, a gradient is a derivative with respect to a position vector, but the term gradient is used more generally than this, e.g. see §1.14 Solid Mechanics Part III 35 Kelly Section 1.6 (iii) the direction of zero d is in the direction perpendicular to (1,1) 1 (1,0) 2 Figure 1.6.5: gradient of a temperature field The curves x1, x2 const. are called isotherms (curves of constant temperature). In general, they are called iso-curves (or iso-surfaces in three dimensions). ■ Many physical laws are given in terms of the gradient of a scalar field. For example, Fourier’s law of heat conduction relates the heat flux q (the rate at which heat flows through a surface of unit area3) to the temperature gradient through q k (1.6.13) where k is the thermal conductivity of the material, so that heat flows along the direction normal to the isotherms.
Recommended publications
  • The Directional Derivative the Derivative of a Real Valued Function (Scalar field) with Respect to a Vector
    Math 253 The Directional Derivative The derivative of a real valued function (scalar field) with respect to a vector. f(x + h) f(x) What is the vector space analog to the usual derivative in one variable? f 0(x) = lim − ? h 0 h ! x -2 0 2 5 Suppose f is a real valued function (a mapping f : Rn R). ! (e.g. f(x; y) = x2 y2). − 0 Unlike the case with plane figures, functions grow in a variety of z ways at each point on a surface (or n{dimensional structure). We'll be interested in examining the way (f) changes as we move -5 from a point X~ to a nearby point in a particular direction. -2 0 y 2 Figure 1: f(x; y) = x2 y2 − The Directional Derivative x -2 0 2 5 We'll be interested in examining the way (f) changes as we move ~ in a particular direction 0 from a point X to a nearby point . z -5 -2 0 y 2 Figure 2: f(x; y) = x2 y2 − y If we give the direction by using a second vector, say ~u, then for →u X→ + h any real number h, the vector X~ + h~u represents a change in X→ position from X~ along a line through X~ parallel to ~u. →u →u h x Figure 3: Change in position along line parallel to ~u The Directional Derivative x -2 0 2 5 We'll be interested in examining the way (f) changes as we move ~ in a particular direction 0 from a point X to a nearby point .
    [Show full text]
  • Vector Calculus and Multiple Integrals Rob Fender, HT 2018
    Vector Calculus and Multiple Integrals Rob Fender, HT 2018 COURSE SYNOPSIS, RECOMMENDED BOOKS Course syllabus (on which exams are based): Double integrals and their evaluation by repeated integration in Cartesian, plane polar and other specified coordinate systems. Jacobians. Line, surface and volume integrals, evaluation by change of variables (Cartesian, plane polar, spherical polar coordinates and cylindrical coordinates only unless the transformation to be used is specified). Integrals around closed curves and exact differentials. Scalar and vector fields. The operations of grad, div and curl and understanding and use of identities involving these. The statements of the theorems of Gauss and Stokes with simple applications. Conservative fields. Recommended Books: Mathematical Methods for Physics and Engineering (Riley, Hobson and Bence) This book is lazily referred to as “Riley” throughout these notes (sorry, Drs H and B) You will all have this book, and it covers all of the maths of this course. However it is rather terse at times and you will benefit from looking at one or both of these: Introduction to Electrodynamics (Griffiths) You will buy this next year if you haven’t already, and the chapter on vector calculus is very clear Div grad curl and all that (Schey) A nice discussion of the subject, although topics are ordered differently to most courses NB: the latest version of this book uses the opposite convention to polar coordinates to this course (and indeed most of physics), but older versions can often be found in libraries 1 Week One A review of vectors, rotation of coordinate systems, vector vs scalar fields, integrals in more than one variable, first steps in vector differentiation, the Frenet-Serret coordinate system Lecture 1 Vectors A vector has direction and magnitude and is written in these notes in bold e.g.
    [Show full text]
  • Symmetry and Tensors Rotations and Tensors
    Symmetry and tensors Rotations and tensors A rotation of a 3-vector is accomplished by an orthogonal transformation. Represented as a matrix, A, we replace each vector, v, by a rotated vector, v0, given by multiplying by A, 0 v = Av In index notation, 0 X vm = Amnvn n Since a rotation must preserve lengths of vectors, we require 02 X 0 0 X 2 v = vmvm = vmvm = v m m Therefore, X X 0 0 vmvm = vmvm m m ! ! X X X = Amnvn Amkvk m n k ! X X = AmnAmk vnvk k;n m Since xn is arbitrary, this is true if and only if X AmnAmk = δnk m t which we can rewrite using the transpose, Amn = Anm, as X t AnmAmk = δnk m In matrix notation, this is t A A = I where I is the identity matrix. This is equivalent to At = A−1. Multi-index objects such as matrices, Mmn, or the Levi-Civita tensor, "ijk, have definite transformation properties under rotations. We call an object a (rotational) tensor if each index transforms in the same way as a vector. An object with no indices, that is, a function, does not transform at all and is called a scalar. 0 A matrix Mmn is a (second rank) tensor if and only if, when we rotate vectors v to v , its new components are given by 0 X Mmn = AmjAnkMjk jk This is what we expect if we imagine Mmn to be built out of vectors as Mmn = umvn, for example. In the same way, we see that the Levi-Civita tensor transforms as 0 X "ijk = AilAjmAkn"lmn lmn 1 Recall that "ijk, because it is totally antisymmetric, is completely determined by only one of its components, say, "123.
    [Show full text]
  • A Brief Tour of Vector Calculus
    A BRIEF TOUR OF VECTOR CALCULUS A. HAVENS Contents 0 Prelude ii 1 Directional Derivatives, the Gradient and the Del Operator 1 1.1 Conceptual Review: Directional Derivatives and the Gradient........... 1 1.2 The Gradient as a Vector Field............................ 5 1.3 The Gradient Flow and Critical Points ....................... 10 1.4 The Del Operator and the Gradient in Other Coordinates*............ 17 1.5 Problems........................................ 21 2 Vector Fields in Low Dimensions 26 2 3 2.1 General Vector Fields in Domains of R and R . 26 2.2 Flows and Integral Curves .............................. 31 2.3 Conservative Vector Fields and Potentials...................... 32 2.4 Vector Fields from Frames*.............................. 37 2.5 Divergence, Curl, Jacobians, and the Laplacian................... 41 2.6 Parametrized Surfaces and Coordinate Vector Fields*............... 48 2.7 Tangent Vectors, Normal Vectors, and Orientations*................ 52 2.8 Problems........................................ 58 3 Line Integrals 66 3.1 Defining Scalar Line Integrals............................. 66 3.2 Line Integrals in Vector Fields ............................ 75 3.3 Work in a Force Field................................. 78 3.4 The Fundamental Theorem of Line Integrals .................... 79 3.5 Motion in Conservative Force Fields Conserves Energy .............. 81 3.6 Path Independence and Corollaries of the Fundamental Theorem......... 82 3.7 Green's Theorem.................................... 84 3.8 Problems........................................ 89 4 Surface Integrals, Flux, and Fundamental Theorems 93 4.1 Surface Integrals of Scalar Fields........................... 93 4.2 Flux........................................... 96 4.3 The Gradient, Divergence, and Curl Operators Via Limits* . 103 4.4 The Stokes-Kelvin Theorem..............................108 4.5 The Divergence Theorem ...............................112 4.6 Problems........................................114 List of Figures 117 i 11/14/19 Multivariate Calculus: Vector Calculus Havens 0.
    [Show full text]
  • Notes for Math 136: Review of Calculus
    Notes for Math 136: Review of Calculus Gyu Eun Lee These notes were written for my personal use for teaching purposes for the course Math 136 running in the Spring of 2016 at UCLA. They are also intended for use as a general calculus reference for this course. In these notes we will briefly review the results of the calculus of several variables most frequently used in partial differential equations. The selection of topics is inspired by the list of topics given by Strauss at the end of section 1.1, but we will not cover everything. Certain topics are covered in the Appendix to the textbook, and we will not deal with them here. The results of single-variable calculus are assumed to be familiar. Practicality, not rigor, is the aim. This document will be updated throughout the quarter as we encounter material involving additional topics. We will focus on functions of two real variables, u = u(x;t). Most definitions and results listed will have generalizations to higher numbers of variables, and we hope the generalizations will be reasonably straightforward to the reader if they become necessary. Occasionally (notably for the chain rule in its many forms) it will be convenient to work with functions of an arbitrary number of variables. We will be rather loose about the issues of differentiability and integrability: unless otherwise stated, we will assume all derivatives and integrals exist, and if we require it we will assume derivatives are continuous up to the required order. (This is also generally the assumption in Strauss.) 1 Differential calculus of several variables 1.1 Partial derivatives Given a scalar function u = u(x;t) of two variables, we may hold one of the variables constant and regard it as a function of one variable only: vx(t) = u(x;t) = wt(x): Then the partial derivatives of u with respect of x and with respect to t are defined as the familiar derivatives from single variable calculus: ¶u dv ¶u dw = x ; = t : ¶t dt ¶x dx c 2016, Gyu Eun Lee.
    [Show full text]
  • Multivariable and Vector Calculus
    Multivariable and Vector Calculus Lecture Notes for MATH 0200 (Spring 2015) Frederick Tsz-Ho Fong Department of Mathematics Brown University Contents 1 Three-Dimensional Space ....................................5 1.1 Rectangular Coordinates in R3 5 1.2 Dot Product7 1.3 Cross Product9 1.4 Lines and Planes 11 1.5 Parametric Curves 13 2 Partial Differentiations ....................................... 19 2.1 Functions of Several Variables 19 2.2 Partial Derivatives 22 2.3 Chain Rule 26 2.4 Directional Derivatives 30 2.5 Tangent Planes 34 2.6 Local Extrema 36 2.7 Lagrange’s Multiplier 41 2.8 Optimizations 46 3 Multiple Integrations ........................................ 49 3.1 Double Integrals in Rectangular Coordinates 49 3.2 Fubini’s Theorem for General Regions 53 3.3 Double Integrals in Polar Coordinates 57 3.4 Triple Integrals in Rectangular Coordinates 62 3.5 Triple Integrals in Cylindrical Coordinates 67 3.6 Triple Integrals in Spherical Coordinates 70 4 Vector Calculus ............................................ 75 4.1 Vector Fields on R2 and R3 75 4.2 Line Integrals of Vector Fields 83 4.3 Conservative Vector Fields 88 4.4 Green’s Theorem 98 4.5 Parametric Surfaces 105 4.6 Stokes’ Theorem 120 4.7 Divergence Theorem 127 5 Topics in Physics and Engineering .......................... 133 5.1 Coulomb’s Law 133 5.2 Introduction to Maxwell’s Equations 137 5.3 Heat Diffusion 141 5.4 Dirac Delta Functions 144 1 — Three-Dimensional Space 1.1 Rectangular Coordinates in R3 Throughout the course, we will use an ordered triple (x, y, z) to represent a point in the three dimensional space.
    [Show full text]
  • Vector Fields
    Vector Calculus Independent Study Unit 5: Vector Fields A vector field is a function which associates a vector to every point in space. Vector fields are everywhere in nature, from the wind (which has a velocity vector at every point) to gravity (which, in the simplest interpretation, would exert a vector force at on a mass at every point) to the gradient of any scalar field (for example, the gradient of the temperature field assigns to each point a vector which says which direction to travel if you want to get hotter fastest). In this section, you will learn the following techniques and topics: • How to graph a vector field by picking lots of points, evaluating the field at those points, and then drawing the resulting vector with its tail at the point. • A flow line for a velocity vector field is a path ~σ(t) that satisfies ~σ0(t)=F~(~σ(t)) For example, a tiny speck of dust in the wind follows a flow line. If you have an acceleration vector field, a flow line path satisfies ~σ00(t)=F~(~σ(t)) [For example, a tiny comet being acted on by gravity.] • Any vector field F~ which is equal to ∇f for some f is called a con- servative vector field, and f its potential. The terminology comes from physics; by the fundamental theorem of calculus for work in- tegrals, the work done by moving from one point to another in a conservative vector field doesn’t depend on the path and is simply the difference in potential at the two points.
    [Show full text]
  • Tensor Calculus and Differential Geometry
    Course Notes Tensor Calculus and Differential Geometry 2WAH0 Luc Florack March 10, 2021 Cover illustration: papyrus fragment from Euclid’s Elements of Geometry, Book II [8]. Contents Preface iii Notation 1 1 Prerequisites from Linear Algebra 3 2 Tensor Calculus 7 2.1 Vector Spaces and Bases . .7 2.2 Dual Vector Spaces and Dual Bases . .8 2.3 The Kronecker Tensor . 10 2.4 Inner Products . 11 2.5 Reciprocal Bases . 14 2.6 Bases, Dual Bases, Reciprocal Bases: Mutual Relations . 16 2.7 Examples of Vectors and Covectors . 17 2.8 Tensors . 18 2.8.1 Tensors in all Generality . 18 2.8.2 Tensors Subject to Symmetries . 22 2.8.3 Symmetry and Antisymmetry Preserving Product Operators . 24 2.8.4 Vector Spaces with an Oriented Volume . 31 2.8.5 Tensors on an Inner Product Space . 34 2.8.6 Tensor Transformations . 36 2.8.6.1 “Absolute Tensors” . 37 CONTENTS i 2.8.6.2 “Relative Tensors” . 38 2.8.6.3 “Pseudo Tensors” . 41 2.8.7 Contractions . 43 2.9 The Hodge Star Operator . 43 3 Differential Geometry 47 3.1 Euclidean Space: Cartesian and Curvilinear Coordinates . 47 3.2 Differentiable Manifolds . 48 3.3 Tangent Vectors . 49 3.4 Tangent and Cotangent Bundle . 50 3.5 Exterior Derivative . 51 3.6 Affine Connection . 52 3.7 Lie Derivative . 55 3.8 Torsion . 55 3.9 Levi-Civita Connection . 56 3.10 Geodesics . 57 3.11 Curvature . 58 3.12 Push-Forward and Pull-Back . 59 3.13 Examples . 60 3.13.1 Polar Coordinates in the Euclidean Plane .
    [Show full text]
  • Introduction to a Line Integral of a Vector Field Math Insight
    Introduction to a Line Integral of a Vector Field Math Insight A line integral (sometimes called a path integral) is the integral of some function along a curve. One can integrate a scalar-valued function1 along a curve, obtaining for example, the mass of a wire from its density. One can also integrate a certain type of vector-valued functions along a curve. These vector-valued functions are the ones where the input and output dimensions are the same, and we usually represent them as vector fields2. One interpretation of the line integral of a vector field is the amount of work that a force field does on a particle as it moves along a curve. To illustrate this concept, we return to the slinky example3 we used to introduce arc length. Here, our slinky will be the helix parameterized4 by the function c(t)=(cost,sint,t/(3π)), for 0≤t≤6π, Imagine that you put a small-magnetized bead on your slinky (the bead has a small hole in it, so it can slide along the slinky). Next, imagine that you put a large magnet to the left of the slink, as shown by the large green square in the below applet. The magnet will induce a magnetic field F(x,y,z), shown by the green arrows. Particle on helix with magnet. The red helix is parametrized by c(t)=(cost,sint,t/(3π)), for 0≤t≤6π. For a given value of t (changed by the blue point on the slider), the magenta point represents a magnetic bead at point c(t).
    [Show full text]
  • Calculus Terminology
    AP Calculus BC Calculus Terminology Absolute Convergence Asymptote Continued Sum Absolute Maximum Average Rate of Change Continuous Function Absolute Minimum Average Value of a Function Continuously Differentiable Function Absolutely Convergent Axis of Rotation Converge Acceleration Boundary Value Problem Converge Absolutely Alternating Series Bounded Function Converge Conditionally Alternating Series Remainder Bounded Sequence Convergence Tests Alternating Series Test Bounds of Integration Convergent Sequence Analytic Methods Calculus Convergent Series Annulus Cartesian Form Critical Number Antiderivative of a Function Cavalieri’s Principle Critical Point Approximation by Differentials Center of Mass Formula Critical Value Arc Length of a Curve Centroid Curly d Area below a Curve Chain Rule Curve Area between Curves Comparison Test Curve Sketching Area of an Ellipse Concave Cusp Area of a Parabolic Segment Concave Down Cylindrical Shell Method Area under a Curve Concave Up Decreasing Function Area Using Parametric Equations Conditional Convergence Definite Integral Area Using Polar Coordinates Constant Term Definite Integral Rules Degenerate Divergent Series Function Operations Del Operator e Fundamental Theorem of Calculus Deleted Neighborhood Ellipsoid GLB Derivative End Behavior Global Maximum Derivative of a Power Series Essential Discontinuity Global Minimum Derivative Rules Explicit Differentiation Golden Spiral Difference Quotient Explicit Function Graphic Methods Differentiable Exponential Decay Greatest Lower Bound Differential
    [Show full text]
  • Matrix Calculus
    Appendix D Matrix Calculus From too much study, and from extreme passion, cometh madnesse. Isaac Newton [205, §5] − D.1 Gradient, Directional derivative, Taylor series D.1.1 Gradients Gradient of a differentiable real function f(x) : RK R with respect to its vector argument is defined uniquely in terms of partial derivatives→ ∂f(x) ∂x1 ∂f(x) , ∂x2 RK f(x) . (2053) ∇ . ∈ . ∂f(x) ∂xK while the second-order gradient of the twice differentiable real function with respect to its vector argument is traditionally called the Hessian; 2 2 2 ∂ f(x) ∂ f(x) ∂ f(x) 2 ∂x1 ∂x1∂x2 ··· ∂x1∂xK 2 2 2 ∂ f(x) ∂ f(x) ∂ f(x) 2 2 K f(x) , ∂x2∂x1 ∂x2 ··· ∂x2∂xK S (2054) ∇ . ∈ . .. 2 2 2 ∂ f(x) ∂ f(x) ∂ f(x) 2 ∂xK ∂x1 ∂xK ∂x2 ∂x ··· K interpreted ∂f(x) ∂f(x) 2 ∂ ∂ 2 ∂ f(x) ∂x1 ∂x2 ∂ f(x) = = = (2055) ∂x1∂x2 ³∂x2 ´ ³∂x1 ´ ∂x2∂x1 Dattorro, Convex Optimization Euclidean Distance Geometry, Mεβoo, 2005, v2020.02.29. 599 600 APPENDIX D. MATRIX CALCULUS The gradient of vector-valued function v(x) : R RN on real domain is a row vector → v(x) , ∂v1(x) ∂v2(x) ∂vN (x) RN (2056) ∇ ∂x ∂x ··· ∂x ∈ h i while the second-order gradient is 2 2 2 2 , ∂ v1(x) ∂ v2(x) ∂ vN (x) RN v(x) 2 2 2 (2057) ∇ ∂x ∂x ··· ∂x ∈ h i Gradient of vector-valued function h(x) : RK RN on vector domain is → ∂h1(x) ∂h2(x) ∂hN (x) ∂x1 ∂x1 ··· ∂x1 ∂h1(x) ∂h2(x) ∂hN (x) h(x) , ∂x2 ∂x2 ··· ∂x2 ∇ .
    [Show full text]
  • Math 1320-9 Notes of 3/30/20 11.6 Directional Derivatives and Gradients
    Math 1320-9 Notes of 3/30/20 11.6 Directional Derivatives and Gradients • Recall our definitions: f(x0 + h; y0) − f(x0; y0) fx(x0; y0) = lim h−!0 h f(x0; y0 + h) − f(x0; y0) and fy(x0; y0) = lim h−!0 h • You can think of these definitions in several ways, e.g., − You keep all but one variable fixed, and differentiate with respect to the one special variable. − You restrict the function to a line whose direction vector is one of the standard basis vectors, and differentiate that restriction with respect to the corresponding variable. • In the case of fx we move in the direction of < 1; 0 >, and in the case of fy, we move in the direction for < 0; 1 >. Math 1320-9 Notes of 3/30/20 page 1 How about doing the same thing in the direction of some other unit vector u =< a; b >; say. • We define: The directional derivative of f at (x0; y0) in the direc- tion of the (unit) vector u is f(x0 + ha; y0 + hb) − f(x0; y0) Duf(x0; y0) = lim h−!0 h (if this limit exists). • Thus we restrict the function f to the line (x0; y0) + tu, think of it as a function g(t) = f(x0 + ta; y0 + tb); and compute g0(t). • But, by the chain rule, d f(x + ta; y + tb) = f (x ; y )a + f (x ; y )b dt 0 0 x 0 0 y 0 0 =< fx(x0; y0); fy(x0; y0) > · < a; b > • Thus we can compute the directional derivatives by the formula Duf(x0; y0) =< fx(x0; y0); fy(x0; y0) > · < a; b > : • Of course, the partial derivatives @=@x and @=@y are just directional derivatives in the directions i =< 0; 1 > and j =< 0; 1 >, respectively.
    [Show full text]