DOCSLIB.ORG

Differential Calculus of Several Variables

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Differential Calculus of Several Variables Differential Calculus of Several Variables David Perkinson Abstract. These are notes for a one semester course in the differential calculus of several variables. The first two chapters are a quick introduction to the derivative as the best affine approximation to a function at a point, calculated via the Jacobian matrix. Chapters 3 and 4 add the details and rigor. Chapter 5 is the basic theory of optimization: the gradient, the extreme value theorem, quadratic forms, the Hessian matrix, and Lagrange multipliers. Studying quadratic forms also gives an excuse for presenting Taylor’s theorem. Chapter 6 is an introduction to differential geometry. We start with a parametrization inducing a metric on its domain, but then show that a metric can be defined intrinsically via a first fundamental form. The chapter concludes with a discussion of geodesics. An appendix presents (without proof) three equivalent theorems: the inverse function theorem, the implicit function theorem, and a theorem about maps of constant rank. Version: January 31, 2008 Contents Chapter 1. Introduction 1 1. A first example 1 § 2. Calculating the derivative 6 § 3. Conclusion 13 § Chapter 2. Multivariate functions 17 1. Function basics 17 § 2. Interpreting functions 19 § 3. Conclusion 31 § Chapter 3. Linear algebra 35 1. Linear structure 35 § 2. Metric structure 37 § 3. Linear subspaces 43 § 4. Linear functions 49 § 5. Conclusion 57 § Chapter 4. The derivative 65 1. Introduction 65 § 2. Topology 65 § 3. Limits, continuity 68 § 4. The definition of the derivative 70 § 5. The best affine approximation revisited 72 § 6. The chain rule 73 § 7. Partial derivatives 77 § 8. ThederivativeisgivenbytheJacobianmatrix 79 § 9. Conclusion 83 § Chapter 5. Optimization 89 1. Introduction 89 § iii iv Contents 2. Directional derivatives and the gradient 89 § 3. Taylor’s theorem 92 § 4. Maxima and minima 97 § 5. The Hessian 106 § Chapter 6. Some Differential Geometry 115 1. Stretching 115 § 2. First Fundamental Form 116 § 3. Metrics 119 § 4. Lengths of curves 120 § 5. Geodesics 122 § Appendix A. Set notation 133 Appendix B. Real numbers 137 1. Field axioms 137 § 2. Order axioms 138 § 3. Least upper bound property 138 § 4. Interval notation 139 § Appendix C. Maps of Constant Rank 141 Appendix. Index 145 Chapter 1 Introduction The main point of differential calculus is to replace curvy things with flat things: to approx- imate complicated functions with linear functions. For example, in one variable calculus, one approximates the graph of a function using a tangent line: 4 2 -2 -1 1 2 0 x In the illustration above, the function g(x)= x2 is replaced by the simpler function ℓ(x)= 2x 1, a good approximation near the point x = 1. We begin these notes with an analogous − example from multivariable calculus. 1. A first example Consider the function f(u,v)=(u2 + v,uv). It takes a point (u,v) in the plane and hands back another point, (u2 + v,uv). For example, f(2, 3) = (22 + 3, 2 3) = (7, 6). · Our first task is to produce a picture of f. In one variable calculus, one usually pictures a function by drawing its graph. For example, one thinks of the function g(x) = x2 as a parabola by drawing points of the form (x,x2). If we try the same for our function, we 1 2 1. Introduction would need to draw points of the form (u,v,u2+v,uv), which would require four dimensions. Further, in some sense, the graph of f is the simplest geometric realization of f: it contains exactly the information necessary to picture f, and no more. Thus, as usual in multivariate calculus, we are forced to picture an object that naturally exists in a space of dimension higher than three. There are several ways of dealing with the problem of picturing objects involving too many dimensions, and in practice functions such as f arise in a context that suggests a particular approach. We will start with one important point of view. Suppose we want to picture f for u and v in the interval [0, 1]∗, so the points (u,v) lie in a unit square in the plane. Think of this unit square as a thin sheet of putty, and think of the function f as a set of instructions for stretching the putty into a new shape. For example, the point 2 1 1 (1, 1) is stretched out to the point f(1, 1) = (1 + 1, 1 1) = (2, 1); the point ( 2 , 2 ) moves 1 1 3 1 · to f( 2 , 2 )=( 4 , 4 ); the origin, (0, 0), remains fixed, f(0, 0) = (0, 0). The motion of these points and a few others is shown below. f (1,1) (2,1) (0,1/2) (1/2,1/2) (3/4,1/4) (1/2,0) (0,0) (1/2,0) (0,0) (1/4,0) Our goal is to see where every point in the unit square is moved by f. To start, consider what happens to the boundary of the square: bottom edge. The bottom edge of the square consists of points of the form (u, 0) as u varies from 0 to 1. Applying f gives f(u, 0)=(u2 + 0,u 0)=(u2, 0). · So as a point moves along the bottom edge at a constant unit speed from (0, 0) to (1, 0), its image under f moves between the same two points, moving slowly at first, then more and more quickly, (velocity = 2u). right edge. The right edge consists of points of the form (1,v), and f(1,v) = (1+ v,v); the image is a line segment starting at (1, 0) when v = 0 and ending at (2, 1) when v = 1. top edge. Points along the top have the form (u, 1), and f(u, 1) = (u2 + 1,u). Calling the first and second coordinates x and y, we have x = u2 +1 and y = u. Thus, points in the image of the top edge satisfy the equation x = y2 + 1, forming a parabolic arc from (2, 1) to (1, 0) as we travel from right to left along the top edge of the square. ∗[0, 1] denotes the real numbers between 0 and 1, including the endpoints. For a reminder on interval notation, see Appendix B. 1. A first example 3 left edge. Points on the left edge have the form (0,v), and f(0,v) = (v, 0). Thus, we can picture f as flipping the left edge over a 45◦ line, placing it along the bottom edge. The following picture summarizes what f does to the boundary of the unit square: 3 3 f 4 2 2 1 1 4 We now want to figure out what is happening to the interior of the square. Considering what happens to the boundary, it seems that f is taking our unit square of putty, folding it along a diagonal, more or less, and lining up the left edge with the bottom edge. To get more information, draw a square grid of lines on the unit square, and plot the images of each of these lines under f. A vertical line, a distance c from the origin, will consist of points of the form (c,v) with v varying, and f will send these points to points of the form f(c,v)=(c2 + v,cv). The image is a line passing through (c2, 0) when v = 0, and (c2 + 1,c) when v = 1. A horizontal line at height c will consist of points of the form (u,c) which are sent by f to points of the form f(u,c)=(u2 + c,uc) lying on a parabolic arc connecting (c, 0) to (1+ c,c). The following picture shows the image of a grid under f: 1 1 0.8 0.6 0.5 f 0.4 0.2 0 0.5 1 0 0.5 1 1.5 2 You should be starting to see that multivariate functions are more interesting than the functions one meets in one variable calculus. Even though f involves only a few very simple terms, its geometry is fairly complicated. Differential calculus provides one main tool for dealing with this complexity: it shows how to approximate a function with a simpler type of function, namely, a linear function. We will give a rigorous definition of a linear function later (cf. page 49). For now, it is enough to know that we can easily analyze a linear function; there is no mystery to its geometry. The image of a square grid under a linear function is always a parallelogram; the image of a grid will be a grid of parallelograms. To be more precise, consider the function f. Given a point p in the unit square, differ- ential calculus will give us a linear function that closely approximates f provided we stay near the point p. (Given a different point, calculus will provide a different linear function.) 1 3 To illustrate the idea, take the point p = ( 4 , 4 ). The linear function provided by calculus turns out to be: 1 3 1 L(u,v)=( u + v, u + v). 2 4 4 4 1. Introduction (To spoil a secret, read the footnote.†) To picture L, consider the image of a unit square. The function L acts on the vertices 1 3 3 1 as follows: L(0, 0) = (0, 0), L(1, 0) = ( 2 , 4 ), L(1, 1) = ( 2 , 1), and L(0, 1) = (1, 4 ). It turns out that linear functions always send lines to lines; hence we can see how L acts on the boundary of the unit square: 3 2 L 4 2 1 3 4 1 The function L stretches, skews, and flips the unit square.
Load more

Recommended publications
  • Parametric Surfaces and 16.6 Their Areas Parametric Surfaces
    Parametric Surfaces and 16.6 Their Areas Parametric Surfaces 2 Parametric Surfaces Similarly to describing a space curve by a vector function r(t) of a single parameter t, a surface can be expressed by a vector function r(u, v) of two parameters u and v. Suppose r(u, v) = x(u, v)i + y(u, v)j + z(u, v)k is a vector-valued function defined on a region D in the uv-plane. So x, y, and, z, the component functions of r, are functions of the two variables u and v with domain D. The set of all points (x, y, z) in R3 s.t. x = x(u, v), y = y(u, v), z = z(u, v) and (u, v) varies throughout D, is called a parametric surface S. Typical surfaces: Cylinders, spheres, quadric surfaces, etc. 3 Example 3 – Important From Book The vector equation of a plane through (x0, y0, z0) and containing vectors is rather 4 Example – Point on Surface? Does the point (2, 3, 3) lie on the given surface? How about (1, 2, 1)? 5 Example – Identify the Surface Identify the surface with the given vector equation. 6 Example – Identify the Surface Identify the surface with the given vector equation. 7 Example – Find a Parametric Equation The part of the hyperboloid –x2 – y2 + z = 1 that lies below the rectangle [–1, 1] X [–3, 3]. 8 Example – Find a Parametric Equation The part of the cylinder x2 + z2 = 1 that lies between the planes y = 1 and y = 3. 9 Example – Find a Parametric Equation Part of the plane z = 5 that lies inside the cylinder x2 + y2 = 16.
    [Show full text]
  • The Mean Value Theorem Math 120 Calculus I Fall 2015
    The Mean Value Theorem Math 120 Calculus I Fall 2015 The central theorem to much of differential calculus is the Mean Value Theorem, which we'll abbreviate MVT. It is the theoretical tool used to study the first and second derivatives. There is a nice logical sequence of connections here. It starts with the Extreme Value Theorem (EVT) that we looked at earlier when we studied the concept of continuity. It says that any function that is continuous on a closed interval takes on a maximum and a minimum value. A technical lemma. We begin our study with a technical lemma that allows us to relate 0 the derivative of a function at a point to values of the function nearby. Specifically, if f (x0) is positive, then for x nearby but smaller than x0 the values f(x) will be less than f(x0), but for x nearby but larger than x0, the values of f(x) will be larger than f(x0). This says something like f is an increasing function near x0, but not quite. An analogous statement 0 holds when f (x0) is negative. Proof. The proof of this lemma involves the definition of derivative and the definition of limits, but none of the proofs for the rest of the theorems here require that depth. 0 Suppose that f (x0) = p, some positive number. That means that f(x) − f(x ) lim 0 = p: x!x0 x − x0 f(x) − f(x0) So you can make arbitrarily close to p by taking x sufficiently close to x0.
    [Show full text]
  • Optimization and Gradient Descent INFO-4604, Applied Machine Learning University of Colorado Boulder
    Optimization and Gradient Descent INFO-4604, Applied Machine Learning University of Colorado Boulder September 11, 2018 Prof. Michael Paul Prediction Functions Remember: a prediction function is the function that predicts what the output should be, given the input. Prediction Functions Linear regression: f(x) = wTx + b Linear classification (perceptron): f(x) = 1, wTx + b ≥ 0 -1, wTx + b < 0 Need to learn what w should be! Learning Parameters Goal is to learn to minimize error • Ideally: true error • Instead: training error The loss function gives the training error when using parameters w, denoted L(w). • Also called cost function • More general: objective function (in general objective could be to minimize or maximize; with loss/cost functions, we want to minimize) Learning Parameters Goal is to minimize loss function. How do we minimize a function? Let’s review some math. Rate of Change The slope of a line is also called the rate of change of the line. y = ½x + 1 “rise” “run” Rate of Change For nonlinear functions, the “rise over run” formula gives you the average rate of change between two points Average slope from x=-1 to x=0 is: 2 f(x) = x -1 Rate of Change There is also a concept of rate of change at individual points (rather than two points) Slope at x=-1 is: f(x) = x2 -2 Rate of Change The slope at a point is called the derivative at that point Intuition: f(x) = x2 Measure the slope between two points that are really close together Rate of Change The slope at a point is called the derivative at that point Intuition: Measure the
    [Show full text]
  • Multivariable and Vector Calculus
    Multivariable and Vector Calculus Lecture Notes for MATH 0200 (Spring 2015) Frederick Tsz-Ho Fong Department of Mathematics Brown University Contents 1 Three-Dimensional Space ....................................5 1.1 Rectangular Coordinates in R3 5 1.2 Dot Product7 1.3 Cross Product9 1.4 Lines and Planes 11 1.5 Parametric Curves 13 2 Partial Differentiations ....................................... 19 2.1 Functions of Several Variables 19 2.2 Partial Derivatives 22 2.3 Chain Rule 26 2.4 Directional Derivatives 30 2.5 Tangent Planes 34 2.6 Local Extrema 36 2.7 Lagrange’s Multiplier 41 2.8 Optimizations 46 3 Multiple Integrations ........................................ 49 3.1 Double Integrals in Rectangular Coordinates 49 3.2 Fubini’s Theorem for General Regions 53 3.3 Double Integrals in Polar Coordinates 57 3.4 Triple Integrals in Rectangular Coordinates 62 3.5 Triple Integrals in Cylindrical Coordinates 67 3.6 Triple Integrals in Spherical Coordinates 70 4 Vector Calculus ............................................ 75 4.1 Vector Fields on R2 and R3 75 4.2 Line Integrals of Vector Fields 83 4.3 Conservative Vector Fields 88 4.4 Green’s Theorem 98 4.5 Parametric Surfaces 105 4.6 Stokes’ Theorem 120 4.7 Divergence Theorem 127 5 Topics in Physics and Engineering .......................... 133 5.1 Coulomb’s Law 133 5.2 Introduction to Maxwell’s Equations 137 5.3 Heat Diffusion 141 5.4 Dirac Delta Functions 144 1 — Three-Dimensional Space 1.1 Rectangular Coordinates in R3 Throughout the course, we will use an ordered triple (x, y, z) to represent a point in the three dimensional space.
    [Show full text]
  • Math 1300 Section 4.8: Parametric Equations A
    MATH 1300 SECTION 4.8: PARAMETRIC EQUATIONS A parametric equation is a collection of equations x = x(t) y = y(t) that gives the variables x and y as functions of a parameter t. Any real number t then corresponds to a point in the xy-plane given by the coordi- nates (x(t); y(t)). If we think about the parameter t as time, then we can interpret t = 0 as the point where we start, and as t increases, the parametric equation traces out a curve in the plane, which we will call a parametric curve. (x(t); y(t)) • The result is that we can \draw" curves just like an Etch-a-sketch! animated parametric circle from wolfram Date: 11/06. 1 4.8 2 Let's consider an example. Suppose we have the following parametric equation: x = cos(t) y = sin(t) We know from the pythagorean theorem that this parametric equation satisfies the relation x2 + y2 = 1 , so we see that as t varies over the real numbers we will trace out the unit circle! Lets look at the curve that is drawn for 0 ≤ t ≤ π. Just picking a few values we can observe that this parametric equation parametrizes the upper semi-circle in a counter clockwise direction. (0; 1) • t x(t) y(t) 0 1 0 p p π 2 2 •(1; 0) 4 2 2 π 2 0 1 π -1 0 Looking at the curve traced out over any interval of time longer that 2π will indeed trace out the entire circle.
    [Show full text]
  • Parametric Curves You Should Know
    Parametric Curves You Should Know Straight Lines Let a and c be constants which are not both zero. Then the parametric equations determining the straight line passing through (b; d) with slope c=a (i.e., the line y − d = c=a(x − b)) are: x(t) = at + b ; −∞ < t < 1: y(t) = ct + d Note that when c = 0, the line is horizontal of the form y = d, and when a = 0, the line is vertical of the form x = b. 15 10 x(t)= 2t+ 3, y(t)=t+4 5 x(t)=3-2t, y(t)= 2t+1 �������� x(t)=t+ 2, y(t)=3- 3t x(t)= 3, y(t)=2+ 3t -10 -5 5 10 15 x(t)=2+3t, y(t)=3 -5 -10 Figure 1 A collection of lines whose parametric equations are given as above. Circles Let r > 0 and let x0 and y0 be real numbers. Then the parametric equations determining the circle of radius r centered at (x0; y0) are: x(t) = r cos t + x 0 ; 0 < t < 2π: (1) y(t) = r sin t + y0 To get a circular arc instead of the full circle, restrict the t-values in (1) to t1 < t < t2. 1 1 1 2 3 4 5 2 3 4 5 (3,-1) -1 -1 (3,-1) -2 -2 -3 -3 (a) 0 ≤ t ≤ 2π (b) π=4 ≤ t ≤ 7π=6 Figure 2 The circle x(t) = 2 cos t + 3, y(t) = 2 sin t − 1 and a circular arc thereof. Note that the center is at (3; 1).
    [Show full text]
  • Polynomial Curves and Surfaces
    Polynomial Curves and Surfaces Chandrajit Bajaj and Andrew Gillette September 8, 2010 Contents 1 What is an Algebraic Curve or Surface? 2 1.1 Algebraic Curves . .3 1.2 Algebraic Surfaces . .3 2 Singularities and Extreme Points 4 2.1 Singularities and Genus . .4 2.2 Parameterizing with a Pencil of Lines . .6 2.3 Parameterizing with a Pencil of Curves . .7 2.4 Algebraic Space Curves . .8 2.5 Faithful Parameterizations . .9 3 Triangulation and Display 10 4 Polynomial and Power Basis 10 5 Power Series and Puiseux Expansions 11 5.1 Weierstrass Factorization . 11 5.2 Hensel Lifting . 11 6 Derivatives, Tangents, Curvatures 12 6.1 Curvature Computations . 12 6.1.1 Curvature Formulas . 12 6.1.2 Derivation . 13 7 Converting Between Implicit and Parametric Forms 20 7.1 Parameterization of Curves . 21 7.1.1 Parameterizing with lines . 24 7.1.2 Parameterizing with Higher Degree Curves . 26 7.1.3 Parameterization of conic, cubic plane curves . 30 7.2 Parameterization of Algebraic Space Curves . 30 7.3 Automatic Parametrization of Degree 2 Curves and Surfaces . 33 7.3.1 Conics . 34 7.3.2 Rational Fields . 36 7.4 Automatic Parametrization of Degree 3 Curves and Surfaces . 37 7.4.1 Cubics . 38 7.4.2 Cubicoids . 40 7.5 Parameterizations of Real Cubic Surfaces . 42 7.5.1 Real and Rational Points on Cubic Surfaces . 44 7.5.2 Algebraic Reduction . 45 1 7.5.3 Parameterizations without Real Skew Lines . 49 7.5.4 Classification and Straight Lines from Parametric Equations . 52 7.5.5 Parameterization of general algebraic plane curves by A-splines .
    [Show full text]
  • Maxima and Minima
    Basic Mathematics Maxima and Minima R Horan & M Lavelle The aim of this document is to provide a short, self assessment programme for students who wish to be able to use differentiation to find maxima and mininima of functions. Copyright c 2004 [email protected] , [email protected] Last Revision Date: May 5, 2005 Version 1.0 Table of Contents 1. Rules of Differentiation 2. Derivatives of order 2 (and higher) 3. Maxima and Minima 4. Quiz on Max and Min Solutions to Exercises Solutions to Quizzes Section 1: Rules of Differentiation 3 1. Rules of Differentiation Throughout this package the following rules of differentiation will be assumed. (In the table of derivatives below, a is an arbitrary, non-zero constant.) y axn sin(ax) cos(ax) eax ln(ax) dy 1 naxn−1 a cos(ax) −a sin(ax) aeax dx x If a is any constant and u, v are two functions of x, then d du dv (u + v) = + dx dx dx d du (au) = a dx dx Section 1: Rules of Differentiation 4 The stationary points of a function are those points where the gradient of the tangent (the derivative of the function) is zero. Example 1 Find the stationary points of the functions (a) f(x) = 3x2 + 2x − 9 , (b) f(x) = x3 − 6x2 + 9x − 2 . Solution dy (a) If y = 3x2 + 2x − 9 then = 3 × 2x2−1 + 2 = 6x + 2. dx The stationary points are found by solving the equation dy = 6x + 2 = 0 . dx In this case there is only one solution, x = −1/3.
    [Show full text]
  • Lecture 1: Explicit, Implicit and Parametric Equations
    4.0 3.5 f(x+h) 3.0 Q 2.5 2.0 Lecture 1: 1.5 Explicit, Implicit and 1.0 Parametric Equations 0.5 f(x) P -3.5 -3.0 -2.5 -2.0 -1.5 -1.0 -0.5 0.5 1.0 1.5 2.0 2.5 3.0 3.5 x x+h -0.5 -1.0 Chapter 1 – Functions and Equations Chapter 1: Functions and Equations LECTURE TOPIC 0 GEOMETRY EXPRESSIONS™ WARM-UP 1 EXPLICIT, IMPLICIT AND PARAMETRIC EQUATIONS 2 A SHORT ATLAS OF CURVES 3 SYSTEMS OF EQUATIONS 4 INVERTIBILITY, UNIQUENESS AND CLOSURE Lecture 1 – Explicit, Implicit and Parametric Equations 2 Learning Calculus with Geometry Expressions™ Calculus Inspiration Louis Eric Wasserman used a novel approach for attacking the Clay Math Prize of P vs. NP. He examined problem complexity. Louis calculated the least number of gates needed to compute explicit functions using only AND and OR, the basic atoms of computation. He produced a characterization of P, a class of problems that can be solved in by computer in polynomial time. He also likes ultimate Frisbee™. 3 Chapter 1 – Functions and Equations EXPLICIT FUNCTIONS Mathematicians like Louis use the term “explicit function” to express the idea that we have one dependent variable on the left-hand side of an equation, and all the independent variables and constants on the right-hand side of the equation. For example, the equation of a line is: Where m is the slope and b is the y-intercept. Explicit functions GENERATE y values from x values.
    [Show full text]
  • Plotting Circles and Ellipses Parametrically Example 1: the Unit Circle
    Lesson 1 Plotting Circles and Ellipses Parametrically Example 1: The Unit Circle Let's compare traditional and parametric equations for the unit circle : Traditional : Parametric : x22 y 1 x(t) cos(t) y(t) sin(t) P(t) cos(t),sin(t) t is called a parameter 0 t 2 You can see that the parametric equation satisfies the traditional equation by substituting one into the other: x22 y 1 (cos(t))22 (sin(t)) 1 11 Created by Christopher Grattoni. All rights reserved. Example 2: Circle of Radius r Let's compare traditional and parametric equations for a circle of radius r centeredTraditional at the : origin : Parametric : 2 2 2 x y r x(t) r cos(t) y(t) r sin(t) P(t) r cos(t),sin(t) 0 t 2 Orientation: Counterclockwise Think of this as dilating the unit circle by a factor of r. Created by Christopher Grattoni. All rights reserved. Example 3: Recentering the Circle Let's compare traditional and parametric equations for a circle of radius r centeredTraditional at (h,k) : : Parametric : 2 2 2 (x h) (y k) r x(t) r cos(t) h y(t) r sin(t) k P(t) r cos(t),sin(t) (h,k) 0 t 2 Think of this as dilating the unit circle by a factor of r and translating by the point (h,k). Let's add the orientation: Created by Christopher Grattoni. All rights reserved. Example 4: Ellipses Let's compare traditional and parametric equations for an ellipse centeredTraditional at (h,k) : : Parametric : 2 2 xh yk x(t) acos(t) h 1 ab y(t) bsin(t) k P(t) acos(t),bsin(t) (h,k) 0 t 2 Think of this as dilating the unit circle by a factor of "a" in the x-direction, a factor of "b" in the y-direction, and translated by the Created by Christopherpoint Grattoni.
    [Show full text]
  • Calculus 120, Section 7.3 Maxima & Minima of Multivariable Functions
    Calculus 120, section 7.3 Maxima & Minima of Multivariable Functions notes by Tim Pilachowski A quick note to start: If you’re at all unsure about the material from 7.1 and 7.2, now is the time to go back to review it, and get some help if necessary. You’ll need all of it for the next three sections. Just like we had a first-derivative test and a second-derivative test to maxima and minima of functions of one variable, we’ll use versions of first partial and second partial derivatives to determine maxima and minima of functions of more than one variable. The first derivative test for functions of more than one variable looks very much like the first derivative test we have already used: If f(x, y, z) has a relative maximum or minimum at a point ( a, b, c) then all partial derivatives will equal 0 at that point. That is ∂f ∂f ∂f ()a b,, c = 0 ()a b,, c = 0 ()a b,, c = 0 ∂x ∂y ∂z Example A: Find the possible values of x, y, and z at which (xf y,, z) = x2 + 2y3 + 3z 2 + 4x − 6y + 9 has a relative maximum or minimum. Answers : (–2, –1, 0); (–2, 1, 0) Example B: Find the possible values of x and y at which fxy(),= x2 + 4 xyy + 2 − 12 y has a relative maximum or minimum. Answer : (4, –2); z = 12 Notice that the example above asked for possible values. The first derivative test by itself is inconclusive. The second derivative test for functions of more than one variable is a good bit more complicated than the one used for functions of one variable.
    [Show full text]
  • Newton and Halley Are One Step Apart
    Methods for Solving Nonlinear Equations Local Methods for Unconstrained Optimization The General Sparsity of the Third Derivative How to Utilize Sparsity in the Problem Numerical Results Newton and Halley are one step apart Trond Steihaug Department of Informatics, University of Bergen, Norway 4th European Workshop on Automatic Differentiation December 7 - 8, 2006 Institute for Scientific Computing RWTH Aachen University Aachen, Germany (This is joint work with Geir Gundersen) Trond Steihaug Newton and Halley are one step apart Methods for Solving Nonlinear Equations Local Methods for Unconstrained Optimization The General Sparsity of the Third Derivative How to Utilize Sparsity in the Problem Numerical Results Overview - Methods for Solving Nonlinear Equations: Method in the Halley Class is Two Steps of Newton in disguise. - Local Methods for Unconstrained Optimization. - How to Utilize Structure in the Problem. - Numerical Results. Trond Steihaug Newton and Halley are one step apart Methods for Solving Nonlinear Equations Local Methods for Unconstrained Optimization The Halley Class The General Sparsity of the Third Derivative Motivation How to Utilize Sparsity in the Problem Numerical Results Newton and Halley A central problem in scientific computation is the solution of system of n equations in n unknowns F (x) = 0 n n where F : R → R is sufficiently smooth. Sir Isaac Newton (1643 - 1727). Sir Edmond Halley (1656 - 1742). Trond Steihaug Newton and Halley are one step apart Methods for Solving Nonlinear Equations Local Methods for Unconstrained Optimization The Halley Class The General Sparsity of the Third Derivative Motivation How to Utilize Sparsity in the Problem Numerical Results A Nonlinear Newton method Taylor expansion 0 1 00 T (s) = F (x) + F (x)s + F (x)ss 2 Nonlinear Newton: Given x.
    [Show full text]