Chapter 21 the Calculus of Variations

Total Page:16

File Type:pdf, Size:1020Kb

Chapter 21 the Calculus of Variations Chapter 21 The Calculus of Variations We have already had ample encounters with Nature's propensity to optimize. Min- imization principles form one of the most powerful tools for formulating mathematical models governing the equilibrium con¯gurations of physical systems. Moreover, the de- sign of numerical integration schemes such as the powerful ¯nite element method are also founded upon a minimization paradigm. This chapter is devoted to the mathematical analysis of minimization principles on in¯nite-dimensional function spaces | a subject known as the \calculus of variations", for reasons that will be explained as soon as we present the basic ideas. Solutions to minimization problems in the calculus of variations lead to boundary value problems for ordinary and partial di®erential equations. Numerical solutions are primarily based upon a nonlinear version of the ¯nite element method. The methods developed to handle such problems prove to be fundamental in many areas of mathematics, physics, engineering, and other applications. The history of the calculus of variations is tightly interwoven with the history of calcu- lus, and has merited the attention of a remarkable range of mathematicians, beginning with Newton, then developed as a ¯eld of mathematics in its own right by the Bernoulli family. The ¯rst major developments appeared in the work of Euler, Lagrange and Laplace. In the nineteenth century, Hamilton, Dirichlet and Hilbert are but a few of the outstanding contributors. In modern times, the calculus of variations has continued to occupy center stage in research, including major theoretical advances, along with wide-ranging applica- tions in physics, engineering and all branches of mathematics. In this chapter, we will only have time to scratch the surface of the vast area of classical and contemporary research. Minimization problems amenable to the methods of the calculus of variations serve to characterize the equilibrium con¯gurations of almost all continuous physical systems, rang- ing through elasticity, solid and fluid mechanics, electro-magnetism, gravitation, quantum mechanics, and many, many others. Many geometrical systems, such as minimal surfaces, can be conveniently formulated as optimization problems. Moreover, numerical approxima- tions to the equilibrium solutions of such boundary value problems are based on a nonlinear ¯nite element approach that reduced the in¯nite-dimensional minimization problem to a ¯nite-dimensional problem, to which we can apply the optimization techniques learned in Section 19.3. We have already treated the simplest problems in the calculus of variations. As we learned in Chapters 11 and 15, minimization of a quadratic functional requires solving an associated boundary value problem for a linear di®erential equation. Just as the vanishing of the gradient of a function of several variables singles out the critical points, among which are the minima, both local and global, so a similar \functional gradient" will distinguish 2/25/04 925 c 2004 Peter J. Olver ° Figure 21.1. The Shortest Path is a Straight Line. the candidate functions that might be minimizers of the functional. The ¯nite-dimensional gradient leads to a system of algebraic equations; the functional gradient leads to a bound- ary value problem for a nonlinear ordinary or partial di®erential equation. Thus, the passage from ¯nite to in¯nite dimensional nonlinear systems mirrors the transition from linear algebraic systems to boundary value problems. 21.1. Examples of Variational Problems. The best way to introduce the subject is to introduce some concrete examples of both mathematical and practical importance. These particular minimization problems played a key role in the historical development of the calculus of variations. And they still serve as an excellent motivation for learning its basic constructions. Minimal Curves and Geodesics The minimal curve problem is to ¯nd the shortest path connecting two points. In its simplest manifestation, we are given two distinct points a = (a; ®) and b = (b; ¯) in the plane R2. (21:1) Our goal is to ¯nd the curve of shortest length connecting them. \Obviously", as you learn in childhood, the shortest path between two points is a straight line; see Figure 21.1. Mathematically, then, the minimizing curve we are after should be given as the graph of the particular a±ne functiony ¯ ® y = c x + d = ¡ (x a) + ® (21:2) b a ¡ ¡ passing through the two points. However, this commonly accepted \fact" that (21.2) is the solution to the minimization problem is, upon closer inspection, perhaps not so immediately obvious from a rigorous mathematical standpoint. y We assume that a =6 b, i.e., the points a; b do not lie on a common vertical line. 2/25/04 926 c 2004 Peter J. Olver ° Let us see how we might properly formulate the minimal curve problem. Let us assume that the minimal curve is given as the graph of a smooth function y = u(x). Then, according to (A.27), the length of the curve is given by the standard arc length integral b J[u] = 1 + (u0)2 dx; (21:3) a Z p where we abbreviate u0 = du=dx. The function is required to satisfy the boundary condi- tions u(a) = ®; u(b) = ¯; (21:4) in order that its graph pass through the two prescribed points (21.1). The minimal curve problem requires us to ¯nd the function y = u(x) that minimizes the arc length functional (21.3) among all reasonable functions satisfying the prescribed boundary conditions. The student should pause to reflect on whether it is mathematically obvious that the a±ne function (21.2) is the one that minimizes the arc length integral (21.3) subject to the given boundary conditions. One of the motivating tasks of the calculus of variations, then, is to rigorously prove that our childhood intuition is indeed correct. Indeed, the word \reasonable" is important. For the arc length functional to be de¯ned, the function u(x) should be at least piecewise C1, i.e., continuous with a piecewise continuous derivative. If we allow discontinuous functions, then the straight line (21.2) does not, in most cases, give the minimizer; see Exercise . Moreover, continuous functions which are not piecewise C1 may not have a well-de¯ned length. The more seriously one thinks about these issues, the less evident the solution becomes. But, rest assured that the \obvious" solution (21.2) does indeed turn out to be the true minimizer. However, a fully rigorous mathematical proof of this fact requires a proper development of the calculus of variations machinery. A closely related problem arises in optics. The general principle, ¯rst formulated by the seventeenth century French mathematician Pierre de Fermat, is that when a light ray moves through an optical medium, e.g., a vacuum, it travels along a path that will minimize the travel time. As always, Nature seeks the most economical solution! Let c(x; y) denote the speed of light at each point in the mediumy. Speed is equal to the time derivative of distance traveled, namely, the arc length (21.3) of the curve y = u(x) traced by the light ray. Thus, ds dx c(x; u(x)) = = 1 + u0(x)2 : dt dt Integrating from start to ¯nish, we conclude pthat the total travel time of the light ray is equal to T b dt b 1 + u0(x)2 T [u] = dt = dx = dx: (21:5) dx c(x; u(x)) Z0 Za Za p Fermat's Principle states that, to get from one point to another, the light ray follows the curve y = u(x) that minimizes this functional. If the medium is homogeneous, then y For simplicity, we only consider the two-dimensional case here. 2/25/04 927 c 2004 Peter J. Olver ° Figure 21.2. Geodesics on a Cylinder. c(x; y) c is constant, and T [u] equals a multiple of the arc length functional, whose minimizers´ are the \obvious" straight lines. In an inhomogeneous medium, the path taken by the light ray is no longer evident, and we are in need of a systematic method for solving the minimization problem. All of the known laws of optics and lens design, governing focusing, refraction, etc., all follow as consequences of the minimization principle, [optics]. Another problem of a similar ilk is to construct the geodesics on a curved surface, meaning the curves of minimal length. In other words, given two points a; b on a surface S R3, we seek the curve C S that joins them and has the minimal possible length. For½example, if S is a circular½cylinder, then the geodesic curves turn out to be straight lines parallel to the center line, circles orthogonal to the center line, and spiral helices; see Figure 21.2 for an illustration. Similarly, the geodesics on a sphere are arcs of great circles; these include the circumpolar paths followed by airplanes around the globe. However, both of these claims are in need of rigorous justi¯cation. In order to mathematically formulate the geodesic problem, we suppose, for simplicity, that our surface S R3 is realized as the graphy of a function z = F (x; y). We seek the geodesic curve C ½S that joins the given points ½ a = (a; ®; F (a; ®)); and b = (b; ¯; F (b; ¯)); on the surface S: Let us assume that C can be parametrized by the x coordinate, in the form y = u(x); z = F (x; u(x)): In particular, this requires a = b. The length of the curve is given by the usual arc length integral (B.17), and so we must6 minimize the functional b dy 2 dz 2 J[u] = 1 + + dx dx dx Za s µ ¶ µ ¶ b du 2 @F @F du 2 = 1 + + (x; u(x)) + (x; u(x)) dx; dx @x @u dx Za s µ ¶ µ ¶ y Cylinders are not graphs, but can be placed within this framework by passing to cylindrical coordinates.
Recommended publications
  • CALCULUS of VARIATIONS and TENSOR CALCULUS
    CALCULUS OF VARIATIONS and TENSOR CALCULUS U. H. Gerlach September 22, 2019 Beta Edition 2 Contents 1 FUNDAMENTAL IDEAS 5 1.1 Multivariable Calculus as a Prelude to the Calculus of Variations. 5 1.2 Some Typical Problems in the Calculus of Variations. ...... 6 1.3 Methods for Solving Problems in Calculus of Variations. ....... 10 1.3.1 MethodofFiniteDifferences. 10 1.4 TheMethodofVariations. 13 1.4.1 Variants and Variations . 14 1.4.2 The Euler-Lagrange Equation . 17 1.4.3 Variational Derivative . 20 1.4.4 Euler’s Differential Equation . 21 1.5 SolvedExample.............................. 24 1.6 Integration of Euler’s Differential Equation. ...... 25 2 GENERALIZATIONS 33 2.1 Functional with Several Unknown Functions . 33 2.2 Extremum Problem with Side Conditions. 38 2.2.1 HeuristicSolution. 40 2.2.2 Solution via Constraint Manifold . 42 2.2.3 Variational Problems with Finite Constraints . 54 2.3 Variable End Point Problem . 55 2.3.1 Extremum Principle at a Moment of Time Symmetry . 57 2.4 Generic Variable Endpoint Problem . 60 2.4.1 General Variations in the Functional . 62 2.4.2 Transversality Conditions . 64 2.4.3 Junction Conditions . 66 2.5 ManyDegreesofFreedom . 68 2.6 Parametrization Invariant Problem . 70 2.6.1 Parametrization Invariance via Homogeneous Function .... 71 2.7 Variational Principle for a Geodesic . 72 2.8 EquationofGeodesicMotion . 76 2.9 Geodesics: TheirParametrization.. 77 3 4 CONTENTS 2.9.1 Parametrization Invariance. 77 2.9.2 Parametrization in Terms of Curve Length . 78 2.10 Physical Significance of the Equation for a Geodesic . ....... 80 2.10.1 Freefloatframe ........................
    [Show full text]
  • Introduction to the Modern Calculus of Variations
    MA4G6 Lecture Notes Introduction to the Modern Calculus of Variations Filip Rindler Spring Term 2015 Filip Rindler Mathematics Institute University of Warwick Coventry CV4 7AL United Kingdom [email protected] http://www.warwick.ac.uk/filiprindler Copyright ©2015 Filip Rindler. Version 1.1. Preface These lecture notes, written for the MA4G6 Calculus of Variations course at the University of Warwick, intend to give a modern introduction to the Calculus of Variations. I have tried to cover different aspects of the field and to explain how they fit into the “big picture”. This is not an encyclopedic work; many important results are omitted and sometimes I only present a special case of a more general theorem. I have, however, tried to strike a balance between a pure introduction and a text that can be used for later revision of forgotten material. The presentation is based around a few principles: • The presentation is quite “modern” in that I use several techniques which are perhaps not usually found in an introductory text or that have only recently been developed. • For most results, I try to use “reasonable” assumptions, not necessarily minimal ones. • When presented with a choice of how to prove a result, I have usually preferred the (in my opinion) most conceptually clear approach over more “elementary” ones. For example, I use Young measures in many instances, even though this comes at the expense of a higher initial burden of abstract theory. • Wherever possible, I first present an abstract result for general functionals defined on Banach spaces to illustrate the general structure of a certain result.
    [Show full text]
  • Calculus of Variations
    MIT OpenCourseWare http://ocw.mit.edu 16.323 Principles of Optimal Control Spring 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 16.323 Lecture 5 Calculus of Variations • Calculus of Variations • Most books cover this material well, but Kirk Chapter 4 does a particularly nice job. • See here for online reference. x(t) x*+ αδx(1) x*- αδx(1) x* αδx(1) −αδx(1) t t0 tf Figure by MIT OpenCourseWare. Spr 2008 16.323 5–1 Calculus of Variations • Goal: Develop alternative approach to solve general optimization problems for continuous systems – variational calculus – Formal approach will provide new insights for constrained solutions, and a more direct path to the solution for other problems. • Main issue – General control problem, the cost is a function of functions x(t) and u(t). � tf min J = h(x(tf )) + g(x(t), u(t), t)) dt t0 subject to x˙ = f(x, u, t) x(t0), t0 given m(x(tf ), tf ) = 0 – Call J(x(t), u(t)) a functional. • Need to investigate how to find the optimal values of a functional. – For a function, we found the gradient, and set it to zero to find the stationary points, and then investigated the higher order derivatives to determine if it is a maximum or minimum. – Will investigate something similar for functionals. June 18, 2008 Spr 2008 16.323 5–2 • Maximum and Minimum of a Function – A function f(x) has a local minimum at x� if f(x) ≥ f(x �) for all admissible x in �x − x�� ≤ � – Minimum can occur at (i) stationary point, (ii) at a boundary, or (iii) a point of discontinuous derivative.
    [Show full text]
  • Calculus of Variations Raju K George, IIST
    Calculus of Variations Raju K George, IIST Lecture-1 In Calculus of Variations, we will study maximum and minimum of a certain class of functions. We first recall some maxima/minima results from the classical calculus. Maxima and Minima Let X and Y be two arbitrary sets and f : X Y be a well-defined function having domain → X and range Y . The function values f(x) become comparable if Y is IR or a subset of IR. Thus, optimization problem is valid for real valued functions. Let f : X IR be a real valued → function having X as its domain. Now x X is said to be maximum point for the function f if 0 ∈ f(x ) f(x) x X. The value f(x ) is called the maximum value of f. Similarly, x X is 0 ≥ ∀ ∈ 0 0 ∈ said to be a minimum point for the function f if f(x ) f(x) x X and in this case f(x ) is 0 ≤ ∀ ∈ 0 the minimum value of f. Sufficient condition for having maximum and minimum: Theorem (Weierstrass Theorem) Let S IR and f : S IR be a well defined function. Then f will have a maximum/minimum ⊆ → under the following sufficient conditions. 1. f : S IR is a continuous function. → 2. S IR is a bound and closed (compact) subset of IR. ⊂ Note that the above conditions are just sufficient conditions but not necessary. Example 1: Let f : [ 1, 1] IR defined by − → 1 x = 0 f(x)= − x x = 0 | | 6 1 −1 +1 −1 Obviously f(x) is not continuous at x = 0.
    [Show full text]
  • Calculus of Variations
    Calculus of Variations The biggest step from derivatives with one variable to derivatives with many variables is from one to two. After that, going from two to three was just more algebra and more complicated pictures. Now the step will be from a finite number of variables to an infinite number. That will require a new set of tools, yet in many ways the techniques are not very different from those you know. If you've never read chapter 19 of volume II of the Feynman Lectures in Physics, now would be a good time. It's a classic introduction to the area. For a deeper look at the subject, pick up MacCluer's book referred to in the Bibliography at the beginning of this book. 16.1 Examples What line provides the shortest distance between two points? A straight line of course, no surprise there. But not so fast, with a few twists on the question the result won't be nearly as obvious. How do I measure the length of a curved (or even straight) line? Typically with a ruler. For the curved line I have to do successive approximations, breaking the curve into small pieces and adding the finite number of lengths, eventually taking a limit to express the answer as an integral. Even with a straight line I will do the same thing if my ruler isn't long enough. Put this in terms of how you do the measurement: Go to a local store and purchase a ruler. It's made out of some real material, say brass.
    [Show full text]
  • The Birth of Calculus: Towards a More Leibnizian View
    The Birth of Calculus: Towards a More Leibnizian View Nicholas Kollerstrom [email protected] We re-evaluate the great Leibniz-Newton calculus debate, exactly three hundred years after it culminated, in 1712. We reflect upon the concept of invention, and to what extent there were indeed two independent inventors of this new mathematical method. We are to a considerable extent agreeing with the mathematics historians Tom Whiteside in the 20th century and Augustus de Morgan in the 19th. By way of introduction we recall two apposite quotations: “After two and a half centuries the Newton-Leibniz disputes continue to inflame the passions. Only the very learned (or the very foolish) dare to enter this great killing- ground of the history of ideas” from Stephen Shapin1 and “When de l’Hôpital, in 1696, published at Paris a treatise so systematic, and so much resembling one of modern times, that it might be used even now, he could find nothing English to quote, except a slight treatise of Craig on quadratures, published in 1693” from Augustus de Morgan 2. Introduction The birth of calculus was experienced as a gradual transition from geometrical to algebraic modes of reasoning, sealing the victory of algebra over geometry around the dawn of the 18 th century. ‘Quadrature’ or the integral calculus had developed first: Kepler had computed how much wine was laid down in his wine-cellar by determining the volume of a wine-barrel, in 1615, 1 which marks a kind of beginning for that calculus. The newly-developing realm of infinitesimal problems was pursued simultaneously in France, Italy and England.
    [Show full text]
  • Applied Calculus of Variations for Engineers Louis Komzsik
    Applied Calculus of Variations for Engineers Louis Komzsik Boca Raton London New York CRC Press is an imprint of the Taylor & Francis Group, an informa business 86626_FM.indd 1 9/26/08 10:17:07 AM CRC Press Taylor & Francis Group 6000 Broken Sound Parkway NW, Suite 300 Boca Raton, FL 33487-2742 © 2009 by Taylor & Francis Group, LLC CRC Press is an imprint of Taylor & Francis Group, an Informa business No claim to original U.S. Government works Printed in the United States of America on acid-free paper 10 9 8 7 6 5 4 3 2 1 International Standard Book Number-13: 978-1-4200-8662-1 (Hardcover) This book contains information obtained from authentic and highly regarded sources. Reasonable efforts have been made to publish reliable data and information, but the author and publisher can- not assume responsibility for the validity of all materials or the consequences of their use. The authors and publishers have attempted to trace the copyright holders of all material reproduced in this publication and apologize to copyright holders if permission to publish in this form has not been obtained. If any copyright material has not been acknowledged please write and let us know so we may rectify in any future reprint. Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced, transmitted, or utilized in any form by any electronic, mechanical, or other means, now known or hereafter invented, including photocopying, microfilming, and recording, or in any information storage or retrieval system, without written permission from the publishers.
    [Show full text]
  • The Calculus of Variations: an Introduction
    The Calculus of Variations: An Introduction By Kolo Sunday Goshi Some Greek Mythology Queen Dido of Tyre – Fled Tyre after the death of her husband – Arrived at what is present day Libya Iarbas’ (King of Libya) offer – “Tell them, that this their Queen of theirs may have as much land as she can cover with the hide of an ox.” What does this have to do with the Calculus of Variations? What is the Calculus of Variations “Calculus of variations seeks to find the path, curve, surface, etc., for which a given function has a stationary value (which, in physical problems, is usually a minimum or maximum).” (MathWorld Website) Variational calculus had its beginnings in 1696 with John Bernoulli Applicable in Physics Calculus of Variations Understanding of a Functional Euler-Lagrange Equation – Fundamental to the Calculus of Variations Proving the Shortest Distance Between Two Points – In Euclidean Space The Brachistochrone Problem – In an Inverse Square Field Some Other Applications Conclusion of Queen Dido’s Story What is a Functional? The quantity z is called a functional of f(x) in the interval [a,b] if it depends on all the values of f(x) in [a,b]. Notation b z f x a – Example 1 1 x22cos x dx 0 0 Functionals The functionals dealt with in the calculus of variations are of the form b f x F x, y ( x ), y ( x ) dx a The goal is to find a y(x) that minimizes Г, or maximizes it. Used in deriving the Euler-Lagrange equation Deriving the Euler-Lagrange Equation I set forth the following equation: y x y x g x Where yα(x) is all the possibilities of y(x) that extremize a functional, y(x) is the answer, α is a constant, and g(x) is a random function.
    [Show full text]
  • Brief Notes on the Calculus of Variations
    BRIEF NOTES ON THE CALCULUS OF VARIATIONS JOSE´ FIGUEROA-O'FARRILL Abstract. These are some brief notes on the calculus of variations aimed at undergraduate students in Mathematics and Physics. The only prerequisites are several variable calculus and the rudiments of linear algebra and differential equations. These are usually taken by second- year students in the University of Edinburgh, for whom these notes were written in the first place. Contents 1. Introduction 1 2. Finding extrema of functions of several variables 2 3. A motivating example: geodesics 2 4. The fundamental lemma of the calculus of variations 4 5. The Euler{Lagrange equation 6 6. Hamilton's principle of least action 7 7. Some further problems 7 7.1. Minimal surface of revolution 8 7.2. The brachistochrone 8 7.3. Geodesics on the sphere 9 8. Second variation 10 9. Noether's theorem and conservation laws 11 10. Isoperimetric problems 13 11. Lagrange multipliers 16 12. Some variational PDEs 17 13. Noether's theorem revisited 20 14. Classical fields 22 Appendix A. Extra problems 26 A.1. Probability and maximum entropy 26 A.2. Maximum entropy in statistical mechanics 27 A.3. Geodesics, harmonic maps and Killing vectors 27 A.4. Geodesics on surfaces of revolution 29 1. Introduction The calculus of variations gives us precise analytical techniques to answer questions of the following type: 1 2 JOSE´ FIGUEROA-O'FARRILL • Find the shortest path (i.e., geodesic) between two given points on a surface. • Find the curve between two given points in the plane that yields a surface of revolution of minimum area when revolved around a given axis.
    [Show full text]
  • The Calculus of Variations
    LECTURE 3 The Calculus of Variations The variational principles of mechanics are firmly rooted in the soil of that great century of Liberalism which starts with Descartes and ends with the French Revolution and which has witnessed the lives of Leibniz, Spinoza, Goethe, and Johann Sebastian Bach. It is the only period of cosmic thinking in the entire history of Europe since the time of the Greeks.1 The calculus of variations studies the extreme and critical points of functions. It has its roots in many areas, from geometry to optimization to mechanics, and it has grown so large that it is difficult to describe with any sort of completeness. Perhaps the most basic problem in the calculus of variations is this: given a function f : Rn ! R that is bounded from below, find a pointx ¯ 2 Rn (if one exists) such that f (¯x) = inf f(x): n x2R There are two main approaches to this problem. One is the `direct method,' in which we take a sequence of points such that the sequence of values of f converges to the infimum of f, and then try to showing that the sequence, or a subsequence of it, converges to a minimizer. Typically, this requires some sort of compactness to show that there is a convergent subsequence of minimizers, and some sort of lower semi-continuity of the function to show that the limit is a minimizer. The other approach is the `indirect method,' in which we use the fact that any interior point where f is differentiable and attains a minimum is a critical, or stationary, point of f, meaning that the derivative of f is zero.
    [Show full text]
  • Calculus of Variations Lecture Notes Riccardo Cristoferi May 9 2016
    Calculus of Variations Lecture Notes Riccardo Cristoferi May 9 2016 Contents Introduction 7 Chapter 1. Some classical problems1 1.1. The brachistochrone problem1 1.2. The hanging cable problem3 1.3. Minimal surfaces of revolution4 1.4. The isoperimetric problem5 N Chapter 2. Minimization on R 9 2.1. The one dimensional case9 2.2. The multidimensional case 11 2.3. Local representation close to non degenerate points 12 2.4. Convex functions 14 2.5. On the notion of differentiability 15 Chapter 3. First order necessary conditions for one dimensional scalar functions 17 3.1. The first variation - C2 theory 17 3.2. The first variation - C1 theory 24 3.3. Lagrangians of some special form 29 3.4. Solution of the brachistochrone problem 32 3.5. Problems with free ending points 37 3.6. Isoperimetric problems 38 3.7. Solution of the hanging cable problem 42 3.8. Broken extremals 44 Chapter 4. First order necessary conditions for general functions 47 4.1. The Euler-Lagrange equation 47 4.2. Natural boundary conditions 49 4.3. Inner variations 51 4.4. Isoperimetric problems 53 4.5. Holomic constraints 54 Chapter 5. Second order necessary conditions 57 5.1. Non-negativity of the second variation 57 5.2. The Legendre-Hadamard necessary condition 58 5.3. The Weierstrass necessary condition 59 Chapter 6. Null lagrangians 63 Chapter 7. Lagrange multipliers and eigenvalues of the Laplace operator 67 Chapter 8. Sufficient conditions 75 8.1. Coercivity of the second variation 75 6 CONTENTS 8.2. Jacobi conjugate points 78 8.3.
    [Show full text]
  • Notes on Calculus of Variation with Applications in Image Analysis
    Notes on Calculus of Variation with applications in Image Analysis Fran¸coisLauze March 8, 2011 2 Contents 1 Introduction 5 2 Finite Dimension 7 2.1 Objective functions and optimizers . .7 2.2 Gradients . .8 2.3 An Important Gradient Computation . 13 2.4 Change of Metric and Gradient . 13 2.5 Cauchy-Scharwz, gradient descent . 15 2.6 Equality Constraints . 16 2.7 Inverse and Implicit Function Theorems . 21 3 Optimization of Functionals 25 3.1 Inner Products, Boundary Conditions,... 25 3.2 Classical Integration Results . 26 3.3 Adjunction . 28 3.4 Change of Variables Theorem . 29 4 Some Applications 31 4.1 Tikhonov Regularization . 31 4.2 Rudin-Osher-Fatemi Model, BV Regularization . 33 4.3 A Somewhat General Lagrangian . 37 4.4 Heat Equation and Calculus of Variations . 39 4.5 Optical Flow `ala Horn and Schunck . 42 4.6 Non Linear Flow Recovery . 44 5 Planar curves 45 5.1 Moving frames . 45 5.2 Length, arc-length parametrization, curvature . 46 5.3 Geometric integrals . 48 5.4 Implicit representation of curves . 49 3 4 CONTENTS 5.5 Representation by distance functions . 51 5.6 A very short introduction to variations of curves . 53 5.7 An extremely short / ultralight introduction to shape deriva- tives . 56 6 Optimization of curves and regions 59 6.1 Snakes . 59 6.2 Curves of minimal length . 60 6.3 Geodesic active contours . 61 6.4 Inner products and distances . 64 6.5 Chan and Vese's Active Contours . 64 6.5.1 Chan and Vese cost function . 64 Bibliography .
    [Show full text]