In Mathematical Optimization, the Method of Lagrange Multipliers
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Introduction to the Modern Calculus of Variations
MA4G6 Lecture Notes Introduction to the Modern Calculus of Variations Filip Rindler Spring Term 2015 Filip Rindler Mathematics Institute University of Warwick Coventry CV4 7AL United Kingdom [email protected] http://www.warwick.ac.uk/filiprindler Copyright ©2015 Filip Rindler. Version 1.1. Preface These lecture notes, written for the MA4G6 Calculus of Variations course at the University of Warwick, intend to give a modern introduction to the Calculus of Variations. I have tried to cover different aspects of the field and to explain how they fit into the “big picture”. This is not an encyclopedic work; many important results are omitted and sometimes I only present a special case of a more general theorem. I have, however, tried to strike a balance between a pure introduction and a text that can be used for later revision of forgotten material. The presentation is based around a few principles: • The presentation is quite “modern” in that I use several techniques which are perhaps not usually found in an introductory text or that have only recently been developed. • For most results, I try to use “reasonable” assumptions, not necessarily minimal ones. • When presented with a choice of how to prove a result, I have usually preferred the (in my opinion) most conceptually clear approach over more “elementary” ones. For example, I use Young measures in many instances, even though this comes at the expense of a higher initial burden of abstract theory. • Wherever possible, I first present an abstract result for general functionals defined on Banach spaces to illustrate the general structure of a certain result. -
Finite Elements for the Treatment of the Inextensibility Constraint
Comput Mech DOI 10.1007/s00466-017-1437-9 ORIGINAL PAPER Fiber-reinforced materials: finite elements for the treatment of the inextensibility constraint Ferdinando Auricchio1 · Giulia Scalet1 · Peter Wriggers2 Received: 5 April 2017 / Accepted: 29 May 2017 © Springer-Verlag GmbH Germany 2017 Abstract The present paper proposes a numerical frame- 1 Introduction work for the analysis of problems involving fiber-reinforced anisotropic materials. Specifically, isotropic linear elastic The use of fiber-reinforcements for the development of novel solids, reinforced by a single family of inextensible fibers, and efficient materials can be traced back to the 1960s are considered. The kinematic constraint equation of inex- and, to date, it is an active research topic. Such materi- tensibility in the fiber direction leads to the presence of als are composed of a matrix, reinforced by one or more an undetermined fiber stress in the constitutive equations. families of fibers which are systematically arranged in the To avoid locking-phenomena in the numerical solution due matrix itself. The interest towards fiber-reinforced mate- to the presence of the constraint, mixed finite elements rials stems from the mechanical properties of the fibers, based on the Lagrange multiplier, perturbed Lagrangian, and which offer a significant increase in structural efficiency. penalty method are proposed. Several boundary-value prob- Particularly, these materials possess high resistance and lems under plane strain conditions are solved and numerical stiffness, despite the low specific weight, together with an results are compared to analytical solutions, whenever the anisotropic mechanical behavior determined by the fiber derivation is possible. The performed simulations allow to distribution. -
Tutorial 8: Solutions
Tutorial 8: Solutions Applications of the Derivative 1. We are asked to find the absolute maximum and minimum values of f on the given interval, and state where those values occur: (a) f(x) = 2x3 + 3x2 12x on [1; 4]. − The absolute extrema occur either at a critical point (stationary point or point of non-differentiability) or at the endpoints. The stationary points are given by f 0(x) = 0, which in this case gives 6x2 + 6x 12 = 0 = x = 1; x = 2: − ) − Checking the values at the critical points (only x = 1 is in the interval [1; 4]) and endpoints: f(1) = 7; f(4) = 128: − Therefore the absolute maximum occurs at x = 4 and is given by f(4) = 124 and the absolute minimum occurs at x = 1 and is given by f(1) = 7. − (b) f(x) = (x2 + x)2=3 on [ 2; 3] − As before, we find the critical points. The derivative is given by 2 2x + 1 f 0(x) = 3 (x2 + x)1=2 and hence we have a stationary point when 2x + 1 = 0 and points of non- differentiability whenever x2 + x = 0. Solving these, we get the three critical points, x = 1=2; and x = 0; 1: − − Checking the value of the function at these critical points and the endpoints: f( 2) = 22=3; f( 1) = 0; f( 1=2) = 2−4=3; f(0) = 0; f(3) = (12)2=3: − − − Hence the absolute minimum occurs at either x = 1 or x = 0 since in both − these cases the minimum value is 0, while the absolute maximum occurs at x = 3 and is f(3) = (12)2=3. -
A Variational Approach to Lagrange Multipliers
JOTA manuscript No. (will be inserted by the editor) A Variational Approach to Lagrange Multipliers Jonathan M. Borwein · Qiji J. Zhu Received: date / Accepted: date Abstract We discuss Lagrange multiplier rules from a variational perspective. This allows us to highlight many of the issues involved and also to illustrate how broadly an abstract version can be applied. Keywords Lagrange multiplier Variational method Convex duality Constrained optimiza- tion Nonsmooth analysis · · · · Mathematics Subject Classification (2000) 90C25 90C46 49N15 · · 1 Introduction The Lagrange multiplier method is fundamental in dealing with constrained optimization prob- lems and is also related to many other important results. There are many different routes to reaching the fundamental result. The variational approach used in [1] provides a deep under- standing of the nature of the Lagrange multiplier rule and is the focus of this survey. David Gale's seminal paper [2] provides a penetrating explanation of the economic meaning of the Lagrange multiplier in the convex case. Consider maximizing the output of an economy with resource constraints. Then the optimal output is a function of the level of resources. It turns out the derivative of this function, if exists, is exactly the Lagrange multiplier for the constrained optimization problem. A Lagrange multiplier, then, reflects the marginal gain of the output function with respect to the vector of resource constraints. Following this observation, if we penalize the resource utilization with a (vector) Lagrange multiplier then the constrained optimization problem can be converted to an unconstrained one. One cannot emphasize enough the importance of this insight. In general, however, an optimal value function for a constrained optimization problem is nei- ther convex nor smooth. -
Lecture Notes – 1
Optimization Methods: Optimization using Calculus-Stationary Points 1 Module - 2 Lecture Notes – 1 Stationary points: Functions of Single and Two Variables Introduction In this session, stationary points of a function are defined. The necessary and sufficient conditions for the relative maximum of a function of single or two variables are also discussed. The global optimum is also defined in comparison to the relative or local optimum. Stationary points For a continuous and differentiable function f(x) a stationary point x* is a point at which the slope of the function vanishes, i.e. f ’(x) = 0 at x = x*, where x* belongs to its domain of definition. minimum maximum inflection point Fig. 1 A stationary point may be a minimum, maximum or an inflection point (Fig. 1). Relative and Global Optimum A function is said to have a relative or local minimum at x = x* if f ()xfxh**≤+ ( )for all sufficiently small positive and negative values of h, i.e. in the near vicinity of the point x*. Similarly a point x* is called a relative or local maximum if f ()xfxh**≥+ ( )for all values of h sufficiently close to zero. A function is said to have a global or absolute minimum at x = x* if f ()xfx* ≤ ()for all x in the domain over which f(x) is defined. Similarly, a function is D Nagesh Kumar, IISc, Bangalore M2L1 Optimization Methods: Optimization using Calculus-Stationary Points 2 said to have a global or absolute maximum at x = x* if f ()xfx* ≥ ()for all x in the domain over which f(x) is defined. -
The Theory of Stationary Point Processes By
THE THEORY OF STATIONARY POINT PROCESSES BY FREDERICK J. BEUTLER and OSCAR A. Z. LENEMAN (1) The University of Michigan, Ann Arbor, Michigan, U.S.A. (3) Table of contents Abstract .................................... 159 1.0. Introduction and Summary ......................... 160 2.0. Stationarity properties for point processes ................... 161 2.1. Forward recurrence times and points in an interval ............. 163 2.2. Backward recurrence times and stationarity ................ 167 2.3. Equivalent stationarity conditions .................... 170 3.0. Distribution functions, moments, and sample averages of the s.p.p ......... 172 3.1. Convexity and absolute continuity .................... 172 3.2. Existence and global properties of moments ................ 174 3.3. First and second moments ........................ 176 3.4. Interval statistics and the computation of moments ............ 178 3.5. Distribution of the t n .......................... 182 3.6. An ergodic theorem ........................... 184 4.0. Classes and examples of stationary point processes ............... 185 4.1. Poisson processes ............................ 186 4.2. Periodic processes ........................... 187 4.3. Compound processes .......................... 189 4.4. The generalized skip process ....................... 189 4.5. Jitte processes ............................ 192 4.6. ~deprendent identically distributed intervals ................ 193 Acknowledgments ............................... 196 References ................................... 196 Abstract An axiomatic formulation is presented for point processes which may be interpreted as ordered sequences of points randomly located on the real line. Such concepts as forward recurrence times and number of points in intervals are defined and related in set-theoretic Q) Presently at Massachusetts Institute of Technology, Lexington, Mass., U.S.A. (2) This work was supported by the National Aeronautics and Space Administration under research grant NsG-2-59. 11 - 662901. Aeta mathematica. 116. Imprlm$ le 19 septembre 1966. -
Derivative, Gradient, and Lagrange Multipliers
EE263 Prof. S. Boyd Derivative, Gradient, and Lagrange Multipliers Derivative Suppose f : Rn → Rm is differentiable. Its derivative or Jacobian at a point x ∈ Rn is × denoted Df(x) ∈ Rm n, defined as ∂fi (Df(x))ij = , i =1, . , m, j =1,...,n. ∂x j x The first order Taylor expansion of f at (or near) x is given by fˆ(y)= f(x)+ Df(x)(y − x). When y − x is small, f(y) − fˆ(y) is very small. This is called the linearization of f at (or near) x. As an example, consider n = 3, m = 2, with 2 x1 − x f(x)= 2 . x1x3 Its derivative at the point x is 1 −2x2 0 Df(x)= , x3 0 x1 and its first order Taylor expansion near x = (1, 0, −1) is given by 1 1 1 0 0 fˆ(y)= + y − 0 . −1 −1 0 1 −1 Gradient For f : Rn → R, the gradient at x ∈ Rn is denoted ∇f(x) ∈ Rn, and it is defined as ∇f(x)= Df(x)T , the transpose of the derivative. In terms of partial derivatives, we have ∂f ∇f(x)i = , i =1,...,n. ∂x i x The first order Taylor expansion of f at x is given by fˆ(x)= f(x)+ ∇f(x)T (y − x). 1 Gradient of affine and quadratic functions You can check the formulas below by working out the partial derivatives. For f affine, i.e., f(x)= aT x + b, we have ∇f(x)= a (independent of x). × For f a quadratic form, i.e., f(x)= xT Px with P ∈ Rn n, we have ∇f(x)=(P + P T )x. -
The First Derivative and Stationary Points
Mathematics Learning Centre The first derivative and stationary points Jackie Nicholas c 2004 University of Sydney Mathematics Learning Centre, University of Sydney 1 The first derivative and stationary points dy The derivative of a function y = f(x) tell us a lot about the shape of a curve. In this dx section we will discuss the concepts of stationary points and increasing and decreasing functions. However, we will limit our discussion to functions y = f(x) which are well behaved. Certain functions cause technical difficulties so we will concentrate on those that don’t! The first derivative dy The derivative, dx ,isthe slope of the tangent to the curve y = f(x)atthe point x.Ifwe know about the derivative we can deduce a lot about the curve itself. Increasing functions dy If > 0 for all values of x in an interval I, then we know that the slope of the tangent dx to the curve is positive for all values of x in I and so the function y = f(x)isincreasing on the interval I. 3 For example, let y = x + x, then y dy 1 =3x2 +1> 0 for all values of x. dx That is, the slope of the tangent to the x curve is positive for all values of x. So, –1 0 1 y = x3 + x is an increasing function for all values of x. –1 The graph of y = x3 + x. We know that the function y = x2 is increasing for x>0. We can work this out from the derivative. 2 If y = x then y dy 2 =2x>0 for all x>0. -
EE2 Maths: Stationary Points
EE2 Maths: Stationary Points df Univariate case: When we maximize f(x) (solving for the x0 such that dx = 0) the d df gradient is zero at these points. What about the rate of change of gradient: dx ( dx ) at the minimum x0? For a minimum the gradient increases as x0 ! x0 + ∆x (∆x > 0). It follows d2f d2f that dx2 > 0. The opposite is true for a maximum: dx2 < 0, the gradient decreases upon d2f positive steps away from x0. For a point of inflection dx2 = 0. r @f @f Multivariate case: Stationary points occur when f = 0. In 2-d this is ( @x ; @y ) = 0, @f @f namely, a generalization of the univariate case. Recall that df = @x dx + @y dy can be written as df = ds · rf where ds = (dx; dy). If rf = 0 at (x0; y0) then any infinitesimal step ds away from (x0; y0) will still leave f unchanged, i.e. df = 0. There are three types of stationary points of f(x; y): Maxima, Minima and Saddle Points. We'll draw some of their properties on the board. We will now attempt to find ways of identifying the character of each of the stationary points of f(x; y). Consider a Taylor expansion about a stationary point (x0; y0). We know that rf = 0 at (x0; y0) so writing (∆x; ∆y) = (x − x0; y − y0) we find: − ∆f = f(x; y)[ f(x0; y0) ] 1 @2f @2f @2f ' 0 + (∆x)2 + 2 ∆x∆y + (∆y)2 : (1) 2! @x2 @x@y @y2 Maxima: At a maximum all small steps away from (x0; y0) lead to ∆f < 0. -
Contactmethodsintegratingplasti
Contact methodsintegrating plasticity B13/1 modelswith application to soil mechanics ChristianWeißenfels Leibniz Universität Hannover Contact methods integrating plasticity models with application to soil mechanics Von der Fakultät für Maschinenbau der Gottfried Wilhelm Leibniz Universität Hannover zur Erlangung des akademischen Grades Doktor-Ingenieur genehmigte Dissertation von Dipl.-Ing. Christian Weißenfels geboren am 30.01.1979 in Rosenheim 2013 Herausgeber: Prof. Dr.-Ing. Peter Wriggers Verwaltung: Institut für Kontinuumsmechanik Gottfried Wilhelm Leibniz Universität Hannover Appelstraße 11 30167 Hannover Tel: +49 511 762 3220 Fax: +49 511 762 5496 Web: www.ikm.uni-hannover.de © Dipl.-Ing. Christian Weißenfels Institut für Kontinuumsmechanik Gottfried Wilhelm Leibniz Universität Hannover Appelstraße 11 30167 Hannover Alle Rechte, insbesondere das der Übersetzung in fremde Sprachen, vorbehalten. Ohne Genehmigung des Autors ist es nicht gestattet, dieses Heft ganz oder teilweise auf photomechanischem, elektronischem oder sonstigem Wege zu vervielfältigen. ISBN 978-3-941302-06-8 1. Referent: Prof. Dr.-Ing. Peter Wriggers 2. Referent: Prof. Dr.-Ing. Karl Schweizerhof Tag der Promotion: 13.12.2012 i Zusammenfassung Der Schwerpunkt der vorliegenden Arbeit liegt in der Entwicklung von neuartigen Kon- zepten zur direkten Integration von drei-dimensionalen Plastizit¨atsmodellen in eine Kontaktformulierung. Die allgemeinen Konzepte wurden speziell auf Boden Bauwerk Interaktionen angewandt und im Rahmen der Mortar-Methode numerisch umgesetzt. Zwei unterschiedliche Strategien wurden dabei verfolgt. Die Erste integriert die Boden- modelle in eine Standard-Kontaktdiskretisierung, wobei die zweite Variante die Kon- taktformulierung in Richtung eines drei-dimensionalen Kontaktelements erweitert. Innerhalb der ersten Variante wurden zwei unterschiedliche Konzepte ausgearbeitet, wobei das erste Konzept das Bodenmodell mit dem Reibbeiwert koppelt. Dabei muss die H¨ohe der Lokalisierungszone entlang der Kontaktfl¨ache bestimmt werden. -
Dual-Dual Formulations for Frictional Contact Problems in Mechanics
View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Institutionelles Repositorium der Leibniz Universität... Dual-dual formulations for frictional contact problems in mechanics Von der Fakultät für Mathematik und Physik der Gottfried Wilhelm Leibniz Universität Hannover zur Erlangung des Grades Doktor der Naturwissenschaften Dr. rer. nat. genehmigte Dissertation von Dipl. Math. Michael Andres geboren am 28. 12. 1980 in Siemianowice (Polen) 2011 Referent: Prof. Dr. Ernst P. Stephan, Leibniz Universität Hannover Korreferent: Prof. Dr. Gabriel N. Gatica, Universidad de Concepción, Chile Korreferent: PD Dr. Matthias Maischak, Brunel University, Uxbridge, UK Tag der Promotion: 17. 12. 2010 ii To my Mum. Abstract This thesis deals with unilateral contact problems with Coulomb friction. The main focus of this work lies on the derivation of the dual-dual formulation for a frictional contact problem. First, we regard the complementary energy minimization problem and apply Fenchel’s duality theory. The result is a saddle point formulation of dual type involving Lagrange multipliers for the governing equation, the symmetry of the stress tensor as well as the boundary conditions on the Neumann boundary and the contact boundary, respectively. For the saddle point problem an equivalent variational inequality problem is presented. Both formulations include a nondiffer- entiable functional arising from the frictional boundary condition. Therefore, we introduce an additional dual Lagrange multiplier denoting the friction force. This procedure yields a dual-dual formulation of a two-fold saddle point structure. For the corresponding variational inequality problem we show the unique solvability. Two different inf-sup conditions are introduced that allow an a priori error analysis of the dual-dual variational inequality problem. -
18.02SC Notes: Lagrange Multipliers
Lagrange Multipliers We will give the argument for why Lagrange multipliers work later. Here, we’ll look at where and how to use them. Lagrange multipliers are used to solve constrained optimization problems. That is, suppose you have a function, say f(x; y), for which you want to find the maximum or minimum value. But, you are not allowed to consider all (x; y) while you look for this value. Instead, the (x; y) you can consider are constrained to lie on some curve or surface. There are lots of examples of this in science, engineering and economics, for example, optimizing some utility function under budget constraints. Lagrange multipliers problem: Minimize (or maximize) w = f(x; y; z) constrained by g(x; y; z) = c. Lagrange multipliers solution: Local minima (or maxima) must occur at a critical point. This is a point where rf = λrg, and g(x; y; z) = c. Example: Making a box using a minimum amount of material. A box is made of cardboard with double thick sides, a triple thick bottom, single thick front and back and no top. It’s volume is fixed at 3. What dimensions use the least amount of cardboard? Answer: We did this problem once before by solving for z in terms of x and y and substi tuting for it. That led to an unconstrained optimization problem in x and y. Here we will do it as a constrained problem. It is important to be able to do this because eliminating one variable is not always easy. The box shown has dimensions x, y, and z.