1.1 the Linear Complementarity Problem and Its Geometry

Total Page:16

File Type:pdf, Size:1020Kb

1.1 the Linear Complementarity Problem and Its Geometry Chapter LINEAR COMPLEMENTARITY PROBLEM ITS GEOMETRY AND APPLICATIONS THE LINEAR COMPLEMENTARITY PROBLEM AND ITS GEOMETRY The Linear Complementarity Problem abbreviated as LCP is a general problem which unies linear and quadratic programs and bimatrix games The study of LCP has led to many far reaching b enets For example an algorithm known as the com plementary pivot algorithm rst develop ed for solving LCPs has b een generalized in a direct manner to yield ecient algorithms for computing Brouwer and Kakutani xed p oints for computing economic equilibria and for solving systems of nonlinear equations and nonlinear programming problems Also iterative metho ds develop ed for solving LCPs hold great promise for handling very large scale linear programs which cannot b e tackled with the well known simplex metho d b ecause of their large size and the consequent numerical diculties For these reasons the study of LCP oers rich rewards for p eople learning or doing research in optimization or engaged in practical applications of optimization In this book we discuss the LCP in all its depth n Let M beagiven square matrix of order n and q a column vector in R Through out this b o ok we will use the symbols w w z z to denote the variables in n n the problem In an LCP there is no ob jective function to be optimized The T T problem is nd w w w z z z satisfying n n w Mz q w z and w z for all i i i Chapter Linear Complementarity Problem Its Geometry and Applications The only data in the problem is the column vector q and the square matrix M So we n n will denote the LCP of nding w R z R satisfying by the symbol q M It is said to be an LCP of order n In an LCP of order n there are n variables As a sp ecic example let n M q This leads to the LCP w z z w z z w w z z and w z w z The problem can be expressed in the form of a vector equation as w w z z w w z z and w z w z In any solution satisfying at least one of the variables in each pair w z j j has to equal zero One approach for solving this problem is to pick one variable from each of the pairs w z w z and to x them at zero value in The remaining variables in the system may be called usable variables After eliminating the zero variables from if the remaining system has a solution in which the usable variables are nonnegative that would provide a solution to and Pick w w as the zerovalued variables After setting w w equal to in the remaining system is q z q z q z z q2 q1 -2 ()-1 -1 (-2 ) Figure A Complementary Cone Equation has a solution i the vector q can be expressed as a nonnegative T T linear combination of the vectors and The set of all nonnegative The Linear Complementarity Problem and its Geometry T T linear combinations of and is a cone in the q q space as in T Figure Only if the given vector q lies in this cone do es the LCP have a solution in which the usable variables are z z We verify that the p oint T do es lie in the cone that the solution of is z z and hence a solution for is w w z z The cone in Figure is known as a complementary cone asso ciated with the LCP Complementary cones are generalizations of the wellknown class of quadrants or orthants Notation The symbol I usually denotes the unit matrix If we want to emphasize its order we denote the unit matrix of order n b y the symbol I n We will use the abbreviation LP for Linear Program and BFS for Basic Feasible Solution See LCP is the abbreviation for Linear Complementarity Problem and NLP is the abbreviation for Nonlinear Program Column and Row Vectors of a Matrix If A a is a matrix of order m n say we will denote its j th column vector ij T a a by the symbol A and its ith row vector a a by A j mj j i in i Nonnegative Semip ositive Positive Vectors n T Let x x x R x that is nonnegative if x for all j Clearly n j x is said to be semip ositive denoted by x if x for all j and at least j one x Notice the distinction in the symbols for denoting nonnegative with j two lines under the and semip ositive with only a single line under the the zero vector is the only nonnegativevector which is not semip ositive Also if x P n x The vector x strictly p ositive if x for all j Given twovectors j j j n x y R we write x y if x y x y if x y and xy if x y Pos Cones n r r If fx x g R the cone fx x x x g is denoted r r r by Posfx x g Given the matrix A of order m n PosA denotes the cone T PosfA A g fx x A for g n n Directions Rays HalfLines and Step Length n n R Given the direction y its ray Any p oint y R y denes a direction in is the halfline obtained by joining the origin to y and continuing indenitely in the Chapter Linear Complementarity Problem Its Geometry and Applications n same direction it is the set of p oints fy g Given x R by moving from x in the direction y we get p oints of the form x y where and the set of all such p oints f x y g is the haline or ray through x in the direction y The p oint x y for issaidtohave b een obtained bymoving from x in the direction n T y a step length of As an example if y R the ray of y is the set of all T T p oints of the form f g In addition if x the haline through T x in the direction y is the set of all p oints of the form f g See T Figure In this halfline letting we get the p oint and this p oint is T T x in the direction y obtained by taking a step of length from x y y Ray of Half-line or ray through y in the direction of x Figure Rays and HalfLines Complementary Cones In the LCP q M the complementary cones are dened by the matrix M The p oint q do es not play any role in the denition of complementary cones Let M be a given square matrix of order n For obtaining C M the class of complementary cones corresp onding to M the pair of column vectors I M is j j The Linear Complementarity Problem and its Geometry known as the j th complementary pair of vectors j n Pick a vector from the pair I M and denote it by A The ordered set of vectors A A is j j j n known as a complementary set of vectors The cone Pos A A fy y n A A g is known as a complementary cone in the n n n n class C M Clearly there are complementary cones Example Let n andM I In this case the class C I is just the class of orthants in R In n general for any n C I is the class of orthants in R Thus the class of complementary cones is a generalization of the class of orthants See Figure Figures and provide some more examples of complementary cones In the example in Figure since fI M g is a linearly dep endent set the cone PosI M has an empty consists of all the p oints on the horizontal axis in Figure the thick interior It axis The remaining three complementary cones have nonemptyinteriors Pos( I 1 , I 2 ) Pos( I 1 , I 2 ) Pos( M 1, I 2 ) Pos( I 1 , I 2 ) I 2 I 2 I 1 I I 1 1 , I 2 M 1 Pos( I 1 M 2 ) Pos( I , I ) Pos( I , I ) 1 2 1 2 M 2 Pos( M 1 , M 2 ) Figure When M I the Complementarity Cones are the Orthants Figure Complementary Cones when M Chapter Linear Complementarity Problem Its Geometry and Applications Degenerate Nondegenerate Complementary Cones Let PosA A b e a complementary cone in C M This cone is said to b e a non n degenerate complementary cone if it has a nonemptyinterior that is if fA A g n is a linearly indep endent set degenerate complementary cone if its interior is empty which happ ens when fA A g is a linearly dep endent set As examples all the n complementary cones in Figures are nondegenerate In Figure the complementary cone PosI is degenerate the remaining three complemen M tary cones are nondegenerate M 2 I 2 I 2 M 2 I 1 I 1 M 1 M 1 Figure Complementary Cones when M Figure Complementary Cones when M The Linear Complementary Problem n Given the square matrix M of order n and the column vector q R theLCPq M is equivalent to the problem of nding a complementary cone in C M that contains the p oint q that is to nd a complementary set of column vectors A A such n that M g for j n i A fI j j j ii q can be expressed as a nonnegative linear combination of A A n The Linear Complementarity Problem and its Geometry where I is the identity matrix of order n and I is its j th column vector This is j P P n n n n equivalent to nding w R z R satisfying I w M z q w j j j j j j j z for all j and either w or z for all j In matrix notation this is j j j w Mz q w z w z for all j j j P n T Because of the condition is equivalent to w z w z this con j j j dition is known as the complementarity constraint In any solution of the LCP q M if one of the variables in the pair w z is p ositive the other should be zero j j complementary pair of variables and Hence the pair w z is known as the j th j j eachvariable in this pair is the complement of the other In the column vector corresp onding to w is I and the column vector corresp onding to z is M For j j j j j to n the pair I M is the j th complementary pair of column vectors in j j be the the LCP q M For j to n let y fw z g and let A column vector j j j j corresp onding to y in So A fI M g Then y y y is a com j j j j n plementary vector of variables in this
Recommended publications
  • Linear Complementarity Problems on Extended Second Order Cones (ESOCLCP)
    Linear complementarity problems on extended second order cones S. Z. N´emeth School of Mathematics, University of Birmingham Watson Building, Edgbaston Birmingham B15 2TT, United Kingdom email: [email protected] L. Xiao School of Mathematics, University of Birmingham Watson Building, Edgbaston Birmingham B15 2TT, United Kingdom email: [email protected] November 9, 2018 Abstract In this paper, we study the linear complementarity problems on extended second order cones. We convert a linear complementarity problem on an extended second order cone into a mixed complementarity problem on the non-negative orthant. We state necessary and sufficient conditions for a point to be a solution of the converted problem. We also present solution strategies for this problem, such as the Newton method and Levenberg- Marquardt algorithm. Finally, we present some numerical examples. Keywords: Complementarity Problem, Extended Second Order Cone, Conic Opti- mization 2010 AMS Subject Classification: 90C33, 90C25 1 Introduction arXiv:1707.04268v5 [math.OC] 19 Jan 2018 Although research in cone complementarity problems (see the definition in the beginning of the Preliminaries) goes back a few decades only, the underlying concept of complementarity is much older, being firstly introduced by Karush in 1939 [1]. It seems that the concept of comple- mentarity problems was first considered by Dantzig and Cottle in a technical report [2], for the non-negative orthant. In 1968, Cottle and Dantzig [3] restated the linear programming prob- lem, the quadratic programming problem and the bimatrix game problem as a complementarity problem, which inspired the research in this field (see [4–8]). The complementarity problem is a cross-cutting area of research which has a wide range of applications in economics, finance and other fields.
    [Show full text]
  • Case Studies in Operations Research Ed
    International Series in Operations Research & Management Science ISOR 212 Murty International Series in Katta G. Murty Editor Operations Research & Management Science Case Studies in Operations Research Ed. Applications of Optimal Decision Making Th is textbook is comprised of detailed case studies covering challenging real world applications of OR techniques. Among the overall goals of the book is to provide readers with descriptions of the history and other background information on a variety of industries, service or other organizations in which decision making is an important component of their daily operations. Th e book considers all methods of optimum decision making in order to improve performances. It also compares possible solutions obtained by diff erent approaches, concluding with a recommendation of the best among Katta G. Murty Editor them for implementation. By exposing students to a variety of applications in a variety of areas and explaining how they can be modeled and solved, the book helps students develop the skills needed for modeling and solving problems that they may face in the workplace. Each chapter of " Case Studies in Operations Research: Applications of Optimal Decision Making" also includes additional data provided on the book’s website on Springer.com. 1 Th ese fi les contain a brief description of the area of application, the problem and the required outputs. Also provided are links to access all the data in the problem. Finally Case Studies there are project exercises for students to practice what they have learnt in the chapter, Research Studies in Operations Case which can also be used by instructors as project assignments in their courses.
    [Show full text]
  • An Introduction to Complementarity (Pdf)
    An Introduction to Complementarity Michael C. Ferris University of Wisconsin, Madison Nonsmooth Mechanics Meeting: June 14, 2010 Ferris (Univ. Wisconsi) EMP Aussois, June 2010 1 / 63 Outline Introduction to Complementarity Models Extension to Variational Inequalities Extended Mathematical Programming Heirarchical Optimization Introduction: Transportation Model Application: World Dairy Market Model Algorithms: Feasible Descent Framework Implementation: PATH Results Ferris (Univ. Wisconsi) EMP Aussois, June 2010 2 / 63 Sample Network D1 S1 D2 S2 D3 S3 D4 Ferris (Univ. Wisconsi) EMP Aussois, June 2010 3 / 63 Transportation Model Suppliers ship good from warehouses to customers I Satisfy demand for commodity I Minimize transportation cost Transportation network provided as set A of arcs Variables xi;j - amount shipped over (i; j) 2 A Parameters I si - supply at node i I di - demand at node i I ci;j - cost to ship good from nodes i to j Ferris (Univ. Wisconsi) EMP Aussois, June 2010 4 / 63 Linear Program P minx≥0 (i;j)2A ci;j xi;j P subject to j:(i;j)2A xi;j ≤ si 8 i P i:(i;j)2A xi;j ≥ dj 8 j Ferris (Univ. Wisconsi) EMP Aussois, June 2010 5 / 63 Multipliers Introduce multipliers (marginal prices) ps and pd P s j:(i;j)2A xi;j ≤ si pi ≥ 0 In a competitive marketplace P s j:(i;j)2A xi;j < si ) pi = 0 At solution P s j:(i;j)2A xi;j = si or pi = 0 Complementarity relationship P s j:(i;j)2A xi;j ≤ si ? pi ≥ 0 Ferris (Univ. Wisconsi) EMP Aussois, June 2010 6 / 63 Wardropian Equilibrium Delivery cost exceeds market price s d pi + ci;j ≥ pj Strict inequality implies no shipment xi;j = 0 Linear complementarity problem P s j:(i;j)2A xi;j ≤ si ? pi ≥ 0 8 i P d dj ≤ i:(i;j)2A xi;j ? pi ≥ 0 8 j d s pj ≤ pi + ci;j ? xi;j ≥ 0 8 (i; j) 2 A • First order conditions for linear program Ferris (Univ.
    [Show full text]
  • Using Simulation for Planning and Design of Robotic Systems with Intermittent Contact
    USING SIMULATION FOR PLANNING AND DESIGN OF ROBOTIC SYSTEMS WITH INTERMITTENT CONTACT By Stephen George Berard A Thesis Submitted to the Graduate Faculty of Rensselaer Polytechnic Institute in Partial Fulfillment of the Requirements for the Degree of DOCTOR OF PHILOSOPHY Major Subject: COMPUTER SCIENCE Approved by the Examining Committee: Jeffrey Trinkle, Thesis Adviser Kurt Anderson, Member John Mitchell, Member Barbara Cutler, Member Rensselaer Polytechnic Institute Troy, New York April 2009 (For Graduation May 2009) c Copyright 2009 by Stephen George Berard All Rights Reserved ii CONTENTS LIST OF TABLES . vii LIST OF FIGURES . viii ACKNOWLEDGMENT . xiii ABSTRACT . xiv 1. Introduction . 1 1.1 Contributions . 2 2. Background . 6 2.1 Rigid Body Kinematics . 6 2.1.1 Position and Orientation . 6 2.1.2 Rotation Group . 8 2.1.3 Euclidean Group . 9 2.1.4 Velocity of a Rigid Body . 11 2.1.4.1 Kinematic Update . 12 2.1.4.2 Velocity of a Point on a Rigid Body . 13 2.1.4.3 Twists . 14 2.2 Kinetics . 15 2.2.1 Wrenches . 16 2.2.2 Transforming Twists and Wrenches . 17 2.2.3 Equations of Motion . 17 2.3 Complementarity Problem . 18 2.3.1 Finding Solutions of Complementarity Problems . 19 2.4 Complementarity formulation of Dynamics . 21 2.4.1 Equality Constraints . 23 2.4.1.1 Bilaterally Constrained Dynamics Formulation . 24 2.4.2 Contact . 25 2.4.2.1 Rigid Contact . 25 2.4.3 Instantaneous Formulation of Constrained Dynamics . 32 2.4.3.1 Nonlinear DCP Formulation . 32 2.4.3.2 Linear DCP Formulation .
    [Show full text]
  • Linear Complementarity Problems on Extended Second Order Cones Nemeth, Sandor; Xiao, Lianghai
    University of Birmingham Linear complementarity problems on extended second order cones Nemeth, Sandor; Xiao, Lianghai DOI: 10.1007/s10957-018-1220-x License: Creative Commons: Attribution (CC BY) Document Version Publisher's PDF, also known as Version of record Citation for published version (Harvard): Nemeth, S & Xiao, L 2018, 'Linear complementarity problems on extended second order cones', Journal of Optimization Theory and Applications, vol. 176, no. 2, pp. 269-288. https://doi.org/10.1007/s10957-018-1220-x Link to publication on Research at Birmingham portal General rights Unless a licence is specified above, all rights (including copyright and moral rights) in this document are retained by the authors and/or the copyright holders. The express permission of the copyright holder must be obtained for any use of this material other than for purposes permitted by law. •Users may freely distribute the URL that is used to identify this publication. •Users may download and/or print one copy of the publication from the University of Birmingham research portal for the purpose of private study or non-commercial research. •User may use extracts from the document in line with the concept of ‘fair dealing’ under the Copyright, Designs and Patents Act 1988 (?) •Users may not further distribute the material nor use it for the purposes of commercial gain. Where a licence is displayed above, please note the terms and conditions of the licence govern your use of this document. When citing, please reference the published version. Take down policy While the University of Birmingham exercises care and attention in making items available there are rare occasions when an item has been uploaded in error or has been deemed to be commercially or otherwise sensitive.
    [Show full text]
  • International Series in Operations Research & Management Science
    International Series in Operations Research & Management Science Volume 212 Series Editor Camille C. Price Stephen F. Austin State University, Texas, USA Associate Series Editor Joe Zhu Worcester Polytechnic Institute Worcester, Massachusetts, USA Founding Series Editor Frederick S. Hillier Stanford University, CA, USA For further volumes: http://www.springer.com/series/6161 The book series International Series in Operations Research and Management Sci- ence encompasses the various areas of operations research and management science. Both theoretical and applied books are included. It describes current advances any- where in the world that are at the cutting edge of the field. The series is aimed especially at researchers, doctoral students, and sophisticated practitioners. The series features three types of books: • Advanced expository books that extend and unify our understanding of particular areas. • Research monographs that make substantial contributions to knowledge. • Handbooks that define the new state of the art in particular areas. They will be entitled Recent Advances in (name of the area). Each handbook will be edited by a leading authority in the area who will organize a team of experts on various aspects of the topic to write individual chapters. A handbook may emphasize expository surveys or completely new advances (either research or applications) or a combination of both. The series emphasizes the following four areas: Mathematical Programming: Including linear programming, integer programming, nonlinear programming, interior point methods, game theory, network optimization models, combinatorics, equilibrium programming, complementarity theory, multi- objective optimization, dynamic programming, stochastic programming, complexity theory, etc. Applied Probability: Including queuing theory, simulation, renewal theory, Brownian motion and diffusion processes, decision analysis, Markov decision processes, reli- ability theory, forecasting, other stochastic processes motivated by applications, etc.
    [Show full text]
  • Todd Munson: Algorithms and Environments for Complementarity
    Algorithms and Environments for Complementarity By Todd S. Munson A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy (Computer Sciences) at the UNIVERSITY OF WISCONSIN – MADISON 2000 i Abstract Complementarity problems arise in a wide variety of disciplines. Prototypical examples include the Wardropian and Walrasian equilibrium models encountered in the engineering and economic disciplines and the first order optimality conditions for nonlinear programs from the optimization community. The main focus of this thesis is algorithms and envi- ronments for solving complementarity problems. Environments, such as AMPL and GAMS, are used by practitioners to easily write large, complex models. Support for these packages is provided by PATH 4.x and SEMI through the customizable solver interface specified in this thesis. The main design feature is the abstraction of core components from the code with implementations tailored to a particular environment supplied either at compile or run time. This solver interface is then used to develop new links to the MATLAB and NEOS tools. Preprocessing techniques are an integral part of linear and mixed integer programming codes and are primarily used to reduce the size and complexity of a model prior to solving it. For example, wasted computation is avoided when an infeasible model is detected. This thesis documents the new techniques for preprocessing complementarity problems contained in the PATH 4.x and SEMI algorithms. PATH 4.x is more reliable than prior versions of the code and has been able to find solutions to previously unsolvable models. The reasons for the improvement are discussed in this thesis and include new theoretical developments for a globalization scheme based on the Fischer-Burmeister merit function, and enhancements made to the linear complementarity solver, nonmonotone linesearch, and restart strategy.
    [Show full text]
  • Tra C Modeling and Variational Inequalities Using GAMS
    Trac Mo deling and Variational Inequalities using GAMS y z Steven P Dirkse Michael C Ferris April Abstract We describ e how several trac assignment and design problems can b e formulated within the GAMS mo deling language using newly developed mo deling and interface to ols The fundamental problem is user equilibrium where multiple drivers comp ete nonco op eratively for the resources of the trac network A description of how these mo dels can b e written as complementarity problems variational inequalities mathematical programs with equilibrium constraints or sto chastic lin ear programs is given At least one general purp ose solution technique for each mo del format is briey outlined Some observations relating to particular mo del solutions are drawn Introduction Mo dels that p ostulate ways to assign trac within a transp ortation network for a given demand have b een used in planning and analysis for many years see and references therein A p opular technique for such assignment is to use the shortest path b etween the origin and destination p oints of a given journey Of course such a path dep ends not only on the physical distance b etween these two p oints but also on the mo de of transp ort and the congestion exp erienced during the trip This material is based on research supp orted by National Science Foundation Grant CCR y GAMS Development Corp oration Potomac Street NW Washington DC stevegamscom z Computer Sciences Department University of Wisconsin Madison West Day ton Street Madison Wisconsin ferriscswiscedu To account
    [Show full text]
  • Some Generalizations of the Linear Complementarity Problem by Peng
    Some Generalizations of The Linear Complementarity Problem by Peng Yi A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Engineering - Industrial Engineering and Operations Research in the Graduate Division of the University of California, Berkeley Committee in charge: Professor Ilan Adler, Chair Professor Shmuel S. Oren Professor Bernd Sturmfels Spring 2016 Some Generalizations of The Linear Complementarity Problem Copyright 2016 by Peng Yi 1 Abstract Some Generalizations of The Linear Complementarity Problem by Peng Yi Doctor of Philosophy in Engineering - Industrial Engineering and Operations Research University of California, Berkeley Professor Ilan Adler, Chair In this thesis, we study two generalizations of the classical linear complementarity prob- lem (LCP) - the weighted extended linear complementarity problem (wXLCP) and the com- plementarity problem (CP) over a general closed cone. Our goal is twofold: extend some fundamental results of the LCP to a more general setting and identify a class of nonmonotone problems which could be solved numerically. The thesis is organized as follows: • In Chapter 1, we formulate problems relevant to our study and introduce background material that will be needed in the rest of the thesis. • In Chapter 2, we formulate the weighted extended linear complementarity problem (XLCP), which naturally generalizes the LCP, the horizontal linear complementarity problem (HLCP) and the extended linear complementarity problem (XLCP). Moti- vated by important roles played by matrix theoretic properties in the LCP theory, we study the monotonicity, sufficiency, P -property and R0-property in the setting of the XLCP. Together with two optimization reformulations of the problem, we establish several fundamental results.
    [Show full text]
  • Linear Programming III
    Linear programming III 1. LP solvers 2. LP solver in Maple 3. GLPK - GNU linear programming kit 4. LP model representations 5. Branch and bound method for mixed Integer linear programming CP412 ADAII Introduction # 1 1. LP solvers LP algorithms have been implemented in many packages https://en.wikipedia.org/wiki/Linear_programming • Proprietary packages – Dedicated packages: CPLEX, free for academic use, LINDO – General math tool: Maple, MATLAB, Mathematica, – Plugin: Excel solver – Libraries for specific LP apps, or embedded applications • Open source packages – CLP -- a LP solver from COIN-OR – GLPK -- GNU Linear Programming Kit, CP412 ADAII Introduction # 2 2. LP solver in Maple • Use Optimization package • Features – LP solver, integer programming by branch and bound, missed LP program – None-linear programming – Support matrix format • Small scale, testing, education Example: with(Optimization): LPSolve( 13*A+23*B, {0 <= A, 0 <= B, 4*A+4*B <= 160, 5*A+15*B <= 480, 35*A+20*B <= 1190}) CP412 ADAII Introduction # 3 3. GLPK • GLPK is available free of charge under GLU license • Features – Simplex method, dual simplex method, mixed integer linear programming, implemented in C – Include Java wrapper, plus many third-party wrappers for other languages – Can be compiled as stand-alone solver, or used as embedded LP solver – Provide library and APIs for application development. – Support major LP input file format – Interfaces to database CP412 ADAII Introduction # 4 GLPK in Action • Download – https://sourceforge.net/projects/winglpk • Build glpk library • Build embedded solver • Build stand alone solver: glpsol.exe glpsol --help glpsol --lp cplextest.lp -o result.txt glpsol --lp beer.lp -o result.txt glpsol --mps beer.mps -o result.txt --max glpsol -m beer.mod -o result.txt Demo • GLPK/Solution information https://en.wikibooks.org/wiki/GLPK/Solution_information CP412 ADAII Introduction # 5 4.
    [Show full text]
  • Basics for Mathematical Economics
    Basics for Mathematical Economics Lagrange multipliers __________________________________________________ 2 Karush–Kuhn–Tucker conditions ________________________________________ 12 Envelope theorem ___________________________________________________ 16 Fixed Point Theorems _________________________________________________ 20 Complementarity theory ______________________________________________ 24 Mixed complementarity problem _______________________________________ 26 Nash equilibrium ____________________________________________________ 30 1 Lagrange multipliers Figure 1: Find x and y to maximize f(x,y)subject to a constraint (shown in red)g(x,y) = c. Figure 2: Contour map of Figure 1. The red line shows the constraint g(x,y) = c. The blue lines are contours of f(x,y). The intersection of red and blue lines is our solution. In mathematical optimization, the method of Lagrange multipliers (named after Joseph Louis Lagrange) is a method for finding the maximum/minimum of a function subject to constraints. For example (see Figure 1 on the right) if we want to solve: maximize subject to We introduce a new variable (λ) called a Lagrange multiplier to rewrite the problem as: maximize Solving this new equation for x, y, and λ will give us the solution (x, y) for our original equation. 2 Introduction Consider a two-dimensional case. Suppose we have a function f(x,y) we wish to maximize or minimize subject to the constraint where c is a constant. We can visualize contours of f given by for various values of dn, and the contour of g given by g(x,y) = c. Suppose we walk along the contour line with g = c. In general the contour lines of f and g may be distinct, so traversing the contour line for g = c could intersect with or cross the contour lines of f.
    [Show full text]
  • On the Nonlinear Complementarity Problem
    CORE Metadata, citation and similar papers at core.ac.uk Provided by Elsevier - Publisher Connector JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS 123, 455460 (1987) On the Nonlinear Complementarity Problem MUHAMMAD ASLAM NOOR Department of Mathemutics, King Saud University, Riyadh, Saudi Arabia Submitted by George Leitmann Received October 15, 1985 We consider and study an algorithm for a new class of complementarity problems of finding u such that u 2 0. Tu+A(u)>O, (u, Tu+A(u))=O, where T is a continuous mapping and A is a diagonally nonlinear mapping from [w” into itself. Furthermore, it is proved that the approximate solution obtained by the iterative scheme converges to the exact solution. Special cases are also discussed. (’ 1987 Academic Press, Inc. 1. INTRODUCTION Variational inequality theory besides being elegant, exciting and rich, also provides us a unified and natural framework to study a large class of linear and nonlinear problems arising in mathematical and engineering sciences. Equally important is the area of operations research known as complementarity theory, which has received much attention during the last twenty years. It has been shown by Karamardian [ 11, that if the convex set involved in a variational inequality problem and complementarity problem is a convex cone, then both problems are equivalent. In fact, variational inequality problems are more general than the complementarity problems, and incluce them as special cases. Recently various extensions and generalizations of the variational inequality and complementarity problems have been introduced and analyzed. An important and useful generalization of the variational inequality problems is the mildly nonlinear variational inequality problem introduced and studied by Noor [2,3].
    [Show full text]