DOCSLIB.ORG

Linear, Affine, and Convex Sets and Hulls in the Sequel, Unless Otherwise Specified, X Will Denote a Real Vector Space. Lines An

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Linear, Affine, and Convex Sets and Hulls in the Sequel, Unless Otherwise Specified, X Will Denote a Real Vector Space. Lines An Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space. Lines and segments. Given two points x; y 2 X, we define ! xy = fx + t(y − x): t 2 Rg = f(1 − t)x + ty : t 2 Rg ; [x; y] = fx + t(y − x): t 2 [0; 1]g = f(1 − t)x + ty : t 2 [0; 1]g : The sets xy! and [x; y] are, respectively, the line passing through x and y, and the (closed) segment with endpoints x; y. Observe that they reduce to a singleton whenever x = y. We shall use also the following notation for non-closed segments: (x; y] = [x; y] n fxg; [x; y) = [x; y] n fyg; (x; y) = [x; y] n fx; yg: Linear, affine, and convex sets. A set A ⊂ X is called: • linear if A is a vector subpace of X (i.e., A is nonempty, and αx + βy 2 A whenever x; y 2 A; α; β 2 R); • affine if the line passing through any two points of A is entirely contained in A (i.e., (1 − t)x + ty 2 A whenever x; y 2 A; t 2 R); • convex if any segment with endpoints in A is contained in A (i.e., (1 − t)x + ty 2 A whenever x; y 2 A; t 2 [0; 1]). Obviously, each linear set is affine, and each affine set is convex. Moreover, any translate of an affine (convex, respectively) set is affine (convex, resp.). 2 Example 0.1. A linear set in R is either the singleton f0g, or a line containing 0, 2 or the whole R . 2 2 An affine set in R is either ;, or a singleton, or a line, or R . 2 There is a large variety of convex sets in R ... Proposition 0.2. Let A be a set in a vector space X. (a) A is linear if and only if A is affine and contains 0. (b) A is affine if and only if either A = ; or A is a translate of a linear set. (Moreover, the linear set is unique in this case.) Proof. Exercise. By Proposition 0.2(b), the following definition is justified. The dimension and the codimension of an affine set A ⊂ X is defined as, respectively, the dimension and the codimension of the (unique) linear translate of A. 1 2 Hyperplanes. A set H ⊂ X is a hyperplane in X if it is an affine set of codimension 1. Equivalently, a hyperplane is any maximal proper affine subset of X. Proposition 0.3. A set H ⊂ X is a hyperplane if and only if it is of the form −1 H = ' (α) where ': X ! R is a nonzero linear functional and α 2 R. Proof. \)" Fix any x0 2 H. By Proposition 0.2, the set Y = H − x0 is a linear subspace of codimension 1 in X. Fix any v0 2 X n Y . Then each x 2 X has a unique representation of the form x = yx + txv0 where yx 2 Y , tx 2 R. The mapping '(x) := tx is linear and satisfies x 2 H , x − x0 2 Y , '(x − x0) = 0 , '(x) = '(x0): Thus we can put α = '(x0). \(" It is easy to see that '−1(α) is a translate of the kernel '−1(0). We have to −1 −1 show that ' (0) has codimension 1. Fix some v0 2 X n ' (0) (this is possible since ' 6≡ 0). By substituting v0 by its appropriate multiple, we can suppose that '(v0) = 1. Then every x 2 X can be written in the form −1 x = [x − '(x)v0] + '(x)v0 2 ' (0) + Rv0 since '(x − '(x)v0) = 0. Corollary 0.4. Let H be a hyperplane in X. Then X can be written as a disjoint union X = H [ H+ [ H− in such a way that if x 2 H+ and y 2 H− then [x; y] \ H is a singleton. (The sets H+;H− are the algebraically open halfspaces generated by H.) Proof. Exercise. Hint: take '; α as in Proposition 0.3 and consider H+ = fx 2 X : − '(x) > αg, H = fx 2 X : '(x) < αg. Convex and affine combinations. Definition 0.5. Let A ⊂ X. An affine combination of elements of A is any finite sum of the form n X Pn (1) λixi where xi 2 A, λi 2 R, 1 λj = 1. i=1 A convex combination of elements of A is any finite sum of the form (1) with λi ≥ 0 (i = 1; : : : ; n). Proposition 0.6. Every convex/affine/linear set in a vector space X is closed under making convex/affine/linear combinations of its elements. Proof. The \linear part" is well known from Linear Algebra. Pn Let C be a convex set and x = i=1 λixi be a convex combination of elements of C. We want to prove that x 2 C. Let us proceed by induction with respect to n. For n = 1, we have x = x1 2 C. Now, suppose that the case n = k holds, Pk+1 and consider the case n = k + 1, that is, x = i=1 λixi with xi 2 C, λi ≥ 0, 3 Pk+1 1 λj = 1. If λk+1 = 1 then necessarily x = xk+1 2 C. Suppose λk+1 6= 1. Then Pk s := 1 λj = 1 − λk+1 6= 0. We can write " k # X λi x = (1 − λ ) x + λ x : k+1 s i k+1 k+1 i=1 Since the sum in the quare brackets belongs to C by our induction assumption, x belongs to C. The “affine part" can be proved in the same way. The only difference is that we start with indexing the points xi in such a way that λk+1 6= 1 (if this is not possible, we are in a trivial case). It is easy to see that the set of all convex combinations of elements of fx; yg is the segment [x; y], and the set of all affine combinations of elements of fx; yg is the line xy!. Observation 0.7. A convex/affine combination of convex/affine combinations of elements of A is a convex/affine combination of elements of A. Fact 0.8. Let X be a normed linear space, x; y; z 2 X, z 2 (x; y). Then kz−yk kx−zk kx − yk = kx − zk + kz − yk and z = kx−yk x + kx−yk y : Proof. We have z = (1 − t)x + ty for some t 2 (0; 1). Then z − x = t(y − x) and kz−xk kz−yk z − y = (1 − t)(x − y). Passing to norms we get t = ky−xk and 1 − t = kx−yk . Now the two formulas easily follow. Hulls. It is an easy but important observation that the intersection of any family of linear/affine/convex sets is again a linear/affine/convex set. (The same does not hold for unions, but does holds for linearly ordered unions.) Given a set A ⊂ X, the intersection of all linear sets containing A is the linear hull of A, denoted by span(A). Analogously, we can define the affine hull of A as the intersection of all affine sets containing A, and the convex hull of A as the intersection of all convex sets containing A. The affine and the convex hull of A will be denoted by aff(A) and conv(A) ; respectively. Obviously, A is linear if and only if span(A) = A; A is affine if and only if aff(A) = A; A is convex if and only if conv(A) = A. It is a well known fact that the linear hull of a set A coincides with the set of all linear combinations of elements of A. The following theorem states that analogous properties hold for convex hulls and for affine hulls as well. Theorem 0.9. Let A be a set in a vector space X. Then conv(A) = fx 2 X : x is a convex combination of elements of Ag ; aff(A) = fx 2 X : x is an affine combination of elements of Ag : 4 Proof. Let us prove the first formula (the second one is analogous). By Obser- vation 0.7, the set C of all convex combinations of points of A is convex; thus conv(A) ⊂ C. On the other hand, any point x 2 C, being a convex combination of points of conv(A), belongs to conv(A) by Proposition 0.6. Let A be an affine set in a vector space X of a finite dimension d and let x 2 aff(A). By translation, we can suppose that 0 2 A. In this case, x belongs to the linear hull of A, and hence it is a linear combination of at most d elements of A: d X x = λixi where λi 2 R; xi 2 A: i=1 Since 0 2 A, we can write x as an affine combination of d + 1 points of A: d X Pn x = λ0 · 0 + λixi with λ0 = 1 − 1 λj. i=1 Thus we have proved that, in an d-dimensional vector space, every point of the affine hull of a set is an affine combination of d + 1 or fewer points of A. The following important theorem shows that a similar result holds for convex hulls as well. Theorem 0.10 (Carath´eodory). Let A be a subset of a d-dimensional vector space X. Then conv(A) = fx 2 X : x is a convex combination of d + 1 or fewer points of Ag : Proof.
Load more

Recommended publications
  • Sharp Finiteness Principles for Lipschitz Selections: Long Version
    Sharp finiteness principles for Lipschitz selections: long version By Charles Fefferman Department of Mathematics, Princeton University, Fine Hall Washington Road, Princeton, NJ 08544, USA e-mail: [email protected] and Pavel Shvartsman Department of Mathematics, Technion - Israel Institute of Technology, 32000 Haifa, Israel e-mail: [email protected] Abstract Let (M; ρ) be a metric space and let Y be a Banach space. Given a positive integer m, let F be a set-valued mapping from M into the family of all compact convex subsets of Y of dimension at most m. In this paper we prove a finiteness principle for the existence of a Lipschitz selection of F with the sharp value of the finiteness number. Contents 1. Introduction. 2 1.1. Main definitions and main results. 2 1.2. Main ideas of our approach. 3 2. Nagata condition and Whitney partitions on metric spaces. 6 arXiv:1708.00811v2 [math.FA] 21 Oct 2017 2.1. Metric trees and Nagata condition. 6 2.2. Whitney Partitions. 8 2.3. Patching Lemma. 12 3. Basic Convex Sets, Labels and Bases. 17 3.1. Main properties of Basic Convex Sets. 17 3.2. Statement of the Finiteness Theorem for bounded Nagata Dimension. 20 Math Subject Classification 46E35 Key Words and Phrases Set-valued mapping, Lipschitz selection, metric tree, Helly’s theorem, Nagata dimension, Whitney partition, Steiner-type point. This research was supported by Grant No 2014055 from the United States-Israel Binational Science Foundation (BSF). The first author was also supported in part by NSF grant DMS-1265524 and AFOSR grant FA9550-12-1-0425.
    [Show full text]
  • The Continuity of Additive and Convex Functions, Which Are Upper Bounded
    THE CONTINUITY OF ADDITIVE AND CONVEX FUNCTIONS, WHICH ARE UPPER BOUNDED ON NON-FLAT CONTINUA IN Rn TARAS BANAKH, ELIZA JABLO NSKA,´ WOJCIECH JABLO NSKI´ Abstract. We prove that for a continuum K ⊂ Rn the sum K+n of n copies of K has non-empty interior in Rn if and only if K is not flat in the sense that the affine hull of K coincides with Rn. Moreover, if K is locally connected and each non-empty open subset of K is not flat, then for any (analytic) non-meager subset A ⊂ K the sum A+n of n copies of A is not meager in Rn (and then the sum A+2n of 2n copies of the analytic set A has non-empty interior in Rn and the set (A − A)+n is a neighborhood of zero in Rn). This implies that a mid-convex function f : D → R, defined on an open convex subset D ⊂ Rn is continuous if it is upper bounded on some non-flat continuum in D or on a non-meager analytic subset of a locally connected nowhere flat subset of D. Let X be a linear topological space over the field of real numbers. A function f : X → R is called additive if f(x + y)= f(x)+ f(y) for all x, y ∈ X. R x+y f(x)+f(y) A function f : D → defined on a convex subset D ⊂ X is called mid-convex if f 2 ≤ 2 for all x, y ∈ D. Many classical results concerning additive or mid-convex functions state that the boundedness of such functions on “sufficiently large” sets implies their continuity.
    [Show full text]
  • Discrete Analytic Convex Geometry Introduction
    Discrete Analytic Convex Geometry Introduction Martin Henk Otto-von-Guericke-Universit¨atMagdeburg Winter term 2012/13 webpage CONTENTS i Contents Preface ii 0 Some basic and convex facts1 1 Support and separate5 2 Radon, Helly, Caratheodory and (a few) relatives9 Index 11 ii CONTENTS Preface The material presented here is stolen from different excellent sources: • First of all: A manuscript of Ulrich Betke on convexity which is partially based on lecture notes given by Peter McMullen. • The inspiring books by { Alexander Barvinok, "A course in Convexity" { G¨unter Ewald, "Combinatorial Convexity and Algebraic Geometry" { Peter M. Gruber, "Convex and Discrete Geometry" { Peter M. Gruber and Cerrit G. Lekkerkerker, "Geometry of Num- bers" { Jiri Matousek, "Discrete Geometry" { Rolf Schneider, "Convex Geometry: The Brunn-Minkowski Theory" { G¨unter M. Ziegler, "Lectures on polytopes" • and some original papers !! and they are part of lecture notes on "Discrete and Convex Geometry" jointly written with Maria Hernandez Cifre but not finished yet. Some basic and convex facts 1 0 Some basic and convex facts n 0.1 Notation. R = x = (x1; : : : ; xn)| : xi 2 R denotes the n-dimensional Pn Euclidean space equipped with the Euclidean inner product hx; yi = i=1 xi yi, n p x; y 2 R , and the Euclidean norm jxj = hx; xi. 0.2 Definition [Linear, affine, positive and convex combination]. Let m 2 n N and let xi 2 R , λi 2 R, 1 ≤ i ≤ m. Pm i) i=1 λi xi is called a linear combination of x1;:::; xm. Pm Pm ii) If i=1 λi = 1 then i=1 λi xi is called an affine combination of x1; :::; xm.
    [Show full text]
  • On Modified L 1-Minimization Problems in Compressed Sensing Man Bahadur Basnet Iowa State University
    Iowa State University Capstones, Theses and Graduate Theses and Dissertations Dissertations 2013 On Modified l_1-Minimization Problems in Compressed Sensing Man Bahadur Basnet Iowa State University Follow this and additional works at: https://lib.dr.iastate.edu/etd Part of the Applied Mathematics Commons, and the Mathematics Commons Recommended Citation Basnet, Man Bahadur, "On Modified l_1-Minimization Problems in Compressed Sensing" (2013). Graduate Theses and Dissertations. 13473. https://lib.dr.iastate.edu/etd/13473 This Dissertation is brought to you for free and open access by the Iowa State University Capstones, Theses and Dissertations at Iowa State University Digital Repository. It has been accepted for inclusion in Graduate Theses and Dissertations by an authorized administrator of Iowa State University Digital Repository. For more information, please contact [email protected]. On modified `-one minimization problems in compressed sensing by Man Bahadur Basnet A dissertation submitted to the graduate faculty in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY Major: Mathematics (Applied Mathematics) Program of Study Committee: Fritz Keinert, Co-major Professor Namrata Vaswani, Co-major Professor Eric Weber Jennifer Davidson Alexander Roitershtein Iowa State University Ames, Iowa 2013 Copyright © Man Bahadur Basnet, 2013. All rights reserved. ii DEDICATION I would like to dedicate this thesis to my parents Jaya and Chandra and to my family (wife Sita, son Manas and daughter Manasi) without whose support, encouragement and love, I would not have been able to complete this work. iii TABLE OF CONTENTS LIST OF TABLES . vi LIST OF FIGURES . vii ACKNOWLEDGEMENTS . viii ABSTRACT . x CHAPTER 1. INTRODUCTION .
    [Show full text]
  • Non-Linear Inner Structure of Topological Vector Spaces
    mathematics Article Non-Linear Inner Structure of Topological Vector Spaces Francisco Javier García-Pacheco 1,*,† , Soledad Moreno-Pulido 1,† , Enrique Naranjo-Guerra 1,† and Alberto Sánchez-Alzola 2,† 1 Department of Mathematics, College of Engineering, University of Cadiz, 11519 Puerto Real, CA, Spain; [email protected] (S.M.-P.); [email protected] (E.N.-G.) 2 Department of Statistics and Operation Research, College of Engineering, University of Cadiz, 11519 Puerto Real (CA), Spain; [email protected] * Correspondence: [email protected] † These authors contributed equally to this work. Abstract: Inner structure appeared in the literature of topological vector spaces as a tool to charac- terize the extremal structure of convex sets. For instance, in recent years, inner structure has been used to provide a solution to The Faceless Problem and to characterize the finest locally convex vector topology on a real vector space. This manuscript goes one step further by settling the bases for studying the inner structure of non-convex sets. In first place, we observe that the well behaviour of the extremal structure of convex sets with respect to the inner structure does not transport to non-convex sets in the following sense: it has been already proved that if a face of a convex set intersects the inner points, then the face is the whole convex set; however, in the non-convex setting, we find an example of a non-convex set with a proper extremal subset that intersects the inner points. On the opposite, we prove that if a extremal subset of a non-necessarily convex set intersects the affine internal points, then the extremal subset coincides with the whole set.
    [Show full text]
  • Subspace Concentration of Geometric Measures
    Subspace Concentration of Geometric Measures vorgelegt von M.Sc. Hannes Pollehn geboren in Salzwedel von der Fakultät II - Mathematik und Naturwissenschaften der Technischen Universität Berlin zur Erlangung des akademischen Grades Doktor der Naturwissenschaften – Dr. rer. nat. – genehmigte Dissertation Promotionsausschuss: Vorsitzender: Prof. Dr. John Sullivan Gutachter: Prof. Dr. Martin Henk Gutachterin: Prof. Dr. Monika Ludwig Gutachter: Prof. Dr. Deane Yang Tag der wissenschaftlichen Aussprache: 07.02.2019 Berlin 2019 iii Zusammenfassung In dieser Arbeit untersuchen wir geometrische Maße in zwei verschiedenen Erweiterungen der Brunn-Minkowski-Theorie. Der erste Teil dieser Arbeit befasst sich mit Problemen in der Lp-Brunn- Minkowski-Theorie, die auf dem Konzept der p-Addition konvexer Körper ba- siert, die zunächst von Firey für p ≥ 1 eingeführt und später von Lutwak et al. für alle reellen p betrachtet wurde. Von besonderem Interesse ist das Zusammen- spiel des Volumens und anderer Funktionale mit der p-Addition. Bedeutsame ofene Probleme in diesem Setting sind die Gültigkeit von Verallgemeinerungen der berühmten Brunn-Minkowski-Ungleichung und der Minkowski-Ungleichung, insbesondere für 0 ≤ p < 1, da die Ungleichungen für kleinere p stärker werden. Die Verallgemeinerung der Minkowski-Ungleichung auf p = 0 wird als loga- rithmische Minkowski-Ungleichung bezeichnet, die wir hier für vereinzelte poly- topale Fälle beweisen werden. Das Studium des Kegelvolumenmaßes konvexer Körper ist ein weiteres zentrales Thema in der Lp-Brunn-Minkowski-Theorie, das eine starke Verbindung zur logarithmischen Minkowski-Ungleichung auf- weist. In diesem Zusammenhang stellen sich die grundlegenden Fragen nach einer Charakterisierung dieser Maße und wann ein konvexer Körper durch sein Kegelvolumenmaß eindeutig bestimmt ist. Letzteres ist für symmetrische konve- xe Körper unbekannt, während das erstere Problem in diesem Fall gelöst wurde.
    [Show full text]
  • The Convex Hull Problem in Practice Improving the Running Time of the Double Description Method
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by E-LIB Dokumentserver - Staats und Universitätsbibliothek Bremen e x3 a h x2 d x1 f b g c The Convex Hull Problem in Practice Improving the Running Time of the Double Description Method Dissertation zur Erlangung des akademischen Grades eines Doktors der Ingenieurwissenschaften - Dr.-Ing. - vorgelegt von Blagoy Genov Fachbereich 3: Mathematik und Informatik The Convex Hull Problem in Practice Improving the Running Time of the Double Description Method Dissertation zur Erlangung des akademischen Grades eines Doktors der Ingenieurwissenschaften - Dr.-Ing. - vorgelegt von Blagoy Genov im Fachbereich 3 (Informatik/Mathematik) der Universit¨atBremen im Juli 2014 Tag der m¨undlichen Pr¨ufung:28. Januar 2015 Gutachter: Prof. Dr. Jan Peleska (Universit¨atBremen) Prof. Dr. Udo Frese (Universit¨atBremen) Erkl¨arung Ich versichere, dass ich die von mir vorgelegte Dissertation selbst¨andigund ohne uner- laubte fremde Hilfe angefertigt habe, dass ich alle benutzen Quellen und Hilfsmittel vollst¨andigangegeben habe und dass alle Stellen, die ich w¨ortlich oder dem Sinne nach aus anderen Arbeiten entnommen habe, kenntlich gemacht worden sind. Ort, Datum Unterschrift 3 Zusammenfassung Die Double-Description-Methode ist ein weit verbreiteter Algorithmus zur Berechnung von konvexen H¨ullenund anderen verwandten Problemen. Wegen seiner unkomplizierten Umsetzung wird er oft in der Praxis bevorzugt, obwohl seine Laufzeitkomplexit¨atnicht durch die Gr¨oßeder Ausgabe beeinflusst wird. Aufgrund seiner zunehmenden Bedeutung in der Programmverifikation und der Analyse von metabolischen Netzwerken ist der Bedarf nach schnellen und zuverl¨assigen Implementierungen in den letzten Jahren rasant gestiegen. Bei den aktuellen Anwendungen besteht erhebliches Potenzial zur Verk¨urzung der Rechenzeit.
    [Show full text]
  • On Cutting Planes*
    Annals of Discrete Mathematics 9 (1980) 291-296 © North-Holland Publishing Company ON CUTTING PLANES* A. SCHRIJVER Department of Mathematics, Eindhoven University of Technology, P.O. Box 513, Eindhoven, The Netherlands, and Mathematical Centre, Kruislaan 413, Amsterdam, The Netherlands We give a geometrical description of Chvatal's version of Gomory's cutting plane method. Restricting ourselves to rational spaces, we prove that the derived geometrical objects are polyhedra again, and that the method also works for unbounded polyhedra. 1. Introduction For any polyhedron P let P1 denote the convex hull of the lattice points contained in P. 1 If H is the half-space {x I wx,;;;; d}, where w is a vector whose components are relatively prime integers and d is a rational number, then one easily sees that H1 ={x I wx:;;;; LdJ}. Geometrically, H1 arises by shifting H until its bounding hyperplane contains lattice points. So for half-spaces H there is an easy way to determine H1. Since for each half-space H, the inclusion Pc H implies that Pr c Hr, we know that (1) where the intersection ranges over all half-spaces H with Pc H. We denote this intersection by P'. Below we show that P' is a polyhedron again, and that p<•> = P1 for some natural number t. (As usual, p<0> = P, and p(r+ll = p(•l'.) This is the essence of Chvatal's [1] formalization of Gomory's [4, 5, 6] cutting plane method for solving integer linear programming problems (cf. Rosenberg [11]). Chvatal's original method applies to bounded polyhedra in real space.
    [Show full text]
  • Notes, We Review Useful Concepts in Convexity and Normed Spaces
    Mastermath, Spring 2019 Lecturers: D. Dadush, J. Briet Geometric Functional Analysis Lecture 0 Scribe: D. Dadush Review of Convexity and Normed Spaces In these notes, we review useful concepts in convexity and normed spaces. As a warning, many of the statements made here will not be proved. For detailed proofs, one is recommended to look up reference books in functional and convex analysis. The intent here is for these notes to serve as a reference for the basic language for the course. The reader may thus skim the material upon first reading, and then reread more carefully later during the course if the relevant concepts remain unclear. 1 Basic Convexity In this section, we will focus on convexity theorems in a finite dimensional real vector space, which will identify with Rn or subspaces theoreof. For vectors x, y 2 Rn, we define the standard T n n inner product hx, yi := x y = ∑i=1 xiyi. For two sets A, B ⊆ R and scalars c, d 2 R, we define the Minkowski sum cA + dB = fca + db : a 2 A, b 2 Bg. A convex set K ⊆ Rn is a set for which the line segment between any two points is in the set, or formally for which 8x, y 2 K, l 2 [0, 1], lx + (1 − l)y 2 K. A useful equivalent definition is that a non-empty set K is convex if 8a, b ≥ 0, aK + bK = (a + b)K. If K = −K, K is said to be symmetric. If K is compact with non-empty interior, then K is a convex body.
    [Show full text]
  • Lecture Slides on Convex Analysis And
    LECTURE SLIDES ON CONVEX ANALYSIS AND OPTIMIZATION BASED ON 6.253 CLASS LECTURES AT THE MASS. INSTITUTE OF TECHNOLOGY CAMBRIDGE, MASS SPRING 2014 BY DIMITRI P. BERTSEKAS http://web.mit.edu/dimitrib/www/home.html Based on the books 1) “Convex Optimization Theory,” Athena Scien- tific, 2009 2) “Convex Optimization Algorithms,” Athena Sci- entific, 2014 (in press) Supplementary material (solved exercises, etc) at http://www.athenasc.com/convexduality.html LECTURE 1 AN INTRODUCTION TO THE COURSE LECTURE OUTLINE The Role of Convexity in Optimization • Duality Theory • Algorithms and Duality • Course Organization • HISTORY AND PREHISTORY Prehistory: Early 1900s - 1949. • Caratheodory, Minkowski, Steinitz, Farkas. − Properties of convex sets and functions. − Fenchel - Rockafellar era: 1949 - mid 1980s. • Duality theory. − Minimax/game theory (von Neumann). − (Sub)differentiability, optimality conditions, − sensitivity. Modern era - Paradigm shift: Mid 1980s - present. • Nonsmooth analysis (a theoretical/esoteric − direction). Algorithms (a practical/high impact direc- − tion). A change in the assumptions underlying the − field. OPTIMIZATION PROBLEMS Generic form: • minimize f(x) subject to x C ∈ Cost function f : n , constraint set C, e.g., ℜ 7→ ℜ C = X x h1(x) = 0,...,hm(x) = 0 ∩ | x g1(x) 0,...,gr(x) 0 ∩ | ≤ ≤ Continuous vs discrete problem distinction • Convex programming problems are those for which• f and C are convex They are continuous problems − They are nice, and have beautiful and intu- − itive structure However, convexity permeates
    [Show full text]
  • Ee364a Review Session 1
    EE364a Review EE364a Review Session 1 administrative info: • office hours: tue 4-6pm, wed 4-8pm, packard 277 • review session: example problems and hw hints • homeworks due thursdays by 5pm • staff email: ee364a-win0708-staff@lists.stanford.edu 1 Combinations and hulls y = θ1x1 + ··· + θkxk is a • linear combination of x1,..., xk • affine combination if i θi =1 P • convex combination if i θi =1, θi ≥ 0 P • conic combination if θi ≥ 0 (linear, affine, . ) hull of S = {x1,...,xk} is a set of all (linear, affine, . ) combinations from S linear hull: span(S) affine hull: aff(S) convex hull: conv(S) conic hull: cone(S) EE364a Review Session 1 2 example: a few simple relations: conv(S) ⊆ aff(S) ⊆ span(S), conv(S) ⊆ cone(S) ⊆ span(S). example: S = {(1, 0, 0), (0, 1, 0), (0, 0, 1)}⊆ R3 what is the linear hull? affine hull? convex hull? conic hull? • linear hull: R3. • affine hull: hyperplane passing through (1, 0, 0), (0, 1, 0), (0, 0, 1). • convex hull: triangle with vertices at (1, 0, 0), (0, 1, 0), (0, 0, 1). 3 • conic hull: R+ EE364a Review Session 1 3 Important rules • intersection subspace subspace affine affine Sα is for α ∈ A =⇒ Sα is convex \ convex α∈A convex cone convex cone example: a polyhedron is intersection of a finite number of halfspaces and hyperplanes. • functions that preserve convexity examples: affine, perspective, and linear fractional functions. if C is convex, and f is an affine/perspective/linear fractional function, then f(C) is convex and f −1(C) is convex.
    [Show full text]
  • Convex Sets, Convex Functions, & Some of Their Properties. (Part I)
    Convex sets, convex functions, & some of their properties. (Part I) John MacLaren Walsh, Ph.D. April 16, 2014 1 References • S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge Univ. Press, 2004. • R. T. Rockafellar, Convex Analysis, Princeton Univ. Press, 1970. The material in this lecture follows the first three chapters of these two books closely, as well as several other chapters from Rockafellar. 2 Affine Sets, Affine Hulls, & Dimension N Consider two points x1; x2 2 R ; x1 6= x2. The line through these two points may be represented as fθx1 +(1−θ)x2jθ 2 Rg. A set A ⊂ RN is affine if the line through any two points in A is itself in A. In other words, A is affine if whenever x1; x2 2 A, θx1 + (1 − θ)x2 2 A for all θ 2 R. More generally, an affine set contains all affine combinations of its points, in that if x1;:::; xn 2 A for an affine set A, then n n X X θixi 2 A 8(θ1; : : : ; θn) such that θi = 1 (1) i=1 i=1 Affine sets containing the origin 0 are vector subspaces (observe that they contain all linear combinations of points within them by including 0 in an associated affine combination). Two affine sets A1 and A2 are said to be parallel if there exists a vector x such that A2 = A1 − x. Every affine set A is parallel to a unique vector subspace, which may be found as A − x0, for any x0 2 A. To see this, observe that the new set will again be affine and will now contain 0.
    [Show full text]