Lecture 1: Affine Subspaces, Affine Combinations, Convex Sets, Convex Combinations

Total Page:16

File Type:pdf, Size:1020Kb

Lecture 1: Affine Subspaces, Affine Combinations, Convex Sets, Convex Combinations LECTURE 1: AFFINE SUBSPACES, AFFINE COMBINATIONS, CONVEX SETS, CONVEX COMBINATIONS In this lecture we introduce the basic concepts used throughout the semester. We deal with only nite dimensional Euclidean spaces. We regard an n-dimensional Euclidean spaces as an ane space whose vectors are the elements of the n-dimensional vector space Rn over the set of real numbers. Fixing an arbitrary point of an ane space, the elements of the corresponding vector space and the points of the space can be identied in a natural way, in which a point is associated to the vector that moves the xed point to this one. In this case the xed point is usually called origin. As it often appears in the literature, during the term we identify the Euclidean space with the vector space Rn (in high school language: we identify points and their position vectors). We will usually denote the points/vectors of the space Rn by small Latin letters, while its subsets by capital Latin letters. We denote the usual inner (scalar) product of Rn by h:; :i. The length p jjvjj of a vector v 2 Rn is the quantity hv; vi. For the coordinates of the vector/point v in the standard orthonormal basis of Rn we use the notation v = (v1; v2; : : : ; vn). We denote the origin by o. The distance of the points and 0 0 0 , denoted p = (x1; x2; : : : ; xn) q = (x1; x2; : : : ; xn) r n by , is the quantity P 0 2, which coincides with the dist(p; q) (xi − xi) i=1 value of jjq − pjj. The interior, boundary, closure and cardinality of a set X ⊆ Rn will be denoted by int(X); bd(X); cl(X); jXj, respectively. Denition 1. Let and be two point sets, and . Then V1 V2 λ 2 R V1 + V2 = fv1 + v2 : v1 2 V1; v2 2 V2g is called the Minkowski sum of the two sets, and λV1 = fλv1 : v1 2 V1g the multiple of V1 by λ. Denition 2. Let p 2 Rn be an arbitrary point, and L and arbitrary (linear) subspace in the vector space Rn. Then the set p + L ⊆ Rn is called an ane subspace of the space Rn. 1 2 The next remark is a straightforward consequence of the properties of linear subspaces. Remark 1. Let p; q 2 Rn and let L; L0 be linear subspaces in Rn. Then p + L = q + L0 is satised if and only if L = L0 and q 2 p + L. Proof. Assume that p + L = q + L0. Then L = (q − p) + L0 by the denition of Minkowski sum, which yields, in particular, that q−p 2 L, from which we have q 2 p + L. But as linear subspaces are closed with respect to addition, q − p 2 L implies (q − p) + L = L, from which (q − p) + L = (q − p) + L0, yielding L = L0. On the other hand, if q 2 p + L, then (q − p) 2 L =) (q − p) + L = L =) q + L = p + L. 2 Theorem 1. A nonempty intersection of ane subspaces is an ane subspace. Proof. Consider the ane subspaces Ai (i 2 I), where I is an arbitrary T index set. Let A = Ai. Consider a point p 2 A. Then, due to the i2I previous remark, for any i 2 I we have Ai = p + Li for some suitable linear subspace of n. The intersection of linear subspaces is a linear Li R T subspace, and thus, L = Li is a linear subspace. On the other hand, i2I we clearly have A = p + L, from which the assertion follows. 2 By the dimension of an ane subspace we mean the dimension of the corresponding linear subspace. We call the 0-, 1-, 2-, (n − 1)- dimensional subspaces points, lines, planes and hyperplanes. The next property readiéy follows from the denition of ane subspaces and the properties of inner product. Remark 2. If u 2 Rn and t 2 R arbitrary, then the set fv 2 Rn : hv; ui = tg is a hyperplane. Furthermore, for any hyperplane H there is some vector u 2 Rn and scalar t 2 R for which H = fv 2 Rn : hv; ui = tg. Since inner product is a continuous map from Rn to R, the previous remark implies that for any hyperplane H decomposes the space into two connected, open components, which we call open half spaces. The unions of open half spaces with the bounding hyperplane we call closed half spaces. Denition 3. Let G1 = p1 + L1 and G2 = p2 + L2 be ane subspaces. If for any vectors v1 2 L1, v2 2 L2 we have hv1; v2i = 0, then we say that G1 and G2 are perpendicular or orthogonal. Two ane subspaces are parallel, if they can be written in the form p1 +L and p2 +L, where L is a linear subspace. 3 Denition 4. Let X ⊂ Rn be a nonempty set. Then the ane hull of X, denoted by aff(X), is dened as the intersection of all ane subspaces containing X. The linear hull of X is dened as the ane hull aff(X [ fog). We denote the linear hull of X by lin(X). The relative interior and relative boundary of X is dened as the interior and boundary of X, respectively, with respect to the induced topology in aff(X). We denote them by relint(X) and relbd(X), respectively. We remark that by Theorem 1, the ane hull of a set is an ane subspace. Denition 5. A point set X is called anely independent if for any x 2 X we have aff(X n fxg) 6= aff X. The points sets that are not anely independent are called anely dependent. Denition 6. Let n nitely many points, and let p1; p2; : : : ; pk 2 R k be real numbers satisfying P . Then the point λ1; λ2; : : : ; λk 2 R λi = 1 i=1 k P λipi is called an ane combination of the points p1; p2; : : : ; pk. i=1 Proposition 1. The ane hull of a set X is the set of the ane combinations of all nite point sets from X. Proof. Let Y denote the set of all ane combinations of nitely many points in X, and let p 2 X be an arbitrary point. Consider the points and numbers for which p1 = p; p2; : : : ; pk 2 X λ1; λ2; : : : ; λk 2 R Pk is satised. According to our conditions: i=1 λi = 1 k k X X λipi = p1 + λi(pi − p1): i=1 i=1 Thus the ane combination can be written as a translate of the point p with a linear combination of the vectors pi − p. Hence, if L denotes the linear subspace formed by the linear combinations of the vectors q − p, q 2 X, then Y = p + L. As it is clearly an ane subspace, we have aff(X) ⊆ Y . On the other hand, if an ane subspace contains X, then it can be written in the form p + L for some linear subspace L. The subspace L contains all vectors of the form q − p, q 2 L, and thus it contains their linear combinations as well. Hence, p + L contains all ane combinations of points of X in the case that p is one of the points. Since any k-point an combination is also a (k + 1)-point ane combination in which one of the points is p, we have that p + L contains all ane 4 combinations of the points of X. Thus, Y ⊆ p + L, implying Y ⊆ aff(X). 2 Corollary 1. A point set X is anely independent if and only if there is no point of X that can be written as an ane combination of some other points from X. Theorem 2. Let n. Then is anely inde- X = fp1; p2; : : : ; pkg ⊂ R X k k P P pendent if and only if λipi = 0 and λi = 0 implies λi = 0 for all i=1 i=1 values of i. Proof. Assume that a pont, say pk, can be written as an ane com- k−1 k−1 P P bination of the other points; that is, pk = λipi, where λi = 1. i=1 i=1 k k P P Then, setting λk = −1, we have 0 = λipi and λi = 0. i=1 i=1 On the other hand, assume that for some values of the coecients k k−1 P P λi, not all of them zero, we have 0 = λipi and λi = 0. Without i=1 i=1 loss of generality, we may assume that λk 6= 0. For any 1 ≤ i ≤ k − 1, let λ0 = − λi . Then i λk k−1 P k−1 λi X i=1 −λk λ0 = − = − = 1; i λ λ i=1 k k and k−1 k−1 X 1 X 1 λ0 p = − λ p = − (−λ p ) = p ; i i λ i i λ k k k i=1 k i=1 k and the point set is anely dependent. 2 2 Corollary 2. If X ⊂ Rn is anely independent, then every point of aff(X) can be uniquely written as an ane combination of some points in X. Theorem 3. If jXj ≥ n + 2, then X is anely dependent. Proof. Assume that p1; p2; : : : ; pn+2 2 X. Consider the vectors p2 − p1; : : : ; pn+2 − p1. Since the n-dimensional Euclidean space is an n- dimensional vector space, the above vectors are linearly dependent, that is one of them, say pn+2 − p1, can be written as a linear combination n+1 of the other vectors: Pn+1 .
Recommended publications
  • Time Series Prediction for Graphs in Kernel and Dissimilarity Spaces∗†
    Time Series Prediction for Graphs in Kernel and Dissimilarity Spaces∗y Benjamin Paaßen Christina Göpfert Barbara Hammer This is a preprint of the publication [46] as provided by the authors. The original can be found at the DOI 10.1007/s11063-017-9684-5. Abstract Graph models are relevant in many fields, such as distributed com- puting, intelligent tutoring systems or social network analysis. In many cases, such models need to take changes in the graph structure into ac- count, i.e. a varying number of nodes or edges. Predicting such changes within graphs can be expected to yield important insight with respect to the underlying dynamics, e.g. with respect to user behaviour. However, predictive techniques in the past have almost exclusively focused on sin- gle edges or nodes. In this contribution, we attempt to predict the future state of a graph as a whole. We propose to phrase time series prediction as a regression problem and apply dissimilarity- or kernel-based regression techniques, such as 1-nearest neighbor, kernel regression and Gaussian process regression, which can be applied to graphs via graph kernels. The output of the regression is a point embedded in a pseudo-Euclidean space, which can be analyzed using subsequent dissimilarity- or kernel-based pro- cessing methods. We discuss strategies to speed up Gaussian Processes regression from cubic to linear time and evaluate our approach on two well-established theoretical models of graph evolution as well as two real data sets from the domain of intelligent tutoring systems. We find that simple regression methods, such as kernel regression, are sufficient to cap- ture the dynamics in the theoretical models, but that Gaussian process regression significantly improves the prediction error for real-world data.
    [Show full text]
  • Vector Space and Affine Space
    Preliminary Mathematics of Geometric Modeling (1) Hongxin Zhang & Jieqing Feng State Key Lab of CAD&CG Zhejiang University Contents Coordinate Systems Vector and Affine Spaces Vector Spaces Points and Vectors Affine Combinations, Barycentric Coordinates and Convex Combinations Frames 11/20/2006 State Key Lab of CAD&CG 2 Coordinate Systems Cartesian coordinate system 11/20/2006 State Key Lab of CAD&CG 3 Coordinate Systems Frame Origin O Three Linear-Independent r rur Vectors ( uvw ,, ) 11/20/2006 State Key Lab of CAD&CG 4 Vector Spaces Definition A nonempty set ς of elements is called a vector space if in ς there are two algebraic operations, namely addition and scalar multiplication Examples of vector space Linear Independence and Bases 11/20/2006 State Key Lab of CAD&CG 5 Vector Spaces Addition Addition associates with every pair of vectors and a unique vector which is called the sum of and and is written For 2D vectors, the summation is componentwise, i.e., if and , then 11/20/2006 State Key Lab of CAD&CG 6 Vector Spaces Addition parallelogram illustration 11/20/2006 State Key Lab of CAD&CG 7 Addition Properties Commutativity Associativity Zero Vector Additive Inverse Vector Subtraction 11/20/2006 State Key Lab of CAD&CG 8 Commutativity for any two vectors and in ς , 11/20/2006 State Key Lab of CAD&CG 9 Associativity for any three vectors , and in ς, 11/20/2006 State Key Lab of CAD&CG 10 Zero Vector There is a unique vector in ς called the zero vector and denoted such that for every vector 11/20/2006 State Key Lab of CAD&CG 11 Additive
    [Show full text]
  • Handbook of Generalized Convexity and Generalized Monotonicity Nonconvex Optimization and Its Applications Volume 76
    Handbook of Generalized Convexity and Generalized Monotonicity Nonconvex Optimization and Its Applications Volume 76 Managing Editor: Panos Pardalos University of Florida, U.S.A. Advisory Board: J. R. Birge University of Michigan, U.S.A. Ding-Zhu Du University of Minnesota, U.S.A. C. A. Floudas Princeton University, U.S.A. J. Mockus Lithuanian Academy of Sciences, Lithuania H. D. Sherali Virginia Polytechnic Institute and State University, U.S.A. G. Stavroulakis Technical University Braunschweig, Germany H. Tuy National Centre for Natural Science and Technology, Vietnam Handbook of Generalized Convexity and Generalized Monotonicity Edited by NICOLAS HADJISAVVAS University of Aegean SÁNDOR KOMLÓSI University of Pécs SIEGFRIED SCHAIBLE University of California at Riverside Springer eBook ISBN: 0-387-23393-8 Print ISBN: 0-387-23255-9 ©2005 Springer Science + Business Media, Inc. Print ©2005 Springer Science + Business Media, Inc. Boston All rights reserved No part of this eBook may be reproduced or transmitted in any form or by any means, electronic, mechanical, recording, or otherwise, without written consent from the Publisher Created in the United States of America Visit Springer's eBookstore at: http://ebooks.kluweronline.com and the Springer Global Website Online at: http://www.springeronline.com Contents Preface vii Contributing Authors xvii Part I GENERALIZED CONVEXITY 1 Introduction to Convex and Quasiconvex Analysis 3 Johannes B. G. Frenk, Gábor Kassay 2 Criteria for Generalized Convexity and Generalized Monotonicity 89 in the Differentiable
    [Show full text]
  • Proquest Dissertations
    u Ottawa L'Universitd canadienne Canada's university FACULTE DES ETUDES SUPERIEURES l==I FACULTY OF GRADUATE AND ET POSTOCTORALES U Ottawa POSDOCTORAL STUDIES L'Universit6 canadienne Canada's university Guy Beaulieu "MEWDE"UATH£S17XUTHORWTHE"STS" Ph.D. (Mathematics) GRADE/DEGREE Department of Mathematics and Statistics 7ACulTirfc6L17bT^ Probabilistic Completion of Nondeterministic Models TITRE DE LA THESE / TITLE OF THESIS Philip Scott DIREWEURlbTRECTRicirDE'iSTHESE"/ THESIS SUPERVISOR EXAMINATEURS (EXAMINATRICES) DE LA THESE /THESIS EXAMINERS Richard Blute _ _ Paul-Eugene Parent Michael Mislove Benjamin Steinberg G ^y.W:.Slater.. Le Doyen de la Faculte des etudes superieures et postdoctorales / Dean of the Faculty of Graduate and Postdoctoral Studies PROBABILISTIC COMPLETION OF NONDETERMINISTIC MODELS By Guy Beaulieu, B.Sc, M.S. Thesis submitted to the Faculty of Graduate and Postdoctoral Studies University of Ottawa in partial fulfillment of the requirements for the PhD degree in the Ottawa-Carleton Institute for Graduate Studies and Research in Mathematics and Statistics ©2008 Guy Beaulieu, B.Sc, M.S. Library and Bibliotheque et 1*1 Archives Canada Archives Canada Published Heritage Direction du Branch Patrimoine de I'edition 395 Wellington Street 395, rue Wellington Ottawa ON K1A0N4 Ottawa ON K1A0N4 Canada Canada Your file Votre reference ISBN: 978-0-494-48387-9 Our file Notre reference ISBN: 978-0-494-48387-9 NOTICE: AVIS: The author has granted a non­ L'auteur a accorde une licence non exclusive exclusive license allowing Library
    [Show full text]
  • Linear Algebra II
    Linear Algebra II Peter Philip∗ Lecture Notes Originally Created for the Class of Spring Semester 2019 at LMU Munich Includes Subsequent Corrections and Revisions† September 19, 2021 Contents 1 Affine Subspaces and Geometry 4 1.1 AffineSubspaces ............................... 4 1.2 AffineHullandAffineIndependence . 6 1.3 AffineBases.................................. 10 1.4 BarycentricCoordinates and Convex Sets. ..... 12 1.5 AffineMaps .................................. 14 1.6 AffineGeometry................................ 20 2 Duality 22 2.1 LinearFormsandDualSpaces. 22 2.2 Annihilators.................................. 27 2.3 HyperplanesandLinearSystems . 31 2.4 DualMaps................................... 34 3 Symmetric Groups 38 ∗E-Mail: [email protected] †Resources used in the preparation of this text include [Bos13, For17, Lan05, Str08]. 1 CONTENTS 2 4 Multilinear Maps and Determinants 46 4.1 MultilinearMaps ............................... 46 4.2 Alternating Multilinear Maps and Determinants . ...... 49 4.3 DeterminantsofMatricesandLinearMaps . .... 57 5 Direct Sums and Projections 71 6 Eigenvalues 76 7 Commutative Rings, Polynomials 87 8 CharacteristicPolynomial,MinimalPolynomial 106 9 Jordan Normal Form 119 10 Vector Spaces with Inner Products 136 10.1 Definition,Examples . 136 10.2 PreservingNorm,Metric,InnerProduct . 138 10.3Orthogonality .................................145 10.4TheAdjointMap ...............................152 10.5 Hermitian,Unitary,andNormalMaps . 158 11 Definiteness of Quadratic Matrices over K 172 A Multilinear Maps 175 B Polynomials in Several Variables 176 C Quotient Rings 192 D Algebraic Field Extensions 199 D.1 BasicDefinitionsandProperties . 199 D.2 AlgebraicClosure...............................205 CONTENTS 3 References 212 1 AFFINE SUBSPACES AND GEOMETRY 4 1 Affine Subspaces and Geometry 1.1 Affine Subspaces Definition 1.1. Let V be a vector space over the field F . Then M V is called an affine subspace of V if, and only if, there exists a vector v V and a (vector)⊆ subspace U V such that M = v + U.
    [Show full text]
  • Affine and Convex Spaces
    Tech. rep. Perimeter Institute pi-other-212 Affine and convex spaces blending the analytic and geometric viewpoints P.G.L. Porta Mana <pgl portamana.org> 25 April 2011; updated 12 February 2019 This is a short introduction to affine and convex spaces, written especially for physics students. It summarizes different elementary presentations available in the mathematical literature, and blends analytic- and geometric-flavoured presentations. References are also provided, as well as a brief discussion of Grassmann spaces and an example showing the relevance and usefulness of affine spaces in Newtonian physics. pacs: 02.40.Dr,02.40.Ft,45.20.-d msc: 14R99,51N10,52A20 to Louise 1 Spaces that deserve more space Scientists and science students of different fields are very familiar, in various degrees of sophistication, with vector spaces. Vectors are used to model places, velocities, forces, generators of rotations, electric fields, and even quantum states. Vector spaces are among the building blocks of clas- sical mechanics, electromagnetism, general relativity, quantum theory; they constitute therefore an essential part of physics and mathematics teaching. Physicists also like to repeat, with Newton (1726 Liber III, regula I; Truesdell et al. 1960 § 293), a maxim variously attributed (Thorburn 1918) to Ockham or Scotus: “frustra fit per plura quod fieri potest per arXiv:1104.0032v2 [physics.class-ph] 10 Feb 2019 pauciora”. Applied to the connexion between mathematics and physics, it says that we should not model a physical phenomenon by means of a mathematical object that has more structure than the phenomenon itself. But this maxim is forsaken in the case of vector spaces, for they are sometimes used where other spaces, having less structure, would suffice.
    [Show full text]
  • Chapter 2 Basics of Affine Geometry
    Chapter 2 Basics of Affine Geometry 2.1 Affine Spaces Suppose we have a particle moving in 3-space and that we want to describe the trajectory of this particle. If one looks up a good textbook on dynamics, such as Greenwood [?], one finds out that the particle is mod- eled as a point, and that the position of this point x is determined with respect to a frame in R3 by a vector. Aframeisapair (O, (e1,e2,e3)) consisting of an origin O (which is a point) together with abasisofthreevectors(e1,e2,e3). 15 16 CHAPTER 2. BASICS OF AFFINE GEOMETRY For example, the standard frame in R3 has origin O =(0, 0, 0) and the basis of three vectors e1 =(1, 0, 0), e2 =(0, 1, 0), and e3 =(0, 0, 1). The position of a point x is then defined by the “unique vector” from O to x. But wait a minute, this definition seems to be defining frames and the position of a point without defining what apointis! Well, let us identify points with elements of R3. If so, given any two points a =(a1,a2,a3)and b =(b1,b2,b3), there is a unique free vector denoted ab from a to b,thevectorab =(b a ,b a ,b a ). 1 − 1 2 − 2 3 − 3 Note that b = a + ab, addition being understood as addition in R3. 2.1. AFFINE SPACES 17 b ab a O Figure 2.1: Points and free vectors Then, in the standard frame, given a point x =(x1,x2,x3), the position of x is the vector Ox =(x1,x2,x3), which coincides with the point itself.
    [Show full text]
  • An Introduction to Convexity
    AN INTRODUCTION TO CONVEXITY GEIR DAHL ∗ NOVEMBER 2010 ∗ University of Oslo, Centre of Mathematics for Applications, P.O.Box 1053, Blindern, 0316 Oslo, Norway ([email protected]) Contents 1 The basic concepts 1 1.1 Is convexity useful? 1 1.2 Nonnegative vectors 4 1.3 Linear programming 5 1.4 Convex sets, cones and polyhedra 6 1.5 Linear algebra and affine sets 11 1.6 Exercises 14 2 Convex hulls and Carath´eodory’s theorem 17 2.1 Convex and nonnegative combinations 17 2.2 The convex hull 19 2.3 Affine independence and dimension 22 2.4 Convex sets and topology 24 2.5 Carath´eodory’s theorem and some consequences 29 2.6 Exercises 32 3 Projection and separation 36 3.1 The projection operator 36 3.2 Separation of convex sets 39 3.3 Exercises 45 4 Representation of convex sets 47 4.1 Faces of convex sets 47 4.2 The recession cone 50 4.3 Inner representation and Minkowski’s theorem 53 4.4 Polytopes and polyhedra 56 4.5 Exercises 64 5 Convex functions 67 5.1 Convex functions of one variable 67 5.2 Convex functions of several variables 75 5.3 Continuity and differentiability 81 5.4 Exercises 88 6 Nonlinear and convex optimization 91 6.1 Local and global minimum in convex optimization 91 6.2 Optimality conditions for convex optimization 93 6.3 Feasible direction methods 95 6.4 Nonlinear optimization and Lagrange multipliers 97 6.5 Nonlinear optimization: inequality constraints 101 6.6 An augmented Lagrangian method 106 6.7 Exercises 107 List of Figures 1.1 Some convex functions 2 1.2 Some convex sets in the plane.
    [Show full text]
  • Affine Geometry
    Affine Geometry Jehee Lee Seoul National University Geometric Programming • A way of handling geometric entities such as vectors, points, and transforms. • Traditionally, computer graphics packages are implemented using homogeneous coordinates. • We will review affine geometry and coordinate-invariant geometric programming. Example of coordinate-dependence Point p Point q • What is the “sum” of these two positions ? If you assume coordinates, … p = (x1, y1) q = (x2, y2) • The sum is (x1+x2, y1+y2) – Is it correct ? – Is it geometrically meaningful ? If you assume coordinates, … p = (x1, y1) (x1+x2, y1+y2) q = (x2, y2) Origin • Vector sum – (x1, y1) and (x2, y2) are considered as vectors from the origin to p and q, respectively. If you select a different origin, … p = (x1, y1) (x1+x2, y1+y2) q = (x2, y2) Origin • If you choose a different coordinate frame, you will get a different result Vector and Affine Spaces • Vector space – Includes vectors and related operations – No points • Affine space – Superset of vector space – Includes vectors, points, and related operations Points and Vectors vector (p-q) Point q Point p • A point is a position specified with coordinate values. • A vector is specified as the difference between two points. • If an origin is specified, then a point can be represented by a vector from the origin. • But, a point is still not a vector in a coordinate-free point of view. Vector spaces • A vector space consists of – Set of vectors, together with – Two operations: addition of vectors and multiplication of vectors
    [Show full text]
  • Topic 1: Convex Sets and Functions
    Division of the Humanities and Social Sciences Ec 181 KC Border Convex Analysis and Economic Theory AY 2019–2020 Topic 1: Convex sets and functions 1.1 Convex sets Recall the affine combination function κ: X × X × R → X is defined by κ(x, y, α) = (1 − α)x + αy. 1.1.1 Definition A subset C of a real vector space X is a convex set if it includes the line segment joining any two of its points. That is, C is convex if for every real α with 0 6 α 6 1 and every x, y ∈ C, (1 − α)x + αy ∈ C. If α = 0 or then (1 − α)x + αy = x and if α = 1, then (1 − α)x + αy = y, so C ⊂ κ C × C × [0, 1] . Thus C is convex ⇐⇒ κ C × C × [0, 1] = C ⇐⇒ κ C × C × (0, 1) ⊂ C. Note that the empty set is convex. 1.1.2 Definition A convex combination is a linear combination αx+βy where > α, β 0 and α + β = 1. More generally, a convex combinationP is a (finite) linear ··· > k combination α1x1 + + αkxk where each αi 0 and i=1 αi = 1. 1.1.3 Lemma If C is convex, then it is closed under general convexP combinations. > ∈ > k That is, for any k 2, if xi C and αi 0, i = 1, . , k, and i=1 αi = 1, then α1x1 + ··· + αkxk ∈ C. 1.1.4 Exercise Prove Lemma 1.1.3. □ Sample answer: We prove this by induction on k. Let P[k] denote the following proposition: ∈ > PIf C is convex, and each xi C and αi 0, for i = 1, .
    [Show full text]
  • Roughly Speaking, Affine Sets Are Vector Spaces Whose Origin We Try
    CONVEX SETS AND CONVEX FUNCTIONS CHEE-HAN TAN Abstract. We define convex sets and convex functions, and explore the intricate relation- ships between these two concepts. The fundamental idea is that convex functions on Rn can be identified with certain convex subsets of Rn+1, while convex sets in Rn can be identified with certain convex functions on Rn. This provides a bridge between a geometric approach and an analytical approach in dealing with convex functions. In particular, one should be acquainted with the geometric connection between convex functions and epigraphs. Preface The structure of these notes follows closely Chapter 1 of the book \Convex Analysis" by R. T. Rockafellar [Roc70]. All the theorems and corollaries are numbered independently of [Roc70], and additional examples or remarks or results from other sources are added as I see fit, mainly to facilitate my understanding. Any mistakes here are of course my own. Please report any typographical errors or mathematical fallacy to me by email. 1. Affine Sets A problem of practical interest is studying geometrical properties of sets of points that are invariant under certain transformations such as translations and rotations. One approach would be to model the space of points as a vector space, but this is not very satisfactory. One reason is that the point corresponds to the zero vector 0, called the origin, plays a special role, when there is really no reason to have a privileged origin [Gal11]. For two distinct points x; y 2 Rn, the set of points of the form (1 − λ)x + λy = x + λ(y − x); λ 2 R; is called the line through x and y.
    [Show full text]
  • Vector and Affine Math
    Vector and Affine Math Don Fussell Computer Science Department The University of Texas at Austin University of Texas at Austin CS354 - Computer Graphics Don Fussell Vectors A vector is a direction and a magnitude Does NOT includeVectors a point of reference Usually thought of as an arrow in space Vectors can be added together and multiplied by scalars Zero vector has no length or direction University of Texas at Austin CS354 - Computer Graphics Don Fussell Vector Spaces Set of vectors Closed under the following operations Vector addition: v1 + v2 = v3 Scalar multiplication: s v1 = v2 n a v v Linear combinations: ∑ i i = i=1 Scalars come from some field F e.g. real or complex numbers Linear independence Basis Dimension University of Texas at Austin CS354 - Computer Graphics Don Fussell Vector Space Axioms Vector addition is associative and commutative Vector addition has a (unique) identity element (the 0 vector) Each vector has an additive inverse So we can define vector subtraction as adding an inverse Scalar multiplication has an identity element (1) Scalar multiplication distributes over vector addition and field addition Multiplications are compatible (a(bv)=(ab)v) University of Texas at Austin CS354 - Computer Graphics Don Fussell Coordinate Representation Pick a basis, order the vectors in it, then all vectors in the space can be represented as sequences of coordinates, i.e. coefficients of the basis vectors, in order. Example: Cartesian 3-space Basis: [i j k] Linear combination: xi + yj + zk Coordinate representation: [x y z] a[x1 y1 z1]+ b[x2 y2 z2 ] = [ax1 + bx2 ay1 + by2 az1 + bz2 ] University of Texas at Austin CS354 - Computer Graphics Don Fussell Row and Column Vectors We can represent a vector, v = (x,y), in the plane as a column vector " x% $ ' # y& as a row vector x y € [ ] University€ of Texas at Austin CS354 - Computer Graphics Don Fussell Linear Transformations Given vector spaces V and W A function f : V → W is a linear map or linear transformation if f (a1v1 +..
    [Show full text]