Introduction to Convexity

Total Page:16

File Type:pdf, Size:1020Kb

Introduction to Convexity 1 Introduction to Convexity 2 Amitabh Basu th 3 Compiled on Monday 9 December, 2019 at 16:35 1 4 Contents 5 1 Definitions and Preliminaries4 6 Basic real analysis and topology...............................4 7 Basic facts about matrices..................................6 8 2 Convex Sets 6 9 2.1 Definitions and basic properties...................................6 10 2.2 Convex cones, affine sets and dimension..............................8 11 2.3 Representations of convex sets................................... 11 12 2.3.1 Extrinsic description: separating hyperplanes....................... 11 13 How to represent general convex sets: Separation oracles................. 12 14 Farkas' lemma: A glimpse into polyhedral theory...................... 12 15 Duality/Polarity........................................ 12 16 2.3.2 Intrinsic description: faces, extreme points, recession cone, lineality space....... 14 17 2.3.3 A remark about extrinsic and intrinsic descriptions.................... 20 18 2.4 Combinatorial theorems: Helly-Radon-Carath´eodory....................... 20 19 An application to learning theory: VC-dimension of halfspaces.............. 21 20 Application to centerpoints.................................. 23 21 2.5 Polyhedra............................................... 25 22 2.5.1 The Minkowski-Weyl Theorem............................... 27 23 2.5.2 Valid inequalities and feasibility.............................. 28 24 2.5.3 Faces of polyhedra...................................... 30 25 2.5.4 Implicit equalities, dimension of polyhedra and facets.................. 31 26 3 Convex Functions 33 27 3.1 General properties, epigraphs, subgradients............................ 34 28 3.2 Continuity properties......................................... 38 29 3.3 First-order derivative properties................................... 40 30 3.4 Second-order derivative properties................................. 42 31 3.5 Sublinear functions, support functions and gauges........................ 43 32 Gauges............................................. 43 33 Support functions....................................... 47 34 Generalized Cauchy-Schwarz/Holder's inequality...................... 48 35 One-to-one correspondence between closed, convex sets and closed, sublinear functions. 49 36 3.6 Directional derivatives, subgradients and subdifferential calculus................ 50 37 4 Optimization 54 38 Algorithmic setup: First-order oracles............................ 56 39 4.1 Subgradient algorithm........................................ 56 40 Subgradient Algorithm.................................... 57 41 4.2 Generalized inequalities and convex mappings........................... 59 42 4.3 Convex optimization with generalized inequalities......................... 60 43 4.3.1 Lagrangian duality for convex optimization with generalized constraints........ 61 44 4.3.2 Solving the Lagrangian dual problem............................ 63 45 4.3.3 Explicit examples of the Lagrangian dual......................... 63 46 Conic optimization...................................... 64 47 Convex optimization with explicit constraints and objective................ 64 48 A closer look at linear programming duality........................ 65 49 4.3.4 Strong duality: sufficient conditions and complementary slackness........... 65 50 Slater's condition for strong duality............................. 65 51 Closed cone condition for strong duality in conic optimization.............. 66 2 52 Complementary slackness................................... 67 53 4.3.5 Saddle point interpretation of the Lagrangian dual.................... 68 54 4.4 Cutting plane schemes........................................ 68 55 General cutting plane scheme................................ 69 56 Center of Gravity Method.................................. 71 57 Ellipsoid method........................................ 72 3 58 1 Definitions and Preliminaries d d d 59 We will focus on R for arbitrary d N: x = (x1; : : : ; xd) R . We will use the notation R+ to denote 2 2 i 60 the set of all vectors with nonnegative coordinates. We will also use e , i = 1; : : : ; d to denote the i-th unit 61 vector, i.e., the vector which has 1 in the i-th coordinate and 0 in every other coordinate. d d 62 Definition 1.1. A norm on R is a function N : R R+ satisfying: ! 63 1. N(x) = 0 if and only if x = 0, d 64 2. N(αx) = α N(x) for all α R and x R , j j 2 2 d 65 3. N(x + y) N(x) + N(y) for all x; y R . (Triangle inequality) ≤ 2 p d p p p 1 66 Example 1.2. For any p 1, define the ` norm on R : x p = ( x1 + x2 + ::: + xd ) p . p = 2 ≥ k k j j j j j j 67 is also called the standard Euclidean norm; we will drop the subscript 2 to denote the standard norm: p 2 2 2 1 n 68 x = x + x + ::: + x : The ` norm is defined as x 1 = max xi . k k 1 2 d k k i=1 j j d d 69 Definition 1.3. Any norm on R defines a distance between points in x; y R as dN (x; y) := N(x y). 2 − 70 This is called the metric or distance induced by the norm. Such a metric satisfies three important properties: 71 1. dN (x; y) = 0 if and only if x = y, d 72 2. dN (x; y) = dN (y; x) for all x R , 2 d 73 3. dN (x; z) dN (x; y) + dN (y; z) for all x; y; z R . (Triangle inequality) ≤ 2 d 74 Definition 1.4. We also utilize the (standard) inner product of x; y R : x; y = x1y1 +x2y2 +:::+xdyd. 2 2 h i 75 (Note that x = x; x ). We say x and y are orthogonal if x; y = 0. k k2 h i h i d d 76 Definition 1.5. For any norm N and x R , r R+, we will call the set BN (x; r) := y R : N(y x) 2 2 f 2 − ≤ 77 r as the ball around x of radius r. BN (0; 1) will be called the unit ball for the norm N. We will drop g 78 the subscript N when we speak of the standard Euclidean norm and there is no chance of confusion in the 79 context. d 80 A subset X R is said to be bounded if there exists R R such that X BN (0;R). ⊆ 2 ⊆ Definition 1.6. Given any set X Rd and a scalar α R, ⊆ 2 αX := αx : x X : f 2 g Given any two sets X; Y Rd, we define the Minkowski sum of X; Y as ⊆ X + Y := x + y : x X; y Y : f 2 2 g 81 Basic real analysis and topology. For any subset of real numbers S R, we denote the concept of the ⊆ 82 infimum by inf S and the supremum by sup S. d d 83 Fix a norm N on R . A set X R is called open if for every x X, there exists r R+ such that ⊆ d 2 2 84 BN (x; r) X. A set X is closed if its complement R X is open. ⊆ n d 85 Theorem 1.7. 1. ; R are both open and closed. ; 86 2. An arbitrary union of open sets is open. An arbitrary intersection of closed sets is closed. 87 3. A finite intersection of open sets is open. A finite union of closed sets is closed. 4 d 1 2 3 i 88 A sequence in R is a countable ordered set of points: x ; x ; x ;::: and will often be denoted by x i2 . f g N 89 We say that the sequence converges or that the limit of the sequence exists if there exists a point x such that n 90 for every > 0, there exists M N such that N(x x ) for all n M. x is called the limit point, or 2 − ≤ ≥ n 91 simply the limit, of the sequence and will also sometimes be denoted by limn!1 x . Although the definition 92 of the limit is made here with respect to a particular norm, it is a well-known fact that the concept actually 93 does not depend on the choice of the norm. 94 Theorem 1.8. A set X is closed if and only if for every convergent sequence in X, the limit of the sequence 95 is also in X. 96 We introduce three important notions: d 97 1. For any set X R , the closure of X is the smallest closed set containing X and will be denoted by ⊆ 98 cl(X). d 99 2. For any set X R , the interior of X is the largest open set contained inside X and will be denoted ⊆ 100 by int(X). d 101 3. For any set X R , the boundary of X is defined as bd(X) := cl(X) int(X). ⊆ n d 102 Definition 1.9. A set in R that is closed and bounded is called compact. d i 103 Theorem 1.10. Let C R be a compact set. Then every sequence x i2 contained in C (not necessarily ⊆ f g N 104 convergent) has a convergent subsequence. d n i d 105 A function f : R R is continuous if for every convergent sequence x i2N R , the following holds: i ! i f g ⊆ 106 limi!1 f(x ) = f(limn!1 x ). d d 107 Theorem 1.11. [Weierstrass' Theorem] Let f : R R be a continuous function. Let X R be a ! min ⊆ 108 nonempty, compact subset. Then inf f(x): x X is attained, i.e., there exists x X such that min f 2 maxg max 2 109 f(x ) = inf f(x): x X . Similarly, there exists x X such that f(x ) = sup f(x): x X . f 2 g 2 f 2 g 110 A generalization of the above theorem is the following. d n 111 Theorem 1.12. Let f : R R be a continuous function, and C be a compact set. Then f(C) is compact. ! d n 112 We will also need to speak of differentiability of functions f : R R . ! Definition 1.13. We say that f : Rd Rn is differentiable at x Rd, if there exists a linear transformation ! 2 A : Rd Rn such that ! f(x + h) f(x) Ah lim k − − k = 0: h!0 h k k 113 If f is differentiable at x, then the linear transformation A is unique.
Recommended publications
  • Boundedness in Linear Topological Spaces
    BOUNDEDNESS IN LINEAR TOPOLOGICAL SPACES BY S. SIMONS Introduction. Throughout this paper we use the symbol X for a (real or complex) linear space, and the symbol F to represent the basic field in question. We write R+ for the set of positive (i.e., ^ 0) real numbers. We use the term linear topological space with its usual meaning (not necessarily Tx), but we exclude the case where the space has the indiscrete topology (see [1, 3.3, pp. 123-127]). A linear topological space is said to be a locally bounded space if there is a bounded neighbourhood of 0—which comes to the same thing as saying that there is a neighbourhood U of 0 such that the sets {(1/n) U} (n = 1,2,—) form a base at 0. In §1 we give a necessary and sufficient condition, in terms of invariant pseudo- metrics, for a linear topological space to be locally bounded. In §2 we discuss the relationship of our results with other results known on the subject. In §3 we introduce two ways of classifying the locally bounded spaces into types in such a way that each type contains exactly one of the F spaces (0 < p ^ 1), and show that these two methods of classification turn out to be identical. Also in §3 we prove a metrization theorem for locally bounded spaces, which is related to the normal metrization theorem for uniform spaces, but which uses a different induction procedure. In §4 we introduce a large class of linear topological spaces which includes the locally convex spaces and the locally bounded spaces, and for which one of the more important results on boundedness in locally convex spaces is valid.
    [Show full text]
  • 1 Definition
    Math 125B, Winter 2015. Multidimensional integration: definitions and main theorems 1 Definition A(closed) rectangle R ⊆ Rn is a set of the form R = [a1; b1] × · · · × [an; bn] = f(x1; : : : ; xn): a1 ≤ x1 ≤ b1; : : : ; an ≤ x1 ≤ bng: Here ak ≤ bk, for k = 1; : : : ; n. The (n-dimensional) volume of R is Vol(R) = Voln(R) = (b1 − a1) ··· (bn − an): We say that the rectangle is nondegenerate if Vol(R) > 0. A partition P of R is induced by partition of each of the n intervals in each dimension. We identify the partition with the resulting set of closed subrectangles of R. Assume R ⊆ Rn and f : R ! R is a bounded function. Then we define upper sum of f with respect to a partition P, and upper integral of f on R, X Z U(f; P) = sup f · Vol(B); (U) f = inf U(f; P); P B2P B R and analogously lower sum of f with respect to a partition P, and lower integral of f on R, X Z L(f; P) = inf f · Vol(B); (L) f = sup L(f; P): B P B2P R R R RWe callR f integrable on R if (U) R f = (L) R f and in this case denote the common value by R f = R f(x) dx. As in one-dimensional case, f is integrable on R if and only if Cauchy condition is satisfied. The Cauchy condition states that, for every ϵ > 0, there exists a partition P so that U(f; P) − L(f; P) < ϵ.
    [Show full text]
  • A Representation of Partially Ordered Preferences Teddy Seidenfeld
    A Representation of Partially Ordered Preferences Teddy Seidenfeld; Mark J. Schervish; Joseph B. Kadane The Annals of Statistics, Vol. 23, No. 6. (Dec., 1995), pp. 2168-2217. Stable URL: http://links.jstor.org/sici?sici=0090-5364%28199512%2923%3A6%3C2168%3AAROPOP%3E2.0.CO%3B2-C The Annals of Statistics is currently published by Institute of Mathematical Statistics. Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained prior permission, you may not download an entire issue of a journal or multiple copies of articles, and you may use content in the JSTOR archive only for your personal, non-commercial use. Please contact the publisher regarding any further use of this work. Publisher contact information may be obtained at http://www.jstor.org/journals/ims.html. Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission. The JSTOR Archive is a trusted digital repository providing for long-term preservation and access to leading academic journals and scholarly literature from around the world. The Archive is supported by libraries, scholarly societies, publishers, and foundations. It is an initiative of JSTOR, a not-for-profit organization with a mission to help the scholarly community take advantage of advances in technology. For more information regarding JSTOR, please contact [email protected]. http://www.jstor.org Tue Mar 4 10:44:11 2008 The Annals of Statistics 1995, Vol.
    [Show full text]
  • Compact and Totally Bounded Metric Spaces
    Appendix A Compact and Totally Bounded Metric Spaces Definition A.0.1 (Diameter of a set) The diameter of a subset E in a metric space (X, d) is the quantity diam(E) = sup d(x, y). x,y∈E ♦ Definition A.0.2 (Bounded and totally bounded sets)A subset E in a metric space (X, d) is said to be 1. bounded, if there exists a number M such that E ⊆ B(x, M) for every x ∈ E, where B(x, M) is the ball centred at x of radius M. Equivalently, d(x1, x2) ≤ M for every x1, x2 ∈ E and some M ∈ R; > { ,..., } 2. totally bounded, if for any 0 there exists a finite subset x1 xn of X ( , ) = ,..., = such that the (open or closed) balls B xi , i 1 n cover E, i.e. E n ( , ) i=1 B xi . ♦ Clearly a set is bounded if its diameter is finite. We will see later that a bounded set may not be totally bounded. Now we prove the converse is always true. Proposition A.0.1 (Total boundedness implies boundedness) In a metric space (X, d) any totally bounded set E is bounded. Proof Total boundedness means we may choose = 1 and find A ={x1,...,xn} in X such that for every x ∈ E © The Editor(s) (if applicable) and The Author(s), under exclusive 429 license to Springer Nature Switzerland AG 2020 S. Gentili, Measure, Integration and a Primer on Probability Theory, UNITEXT 125, https://doi.org/10.1007/978-3-030-54940-4 430 Appendix A: Compact and Totally Bounded Metric Spaces inf d(xi , x) ≤ 1.
    [Show full text]
  • Chapter 7. Complete Metric Spaces and Function Spaces
    43. Complete Metric Spaces 1 Chapter 7. Complete Metric Spaces and Function Spaces Note. Recall from your Analysis 1 (MATH 4217/5217) class that the real numbers R are a “complete ordered field” (in fact, up to isomorphism there is only one such structure; see my online notes at http://faculty.etsu.edu/gardnerr/4217/ notes/1-3.pdf). The Axiom of Completeness in this setting requires that ev- ery set of real numbers with an upper bound have a least upper bound. But this idea (which dates from the mid 19th century and the work of Richard Dedekind) depends on the ordering of R (as evidenced by the use of the terms “upper” and “least”). In a metric space, there is no such ordering and so the completeness idea (which is fundamental to all of analysis) must be dealt with in an alternate way. Munkres makes a nice comment on page 263 declaring that“completeness is a metric property rather than a topological one.” Section 43. Complete Metric Spaces Note. In this section, we define Cauchy sequences and use them to define complete- ness. The motivation for these ideas comes from the fact that a sequence of real numbers is Cauchy if and only if it is convergent (see my online notes for Analysis 1 [MATH 4217/5217] http://faculty.etsu.edu/gardnerr/4217/notes/2-3.pdf; notice Exercise 2.3.13). 43. Complete Metric Spaces 2 Definition. Let (X, d) be a metric space. A sequence (xn) of points of X is a Cauchy sequence on (X, d) if for all ε > 0 there is N N such that if m, n N ∈ ≥ then d(xn, xm) < ε.
    [Show full text]
  • Topology Proceedings
    Topology Proceedings Web: http://topology.auburn.edu/tp/ Mail: Topology Proceedings Department of Mathematics & Statistics Auburn University, Alabama 36849, USA E-mail: [email protected] ISSN: 0146-4124 COPYRIGHT °c by Topology Proceedings. All rights reserved. Topology Proceedings Vol 18, 1993 H-BOUNDED SETS DOUGLAS D. MOONEY ABSTRACT. H-bounded sets were introduced by Lam­ brinos in 1976. Recently they have proven to be useful in the study of extensions of Hausdorff spaces. In this con­ text the question has arisen: Is every H-bounded set the subset of an H-set? This was originally asked by Lam­ brinos along with the questions: Is every H-bounded set the subset of a countably H-set? and Is every countably H-bounded set the subset of a countably H-set? In this paper, an example is presented which gives a no answer to each of these questions. Some new characterizations and properties of H-bounded sets are also examined. 1. INTRODUCTION The concept of an H-bounded set was defined by Lambrinos in [1] as a weakening of the notion of a bounded set which he defined in [2]. H-bounded sets have arisen naturally in the au­ thor's study of extensions of Hausdorff spaces. In [3] it is shown that the notions of S- and O-equivalence defined by Porter and Votaw [6] on the upper-semilattice of H-closed extensions of a Hausdorff space are equivalent if and only if every closed nowhere dense set is an H-bounded set. As a consequence, it is shown that a Hausdorff space has a unique Hausdorff exten­ sion if and only if the space is non-H-closed, almost H-closed, and every closed nowhere dense set is H-bounded.
    [Show full text]
  • On the Polyhedrality of Closures of Multi-Branch Split Sets and Other Polyhedra with Bounded Max-Facet-Width
    On the polyhedrality of closures of multi-branch split sets and other polyhedra with bounded max-facet-width Sanjeeb Dash Oktay G¨unl¨uk IBM Research IBM Research [email protected] [email protected] Diego A. Mor´anR. School of Business, Universidad Adolfo Iba~nez [email protected] August 2, 2016 Abstract For a fixed integer t > 0, we say that a t-branch split set (the union of t split sets) is dominated by another one on a polyhedron P if all cuts for P obtained from the first t-branch split set are implied by cuts obtained from the second one. We prove that given a rational polyhedron P , any arbitrary family of t-branch split sets has a finite subfamily such that each element of the family is dominated on P by an element from the subfamily. The result for t = 1 (i.e., for split sets) was proved by Averkov (2012) extending results in Andersen, Cornu´ejols and Li (2005). Our result implies that the closure of P with respect to any family of t-branch split sets is a polyhedron. We extend this result by replacing split sets with polyhedral sets with bounded max-facet-width as building blocks and show that any family of such sets also has a finite dominating subfamily. This result generalizes a result of Averkov (2012) on bounded max-facet-width polyhedra. 1 Introduction Cutting planes (or cuts, for short) are essential tools for solving general mixed-integer programs (MIPs). Split cuts are an important family of cuts for general MIPs, and special cases of split cuts are effective in practice.
    [Show full text]
  • An Introduction to Some Aspects of Functional Analysis
    An introduction to some aspects of functional analysis Stephen Semmes Rice University Abstract These informal notes deal with some very basic objects in functional analysis, including norms and seminorms on vector spaces, bounded linear operators, and dual spaces of bounded linear functionals in particular. Contents 1 Norms on vector spaces 3 2 Convexity 4 3 Inner product spaces 5 4 A few simple estimates 7 5 Summable functions 8 6 p-Summable functions 9 7 p =2 10 8 Bounded continuous functions 11 9 Integral norms 12 10 Completeness 13 11 Bounded linear mappings 14 12 Continuous extensions 15 13 Bounded linear mappings, 2 15 14 Bounded linear functionals 16 1 15 ℓ1(E)∗ 18 ∗ 16 c0(E) 18 17 H¨older’s inequality 20 18 ℓp(E)∗ 20 19 Separability 22 20 An extension lemma 22 21 The Hahn–Banach theorem 23 22 Complex vector spaces 24 23 The weak∗ topology 24 24 Seminorms 25 25 The weak∗ topology, 2 26 26 The Banach–Alaoglu theorem 27 27 The weak topology 28 28 Seminorms, 2 28 29 Convergent sequences 30 30 Uniform boundedness 31 31 Examples 32 32 An embedding 33 33 Induced mappings 33 34 Continuity of norms 34 35 Infinite series 35 36 Some examples 36 37 Quotient spaces 37 38 Quotients and duality 38 39 Dual mappings 39 2 40 Second duals 39 41 Continuous functions 41 42 Bounded sets 42 43 Hahn–Banach, revisited 43 References 44 1 Norms on vector spaces Let V be a vector space over the real numbers R or the complex numbers C.
    [Show full text]
  • Math 131: Introduction to Topology 1
    Math 131: Introduction to Topology 1 Professor Denis Auroux Fall, 2019 Contents 9/4/2019 - Introduction, Metric Spaces, Basic Notions3 9/9/2019 - Topological Spaces, Bases9 9/11/2019 - Subspaces, Products, Continuity 15 9/16/2019 - Continuity, Homeomorphisms, Limit Points 21 9/18/2019 - Sequences, Limits, Products 26 9/23/2019 - More Product Topologies, Connectedness 32 9/25/2019 - Connectedness, Path Connectedness 37 9/30/2019 - Compactness 42 10/2/2019 - Compactness, Uncountability, Metric Spaces 45 10/7/2019 - Compactness, Limit Points, Sequences 49 10/9/2019 - Compactifications and Local Compactness 53 10/16/2019 - Countability, Separability, and Normal Spaces 57 10/21/2019 - Urysohn's Lemma and the Metrization Theorem 61 1 Please email Beckham Myers at [email protected] with any corrections, questions, or comments. Any mistakes or errors are mine. 10/23/2019 - Category Theory, Paths, Homotopy 64 10/28/2019 - The Fundamental Group(oid) 70 10/30/2019 - Covering Spaces, Path Lifting 75 11/4/2019 - Fundamental Group of the Circle, Quotients and Gluing 80 11/6/2019 - The Brouwer Fixed Point Theorem 85 11/11/2019 - Antipodes and the Borsuk-Ulam Theorem 88 11/13/2019 - Deformation Retracts and Homotopy Equivalence 91 11/18/2019 - Computing the Fundamental Group 95 11/20/2019 - Equivalence of Covering Spaces and the Universal Cover 99 11/25/2019 - Universal Covering Spaces, Free Groups 104 12/2/2019 - Seifert-Van Kampen Theorem, Final Examples 109 2 9/4/2019 - Introduction, Metric Spaces, Basic Notions The instructor for this course is Professor Denis Auroux. His email is [email protected] and his office is SC539.
    [Show full text]
  • Definition in Terms of Order Alone in the Linear
    DEFINITION IN TERMS OF ORDERALONE IN THE LINEAR CONTINUUMAND IN WELL-ORDERED SETS* BY OSWALD VEBLEN First definition of the continuum. A linear continuum is a set of elements { P} which we may call points, sub- ject to a relation -< which we may read precedes, governed by the following conditions, A to E : A. General Postulates of Order. 1. { P} contains at least two elements. 2. If Px and P2 are distinct elements of {P} then either Px -< P2 or P < P . 3. IfP, -< F2 then Px is distinct from P2. f 4. IfPx <. P2 and P2 < P3, then P, < P3. f B. Dedekind Postulate of Closure. J If {P} consists entirely of two infinite subsets, [P] and [P"] such that P' -< P", then there is either a P'0 of [PJ such that P' -< P'0 whenever P + P'0 or a P'J of [P"J such that P'0' < P" whenever P" +- P'¡. C. Pseudo-Archimedean postulate. 1. If { P} is an infinite set then there exists a subset [ P„ ] , such that P„ -< P„+ ,(^==1, 2, 3, ■••) and if P is any element of { P} for which Px "C P, then there exists a v such that P -< Pv. * Presented to the Society December 30, 1904, uuder the title, Non-Metrictd Definition of the Linear Continuum. Received for publication January 26, 1905. |The propositions As and At say that -< is "non-reflexive" and "transitive." It follows immediately that it is "non-symmetric," for if Px -< P2 and P,A. Pi could occur simultaneously, 4 would lead to P¡^P¡, contrary to 3.
    [Show full text]
  • Metric Spaces
    Chapter 1. Metric Spaces Definitions. A metric on a set M is a function d : M M R × → such that for all x, y, z M, Metric Spaces ∈ d(x, y) 0; and d(x, y)=0 if and only if x = y (d is positive) MA222 • ≥ d(x, y)=d(y, x) (d is symmetric) • d(x, z) d(x, y)+d(y, z) (d satisfies the triangle inequality) • ≤ David Preiss The pair (M, d) is called a metric space. [email protected] If there is no danger of confusion we speak about the metric space M and, if necessary, denote the distance by, for example, dM . The open ball centred at a M with radius r is the set Warwick University, Spring 2008/2009 ∈ B(a, r)= x M : d(x, a) < r { ∈ } the closed ball centred at a M with radius r is ∈ x M : d(x, a) r . { ∈ ≤ } A subset S of a metric space M is bounded if there are a M and ∈ r (0, ) so that S B(a, r). ∈ ∞ ⊂ MA222 – 2008/2009 – page 1.1 Normed linear spaces Examples Definition. A norm on a linear (vector) space V (over real or Example (Euclidean n spaces). Rn (or Cn) with the norm complex numbers) is a function : V R such that for all · → n n , x y V , x = x 2 so with metric d(x, y)= x y 2 ∈ | i | | i − i | x 0; and x = 0 if and only if x = 0(positive) i=1 i=1 • ≥ cx = c x for every c R (or c C)(homogeneous) • | | ∈ ∈ n n x + y x + y (satisfies the triangle inequality) Example (n spaces with p norm, p 1).
    [Show full text]
  • Introduction to Real Analysis
    Introduction to Real Analysis Joshua Wilde, revised by Isabel Tecu, Takeshi Suzuki and María José Boccardi August 13, 2013 1 Sets Sets are the basic objects of mathematics. In fact, they are so basic that there is no simple and precise denition of what a set actually is. For our purposes it suces to think of a set as a collection of objects. Sets are denoted as a list of their elements: A = fa; b; cg means the set A consists of the elements a; b; c. The number of elements in a set can be nite or innite. For example, the set of all even integers f2; 4; 6;:::g is an innite set. We use the notation a 2 A to say that a is an element of the set A. Suppose we are given a set X. A is a subset of X if all elements in A are also contained in X: a 2 A ) a 2 X. It is denoted A ⊂ X. The empty set is the set that contains no elements. It is denoted fg or ?. Note that any statement about the elements of the empty set is true - since there are no elements in the empty set. 1.1 Set Operations The union of two sets A and B is the set consisting of the elements that are in A or in B (or in both). It is denoted A [ B. For example, if A = f1; 2; 3g and B = f2; 3; 4g then A [ B = f1; 2; 3; 4g. The intersection of two sets A and B is the set consisting of the elements that are in A and in B.
    [Show full text]