An Incidence Geometry Approach to Dictionary Learning∗

Total Page:16

File Type:pdf, Size:1020Kb

An Incidence Geometry Approach to Dictionary Learning∗ CCCG 2014, Halifax, Nova Scotia, August 11{13, 2014 An Incidence Geometry approach to Dictionary Learning∗ Meera Sitharamy Mohamad Tarifiz Menghan Wangx Abstract The Dictionary Learning problem arises in various con- texts such as signal processing and machine learning. We study the Dictionary Learning (aka Sparse Coding) The dictionary under consideration is usually overcom- problem of obtaining a sparse representation of data plete, with n > d. However we are interested in asymp- points, by learning dictionary vectors upon which the totic performance with respect to all four variables data points can be written as sparse linear combina- n; m; d; s. Typically, m n d > s. Both cases tions. We view this problem from a geometry per- when s is large relative to d and when s is small relative spective as the spanning set of a subspace arrange- to d are interesting. ment, and focus on understanding the case when the underlying hypergraph of the subspace arrangement is specified. For this Fitted Dictionary Learning prob- 1.1 Previous approaches and challenges lem, we completely characterize the combinatorics of Several traditional Dictionary Learning algorithms work the associated subspace arrangements (i.e. their under- by alternating minimization, i.e. iterating the two steps lying hypergraphs), using incidence geometry. Specif- of Vector Selection which finds a representation Θ of X ically, a combinatorial rigidity-type theorem is proven in an estimated dictionary, and updating the Dictionary that characterizes the hypergraphs of subspace arrange- estimation by solving an optimization problem that is ments that generically yield (a) at least one dictionary convex in D when Θ is known [25, 20, 19]. (b) a locally unique dictionary (i.e. at most a finite num- ber of isolated dictionaries) of the specified size. We For an overcomplete dictionary, the general vector se- are unaware of prior application of combinatorial rigid- lection problem is ill defined and has been shown to be ity techniques in the setting of Dictionary Learning, or NP-hard [21]. One is then tempted to conclude that even in machine learning. We also provide a systematic Dictionary Learning is also NP-hard. However, this can- classification of problems related to Dictionary Learning not be directly deduced in general, since even though together with various approaches, assumptions required adding a witness D turns the problem into an NP-hard and performance. problem, it is possible that the Dictionary Learning so- lution produces a different dictionary D´. On the other hand, if D satisfies the condition of being a frame, i.e. 1 Introduction for all θ such that kθk0 ≤ s, there exists a δs such that 2 kDθk2 (1 − δs) ≤ 2 ≤ (1 + δs), it is guaranteed that the Dictionary Learning (aka Sparse Coding) is the problem kθk2 of obtaining a sparse representation of data points, by sparsest solution to the Vector Selection problem can be learning dictionary vectors upon which the data points found via l1 minimization [8, 7]. can be written as sparse linear combinations. One popular alternating minimization method is the Method of Optimal Dictionary (MOD) [9], which uses a Problem 1 (Dictionary Learning) A point set X = maximum likelihood formalism, and compute D via the d [x1 : : : xm] in R is said to be s-represented by a dic- pseudoinverse. Another method k-SVD [2] updates D tionary D = [v1 : : : vn] for a given sparsity s < d, if by taking every atom in D and applying SVD to X and there exists Θ = [θ1 : : : θm] such that xi = Dθi, with Θ restricted to only the columns that have contribution kθik0 ≤ s. Given an X known to be s-represented by from that atom. an unknown dictionary D of size jDj = n, Dictionary Though alternating minimization methods work well Learning is the problem of finding any dictionary D´ sat- ´ in practice, there is no theoretical guarantee that the isfying the properties of D, i.e. jDj ≤ n, and there exists their results will converge to a true dictionary. Several ´ ´ ´ Θi such that xi = Dθi for all xi 2 X. recent works give provable algorithms under stronger ∗This research was supported in part by the research grant constraints on X and D. Spielman et. al [24] give an NSF CCF-1117695 and a research gift from SolidWorks. l1 minimization based approach which is provable to yDepartment of Computer and Information Science and Engi- find the exact dictionary D, but requires D to be a neering, University of Florida, [email protected] basis. Arora et. al [3] and Agarwal et. al [1] indepen- zGoogle, [email protected] xDepartment of Computer and Information Science and Engi- dently give provable non-iterative algorithms for learn- neering, University of Florida, [email protected] ing approximation of overcomplete dictionaries. Both 26th Canadian Conference on Computational Geometry, 2014 of their methods are based on an overlapping cluster- sphere Sd−1, then when s is fixed, jDj = Ω(jXj) ing approach to find data points sharing a dictionary with probability 1 (see Corollary 4). vector, and then estimate the dictionary vectors from the clusters via SVD. However, their algorithms require • As a corollary to our main result, we obtain an Dic- the dictionaries to be pairwise incoherent which is much tionary Learning algorithm for sufficiently general stronger than the frame property. data X, i.e. requiring sufficiently large dictionary In this paper, we understand the Dictionary Learn- size n (see Corollary 5). ing problem from an intrinsically geometric point of • We provide a systematic classification of problems view. Notice that each x 2 X lies in an s-dimensional related to Dictionary Learning together with var- subspace supp (x), which is the span of s vectors D ious approaches, conditions and performance (see v 2 D that form the support of x. The result- Section 4). ing s-subspace arrangement SX;D = f(x; suppD(x)) : x 2 Xg has an underlying labeled (multi)hypergraph Note that although our results are stated for uniform H(SX;D) = (I(D); I(SX;D)), where I(D) denotes the hypergraphs H(SX;D) (i.e. each subspace in SX;D has index set of the dictionary D and I(SX;D) is the set of the same dimension), they can be easily generalized to (multi)hyperedges over the indices I(D) corresponding non-uniform underlying hypergraphs. to the labeled sets (x; suppD(x)). The word \multi" ap- Remark on technical significance: in this paper, we fol- pears because if suppD(x1) = suppD(x2) for data points low [4] and [31] to give a complete combinatorial charac- x1; x2 2 X with x1 6= x2, then that support set of dictio- terization for the Fitted Dictionary Learning problem, nary vectors (resp. their indices) is multiply represented starting from the initial representation as a nonlinear al- in SX;D (resp. I(SX;D)) as labeled sets (x1; suppD(x1)) gebraic system. For more details of technical challenges and (x2; suppD(x2)). We denote the sizes of these mul- and significance, see Section 3.4. tisets as jSX;Dj (resp. jI(SX;D)j). Note that there could be many dictionaries D for the 3 Main Result: Combinatorial Rigidity Characteri- same set X of data points and for each D, many possible zation for Dictionary Learning subspace arrangements SX;D that are solutions to the Dictionary Learning problem. In this section, we present the main result of the paper, i.e. a combinatorial characterization of the 2 Contributions (multi)hypergraphs H such that the existence and local uniqueness of a dictionary D is guaranteed for generic In this paper, we focus on the version of Dictionary X satisfying H(SX;D) = H. Learning where the underlying hypergraph is specified. Since the magnitudes of the vectors in X or D are uninteresting, we treat the data and dictionary points Problem 2 (Fitted Dictionary Learning) Let X be a given set of data points in d. For an unknown dictio- as living in the projective (d−1) space and use the same R notation to refer to both original d-dimensional and nary D = [v1; : : : ; vn] that s-represents X, we are given the hypergraph H(S ) of the underlying subspace ar- projective d − 1 dimensional versions when the mean- X;D ing is clear from the context. We rephrase the Fitted rangement S . Find any dictionary D´ of size jD´j ≤ n X;D Dictionary Learning problem as the following Pinned consistent with the hypergraph H(S ). X;D Subspace-Incidence problem for the convenience of ap- Our contributions in this paper are as follows: plying machinery from incidence geometry. • As the main result, we use combinatorial rigidity Problem 3 (Pinned Subspace-Incidence Problem) techniques to obtain a complete characterization of Let X be a given set of m points (pins) in Pd−1(R). the hypergraphs H(SX;D) that generically yield (a) For every pin x 2 X, we are also given the hyperedge at least one solution dictionary D, and (b) a lo- suppD(x), i.e, an index subset of an unknown set cally unique solution dictionary D (i.e. at most a of points D = fv1; : : : ; vng, such that xi lies on the finite number of isolated solution dictionaries) of subspace spanned by suppD(x). Find any such set D the specified size (see Theorem 2). To the best that satisfies the given subspace incidences. of our knowledge, this paper pioneers the use of combinatorial rigidity for problems related to Dic- 3.1 Algebraic Representation tionary Learning. We represent the Pinned Subspace-Incidence problem in • We are interested in minimizing jDj for general X. the tradition of geometric constraint solving [6, 23], and However, as a corollary of the main result, we ob- view the problem as finding the common solutions of a tain that if the data points in X are highly general, system of polynomial equations (finding a real algebraic for example, picked uniformly at random from the variety).
Recommended publications
  • Study Guide for the Midterm. Topics: • Euclid • Incidence Geometry • Perspective Geometry • Neutral Geometry – Through Oct.18Th
    Study guide for the midterm. Topics: • Euclid • Incidence geometry • Perspective geometry • Neutral geometry { through Oct.18th. You need to { Know definitions and examples. { Know theorems by names. { Be able to give a simple proof and justify every step. { Be able to explain those of Euclid's statements and proofs that appeared in the book, the problem set, the lecture, or the tutorial. Sources: • Class Notes • Problem Sets • Assigned reading • Notes on course website. The test. • Excerpts from Euclid will be provided if needed. • The incidence axioms will be provided if needed. • Postulates of neutral geometry will be provided if needed. • There will be at least one question that is similar or identical to a homework question. Tentative large list of terms. For each of the following terms, you should be able to write two sentences, in which you define it, state it, explain it, or discuss it. Euclid's geometry: - Euclid's definition of \right angle". - Euclid's definition of \parallel lines". - Euclid's \postulates" versus \common notions". - Euclid's working with geometric magnitudes rather than real numbers. - Congruence of segments and angles. - \All right angles are equal". - Euclid's fifth postulate. - \The whole is bigger than the part". - \Collapsing compass". - Euclid's reliance on diagrams. - SAS; SSS; ASA; AAS. - Base angles of an isosceles triangle. - Angles below the base of an isosceles triangle. - Exterior angle inequality. - Alternate interior angle theorem and its converse (we use the textbook's convention). - Vertical angle theorem. - The triangle inequality. - Pythagorean theorem. Incidence geometry: - collinear points. - concurrent lines. - Simple theorems of incidence geometry. - Interpretation/model for a theory.
    [Show full text]
  • Arxiv:1609.06355V1 [Cs.CC] 20 Sep 2016 Outlaw Distributions And
    Outlaw distributions and locally decodable codes Jop Bri¨et∗ Zeev Dvir† Sivakanth Gopi‡ September 22, 2016 Abstract Locally decodable codes (LDCs) are error correcting codes that allow for decoding of a single message bit using a small number of queries to a corrupted encoding. De- spite decades of study, the optimal trade-off between query complexity and codeword length is far from understood. In this work, we give a new characterization of LDCs using distributions over Boolean functions whose expectation is hard to approximate (in L∞ norm) with a small number of samples. We coin the term ‘outlaw distribu- tions’ for such distributions since they ‘defy’ the Law of Large Numbers. We show that the existence of outlaw distributions over sufficiently ‘smooth’ functions implies the existence of constant query LDCs and vice versa. We also give several candidates for outlaw distributions over smooth functions coming from finite field incidence geometry and from hypergraph (non)expanders. We also prove a useful lemma showing that (smooth) LDCs which are only required to work on average over a random message and a random message index can be turned into true LDCs at the cost of only constant factors in the parameters. 1 Introduction Error correcting codes (ECCs) solve the basic problem of communication over noisy channels. They encode a message into a codeword from which, even if the channel partially corrupts it, arXiv:1609.06355v1 [cs.CC] 20 Sep 2016 the message can later be retrieved. With one of the earliest applications of the probabilistic method, formally introduced by Erd˝os in 1947, pioneering work of Shannon [Sha48] showed the existence of optimal (capacity-achieving) ECCs.
    [Show full text]
  • Connections Between Graph Theory, Additive Combinatorics, and Finite
    UNIVERSITY OF CALIFORNIA, SAN DIEGO Connections between graph theory, additive combinatorics, and finite incidence geometry A dissertation submitted in partial satisfaction of the requirements for the degree Doctor of Philosophy in Mathematics by Michael Tait Committee in charge: Professor Jacques Verstra¨ete,Chair Professor Fan Chung Graham Professor Ronald Graham Professor Shachar Lovett Professor Brendon Rhoades 2016 Copyright Michael Tait, 2016 All rights reserved. The dissertation of Michael Tait is approved, and it is acceptable in quality and form for publication on microfilm and electronically: Chair University of California, San Diego 2016 iii DEDICATION To Lexi. iv TABLE OF CONTENTS Signature Page . iii Dedication . iv Table of Contents . .v List of Figures . vii Acknowledgements . viii Vita........................................x Abstract of the Dissertation . xi 1 Introduction . .1 1.1 Polarity graphs and the Tur´annumber for C4 ......2 1.2 Sidon sets and sum-product estimates . .3 1.3 Subplanes of projective planes . .4 1.4 Frequently used notation . .5 2 Quadrilateral-free graphs . .7 2.1 Introduction . .7 2.2 Preliminaries . .9 2.3 Proof of Theorem 2.1.1 and Corollary 2.1.2 . 11 2.4 Concluding remarks . 14 3 Coloring ERq ........................... 16 3.1 Introduction . 16 3.2 Proof of Theorem 3.1.7 . 21 3.3 Proof of Theorems 3.1.2 and 3.1.3 . 23 3.3.1 q a square . 24 3.3.2 q not a square . 26 3.4 Proof of Theorem 3.1.8 . 34 3.5 Concluding remarks on coloring ERq ........... 36 4 Chromatic and Independence Numbers of General Polarity Graphs .
    [Show full text]
  • Keith E. Mellinger
    Keith E. Mellinger Department of Mathematics home University of Mary Washington 1412 Kenmore Avenue 1301 College Avenue, Trinkle Hall Fredericksburg, VA 22401 Fredericksburg, VA 22401-5300 (540) 368-3128 ph: (540) 654-1333, fax: (540) 654-2445 [email protected] http://www.keithmellinger.com/ Professional Experience • Director of the Quality Enhancement Plan, 2013 { present. UMW. • Professor of Mathematics, 2014 { present. Department of Mathematics, UMW. • Interim Director, Office of Academic and Career Services, Fall 2013 { Spring 2014. UMW. • Associate Professor, 2008 { 2014. Department of Mathematics, UMW. • Department Chair, 2008 { 2013. Department of Mathematics, UMW. • Assistant Professor, 2003 { 2008. Department of Mathematics, UMW. • Research Assistant Professor (Vigre post-doc), 2001 - 2003. Department of Mathematics, Statistics, and Computer Science, University of Illinois at Chicago, Chicago, IL, 60607-7045. Position partially funded by a VIGRE grant from the National Science Foundation. Education • Ph.D. in Mathematics: August 2001, University of Delaware, Newark, DE. { Thesis: Mixed Partitions and Spreads of Projective Spaces • M.S. in Mathematics: May 1997, University of Delaware. • B.S. in Mathematics: May 1995, Millersville University, Millersville, PA. { minor in computer science, option in statistics Grants and Awards • Millersville University Outstanding Young Alumni Achievement Award, presented by the alumni association at MU, May 2013. • Mathematical Association of America's Carl B. Allendoerfer Award for the article,
    [Show full text]
  • 1 Definition and Models of Incidence Geometry
    1 Definition and Models of Incidence Geometry (1.1) Definition (geometry) A geometry is a set S of points and a set L of lines together with relationships between the points and lines. p 2 1. Find four points which belong to set M = f(x;y) 2 R jx = 5g: 2. Let M = f(x;y)jx;y 2 R;x < 0g: p (i) Find three points which belong to set N = f(x;y) 2 Mjx = 2g. − 4 L f 2 Mj 1 g (ii) Are points P (3;3), Q(6;4) and R( 2; 3 ) belong to set = (x;y) y = 3 x + 2 ? (1.2) Definition (Cartesian Plane) L Let E be the set of all vertical and non-vertical lines, La and Lk;n where vertical lines: f 2 2 j g La = (x;y) R x = a; a is fixed real number ; non-vertical lines: f 2 2 j g Lk;n = (x;y) R y = kx + n; k and n are fixed real numbers : C f 2 L g The model = R ; E is called the Cartesian Plane. C f 2 L g 3. Let = R ; E denote Cartesian Plane. (i) Find three different points which belong to Cartesian vertical line L7. (ii) Find three different points which belong to Cartesian non-vertical line L15;p2. C f 2 L g 4. Let P be some point in Cartesian Plane = R ; E . Show that point P cannot lie simultaneously on both L and L (where a a ). a a0 , 0 (1.3) Definition (Poincar´ePlane) L Let H be the set of all type I and type II lines, aL and pLr where type I lines: f 2 j g aL = (x;y) H x = a; a is a fixed real number ; type II lines: f 2 j − 2 2 2 2 g pLr = (x;y) H (x p) + y = r ; p and r are fixed R, r > 0 ; 2 H = f(x;y) 2 R jy > 0g: H f L g The model = H; H will be called the Poincar´ePlane.
    [Show full text]
  • ON the POLYHEDRAL GEOMETRY of T–DESIGNS
    ON THE POLYHEDRAL GEOMETRY OF t{DESIGNS A thesis presented to the faculty of San Francisco State University In partial fulfilment of The Requirements for The Degree Master of Arts In Mathematics by Steven Collazos San Francisco, California August 2013 Copyright by Steven Collazos 2013 CERTIFICATION OF APPROVAL I certify that I have read ON THE POLYHEDRAL GEOMETRY OF t{DESIGNS by Steven Collazos and that in my opinion this work meets the criteria for approving a thesis submitted in partial fulfillment of the requirements for the degree: Master of Arts in Mathematics at San Francisco State University. Matthias Beck Associate Professor of Mathematics Felix Breuer Federico Ardila Associate Professor of Mathematics ON THE POLYHEDRAL GEOMETRY OF t{DESIGNS Steven Collazos San Francisco State University 2013 Lisonek (2007) proved that the number of isomorphism types of t−(v; k; λ) designs, for fixed t, v, and k, is quasi{polynomial in λ. We attempt to describe a region in connection with this result. Specifically, we attempt to find a region F of Rd with d the following property: For every x 2 R , we have that jF \ Gxj = 1, where Gx denotes the G{orbit of x under the action of G. As an application, we argue that our construction could help lead to a new combinatorial reciprocity theorem for the quasi{polynomial counting isomorphism types of t − (v; k; λ) designs. I certify that the Abstract is a correct representation of the content of this thesis. Chair, Thesis Committee Date ACKNOWLEDGMENTS I thank my advisors, Dr. Matthias Beck and Dr.
    [Show full text]
  • Matroid Enumeration for Incidence Geometry
    Discrete Comput Geom (2012) 47:17–43 DOI 10.1007/s00454-011-9388-y Matroid Enumeration for Incidence Geometry Yoshitake Matsumoto · Sonoko Moriyama · Hiroshi Imai · David Bremner Received: 30 August 2009 / Revised: 25 October 2011 / Accepted: 4 November 2011 / Published online: 30 November 2011 © Springer Science+Business Media, LLC 2011 Abstract Matroids are combinatorial abstractions for point configurations and hy- perplane arrangements, which are fundamental objects in discrete geometry. Matroids merely encode incidence information of geometric configurations such as collinear- ity or coplanarity, but they are still enough to describe many problems in discrete geometry, which are called incidence problems. We investigate two kinds of inci- dence problem, the points–lines–planes conjecture and the so-called Sylvester–Gallai type problems derived from the Sylvester–Gallai theorem, by developing a new algo- rithm for the enumeration of non-isomorphic matroids. We confirm the conjectures of Welsh–Seymour on ≤11 points in R3 and that of Motzkin on ≤12 lines in R2, extend- ing previous results. With respect to matroids, this algorithm succeeds to enumerate a complete list of the isomorph-free rank 4 matroids on 10 elements. When geometric configurations corresponding to specific matroids are of interest in some incidence problems, they should be analyzed on oriented matroids. Using an encoding of ori- ented matroid axioms as a boolean satisfiability (SAT) problem, we also enumerate oriented matroids from the matroids of rank 3 on n ≤ 12 elements and rank 4 on n ≤ 9 elements. We further list several new minimal non-orientable matroids. Y. Matsumoto · H. Imai Graduate School of Information Science and Technology, University of Tokyo, Tokyo, Japan Y.
    [Show full text]
  • Set Theory. • Sets Have Elements, Written X ∈ X, and Subsets, Written a ⊆ X. • the Empty Set ∅ Has No Elements
    Set theory. • Sets have elements, written x 2 X, and subsets, written A ⊆ X. • The empty set ? has no elements. • A function f : X ! Y takes an element x 2 X and returns an element f(x) 2 Y . The set X is its domain, and Y is its codomain. Every set X has an identity function idX defined by idX (x) = x. • The composite of functions f : X ! Y and g : Y ! Z is the function g ◦ f defined by (g ◦ f)(x) = g(f(x)). • The function f : X ! Y is a injective or an injection if, for every y 2 Y , there is at most one x 2 X such that f(x) = y (resp. surjective, surjection, at least; bijective, bijection, exactly). In other words, f is a bijection if and only if it is both injective and surjective. Being bijective is equivalent to the existence of an inverse function f −1 such −1 −1 that f ◦ f = idY and f ◦ f = idX . • An equivalence relation on a set X is a relation ∼ such that { (reflexivity) for every x 2 X, x ∼ x; { (symmetry) for every x; y 2 X, if x ∼ y, then y ∼ x; and { (transitivity) for every x; y; z 2 X, if x ∼ y and y ∼ z, then x ∼ z. The equivalence class of x 2 X under the equivalence relation ∼ is [x] = fy 2 X : x ∼ yg: The distinct equivalence classes form a partition of X, i.e., every element of X is con- tained in a unique equivalence class. Incidence geometry.
    [Show full text]
  • Math 431 Solutions to Homework 3
    Math 431 Solutions to Homework 3 1. Show that the following familiar interpretation is a model for incidence geometry. Note that in class we already showed that Axiom I-1 is satisfied, so you only need to show that I-2 and I-3 are satisfied. • The “points” are all ordered pairs (x, y) of real numbers. • A “line” is specified by an ordered triple (a, b, c) of real numbers such that either a 6= 0 or b 6= 0; it is defined as the set of all “points” (x, y) that satisfy the equation ax + by + c = 0. • “Incidence” is defined as set membership. Proof that I-1 is satisfied. This is an expanded version of what was done in class. Let P = (x1, y1) and Q = (x2, y2) be two distinct points. We need to show that there is a unique line passing through both of them. Case 1: Suppose that x1 = x2. In this case the line given by the equation x = x1 (1) passes through P and Q (since (x1, y1) and (x2, y2) satisfy this equation). To show that this line is unique, suppose we are given any line l passing through P and Q. Let ax + by + c = 0 be an equation for l. Since P and Q satisfy this equation, ax1 + by1 + c = 0, and ax2 + by2 + c = 0. Now we have ax1 + by1 + c = ax2 + by2 + c ⇐⇒ ax1 + by1 = ax2 + by2 ⇐⇒ ax1 − ax2 = by2 − by1 ⇐⇒ −a(x2 − x1) = b(y2 − y1). We know that y1 6= y2 (because x1 = x2 and P 6= Q).
    [Show full text]
  • Analogy Between Additive Combinations, Finite Incidence Geometry & Graph Theory
    International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395 -0056 Volume: 04 Issue: 05 | May -2017 www.irjet.net p-ISSN: 2395-0072 Analogy between Additive Combinations, Finite incidence Geometry & Graph Theory 1 2 K SrnivasaRao , Dr k.Rameshbabu 1Associate Professor, Mathematics, H&S.CIET, JNTUK, Guntur, AP, India. 2Associate. Professor, Comm. stream, ECE Department, JIT, JU, East.Afrika --------------------------------------------------------------***-------------------------------------------------------------- Abstract: The topic is the study of the Tur´an number finite subsets of a group with the property that they are for C4. Fu¨redi showed that C4-free graphs with ex(n,C4) almost closed under multiplication. Approximate groups edges are intimately related to polarity graphs of and their applications (for example, to expand er graphs, projective planes. Then prove a general theorem about group theory, Probability, model theory, and so on) form dense subgraphs in a wide class of polarity graphs, and as a very active and promising area of research in additive a result give the best-known lower bounds for ex(n,C4) for combinatorics. this paper describes additive many values of n.and also study the chromatic and combinatorics as the following: “additive combinatorics independence numbers of polarity graphs, with special focuses on three classes of theorems: decomposition emphasis on the graph ERq. Next study is Sidon sets on theorems, approximate structural theorems, and graphs by considering what sets of integers may look like transference principles ”.Techniques and approaches when certain pairs of them are restricted from having the applied in additive combinatorics are often extremely same product. Other generalizations of Sidon sets are sophisticated, and may have roots in several unexpected considered as well.
    [Show full text]
  • Extending Erd\H {O} S-Beck's Theorem to Higher Dimensions
    EXTENDING ERDOS-˝ BECK’S THEOREM TO HIGHER DIMENSIONS THAO DO1 ABSTRACT. Erd˝os-Beck theorem states that n points in the plane with at most n − x points collinear define at least cxn lines for some positive constant c. It implies n points in the plane define Θ(n2) lines unless most of the points (i.e. n − o(n) points) are collinear. In this paper, we will present two ways to extend this result to higher dimensions. Given a set S of n points in Rd, we want to estimate a lower bound of the number of hyperplanes they define (a hyperplane is defined or spanned by S if it contains d +1 points of S in general position). Our first result says the number of spanned hyperplanes is at least cxnd−1 if there exists some hyperplane that contains n − x points of S and saturated (as defined in Definition 1.3). Our second result says n points in Rd define Θ(nd) hyperplanes unless most of the points belong to the union of a collection of flats whose sum of dimension is strictly less than d. Our result has application to point-hyperplane incidences and potential application to the point covering problem. 1. INTRODUCTION Given a set S of n points in the plane, we say a line l is a spanning line of S (or l is spanned by S) if l contains at least two distinct points of S. The following theorem was proposed by Erd˝os and proved by Beck in [3]: Theorem 1.1.
    [Show full text]
  • Structure Theorems and Extremal Problems in Incidence Geometry
    Structure theorems and extremal problems in incidence geometry Hiu Chung Aaron Lin A thesis submitted for the degree of Doctor of Philosophy Department of Mathematics The London School of Economics and Political Science November 2019 Declaration I certify that the thesis I have presented for examination for the MPhil/PhD degree of the London School of Economics and Political Science is my own work, with the following exceptions. Parts of Section 3.3, parts of Chapter4, Section 5.3, and Section 6.3 are based on [40], which is published in Discrete & Computational Geometry, and is joint work with Mehdi Makhul, Hossein Nassajian Mojarrad, Josef Schicho, Konrad Swanepoel, and Frank de Zeeuw. Lemma 3.16 of Section 3.2, Section 5.1, and Section 6.1 are based on [41], which is accepted to the Journal of the London Mathematical Society, and is joint work with Konrad Swanepoel. Lemma 2.6 of Section 2.1, Section 2.2.2, Section 3.2, parts of Chapter4, Section 5.2, and Section 6.2 are based on [42], which is joint work with Konrad Swanepoel. Parts of Section 3.3, Section 5.4, and Section 6.4 are based on [43], which is joint work with Konrad Swanepoel. The copyright of this thesis rests with the author. Quotation from it is permitted, provided that full acknowledgement is made. This thesis may not be reproduced without the prior written consent of the author. I warrant that this authorisation does not, to the best of my belief, infringe the rights of any third party.
    [Show full text]