Tropical Gaussians: a Brief Survey 3
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Tropical Geometry of Deep Neural Networks
Tropical Geometry of Deep Neural Networks Liwen Zhang 1 Gregory Naitzat 2 Lek-Heng Lim 2 3 Abstract 2011; Montufar et al., 2014; Eldan & Shamir, 2016; Poole et al., 2016; Telgarsky, 2016; Arora et al., 2018). Recent We establish, for the first time, explicit connec- work (Zhang et al., 2016) showed that several successful tions between feedforward neural networks with neural networks possess a high representation power and ReLU activation and tropical geometry — we can easily shatter random data. However, they also general- show that the family of such neural networks is ize well to data unseen during training stage, suggesting that equivalent to the family of tropical rational maps. such networks may have some implicit regularization. Tra- Among other things, we deduce that feedforward ditional measures of complexity such as VC-dimension and ReLU neural networks with one hidden layer can Rademacher complexity fail to explain this phenomenon. be characterized by zonotopes, which serve as Understanding this implicit regularization that begets the building blocks for deeper networks; we relate generalization power of deep neural networks remains a decision boundaries of such neural networks to challenge. tropical hypersurfaces, a major object of study in tropical geometry; and we prove that linear The goal of our work is to establish connections between regions of such neural networks correspond to neural network and tropical geometry in the hope that they vertices of polytopes associated with tropical ra- will shed light on the workings of deep neural networks. tional functions. An insight from our tropical for- Tropical geometry is a new area in algebraic geometry that mulation is that a deeper network is exponentially has seen an explosive growth in the recent decade but re- more expressive than a shallow network. -
Group Actions and Divisors on Tropical Curves Max B
Claremont Colleges Scholarship @ Claremont HMC Senior Theses HMC Student Scholarship 2011 Group Actions and Divisors on Tropical Curves Max B. Kutler Harvey Mudd College Recommended Citation Kutler, Max B., "Group Actions and Divisors on Tropical Curves" (2011). HMC Senior Theses. 5. https://scholarship.claremont.edu/hmc_theses/5 This Open Access Senior Thesis is brought to you for free and open access by the HMC Student Scholarship at Scholarship @ Claremont. It has been accepted for inclusion in HMC Senior Theses by an authorized administrator of Scholarship @ Claremont. For more information, please contact [email protected]. Group Actions and Divisors on Tropical Curves Max B. Kutler Dagan Karp, Advisor Eric Katz, Reader May, 2011 Department of Mathematics Copyright c 2011 Max B. Kutler. The author grants Harvey Mudd College and the Claremont Colleges Library the nonexclusive right to make this work available for noncommercial, educational purposes, provided that this copyright statement appears on the reproduced ma- terials and notice is given that the copying is by permission of the author. To dis- seminate otherwise or to republish requires written permission from the author. Abstract Tropical geometry is algebraic geometry over the tropical semiring, or min- plus algebra. In this thesis, I discuss the basic geometry of plane tropical curves. By introducing the notion of abstract tropical curves, I am able to pass to a more abstract metric-topological setting. In this setting, I discuss divisors on tropical curves. I begin a study of G-invariant divisors and divisor classes. Contents Abstract iii Acknowledgments ix 1 Tropical Geometry 1 1.1 The Tropical Semiring . -
Gaussian Measures in Traditional and Not So Traditional Settings
BULLETIN (New Series) OF THE AMERICAN MATHEMATICAL SOCIETY Volume 33, Number 2, April 1996 GAUSSIAN MEASURES IN TRADITIONAL AND NOT SO TRADITIONAL SETTINGS DANIEL W. STROOCK Abstract. This article is intended to provide non-specialists with an intro- duction to integration theory on pathspace. 0: Introduction § Let Q1 denote the set of rational numbers q [0, 1], and, for a Q1, define the ∈ ∈ translation map τa on Q1 by addition modulo 1: a + b if a + b 1 τab = ≤ for b Q1. a + b 1ifa+b>1 ∈ − Is there a probability measure λQ1 on Q1 which is translation invariant in the sense that 1 λQ1 (Γ) = λQ1 τa− Γ for every a Q1? To answer∈ this question, it is necessary to be precise about what it is that one is seeking. Indeed, the answer will depend on the level of ambition at which the question is asked. For example, if denotes the algebra of subsets Γ Q1 generated by intervals A ⊆ [a, b] 1 q Q1 : a q b Q ≡ ∈ ≤ ≤ for a b from Q1, then it is easy to check that there is a unique, finitely additive way to≤ define λ on .Infact, Q1 A λ 1 [a, b] 1 = b a, for a b from Q1. Q Q − ≤ On the other hand, if one is more ambitious and asks for a countably additive λQ1 on the σ-algebra generated by (equivalently, all subsets of Q1), then one is asking A for too much. In fact, since λQ1 ( q ) = 0 for every q Q1, countable additivity forces { } ∈ λ 1 (Q1)= λ 1 q =0, Q Q { } q 1 X∈Q which is obviously irreconcilable with λQ1 (Q1) = 1. -
Notes by Eric Katz TROPICAL GEOMETRY
Notes by Eric Katz TROPICAL GEOMETRY GRIGORY MIKHALKIN 1. Introduction 1.1. Two applications. Let us begin with two examples of questions where trop- ical geometry is useful. Example 1.1. Can we represent an untied trefoil knot as a genus 1 curve of degree 5 in RP3? Yes, by means of tropical geometry. It turns out that it can be be represented by a rational degree 5 curve but not by curve of genus greater than 1 since such a curve must sit on a quadric surface in RP3. 3 k 3 Figure 1. Untied trefoil. Example 1.2. Can we enumerate real and complex curves simultaneously by com- binatorics? For example, there is a way to count curves in RP2 or CP2 through 3d − 1+ g points by using bipartite graphs. 1.2. Tropical Geometry. Tropical geometry is algebraic geometry over the tropi- cal semi-field, (T, “+”, “·”). The semi-field’s underlying set is the half-open interval [−∞, ∞). The operations are given for a,b ∈ T by “a + b” = max(a,b) “a · b”= a + b. The semi-field has the properties of a field except that additive inverses do not exist. Moreover, every element is an idempotent, “a + a”= a so there is no way to adjoin inverses. In some sense algebra becomes harder, geometry becomes easier. By the way, tropical geometry is named in honor of a Brazilian computer scien- tist, Imre Simon. Two observations make tropical geometry easy. First, the tropical semiring T naturally has a Euclidean topology like R and C. Second, the geometric structures are piecewise linear structures, and so tropical geometry reduces to a combination 1 2 MIKHALKIN of combinatorics and linear algebra. -
Infinite Dimension
Tel Aviv University, 2006 Gaussian random vectors 10 2 Basic notions: infinite dimension 2a Random elements of measurable spaces: formu- lations ......................... 10 2b Random elements of measurable spaces: proofs, andmorefacts .................... 14 2c Randomvectors ................... 17 2d Gaussian random vectors . 20 2e Gaussian conditioning . 24 foreword Up to isomorphism, we have for each n only one n-dimensional Gaussian measure (like a Euclidean space). What about only one infinite-dimensional Gaussian measure (like a Hilbert space)? Probability in infinite-dimensional spaces is usually overloaded with topo- logical technicalities; spaces are required to be Hilbert or Banach or locally convex (or not), separable (or not), complete (or not) etc. A fuss! We need measurability, not continuity; a σ-field, not a topology. This is the way to a single infinite-dimensional Gaussian measure (up to isomorphism). Naturally, the infinite-dimensional case is more technical than finite- dimensional. The crucial technique is compactness. Back to topology? Not quite so. The art is, to borrow compactness without paying dearly to topol- ogy. Look, how to do it. 2a Random elements of measurable spaces: formulations Before turning to Gaussian measures on infinite-dimensional spaces we need some more general theory. First, recall that ∗ a measurable space (in other words, Borel space) is a set S endowed with a σ-field B; ∗ B ⊂ 2S is a σ-field (in other words, σ-algebra, or tribe) if it is closed under finite and countable operations (union, intersection and comple- ment); ∗ a collection closed under finite operations is called a (Boolean) algebra (of sets); Tel Aviv University, 2006 Gaussian random vectors 11 ∗ the σ-field σ(C) generated by a given set C ⊂ 2S is the least σ-field that contains C; the algebra α(C) generated by C is defined similarly; ∗ a measurable map from (S1, B1) to (S2, B2) is f : S1 → S2 such that −1 f (B) ∈ B1 for all B ∈ B2. -
Applications of Tropical Geometry in Deep Neural Networks
Applications of Tropical Geometry in Deep Neural Networks Thesis by Motasem H. A. Alfarra In Partial Fulfillment of the Requirements For the Degree of Masters of Science in Electrical Engineering King Abdullah University of Science and Technology Thuwal, Kingdom of Saudi Arabia April, 2020 2 EXAMINATION COMMITTEE PAGE The thesis of Motasem H. A. Alfarra is approved by the examination committee Committee Chairperson: Bernard S. Ghanem Committee Members: Bernard S. Ghanem, Wolfgang Heidrich, Xiangliang Zhang 3 ©April, 2020 Motasem H. A. Alfarra All Rights Reserved 4 ABSTRACT Applications of Tropical Geometry in Deep Neural Networks Motasem H. A. Alfarra This thesis tackles the problem of understanding deep neural network with piece- wise linear activation functions. We leverage tropical geometry, a relatively new field in algebraic geometry to characterize the decision boundaries of a single hidden layer neural network. This characterization is leveraged to understand, and reformulate three interesting applications related to deep neural network. First, we give a geo- metrical demonstration of the behaviour of the lottery ticket hypothesis. Moreover, we deploy the geometrical characterization of the decision boundaries to reformulate the network pruning problem. This new formulation aims to prune network pa- rameters that are not contributing to the geometrical representation of the decision boundaries. In addition, we propose a dual view of adversarial attack that tackles both designing perturbations to the input image, and the equivalent perturbation to the decision boundaries. 5 ACKNOWLEDGEMENTS First of all, I would like to express my deepest gratitude to my thesis advisor Prof. Bernard Ghanem who supported me through this journey. Prof. -
Computations in Algebraic Geometry with Macaulay 2
Computations in algebraic geometry with Macaulay 2 Editors: D. Eisenbud, D. Grayson, M. Stillman, and B. Sturmfels Preface Systems of polynomial equations arise throughout mathematics, science, and engineering. Algebraic geometry provides powerful theoretical techniques for studying the qualitative and quantitative features of their solution sets. Re- cently developed algorithms have made theoretical aspects of the subject accessible to a broad range of mathematicians and scientists. The algorith- mic approach to the subject has two principal aims: developing new tools for research within mathematics, and providing new tools for modeling and solv- ing problems that arise in the sciences and engineering. A healthy synergy emerges, as new theorems yield new algorithms and emerging applications lead to new theoretical questions. This book presents algorithmic tools for algebraic geometry and experi- mental applications of them. It also introduces a software system in which the tools have been implemented and with which the experiments can be carried out. Macaulay 2 is a computer algebra system devoted to supporting research in algebraic geometry, commutative algebra, and their applications. The reader of this book will encounter Macaulay 2 in the context of concrete applications and practical computations in algebraic geometry. The expositions of the algorithmic tools presented here are designed to serve as a useful guide for those wishing to bring such tools to bear on their own problems. A wide range of mathematical scientists should find these expositions valuable. This includes both the users of other programs similar to Macaulay 2 (for example, Singular and CoCoA) and those who are not interested in explicit machine computations at all. -
Prizes and Awards Session
PRIZES AND AWARDS SESSION Wednesday, July 12, 2021 9:00 AM EDT 2021 SIAM Annual Meeting July 19 – 23, 2021 Held in Virtual Format 1 Table of Contents AWM-SIAM Sonia Kovalevsky Lecture ................................................................................................... 3 George B. Dantzig Prize ............................................................................................................................. 5 George Pólya Prize for Mathematical Exposition .................................................................................... 7 George Pólya Prize in Applied Combinatorics ......................................................................................... 8 I.E. Block Community Lecture .................................................................................................................. 9 John von Neumann Prize ......................................................................................................................... 11 Lagrange Prize in Continuous Optimization .......................................................................................... 13 Ralph E. Kleinman Prize .......................................................................................................................... 15 SIAM Prize for Distinguished Service to the Profession ....................................................................... 17 SIAM Student Paper Prizes .................................................................................................................... -
Tropical Geometry? Eric Katz Communicated by Cesar E
THE GRADUATE STUDENT SECTION WHAT IS… Tropical Geometry? Eric Katz Communicated by Cesar E. Silva This note was written to answer the question, What is tropical geometry? That question can be interpreted in two ways: Would you tell me something about this research area? and Why the unusual name ‘tropi- Tropical cal geometry’? To address Figure 1. Tropical curves, such as this tropical line the second question, trop- and two tropical conics, are polyhedral complexes. geometry ical geometry is named in transforms honor of Brazilian com- science. Here, tropical geometry can be considered as alge- puter scientist Imre Simon. braic geometry over the tropical semifield (ℝ∪{∞}, ⊕, ⊗) questions about This naming is compli- with operations given by cated by the fact that he algebraic lived in São Paolo and com- 푎 ⊕ 푏 = min(푎, 푏), 푎 ⊗ 푏 = 푎 + 푏. muted across the Tropic One can then find tropical analogues of classical math- varieties into of Capricorn. Whether his ematics and define tropical polynomials, tropical hyper- work is tropical depends surfaces, and tropical varieties. For example, a degree 2 questions about on whether he preferred to polynomial in variables 푥, 푦 would be of the form do his research at home or polyhedral min(푎 + 2푥, 푎 + 푥 + 푦, 푎 + 2푦, 푎 + 푥, 푎 + 푦, 푎 ) in the office. 20 11 02 10 01 00 complexes. The main goal of for constants 푎푖푗 ∈ ℝ ∪ {∞}. The zero locus of a tropical tropical geometry is trans- polynomial is defined to be the set of points where the forming questions about minimum is achieved by at least two entries. -
Arxiv:2010.06953V2 [Math.RA] 23 Apr 2021
IDENTITIES AND BASES IN THE HYPOPLACTIC MONOID ALAN J. CAIN, ANTÓNIO MALHEIRO, AND DUARTE RIBEIRO Abstract. This paper presents new results on the identities satisfied by the hypoplactic monoid. We show how to embed the hypoplactic monoid of any rank strictly greater than 2 (including infinite rank) into a direct product of copies of the hypoplactic monoid of rank 2. This confirms that all hypoplactic monoids of rank greater than or equal to 2 satisfy exactly the same identities. We then give a complete characterization of those identities, and prove that the variety generated by the hypoplactic monoid has finite axiomatic rank, by giving a finite basis for it. 1. Introduction A (non-trivial) identity is a formal equality u ≈ v, where u and v are words over some alphabet of variables, which is not of the form u ≈ u. If a monoid is known to satisfy an identity, an important question is whether the set of identities it satisfies is finitely based, that is, if all these identities are consequences of those in some finite subset (see [37, 42]). The plactic monoid plac, also known as the monoid of Young tableaux, is an important algebraic structure, first studied by Schensted [38] and Knuth [23], and later studied in depth by Lascoux and Schützenberger [27]. It is connected to many different areas of Mathematics, such as algebraic combinatorics, symmetric functions [29], crystal bases [4] and representation theory [14]. In particular, the question of identities in the plactic monoid has received a lot of attention recently [26, 20]. Finitely-generated polynomial-growth groups are virtually nilpotent and so sat- isfy identities [16]. -
Probability Measures on Infinite-Dimensional Stiefel Manifolds
JOURNAL OF GEOMETRIC MECHANICS doi:10.3934/jgm.2017012 ©American Institute of Mathematical Sciences Volume 9, Number 3, September 2017 pp. 291–316 PROBABILITY MEASURES ON INFINITE-DIMENSIONAL STIEFEL MANIFOLDS Eleonora Bardelli‡ Microsoft Deutschland GmbH, Germany Andrea Carlo Giuseppe Mennucci∗ Scuola Normale Superiore Piazza dei Cavalieri 7, 56126, Pisa, Italia Abstract. An interest in infinite-dimensional manifolds has recently appeared in Shape Theory. An example is the Stiefel manifold, that has been proposed as a model for the space of immersed curves in the plane. It may be useful to define probabilities on such manifolds. Suppose that H is an infinite-dimensional separable Hilbert space. Let S ⊂ H be the sphere, p ∈ S. Let µ be the push forward of a Gaussian measure γ from TpS onto S using the exponential map. Let v ∈ TpS be a Cameron–Martin vector for γ; let R be a rotation of S in the direction v, and ν = R#µ be the rotated measure. Then µ, ν are mutually singular. This is counterintuitive, since the translation of a Gaussian measure in a Cameron– Martin direction produces equivalent measures. Let γ be a Gaussian measure on H; then there exists a smooth closed manifold M ⊂ H such that the projection of H to the nearest point on M is not well defined for points in a set of positive γ measure. Instead it is possible to project a Gaussian measure to a Stiefel manifold to define a probability. 1. Introduction. Probability theory has been widely studied for almost four cen- turies. Large corpuses have been written on the theoretical aspects. -
Vita BERND STURMFELS Department of Mathematics, University of California, Berkeley, CA 94720 Phone
Vita BERND STURMFELS Department of Mathematics, University of California, Berkeley, CA 94720 Phone: (510) 642 4687, Fax: (510) 642 8204, [email protected] M.A. [Diplom] TH Darmstadt, Germany, Mathematics and Computer Science, 1985 Ph.D. [Dr. rer. nat.] TH Darmstadt, Germany, Mathematics, 1987 Ph.D. University of Washington, Seattle, Mathematics, 1987 Professional Experience: 1987–1988 Postdoctoral Fellow, I.M.A., University of Minnesota, Minneapolis 1988–1989 Assistant Professor, Research Institute for Symbolic Computation, (RISC-Linz), Linz, Austria 1989–1991 Assistant Professor, Department of Mathematics, Cornell University 1992–1996 Associate Professor, Department of Mathematics, Cornell University 1994–2001 Professor, Department of Mathematics, University of California, Berkeley 2001– Professor, Department of Mathematics and Computer Science, UC Berkeley Academic Honors: 1986 - 1987 Alfred P. Sloan Doctoral Dissertation Fellowship 1991 - 1993 Alfred P. Sloan Research Fellow 1992 - 1997 National Young Investigator (NSF) 1992 - 1997 David and Lucile Packard Fellowship 1999 Lester R. Ford Prize for Expository Writing (MAA) 2000-2001 Miller Research Professorship, UC Berkeley Spring 2003 John von Neumann Professor, Technical University M¨unchen 2003-2004 Hewlett-Packard Research Professor at MSRI Berkeley July 2004 Clay Mathematics Institute Senior Scholar Research Interests: Computational Algebra, Combinatorics, Algebraic Geometry Selected Professional Activities: Visiting Positions: D´epartment de Math´ematiques, Universit´ede Nice, France, Spring 1989 Mathematical Sciences Research Institute, Berkeley, Fall 1992 Courant Institute, New York University, 1994–95 RIMS, Kyoto University, Japan, 1997–98 Current Editorial Board Membership: Journal of the American Mathematical Society, Duke Mathematical Journal, Collecteana Mathematica, Beitr¨agezur Geometrie und Algebra, Order, Discrete and Computational Geometry, Applicable Algebra (AAECC) Journal of Combinatorial Theory (Ser.