Lecture Notes on Tropical Geometry
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Tropical Geometry of Deep Neural Networks
Tropical Geometry of Deep Neural Networks Liwen Zhang 1 Gregory Naitzat 2 Lek-Heng Lim 2 3 Abstract 2011; Montufar et al., 2014; Eldan & Shamir, 2016; Poole et al., 2016; Telgarsky, 2016; Arora et al., 2018). Recent We establish, for the first time, explicit connec- work (Zhang et al., 2016) showed that several successful tions between feedforward neural networks with neural networks possess a high representation power and ReLU activation and tropical geometry — we can easily shatter random data. However, they also general- show that the family of such neural networks is ize well to data unseen during training stage, suggesting that equivalent to the family of tropical rational maps. such networks may have some implicit regularization. Tra- Among other things, we deduce that feedforward ditional measures of complexity such as VC-dimension and ReLU neural networks with one hidden layer can Rademacher complexity fail to explain this phenomenon. be characterized by zonotopes, which serve as Understanding this implicit regularization that begets the building blocks for deeper networks; we relate generalization power of deep neural networks remains a decision boundaries of such neural networks to challenge. tropical hypersurfaces, a major object of study in tropical geometry; and we prove that linear The goal of our work is to establish connections between regions of such neural networks correspond to neural network and tropical geometry in the hope that they vertices of polytopes associated with tropical ra- will shed light on the workings of deep neural networks. tional functions. An insight from our tropical for- Tropical geometry is a new area in algebraic geometry that mulation is that a deeper network is exponentially has seen an explosive growth in the recent decade but re- more expressive than a shallow network. -
Group Actions and Divisors on Tropical Curves Max B
Claremont Colleges Scholarship @ Claremont HMC Senior Theses HMC Student Scholarship 2011 Group Actions and Divisors on Tropical Curves Max B. Kutler Harvey Mudd College Recommended Citation Kutler, Max B., "Group Actions and Divisors on Tropical Curves" (2011). HMC Senior Theses. 5. https://scholarship.claremont.edu/hmc_theses/5 This Open Access Senior Thesis is brought to you for free and open access by the HMC Student Scholarship at Scholarship @ Claremont. It has been accepted for inclusion in HMC Senior Theses by an authorized administrator of Scholarship @ Claremont. For more information, please contact [email protected]. Group Actions and Divisors on Tropical Curves Max B. Kutler Dagan Karp, Advisor Eric Katz, Reader May, 2011 Department of Mathematics Copyright c 2011 Max B. Kutler. The author grants Harvey Mudd College and the Claremont Colleges Library the nonexclusive right to make this work available for noncommercial, educational purposes, provided that this copyright statement appears on the reproduced ma- terials and notice is given that the copying is by permission of the author. To dis- seminate otherwise or to republish requires written permission from the author. Abstract Tropical geometry is algebraic geometry over the tropical semiring, or min- plus algebra. In this thesis, I discuss the basic geometry of plane tropical curves. By introducing the notion of abstract tropical curves, I am able to pass to a more abstract metric-topological setting. In this setting, I discuss divisors on tropical curves. I begin a study of G-invariant divisors and divisor classes. Contents Abstract iii Acknowledgments ix 1 Tropical Geometry 1 1.1 The Tropical Semiring . -
1 Affine Varieties
1 Affine Varieties We will begin following Kempf's Algebraic Varieties, and eventually will do things more like in Hartshorne. We will also use various sources for commutative algebra. What is algebraic geometry? Classically, it is the study of the zero sets of polynomials. We will now fix some notation. k will be some fixed algebraically closed field, any ring is commutative with identity, ring homomorphisms preserve identity, and a k-algebra is a ring R which contains k (i.e., we have a ring homomorphism ι : k ! R). P ⊆ R an ideal is prime iff R=P is an integral domain. Algebraic Sets n n We define affine n-space, A = k = f(a1; : : : ; an): ai 2 kg. n Any f = f(x1; : : : ; xn) 2 k[x1; : : : ; xn] defines a function f : A ! k : (a1; : : : ; an) 7! f(a1; : : : ; an). Exercise If f; g 2 k[x1; : : : ; xn] define the same function then f = g as polynomials. Definition 1.1 (Algebraic Sets). Let S ⊆ k[x1; : : : ; xn] be any subset. Then V (S) = fa 2 An : f(a) = 0 for all f 2 Sg. A subset of An is called algebraic if it is of this form. e.g., a point f(a1; : : : ; an)g = V (x1 − a1; : : : ; xn − an). Exercises 1. I = (S) is the ideal generated by S. Then V (S) = V (I). 2. I ⊆ J ) V (J) ⊆ V (I). P 3. V ([αIα) = V ( Iα) = \V (Iα). 4. V (I \ J) = V (I · J) = V (I) [ V (J). Definition 1.2 (Zariski Topology). We can define a topology on An by defining the closed subsets to be the algebraic subsets. -
Notes by Eric Katz TROPICAL GEOMETRY
Notes by Eric Katz TROPICAL GEOMETRY GRIGORY MIKHALKIN 1. Introduction 1.1. Two applications. Let us begin with two examples of questions where trop- ical geometry is useful. Example 1.1. Can we represent an untied trefoil knot as a genus 1 curve of degree 5 in RP3? Yes, by means of tropical geometry. It turns out that it can be be represented by a rational degree 5 curve but not by curve of genus greater than 1 since such a curve must sit on a quadric surface in RP3. 3 k 3 Figure 1. Untied trefoil. Example 1.2. Can we enumerate real and complex curves simultaneously by com- binatorics? For example, there is a way to count curves in RP2 or CP2 through 3d − 1+ g points by using bipartite graphs. 1.2. Tropical Geometry. Tropical geometry is algebraic geometry over the tropi- cal semi-field, (T, “+”, “·”). The semi-field’s underlying set is the half-open interval [−∞, ∞). The operations are given for a,b ∈ T by “a + b” = max(a,b) “a · b”= a + b. The semi-field has the properties of a field except that additive inverses do not exist. Moreover, every element is an idempotent, “a + a”= a so there is no way to adjoin inverses. In some sense algebra becomes harder, geometry becomes easier. By the way, tropical geometry is named in honor of a Brazilian computer scien- tist, Imre Simon. Two observations make tropical geometry easy. First, the tropical semiring T naturally has a Euclidean topology like R and C. Second, the geometric structures are piecewise linear structures, and so tropical geometry reduces to a combination 1 2 MIKHALKIN of combinatorics and linear algebra. -
Applications of Tropical Geometry in Deep Neural Networks
Applications of Tropical Geometry in Deep Neural Networks Thesis by Motasem H. A. Alfarra In Partial Fulfillment of the Requirements For the Degree of Masters of Science in Electrical Engineering King Abdullah University of Science and Technology Thuwal, Kingdom of Saudi Arabia April, 2020 2 EXAMINATION COMMITTEE PAGE The thesis of Motasem H. A. Alfarra is approved by the examination committee Committee Chairperson: Bernard S. Ghanem Committee Members: Bernard S. Ghanem, Wolfgang Heidrich, Xiangliang Zhang 3 ©April, 2020 Motasem H. A. Alfarra All Rights Reserved 4 ABSTRACT Applications of Tropical Geometry in Deep Neural Networks Motasem H. A. Alfarra This thesis tackles the problem of understanding deep neural network with piece- wise linear activation functions. We leverage tropical geometry, a relatively new field in algebraic geometry to characterize the decision boundaries of a single hidden layer neural network. This characterization is leveraged to understand, and reformulate three interesting applications related to deep neural network. First, we give a geo- metrical demonstration of the behaviour of the lottery ticket hypothesis. Moreover, we deploy the geometrical characterization of the decision boundaries to reformulate the network pruning problem. This new formulation aims to prune network pa- rameters that are not contributing to the geometrical representation of the decision boundaries. In addition, we propose a dual view of adversarial attack that tackles both designing perturbations to the input image, and the equivalent perturbation to the decision boundaries. 5 ACKNOWLEDGEMENTS First of all, I would like to express my deepest gratitude to my thesis advisor Prof. Bernard Ghanem who supported me through this journey. Prof. -
Algebraic Geometry Part III Catch-Up Workshop 2015
Algebraic Geometry Part III Catch-up Workshop 2015 Jack Smith June 6, 2016 1 Abstract Algebraic Geometry This workshop will give a basic introduction to affine algebraic geometry, assuming no prior exposure to the subject. In particular, we will cover: • Affine space and algebraic sets • The Hilbert basis theorem and applications • The Zariski topology on affine space • Irreducibility and affine varieties • The Nullstellensatz • Morphisms of affine varieties. If there's time we may also touch on projective varieties. What we expect you to know • Elementary point-set topology: topological spaces, continuity, closure of a subset etc • Commutative algebra, at roughly the level covered in the Rings and Modules workshop: rings, ideals (including prime and maximal) and quotients, algebras over fields (in particular, some familiarity with polynomial rings over fields). Useful for Part III courses Algebraic Geometry, Commutative Algebra, Elliptic Curves 2 Talk 2.1 Preliminaries Useful resources: • Hartshorne `Algebraic Geometry' (classic textbook, on which I think this year's course is based, although it's quite dense; I'll mainly try to match terminology and notation with Chapter 1 of this book). • Ravi Vakil's online notes `Math 216: Foundations of Algebraic Geometry'. • Eisenbud `Commutative Algebra with a view toward algebraic geometry' (covers all the algebra you might need, with a geometric flavour|it has pictures). 1 • Pelham Wilson's online notes for the `Preliminary Chapter 0' of his Part III Algebraic Geometry course from last year cover much of this catch-up material but are pretty brief (warning: this year's course has a different lecturer so will be different). -
Tropical Geometry? Eric Katz Communicated by Cesar E
THE GRADUATE STUDENT SECTION WHAT IS… Tropical Geometry? Eric Katz Communicated by Cesar E. Silva This note was written to answer the question, What is tropical geometry? That question can be interpreted in two ways: Would you tell me something about this research area? and Why the unusual name ‘tropi- Tropical cal geometry’? To address Figure 1. Tropical curves, such as this tropical line the second question, trop- and two tropical conics, are polyhedral complexes. geometry ical geometry is named in transforms honor of Brazilian com- science. Here, tropical geometry can be considered as alge- puter scientist Imre Simon. braic geometry over the tropical semifield (ℝ∪{∞}, ⊕, ⊗) questions about This naming is compli- with operations given by cated by the fact that he algebraic lived in São Paolo and com- 푎 ⊕ 푏 = min(푎, 푏), 푎 ⊗ 푏 = 푎 + 푏. muted across the Tropic One can then find tropical analogues of classical math- varieties into of Capricorn. Whether his ematics and define tropical polynomials, tropical hyper- work is tropical depends surfaces, and tropical varieties. For example, a degree 2 questions about on whether he preferred to polynomial in variables 푥, 푦 would be of the form do his research at home or polyhedral min(푎 + 2푥, 푎 + 푥 + 푦, 푎 + 2푦, 푎 + 푥, 푎 + 푦, 푎 ) in the office. 20 11 02 10 01 00 complexes. The main goal of for constants 푎푖푗 ∈ ℝ ∪ {∞}. The zero locus of a tropical tropical geometry is trans- polynomial is defined to be the set of points where the forming questions about minimum is achieved by at least two entries. -
Chapter 2 Affine Algebraic Geometry
Chapter 2 Affine Algebraic Geometry 2.1 The Algebraic-Geometric Dictionary The correspondence between algebra and geometry is closest in affine algebraic geom- etry, where the basic objects are solutions to systems of polynomial equations. For many applications, it suffices to work over the real R, or the complex numbers C. Since important applications such as coding theory or symbolic computation require finite fields, Fq , or the rational numbers, Q, we shall develop algebraic geometry over an arbitrary field, F, and keep in mind the important cases of R and C. For algebraically closed fields, there is an exact and easily motivated correspondence be- tween algebraic and geometric concepts. When the field is not algebraically closed, this correspondence weakens considerably. When that occurs, we will use the case of algebraically closed fields as our guide and base our definitions on algebra. Similarly, the strongest and most elegant results in algebraic geometry hold only for algebraically closed fields. We will invoke the hypothesis that F is algebraically closed to obtain these results, and then discuss what holds for arbitrary fields, par- ticularly the real numbers. Since many important varieties have structures which are independent of the field of definition, we feel this approach is justified—and it keeps our presentation elementary and motivated. Lastly, for the most part it will suffice to let F be R or C; not only are these the most important cases, but they are also the sources of our geometric intuitions. n Let A denote affine n-space over F. This is the set of all n-tuples (t1,...,tn) of elements of F. -
The Boardman Vogt Resolution and Tropical Moduli Spaces
The Boardman Vogt resolution and tropical moduli spaces by Nina Otter Master Thesis submitted to The Department of Mathematics Supervisors: Prof. Dr. John Baez (UCR) Prof. Dr. Giovanni Felder (ETH) Contents Page Acknowledgements 5 Introduction 7 Preliminaries 9 1. Monoidal categories 9 2. Operads 13 3. Trees 17 Operads and homotopy theory 31 4. Monoidal model categories 31 5. A model structure on the category of topological operads 32 6. The W-construction 35 Tropical moduli spaces 41 7. Abstract tropical curves as metric graphs 47 8. Tropical modifications and pointed curves 48 9. Tropical moduli spaces 49 Appendix A. Closed monoidal categories, enrichment and the endomorphism operad 55 Appendix. Bibliography 63 3 Acknowledgements First and foremost I would like to thank Professor John Baez for making this thesis possible, for his enduring patience and support, and for sharing his lucid vision of the big picture, sparing me the agony of mindlessly hacking my way through the rainforest of topological operads and possibly falling victim to the many perils which lurk within. Furthermore I am indebted to Professor Giovanni Felder who kindly assumed the respon- sibility of supervising the thesis on behalf of the ETH, and for several fruitful meetings in which he took time to listen to my progress, sharing his clear insight and giving precious advice. I would also like to thank David Speyer who pointed out the relation between tropical geometry and phylogenetic trees to Professor Baez, and Adrian Clough for all the fruitful discussions on various topics in this thesis and for sharing his ideas on mathematical writing in general. -
1. Affine Varieties
6 Andreas Gathmann 1. Affine Varieties As explained in the introduction, the goal of algebraic geometry is to study solutions of polynomial equations in several variables over a fixed ground field, so we will start by making the corresponding definitions. In order to make the correspondence between geometry and algebra as clear as possible (in particular to allow for Hilbert’s Nullstellensatz in Proposition 1.10) we will restrict to the case of algebraically closed ground fields first. In particular, if we draw pictures over R they should always be interpreted as the real points of an underlying complex situation. Convention 1.1. (a) In the following, until we introduce schemes in Chapter 12, K will always denote a fixed algebraically closed ground field. (b) Rings are always assumed to be commutative with a multiplicative unit 1. If J is an ideal in a ring R we will write this as J E R, and denote the radical of J by p k J := f f 2 R : f 2 J for some k 2 Ng: The ideal generated by a subset S of a ring will be written as hSi. (c) As usual, we will denote the polynomial ring in n variables x1;:::;xn over K by K[x1;:::;xn], n and the value of a polynomial f 2 K[x1;:::;xn] at a point a = (a1;:::;an) 2 K by f (a). If there is no risk of confusion we will often denote a point in Kn by the same letter x as we used for the formal variables, writing f 2 K[x1;:::;xn] for the polynomial and f (x) for its value at a point x 2 Kn. -
Commutative Algebra
Commutative Algebra Andrew Kobin Spring 2016 / 2019 Contents Contents Contents 1 Preliminaries 1 1.1 Radicals . .1 1.2 Nakayama's Lemma and Consequences . .4 1.3 Localization . .5 1.4 Transcendence Degree . 10 2 Integral Dependence 14 2.1 Integral Extensions of Rings . 14 2.2 Integrality and Field Extensions . 18 2.3 Integrality, Ideals and Localization . 21 2.4 Normalization . 28 2.5 Valuation Rings . 32 2.6 Dimension and Transcendence Degree . 33 3 Noetherian and Artinian Rings 37 3.1 Ascending and Descending Chains . 37 3.2 Composition Series . 40 3.3 Noetherian Rings . 42 3.4 Primary Decomposition . 46 3.5 Artinian Rings . 53 3.6 Associated Primes . 56 4 Discrete Valuations and Dedekind Domains 60 4.1 Discrete Valuation Rings . 60 4.2 Dedekind Domains . 64 4.3 Fractional and Invertible Ideals . 65 4.4 The Class Group . 70 4.5 Dedekind Domains in Extensions . 72 5 Completion and Filtration 76 5.1 Topological Abelian Groups and Completion . 76 5.2 Inverse Limits . 78 5.3 Topological Rings and Module Filtrations . 82 5.4 Graded Rings and Modules . 84 6 Dimension Theory 89 6.1 Hilbert Functions . 89 6.2 Local Noetherian Rings . 94 6.3 Complete Local Rings . 98 7 Singularities 106 7.1 Derived Functors . 106 7.2 Regular Sequences and the Koszul Complex . 109 7.3 Projective Dimension . 114 i Contents Contents 7.4 Depth and Cohen-Macauley Rings . 118 7.5 Gorenstein Rings . 127 8 Algebraic Geometry 133 8.1 Affine Algebraic Varieties . 133 8.2 Morphisms of Affine Varieties . 142 8.3 Sheaves of Functions . -
A Course in Commutative Algebra
Graduate Texts in Mathematics 256 A Course in Commutative Algebra Bearbeitet von Gregor Kemper 1. Auflage 2010. Buch. xii, 248 S. Hardcover ISBN 978 3 642 03544 9 Format (B x L): 0 x 0 cm Gewicht: 1200 g Weitere Fachgebiete > Mathematik > Algebra Zu Inhaltsverzeichnis schnell und portofrei erhältlich bei Die Online-Fachbuchhandlung beck-shop.de ist spezialisiert auf Fachbücher, insbesondere Recht, Steuern und Wirtschaft. Im Sortiment finden Sie alle Medien (Bücher, Zeitschriften, CDs, eBooks, etc.) aller Verlage. Ergänzt wird das Programm durch Services wie Neuerscheinungsdienst oder Zusammenstellungen von Büchern zu Sonderpreisen. Der Shop führt mehr als 8 Millionen Produkte. Chapter 1 Hilbert’s Nullstellensatz Hilbert’s Nullstellensatz may be seen as the starting point of algebraic geom- etry. It provides a bijective correspondence between affine varieties, which are geometric objects, and radical ideals in a polynomial ring, which are algebraic objects. In this chapter, we give proofs of two versions of the Nullstellensatz. We exhibit some further correspondences between geometric and algebraic objects. Most notably, the coordinate ring is an affine algebra assigned to an affine variety, and points of the variety correspond to maximal ideals in the coordinate ring. Before we get started, let us fix some conventions and notation that will be used throughout the book. By a ring we will always mean a commutative ring with an identity element 1. In particular, there is a ring R = {0},the zero ring,inwhich1=0.AringR is called an integral domain if R has no zero divisors (other than 0 itself) and R ={0}.Asubring of a ring R must contain the identity element of R, and a homomorphism R → S of rings must send the identity element of R to the identity element of S.