Tensors: Geometry and Applications J.M. Landsberg
Total Page:16
File Type:pdf, Size:1020Kb
Tensors: Geometry and Applications J.M. Landsberg Contents Preface xi 0.1. Usage xi § 0.2. Overview xii § 0.3. Clash of cultures xvii § 0.4. Further reading xviii § 0.5. Conventions, acknowledgments xix § Part 1. Motivation from applications, multilinear algebra and elementary results Chapter 1. Introduction 3 1.1. The complexity of matrix multiplication 5 § 1.2. Definitions from multilinear algebra 6 § 1.3. Tensor decomposition 11 § 1.4. P v. NP and algebraic variants 17 § 1.5. Algebraic Statistics and tensor networks 21 § 1.6. Geometry and representation theory 24 § Chapter 2. Multilinear algebra 27 2.1. Rust removal exercises 28 § 2.2. Groups and representations 30 § 2.3. Tensor products 32 § 2.4. The rank and border rank of a tensor 35 § 2.5. Examples of invariant tensors 39 § v vi Contents 2.6. Symmetric and skew-symmetric tensors 40 § 2.7. Polynomials on the space of matrices 48 § 2.8. Decomposition of V ⊗3 52 § 2.9. Appendix: Basic definitions from algebra 55 § 2.10. Appendix: Jordan and rational canonical form 57 § 2.11. Appendix: Wiring diagrams 58 § Chapter 3. Elementary results on rank and border rank 67 3.1. Ranks of tensors 68 § 3.2. Symmetric rank 70 § 3.3. Uniqueness of CP decompositions 72 § 3.4. First tests of border rank: flattenings 74 § 3.5. Symmetric border rank 76 § 3.6. Partially symmetric tensor rank and border rank 79 § 3.7. Two useful techniques for determining border rank 79 § 3.8. Strassen’s equations and variants 81 § 3.9. Equations for small secant varieties 86 § 3.10. Equations for symmetric border rank 88 § 3.11. Tensors in C2 Cb Cc 92 § ⊗ ⊗ Part 2. Geometry and Representation Theory Chapter 4. Algebraic geometry for spaces of tensors 97 4.1. Diagnostic test for those familiar with algebraic geometry 98 § 4.2. First definitions 98 § 4.3. Examples of algebraic varieties 101 § 4.4. Defining equations of Veronese re-embeddings 105 § 4.5. Grassmannians 106 § 4.6. Tangent and cotangent spaces to varieties 107 § 4.7. G-varieties and homogeneous varieties 110 § 4.8. Exercises on Jordan normal form and geometry 111 § 4.9. Further information regarding algebraic varieties 111 § Chapter 5. Secant varieties 117 5.1. Joins and secant varieties 118 § 5.2. Geometry of rank and border rank 120 § 5.3. Terracini’s lemma and first consequences 122 § Contents vii 5.4. The polynomial Waring problem 125 § 5.5. Dimensions of secant varieties of Segre Varieties 127 § 5.6. Ideas of proofs of dimensions of secant varieties of triple Segre § products 130 5.7. BRPP and conjectures of Strassen and Comon 132 § Chapter 6. Exploiting symmetry: Representation theory for spaces of tensors 137 6.1. Schur’s lemma 138 § 6.2. Finite groups 139 § 6.3. Representations of the permutation group Sd 140 § ⊗d 6.4. Decomposing V as a GL(V ) module with the aid of Sd 144 § d 6.5. Decomposing S (A An) as a G = GL(A ) § 1⊗···⊗ 1 ×···× GL(An)-module 149 6.6. Characters 151 § 6.7. The Littlewood-Richardson rule 153 § 6.8. Weights and weight spaces: a generalization of eigenvalues § and eigenspaces 157 6.9. Homogeneous varieties 164 § 6.10. Ideals of homogeneous varieties 167 § 6.11. Symmetric functions 170 § Chapter 7. Tests for border rank: Equations for secant varieties 173 7.1. Subspace varieties and multi-linear rank 174 § 7.2. Additional auxiliary varieties 177 § 7.3. Flattenings 179 § 7.4. Inheritance 184 § 7.5. Prolongation and multi-prolongation 186 § 7.6. Strassen’s equations, applications and generalizations 192 § 7.7. Equations for σ (Seg(PA PB PC)) 198 § 4 × × 7.8. Young flattenings 201 § Chapter 8. Additional varieties useful for spaces of tensors 207 8.1. Tangential varieties 208 § 8.2. Dual varieties 211 § 8.3. The Pascal determinant 214 § 8.4. Differential invariants of projective varieties 215 § 8.5. Stratifications of PV ∗ via dual varieties 219 § viii Contents 8.6. The Chow variety of zero cycles and its equations 221 § 8.7. The Fano variety of lines on a variety 225 § Chapter 9. Rank 229 9.1. Remarks on rank for arbitrary varieties 229 § 9.2. Bounds on symmetric rank 231 § 9.3. Examples of classes of polynomials and their ranks 235 § Chapter 10. Normal forms for small tensors 243 10.1. Vector spaces with a finite number of orbits 244 § 10.2. Vector spaces where the orbits can be explicitly parametrized246 § 10.3. Points in C2 Cb Cc 249 § ⊗ ⊗ 10.4. Ranks and border ranks of elements of S3C3 255 § 10.5. Tensors in C3 C3 C3 257 § ⊗ ⊗ 10.6. Normal forms for C2 S2W 258 § ⊗ 10.7. Exercises on normal forms for general points on small secant § varieties 259 10.8. Limits of secant planes 259 § 10.9. Limits for Veronese varieties 261 § 10.10. Ranks and normal forms in σ (Seg(PA PAn)) 264 § 3 1⊗···⊗ Part 3. Applications Chapter 11. The complexity of matrix multiplication 271 11.1. “Real world” issues 272 § 11.2. Failure of the border rank version of Strassen’s conjecture 273 § 11.3. Finite group approach to upper bounds 277 § 11.4. R(M , , ) 23 279 § 3 3 3 ≤ 11.5. Bl¨aser’s 5 -Theorem 279 § 2 11.6. The Brockett-Dobkin Theorem 281 § 11.7. Multiplicative complexity 283 § Chapter 12. Tensor decomposition 285 12.1. Cumulants 286 § 12.2. Blind deconvolution of DS-CMDA signals 289 § 12.3. Uniqueness results coming from algebraic geometry 295 § 12.4. Exact decomposition algorithms 297 § 12.5. Kruskal’s Theorem and its proof 301 § Contents ix Chapter 13. P v. NP 307 13.1. Introduction to complexity 308 § 13.2. Polynomials arising in complexity theory, graph theory, and § statistics 311 13.3. Definitions of VP, VNP and other algebraic complexity § classes 313 13.4. Complexity of perm and detn 318 § n 13.5. Immanants and their symmetries 325 § 13.6. Geometric Complexity Theory approach to VPws v. VNP 329 § 13.7. Other complexity classes via polynomials 336 § 13.8. Vectors of minors and homogeneous varieties 337 § 13.9. Holographic algorithms and spinors 344 § Chapter 14. Varieties of tensors in phylogenetics and quantum mechanics 353 14.1. Tensor network states 353 § 14.2. Algebraic Statistics and phylogenetics 359 § Part 4. Advanced topics Chapter 15. Overview of the proof of the Alexander-Hirschowitz theorem 369 15.1. The semi-classical cases 370 § 15.2. The Alexander-Hirschowitz idea for dealing with the § remaining cases 373 Chapter 16. Representation theory 377 16.1. Basic definitions 377 § 16.2. Casimir eigenvalues and Kostant’s theorem 381 § 16.3. Cohomology of homogeneous vector bundles 385 § 16.4. Equations and Inheritance in a more general context 389 § Chapter 17. Weyman’s method 391 17.1. Ideals and coordinate rings of projective varieties 392 § 17.2. Koszul sequences 393 § 17.3. The Kempf-Weyman method 396 § 17.4. Subspace varieties 400 § Hints and Answers to Selected Exercises 405 Bibliography 411 x Contents Index 429 Preface Tensors are ubiquitous in the sciences. One reason for their ubiquity is that they provide a useful way to organize data. Geometry is a powerful tool for extracting information from data sets, and a beautiful subject in its own right. This book has three intended uses: as a classroom textbook, a reference work for researchers, and a research manuscript. 0.1. Usage Classroom uses. Here are several possible courses one could give from this text: (1) The first part of this text is suitable for an advanced course in multi- linear algebra - it provides a solid foundation for the study of tensors and contains numerous applications, exercises, and examples. Such a course would cover Chapters 1,2,3 and parts of Chapters 4,5,6. (2) For a graduate course on the geometry of tensors not assuming al- gebraic geometry, one can cover Chapters 1,2,4,5,6,7 and 8 skipping 2.9-12, 4.6, 5.7, 6.7 (except Pieri), 7.6 and 8.6-8. (3) For a graduate course on the geometry of tensors assuming alge- braic geometry and with more emphasis on theory, one can follow the above outline only skimming Chapters 2 and 4 (but perhaps add 2.12) and add selected later topics. (4) I have also given a one semester class on the complexity of ma- trix multiplication using selected material from earlier chapters and then focusing on Chapter 11. xi xii Preface (5) Similarly I have used chapter 13 as a basis of a semester long class on P v. NP, assuming some algebraic geometry. Here Chapter 8 is important. (6) I have also given several intensive short classes on various topics. A short class for statisticians, focusing on cumulants and tensor decomposition is scheduled for the near future. Reference uses. I have compiled information on tensors in table format (e.g. regarding border rank, maximal rank, typical rank etc.) for easy reference. In particular, Chapter 3 contains most what is known on rank and border rank, stated in elementary terms. Up until now there had been no reference for even the classical results regarding tensors. (Caveat: I do not include results relying on a metric or Hermitian metric.) Research uses. I have tried to state all the results and definitions from geometry and representation theory needed to study tensors. When proofs are not included, references for them are given. The text includes the state of the art regarding ranks and border ranks of tensors, and explains for the first time many results and problems coming from outside mathematics in geometric language. For example, a very short proof of the well-known Kruskal theorem is presented, illustrating that it hinges upon a basic geomet- ric fact about point sets in projective space.