Hopf Algebras and Markov Chains
Total Page:16
File Type:pdf, Size:1020Kb
HOPF ALGEBRAS AND MARKOV CHAINS A DISSERTATION SUBMITTED TO THE DEPARTMENT OF MATHEMATICS AND THE COMMITTEE ON GRADUATE STUDIES OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY Chung Yin Amy Pang July 2014 © 2014 by Chung Yin Amy Pang. All Rights Reserved. Re-distributed by Stanford University under license with the author. This work is licensed under a Creative Commons Attribution- Noncommercial-Share Alike 3.0 United States License. http://creativecommons.org/licenses/by-nc-sa/3.0/us/ This dissertation is online at: http://purl.stanford.edu/vy459jk2393 ii I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Persi Diaconis, Primary Adviser I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Daniel Bump I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Eric Marberg Approved for the Stanford University Committee on Graduate Studies. Patricia J. Gumport, Vice Provost for Graduate Education This signature page was generated electronically upon submission of this dissertation in electronic format. An original signed hard copy of the signature page is on file in University Archives. iii Abstract This thesis introduces a way to build Markov chains out of Hopf algebras. The transition matrix of a Hopf-power Markov chain is (the transpose of) the matrix of the coproduct- then-product operator on a combinatorial Hopf algebra with respect to a suitable basis. These chains describe the breaking-then-recombining of the combinatorial objects in the Hopf algebra. The motivating example is the famous Gilbert-Shannon-Reeds model of riffle-shuffling of a deck of cards, which arise in this manner from the shuffle algebra. The primary reason for constructing Hopf-power Markov chains, or for rephrasing fa- miliar chains through this lens, is that much information about them comes simply from translating well-known facts on the underlying Hopf algebra. For example, there is an explicit formula for the stationary distribution (Theorem 3.4.1), and constructing quotient algebras show that certain statistics on a Hopf-power Markov chain are themselves Markov chains (Theorem 3.6.1). Perhaps the pinnacle is Theorem 4.4.1, a collection of algorithms for a full left and right eigenbasis in many common cases where the underlying Hopf alge- bra is commutative or cocommutative. This arises from a cocktail of the Poincare-Birkhoff- Witt theorem, the Cartier-Milnor-Moore theorem, Reutenauer’s structure theory of the free Lie algebra, and Patras’s Eulerian idempotent theory. Since Hopf-power Markov chains can exhibit very different behaviour depending on the structure of the underlying Hopf algebra and its distinguished basis, one must restrict at- tention to certain styles of Hopf algebras in order to obtain stronger results. This thesis will focus respectively on a free-commutative basis, which produces "independent breaking" chains, and a cofree basis; there will be both general statements and in-depth examples. Remark. An earlier version of the Hopf-power Markov chain framework, restricted to free- commutative or free state space bases, appeared in [DPR14]. Table 1 pairs up the results iv [DPR14] thesis construction 3.2 3.2,3.3 stationary distribution 3.7.1 3.4 reversibility 3.5 projection 3.6 diagonalisation general 3.5 4 algorithm for free-commutative basis Th. 3.15 Th. 4.4.1.A algorithm for basis of primitives Th. 4.4.1.B algorithm for shuffle basis Th. 4.4.1.A0 algorithm for free basis Th. 3.16 Th. 4.4.1.B0 unidirectionality for free-commutative basis 3.3 5.1.2 right eigenfunctions for free-commutative basis 3.6 5.1.3 link to terminality of QSym 3.7.2 5.1.4 examples rock-breaking 4 5.2 tree-pruning 5.3 riffle-shuffling1 5 6.1 descent sets under riffle-shuffling 6.2 Table 1: Corresponding sections of [DPR14] and the present thesis and examples of that paper and their improvements in this thesis. (I plan to update this table on my website, as the theory advances and more examples are available.) In addition, a summary of Section 6.2, on the descent-set Markov chain under riffle-shuffling, appeared in [Pan13]. v Acknowledgement First, I must thank my advisor Persi Diaconis for his patient guidance throughout my time at Stanford. You let me roam free on a landscape of algebra, probability and combinatorics in whichever direction I choose, yet are always ready with a host of ideas the moment I feel lost. Thanks in addition for putting me in touch with many algebraic combinatorialists. Thanks to my coauthor Arun Ram for your observations about card-shuffling and the shuffle algebra, from which grew the theory in this thesis. I also greatly appreciate your help in improving my mathematical writing while we worked on our paper together. I’m grateful to Marcelo Aguiar for pointing me to Patras’s work, which underlies a key part of this thesis, and for introducing me to many of the combinatorial Hopf algebras I describe here. To the algebraic combinatorics community: thanks for taking me in as a part of your family at FPSAC and other conferences. Special mentions go to Sami Assaf and Aaron Lauve for spreading the word about my work; it makes a big difference to know that you are as enthusiastic as I am about my little project. I’d like to thank my friends, both at Stanford and around the world, for mathematical insights, practical tips, and just cheerful banter. You’ve very much brightened my journey in the last five years. Thanks especially to Agnes and Janet for taking time from your busy schedules to hear me out during my rough times; because of you, I now have a more positive look on life. Finally, my deepest thanks go to my parents. You are always ready to share my ex- citement at my latest result, and my frustrations at another failed attempt, even though I’m expressing it in way too much technical language. Thank you for always being there for me and supporting my every decision. vi Contents Abstract iv Acknowledgement vi 1 Introduction 1 1.1 Markov chains . 1 1.2 Hopf algebras . 6 1.3 Hopf-power Markov chains . 7 2 Markov chains from linear operators 9 2.1 Construction . 10 2.2 Diagonalisation . 12 2.3 Stationarity and Reversibility . 13 2.4 Projection . 16 3 Construction and Basic Properties of Hopf-power Markov Chains 19 3.1 Combinatorial Hopf algebras . 21 3.1.1 Species-with-Restrictions . 24 3.1.2 Representation rings of Towers of Algebras . 26 3.1.3 Subalgebras of Power Series . 28 3.2 First Definition of a Hopf-power Markov Chain . 32 3.3 General Definition of a Hopf-power Markov Chain . 35 3.4 Stationary Distributions . 44 3.5 Reversibility . 47 vii 3.6 Projection . 49 4 Diagonalisation of the Hopf-power operator 54 4.1 The Eulerian Idempotent . 54 4.2 Eigenvectors of Higher Eigenvalue . 57 4.3 Lyndon Words . 58 4.4 Algorithms for a Full Eigenbasis . 60 5 Hopf-power Markov chains on Free-Commutative Bases 69 5.1 General Results . 71 5.1.1 Independence . 71 5.1.2 Unidirectionality . 73 5.1.3 Probability Estimates from Eigenfunctions . 76 5.1.4 Probability Estimates from Quasisymmetric Functions . 87 5.2 Rock-Breaking . 90 5.2.1 Constructing the Chain . 91 5.2.2 Right Eigenfunctions . 92 5.2.3 Left Eigenfunctions . 95 5.2.4 Transition Matrix and Eigenfunctions when n = 4 . 98 5.3 Tree-Pruning . 99 5.3.1 The Connes-Kreimer Hopf algebra . 100 5.3.2 Constructing the Chain . 103 5.3.3 Right Eigenfunctions . 108 6 Hopf-power Markov Chains on Cofree Commutative Algebras 117 6.1 Riffle-Shuffling . 117 6.1.1 Right Eigenfunctions . 118 6.1.2 Left Eigenfunctions . 125 6.1.3 Duality of Eigenfunctions . 127 6.2 Descent Sets under Riffle-Shuffling . 129 6.2.1 Notation regarding compositions and descents . 132 viii 6.2.2 Quasisymmetric Functions and Noncommutative Symmetric Func- tions . 133 6.2.3 The Hopf-power Markov chain on QSym . 136 6.2.4 Right Eigenfunctions Corresponding to Partitions . 138 6.2.5 A full Basis of Right Eigenfunctions . 142 6.2.6 Left Eigenfunctions Corresponding to Partitions . 144 6.2.7 A full Basis of Left Eigenfunctions . 147 6.2.8 Duality of Eigenfunctions . 149 6.2.9 Transition Matrix and Eigenfunctions when n = 4 . 152 Bibliography 155 ix List of Tables 1 Corresponding sections of [DPR14] and the present thesis . v x List of Figures 3.1 An example coproduct calculation in G¯, the Hopf algebra of graphs . 25 5.1 The “two triangles with one common vertex” graph . 79 5.2 The tree [•Q3] .................................101 5.3 Coproduct of [•Q3] ..............................103 6.1 The trees T(13245) and T(1122) . 120 6.2 The Lyndon hedgerow T(35142) . 121 xi Chapter 1 Introduction This chapter briefly summarises the basics of the two worlds that this thesis bridges, namely Markov chains and Hopf algebras, and introduces the motivating example of riffle-shuffling of a deck of cards. 1.1 Markov chains A friendly introduction to this topic is Part I of the textbook [LPW09]. A (discrete time) Markov chain is a simple model of the evolution of an object over time.