Tropical Tensor Network for Ground States of Spin Glasses Jin-Guo Liu,1, 2, 3, ∗ Lei Wang,4, 5, y and Pan Zhang6, 7, 8, z 1Beijing National Lab for Condensed Matter Physics and Institute of Physics, Chinese Academy of Sciences, Beijing 100190, China 2Harvard University, Cambridge, Massachusetts 02138, United States 3QuEra Computing Inc., Boston, Massachusetts 02143, United States 4Institute of Physics, Chinese Academy of Sciences, Beijing 100190, China 5Songshan Lake Materials Laboratory, Dongguan, Guangdong 523808, China 6CAS Key Laboratory for Theoretical Physics, Institute of Theoretical Physics, Chinese Academy of Sciences, Beijing 100190, China 7School of Fundamental Physics and Mathematical Sciences, Hangzhou Institute for Advanced Study, UCAS, Hangzhou 310024, China 8International Centre for Theoretical Physics Asia-Pacific, Beijing/Hangzhou, China We present a unified exact tensor network approach to compute the ground state energy, identify the optimal configuration, and count the number of solutions for spin glasses. The method is based on tensor networks with the Tropical Algebra defined on the semiring of (R [ {−∞}; ⊕; ). Contracting the tropical tensor network gives the ground state energy; differentiating through the tensor network contraction gives the ground state configuration; mixing the tropical algebra and the ordinary algebra counts the ground state degeneracy. The approach brings together the concepts from graphical models, tensor networks, differentiable programming, and quantum circuit simulation, and easily utilizes the computational power of graphical processing units (GPUs). For applications, we compute the exact ground state energy of Ising spin glasses on square lattice up to 1024 spins, on cubic lattice up to 216 spins, and on 3 regular random graphs up to 220 spins, on a single GPU; We obtain exact ground state energy of ±J Ising spin glass on the chimera graph of D-Wave quantum annealer of 512 qubits in less than 100 seconds and investigate the exact value of the residual entropy of ±J spin glasses on the chimera graph; Finally, we investigate ground-state energy and entropy of 3-state Potts glasses on square lattices up to size 18×18. Our approach provides baselines and benchmarks for exact algorithms for spin glasses and combinatorial optimization problems, and for evaluating heuristic algorithms and mean-field theories. I. INTRODUCTION est from a physics and optimization perspective. The num- ber of degeneracy characterizes the level of frustration and Combinatorial optimization problems are fundamental to gives rise to residual entropy of the system at zero temper- theoretical studies in statistical physics and computer science. ature [7]. For example, there can be an exponentially large Efficient solutions to combinatorial optimization problems are number of degenerated ground states of the spin-glass such also relevant to many practical applications such as operations that the system exhibits finite entropy density in the thermody- research and artificial intelligence. A prototypical combinato- namic limit. Unfortunately, counting the number of the degen- rial optimization problem is finding the ground state of the erated ground state of spin glasses is #P-complete [8] which Ising spin glass with the energy function can be even harder than finding the ground state. In this paper, we present a unified approach to compute X X ground state energy, find out the ground state configuration, E(fσg) = − Ji jσiσ j − hiσi; (1) i< j i and count the ground state degeneracy of spin glasses exactly. The approach is based on the exact contraction of the tensor where fσg 2 {±1gN denotes a configuration of N Ising spins. networks with tropical numbers which compute the spin-glass Such problem arises in broad contexts ranging from mag- partition function directly in the zero-temperature limit. In the netic properties of dilute alloys [1] to probabilistic inference principle, the approach is not conceptually new since there can in graphical models [2]. Finding the ground state of the spin- be equivalent dynamic programming or message passing for- glass is NP-hard except on some special graphs [3]. This im- mulations. It is rather a synthesis of techniques in combinato- plies that an efficient solution to the problem is unlikely un- rial optimization, graphical model, and machine learning into less P = NP. Many NP problems have convenient Ising spin a unified framework in the language of tensor networks, which glass formulation [4]. In past decades, various approaches provides valuable insights for efficient and generic implemen- have been applied to such a problem, including simulated an- tations. In particular, the tropical tensor network offers a gen- nealing on classical computers [5] and quantum annealing on eral computational framework so that one can easily exploit arXiv:2008.06888v2 [cond-mat.stat-mech] 17 Feb 2021 manufactured quantum devices [6]. software and hardware advances in quantum circuit simula- Besides the ground state energy and configurations, count- tions, automatic differentiation, and hardware accelerations. ing the number of ground-state configurations is also of inter- In this regard, the approach adds another example along the fruitful line of research bridging the graphical models, tensor networks, and quantum circuits [9–17]. There were previous efforts of investigating low- ∗ [email protected] temperature properties of spin-glasses using approxi- y [email protected] mated tensor contraction methods [17–19]. Among other z [email protected] things, these approaches and the related transfer matrix 2 (a) (b) ative coupling energies. The dots are diagonal tensors with h J h J h J h 1 2 J J J J 1 1 = hi, 2 2 = −hi, and −∞ for all other ten- h J h J h J h 1 2 J J J J sor elements. In cases where the local field vanishes, these h J h J h J h dots reduce to the copy tensor in terms of the tropical algebra J J J J which demands that all the legs have the same indices. Con- h J h J h J h traction of the tensor network under the tropical algebra gives the ground state energy of the Ising spin glass. In the contrac- FIG. 1. (a) The tensor network representation of a square lattice tion, the ⊕ operator selects the optimal spin configuration, and Ising spin glass. (b) An equivalent circuit representation used for the the operator sums the energy contribution from subregions practical simulation. See text for the definition of the symbols. of the graph. The intermediate tensors record the minimal en- ergy given the external tensor indices, so they correspond to approach [20, 21] face numerical issues at low temperatures max-marginals in the graphical model [34]. due to the cancellation of tensor elements with exponential From a physics perspective, the tropical tensor scales [22]. References [23, 24] investigated the residual network naturally arises from computing the zero- P −βE entropy of infinite translational invariant frustrated classical temperature limit of the partition function Z = fσg e . ∗ 1 spin systems by constructing tensor networks according to The ground state energy, E = − limβ!1 β ln Z = local rules of the ground-state manifold. More closely related 1 P Q βJi jσiσ j Q βhiσi − limβ!1 β ln fσg i< j e i e , involves ordi- to the present paper, one can employ exact tensor network nary sum and product operations for the Boltzmann weights. contraction to count the number of solutions in the constraint When taking the zero temperature limit, it is more convenient satisfaction problems [25–28], however, with the ground-state to deal with the exponents directly energy known to be zero a priori. 1 1 lim ln(eβx + eβy) = x ⊕ y; ln(eβx · eβy) = x y; (3) II. TROPICAL TENSOR NETWORK β!1 β β Tropical algebra is defined by replacing the usual sum and which leads to the tropical algebra Eq. (2). The tropical rep- product operators for ordinary real numbers with the max and resentation also corresponds to the logarithmic number sys- sum operators respectively [29] tem [35] which avoids the numerical issue in dealing with ex- x ⊕ y = max(x; y); x y = x + y: (2) ponentially large numbers on computers with finite precision numerics [22]. −∞ One sees that acts as zero element for the tropical number Moreover, one can also employ the present approach to −∞ ⊕ −∞ −∞ since x = x and x = . On the other hand, 0 count the number of ground states at the same computational ⊕ acts as the multiplicative identity since 0 x = x. The and complexity of computing the ground state energy. To im- operators still have commutative, associative, and distributive plement this, we further generalize the tensor element to be ⊕ properties. However, since there is no additive inverse, the a tuple (x; n) composed by a tropical number x and an or- R [ {−∞} and and operations define a semiring over . The dinary number n. The tropical number records the nega- semiring formulation unifies a large number of inference al- tive energy, while the ordinary number counts the number gorithms in the graphical models based on dynamic program- of minimal energy configurations. For tensor network con- ming [30, 31]. Recently, there have been efforts in combing traction, we need the multiplication and addition of the tuple: the semiring algebra with modern deep learning frameworks (x ; n ) (x ; n ) = (x + x ; n · n ) and with optimized tensor operations and automatic differentia- 1 1 2 2 1 2 1 2 tion [32, 33]. 8 One can consider tensor networks whose elements are trop- >(x1 ⊕ x2; n1 + n2) if x1 = x2 <> ical numbers with the algebra Eq. (2). Since the elementary (x1; n1) ⊕ (x2; n2) = (x1 ⊕ x2; n1) if x1 > x2 : (4) > operations involved in contracting tensor networks are just :>(x ⊕ x ; n ) if x < x sum and product, the contraction of tropical tensor networks 1 2 2 1 2 is well defined. One can use such contraction to solve the ground state of the Ising spin glass.