Inverse renormalization group in quantum field theory

Dimitrios Bachtis,1, ∗ Gert Aarts,2, 3, † Francesco Di Renzo,4, ‡ and Biagio Lucini1, 5, § 1Department of Mathematics, Swansea University, Bay Campus, SA1 8EN, Swansea, Wales, UK 2Department of Physics, Swansea University, Singleton Campus, SA2 8PP, Swansea, Wales, UK 3European Centre for Theoretical Studies in Nuclear Physics and Related Areas (ECT*) & Fondazione Bruno Kessler Strada delle Tabarelle 286, 38123 Villazzano (TN), Italy 4Dipartimento di Scienze Matematiche, Fisiche e Informatiche, Universit´adi Parma and INFN, Gruppo Collegato di Parma, I-43100 Parma, Italy 5Swansea Academy of Advanced Computing, Swansea University, Bay Campus, SA1 8EN, Swansea, Wales, UK (Dated: July 01, 2021) We propose inverse renormalization group transformations within the context of quantum field theory that produce the appropriate critical fixed point structure, give rise to inverse flows in parameter space, and evade the critical slowing down effect in calculations pertinent to criticality. Given configurations of the two-dimensional φ4 scalar field theory with size V = 322, we apply the inverse transformations to produce rescaled systems of size up to V 0 = 5122 which we utilize to extract two critical exponents. We conclude by discussing how the approach is generally applicable to any method that successfully produces configurations from a statistical ensemble and how it can give novel insights into the structure of the renormalization group.

I. INTRODUCTION

Invertibility is a concept that emerges naturally in the mathematical and physical sciences. A simple example of an inverse problem can be defined as follows: given a set of configurations which are sampled in a Monte Carlo simulation, specify the most accurate coupling con- stants in the underlying Hamiltonian or action of the sys- FIG. 1. Illustration of the inverse renormalization group. tem that are able to reproduce them. The problem can Inverse transformations are applied to iteratively increase the be formally expressed as the minimization of a distance size L in each dimension by a factor of b, therefore evading metric between two probability distributions under the the critical slowing down effect. condition that the model distribution has a dependence on a set of variational parameters, which in the consid- ered case is the set of the coupling constants. The same the transition to quantum field theory will give rise to a concept underpins numerous approaches within machine variety of intricacies, the most simple being the concep- learning. An example arises in quantum field-theoretic tion of appropriate inverse transformations for systems machine learning algorithms where arbitrary continuous with continuous degrees of freedom. data can be reproduced based on representations con- To our knowledge, no inverse renormalization group structed by specifying the optimal values of the coupling approach has ever been explored within quantum field constants within algorithms derived from lattice field the- theory, despite the fact that computational applications ories [1]. pertinent to the standard renormalization group are nu- The renormalization group [2–4], which is omnipresent merous, for instance, see Refs. [8–10]. The benefits of in quantum field theory and statistical physics, is con- inverse renormalization would be tremendous: one could sidered to be a non-invertible concept. Scale transfor- apply the transformations iteratively in the vicinity of a arXiv:2107.00466v1 [hep-lat] 1 Jul 2021 mations which construct reduced self-similar represen- phase transition to increase the size of the system and tations of systems necessarily incur some loss of infor- eliminate the critical slowing down effect. Inverse flows mation about the original representation. One should in parameter space would then enable the accurate lo- then classify the renormalization group as a semi-group. cation of the critical fixed point, and relations between Nevertheless, the concept of inverse renormalization has observables of the original and the rescaled system could been discussed within the context of statistical physics be derived to calculate multiple critical exponents and to based on systems with simple degrees of freedom, such obtain complete knowledge of the considered phase tran- as the binary Ising model [5–7]. One then expects that sition. Compared to the standard renormalization group, which reduces the size of the system by eliminating de- grees of freedom and can hence be applied for only a ∗ [email protected] finite number of steps, inverse renormalization increases † [email protected] the size of the system and can therefore, in principle, be ‡ [email protected] applied for an arbitrary number of steps. § [email protected] In this manuscript, we propose inverse renormaliza- 2 tion group transformations as a means to study phase on the distance t from the critical point; in the thermo- transitions in quantum field theory. We explore if the dynamic limit it diverges at K = Kc. Through the ap- application of inverse transformations is able to itera- plication of iterative transformations which increase the tively increase the size of the system and if it accurately correlation length, each of the rescaled systems will have produces the anticipated flows in parameter space. We a different distance t0 from the critical point and as a re- then derive expressions between observables of the orig- sult a different coupling constant K0. This is the essence inal and the rescaled system that enable the accurate of the renormalization group flow induced in parameter calculation of multiple critical exponents. The results space. are illustrated using the second-order phase transition of We now consider an intensive observable O in the orig- the two-dimensional φ4 scalar field theory. We conclude inal system which is a function of the coupling constant by discussing how the approach is generally applicable to K. Due to the divergence of the correlation length at any method that produces configurations from a statisti- the critical point Kc the intensive observable quantities cal ensemble and how it can give novel insights into the O and O0 of the original and the rescaled systems will be structure of the renormalization group. equal: 0 O(Kc) = O (Kc). (6) II. FUNDAMENTALS OF THE INVERSE This equation provides a self-consistent manner in lo- RENORMALIZATION GROUP cating the critical fixed point: specifically it is the point in parameter space where the observables of the two sys- To construct inverse transformations for systems on tems intersect. To locate the critical point it is advisable graphs or lattices we will devise a set of operations that to compare an original and a rescaled system of the same mimics the inversion of a previously induced transfor- lattice size to reduce finite size effects [11]. mation. Explicitly, we consider a system of lattice size Under the condition that observables O0 in the rescaled L in each dimension and apply a renormalization group system appear according to the probability distribution transformation to reduce its size as of the original system [11, 12], we can extrapolate O0 along the trajectory of a coupling constant K using his- L → L0 = L/b, (1) togram reweighting [12–15], while relying on the action where b > 1 is the rescaling factor. Our aim is now to S of the original system: learn a set of operations that can mimic the inversion of PN 0 (0) (m) O exp[−(Km − Km )Sσ )] this transformation: hO0i = l=1 σl l , (7) PN (0) (m) l=1 exp[−(Km − Km )Sσl )] L0 → L = bL0. (2) where σl is a configuration of the system, N is the num- The benefit of the approach is that the operations can P (0) (m) ber of samples and the action S = m Km S of the be iteratively applied to arbitrarily increase the size of original system is expressed as a sum over products of the system (see Fig. 1). Specifically, if we consider an (0) coupling constants Km and their corresponding action initial system of size L in each dimension and correlation terms S(m). In this example the discussed histogram length ξ, then the consecutive applications will produce reweighting approach considers strictly the extrapola- systems of sizes L0 → L1 = bL0 → L2 = bL1 → ... tion of exclusively one coupling constant K in parameter where the relation describing the increase in the system space. size at step j is: A critical exponent that characterizes a phase tran- (j−i) sition is the exponent β which couples to the magneti- Lj = b Li. (3) β β zation mi ∼ |ti| and mj ∼ |tj| , and which can be equivalently expressed in terms of the correlation length Here j > i ≥ 0, and L0 = L. The increase in the lattice −β/ν −β/ν size will additionally induce an increase in the correlation as mi ∼ ξi and mj ∼ ξj , where ν is the exponent length: that governs the divergence of ξ. By dividing, substitut- ing, and taking the natural logarithm of the expressions (j−i) ξj = b ξi, (4) we arrive at the relation: m m with ξ = ξ. To proceed we introduce the concept of β ln j ln j 0 = − mi = − mi . (8) a reduced coupling constant, which is a measure of the ν ln ξj (j − i) ln b distance of a coupling constant K from the critical point ξi Kc, and which can be defined as: The above expression can be redefined to be suitable for a finite system using l’Hˆopital’srule [11], arriving at K − K t = c . (5) the expression: Kc dmj dmj β ln ln The correlation length ξ arises dynamically in the = − dmi Kc = − dmi Kc . (9) vicinity of a phase transition and it inherently depends ν ln ξj (j − i) ln b ξi 3

FIG. 3. Illustration of the optimization approach. Trans- posed convolutions (TC) are applied on configurations pro- duced with the renormalization group (RG) to construct a FIG. 2. Absolute value of the magnetization versus the set of configuration which is compared with the original. dimensionless squared mass. L0 denotes a system produced with the standard renormalization group approach which re- duces the size of the system. The region bounded by the lines 0 denotes the statistical uncertainty. L = 16. Specifically the transformation consists of sepa- rating the system in blocks of size b×b, where the degrees of freedom are summed within each block. If the sum is Following a similar procedure for the magnetic suscep- positive or negative then we select the rescaled degree of −γ −γ freedom as the mean of the positive or negative degrees tibility χi ∼ |ti| and χj ∼ |tj| we obtain: of freedom within the block, respectively. Since the lat-

dχj dχj tice size is halved the correlation length will be reduced γ ln ln 0 = dχi Kc = dχi Kc . (10) similarly, ξ = ξ/2. The emergent renormalization group ν ξj (j − i) ln b ln ξ flow then drives the system away from the critical point i towards either the broken-symmetry or the symmetric Using the above equations and the renormalization phase, depending on where the system was initially po- group, one can calculate critical exponents through nu- sitioned. This implies that if the original system had a merical derivatives of the observables m and χ in the certain magnetization m then the rescaled system will 0 0 vicinity of the critical point Kc. have magnetization m > m ( m < m) if it was ini- tially in the broken-symmetry (symmetric) phase. The results, obtained with the use of histogram reweighting, III. INVERSE RENORMALIZATION IN THE φ4 are depicted in Fig. 2 where the standard renormalization THEORY group flow and a critical fixed point have emerged. Every successful renormalization group transformation We consider the discretized two-dimensional φ4 scalar encodes important information. First, that the original field theory on a square lattice with the lattice action [1]: and the rescaled systems are an accurate representation of the same physical model. Second, that configurations 2 of the rescaled system follow the probability distribution X (µ + 4κL) X λL X S = −κ φ φ + L φ2+ φ4. (11) of the original system, and, third, that a critical fixed L i j 2 i 4 i hiji i i point structure exists at criticality. We have verified, through the obtained results, that the standard renor- 2 Here κL, µL, λL are dimensionless parameters. The sys- malization group transformation, implemented as above, tem undergoes a second-order phase transition between satisfies these conditions. By learning how to mimic the a symmetric and broken-symmetry phase for specific val- inversion of this transformation we anticipate that the 2 ues of µL < 0 when λL > 0 and κL > 0 [16]. We will same conditions will additionally be satisfied on the in- consider the case λL = 0.7, κL = 1 and vary the coupling verse transformation. The inverse transformation can 2 constant µL ≡ K. We simulate the system using a com- then be iteratively applied to arbitrarily increase the size bination of the Metropolis and Wolff algorithms [17–20], of the system. and the errors are calculated with a binning analysis us- To learn the inverse of a transformation we will rely ing 104 configurations in 10 separate bins. Observables on the application of a set of transposed convolutions. P of interest are the magnetization M = | i φi|, and the The input to the transposed convolutions is the rescaled magnetic susceptibility χ = (1/V )(hM 2i−hMi2). We de- system with size L0 = 16, where the rescaling factor is note as m = (1/V )M the intensive magnetization which b = 2. The output is a model system whose size L = 32 is normalized by the size of the system V = L × L. is equal to the original. The degrees of freedom of this Starting from a φ4 theory with lattice size L = 32 model system are then compared with the degrees of free- in each dimension, we first apply a standard renormal- dom of the original by minimizing the mean squared error ization group transformation with b = 2 on configura- function between them. Through an iterative process a 2 tions sampled at µL = −0.9515 in the vicinity of the set of transformations is learned that is able to repro- phase transition to produce a rescaled system with size duce an original system from a rescaled one by increas- 4

rameter space has emerged. The previous results, which relied on a comparison of the rescaled versus the orig- inal system at the same lattice size, served as a proof- of-principle demonstration to establish the inverse renor- malization group approach. In fact, this comparison is neither needed nor desired because it requires the sim- ulation of the original system at all lattice sizes and is therefore hindered by the critical slowing down effect. The critical slowing down effect can be entirely avoided in calculations pertinent to criticality through the use of Eqs. 9 and 10. Based on the original system with L0 = 32 we obtain with the inverse transformations a set of rescaled systems Lj = 64, 128, 256, 512, from which we calculate two critical exponents through a nu- merical derivative of the magnetization and the mag- netic susceptibility in the vicinity of the phase transi- tion. Since the method does not require any additional FIG. 4. Absolute value of the magnetization versus the simulation, other than the one at L0 = 32, no critical dimensionless squared mass. L0 denotes a system produced slowing down effect emerges. In addition, it is possible with the inverse renormalization group approach which in- to compare two rescaled systems, for instance the ones creases the size of the system. The region bounded by the with L3 = 256 versus L4 = 512 to further increase the lines denotes the statistical uncertainty. accuracy of the results as the comparison between larger lattices will substantially diminish finite size effects. The magnetic susceptibility for the rescaled systems is de- ing its size and its correlation length by a factor of b, picted in Fig. 5 and comparisons for all possible sets of see Fig. 3. Specifically, we apply a set of 128 transposed systems are provided in Table I. We calculate the critical convolutions with stride 2, followed by one convolution exponents based on the same range of coupling constants 2 with stride 1. The filter size is 2 × 2 and the optimiza- −0.9516 ≤ µL ≤ −0.9514, to guarantee consistency in tion is completed on 103 configurations using the adap- tive moment estimation algorithm and a learning rate of 3 × 10−4. We remark that the inverse transformation is not anticipated to be a perfect inversion of the origi- nal one. The architecture can be easily implemented, for instance, through the use of the Keras library [21], and we train the algorithm 10 different times to conduct the error analysis. After the optimization approach is com- pleted we discard the data and start from a new system simulated at the same value of mass and with lattice size L = 32. The set of transformations have no dependence on the size of the system and can therefore be applied to any arbitrary size L. We will now apply the inverse transformations to it- eratively increase the lattice size by a factor of b = 2 through the relation of Eq. 3. We anticipate that the iter- ative increase in the lattice size will also equally increase the correlation length (see Eq. 4), under the condition that there exists some finite correlation length present in the initial configurations, therefore driving the sys- tem towards the critical point irrespective of the phase that it is initially positioned in. This implies that if the original system had magnetization m then the rescaled system will have magnetization m0 < m ( m0 > m) if it was initially in the broken-symmetry (symmetric) phase, respectively. The results are depicted in Fig. 4. We ob- serve, based on the intersection of observables (see Eq. 6), that the critical fixed point agrees with the expected val- FIG. 5. Magnetic susceptibility χ versus the dimensionless 2 2 squared mass. The region bounded by the lines denotes the ues of µc = −0.95151(25)[18], µc = −0.9516(8)[19], and that the anticipated behaviour of the inverse flows in pa- statistical uncertainty. 5

be implemented to learn the appropriate coupling con- TABLE I. Values of the critical exponents γ/ν and β/ν. The stants of the rescaled systems allowing for complete phys- original system has lattice size L = 32 in each dimension. The ical interpretability of the results. The structure of the rescaled systems are obtained through inverse renormalization group transformations. inverse renormalization group transformations and the emergent flows could then be understood fully. Fur- Li/Lj γ/ν β/ν thermore, the extraction of additional critical expo- 32/64 1.735(5) 0.132(2) nents can be achieved by introducing terms which in- 32/128 1.738(5) 0.130(2) duce symmetry-breaking in the original system. These 32/256 1.741(5) 0.128(2) terms could be extrapolated to the iteratively rescaled 32/512 1.742(5) 0.128(2) 64/128 1.742(5) 0.128(2) ones through the use of histogram reweighting which is 64/256 1.744(5) 0.127(2) agnostic to the form of the underlying action [12]. In 64/512 1.744(5) 0.127(2) addition, one could construct the linearized renormaliza- 128/256 1.745(5) 0.126(2) tion group transformation matrix [5], using the rescaled 128/512 1.745(5) 0.126(2) configurations to extract the relevant operators. Compu- 256/512 1.746(5) 0.126(2) tational investigations of the renormalization group have been applied in a diverse range of quantum field theories [8–10], including quantum chromodynamics, and inverse the results. We observe that there is a clear convergence transformations within these systems are therefore open towards the expected values of γ/ν = 7/4 = 1.75 and to explore. Finally, the method only requires one set of β/ν = 1/8 = 0.125 as the comparison between systems configurations in the vicinity of the phase transition and is conducted on larger lattice sizes, therefore diminishing it is therefore generally applicable to any approach that finite size effects. successfully samples configurations from a statistical en- In summary, through the use of inverse renormaliza- semble. tion group transformations we were able to iteratively In conclusion, the inverse renormalization group, an increase the size of the system in absence of the critical approach that successfully evades the critical slowing slowing down effect and to obtain two critical exponents down effect which has hindered numerical simulations of of the second-order phase transition. It is intriguing that systems that undergo phase transitions since their ini- the combination of the probabilistic perspective and the tial conception, is a vastly unexplored concept within inverse renormalization is able to produce extrapolations quantum field theory, and further exploration could po- of observables for the iteratively increasing lattice sizes tentially yield novel mathematical and physical insights into the structure of the renormalization group, thereby Lj = 64, 128, 256, 512 given exclusively one Monte Carlo simulation obtained at one point in parameter space for paving the way for a deeper understanding of a concept ubiquitous in physics. lattice size L0 = 32. This information would have not been otherwise accessible and could have been previously Note added: While this work was being submit- obtained only through the use of computationally de- ted, we became aware of the investigations reported in manding simulations conducted directly at the specific Ref. [22], which proposes related ideas applied to discrete spin systems. lattice sizes Lj = 64, 128, 256, 512.

IV. CONCLUSIONS V. ACKNOWLEDGEMENTS

We have shown that inverse renormalization group The authors received funding from the European Re- transformations emerge as an approach within quantum search Council (ERC) under the European Union’s Hori- field theory which is able to evade the critical slowing zon 2020 research and innovation programme under grant down effect in numerical calculations pertinent to criti- agreement No 813942. The work of GA and BL has cality. Specifically, using the two-dimensional φ4 scalar been supported in part by the UKRI Science and Tech- field theory of lattice size L0 = 32 in each dimension, we nology Facilities Council (STFC) Consolidated Grant applied the inverse transformations to iteratively increase ST/T000813/1. The work of BL is further supported in the size of the system to L0 = 512, without the need part by the Royal Society Wolfson Research Merit Award to conduct additional simulations, and we observed the WM170010 and by the Leverhulme Foundation Research induced renormalization group flow in parameter space. Fellowship RF-2020-461\9. FDR acknowledges partial The approach enables the accurate extraction of the crit- support from I.N.F.N. under the research project i.s. ical exponents for the magnetization and the magnetic QCDLAT. Numerical simulations have been performed susceptibility using exclusively configurations produced on the Swansea SUNBIRD system. This system is part of from the inverse transformations. the Supercomputing Wales project, which is part-funded Numerous research directions can be envisaged. Quan- by the European Regional Development Fund (ERDF) tum field-theoretic machine learning algorithms [1] can via Welsh Government. 6

[1] D. Bachtis, G. Aarts, and B. Lucini, Quantum field- 1999). theoretic machine learning, Phys. Rev. D 103, 074510 [12] D. Bachtis, G. Aarts, and B. Lucini, Adding machine (2021). learning within hamiltonians: Renormalization group [2] K. G. Wilson, Renormalization group and critical phe- transformations, symmetry breaking and restoration, nomena. i. renormalization group and the kadanoff scal- Phys. Rev. Research 3, 013134 (2021). ing picture, Phys. Rev. B 4, 3174 (1971). [13] A. M. Ferrenberg and R. H. Swendsen, New monte carlo [3] K. G. Wilson and J. Kogut, The renormalization group technique for studying phase transitions, Phys. Rev. Lett. and the expansion, Physics Reports 12, 75 (1974). 61, 2635 (1988). [4] K. G. Wilson, The renormalization group: Critical phe- [14] D. Bachtis, G. Aarts, and B. Lucini, Extending ma- nomena and the kondo problem, Rev. Mod. Phys. 47, chine learning classification capabilities with histogram 773 (1975). reweighting, Phys. Rev. E 102, 033303 (2020). [5] R. H. Swendsen, Monte carlo renormalization group, [15] D. Bachtis, G. Aarts, and B. Lucini, Mapping distinct Phys. Rev. Lett. 42, 859 (1979). phase transitions to a neural network, Phys. Rev. E 102, [6] D. Ron, R. H. Swendsen, and A. Brandt, Inverse monte 053306 (2020). carlo renormalization group transformations for critical [16] A. Milchev, D. W. Heermann, and K. Binder, Finite- phenomena, Phys. Rev. Lett. 89, 275701 (2002). size scaling analysis of the ϕ4 field theory on the square [7] S. Efthymiou, M. J. S. Beach, and R. G. Melko, Super- lattice, Journal of Statistical Physics 44, 749 (1986). resolving the ising model with convolutional neural net- [17] R. C. Brower and P. Tamayo, Embedded dynamics for works, Phys. Rev. B 99, 075113 (2019). ϕ4 theory, Phys. Rev. Lett. 62, 1087 (1989). [8] A. Hasenfratz, Infrared fixed point of the 12-fermion [18] D. Schaich and W. Loinaz, Improved lattice measurement 4 su(3) gauge model based on 2-lattice monte carlo of the critical coupling in φ2 theory, Phys. Rev. D 79, renomalization-group matching, Phys. Rev. Lett. 108, 056008 (2009). 061601 (2012). [19] W. Loinaz and R. S. Willey, Monte carlo simulation [9] K. Akemi, M. Fujisaki, M. Okuda, Y. Tago, P. de For- calculation of the critical coupling constant for two- crand, T. Hashimoto, S. Hioki, O. Miyamura, dimensional continuum ϕ4 theory, Phys. Rev. D 58, T. Takaishi, A. Nakamura, and I. O. Stamatescu, Scaling 076003 (1998). study of pure gauge lattice qcd by monte carlo renormal- [20] U. Wolff, Collective monte carlo updating for spin sys- ization group method, Phys. Rev. Lett. 71, 3063 (1993). tems, Phys. Rev. Lett. 62, 361 (1989). [10] A. Hasenfratz, Investigating the critical properties of [21] F. Chollet et al., Keras (2015). beyond-qcd theories using monte carlo renormalization [22] K. Shiina, H. Mori, Y. Tomita, H. K. Lee, and Y. Ok- group matching, Phys. Rev. D 80, 034505 (2009). abe, Inverse renormalization group based on image super- [11] M. E. J. Newman and G. T. Barkema, Monte Carlo resolution using deep convolutional networks, Scientific methods in statistical physics (Clarendon Press, Oxford, Reports 11, 9617 (2021).