Nonflat Histogram Techniques for Spin Glasses Fabio M¨uller,∗ Stefan Schnabel,† and Wolfhard Janke‡ Institut f¨ur Theoretische Physik, Universit¨at Leipzig, IPF 231101, 04081 Leipzig, Germany (Dated: November 18, 2020) We study the bimodal Edwards-Anderson spin glass comparing established methods, namely the multicanonical method, the 1/k-ensemble and parallel tempering, to an approach where the ensemble is modified by simulating power-law-shaped histograms in energy instead of flat histograms as in the standard multicanonical case. We show that by this modification a significant speed-up in terms of mean round-trip times can be achieved for all lattice sizes taken into consideration. I. INTRODUCTION to Simulated Annealing [14] as the system is gradually cooled down according to an annealing schedule. The an- Simulations of systems with rugged free-energy land- nealing is performed on a big population of replicas and scape [1] suffer from massive slowing down of the dy- by introducing intermediate resampling of the population namics in the low-temperature phase. This problem en- of replicas after lowering the temperature the simulation countered in many physical systems, e.g., folding poly- is kept at thermal equilibrium. This permits the evalua- mers or spin glasses, renders the investigation of the tion of thermodynamic observables in contrast to simple thermodynamical properties of such systems in the low- Simulated Annealing. Despite the attempts of optimizing temperature phase a very challenging task. the method for spin glasses [10, 12, 15] it is not able to The Metropolis algorithm [2] is designed to sample con- outperform PT. Its optimization, however, remains more figurations according to their statistical weight in the cumbersome due to the additional complexity. The main canonical ensemble. At low temperatures it fails dra- advantage of this algorithm is its suitability for massively matically for systems with rugged free-energy landscape parallel implementation. For disordered systems, how- because of the effectively broken ergodicity. The simula- ever, this advantage does not come into play, because tions get stuck in local minima (metastable states) and the necessity of simulating many different disorder real- the thermal energy is not sufficient to overcome the huge izations allows the efficient use of parallel computing for free-energy barriers. There have been a wide range of any method. algorithmic developments tackling this problem that can The Multicanonical (MUCA) method [16–18] is an- all be subsumed in the term of broad-energy ensembles. other well established algorithm designed for the simu- One commonly employed method is the Parallel Tem- lation of systems with first-order phase transitions which pering (PT) [3–5] method where Metropolis simulations performs well in the simulation of systems with rugged of copies of the system (replicas) at different tempera- free-energy landscape, too. It has already been applied tures are performed. After certain time intervals ex- to spin glasses in Refs. [19, 20]. In this method the simu- changes of the replicas between the different tempera- lation is set up to visit all possible energies with the same tures are attempted. This procedure enables the replicas probability yielding a flat histogram in energy. However, at low temperature to fully explore deep free-energy val- it has been noted by different researchers that this en- leys and at high temperature to travel freely through the semble is not optimal. One suggested improvement is the phase space and thus to decorrelate. Thereby, the differ- 1/k-ensemble by Hesselbo and Stinchcombe [21], where ent replicas can explore the rugged structure of the free- the sampling distribution is the inverse of the integrated energy landscape much more efficiently than in a simple density of states. As the authors point out, this descrip- Metropolis simulation. Using this method at tempera- tion samples the low-energy region more often than the tures close to the transition, studies of spin-glass sys- high-energy region, resulting in energy histograms which 3 tems of sizes up to 40 spins have been reported [6, 7]. grow towards the low-temperature phase. For ground-state searches systems of about 103 are fea- arXiv:2011.08560v1 [cond-mat.dis-nn] 17 Nov 2020 sible [8]. The great advantage of PT is its simplicity: Another non-parametric optimization of the MUCA al- the algorithm only needs a suitable temperature set and gorithm was proposed in Ref. [22]. The method uses an exhibits good performance which makes it probably the estimator of the local diffusivity in order to maximize the most employed method in the investigation of systems number of performed round trips in energy. The method with rugged free-energy landscape. is among others applied to the ferromagnetic Ising model Another recent development is the Population Anneal- for which it improves the scaling behavior of the round- ing Monte Carlo [9–13] method which proceeds similarly trip times in energy. The improved performance for the models considered in that work and the nature of the algorithm of automatically identifying the bottlenecks of the simulation and concentrating the simulation effort on ∗ [email protected] this region suggest that the round-trip times of the simu- † [email protected] lations should diminish independently of the underlying ‡ [email protected] system. However, in our implementation, in the case of 2 11 the three-dimensional (3D) bimodal Edwards-Anderson 10 5 10 (EA) spin glass [23], the round-trip times did not sys- flat PSH(E) 1/k 4 tematically improve with this method. Instead the simu- PT 10 lation got stuck for some of the considered samples, ren- 9 power law 10 3 dering a comparison to the other methods impossible. 10 ) ) E ( In this work we present a different approach: we pre- E 2 ( 10 scribe parametric profiles for the histograms of the simu- SH H E 7 P lation and adjust the simulation weights accordingly. As 10 ∆ 1 g 10 E for the three previous MUCA variants, it requires the − g 0 knowledge of the underlying density of states, but it is E 10 much more flexible. The profiles are all chosen to be 5 10 shifted power laws having two free parameters. −1000 −800 −600 −400 −200 0 As an example we consider the 3D bimodal EA spin E glass. This is one of the simplest models exhibiting a rugged free-energy landscape and is also interesting from FIG. 1. The recorded histograms H(E) of the different meth- the point of view of an optimization problem where find- ods and the profile function PSH(E) for one disorder realiza- ing ground states of hard disorder realizations is NP- tion of linear lattice size L = 8. The dotted and the dashed hard [24]. Despite the exponential growth of the compu- vertical lines indicate the position of the ground-state energy Eg and the position of the pole of the power law (5), respec- tational resources fundamental questions regarding the tively. nature of the spin-glass phase still remain. For the progress in understanding the open questions the devel- opment of new methods and an improvement of the ex- criterion with an energy dependent weight function isting methods is crucial. The rest of the paper is organized as follows. In Sec. II W (Enew) Pacc = min 1, , (2) the spin-glass model and the simulation methods are ex- W (E ) old plained. The direct comparison of the round-trip times of the individual methods is performed in Sec. III. The where the weight function is proportional to the inverse of the density of states Ω(E), framework of extreme-value statistics is introduced in Sec. IV. In Sec. V benchmarks for the global comparison W (E) ∝ Ω−1(E). (3) are discussed and the different methods are compared in terms of those benchmarks. The results are summarized For the MUCA simulations Ω(E) has to be sufficiently in Sec. VI. well-known a priori for each disorder realization. An es- timator for it can, for instance, be obtained by means of the Wang-Landau algorithm [25] or, as in this work, by II. MODEL AND EMPLOYED METHODS other iterative procedures which are explained, e.g., in Ref. [26]. This ensemble produces histograms which are We take into consideration the 3D bimodal EA model flat in energy and is, therefore, often also referred to as whose Hamiltonian takes the form “flat histogram method”. A straightforward generalization of the flat histogram H = − Jij SiSj, (1) method are the nonflat histogram methods. If the sim- Xhiji ulation weights for the flat MUCA method are multi- plied with the desired energy dependent shape (or profile) where the bonds Jij and the spins Si can take values ±1. function PSH(E) The sum runs over all neighboring spins in the simple- −1 cubic lattice with periodic boundary conditions. W (E) ∝ Ω (E)PSH(E), (4) Due to the disordered nature of spin glasses the study has to take into account a sufficiently large set of disor- the resulting histograms will be shaped according to der realizations on which the averaged quantities can be PSH(E). In this work all the profiles are shifted power computed. In this case one disorder realization consists laws of the form α of a set of 3V couplings Jij which are either positive or E 3 P (E, ∆E, α)= +1 , (5) negative unity with a probability of 50%, where V = L SH ∆E − E is number of spins in a lattice of linear lattice size L. The g disorder realizations are generated prior to the simulation where the exponent α < 0 and ∆E > 0 is the position and then kept fixed for all times (quenched disorder).