A New Approach to Spin Glass Simulations∗ Bernd A. Berg1,2 and Tarik Celik1,3 1 Supercomputer Computations Research Institute Tallahassee, FL 32306, USA 2 Department of Physics, The Florida State University Tallahassee, FL 32306, USA 3 On leave of absence from Department of Physics Hacettepe University Ankara, Turkey March 19, 2018 arXiv:hep-lat/9204001v1 8 Apr 1992 ∗Submitted to Physical Review Letters. 1 Abstract We present a recursive procedure to calculate the parameters of the recently introduced multicanonical ensemble and explore the approach for spin glasses. Temperature dependence of the energy, the entropy and other physical quantities are easily calculable and we report re- sults for the zero temperature limit. Our data provide evidence that the large L increase of the ergodicity time is greatly improved. The multicanonical ensemble seems to open new horizons for simulations of spin glasses and other systems which have to cope with conflicting constraints. 2 The theoretical understanding of spin glasses, for a review see [1], has re- mained a great challenge. In particular the low temperature limit leaves many open questions about the effects of disorder and frustration. For instance, it has remained controversial whether Parisi’s [2] mean field theory provides the appropriate description for 3D spin glasses. The attractive alternative is the droplet model [3], which in turn is equivalent to a one parameter scaling picture [4]. The simplest spin glass system to study such questions numeri- cally is the Edwards-Anderson model. In its Ising version it is described by the Hamiltonian H = − J s s , (1) X ij i j <ij> where the sum goes over nearest neighbours and the exchange interactions Jij = ±1 between the spins si = ±1 are quenched random variables. In our investigation we impose the constraint Jij = 0 for each realization. P Recent simulations [5] of the 3D model in a magnetic field support the mean field picture. However, one may argue that sufficiently low temperatures on sufficiently large systems have not been reached. For previous simulations of the Edwards-Anderson model without magnetic field see [6, 7]. Low temperature simulations of spin glasses suffer from a slowing down due to energy barriers. To illustrate the problem, let us consider a simple ferromagnet: the 2D Ising model on an 50 × 50 lattice. In Figure 1 we give its magnetic probability density versus βˆ = T −1. The two distinct branches below the Curie temperature are associated with free energy valleys in con- figuration space, each of which defines a (pure) thermodynamic state. At 1 e temperatures below the Curie point the ergodicity time τL increases expo- nentially fast with lattice size, asymptotically like exp[f s(β)LD−1], where f s is the surface free energy. Therefore, on large lattices at sufficiently low tem- perature the simulation of the system will, given a reasonable finite amount of computer time, never tunnel from one phase to the other. Besides for partic- ular problems (like the determination of the order-order surface free energy) this lack of tunneling does not pose a major handicap for Ising model sim- ulations. The reason is that the two configuration space valleys are related by the exact symmetry si → −si of the Hamiltonian. Exploring one valley 1It is for the present investigation of spin glasses more appropriate to use the term ergodicity time τ e, instead of tunneling time τ t which is appropriate in the context of surface tension investigations. 3 Figure 1: Ising model magnetic probability density from 50 × 50 lattice. 4 by means of a simulation yields also all the properties of the other one and, hence, allows to overlook the entire system. The situation is much more involved for spin glasses. For low enough temperature the system is supposed to split of into many thermodynamic states, separated by similar tunneling barriers as the two pure states of the Ising model. However, unlike in the Ising model the states are not related to each other by a symmetry of the Hamiltonian. Rather they appear be- cause of accidental degeneracy which in turn occurs because of randomness and frustration of the system. For computer simulations this means that one would like to explore many independent configuration space valleys while keeping track of their relative weights. The groundstate energies associated with these valleys may or may not be degenerate, but it should be noted that even if they are not degenerate, tunneling between the valleys would still be governed by the energy barriers. The physics of these barriers is far less well understood as in the ferromagnetic case. As detailed finite size scaling (FSS) studies do not exist, it is unclear to us to what extent these barriers depend on the system size, whereas the temperature dependence has been investigated [1]. We use the notation bifurcation temperature (bifurca- tion point) for the temperature at which the spin glass configuration space (phase transition or not) begins to split of into a number of valleys which are well separated by energy barriers. In the present paper we suggest that the e increase of τL can be reduced to a fairly decent power law by performing a simulation which covers in a single ensemble a whole temperature range from well above to far below the bifurcation point. The appropriate formulation is provided by a generalization of the multicanonical ensemble [8]. To test the approach we have performed multicanonical simulations of the 2D Ising fer- romagnet and then of the 2D Edward-Anderson Ising spin glass model. We concentrate on ground state properties what is a kind of worst case scenario for the performance of the multicanonical simulation. It should be noted that Figure 1 does rely on a multicanonical simulation, what explains the slight asymmetry between the two branches. Ever since the pioneering paper by Metropolis et al.[9] most MC simula- tions concentrated on importance sampling for the canonical Gibbs ensemble. It has always been well-known, for instance [10], that one is allowed to choose phase-space points according to any other probability distribution, if it is con- venient. However, a systematic reasoning for a better than canonical choice 5 has rarely been put forward1. It is our suggestion that in a large class of situations, in particular those where canonical simulations face severe ergod- icity problems, it is more efficient to reconstruct the Gibbs ensemble from a simulation of a multicanonical ensemble [8] than simulating it directly. In canonical simulations configurations are weighted with the Boltzmann factor PB(E) = exp(−βEˆ ). Here E is the energy of the system under consideration. The resulting canonical probability density is Pc(E) ∼ n(E)PB(E), (2) where n(E) is the spectral density. In order of increasing severity problems with canonical spin glass simulations are: i) Simulations at many temperatures are needed to get an overview of the system. ii) The normalization in equation (2) is lost. It is tedious to calculate im- portant physical quantities like the free energy and the entropy. e iii) The low temperature ergodicity time τL diverges fast with lattice size (either exponentially or with a high power law). The relative weights of pure states can only be estimated for small systems. Let us choose an energy range Emin ≤ E ≤ Emax and define for a given function β(E) the function α(E) by the recursion relation (with the Hamil- tonian (1) the energy changes in steps of 4) α(E − 4) = α(E) + [β(E − 4) − β(E)] E, α(Emax)=0. (3) The multicanonical ensemble [8] is then defined by weight factors PM (E) = exp [−β(E)E + α(E)] , (4) where β(E) is determined such that for the chosen energy range the resulting multicanonical probability density is approximately flat: Pmu(E) = cmu n(E)PM (E) ≈ const. (5) In the present study we take Emax = 0(β(E) ≡ 0 for E ≥ Emax) and 0 Emin = E the ground state energy of the considered spin glass realization. 1Notable may be microcanonical simulations, but for the ergodicity problems on which we focus here they perform even worse than the canonical approach does. 6 A multicanonical function β(E) can be obtained via recursive MC calcu- lations. One performs simulations βn(E), n = 0, 1, 2, ..., which yield prob- n n n n ability densities P (E) with medians Emedian. For E < Emin < Emedian the probability density P n(E) becomes unreliable due to insufficient statistics, caused by the exponentially fast fall-off for decreasing E. We start off with n = 0 and β0(E) ≡ 0. The recursion from n to n + 1 reads n n β (E) for E ≥ Emedian; n n n+1 β (Emedian) + β (E) = n −1 n n n n n (Emedian − E) ln [P (Emedian)/P (E)] for Emedian > E ≥ Emin; βn+1(En ) for E < En . min min (6) th n−1 Here the n simulation may be constrained to E < Emedian by rejecting n−1 all proposal with energy E > Emedian, but one has to be careful with such bounds in order to maintain ergodicity. The recursion is stopped for m m−1 0 with Emin = E being groundstate. Starting with this simple approach we have explored several more sophisticated variants. Considerable speed-ups and gains in stability could be achieved. The CPU time spent to estimate the multicanonical parameters was 10% to 30% of the CPU time spent for simulations with the final set. Once the functions β(E) and α(E) are fixed, the multicanonical simula- tion exhibits a number of desireable features: i) By reweighting with exp[−βEˆ + β(E)E − α(E)] the canonical expectation values O(βˆ) = Z(βˆ)−1 O(E) n(E) exp(−βEˆ ), (7) X E ˆ ˆ where Z(β) = E n(E) exp(−βE) is the partition function, can be recon- Pˆ ˆ structed for all β in an entire range βmin ≤ β ≤ βmax.