sign in sign up
<<
Home , Stochastic process

arXiv:1402.7067v1 [cond-mat.stat-mech] 27 Feb 2014 eto .I h eune eddct h eto Ito VI section the considerations. dedicate in we final made , the is the model In the V. of section interpretation magnetic physical localized of of A implementation model nuclei. the explicit on the dynamics Glauber IV, application, the an section As in III. present Glauber section we the in of presented generalities are The dynamics ). process statistical ( and background mathematical in focus we rcse nw sGabrdynamic Glauber as known processes ul sdt ra n nesadpolm nphysics in problems understand systems and complex treat of to used fully rml motn ic ti h hoeia ai o the for annealing basis simulated theoretical (or the is Metropolis it since important tremely besaespace state able hsc soeo h ra fkoldeta fe uses often model that Ehrenfest knowledge example, of For areas the process. Markov of one is physics rclengineering trical fasueti euneo xm nacourse. a in exams of sequence grades a of in prediction student the a example, the of For for predictions experiment. our of influence next all could experiments, outcomes chance past of the principle, sequence a In observe we occurrence. when of their quantifies iuinadGabrdynamics Glauber and diffusion oaas hr r ueosapiain fwihwe phenomena which dependent. Biological of are numbers applications variables mention: large numerous random the are the there that if Nowadays, even show valid In to the is applications. was law presenting the intention When with his bother fact, process. not did the Markov given of model, state the of present words, independent other the af- In conditionally can is experiment. experiment past next In given the the of a process). of the (Markov outcome fect the process process, random this of type portant h raiainti ril sa olw:I eto II, Section In follows: as is article this organization The A Markov of class special a present we paper, this In n10,Ade nryvc Markov Andreyevich Andrei 1906, In and phenomena random the studies theory otnostm akvprocess Markov time continuous I RLMNR CONCEPTS PRELIMINARY II. h otn fti okwsdsge nsc a htterea the that a way details a with such material introductory in an designed here was finds its work and dynamics, this dynamics in of Glauber example, of content theory for The basic the importance, present are we this, processes Markov dynamics. nti ae,w netgt pca ls fsohsi M stochastic of class special a investigate we paper, this In .Sohsi Process Stochastic A. lue yais nApoc naSml hsclSystem Physical Simple a in Approach An Dynamics: Glauber .INTRODUCTION I. S 4 = etod ieca xtseTco´gcs nvriaed Tecnol´ogicas, Universidade e Ciˆencias Exatas de Centro 9,10 mn tes eepaiethat emphasize We others. among { s . 0 s , 1 . . . , iab aSlaJunior Silva da Vilarbo } 6 2 ax otl25 32-0 ˜oLood S Brazil RS, S˜ao Leopoldo 93022-000 275, Postal Caixa sasqec frandom of sequence a is oilscience Social , o h sn model. Ising the for 6,7 nafiieo count- or finite a on hstpci ex- is topic This . 1 tde nim- an studied 8 ,success- ), 5 3 o the for Elec- , ∗ n lxadoM Carvalho M. Alexsandro and iinlpoaiiyo occur of probability ditional arx n tcatcvector stochastic a and matrix) ht o all for that, h akvpoet o iceetm process discrete-time a for property Markov the time to prior set time any at time process time to at the prior of times state the of given Thus, neously. n sslto fteiiilvlepolm(Kolmogorov problem value initial the of solution as find When l h ie of lines the all variable h akvpoesi opeeydtrie yatime a by determined matrix completely stochastic dependent is process Markov the imsaeo h ytm fteei nain distribu- invariant a is there If system. tion the of state rium whenever s µP P r called are h ytmi state in system the are rxadiseeet r eoe as denoted are elements its and trix i j Q oigconditions: lowing where n | ( X to - P ,B A, ftetm sdsrt,teprobability the discrete, is time the If o,i iei otnos h yaisof dynamics the continuous, is time if Now, ) matrix ( ( 0 > µ t X µ = ) j i = 0 .Here 0. I from S = stepoaiiyta occur that probability the is ) ntime in = t dexample. nd plcto oasml hsclmodel. physical simple a to application X steiett arxadthe and matrix identity the is i has µ h lmnso Q, of elements The . 11 P ,i.e, ), eed nyo h rcs ttems recent most the at process the on only depends s t > t 0 ( h td fcmlxsses For systems. complex of study the ro rcse,kona Glauber as known processes, arkov invariant ) 0 o all for X , X P | t X n 0 aed i o Sinos, dos Rio do Vale o e naiirwt h Glauber the with unfamiliar der ( ≥ t t P t 1 M = ttsi olw that follows it states n ,te ehv lim have we them ), n t 0 p . . . , ( and 0 utemr,the Furthermore, . A ij = − ≤ > i t are ersnstepoaiiyo finding of probability the represents ) | ( t dt B d t X j hsnto seatyaaoosto analogous exactly is notion This . s ≥ · · · aigvle in values taking stetasto rbblt from probability transition the is ) ∈ n i or P = ) P S q µ = ) .Ti atidctsteequilib- the indicates fact This 0. s ntal.Aiiildistribution initial A initially. ii 0 = (0) t ( q q . 0 t > h itiuino h process the of distribution the , t stationary ij ij s , < = ) P † P > 0 = ( 1 ∞ 1 ,B A, ( s , . . . , A X 0 P > , 0 QP I, ie htoccurred that given ( t q and 0 = ) tasto probability (transition ) ij ∀ ∀ ∀ / µ n ( P s utstsytefol- the satisfy must , t t s , from 0 iiildistribution). (initial ( ) →∞ i i i S B X , . . . , , P 6= n ihteproperty the with , ∈ eoe h con- the denotes ) A P ( Q p t j oriae of coordinates ( P S ij sa is ) X and P arxi called is matrix ( ( P ehave we 0 t t ( t = ) = ) t n soit to associate fsatisfies if ) = B = n s M 11 × 0 simulta- s P | P n ( . X B n where (1) ) X ( t t n ma- t and is ) (2) (3) (4) (5) = = µ µ 2

The Q-matrix is also called matrix row sum zero, which complies with its last property. Each off-diagonal en- try qij we shall interpret as the rate going from i to j and the diagonal elements are chosen in general as qii = − qij . For end, the explicit form of transi- Pj6=i tion probability matrix is P (t) = etQ (solution of dif- ferential equation (2)), where the exponential matrix is etQ = ∞ tkQk/k!. Thus, the stochastic vector µ(t) Pk=0 FIG. 1: Simple system G in contact with a thermal reservoir that describes the probability of finding the system in R with temperature T . their states on time t is µ(t)= µetQ, where µ is the ini- tial distribution. The solution P (t) = etQ shows how basic the matrix Q is to the properties of a • First Postulate: The microscopic state of a pure continuous time . For example, if ν is a fluid is completely characterized by the internal en- probability vector and satisfies νQ = 0 ν is a sta- ergy U, volume V and number of particles N. tionary distribution of Markov process11. Some stochastic processes have the property that, when the direction of time is reversed the behavior of • Second Postulate: There is a of all ex- the process remains the same. This class of stochastic tensive parameters of a composite system named process is known as reversible . We say S(U1, V1,N1,...,Un, Vn,Nn), which is de- fined for all equilibrium states. On removal of an that a continuous time Markov process {Xt}t≥0 is re- versible with respect to initial distribution µ if, for all inner constraints, the extensive parameters assume values which maximize the entropy. n ≥ 1, s0,s1,...,sn ∈ S and tn > ··· > t1 > 0 oc- P P cur (X0 = s0,Xt1 = s1 ...,Xtn = sn) = (Xtn = • Third Postulate: The entropy of a composite sys- s0,Xtn−tn−1 = s1 ...,X0 = sn). Intuitively, if we take a movie of such a process and, then, to run the movie tem is additive on each of its components. Entropy backwards the process result will be statistically indistin- is a continuous, differentiable and monotonically in- guishable from the original process. There is a condition creasing function. for reversibility that can be easily checked, called detailed balance condition. In more detail, this condition is ob- • The fundamental postulate of : tained when Markov process is reversible with respect to In a closed statistical system with fixed energy, all initial distribution µ, i.e., accessible microscopic states are equally likely.

µ q = µ q , (6) i ij j ij Let us consider a simple system G in contact with a thermal reservoir R with temperature T , by means of a for all states i and j, where qij denotes the entry of Q- diathermic constraint fixed and impermeable (see Fig. 1), matrix of P (t) and µi the coordinates of µ. A first con- sequence is that if µ and Q satisfies the detailed balance where R is very large compared to G. If the composite condition then µ is a stationary distribution for P (t)11. system G + R is isolated with total energy E0, then the This condition has a very clear intuitive meaning: in equilibrium, we must have the same number of transi- µ(T ) = (µ (T ),µ (T ),...) (7) tions in both directions (i → j and j → i). 1 2 is characterized by

E − i B. Statistical Physics e T µ (T )= , (8) i Z(T ) Here, we present some concepts of equilibrium statisti- cal mechanics. For a complete treatment, we suggest the where µi(T ) is the probability of finding the system G in 12 13 references: Huang and Reif . particular microscopic state i with energy Ei and tem- Simple systems are macroscopically homogeneous, perature T (we choose the Boltzmann constant kB = 1, isotropic, discharged, chemically inert and sufficiently for convenience). The normalization constant Z(T ) = −Ej /T large. Often, a simple system is called pure fluid. A com- j e is called partition function of the system. posite system is constituted by a set of simple systems Furthermore,P the distribution µ(T ) is known as a Gibbs separated by constraints. Constraints are optimal par- states. Thus the consists in a set titions that can be restrictive to certain variables. The microscopic states i accessible to the system G in con- main types of constraints are: adiabatic, fixed and imper- tact with a thermal reservoir R and temperature T , with meable. probability distribution given by Eq. (8) (Gibbs distribu- In relation the equilibrium thermodynamics is impor- tion). Clearly, there is a energy fluctuation in the canon- tant to know its postulates, which are: ical ensemble. Using the Gibbs distribution, we obtain 3 that the average energy of system G (using β =1/T ) is

∂ hEi = − log (Z(β)) = µ (β)E (9) ∂β X j j j and its variance can be write as FIG. 2: Picture of a magnetic nuclei chain. The up arrow ∂2 σ2(E)= E2 − hEi2 = log (Z(β)), (10) means σ = +1, no arrow means σ = 0 and down arrow σ = ∂β2 −1. where Ej is the energy in a particular microscopic state j. In summary, based on the Gibbs distribution, equi- IV. EXAMPLE: LOCALIZED MAGNETIC librium statistical mechanics indicates that states with NUCLEI lower energy are more likely than those with higher en- ergy. The nuclei of certain solids16 have spin. Ac- cording to quantum theory17, each nuclei can have three quantum spin states (with σ = +1, 0 or −1). This quan- tum number measures the projection of the nuclear spin III. GLAUBER DYNAMICS along the axis of the crystalline solid. As the charge distribution is not spherically symmetric, nuclei energy We saw in the previous section, the Gibbs state (7) depends on the spin orientation relative to the local elec- is the equilibrium state of the system. Thus, a relevant tric field. In Fig. 2, we show a possible configuration of question is: how the system evolves from the initial state this magnetic nucleons. to the Gibbs state? Note that the equilibrium state, in Thus, nuclei in states σ = ±1 and σ = 0 have en- the context of the Markov process, corresponds to sta- ergy, respectively, D> 0 and zero. Therefore, its energy tionary distribution. Thus, we forward the answer to function is given by the question as the solution of Kolgomorov equation (2). 2 However, for this purpose, we need to know the behav- Eσ = Dσ , (12) ior of the Q-matrix. An alternative to the shape of the Q-matrix is the Glauber dynamics6. where D > 0 is electric field intensity and the micro- In order to build a Glauber dynamics is necessary to scopic states (quantum states) are characterized by ran- dom variables (spins) σ ∈ S = {+1, 0, −1}. So, for each know the single particle energy function Ei and their ac- cessible microscopic states (states ) S = {i}. Thus, fixed temperature T , the partition function is written as we write explicitly the partition function Z(T ) and Gibbs − 1 Dσ2 − 1 D Z(T )= e T =1+2e T (13) states µi(T ). To describe the time dependent probabil- X ities matrix P (t) = etQ(T ) which is reversible with re- σ∈{+1,0,−1} spect to the Gibbs state, we need to propose a Q(T )- matrix that satisfies the detailed balance condition (6) and the Gibbs states coordinates µσ(T ) (8) are given by with Gibbs state µ(T ) (for each fixed temperature T ). − 1 Dσ2 14 e T There are many other possibilities , and the optimal µ (T )= . (14) σ − 1 D choice is often dictated by special features of the situa- 1+2e T tion under consideration. However, for our purposes, the one which will serve us best is the one whose Q(T )-matrix In order to explicit the Q(T )-matrix for this physical is given by7 system, we apply the energy function (12) at (11). This results (see App. VII B) − 1 (E −E ) q (T )= e T j i if E > E  ij j i qij (T ) = 1 if Ej ≤ Ei (11) −2 1 1   − 1 D − 1 D − 1 D  Q(T )= e T −2e T e T . (15) qii(T )= − j6=i qij (T ),  P  1 1 −2  where Ei is the single particle energy at particular mi- croscopic state i. To find P (t) = etQ(T ), we need to diagonalize the In the App. VII A, we show that above matrix satis- Q(T )-matrix15. For this, we must present a invertible fies the detailed balance condition with the Gibbs states. matrix B such as Q(T )B = BD3 (equivalently Q(T ) = −1 Therefore, the time dependent probability matrix gener- BD3B ), where B´s columns is composite by eigenvec- −1 ated by Eq. (11) is a Glauber dynamics for the Gibbs tor of Q(T ), B its inverse and D3 is a diagonal matrix states. (3 × 3) formed by eigenvalues of Q(T ). In this present 4 case, the characteristic polynomial is

p(λ) = det (Q(T ) − λI) − 1 D 1 D = −e T λ(3 + λ)(2 + e T (1 + λ)). (16)

The eigenvalues λ’s are solution of characteristic equation p(λ) = 0, i.e,

λ1 = −3, λ2 =0, λ3 = −Z(T ), (17) where Z(T ) is the partition function (13). Consequently, its associated eigenvectors are

−1 1 1      1 D  v = 0 , v = 1 , v = T . (18) 1 2 3 −2e FIG. 3: Time dependence for some transition probabilities 1 1      1  pσσe(t) for T = 1 and D = log (2). The solid line corre- sponds to p00(t), short dashed line p+1+1(t), medium dashed We conclude that Q(T )-matrix admits a decomposition line p+10(t) and long dashed line p+1−1(t). −1 Q(T ) = BD3B (see App. VII C). Then, P (t) = BetD3 B−1 is responsible for describing the dynamics of transition probabilities between spin. More explicit, P (t) sider initially the state σ = +1. Note that we have is p+1+1(t) ≥ p+1−1(t) for all t. This means that since p+1+1(t) p+10(t) p+1−1(t) the nuclei is in the quantum spin state σ = +1 is more   P (t)= p0+1(t) p00(t) p0−1(t) (19) likely that it remains in such a state that it “flip” to the  p−1+1(t) p−10(t) p−1−1(t)  quantum spin state σ = −1. In the Fig. 3, we present the dynamics of some transition probabilities. For our where choice of parameters T = 1 and D = log (2) we have limt→∞ µ(T )(t) = µ(T ) = (1/4 1/2 1/4). Therefore, in −3t − 1 D −Z(T )t e e T e a sample of N nuclei, on average N/2 occupy the quan- p (t) = p (t)= + + , +1+1 −1−1 2 Z(T ) 2Z(T ) tum spin state σ = 0, N/4 occupy σ = +1 and N/4 − 1 D − 1 D−Z(T )t occupy σ = −1. In this figure, we see the convergence e T e T p0+1(t) = p0−1(t)= − , (exponential) this limit as well as the consistency in their Z(T ) Z(T ) values. −3t − 1 D −Z(T )t e e T e Still on the limit t → ∞, we have p (t) = p (t)= − + + , −1+1 +1−1 2 Z(T ) 2Z(T ) µ (T ) µ (T ) µ (T ) 1 e−Z(T )t  +1 0 −1  p+10(t) = p−10(t)= − , lim P (t)= µ+1(T ) µ0(T ) µ−1(T ) (20) Z(T ) Z(T ) t→∞  µ+1(T ) µ0(T ) µ−1(T )  − 1 D−Z(T )t 1 2e T p00(t) = + . Z(T ) Z(T ) where µσ(T ) are the coordinates of Gibbs state µ(T ). This result is consistent with that shown in the Sec. II A, Here, pσ,σe(t) = P(Xt = σ|X0 = σ) indicates the tran- i.e, µ(T ) = (µ+1(T ) µ0(T ) µ−1(T )) is the unique equilib- rium state (invariant distribution) for P (t). Then, what- sition probability from spine state σ to σ in time t. For ever the initial spin states distribution ν = (ν ν ν ), example, p+10(t) is the probability fromeσ = +1 to σ =0 +1 0 −1 after time t. we always have limt→∞ µ(T )(t) = limt→∞ νP (t)= µ(T ). It is relatively easy to prove that P (t) satisfies the This result, partly, justifies freedom of choice in the ini- detailed balance condition with Gibbs state µ(T ) (14). tial distribution of spin states in Monte Carlo simulations 18 Therefore, the stochastic Markov process {Xt}t≥0 where (Metropolis algorithm ). the Xt denotes the quantum spin state of Note by Eq. (14) that µ0(T ) ≥ µ+1(T ) = µ−1(T ). each located nucleus at time t (i.e. Xt = σ) is a Glauber Thus, we can conclude that after a long time, most of dynamics. the nuclei are occupying the quantum spin state σ = 0. This occupation number is due to the fact that the quan- tum spin state σ = 0 is less energetic than the other V. RESULTS AND DISCUSSION two states (E0 = 0 and E+1 = E−1 = D > 0). This is in accordance with a general physical principle that Given the P (t) elements and an initial quantum state, any physical system tends to occupy the lower energy we can follow the dynamics of the transition probabil- state. Additionally, note that if T → ∞, we prove that ity between quantum spin states. For example, con- limT →∞ µ0(T ) = limT →∞ µ+1(T ) = limT →∞ µ−1(T ) = 5

1/3. Therefore, for high temperature the three quantum because as we are assuming Ej > Ei it follows that Ei < spin states are equally likely (same occupation number). Ej then by (11) qji(T ) = 1. Therefore, Q(T ) and µ(T ) In the opposite limit, when T → 0, limT →0 µ0(T ) = 1 and satisfy the detailed balance condition and hence P (t) = tQ(T ) limT →0 µ+1(T ) = limT →0 µ−1(T ) = 0. This indicates e generated by Q(T ) is a Glauber dynamics. that for low temperatures, all the nuclei tend to occupy the quantum spin state of lower energy σ = 0 (ground state). Another important verification is the average number of spin hσi, given by hσi = σ∈S σµσ(T )=0 where S = {+1, 0, −1}. If we chose aP nuclei randomly, is more likely to be found in the quantum spin state σ = 0. The quantity m = hσi is called the magnetization of sys- 13 tem . B. Q(T )-matrix Calculations

VI. CONCLUSIONS In this appendix, we show in detail the entry of Q(T )- matrix. As the S = {+1, 0, −1} has tree This paper presents a review about continuous time states our Q(T )-matrix is 3 × 3 and its elements q e(T ), stochastic Markov processes which are reversible with re- σ,σ evaluated as prediction in Eq. (11) with Eq. (12), are spect to Gibbs State, called Glauber dynamics. given by: The main result of our exposition is contained in Sec. IV. We use the theory developed in the preceding − 1 (E −E ) q (T ) = e T 0 +1 =1, sections applying them in a very simple physical model. +10 1 1 − (E−1−E+1) − (D−D) This example, contains the necessary ingredients to illus- q+1−1(T ) = e T = e T =1, trate richness of the method. q+1+1(T ) = −q+10(T ) − q+1−1(T )= −2, We show that, after a long time , distribution 1 1 1 − (E+1−E0) − (D−0) − D of quantum spin states are given by the state Gibbs. This q0+1(T ) = e T = e T = e T , 1 1 1 − (E−1−E0) − (D−0) − D state is a equilibrium state for the Glauber dynamics. So q0−1(T ) = e T = e T = e T , any initial distribution of spin state will relax in µ(T ). − 1 D q (T ) = −q (T ) − q (T )= −2e T , This, ,in turn, justifying the free choice of the initial dis- 00 0+1 0−1 1 1 − (E+1−E+1) − (D−D) tribution of spin states in computational simulations via q−1+1(T ) = e T = e T =1, 1 Monte Carlo method. − (E0−E−1) q (T ) = e T =1, For a fixed temperature, we verify that the quantum −10 spin state σ = 0 is the one with the highest number of q−1−1(T ) = −q−1+1(T ) − q−10(T )= −2. occupants (most likely). This is consistent with what is because E > E . expected physically since σ = 0 is the lowest energy state. ±1 0 This fact indicates that average value of the random spin variable was zero and, consequently, a zero magnetization for a sample of this kind of spins. Finally, for high temperatures, the nuclei are uniformly distributed in the quantum spin states (1/3 for each). On the other hand, for low temperatures, all the nuclei tend to occupy a quantum spin state σ = 0. −1 C. Explicit Elements: B, D3 and B

VII. APPENDICES In Sec. (IV), we discus a decomposition Q(T ) = −1 A. Proof of the Detailed Balance Condition BD3B . Explicitly,

In order to show the equality (6) for Q(T )-matrix (11) −11 1 −30 0  − 1 D    and Gibbs state (8) let us assume, without loss of gener- B = 0 1 −2e T ,D3 = 00 0 ality, that Ej > Ei. So,  11 1   0 0 −Z(T ) 

E 1 − i 1 (E −E ) and µ (T )q (T ) = e T e T j i i ij Z(T ) − 1 0 1 E E E 12 21 1 − i − j i  − D − D  = e T e T e T B−1 = e T 1 e T . Z(T ) Z(T ) Z(T ) Z(T )  1 − 1 1  Ej E E  2Z(T ) Z(T ) 2Z(T )  1 − − i + i = e T e T T Z(T ) E 1 − j = e T 1= µ (T )q (T ), Z(T ) j ji 6

∗ Electronic address: [email protected] 9 E. J. Newman, Complex Systems: A Survey cond- † Electronic address: [email protected] mat.stat-mech 79 800-810 (2011). 1 A. A. Markov, Rasprostranenie zakona bol shih chisel 10 R. Albert, A.L. Barab´asi, Statistical mechanics of complex na velichiny, zavisyaschie drug ot druga (Izvestiya Fiziko- networks Rev. Mod. Phys. 74 47-97 (2002). matematicheskogo obschestva pri Kazanskom univer- 11 J. R. Norris, Markov Chains (Cambridge Series in Statis- sitete), 2-ya seriya 15 135-156 (1906). tical and Probability Methematics, Cambridge U. Press, 2 M. C. Gibson, A. B. Patel, R. Nagpal and N. Perrimon, 1997.). The emergence of geometric order in proliferating meta- 12 K. Huang, Statistical Mechanics (John Wyley Inc, New zoan epithelia Nature 442 05014 (2006). York, 1963.). 3 J. Stander, D. P. Farrington, G. Hill and P. M. E. Altham, 13 F. Reif, Fundamentals of Statistical and Thermal Physics Markov Chain Analysis and Specialization in Criminal Ca- (McGrawHill, New York, 1965.) reers Br J Criminol 29 317-335 (1989). 14 Y. G. Sinai, : An Introductory Course 4 K. Aas, L. Eikvil and R. B. Huseby, Applications of hidden by Yakov G. Sinai ( Springer Textbook Ser, New York, Markov chains in image analysis Pattern Recognition 32 1992.) 703-713 (1999). 15 Lay, David C., and Its Applications (Ad- 5 P. and T.Ehrenfest, Uber zwei bekannte Einwande gegen dison Wesley, New York, 2005.) das Boltzmannsche H-Theorem Physikalische Zeitschrift 8 16 R. Sessoli and D. Gatteschi, Quantum Tunneling of Mag- 311-314 (1907). netization and Related Phenomena in Molecular Materials 6 R. J. Glauber, Time Dependent of the Ising Angew. Chem. 42 268 (2003). Model J Math Phys 4 294-307 (1963). 17 J.J. Sakurai, Modern Quantum Mechanics (Addison- 7 S. W. Daniel, An Introduction to Markov Processes Wesley, New York, 1994.) (Springer-Verlag, New York, 2000). 18 K, Binder, D. W. Heermann, Monte Carlo Simulation 8 M. Nicholas, R. W. Arianna, R. N. Marshall, T. H. Au- in Statistical Physics : An Introductory (Springer-Verlag, gusta, T. Edward, Calculations by Fast New York, 2002.) Computing Machines J. Chem. Phys. 21 1087-1093 (1953).