Arxiv:1905.07421V1

Home , Relative velocity

arXiv:1905.07421v1 [cond-mat.stat-mech] 17 May 2019 g xed oteBlzankntceuto hc is which equation kinetic Boltzmann for the expression to Boltzmann extends ogy the fact, In − time. quantity with H-theorem the ically Boltzmann which the to with fol- according analogy it time. has with nonnegative, result monotonically is This increases entropy entropy the of that lows production the Since qastepouto fetoyimplying, entropy of production the equals equilibrium. and thermodynamic balance, of detailed hallmark or the reversibility microscopic of sion is h eutn xrsini afo h summation the of half is ( expression of resulting The ries. ersnaino h eodlwo hroyais In thermodynamics. situation, of a nonequilibrium law and the second production, the entropy of representation the of property fundamental rdcin .Tecondition The entropy 0. the = of vanishing Π the production, implying trajectories, all for n h rdcino nrp titypstv quantity positive strictly a entropy Π of production the ing eae otelgrtmo h ai fteprobability the of trajectory reverse ratio the the of be logarithm P to of the assumed production is to entropy thermodynamic related the of of production representing out The systems of equilibrium. in way occurs the which entropy, in a found by is or equation master a by [21–23]. the governed equation over Fokker-Planck distribu- is defined and probability space system the phase whole of the evolution representing time tion the pro- Markovian and the time cess continuous Usually a trajectory trajectory. is stochastic evo- dynamics deterministic a stochastic pure time of a the consists than that space rather phase meaning in dynamics, systems lution these stochastic of a description exten- the by The through achieved equilibrium. is sion thermodynamic of comprise to out mechanics systems statistical Gibbs extends chanics, sotie ysumming by obtained is Π dH/dt o nioae ytm h ievraino entropy of variation time the system, isolated an For udmna etr fsohsi thermodynamics stochastic of feature fundamental A me- stochastic or [1–20], thermodynamics Stochastic > fataetr npaesaeadtepoaiiyof probability the and space phase in trajectory a of P .Temdnmceulbimocr when occurs equilibrium Thermodynamic 0. − P seuvln oteepeso o .Teanal- The Π. for expression the to equivalent is r nvriaed õPuo nttt eFıia u oMat do F´ısica, Rua de Instituto São Paulo, de Universidade ln( ) n otmn ntekntcter fgssrgrigtemi the regarding gases of theory kinetic red t the equation interpretat of in master stochastic Boltzmann equation a the and as differential type, understood a is Hamiltonian approach to produ the present reduced scattering of be the is of to dynamics col angle shown the to is When corresponding equation rates attained. is transition equation equation incr considering Liouville an By the to by time. leading described entropy, dynamics, of isolate generation Hamiltonian an a of space yields phase evolution in dynamics stochastic a describes h otmn iei qaini bandfo nintegro- an from obtained is equation kinetic Boltzmann The P/P .INTRODUCTION I. r hc sanneaieqatt,a quantity, nonnegative a is which ) P r h oa nrp production entropy total The . P ln( P otmn tcatcthermodynamics stochastic Boltzmann sdsic from distinct is P/P H P erae monoton- decreases r = vraltrajecto- all over ) P r steexpres- the is dS/dt ´ roJ eOliveira de J. Mário P P r Π. = mak- = P r qain nteohrhn,teei opouto of production no is there Liouville is a hand, trajectory by other entropy. described the the systems on When to equation, happens entropy. as of occurrence. unique, lead production of evolution the stochastic probability the to of certain trajectories a emerg- multiple Each The has unique. not trajectory is space ing phase the of point given energy. kinetic the preserves equation, equation Boltzmann differential the equation the Like differential a type. Fokker-Planck to the reduced Boltzmann of be integro-differential to shown the is small, equation scat- is the angle When tering molecules. two between interaction the in one-body of prob- product two-body a distributions. a by probability which replaced in is equa- scheme distribution ability truncation master a integro-differential is by the tion [32–36] from equation derived by kinetic and then Boltzmann Maxwell the The by describe employed Boltzmann. to molecules, two appropriate of are motion collision which the al- molecules, to The two corresponding gases. of those as of are such theory transitions kinetic particles micro- lowed the interacting the within of studied of systems those of distribution states probability scopic the of evolution [31]. model, process urn stochastic a the clearly of the is dynamics between which the analogy and an kinetics presented Boltzmann he dy- of Boltzmann when stochastic the views H-theorem, of the a irreversibility in by the implicit concerning ruled Ehrenfest was was understanding micro- system This the a namics. of of to evolution lead also states time reasonings but scopic the their sense that is, understanding static That the the sense. reasonings dynamical in their the probabilistic However, in only [30]. of not was Jeans were theory mechanical by strictly kinetic stated not clearly the and probabilistic within were gases Boltzmann and Maxwell stochastic and [24–30] gases be- of connection thermodynamics. theory a kinetic revealing the equation, tween master a to similar nasohsi yais rjcoysatn rma from starting trajectory a dynamics, stochastic a In occurring scattering the describe rates transition The time the for equation master general a up set we Here by employed reasonings the that recognition The o fteraoig mlydb Maxwell by employed reasonings the of ion hroyai ytm h stochastic The system. thermodynamic d a ,17,05800Sa al,S,Brasil SP, São Paulo, 05508-090 ão, 1371, iin ftoprils h Boltzmann the particles, two of lisions aeo ib nrp,i otatt a to contrast in entropy, Gibbs of ease o hc h nrp scntn in constant is entropy the which for , e ycliin ssal h master the small, is collisions by ced rsoi ieevolution. time croscopic cst h iuil qain The equation. Liouville the to uces eFke-lnktp.We the When type. Fokker-Planck he ieeta atreuto that equation master differential 2

II. STOCHASTIC MECHANICS will be found in a nonequilibrium stationary state and ρe(x) is the nonequilibrium stationary probability den- A. General approach sity. Let E(x) denote the energy of the system when the We consider a system of particles evolving in time state is x. We are considering that E(x) does not depend according to a dynamics defined in the phase space explicitly on time. The time evolution of the average x = (q,p), where q denotes the collection of coordinates energy U = hE(x)i, defined by qi of particles and p the collection of momenta pi. Dur- ing a certain time interval τ, the state of the system U = E(x)ρ(x)dx, (6) ′ Z evolves from a state x to a state x . If x evolves to a ′ single state x , as happens in a Hamiltonian dynamics, is obtained by multiplying equation (3) by E(x) and in- ′ then the motion is deterministic, that is, x is a func- tegrating over x. The result is tion of x. In a stochastic motion, x can evolve to more than one state x′. To describe this situation, we resort dU = −Φu, (7) to a random variable ξ by associating to each value of ξ dt ′ ′ a certain value of x , that is, x becomes a function of where x and ξ, which we write as x′ = f(x, ξ). A trajectory ′ ′′ ′′′ x → x → x → x → ... in phase space becomes estab- ′ ′ ′ ′ ′ ′′ Φu = {E(x ) − E(x)}w(x|x )ρ(x )dx dx, (8) lished if the sequence ξ → ξ → ξ → ... is given. The Z random variables in this sequence are considered to be statistically independent, which means that the stochas- is understood as the flux of energy from the system to the tic process is Markovian. environment. In general, the flux of energy is a sum of the If the system is in state x, we ask for the conditional heat flux and the work done on the system per unit time. probability P(x′|x)dx′ of finding the system in phase In the absence of the last term, Φu is just the heat flux space volume dx′ around x′ after an interval of time τ. which is understood as describing the heat exchange by Denoting by P(ξ) the probability density of ξ, the con- the contact with the environment and also by absorption ditional probability is determined by and emission of radiation. In deriving expression (8), we have rearranged the second term by exchanging the ′ ′ ′ variables x and x . P(x |x)= δ(x − f(x, ξ))P(ξ)dξ. (1) Z The entropy S of the system is defined as the Gibbs entropy The transition rate w(x′|x)dx′, defined as the rate in which the state x goes into state x′ around dx′, is pro- S(t)= −kB ρ(x, t) ln ρ(x, t)dx, (9) portional to the conditional probability, that is, Z ′ ′ w(x |x)= a(x)P(x |x), (2) where kB is the Boltzmann constant. Its time derivative can be written as [19] where the factor a(x) might depend on the given state x. Once the transition rate densities w(x′|x) are given, dS = Π − Φ, (10) we may write the master equation, which is the equation dt that governs the time evolution of the probability density where Φ is the flux of entropy from the system to the ρ(x, t) of x at time t, environment, ∂ ′ ′ ′ ′ ′ ρ(x)= {w(x|x )ρ(x ) − w(x |x)ρ(x)}dx , (3) ′ ′ w(x |x) ′ ∂t Z Φ= −kB w(x|x )ρ(x ) ln dxdx , (11) Z w(x|x′) where we are omitting the dependence of ρ on t. In the stationary steady state, this equation becomes and Π is the entropy being generated inside the system per unit time, or the entropy production per unit time, ′ ′ ′ ′ given by {w(x|x )ρe(x ) − w(x |x)ρe(x)}dx =0, (4) Z ′ ′ ′ w(x |x)ρ(x) ′ Π= −kB w(x|x )ρ(x ) ln dxdx . (12) where ρe(x) is the time independent stationary solution. Z w(x|x′)ρ(x′) If, in addition, the transition rates w(x′|x) obey the microscopic reversibility, or detailed balance condition, It is straightforward to show that Π is a nonnegative quantity, Π ≥ 0. To this end, we exchange variable x ′ ′ ′ w(x|x )ρe(x )= w(x |x)ρe(x), (5) and x′ in the right-hand side of equation (12) to reach an expression which, added to (12), gives us the equation for any pair of states (x, x′), the system is in thermody- e namic equilibrium and ρ (x) is the equilibrium probabil- kB ′ ′ ′ Π= {w(x |x)ρ(x) − w(x|x )ρ(x )}× ity density. If (5) does not hold, but (4) does, the system 2 Z 3

′ w(x |x)ρ(x) ′ × ln dxdx . (13) The vanishing of the two quantities Φ and Φu charac- w(x|x′)ρ(x′) terizes an isolated system. In this case, the detailed balance condition (5) gives ρe(x) = ρe(x′) if E(x) = E(x′) The integrand is of the form (a − b) ln(a/b) ≥ 0, which is which implies that the equilibrium probability distribu- nonnegative. tion is of the form

ρe(x)= F (E(x)), (20) B. Time reversal that is, ρe(x) depends on x through E(x). Suppose a system makes the transition Let us consider as the initial condition a probability distribution such that all states x have the same energy ′ ′ ′ x = (q,p) → x = (q ,p ) (14) E0, that is, during a certain interval of time τ. The time reversal ρ(x, 0) 6= 0 only if E(x)= E0. (21) transition is For example, ρ(x, 0) = δ(x − x0) where E(x0) = E0. ′ ′ ′ xtr = (q , −p ) → xtr = (q, −p), (15) Since the energy is conserved by the transition rates, it follows that any subsequent probability distribution will which might be distinct from hold the same property (21), including the stationary probability distribution. We may conclude from property ′ ′ ′ e e x = (q ,p ) → x = (q,p), (16) (20) that ρ (x) = F (E0), that is, ρ (x) has the same value for all states such that E(x)= E0, or which we call the reverse transition. In some cases, the reverse transition may not exist in which case the detailed 1 ρe(x)= δ(E(x) − E ), (22) balance condition (5) cannot be fulfilled. But if, in this Ω 0 case, the time reversal transition exists, then the detailed balance condition can be fulfilled in the following form, which is the equilibrium Gibbs microcanonical probability distribution, where ′ e ′ ′ e w(xtr|xtr)ρ (xtr)= w(x |x)ρ (x), (17) Ω= δ(E(x) − E0)dx. (23) and again the system will be found in thermodynamic Z equilibrium. Nevertheless, the formalism developed above can still be used if we formally replace the time The trajectories lie on the surface of constant energy in reversal transition by the reverse transition and assume phase space. However, the states will be equiprobable that the density ρ(q,p) is even in the variable p. and given by (22), only for long times. We remark that in the present case of an isolated system, dS/dt = Π ≥ 0, since Φ = 0, where Π is given C. Isolated system by (19). For any initial probability distribution distinct from the final distribution S will increase with time, as expected. An isolated system does not exchange heat and per- forms no work so that its energy E(x) remains invari- ant in time. The conservation of energy in a transition D. Boltzmann equation and H-theorem x → x′ is fulfilled by assuming that w(x′|x) is nonzero only when E(x′)= E(x). This implies that the flux of en- We analyze the case in which the allowed transitions ergy, given by equation (8), vanishes identically, Φu = 0. ′ Also, in an isolated system there should be no entropy from a state x to a state x are those in which only two components of x, say xi and xj , have their states mod- flux. To fulfill this condition, we assume that the rate ′ ′ of a transition is equal to the reverse transition, that ified. That is, (xi, xj ) changes to (xi, xj ) whereas xk, ′ ′ k 6= i and k 6= j, remain unchanged. The correspond- is, w(x |x) = w(x|x ), and the flux of entropy, given by ′ equation (11), vanishes identically, Φ = 0. The master ing transition rate is denoted by wij (x |x). To reach the equation (3) in the absence of entropy flux becomes Boltzmann kinetic equation, we assume two conditions. One of them is that the transition rate is equal to its re- ′ ′ ∂ ′ ′ ′ verse wij (x |x)= wij (x|x ). This describes the evolution ρ(x)= w(x|x ){ρ(x ) − ρ(x)}dx , (18) of an isolated system, as we have seen above. The other ∂t Z ′ condition is that the transition rate wij (x |x) depends ′ and, in addition, from equation (13), we find only on the variables i and j, and write wij (xij | xij ) where the notation xij = (xi, xj ) is being used. This sec- kB ′ ′ ρ(x) ′ ond condition is necessary to describe a binary collision, Π= w(x |x){ρ(x) − ρ(x )} ln dxdx . (19) 2 Z ρ(x′) in which the states of two particles are being changed. 4

The transition rate w(x′|x) in equation (18) becomes III. STOCHASTIC KINETIC EQUATION ′ a sum of all pairs i, j of wij (xij |xij )/n, A. Maxwell ∂ρ(x) 1 ′ ij ′ ′ = wij (xij |x ){ρ(x ) − ρ(x)}dx dx , ∂t n Z ij i j Here we provide a derivation of the Boltzmann ki- X(ij) (24) netic equation following the original lines of thought of where n is the number of components of the vector x and Maxwell and also that of Boltzmann but interpreting the summation extends over all distinct pairs (ij). The their reasoning as stochastic. At the end, we set up a notation xij stands for the vector with the same compo- diﬀerential form of the Boltzmann kinetic equation, ob- nents of the the vector x except the i and j components tained when the angles of deﬂection of the molecules by which are x′ and x′ , respectively collisions can be considered to be small. i j The model used by Maxwell to describe the kinetics of Integrating the left and right-hand sides of equation an ideal gas consisted of molecules that move in straight (24) in all variables except x , we have 1 lines in any possible direction and speed, colliding with each other and with the walls of the container. The ve- ∂ ′ ρ1(x1)= w12(x12|x12)× locities of the molecules are not arbitrary but are in ac- ∂t Z cordance with the well known velocity distribution introduced by Maxwell [37]

′ ′ ′ − 2 ×{ρ2(x12) − ρ2(x12)}dx1dx2dx2, (25) ρ(v)= be av /2 (29) v v where ρ1(x1) is a one-variable probability density and where a and b are constants, v = | |, and is the velocity v ρ2(x12) is a two-variable probability density. of a molecule. A derivation of the velocity distribution To get a closed equation for ρ1(x1), we use the approx- provided by Maxwell [24] used reasonings of the stochas- imation in which the two-variable probability is written tic type, and are as follows. as the product of one-variable probabilities, that is, we We consider a gas consisting of several molecules of two v v assume that the variables x1 and x2 are statistically inde- types. Let ρ2( 1, 2) represent the final velocity proba- pendent, ρ2(x12)= ρ1(x1)ρ1(x2). This is a good approx- bility density related to two types of molecules, A and B, v v imation when the the particles are far from each other, where 1 and 2 denotes the velocities of A and B, respec- as happens to a rarefied gas. Equation (25) becomes tively. The velocities of the molecules are being changed continuously due to the interaction between molecules, ∂ ′ such as collisions in the case of molecules modeled by ρ1(x1)= w12(x12|x )× ∂t Z 12 rigid elastic bodies. During a certain small interval of time τ, let us suppose that the velocities of two molecules v v v ′ v ′ A and B, change from ( 1, 2) to ( 1, 2). The proba- ′ ′ ′ ′ v ′ v ′ ×{ρ (x )ρ (x ) − ρ (x )ρ (x )}dx dx dx , (26) bility of finding the velocities of A and B inside d 1d 2 1 1 1 2 1 1 1 2 1 2 2 v ′ v ′ around ( 1, 2) at a certain instant of time and inside v v v v which is the Boltzmann kinetic equation, except for the d 1d 2 around ( 1, 2) at an earlier small interval of time transition rate which should be specified. This will be τ is done below. ′ ′ ′ ′ {w(v , v | v1, v2)dv dv τ} ρ2(v1, v2)dv1dv2, (30) The production of entropy, given by (19), becomes 1 2 1 2 where the expression inside curly brackets is the con- kB ′ ′ ditional probability of finding the velocities of A and Π= n {ρ1(x1)ρ1(x2) − ρ1(x1)ρ1(x2)}× v ′ v ′ v ′ v ′ 2 Z B inside d 1d 2 around ( 1, 2) at a certain instant of time t given that they were (v1, v2) at an earlier time t−τ. The analogous expression for the reverse transition v ′ v ′ v v ′ ρ1(x1)ρ1(x2) ′ ′ ( 1, 2) → ( 1, 2) is ×w12(x |x12) ln ′ ′ dx1dx2dx dx . (27) 12 1 2 ′ ′ ′ ′ ′ ′ ρ1(x1)ρ1(x2) v v v v v v v v v v {w( 1, 2 | 1, 2)d 1d 2 τ} ρ2( 1, 2)d 1d 2. (31) Recalling that If the gas is in a state of equilibrium, expression (30) should be equal to (31), that is, dS = Π, (28) v ′ v ′ v v v v v v v ′ v ′ v ′ v ′ dt w( 1, 2 | 1, 2)ρ2( 1, 2)= w( 1, 2 | 1, 2)ρ2( 1, 2). (32) we see that the right-hand side of equation (27) is iden- This is the well known detailed balance condition, or mi- tical to the Boltzmann expression for −dH/dt. Taking croscopic reversibility, which is the condition of reversibil- into account that Π ≥ 0, we conclude that dS/dt ≥ 0, or ity of stochastic processes and identified as the condition that dH/dt ≤ 0, which is the Boltzmann H-theorem. for thermodynamic equilibrium [23]. 5

The transition rate considered by Maxwell corresponds Like Maxwell, Boltzmann assumes that the probabil- to the collision of two molecules. Assuming that the ki- ity transition rate is nonzero when the kinetic energy, netic energy before the collision equals that after the col- expressed by (33) is conserved, and that it is equal to its v ′ v ′ v v lision, it follows that the transition rate w( 1, 2 | 1, 2) reverse, as given by equation (34), in which case the time will be nonzero only when the conservation of energy is evolution equation for ρ1(v,t) becomes fulﬁlled, that is, ∂ v v v v ′ v ′ ′ 2 ′ 2 2 2 ρ1( 1)= w( 1, 2 | 1, 2)× m1v1 + m2v2 = m1v1 + m2v2, (33) ∂t Z where m and m are the masses of molecules A and B, ′ ′ ′ ′ 1 2 ×{ρ (v , v ) − ρ (v , v )}dv dv dv . (39) respectively. At this point Maxwell assumes the transi- 2 1 2 2 1 2 2 1 2 tion rate and its reverse to be equal, Assuming that v1 and v2 are statistically independent, equation (39) becomes the Boltzmann kinetic equation v ′ v ′ v v v v v ′ v ′ w( 1, 2 | 1, 2)= w( 1, 2 | 1, 2). (34) [25]

This result together with the equality (32) allows us to ∂ ′ ′ ρ1(v1)= w(v1, v2 | v , v )× write ∂t Z 1 2 ′ ′ ρ (v , v )= ρ (v , v ). (35) 2 1 2 2 1 2 v ′ v ′ v v v v ′ v ′ ×{ρ1( 1)ρ1( 2) − ρ1( 1)ρ1( 2)}d 2d 1d 2. (40) Assuming that the velocities of two molecules are statistically independent, it follows that It should be remarked that in equilibrium the integrand vanishes and the Maxwell condition (35) is recovered. v v v ′ v ′ ρ1( 1)ρ1( 2)= ρ1( 1)ρ1( 2), (36) The reasonings employed above will also lead us to the full master equation After taking the logarithm of both sides of equation (36), ∂ρ 1 ′ ′ ′ ′ = w(vi, vj | v , v )× ln ρ (v ) + ln ρ (v ) = ln ρ (v ) + ln ρ (v ), (37) ∂t n Z i j 1 1 1 2 1 1 1 2 Ximomentum in a collision of two molecules, that is, inside dv1 around v1 at time t which change to velocities inside dv around v at t + τ. This contribution ′ ′ 2 2 m1v + m2v = m1v1 + m2v2. (42) is equal to expression (30), with the understanding that 1 2 ρ2(v1, v2,t) now depends on time. The positive contribu- From equation (33) and (42) one obtains tion comes from the reverse situation and is equal to ex- v ′ v ′ v v pression (31). By subtracting expressions (31) and (30), | 1 − 2| = | 1 − 2|. (43) ′ ′ v v v ′ and integrating over all possible velocities 2, 1 and 2, Let us deﬁne the velocities u and u of the center of v v 12 12 one obtains the diﬀerence ρ1( 1,t + τ) − ρ1( 1,t). After mass before and after collision by dividing by τ and taking the limit τ → 0, the following u v v u′ v′ v′ equation is obtained 12 = r2 1 + r1 2, 12 = r2 1 + r1 2, (44)

∂ v v v v ′ v ′ v ′ v ′ where r1 = m2/(m1 + m2) and r2 = m1/(m1 + m2), and ρ1( 1)= {w( 1, 2 | 1, 2)ρ2( 1, 2) v v′ ∂t Z the relative velocities 12 and 12 before and after the collision by v ′ v ′ v v v v v v ′ v ′ v v v v′ v′ v′ −w( 1, 2 | 1, 2)ρ2( 1, 2)}d 2d 1d 2. (38) 12 = 1 − 2, 12 = 1 − 2. (45) 6

The two conservation laws (42) and (43) are equivalent be equally probable. For other types of collision, such to as that between soft spheres, one expects a small angle to be more probable. That is, we expect the deviation u′ u 12 = 12, (46) ∆v12 = v12e − v12 to be small, in general, and we may ′ expand the integrand of (50) in powers of the deviation. and v12 = v12, respectively. This last relation can be Up to second order, the expansion reads written in the form v′ e v D 1 v D 2 e e 12 = v12 , (47) a ∆ 12 · 12ρ + (∆ 12 · 12) ρ P( )d , (54) Z v12 where e is a unit vector parameter. Denoting by α the where angle between e and the unit vector v12, we may write ∂ρ e z D = cos α + θ sin α cos β + φ sin α sin β, (48) 12ρ = v12 v , (55) ∂ 12 v12 where the unit vectors θ and φ together with z = v /v 12 12 and the derivations are performed in such a way that v form a spherical orthogonal basis. 12 is kept constant, or, in an equivalent form, Regarding the vector e as a random unit vector with a given probability P(e)de = P(α, β)dαdβ, the rate of the ′ ′ D ∂ρ ∂ρ transition (v1, v2) → (v , v ) is 12ρ = v12 −r1 + r2 , (56) 1 2 v1 v ∂ ∂ 2 v12,u12 ′ ′ ′ ′ w(v , v |v1, v2)= av12 δ(u −u12)δ(v −v12e)P(e)de. and the derivations are performed with v and u kept 1 2 Z 12 12 12 12 (49) constant. Taking into account that v12 is orthogonal to D12ρ it To fulﬁll the condition that the transition rate is equal v D e D to its reverse, given by (34), P(e) is chosen to be inde- follows that ∆ 12 · 12ρ = v12 · 12ρ and expression pendent of the azimuthal angle β. (54) becomes Following Maxwell [24], we are choosing the pre-factor 1 as proportional to v . The factor a is a constant having av e · D ρ + (e · D )2ρ P(e)de. (57) 12 12 12 2 12 the unit of frequency that sets the scale of time. Replac- Z ing expression (49) in the right-hand side of (40), this Using the property that P(e) does not depend on the term becomes azimuthal angle β and that D12ρ is orthogonal to z, the ﬁrst integral vanishes and we are left with av12 {ρ2(v1 + r1(v12e − v12), v2 − r2(v12e − v12)) Z 1 2 av12 (e · D12) ρ P(e)de. (58) 2 Z −ρ2(v1, v2)}P(e)de. (50) Let us write D12 in spherical coordinates The full master equation is ∂ρ φ ∂ρ D12ρ = θ + , (59) ∂ρ a ′ ′ ∂θ sin θ ∂φ = vij {ρ(v , v )−ρ(vi, vj )}P(eij)deij , (51) ∂t n Z i j Xi

v ′ v e v where j = j − r2(vij ij − ij ), (53) 2 and we have omitted, on the left-hand side, the depen- b = (sin α cos β) P(α)dαdβ. (61) Z dence of ρ on all variables vk and, on the right-hand side, v 2 the dependence of ρ on the variables k, k 6= i and k 6= j. The explicit form of D12ρ is 1 ∂ ∂ρ 1 ∂2ρ D2 ρ = sin θ + . (62) D. Diﬀerential form 12 sin θ ∂θ ∂θ sin2 θ ∂φ2

The angle between the relative velocity of two The master equation (41) acquires the differential form molecules before the collision, v12, and after the col- v′ e ∂ρ ba 2 lision, 12 = v12 is understood as the deflection an- = v D ρ, (63) ∂t 2n ij ij gle. For hard spheres the deflection angle is expected to Xi

S = −kB ρ ln ρ dv, (64) In this case, the transition rate is given by Z ′ ′ ∂H ′ ∂H where dv = dv ...dv one finds w(x |x)τ = δ(q − q − τ) δ(p − p + τ), (70) 1 n ∂p ∂q dS ∂ρ = −kB ln ρ dv. (65) which replaced in the right-hand side of equation (3) gives dt Z ∂t 1 ∂H ∂H {ρ(q,p) − ρ(q + τ,p − τ)}. (71) After substituting (63) in (65) and performing an inte- τ ∂p ∂q gration by parts, one reaches the result for the rate of entropy production Taking the limit τ → 0, we reach the result ∂ρ ∂ρ ∂H ∂ρ ∂H ba vij 2 = − · − · , (72) Π= nkB (D12ρ) dv, (66) 2 Z ρ ∂t ∂q ∂p ∂p ∂q which, clearly, is a nonnegative quantity. which is the Liouville equation (68). The time derivative of the entropy S, given by (9), vanishes identically and we conclude that S is constant IV. LIOUVILLE EQUATION in time. To see this, it suffices to replace the Liouville equation in the expression for dS/dt and perform an integration by parts. Considering that the Liouville equation A. Transition rate is understood as describing an isolated system, this result does not envisage the increase in entropy as required The Liouville equation gives the evolution of the prob- by thermodynamics of isolated systems. In contrast, the ability density ρ(x, t) in phase space of a system that master equation that we have set up for isolated systems evolves in time in a deterministic way. Let us consider a can predict an increase in entropy. system with n degrees of freedom described by a Hamil- tonian H(x), defined in the phase space x = (q,p), where q and p denote vectors with components qi pi, respec- B. Jeans equation tively. The evolution of a point in phase space is given by Let us consider an approximation to the Liouville equa- dq ∂H dp ∂H tion similar to that we have employed when we consid- = , = − , (67) ered the variables corresponding to two particles as sta- dt ∂p dt ∂q tistically independent. To this end, we start by writing where the partial derivatives denote vectors with compo- down the evolution equation for the one particle probability density ρ1(x1). Considering a Hamiltonian of the nents ∂H/∂qi and ∂H/∂pi. The Liouville equation is type ∂ρ = {H,ρ}, (68) p2 ∂t H = i + H (q , q ), (73) 2m ij i j Xi X(ij) where {A, B} are the Poisson brackets. Usually, the Liouville equation is introduced by the and integrating the Liouville equation over all variables use of the Liouville theorem according to which the vol- except x1, we find ume of a certain region in phase space is preserved under the Hamiltonian dynamics (67). If x represents the sys- ∂f1 ∂f1 p1 ∂f12 ∂H12 ′ ′ = − + dq2dp2. (74) tem at time t and x at time t , the Liouville theorem ∂t ∂q1 m Z ∂p1 ∂q1 is expressed by dx = dx′. In addition, one postulates where f1 = nρ1 and f12 = n(n − 1)ρ12, and n is the that the probability of two regions that are mapped onto number of degrees of freedom. each other by the Hamiltonian dynamics are equal, that ′ ′ ′ Assuming that the variables x1 and x2 are statis- is, ρ(x, t)dx = ρ(x ,t )dx . This postulate together with tically independent, that is, using the approximation Liouville theorem gives ρ(x, t)= ρ(x′,t′), from which fol- ρ2(x1, x2) = ρ1(x1)ρ1(x2), which yields f2(x1, x2) = lows the Liouville equation (68). f (x )f (x ) for large n, we get Here, instead, we derive the Liouville equation from 1 1 1 2 equation (3) by the use of a transition rate w(x′|x) which ∂f ∂f p ∂f ∂ψ 1 = − 1 1 + 1 1 , (75) is nonzero only when x = (q,p) evolves to a single state ∂t ∂q1 m ∂p1 ∂q1 8 where producing no entropy, and what types should be in the Boltzmann part, giving rise to entropy production in a ψ1 = f1(q2,p2)H12dq2dp2. (76) nonequilibrium regime. A possible answer is to be found Z in the Lyapunov exponent, which says whether the tra- Equation (75) was proposed by Jeans [38, 39] in the con- jectories determined by a force will diverge exponentially or not when they originate from nearby states. If they text of stellar dynamics in which case the Hij is the gravitational potential between particles i and j. It is diverge, as happens to the collision of hard spheres, in also known as the collisionless Boltzmann equation and which case the Lyapunov exponent is positive, this type sometimes the Vlasov equation [40]. of force should be included in the Boltzmann part; oth- To determine the production of entropy predicted by erwise, in the Liouville part. Jeans equation, we may use the Boltzmann entropy The stochastic character of the dynamics is embodied in P (ξ), introduced as an a priori probability distribution, from which one obtains the transition rate. In the S = −kB f1 ln f1dq1dp1, (77) Z case of the Boltzmann equation (40), this probability distribution, called P(e) = P(α, β), is identified as being which comes from equation (9) by assuming the same proportional to the collision differential cross section be- approximation that we have used to derive the Jeans tween two colliding molecules, and the polar angle α is equation. Again, the time derivative of the entropy S identified as the deflection angle. related to the Jeans equation vanishes identically and S We have also shown that the Boltzmann equation can is constant in time. To see this, it suffices to replace the be reduced to a differential form, in which case it can Jeans equation in the expression for dS/dt and perform be understood as an equation of the Fokker-Planck type. an integration by parts. Therefore, not only the Liou- This reduction is obtained when the deviation between ville equation but also the approximate Jeans equation relative velocities of two molecules before and after a col- predicts an invariance of entropy in time. lision is small. The magnitude of this deviation is given by the scattering angle α, which should then be small. The differential operator D changes the velocities of two V. CONCLUSION ij molecules but preserves the sum of their kinetic energies and the sum of their momenta. Therefore, the total ki- We have interpreted the dynamics of the kinetic theory netic energy and the total momentum of the molecules of gases of Maxwell and Boltzmann as a stochastic dy- is preserved by the differential form of the Boltzmann namics. Accordingly, a trajectory emerging from a given equation. point of the phase space is not unique, as happens with The aim of the kinetic theory of the nineteenth cen- a deterministic dynamics obeying the laws of classical tury was the derivation of the macroscopic properties of motion, but may be split into several trajectories, each gases from the microscopic laws that govern the motion one with a given probability of occurrence. When the of molecules. It was tacitly understood that the deriva- dynamics is deterministic, it leads to the Liouville equation should be founded on the use of deterministic laws tion, which gives no generation of entropy. On the other of mechanics, only, that is, a purely mechanical deriva- hand, if the dynamics is stochastic, as with the Boltz- tion. However, this aim was not fully accomplished. The mann equation, there is a production of entropy. Con- purely mechanical derivation was replaced by a deriva- sidering that, according to thermodynamics, the entropy tion containing, sometimes implicitly, probabilistic and increases in isolated systems, the appropriate description stochastic reasonings. The crucial step in our stochastic of these systems could be given by an equation which is a approach was the introduction of the a priori probability combination of the right hand-side of Liouville equation distribution P(ξ) of the variable ξ which describes the (68) and the right-hand side of the Boltzmann kinetic stochastic motion. If this probability distribution could equation (18), be provided by the laws of mechanics, that is, from pure mechanics, then the original aim of kinetic theory would ∂ρ ′ ′ ′ = {H,ρ} + w(x|x ){ρ(x ) − ρ(x)}dx . (78) be fully accomplished. ∂t Z The reasonings of Maxwell and Boltzmann tacitly em- The irreversible character of the second law of thermo- ployed two important assumptions related to irreversibil- dynamics, expressed by the increase of entropy of isolated ity that were later made explicit by Boltzmann himself, systems dS/dt ≥ 0, comes from the Boltzmann part of by Jeans, and by the Ehrenfests. One of them was the equation (78). Indeed, the production of entropy Π asso- assumption of statistical independence between the dy- ciated with the evolution of ρ given by equation (78) is namic variables of one molecule and those of another expressed by equation (19), which is nonnegative imply- molecule. We employed this assumption, which is in fact ing dS/dt = Π ≥ 0. This is equivalent to the Boltzmann an approximation, to get the Boltzmann equation (40) H-theorem. from (39), or from the full master equation (41), and to It is worth asking what types of interacting forces get the Jeans equation (76) from the Liouville equation should be included in the Liouville part of equation (78), (68). The Ehrenfests [41] called this assumption the hy- 9 pothesis of molecular disorder (molekularen Unordnung), source of irreversibility and entropy production. This but this cannot be seen as the source of irreversibility and assumption allows us to write the rate in terms of the ve- production of entropy. When this assumption is applied locities only, and it gives the property (34). This crucial to the Liouville equation, the resulting Jeans equation assumption was called the collision number hypothesis produces no entropy. (Stosszahlansatz) by the Ehrenfests [41]. The second assumption concerns the transition rate. Boltzmann [28] stated that the two assumptions above The frequency of collisions of two molecules which were consequences of the state of the gas being molecu- changes their velocities is assumed to be independent of larly disordered (molekular Ungeordnet) [28]. Jeans [30] the position of the molecules. In addition, the frequency distinguished the two assumptions but considered them of collisions is the same if the velocities of the molecules as consequences of the assumption of molecular chaos, are interchanged. This assumption introduces probabilis- and the Ehrenfests [41] not only distinguished the two tic and stochastic elements into the approach and is the assumptions but called them by different names.

[1] T. Tomé, Braz. J. Phys. 36, 1285 (2006). [24] J. C. Maxwell, Philosophical Transactions of the Royal [2] R. K. P. Zia and B Schmittmann, J. Phys. A: Math. Gen. Society of london 157, 49 (1867). 39, L407 (2006). [25] L. Boltzmann, Sitzungsberichte der Kaiserlichen [3] T. Schmiedl and U. Seifert, J. Chem. Phys. 126, 044101 Akademie der Wissenchaften 66, 275 (1872). (2007). [26] H. W. Watson, A Treatise on the Kinetic Theory of Gases [4] R. K. P. Zia and B. Schmittmann, J. Stat. Mech. P07012 (Clarendon Press, Oxford, 1876). (2007). [27] O. E. Meyer, Die kinetische Theorie der Gase (Mar- [5] U. Seifert, Eur. Phys. J. B 64, 423 (2008). uschke und Berendt, Breslau, 1877). [6] R. A. Blythe, Phys. Rev. Lett. 100, 1010060 (2008). [28] L. Boltzmann, Vorlesungen über Gastheorie (Barth, [7] M. Esposito, K. Lindenberg, and C. Van den Broeck, Leipzig, 1896-1898); 2 vols. Phys. Rev. Lett. 102, 130602 (2009). [29] S. H. Burbury, A Treatise on the Kinetic Theory of Gases [8] T. Toméand M. J. de Oliveira, Phys. Rev. E 82, 021120 (Cambridge University Press, Cambridge, 1899). (2010). [30] J. H. Jeans, The Dynamical Theory of Gases (Cambridge [9] C. Van de Broeck and M. Esposito, Phys. Rev. E 82, Universiyt Press, Cambridge, 1904). 011144 (2010). [31] P. und T. Ehrenfest, Physikalische Zeitschrift 8, 311 [10] T. Toméand M. J. de Oliveira, Phys. Rev. Lett. 108, (1907). 020601 (2012). [32] K. Huang, Statistical Mechanics (Wiley, New York, [11] R. E. Spinney and I. J. Ford, Phys. Rev. E 85, 051113 1963). (2012). [33] Y. B. Rumer and M. S. Ryvkin, Thermodynamics, Sta- [12] M. Esposito, Phys. Rev. E 85, 041125 (2012). tistical Physics and Kinetics (Mir, Moscow, 1980). [13] F. Zhang, L. Xu, K. Zhang, E. Wang and J. Wang, J. [34] L. E. Reichl, A Modern Course in Statistical Mechanics Chem. Phys. 137, 065102(2012). (University of Texas Press, Austin, 1980). [14] U. Seifert, Rep. Prog. Phys. 75, 126001 (2012). [35] C. Cercignani, The Boltzmann Equation and its Applica- [15] H. Ge, M. Qian and H. Qian, Phys. Rep. 510, 87 (2012). tions (Springer, New York, 1988). [16] M. Santillan and H. Qian, Physica A 392, 123 (2013). [36] G. M. Kremer, An Introduction to the Boltzmann Equa- [17] D. Luposchainsky and H. Hinrichsen, J. Stat. Phys. 153, tion and Transport Processes in Gases (Springer, Berlin, 828 (2013). 2010). [18] W. Wu and J. Wang, J. Chem. Phys. 141, 105104 (2014). [37] J. C. Maxwell, Philosophical Magazine 19, 19; 20, 21 [19] T. Toméand M. J. de Oliveira, Phys. Rev. E 91, 042140 (1860). (2015). [38] J. H. Jeans, MNRAS 76, 70 (1915). [20] T. Toméand M. J. de Oliveira, J. Chem. Phys. 148, [39] J. H. Jeans, Problems of Cosmogony and Stellar Dynam- 224104 (2018). ics (Cambridge University Press, Cambridge, 1919). [21] N. G. van Kampen, Stochastic Processes in Physics and [40] M. Hénon, Astron. Astrophys. 114, 211 (1982). Chemistry (North-Holland, Amsterdam, 1981). [41] P. und T. Ehrenfest, ”Begriffliche Grundlagen der [22] W. Ebeling and I. M. Sokolov, Statistical Thermody- statistischen Auffassungen in der Mechanik”, Encyk- namics and Stochastic Theory of Nonequilibrium Systems lopädie der mathematischen Wissenschaften, 4-4 (Teub- (World Scientific, New Jersey, 2005). ner, Leipzig, 1907-1914); Art. 32. [23] T. Toméand M. J. de Oliveira, Stochastic Dynamics and Irreversibility (Springer, Cham, 2015).