DOCSLIB.ORG

A Maximum Entropy Framework for Nonexponential Distributions

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
A Maximum Entropy Framework for Nonexponential Distributions A maximum entropy framework for nonexponential distributions Jack Petersona,b, Purushottam D. Dixitc, and Ken A. Dillb,1 aDepartment of Mathematics, Oregon State University, Corvallis, OR 97331; bLaufer Center for Physical and Quantitative Biology, Departments of Physics and Chemistry, State University of New York, Stony Brook, NY 11794; and cDepartment of Systems Biology, Columbia University, New York, NY 10032 Contributed by Ken A. Dill, November 7, 2013 (sent for review June 26, 2013) P Probability distributions having power-law tails are observed in functional S½fpkg = − kpklog pk subject to constraints, such as a broad range of social, economic, and biological systems. We the known value of the average energy hEi. This procedure gives −βE describe here a potentially useful common framework. We derive the exponential (Boltzmann) distribution, pk ∝ e k ,whereβ distribution functions {pk} for situations in which a “joiner particle” is the Lagrange multiplier that enforces the constraint. This var- k pays some form of price to enter a community of size k − 1, where iational principle has been the subject of various historical justifi- costs are subject to economies of scale. Maximizing the Boltzmann– cations. It is now commonly understood as the approach that Gibbs–Shannon entropy subject to this energy-like constraint chooses the least-biased model that is consistent with the known predicts a distribution having a power-law tail; it reduces to the constraint(s) (39). Boltzmann distribution in the absence of economies of scale. We Is there an equally compelling principle that would select fat- show that the predicted function gives excellent fits to 13 different tailed distributions, given limited information? There is a large distribution functions, ranging from friendship links in social net- literature that explores this. Inferring nonexponential distribu- works, to protein–protein interactions, to the severity of terrorist tions can be done by maximizing a different mathematical form attacks. This approach may give useful insights into when to expect of entropy, rather than the BGS form. Examples of these non- power-law distributions in the natural and social sciences. traditional entropies include those of Tsallis (40), Renyi (41), and othersP (42, 43). For example, the Tsallis entropy is defined heavy tail | fat tail | statistical mechanics | thermostatistics | social physics K pq − K q as 1 − q ð k k 1Þ, where is a constant and is a parameter for the problem at hand. Such methods otherwise follow the same robability distributions are often observed to have power-law strategy as above: maximizing the chosen form of entropy subject Ptails, particularly in social, economic, and biological systems. fl fi to an extensive energy constraint gives nonexponential distribu- Examples include distributions of uctuations in nancial mar- tions. The Tsallis entropy has been applied widely (44–53). kets (1), the populations of cities (2), the distribution of Web site However, we adopt an alternative way to infer nonexponential links (3), and others (4, 5). Such distributions have generated much distributions. To contrast our approach, we first switch from proba- popular interest (6, 7) because of their association with rare but bilities to their logarithms. Logarithms of probabilities can be consequential events, such as stock market bubbles and crashes. parsed into energy-like and entropy-like components, as is stan- If sufficient data are available, finding the mathematical shape of fi dard in statistical physics. Said differently, a nonexponential dis- a distribution function can be as simple as curve- tting, with a fol- tribution that is derived from a Max Ent principle requires that low-up determination of the significance of the mathematical form fi there be nonextensivity in either an energy-like or entropy-like used to t it. However, it is often interesting to know if the shape of term; that is, it is nonadditive over independent subsystems, not a given distribution function can be explained by an underlying scaling linearly with system size. Tsallis and others have chosen to generative principle. Principles underlying power-law distributions assign the nonextensivity to an entropy term, and retain exten- have been sought in various types of models. For example, the sivity in an energy term. Here, instead, we keep the canonical power-law distributions of node connectivities in social networks BGS form of entropy, and invoke a nonextensive energy-like term. have been derived from dynamical network evolution models (8– 17). A large and popular class of such models is based on the fi preferential attachment rule (18–27), wherein it is assumed that Signi cance new nodes attach preferentially to the largest of the existing nodes. Explanations for power laws are also given by Ising models in Many statistical distributions, particularly among social and bi- “ ” critical phenomena (28–34), network models with thresholded ological systems, have heavy tails, which are situations where “fitness” values (35), and random-energy models of hydrophobic rare events are not as improbable as would have been guessed contacts in protein interaction networks (36). from more traditional statistics. Heavy-tailed distributions are “ ” However, such approaches are often based on particular the basis for the phrase the rich get richer. Here, we propose mechanisms or processes; they often predict particular power-law a basic principle underlying systems with heavy-tailed dis- exponents, for example. Our interest here is in finding a broader tributions. We show that it is the same principle (maximum vantage point, as well as a common language, for describing a entropy) used in statistical physics and statistics to estimate range of distributions, from power law to exponential. For de- probabilistic models from relatively few constraints. The heavy- riving exponential distributions, a well-known general principle is tail principle can be expressed in terms of shared costs and the method of maximum entropy (Max Ent) in statistical physics economies of scale. The probability distribution we derive is (37, 38). In such problems, you want to choose the best possible a mathematical digamma function, and we show that it accu- rately fits 13 real-world data sets. distribution from all candidate distributions that are consistent with certain set of constrained moments, such as the average en- Author contributions: J.P. and K.A.D. designed research; J.P. and P.D.D. performed research; ergy. For this type of problem, which is highly underdetermined, J.P. and K.A.D. contributed new reagents/analytic tools; J.P. analyzed data; and J.P., P.D.D., a principle is needed for selecting a “best” mathematical function and K.A.D. wrote the paper. from among alternative model distribution functions. To find the The authors declare no conflict of interest. mathematical form of the distribution function pk over states 1To whom correspondence should be addressed. E-mail: [email protected]. k = ; ; ; ... 1 2 3 , the Max Ent principle asserts that you should This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10. maximize the Boltzmann–Gibbs–Shannon (BGS) entropy 1073/pnas.1320578110/-/DCSupplemental. 20380–20385 | PNAS | December 17, 2013 | vol. 110 | no. 51 www.pnas.org/cgi/doi/10.1073/pnas.1320578110 Downloaded by guest on September 25, 2021 − μ Fig. 1. The joining cost for a particle to join a size k 1 community is k . This diagram can describe particles forming colloidal clusters, or social processes such as people joining cities, citations added to papers, or link creation in a social network. In our view, only the latter approach is consistent with the principles Communal Assemblies and Economies of Scale. Now, we develop a elucidated by Shore and Johnson (37) (reviewed in ref. 39). Shore general model of communal assembly based on economies of scale. and Johnson (37) showed that the BGS form of entropy is uniquely Consider a situation where the joining cost for a particle depends the mathematical function that ensures satisfaction of the addition on the size of the community it joins. In particular, consider and multiplication rules of probability. Shore and Johnson (37) as- situations in which the costs are lower for joining a larger sert that any form of entropy other than BGS will impart a bias that community. Said differently, the cost-minus-benefit function is unwarranted by the data it aims to fit. We regard the Shore and μk is now allowed to be subject to economies of scale, which, as Johnson (37) argument as a compelling first-principles basis for we note below, can also be interpreted instead as a form of defining a proper variational principle for modeling distribution discount in which the community pays down some of the joining functions. Here, we describe a variational approach based on the costs for the joiner particle. BGS entropy function, and we seek an explanation for power-law To see the idea of economy-of-scale cost function, imagine distributions in the form of an energy-like function instead. building a network of telephones. In this case, a community of size 1 is a single unconnected phone. A community of size 2 is Theory two connected phones, etc. Consider the first phone: The cost of Assembly of Simple Colloidal Particles. We frame our discussion in creating the first phone is high because it requires initial in- terms of a joiner particle that enters a cluster or community of vestment in the phone assembly plant. And the benefit is low, particles, as shown in Fig. 1. However, this is a natural way to because there is no value in having a single phone. Now, for the APPLIED describe the classical problem of the colloidal clustering of second phone, the cost-minus-benefit is lower. The cost of pro- MATHEMATICS physical particles; it is readily shown (reviewed below) to give an ducing the second phone is lower than the first because the exponential distribution of cluster sizes.
Load more

Recommended publications
  • Conceptual Inadequacy of the Shore and Johnson Axioms for Wide Classes of Complex Systems
    Entropy 2015, 17, 2853-2861; doi:10.3390/e17052853 OPEN ACCESS entropy ISSN 1099-4300 www.mdpi.com/journal/entropy Article Conceptual Inadequacy of the Shore and Johnson Axioms for Wide Classes of Complex Systems Constantino Tsallis 1;2 1 Centro Brasileiro de Pesquisas Físicas and National Institute of Science and Technology for Complex Systems, Rua Xavier Sigaud 150, 22290-180, Rio de Janeiro - RJ, Brazil; E-Mail: [email protected] 2 Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, New Mexico 87501, NM, USA Academic Editor: Antonio M. Scarfone Received: 9 April 2015 / Accepted: 4 May 2015 / Published: 5 May 2015 Abstract: It is by now well known that the Boltzmann-Gibbs-von Neumann-Shannon logarithmic entropic functional (SBG) is inadequate for wide classes of strongly correlated systems: see for instance the 2001 Brukner and Zeilinger’s Conceptual inadequacy of the Shannon information in quantum measurements, among many other systems exhibiting various forms of complexity. On the other hand, the Shannon and Khinchin axioms uniquely P mandate the BG form SBG = −k i pi ln pi; the Shore and Johnson axioms follow the same path. Many natural, artificial and social systems have been satisfactorily approached P q 1− i pi with nonadditive entropies such as the Sq = k q−1 one (q 2 R; S1 = SBG), basis of nonextensive statistical mechanics. Consistently, the Shannon 1948 and Khinchine 1953 uniqueness theorems have already been generalized in the literature, by Santos 1997 and Abe 2000 respectively, in order to uniquely mandate Sq. We argue here that the same remains to be done with the Shore and Johnson 1980 axioms.
    [Show full text]
  • Nanothermodynamics – a Generic Approach to Material Properties at Nanoscale
    Nanothermodynamics – A generic approach to material properties at nanoscale A. K. Rajagopal (1) , C. S. Pande (1) , and Sumiyoshi Abe (2) (1) Naval Research Laboratory, Washington D.C., 20375, USA (2) Institute of Physics, University of Tsukuba, Ibaraki 305-8571, Japan ABSTRACT Granular and nanoscale materials containing a relatively small number of constituents have been studied to discover how their properties differ from their macroscopic counterparts. These studies are designed to test how far the known macroscopic approaches such as thermodynamics may be applicable in these cases. A brief review of the recent literature on these topics is given as a motivation to introduce a generic approach called “Nanothermodynamics”. An important feature that must be incorporated into the theory is the non-additive property because of the importance of ‘surface’ contributions to the Physics of these systems. This is achieved by incorporating fluctuations into the theory right from the start. There are currently two approaches to incorporate this property: Hill (and further elaborated more recently with Chamberlin) initiated an approach by modifying the thermodynamic relations by taking into account the surface effects; the other generalizes Boltzmann-Gibbs statistical mechanics by relaxing the additivity properties of thermodynamic quantities to include nonextensive features of such systems. An outline of this generalization of the macroscopic thermodynamics to nano-systems will be given here. Invited presentation at the Indo-US Workshop on “Nanoscale
    [Show full text]
  • [Cond-Mat.Stat-Mech] 3 Sep 2004 H Ee Om Esalte S Tt E H Specific the Get to It Use Then and Shall Tsallis We for Simple Temperature Form
    Generalized Entropies and Statistical Mechanics Fariel Shafee Department of Physics Princeton University Princeton, NJ 08540 USA.∗ We consider the problem of defining free energy and other thermodynamic functions when the entropy is given as a general function of the probability distribution, including that for nonextensive forms. We find that the free energy, which is central to the determination of all other quantities, can be obtained uniquely numerically even when it is the root of a transcendental equation. In particular we study the cases of the Tsallis form and a new form proposed by us recently. We compare the free energy, the internal energy and the specific heat of a simple system of two energy states for each of these forms. PACS numbers: 05.70.-a, 05.90 +m, 89.90.+n Keywords: entropy, nonextensive, probability distribution function, free energy, specific heat I. INTRODUCTION heat in both cases and see how it changes with the change of the parameter at different temperatures. We have recently [1] proposed a new form of nonex- tensive entropy which depends on a parameter similar II. ENTROPY AND PDF to Tsallis entropy [2, 3, 4], and in a similar limit ap- proaches Shannon’s classical extensive entropy. We have shown how the definition for this new form of entropy can The pdf is found by optimizing the function arise naturally in terms of mixing of states in a phase cell when the cell is re-scaled, the parameter being a measure L = S + α(1 − pi)+ β(U − piEi) (1) of the rescaling, and how Shannon’s coding theorem [5] Xi Xi elucidates such an approach.
    [Show full text]
  • Finite Size Analysis of a Two-Dimensional Ising Model Within
    Finite size analysis of a two-dimensional Ising model within a nonextensive approach N. Crokidakis,1, ∗ D.O. Soares-Pinto,2, † M.S. Reis,3 A.M. Souza,4 R.S. Sarthour,2 and I.S. Oliveira2 1Instituto de F´ısica - Universidade Federal Fluminense, Av. Litorˆanea s/n, 24210-340 Niter´oi - RJ, Brazil. 2Centro Brasileiro de Pesquisas F´ısicas, Rua Dr. Xavier Sigaud 150, Urca, 22290-180 Rio de Janeiro - RJ, Brazil. 3CICECO, Universidade de Aveiro, 3810-193 Aveiro, Portugal. 4Institute for Quantum Computing and Department of Physics and Astronomy, University of Waterloo, Waterloo, Ontario, N2L 3G1, Canada. (Dated: June 26, 2018) In this work we present a thorough analysis of the phase transitions that occur in a ferromagnetic 2D Ising model, with only nearest-neighbors interactions, in the framework of the Tsallis nonextensive statistics. We performed Monte Carlo simulations on square lattices with linear sizes L ranging from 32 up to 512. The statistical weight of the Metropolis algorithm was changed according to the nonextensive statistics. Discontinuities in the m(T) curve are observed for q ≤ 0.5. However, we have verified only one peak on the energy histograms at the critical temperatures, indicating the occurrence of continuous phase transitions. For the 0.5 < q ≤ 1.0 regime, we have found continuous phase transitions between the ordered and the disordered phases, and determined the critical exponents via finite-size scaling. We verified that the critical exponents α, β and γ depend 2 on the entropic index q in the range 0.5 < q ≤ 1.0 in the form α(q) = (10 q − 33 q + 23)/20, β(q) = (2 q − 1)/8 and γ(q)=(q2 − q + 7)/4.
    [Show full text]
  • The Role of Entropy in the Development of Economics
    entropy Article The Role of Entropy in the Development of Economics Aleksander Jakimowicz Department of World Economy, Institute of Economics, Polish Academy of Sciences, Palace of Culture and Science, 1 Defilad Sq., 00-901 Warsaw, Poland; [email protected] Received: 25 February 2020; Accepted: 13 April 2020; Published: 16 April 2020 Abstract: The aim of this paper is to examine the role of thermodynamics, and in particular, entropy, for the development of economics within the last 150 years. The use of entropy has not only led to a significant increase in economic knowledge, but also to the emergence of such scientific disciplines as econophysics, complexity economics and quantum economics. Nowadays, an interesting phenomenon can be observed; namely, that rapid progress in economics is being made outside the mainstream. The first significant achievement was the emergence of entropy economics in the early 1970s, which introduced the second law of thermodynamics to considerations regarding production processes. In this way, not only was ecological economics born but also an entropy-based econometric approach developed. This paper shows that non-extensive cross-entropy econometrics is a valuable complement to traditional econometrics as it explains phenomena based on power-law probability distribution and enables econometric model estimation for non-ergodic ill-behaved (troublesome) inverse problems. Furthermore, the entropy economics has accelerated the emergence of modern econophysics and complexity economics. These new directions of research have led to many interesting discoveries that usually contradict the claims of conventional economics. Econophysics has questioned the efficient market hypothesis, while complexity economics has shown that markets and economies function best near the edge of chaos.
    [Show full text]
  • Extensive Statistical Mechanics Based on Nonadditive Entropy: Canonical
    Extensive statistical mechanics based on nonadditive entropy: Canonical ensemble A.S. Parvan Bogoliubov Laboratory of Theoretical Physics, Joint Institute for Nuclear Research, 141980 Dubna, Russia and Institute of Applied Physics, Moldova Academy of Sciences, MD-2028 Kishineu, Republic of Moldova The original canonical ensemble formalism for the nonextensive entropy thermostatistics is re- considered. It is shown that the unambiguous connection of the statistical mechanics with the equilibrium thermodynamics is provided if the entropic parameter 1/(q − 1) is an extensive variable of the state. Based on a particular example of the perfect gas, it is proved that the Tsallis thermo- statistics meets all the requirements of equilibrium thermodynamics in the thermodynamic limit. In particular, the entropy of the system is extensive and the temperature is intensive. However, for finite systems both the Tsallis and Boltzmann-Gibbs entropies are nonextensive. The equivalence of the canonical and microcanonical ensembles of Tsallis thermostatistics in the thermodynamic limit is established. The issue associated with physical interpretation of the entropic variable is discussed in detail. PACS numbers: 24.60. Ky, 25.70. Pq; 05.70.Jk I. INTRODUCTION The main purpose of this Letter is to establish a clear way to implement the equilibrium statistical mechanics based on the nonadditive entropy deferent from the usual Boltzmann-Gibbs statistical one. For the first time this concept was formulated by Tsallis in [1]. It is very well known that the conventional equilibrium statistical mechanics based on the Boltzmann-Gibbs entropy meets all the requirements of the equilibrium thermodynamics in the thermodynamic limit [2]. This is a necessary condition for self-consistent definition of any equilibrium statistical mechanics.
    [Show full text]
  • Dynamical Correlations As Origin of Nonextensive Entropy
    EUROPHYSICS LETTERS 15 May 2005 Europhys. Lett., 70 (4), pp. 439–445 (2005) DOI: 10.1209/epl/i2004-10506-9 Dynamical correlations as origin of nonextensive entropy T. Kodama 1, H.-T. Elze 1,C.E.Aguiar1 and T. Koide 2(∗) 1 Instituto de F´ısica, Universidade Federal do Rio de Janeiro C.P. 68528, 21945-970 Rio de Janeiro, RJ, Brazil 2 Institut f¨ur Theoretische Physik, University of Frankfurt - Frankfurt, Germany received 10 November 2004; accepted in final form 23 March 2005 published online 13 April 2005 PACS. 05.70.-a – Thermodynamics. PACS. 05.90.+m – Other topics in statistical physics, thermodynamics, and nonlinear dynam- ical systems. Abstract. – We present a simple and general argument showing that a class of dynamical correlations give rise to the so-called Tsallis nonextensive statistics. An example of a system having such a dynamics is given, exhibiting a non-Boltzmann energy distribution. A relation with prethermalization processes is discussed. Generalized statistics and correlations. – In the recent paper by Berges et al. [1], the au- thors show that the dynamics of a quantum scalar field exhibits a prethermalization behavior, where the thermodynamical relations become valid long before the real thermal equilibrium is attained. There, although the system is spatially homogeneous, the single-particle spectra are different from those determined by the usual Boltzmann equilibrium. This means that the validity of thermodynamics does not imply thermal equilibrium in the sense of Boltzmann. Such a situation has also long been claimed by Tsallis [2,3], who introduced the q-entropy, defined in terms of the occupation probabilities {pα} of the microstate α by q 1 − α pa Sq [{pα}]= , (1) q − 1 instead of the usual entropy S[{pα}]=− α pα ln pα.
    [Show full text]
  • Lecture Notes in Physics
    Lecture Notes in Physics Editorial Board R. Beig, Wien, Austria J. Ehlers, Potsdam, Germany U. Frisch, Nice, France K. Hepp, Zurich,¨ Switzerland W. Hillebrandt, Garching, Germany D. Imboden, Zurich,¨ Switzerland R. L. Jaffe, Cambridge, MA, USA R. Kippenhahn, Gottingen,¨ Germany R. Lipowsky, Golm, Germany H. v. Lohneysen,¨ Karlsruhe, Germany I. Ojima, Kyoto, Japan H. A. Weidenmuller,¨ Heidelberg, Germany J. Wess, Munchen,¨ Germany J. Zittartz, Koln,¨ Germany 3 Berlin Heidelberg New York Barcelona Hong Kong London Milan Paris Singapore Tokyo Editorial Policy The series Lecture Notes in Physics (LNP), founded in 1969, reports new developments in physics research and teaching -- quickly, informally but with a high quality. Manuscripts to be considered for publication are topical volumes consisting of a limited number of contributions, carefully edited and closely related to each other. Each contribution should contain at least partly original and previously unpublished material, be written in a clear, pedagogical style and aimed at a broader readership, especially graduate students and nonspecialist researchers wishing to familiarize themselves with the topic concerned. For this reason, traditional proceedings cannot be considered for this series though volumes to appear in this series are often based on material presented at conferences, workshops and schools (inceptional cases the original papers and/or those not included in the printed book may be added on an accompanying CD ROM, together with the abstracts of posters and other material suitable for publication, e.g. large tables, colour pictures, program codes, etc.). Acceptance Aprojectcanonlybeacceptedtentativelyforpublication,byboththeeditorialboardandthe publisher, following thorough amination of the material submitted. The book proposal sent to the publisher should consist at least of a preliminary table of contents outlining the structureofthebooktogetherwithabstractsofallcontributionstobeincluded.
    [Show full text]
  • Nonextensive Perfect Hydrodynamics – a Model of Dissipative Relativistic Hydrodynamics?
    Cent. Eur. J. Phys. • 7(3) • 2009 • 432-443 DOI: 10.2478/s11534-008-0163-5 Central European Journal of Physics Nonextensive perfect hydrodynamics – a model of dissipative relativistic hydrodynamics? Research Article Takeshi Osada1∗, Grzegorz Wilk2† 1 Theoretical Physics Lab., Faculty of Knowledge Engineering, Musashi Institute of Technology, Setagaya-ku, Tokyo 158-8557, Japan 2 The Andrzej Sołtan Institute for Nuclear Studies, Theoretical Physics Department, ul. Hoża 69, 00-681 Warsaw, Poland Received 14 October 2008; accepted 19 December 2008 Abstract: We demonstrate that nonextensive perfect relativistic hydrodynamics (q-hydrodynamics) can serve as a model of the usual relativistic dissipative hydrodynamics (d-hydrodynamics) therefore facilitating consider- ably its applications. As an illustration, we show how using q-hydrodynamics one gets the q-dependent expressions for the dissipative entropy current and the corresponding ratios of the bulk and shear viscosities to entropy density, ζ/s and η/s respectively. PACS (2008): 05.70.Ln, 12.38.Mh, 12.40.Ee Keywords: nonextensive statistical mechanics • hydrodynamic models • high energy collisions • multiparticle produc- tion processes © Versita Warsaw and Springer-Verlag Berlin Heidelberg. 1. Introduction be very effectively described by using a thermodynamic approach in conjunction with hydrodynamical flow. In this so called Landau Hydrodynamic Model, the secondaries were considered to be a product of the decay of some Hydrodynamics is well established as an effective ap- kind of hadronic fluid, produced in such collisions, which proach to flow phenomena. Here we shall present its was expanding before hadronization [1–3]. This model has nonextensive relativistic version from the point of view of recently been updated to describe recent experimental high energy collision physics [1–14].
    [Show full text]
  • Nonextensive Statistical Mechanics and High Energy Physics
    EPJ Web of Conferences 71, 00132 (2014) DOI: 10.1051/epjconf/20147100132 C Owned by the authors, published by EDP Sciences, 2014 Nonextensive statistical mechanics and high energy physics Constantino Tsallis1,2,a and Zochil Gonzalez Arenas1,b 1Centro Brasileiro de Pesquisas Fisicas, and National Institute of Science and Technology for Complex Systems - Rua Xavier Sigaud 150, 22290-180 Rio de Janeiro-RJ, Brazil 2Santa Fe Institute - 1399 Hyde Park Road, Santa Fe, NM 87501, USA Abstract. The use of the celebrated Boltzmann-Gibbs entropy and statistical mechanics is justified for ergodic-like systems. In contrast, complex systems typically require more powerful theories. We will provide a brief introduction to nonadditive entropies (char- acterized by indices like q,which,intheq → 1 limit, recovers the standard Boltzmann- Gibbs entropy) and associated nonextensive statistical mechanics. We then present some recent applications to systems such as high-energy collisions, black holes and others. In addition to that, we clarify and illustrate the neat distinction that exists between Lévy distributions and q-exponential ones, a point which occasionally causes some confusion in the literature, very particularly in the LHC literature. 1 Introduction Boltzmann-Gibbs (BG) statistical mechanics constitutes one of the pillars of contemporary physics, together with Newtonian, quantum and relativistic mechanics, and Maxwell’s electromagnetism. Cen- tral points of any physical theory are when and why it works, and when and why it fails. This is so for any human intellectual construct, hence for the BG theory as well. We intend to briefly discuss here when we must (or must not) use the BG entropy W W 1 S = k p ln p = 1 , (1) BG i p i i=1 i i=1 where k is a constant (either taken equal to Boltzmann constant kB, or to unity).
    [Show full text]
  • Arxiv:Cond-Mat/0011012 V4 6 Jan 2001
    Nonextensive thermodynamic relations Sumiyoshi Abea, S. Martínezb, c, F. Penninib, c and A. Plastinob, c a College of Science and Technology, Nihon University, Funabashi, Chiba 274-8501, Japan b Instituto de Física de La Plata, National University La Plata, C.C. 727, 1900 La Plata, Argentina c Argentine National Research Council (CONICET) The generalized zeroth law of thermodynamics indicates that the physical temperature in nonextensive statistical mechanics is different from the inverse of the Lagrange multiplier, β . This fact leads to modifications of some of thermodynamic relations for nonextensive systems. Here, taking the first law of thermodynamics and the Legendre transform structure as the basic premises, it is found that Clausius’ definition of the thermodynamic entropy has to be appropriately modified, and accordingly the thermodynamic relations proposed by Tsallis, Mendes and Plastino [Physica A 261 (1998) 534] are also to be rectified. It is shown that the definition of arXiv:cond-mat/0011012 v4 6 Jan 2001 specific heat and the equation of state remain form invariant. As an application, the classical gas model is reexamined and, in marked contrast with the previous result obtained by Abe [Phys. Lett. A 263 (1999) 424: Erratum A 267 (2000) 456] using the unphysical temperature and the unphysical pressure, the specific heat and the equation of state are found to be similar to those in ordinary extensive thermodynamics. PACS: 05.70.-a; 05.20.-y; 05.90.+m 1 1. Introduction It is generally believed that the framework of thermodynamics will remain unchanged forever even if the microscopic dynamical laws may be modified in the future.
    [Show full text]
  • Consequences of the H Theorem from Nonlinear Fokker-Planck Equations
    PHYSICAL REVIEW E 76, 041123 ͑2007͒ Consequences of the H theorem from nonlinear Fokker-Planck equations Veit Schwämmle,* Fernando D. Nobre,† and Evaldo M. F. Curado‡ Centro Brasileiro de Pesquisas Físicas, Rua Xavier Sigaud 150, 22290-180 Rio de Janeiro, Rio de Janeiro, Brazil ͑Received 18 June 2007; published 17 October 2007͒ A general type of nonlinear Fokker-Planck equation is derived directly from a master equation, by introduc- ing generalized transition rates. The H theorem is demonstrated for systems that follow those classes of nonlinear Fokker-Planck equations, in the presence of an external potential. For that, a relation involving terms of Fokker-Planck equations and general entropic forms is proposed. It is shown that, at equilibrium, this relation is equivalent to the maximum-entropy principle. Families of Fokker-Planck equations may be related to a single type of entropy, and so, the correspondence between well-known entropic forms and their associated Fokker-Planck equations is explored. It is shown that the Boltzmann-Gibbs entropy, apart from its connection with the standard—linear Fokker-Planck equation—may be also related to a family of nonlinear Fokker-Planck equations. DOI: 10.1103/PhysRevE.76.041123 PACS number͑s͒: 05.40.Fb, 05.20.Ϫy, 05.40.Jc, 66.10.Cb I. INTRODUCTION nonlinear effects on its associated transition probabilities ͓21–23͔. It is well known that many real systems exhibit a dynami- The nonextensive statistical mechanics formalism has cal behavior that falls out of the scope of the standard linear emerged naturally as a strong candidate for dealing appropri- differential equations of physics.
    [Show full text]