Entropy Differential Review Abstract: Keywords: Literature

Total Page:16

File Type:pdf, Size:1020Kb

Entropy Differential Review Abstract: Keywords: Literature Entropy 2005, 7[4], 253-299 Entropy ISSN 1099-4300 www.mdpi.org/entropy/ Review Differential entropy and time Piotr Garbaczewski Institute of Physics, University of Zielona G´ora, ul. Szafrana 4a, 65-516 Zielona G´ora, Poland E-mail: [email protected] Received: 22 August 2005 / Accepted: 17 October 2005 / Published: 18 October 2005 Abstract: We give a detailed analysis of the Gibbs-type entropy notion and its dynamical be- havior in case of time-dependent continuous probability distributions of varied origins: related to classical and quantum systems. The purpose-dependent usage of conditional Kullback-Leibler and Gibbs (Shannon) entropies is explained in case of non-equilibrium Smoluchowski processes. A very different temporal behavior of Gibbs and Kullback entropies is confronted. A specific con- ceptual niche is addressed, where quantum von Neumann, classical Kullback-Leibler and Gibbs entropies can be consistently introduced as information measures for the same physical system. If the dynamics of probability densities is driven by the Schr¨odinger picture wave-packet evolution, Gibbs-type and related Fisher information functionals appear to quantify nontrivial power transfer processes in the mean. This observation is found to extend to classical dissipative processes and supports the view that the Shannon entropy dynamics provides an insight into physically relevant non-equilibrium phenomena, which are inaccessible in terms of the Kullback-Leibler entropy and arXiv:quant-ph/0408192v5 17 Oct 2005 typically ignored in the literature. Keywords: differential entropy; von Neumann entropy; Shannon entropy; Kullback-Leibler entropy; Gibbs entropy; entropy methods; entropy functionals; Fisher information; Ornstein- Uhlenbeck process; Schr¨odinger picture evolution; dynamics of probability densities; invariant density. PACS codes: 05.45.+b, 02.50.-r, 03.65.Ta, 03.67.-a Entropy 2005, 7[4], 253-299 2 1 Introduction Among numerous manifestations of the concept of entropy in physics and mathematics, the information-theory based entropy methods have been devised to investigate the large time be- havior of solutions of various (mostly dissipative) partial differential equations. Shannon, Kull- back and von Neumann entropies are typical information theory tools, designed to quantify the information content and possibly information loss for various classical and quantum systems in a specified state. For quantum systems the von Neumann entropy vanishes on pure states, hence one presumes to have a complete information about the state of a system. On the other hand, for pure states the Gibbs-type (Shannon, e.g. differential) entropy gives access to another information-theory level, associated with a probability distribution inferred from a L2(Rn) wave packet. Although Shannon or Kullback entropies are interpreted as information measures, it is quite natural to think of entropy as a measure of uncertainty. In view of the profound role played by the Shannon entropy in the formulation of entropic indeterminacy relations [1, 2], the term information, in the present paper is mostly used in the technical sense, meaning the inverse of uncertainty. In physics, the notion of entropy is typically regarded as a measure of the degree of randomness and the tendency (trends) of physical systems to become less and less organized. Throughout the paper we shall attribute a more concrete meaning to the term organization, both in the classical and quantum contexts. Namely, we shall pay special attention to quantifying, in terms of suitable entropy functionals, the degree of the probability distribution (de)localization, and the dynamical behavior of this specific - localization uncertainty - feature of a physical system. 1.1 Notions of entropy Notions of entropy, information and uncertainty are intertwined and cannot be sharply differen- tiated. While entropy and uncertainty are - to some extent synonymous - measures of ignorance (lack of information, uncertainty), the complementary notion of information basically quantifies the ability of observers to make reliable predictions about the system, [4, 6, 7]: the more aware one is about chances of a concrete outcome, the lower is the uncertainty of this outcome. Normally, the growth of uncertainty is identified with an increase of the entropy which in turn is interpreted as an information loss. Consult e.g. standard formulations of the celebrated Boltzmann H-theorem. Following Ref. [3] let us recall that entropy - be it thermodynamical (Gibbs-Boltzmann), dynam- ical, von Neumann, Wehrl, Shannon, Renyi, Tsallis or any other conceivable candidate - has an exceptional status among physical quantities. As a derived quantity it does not show up in any fundamental equation of motion. Generically, there is no a priori preferred notion of entropy (perhaps, except for the thermodynamical Clausius case) in physical applications and its specific choice appears to be purpose-dependent. As an obvious remnant of the standard thermodynamical reasoning, one expects entropy to be a state function of the system (thermodynamical notions of equilibrium or near-equilibrium are Entropy 2005, 7[4], 253-299 3 implicit). This state connotation is a source of ambiguities, since inequivalent notions of the system state are used in the description of physical systems, be them classical, thermodynamical and quantum. Not to mention rather specialized meaning of state employed in the standard information theory, [4, 9, 7]. A primitive information-theory system is simply a bit whose two admissible states are binary digits 1 and 0. Its quantum equivalent is a qubit whose admissible states are vectors in a two-dimensional Hilbert space, hence an infinity of pure states of a two-level quantum system. The information theory framework, if extended to more complicated systems, employs a plethora of notions of state [4, 7]. As very special cases we may mention a phase-space point as the determi- native of the state of a classical dynamical system, or the macroscopic notion of a thermodynamical state in its classical and quantum versions, [3]. A symbolic mathematical representation of quantum states in terms of wave vectors and/or density operators is expected to provide an experimentally verifiable ”information” about the system. To obtain a catalogue of the corresponding statistical predictions, an a priori choice of suitable observables (and thus measurement procedures) is necessary. Then, a casual interpretation of entropy as a measure of one’s uncertainty about measurable properties of a system in a prescribed quantum state may acquire an unambiguous meaning. When adopting the state notion to the Hilbert space language of quantum theory, we realize that normalized wave functions and density operators, which are traditionally supposed to determine the quantum state, allow to extend the notion of entropy to certain functionals of the state of the quantum system. The von Neumann entropy (ˆρ)= k Tr(ˆρ lnρ ˆ) (1) S − B of a quantum state (e.g. the density operatorρ ˆ), though often infinite, is typically related to the degree of departure from purity (e.g. the ”mixedness” level) of the state and is particularly useful while quantifying measurements performed upon finite quantum systems. For a given density operatorρ ˆ, von Neumann entropy is commonly accepted as a reliable measure of the information content (about the departure from purity), to be experimentally extracted from of a quantum system in a given state. Only under very specific circumstances, like e.g. in an optimal ”quantum experiment” [11, 12] which refers to the diagonal density operator (with pi, 1 i N being its eigenvalues), the information gain can be described in terms of both von ≤ ≤ Neumann’s and the standard Shannon measure of information: Tr(ˆρ lnρ ˆ)= p ln p . (2) − − i i i X Since von Neumann entropy is invariant under unitary transformations, the result exhibits an invariance under the change of the Hilbert space basis and the conservation in time for a closed system (when there is no information/energy exchange with the environment). Thus, Schr¨odinger dynamics has no impact on the von Neumann encoding of information, see e.g. also [13, 14] for a related discussion. Entropy 2005, 7[4], 253-299 4 Pure states have vanishing von Neumann entropy ( (ˆρ) = 0 ”for the pure states and only for S them”, [3]) and are normally considered as irrelevant from the quantum information theory per- spective, since ”one has complete information” [3] about such states. One may even say that a pure state is an unjustified over-idealization, since otherwise it would constitute e.g. a completely measured state of a system in an infinite Hilbert space, [15]. A colloquial interpretation of this situation is: since the wave function provides a complete description of a quantum system, surely we have no uncertainty about this quantum system, [16]. Note that as a side comment we find in Ref. [15] a minor excuse: this idealization, often employed for position-momentum degrees of freedom, is usually an adequate approximation, to be read as an answer to an objection of Ref. [17]: ”although continuous observables such as the position are familiar enough, they are really unphysical idealizations”, c.f. in this connection [18] for an alternative view. On the other hand, the classic Shannon entropy is known to be a natural measure of the amount of uncertainty related to measurements for pairs of observables, discrete and continuous on an equal footing, when a quantum system actually is in a pure state. Hence,
Recommended publications
  • Entropic Uncertainty Relations and Their Applications
    REVIEWS OF MODERN PHYSICS, VOLUME 89, JANUARY–MARCH 2017 Entropic uncertainty relations and their applications Patrick J. Coles* Institute for Quantum Computing and Department of Physics and Astronomy, University of Waterloo, N2L3G1 Waterloo, Ontario, Canada Mario Berta† Institute for Quantum Information and Matter, California Institute of Technology, Pasadena, California 91125, USA Marco Tomamichel‡ School of Physics, The University of Sydney, Sydney, NSW 2006, Australia Stephanie Wehner§ QuTech, Delft University of Technology, 2628 CJ Delft, Netherlands (published 6 February 2017) Heisenberg’s uncertainty principle forms a fundamental element of quantum mechanics. Uncertainty relations in terms of entropies were initially proposed to deal with conceptual shortcomings in the original formulation of the uncertainty principle and, hence, play an important role in quantum foundations. More recently, entropic uncertainty relations have emerged as the central ingredient in the security analysis of almost all quantum cryptographic protocols, such as quantum key distribution and two-party quantum cryptography. This review surveys entropic uncertainty relations that capture Heisenberg’s idea that the results of incompatible measurements are impossible to predict, covering both finite- and infinite-dimensional measurements. These ideas are then extended to incorporate quantum correlations between the observed object and its environment, allowing for a variety of recent, more general formulations of the uncertainty principle. Finally, various applications are discussed, ranging from entanglement witnessing to wave-particle duality to quantum cryptography. DOI: 10.1103/RevModPhys.89.015002 CONTENTS 1. Shannon entropy 9 2. Rényi entropies 10 I. Introduction 2 3. Maassen-Uffink proof 10 A. Scope of this review 4 4. Tightness and extensions 10 II.
    [Show full text]
  • Uncertainty Relations for a Non-Canonical Phase-Space Noncommutative Algebra
    Journal of Physics A: Mathematical and Theoretical PAPER Uncertainty relations for a non-canonical phase-space noncommutative algebra To cite this article: Nuno C Dias and João N Prata 2019 J. Phys. A: Math. Theor. 52 225203 View the article online for updates and enhancements. This content was downloaded from IP address 188.184.3.52 on 21/05/2019 at 07:56 IOP Journal of Physics A: Mathematical and Theoretical J. Phys. A: Math. Theor. Journal of Physics A: Mathematical and Theoretical J. Phys. A: Math. Theor. 52 (2019) 225203 (32pp) https://doi.org/10.1088/1751-8121/ab194b 52 2019 © 2019 IOP Publishing Ltd Uncertainty relations for a non-canonical phase-space noncommutative algebra JPHAC5 Nuno C Dias1,2 and João N Prata1,2 225203 1 Grupo de Física Matemática, Faculdade de Ciências da Universidade de Lisboa, Campo Grande, Edifício C6 1749-016 Lisboa, Portugal N C Dias and J N Prata 2 Escola Superior Náutica Infante D. Henrique, Av. Engenheiro Bonneville Franco, 2770-058 Paço de Arcos, Portugal Uncertainty relations for noncommutative algebra E-mail: [email protected] and [email protected] Received 17 October 2018, revised 22 March 2019 Printed in the UK Accepted for publication 15 April 2019 Published 3 May 2019 JPA Abstract We consider a non-canonical phase-space deformation of the Heisenberg– 10.1088/1751-8121/ab194b Weyl algebra that was recently introduced in the context of quantum cosmology. We prove the existence of minimal uncertainties for all pairs of non-commuting variables. We also show that the states which minimize each Paper uncertainty inequality are ground states of certain positive operators.
    [Show full text]
  • Additivity of Entropic Uncertainty Relations
    Additivity of entropic uncertainty relations René Schwonnek Institut für Theoretische Physik, Leibniz Universität Hannover, Germany March 28, 2018 We consider the uncertainty between two bound cABC... gives the central estimate in many ap- pairs of local projective measurements per- plications like: entropic steering witnesses [1–4], un- formed on a multipartite system. We show certainty relations with side-information [5], some se- that the optimal bound in any linear uncer- curity proofs [6] and many more. tainty relation, formulated in terms of the When speaking about uncertainty, we consider so Shannon entropy, is additive. This directly im- called preparation uncertainty relations [7–14]. From plies, against naive intuition, that the minimal an operational point of view, a preparation uncer- entropic uncertainty can always be realized by tainty describes fundamental limitations, i.e. a trade- fully separable states. Hence, in contradic- off, on the certainty of predicting outcomes of sev- tion to proposals by other authors, no entan- eral measurements that are performed on instances glement witness can be constructed solely by of the same state. This should not be confused [15] comparing the attainable uncertainties of en- with its operational counterpart named measurement tangled and separable states. However, our re- uncertainty[16–20]. A measurement uncertainty rela- sult gives rise to a huge simplification for com- tion describes the ability of producing a measurement puting global uncertainty bounds as they now device which approximates several incompatible mea- can be deduced from local ones. surement devices in one shot. Furthermore, we provide the natural gener- The calculations in this work focus on uncertainty alization of the Maassen and Uffink inequality relations in a bipartite setting.
    [Show full text]
  • Arxiv:1312.4392V2 [Quant-Ph] 30 Apr 2014 Approach the Uncertainty-Limited Regime
    Measurement uncertainty relations Paul Busch,1, a) Pekka Lahti,2, b) and Reinhard F. Werner3, c) 1)Department of Mathematics, University of York, York, United Kingdom 2)Turku Centre for Quantum Physics, Department of Physics and Astronomy, University of Turku, FI-20014 Turku, Finland 3)Institut f¨urTheoretische Physik, Leibniz Universit¨at,Hannover, Germany (Dated: 29 March 2014 (Revised Version)) Measurement uncertainty relations are quantitative bounds on the errors in an approximate joint measurement of two observables. They can be seen as a general- ization of the error/disturbance tradeoff first discussed heuristically by Heisenberg. Here we prove such relations for the case of two canonically conjugate observables like position and momentum, and establish a close connection with the more familiar preparation uncertainty relations constraining the sharpness of the distributions of the two observables in the same state. Both sets of relations are generalized to means of order α rather than the usual quadratic means, and we show that the optimal constants are the same for preparation and for measurement uncertainty. The constants are determined numerically and compared with some bounds in the literature. In both cases the near-saturation of the inequalities entails that the state (resp. observable) is uniformly close to a minimizing one. Published in: J. Math. Phys. 55 (2014) 042111. DOI:10.1063/1.4871444 PACS numbers: 03.65.Ta, 03.65.Db, 03.67.-a I. INTRODUCTION Following Heisenberg's ground-breaking paper1 from 1927 uncertainty relations have be- come an indispensable tool of quantum mechanics. Often they are used in a qualitative heuristic way rather than in the form of proven inequalities.
    [Show full text]
  • Quantum Information Chapter 10. Quantum Shannon Theory
    Quantum Information Chapter 10. Quantum Shannon Theory John Preskill Institute for Quantum Information and Matter California Institute of Technology Updated June 2016 For further updates and additional chapters, see: http://www.theory.caltech.edu/people/preskill/ph219/ Please send corrections to [email protected] Contents 10 Quantum Shannon Theory 1 10.1 Shannon for Dummies 2 10.1.1 Shannon entropy and data compression 2 10.1.2 Joint typicality, conditional entropy, and mutual infor- mation 6 10.1.3 Distributed source coding 8 10.1.4 The noisy channel coding theorem 9 10.2 Von Neumann Entropy 16 10.2.1 Mathematical properties of H(ρ) 18 10.2.2 Mixing, measurement, and entropy 20 10.2.3 Strong subadditivity 21 10.2.4 Monotonicity of mutual information 23 10.2.5 Entropy and thermodynamics 24 10.2.6 Bekenstein’s entropy bound. 26 10.2.7 Entropic uncertainty relations 27 10.3 Quantum Source Coding 30 10.3.1 Quantum compression: an example 31 10.3.2 Schumacher compression in general 34 10.4 Entanglement Concentration and Dilution 38 10.5 Quantifying Mixed-State Entanglement 45 10.5.1 Asymptotic irreversibility under LOCC 45 10.5.2 Squashed entanglement 47 10.5.3 Entanglement monogamy 48 10.6 Accessible Information 50 10.6.1 How much can we learn from a measurement? 50 10.6.2 Holevo bound 51 10.6.3 Monotonicity of Holevo χ 53 10.6.4 Improved distinguishability through coding: an example 54 10.6.5 Classical capacity of a quantum channel 58 ii Contents iii 10.6.6 Entanglement-breaking channels 62 10.7 Quantum Channel Capacities and Decoupling
    [Show full text]
  • Entropic Uncertainty Minimum for Angle and Angular Momentum
    Journal of Optics J. Opt. 16 (2014) 105404 (6pp) doi:10.1088/2040-8978/16/10/105404 Entropic uncertainty minimum for angle and angular momentum Alison M Yao1, Thomas Brougham2, Electra Eleftheriadou1, Miles J Padgett2 and Stephen M Barnett2 1 Department of Physics, SUPA, University of Strathclyde, Glasgow G4 0NG, UK 2 School of Physics and Astronomy, University of Glasgow, Glasgow G12 8QQ, UK Received 19 June 2014, revised 8 August 2014 Accepted for publication 15 August 2014 Published 23 September 2014 Abstract Uncertainty relations are key components in the understanding of the nature of quantum mechanics. In particular, entropic relations are preferred in the study of angular position and angular momentum states. We propose a new form of angle–angular momentum state that provides, for all practical purposes, a lower bound on the entropic uncertainty relation, Hφ + Hm, for any given angular uncertainty, thus improving upon previous bounds. We establish this by comparing this sum with the absolute minimum value determined by a global numerical search. These states are convenient to work with both analytically and experimentally, which suggests that they may be of use for quantum information purposes. Keywords: entropic uncertainty, orbital angular momentum, quantum information PACS numbers: 03.67.-a, 03.67.Dd, 03.67.Mn, 42.50.-p (Some figures may appear in colour only in the online journal) 1. Introduction determined, the less well known will be its counterpart. Indeed, the complementarity of incompatible observables is Current demands for secure, high-bandwidth communications one of the fundamentally distinctive properties of quantum have resulted in a lot of interest in new protocols in quantum theory [5].
    [Show full text]
  • Arxiv:1101.2944V2 [Quant-Ph] 30 Jul 2021 Entropic Uncertainty Relations
    Entropic uncertainty relations in multidimensional position and momentum spaces Yichen Huang (黄溢辰)∗† Department of Physics, University of California, Berkeley, Berkeley, California 94720, USA August 2, 2021 Abstract Commutator-based entropic uncertainty relations in multidimensional position and momentum spaces are derived, twofold generalizing previous entropic uncertainty re- lations for one-mode states. They provide optimal lower bounds and imply the multi- dimensional variance-based uncertainty principle. The article concludes with an open conjecture. 1 Introduction Without a classical analog, uncertainty relations are one of the most fundamental ideas of quantum mechanics, underlying many conceptual differences between classical and quantum theories. They reveal by rigorous inequalities that incompatible observables cannot be mea- sured to arbitrarily high precision simultaneously. They are applied widely in areas both related and unrelated to quantum mechanics, such as entanglement detection [1–8], quantum cryptography [9–11], and signal processing [12, 13]. arXiv:1101.2944v2 [quant-ph] 30 Jul 2021 We associate a random variable A with an operator Aˆ. The possible values of A are the eigenvalues of Aˆ, and the probability (density) that A takes the value a is the probability (density) that we get a when we measure the operator Aˆ with respect to a quantum state |Ψi. The variance of Aˆ, denoted ∆Aˆ, is the variance of A, and the (differential) Shannon entropy of Aˆ, denoted H(A,ˆ |Ψi), or H(Aˆ), or H(P (a)), where P (a) is the distribution of A, is defined as the (differential) Shannon entropy of A. The famous commutator-based Heisenberg uncertainty principle is formulated by Robert- son [14] for observables: 2 ∆Aˆ∆Bˆ ≥ hΨ|[A,ˆ Bˆ]|Ψi /4.
    [Show full text]
  • Some Extensions of the Uncertainty Principle
    Some extensions of the uncertainty principle Steeve Zozor a, Mariela Portesi b and Christophe Vignat c aGIPSA-Lab, D´epartement Images et Signal 961 Rue de la Houille Blanche, B.P. 46 38420 Saint Martin d’H`eres Cedex, France E-mail: [email protected] bInstituto de F´ısica La Plata (CONICET), and Departamento de F´ısica, Facultad de Ciencias Exactas, Universidad Nacional de La Plata C.C. 67, 1900 La Plata, Argentina E-mail: [email protected] cLaboratoire d’Informatique de l’Institut Gaspard Monge, Equipe SYSCOM Universit´ede Marne-la-Vall´ee, 77454 Marne-la-Vall´ee Cedex 2, France Abstract We study the formulation of the uncertainty principle in quantum mechanics in terms of entropic inequalities, extending results recently derived by Bialynicki- Birula [1] and Zozor et al. [2]. Those inequalities can be considered as general- izations of the Heisenberg uncertainty principle, since they measure the mutual uncertainty of a wave function and its Fourier transform through their associated R´enyi entropies with conjugated indices. We consider here the general case where the entropic indices are not conjugated, in both cases where the state space is discrete and continuous: we discuss the existence of an uncertainty inequality depending on the location of the entropic indices α and β in the plane (α, β). Our results explain and extend a recent study by Luis [3], where states with quantum fluctuations below arXiv:0709.3011v2 [math.PR] 2 Apr 2008 the Gaussian case are discussed at the single point (2, 2). Key words: Entropic uncertainty relation, R´enyi entropy, non-conjugated indices PACS: 03.65.Ca, 03.65.Ta, 03.65.Db, 89.70.Cf 1 Introduction The Uncertainty Principle (UP) is such a fundamental concept that it focuses great attention not only in quantum physics but even in other areas (e.g.
    [Show full text]
  • Discrete Entropic Uncertainty Relations Associated with FRFT*
    Journal of Signal and Information Processing, 2013, 4, 120-124 doi:10.4236/jsip.2013.43B021 Published Online August 2013 (http://www.scirp.org/journal/jsip) Discrete Entropic Uncertainty Relations Associated with * FRFT Guanlei Xu1, Xiaotong Wang2, Lijia Zhou1, Limin Shao1, Xiaogang Xu2 1Ocean department of Dalian Naval Academy, Dalian, China, 116018; 2Navgation department of Dalian Naval Academy, Dalian, China, 116018. Email: [email protected] Received March, 2013. ABSTRACT Based on the definition and properties of discrete fractional Fourier transform (DFRFT), we introduced the discrete Hausdorff-Young inequality. Furthermore, the discrete Shannon entropic uncertainty relation and discrete Rényi en- tropic uncertainty relation were explored. Also, the condition of equality via Lagrange optimization was developed, as shows that if the two conjugate variables have constant amplitudes that are the inverse of the square root of numbers of non-zero elements, then the uncertainty relations reach their lowest bounds. In addition, the resolution analysis via the uncertainty is discussed as well. Keywords: Discrete Fractional Fourier Transform (DFRFT); Uncertainty Principle; Rényi Entropy; Shannon Entropy 1. Introduction zation. The third contribution is that we derived the Renyi entropic uncertainty principle in FRFT domain for Uncertainty principle not only holds in analog signals, discrete case. The final contribution is that we discussed but also in discrete signals [1,2]. Recently, with the de- the resolution in multiple FRFT domains as a succession velopment of fractional Fourier transform (FRFT), ana- of above derivative, including new proofs. In a word, log generalized uncertainty relations associated with there have been no reported papers covering these gener- FRFT have been carefully explored in some papers such alized discrete entropic uncertainty relations on FRFT.
    [Show full text]
  • Entropic Uncertainty Relations in Quantum Physics
    Chapter 1 Entropic Uncertainty Relations in Quantum Physics Iwo Bialynicki-Birula and Łukasz Rudnicki Abstract Uncertainty relations have become the trademark of quantum theory since they were formulated by Bohr and Heisenberg. This review covers various generalizations and extensions of the uncertainty relations in quantum theory that involve the Rényi and the Shannon entropies. The advantages of these entropic un- certainty relations are pointed out and their more direct connection to the observed phenomena is emphasized. Several remaining open problems are mentioned. 1.1 Introduction In recent years we have seen many applications of the Rényi and Shannon entropies in many fields from biology, medicine, genetics, linguistics, and economics to elec- trical engineering, computer science, geophysics, chemistry, and physics. In particu- lar, the Rényi entropy has been widely used in the study of quantum systems. It was used in the analysis of quantum entanglement [1–5], quantum communication pro- tocols [6, 7], quantum correlations [8], quantum measurement [9], and decoherence [10], multiparticle production in high-energy collisions [11–13], quantum statisti- cal mechanics [14], pattern formation [15, 16], localization properties of Rydberg states [17] and spin systems [18, 19], in the study of the quantum-classical corre- spondence [20], in electromagnetic beams [21], and the localization in phase space [22, 23]. Our aim in this review is to use the Shannon and Rényi entropies to describe the limitations on the available information that characterizes the states of quantum sys- tems. These limitations in the form of mathematical inequalities have the physical interpretation of the uncertainty relations. We will not enter here into the discussion (cf.
    [Show full text]
  • The Entropic Uncertainty Principle and the Fast Fourier Transform
    The Entropic Uncertainty Principle and the Fast Fourier Transform Charles S. Peskin Courant Institute of Mathematical Sciences, New York University Modeling and Simulation Group Seminar — March 5, 2020 Abstract The entropic uncertainty principle for the discrete Fourier transform states that H(u)+ H(F u) log(n), where F is the discrete Fourier transform of order n ≥ n n, and H(u) is the entropy of the discrete probability distribution given by Pj = 2 ( uj / u ) . This is a special case of a known result [1] that requires substantial mathematical| | k k apparatus for its proof. Here, we give an elementary proof for the special case of the discrete Fourier transform with n = 2p. Our method of proof is induction on p. By proceeding in this way, we reveal a connection between the entropic uncertainty principle and the Fast Fourier Transform algorithm. Introduction The discrete Fourier transform F : Cn Cn is defined by n → n 1 − 2 1 i π jk (F u) = e− n u , (1) n k √n j j=0 X for k =0, 1,...,n 1. It is easy to check that F is unitary: − n F u = u , (2) k n k k k where is the Euclidean norm. Thek entropy k of a vector u Cn may be defined as follows: ∈ n 1 2 2 − u u H(u)= | j| log | j| . (3) − u u j=0 ! X k k k k 1 Note that H(u) is invariant under any permutation of the components of u, and also that H is homogeneous of degree 0, that is, H(cu)= H(u) (4) for any complex number c.
    [Show full text]
  • Arxiv:1609.09207V2 [Quant-Ph]
    R´enyi and Tsallis formulations of separability conditions in finite dimensions Alexey E. Rastegin Department of Theoretical Physics, Irkutsk State University, Gagarin Bv. 20, Irkutsk 664003, Russia Separability conditions for a bipartite quantum system of finite-dimensional subsystems are for- mulated in terms of R´enyi and Tsallis entropies. Entropic uncertainty relations often lead to en- tanglement criteria. We propose new approach based on the convolution of discrete probability distributions. Measurements on a total system are constructed of local ones according to the con- volution scheme. Separability conditions are derived on the base of uncertainty relations of the Maassen–Uffink type as well as majorization relations. On each of subsystems, we use a pair of sets of subnormalized vectors that form rank-one POVMs. We also obtain entropic separability conditions for local measurements with a special structure, such as mutually unbiased bases and symmetric informationally complete measurements. The relevance of the derived separability con- ditions is demonstrated with several examples. Keywords: entropic uncertainty principle, convolution, majorization, separable states I. INTRODUCTION Quantum entanglement stands among fundamentals of the quantum world. This quantum-mechanical feature was concerned by founders in the Schr¨odinger “cat paradox” paper [1] and in the Einstein–Podolsky–Rosen paper [2]. Entanglement is central to all questions of the emerging technologies of quantum information. Features of quantum entanglement are currently the subject of active research (see, e.g., the review [3] and references therein). Due to progress in quantum information processing, both the detection and quantification of entanglement are very important. In the case of discrete variables, the positive partial transpose (PPT) criterion [4] and the reduction criterion [5] are very powerful.
    [Show full text]