DOCSLIB.ORG

1 Oscar Sheynin History of Statistics Berlin, 2012 ISBN 978-3-942944-20-5 © Oscar Sheynin 2012 NG Verlag Berlin

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
1 Oscar Sheynin History of Statistics Berlin, 2012 ISBN 978-3-942944-20-5 © Oscar Sheynin 2012 NG Verlag Berlin Oscar Sheynin History of Statistics Berlin, 2012 ISBN 978-3-942944-20-5 © Oscar Sheynin 2012 NG Verlag Berlin 1 Contents 0. Introduction 0.1. General information 0.2. The pertinent disciplines and their stages 1. Prehistory 1.1. Randomness 1.2. Probability 1.3. Cause vs chance 1.4. Expectation 1.5. Astronomy 1.6. Astrology 1.7. Treatment of observations 2. Early history 2.1. Stochastic ideas in science and society 2.2. Mathematical investigations 3. Jakob Bernoulli and the law of large numbers 3.1. Bernoulli’s works 3.2. Art of Conjecturing : part four 3.3. Bernoulli’s contemporaries 4. De Moivre and the De Moivre – Laplace limit theorem 4.1. The Measurement of Chance (1712) 4.2. Life insurance 4.3. The Doctrine of Chances (1718, 1738, 1756) 4.4. The De Moivre – Laplace limit theorem 5. Bayes 5.1. The Bayes formula and induction 5.2. The limit theorem 5.3. Additional remark 6. Other investigations before Laplace 6.1. Stochastic investigations 6.2. Statistical investigations 6.3. Treatment of observations 7. Laplace 7.1. Theory of probability 7.2. Theory of errors 7.3. Critical considerations 8. Poisson 8.1. Probability and statistics 8.2. Theory of errors 8.3. Criminal statistics 8.4. Statistical physics 8.5. Medical statistics 9. Gauss, Helmert, Bessel 9.1. Gauss 9.2. Helmert 9.3. Bessel 10. The second half of the nineteenth century 10.1. Cauchy 10.2. Bienaymé 10.3. Cournot 10.4. Buniakovsky 10.5. Quetelet 10.6. Galton 10.7. Statistics 10.8. Statistics and natural sciences 10.9. Natural scientists 11. Bertrand and Poincaré 11.1. Bertrand: general information 11.2. Bertrand: the random chord 11.3. Poincaré 2 12. Chebyshev 12.1. His contributions 12.2. His lectures 12.3. Some general considerations 13. Markov, Liapunov, Nekrasov 13.1 Markov: personal traits 13.2. Markov: scientific issues 13.3. Markov: main investigations 13.4. Liapunov 13.5. Nekrasov 14. The birth of mathematical statistics 14.1. Stability of statistical series 14.2. The Biometric school 14.3. The merging of the two streams? Supplement: axiomatization Bibliography Index of names 3 0. Introduction I do feel how wrongful it was to work for so many years at statistics and neglect its history K. Pearson (1978, p. 1) 0.1. General Information. This book is intended for those interested in the history of mathematics or statistics and more or less acquainted with the latter. It will also be useful for statisticians. My exposition is based, in the first place, on my own investigations published over some 35 years and monograph (2009) and I stop at the axiomatization of probability and at the birth of the real mathematical statistics, i.e., at Fisher. In § 9.1.3 I succeeded in greatly simplifying Gauss’ mature justification of least squares. Among the preceding literature I single out the great work of Hald (1900; 1998). However, his second book does not touch on the contribution of the Continental direction of statistics (see my § 14.1) and only describes everything from a modern point of view. It is therefore only intended for highly qualified readers (my account is much easier to understand). Second, Hald does not describe the contents of any given contribution and the reader will not know what exactly was contained in, say, any of Laplace’s memoirs. At least in my field the situation is greatly worsened by bad reviewing. Reputable publishers sometimes reprint literature without consulting their authors so that the unsuspecting reader gets dated information. Gnedenko & Sheynin (1978/1992) reprinted in 2001 in the volume put out by Birkhäuser is a good example. Many bad books are also appearing because their manuscripts had not been properly reviewed. Subsequent comments are often no more than sweet nothings or downright misleading. An ignorant author who stated that Poisson had proved the strong law of large numbers was praised as a scholar of the first rank. In some cases the cause of such facts is apparently well described by the saying Scratch my back, and I’ll scratch yours . Incidentally, this is a consequence of publishers supplying free copies of their new books to editors of periodicals. Then, abstracting journals are as a rule publishing whatever they get from their reviewers. But, first and foremost, the scientific community wrongly does not set high store on that most important work. Even worse: Truth is dismissed as an old-fashioned superstition. This conclusion (Truesdell 1984, p. 292) which concerned scientific work in general fell on deaf ears. About 1985 the then Editor of Historia Mathematica visited Moscow and made a report at the (now, Vavilov) Institute for History of Natural Sciences and Technology. Answering a question, he said that only a few readers of his periodical read Russian. I do not think that that situation had changed, much to the detriment of science. For that matter, students of the humanities certainly become versed in older masters, but not in modernity. How, indeed, can we otherwise explain why did a young offspring of the British Royal family go to a fancy-dress party clad as a German officer of SS? With sincere gratitude I recall the late Professors Youshkevitch, without whose assistance I, living in Moscow, would have been unable to publish abroad, and Truesdell, the Editor of the Archive for History of Exact Sciences , who had to busy himself with my English and compelled me to 4 pay due attention to style. In 1991, after moving to Germany, I became able to continue my work largely because of Professor Pfanzagl’s warm support. He secured a grant for me (which regrettably dried up long ago) from Axel- Springer Verlag. Professor Strecker essentially helped me to prepare and publish both English editions of my Russian book (1990). In my papers, I had acknowledged the help of many colleagues including the late Doctors Chirikov (an able mathematician whose bad health thwarted his scientific career) and Eisenhart. Professor Herbert A. David (Iowa State University) and especially Professor Ulrich Krengel provided useful comments on this text. A final remark. According to some clever regulation, Bernstein, who published many contributions abroad and spelled his name in that way, should now be called Bernshtein. This is ugly and it corrupts his pen-name (if not real name). And why then are we not ordered to spell Markof, Chuprof? When I began publishing abroad, I had not chosen the best spelling of my name, but it became my pen-name, and I refuse to change it. Some explanation Abbreviation CLT – central limit theorem LLN – law of large numbers MLSq – method of least squares W-i – Gauss, Werke , Bd. i W/Erg-i – Gauss, Werke , Ergänzungsreihe, Bd. i Notation [ ab ] = a1b1 + ... + anbn (introduced by Gauss). ln x = log nat x, lg x = log 10 x References in text A double page number, e.g. 59/216, means that either the pertinent source has double paging, or a reference to a later edition, or that it was translated from Russian into English with p. 59 of the original contribution corresponding to p. 216 of the translation. 0.2. The Pertinent Scientific Disciplines and Their Stages My subject covers a great chronological period and is very wide since it includes the theory of probability and statistics, which are difficult to separate, while statistics itself is a vast subject which ought to be subdivided. I also have to explain the relation of the theory of errors to statistics. In addition, I subdivide the history of the development of these disciplines into stages to help the readers grasp at once their general outline. Theory of Probability 1. Its prehistory (from Aristotle to the mid-17th century). 2. Its early history (from Pascal and Fermat to Jakob Bernoulli). 3. The creation of its initial version (completed by Jakob Bernoulli, De Moivre and Bayes). 4. Its development as an applied mathematical discipline (from Bayes to Laplace and Poisson to Chebyshev). 5. A rigorous proof of its limit theorems (Chebyshev, Markov, Liapunov) and its gradual transition to the realm of pure mathematics. 5 6. Axiomatization. In the second half of the 19 th century and the first decades of the 20 th mathematicians barely recognized probability theory and perhaps to our day all but ignore the Gaussian theory of errors. Mathematical Statistics. It originated in the early years of the 20 th century in the Biometric school and the Continental direction of statistics and Fisher moved it to the realm of pure mathematics. Its aim is the systematizing, processing and utilizing statistical data, – information on the number of the specified objects (Kolmogorov & Prokhorov 1988/1990, p. 138). Unlike theoretical statistics , it does not include collection of data or exploratory data analysis which means revealing general structures in the data (e. g., blunders, systematic influences, deception). The Statistical Method. Usually, statistics is meant to study population and the term statistical method is applied in all other instances. The statistical method underwent three stages. At first, conclusions were being based on qualitative regularities conforming to the essence of ancient science. Indeed, a Roman scholar Celsus (1935, p.19) stated: Careful men noted what generally answered the better, and then began to prescribe the same for their patients. Thus sprang up the Art of medicine. During the second stage (Tycho in astronomy, Graunt in demography and medical statistics) statistical data became available. Conclusions were made by means of simple stochastic ideas and methods or even directly, as before. At the present stage, which dates back to Poisson, inferences are being checked by quantitative stochastic rules.
Load more

Recommended publications
  • Life with Augustine
    Life with Augustine ...a course in his spirit and guidance for daily living By Edmond A. Maher ii Life with Augustine © 2002 Augustinian Press Australia Sydney, Australia. Acknowledgements: The author wishes to acknowledge and thank the following people: ► the Augustinian Province of Our Mother of Good Counsel, Australia, for support- ing this project, with special mention of Pat Fahey osa, Kevin Burman osa, Pat Codd osa and Peter Jones osa ► Laurence Mooney osa for assistance in editing ► Michael Morahan osa for formatting this 2nd Edition ► John Coles, Peter Gagan, Dr. Frank McGrath fms (Brisbane CEO), Benet Fonck ofm, Peter Keogh sfo for sharing their vast experience in adult education ► John Rotelle osa, for granting us permission to use his English translation of Tarcisius van Bavel’s work Augustine (full bibliography within) and for his scholarly advice Megan Atkins for her formatting suggestions in the 1st Edition, that have carried over into this the 2nd ► those generous people who have completed the 1st Edition and suggested valuable improvements, especially Kath Neehouse and friends at Villanova College, Brisbane Foreword 1 Dear Participant Saint Augustine of Hippo is a figure in our history who has appealed to the curiosity and imagination of many generations. He is well known for being both sinner and saint, for being a bishop yet also a fellow pilgrim on the journey to God. One of the most popular and attractive persons across many centuries, his influence on the church has continued to our current day. He is also renowned for his influ- ence in philosophy and psychology and even (in an indirect way) art, music and architecture.
    [Show full text]
  • The Evolution of Technical Analysis Lo “A Movement Is Over When the News Is Out,” So Goes Photo: MIT the Evolution the Wall Street Maxim
    Hasanhodzic $29.95 USA / $35.95 CAN PRAISE FOR The Evolution of Technical Analysis Lo “A movement is over when the news is out,” so goes Photo: MIT Photo: The Evolution the Wall Street maxim. For thousands of years, tech- ANDREW W. LO is the Harris “Where there is a price, there is a market, then analysis, and ultimately a study of the analyses. You don’t nical analysis—marred with common misconcep- & Harris Group Professor of Finance want to enter this circle without a copy of this book to guide you through the bazaar and fl ash.” at MIT Sloan School of Management tions likening it to gambling or magic and dismissed —Dean LeBaron, founder and former chairman of Batterymarch Financial Management, Inc. and the director of MIT’s Laboratory by many as “voodoo fi nance”—has sought methods FINANCIAL PREDICTION of Technical Analysis for Financial Engineering. He has for spotting trends in what the market’s done and “The urge to fi nd order in the chaos of market prices is as old as civilization itself. This excellent volume published numerous papers in leading academic what it’s going to do. After all, if you don’t learn from traces the development of the tools and insights of technical analysis over the entire span of human history; FINANCIAL PREDICTION FROM BABYLONIAN history, how can you profi t from it? and practitioner journals, and his books include beginning with the commodity price and astronomical charts of Mesopotamia, through the Dow Theory The Econometrics of Financial Markets, A Non- of the early twentieth century—which forecast the Crash of 1929—to the analysis of the high-speed TABLETS TO BLOOMBERG TERMINALS Random Walk Down Wall Street, and Hedge Funds: electronic marketplace of today.
    [Show full text]
  • Leibniz on China and Christianity: the Reformation of Religion and European Ethics Through Converting China to Christianity
    Bard College Bard Digital Commons Senior Projects Spring 2016 Bard Undergraduate Senior Projects Spring 2016 Leibniz on China and Christianity: The Reformation of Religion and European Ethics through Converting China to Christianity Ela Megan Kaplan Bard College, [email protected] Follow this and additional works at: https://digitalcommons.bard.edu/senproj_s2016 Part of the European History Commons This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License. Recommended Citation Kaplan, Ela Megan, "Leibniz on China and Christianity: The Reformation of Religion and European Ethics through Converting China to Christianity" (2016). Senior Projects Spring 2016. 279. https://digitalcommons.bard.edu/senproj_s2016/279 This Open Access work is protected by copyright and/or related rights. It has been provided to you by Bard College's Stevenson Library with permission from the rights-holder(s). You are free to use this work in any way that is permitted by the copyright and related rights. For other uses you need to obtain permission from the rights- holder(s) directly, unless additional rights are indicated by a Creative Commons license in the record and/or on the work itself. For more information, please contact [email protected]. Leibniz on China and Christianity: The Reformation of Religion and European Ethics through Converting China to Christianity Senior Project submitted to The Division of Social Studies Of Bard College by Ela Megan Kaplan Annandale-on-Hudson, New York May 2016 5 Acknowledgements I would like to thank my mother, father and omniscient advisor for tolerating me for the duration of my senior project.
    [Show full text]
  • The Metaphysical Foundations Underlying Augustine's Solution to the Problem of Evil
    Georgia State University ScholarWorks @ Georgia State University Philosophy Theses Department of Philosophy 11-30-2007 Between Being and Nothingness: The Metaphysical Foundations Underlying Augustine's Solution to the Problem of Evil Brian Keith Kooy Follow this and additional works at: https://scholarworks.gsu.edu/philosophy_theses Part of the Philosophy Commons Recommended Citation Kooy, Brian Keith, "Between Being and Nothingness: The Metaphysical Foundations Underlying Augustine's Solution to the Problem of Evil." Thesis, Georgia State University, 2007. https://scholarworks.gsu.edu/philosophy_theses/32 This Thesis is brought to you for free and open access by the Department of Philosophy at ScholarWorks @ Georgia State University. It has been accepted for inclusion in Philosophy Theses by an authorized administrator of ScholarWorks @ Georgia State University. For more information, please contact [email protected]. BETWEEN BEING AND NOTHINGNESS: THE METAPHYSICAL FOUNDATIONS UNDERLYING AUGUSTINE’S SOLUTION TO THE PROBLEM OF EVIL by BRIAN KEITH KOOY Under the Direction of Dr. Timothy M. Renick ABSTRACT Several commentators make the claim that Augustine is not a systematic thinker. The purpose of this thesis is to refute that claim in one specific area of Augustine's thought, the metaphysical foundations underlying his solutions to the problem of evil. Through an exegetical examination of various works in which Augustine writes on evil, I show that his solutions for both natural and moral evil rely on a coherent metaphysical system,
    [Show full text]
  • Title : Random Number Generator: Testing and Whitening. Co
    Title : Random number generator: testing and whitening. Co-Encadrants : Andrei ROMASHCHENKO and Alexander SHEN (LIRMM) contact for more detail : [email protected], [email protected] Keywords : random number generators, statistical tests Prerequisites : The candidate should have programming skills and some knowledge in probability theory. Abstract : Generation of random bits is a classical problem known in the context of pseudo-random generators and also in connection with of truly ran- dom physical processes (there exist electronic devices that produce random bits using an unpredictable physical noise or intrinsically nondeterministic quantum phenomena). However, the quality of physical generators of random bits remains badly founded and poorly tested. The first objective of this pro- ject is an experimental study of the validity and quality of several physical random numbers generators. When we talk about the quality of random or pseudo-random genera- tors, we have to use randomness tests. The second objective of the project is an inventory and revision of statistical tests for random and pseudo-random generators. We suggest to improve the quality of statistical tests and de- velop new techniques of “whitening” that improves the quality of non-ideal sources of random bits. Another axis of the project is a conversion of various probabilistic proofs into unconventional randomness tests. Some more detail : Randomness (in a form of sequences of random bits, random numbers, and so on) is widely used in computer science in crypto- graphy, in randomized algorithms, in various simulations, etc. So the question arises : where can we obtain necessary random digits suitable for randomi- zed computations and communication protocols ? In some applications even a simple pseudo-random generator would cope with a task.
    [Show full text]
  • Gottfried Wilhelm Leibniz, the Humanist Agenda and the Scientific Method
    3237827: M.Sc. Dissertation Gottfried Wilhelm Leibniz, the humanist agenda and the scientific method Kundan Misra A dissertation submitted in partial fulfilment of the requirements for the degree of Master of Science (Research), University of New South Wales School of Mathematics and Statistics Faculty of Science University of New South Wales Submitted August 2011 Changes completed September 2012 THE UNIVERSITY OF NEW SOUTH WALES Thesis/Dissertation Sheet Surname or Family name: Misra First name: Kundan Other name/s: n/a Abbreviation for degree as given in the University calendar: MSc School: Mathematics and Statistics Faculty: Science Title: Gottfried Wilhelm Leibniz, the humanist agenda and the scientific method Abstract 350 words maximum: Modernity began in Leibniz’s lifetime, arguably, and due to the efforts of a group of philosopher-scientists of which Leibniz was one of the most significant active contributors. Leibniz invented machines and developed the calculus. He was a force for peace, and industrial and cultural development through his work as a diplomat and correspondence with leaders across Europe, and in Russia and China. With Leibniz, science became a means for improving human living conditions. For Leibniz, science must begin with the “God’s eye view” and begin with an understanding of how the Creator would have designed the universe. Accordingly, Leibniz advocated the a priori method of scientific discovery, including the use of intellectual constructions or artifices. He defended the usefulness and success of these methods against detractors. While cognizant of Baconian empiricism, Leibniz found that an unbalanced emphasis on experiment left the investigator short of conclusions on efficient causes.
    [Show full text]
  • Measures of Maximal Entropy for Shifts of Finite Type
    Measures of maximal entropy for shifts of finite type Ben Sherman July 7, 2013 Contents Preface 2 1 Introduction 9 2 Dynamical systems 10 3 Topological entropy 13 4 Measure-preserving dynamical systems 20 5 Measure-theoretic entropy 22 6 Parry measure 27 7 Conclusion 30 Appendix: Deriving the Parry measure 30 1 Preface Before I get to the technical material, I thought I might provide a little non-technical background as to why randomness is so interesting, and why unpredictable dynamical systems (i.e., dynamical systems with positive entropy) provide an interesting explanation of randomness. What is randomness? \How dare we speak of the laws of chance? Is not chance the antithesis of all law?" |Joseph Bertrand, Calcul des probabilit´es, 1889 Throughout history, phenomena which could not be understood in a mundane sense have been ascribed to fate. After all, if something cannot be naturally understood, what else but a supernatural power can explain it? Concepts of chance and randomness thus have been closely associated with actions of deities. After all, for something to be random, it must, by definition, defy all explanation. Many ancient cultures were fascinated with games of chance, such as throwing dice or flipping coins, and interpreted their outcomes as prescriptions of fate. To play a game of chance was to probe the supernatural world. In ancient Rome, the goddess Fortuna was the deity who determined fortune and fate; the two concepts were naturally inseparable. Randomness, in many ways, is simply a lack of understanding. Democritus of an- cient Greece realized the subjectivity of randomness with an explanatory story (Wikipedia, 2012).
    [Show full text]
  • 115. Studies in the History of Statistics and Probability, Vol. 18
    Studies in the History of Statistics and Probability Vol. 18 Compiled by Oscar Sheynin Berlin 2020 Contents I am the author of all the contributions listed below Notation I. Prehistory of the theory of probability, 1974 II. Poisson and statistics, 2012 III. Simon Newcomb as a statistician, 2002 IV. Mathematical treatment of astronomical observations, 1973 V. Gauss and geodetic observations, 1994 VI. Gauss, Bessel and the adjustment of triangulation, 2001 VII. The theory of probability. Definition and relation with statistics, 1998 [email protected] 2 Notation Notation S, G, n refers to downloadable file n placed on my website www.sheynin.de which is being diligently copied by Google (Google, Oscar Sheynin, Home). I apply this notation in case of sources either rare or those in my translation into English. L, M, R = Leningrad, Moscow, in Russian 3 I On the Prehistory of the Theory of Probability Arch. Hist. Ex. Sci., vol. 12, N. 2, 1974, pp. 97 – 141 1. Introduction Evidently, none of the traditional sciences busies itself about the accidental, says ARISTOTLE1, continuing that this (the accidental) none of the recognized sciences considers, but only sophistic‚ and repeats himself m other places2. However, this opinion is wide of the mark since neither does the modern theory of probability busy itself with chance, but rather with the laws of chance, with the probable2a. And ARISTOTLE describes rhetoric as an art of persuasion based on probabilities (§ 3.2). Moreover, reasoning on the probable abound in various sciences in antiquity. The study of this aspect of various sciences before the origin of the theory of probability (i.
    [Show full text]
  • The Evolution of Technical Analysis Lo “A Movement Is Over When the News Is Out,” So Goes Photo: MIT the Evolution the Wall Street Maxim
    Hasanhodzic $29.95 USA / $35.95 CAN PRAISE FOR The Evolution of Technical Analysis Lo “A movement is over when the news is out,” so goes Photo: MIT Photo: The Evolution the Wall Street maxim. For thousands of years, tech- ANDREW W. LO is the Harris “Where there is a price, there is a market, then analysis, and ultimately a study of the analyses. You don’t nical analysis—marred with common misconcep- & Harris Group Professor of Finance want to enter this circle without a copy of this book to guide you through the bazaar and fl ash.” at MIT Sloan School of Management tions likening it to gambling or magic and dismissed —Dean LeBaron, founder and former chairman of Batterymarch Financial Management, Inc. and the director of MIT’s Laboratory by many as “voodoo fi nance”—has sought methods FINANCIAL PREDICTION of Technical Analysis for Financial Engineering. He has for spotting trends in what the market’s done and “The urge to fi nd order in the chaos of market prices is as old as civilization itself. This excellent volume published numerous papers in leading academic what it’s going to do. After all, if you don’t learn from traces the development of the tools and insights of technical analysis over the entire span of human history; FINANCIAL PREDICTION FROM BABYLONIAN history, how can you profi t from it? and practitioner journals, and his books include beginning with the commodity price and astronomical charts of Mesopotamia, through the Dow Theory The Econometrics of Financial Markets, A Non- of the early twentieth century—which forecast the Crash of 1929—to the analysis of the high-speed TABLETS TO BLOOMBERG TERMINALS Random Walk Down Wall Street, and Hedge Funds: electronic marketplace of today.
    [Show full text]
  • Russian Papers on the History of Probability and Statistics Translated by the Author Berlin 2004 (C) Oscar Sheynin
    Russian Papers on the History of Probability and Statistics Translated by the Author Berlin 2004 (C) Oscar Sheynin www.sheynin.de Contents Introduction 1. Review of Kendall, M.G., Doig, A.G. Bibliography of Statistical Literature Pre-1940 with Supplements to the Volumes for 1940 – 1949 and 1950 – 1958. Edinburgh, 1968. Novye Knigi za Rubezhom , ser. A, No. 10, 1969, 2. On the work of Adrain in the theory of errors. Istoriko-Matematicheskie Issledovania (IMI), vol. 16, 1965, pp. 325 – 336 3. On the history of the iterative methods of solving systems of linear algebraic equations. Trudy IX Nauchn Konf. Aspirantov i Mladsh. Nauchn. Sotrundn. Inst. Istorii Estestvoznania iTekhniki , Sektsia istorii fiz. i mat. nauk. Moscow, 1966, pp. 8 – 12 4. On selection and adjustment of direct observations. Izvestia Vuzov. Geodezia i Aerofotos’emka No. 2, 1966, pp. 107 – 112 5. On the history of the adjustment of indirect observations. Ibidem, No. 3, 1967, pp. 25 – 32 6. Some Issues in the History of the Theory of Errors. Abstract of dissertation. Moscow, 1967. Published as a manuscript. Inst. Istorii Estestvoznania i Tekhniki 7. On the work of Bayes in the theory of probability. Trudy XII Nauchn. Konf. Aspirantov i Mladsh. Nauchn. Sotrudn. Inst. Istorii Estestvoznania I Tekhniki , Sektsia istorii mat. i mekh. nauk. Moscow, 1969, pp. 40 – 57 8. On the history of the De Moivre – Laplace limit theorem. Istoria i Metodologia Estestven. Nauk , vol. 9, 1970, pp. 199 – 211 9. On the appearance of the Dirac delta-function in a memoir of Laplace. IMI, vol. 20, 1975, pp. 303 – 308 10.
    [Show full text]
  • On Randomness As a Principle of Structure and Computation in Neural Networks
    Research Collection Doctoral Thesis On randomness as a principle of structure and computation in neural networks Author(s): Weissenberger, Felix Publication Date: 2018 Permanent Link: https://doi.org/10.3929/ethz-b-000312548 Rights / License: In Copyright - Non-Commercial Use Permitted This page was generated automatically upon download from the ETH Zurich Research Collection. For more information please consult the Terms of use. ETH Library Felix Weissenberger On randomness as a principle of structure and com- putation in neural networks Diss. ETH No. 25298 2018 ONRANDOMNESSASAPRINCIPLEOFSTRUCTURE AND COMPUTATION IN NEURAL NETWORKS Diss. ETH No. 25298 On randomness as a principle of structure and computation in neural networks A thesis submitted to attain the degree of DOCTOROFSCIENCES of ETHZURICH (Dr. sc. ETH Zurich) presented by FELIXWEISSENBERGER MSc ETH in Theoretical Computer Science born on 04.08.1989 citizen of Germany accepted on the recommendation of Prof. Dr. Angelika Steger Prof. Dr. Jean-Pascal Pfister Dr. Johannes Lengler 2018 Contents Abstract iii Zusammenfassung v Thanks vii 1 Introduction 1 2 Emergence of synfire chains 19 3 Rate based learning with short stimuli 79 4 Mutual inhibition with few inhibitory cells 109 5 Lognormal synchrony in CA1 125 Bibliography 163 i Abstract This work examines the role of randomness in structure and informa- tion processing of biological neural networks and how it may improve our understanding of the nervous system. Our approach is motivated by the pragmatic observation that many components and processes in the brain are intrinsically stochastic. Therefore, probability theory and its methods are particularly well suited for its analysis and modeling.
    [Show full text]
  • Randomness Extractors in Mobile Devices
    MASARYK UNIVERSITY FACULTY}w¡¢£¤¥¦§¨ OF I !"#$%&'()+,-./012345<yA|NFORMATICS Randomness extractors in mobile devices MASTER’S THESIS Filip Jurneˇcka Brno, Spring 2010 Declaration Hereby I declare, that this paper is my original authorial work, which I have worked out by my own. All sources, references and literature used or excerpted during elaboration of this work are properly cited and listed in complete reference to the due source. Brno, May 25, 2010 Filip Jurneˇcka Advisor: RNDr. Jan Bouda, Ph.D. ii Acknowledgement I would like to thank my mother for her unyielding support and belief in me. I would also like to thank all of those who helped me to get through my studies. iii Abstract Objective of this thesis is to give an overview of the problematics of ran- domness extractors with focus on searching an extractor suitable for gen- erating random numbers for cryptographic applications in mobile devices. Selected extractors based on their suitability for given application will be implemented in mobile device on a platform chosen by student. iv Keywords Evaluation hash, extractor, JavaME, mobile, pseudorandom, randomness, shift register hash, truly random, weak source. v Contents Chapter outline . 3 1 Introduction ............................... 5 1.1 Troubles with implementations of PRNGs ........... 6 1.2 Usage of randomness ....................... 7 1.2.1 Deterministic vs randomized algorithms . 7 1.2.2 Randomness in cryptography . 10 2 Sources of randomness ........................ 13 2.1 Definitions ............................. 13 2.2 Weak random sources ...................... 15 3 Randomness extractors ........................ 20 3.1 Preliminaries ............................ 20 3.2 Definitions ............................. 23 3.3 Tradeoffs .............................. 24 3.3.1 Simulating BPP . 24 3.3.2 Lower bounds .
    [Show full text]