Robert E. Kass Maurice Falk Professor of Statistics & Computational Neuroscience
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
National Academy Elects IMS Fellows Have You Voted Yet?
Volume 38 • Issue 5 IMS Bulletin June 2009 National Academy elects IMS Fellows CONTENTS The United States National Academy of Sciences has elected 72 new members and 1 National Academy elects 18 foreign associates from 15 countries in recognition of their distinguished and Raftery, Wong continuing achievements in original research. Among those elected are two IMS Adrian Raftery 2 Members’ News: Jianqing Fellows: , Blumstein-Jordan Professor of Statistics and Sociology, Center Fan; SIAM Fellows for Statistics and the Social Sciences, University of Washington, Seattle, and Wing Hung Wong, Professor 3 Laha Award recipients of Statistics and Professor of Health Research and Policy, 4 COPSS Fisher Lecturer: Department of Statistics, Stanford University, California. Noel Cressie The election was held April 28, during the business 5 Members’ Discoveries: session of the 146th annual meeting of the Academy. Nicolai Meinshausen Those elected bring the total number of active members 6 Medallion Lecture: Tony Cai to 2,150. Foreign associates are non-voting members of the Academy, with citizenship outside the United States. Meeting report: SSP Above: Adrian Raftery 7 This year’s election brings the total number of foreign 8 New IMS Fellows Below: Wing H. Wong associates to 404. The National Academy of Sciences is a private 10 Obituaries: Keith Worsley; I.J. Good organization of scientists and engineers dedicated to the furtherance of science and its use for general welfare. 12-3 JSM program highlights; It was established in 1863 by a congressional act of IMS sessions at JSM incorporation signed by Abraham Lincoln that calls on 14-5 JSM tours; More things to the Academy to act as an official adviser to the federal do in DC government, upon request, in any matter of science or 16 Accepting rejections technology. -
The Meaning of Probability
CHAPTER 2 THE MEANING OF PROBABILITY INTRODUCTION by Glenn Shafer The meaning of probability has been debated since the mathematical theory of probability was formulated in the late 1600s. The five articles in this section have been selected to provide perspective on the history and present state of this debate. Mathematical statistics provided the main arena for debating the meaning of probability during the nineteenth and early twentieth centuries. The debate was conducted mainly between two camps, the subjectivists and the frequentists. The subjectivists contended that the probability of an event is the degree to which someone believes it, as indicated by their willingness to bet or take other actions. The frequentists contended that probability of an event is the frequency with which it occurs. Leonard J. Savage (1917-1971), the author of our first article, was an influential subjectivist. Bradley Efron, the author of our second article, is a leading contemporary frequentist. A newer debate, dating only from the 1950s and conducted more by psychologists and economists than by statisticians, has been concerned with whether the rules of probability are descriptive of human behavior or instead normative for human and machine reasoning. This debate has inspired empirical studies of the ways people violate the rules. In our third article, Amos Tversky and Daniel Kahneman report on some of the results of these studies. In our fourth article, Amos Tversky and I propose that we resolve both debates by formalizing a constructive interpretation of probability. According to this interpretation, probabilities are degrees of belief deliberately constructed and adopted on the basis of evidence, and frequencies are only one among many types of evidence. -
Strength in Numbers: the Rising of Academic Statistics Departments In
Agresti · Meng Agresti Eds. Alan Agresti · Xiao-Li Meng Editors Strength in Numbers: The Rising of Academic Statistics DepartmentsStatistics in the U.S. Rising of Academic The in Numbers: Strength Statistics Departments in the U.S. Strength in Numbers: The Rising of Academic Statistics Departments in the U.S. Alan Agresti • Xiao-Li Meng Editors Strength in Numbers: The Rising of Academic Statistics Departments in the U.S. 123 Editors Alan Agresti Xiao-Li Meng Department of Statistics Department of Statistics University of Florida Harvard University Gainesville, FL Cambridge, MA USA USA ISBN 978-1-4614-3648-5 ISBN 978-1-4614-3649-2 (eBook) DOI 10.1007/978-1-4614-3649-2 Springer New York Heidelberg Dordrecht London Library of Congress Control Number: 2012942702 Ó Springer Science+Business Media New York 2013 This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. Exempted from this legal reservation are brief excerpts in connection with reviews or scholarly analysis or material supplied specifically for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work. Duplication of this publication or parts thereof is permitted only under the provisions of the Copyright Law of the Publisher’s location, in its current version, and permission for use must always be obtained from Springer. -
Memorial to Sir Harold Jeffreys 1891-1989 JOHN A
Memorial to Sir Harold Jeffreys 1891-1989 JOHN A. HUDSON and ALAN G. SMITH University of Cambridge, Cambridge, England Harold Jeffreys was one of this century’s greatest applied mathematicians, using mathematics as a means of under standing the physical world. Principally he was a geo physicist, although statisticians may feel that his greatest contribution was to the theory of probability. However, his interest in the latter subject stemmed from his realization of the need for a clear statistical method of analysis of data— at that time, travel-time readings from seismological stations across the world. He also made contributions to astronomy, fluid dynamics, meteorology, botany, psychol ogy, and photography. Perhaps one can identify Jeffreys’s principal interests from three major books that he wrote. His mathematical skills are displayed in Methods of Mathematical Physics, which he wrote with his wife Bertha Swirles Jeffreys and which was first published in 1946 and went through three editions. His Theory o f Probability, published in 1939 and also running to three editions, espoused Bayesian statistics, which were very unfashionable at the time but which have been taken up since by others and shown to be extremely powerful for the analysis of data and, in particular, image enhancement. However, the book for which he is probably best known is The Earth, Its Origin, History and Physical Consti tution, a broad-ranging account based on observations analyzed with care, using mathematics as a tool. Jeffreys’s scientific method (now known as Inverse Theory) was a logical process, clearly stated in another of his books, Scientific Inference. -
Cramer, and Rao
2000 PARZEN PRIZE FOR STATISTICAL INNOVATION awarded by TEXAS A&M UNIVERSITY DEPARTMENT OF STATISTICS to C. R. RAO April 24, 2000 292 Breezeway MSC 4 pm Pictures from Parzen Prize Presentation and Reception, 4/24/2000 The 2000 EMANUEL AND CAROL PARZEN PRIZE FOR STATISTICAL INNOVATION is awarded to C. Radhakrishna Rao (Eberly Professor of Statistics, and Director of the Center for Multivariate Analysis, at the Pennsylvania State University, University Park, PA 16802) for outstanding distinction and eminence in research on the theory of statistics, in applications of statistical methods in diverse fields, in providing international leadership for 55 years in directing statistical research centers, in continuing impact through his vision and effectiveness as a scholar and teacher, and in extensive service to American and international society. The year 2000 motivates us to plan for the future of the discipline of statistics which emerged in the 20th century as a firmly grounded mathematical science due to the pioneering research of Pearson, Gossett, Fisher, Neyman, Hotelling, Wald, Cramer, and Rao. Numerous honors and awards to Rao demonstrate the esteem in which he is held throughout the world for his unusually distinguished and productive life. C. R. Rao was born September 10, 1920, received his Ph.D. from Cambridge University (England) in 1948, and has been awarded 22 honorary doctorates. He has worked at the Indian Statistical Institute (1944-1992), University of Pittsburgh (1979- 1988), and Pennsylvania State University (1988- ). Professor Rao is the author (or co-author) of 14 books and over 300 publications. His pioneering contributions (in linear models, multivariate analysis, design of experiments and combinatorics, probability distribution characterizations, generalized inverses, and robust inference) are taught in statistics textbooks. -
A Parsimonious Tour of Bayesian Model Uncertainty
A Parsimonious Tour of Bayesian Model Uncertainty Pierre-Alexandre Mattei Université Côte d’Azur Inria, Maasai project-team Laboratoire J.A. Dieudonné, UMR CNRS 7351 e-mail: [email protected] Abstract: Modern statistical software and machine learning libraries are enabling semi-automated statistical inference. Within this context, it appears eas- ier and easier to try and fit many models to the data at hand, thereby reversing the Fisherian way of conducting science by collecting data after the scientific hypothesis (and hence the model) has been determined. The renewed goal of the statistician becomes to help the practitioner choose within such large and heterogeneous families of models, a task known as model selection. The Bayesian paradigm offers a systematized way of as- sessing this problem. This approach, launched by Harold Jeffreys in his 1935 book Theory of Probability, has witnessed a remarkable evolution in the last decades, that has brought about several new theoretical and methodological advances. Some of these recent developments are the focus of this survey, which tries to present a unifying perspective on work carried out by different communities. In particular, we focus on non-asymptotic out-of-sample performance of Bayesian model selection and averaging tech- niques, and draw connections with penalized maximum likelihood. We also describe recent extensions to wider classes of probabilistic frameworks in- cluding high-dimensional, unidentifiable, or likelihood-free models. Contents 1 Introduction: collecting data, fitting many models . .2 2 A brief history of Bayesian model uncertainty . .2 3 The foundations of Bayesian model uncertainty . .3 3.1 Handling model uncertainty with Bayes’s theorem . -
Statistical Inference: Paradigms and Controversies in Historic Perspective
Jostein Lillestøl, NHH 2014 Statistical inference: Paradigms and controversies in historic perspective 1. Five paradigms We will cover the following five lines of thought: 1. Early Bayesian inference and its revival Inverse probability – Non-informative priors – “Objective” Bayes (1763), Laplace (1774), Jeffreys (1931), Bernardo (1975) 2. Fisherian inference Evidence oriented – Likelihood – Fisher information - Necessity Fisher (1921 and later) 3. Neyman- Pearson inference Action oriented – Frequentist/Sample space – Objective Neyman (1933, 1937), Pearson (1933), Wald (1939), Lehmann (1950 and later) 4. Neo - Bayesian inference Coherent decisions - Subjective/personal De Finetti (1937), Savage (1951), Lindley (1953) 5. Likelihood inference Evidence based – likelihood profiles – likelihood ratios Barnard (1949), Birnbaum (1962), Edwards (1972) Classical inference as it has been practiced since the 1950’s is really none of these in its pure form. It is more like a pragmatic mix of 2 and 3, in particular with respect to testing of significance, pretending to be both action and evidence oriented, which is hard to fulfill in a consistent manner. To keep our minds on track we do not single out this as a separate paradigm, but will discuss this at the end. A main concern through the history of statistical inference has been to establish a sound scientific framework for the analysis of sampled data. Concepts were initially often vague and disputed, but even after their clarification, various schools of thought have at times been in strong opposition to each other. When we try to describe the approaches here, we will use the notions of today. All five paradigms of statistical inference are based on modeling the observed data x given some parameter or “state of the world” , which essentially corresponds to stating the conditional distribution f(x|(or making some assumptions about it). -
School of Social Sciences Economics Division University of Southampton Southampton SO17 1BJ, UK
School of Social Sciences Economics Division University of Southampton Southampton SO17 1BJ, UK Discussion Papers in Economics and Econometrics Professor A L Bowley’s Theory of the Representative Method John Aldrich No. 0801 This paper is available on our website http://www.socsci.soton.ac.uk/economics/Research/Discussion_Papers ISSN 0966-4246 Key names: Arthur L. Bowley, F. Y. Edgeworth, , R. A. Fisher, Adolph Jensen, J. M. Keynes, Jerzy Neyman, Karl Pearson, G. U. Yule. Keywords: History of Statistics, Sampling theory, Bayesian inference. Professor A. L. Bowley’s Theory of the Representative Method * John Aldrich Economics Division School of Social Sciences University of Southampton Southampton SO17 1BJ UK e-mail: [email protected] Abstract Arthur. L. Bowley (1869-1957) first advocated the use of surveys–the “representative method”–in 1906 and started to conduct surveys of economic and social conditions in 1912. Bowley’s 1926 memorandum for the International Statistical Institute on the “Measurement of the precision attained in sampling” was the first large-scale theoretical treatment of sample surveys as he conducted them. This paper examines Bowley’s arguments in the context of the statistical inference theory of the time. The great influence on Bowley’s conception of statistical inference was F. Y. Edgeworth but by 1926 R. A. Fisher was on the scene and was attacking Bayesian methods and promoting a replacement of his own. Bowley defended his Bayesian method against Fisher and against Jerzy Neyman when the latter put forward his concept of a confidence interval and applied it to the representative method. * Based on a talk given at the Sample Surveys and Bayesian Statistics Conference, Southampton, August 2008. -
The Enigma of Karl Pearson and Bayesian Inference
The Enigma of Karl Pearson and Bayesian Inference John Aldrich 1 Introduction “An enigmatic position in the history of the theory of probability is occupied by Karl Pearson” wrote Harold Jeffreys (1939, p. 313). The enigma was that Pearson based his philosophy of science on Bayesian principles but violated them when he used the method of moments and probability-values in statistics. It is not uncommon to see a divorce of practice from principles but Pearson also used Bayesian methods in some of his statistical work. The more one looks at his writings the more puzzling they seem. In 1939 Jeffreys was probably alone in regretting that Pearson had not been a bottom to top Bayesian. Bayesian methods had been in retreat in English statistics since Fisher began attacking them in the 1920s and only Jeffreys ever looked for a synthesis of logic, statistical methods and everything in between. In the 1890s, when Pearson started, everything was looser: statisticians used inverse arguments based on Bayesian principles and direct arguments based on sampling theory and a philosopher-physicist-statistician did not have to tie everything together. Pearson did less than his early guide Edgeworth or his students Yule and Gosset (Student) to tie up inverse and direct arguments and I will be look- ing to their work for clues to his position and for points of comparison. Of Pearson’s first course on the theory of statistics Yule (1938, p. 199) wrote, “A straightforward, organized, logically developed course could hardly then [in 1894] exist when the very elements of the subject were being developed.” But Pearson never produced such a course or published an exposition as integrated as Yule’s Introduction, not to mention the nonpareil Probability of Jeffreys. -
Mathematical Statistics and the ISI (1885-1939)
Mathematical Statistics and the ISI (1885-1939) Stephen M. Stigler University of Chicago, Department of Statistics 5734 University Avenue Chicago IL 60637, USA [email protected] 1. Introduction From its inception in 1885, the International Statistical Institute took all of statistics as its province. But the understood meaning of “statistics” has undergone significant change over the life of the Institute, and it is of interest to inquire how that change, whether evolutionary or revolutionary, has been reflected in the business of the Institute, in its meetings and its membership. I propose to consider this question in regard to one particular dimension, that of mathematical statistics, and one particular period, that from the rebirth of international statistics in 1885 until the eve of World War II. Mathematical statistics has been a recognized division of statistics at least since the 1860s, when Quetelet at the Congress in the Hague admonished the assembled statisticians not to divide the école mathématique from the école historique, but to take statistics whole, to open the doors to statistics in the broadest sense in all its flavors (Stigler, 2000). But even with this recognition, mathematical statistics only emerged as a discipline later. I have argued elsewhere that this emergence can be dated to the year 1933, and even if one thinks that date absurdly precise, there was a distinct and palpable change that was evident around that time (Stigler, 1999, Ch. 8). It was then that changes initiated a half-century earlier by Galton and Edgeworth and developed subsequently by Karl Pearson and Udny Yule, were seized upon and transformed by Ronald Fisher and Jerzy Neyman and Egon S. -
Bayesian Data-Analysis Toolbox User Manual
Bayesian Data-Analysis Toolbox Release 4.23, Manual Version 3 G. Larry Bretthorst Biomedical MR Laboratory Washington University School Of Medicine, Campus Box 8227 Room 2313, East Bldg., 4525 Scott Ave. St. Louis MO 63110 http://bayes.wustl.edu Email: [email protected] September 18, 2018 Appendix C Thermodynamic Integration Thermodynamic Integration is a technique used in Bayesian probability theory to compute the posterior probability for a model. As a reminder, if a set of m models is designated as M 2 f1; 2; : : : ; mg, then one can compute the posterior probability for the models by an application of Bayes' Theorem [1] P (MjDI) / P (MjI)P (DjMI) (C.1) where we have dropped a normalization constant, M = 1 means we are computing the posterior probability for model 1, M = 2 the probability for model 2, etc. The three terms in this equation, going from left to right, are the posterior probability for the model indicator given the data and the prior information, P (MjDI), the prior probability for the model given only the prior information, P (MjI), and the marginal direct probability for the data given the model and the prior information, P (DjMI). The marginal direct probability for the data given a model can be computed from the joint posterior probability for the data and the model parameters, which we will call Ω, given the Model and the prior information Z P (DjMI) = dΩP (ΩjMI)P (DjΩMI): (C.2) Unfortunately, the integrals on the right-hand side of this equation can be very high dimensional. Consequently, although we know exactly what calculation must be done to compute the marginal direct probability, in most applications the integrals are not tractable. -
David Donoho. 50 Years of Data Science. Journal of Computational
Journal of Computational and Graphical Statistics ISSN: 1061-8600 (Print) 1537-2715 (Online) Journal homepage: https://www.tandfonline.com/loi/ucgs20 50 Years of Data Science David Donoho To cite this article: David Donoho (2017) 50 Years of Data Science, Journal of Computational and Graphical Statistics, 26:4, 745-766, DOI: 10.1080/10618600.2017.1384734 To link to this article: https://doi.org/10.1080/10618600.2017.1384734 © 2017 The Author(s). Published with license by Taylor & Francis Group, LLC© David Donoho Published online: 19 Dec 2017. Submit your article to this journal Article views: 46147 View related articles View Crossmark data Citing articles: 104 View citing articles Full Terms & Conditions of access and use can be found at https://www.tandfonline.com/action/journalInformation?journalCode=ucgs20 JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS , VOL. , NO. , – https://doi.org/./.. Years of Data Science David Donoho Department of Statistics, Stanford University, Standford, CA ABSTRACT ARTICLE HISTORY More than 50 years ago, John Tukey called for a reformation of academic statistics. In “The Future of Data science Received August Analysis,” he pointed to the existence of an as-yet unrecognized , whose subject of interest was Revised August learning from data, or “data analysis.” Ten to 20 years ago, John Chambers, Jeff Wu, Bill Cleveland, and Leo Breiman independently once again urged academic statistics to expand its boundaries beyond the KEYWORDS classical domain of theoretical statistics; Chambers called for more emphasis on data preparation and Cross-study analysis; Data presentation rather than statistical modeling; and Breiman called for emphasis on prediction rather than analysis; Data science; Meta inference.