P.J. Green 1994.Pdf

Total Page:16

File Type:pdf, Size:1020Kb

P.J. Green 1994.Pdf MONOGRAPHS ON STATISTICS AND APPLIED PROBABILITY General Editors D.R. Cox, D.V. Hinkley, N. Reid, D.B. Rubin and B.W. Silverman Stochastic Population Models in Ecology and Epidemology MS. Bartlett (1960) 2 Queues D.R. Cox and W.L. Smith (1961) 3 Monte Carlo Methods J.M Hammersley and D.C. Handscomb (1964) 4 The Statistical Analysis of Series of Events D.R. Cox and P.A.W. Lewis (1966) 5 Population Genetics W.J. Ewens (1969) 6 Probability, Statistics and Time MS. Barlett (1975) 7 Statistical Inference S.D. S/ivey (1975) 8 The Analysis .of Contingency Tables B.S. Everitt (1977) 9 Multivariate Analysis in Behavioural Research A.E. Maxwell (1977) 10 Stochastic Abundance Models S. Engen (1978) 11 Some Basic Theory for Statistical Inference E.J.G. Pitman (1978) 12 Point Processes D.R. Cox and V. Isham (1980) 13 Identification of Outliers D.M Hawkins (1980) 14 Optimal Design S.D. Silvey (1980) 15 Finite Mixture Distributions B.S. Everitt and D.J. Hand (1981) 16 Classification A.D. Gordon (1981) 17 Distribution-free Statistical Methods J.S. Maritz (1981) 18 Residuals and Influence in Regression R.D. Cook and S. Weisberg(1982) 19 Applications of Queueing Theory G.F. Newell (1982) 20 Risk Theory, 3rd edition R.E. Beard, T Pentikainen and E. Pesonen (1984) 21 Analysis of Survival Data D.R. Cox and D. Oakes (1984) 22 An Introduction to Latent Variable Models B.S. Everitt (1984) 23 Bandit Problems D.A. Berry and B. Fristedt (1985) 24 Stochastic Modelling and Control MHA. Davis and R. Vinter (1985) 25 The Statistical Analysis of Compositional Data J. Aitchison (1986) 26 Density Estimation for Statistical and Data Analysis B. W. Silverman 27 Regression Analysis with Application G.B. Wetherill (1986) 28 Sequential Methods in Statistics, 3rd edition G.B. Wetherill (1986) 29 Tensor Methods in Statistics P. McCullagh (1987) 30 Transformation and Weighting in Regression R.J. Carroll and D. Ruppert (1988) 31 Asymptotic Techniques foe Use in Statistics O.E. Barndor.ff-Nielson and D.R. Cox (1989) 32 Analysis of Binary Data, 2nd edition D.R Cox and E.J. Snell (1989) 33 Analysis of Infectious Disease Data N.G. Becker (1989) 34 Design and Analysis of Cross-Over Trials B. Jones and MG. Kenward (1989) 35 Empirical Bayes Method, 2nd edition J.S. Maritz and T. Lwin (1989) 36 Symmetric Multivariate and Related Distributions K.-T. Fang S. Kotz and K. Ng (1989) 37 Generalized Linear Models, 2nd edition P. McCullagh and J.A. Neider (1989) 38 Cyclic Designs J.A. John (1987) 39 Analog Estimation Mehtods in Econometrics C.F. Manski (1988) 40 Subset Selection in Regression A.J. Miller (1990) 41 Analysis of Repeated Measures M Crowder and D.J. Hand (1990) 42 Statistical Reasoning with Imprecise Probabilities P. Walley (1990) 43 Generalized Additive Models T.J. Hastie and R.J. Tibshirani (1990) 44 Inspection Errors for Attributes in Quality Control N.L. Johnson, S. Kotz and X Wu (1991) 45 The Analysis of Contingency Tables, 2nd edition B.S. Everitt (1992) 4 7 Longitudinal Data with Serial Correlation: A State-space Approach R.H Jones (1993) 48 Differential Geometry and Statistics MK. Murray and J.W. Rice (1993) 49 Markov Models and Optimization MHA. Davis (1993) 50 Networks and Chaos - Statistical and Probalistic Aspects O.E. Barndorff-Nielson, J.H Jensen and W.S. Kendall (1993) 51 Number Theoretic Methods in Statistics K.-T. Fang andY. Wang (1993) 52 Inference and Asymptotics D.R Cox and O.E. Barndorff-Nielson (1994) 53 Practical Risk Theory for Actuaries C.D. Daykin, T. Pentikiiinen and M Pesonen (1993) 54 Statistical Concepts and Applications in Medicine J. Aitchison and LJ. Lauder (1994) 55 Predictive Inference S. Geisser (1993) 56 Model Free Curve Estimation M Tartar and M Lock (1994) 57 An Introduction to the Bootstrap B. Efron and R. Tibshirani (1993) 58 Nonparametric Regression and Generalized Linear Models P.J. Green and B. W. Silverman (1994) (Full details concerning this series are available from the publisher) Nonparametric Regression and Generalized Linear Models A ROUGHNESS PENALTY APPROACH P.J.GREEN and B.W. SILVERMAN School of Mathematics University of Bristol UK SPRINGER-SCIENCE+BUSINESS MEDIA, B.V. First edition 1994 © P.J. Green and B.B. Silverman 1994 Originally published by Chapman & Hall in 1994 So ftc over reprint of the hardcover 1st edition 1994 ISBN 978-0-412-30040-0 ISBN 978-1-4899-4473-3 (eBook) DOI 10.1007/978-1-4899-4473-3 Apart from any fair dealing for the purposes of research or private study, or criticism or review, as pennitted under the UK Copyright Designs and Patents Act, 1988, this publication may not be reproduced, stored, or transmitted, in any form or by any means, without the prior permission in writing of the publishers, or in the case of reprographic reproduction only in accordance with the terms of the licences issued by the Copyright Licensing Agency in the UK, or in accordance with the terms of licences issued by the appropriate Reproduction Rights Organization outside the UK. Enquiries concerning reproduction outside the terms stated here should be sent to the publishers at the London address printed on this page. The publisher makes no representation, express or implied, with regard to the accuracy of the information contained in this book and cannot accept any legal responsibility or liability for any errors or omissions that may be made. A catalogue record for this book is available from the British Library Library of Congress Cataloging-in-Publication data available Contents Preface xi 1 Introduction 1 1.1 Approaches to regression 1 1.1.1 Linear regression 1 1.1.2 Polynomial regression 2 1.2 Roughness penalties 2 1.2.1 The aims of curve fitting 2 1.2.2 Quantifying the roughness of a curve 4 1.2.3 Penalized least squares regression 5 1.3 Extensions of the roughness penalty approach 7 1.4 Computing the estimates 9 1.5 Further reading 9 2 Interpolating and smoothing splines 11 2.1 Cubic splines 11 2.1.1 What is a cubic spline? 11 2.1.2 The value-second derivative representation 12 2.2 Interpolating splines 13 2.2.1 Constructing the interpolating natural cubic spline 15 2.2.2 Optimality properties of the natural cubic spline interpolant 16 2.3 Smoothing splines 17 2.3.1 Restricting the class of functions to be considered 18 2.3.2 Existence and uniqueness of the minimizing spline curve 18 2.3.3 The Reinsch algorithm 19 2.3.4 Some concluding remarks 21 2.4 Plotting a natural cubic spline 22 vi CONTENTS 2.4.1 Constructing a cubic given values and second derivatives at the ends of an interval 22 2.4.2 Plotting the entire cubic spline 23 2.5 Some background technical properties 24 2.5.1 The key property for g to be a natural cubic spline 24 2.5.2 Expressions for the roughness penalty 24 2.6 Band matrix manipulations 25 2.6.1 The Cholesky decomposition 26 2.6.2 Solving linear equations 26 3 One-dimensional case: further topics 29 3.1 Choosing the smoothing parameter 29 3.2 Cross-validation 30 3.2.1 Efficient calculation of the cross-validation score 31 3.2.2 Finding the diagonal elements of the hat matrix 33 3.3 Generalized cross-validation 35 3.3.1 The basic idea 35 3.3.2 Computational aspects 35 3.3.3 Leverage values 36 3.3.4 Degrees of freedom 37 3.4 Estimating the residual variance 38 3.4.1 Local differencing 38 3.4.2 Residual sum of squares about a fitted curve 39 3.4.3 Some comparisons 40 3.5 Weighted smoothing 40 3.5.1 Basic properties of the weighted formulation 41 3.5.2 The Reinsch algorithm for weighted smoothing 41 3.5.3 Cross-validation for weighted smoothing 42 3.5.4 Tied design points 43 3.6 The basis functions approach 44 3.6.1 Details of the calculations 46 3.7 The equivalent kernel 47 3.7.1 Roughness penalty and kernel methods 47 3.7.2 Approximating the weight function 47 3.8 The philosophical basis of roughness penalties 49 3.8.1 Penalized likelihood 50 3.8.2 The bounded roughness approach 51 3.8.3 The Bayesian approach 51 3.8.4 A finite-dimensional Bayesian formulation 54 3.8.5 Bayesian inference for functionals of the curve 55 3.9 Nonparametric Bayesian calibration 57 3.9.1 The monotonicity constraint 58 CONTENTS vii 3.9.2 Accounting for the error in the prediction observation 59 3.9.3 Considerations of efficiency 59 3.9.4 An application in forensic odontology 60 4 Partial splines 63 4.1 Introduction 63 4.2 The semiparametric formulation 64 4.3 Penalized least squares for semi parametric models 65 4.3.1 Incidence matrices 65 4.3.2 Characterizing the minimum 65 4.3.3 Uniqueness of the solution 66 4.3.4 Finding the solution in practice 68 4.3.5 A direct method 69 4.4 Cross-validation for partial spline models 70 4.5 A marketing example 71 4.5.1 A partial spline approach 72 4.5.2 Comparison with a parametric model 73 4.6 Application to agricultural field trials 75 4.6.1 A discrete roughness penalty approach 75 4.6.2 Two spring barley trials 77 4.7 The relation between weather and electricity sales 79 4.7.1 The observed data and the model assumed 79 4.7.2 Estimating the temperature response 81 4.8 Additive models 83 4.9 An alternative approach to partial spline fitting 85 4.9.1 Speckman's algorithm 85 4.9.2 Application: the marketing data 86 4.9.3 Comparison with the penalized least squares method 86 5 Generalized linear models 89 5.1 Introduction 89 5.1.1 Unifying regression models 89 5.1.2 Extending the model 90 5.2 Generalized linear models 91 5.2.1 Exponential families 91 5.2.2 Maximum likelihood estimation 93 5.2.3 Fisher scoring 94 5.2.4 Iteratively reweighted least squares 95 5.2.5 Inference in GLMs 95 5.3 A first look at nonparametric GLMs 98 viii CONTENTS 5.3.1 Relaxing parametric assumptions
Recommended publications
  • Agenda and Minutes of the UK Statistics Authority Meeting on 6
    UK STATISTICS AUTHORITY Minutes Thursday, 6 June 2013 Boardroom, Titchfield Present UK Statistics Authority Sir Andrew Dilnot (Chair) Professor David Rhind Professor Sir Adrian Smith Mr Richard Alldritt Mr Partha Dasgupta Ms Carolyn Fairbairn Dame Moira Gibb Professor David Hand Dr David Levy Ms Jil Matheson Mr Glen Watson Secretariat Mr Robert Bumpstead Mr Joe Cuddeford Apologies Dr Colette Bowe Other attendees Mr Peter Benton, Mr Alistair Calder and Mr Ian Cope (for item 7) Minutes 1. Apologies 1.1 Apologies were received from Dr Bowe. 2. Declarations of interest 2.1 There were no declarations of interest. 3. Minutes, matters arising from the previous meetings 3.1 The minutes of the previous meeting held on 9 May 2013 were agreed as a true and fair account. 3.2 It was confirmed that a paper from ONS about migration statistics would be considered at the July Authority Board meeting. 4. Authority Chair’s Report 4.1 The Chair had recently attended a meeting of the Cabinet’s Ministerial Committee on Home Affairs to discuss the future provision of population statistics for England and Wales. 4.2 The Chair would be meeting with the Work and Pensions Select Committee on 10 June to discuss official statistics in the Department for Work and Pensions. 4.3 The Chair had written to the Secretary of State for Work and Pensions, Iain Duncan Smith MP, regarding statistics about the benefit cap, and the Chairman of the Conservative Party, Grant Shapps MP, regarding statistics about the Employment and Support Allowance. 5. Reports from Authority Committee Chairs Assessment Committee 5.1 Professor Rhind reported on the meeting of the Assessment Committee held on 16 May.
    [Show full text]
  • Statistics Making an Impact
    John Pullinger J. R. Statist. Soc. A (2013) 176, Part 4, pp. 819–839 Statistics making an impact John Pullinger House of Commons Library, London, UK [The address of the President, delivered to The Royal Statistical Society on Wednesday, June 26th, 2013] Summary. Statistics provides a special kind of understanding that enables well-informed deci- sions. As citizens and consumers we are faced with an array of choices. Statistics can help us to choose well. Our statistical brains need to be nurtured: we can all learn and practise some simple rules of statistical thinking. To understand how statistics can play a bigger part in our lives today we can draw inspiration from the founders of the Royal Statistical Society. Although in today’s world the information landscape is confused, there is an opportunity for statistics that is there to be seized.This calls for us to celebrate the discipline of statistics, to show confidence in our profession, to use statistics in the public interest and to champion statistical education. The Royal Statistical Society has a vital role to play. Keywords: Chartered Statistician; Citizenship; Economic growth; Evidence; ‘getstats’; Justice; Open data; Public good; The state; Wise choices 1. Introduction Dictionaries trace the source of the word statistics from the Latin ‘status’, the state, to the Italian ‘statista’, one skilled in statecraft, and on to the German ‘Statistik’, the science dealing with data about the condition of a state or community. The Oxford English Dictionary brings ‘statistics’ into English in 1787. Florence Nightingale held that ‘the thoughts and purpose of the Deity are only to be discovered by the statistical study of natural phenomena:::the application of the results of such study [is] the religious duty of man’ (Pearson, 1924).
    [Show full text]
  • IMS Bulletin 33(5)
    Volume 33 Issue 5 IMS Bulletin September/October 2004 Barcelona: Annual Meeting reports CONTENTS 2-3 Members’ News; Bulletin News; Contacting the IMS 4-7 Annual Meeting Report 8 Obituary: Leopold Schmetterer; Tweedie Travel Award 9 More News; Meeting report 10 Letter to the Editor 11 AoS News 13 Profi le: Julian Besag 15 Meet the Members 16 IMS Fellows 18 IMS Meetings 24 Other Meetings and Announcements 28 Employment Opportunities 45 International Calendar of Statistical Events 47 Information for Advertisers JOB VACANCIES IN THIS ISSUE! The 67th IMS Annual Meeting was held in Barcelona, Spain, at the end of July. Inside this issue there are reports and photos from that meeting, together with news articles, meeting announcements, and a stack of employment advertise- ments. Read on… IMS 2 . IMS Bulletin Volume 33 . Issue 5 Bulletin Volume 33, Issue 5 September/October 2004 ISSN 1544-1881 Member News In April 2004, Jeff Steif at Chalmers University of Stephen E. Technology in Sweden has been awarded Contact Fienberg, the the Goran Gustafsson Prize in mathematics Information Maurice Falk for his work in “probability theory and University Professor ergodic theory and their applications” by Bulletin Editor Bernard Silverman of Statistics at the Royal Swedish Academy of Sciences. Assistant Editor Tati Howell Carnegie Mellon The award, given out every year in each University in of mathematics, To contact the IMS Bulletin: Pittsburgh, was named the Thorsten physics, chemistry, Send by email: [email protected] Sellin Fellow of the American Academy of molecular biology or mail to: Political and Social Science. The academy and medicine to a IMS Bulletin designates a small number of fellows each Swedish university 20 Shadwell Uley, Dursley year to recognize and honor individual scientist, consists of GL11 5BW social scientists for their scholarship, efforts a personal prize and UK and activities to promote the progress of a substantial grant.
    [Show full text]
  • Trustees' Report and Financial Statements
    Trustees’ Report and Financial Statements For the year ended 31 March 2010 02 Trustees’ Report and Financial Statements Trustees’ Report and Financial Statements 03 Trustees’ Report and Financial Statements Auditors Registered charity No 207043 Other members of the Council Contents PKF (UK) LLP Professor David Barford b Trustees Chartered Accountants and Registered Auditors Professor David Baulcombe a Trustees’ Report 03 The Trustees of the Society are the Members Farringdon Place Sir Michael Berry Independent Auditors’ Report of its Council duly elected by its Fellows. 20 Farringdon Road Professor Richard Catlow b to the Council of the Royal Society 12 London EC1M 3AP Ten of the 21 members of Council retire each Dame Kay Davies DBE a Audit Committee Report to the year in line with its Royal Charter. Dame Ann Dowling DBE Solicitors Council of the Royal Society on Professor Jeffery Errington a Needham & James LLP President the Financial Statements 13 Professor Alastair Fitter Needham & James House Lord Rees of Ludlow OM Kt Dr Matthew Freeman b Consolidated Statement of Bridgeway Treasurer and Vice-President Sir Richard Friend Financial Activities 14 Stratford upon Avon Warwickshire Sir Peter Williams CBE Professor Brian Greenwood CBE b CV37 6YY b Consolidated Balance Sheet 16 Physical Secretary and Vice-President Professor Andrew Hopper CBE Bankers Dame Louise Johnson DBE b Consolidated Cash Flow Statement 17 Sir Martin Taylor a Barclays Bank plc a Professor John Pethica b Sir John Kingman Accounting Policies 18 Level 28 Dr Tim Palmer a
    [Show full text]
  • The Royal Statistical Society Getstats Campaign Ten Years to Statistical Literacy? Neville Davies Royal Statistical Society Cent
    The Royal Statistical Society getstats Campaign Ten Years to Statistical Literacy? Neville Davies Royal Statistical Society Centre for Statistical Education University of Plymouth, UK www.rsscse.org.uk www.censusatschool.org.uk [email protected] twitter.com/CensusAtSchool RSS Centre for Statistical Education • What do we do? • Who are we? • How do we do it? • Where are we? What we do: promote improvement in statistical education For people of all ages – in primary and secondary schools, colleges, higher education and the workplace Cradle to grave statistical education! Dominic Mark John Neville Martignetti Treagust Marriott Paul Hewson Davies Kate Richards Lauren Adams Royal Statistical Society Centre for Statistical Education – who we are HowWhat do we we do: do it? Promote improvement in statistical education For people of all ages – in primary and secondary schools, colleges, higher education and theFunders workplace for the RSSCSE Cradle to grave statistical education! MTB support for RSSCSE How do we do it? Funders for the RSSCSE MTB support for RSSCSE How do we do it? Funders for the RSSCSE MTB support for RSSCSE How do we do it? Funders for the RSSCSE MTB support for RSSCSE How do we do it? Funders for the RSSCSE MTB support for RSSCSE How do we do it? Funders for the RSSCSE MTB support for RSSCSE Where are we? Plymouth Plymouth - on the border between Devon and Cornwall University of Plymouth University of Plymouth Local attractions for visitors to RSSCSE - Plymouth harbour area The Royal Statistical Society (RSS) 10-year
    [Show full text]
  • Acknowledgments
    Acknowledgments Numerous people have helped in various ways to ensure that we achieved the best possible outcome for this book. We would especially like to thank the following: Colin Aitken, Carol Alexander, Peter Ayton, David Balding, Beth Bateman, George Bearfield, Daniel Berger, Nic Birtles, Robin Bloomfield, Bill Boyce, Rob Calver, Neil Cantle, Patrick Cates, Chris Chapman, Xiaoli Chen, Keith Clarke, Julie Cooper, Robert Cowell, Anthony Constantinou, Paul Curzon, Phil Dawid, Chris Eagles, Shane Cooper, Eugene Dementiev, Itiel Dror, John Elliott, Phil Evans, Ian Evett, Geir Fagerhus, Simon Forey, Duncan Gillies, Jean-Jacques Gras, Gerry Graves, David Hager, George Hanna, David Hand, Roger Harris, Peter Hearty, Joan Hunter, Jose Galan, Steve Gilmour, Shlomo Gluck, James Gralton, Richard Jenkinson, Adrian Joseph, Ian Jupp, Agnes Kaposi, Paul Kaye, Kevin Korb, Paul Krause, Dave Lagnado, Helge Langseth, Steffen Lauritzen, Robert Leese, Peng Lin, Bev Littlewood, Paul Loveless, Peter Lucas, Bob Malcom, Amber Marks, David Marquez, William Marsh, Peter McOwan, Tim Menzies, Phil Mercy, Martin Newby, Richard Nobles, Magda Osman, Max Parmar, Judea Pearl, Elena Perez-Minana, Andrej Peitschker, Ursula Martin, Shoaib Qureshi, Lukasz Radlinksi, Soren Riis, Edmund Robinson, Thomas Roelleke, Angela Saini, Thomas Schulz, Jamie Sherrah, Leila Schneps, David Schiff, Bernard Silverman, Adrian Smith, Ian Smith, Jim Smith, Julia Sonander, David Spiegelhalter, Andrew Stuart, Alistair Sutcliffe, Lorenzo Strigini, Nigel Tai, Manesh Tailor, Franco Taroni, Ed Tranham, Marc Trepanier, Keith van Rijsbergen, Richard Tonkin, Sue White, Robin Whitty, Rosie Wild, Patricia Wiltshire, Rob Wirszycz, David Wright and Barbaros Yet. xvii K10450.indb 17 09/10/12 4:19 PM.
    [Show full text]
  • The Pandemic Jsm
    July 2020 • Issue #517 AMSTATNEWS The Membership Magazine of the American Statistical Association • http://magazine.amstat.org THE PANDEMIC JSM Hello! Welcome! ALSO: ASA Election Results Lessons Learned from Virtual Meetings AMSTATNEWS JULY 2020 • ISSUE #517 Executive Director Ron Wasserstein: [email protected] Associate Executive Director and Director of Operations Stephen Porzio: [email protected] features Senior Advisor for Statistics Communication and Media Innovation 3 President’s Corner Regina Nuzzo: [email protected] Director of Science Policy 5 A Note from the ASA Presidents Steve Pierson: [email protected] 6 Katherine Ensor Elected 2022 ASA President Director of Strategic Initiatives and Outreach Donna LaLonde: [email protected] 9 ASA Members Lead at Los Alamos Director of Education 12 A Glimpse into the CDC’s Innovation, Technology, and Rebecca Nichols: [email protected] Analytics Task Force Managing Editor 13 ASA Releases Statement on Government Data Experts Megan Murphy: [email protected] Editor and Content Strategist 14 New ASA Interest Group: Text Analysis Val Nirala: [email protected] 16 Sections and Interest Groups: A Career Production Coordinators/Graphic Designers Development Perspective Olivia Brown: [email protected] Megan Ruyle: [email protected] 17 Nominations Wanted for Norwood Award Advertising Manager 18 JSM 2020: Opportunities for Interaction, Claudine Donovan: [email protected] Learning, Engagement Contributing Staff Members 20 ASA Members Stop the Presses with New Book Naomi Friedman • Kathleen Wert • Elizabeth Henry • Valerie Nirala About Disease Outbreaks Regina Nuzzo • Amanda Malloy Amstat News welcomes news items and letters from readers on matters of interest to the association and the profession. Address correspondence to Managing Editor, Amstat News, American Statistical Association, 732 North Washington Street, Alexandria VA 22314-1943 USA, or email amstat@ columns amstat.org.
    [Show full text]
  • Spatial Statistics and Bayesian Computation
    J. R. Statist. Soc. B (1993) 55,No. 1,pp.25-37 Spatial Statistics and Bayesian Computation By JULIAN BESAG and PETER J. GREENt University of Washington, Seattle, USA University of Bristol, UK [Read before The Royal Statistical Society at a meeting on 'The Gibbs sampler and other Markov chain Monte Carlo methods' organized by the Research Section on Wednesday, May 6th, 1992, Professor B. W. Silverman in the Chair] SUMMARY Markov chain Monte Carlo (MCMC) algorithms, such as the Gibbs sampler, have provided a Bayesian inference machine in image analysis and in other areas of spatial statistics for several years, founded on the pioneering ideas of Ulf Grenander. More recently, the observation that hyperparameters can be included as part of the updating schedule and the fact that almost any multivariate distribution is equivalently a Markov random field has opened the way to the use of MCMC in general Bayesian computation. In this paper, we trace the early development of MCMC in Bayesian inference, review some recent computational progress in statistical physics, based on the introduction of auxiliary variables, and discuss its current and future relevance in Bayesian applications. We briefly describe a simple MCMC implementation for the Bayesian analysis of agricultural field experiments, with which we have some practical experience. Keywords: AGRICULTURAL FIELD EXPERIMENTS; ANTITHETIC VARIABLES; AUXILIARY VARIABLES; GIBBS SAMPLER; MARKOV CHAIN MONTE CARLO; MARKOV RANDOM FIELDS; METROPOLIS METHOD; MULTIGRID; MULTIMODALITY; SWENDSEN-WANG METHOD 1. INTRODUCTION In this paper, we trace the early development of Markov chain Monte Carlo (MCMC) methods in Bayesian inference, review some comparatively recent computational progress in statistical physics and describe how this may be developed in future Bayesian applications.
    [Show full text]
  • Oxford University Department of Statistics a Brief History John Gittins
    Oxford University Department of Statistics A Brief History John Gittins 1 Contents Preface 1 Genesis 2 LIDASE and its Successors 3 The Department of Biomathematics 4 Early Days of the Department of Statistics 5 Rapid Growth 6 Mathematical Genetics and Bioinformatics 7 Other Recent Developments 8 Research Assessment Exercises 9 Location 10 Administrative, Financial and Secretarial 11 Computing 12 Advisory Service 13 External Advisory Panel 14 Mathematics and Statistics BA and MMath 15 Actuarial Science and the Institute of Actuaries (IofA) 16 MSc in Applied Statistics 17 Doctoral Training Centres 18 Data Base 19 Past and Present Oxford Statistics Groups 20 Honours 2 Preface It has been a pleasure to compile this brief history. It is a story of great achievement which needed to be told, and current and past members of the department have kindly supplied the anecdotal material which gives it a human face. Much of this achievement has taken place since my retirement in 2005, and I apologise for the cursory treatment of this important period. It would be marvellous if someone with first-hand knowledge was moved to describe it properly. I should like to thank Steffen Lauritzen for entrusting me with this task, and all those whose contributions in various ways have made it possible. These have included Doug Altman, Nancy Amery, Shahzia Anjum, Peter Armitage, Simon Bailey, John Bithell, Jan Boylan, Charlotte Deane, Peter Donnelly, Gerald Draper, David Edwards, David Finney, Paul Griffiths, David Hendry, John Kingman, Alison Macfarlane, Jennie McKenzie, Gilean McVean, Madeline Mitchell, Rafael Perera, Anne Pope, Brian Ripley, Ruth Ripley, Christine Stone, Dominic Welsh, Matthias Winkel and Stephanie Wright.
    [Show full text]
  • Primer: the Use of Statistics in Legal Proceedings
    THE USE OF STATISTICS IN LEGAL PROCEEDINGS: A PRIMER FOR COURTS 1 The use of statistics in legal proceedings A PRIMER FOR COURTS 2 THE USE OF STATISTICS IN LEGAL PROCEEDINGS: A PRIMER FOR COURTS The use of statistics in legal proceedings: a primer for courts Issued: November 2020 DES6439 ISBN: 978-1-78252-486-1 The text of this work is licensed under the terms of the Creative Commons Attribution License, which permits unrestricted use provided the original author and source are credited. The licence is available at: creativecommons.org/licenses/by/4.0 Images are not covered by this licence. To request additional copies of this document please contact: The Royal Society 6 – 9 Carlton House Terrace London SW1Y 5AG T +44 20 7451 2571 E [email protected] W royalsociety.org/science-and-law This primer can be viewed online at royalsociety.org/science-and-law THE USE OF STATISTICS IN LEGAL PROCEEDINGS: A PRIMER FOR COURTS 3 Contents Summary, introduction and scope 5 1. What is statistical science? 6 1.1 Use of statistical science and types of evidence 8 1.2 Communication of the probative value when statistical science is used 10 2. Probability and the principles of evaluating scientific evidence 13 2.1 What probability is not 13 2.2 Personal probabilities 14 2.3 Datasets containing relevant past observations 16 2.4 Probative value expressed as a likelihood ratio 17 2.5 Bayes’ theorem and the likelihood ratio 20 3. Issues with the potential for misunderstanding 22 3.1 Prosecutor’s fallacy 22 3.2 Defence attorney’s fallacy 22 3.3 Combining evidence 22 3.4 Coincidences and rare events 24 3.5 Interpretation of ‘beyond reasonable doubt’ and ‘balance of probabilities’ 24 4.
    [Show full text]
  • Trustees' Report and Financial Statements for the Year Ended 31 March 2009 1 Trustees’ Report for the Year Ended 31 March 2009
    Trustees’ Report and Financial Statements For the year ended 31 March 2009 Trustees’ Report For the year ended 31 March 2009 CONTENTS Page Trustees’ Report 1 Report of the Independent Auditors to the Fellowship of the Royal Society 8 Report of the Audit Committee to Council on the Financial Statements 9 Consolidated Statement of Financial Activities 10-11 Consolidated Balance Sheet 12 Consolidated Cash Flow Statement 13 Accounting Policies 14-16 Notes to the Financial Statements 17-32 Parliamentary Grant-in-Aid 33-36 Auditors Investment Managers PKF (UK) LLP Rathbone Investment Management Ltd Chartered Accountants and Registered Auditors 159 New Bond Street Farringdon Place London 20 Farringdon Road W1S 2UD London EC1M 3AP UBS AG 1 Curzon Street Solicitors London Needham & James LLP W1J 5UB Needham & James House Bridgeway Internal Auditors Stratford upon Avon haysmacintyre Warwickshire Fairfax House CV37 6YY 15 Fulwood Place London Bankers WC1V 6AY Barclays Bank plc Level 28 1 Churchill Place London E14 5HP Trustees’ Report For the year ended 31 March 2009 Registered charity No 207043 Trustees Other members of the Council The Trustees of the Society are the Members of its Professor Frances Ashcroft a Council duly elected by its Fellows. Ten of the 21 Sir David Baulcombe members of Council retire each year in line with Sir Michael Berry b its Royal Charter. Sir Michael Brady a Dame Kay Davies DBE President Dame Ann Dowling DBE b Lord Rees of Ludlow OM Kt Professor Jeffery Errington Professor Alastair Fitter b Treasurer and Vice-President
    [Show full text]
  • Julian Besag FRS, 1945–2010
    Julian Besag FRS, 1945–2010 Preface Julian Besag will long be remembered for his many original contributions to statistical science, spanning theory, methodology and substantive application. This booklet arose out of a two-day memorial meeting held at the University of Bristol in April 2011. The first day of the memorial meeting was devoted to personal reminiscences from some of Julians many colleagues and friends. These collectively paint a vivid portrait of an unforgettable character who could infuriate on occasion, but was universally admired and much loved. Their informality also complements the scientific obituaries that have been published in the open literature, for example in the April 2011 issue of the Journal of the Royal Statistical Society, Series A. Peter Green, Peter Diggle, September 2011 Hilde Ubelacker-Besag¨ Dear Julian, This is a letter to say farewell to you. For the last time I want to talk to you and to be near to you at least in my thoughts. They go back to your start in life, the 25th March 1945. We were living near Basel at that time, my mother and my grandmother hoping to join the family in England soon. But my grandmother was lying on her deathbed after a stroke when we got the news of your birth. She had been looking forward so much to that event: her beloved grandson’s first child. She was unconscious, but we told her the news, and I have always hoped that she heard it. So your birth for me was linked with my grandmother’s death. Was it a forecast of what you would have to experience as a little boy? Because there was the shadow of death.
    [Show full text]