A Revisit of the Gram-Charlier and Edgeworth Series Expansions

Total Page:16

File Type:pdf, Size:1020Kb

A Revisit of the Gram-Charlier and Edgeworth Series Expansions ORIG I NAL AR TI CLE DRAFT VERSION 0.1 A REVISIT OF THE Gram-Charlier AND Edgeworth SERIES EXPANSIONS TORGEIR Brenn1 | Stian Normann AnfiNSEN1 1UnivERSITY OF Tromsø - The Arctic UnivERSITY OF NorwaY, Department OF In THIS PAPER WE MAKE SEVERAL OBSERVATIONS ON THE Gram- PhYSICS AND TECHNOLOGY, Machine LEARNING Charlier AND Edgeworth series, WHICH ARE METHODS FOR mod- Group, 9037 Tromsø, NorwaY ELING AND APPROXIMATING PROBABILITY DENSITY functions. WE Correspondence PRESENT A SIMPLIfiED DERIVATION WHICH HIGHLIGHTS BOTH THE Stian Normann Anfinsen, UiT The Arctic UnivERSITY OF NorwaY, Department OF SIMILARITY AND THE DIFFERENCES OF THE SERIES Expansions, THAT PhYSICS AND TECHNOLOGY, 9037 Tromsøø, ARE OFTEN OBSCURED BY ALTERNATIVE derivations. WE ALSO in- NorwaY Email: [email protected] TRODUCE A REFORMULATION OF THE Edgeworth SERIES IN TERMS OF THE COMPLETE EXPONENTIAL Bell polynomials, WHICH MAKE FUNDING INFORMATION BOTH SERIES EASY TO IMPLEMENT AND Evaluate. The RESULT IS A SIGNIfiCANTLY MORE ACCESSIBLE METHODOLOGY, IN THE SENSE THAT IT IS EASIER TO UNDERSTAND AND TO implement. Finally, WE ALSO MAKE A REMARK ON THE Gram-Charlier SERIES WITH A GAMMA Kernel, PROVIDING A NOVEL AND SIMPLE EXPRESSION FOR ITS COEFficients. KEYWORDS PROBABILITY DENSITY functions, SERIES Expansions, Edgeworth, Gram-Charlier, Bell polynomials, Normal Kernel, GAMMA KERNEL 1 | INTRODUCTION The Gram-Charlier AND Edgeworth SERIES EXPANSIONS PROVIDE ATTRACTIVE ALTERNATIVES WHEN IT COMES TO PROBABILITY DENSITY FUNCTION (PDF) estimation. TheY COMBINE THE SIMPLICITY OF fiTTING A two-parAMETER PDF WITH THE flEXIBILITY OF CORRECTING FOR HIGHER ORDER moments, OFTEN RESULTING IN FAST AND ACCURATE APPROximations. Abbreviations: CF, CHARACTERISTIC function; FT, FOURIER TRansform; IID, INDEPENDENT AND IDENTICALLY distributed; PDF, PROBABILITY den- SITY function; RV, RANDOM variable. 1 2 BRENN AND ANFINSEN The SERIES EXPANSION METHODS WERE INTRODUCED IN THE LATE 19th AND EARLY 20th CENTURY (ChebYSHEv, 1860; Gram, 1883; Thiele, 1889; ChebYSHEv, 1890; Thiele, 1903; Edgeworth, 1905; Charlier, 1905, 1906), AND THEIR HISTORY IS SUMMARIZED IN (Wallace, 1958) AND (Hald, 2000). The METHODS CAN BE DERIVED IN TERMS OF ORTHOGONAL POLYNOMIALS (KENDALL ET al., 1994), BUT IT IS ALSO POSSIBLE TO RETRIEVE THE PDF FROM THE CHARACTERISTIC FUNCTION (CF) (Lévy, 1925; Lukacs, 1970), AS IN (Wallace, 1958; BlinnikOV AND Moessner, 1998). TRADITIONALLY, THE SERIES EXPANSIONS USED THE NORMALIAN PDF AS THE KERNEL ALMOST EXCLUSIVELY, BUT (KENDALL ET al., 1994) MENTIONED OTHER POSSIBILITIES AND (Gaztanaga ET al., 2000) PRESENTED AN EXPLICIT EXPRESSION FOR THE Gram-Charlier SERIES WITH A GAMMA PDF Kernel. A TOOL WHICH WAS NOT AVAILABLE TO Gram, Charlier, Edgeworth etc. ARE THE Bell polynomials, NAMED AFTER Eric TEMPLE Bell, WHO INTRODUCED THEM UNDER THE NAME PARTITION POLYNOMIALS IN (Bell, 1927). Among OTHER things, THEY CAN BE USED TO RETRIEVE MOMENTS FROM CUMULANTS (Pitman, 2002; Rota AND Shen, 2000). Thiele, WHO INTRODUCED THE CUMULANTS IN (Thiele, 1889), CERTAINLY MASTERED THEIR RELATIONSHIP WITH THE moments, BUT NATURALLY DID NOT HAVE ACCESS TO THE Bell polynomials. Instead, HE GAVE A RECURSION FORMULA TO COMPUTE CUMULANTS FROM MOMENTS (Hald, 2000). TODAY, POLYNOMIALS LIKE THOSE NAMED AFTER Bell OR Kummer (Kummer, 1837; Daalhuis, 2010) ARE READILY AVAILABLE ONLINE AND IN MATHEMATICS software. The IMPLICATION THAT USING THESE POLYNOMIALS TO EXPRESS THE Gram-Charlier AND Edgeworth SERIES ALLOWS FOR EASIER AND FASTER implementation, AS DEMONSTRATED IN (Withers AND Nadarajah, 2009, 2015). This PAPER IS ORGANIZED AS follows. In Section 2 WE BRIEflY ACCOUNT FOR THE NECESSARY THEORETICAL background, INCLUDING moments, cumulants, CF, Bell POLYNOMIALS AND THE TRADITIONAL WAY OF DERIVING THE Gram-Charlier AND Edge- WORTH series. In Section 3 WE PRESENT OUR DERIVATION OF THE SAME Gram-Charlier AND Edgeworth SERIES WITH THE NOVEL APPLICATION OF THE Bell POLYNOMIALS IN THIS CONTExt. WE MAKE AN OBSERVATION ON THE Gram-Charlier SERIES AROUND THE GAMMA KERNEL IN Section 4 AND PRESENT OUR CONCLUSIONS IN Section 5. 2 | THEORETICAL BACKGROUND 2.1 | The Hermite POLYNOMIALS AND THE Normal Distribution The nTH probabilists’ Hermite POLYNOMIAL Hn ¹xº IS DEfiNED IN TERMS OF THE DERIVATIVES OF THE STANDARDIZED (zero mean, 2 UNIT VARIANCE) NORMAL PDF φ¹xº = ¹2πº−1/2e−x /2, NAMELY n (−Dx º φ¹xº = Hn ¹xºφ¹xº; (1) n WHERE Dx = D/Dx IS THE DIFFERENTIAL OPERATOR AND THE FACTOR (−1º ENSURES THAT THE LEADING COEFfiCIENT OF Hn ¹xº IS 1 (KENDALL ET al., 1994). FOR ARBITRARY MEAN µ AND VARIANCE σ2, WE DEfiNE 1 ¹x − µº2 1 x − µ φ¹x; µ; σº = p EXP − = φ ; (2) 2πσ 2σ2 σ σ −1 AND LETTING y = ¹x − µ)/σ WE SEE THAT Dy = σ Dx , i.e. n 1 x − µ (−Dx º φ¹x; µ; σº = Hn φ¹x; µ; σº: (3) σn σ WE CAN NOW WORK WITH THE STANDARDIZED φ¹xº DURING THE DERIVATIONS FOR BREVITY AND USE (3) TO GENERALIZE TO ARBITRARY KERNEL MEAN AND variance. The Hermite POLYNOMIALS ARE ORTHOGONAL WITH RESPECT THE NORMAL PDF IN THE SENSE THAT BRENN AND ANFINSEN 3 (KENDALL ET al., 1994) 1 ( ¹ n!; k = n ; Hk ¹xºHn ¹xºφ¹xºDx = (4) 0 k n : −∞ ; , 2.2 | The Gram-Charlier Series WITH THE Normal KERNEL Suppose NOW THAT THE RANDOM VARIABLE (RV) X HAS UNKNOWN PDF fX ¹xº, WHICH CAN BE WRITTEN IN TERMS OF THE DERIVATIVES OF THE NORMAL PDF, i.e. 1 Õ fX ¹xº = an Hn ¹xºφ¹xº; (5) n=0 WHERE WE USED (1). TO fiND THE COEFfiCIENTS an , WE MULTIPLY BOTH SIDES WITH Hk ¹xº, INTEGRATE FROM −∞ TO +1, SWAP THE ORDER OF INTEGRATION AND summation, AND USE THE ORTHOGONAL PROPERTY FROM (4) TO GET 1 1 1 ¹ ¹ Õ fX ¹xºHk ¹xºDx = an Hk ¹xºHn ¹xºφ¹xº = an n! ; (6) −∞ −∞ n=0 1 1 ¹ an = fX ¹xºHn ¹xºDx : (7) n! −∞ ν Since Hn ¹xº IS A POLYNOMIAL IN x, THE COEFfiCIENTS an MUST BE A LINEAR COMBINATION OF THE MOMENTS µν = EfX g OF X . (KENDALL ET al., 1994) LISTS THE fiRST FEW COEFfiCIENTS BOTH IN TERMS OF THE MOMENTS AND IN TERMS OF THE cumulants, WITH THE LATTER REPRESENTATION PRESENTED IN (13). 2.3 | The Gram-Charlier Series WITH THE Gamma KERNEL LET THE GAMMA DISTRIBUTION PDF WITH SHAPE φ AND SCALE β BE DENOTED − γ¹x; φ; βº = β φ+1xφ e βx /Γ¹φ + 1º (8) FOR x ≥ 0. The GENERALIZED Laguerre POLYNOMIAL OF DEGREE n AND ORDER φ IS IMPLICITLY DEfiNED AS (Szeg, 1939) ¹φº 1 n n Ln ¹xºγ¹x; φº = D »x γ¹x; φº¼ ; (9) n! WHERE WE TAKE γ¹x; φº TO MEAN THAT β = 1 FOR BREVITY, WHICH IS EASILY GENERALIZED BY REPLACING x WITH βx AS THE ARGUMENT ¹φº 1 OF BOTH Ln ¹xº AND γ¹x; φº. The Laguerre POLYNOMIALS HAVE AN ORTHOGONALITY PROPERTY ANALOGOUS TO (4), NAMELY 1 Γ¹n + φ + 1º ¹ >8 ; k = n ; ¹φº¹ º ¹φº¹ º ¹ º >< Γ¹n + 1ºΓ¹φ + 1º Ln x Lk x γ x; φ Dx = (10) > 0 ; k , n : 0 : 1This IS FOUND IN TERMS OF BINOMIAL COEFfiCIENTS IN (Szeg, 1939), WITH (Fowler, 1996) PROVIDING A GENERALIZATION TO non-integer arguments. This CAN ALSO BE GENERALIZED BY REPLACING x WITH βx ON THE LEFT HAND SIDE IN (10), LEAVING THE RIGHT HAND SIDE unchanged. 4 BRENN AND ANFINSEN FROM (KENDALL ET al., 1994) AND (Gaztanaga ET al., 2000) WE KNOW THAT A PDF fX ¹xº WHICH IS ZERO FOR NEGATIVE x, CAN BE WRITTEN AS 1 Õ ¹φº fX ¹xº = an Ln ¹βxºγ¹x; φ; βº ; (11) n=0 WHERE THE COEFfiCIENTS an ARE FOUND THE SAME WAY AS IN Section 2.2, GIVING 1 n ¹ ! ¹ º ¹φº¹ º an = n fX x Ln βx Dx; (12) Î ¹φ + i º 0 i =1 WHICH CLEARLY IS A LINEAR COMBINATION OF THE MOMENTS OF X BY THE SAME REASONING AS IN Section 2.2. The fiRST FEW TERMS OF THE SERIES IS GIVEN IN (14). 2.4 | The Edgeworth Series FOR THE RV X WITH UNKNOWN PDF fX ¹xº, ITS CF ΨX ¹t º IS THE FT OF fX ¹xº (KENDALL ET al., 1994), THAT IS 1 ¹ i t x i t X ΨX ¹t º ≡ F»fX ¹xº¼¹t º = e fX ¹xº Dx = Efe g ; (16) −∞ WHERE j IS THE IMAGINARY unit, THE EXPECTATION Ef·g IS WITH RESPECT TO x AND t IS A TRANSFORM variable. The CUMULANT GENERATING FUNCTION IS DEfiNED AS LOG ΨX ¹t º ; (17) " 2 # κ3 x − µ κ4 x − µ κ5 x − µ κ6+10κ3 x − µ κ7+35κ3κ4 x − µ fX ¹xº= 1+ H3 + H4 + H5 + H6 + H7 + ··· φ¹x; µ; σº 6σ3 σ 24σ4 σ 120σ5 σ 720σ6 σ 5040σ7 σ (13) 3 4 3 β µ3 ¹φº β µ4 4β µ3 ¹φº fX ¹xº= 1 + − + 1 L ¹βxº + − + 3 L ¹βxº + ··· γ¹x; φ; βº ¹φ + 1º¹φ + 2º¹φ + 3º 3 ¹φ + 1º · · · ¹φ + 4º ¹φ + 1º¹φ + 2º¹φ + 3º 4 (14) " 2 # 1 λ3 x − µ 1 λ4 x − µ λ3 x − µ fX ¹xº = φ¹x; µ; σº + H3 φ¹x; µ; σº + H4 + H6 φ¹x; µ; σº (15) r 1/2 6σ3 σ r 24σ4 σ 72σ6 σ " 3 # 1 λ5 x − µ λ3λ4 x − µ λ3 x − µ 1 + H5 + H7 + H9 φ¹x; µ; σº + O r 3/2 120σ5 σ 144σ7 σ 1296σ9 σ r 2 BRENN AND ANFINSEN 5 i.e. THE NATURAL LOGARITHM OF THE CF. The CUMULANTS κX ;ν; ν 2 Ú>0 can, IF THEY ALL Exist, BE RETRIEVED FROM 1 Õ ¹i t ºν LOG ΨX ¹t º = κX ;ν : (18) ν ν=1 ! WE LET Ψφ ¹t º DENOTE THE CF OF φ¹xº (Bryc, 2012). Using (17) AND (18), WE CAN WRITE THE CFs OF X AND THE NORMAL KERNEL AS ( 1 ) Õ ¹i t ºν ΨX ¹t º = EXP κX ;ν ; (19) ν ν=1 ! ( 1 ) Õ ¹i t ºν Ψφ ¹t º = EXP κφ;ν : (20) ν ν=1 ! These CAN BE COMBINED INTO ( 1 ) Õ ¹i t ºν ΨX ¹t º = EXP »κX ;ν − κφ;ν ¼ Ψφ ¹t º: (21) ν ν=1 ! As (Wallace, 1958) notes, IT IS POSSIBLE TO RETRIEVE THE Gram-Charlier SERIES AT THIS POINT BY USING THE POWER SERIES EXPANSION OF EXPf·g, SORTING THE TERMS BY THEIR POWER OF (−Dx º, AND APPLYING (1).
Recommended publications
  • Effects of Scale-Dependent Non-Gaussianity on Cosmological
    Preprint typeset in JHEP style - HYPER VERSION Effects of Scale-Dependent Non-Gaussianity on Cosmological Structures Marilena LoVerde1, Amber Miller1, Sarah Shandera1, Licia Verde2 1 Institute of Strings, Cosmology and Astroparticle Physics Physics Department, Columbia University, New York, NY 10027 2 ICREA, Institut de Ci`encies de l’Espai (ICE), IEEC-CSIC, Campus UAB, F. de Ci`encies, Torre C5 par-2, Barcelona 08193, Spain Emails: [email protected], [email protected], [email protected], [email protected] Abstract: The detection of primordial non-Gaussianity could provide a powerful means to test various inflationary scenarios. Although scale-invariant non-Gaussianity (often de- scribed by the fNL formalism) is currently best constrained by the CMB, single-field models with changing sound speed can have strongly scale-dependent non-Gaussianity. Such mod- els could evade the CMB constraints but still have important effects at scales responsible for the formation of cosmological objects such as clusters and galaxies. We compute the effect of scale-dependent primordial non-Gaussianity on cluster number counts as a function of redshift, using a simple ansatz to model scale-dependent features. We forecast constraints arXiv:0711.4126v3 [astro-ph] 13 Mar 2008 on these models achievable with forthcoming data sets. We also examine consequences for the galaxy bispectrum. Our results are relevant for the Dirac-Born-Infeld model of brane inflation, where the scale-dependence of the non-Gaussianity is directly related to the geometry of the extra dimensions. Contents 1. Introduction 1 2. General Single-field Inflation: Review and Example 6 2.1 General Single Field Formalism 6 2.2 Scale-Dependent Relationships 8 2.3 An Example from String Theory 9 3.
    [Show full text]
  • Gaussian and Non-Gaussian-Based Gram-Charlier and Edgeworth Expansions for Correlations of Identical Particles in HBT Interferometry
    Gaussian and non-Gaussian-based Gram-Charlier and Edgeworth expansions for correlations of identical particles in HBT interferometry by Michiel Burger De Kock Thesis presented in partial fulfilment of the requirements for the degree of Master of Theoretical Physics at the University of Stellenbosch Department of Physics University of Stellenbosch Private Bag X1, 7602 Matieland, South Africa Supervisor: Prof H.C. Eggers March 2009 Declaration By submitting this thesis electronically, I declare that the entirety of the work contained therein is my own, original work, that I am the owner of the copyright thereof (unless to the extent explicitly otherwise stated) and that I have not previously in its entirety or in part submitted it for obtaining any qualification. Date: 02-03-2009 Copyright c 2009 Stellenbosch University All rights reserved. i Abstract Gaussian and non-Gaussian-based Gram-Charlier and Edgeworth expansions for correlations of identical particles in HBT interferometry M.B. De Kock Department of Physics University of Stellenbosch Private Bag X1, 7602 Matieland, South Africa Thesis: MSc (Theoretical Physics) March 2009 Hanbury Brown{Twiss interferometry is a correlation technique by which the size and shape of the emission function of identical particles created during collisions of high-energy leptons, hadrons or nuclei can be determined. Accurate experimental datasets of three-dimensional correlation functions in momentum space now exist; these are sometimes almost Gaussian in form, but may also show strong deviations from Gaussian shapes. We investigate the suitability of expressing these correlation functions in terms of statistical quantities beyond the normal Gaussian description. Beyond means and the covariance matrix, higher-order moments and cumulants describe the form and difference between the measured correlation function and a Gaussian distribution.
    [Show full text]
  • On the Validity of the Formal Edgeworth Expansion for Posterior Densities
    On the validity of the formal Edgeworth expansion for posterior densities John E. Kolassa Department of Statistics and Biostatistics Rutgers University [email protected] Todd A. Kuffner Department of Mathematics Washington University in St. Louis [email protected] October 6, 2017 Abstract We consider a fundamental open problem in parametric Bayesian theory, namely the validity of the formal Edgeworth expansion of the posterior density. While the study of valid asymptotic expansions for posterior distributions constitutes a rich literature, the va- lidity of the formal Edgeworth expansion has not been rigorously established. Several authors have claimed connections of various posterior expansions with the classical Edge- worth expansion, or have simply assumed its validity. Our main result settles this open problem. We also prove a lemma concerning the order of posterior cumulants which is of independent interest in Bayesian parametric theory. The most relevant literature is synthe- sized and compared to the newly-derived Edgeworth expansions. Numerical investigations illustrate that our expansion has the behavior expected of an Edgeworth expansion, and that it has better performance than the other existing expansion which was previously claimed to be of Edgeworth-type. Keywords and phrases: Posterior; Edgeworth expansion; Higher-order asymptotics; arXiv:1710.01871v1 [math.ST] 5 Oct 2017 Cumulant expansion. 1 Introduction The Edgeworth series expansion of a density function is a fundamental tool in classical asymp- totic theory for parametric inference. Such expansions are natural refinements to first-order asymptotic Gaussian approximations to large-sample distributions of suitably centered and normalized functionals of sequences of random variables, X1;:::;Xn. Here, n is the avail- able sample size, asymptotic means n ! 1, and first-order means that the approximation 1 using only the standard Gaussian distribution incurs an absolute approximation error of order O(n−1=2).
    [Show full text]
  • Relationship of Bell's Polynomial Matrix and K-Fibonacci Matrix
    American Scientific Research Journal for Engineering, Technology, and Sciences (ASRJETS) ISSN (Print) 2313-4410, ISSN (Online) 2313-4402 © Global Society of Scientific Research and Researchers http://asrjetsjournal.org/ Relationship of Bell’s Polynomial Matrix and k-Fibonacci Matrix Mawaddaturrohmaha, Sri Gemawatib* a,bDepartment of Mathematics, University of Riau, Pekanbaru 28293, Indonesia aEmail: [email protected] bEmail: [email protected] Abstract The Bell‟s polynomial matrix is expressed as , where each of its entry represents the Bell‟s polynomial number.This Bell‟s polynomial number functions as an information code of the number of ways in which partitions of a set with certain elements are arranged into several non-empty section blocks. Furthermore, thek- Fibonacci matrix is expressed as , where each of its entry represents the k-Fibonacci number, whose first term is 0, the second term is 1 and the next term depends on a positive integer k. This article aims to find a matrix based on the multiplication of the Bell‟s polynomial matrix and the k-Fibonacci matrix. Then from the relationship between the two matrices the matrix is obtained. The matrix is not commutative from the product of the two matrices, so we get matrix Thus, the matrix , so that the Bell‟s polynomial matrix relationship can be expressed as Keywords: Bell‟s Polynomial Number; Bell‟s Polynomial Matrix; k-Fibonacci Number; k-Fibonacci Matrix. 1. Introduction Bell‟s polynomial numbers are studied by mathematicians since the 19th century and are named after their inventor Eric Temple Bell in 1938[5] Bell‟s polynomial numbers are represented by for each n and kelementsof the natural number, starting from 1 and 1 [2, p 135] Bell‟s polynomial numbers can be formed into Bell‟s polynomial matrix so that each entry of Bell‟s polynomial matrix is Bell‟s polynomial number and is represented by [11].
    [Show full text]
  • Interview of Albert Tucker
    University of Tennessee, Knoxville TRACE: Tennessee Research and Creative Exchange About Harlan D. Mills Science Alliance 9-1975 Interview of Albert Tucker Terry Speed Evar Nering Follow this and additional works at: https://trace.tennessee.edu/utk_harlanabout Part of the Mathematics Commons Recommended Citation Speed, Terry and Nering, Evar, "Interview of Albert Tucker" (1975). About Harlan D. Mills. https://trace.tennessee.edu/utk_harlanabout/13 This Report is brought to you for free and open access by the Science Alliance at TRACE: Tennessee Research and Creative Exchange. It has been accepted for inclusion in About Harlan D. Mills by an authorized administrator of TRACE: Tennessee Research and Creative Exchange. For more information, please contact [email protected]. The Princeton Mathematics Community in the 1930s (PMC39)The Princeton Mathematics Community in the 1930s Transcript Number 39 (PMC39) © The Trustees of Princeton University, 1985 ALBERT TUCKER CAREER, PART 2 This is a continuation of the account of the career of Albert Tucker that was begun in the interview conducted by Terry Speed in September 1975. This recording was made in March 1977 by Evar Nering at his apartment in Scottsdale, Arizona. Tucker: I have recently received the tapes that Speed made and find that these tapes carried my history up to approximately 1938. So the plan is to continue the history. In the late '30s I was working in combinatorial topology with not a great deal of results to show. I guess I was really more interested in my teaching. I had an opportunity to teach an undergraduate course in topology, combinatorial topology that is, classification of 2-dimensional surfaces and that sort of thing.
    [Show full text]
  • New Edgeworth-Type Expansions with Finite Sample Guarantees1]A2
    New Edgeworth-type expansions with finite sample guarantees1 Mayya Zhilova2 School of Mathematics Georgia Institute of Technology Atlanta, GA 30332-0160 USA e-mail: [email protected] Abstract: We establish higher-order expansions for a difference between probability distributions of sums of i.i.d. random vectors in a Euclidean space. The derived bounds are uniform over two classes of sets: the set of all Euclidean balls and the set of all half-spaces. These results allow to account for an impact of higher-order moments or cumulants of the considered distributions; the obtained error terms depend on a sample size and a dimension explicitly. The new inequalities outperform accuracy of the normal approximation in existing Berry–Esseen inequalities under very general conditions. For symmetrically distributed random summands, the obtained results are optimal in terms of the ratio between the dimension and the sample size. The new technique which we developed for establishing nonasymptotic higher-order expansions can be interesting by itself. Using the new higher-order inequalities, we study accuracy of the nonparametric bootstrap approximation and propose a bootstrap score test under possible model misspecification. The results of the paper also include explicit error bounds for general elliptical confidence regions for an expected value of the random summands, and optimality of the Gaussian anti-concentration inequality over the set of all Euclidean balls. MSC2020 subject classifications: Primary 62E17, 62F40; secondary 62F25. Keywords and phrases: Edgeworth series, dependence on dimension, higher-order accuracy, multivariate Berry–Esseen inequality, finite sam- ple inference, anti-concentration inequality, bootstrap, elliptical confidence sets, linear contrasts, bootstrap score test, model misspecification.
    [Show full text]
  • E. T. Bell and Mathematics at Caltech Between the Wars Judith R
    E. T. Bell and Mathematics at Caltech between the Wars Judith R. Goodstein and Donald Babbitt E. T. (Eric Temple) Bell, num- who was in the act of transforming what had been ber theorist, science fiction a modest technical school into one of the coun- novelist (as John Taine), and try’s foremost scientific institutes. It had started a man of strong opinions out in 1891 as Throop University (later, Throop about many things, joined Polytechnic Institute), named for its founder, phi- the faculty of the California lanthropist Amos G. Throop. At the end of World Institute of Technology in War I, Throop underwent a radical transformation, the fall of 1926 as a pro- and by 1921 it had a new name, a handsome en- fessor of mathematics. At dowment, and, under Millikan, a new educational forty-three, “he [had] be- philosophy [Goo 91]. come a very hot commodity Catalog descriptions of Caltech’s program of in mathematics” [Rei 01], advanced study and research in pure mathematics having spent fourteen years in the 1920s were intended to interest “students on the faculty of the Univer- specializing in mathematics…to devote some sity of Washington, along of their attention to the modern applications of with prestigious teaching mathematics” and promised “to provide defi- stints at Harvard and the nitely for such a liaison between pure and applied All photos courtesy of the Archives, California Institute of Technology. of Institute California Archives, the of courtesy photos All University of Chicago. Two Eric Temple Bell (1883–1960), ca. mathematics by the addition of instructors whose years before his arrival in 1951.
    [Show full text]
  • On the Validity of the Formal Edgeworth Expansion for Posterior Densities
    Submitted to the Annals of Statistics ON THE VALIDITY OF THE FORMAL EDGEWORTH EXPANSION FOR POSTERIOR DENSITIES By John E. Kolassaz and Todd A. Kuffnerx Rutgers Universityz and Washington University in St. Louisx We consider a fundamental open problem in parametric Bayesian theory, namely the validity of the formal Edgeworth expansion of the posterior density. While the study of valid asymptotic expansions for posterior distributions constitutes a rich literature, the validity of the formal Edgeworth expansion has not been rigorously estab- lished. Several authors have claimed connections of various posterior expansions with the classical Edgeworth expansion, or have simply assumed its validity. Our main result settles this open problem. We also prove a lemma concerning the order of posterior cumulants which is of independent interest in Bayesian parametric theory. The most relevant literature is synthesized and compared to the newly-derived Edgeworth expansions. Numerical investigations illustrate that our expansion has the behavior expected of an Edgeworth expansion, and that it has better performance than the other existing expansion which was previously claimed to be of Edgeworth-type. 1. Introduction. The Edgeworth series expansion of a density function is a fundamental tool in classical asymptotic theory for parametric inference. Such expansions are natural refinements to first-order asymptotic Gaussian approximations to large-sample distributions of suitably centered and nor- malized functionals of sequences of random variables, X1;:::;Xn. Here, n is the available sample size, asymptotic means n ! 1, and first-order means that the approximation using only the standard Gaussian distribution incurs an absolute approximation error of order O(n−1=2).
    [Show full text]
  • Bell Polynomials and Binomial Type Sequences Miloud Mihoubi
    CORE Metadata, citation and similar papers at core.ac.uk Provided by Elsevier - Publisher Connector Discrete Mathematics 308 (2008) 2450–2459 www.elsevier.com/locate/disc Bell polynomials and binomial type sequences Miloud Mihoubi U.S.T.H.B., Faculty of Mathematics, Operational Research, B.P. 32, El-Alia, 16111, Algiers, Algeria Received 3 March 2007; received in revised form 30 April 2007; accepted 10 May 2007 Available online 25 May 2007 Abstract This paper concerns the study of the Bell polynomials and the binomial type sequences. We mainly establish some relations tied to these important concepts. Furthermore, these obtained results are exploited to deduce some interesting relations concerning the Bell polynomials which enable us to obtain some new identities for the Bell polynomials. Our results are illustrated by some comprehensive examples. © 2007 Elsevier B.V. All rights reserved. Keywords: Bell polynomials; Binomial type sequences; Generating function 1. Introduction The Bell polynomials extensively studied by Bell [3] appear as a standard mathematical tool and arise in combina- torial analysis [12]. Moreover, they have been considered as important combinatorial tools [11] and applied in many different frameworks from, we can particularly quote : the evaluation of some integrals and alterning sums [6,10]; the internal relations for the orthogonal invariants of a positive compact operator [5]; the Blissard problem [12, p. 46]; the Newton sum rules for the zeros of polynomials [9]; the recurrence relations for a class of Freud-type polynomials [4] and many others subjects. This large application of the Bell polynomials gives a motivation to develop this mathematical tool.
    [Show full text]
  • FOCUS 8 3.Pdf
    Volume 8, Number 3 THE NEWSLETTER OF THE MATHEMATICAL ASSOCIATION OF AMERICA May-June 1988 More Voters and More Votes for MAA Mathematics and the Public Officers Under Approval Voting Leonard Gilman Over 4000 MAA mebers participated in the 1987 Association-wide election, up from about 3000 voters in the elections two years ago. Is it possible to enhance the public's appreciation of mathematics and Lida K. Barrett, was elected President Elect and Alan C. Tucker was mathematicians? Science writers are helping us by turning out some voted in as First Vice-President; Warren Page was elected Second first-rate news stories; but what about mathematics that is not in the Vice-President. Lida Barrett will become President, succeeding Leon­ news? Can we get across an idea here, a fact there, and a tiny notion ard Gillman, at the end of the MAA annual meeting in January of 1989. of what mathematics is about and what it is for? Is it reasonable even See the article below for an analysis of the working of approval voting to try? Yes. Herewith are some thoughts on how to proceed. in this election. LOUSY SALESPEOPLE Let us all become ambassadors of helpful information and good will. The effort will be unglamorous (but MAA Elections Produce inexpensive) and results will come slowly. So far, we are lousy salespeople. Most of us teach and think we are pretty good at it. But Decisive Winners when confronted by nonmathematicians, we abandon our profession and become aloof. We brush off questions, rejecting the opportunity Steven J.
    [Show full text]
  • Multivariate Generalized Gram-Charlier Series in Vector
    arXiv: math.ST: 1503.03212 Multivariate Generalized Gram-Charlier Series in Vector Notations Dharmani Bhaveshkumar C. Dhirubhai Ambani Institute of Information & Communication Technology (DAIICT), Gandhinagar, Gujarat, INDIA - 382001 e-mail: [email protected] Abstract: The article derives multivariate Generalized Gram-Charlier (GGC) series that expands an unknown joint probability density function (pdf ) of a random vector in terms of the differentiations of the joint pdf of a reference random vector. Conventionally, the higher order differentiations of a multivariate pdf in GGC series will require multi-element array or tensor representations. But, the current article derives the GGC series in vector notations. The required higher order differentiations of a multivari- ate pdf in vector notations are achieved through application of a specific Kronecker product based differentiation operator. Overall, the article uses only elementary calculus of several variables; instead Tensor calculus; to achieve the extension of an existing specific derivation for GGC series in uni- variate to multivariate. The derived multivariate GGC expression is more elementary as using vector notations compare to the coordinatewise ten- sor notations and more comprehensive as apparently more nearer to its counterpart for univariate. The same advantages are shared by the other expressions obtained in the article; such as the mutual relations between cumulants and moments of a random vector, integral form of a multivariate pdf, integral form of the multivariate Hermite polynomials, the multivariate Gram-Charlier A (GCA) series and others. Primary 62E17, 62H10; Secondary 60E10. Keywords and phrases: Multivariate Generalized Gram-Charlier (GGC) series; Multivariate Gram-Charlier A (GCA) series; Multivariate Vector Hermite Polynomials; Kronecker Product; Vector moments; Vector cumu- lants.
    [Show full text]
  • A FAMILY of SEQUENCES of BINOMIAL TYPE 3 and If Jp +1= N Then This Difference Is 0
    A FAMILY OF SEQUENCES OF BINOMIAL TYPE WOJCIECH MLOTKOWSKI, ANNA ROMANOWICZ Abstract. For delta operator aD bDp+1 we find the corresponding polynomial se- − 1 2 quence of binomial type and relations with Fuss numbers. In the case D 2 D we show that the corresponding Bessel-Carlitz polynomials are moments of the− convolu- tion semigroup of inverse Gaussian distributions. We also find probability distributions νt, t> 0, for which yn(t) , the Bessel polynomials at t, is the moment sequence. { } 1. Introduction ∞ A sequence wn(t) n=0 of polynomials is said to be of binomial type (see [10]) if deg w (t)= n and{ for} every n 0 and s, t R we have n ≥ ∈ n n (1.1) w (s + t)= w (s)w − (t). n k k n k Xk=0 A linear operator Q of the form c c c (1.2) Q = 1 D + 2 D2 + 3 D3 + ..., 1! 2! 3! acting on the linear space R[x] of polynomials, is called a delta operator if c1 = 0. Here D denotes the derivative operator: D1 := 0 and Dtn := n tn−1 for n 1. We6 will write Q = g(D), where · ≥ c c c (1.3) g(x)= 1 x + 2 x2 + 3 x3 + .... 1! 2! 3! There is one-to-one correspondence between sequences of binomial type and delta ∞ operators, namely if Q is a delta operator then there is unique sequence w (t) of { n }n=0 binomial type satisfying Qw0(t) = 0 and Qwn(t)= n wn−1(t) for n 1.
    [Show full text]