Beta Distribution Fitting
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
The Exponential Family 1 Definition
The Exponential Family David M. Blei Columbia University November 9, 2016 The exponential family is a class of densities (Brown, 1986). It encompasses many familiar forms of likelihoods, such as the Gaussian, Poisson, multinomial, and Bernoulli. It also encompasses their conjugate priors, such as the Gamma, Dirichlet, and beta. 1 Definition A probability density in the exponential family has this form p.x / h.x/ exp >t.x/ a./ ; (1) j D f g where is the natural parameter; t.x/ are sufficient statistics; h.x/ is the “base measure;” a./ is the log normalizer. Examples of exponential family distributions include Gaussian, gamma, Poisson, Bernoulli, multinomial, Markov models. Examples of distributions that are not in this family include student-t, mixtures, and hidden Markov models. (We are considering these families as distributions of data. The latent variables are implicitly marginalized out.) The statistic t.x/ is called sufficient because the probability as a function of only depends on x through t.x/. The exponential family has fundamental connections to the world of graphical models (Wainwright and Jordan, 2008). For our purposes, we’ll use exponential 1 families as components in directed graphical models, e.g., in the mixtures of Gaussians. The log normalizer ensures that the density integrates to 1, Z a./ log h.x/ exp >t.x/ d.x/ (2) D f g This is the negative logarithm of the normalizing constant. The function h.x/ can be a source of confusion. One way to interpret h.x/ is the (unnormalized) distribution of x when 0. It might involve statistics of x that D are not in t.x/, i.e., that do not vary with the natural parameter. -
Probabilistic Proofs of Some Beta-Function Identities
1 2 Journal of Integer Sequences, Vol. 22 (2019), 3 Article 19.6.6 47 6 23 11 Probabilistic Proofs of Some Beta-Function Identities Palaniappan Vellaisamy Department of Mathematics Indian Institute of Technology Bombay Powai, Mumbai-400076 India [email protected] Aklilu Zeleke Lyman Briggs College & Department of Statistics and Probability Michigan State University East Lansing, MI 48825 USA [email protected] Abstract Using a probabilistic approach, we derive some interesting identities involving beta functions. These results generalize certain well-known combinatorial identities involv- ing binomial coefficients and gamma functions. 1 Introduction There are several interesting combinatorial identities involving binomial coefficients, gamma functions, and hypergeometric functions (see, for example, Riordan [9], Bagdasaryan [1], 1 Vellaisamy [15], and the references therein). One of these is the following famous identity that involves the convolution of the central binomial coefficients: n 2k 2n − 2k =4n. (1) k n − k k X=0 In recent years, researchers have provided several proofs of (1). A proof that uses generating functions can be found in Stanley [12]. Combinatorial proofs can also be found, for example, in Sved [13], De Angelis [3], and Miki´c[6]. A related and an interesting identity for the alternating convolution of central binomial coefficients is n n n 2k 2n − 2k 2 n , if n is even; (−1)k = 2 (2) k n − k k=0 (0, if n is odd. X Nagy [7], Spivey [11], and Miki´c[6] discussed the combinatorial proofs of the above identity. Recently, there has been considerable interest in finding simple probabilistic proofs for com- binatorial identities (see Vellaisamy and Zeleke [14] and the references therein). -
A Skew Extension of the T-Distribution, with Applications
J. R. Statist. Soc. B (2003) 65, Part 1, pp. 159–174 A skew extension of the t-distribution, with applications M. C. Jones The Open University, Milton Keynes, UK and M. J. Faddy University of Birmingham, UK [Received March 2000. Final revision July 2002] Summary. A tractable skew t-distribution on the real line is proposed.This includes as a special case the symmetric t-distribution, and otherwise provides skew extensions thereof.The distribu- tion is potentially useful both for modelling data and in robustness studies. Properties of the new distribution are presented. Likelihood inference for the parameters of this skew t-distribution is developed. Application is made to two data modelling examples. Keywords: Beta distribution; Likelihood inference; Robustness; Skewness; Student’s t-distribution 1. Introduction Student’s t-distribution occurs frequently in statistics. Its usual derivation and use is as the sam- pling distribution of certain test statistics under normality, but increasingly the t-distribution is being used in both frequentist and Bayesian statistics as a heavy-tailed alternative to the nor- mal distribution when robustness to possible outliers is a concern. See Lange et al. (1989) and Gelman et al. (1995) and references therein. It will often be useful to consider a further alternative to the normal or t-distribution which is both heavy tailed and skew. To this end, we propose a family of distributions which includes the symmetric t-distributions as special cases, and also includes extensions of the t-distribution, still taking values on the whole real line, with non-zero skewness. Let a>0 and b>0be parameters. -
On a Problem Connected with Beta and Gamma Distributions by R
ON A PROBLEM CONNECTED WITH BETA AND GAMMA DISTRIBUTIONS BY R. G. LAHA(i) 1. Introduction. The random variable X is said to have a Gamma distribution G(x;0,a)if du for x > 0, (1.1) P(X = x) = G(x;0,a) = JoT(a)" 0 for x ^ 0, where 0 > 0, a > 0. Let X and Y be two independently and identically distributed random variables each having a Gamma distribution of the form (1.1). Then it is well known [1, pp. 243-244], that the random variable W = X¡iX + Y) has a Beta distribution Biw ; a, a) given by 0 for w = 0, (1.2) PiW^w) = Biw;x,x)=\ ) u"-1il-u)'-1du for0<w<l, Ío T(a)r(a) 1 for w > 1. Now we can state the converse problem as follows : Let X and Y be two independently and identically distributed random variables having a common distribution function Fix). Suppose that W = Xj{X + Y) has a Beta distribution of the form (1.2). Then the question is whether £(x) is necessarily a Gamma distribution of the form (1.1). This problem was posed by Mauldon in [9]. He also showed that the converse problem is not true in general and constructed an example of a non-Gamma distribution with this property using the solution of an integral equation which was studied by Goodspeed in [2]. In the present paper we carry out a systematic investigation of this problem. In §2, we derive some general properties possessed by this class of distribution laws Fix). -
Standard Distributions
Appendix A Standard Distributions A.1 Standard Univariate Discrete Distributions I. Binomial Distribution B(n, p) has the probability mass function n f(x)= px (x =0, 1,...,n). x The mean is np and variance np(1 − p). II. The Negative Binomial Distribution NB(r, p) arises as the distribution of X ≡{number of failures until the r-th success} in independent trials each with probability of success p. Thus its probability mass function is r + x − 1 r x fr(x)= p (1 − p) (x =0, 1, ··· , ···). x Let Xi denote the number of failures between the (i − 1)-th and i-th successes (i =2, 3,...,r), and let X1 be the number of failures before the first success. Then X1,X2,...,Xr and r independent random variables each having the distribution NB(1,p) with probability mass function x f1(x)=p(1 − p) (x =0, 1, 2,...). Also, X = X1 + X2 + ···+ Xr. Hence ∞ ∞ x x−1 E(X)=rEX1 = r p x(1 − p) = rp(1 − p) x(1 − p) x=0 x=1 ∞ ∞ d d = rp(1 − p) − (1 − p)x = −rp(1 − p) (1 − p)x x=1 dp dp x=1 © Springer-Verlag New York 2016 343 R. Bhattacharya et al., A Course in Mathematical Statistics and Large Sample Theory, Springer Texts in Statistics, DOI 10.1007/978-1-4939-4032-5 344 A Standard Distributions ∞ d d 1 = −rp(1 − p) (1 − p)x = −rp(1 − p) dp dp 1 − (1 − p) x=0 =p r(1 − p) = . (A.1) p Also, one may calculate var(X) using (Exercise A.1) var(X)=rvar(X1). -
A Family of Skew-Normal Distributions for Modeling Proportions and Rates with Zeros/Ones Excess
S S symmetry Article A Family of Skew-Normal Distributions for Modeling Proportions and Rates with Zeros/Ones Excess Guillermo Martínez-Flórez 1, Víctor Leiva 2,* , Emilio Gómez-Déniz 3 and Carolina Marchant 4 1 Departamento de Matemáticas y Estadística, Facultad de Ciencias Básicas, Universidad de Córdoba, Montería 14014, Colombia; [email protected] 2 Escuela de Ingeniería Industrial, Pontificia Universidad Católica de Valparaíso, 2362807 Valparaíso, Chile 3 Facultad de Economía, Empresa y Turismo, Universidad de Las Palmas de Gran Canaria and TIDES Institute, 35001 Canarias, Spain; [email protected] 4 Facultad de Ciencias Básicas, Universidad Católica del Maule, 3466706 Talca, Chile; [email protected] * Correspondence: [email protected] or [email protected] Received: 30 June 2020; Accepted: 19 August 2020; Published: 1 September 2020 Abstract: In this paper, we consider skew-normal distributions for constructing new a distribution which allows us to model proportions and rates with zero/one inflation as an alternative to the inflated beta distributions. The new distribution is a mixture between a Bernoulli distribution for explaining the zero/one excess and a censored skew-normal distribution for the continuous variable. The maximum likelihood method is used for parameter estimation. Observed and expected Fisher information matrices are derived to conduct likelihood-based inference in this new type skew-normal distribution. Given the flexibility of the new distributions, we are able to show, in real data scenarios, the good performance of our proposal. Keywords: beta distribution; centered skew-normal distribution; maximum-likelihood methods; Monte Carlo simulations; proportions; R software; rates; zero/one inflated data 1. -
Lecture 2 — September 24 2.1 Recap 2.2 Exponential Families
STATS 300A: Theory of Statistics Fall 2015 Lecture 2 | September 24 Lecturer: Lester Mackey Scribe: Stephen Bates and Andy Tsao 2.1 Recap Last time, we set out on a quest to develop optimal inference procedures and, along the way, encountered an important pair of assertions: not all data is relevant, and irrelevant data can only increase risk and hence impair performance. This led us to introduce a notion of lossless data compression (sufficiency): T is sufficient for P with X ∼ Pθ 2 P if X j T (X) is independent of θ. How far can we take this idea? At what point does compression impair performance? These are questions of optimal data reduction. While we will develop general answers to these questions in this lecture and the next, we can often say much more in the context of specific modeling choices. With this in mind, let's consider an especially important class of models known as the exponential family models. 2.2 Exponential Families Definition 1. The model fPθ : θ 2 Ωg forms an s-dimensional exponential family if each Pθ has density of the form: s ! X p(x; θ) = exp ηi(θ)Ti(x) − B(θ) h(x) i=1 • ηi(θ) 2 R are called the natural parameters. • Ti(x) 2 R are its sufficient statistics, which follows from NFFC. • B(θ) is the log-partition function because it is the logarithm of a normalization factor: s ! ! Z X B(θ) = log exp ηi(θ)Ti(x) h(x)dµ(x) 2 R i=1 • h(x) 2 R: base measure. -
Extended K-Gamma and K-Beta Functions of Matrix Arguments
mathematics Article Extended k-Gamma and k-Beta Functions of Matrix Arguments Ghazi S. Khammash 1, Praveen Agarwal 2,3,4 and Junesang Choi 5,* 1 Department of Mathematics, Al-Aqsa University, Gaza Strip 79779, Palestine; [email protected] 2 Department of Mathematics, Anand International College of Engineering, Jaipur 303012, India; [email protected] 3 Institute of Mathematics and Mathematical Modeling, Almaty 050010, Kazakhstan 4 Harish-Chandra Research Institute Chhatnag Road, Jhunsi, Prayagraj (Allahabad) 211019, India 5 Department of Mathematics, Dongguk University, Gyeongju 38066, Korea * Correspondence: [email protected] Received: 17 August 2020; Accepted: 30 September 2020; Published: 6 October 2020 Abstract: Various k-special functions such as k-gamma function, k-beta function and k-hypergeometric functions have been introduced and investigated. Recently, the k-gamma function of a matrix argument and k-beta function of matrix arguments have been presented and studied. In this paper, we aim to introduce an extended k-gamma function of a matrix argument and an extended k-beta function of matrix arguments and investigate some of their properties such as functional relations, inequality, integral formula, and integral representations. Also an application of the extended k-beta function of matrix arguments to statistics is considered. Keywords: k-gamma function; k-beta function; gamma function of a matrix argument; beta function of matrix arguments; extended gamma function of a matrix argument; extended beta function of matrix arguments; k-gamma function of a matrix argument; k-beta function of matrix arguments; extended k-gamma function of a matrix argument; extended k-beta function of matrix arguments 1. -
TYPE BETA FUNCTIONS of SECOND KIND 135 Operators
Adv. Oper. Theory 1 (2016), no. 1, 134–146 http://doi.org/10.22034/aot.1609.1011 ISSN: 2538-225X (electronic) http://aot-math.org (p, q)-TYPE BETA FUNCTIONS OF SECOND KIND ALI ARAL 1∗ and VIJAY GUPTA2 Communicated by A. Kaminska Abstract. In the present article, we propose the (p, q)-variant of beta func- tion of second kind and establish a relation between the generalized beta and gamma functions using some identities of the post-quantum calculus. As an ap- plication, we also propose the (p, q)-Baskakov–Durrmeyer operators, estimate moments and establish some direct results. 1. Introduction The quantum calculus (q-calculus) in the field of approximation theory was discussed widely in the last two decades. Several generalizations to the q variants were recently presented in the book [3]. Further there is possibility of extension of q-calculus to post-quantum calculus, namely the (p, q)-calculus. Actually such extension of quantum calculus can not be obtained directly by substitution of q by q/p in q-calculus. But there is a link between q-calculus and (p, q)-calculus. The q calculus may be obtained by substituting p = 1 in (p, q)-calculus. We mentioned some previous results in this direction. Recently, Gupta [8] introduced (p, q) gen- uine Bernstein–Durrmeyer operators and established some direct results. (p, q) generalization of Sz´asz–Mirakyan operators was defined in [1]. Also authors inves- tigated a Durrmeyer type modifications of the Bernstein operators in [9]. We can also mention other papers as Bernstein operators [10], Bernstein–Stancu oper- ators [11]. -
Distributions (3) © 2008 Winton 2 VIII
© 2008 Winton 1 Distributions (3) © onntiW8 020 2 VIII. Lognormal Distribution • Data points t are said to be lognormally distributed if the natural logarithms, ln(t), of these points are normally distributed with mean μ ion and standard deviatσ – If the normal distribution is sampled to get points rsample, then the points ersample constitute sample values from the lognormal distribution • The pdf or the lognormal distribution is given byf - ln(x)()μ 2 - 1 2 f(x)= e ⋅ 2 σ >(x 0) σx 2 π because ∞ - ln(x)()μ 2 - ∞ -() t μ-2 1 1 2 1 2 ∫ e⋅ 2eσ dx = ∫ dt ⋅ 2σ (where= t ln(x)) 0 xσ2 π 0σ2 π is the pdf for the normal distribution © 2008 Winton 3 Mean and Variance for Lognormal • It can be shown that in terms of μ and σ σ2 μ + E(X)= 2 e 2⋅μ σ + 2 σ2 Var(X)= e( ⋅ ) e - 1 • If the mean E and variance V for the lognormal distribution are given, then the corresponding μ and σ2 for the normal distribution are given by – σ2 = log(1+V/E2) – μ = log(E) - σ2/2 • The lognormal distribution has been used in reliability models for time until failure and for stock price distributions – The shape is similar to that of the Gamma distribution and the Weibull distribution for the case α > 2, but the peak is less towards 0 © 2008 Winton 4 Graph of Lognormal pdf f(x) 0.5 0.45 μ=4, σ=1 0.4 0.35 μ=4, σ=2 0.3 μ=4, σ=3 0.25 μ=4, σ=4 0.2 0.15 0.1 0.05 0 x 0510 μ and σ are the lognormal’s mean and std dev, not those of the associated normal © onntiW8 020 5 IX. -
Theoretical Properties of the Weighted Feller-Pareto Distributions." Asian Journal of Mathematics and Applications, 2014: 1-12
CORE Metadata, citation and similar papers at core.ac.uk Provided by Georgia Southern University: Digital Commons@Georgia Southern Georgia Southern University Digital Commons@Georgia Southern Mathematical Sciences Faculty Publications Mathematical Sciences, Department of 2014 Theoretical Properties of the Weighted Feller- Pareto Distributions Oluseyi Odubote Georgia Southern University Broderick O. Oluyede Georgia Southern University, [email protected] Follow this and additional works at: https://digitalcommons.georgiasouthern.edu/math-sci-facpubs Part of the Mathematics Commons Recommended Citation Odubote, Oluseyi, Broderick O. Oluyede. 2014. "Theoretical Properties of the Weighted Feller-Pareto Distributions." Asian Journal of Mathematics and Applications, 2014: 1-12. source: http://scienceasia.asia/index.php/ama/article/view/173/ https://digitalcommons.georgiasouthern.edu/math-sci-facpubs/307 This article is brought to you for free and open access by the Mathematical Sciences, Department of at Digital Commons@Georgia Southern. It has been accepted for inclusion in Mathematical Sciences Faculty Publications by an authorized administrator of Digital Commons@Georgia Southern. For more information, please contact [email protected]. ASIAN JOURNAL OF MATHEMATICS AND APPLICATIONS Volume 2014, Article ID ama0173, 12 pages ISSN 2307-7743 http://scienceasia.asia THEORETICAL PROPERTIES OF THE WEIGHTED FELLER-PARETO AND RELATED DISTRIBUTIONS OLUSEYI ODUBOTE AND BRODERICK O. OLUYEDE Abstract. In this paper, for the first time, a new six-parameter class of distributions called weighted Feller-Pareto (WFP) and related family of distributions is proposed. This new class of distributions contains several other Pareto-type distributions such as length-biased (LB) Pareto, weighted Pareto (WP I, II, III, and IV), and Pareto (P I, II, III, and IV) distributions as special cases. -
Field Guide to Continuous Probability Distributions
Field Guide to Continuous Probability Distributions Gavin E. Crooks v 1.0.0 2019 G. E. Crooks – Field Guide to Probability Distributions v 1.0.0 Copyright © 2010-2019 Gavin E. Crooks ISBN: 978-1-7339381-0-5 http://threeplusone.com/fieldguide Berkeley Institute for Theoretical Sciences (BITS) typeset on 2019-04-10 with XeTeX version 0.99999 fonts: Trump Mediaeval (text), Euler (math) 271828182845904 2 G. E. Crooks – Field Guide to Probability Distributions Preface: The search for GUD A common problem is that of describing the probability distribution of a single, continuous variable. A few distributions, such as the normal and exponential, were discovered in the 1800’s or earlier. But about a century ago the great statistician, Karl Pearson, realized that the known probabil- ity distributions were not sufficient to handle all of the phenomena then under investigation, and set out to create new distributions with useful properties. During the 20th century this process continued with abandon and a vast menagerie of distinct mathematical forms were discovered and invented, investigated, analyzed, rediscovered and renamed, all for the purpose of de- scribing the probability of some interesting variable. There are hundreds of named distributions and synonyms in current usage. The apparent diver- sity is unending and disorienting. Fortunately, the situation is less confused than it might at first appear. Most common, continuous, univariate, unimodal distributions can be orga- nized into a small number of distinct families, which are all special cases of a single Grand Unified Distribution. This compendium details these hun- dred or so simple distributions, their properties and their interrelations.