Linear Regression for Heavy Tails

Total Page:16

File Type:pdf, Size:1020Kb

Linear Regression for Heavy Tails risks Article Linear Regression for Heavy Tails Guus Balkema 1,* and Paul Embrechts 2 1 Department of Mathematics, Universiteit van Amsterdam, 1098xh Amsterdam, The Netherlands 2 RiskLab, Department of Mathematics, ETH Zurich, 8092 Zurich, Switzerland; [email protected] * Correspondence: [email protected] Received: 29 June 2018; Accepted: 21 August 2018; Published: 10 September 2018 Abstract: There exist several estimators of the regression line in the simple linear regression: Least Squares, Least Absolute Deviation, Right Median, Theil–Sen, Weighted Balance, and Least Trimmed Squares. Their performance for heavy tails is compared below on the basis of a quadratic loss function. The case where the explanatory variable is the inverse of a standard uniform variable and where the error has a Cauchy distribution plays a central role, but heavier and lighter tails are also considered. Tables list the empirical sd and bias for ten batches of one hundred thousand simulations when the explanatory variable has a Pareto distribution and the error has a symmetric Student distribution or a one-sided Pareto distribution for various tail indices. The results in the tables may be used as benchmarks. The sample size is n = 100 but results for n = ¥ are also presented. The error in the estimate of the slope tneed not be asymptotically normal. For symmetric errors, the symmetric generalized beta prime densities often give a good fit. Keywords: exponential generalized beta prime; generalized beta prime; hyperbolic balance; least absolute deviation; least trimmed squares; Pareto distribution; right median; Theil–Sen; weighted balance Contents 1 Introduction 2 2 Background 6 3 Three Simple Estimators: LS, LAD and RMP 12 4 Weighted Balance Estimators 20 4.1 Three Examples.......................................... 21 4.2 The Monotonicity Lemma.................................... 22 4.3 LAD as a Weighted Balance Estimator............................. 24 4.4 Variations on LAD: LADPC, LADGC, and LADHC..................... 25 5 Theil’s Estimator and Kendall’s t 26 6 Trimming 27 7 Tables 30 7.1 The Empirical sd and Bias.................................... 31 7.2 Parameter Values......................................... 35 7.3 An Example............................................ 37 Risks 2018, 6, 93; doi:10.3390/risks6030093 www.mdpi.com/journal/risks Risks 2018, 6, 93 2 of 70 8 Conclusions 39 A Tails 42 A.1 Tails of aˆLAD ............................................ 42 A.2 Tails of aˆRM ............................................. 43 A.3 Tails of aˆWB0 ............................................ 44 A.4 Tails of aˆLADHC .......................................... 45 A.5 The Left Tail of Dn ........................................ 48 B The Poisson Point Process Model 49 B.1 Distributions and Densities of Poisson Point Processes.................... 49 B.2 Equivalence of the Distributions pa for x > 1/2........................ 50 B.3 Error Densities with Local Irregularities............................ 52 B.4 Two Plots.............................................. 53 B.5 Convergence for the LS Estimates................................ 55 B.6 Convergence for the RM Estimates............................... 57 C The EGBP Distributions 59 C.1 The Exponential Generalized Beta Prime Densities...................... 59 C.2 Basic Formulas.......................................... 61 C.3 The Closure of EGBP....................................... 62 C.4 The Symmetric Generalized Beta Prime Distributions.................... 63 C.5 The Parameters.......................................... 64 C.6 Fitting EGBP Distributions to Frequency Plots of log jaˆn(E)j ................ 64 C.7 Variations in the Error Density at the Origin.......................... 67 References 69 1. Introduction The paper treats the simple linear regression ∗ Yi = b + aXi + Yi i = 1, . , n (1) ∗ when the errors Yi are observations from a heavy tailed distribution, and the explanatory variables Xi too. In linear regression, the explanatory variables are often assumed to be equidistant on an interval. If the values are random, they may be uniformly distributed over an interval or normal or have some other distribution. In this paper, the explanatory variables are random. The Xi are inverse powers x of uniform variables Ui in (0, 1): Xi = 1/Ui . The variables Xi have a Pareto distribution with tail index x > 0. The tails become heavier as the index increases. For x ≥ 1, the expectation is infinite. ∗ We assume that the error variables Yi have heavy tails too, with tail index h > 0. The aim of this paper is twofold: • The paper compares a number of estimators E for the regression line in the case of heavy tails. The distribution of the error is Student or Pareto. The errors are scaled to have InterQuartile Distance IQD = 1. The tail index x of the Pareto distribution of the explanatory variable varies between zero and three; the tail index h of the error varies between zero and four. The performance of an estimator E is measured by the loss function L(u) = u2 applied to the difference between the slope a of the regression line and its estimate aˆE. Our approach is unorthodox. For various values of the tail indices x and h, we compute the average loss for ten batches of a hundred thousand simulations of a sample of size one hundred. Theorems and proofs are replaced by tables and programs. If the error has a symmetric distribution, the square root of the average loss is the Risks 2018, 6, 93 3 of 70 empirical sd (standard deviation). From the tables in Section7, it may be seen that, for good estimators, this sd depends on the tail index of the explanatory variables rather than the tail index of the error. As a rule of thumb, the sd is of the order of 1/10x+1 0 ≤ x ≤ 3, 0 ≤ h ≤ 4, n = 100. (2) This crude approximation is also valid for errors with a Pareto distribution. It may be used to determine whether an estimator of the regression line performs well for heavy tails. • The paper introduces a new class of non-linear estimators. A weighted balance estimator of the regression line is a bisector of the sample. For even sample size half the points lie below the bisector, half above. There are many bisectors. A weight sequence is used to select a bisector which yields a good estimate of the regression line. Weighted balance estimators for linear regression may be likened to the median for univariate samples. The LAD (Least Absolute Deviation) estimator is a weighted balance estimator. However, there exist weighted balance estimators which perform better when the explanatory variable has heavy tails. The results of our paper are exemplary rather than analytical. They describe the outcomes of an initial exploration on estimators for linear regression with heavy tails. The numerical results in the tables in Section7 may be regarded as benchmarks. They may be used to measure the performance of alternative estimators. Insight in the performance of estimators of the regression line for samples of size one hundred where the explanatory variable has a Pareto distribution and the error a Student or Pareto distribution may help to select a good estimator in the case of heavy tails. The literature on the LAD (Least Absolute Deviation) estimator is extensive (see Dielman(2005)). The theory for the TS (Theil–Sen) estimator is less well developed, even though TS is widely used for data which may have heavy tails, as is apparent from a search on the Internet. A comparison of the performance of these two estimators is overdue. When the tail indices x and h are positive, outliers occur naturally. Their effect on estimates has been studied in many papers. A major concern is whether an outlier should be accepted as a sample point. In simulations, contamination does not play a role. In this paper, outliers do not receive special attention. Robust statistics does not apply here. If a good fairy were to delete all outliers, that would incommode us. It is precisely the outliers which allow us to position the underlying distribution in the (x, h)-domain and select the appropriate estimator. Equation (2) makes no sense in robust regression. Our procedure for comparing estimators by computing the average loss over several batches of a large number of simulations relies on uncontaminated samples. This does not mean that we ignore the literature on robust regression. Robust regression estimates may serve as initial estimates. (This approach does not do justice to the special nature of robust regression, which aims at providing good estimates of the regression line when working with contaminated data.) In our paper, we have chosen a small number of geometric estimators of the regression line, whose performance is then compared for a symmetric and an asymmetric error distribution at various points in the x, h-domain, see Figure1a. In robust regression, one distinguishes M-, R- and L-estimators. We treat the M-estimators LS and LAD. These minimize the lp distance of the residuals for p = 2 and p = 1, respectively. We have not looked at other values of p 2 [1, ¥). Tukey’s biweight and Huber’s Method are non-geometric M-estimators since the estimate depends on the scaling on the vertical axis. The R-estimators of Jaeckel and Jureˇckováare variations on the LAD estimator. They are less sensitive to the behaviour of the density at the median, as we show in Section3. They are related to the weighted balance estimators WB40, and are discussed in Section4. Least Trimmed Squares ( LTS) was introduced in Rousseeuw(1984). It is a robust version of least squares. It is a geometric L estimator. Least Median Squares introduced in the same paper yields the central line of a closed strip containing fifty of the hundred sample points. It selects the strip with minimal vertical width. If the error has a symmetric unimodal density one may add the extra condition that there are twenty five sample points on either side of the strip. This estimator was investigated in a recent paper Postnikov and Sokolov(2015). Risks 2018, 6, 93 4 of 70 Maximum Likelihood may be used if the error distribution is known.
Recommended publications
  • A New Parameter Estimator for the Generalized Pareto Distribution Under the Peaks Over Threshold Framework
    mathematics Article A New Parameter Estimator for the Generalized Pareto Distribution under the Peaks over Threshold Framework Xu Zhao 1,*, Zhongxian Zhang 1, Weihu Cheng 1 and Pengyue Zhang 2 1 College of Applied Sciences, Beijing University of Technology, Beijing 100124, China; [email protected] (Z.Z.); [email protected] (W.C.) 2 Department of Biomedical Informatics, College of Medicine, The Ohio State University, Columbus, OH 43210, USA; [email protected] * Correspondence: [email protected] Received: 1 April 2019; Accepted: 30 April 2019 ; Published: 7 May 2019 Abstract: Techniques used to analyze exceedances over a high threshold are in great demand for research in economics, environmental science, and other fields. The generalized Pareto distribution (GPD) has been widely used to fit observations exceeding the tail threshold in the peaks over threshold (POT) framework. Parameter estimation and threshold selection are two critical issues for threshold-based GPD inference. In this work, we propose a new GPD-based estimation approach by combining the method of moments and likelihood moment techniques based on the least squares concept, in which the shape and scale parameters of the GPD can be simultaneously estimated. To analyze extreme data, the proposed approach estimates the parameters by minimizing the sum of squared deviations between the theoretical GPD function and its expectation. Additionally, we introduce a recently developed stopping rule to choose the suitable threshold above which the GPD asymptotically fits the exceedances. Simulation studies show that the proposed approach performs better or similar to existing approaches, in terms of bias and the mean square error, in estimating the shape parameter.
    [Show full text]
  • 5. the Student T Distribution
    Virtual Laboratories > 4. Special Distributions > 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 5. The Student t Distribution In this section we will study a distribution that has special importance in statistics. In particular, this distribution will arise in the study of a standardized version of the sample mean when the underlying distribution is normal. The Probability Density Function Suppose that Z has the standard normal distribution, V has the chi-squared distribution with n degrees of freedom, and that Z and V are independent. Let Z T= √V/n In the following exercise, you will show that T has probability density function given by −(n +1) /2 Γ((n + 1) / 2) t2 f(t)= 1 + , t∈ℝ ( n ) √n π Γ(n / 2) 1. Show that T has the given probability density function by using the following steps. n a. Show first that the conditional distribution of T given V=v is normal with mean 0 a nd variance v . b. Use (a) to find the joint probability density function of (T,V). c. Integrate the joint probability density function in (b) with respect to v to find the probability density function of T. The distribution of T is known as the Student t distribution with n degree of freedom. The distribution is well defined for any n > 0, but in practice, only positive integer values of n are of interest. This distribution was first studied by William Gosset, who published under the pseudonym Student. In addition to supplying the proof, Exercise 1 provides a good way of thinking of the t distribution: the t distribution arises when the variance of a mean 0 normal distribution is randomized in a certain way.
    [Show full text]
  • A Study of Non-Central Skew T Distributions and Their Applications in Data Analysis and Change Point Detection
    A STUDY OF NON-CENTRAL SKEW T DISTRIBUTIONS AND THEIR APPLICATIONS IN DATA ANALYSIS AND CHANGE POINT DETECTION Abeer M. Hasan A Dissertation Submitted to the Graduate College of Bowling Green State University in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY August 2013 Committee: Arjun K. Gupta, Co-advisor Wei Ning, Advisor Mark Earley, Graduate Faculty Representative Junfeng Shang. Copyright c August 2013 Abeer M. Hasan All rights reserved iii ABSTRACT Arjun K. Gupta, Co-advisor Wei Ning, Advisor Over the past three decades there has been a growing interest in searching for distribution families that are suitable to analyze skewed data with excess kurtosis. The search started by numerous papers on the skew normal distribution. Multivariate t distributions started to catch attention shortly after the development of the multivariate skew normal distribution. Many researchers proposed alternative methods to generalize the univariate t distribution to the multivariate case. Recently, skew t distribution started to become popular in research. Skew t distributions provide more flexibility and better ability to accommodate long-tailed data than skew normal distributions. In this dissertation, a new non-central skew t distribution is studied and its theoretical properties are explored. Applications of the proposed non-central skew t distribution in data analysis and model comparisons are studied. An extension of our distribution to the multivariate case is presented and properties of the multivariate non-central skew t distri- bution are discussed. We also discuss the distribution of quadratic forms of the non-central skew t distribution. In the last chapter, the change point problem of the non-central skew t distribution is discussed under different settings.
    [Show full text]
  • Independent Approximates Enable Closed-Form Estimation of Heavy-Tailed Distributions
    Independent Approximates enable closed-form estimation of heavy-tailed distributions Kenric P. Nelson Abstract – Independent Approximates (IAs) are proven to enable a closed-form estimation of heavy-tailed distributions with an analytical density such as the generalized Pareto and Student’s t distributions. A broader proof using convolution of the characteristic function is described for future research. (IAs) are selected from independent, identically distributed samples by partitioning the samples into groups of size n and retaining the median of the samples in those groups which have approximately equal samples. The marginal distribution along the diagonal of equal values has a density proportional to the nth power of the original density. This nth-power-density, which the IAs approximate, has faster tail decay enabling closed-form estimation of its moments and retains a functional relationship with the original density. Computational experiments with between 1000 to 100,000 Student’s t samples are reported for over a range of location, scale, and shape (inverse of degree of freedom) parameters. IA pairs are used to estimate the location, IA triplets for the scale, and the geometric mean of the original samples for the shape. With 10,000 samples the relative bias of the parameter estimates is less than 0.01 and a relative precision is less than ±0.1. The theoretical bias is zero for the location and the finite bias for the scale can be subtracted out. The theoretical precision has a finite range when the shape is less than 2 for the location estimate and less than 3/2 for the scale estimate.
    [Show full text]
  • ACTS 4304 FORMULA SUMMARY Lesson 1: Basic Probability Summary of Probability Concepts Probability Functions
    ACTS 4304 FORMULA SUMMARY Lesson 1: Basic Probability Summary of Probability Concepts Probability Functions F (x) = P r(X ≤ x) S(x) = 1 − F (x) dF (x) f(x) = dx H(x) = − ln S(x) dH(x) f(x) h(x) = = dx S(x) Functions of random variables Z 1 Expected Value E[g(x)] = g(x)f(x)dx −∞ 0 n n-th raw moment µn = E[X ] n n-th central moment µn = E[(X − µ) ] Variance σ2 = E[(X − µ)2] = E[X2] − µ2 µ µ0 − 3µ0 µ + 2µ3 Skewness γ = 3 = 3 2 1 σ3 σ3 µ µ0 − 4µ0 µ + 6µ0 µ2 − 3µ4 Kurtosis γ = 4 = 4 3 2 2 σ4 σ4 Moment generating function M(t) = E[etX ] Probability generating function P (z) = E[zX ] More concepts • Standard deviation (σ) is positive square root of variance • Coefficient of variation is CV = σ/µ • 100p-th percentile π is any point satisfying F (π−) ≤ p and F (π) ≥ p. If F is continuous, it is the unique point satisfying F (π) = p • Median is 50-th percentile; n-th quartile is 25n-th percentile • Mode is x which maximizes f(x) (n) n (n) • MX (0) = E[X ], where M is the n-th derivative (n) PX (0) • n! = P r(X = n) (n) • PX (1) is the n-th factorial moment of X. Bayes' Theorem P r(BjA)P r(A) P r(AjB) = P r(B) fY (yjx)fX (x) fX (xjy) = fY (y) Law of total probability 2 If Bi is a set of exhaustive (in other words, P r([iBi) = 1) and mutually exclusive (in other words P r(Bi \ Bj) = 0 for i 6= j) events, then for any event A, X X P r(A) = P r(A \ Bi) = P r(Bi)P r(AjBi) i i Correspondingly, for continuous distributions, Z P r(A) = P r(Ajx)f(x)dx Conditional Expectation Formula EX [X] = EY [EX [XjY ]] 3 Lesson 2: Parametric Distributions Forms of probability
    [Show full text]
  • Beta-Cauchy Distribution: Some Properties and Applications
    Journal of Statistical Theory and Applications, Vol. 12, No. 4 (December 2013), 378-391 Beta-Cauchy Distribution: Some Properties and Applications Etaf Alshawarbeh Department of Mathematics, Central Michigan University Mount Pleasant, MI 48859, USA Email: [email protected] Felix Famoye Department of Mathematics, Central Michigan University Mount Pleasant, MI 48859, USA Email: [email protected] Carl Lee Department of Mathematics, Central Michigan University Mount Pleasant, MI 48859, USA Email: [email protected] Abstract Some properties of the four-parameter beta-Cauchy distribution such as the mean deviation and Shannon’s entropy are obtained. The method of maximum likelihood is proposed to estimate the parameters of the distribution. A simulation study is carried out to assess the performance of the maximum likelihood estimates. The usefulness of the new distribution is illustrated by applying it to three empirical data sets and comparing the results to some existing distributions. The beta-Cauchy distribution is found to provide great flexibility in modeling symmetric and skewed heavy-tailed data sets. Keywords and Phrases: Beta family, mean deviation, entropy, maximum likelihood estimation. 1. Introduction Eugene et al.1 introduced a class of new distributions using beta distribution as the generator and pointed out that this can be viewed as a family of generalized distributions of order statistics. Jones2 studied some general properties of this family. This class of distributions has been referred to as “beta-generated distributions”.3 This family of distributions provides some flexibility in modeling data sets with different shapes. Let F(x) be the cumulative distribution function (CDF) of a random variable X, then the CDF G(x) for the “beta-generated distributions” is given by Fx() 1 11 G( x ) [ B ( , )] t(1 t ) dt , 0 , , (1) 0 where B(αβ , )=ΓΓ ( α ) ( β )/ Γ+ ( α β ) .
    [Show full text]
  • Statistical Distributions in General Insurance Stochastic Processes
    Statistical distributions in general insurance stochastic processes by Jan Hendrik Harm Steenkamp Submitted in partial fulfilment of the requirements for the degree Magister Scientiae In the Department of Statistics In the Faculty of Natural & Agricultural Sciences University of Pretoria Pretoria January 2014 © University of Pretoria 1 I, Jan Hendrik Harm Steenkamp declare that the dissertation, which I hereby submit for the degree Magister Scientiae in Mathematical Statistics at the University of Pretoria, is my own work and has not previously been submit- ted for a degree at this or any other tertiary institution. SIGNATURE: DATE: 31 January 2014 © University of Pretoria Summary A general insurance risk model consists of in initial reserve, the premiums collected, the return on investment of these premiums, the claims frequency and the claims sizes. Except for the initial reserve, these components are all stochastic. The assumption of the distributions of the claims sizes is an integral part of the model and can greatly influence decisions on reinsurance agreements and ruin probabilities. An array of parametric distributions are available for use in describing the distribution of claims. The study is focussed on parametric distributions that have positive skewness and are defined for positive real values. The main properties and parameterizations are studied for a number of distribu- tions. Maximum likelihood estimation and method-of-moments estimation are considered as techniques for fitting these distributions. Multivariate nu- merical maximum likelihood estimation algorithms are proposed together with discussions on the efficiency of each of the estimation algorithms based on simulation exercises. These discussions are accompanied with programs developed in SAS PROC IML that can be used to simulate from the var- ious parametric distributions and to fit these parametric distributions to observed data.
    [Show full text]
  • Chapter 7 “Continuous Distributions”.Pdf
    CHAPTER 7 Continuous distributions 7.1. Basic theory 7.1.1. Denition, PDF, CDF. We start with the denition a continuous random variable. Denition (Continuous random variables) A random variable X is said to have a continuous distribution if there exists a non- negative function f = f such that X ¢ b P(a 6 X 6 b) = f(x)dx a for every a and b. The function f is called the density function for X or the PDF for X. ¡More precisely, such an X is said to have an absolutely continuous¡ distribution. Note that 1 . In particular, a for every . −∞ f(x)dx = P(−∞ < X < 1) = 1 P(X = a) = a f(x)dx = 0 a 3 ¡Example 7.1. Suppose we are given that f(x) = c=x for x > 1 and 0 otherwise. Since 1 and −∞ f(x)dx = 1 ¢ ¢ 1 1 1 c c f(x)dx = c 3 dx = ; −∞ 1 x 2 we have c = 2. PMF or PDF? Probability mass function (PMF) and (probability) density function (PDF) are two names for the same notion in the case of discrete random variables. We say PDF or simply a density function for a general random variable, and we use PMF only for discrete random variables. Denition (Cumulative distribution function (CDF)) The distribution function of X is dened as ¢ y F (y) = FX (y) := P(−∞ < X 6 y) = f(x)dx: −∞ It is also called the cumulative distribution function (CDF) of X. 97 98 7. CONTINUOUS DISTRIBUTIONS We can dene CDF for any random variable, not just continuous ones, by setting F (y) := P(X 6 y).
    [Show full text]
  • (Introduction to Probability at an Advanced Level) - All Lecture Notes
    Fall 2018 Statistics 201A (Introduction to Probability at an advanced level) - All Lecture Notes Aditya Guntuboyina August 15, 2020 Contents 0.1 Sample spaces, Events, Probability.................................5 0.2 Conditional Probability and Independence.............................6 0.3 Random Variables..........................................7 1 Random Variables, Expectation and Variance8 1.1 Expectations of Random Variables.................................9 1.2 Variance................................................ 10 2 Independence of Random Variables 11 3 Common Distributions 11 3.1 Ber(p) Distribution......................................... 11 3.2 Bin(n; p) Distribution........................................ 11 3.3 Poisson Distribution......................................... 12 4 Covariance, Correlation and Regression 14 5 Correlation and Regression 16 6 Back to Common Distributions 16 6.1 Geometric Distribution........................................ 16 6.2 Negative Binomial Distribution................................... 17 7 Continuous Distributions 17 7.1 Normal or Gaussian Distribution.................................. 17 1 7.2 Uniform Distribution......................................... 18 7.3 The Exponential Density...................................... 18 7.4 The Gamma Density......................................... 18 8 Variable Transformations 19 9 Distribution Functions and the Quantile Transform 20 10 Joint Densities 22 11 Joint Densities under Transformations 23 11.1 Detour to Convolutions......................................
    [Show full text]
  • Chapter 10 “Some Continuous Distributions”.Pdf
    CHAPTER 10 Some continuous distributions 10.1. Examples of continuous random variables We look at some other continuous random variables besides normals. Uniform distribution A continuous random variable has uniform distribution if its density is f(x) = 1/(b a) − if a 6 x 6 b and 0 otherwise. For a random variable X with uniform distribution its expectation is 1 b a + b EX = x dx = . b a ˆ 2 − a Exponential distribution A continuous random variable has exponential distribution with parameter λ > 0 if its λx density is f(x) = λe− if x > 0 and 0 otherwise. Suppose X is a random variable with an exponential distribution with parameter λ. Then we have ∞ λx λa (10.1.1) P(X > a) = λe− dx = e− , ˆa λa FX (a) = 1 P(X > a) = 1 e− , − − and we can use integration by parts to see that EX = 1/λ, Var X = 1/λ2. Examples where an exponential random variable is a good model is the length of a telephone call, the length of time before someone arrives at a bank, the length of time before a light bulb burns out. Exponentials are memoryless, that is, P(X > s + t X > t) = P(X > s), | or given that the light bulb has burned 5 hours, the probability it will burn 2 more hours is the same as the probability a new light bulb will burn 2 hours. Here is how we can prove this 129 130 10. SOME CONTINUOUS DISTRIBUTIONS P(X > s + t) P(X > s + t X > t) = | P(X > t) λ(s+t) e− λs − = λt = e e− = P(X > s), where we used Equation (10.1.1) for a = t and a = s + t.
    [Show full text]
  • Fixed-K Asymptotic Inference About Tail Properties
    Journal of the American Statistical Association ISSN: 0162-1459 (Print) 1537-274X (Online) Journal homepage: http://www.tandfonline.com/loi/uasa20 Fixed-k Asymptotic Inference About Tail Properties Ulrich K. Müller & Yulong Wang To cite this article: Ulrich K. Müller & Yulong Wang (2017) Fixed-k Asymptotic Inference About Tail Properties, Journal of the American Statistical Association, 112:519, 1334-1343, DOI: 10.1080/01621459.2016.1215990 To link to this article: https://doi.org/10.1080/01621459.2016.1215990 Accepted author version posted online: 12 Aug 2016. Published online: 13 Jun 2017. Submit your article to this journal Article views: 206 View related articles View Crossmark data Full Terms & Conditions of access and use can be found at http://www.tandfonline.com/action/journalInformation?journalCode=uasa20 JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION , VOL. , NO. , –, Theory and Methods https://doi.org/./.. Fixed-k Asymptotic Inference About Tail Properties Ulrich K. Müller and Yulong Wang Department of Economics, Princeton University, Princeton, NJ ABSTRACT ARTICLE HISTORY We consider inference about tail properties of a distribution from an iid sample, based on extreme value the- Received February ory. All of the numerous previous suggestions rely on asymptotics where eventually, an infinite number of Accepted July observations from the tail behave as predicted by extreme value theory, enabling the consistent estimation KEYWORDS of the key tail index, and the construction of confidence intervals using the delta method or other classic Extreme quantiles; tail approaches. In small samples, however, extreme value theory might well provide good approximations for conditional expectations; only a relatively small number of tail observations.
    [Show full text]
  • Package 'Renext'
    Package ‘Renext’ July 4, 2016 Type Package Title Renewal Method for Extreme Values Extrapolation Version 3.1-0 Date 2016-07-01 Author Yves Deville <[email protected]>, IRSN <[email protected]> Maintainer Lise Bardet <[email protected]> Depends R (>= 2.8.0), stats, graphics, evd Imports numDeriv, splines, methods Suggests MASS, ismev, XML Description Peaks Over Threshold (POT) or 'methode du renouvellement'. The distribution for the ex- ceedances can be chosen, and heterogeneous data (including histori- cal data or block data) can be used in a Maximum-Likelihood framework. License GPL (>= 2) LazyData yes NeedsCompilation no Repository CRAN Date/Publication 2016-07-04 20:29:04 R topics documented: Renext-package . .3 anova.Renouv . .5 barplotRenouv . .6 Brest . .8 Brest.years . 10 Brest.years.missing . 11 CV2............................................. 11 CV2.test . 12 Dunkerque . 13 EM.mixexp . 15 expplot . 16 1 2 R topics documented: fgamma . 17 fGEV.MAX . 19 fGPD ............................................ 22 flomax . 24 fmaxlo . 26 fweibull . 29 Garonne . 30 gev2Ren . 32 gof.date . 34 gofExp.test . 37 GPD............................................. 38 gumbel2Ren . 40 Hpoints . 41 ini.mixexp2 . 42 interevt . 43 Jackson . 45 Jackson.test . 46 logLik.Renouv . 47 Lomax . 48 LRExp . 50 LRExp.test . 51 LRGumbel . 53 LRGumbel.test . 54 Maxlo . 55 MixExp2 . 57 mom.mixexp2 . 58 mom2par . 60 NBlevy . 61 OT2MAX . 63 OTjitter . 66 parDeriv . 67 parIni.MAX . 70 pGreenwood1 . 72 plot.Rendata . 73 plot.Renouv . 74 PPplot . 78 predict.Renouv . 79 qStat . 80 readXML . 82 Ren2gev . 84 Ren2gumbel . 85 Renouv . 87 RenouvNoEst . 94 RLlegend . 96 RLpar . 98 RLplot . 99 roundPred . 101 rRendata . 102 Renext-package 3 SandT . 105 skip2noskip .
    [Show full text]