Technical Article

Total Page:16

File Type:pdf, Size:1020Kb

Technical Article Risk Technical article Risk is the world's leading financial risk management magazine. Risk’s Cutting Edge articles are a showcase for the latest thinking and research into derivatives tools and techniques, with comprehensive coverage of the most recent advances in areas such as option pricing and hedging, market risk, credit risk, swaps and Monte Carlo methods. www.risk.net/technical Copyright statement © Risk Waters Group Ltd, 2003. All rights This PDF is made available for personal use reserved. No parts of this article may be only. Under the following terms you are reproduced, stored in or introduced into any granted permission to view online, print out, retrieval system, or transmitted, in any form or store on your computer a single copy, or by any means, electronic, mechanical, provided this is intended for the benefit of photocopying, recording or otherwise the individual user. Should you wish to use without the prior written permission of the multiple copies of this article, please contact copyright owners. [email protected] HOSKING.QXD 03/05/00 13:36 Page 1 Value-at-risk Beyond the lognormal Although value-at-risk has suffered a fair amount of criticism in recent years, it remains a central platform of any market risk management system. In the first of two VAR-themed articles, Jonathan Hosking, Gabriel Bonti and Dirk Siegel propose a new method for incorporating non-lognormality into Monte Carlo VAR simulation ost risk managers recognise that market returns with location and scale parameters in addition to the degrees of freedom) are not lognormally distributed but exhibit so- gives a satisfactory approximation for most data sets. called fat tails. This well-established phenomenon Short-term interest rates, whose daily returns contain many exact zero is important when measuring value-at-risk, as the values, may require a different model, perhaps a fat-tailed distribution with quantiles in VAR are directly related to the tails of a “spike” of non-zero probability mass at zero. This is a subject of contin- the distributions of market parameters. The more uing research. Mextreme a quantile required, the more sensitive is the result to the correct Meta-Gaussian joint distributions. The probability integral transform modelling of the tails of the distribution. permits any continuous distribution to be transformed into any other. We Two of the most widely used approaches to calculating VAR, however, use it to transform scaled returns so that their distribution is Gaussian. The Φ–1 are based on the (log) normality assumption. They are the covariance transformation is zt = (F(st)), where F is the cumulative distribution method of JP Morgan’s RiskMetrics and the Monte Carlo simulation ap- function (CDF) of the distribution of scaled returns and Φ–1 is the inverse proach. The historical simulation technique does not suffer from this draw- CDF of the standard Gaussian distribution. back but can be criticised for other reasons (Jorion, 1997, pages 195–196). A simple model for the joint dependence of market variables is that As part of a research project between Deutsche Bank and IBM, we have after this transformation of the scaled returns to Gaussianity, the joint dis- devised a method for calculating VAR that overcomes the problems asso- tribution of the transformed variables is multivariate Gaussian. The joint ciated with the assumption of normality. Our basic approach uses Monte distribution of the original variables has been termed the “meta-Gaussian” Carlo simulation, which has the desirable property of being able to gen- distribution (Kelly & Krzysztofowicz, 1997). Tests, which we describe erate large scenario sets, thereby improving the statistical properties of the below, of this meta-Gaussian model for scaled returns indicate that it gives VAR estimator. We generate the scenarios by modifying the classical Monte an adequate fit to the data. Carlo approach to take into account the fat-tailed distributions of market Time-varying dependence. In the meta-Gaussian distribution, depen- variables. The method uses new statistical techniques for identifying and dence between the variables is measured by the correlation matrix of the estimating fat-tailed distributions, and includes a model of statistical de- transformed Gaussian variables. These correlations vary substantially over pendence between quantities that are not normally distributed. time, so they are estimated from relatively short stretches of data. Analo- In this paper, we describe the rationale behind our approach, give de- gously to our volatility estimates, we estimate the correlation from the last tails of the mathematical framework and report encouraging results ob- 260 trading days’ values of each pair of transformed series of scaled returns. tained by applying the method to several real-world portfolios. Statistical analyses Model specifications L-moment methods to identify marginal distributions. L-moments Logarithmic daily returns. The model is based on logarithmic daily are measures of the salient features – location, scale and shape – of prob- returns rt = log(pt /pt – 1), where pt is the market variable (stock index, ability distributions or data samples. They were introduced by Hosking forex rate or interest rate) on trading day t. (1990) and are further described in Hosking (1998, 1999). For a distribu- Time-varying volatility. To allow for non-constant volatility, we model tion with quantile function (inverse cumulative distribution function) Q(.), the scaled returns st = rt /vtt – 1, where vtt – 1 is the volatility of trading the L-moment of order r is defined by: day t, as estimated using data up to day t – 1. This estimated volatility is 1 * λ=∫ PuQudu− () () used because, when simulating scenarios, we will be simulating data for rr10 * * tomorrow (day t + 1) but will have only data up to today (day t) from where Pr is a polynomial of degree r. Specifically, the Pr are shifted Le- which to calculate tomorrow’s volatility. gendre polynomials, which are orthogonal on the interval (0, 1) with con- λ λ We use a simple estimate of volatility, the second sample L-moment, 2, stant weight function. 1 is the mean of the distribution and 2 is a scale τ λ λ of the last 260 daily returns. The second L-moment is a dispersion mea- or dispersion measure. The L-moment ratios r = r / 2 are dimensionless sure analogous to the standard deviation, but is less affected by extreme measures of the shape of the distribution; they all take values between –1 τ data values than are ordinary moments and is therefore more suitable for and +1. Analogously to the ordinary moments, 3 is a measure of skew- τ use with data drawn from fat-tailed distributions (Hosking, 1990). We use ness and 4 is a measure of kurtosis (in a sense that can be formalised; 260 days of past data to satisfy regulatory requirements (Basle Committee see Hosking, 1990, page 109). on Banking Supervision, 1996, page 44). If the mean of the distribution exists, then so do all the higher-order L- Non-Gaussian marginal distributions. Although scaling the returns moments. This means that L-moments can describe fat-tailed distributions to allow for non-constant volatility can, under some theoretical models, whose variance or higher-order ordinary moments may be infinite. account for fat-tailedness in market variables, in practice it is not sufficient. From a sample of data, the L-moments of the distribution from which L-moment analysis, which we describe below, indicates that distribu- the sample was drawn can be estimated by “sample L-moments”, which tions of returns are approximately symmetric and have heavier tails than are linear combinations of the ordered data values. Corresponding sample the Gaussian. A Pearson-type VII distribution (a Student’s t distribution L-moment ratios can also be defined. 59 • RISK • MAY 2000 HOSKING.QXD 03/05/00 13:36 Page 2 Value-at-risk 2. Nikkei stock index: 1. L-moment ratio diagram Jun 1993–May 1998 0.3 15 Data Ger. Jap. US HK Thai Nikkei scaled daily returns Forex v. $ 6 τ Stock 10 Int 2-yr 0.2 Int 5-yr 5 Int 10-yr 0 0.1 Scaled returns –5 Distributions Distributions Stable –10 Stable α = 1.82 Sixth-order L-moment ratio, Student's t Normal Student's t 4.2 df Power exp Power exp β = 1.13 0.0 –15 0.1 0.2 0.3 0.4 –4 –2 0 2 4 τ Fourth-order L-moment ratio, 4 Normal variate By comparing the sample data points with the population L-moment curves for Normal probability plot of scaled returns of the Nikkei stock index, and of three different distributions, one can choose the best distribution to fit to the data distributions fitted to the data The scaled returns of market variables have little skewness. The sam- in figure 1, and the sample moments can be wildly unstable across differ- τ ple estimate of 3 is generally less than 0.05 in absolute value, and dis- ent five-year samples, because their values are strongly affected by the plays little consistency across different data series. We are therefore content most extreme observations in the sample.) to use symmetric distributions to fit the data. Tests of meta-Gaussianity. Testing the hypothesis of meta-Gaussiani- For symmetric distributions, all the odd-order L-moment ratios are zero ty is complicated by the time variability of correlations between market and the even-order L-moment ratios carry the information about the shape variables. For periods during which correlations are approximately con- τ τ of the distribution. In particular, the relation between 4 and 6 can be stant, standard tests and judgements of joint Gaussianity can be made for used to distinguish different families of symmetric distributions.
Recommended publications
  • Use of Proc Iml to Calculate L-Moments for the Univariate Distributional Shape Parameters Skewness and Kurtosis
    Statistics 573 USE OF PROC IML TO CALCULATE L-MOMENTS FOR THE UNIVARIATE DISTRIBUTIONAL SHAPE PARAMETERS SKEWNESS AND KURTOSIS Michael A. Walega Berlex Laboratories, Wayne, New Jersey Introduction Exploratory data analysis statistics, such as those Gaussian. Bickel (1988) and Van Oer Laan and generated by the sp,ge procedure PROC Verdooren (1987) discuss the concept of robustness UNIVARIATE (1990), are useful tools to characterize and how it pertains to the assumption of normality. the underlying distribution of data prior to more rigorous statistical analyses. Assessment of the As discussed by Glass et al. (1972), incorrect distributional shape of data is usually accomplished conclusions may be reached when the normality by careful examination of the values of the third and assumption is not valid, especially when one-tail tests fourth central moments, skewness and kurtosis. are employed or the sample size or significance level However, when the sample size is small or the are very small. Hopkins and Weeks (1990) also underlying distribution is non-normal, the information discuss the effects of highly non-normal data on obtained from the sample skewness and kurtosis can hypothesis testing of variances. Thus, it is apparent be misleading. that examination of the skewness (departure from symmetry) and kurtosis (deviation from a normal One alternative to the central moment shape statistics curve) is an important component of exploratory data is the use of linear combinations of order statistics (L­ analyses. moments) to examine the distributional shape characteristics of data. L-moments have several Various methods to estimate skewness and kurtosis theoretical advantages over the central moment have been proposed (MacGillivray and Salanela, shape statistics: Characterization of a wider range of 1988).
    [Show full text]
  • On the Meaning and Use of Kurtosis
    Psychological Methods Copyright 1997 by the American Psychological Association, Inc. 1997, Vol. 2, No. 3,292-307 1082-989X/97/$3.00 On the Meaning and Use of Kurtosis Lawrence T. DeCarlo Fordham University For symmetric unimodal distributions, positive kurtosis indicates heavy tails and peakedness relative to the normal distribution, whereas negative kurtosis indicates light tails and flatness. Many textbooks, however, describe or illustrate kurtosis incompletely or incorrectly. In this article, kurtosis is illustrated with well-known distributions, and aspects of its interpretation and misinterpretation are discussed. The role of kurtosis in testing univariate and multivariate normality; as a measure of departures from normality; in issues of robustness, outliers, and bimodality; in generalized tests and estimators, as well as limitations of and alternatives to the kurtosis measure [32, are discussed. It is typically noted in introductory statistics standard deviation. The normal distribution has a kur- courses that distributions can be characterized in tosis of 3, and 132 - 3 is often used so that the refer- terms of central tendency, variability, and shape. With ence normal distribution has a kurtosis of zero (132 - respect to shape, virtually every textbook defines and 3 is sometimes denoted as Y2)- A sample counterpart illustrates skewness. On the other hand, another as- to 132 can be obtained by replacing the population pect of shape, which is kurtosis, is either not discussed moments with the sample moments, which gives or, worse yet, is often described or illustrated incor- rectly. Kurtosis is also frequently not reported in re- ~(X i -- S)4/n search articles, in spite of the fact that virtually every b2 (•(X i - ~')2/n)2' statistical package provides a measure of kurtosis.
    [Show full text]
  • The Normal Probability Distribution
    BIOSTATISTICS BIOL 4343 Assessing normality Not all continuous random variables are normally distributed. It is important to evaluate how well the data set seems to be adequately approximated by a normal distribution. In this section some statistical tools will be presented to check whether a given set of data is normally distributed. 1. Previous knowledge of the nature of the distribution Problem: A researcher working with sea stars needs to know if sea star size (length of radii) is normally distributed. What do we know about the size distributions of sea star populations? 1. Has previous work with this species of sea star shown them to be normally distributed? 2. Has previous work with a closely related species of seas star shown them to be normally distributed? 3. Has previous work with seas stars in general shown them to be normally distributed? If you can answer yes to any of the above questions and you do not have a reason to think your population should be different, you could reasonably assume that your population is also normally distributed and stop here. However, if any previous work has shown non-normal distribution of sea stars you had probably better use other techniques. 2. Construct charts For small- or moderate-sized data sets, the stem-and-leaf display and box-and- whisker plot will look symmetric. For large data sets, construct a histogram or polygon and see if the distribution bell-shaped or deviates grossly from a bell-shaped normal distribution. Look for skewness and asymmetry. Look for gaps in the distribution – intervals with no observations.
    [Show full text]
  • 2.8 Probability-Weighted Moments 33 2.8.1 Exact Variances and Covariances of Sample Probability Weighted Moments 35 2.9 Conclusions 36
    Durham E-Theses Probability distribution theory, generalisations and applications of l-moments Elamir, Elsayed Ali Habib How to cite: Elamir, Elsayed Ali Habib (2001) Probability distribution theory, generalisations and applications of l-moments, Durham theses, Durham University. Available at Durham E-Theses Online: http://etheses.dur.ac.uk/3987/ Use policy The full-text may be used and/or reproduced, and given to third parties in any format or medium, without prior permission or charge, for personal research or study, educational, or not-for-prot purposes provided that: • a full bibliographic reference is made to the original source • a link is made to the metadata record in Durham E-Theses • the full-text is not changed in any way The full-text must not be sold in any format or medium without the formal permission of the copyright holders. Please consult the full Durham E-Theses policy for further details. Academic Support Oce, Durham University, University Oce, Old Elvet, Durham DH1 3HP e-mail: [email protected] Tel: +44 0191 334 6107 http://etheses.dur.ac.uk 2 Probability distribution theory, generalisations and applications of L-moments A thesis presented for the degree of Doctor of Philosophy at the University of Durham Elsayed Ali Habib Elamir Department of Mathematical Sciences, University of Durham, Durham, DHl 3LE. The copyright of this thesis rests with the author. No quotation from it should be published in any form, including Electronic and the Internet, without the author's prior written consent. All information derived from this thesis must be acknowledged appropriately.
    [Show full text]
  • Tests of Normality and Other Goodness-Of-Fit Tests
    Statistics 2 7 3 TESTS OF NORMALITY AND OTHER GOODNESS-OF-FIT TESTS Ralph B. D'Agostino, Albert J. Belanger, and Ralph B. D' Agostino Jr. Boston University Mathematics Department, Statistics and Consulting Unit Probability plots and goodness-of-fit tests are standardized deviates, :z;. on the horizontal axis. In table useful tools in detennining the underlying disnibution of I, we list the formulas for the disnibutions we plot in our a population (D'Agostino and Stephens, 1986. chapter 2). macro. If the underlying distribution is F(x), the resulting Probability plotting is an informal procedure for describing plot will be approximately a straight line. data and for identifying deviations from the hypothesized disnibution. Goodness-of-fit tests are formal procedures TABLE 1 which can be used to test for specific hypothesized disnibutions. We will present macros using SAS for Plotting Fonnulas for the six distributions plotted in our macro. creating probability plots for six disnibutions: the uniform. (PF(i-0.5)/n) normal, lognonnai, logistic, Weibull. and exponential. In Distribution cdf F(x) Vertical Horizontal addition these macros will compute the skewness <.pi;> . Axis Axis 7, kurtosis (b2), and D'Agostino-Pearson Kz statistics for testing if the underlying disttibution is normal (or Unifonn x-11 for 1'<%<1' +o ~ P... ~ ·lognormal) and the Anderson-Darling (EDF) A2 statistic G II for testing for the normal, log-normal, and exponential disnibutions. The latter can be modified for general ··I( ~;j i-3/8) distributions. 11+1(4 PROBABILITY PLOTS In(~~ ·-1( 1-3/8) 11+1{4 Say we desire to investigate if the underlying cumulative disnibution of a population is F(x) where this Weibull 1-exp( -(.!.t) ln(lw) In( -In( 1-p,)) disnibution depends upon a location parameter )l and scale 6 plll31lleter a.
    [Show full text]
  • Univariate Analysis and Normality Test Using SAS, STATA, and SPSS
    © 2002-2006 The Trustees of Indiana University Univariate Analysis and Normality Test: 1 Univariate Analysis and Normality Test Using SAS, STATA, and SPSS Hun Myoung Park This document summarizes graphical and numerical methods for univariate analysis and normality test, and illustrates how to test normality using SAS 9.1, STATA 9.2 SE, and SPSS 14.0. 1. Introduction 2. Graphical Methods 3. Numerical Methods 4. Testing Normality Using SAS 5. Testing Normality Using STATA 6. Testing Normality Using SPSS 7. Conclusion 1. Introduction Descriptive statistics provide important information about variables. Mean, median, and mode measure the central tendency of a variable. Measures of dispersion include variance, standard deviation, range, and interquantile range (IQR). Researchers may draw a histogram, a stem-and-leaf plot, or a box plot to see how a variable is distributed. Statistical methods are based on various underlying assumptions. One common assumption is that a random variable is normally distributed. In many statistical analyses, normality is often conveniently assumed without any empirical evidence or test. But normality is critical in many statistical methods. When this assumption is violated, interpretation and inference may not be reliable or valid. Figure 1. Comparing the Standard Normal and a Bimodal Probability Distributions Standard Normal Distribution Bimodal Distribution .4 .4 .3 .3 .2 .2 .1 .1 0 0 -5 -3 -1 1 3 5 -5 -3 -1 1 3 5 T-test and ANOVA (Analysis of Variance) compare group means, assuming variables follow normal probability distributions. Otherwise, these methods do not make much http://www.indiana.edu/~statmath © 2002-2006 The Trustees of Indiana University Univariate Analysis and Normality Test: 2 sense.
    [Show full text]
  • Typical Distribution Functions in Geophysics, Hydrology and Water Resources
    Chapter 6 Typical distribution functions in geophysics, hydrology and water resources Demetris Koutsoyiannis Department of Water Resources and Environmental Engineering Faculty of Civil Engineering, National Technical University of Athens, Greece Summary In this chapter we describe four families of distribution functions that are used in geophysical and engineering applications, including engineering hydrology and water resources technology. The first includes the normal distribution and the distributions derived from this by the logarithmic transformation. The second is the gamma family and related distributions that includes the exponential distribution, the two- and three-parameter gamma distributions, the Log-Pearson III distribution derived from the last one by the logarithmic transformation and the beta distribution that is closely related to the gamma distribution. The third is the Pareto distribution, which in the last years tends to become popular due to its long tail that seems to be in accordance with natural behaviours. The fourth family includes the extreme value distributions represented by the generalized extreme value distributions of maxima and minima, special cases of which are the Gumbel and the Weibull distributions. 5.1 Normal Distribution and related transformations 5.1.1 Normal (Gaussian) Distribution In the preceding chapters we have discussed extensively and in detail the normal distribution and its use in statistics and in engineering applications. Specifically, the normal distribution has been introduced in section 2.8, as a consequence of the central limit theorem, along with two closely related distributions, the χ2 and the Student (or t), which are of great importance in statistical estimates, even though they are not used for the description of geophysical variables.
    [Show full text]
  • Inference for Unreplicated Factorial and Fractional Factorial Designs. William J
    Louisiana State University LSU Digital Commons LSU Historical Dissertations and Theses Graduate School 1994 Inference for Unreplicated Factorial and Fractional Factorial Designs. William J. Kasperski Louisiana State University and Agricultural & Mechanical College Follow this and additional works at: https://digitalcommons.lsu.edu/gradschool_disstheses Recommended Citation Kasperski, William J., "Inference for Unreplicated Factorial and Fractional Factorial Designs." (1994). LSU Historical Dissertations and Theses. 5731. https://digitalcommons.lsu.edu/gradschool_disstheses/5731 This Dissertation is brought to you for free and open access by the Graduate School at LSU Digital Commons. It has been accepted for inclusion in LSU Historical Dissertations and Theses by an authorized administrator of LSU Digital Commons. For more information, please contact [email protected]. INFORMATION TO USERS This manuscript has been reproduced from the microfilm master. UMI films the text directly from the original or copy submitted. Thus, some thesis and dissertation copies are in typewriter face, while others may be from any type of computer printer. The quality of this reproduction is dependent upon the quality of the copy submitted. Broken or indistinct print, colored or poor quality illustrations and photographs, print bleedthrough, substandard margins, and improper alignment can adversely affect reproduction. In the unlikely event that the author did not send UMI a complete manuscript and there are missing pages, these will be noted. Also, if unauthorized copyright material had to be removed, a note will indicate the deletion. Oversize materials (e.g., maps, drawings, charts) are reproduced by sectioning the original, beginning at the upper left-hand corner and continuing from left to right in equal sections with small overlaps.
    [Show full text]
  • 5 Checking Assumptions
    5 CHECKING ASSUMPTIONS 5 Checking Assumptions Almost all statistical methods make assumptions about the data collection process and the shape of the population distribution. If you reject the null hypothesis in a test, then a reasonable conclusion is that the null hypothesis is false, provided all the distributional assumptions made by the test are satisfied. If the assumptions are not satisfied then that alone might be the cause of rejecting H0. Additionally, if you fail to reject H0, that could be caused solely by failure to satisfy assumptions also. Hence, you should always check assumptions to the best of your abilities. Two assumptions that underly the tests and CI procedures that I have discussed are that the data are a random sample, and that the population frequency curve is normal. For the pooled variance two sample test the population variances are also required to be equal. The random sample assumption can often be assessed from an understanding of the data col- lection process. Unfortunately, there are few general tests for checking this assumption. I have described exploratory (mostly visual) methods to assess the normality and equal variance assump- tion. I will now discuss formal methods to assess these assumptions. Testing Normality A formal test of normality can be based on a normal scores plot, sometimes called a rankit plot or a normal probability plot or a normal Q-Q plot. You plot the data against the normal scores, or expected normal order statistics (in a standard normal) for a sample with the given number of observations. The normality assumption is plausible if the plot is fairly linear.
    [Show full text]
  • Probability Plots for Exploratory Data Analysis
    SESUG Paper 172-2019 Probability Plots for Exploratory Data Analysis Dennis J. Beal, Leidos, Oak Ridge, Tennessee ABSTRACT Probability plots are used in statistical analysis to check distributional assumptions, visually check for potential outliers, and see the range, median, and variability of a data set. Probability plots are an important statistical tool to use for exploratory data analysis. This paper shows SAS® code that generates normal and lognormal probability plots using the Output Delivery System (ODS) on a real environmental data set using PROC UNIVARIATE and interprets the results. This paper is for beginning or intermediate SAS users of Base SAS® and SAS/GRAPH®. Key words: normal probability plots, lognormal probability plots, PROC UNIVARIATE INTRODUCTION When the data analyst receives a data set, the first step to understanding the data is to conduct an exploratory data analysis. This first step might include a PROC CONTENTS to list the variables that are in the data set and their data types (numeric, character, date, time, etc.). The next step might be to run PROC FREQ to see the values of all the variables in the data set. Another common practice is to run PROC UNIVARIATE to see summary statistics for all numeric variables. These steps help guide the data analyst to see whether the data needs cleaning or standardizing before conducting a statistical analysis. In addition to summary statistics, PROC UNIVARIATE also generates histograms and normal probability plots for numeric variables. In SAS v. 9.3 and 9.4 PROC UNIVARIATE generates generic histograms and normal probability plots for the numeric variables with the ODS.
    [Show full text]
  • Using SAS/IML to Calculate L-Moments for the Univariate
    USE OF PROC IML TO CALCULATE L-MOMENTS FOR THE UNIVARIATE DISTRIBUTIONAL SHAPE PARAMETERS SKEWNESS AND KURTOSIS Michael A. Walega Covance, Princeton, New Jersey Introduction and how it pertains to the assumption of normality. Exploratory data analysis statistics, such as those As discussed by Glass et al. (1972), incorrect generated by the SAS® procedure PROC conclusions may be reached when the normality UNIVARIATE (1990), are useful tools to assumption is not valid, especially when one-tail characterize the underlying distribution of data prior tests are employed or the sample size or to more rigorous statistical analyses. Assessment of significance level are very small. Hopkins and the distributional shape of data is usually Weeks (1990) also discuss the effects of highly non- accomplished by careful examination of the values normal data on hypothesis testing of variances. of the third and fourth central moments, skewness Thus, the exam-ination of the skewness (departure and kurtosis. However, when the sample size is from symmetry) and kurtosis (deviation from a small or the underlying distribution is non-normal, normal curve) is an important component of the information obtained from the sample skewness exploratory data analyses. and kurtosis can be misleading. Various methods to estimate skewness and kurtosis One alternative to the central moment shape have been proposed (MacGillivray and Balanda, statistics is the use of a linear combination of order 1988). For many years, the conventional statistics (L-moments) to examine the distributional coefficients of skewness and kurtosis, ϒ and κ shape characteristics of data. L-moments have (Hosking, 1990), have been used to describe the several theoretical advantages over the central shape characteristics of distributions.
    [Show full text]
  • Normality Tests
    NCSS Statistical Software NCSS.com Chapter 194 Normality Tests Introduction This procedure provides seven tests of data normality. If the variable is normally distributed, you can use parametric statistics that are based on this assumption. If a variable fails a normality test, it is critical to look at the histogram and the normal probability plot to see if an outlier or a small subset of outliers has caused the non-normality. If there are no outliers, you might try a transformation (such as, the log or square root) to make the data normal. If a transformation is not a viable alternative, nonparametric methods that do not require normality may be used. Always remember that a reasonably large sample size is required to detect departures from normality. Only extreme types of non-normality can be detected with samples less than fifty observations. There is a common misconception that a histogram is always a valid graphical tool for assessing normality. Since there are many subjective choices that must be made in constructing a histogram, and since histograms generally need large sample sizes to display an accurate picture of normality, preference should be given to other graphical displays such as the box plot, the density trace, and the normal probability plot. Normality tests generally have small statistical power (probability of detecting non-normal data) unless the sample sizes are at least over 100. Technical Details This section provides details of the seven normality tests that are available. Shapiro-Wilk W Test This test for normality has been found to be the most powerful test in most situations.
    [Show full text]