The Interpretation of the Probable Error and the Coefficient of Correlation

Total Page:16

File Type:pdf, Size:1020Kb

The Interpretation of the Probable Error and the Coefficient of Correlation THE UNIVERSITY OF ILLINOIS LIBRARY 370 IL6 . No. 26-34 sssftrsss^"" Illinois Library University of L161—H41 Digitized by the Internet Archive in 2011 with funding from University of Illinois Urbana-Champaign http://www.archive.org/details/interpretationof32odel BULLETIN NO. 32 BUREAU OF EDUCATIONAL RESEARCH COLLEGE OF EDUCATION THE INTERPRETATION OF THE PROBABLE ERROR AND THE COEFFICIENT OF CORRELATION By Charles W. Odell Assistant Director, Bureau of Educational Research ( (Hi THE UBMM Of MAR 14 1927 HKivERsrrv w Illinois PRICE 50 CENTS PUBLISHED BY THE UNIVERSITY OF ILLINOIS. URBANA 1926 370 lit TABLE OF CONTENTS PAGE Preface 5 i Chapter I. Introduction 7 Chapter II. The Probable Error 9 .Chapter III. The Coefficient of Correlation 33 PREFACE Graduate students and other persons contemplating ed- ucational research frequently ask concerning the need for training in statistical procedures. They usually have in mind training in the technique of making tabulations and calcula- tions. This, as Doctor Odell points out, is only one phase, and probably not the most important phase, of needed train- ing in statistical methods. The interpretation of the results of calculation has not received sufficient attention by the authors of texts in this field. The following discussion of two derived measures, the probable error and the coefficient of correlation, is offered as a contribution to the technique of educational research. It deals with the problems of the reader of reports of research, as well as those of original investigators. The tabulating of objective data and the mak- ing of calculations from the tabulations may be and fre- quently is a tedious task, but it is primarily one of routine. The interpreting of the results of calculation is not a routine task. Many conditions affect their meaning and the research worker constantly encounters new problems of interpretation. It is, however, possible to state certain general principles that will serve as a guide in this phase of educational research. Walter S. Monroe, Director. July 7, 1926 THE INTERPRETATION OF THE PROBABLE ERROR AND THE COEFFICIENT OF CORRELATION CHAPTER I INTRODUCTION Purpose of this bulletin. One of the most noticeable recent devel- opments in the field of education has been the extensive application of statistical methods to the description of educational conditions and the solution of educational problems. Only a comparatively few years ago conditions were portrayed chiefly in terms of adjectives and other ex- pressions of quality or degree, but now these have been superseded to a considerable extent by definite quantitative terms. There are at least two reasons why everyone engaged in educational work, from the class- room teacher to the research expert, should become acquainted with certain commonly used formulae, methods of computation, and other statistical procedures. In the first place, situations frequently are en- countered in which it is desirable to make use of statistical procedures for the purpose of collecting and analyzing data which have a bearing upon practical educational problems. For the great majority of educa- tional workers, however, it is probably more important to be able to interpret correctly the numerous statistical expressions and discussions which are encountered in professional reading and other work. It is almost impossible to peruse a single issue of an educational periodical or a recent book in the field of education or to attend an educational meeting without seeing or hearing many statistical terms employed. Most of the commonly used methods of computation can be mastered by practically any person of average intelligence and arithmetical ability within a rather short time, but the power of interpreting correctly the various measures derived by statistical methods is not so easily ac- quired. The acquisition of this power demands considerable familiarity with the concepts involved and this in turn requires clear and critical thinking. It is with the second of the two purposes mentioned in the preced- ing paragraph chiefly in mind that the writer has attempted in this bulletin to throw some light on the use and interpretation of two of the most frequently used statistical measures, 1 the probable error 2 (com- 'The term "statistical measure," sometimes shortened to "measure," is used in this bulletin to refer to a measure or quantitative expression which has been derived from a number of data such as scores or other measurements and which summarizes [7] monly abbreviated P.E.), and the coefficient of correlation (commonly abbreviated r), in the hope that readers will be helped in their under- standing of the significance of these terms. Since the methods of com- puting them can be found in many places, 3 their actual calculation will not be explained in detail, although the formulae for them will be given. or expresses in a single numerical index some tendency of the original data. All such expressions as means, medians, modes, measures of deviation, measures of relationship, and so on are statistical measures. In order to avoid confusion the term "measure," which is often used to refer to the result obtained by applying a measuring instrument to an individual case, will not be used in this bulletin in that sense, but "score" or "measure- ment" will be used instead. 'The term "probable error" (P.E.) has come to be generally used to include both the probable error proper and the median deviation (abbreviated Md.D.), although, as will be shown later in the discussion, the latter is in no real sense an error. For this reason and also to avoid confusion the term probable error will sometimes be used when median deviation would be preferable from the standpoint of strict accuracy of use. The reader should not obtain the idea, however, that the writer believes it is desirable to use probable error instead of median deviation; he distinctly does not believe so. 3 See: Odell, C. W. Educational Statistics. New York: The Century Company, 1925, p. 138-39, 150-8-, 221-41, or any other standard text on statistics. [8] CHAPTER II THE PROBABLE ERROR 1 Formula for the probable error. Since the probable error, as shown by the substitute term median deviation, is the median of the deviations or differences of the individual scores or measurements from their aver- 2 age, it may be computed simply by determining the median of these deviations or differences. However, the customary method is to deter- 3 4 mine the standard deviation first and then to multiply it by .6745 to obtain the probable error. In other words the usual formula for the probable error is: P.E. = .6745 a. The relationship existing between the probable error and the standard deviation is therefore of the same sort as that existing between a foot and a yard or a pint and a quart, that one always equals the other mul- tiplied by a constant factor. Thus just as .5 quart equals a pint and 2 5 pints a quart, so .6745o- equals 1 P.E. and 1.4826 P.E. equals la. Different uses of the probable error. There are several more or less different uses or meanings of the probable error, at least five of 1 The probable error, often more properly called the median deviation, is only one of several commonly used measures of the same sort. Among the other similar ones are the standard deviation (abbreviated S.D. or a (sigma) ), which in certains uses becomes the standard error, the mean deviation (M.D. or A.D.), the quartile deviation or semi-interquartile range (Q), and the 10-90 percentile range (D). All of these except the last are rather frequently encountered. In general, what- ever is said about the probable error may be applied to these other measures also. The one important exception to this statement is that since these measures, except Q, differ from the probable error in magnitude, their interpretations in numerical statements will, of course, differ. For a discussion of these other measures see: . Odell, op. cit., p. 120-38. 2 The term "average" is used here in a general sense, that is, it includes the arith- metic mean, commonly called the average, the median, the mode, and all other measures of central tendency. Deviations or differences are usually computed from the arithmetic mean but may be taken from any other measure of central tendency. t=tN in which .v denotes the deviation or difference of a particular score from the average, N stands for the total number of cases or scores and 2 (sigma) is the symbol for summation. 4 It is only in the case of a normal distribution or by chance that the probable error is equal to nearly .6745 times the standard deviation. However, most educational data form distributions which approximate normality closely enough that no serious, error is involved in using the given decimal as the multiplier. This number is of course the reciprocal of .6745. [9] which are fairly distinct from one another, and will be dealt with in this discussion. 1. A measure of the spread or variability of a distribution of data about the average. When used in this way it should properly be called the median deviation (Md.D.). If the term probable error is employed it should be followed by the words "of the distribu- tion" and abbreviated P.E. Dis. 2. A unit of measurement. This also is a use for which the term median deviation is really the correct one to employ, since it involves merely a particular use of the median deviation of a dis- tribution. Since no subscript has been agreed upon to denote this use, the writer suggests "U" for "unit." Thus, when designating the median deviation used as a unit of measurement one should write Md.D.
Recommended publications
  • Krishnan Correlation CUSB.Pdf
    SELF INSTRUCTIONAL STUDY MATERIAL PROGRAMME: M.A. DEVELOPMENT STUDIES COURSE: STATISTICAL METHODS FOR DEVELOPMENT RESEARCH (MADVS2005C04) UNIT III-PART A CORRELATION PROF.(Dr). KRISHNAN CHALIL 25, APRIL 2020 1 U N I T – 3 :C O R R E L A T I O N After reading this material, the learners are expected to : . Understand the meaning of correlation and regression . Learn the different types of correlation . Understand various measures of correlation., and, . Explain the regression line and equation 3.1. Introduction By now we have a clear idea about the behavior of single variables using different measures of Central tendency and dispersion. Here the data concerned with one variable is called ‗univariate data‘ and this type of analysis is called ‗univariate analysis‘. But, in nature, some variables are related. For example, there exists some relationships between height of father and height of son, price of a commodity and amount demanded, the yield of a plant and manure added, cost of living and wages etc. This is a a case of ‗bivariate data‘ and such analysis is called as ‗bivariate data analysis. Correlation is one type of bivariate statistics. Correlation is the relationship between two variables in which the changes in the values of one variable are followed by changes in the values of the other variable. 3.2. Some Definitions 1. ―When the relationship is of a quantitative nature, the approximate statistical tool for discovering and measuring the relationship and expressing it in a brief formula is known as correlation‖—(Craxton and Cowden) 2. ‗correlation is an analysis of the co-variation between two or more variables‖—(A.M Tuttle) 3.
    [Show full text]
  • BACHELOR of COMMERCE (Hons)
    GURU GOBIND SINGH INDRAPRASTHA UNIVERSITY , D ELHI BACHELOR OF COMMERCE (Hons) BCOM 110- Business Statistics L-5 T/P-0 Credits-5 Objectives: The objective of this course is to familiarize students with the basic statistical tools used to summarize and analyze quantitative information for decision making. COURSE CONTENTS Unit I Lectures: 20 Statistical Data and Descriptive Statistics: Measures of Central Tendency: Mathematical averages including arithmetic mean, geometric mean and harmonic mean, properties and applications, positional averages, mode, median (and other partition values including quartiles, deciles, and percentile; Unit II Lectures: 15 Measures of variation: absolute and relative, range, quartile deviation, mean deviation, standard deviation, and their co-efficients, properties of standard deviation/variance; Moments: calculation and significance; Skewness, Kurtosis and Moments. Unit III Lectures: 15 Simple Correlation and Regression Analysis: Correlation Analysis, meaning of correlation simple, multiple and partial; linear and non-linear, Causation and correlation, Scatter diagram, Pearson co-efficient of correlation; calculation and properties, probable and standard errors, rank correlation; Simple Regression Analysis: Regression equations and estimation. Unit IV Lectures: 20 Index Numbers: Meaning and uses of index numbers, construction of index numbers, univariate and composite, aggregative and average of relatives – simple and weighted, tests of adequacy of index numbers, Base shifting, problems in the construction of index numbers. Text Books : 1. Levin, Richard and David S. Rubin. (2011), Statistics for Management. 7th Edition. PHI. 2. Gupta, S.P., and Gupta, Archana, (2009), Statistical Methods. Sultan Chand and Sons, New Delhi. Reference Books : 1. Berenson and Levine, (2008), Basic Business Statistics: Concepts and Applications. Prentice Hall. BUSINESS STATISTICS:PAPER CODE 110 Dr.
    [Show full text]
  • Revision of All Topics
    Revision Of All Topics Quantitative Aptitude & Business Statistics Def:Measures of Central Tendency • A single expression representing the whole group,is selected which may convey a fairly adequate idea about the whole group. • This single expression is known as average. Quantitative Aptituide & Business 2 Statistics: Revision Of All Toics Averages are central part of distribution and, therefore ,they are also called measures of central tendency. Quantitative Aptituide & Business 3 Statistics: Revision Of All Toics Types of Measures central tendency: There are five types ,namely 1.Arithmetic Mean (A.M) 2.Median 3.Mode 4.Geometric Mean (G.M) 5.Harmonic Mean (H.M) Quantitative Aptituide & Business 4 Statistics: Revision Of All Toics Arithmetic Mean (A.M) The most commonly used measure of central tendency. When people ask about the “average" of a group of scores, they usually are referring to the mean. Quantitative Aptituide & Business 5 Statistics: Revision Of All Toics • The arithmetic mean is simply dividing the sum of variables by the total number of observations. Quantitative Aptituide & Business 6 Statistics: Revision Of All Toics Arithmetic Mean for Ungrouped data is given by n ∑ xi + + + + X = x1 x2 x3 ...... xn = i=1 n n Quantitative Aptituide & Business 7 Statistics: Revision Of All Toics Arithmetic Mean for Discrete Series n ∑ fi xi f1x1 + f 2 x2 + f 3 x3 +......+ f n xn i=1 X = = n f1 + f2 + f3 + .... + fn ∑ fi i=1 Quantitative Aptituide & Business 8 Statistics: Revision Of All Toics Arithmetic Mean for Continuous Series fd X = A + ∑ ×C N Quantitative Aptituide & Business 9 Statistics: Revision Of All Toics Weighted Arithmetic Mean • The term ‘ weight’ stands for the relative importance of the different items of the series.
    [Show full text]
  • Outing the Outliers – Tails of the Unexpected
    Presented at the 2016 International Training Symposium: www.iceaaonline.com/bristol2016 Outing the Outliers – Tails of the Unexpected Outing the Outliers – Tails of the Unexpected Cynics would say that we can prove anything we want with statistics as it is all down to … a word (or two) from the Wise? interpretation and misinterpretation. To some extent this is true, but in truth it is all down to “The great tragedy of Science: the slaying making a judgement call based on the balance of of a beautiful hypothesis by an ugly fact” probabilities. Thomas Henry Huxley (1825-1895) British Biologist The problem with using random samples in estimating is that for a small sample size, the values could be on the “extreme” side, relatively speaking – like throwing double six or double one with a pair of dice, and nothing else for three of four turns. The more random samples we have the less likely (statistically speaking) we are to have all extreme values. So, more is better if we can get it, but sometimes it is a question of “We would if we could, but we can’t so we don’t!” Now we could argue that Estimators don’t use random values (because it sounds like we’re just guessing); we base our estimates on the “actuals” we have collected for similar tasks or activities. However, in the context of estimating, any “actual” data is in effect random because the circumstances that created those “actuals” were all influenced by a myriad of random factors. Anyone who has ever looked at the “actuals” for a repetitive task will know that there are variations in those values.
    [Show full text]
  • STATISTICS of OBSERVATIONS & SAMPLING THEORY Parent
    ASTR 511/O’Connell Lec 6 1 STATISTICS OF OBSERVATIONS & SAMPLING THEORY References: Bevington “Data Reduction & Error Analysis for the Physical Sciences” LLM: Appendix B Warning: the introductory literature on statistics of measurement is remarkably uneven, and nomenclature is not consistent. Is error analysis important? Yes! See next page. Parent Distributions Measurement of any physical quantity is always affected by uncontrollable random (“stochastic”) processes. These produce a statistical scatter in the values measured. The parent distribution for a given measurement gives the probability of obtaining a particular result from a single measure. It is fully defined and represents the idealized outcome of an infinite number of measures, where the random effects on the measuring process are assumed to be always the same (“stationary”). ASTR 511/O’Connell Lec 6 2 ASTR 511/O’Connell Lec 6 3 Precision vs. Accuracy • The parent distribution only describes the stochastic scatter in the measuring process. It does not characterize how close the measurements are to the true value of the quantity of interest. Measures can be affected by systematic errors as well as by random errors. In general, the effects of systematic errors are not manifested as stochastic variations during an experiment. In the lab, for instance, a voltmeter may be improperly calibrated, leading to a bias in all the measurements made. Examples of potential systematic effects in astronomical photometry include a wavelength mismatch in CCD flat-field calibrations, large differential refraction in Earth’s atmosphere, or secular changes in thin clouds. • Distinction between precision and accuracy: o A measurement with a large ratio of value to statistical uncertainty is said to be “precise.” o An “accurate” measurement is one which is close to the true value of the parameter being measured.
    [Show full text]
  • Chapter 3 the Problem of Scale
    Chapter 3 The problem of scale Exploratory data analysis is detective work–numerical detective work–or counting detective work–or graphical detective work. A detective investigating a crime needs both tools and under- standing. If he has no fingerprint powder, he will fail to find fingerprints on most surfaces. If he does not understand where the criminal is likely to have put his fingers, he will will not look in the right places. Equally, the analyst of data needs both tools and understanding (p 1: Tukey (1977)) As discussed in Chapter 1 the challenge of psychometrics is assign numbers to observations in a way that best summarizes the underlying constructs. The ways to collect observations are multiple and can be based upon comparisons of order or of proximity (Chapter 2). But given a set of observations, how best to describe them? This is a problem not just for observational but also for experimental psychologists for both approaches are attempting to make inferences about latent variables in terms of statistics based upon observed variables (Figure 3.1). For the experimentalist, the problem becomes interpreting the effect of an experimental manipulation upon some outcome variable (path B in Figure 3.1 in terms of the effect of manipulation on the latent outcome variable (path b) and the relationship between the latent and observed outcome variables (path s). For the observationalist, the observed correlation between the observed Person Variable and Outcome variable (path A) is interpreted as a function of the relationship between the latent person trait variable and the observed trait variable (path r), the latent outcome variable and the observed outcome variable (path s), and most importantly for inference, the relationship between the two latent variables (path a).
    [Show full text]
  • Notes on the Use of Propagation of Error Formulas
    ~.------~------------ JOURNAL OF RESEARCH of the National Bureau of Standards - C. Engineering and Instrumentation Vol. 70C, No.4, October- December 1966 Notes on the Use of Propagation of Error Formulas H. H. Ku Institute for Basic Standards, National Bureau of Standards, Washington, D.C. 20234 (May 27, 1966) The " la w of propagation o[ error" is a tool th at physical scientists have convenie ntly and frequently used in th eir work for many years, yet an adequate refere nce is diffi c ult to find. In this paper an exposi­ tory rev ie w of this topi c is presented, partic ularly in the li ght of c urre nt practi ces a nd interpretations. Examples on the accuracy of the approximations are given. The reporting of the uncertainties of final results is discussed. Key Words : Approximation, e rror, formula, imprecision, law of error, prod uc ts, propagati on of error, random, ratio, syste mati c, sum. Introduction The " law of propagation of error" is a tool that physical scientists have conveniently and frequently In the December 1939, issue of the American used in their work for many years. No claim is Physics Teacher, Raymond T. Birge wrote an ex­ made here that it is the only tool or even a suitable pository paper on "The Propagation of Errors." tool for all occasions. "Data analysis" is an ever­ In the introductory paragraph of his paper, Birge expanding field and other methods, existing or new, re marked: are probably available for the analysis and inter­ "The questi on of what constitutes the most reliable valu e to pretation fo r each particular set of data.
    [Show full text]
  • Measures of Central Tendency
    1 UNIT-1 FREQUENCY DISTRIBUTION Structure: 1.0 Introduction 1.1 Objectives 1.2 Measures of Central Tendency 1.2.1 Arithmetic mean 1.2.2 Median 1.2.3 Mode 1.2.4 Empirical relation among mode, median and mode 1.2.5 Geometric mean 1.2.6 Harmonic mean 1.3 Partition values 1.3.1 Quartiles 1.3.2 Deciles 1.3.3 Percentiles 1.4 Measures of dispersion 1.4.1 Range 1.4.2 Semi-interquartile range 1.4.3 Mean deviation 1.4.4 Standard deviation 1.2.5 Geometric mean 1.5 Absolute and relative measure of dispersion 1.6 Moments 1.7 Karl Pearson’s β and γ coefficients 1.8 Skewness 1.9 Kurtosis 1.10 Let us sum up 1.11 Check your progress : The key. 2 1.0 INTRODUCTION According to Simpson and Kafka a measure of central tendency is typical value around which other figures aggregate‘. According to Croxton and Cowden ‗An average is a single value within the range of the data that is used to represent all the values in the series. Since an average is somewhere within the range of data, it is sometimes called a measure of central value‘. 1.1 OBJECTIVES The main aim of this unit is to study the frequency distribution. After going through this unit you should be able to : describe measures of central tendency ; calculate mean, mode, median, G.M., H.M. ; find out partition values like quartiles, deciles, percentiles etc; know about measures of dispersion like range, semi-inter-quartile range, mean deviation, standard deviation; calculate moments, Karls Pearsion’s β and γ coefficients, skewness, kurtosis.
    [Show full text]