DOCSLIB.ORG

ECE 302: Lecture 4.4 Median, Mode, and Mean

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
ECE 302: Lecture 4.4 Median, Mode, and Mean ECE 302: Lecture 4.4 Median, Mode, and Mean Prof Stanley Chan School of Electrical and Computer Engineering Purdue University c Stanley Chan 2020. All Rights Reserved. 1 / 16 Median Given a sequence of numbers n 1 2 3 4 5 6 7 8 9 . 100 xn 1.5 2.5 3.1 1.1 -0.4 -4.1 0.5 2.2 -3.4 . -1.4 Find the median. Step 1: You sort the sequence Step 2: You pick the one in the middle If we have a random variable, what is the ideal median? c Stanley Chan 2020. All Rights Reserved. 2 / 16 Median from PMF Definition Let X be a continuous random variable with PDF fX . The median of X is a point c 2 R such that Z c Z 1 fX (x)dx = fX (x)dx: (1) −∞ c c Stanley Chan 2020. All Rights Reserved. 3 / 16 Median from CDF Theorem The median of a random variable X is the point c such that 1 F (c) = : (2) X 2 Proof. R x 0 0 Since FX (x) = −∞ fX (x )dx , we have Z c Z 1 FX (c) = fX (x)dx = fX (x)dx = 1 − FX (c): −∞ c 1 Rearranging the terms shows that FX (c) = 2 . c Stanley Chan 2020. All Rights Reserved. 4 / 16 Example Example 1. (Uniform random variable) Let X be a continuous random variable with 1 PDF: fX (x) = b−a for a ≤ x ≤ b, and is 0 otherwise. x−a CDF: FX (x) = b−a for a ≤ x ≤ b. Find median. Solution: Want FX (c) = 1=2. a + b c = 2 c Stanley Chan 2020. All Rights Reserved. 5 / 16 Example Example 2. (Exponential random variable) Let X be a continuous random variable with −λx PDF: fX (x) = λe for x ≥ 0 −λx CDF: FX (x) = 1 − e for x ≥ 0 Find median. Solution: Want FX (c) = 1=2. c = (log 2)/λ c Stanley Chan 2020. All Rights Reserved. 6 / 16 Mode Given a sequence of numbers n 1 2 3 4 5 6 7 8 9 . 100 xn 50 50 30 10 -40 -10 50 20 -30 . -1 How to find the mode? Step 1: Sort the sequence Step 2: Pick the number that occurs most often? What is the ideal mode? c Stanley Chan 2020. All Rights Reserved. 7 / 16 Mode from PDF and CDF Definition Let X be a continuous random variable. The mode is the point c such that fX (x) attains the maximum: d c = argmax fX (x) = argmax FX (x): (3) x2Ω x2Ω dx c Stanley Chan 2020. All Rights Reserved. 8 / 16 Example Example 1. Let X be a continuous random variable with PDF fX (x) = 6x(1 − x) for 0 ≤ x ≤ 1. Find mode. Solution. The mode of X happens at argmax fX (x). x 1 x = 2 c Stanley Chan 2020. All Rights Reserved. 9 / 16 Mean Given a sequence of numbers n 1 2 3 4 5 6 7 8 9 . 100 xn 1.5 2.5 3.1 1.1 -0.4 -4.1 0.5 2.2 -3.4 . -1.4 Find the mean. N 1 X X = X : N n n=1 How to find mean from CDF? c Stanley Chan 2020. All Rights Reserved. 10 / 16 Mean from CDF: Positive Case Lemma Let X > 0. Then, E[X ] can be computed from FX as Z 1 E[X ] = (1 − FX (t)) dt: (4) 0 Proof: Z 1 Z 1 Z 1 (1 − FX (t)) dt = [1 − P[X ≤ t]] dt = P[X > t]dt 0 0 0 1 1 1 x Z Z (a) Z Z = fX (x)dxdt = fX (x)dtdx 0 t 0 0 Z 1 Z x Z 1 = dtfX (x)dx = xfX (x)dx = E[X ]: 0 0 0 c Stanley Chan 2020. All Rights Reserved. 11 / 16 Interchange the integrations Figure: A double integration can be evaluated in two ways: x then t, or t then x. c Stanley Chan 2020. All Rights Reserved. 12 / 16 Negative Case Lemma Let X < 0. Then, E[X ] can be computed from FX as Z 0 E[X ] = FX (t)dt: (5) −∞ Proof. Z 0 Z 0 FX (t)dt = P[X ≤ t]dt −∞ −∞ Z 0 Z t = fX (x)dxdt −∞ −∞ Z 0 Z 0 Z 0 = fX (x)dtdx = xfX (x)dx = E[X ]: −∞ x −∞ c Stanley Chan 2020. All Rights Reserved. 13 / 16 The overall result Theorem The mean of a random variable X can be computed from the CDF as Z 1 Z 0 E[X ] = (1 − FX (t)) dt − FX (t)dt: (6) 0 −∞ Proof. Let X = X + − X −. Then, + − E[X ] = E[X − X ] + − = E[X ] − E[X ] Z 1 Z 0 = (1 − FX (t)) dt − FX (t)dt: 0 −∞ c Stanley Chan 2020. All Rights Reserved. 14 / 16 Summary We have learned three things: Median 50% of the area, from left and from right. Mode Peak of PDF, steepest slope of CDF Mean R 1 PDF: 0 tfX (t)dt, for X > 0 R 1 CDF: 0 (1 − FX (t)) dt, for X > 0 c Stanley Chan 2020. All Rights Reserved. 15 / 16 Questions? c Stanley Chan 2020. All Rights Reserved. 16 / 16.
Load more

Recommended publications
  • 5. the Student T Distribution
    Virtual Laboratories > 4. Special Distributions > 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 5. The Student t Distribution In this section we will study a distribution that has special importance in statistics. In particular, this distribution will arise in the study of a standardized version of the sample mean when the underlying distribution is normal. The Probability Density Function Suppose that Z has the standard normal distribution, V has the chi-squared distribution with n degrees of freedom, and that Z and V are independent. Let Z T= √V/n In the following exercise, you will show that T has probability density function given by −(n +1) /2 Γ((n + 1) / 2) t2 f(t)= 1 + , t∈ℝ ( n ) √n π Γ(n / 2) 1. Show that T has the given probability density function by using the following steps. n a. Show first that the conditional distribution of T given V=v is normal with mean 0 a nd variance v . b. Use (a) to find the joint probability density function of (T,V). c. Integrate the joint probability density function in (b) with respect to v to find the probability density function of T. The distribution of T is known as the Student t distribution with n degree of freedom. The distribution is well defined for any n > 0, but in practice, only positive integer values of n are of interest. This distribution was first studied by William Gosset, who published under the pseudonym Student. In addition to supplying the proof, Exercise 1 provides a good way of thinking of the t distribution: the t distribution arises when the variance of a mean 0 normal distribution is randomized in a certain way.
    [Show full text]
  • Chapter 8 Fundamental Sampling Distributions And
    CHAPTER 8 FUNDAMENTAL SAMPLING DISTRIBUTIONS AND DATA DESCRIPTIONS 8.1 Random Sampling pling procedure, it is desirable to choose a random sample in the sense that the observations are made The basic idea of the statistical inference is that we independently and at random. are allowed to draw inferences or conclusions about a Random Sample population based on the statistics computed from the sample data so that we could infer something about Let X1;X2;:::;Xn be n independent random variables, the parameters and obtain more information about the each having the same probability distribution f (x). population. Thus we must make sure that the samples Define X1;X2;:::;Xn to be a random sample of size must be good representatives of the population and n from the population f (x) and write its joint proba- pay attention on the sampling bias and variability to bility distribution as ensure the validity of statistical inference. f (x1;x2;:::;xn) = f (x1) f (x2) f (xn): ··· 8.2 Some Important Statistics It is important to measure the center and the variabil- ity of the population. For the purpose of the inference, we study the following measures regarding to the cen- ter and the variability. 8.2.1 Location Measures of a Sample The most commonly used statistics for measuring the center of a set of data, arranged in order of mag- nitude, are the sample mean, sample median, and sample mode. Let X1;X2;:::;Xn represent n random variables. Sample Mean To calculate the average, or mean, add all values, then Bias divide by the number of individuals.
    [Show full text]
  • Chapter 4: Central Tendency and Dispersion
    Central Tendency and Dispersion 4 In this chapter, you can learn • how the values of the cases on a single variable can be summarized using measures of central tendency and measures of dispersion; • how the central tendency can be described using statistics such as the mode, median, and mean; • how the dispersion of scores on a variable can be described using statistics such as a percent distribution, minimum, maximum, range, and standard deviation along with a few others; and • how a variable’s level of measurement determines what measures of central tendency and dispersion to use. Schooling, Politics, and Life After Death Once again, we will use some questions about 1980 GSS young adults as opportunities to explain and demonstrate the statistics introduced in the chapter: • Among the 1980 GSS young adults, are there both believers and nonbelievers in a life after death? Which is the more common view? • On a seven-attribute political party allegiance variable anchored at one end by “strong Democrat” and at the other by “strong Republican,” what was the most Democratic attribute used by any of the 1980 GSS young adults? The most Republican attribute? If we put all 1980 95 96 PART II :: DESCRIPTIVE STATISTICS GSS young adults in order from the strongest Democrat to the strongest Republican, what is the political party affiliation of the person in the middle? • What was the average number of years of schooling completed at the time of the survey by 1980 GSS young adults? Were most of these twentysomethings pretty close to the average on
    [Show full text]
  • Notes Mean, Median, Mode & Range
    Notes Mean, Median, Mode & Range How Do You Use Mode, Median, Mean, and Range to Describe Data? There are many ways to describe the characteristics of a set of data. The mode, median, and mean are all called measures of central tendency. These measures of central tendency and range are described in the table below. The mode of a set of data Use the mode to show which describes which value occurs value in a set of data occurs most frequently. If two or more most often. For the set numbers occur the same number {1, 1, 2, 3, 5, 6, 10}, of times and occur more often the mode is 1 because it occurs Mode than all the other numbers in the most frequently. set, those numbers are all modes for the data set. If each number in the set occurs the same number of times, the set of data has no mode. The median of a set of data Use the median to show which describes what value is in the number in a set of data is in the middle if the set is ordered from middle when the numbers are greatest to least or from least to listed in order. greatest. If there are an even For the set {1, 1, 2, 3, 5, 6, 10}, number of values, the median is the median is 3 because it is in the average of the two middle the middle when the numbers are Median values. Half of the values are listed in order. greater than the median, and half of the values are less than the median.
    [Show full text]
  • Volatility Modeling Using the Student's T Distribution
    Volatility Modeling Using the Student’s t Distribution Maria S. Heracleous Dissertation submitted to the Faculty of the Virginia Polytechnic Institute and State University in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Economics Aris Spanos, Chair Richard Ashley Raman Kumar Anya McGuirk Dennis Yang August 29, 2003 Blacksburg, Virginia Keywords: Student’s t Distribution, Multivariate GARCH, VAR, Exchange Rates Copyright 2003, Maria S. Heracleous Volatility Modeling Using the Student’s t Distribution Maria S. Heracleous (ABSTRACT) Over the last twenty years or so the Dynamic Volatility literature has produced a wealth of uni- variateandmultivariateGARCHtypemodels.Whiletheunivariatemodelshavebeenrelatively successful in empirical studies, they suffer from a number of weaknesses, such as unverifiable param- eter restrictions, existence of moment conditions and the retention of Normality. These problems are naturally more acute in the multivariate GARCH type models, which in addition have the problem of overparameterization. This dissertation uses the Student’s t distribution and follows the Probabilistic Reduction (PR) methodology to modify and extend the univariate and multivariate volatility models viewed as alternative to the GARCH models. Its most important advantage is that it gives rise to internally consistent statistical models that do not require ad hoc parameter restrictions unlike the GARCH formulations. Chapters 1 and 2 provide an overview of my dissertation and recent developments in the volatil- ity literature. In Chapter 3 we provide an empirical illustration of the PR approach for modeling univariate volatility. Estimation results suggest that the Student’s t AR model is a parsimonious and statistically adequate representation of exchange rate returns and Dow Jones returns data.
    [Show full text]
  • The Value at the Mode in Multivariate T Distributions: a Curiosity Or Not?
    The value at the mode in multivariate t distributions: a curiosity or not? Christophe Ley and Anouk Neven Universit´eLibre de Bruxelles, ECARES and D´epartement de Math´ematique,Campus Plaine, boulevard du Triomphe, CP210, B-1050, Brussels, Belgium Universit´edu Luxembourg, UR en math´ematiques,Campus Kirchberg, 6, rue Richard Coudenhove-Kalergi, L-1359, Luxembourg, Grand-Duchy of Luxembourg e-mail: [email protected]; [email protected] Abstract: It is a well-known fact that multivariate Student t distributions converge to multivariate Gaussian distributions as the number of degrees of freedom ν tends to infinity, irrespective of the dimension k ≥ 1. In particular, the Student's value at the mode (that is, the normalizing ν+k Γ( 2 ) constant obtained by evaluating the density at the center) cν;k = k=2 ν converges towards (πν) Γ( 2 ) the Gaussian value at the mode c = 1 . In this note, we prove a curious fact: c tends k (2π)k=2 ν;k monotonically to ck for each k, but the monotonicity changes from increasing in dimension k = 1 to decreasing in dimensions k ≥ 3 whilst being constant in dimension k = 2. A brief discussion raises the question whether this a priori curious finding is a curiosity, in fine. AMS 2000 subject classifications: Primary 62E10; secondary 60E05. Keywords and phrases: Gamma function, Gaussian distribution, value at the mode, Student t distribution, tail weight. 1. Foreword. One of the first things we learn about Student t distributions is the fact that, when the degrees of freedom ν tend to infinity, we retrieve the Gaussian distribution, which has the lightest tails in the Student family of distributions.
    [Show full text]
  • Statistics, Measures of Central Tendency I
    Statistics, Measures of Central TendencyI We are considering a random variable X with a probability distribution which has some parameters. We want to get an idea what these parameters are. We perfom an experiment n times and record the outcome. This means we have X1;:::; Xn i.i.d. random variables, with probability distribution same as X . We want to use the outcome to infer what the parameters are. Mean The outcomes are x1;:::; xn. The Sample Mean is x1+···+xn x := n . Also sometimes called the average. The expected value of X , EX , is also called the mean of X . Often denoted by µ. Sometimes called population mean. Median The number so that half the values are below, half above. If the sample is of even size, you take the average of the middle terms. Mode The number that occurs most frequently. There could be several modes, or no mode. Dan Barbasch Math 1105 Chapter 9 Week of September 25 1 / 24 Statistics, Measures of Central TendencyII Example You have a coin for which you know that P(H) = p and P(T ) = 1 − p: You would like to estimate p. You toss it n times. You count the number of heads. The sample mean should be an estimate of p: EX = p, and E(X1 + ··· + Xn) = np: So X + ··· + X E 1 n = p: n Dan Barbasch Math 1105 Chapter 9 Week of September 25 2 / 24 Descriptive StatisticsI Frequency Distribution Divide into a number of equal disjoint intervals. For each interval count the number of elements in the sample occuring.
    [Show full text]
  • Exploring the Mode – the Most Likely Value? Jerzy Letkowski Western New England University
    OC13077 Exploring the Mode – the Most Likely Value? Jerzy Letkowski Western New England University Abstract The mean, median and mode are typical summary measures, each representing some focal tendency in random data. Even so the focus of each of the measures is different; they usually are packaged together as measures of central tendency. Among these three measures, the mode is granted the least amount of attention and it is frequently misinterpreted in many introductory textbooks on statistics. Also its centrality is questionable in some situations. The purpose of the paper is to provide a formal definition of the mode and to show appropriate interpretation of this measure with respect to different random data types: qualitative and quantitative (discrete and continuous). Several cases are presented to exemplify this purpose. Detail data processing steps are shown in Google spreadsheets. Keywords: mode, statistics, summary measures, probability distribution, data types, spreadsheet. Exploring the Mode – the Most Likely Value? OC13077 WHAT IS THE MODE? In general, in the context of a population, the concept of the mode of a random variable, X, having domain DX, is quite simple. Formally speaking (Spiegel, 1975, p. 84, McClave, 2011, p. 58, Sharpie, 2010, p. 115), it is a value, x*, of the variable that uniquely maximizes the probability-distribution function, f(x) : x* : f (x* ) = max {f (x)} or None (i) x∈DX One could refer to such a definition of the mode as a probability-distribution driven definition. In a way, it is a universal definition. For example, the maximum point for the Normal distribution (density function) is µ.
    [Show full text]
  • UNIT NUMBER 19.4 PROBABILITY 4 (Measures of Location and Dispersion)
    “JUST THE MATHS” UNIT NUMBER 19.4 PROBABILITY 4 (Measures of location and dispersion) by A.J.Hobson 19.4.1 Common types of measure 19.4.2 Exercises 19.4.3 Answers to exercises UNIT 19.4 - PROBABILITY 4 MEASURES OF LOCATION AND DISPERSION 19.4.1 COMMON TYPES OF MEASURE We include, here three common measures of location (or central tendency), and one common measure of dispersion (or scatter), used in the discussion of probability distributions. (a) The Mean (i) For Discrete Random Variables If the values x1, x2, x3, . , xn of a discrete random variable, x, have probabilities P1,P2,P3,....,Pn, respectively, then Pi represents the expected frequency of xi divided by the total number of possible outcomes. For example, if the probability of a certain value of x is 0.25, then there is a one in four chance of its occurring. The arithmetic mean, µ, of the distribution may therefore be given by the formula n X µ = xiPi. i=1 (ii) For Continuous Random Variables In this case, it is necessary to use the probability density function, f(x), for the distribution which is the rate of increase of the probability distribution function, F (x). For a small interval, δx of x-values, the probability that any of these values occurs is ap- proximately f(x)δx, which leads to the formula Z ∞ µ = xf(x) dx. −∞ (b) The Median (i) For Discrete Random Variables The median provides an estimate of the middle value of x, taking into account the frequency at which each value occurs.
    [Show full text]
  • Skewness and Kurtosis 2
    A distribution is said to be 'skewed' when the mean and the median fall at different points in the distribution, and the balance (or centre of gravity) is shifted to one side or the other-to left or right. Measures of skewness tell us the direction and the extent of Skewness. In symmetrical distribution the mean, median and mode are identical. The more the mean moves away from the mode, the larger the asymmetry or skewness A frequency distribution is said to be symmetrical if the frequencies are equally distributed on both the sides of central value. A symmetrical distribution may be either bell – shaped or U shaped. 1- Bell – shaped or unimodel Symmetrical Distribution A symmetrical distribution is bell – shaped if the frequencies are first steadily rise and then steadily fall. There is only one mode and the values of mean, median and mode are equal. Mean = Median = Mode A frequency distribution is said to be skewed if the frequencies are not equally distributed on both the sides of the central value. A skewed distribution may be • Positively Skewed • Negatively Skewed • ‘L’ shaped positively skewed • ‘J’ shaped negatively skewed Positively skewed Mean ˃ Median ˃ Mode Negatively skewed Mean ˂ Median ˂ Mode ‘L’ Shaped Positively skewed Mean ˂ Mode Mean ˂ Median ‘J’ Shaped Negatively Skewed Mean ˃ Mode Mean ˃ Median In order to ascertain whether a distribution is skewed or not the following tests may be applied. Skewness is present if: The values of mean, median and mode do not coincide. When the data are plotted on a graph they do not give the normal bell shaped form i.e.
    [Show full text]
  • Measures of Central Tendency & Dispersion
    Measures of Central Tendency & Dispersion Measures that indicate the approximate center of a distribution are called measures of central tendency. Measures that describe the spread of the data are measures of dispersion. These measures include the mean, median, mode, range, upper and lower quartiles, variance, and standard deviation. A. Finding the Mean The mean of a set of data is the sum of all values in a data set divided by the number of values in the set. It is also often referred to as an arithmetic average. The Greek letter (“mu”) is used as the symbol for population mean and the symbol ̅ is used to represent the mean of a sample. To determine the mean of a data set: 1. Add together all of the data values. 2. Divide the sum from Step 1 by the number of data values in the set. Formula: ∑ Example: Consider the data set: 17, 10, 9, 14, 13, 17, 12, 20, 14 ∑ The mean of this data set is 14. B. Finding the Median The median of a set of data is the “middle element” when the data is arranged in ascending order. To determine the median: 1. Put the data in order from smallest to largest. 2. Determine the number in the exact center. i. If there are an odd number of data points, the median will be the number in the absolute middle. ii. If there is an even number of data points, the median is the mean of the two center data points, meaning the two center values should be added together and divided by 2.
    [Show full text]
  • Fluorescence Correlation Spectroscopy 1
    Petra Schwille and Elke Haustein Fluorescence Correlation Spectroscopy 1 Fluorescence Correlation Spectroscopy An Introduction to its Concepts and Applications Petra Schwille and Elke Haustein Experimental Biophysics Group Max-Planck-Institute for Biophysical Chemistry Am Fassberg 11 D-37077 Göttingen Germany 2 Fluorescence Correlation Spectroscopy Petra Schwille and Elke Haustein Table of Contents TABLE OF CONTENTS 1 1. INTRODUCTION 3 2. EXPERIMENTAL REALIZATION 5 2.1. ONE-PHOTON EXCITATION 5 2.2. TWO-PHOTON EXCITATION 7 2.3. FLUORESCENT DYES 9 3. THEORETICAL CONCEPTS 10 3.1. AUTOCORRELATION ANALYSIS 10 3.2. CROSS-CORRELATION ANALYSIS 18 4. FCS APPLICATIONS 21 4.1. CONCENTRATION AND AGGREGATION MEASUREMENTS 21 4.2. CONSIDERATION OF RESIDENCE TIMES: DETERMINING MOBILITY AND MOLECULAR INTERACTIONS 23 4.2.1 DIFFUSION ANALYSIS 23 4.2.2 CONFINED AND ANOMALOUS DIFFUSION 24 4.2.3 ACTIVE TRANSPORT PHENOMENA IN TUBULAR STRUCTURES 24 4.2.4 DETERMINATION OF MOLECULAR INTERACTIONS 26 4.2.5 CONFORMATIONAL CHANGES 27 4.3. CONSIDERATION OF CROSS-CORRELATION AMPLITUDES: A DIRECT WAY TO MONITOR ASSOCIATION/DISSOCIATION AND ENZYME KINETICS 28 4.4. CONSIDERATION OF FAST FLICKERING: INTRAMOLECULAR DYNAMICS AND PROBING OF THE MICROENVIRONMENT 30 5. CONCLUSIONS AND OUTLOOK 31 6. REFERENCES 32 Petra Schwille and Elke Haustein Fluorescence Correlation Spectroscopy 3 1. Introduction Currently, it is almost impossible to open your daily newspaper without stumbling over words like gene manipulation, genetic engineering, cloning, etc. that reflect the tremendous impact of life sciences to our modern world. Press coverage of these features has long left behind the stage of merely reporting scientific facts. Instead, it focuses on general pros and cons, and expresses worries about what scientists have to do and what to refrain from.
    [Show full text]