Means, Standard Deviations and Standard Errors
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Applied Biostatistics Mean and Standard Deviation the Mean the Median Is Not the Only Measure of Central Value for a Distribution
Health Sciences M.Sc. Programme Applied Biostatistics Mean and Standard Deviation The mean The median is not the only measure of central value for a distribution. Another is the arithmetic mean or average, usually referred to simply as the mean. This is found by taking the sum of the observations and dividing by their number. The mean is often denoted by a little bar over the symbol for the variable, e.g. x . The sample mean has much nicer mathematical properties than the median and is thus more useful for the comparison methods described later. The median is a very useful descriptive statistic, but not much used for other purposes. Median, mean and skewness The sum of the 57 FEV1s is 231.51 and hence the mean is 231.51/57 = 4.06. This is very close to the median, 4.1, so the median is within 1% of the mean. This is not so for the triglyceride data. The median triglyceride is 0.46 but the mean is 0.51, which is higher. The median is 10% away from the mean. If the distribution is symmetrical the sample mean and median will be about the same, but in a skew distribution they will not. If the distribution is skew to the right, as for serum triglyceride, the mean will be greater, if it is skew to the left the median will be greater. This is because the values in the tails affect the mean but not the median. Figure 1 shows the positions of the mean and median on the histogram of triglyceride. -
Startips …A Resource for Survey Researchers
Subscribe Archives StarTips …a resource for survey researchers Share this article: How to Interpret Standard Deviation and Standard Error in Survey Research Standard Deviation and Standard Error are perhaps the two least understood statistics commonly shown in data tables. The following article is intended to explain their meaning and provide additional insight on how they are used in data analysis. Both statistics are typically shown with the mean of a variable, and in a sense, they both speak about the mean. They are often referred to as the "standard deviation of the mean" and the "standard error of the mean." However, they are not interchangeable and represent very different concepts. Standard Deviation Standard Deviation (often abbreviated as "Std Dev" or "SD") provides an indication of how far the individual responses to a question vary or "deviate" from the mean. SD tells the researcher how spread out the responses are -- are they concentrated around the mean, or scattered far & wide? Did all of your respondents rate your product in the middle of your scale, or did some love it and some hate it? Let's say you've asked respondents to rate your product on a series of attributes on a 5-point scale. The mean for a group of ten respondents (labeled 'A' through 'J' below) for "good value for the money" was 3.2 with a SD of 0.4 and the mean for "product reliability" was 3.4 with a SD of 2.1. At first glance (looking at the means only) it would seem that reliability was rated higher than value. -
Appendix F.1 SAWG SPC Appendices
Appendix F.1 - SAWG SPC Appendices 8-8-06 Page 1 of 36 Appendix 1: Control Charts for Variables Data – classical Shewhart control chart: When plate counts provide estimates of large levels of organisms, the estimated levels (cfu/ml or cfu/g) can be considered as variables data and the classical control chart procedures can be used. Here it is assumed that the probability of a non-detect is virtually zero. For these types of microbiological data, a log base 10 transformation is used to remove the correlation between means and variances that have been observed often for these types of data and to make the distribution of the output variable used for tracking the process more symmetric than the measured count data1. There are several control charts that may be used to control variables type data. Some of these charts are: the Xi and MR, (Individual and moving range) X and R, (Average and Range), CUSUM, (Cumulative Sum) and X and s, (Average and Standard Deviation). This example includes the Xi and MR charts. The Xi chart just involves plotting the individual results over time. The MR chart involves a slightly more complicated calculation involving taking the difference between the present sample result, Xi and the previous sample result. Xi-1. Thus, the points that are plotted are: MRi = Xi – Xi-1, for values of i = 2, …, n. These charts were chosen to be shown here because they are easy to construct and are common charts used to monitor processes for which control with respect to levels of microbiological organisms is desired. -
Estimating the Mean and Variance of a Normal Distribution
Estimating the Mean and Variance of a Normal Distribution Learning Objectives After completing this module, the student will be able to • explain the value of repeating experiments • explain the role of the law of large numbers in estimating population means • describe the effect of increasing the sample size or reducing measurement errors or other sources of variability Knowledge and Skills • Properties of the arithmetic mean • Estimating the mean of a normal distribution • Law of Large Numbers • Estimating the Variance of a normal distribution • Generating random variates in EXCEL Prerequisites 1. Calculating sample mean and arithmetic average 2. Calculating sample standard variance and standard deviation 3. Normal distribution Citation: Neuhauser, C. Estimating the Mean and Variance of a Normal Distribution. Created: September 9, 2009 Revisions: Copyright: © 2009 Neuhauser. This is an open‐access article distributed under the terms of the Creative Commons Attribution Non‐Commercial Share Alike License, which permits unrestricted use, distribution, and reproduction in any medium, and allows others to translate, make remixes, and produce new stories based on this work, provided the original author and source are credited and the new work will carry the same license. Funding: This work was partially supported by a HHMI Professors grant from the Howard Hughes Medical Institute. Page 1 Pretest 1. Laura and Hamid are late for Chemistry lab. The lab manual asks for determining the density of solid platinum by repeating the measurements three times. To save time, they decide to only measure the density once. Explain the consequences of this shortcut. 2. Tom and Bao Yu measured the density of solid platinum three times: 19.8, 21.4, and 21.9 g/cm3. -
Problems with OLS Autocorrelation
Problems with OLS Considering : Yi = α + βXi + ui we assume Eui = 0 2 = σ2 = σ2 E ui or var ui Euiuj = 0orcovui,uj = 0 We have seen that we have to make very specific assumptions about ui in order to get OLS estimates with the desirable properties. If these assumptions don’t hold than the OLS estimators are not necessarily BLU. We can respond to such problems by changing specification and/or changing the method of estimation. First we consider the problems that might occur and what they imply. In all of these we are basically looking at the residuals to see if they are random. ● 1. The errors are serially dependent ⇒ autocorrelation/serial correlation. 2. The error variances are not constant ⇒ heteroscedasticity 3. In multivariate analysis two or more of the independent variables are closely correlated ⇒ multicollinearity 4. The function is non-linear 5. There are problems of outliers or extreme values -but what are outliers? 6. There are problems of missing variables ⇒can lead to missing variable bias Of course these problems do not have to come separately, nor are they likely to ● Note that in terms of significance things may look OK and even the R2the regression may not look that bad. ● Really want to be able to identify a misleading regression that you may take seriously when you should not. ● The tests in Microfit cover many of the above concerns, but you should always plot the residuals and look at them. Autocorrelation This implies that taking the time series regression Yt = α + βXt + ut but in this case there is some relation between the error terms across observations. -
Business Statistics Unit 4 Correlation and Regression.Pdf
RCUB, B.Com 4 th Semester Business Statistics – II Rani Channamma University, Belagavi B.Com – 4th Semester Business Statistics – II UNIT – 4 : CORRELATION Introduction: In today’s business world we come across many activities, which are dependent on each other. In businesses we see large number of problems involving the use of two or more variables. Identifying these variables and its dependency helps us in resolving the many problems. Many times there are problems or situations where two variables seem to move in the same direction such as both are increasing or decreasing. At times an increase in one variable is accompanied by a decline in another. For example, family income and expenditure, price of a product and its demand, advertisement expenditure and sales volume etc. If two quantities vary in such a way that movements in one are accompanied by movements in the other, then these quantities are said to be correlated. Meaning: Correlation is a statistical technique to ascertain the association or relationship between two or more variables. Correlation analysis is a statistical technique to study the degree and direction of relationship between two or more variables. A correlation coefficient is a statistical measure of the degree to which changes to the value of one variable predict change to the value of another. When the fluctuation of one variable reliably predicts a similar fluctuation in another variable, there’s often a tendency to think that means that the change in one causes the change in the other. Uses of correlations: 1. Correlation analysis helps inn deriving precisely the degree and the direction of such relationship. -
The Bootstrap and Jackknife
The Bootstrap and Jackknife Summer 2017 Summer Institutes 249 Bootstrap & Jackknife Motivation In scientific research • Interest often focuses upon the estimation of some unknown parameter, θ. The parameter θ can represent for example, mean weight of a certain strain of mice, heritability index, a genetic component of variation, a mutation rate, etc. • Two key questions need to be addressed: 1. How do we estimate θ ? 2. Given an estimator for θ , how do we estimate its precision/accuracy? • We assume Question 1 can be reasonably well specified by the researcher • Question 2, for our purposes, will be addressed via the estimation of the estimator’s standard error Summer 2017 Summer Institutes 250 What is a standard error? Suppose we want to estimate a parameter theta (eg. the mean/median/squared-log-mode) of a distribution • Our sample is random, so… • Any function of our sample is random, so... • Our estimate, theta-hat, is random! So... • If we collected a new sample, we’d get a new estimate. Same for another sample, and another... So • Our estimate has a distribution! It’s called a sampling distribution! The standard deviation of that distribution is the standard error Summer 2017 Summer Institutes 251 Bootstrap Motivation Challenges • Answering Question 2, even for relatively simple estimators (e.g., ratios and other non-linear functions of estimators) can be quite challenging • Solutions to most estimators are mathematically intractable or too complicated to develop (with or without advanced training in statistical inference) • However • Great strides in computing, particularly in the last 25 years, have made computational intensive calculations feasible. -
Beating Monte Carlo
SIMULATION BEATING MONTE CARLO Simulation methods using low-discrepancy point sets beat Monte Carlo hands down when valuing complex financial derivatives, report Anargyros Papageorgiou and Joseph Traub onte Carlo simulation is widely used to ods with basic Monte Carlo in the valuation of alised Faure achieves accuracy of 10"2 with 170 M price complex financial instruments, and a collateraliscd mortgage obligation (CMO). points, while modified Sobol uses 600 points. much time and money have been invested in We found that deterministic methods beat The Monte Carlo method, on the other hand, re• the hope of improving its performance. How• Monte Carlo: quires 2,700 points for the same accuracy, ever, recent theoretical results and extensive • by a wide margin. In particular: (iii) Monte Carlo tends to waste points due to computer testing indicate that deterministic (i) Both the generalised Faure and modified clustering, which severely compromises its per• methods, such as simulations using Sobol or Sobol methods converge significantly faster formance when the sample size is small. Faure points, may be superior in both speed than Monte Carlo. • as the sample size and the accuracy de• and accuracy. (ii) The generalised Faure method always con• mands grow. In particular: Tn this paper, we refer to a deterministic verges at least as fast as the modified Sobol (i) Deterministic methods are 20 to 50 times method by the name of the sequence of points method and often faster. faster than Monte Carlo (the speed-up factor) it uses, eg, the Sobol method. Wc tested the gen• (iii) The Monte Carlo method is sensitive to the even with moderate sample sizes (2,000 de• eralised Faure sequence due to Tezuka (1995) initial seed. -
Lecture 5 Significance Tests Criticisms of the NHST Publication Bias Research Planning
Lecture 5 Significance tests Criticisms of the NHST Publication bias Research planning Theophanis Tsandilas !1 Calculating p The p value is the probability of obtaining a statistic as extreme or more extreme than the one observed if the null hypothesis was true. When data are sampled from a known distribution, an exact p can be calculated. If the distribution is unknown, it may be possible to estimate p. 2 Normal distributions If the sampling distribution of the statistic is normal, we will use the standard normal distribution z to derive the p value 3 Example An experiment studies the IQ scores of people lacking enough sleep. H0: μ = 100 and H1: μ < 100 (one-sided) or H0: μ = 100 and H1: μ = 100 (two-sided) 6 4 Example Results from a sample of 15 participants are as follows: 90, 91, 93, 100, 101, 88, 98, 100, 87, 83, 97, 105, 99, 91, 81 The mean IQ score of the above sample is M = 93.6. Is this value statistically significantly different than 100? 5 Creating the test statistic We assume that the population standard deviation is known and equal to SD = 15. Then, the standard error of the mean is: σ 15 σµˆ = = =3.88 pn p15 6 Creating the test statistic We assume that the population standard deviation is known and equal to SD = 15. Then, the standard error of the mean is: σ 15 σµˆ = = =3.88 pn p15 The test statistic tests the standardized difference between the observed mean µ ˆ = 93 . 6 and µ 0 = 100 µˆ µ 93.6 100 z = − 0 = − = 1.65 σµˆ 3.88 − The p value is the probability of getting a z statistic as or more extreme than this value (given that H0 is true) 7 Calculating the p value µˆ µ 93.6 100 z = − 0 = − = 1.65 σµˆ 3.88 − The p value is the probability of getting a z statistic as or more extreme than this value (given that H0 is true) 8 Calculating the p value To calculate the area in the distribution, we will work with the cumulative density probability function (cdf). -
Lecture 3: Measure of Central Tendency
Lecture 3: Measure of Central Tendency Donglei Du ([email protected]) Faculty of Business Administration, University of New Brunswick, NB Canada Fredericton E3B 9Y2 Donglei Du (UNB) ADM 2623: Business Statistics 1 / 53 Table of contents 1 Measure of central tendency: location parameter Introduction Arithmetic Mean Weighted Mean (WM) Median Mode Geometric Mean Mean for grouped data The Median for Grouped Data The Mode for Grouped Data 2 Dicussion: How to lie with averges? Or how to defend yourselves from those lying with averages? Donglei Du (UNB) ADM 2623: Business Statistics 2 / 53 Section 1 Measure of central tendency: location parameter Donglei Du (UNB) ADM 2623: Business Statistics 3 / 53 Subsection 1 Introduction Donglei Du (UNB) ADM 2623: Business Statistics 4 / 53 Introduction Characterize the average or typical behavior of the data. There are many types of central tendency measures: Arithmetic mean Weighted arithmetic mean Geometric mean Median Mode Donglei Du (UNB) ADM 2623: Business Statistics 5 / 53 Subsection 2 Arithmetic Mean Donglei Du (UNB) ADM 2623: Business Statistics 6 / 53 Arithmetic Mean The Arithmetic Mean of a set of n numbers x + ::: + x AM = 1 n n Arithmetic Mean for population and sample N P xi µ = i=1 N n P xi x¯ = i=1 n Donglei Du (UNB) ADM 2623: Business Statistics 7 / 53 Example Example: A sample of five executives received the following bonuses last year ($000): 14.0 15.0 17.0 16.0 15.0 Problem: Determine the average bonus given last year. Solution: 14 + 15 + 17 + 16 + 15 77 x¯ = = = 15:4: 5 5 Donglei Du (UNB) ADM 2623: Business Statistics 8 / 53 Example Example: the weight example (weight.csv) The R code: weight <- read.csv("weight.csv") sec_01A<-weight$Weight.01A.2013Fall # Mean mean(sec_01A) ## [1] 155.8548 Donglei Du (UNB) ADM 2623: Business Statistics 9 / 53 Will Rogers phenomenon Consider two sets of IQ scores of famous people. -
Probability Distributions and Error Bars
Statistics and Data Analysis in MATLAB Kendrick Kay, [email protected] Lecture 1: Probability distributions and error bars 1. Exploring a simple dataset: one variable, one condition - Let's start with the simplest possible dataset. Suppose we measure a single quantity for a single condition. For example, suppose we measure the heights of male adults. What can we do with the data? - The histogram provides a useful summary of a set of data—it shows the distribution of the data. A histogram is constructed by binning values and counting the number of observations in each bin. - The mean and standard deviation are simple summaries of a set of data. They are parametric statistics, as they make implicit assumptions about the form of the data. The mean is designed to quantify the central tendency of a set of data, while the standard deviation is designed to quantify the spread of a set of data. n ∑ xi mean(x) = x = i=1 n n 2 ∑(xi − x) std(x) = i=1 n − 1 In these equations, xi is the ith data point and n is the total number of data points. - The median and interquartile range (IQR) also summarize data. They are nonparametric statistics, as they make minimal assumptions about the form of the data. The Xth percentile is the value below which X% of the data points lie. The median is the 50th percentile. The IQR is the difference between the 75th and 25th percentiles. - Mean and standard deviation are appropriate when the data are roughly Gaussian. When the data are not Gaussian (e.g. -
Examples of Standard Error Adjustment In
Statistical Analysis of NCES Datasets Employing a Complex Sample Design > Examples > Slide 11 of 13 Examples of Standard Error Adjustment Obtaining a Statistic Using Both SRS and Complex Survey Methods in SAS This resource document will provide you with an example of the analysis of a variable in a complex sample survey dataset using SAS. A subset of the public-use version of the Early Child Longitudinal Studies ECLS-K rounds one and two data from 1998 accompanies this example, as well as an SAS syntax file. The stratified probability design of the ECLS-K requires that researchers use statistical software programs that can incorporate multiple weights provided with the data in order to obtain accurate descriptive or inferential statistics. Research question This dataset training exercise will answer the research question “Is there a difference in mathematics achievement gain from fall to spring of kindergarten between boys and girls?” Step 1- Get the data ready for use in SAS There are two ways for you to obtain the data for this exercise. You may access a training subset of the ECLS-K Public Use File prepared specifically for this exercise by clicking here, or you may use the ECLS-K Public Use File (PUF) data that is available at http://nces.ed.gov/ecls/dataproducts.asp. If you use the training dataset, all of the variables needed for the analysis presented herein will be included in the file. If you choose to access the PUF, extract the following variables from the online data file (also referred to by NCES as an ECB or “electronic code book”): CHILDID CHILD IDENTIFICATION NUMBER C1R4MSCL C1 RC4 MATH IRT SCALE SCORE (fall) C2R4MSCL C2 RC4 MATH IRT SCALE SCORE (spring) GENDER GENDER BYCW0 BASE YEAR CHILD WEIGHT FULL SAMPLE BYCW1 through C1CW90 BASE YEAR CHILD WEIGHT REPLICATES 1 through 90 BYCWSTR BASE YEAR CHILD STRATA VARIABLE BYCWPSU BASE YEAR CHILD PRIMARY SAMPLING UNIT Export the data from this ECB to SAS format.