Chapter 8 Introduction to Statistical Analysis
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Data Analysis in Astronomy and Physics
Data Analysis in Astronomy and Physics Lecture 3: Statistics 2 Lecture_Note_3_Statistics_new.nb M. Röllig - SS19 Lecture_Note_3_Statistics_new.nb 3 Statistics Statistics are designed to summarize, reduce or describe data. A statistic is a function of the data alone! Example statistics for a set of data X1,X 2, … are: average, the maximum value, average of the squares,... Statistics are combinations of finite amounts of data. Example summarizing examples of statistics: location and scatter. 4 Lecture_Note_3_Statistics_new.nb Location Average (Arithmetic Mean) Out[ ]//TraditionalForm= N ∑Xi i=1 X N Example: Mean[{1, 2, 3, 4, 5, 6, 7}] Mean[{1, 2, 3, 4, 5, 6, 7, 8}] Mean[{1, 2, 3, 4, 5, 6, 7, 100}] 4 9 2 16 Lecture_Note_3_Statistics_new.nb 5 Location Weighted Average (Weighted Arithmetic Mean) 1 "N" In[36]:= equationXw ⩵ wi Xi "N" = ∑ wi i 1 i=1 Out[36]//TraditionalForm= N ∑wi Xi i=1 Xw N ∑wi i=1 1 1 1 1 In case of equal weights wi = w : Xw = ∑wi Xi = ∑wXi = w ∑Xi = ∑Xi = X ∑wi ∑w w N 1 N Example: data: xi, weights :w i = xi In[46]:= x1={1., 2, 3, 4, 5, 6, 7}; w1=1/ x1; x2={1., 2, 3, 4, 5, 6, 7, 8}; w2=1 x2; x3={1., 2, 3, 4, 5, 6, 7, 100}; w3=1 x3; In[49]:= x1.w1 Total[w1] x2.w2 Total[w2] x3.w3 Total[w3] Out[49]= 2.69972 Out[50]= 2.9435 Out[51]= 3.07355 6 Lecture_Note_3_Statistics_new.nb Location Median Arrange Xi according to size and renumber. -
The Generalized Likelihood Uncertainty Estimation Methodology
CHAPTER 4 The Generalized Likelihood Uncertainty Estimation methodology Calibration and uncertainty estimation based upon a statistical framework is aimed at finding an optimal set of models, parameters and variables capable of simulating a given system. There are many possible sources of mismatch between observed and simulated state variables (see section 3.2). Some of the sources of uncertainty originate from physical randomness, and others from uncertain knowledge put into the system. The uncertainties originating from physical randomness may be treated within a statistical framework, whereas alternative methods may be needed to account for uncertainties originating from the interpretation of incomplete and perhaps ambiguous data sets. The GLUE methodology (Beven and Binley 1992) rejects the idea of one single optimal solution and adopts the concept of equifinality of models, parameters and variables (Beven and Binley 1992; Beven 1993). Equifinality originates from the imperfect knowledge of the system under consideration, and many sets of models, parameters and variables may therefore be considered equal or almost equal simulators of the system. Using the GLUE analysis, the prior set of mod- els, parameters and variables is divided into a set of non-acceptable solutions and a set of acceptable solutions. The GLUE methodology deals with the variable degree of membership of the sets. The degree of membership is determined by assessing the extent to which solutions fit the model, which in turn is determined 53 CHAPTER 4. THE GENERALIZED LIKELIHOOD UNCERTAINTY ESTIMATION METHODOLOGY by subjective likelihood functions. By abandoning the statistical framework we also abandon the traditional definition of uncertainty and in general will have to accept that to some extent uncertainty is a matter of subjective and individual interpretation by the hydrologist. -
Weighted Means and Grouped Data on the Graphing Calculator
Weighted Means and Grouped Data on the Graphing Calculator Weighted Means. Suppose that, in a recent month, a bank customer had $2500 in his account for 5 days, $1900 for 2 days, $1650 for 3 days, $1375 for 9 days, $1200 for 1 day, $900 for 6 days, and $675 for 4 days. To calculate the average balance for that month, you would use a weighted mean: ∑ ̅ ∑ To do this automatically on a calculator, enter the account balances in L1 and the number of days (weight) in L2: As before, go to STAT CALC and 1:1-Var Stats. This time, type L1, L2 after 1-Var Stats and ENTER: The weighted (sample) mean is ̅ (so that the average balance for the month is $1430.83.) We can also see that the weighted sample standard deviation is . Estimating the Mean and Standard Deviation from a Frequency Distribution. If your data is organized into a frequency distribution, you can still estimate the mean and standard deviation. For example, suppose that we are given only a frequency distribution of the heights of the 30 males instead of the list of individual heights: Height (in.) Frequency (f) 62 - 64 3 65- 67 7 68 - 70 9 71 - 73 8 74 - 76 3 ∑ n = 30 We can just calculate the midpoint of each height class and use that midpoint to represent the class. We then find the (weighted) mean and standard deviation for the distribution of midpoints with the given frequencies as in the example above: Height (in.) Height Class Frequency (f) Midpoint 62 - 64 (62 + 64)/2 = 63 3 65- 67 (65 + 67)/2 = 66 7 68 - 70 69 9 71 - 73 72 8 74 - 76 75 3 ∑ n = 30 The approximate sample mean of the distribution is ̅ , and the approximate sample standard deviation of the distribution is . -
Lecture 3: Measure of Central Tendency
Lecture 3: Measure of Central Tendency Donglei Du ([email protected]) Faculty of Business Administration, University of New Brunswick, NB Canada Fredericton E3B 9Y2 Donglei Du (UNB) ADM 2623: Business Statistics 1 / 53 Table of contents 1 Measure of central tendency: location parameter Introduction Arithmetic Mean Weighted Mean (WM) Median Mode Geometric Mean Mean for grouped data The Median for Grouped Data The Mode for Grouped Data 2 Dicussion: How to lie with averges? Or how to defend yourselves from those lying with averages? Donglei Du (UNB) ADM 2623: Business Statistics 2 / 53 Section 1 Measure of central tendency: location parameter Donglei Du (UNB) ADM 2623: Business Statistics 3 / 53 Subsection 1 Introduction Donglei Du (UNB) ADM 2623: Business Statistics 4 / 53 Introduction Characterize the average or typical behavior of the data. There are many types of central tendency measures: Arithmetic mean Weighted arithmetic mean Geometric mean Median Mode Donglei Du (UNB) ADM 2623: Business Statistics 5 / 53 Subsection 2 Arithmetic Mean Donglei Du (UNB) ADM 2623: Business Statistics 6 / 53 Arithmetic Mean The Arithmetic Mean of a set of n numbers x + ::: + x AM = 1 n n Arithmetic Mean for population and sample N P xi µ = i=1 N n P xi x¯ = i=1 n Donglei Du (UNB) ADM 2623: Business Statistics 7 / 53 Example Example: A sample of five executives received the following bonuses last year ($000): 14.0 15.0 17.0 16.0 15.0 Problem: Determine the average bonus given last year. Solution: 14 + 15 + 17 + 16 + 15 77 x¯ = = = 15:4: 5 5 Donglei Du (UNB) ADM 2623: Business Statistics 8 / 53 Example Example: the weight example (weight.csv) The R code: weight <- read.csv("weight.csv") sec_01A<-weight$Weight.01A.2013Fall # Mean mean(sec_01A) ## [1] 155.8548 Donglei Du (UNB) ADM 2623: Business Statistics 9 / 53 Will Rogers phenomenon Consider two sets of IQ scores of famous people. -
Random Variables and Applications
Random Variables and Applications OPRE 6301 Random Variables. As noted earlier, variability is omnipresent in the busi- ness world. To model variability probabilistically, we need the concept of a random variable. A random variable is a numerically valued variable which takes on different values with given probabilities. Examples: The return on an investment in a one-year period The price of an equity The number of customers entering a store The sales volume of a store on a particular day The turnover rate at your organization next year 1 Types of Random Variables. Discrete Random Variable: — one that takes on a countable number of possible values, e.g., total of roll of two dice: 2, 3, ..., 12 • number of desktops sold: 0, 1, ... • customer count: 0, 1, ... • Continuous Random Variable: — one that takes on an uncountable number of possible values, e.g., interest rate: 3.25%, 6.125%, ... • task completion time: a nonnegative value • price of a stock: a nonnegative value • Basic Concept: Integer or rational numbers are discrete, while real numbers are continuous. 2 Probability Distributions. “Randomness” of a random variable is described by a probability distribution. Informally, the probability distribution specifies the probability or likelihood for a random variable to assume a particular value. Formally, let X be a random variable and let x be a possible value of X. Then, we have two cases. Discrete: the probability mass function of X specifies P (x) P (X = x) for all possible values of x. ≡ Continuous: the probability density function of X is a function f(x) that is such that f(x) h P (x < · ≈ X x + h) for small positive h. -
Mistaking the Forest for the Trees: the Mistreatment of Group-Level Treatments in the Study of American Politics
Mistaking the Forest for the Trees: The Mistreatment of Group-Level Treatments in the Study of American Politics Kelly T. Rader Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Graduate School of Arts and Sciences COLUMBIA UNIVERSITY 2012 c 2012 Kelly T. Rader All Rights Reserved ABSTRACT Mistaking the Forest for the Trees: The Mistreatment of Group-Level Treatments in the Study of American Politics Kelly T. Rader Over the past few decades, the field of political science has become increasingly sophisticated in its use of empirical tests for theoretical claims. One particularly productive strain of this devel- opment has been the identification of the limitations of and challenges in using observational data. Making causal inferences with observational data is difficult for numerous reasons. One reason is that one can never be sure that the estimate of interest is un-confounded by omitted variable bias (or, in causal terms, that a given treatment is ignorable or conditionally random). However, when the ideal hypothetical experiment is impractical, illegal, or impossible, researchers can often use quasi-experimental approaches to identify causal effects more plausibly than with simple regres- sion techniques. Another reason is that, even if all of the confounding factors are observed and properly controlled for in the model specification, one can never be sure that the unobserved (or error) component of the data generating process conforms to the assumptions one must make to use the model. If it does not, then this manifests itself in terms of bias in standard errors and incor- rect inference on statistical significance of quantities of interest. -
Experimental and Simulation Studies of the Shape and Motion of an Air Bubble Contained in a Highly Viscous Liquid Flowing Through an Orifice Constriction
Accepted Manuscript Experimental and simulation studies of the shape and motion of an air bubble contained in a highly viscous liquid flowing through an orifice constriction B. Hallmark, C.-H. Chen, J.F. Davidson PII: S0009-2509(19)30414-2 DOI: https://doi.org/10.1016/j.ces.2019.04.043 Reference: CES 14954 To appear in: Chemical Engineering Science Received Date: 13 February 2019 Revised Date: 25 April 2019 Accepted Date: 27 April 2019 Please cite this article as: B. Hallmark, C.-H. Chen, J.F. Davidson, Experimental and simulation studies of the shape and motion of an air bubble contained in a highly viscous liquid flowing through an orifice constriction, Chemical Engineering Science (2019), doi: https://doi.org/10.1016/j.ces.2019.04.043 This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain. Experimental and simulation studies of the shape and motion of an air bubble contained in a highly viscous liquid flowing through an orifice constriction. B. Hallmark, C.-H. Chen, J.F. Davidson Department of Chemical Engineering and Biotechnology, Philippa Fawcett Drive, Cambridge. CB3 0AS. UK Abstract This paper reports an experimental and computational study on the shape and motion of an air bubble, contained in a highly viscous Newtonian liquid, as it passes through a rectangular channel having a constriction orifice. -
Principal Component Analysis: Application to Statistical Process Control
Chapter 1 Principal Component Analysis: Application to Statistical Process Control 1.1. Introduction Principal component analysis (PCA) is an exploratory statistical method for graphical description of the information present in large datasets. In most applications, PCA consists of studying p variables measured on n individuals. When n and p are large, the aim is to synthesize the huge quantity of information into an easy and understandable form. Unidimensional or bidimensional studies can be performed on variables using graphical tools (histograms, box plots) or numerical summaries (mean, variance, correlation). However, these simple preliminary studies in a multidimensional context are insufficient since they do not take into account the eventual relationships between variables, which is often the most important point. Principal component analysis is often considered as the basic method of factor analysis, which aims to find linear combinations of the p variables called components used to visualize the observations in a simple way. Because it transforms a large number of correlated variables into a few uncorrelated principal components, PCA is a dimension reduction method. However, PCA can also be used as a multivariate outlier detection method, especially by studying the last principal components. This property is useful in multidimensional quality control. Chapter written by Gilbert SAPORTA and Ndèye NIANG. 1 2 Data Analysis 1.2. Data table and related subspaces 1.2.1. Data and their characteristics Data are generally represented in a rectangulartable with n rows for the individuals and p columns corresponding to the variables. Choosing individuals and variables to analyze is a crucial phase which has an important influence on PCA results. -
Statistics, Measures of Central Tendency I
Statistics, Measures of Central TendencyI We are considering a random variable X with a probability distribution which has some parameters. We want to get an idea what these parameters are. We perfom an experiment n times and record the outcome. This means we have X1;:::; Xn i.i.d. random variables, with probability distribution same as X . We want to use the outcome to infer what the parameters are. Mean The outcomes are x1;:::; xn. The Sample Mean is x1+···+xn x := n . Also sometimes called the average. The expected value of X , EX , is also called the mean of X . Often denoted by µ. Sometimes called population mean. Median The number so that half the values are below, half above. If the sample is of even size, you take the average of the middle terms. Mode The number that occurs most frequently. There could be several modes, or no mode. Dan Barbasch Math 1105 Chapter 9 Week of September 25 1 / 24 Statistics, Measures of Central TendencyII Example You have a coin for which you know that P(H) = p and P(T ) = 1 − p: You would like to estimate p. You toss it n times. You count the number of heads. The sample mean should be an estimate of p: EX = p, and E(X1 + ··· + Xn) = np: So X + ··· + X E 1 n = p: n Dan Barbasch Math 1105 Chapter 9 Week of September 25 2 / 24 Descriptive StatisticsI Frequency Distribution Divide into a number of equal disjoint intervals. For each interval count the number of elements in the sample occuring. -
Prevalence of Elevated Blood Pressure Levels In
PREVALENCE OF ELEVATED BLOOD PRESSURE LEVELS IN OVERWEIGHT AND OBESE YOUNG POPULATION (2 – 19 YEARS) IN THE UNITED STATES BETWEEN 2011 AND 2012 By: Lawrence O. Agyekum A Dissertation Submitted to Faculty of the School of Health Related Professions, Rutgers, The State University of New Jersey in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Biomedical Informatics Department of Health Informatics Spring 2015 © 2015 Lawrence Agyekum All Rights Reserved Final Dissertation Approval Form PREVALENCE OF ELEVATED BLOOD PRESSURE LEVELS IN OVERWEIGHT AND OBESE YOUNG POPULATION (2 – 19 YEARS) IN THE UNITED STATES BETWEEN 2011 AND 2012 BY Lawrence O. Agyekum Dissertation Committee: Syed Haque, Ph.D., Committee Chair Frederick Coffman Ph.D., Committee Member Shankar Srinivasan, Ph.D., Member Approved by the Dissertation Committee: _____________________________________ Date: _______________ _____________________________________ Date: _______________ ____________________________________ Date: _______________ ii ABSTRACT Prevalence of Elevated Blood Pressure Levels in Overweight and Obese Young Population (2 -19 Years) in the United States between 2011-2012 By Lawrence Ofori Agyekum Several studies have reported hypertension prevalence in children and adolescents in the United States (US) using regional or local population-based samples but few have reported national prevalence. The present study estimates national hypertension prevalence in US children and adolescents for 2011-2012. A convenient sample size of 4,196 (population aged ≤ 19) representing 43% of 9,756 (total survey respondents) was selected and stratified by age groups; “Children” and “Adolescents” using the 2007 Joint National Committee recommended definitions. Next, hypertension distribution was explained by gender, race, age, body weight, standing height and blood serum total cholesterol. -
Lesson 16.5 Measures of Central Tendency and Grouped Data
NAME: INTEGRATED ALGEBRA 1 DATE: MR. THOMPSON LESSON 16.5 MEASURES OF CENTRAL TENDENCY AND GROUPED DATA HOMEWORK ASSIGNMENT # 126: PAGES 695-697: # 2 - 12 EVENS EXAMPLE I OiliflitEMIZZEITIOMMESEMZESEM72ra, In the table, the data indicate the heights, in inches, of 17 basketball players. For these data find: a. the mode b. the median c. the mean 77 2 Solution a. The greatest frequency, 5, occurs for the height 76 0 of 75 inches. The mode, or height appearing most often, is 75. 75 5 74 3 b.For 17 players, the median is the 9th number, so there are 8 heights greater than or equal to the 73 4 median and 8 heights less than or equal to the 72 2 median. Counting the frequencies going down, 1 we have 2 + 0 + 5 = 7. Since the frequency of 71 the next interval is 3, the 8th, 9th, and 10th heights are in this interval, 74. Counting the frequencies going up, we have 1 + 2 + 4 = 7. Again, the fre- quency of the next interval is 3, and the 8th, 9th, and 10th heights are in this interval. The 9th height, the median, is 74. c.(1) Multiply each height by its corresponding frequency: 77 x 2 = 154 76 x 0 = 0 75 x 5 375 74 x 3 = 222 73 X 4 = 292 72 X 2 = 144 71 x 1 = 71 (2) Fmd the total of these products: 154 + 0 + 375 + 222 + 292 + 144 + 71 = 1,258 (3) Divide this total, 1,258, by the total frequency, 17 to obtain the mean: 1258 +47 = 74 14. -
Arxiv:1111.2491V1 [Physics.Data-An] 10 Nov 2011 .Simulation 2
Optimized differential energy loss estimation for tracker detectors Ferenc Sikl´er KFKI Research Institute for Particle and Nuclear Physics, Budapest, Hungary CERN, Geneva, Switzerland S´andor Szeles E¨otv¨os University, Budapest, Hungary Abstract The estimation of differential energy loss for charged particles in tracker detectors is studied. The robust truncated mean method can be generalized to the linear combination of the energy deposit measurements. The optimized weights in case of arithmetic and geometric means are obtained using a detailed simulation. The results show better particle separation power for both semiconductor and gaseous detectors. Key words: Energy loss, Silicon, TPC PACS: 29.40.Gx, 29.85.-c, 34.50.Bw 1. Introduction The identification of charged particles is crucial in several fields of particle and nuclear physics: particle spectra, correlations, selection of daughters of resonance decays and for reducing the background of rare physics processes [1, 2]. Tracker detectors, both semiconductor and gaseous, can be employed for particle identification, or yield extraction in the statistical sense, by proper use of energy deposit measurements along the trajectory of the particle. While for gaseous detectors a wide momentum range is available, in semiconductors there is practically no logarithmic rise of differential energy loss (dE/dx) at high momentum, thus only momenta below the the minimum ionization region are accessible. In this work two representative materials, silicon and neon are studied. Energy loss of charged particles inside matter is a complicated process. For detailed theoretical model and several comparisons to measured data see Refs. [3, 4]. While the energy lost and deposited differ, they will be used interchangeably in the discussion.