Order Statistics

Total Page:16

File Type:pdf, Size:1020Kb

Order Statistics Chapter 1 Order Statistics This presentation delivered to CE397 Statistics in Water Resources, University of Texas at Austin Spring 2009 on March 31, 2009 by William H. Asquith Ph.D. The software used is R from www.r-project.org and is available for all platforms. The lmomco package provides some functions discussed in class related to order statitics and L-moments and can be found at www.cran.r-project.org/package=lmomco. 1 2 1 Order Statistics 1.1 Introduction A branch of statistics known as order statistics plays a prominent role in L-moment theory. The study of order statistics is the study of the statistics of ordered (sorted) random variables and samples. This chapter presents a very brief introduction to order statistics to provide a foundation for later chapters. A comprehensive exposition of order statistics is provided by David (1981), and an R-oriented approach is described in various contexts by Baclawski (2008). The random variable X for a sample of size n, when sorted, forms the order statistics of X: X1:n ≤ X2:n ≤ ··· ≤ Xn:n. The sample order statistics from a random sample are created by sorting the sample into ascending order: x1:n ≤ x2:n ≤ ··· ≤ xn:n. As we will see, the concept and use of order statistics take into account both the value (magnitude) and the relative relation (order) to other observations. Barrett (2004, p. 23) reports that . the effects of ordering can be impressive in terms of both what aspects of sample behavior can be usefully employed and the effectiveness and efficiency of resulting inferences. and that . linear combinations of all ordered samples values can provide efficient estimators. This presentation will show that the L-moments, which are based on linear combinations of order statistics, do in fact provide efficient estimators of distributional geometry. In general, order statistics are already a part of the basic summary statistic repertoire that most individuals— including nonscientists or statisticians—are familiar with. The minimum and maximum are examples of extreme order statistics and are defined by the following notation minfXng = X1:n (1.1) maxfXng = Xn:n (1.2) The familiar median X0:50 by convention is 1.1 Introduction 3 ( (X[n=2]:n + X[(n=2)+1]:n)=2 if n is even X0:50 = (1.3) X[(n+1)=2]:n if n is odd and thus clearly is defined in terms of one order statistic or a linear combination of two order statistics. Other order statistics exist and several important interpretations towards the purpose of this presentation can be made. Concerning L-moments, Hosking (1990, p. 109) and Hosking and Wallis (1997, p. 21) provide an “intuitive” justification for L-moments and by association the probability-weighted moments. The justification follows: • The order statistic X1:1 (a single observation) contains information about the location of the distribution on the real-number line R; • For a sample of n = 2, the order statistics are X1:2 (smallest) and X2:2 (largest). For a highly dispersed distribution, the expected difference between X2:2 − X1:2 would be large, whereas for a tightly dispersed distribution, the differ- ence would be small. The expected differences between order statistics of an n = 2 sample hence can be used to expression the variability or scale of a distribution; and • For a sample of n = 3, the order statistics are X1:3 (smallest), X2:3 (median), and X3:3 (largest). For a negatively skewed distribution, the difference X2:3 − X1:3 would be larger (more data to the left) than X3:3 − X2:3. The opposite (more data to the right) would occur if a distribution where positively skewed. These interpretations show the importance of the intra-sample differences in the expression of distribution geometry. Expectations and Distributions of Order Statistics A fundamental definition regarding order statistics, which will be critically important in the computation of L-moments and probability-weighted moments, is the expectation of an order statistic. The expectation is defined in terms of the QDF. The expectation of an order statistic for the jth largest of r values is defined (David, 1981, p. 33) in terms of the QDF x(F) as 4 1 Order Statistics Z 1 n! j−1 n− j E[Xj:n] = x(F) × F × (1 − F) dF (1.4) ( j − 1)!(n − j)! 0 The expectation of an order statistic for a sample of size n = 1 is especially important because Z 1 E[X1:1] = x(F) dF = m = arithmetic mean (1.5) 0 Therefore, the familiar mean can be interpreted thus: The mean is the expected value of a single observation if one and only one sample is drawn from the distribution. Hosking (2006) reports from references cited therein that “the expectations of extreme order statistics characterize a distribution.” In particular, if the expectation of a random variable X is finite, then the set fE[X1:n : n=1;2;···]g or fE[Xn:n : n=1;2;···]g uniquely determine the distribution. Hosking (2006) reports that such sets of expectations contain redundant information and that technically a subset of expectations can be dropped and the smaller set is still sufficient to characterize the distribution. USING R USING R Using eq. (1.4) and R, the expected value of the 123rd-ordered (increasing) value of a sample of size n = 300 is computed for an Exponential distribution in example 1–1 . The ratio of factorial functions in eq. (1.4) is difficult to compute for large values—judicious use of the fact that n! = G(n + 1) and use of logarithms of the complete Gamma function G(a) suffices. The results of the integration using QDF of the Exponential by the qexp() function and stochastic computation using random variates of the Exponential by the rexp() function for E[X123:300] are equivalent. 1–1 nsim <- 10000; n <- 300; j <- 123 int <- integrate(function(f,n=NULL,j=NULL) { exp(lgamma(n+1) - lgamma(j) - lgamma(n-j+1)) * qexp(f) * fˆ(j-1) * (1-f)ˆ(n-j) }, lower=0, upper=1, n=n, j=j) E_integrated <- int$value 1.1 Introduction 5 E_stochastic <- mean(replicate(nsim, sort(rexp(n))[j])) cat(c("RESULTS:", round(E_integrated, digits=3), "and", round(E_stochastic, digits=3), "\n")) RESULTS: 0.526 and 0.527 J Distributions of Order Statistic Extrema The extrema X1:n and Xn:n are of special interest in many practical problems of distributional analysis. Let us consider the sample maximum of random variable X having CDF of F(x) = Pr[Xn:n ≤ x]. If Xn:n ≤ x, then all xi ≤ x for i = 1;2;··· ;n, it can be shown that n n Fn(x) = Pr[X ≤ x] = fF(x)g (1.6) Similarly, it can be shown for the sample minimum that n n F1(x) = Pr[X > x] = f1 − F(x)g (1.7) Using the arguments producing eqs. (1.6) and (1.7) with a focus on the QDF, Gilchrist (2000, p. 85) provides 1=n xn:n(Fn:n) = x(Fn:n ) (1.8) 1=n x1:n(F1:n) = x(1 − (1 − F1:n) ) (1.9) for the maximum and minimum, respectively. Gilchrist (2000, p. 85) comments that, at least for xn:n that “the quantile function of the largest observation is thus found from the original quantile function in the simplest of calculations.” 6 1 Order Statistics For the general computation of the distribution of non extrema order statistics, the computations are more difficult. (Gilchrist, 2000, p. 86) shows that the QDF of the distribution of the jth order statistic of a sample of size n is (−1) x j:n(Fj:n) = x[B (Fj:n; j; n − j + 1)] (1.10) where x j:n(Fj:n) is to be read as “the QDF of the jth order statistic for a sample of size n given by nonexceedance (−1) (−1) probability Fj:n.” The function B (F;a;b) is the QDF of the Beta distribution—the notation represents the inverse of the CDF, which is of course a QDF. It follows that the QDF of the order statistic extrema for an F are (−1) x1:n(F) = x[B (F; 1; n)] (1.11) (−1) xn:n(F) = x[B (F; n; 1)] (1.12) for the minimum X1:n and maximum Xn:n, respectively. USING R USING R In the context of eqs. (1.6) and eq. (1.7), the expectations of extrema for the Exponential distribution are stochas- tically computed in example 1–2 using the min() and max() functions. The random variates from the Exponential are computed by the rexp() function. The example begins by setting the sample size n = 4, the size of a simulation run in nsim, and finally, the scale parameter (note that R uses a rate expression for the dispersion parameter) of the Exponential distribution is set to 1000. (A location parameter of 0 is implied.) The example reports (1000, 1500, 500) for the respective mean, maximum, and minimum values. (It is well known that the mean of this Exponential distribution is 1000.) 1–2 n <- 4; nsim <- 200000 s <- 1/1000 # inverse of scale parameter = 1000 # Expectation of Expectation of Exponential Distribution mean(replicate(nsim, mean(rexp(n, rate=s)))) 1.1 Introduction 7 [1] 1000.262 # Expectation of Maximum from Exponential Distribution mean(replicate(nsim, max(rexp(n, rate=s)))) [1] 1504.404 # Expectation of Minimum from Exponential Distribution mean(replicate(nsim, min(rexp(n, rate=s)))) [1] 499.6178 The demonstration continues in example 1–3 with the stochastic computation of the expected values of the max- imum and minimum through eqs.
Recommended publications
  • The Probability Lifesaver: Order Statistics and the Median Theorem
    The Probability Lifesaver: Order Statistics and the Median Theorem Steven J. Miller December 30, 2015 Contents 1 Order Statistics and the Median Theorem 3 1.1 Definition of the Median 5 1.2 Order Statistics 10 1.3 Examples of Order Statistics 15 1.4 TheSampleDistributionoftheMedian 17 1.5 TechnicalboundsforproofofMedianTheorem 20 1.6 TheMedianofNormalRandomVariables 22 2 • Greetings again! In this supplemental chapter we develop the theory of order statistics in order to prove The Median Theorem. This is a beautiful result in its own, but also extremely important as a substitute for the Central Limit Theorem, and allows us to say non- trivial things when the CLT is unavailable. Chapter 1 Order Statistics and the Median Theorem The Central Limit Theorem is one of the gems of probability. It’s easy to use and its hypotheses are satisfied in a wealth of problems. Many courses build towards a proof of this beautiful and powerful result, as it truly is ‘central’ to the entire subject. Not to detract from the majesty of this wonderful result, however, what happens in those instances where it’s unavailable? For example, one of the key assumptions that must be met is that our random variables need to have finite higher moments, or at the very least a finite variance. What if we were to consider sums of Cauchy random variables? Is there anything we can say? This is not just a question of theoretical interest, of mathematicians generalizing for the sake of generalization. The following example from economics highlights why this chapter is more than just of theoretical interest.
    [Show full text]
  • Lecture 14: Order Statistics; Conditional Expectation
    Department of Mathematics Ma 3/103 KC Border Introduction to Probability and Statistics Winter 2017 Lecture 14: Order Statistics; Conditional Expectation Relevant textbook passages: Pitman [5]: Section 4.6 Larsen–Marx [2]: Section 3.11 14.1 Order statistics Pitman [5]: Given a random vector (X(1,...,Xn) on the probability) space (S, E,P ), for each s ∈ S, sort the § 4.6 components into a vector X(1)(s),...,X(n)(s) satisfying X(1)(s) 6 X(2)(s) 6 ··· 6 X(n)(s). The vector (X(1),...,X(n)) is called the vector of order statistics of (X1,...,Xn). Equivalently, { } X(k) = min max{Xj : j ∈ J} : J ⊂ {1, . , n} & |J| = k . Order statistics play an important role in the study of auctions, among other things. 14.2 Marginal Distribution of Order Statistics From here on, we shall assume that the original random variables X1,...,Xn are independent and identically distributed. Let X1,...,Xn be independent and identically distributed random variables with common cumulative distribution function F ,( and let (X) (1),...,X(n)) be the vector of order statistics of X1,...,Xn. By breaking the event X(k) 6 x into simple disjoint subevents, we get ( ) X(k) 6 x = ( ) X(n) 6 x ∪ ( ) X(n) > x, X(n−1) 6 x . ∪ ( ) X(n) > x, . , X(j+1) > x, X(j) 6 x . ∪ ( ) X(n) > x, . , X(k+1) > x, X(k) 6 x . 14–1 Ma 3/103 Winter 2017 KC Border Order Statistics; Conditional Expectation 14–2 Each of these subevents is disjoint from the ones above it, and each has a binomial probability: ( ) X(n) > x, .
    [Show full text]
  • Medians and Order Statistics
    Medians and Order Statistics CLRS Chapter 9 1 What Are Order Statistics? The k-th order statistic is the k-th smallest element of an array. 3 4 13 14 23 27 41 54 65 75 8th order statistic ⎢n⎥ ⎢ ⎥ The lower median is the ⎣ 2 ⎦ -th order statistic ⎡n⎤ ⎢ ⎥ The upper median is the ⎢ 2 ⎥ -th order statistic If n is odd, lower and upper median are the same 3 4 13 14 23 27 41 54 65 75 lower median upper median What are Order Statistics? Selecting ith-ranked item from a collection. – First: i = 1 – Last: i = n ⎢n⎥ ⎡n⎤ – Median(s): i = ⎢ ⎥,⎢ ⎥ ⎣2⎦ ⎢2⎥ 3 Order Statistics Overview • Assume collection is unordered, otherwise trivial. find ith order stat = A[i] • Can sort first – Θ(n lg n), but can do better – Θ(n). • I can find max and min in Θ(n) time (obvious) • Can we find any order statistic in linear time? (not obvious!) 4 Order Statistics Overview How can we modify Quicksort to obtain expected-case Θ(n)? ? ? Pivot, partition, but recur only on one set of data. No join. 5 Using the Pivot Idea • Randomized-Select(A[p..r],i) looking for ith o.s. if p = r return A[p] q <- Randomized-Partition(A,p,r) k <- q-p+1 the size of the left partition if i=k then the pivot value is the answer return A[q] else if i < k then the answer is in the front return Randomized-Select(A,p,q-1,i) else then the answer is in the back half return Randomized-Select(A,q+1,r,i-k) 6 Randomized Selection • Analyzing RandomizedSelect() – Worst case: partition always 0:n-1 T(n) = T(n-1) + O(n) = O(n2) • No better than sorting! – “Best” case: suppose a 9:1 partition T(n) = T(9n/10)
    [Show full text]
  • Exponential Families and Theoretical Inference
    EXPONENTIAL FAMILIES AND THEORETICAL INFERENCE Bent Jørgensen Rodrigo Labouriau August, 2012 ii Contents Preface vii Preface to the Portuguese edition ix 1 Exponential families 1 1.1 Definitions . 1 1.2 Analytical properties of the Laplace transform . 11 1.3 Estimation in regular exponential families . 14 1.4 Marginal and conditional distributions . 17 1.5 Parametrizations . 20 1.6 The multivariate normal distribution . 22 1.7 Asymptotic theory . 23 1.7.1 Estimation . 25 1.7.2 Hypothesis testing . 30 1.8 Problems . 36 2 Sufficiency and ancillarity 47 2.1 Sufficiency . 47 2.1.1 Three lemmas . 48 2.1.2 Definitions . 49 2.1.3 The case of equivalent measures . 50 2.1.4 The general case . 53 2.1.5 Completeness . 56 2.1.6 A result on separable σ-algebras . 59 2.1.7 Sufficiency of the likelihood function . 60 2.1.8 Sufficiency and exponential families . 62 2.2 Ancillarity . 63 2.2.1 Definitions . 63 2.2.2 Basu's Theorem . 65 2.3 First-order ancillarity . 67 2.3.1 Examples . 67 2.3.2 Main results . 69 iii iv CONTENTS 2.4 Problems . 71 3 Inferential separation 77 3.1 Introduction . 77 3.1.1 S-ancillarity . 81 3.1.2 The nonformation principle . 83 3.1.3 Discussion . 86 3.2 S-nonformation . 91 3.2.1 Definition . 91 3.2.2 S-nonformation in exponential families . 96 3.3 G-nonformation . 99 3.3.1 Transformation models . 99 3.3.2 Definition of G-nonformation . 103 3.3.3 Cox's proportional risks model .
    [Show full text]
  • Decomposing High-Order Statistics for Sensitivity Analysis
    Center for Turbulence Research 139 Annual Research Briefs 2014 Decomposing high-order statistics for sensitivity analysis By G. Geraci, P.M. Congedo† AND G. Iaccarino 1. Motivation and objectives Sensitivity analysis in the presence of uncertainties in operating conditions, material properties, and manufacturing tolerances poses a tremendous challenge to the scientific computing community. In particular, in realistic situations, the presence of a large number of uncertain inputs complicates the task of propagation and assessment of output un- certainties; many of the popular techniques, such as stochastic collocation or polynomial chaos, lead to exponentially increasing costs, thus making these methodologies unfeasible (Foo & Karniadakis 2010). Handling uncertain parameters becomes even more challeng- ing when robust design optimization is of interest (Kim et al. 2006; Eldred 2009). One of the alternative solutions for reducing the cost of the Uncertainty Quantification (UQ) methods is based on approaches attempting to identify the relative importance of the in- put uncertainties. In the literature, global sensitivity analysis (GSA) aims at quantifying how uncertainties in the input parameters of a model contribute to the uncertainties in its output (Borgonovo et al. 2003). Traditionally, GSA is performed using methods based on the decomposition of the output variance (Sobol 2001), i.e., ANalysis Of VAriance, ANOVA. The ANOVA approach involves splitting a multi-dimensional function into its contributions from different groups of dependent variables. The ANOVA-based analysis creates a hierarchy of dominant input parameters, for a given output, when variations are computed in terms of variance. A limitation of this approach is the fact that it is based on the variance since it might not be a sufficient indicator of the overall output variations.
    [Show full text]
  • Inference Procedures Based on Order Statistics
    INFERENCE PROCEDURES BASED ON ORDER STATISTICS DISSERTATION Presented in Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the Graduate School of The Ohio State University By Jesse C. Frey, M.S. * * * * * The Ohio State University 2005 Dissertation Committee: Approved by Prof. H. N. Nagaraja, Adviser Prof. Steven N. MacEachern Adviser ¨ ¨ Prof. Omer Ozturk¨ Graduate Program in Prof. Douglas A. Wolfe Statistics ABSTRACT In this dissertation, we develop several new inference procedures that are based on order statistics. Each procedure is motivated by a particular statistical problem. The first problem we consider is that of computing the probability that a fully- specified collection of independent random variables has a particular ordering. We derive an equal conditionals condition under which such probabilities can be computed exactly, and we also derive extrapolation algorithms that allow approximation and computation of such probabilities in more general settings. Romberg integration is one idea that is used. The second problem we address is that of producing optimal distribution-free confidence bands for a cumulative distribution function. We treat this problem both in the case of simple random sampling and in the more general case in which the sample consists of independent order statistics from the distribution of interest. The latter case includes ranked-set sampling. We propose a family of optimality criteria motivated by the idea that good confidence bands are narrow, and we develop theory that makes the identification and computation of optimal bands possible. The Brunn-Minkowski Inequality from the theory of convex bodies plays a key role in this work.
    [Show full text]
  • Speech Detection Using High Order Statistic (Skewness)
    Speech Detection Using High Order Statistic (Skewness) Juraj Kačur1, Matúš Jurečka2 1) Slovak University of Technology, Faculty of Electrical Engineering and Information Technology, Department of Telecommunications, Ilkovičová 3, Bratislava, Slovakia, e- mail: [email protected], phone: +421-2- 68279416 2) Slovak University of Technology, Faculty of Electrical Engineering and Information Technology, Department of Telecommunications, Ilkovičová 3, Bratislava, Slovakia, e- mail: [email protected] process. Another detection problem poses the Abstract speech itself, containing high energy vowels of In this article we discuses one of many various lengths as well as unvoiced consonants possible applications of high order statistic of low energy and higher frequency (HOS) to speech detection problem. As a components; even intervals of silence are speech feature we used skewness or third- regular parts of speech. Situation dramatically order cumulant with two zero lags in a simple deteriorates if there is some background noise voiced speech detection algorithm. We present and mixed up with useful signal. It is compared its properties with the energy important to stress that noises can have almost feature in symmetric noises, speech signals any spectral and time characteristic that makes and in various signal to noise ratios (SNR). their separation from speech sometime almost These results proofed skewness feature being impossible. much suitable than energy for detection The process of speech detection includes: purposes, given those environment settings. finding proper speech features distinguishing Furthermore, we executed detection accuracy speech from noise, evaluation of their tests, which showed skewness outperforming behaviour in the time and decision taking classical approach, especially in low SNRs’.
    [Show full text]
  • The Multivariate Normal Distribution
    The Multivariate Normal Distribution Why should we consider the multivariate normal distribution? It would seem that applied problems are so complex that it would only be interesting from a mathematical perspective. 1. It is mathematically tractable for a large number of problems, and, therefore, progress towards answers to statistical questions can be provided, even if only approximately so. 2. Because it is tractable for so many problems, it provides insight into techniques based upon other distributions or even non-parametric techniques. For this, it is often a benchmark against which other methods are judged. 3. For some problems it serves as a reasonable model of the data. In other instances, transfor- mations can be applied to the set of responses to have the set conform well to multivariate normality. 4. The sampling distribution of many (multivariate) statistics are normal, regardless of the parent distribution (Multivariate Central Limit Theorems). Thus, for large sample sizes, we may be able to make use of results from the multivariate normal distribution to answer our statistical questions, even when the parent distribution is not multivariate normal. Consider first the univariate normal distribution with parameters µ (the mean) and σ (the variance) for the random variable x, 2 1 − 1 (x−µ) f(x)=√ e 2 σ2 (1) 2πσ2 for −∞ <x<∞, −∞ <µ<∞,andσ2 > 0. Now rewrite the exponent (x − µ)2/σ2 using the linear algebra formulation of (x − µ)(σ2)−1(x − µ). This formulation matches that for the generalized or Mahalanobis squared distance (x − µ)Σ−1(x − µ), where both x and µ are vectors.
    [Show full text]
  • Algorithms Chapter 9 Medians and Order Statistics
    Algorithms Chapter 9 Medians and Order Statistics Assistant Professor: Ching‐Chi Lin 林清池 助理教授 [email protected] Department of Computer Science and Engineering National Taiwan Ocean University Outline ` Minimum and maximum ` Selection in expected linear time ` Selection in worst‐case linear time 2 Order statistics ` The ith order statistic of a set of n elements is the ith smallest element. ` The minimum is the first order statistic (i =1). ` The maximum is the nth order statistic (i = n). ` A median is the “halfway point” of the set. ` When n is odd, the median is unique, at i = (n + 1)/2. ` When n is even, there are two medians: ` The lower median: i = ⎣(n + 1)/2⎦, and ` The upper median: i = ⎡(n + 1)/2⎤. ` We mean lower median when we use the phrase “the median”. 3 The selection problem ` How can we find the ith order statistic of a set and what is the running time? ` Input: A set A of n (distinct) number and a number i, with 1 ≤ i ≤ n. ` Output: The element x ∈ A that is larger than exactly i–1 other elements of A. ` The selection problem can be solved in O(nlgn) time. ` Sort the numbers using an O(nlgn)‐time algorithm, such as heapsort or merge sort. ` Then return the ith element in the sorted array. ` Are there faster algorithms? ` An O(n)‐time algorithm would be presented in this chapter. 4 Finding minimum ` We can easily obtain an upper bound of n−1 comparisons for finding the minimum of a set of n elements.
    [Show full text]
  • Concomitants of Order Statistics Shie-Shien Yang Iowa State University
    Iowa State University Capstones, Theses and Retrospective Theses and Dissertations Dissertations 1976 Concomitants of order statistics Shie-Shien Yang Iowa State University Follow this and additional works at: https://lib.dr.iastate.edu/rtd Part of the Statistics and Probability Commons Recommended Citation Yang, Shie-Shien, "Concomitants of order statistics " (1976). Retrospective Theses and Dissertations. 5720. https://lib.dr.iastate.edu/rtd/5720 This Dissertation is brought to you for free and open access by the Iowa State University Capstones, Theses and Dissertations at Iowa State University Digital Repository. It has been accepted for inclusion in Retrospective Theses and Dissertations by an authorized administrator of Iowa State University Digital Repository. For more information, please contact [email protected]. INFORMATION TO USERS This material was produced from a microfilm copy of the original document. While the most advanced technological means to photograph and reproduce this document have been used, the quality is heavily dependent upon the quality of the original submitted. The following explanation of techniques is provided to help you understand markings or patterns which may appear on this reproduction. 1. The sign or "target" for pages apparently lacking from the document photographed is "Missing Page(s)". If it was possible to obtain the missing page(s) or section, they are spliced into the film along with adjacent pages. This may have necessitated cutting thru an image and duplicating adjacent pages to insure you complete continuity. 2. When an image on the film is obliterated with a large round black mark, it is an indication that the photographer suspected that the copy may have moved during exposure and thus cause a blurred image.
    [Show full text]
  • On Concomitants of Order Statistics
    ON CONCOMITANTS OF ORDER STATISTICS DISSERTATION Presented in Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the Graduate School of The Ohio State University By Ke Wang, M.S. ***** The Ohio State University 2008 Dissertation Committee: Approved by H. N. Nagaraja, Adviser Douglas Wolfe Adviser Shi Tao Graduate Program in Statistics °c Copyright by Ke Wang 2008 ABSTRACT Let (Xi;Yi); 1 · i · n, be a sample of size n from an absolutely continuous random vector (X; Y ). Let Xi:n be the ith order statistic of the X-sample and Y[i:n] be its concomi- tant. We study three problems related to the Y[i:n]’s in this dissertation. The first problem is about the distribution of concomitants of order statistics (COS) in dependent samples. We derive the finite-sample and asymptotic distribution of COS under a specific setting of dependent samples where the X’s form an equally correlated multivariate normal sample. This work extends the available results on the distribution theory of COS in the literature, which usually assumes independent and identically distributed (i.i.d) or independent sam- ples. The second problem we examine is about the distribution of order statistics of subsets of concomitants from i.i.d samples. Specifically, we study the finite-sample and asymptotic distributions of Vs:m and Wt:n¡m, where Vs:m is the sth order statistic of the concomitants subset fY[i:n]; i = n ¡ m + 1; : : : ; ng, and Wt:n¡m is the tth order statistic of the concomi- tants subset fY[j:n]; j = 1; : : : ; n ¡ mg.
    [Show full text]
  • On the Student's T-Distribution and the T-Statistic
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Elsevier - Publisher Connector Journal of Multivariate Analysis 98 (2007) 1293–1304 www.elsevier.com/locate/jmva On the Student’s t-distribution and the t-statistic Zhenhai Yanga,1, Kai-Tai Fangb,∗, Samuel Kotzc aCollege of Applied Sciences, Beijing University of Technology, Beijing 10002, China bBNU-HKBU United International College, Zhuhai Campus of Beijing Normal University, Jinfenf Road, Zhuhai 519085, China cDepartment of Engineering Management, George Washington University, USA Received 26 September 2005 Available online 22 February 2007 Abstract In this paper we provide rather weak conditions on a distribution which would guarantee that the t-statistic of a random vector of order n follows the t-distribution with n − 1 degrees of freedom. The results sharpen the earlier conclusions of Mauldon [Characterizing properties of statistical distributions, Quart. J. Math. 2(7) (1956) 155–160] and the more recent advances due to Bondesson [When is the t-statistic t-distributed, Sankhy¯a, Ser. A 45 (1983) 338–345]. The basic tool involved in the derivations is the vertical density repre- sentation originally suggested by Troutt [A theorem on the density of the density ordinate and an alternative interpretation of the Box–Muller method, Statistics 22(3) (1991) 463–466; Vertical density representation and a further remark on the Box–Muller method, Statistics 24 (1993) 81–83]. Several illustrative examples are presented. © 2006 Elsevier Inc. All rights reserved. AMS 1991 subject classification: 62E10; 62E15 1. Introduction Let X1,...,Xn be a random sample from a cumulative distribution function (cdf) F(·) with mean zero and let √ ¯ nXn Tn = T(Xn) = , (1) sn ∗ Corresponding author.
    [Show full text]