DOCSLIB.ORG

Math 141 Lecture 3: the Binomial Distribution

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Math 141 Lecture 3: the Binomial Distribution Coin Tossing The General Case Math 141 Lecture 3: The Binomial Distribution Albyn Jones1 1Library 304 [email protected] www.people.reed.edu/∼jones/courses/141 Albyn Jones Math 141 Coin Tossing The General Case Outline Coin Tosses The General Case Albyn Jones Math 141 Coin Tossing The General Case Independent Coin Tosses Crucial Features Dichotomous Trials: Each toss results in either Heads, H, or Tails T . Independence: Successive tosses are independent; knowing we got H on the first toss does not help us predict the outcome of the second toss. Constant probability: Each trial has the same probability P(H) = 1=2 = P(T ) (a ‘fair coin’). Albyn Jones Math 141 Coin Tossing The General Case Examples of Different Experiments Binomial: Count the number of Heads in a fixed number of tosses. Geometric: Count the number of Tails before the first Head. Negative Binomial: Count the number of Tails before before the k-th Head. Albyn Jones Math 141 Coin Tossing The General Case Random Variables Random Variable: A random variable is a function mapping points in the sample space to R, the real numbers. Example: Let X be the number of Heads in 3 independent tosses of a fair coin. Albyn Jones Math 141 Coin Tossing The General Case A Binomial Random Variable Toss a fair coin 3 times, count the number of Heads. Let X be the number of Heads. What are the possible outcomes? fHHHg 7! X = 3 fHHT g [ fHTHg [ fTHHg 7! X = 2 fHTT g [ fTHT g [ fTTHg 7! X = 1 fTTT g 7! X = 0 Albyn Jones Math 141 Coin Tossing The General Case Probabilities Thus we can compute probabilities for the random variable (RV) X is we can compute probabilities of events in the original sample space. P(X = 3) = P(fHHHg) P(X = 2) = P(fHHT g [ fHTHg [ fTHHg) P(X = 1) = P(fHTT g [ fTHT g [ fTTHg) P(X = 0) = P(fTTT g) Albyn Jones Math 141 Coin Tossing The General Case Probabilities Successive tosses are independent, so 13 (X = 3) = (fHHHg) = (H) (H) (H) = P P P P P 2 and 13 (X = 0) = (fTTT g) = (T ) (T ) (T ) = P P P P P 2 In fact, the probability of any sequence of 3 tosses is the same, for example 13 (fHHT g) = (H) (H) (T ) = P P P P 2 Albyn Jones Math 141 Coin Tossing The General Case More Probabilities Since probabilities of unions of disjoint events add, we just have to count the number of sequences of three tosses with 2 Heads to get P(X = 2): P(X = 2) = P(fHHT g [ fHTHg [ fTHHg) = P(fHHT g) + P(fHTHg) + P(fTHHg) Again, due to independence, the order of getting the two Heads and one Tail doesn’t matter, so 13 (fHHT g) = (fHTHg) = (fTHHg) = P P P 2 Thus 13 3 (X = 2) = 3 = P 2 8 Albyn Jones Math 141 Coin Tossing The General Case Finally: Probabilities for 3 tosses 13 1 (X = 3) = 1 = P 2 8 13 3 (X = 2) = 3 = P 2 8 13 3 (X = 1) = 3 = P 2 8 13 1 (X = 0) = 1 = P 2 8 Note: P(X = 0) + P(X = 1) + P(X = 2) + P(X = 3) = 1 Albyn Jones Math 141 Coin Tossing The General Case X ∼ Binomial(n; 1=2) Count Heads in n independent tosses of a fair coin As with 3 independent tosses, any sequence of n independent tosses of a fair coin has the same probability. Example: for 8 tosses, 18 (HHHHTTTT ) = (HTHTHTHT ) = (TTTTTTHH) = P P P 2 The point: to compute P(X = k) we have to count the number of sequences of n symbols fH; T g with k H’s, and thus (n − k) T ’s, then multiply by the probability of any sequence of n tosses. Albyn Jones Math 141 Coin Tossing The General Case Counting Things: Permutations How many ways are there to rearrange the numbers 1; 2; 3; 4? We could list them all, with some effort: f1; 2; 3; 4g; f2; 1; 3; 4g; f3; 1; 2; 4g; f4; 1; 2; 3g;::: We could be clever: There are 4 choices for the first position. After choosing the first, there remain 3 choices for the second position. After choosing the first and second positions, there are 2 possibilities for the third, and only 1 for the fourth. 4 · 3 · 2 · 1 = 4! = 24 Albyn Jones Math 141 Coin Tossing The General Case Permutations of n objects How many ways are there to rearrange the numbers 1; 2; 3;:::; n? There are n choices for the first position. After choosing the first, there remain (n − 1) choices for the second position. After choosing the first and second positions, there are (n − 2) possibilities for the third, and so forth. n · (n − 1) · (n − 2) ::: · 1 = n! n! gets big quickly: 10! = 3628800. Albyn Jones Math 141 Coin Tossing The General Case Example: Permutations of 4 objects Each row lists permuations beginning with the same object, grouped by the choices for the second object: 1234 1243 1324 1342 1423 1432 2134 2134 2314 2341 2413 2431 3124 3142 3214 3241 3412 3421 4123 4123 4213 4231 4312 4321 Albyn Jones Math 141 Coin Tossing The General Case Practice with Factorials What is 1! ? What is 2! ? What is 3! ? What is 0! ? Albyn Jones Math 141 Coin Tossing The General Case A Formal definition for Factorials The standard recursive definition is 0! = 1 For n > 0 2 Z, n! = n · (n − 1)! It is useful to remember this recursive definition! For example it makes obvious the relation n! = (n − 1)! n Albyn Jones Math 141 Coin Tossing The General Case Combinations How many ways are there to rearrange the 5 symbols H; H; H; T ; T , that is three Heads and two Tails? Label them uniquely: H1; H2; H3; T4; T5 We have 5 objects, there are 5! orders. Some of those orders are redundant: fH1; H2; H3; T4; T5g is indistinguishable from fH3; H2; H1; T5; T4g or fH3; H1; H2; T4; T5g. Divide out the number of indistinguishable (or equivalent) patterns of 3 Heads, i.e. 3!, and 2 Tails, i.e. 2!. Answer: 5! 5 · 4 · 3! 5 · 4 = = = 10 3! · 2! 3! · 2! 2 · 1 Albyn Jones Math 141 Coin Tossing The General Case Example: 4 Coin Tosses 4 4 HHHH 4 4 3 HHHT ; HHTH; HTHH; THHH 3 4 2 HHTT ; HTHT ; THHT ; TTHH; THTH; HTTH 2 4 1 TTTH; TTHT ; THTT ; HTTT 1 4 0 TTTT 0 Albyn Jones Math 141 Coin Tossing The General Case Sequences of k Heads in n tosses For 3 H and 2 T the number of possible orders was 5! 3! · 2! For k H and (n − k) T in n tosses the number of possible orders will be‘ n choose k’: the number of ways to select k objects out of a set of size n. n n! = k k! · (n − k)! Note: n n! n = = n − k (n − k)! · k! k Albyn Jones Math 141 Coin Tossing The General Case Practice with Binomial Coefficients What is each of the following? n 0 n n n 1 n n − 1 n 2 Albyn Jones Math 141 Coin Tossing The General Case The General Case In general, we might be working with dichotomous trials where the event of interest has probability p, possibly not 1=2. Most of what we have learned about coin-tossing carries over to the general case. Albyn Jones Math 141 Coin Tossing The General Case The Binomial Distribution X ∼ Binomial(n; p) Dichotomous Trials: Each trial results in either a ‘Success’, S, or a ‘Failure’ F. Independence: Trials are mutually independent; knowing we got S on one trial does not help us predict the outcome of any other trial. Constant probability: Each trial has the same probability P(S) = p, and P(F) = 1 − p. X counts the number of S’s. n the number of trials is fixed. Albyn Jones Math 141 Coin Tossing The General Case Binomial(n; p) Probabilities Independence: Every sequence of n trials with k successes has the same probability! P(SSF) = P(S)P(S)P(F) = P(F)P(S)P(S) = P(FSS) Let p = P(S) and q = 1 − p = P(F), then for a RV X ∼ Binomial(n; p) n (X = k) = pk qn−k P k n Again, k counts the number of sequences of length n with k successes. Albyn Jones Math 141 Coin Tossing The General Case Example Suppose we roll a fair die 5 times. What is the probability we get no ones? What Binomial distribution should we use? Let S be the event we roll a 1. If the die is fair, p = P(S) = 1=6. n = 5, as there are 5 trials. Let X be the number of 1’s we get in the 5 rolls. Then 1 X ∼ Binomial(5; ) 6 Thus 5 10 55 3125 (X = 0) = = 1 · 1 · ∼ 0:402 P 0 6 6 7776 Albyn Jones Math 141 Coin Tossing The General Case Binomial(10,1=2) 0.20 0.15 0.10 0.05 0.00 0 1 2 3 4 5 6 7 8 9 10 Albyn Jones Math 141 Coin Tossing The General Case Binomial(10,1=5) 0.30 0.25 0.20 0.15 0.10 0.05 0.00 0 1 2 3 4 5 6 7 8 9 10 Albyn Jones Math 141 Coin Tossing The General Case Sums of Binomial RV’s Suppose that X ∼ Binomial(n; p) and Y ∼ Binomial(m; p) are independent Binomial RV’s with the same probability p.
Load more

Recommended publications
  • Notes on Elementary Martingale Theory 1 Conditional Expectations
    . Notes on Elementary Martingale Theory by John B. Walsh 1 Conditional Expectations 1.1 Motivation Probability is a measure of ignorance. When new information decreases that ignorance, it changes our probabilities. Suppose we roll a pair of dice, but don't look immediately at the outcome. The result is there for anyone to see, but if we haven't yet looked, as far as we are concerned, the probability that a two (\snake eyes") is showing is the same as it was before we rolled the dice, 1/36. Now suppose that we happen to see that one of the two dice shows a one, but we do not see the second. We reason that we have rolled a two if|and only if|the unseen die is a one. This has probability 1/6. The extra information has changed the probability that our roll is a two from 1/36 to 1/6. It has given us a new probability, which we call a conditional probability. In general, if A and B are events, we say the conditional probability that B occurs given that A occurs is the conditional probability of B given A. This is given by the well-known formula P A B (1) P B A = f \ g; f j g P A f g providing P A > 0. (Just to keep ourselves out of trouble if we need to apply this to a set f g of probability zero, we make the convention that P B A = 0 if P A = 0.) Conditional probabilities are familiar, but that doesn't stop themf fromj g giving risef tog many of the most puzzling paradoxes in probability.
    [Show full text]
  • Random Variables and Expectations 2 1.1 Randomvariables
    Contents 1 Random Variables and Expectations 2 1.1 RandomVariables ............................ 2 1.1.1 Joint and Conditional Probability for Random Variables . 3 1.1.2 Just a Little Continuous Probability . 6 1.1.3 ExpectationsandExpectedValues . 8 1.1.4 Expectations for Continuous Random Variables . 9 1.1.5 Mean,VarianceandCovariance. 10 1.1.6 Expectations from Simulation . 14 1.2 Some Probability Distributions . 16 1.2.1 The Geometric Distribution . 16 1.2.2 The Binomial Probability Distribution . 19 1.2.3 Multinomial probabilities . 21 1.2.4 The Discrete Uniform Distribution . 22 1.2.5 The Poisson Distribution . 23 1.2.6 The Continuous Uniform Distribution . 24 1.3 TheNormalDistribution. .. .. .. .. .. .. .. .. .. .. 24 1.4 UsingExpectations............................ 27 1.4.1 Shouldyouacceptthebet? . 27 1.4.2 Odds and bookmaking — a cultural diversion . 29 1.4.3 Endingagameearly....................... 30 1.4.4 Making a Decision . 30 1.4.5 Two Inequalities . 32 1.5 Appendix: The normal distribution from Stirling’s approximation . 35 1 CHAPTER 1 Random Variables and Expectations 1.1 RANDOM VARIABLES Quite commonly, we would like to deal with numbers that are random. We can do so by linking numbers to the outcome of an experiment. We define a random variable: Definition: Discrete random variable Given a sample space Ω, a set of events , and a probability function P , and a countable set of of real numbers D, a discreteF random variable is a function with domain Ω and range D. This means that for any outcome ω there is a number X(ω). P will play an important role, but first we give some examples.
    [Show full text]
  • CONDITIONAL EXPECTATION and MARTINGALES 1.1. Definition of A
    CONDITIONAL EXPECTATION AND MARTINGALES 1. DISCRETE-TIME MARTINGALES 1.1. Definition of a Martingale. Let {Fn}n 0 be an increasing sequence of σ algebras in a ¸ ¡ probability space (­,F ,P). Such a sequence will be called a filtration. Let X0, X1,... be an adapted sequence of integrable real-valued random variables, that is, a sequence with the prop- erty that for each n the random variable X is measurable relative to F and such that E X n n j nj Ç . The sequence X0, X1,... is said to be a martingale relative to the filtration {Fn}n 0 if it is 1 ¸ adapted and if for every n, (1) E(Xn 1 Fn) Xn. Å j Æ Similarly, it is said to be a supermartingale (respectively, submartingale) if for every n, (2) E(Xn 1 Fn) ( )Xn. Å j · ¸ Observe that any martingale is automatically both a submartingale and a supermartingale. 1.2. Martingales and Martingale Difference Sequences. The most basic examples of martin- gales are sums of independent, mean zero random variables. Let Y0,Y1,... be such a sequence; then the sequence of partial sums n X (3) Xn Y j Æ j 1 Æ is a martingale relative to the natural filtration generated by the variables Yn. This is easily verified, using the linearity and stability properties and the independence law for conditional expectation: E(Xn 1 Fn) E(Xn Yn 1 Fn) Å j Æ Å Å j E(Xn Fn) E(Yn 1 Fn) Æ j Å Å j Xn EYn 1 Æ Å Å X .
    [Show full text]
  • Conditional Expectation and Martingales
    CONDITIONAL EXPECTATION AND MARTINGALES 1. INTRODUCTION Martingales play a role in stochastic processes roughly similar to that played by conserved quantities in dynamical systems. Unlike a conserved quantity in dynamics, which remains constant in time, a martingale’s value can change; however, its expectation remains constant in time. More important, the expectation of a martingale is unaffected by optional sampling. In fact, this can be used as a provisional definition: A discrete-timemartingale is a sequence {Xn}n 0 of integrable real (or complex) random variables with the property that for every bounded ¸ stopping time ¿, the Optional Sampling Formula (1) EX EX ¿ Æ 0 is valid. We have seen the Optional Sampling Formula before, in various guises. In particular, the Wald Identities I,II, and III are all instances of (1). Let »0,»1,... be independent, identically distributed random variables, and let Sn »1 »2 »n be the nth partial sum. Denote by 2 Æ Å Å ¢¢¢ ¹,σ , and '(θ) the mean, variance, and moment generating function of »1, that is, ¹ E» , Æ 1 σ2 E(» ¹)2, and Æ 1 ¡ '(θ) E exp{θ» }. Æ 1 Corresponding to each of these scalar quantities is a martingale: M : S n¹,(2) n Æ n ¡ V : (S n¹)2 nσ2, and(3) n Æ n ¡ ¡ Z (θ): exp{θS }/'(θ)n.(4) n Æ n Observe that there is a separate martingale Z (θ) for every real value of θ such that '(θ) . n Ç 1 The Optional Sampling Formula could be taken as the definition of a martingale, but usually isn’t.
    [Show full text]
  • Probability Theory 1 Sample Spaces and Events
    18.310 lecture notes February 10, 2015 Probability Theory Lecturer: Michel Goemans These notes cover the basic definitions of discrete probability theory, and then present some results including Bayes' rule, inclusion-exclusion formula, Chebyshev's inequality, and the weak law of large numbers. 1 Sample spaces and events To treat probability rigorously, we define a sample space S whose elements are the possible outcomes of some process or experiment. For example, the sample space might be the outcomes of the roll of a die, or flips of a coin. To each element x of the sample space, we assign a probability, which will be a non-negative number between 0 and 1, which we will denote by p(x). We require that X p(x) = 1; x2S so the total probability of the elements of our sample space is 1. What this means intuitively is that when we perform our process, exactly one of the things in our sample space will happen. Example. The sample space could be S = a; b; c , and the probabilities could be p(a) = 1=2, p(b) = 1=3, p(c) = 1=6. f g If all elements of our sample space have equal probabilities, we call this the uniform probability distribution on our sample space. For example, if our sample space was the outcomes of a die roll, the sample space could be denoted S = x1; x2; : : : ; x6 , where the event xi correspond to rolling i. f g The uniform distribution, in which every outcome xi has probability 1/6 describes the situation for a fair die.
    [Show full text]
  • A Martingale Approach to the Study of Occurrence of Sequence Patterns in Repeated Experiments Author(S): Shuo-Yen Robert Li Source: the Annals of Probability, Vol
    A Martingale Approach to the Study of Occurrence of Sequence Patterns in Repeated Experiments Author(s): Shuo-Yen Robert Li Source: The Annals of Probability, Vol. 8, No. 6 (Dec., 1980), pp. 1171-1176 Published by: Institute of Mathematical Statistics Stable URL: https://www.jstor.org/stable/2243018 Accessed: 28-03-2019 19:59 UTC JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about JSTOR, please contact [email protected]. Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at https://about.jstor.org/terms Institute of Mathematical Statistics is collaborating with JSTOR to digitize, preserve and extend access to The Annals of Probability This content downloaded from 137.99.108.192 on Thu, 28 Mar 2019 19:59:53 UTC All use subject to https://about.jstor.org/terms The Annals of Probability 1980, Vol. 8, No. 6, 1171-1176 A MARTINGALE APPROACH TO THE STUDY OF OCCURRENCE OF SEQUENCE PATTERNS IN REPEATED EXPERIMENTS1 BY SHUO-YEN ROBERT Li University of Illinois at Chicago We apply the concept of stopping times of martingales to problems in classical probability theory regarding the occurrence of sequence patterns in repeated experiments. For every finite collection of sequences of possible out- comes, we compute the expected waiting time till one of them is observed in a run of experiments.
    [Show full text]
  • Discrete Probability [Sp’17]
    Algorithms Lecture 1: Discrete Probability [Sp’17] The first lot fell to Jehoiarib, the second to Jedaiah, the third to Harim, the fourth to Seorim, the fifth to Malkijah, the sixth to Mijamin, the seventh to Hakkoz, the eighth to Abijah, the ninth to Jeshua, the tenth to Shekaniah, the eleventh to Eliashib, the twelfth to Jakim, the thirteenth to Huppah, the fourteenth to Jeshebeab, the fifteenth to Bilgah, the sixteenth to Immer, the seventeenth to Hezir, the eighteenth to Happizzez, the nineteenth to Pethahiah, the twentieth to Jehezkel, the twenty-first to Jakin, the twenty-second to Gamul, the twenty-third to Delaiah, and the twenty-fourth to Maaziah. This was their appointed order of ministering when they entered the temple of the LORD, according to the regulations prescribed for them by their ancestor Aaron, as the LORD, the God of Israel, had commanded him. — 1 Chronicles 24:7–19 (New International Version) The ring worm is not ringed, nor is it worm. It is a fungus. The puff adder is not a puff, nor can it add. It is a snake. The funny bone is not funny, nor is it a bone. It is a nerve. The fishstick is not a fish, nor is it a stick. It is a fungus. — Matt Groening, “Life in Hell” (1986) This is in accordance with the principle that in mathematics, a red herring does not have to be either red or a herring. — Morris W. Hirsch, Differential Topology (1976) 1 Discrete Probability Before I start discussing randomized algorithms at all, I need to give a quick formal overview of the relatively small subset of probability theory that we will actually use.
    [Show full text]
  • Martingales 1 Background
    Martingales The unit will cover topics related to martingale convergence, possibly including materials on uniformly integrable martingales, and will be mostly restricted to discrete-time martingales. Chapters 3-4 are partially based on an earlier set of notes on martingales by Stas Volkov. 1 Background 1.1 Probability Theory Background Recall: Definition 1 A probability space is a triple (Ω; F; P). Ω is the sample space, i.e. the set of all possible outcomes. F is a σ-field (also called σ-algebra), defined to satisfy these axioms: 1. ; 2 F; S1 2. if A1;A2;::: 2 F, then i=1 Ai 2 F; 3. if A 2 F, then Ac 2 F. The σ-field F consists of events whose probabilities we may want to calculate. These events (sets) are said to be F-measurable (or simply measurable if it is clear what the underlying σ-field is). Note that by definition, an event is measurable, but sometimes we use the term \measurable event" to emphasize this fact. In particular, ; 2 F is known as the impossible event, Ω 2 F is known as the certain event, and intersections of events are also events. We require infinite unions of measurable sets to be measurable, because not requiring this will make life difficult if Ω is infinite, e.g. [0; 1] or R. Examples of sample spaces • toss a coin once or twice: fH; T g • toss a coin until a head turns up: f!1;!2;:::g. May wish to study the probability of requiring an even number of tries • choose a number uniformly in [0; 1] Examples of σ-fields • f;; Ωg: absolutely useless • f;; A; Ac; Ωg: smallest σ-field containing fAg • f0; 1gΩ (power set of Ω, i.e.
    [Show full text]
  • The Simple Random Walk
    Chapter 8 The Simple Random Walk In this chapter we consider a classic and fundamental problem in random processes; the simple random walk in one dimension. Suppose a ‘walker’ chooses a starting point on a line (one-dimensional motion) and then decides to take one step right or left at random, dependent on the toss of a coin. If the coin is HEADS, they move right, if it comes up TAILS then the move is to the left. The second step proceeds in the same manner, and so on for each subsequent step. Then the position of the walker at any time is uncertain (random), although the location at future times will be determined by a probability distribution. We contrast this with a deterministic walk, for example, in which a walker takes steps in a fixed direction (left or right) at a uniform pace. In such a case, the position of the walker at any future time is completely predictable. The random walk is called ‘simple’ if each and every step has the same length. Consider an example, in which the length of the step is one unit, and the walker starts at the location x = 5. Suppose that we use a fair coin so that the probability of heads or tails is the same. Then the position of the walker, according to the number of steps taken (that is as time progresses) will trace out a path. An example of such a process is shown in figure 8.1. We note that such a graph of position versus time is equivalent to recording the sequence of outcomes.
    [Show full text]
  • Probabilities and Random Variables
    Chapter 1 Probabilities and random variables Probability theory is a systematic method for describing randomness and uncertainty. It prescribes a set of mathematical rules for manipulat- ing and calculating probabilities and expectations. It has been applied in many areas: gambling, insurance, finance, the study of experimental error, statistical inference, and more. One standard approach to probability theory (but not the only approach) starts from the concept of a sample space, which is an exhaustive list of possible outcomes in an experiment or other situation where the result is uncertain. Subsets of the list are called events. For example, in the very simple situation where 3 coins are tossed, the sample space might be S = fhhh; hht; hth; htt; thh; tht; tth; tttg: There is an event corresponding to \the second coin landed heads", namely, fhhh; hht; thh; thtg: Each element in the sample space corresponds to a uniquely specified out- come. Notice that S contains nothing that would specify an outcome like \the second coin spun 17 times, was in the air for 3.26 seconds, rolled 23.7 inches when it landed, then ended with heads facing up". If we wish to contemplate such events we need a more intricate sample space S. Indeed, the choice of S|the detail with which possible outcomes are described|depends on the sort of events we wish to describe. In general, a sample space can make it easier to think precisely about events, but it is not always essential. It often suffices to manipulate events via a small number of rules (to be specified soon) without explicitly identi- fying the events with subsets of a sample space.
    [Show full text]
  • Lecture 16: Simple Random Walk
    Department of Mathematics Ma 3/103 KC Border Introduction to Probability and Statistics Winter 2017 Lecture 16: Simple Random Walk In 1950 William Feller published An Introduction to Probability Theory and Its Applications [10]. According to Feller [11, p. vii], at the time “few mathematicians outside the Soviet Union recognized probability as a legitimate branch of mathemat- ics.” In 1957, he published a second edition, “which was in fact motivated principally by the unexpected discovery that [Chapter III’s] enticing material could be treated by elementary methods.” Here is an elementary treatment of some of these fun and possibly counterintuitive facts about random walks, the subject of Chapter III. It is based primarily on Feller [11, Chapter 3] and [12, Chapter 12], but I have tried to make it even easier to follow. 16.1 ⋆ What is the simple random walk? Let X1,...,Xt,... be a sequence of independent Rademacher random variables, { 1 with probability 1/2 Xt = −1 with probability 1/2 so E Xt = 0, and Var Xt = 1 (t = 1, 2,... ) (Imagine a game played between Hetty and Taylor, in which a fair coin is tossed repeatedly. When Heads occurs, Hetty wins a dollar from Taylor, and when Tails occurs Taylor wins a dollar th from Hetty. Then Xt is the change in Hetty’s net winnings on the t coin toss.) The index t indicates a point in time. Feller uses the term epoch to denote a particular moment t, and reserves the use of the word “time” to refer to a duration or interval of time, rather than a point in time, and I shall adhere to his convention.
    [Show full text]