STAT 6201 - Mathematical

: Chapter 3 Random variables .

5 Event Prc . ) , , Random variables and distributions Let S be the associated with a . Assume that we have defined the events of interest and a probability assignment for each event.

A is a real-valued that is defined on the sample space S. Examples:

I X = number of H in 10 tosses is a random variable; I Y = 10 X = number of T in 10 tosses is a random variable; I T = the temperature in this room; I Z = the price of Apple, Inc. stock tomorrow; I etc.

The value of a random variable is not known before performing the probability experiment ! of values for a random variable

I While we don’t know the value of a random variable ahead of time (before performing the experiment), we can (in most cases) list the possible range of values for a random variable.

Examples :

I X = number of H in 10 tosses is a random variable: X 0, 1, 2,...,10 2 { } I Y = 10 X = number of T in 10 tosses is a random variable Y 0,1, 2,...,10 2 { } I N = number of coin flips until H is observed: N 1, 2, 3,... 2 { } I T = the temperature in this room; T [20.0, 90.0] 2 I Z = the price of Apple, Inc. stock tomorrow Z [0.0, ) 2 1 Discrete vs. conitnuous random variables

I A random variable X is called a discrete if X can take only a finite or countable set of values

X x , x ,...,x or X x , x , x ,... 2 { 1 2 n} 2 { 1 2 3 }

I A random variable X is called continuous if it takes values in a subinterval of the real line, or the entire real line.

X [a, b]orX (a, )orX R 2 2 1 2

a XE too , ] XE ( , a) Examples Classify the following variables as discrete or continuous:

I X = number of H in 10 tosses is a random variable: X 0, 1, 2,...,10 discrete 2 { } I Y = 10 X = number of T in 10 tosses is a random variable Y 0,1, 2,...,10 discrete 2 { } I N = number of coin flips until H is observed:

N 1, 2, 3,... discrete . 2 { } I T = the temperature in this room; T [20.0, 90.0] 2 I Z = the price of Apple, Inc. stock tomorrow Z [0.0, )

2 1 s:. Discrete random variables and their distributions Recall that a random variable X is called discrete if the range of possible values is finite or countably infinite. Without loss of generality, we will assume that X x , x , x ,... 2 { 1 2 3 }

Since we can’t know the value of X before performing the experiment, we characterize X by describing how likely each value is. That is, for each value xi in the range of X ,wedefine

. . it . f (xi )=Pr(X = xi ) , 2,3 ,

which is the probability that X will take on the value xi . The collection of

f (x1), f (x2), f (x3),...

define the probability mass function (pmf) of X and they describe the distribution of X. Example Toss a coin three times and let X be the number of H observed. Find the probability mass function (pmf) of X .

- 3 XELO , 1,2 , } " " 4 K 22 3 ,

b % % 18 Ho )=Pr(X=o ) = f ⇐

f4)=Pr(x=D = § fH=Pr(X=y= f fbtprlx =D = ft Example Roll two dice and let X be the sum of the two numbers. Find the pmf of X .

. . XER , 3,4 , , ,l2 } fH=Pr(X=2)=3t 436256 #. " .fB)=Pr(X=D=}z

fl4I=PrlX=4)= ... until observe H flip a coin you

= coin . N # of Clips Find the pmf . of N

Nell , 2,3 , . ... } f(D=Pr(N=D= E

fH=Pr( Not =L . I = at

9 %D= Pr(N=2o)=#' . }

: i w1=Pr(N=w)=#n Properties of the pmf

Let X be a discrete random variable X x1, x2, x3,... with probability mass function 2 { } f (x1), f (x2), f (x3),...

The numbers f (xi ), i =1, 2,... must satisfy the following properties

I f (x ) 0; i 1 I f (x )+f (x )+f (x )+ = f (x )=1 1 2 3 ··· i Xi=1 Oefki ) < 1 Major discrete distributions Bernoulli distribution A discrete random variable X has a if it can only take two possible values, sometimes X 0, 1 2 { } " " 1 = success " ' ' 0 = failure The pmf of a Bernoulli random variable is

f (0) = Pr(X = 0) f (1) = Pr(X = 1)

Convention: f (1) = Pr(X = 1) = p thus f (0) = Pr(X = 0) = 1 p. Notation X Bernoulli(p). ⇠ Consider an experiment whose outcome can be either success or failure. Assume that Pr(success) = p on each trial. Repeat this experiment n times. Examples:

I Flip a coin 10 times, think of H as success and T as failure on each trial; I Observe 20 items coming out of a production line and record whether they are defective or not. I Perform a and record whether a patient recovers from her symptoms or not.

A random variable X has a Binomial distribution if it describes the total number of successes in n independent and identical trials.

X Binomial(n, p) ⇠ Binomial distribution Repeat the same trial n times and let p be the probability of success on any given trial. Let X denote the total number of successes in n trials. We say that X Binomial(n, p) ( X has a Binomial distribution with n, p).⇠

Note that X 0, 1, 2, 3,...,n 1, n 2 { } What is the probability mass function (pmf) of X ? flu --Pr(X=o)=kpT

ftp.prl#D=wp(rpymfH=Pr(Xz2)=(Y)p2ltpT2

" Ye k=o 1,2 ... flk)=Pr(X=k)=( )p4rA , , ,w Binomial distribution X Binomial(n, p) then ⇠ X 0, 1, 2,...,n 2 { } and X has probability mass function

n i n i f (i)=Pr(X = i)= p (1 p) i =0, 1, 2,...,n i ✓ ◆ Binomial distribution Connection to the Bernoulli(p) distribution:

Let p (0, 1) and consider n random variables X1, X2,...,Xn which are independent2 and identically distributed (iid) random variables with

X Bernoulli(p) i ⇠

Then Y = X + X + + X 1 2 ··· n counts the number of “successes” among the n variates X1, X2,...,Xn. Thus, Y Binomial(n, p) ⇠ Exercise Suppose that a random variable X has the Binomial distribution with parameters n = 15 and p =0.5.FindPr(X < 6).

. . 15 . XELO ,1 , , ) flitprlxai )

.fi?)piCi.pj5iPr(xc6)=Pr(X=o)tMX=Dt...tprlx=5)=lYHsilD'stCi9tHl.H4t..

. Exercise Suppose that a random variable X has the Binomial distribution with parameters n =8and p =0.7.FindPr(X 5).

exercise