Short recap: σ-algebras generated by maps
1) Let (X, A) and (Y, B) be measurable spaces and f : X → Y be a map. Then we define the pull back σ-algebra as f −1(B) := {f −1(B): B ∈ B} This is the smallest σ-algebra on X such that f is measurable. In particular, f is (A, B)- measurable if and only if f −1(B) ⊆ A.
2) If (fi)i∈I is a family of maps fi : X → Yi, then
[ −1 σ(fi, i ∈ I) := σ fi (Bi) i∈I
S −1 is the σ-algebra generated by (fi)i∈I . Please note that i∈I fi (Bi) is not a σ-algebra in general, and as in 1) we can easily prove that σ(fi, i ∈ I) is the smallest σ-algebra on X such that all fi are measurable.
Exercise 4 (σ(X)-measurable random variables) . Let (Ω, A) be a measurable space.
a) Let a1, . . . , an ∈ R be pairwise distinct and A1,...,An ∈ A be pairwise disjoint with Sn Pn 1 Ω = j=1 Aj. Let X := j=1 aj Aj and σ(X) be the σ-algebra generated by X. i) Determine σ(X). ii) Let Y be a σ(X)-measurable random variable. Show that Y is constant on each set Aj, j = 1, . . . , n. iii) Show that Y can be written as a function of X.
b) Let X :Ω → R be an arbitrary random variable and let Y :Ω → R be σ(X)- measurable. Show that there exists a function Φ such that
Y = Φ(X).
Hint: algebraic induction.
Solution: a) i) In this particular case we obtain
−1 n[ o σ(X) = X (B(R)) = σ {A1,...,An} = Aj : J ⊆ {1, . . . , n} . j∈J
−1 −1 a) ii) We have Y (B) ∈ σ(X) for all B ∈ B(R), in particular Y ({z}) ∈ σ(X) for −1 all z ∈ R. Now assume that Y ({z}) 6= ∅ for some z ∈ R. Then there exists a set −1 S A ∈ σ(X) \ {∅} such that Y ({z}) = A = j∈J Aj for some index set J ⊆ {1, . . . , n}, i.e. Y (ω) = z for all ω ∈ A. This means, that Y is constant on each set Aj, j = 1, . . . , n. a) iii) By part ii) we can find z1, . . . , zn ∈ R such that
n n X 1 X 1 Y = zi Ai = zi {X=ai}. i=1 i=1
1 Pn 1 By defining the map g : R → R by g(x) = i=1 zi {ai}(x) we finally obtain
n X 1 g(X(ω)) = zi {X=ai}(ω) = Y (ω). i=1
Pn 1 b) 1) Let Y be a simple function, i.e Y = i=1 zi Ai for some (zi) ⊆ R and (Ai) ⊆ σ(X). −1 Then there exist sets Bi ∈ B(R) such that Ai = X (Bi), i = 1, . . . , n. Now define
n X 1 ϕ(x) := zi Bi (x), x ∈ R. i=1 Then we obtain n n X 1 X 1 ϕ(X(ω)) = zi Bi (X(ω)) = zi Ai = Y. i=1 | {z } i=1 =1 −1 (ω) X (Bi)
2) Let Y :Ω → R be a positive function. Then there exists a sequence of simple functions Yn such that 0 ≤ Yn % Y pointwise, in particular Y = supn Yn. By part 1) we can find a sequence of functions ϕn such that ϕn(X) = Yn, n ∈ N. Now take ϕ := supn∈N ϕn. Then we get ϕ(X) = sup ϕn(X) = sup Yn = Y. n n
3) Let Y be a general measurable map. Then Y = Y+ − Y− with Y+,Y− ≥ 0. By part 2) we can construct functions ϕ+ and ϕ− such that Y+ = ϕ+(X) and Y− = ϕ−(X). Defining ϕ := ϕ+ − ϕ− we finally get
ϕ(X) = ϕ+(X) − ϕ−(X) = Y+ − Y− = Y.
Moreover, we obtain the following result:
Lemma T2. Let fi : (Ω, A) → (Ωi, Bi), i ∈ I, and ϕ: (Ω0, A0) → (Ω, A) be maps. Then we have
ϕ is (A0, σ(fi, i ∈ I))-measurable ⇐⇒ fi ◦ ϕ is (A0, Bi)-measurable for all i ∈ I.
Proof: First assume the left-hand side. Since ϕ is (A0, σ(fi))-measurable and fi is (σ(fi), Bi)-measurable for any fixed i ∈ I, we trivially obtain that fi ◦ ϕ is (A0, Bi)- measurable for all i ∈ I. S −1 Now assume the converse. Let M := i∈I fi (Bi) be the generating system of σ(fi, i ∈ I) −1 and A ∈ M be any set. Then there exists an i ∈ I and Bi ∈ Bi with A = fi (Bi) satisfying
−1 −1 −1 −1 ϕ (A) = ϕ (fi (Bi)) = (fi ◦ ϕ) (Bi) ∈ A0.
Since A ∈ M was arbitrary, the claim follows.
2 Exercise 5 (Product probability spaces) .
Let (Ωj, Aj, Pj), j ∈ N, be probability spaces,
∞ ∞ O Ω := × Ωj, and A := Aj := σ(πj, j ∈ N) j=1 j=1 the product σ-algebra generated by the projections πj :Ω → Ωj (πj(ω) = ωj, j ∈ N). Show that there exists a uniquely determined probability measure P on A satisfying
∞ n Y P A1 × ... × An × × Ωj = Pj(Aj) j=n+1 j=1 for any sets Aj ∈ Aj, j = 1, . . . , n.
N∞ N∞ ∞ N∞ N∞ Notation: P = j=1 Pj and j=1(Ωj, Aj, Pj) := (×j=1 Ωj, j=1 Aj, j=1 Pj).
Hints for the proof:
1) For n ∈ N define
∞ Fn := Bn × × Ωj : Bn ∈ A1 ⊗ ... ⊗ An j=n+1
and show that this is an ascending sequence of σ-algebras. S∞ 2) For F := n=1 Fn show that F ⊂ A and σ(F) = A.
3) On Fn define the probability measure
∞ µn Bn × × Ωj := P1 ⊗ ... ⊗ Pn(Bn) j=n+1
and on F the map P by P(A) := µn(A) if A ∈ Fn.
4) Show that P(Ω) = 1 and P is σ-additive. 5) Finally, use Caratheodory’s extension theorem as well as the measure uniqueness theorem to conclude the proof.
Before we start with the proof of this result we shortly recall Caratheodory’s extension theorem and the measure uniqueness theorem:
Caratheodory’s extension theorem. Let R be a semi-ring, µ: R → [0, ∞] be a set function satisfying
1) µ(∅) = 0
2) µ is σ-additive
Then there exists a measureµ ˜ on σ(R) with µ(A) =µ ˜(A) for all A ∈ R.
3 Measure uniqueness theorem. Let M ⊆ P(Ω) be an intersection stable generator of the σ-algebra A and let µ1, µ2 be measures on A such that
µ1(A) = µ2(A) for all A ∈ M. S If there exists an exhausting sequence of sets (An)n≥1 ⊆ M with Ω = n≥1 An with µ1(An) = µ2(An) < ∞ for all n ∈ N, then µ1 = µ2.
∞ Solution: 1) Let Fn := Bn × ×j=n+1 Ωj : Bn ∈ A1 ⊗ ... ⊗ An , n ∈ N. Using that n ⊗j=1Aj is a σ-algebra, it can be easily verified that Fn is a σ-algebra as well. Moreover, n+1 n since Bn × Ωn+1 ∈ ⊗j=1 Aj for any set Bn ∈ ⊗j=1Aj we trivially obtain Fn ⊆ Fn+1.
2) Now define F := S F (which is not a σ-algebra in general). Then F is an algebra: n∈N n
i) Since Ω ∈ Fn for all n ∈ N, we obtain Ω ∈ F.
ii) Let A ∈ F. Then there is an n ∈ N such that A ∈ Fn. Using that Fn is a σ-algebra C C we get A ∈ Fn, i.e. A ∈ F.
iii) Let A, B ∈ F. Then there are m, n ∈ N such that A ∈ Fn and B ∈ Fm. Without loss of generality we may assume that n < m. Then A, B ∈ Fm by part 1). Using again that Fm is a σ-algebra, we get A ∪ B ∈ Fm, and this implies A ∪ B ∈ F by definition. In particular, F is an intersection stable semi-ring. Consider now the maps
pn :Ω → Ω1 × ... × Ωn, pn(ω) = (ω1, . . . , ωn).
n Then pn is (A, ⊗i=1Ai)-measurable. This can be seen by considering the maps
n n n πj : × Ωi → Ωj, πj ((ω1, . . . , ωn)) = ωj, j = 1, . . . , n i=1
n which has the property πj ◦ pn = πj, and this is (A, Aj)-measurable for each j = 1, . . . , n. n By Lemma T2 pn is (A, σ(πj , j = 1, . . . , n))-measurable.
| n{z } =⊗j=1Aj ∞ For any set A ∈ F we can find an n ∈ N such that A = Bn × ×j=n+1 Ωj for some n Bn ∈ ⊗j=1Aj. Using the measurability of pn above we obtain
−1 A = pn (Bn) ∈ A.
This implies F ⊆ A. ∞ Define the sets Rn := {A1 × ...An × ×j=n+1 Ωj : Aj ∈ Aj}, n ∈ N. Then we have
∞ ∞ [ −1 [ πj (Aj) ⊆ Rj ⊆ F ⊆ A, j=1 j=1 which implies that σ(F) = A.
3) On Fn we define the probability measure µn by
∞ n µn Bn × × Ωj := ⊗j=1Pj(Bn) j=n+1
4 and the set function P on F by
P(A) := µn(A) if A ∈ Fn.
4) By construction P is well-defined and it holds that
P(Ω) = µ1(Ω1) = P1(Ω1) = 1.
Now let A1,...,An ∈ F be disjoint sets. Then there is an m ∈ N such that A1,...,An ∈ Fm. This implies
n n n n [ [ X X P Aj = µm Aj = µm(Aj) = P(Aj). j=1 j=1 j=1 j=1 which means that P is finitely additive. We next show that P is continuous in ∅ (and hence σ-additive). To prove that let (Cn)n ⊆ F be a decreasing sequence of sets such that T∞ limn→∞ P(Cn) > 0. In the remaining of this part we want to show that n=1 Cn 6= ∅ (which then proves the continuity of P). ∞ We may assume that Cn = Bn × ×j=n+1 Ωj, Bn ∈ A≤n. Then
lim µn(Cn) = lim (Cn) > 0. n→∞ n→∞ P Now define Z 1 1 fn(ω1) := Bn (ω1, ω2, . . . , ωn) d(P2 ⊗ ... ⊗ Pn)(ω2, . . . , ωn) Ω2×...×Ωn Z 1 ≥ Bn+1 (ω1, ω2, . . . , ωn+1) d(P2 ⊗ ... ⊗ Pn+1)(ω2, . . . , ωn+1) Ω2×...×Ωn+1 1 = fn+1(ω1), where the inequality comes from the fact that Cn+1 ⊆ Cn and Bn+1 ⊆ Bn × Ωn+1. This 1 implies that (fn)n≥2 is a decreasing sequence. By monotone convergence this implies Z Z 1 1 def inf fn(ω1) dP1(ω1) = inf fn(ω1) dP1(ω1) = inf µn(Cn) > 0. n≥2 n≥2 n≥2 Ω1 Ω1
1 Hence, there exists anω ¯1 ∈ Ω1 such that infn≥2 fn(¯ω1) > 0. Inductively, we can define for any k ∈ N and n ≥ k + 1 the function Z k 1 fn (¯ω1,..., ω¯k−1, ωk) := Bn (¯ω1,..., ω¯k−1, ωk, . . . , ωn) d(Pk+1⊗...⊗Pn)(ωk+1, . . . , ωn) Ωk+1×...Ωn and with the same argument as above we get anω ¯k ∈ Ωk satisfying
k inf fn (¯ω1,..., ω¯k) > 0. n≥k+1
k R In particular, f (¯ω1,..., ω¯k) = 1B (¯ω1,..., ω¯k, ωk+1) d k+1(ωk+1) > 0. This k+1 Ωk+1 k+1 P implies that the set {ωk+1 ∈ Ωk+1 : (¯ω1,..., ω¯k, ωk+1) ∈ Bk+1} is not empty for all k ∈ N. Now using that Bk+1 ⊆ Bk × Ωk+1 we obtain
(¯ω1,..., ω¯k) ∈ Bk for all k ∈ N.
5 T∞ Eventually,ω ¯ := (¯ωj)j≥1 ∈ n=1 Cn.
5) By part 4) the set function P is σ-additive on the intersection stable semi-ring F. By Caratheodory’s extension theorem and the uniqueness theorem for measures we obtain a unique probability measure P˜ on σ(F) = A such that
P˜(A) = P(A) for all A ∈ F.
Having this result at hand we can prove the following Corollary:
Corollary T3. Let Xi :Ω → Ωi, i ∈ N, be random variables. Then we have
X ∞ Xi X = (Xi)i∈N is independent ⇐⇒ P = ⊗i=1P .
(X1,...,Xn) n Xi Proof: Let (Xi)i∈N be independent. Then, for any n ∈ N we have P = ⊗i=1P . Using this, we get
∞ X P (B1 × ... × Bn × × Ωj) = P(X1 ∈ B1,...,Xn ∈ Bn,Xj ∈ Ωj, j ≥ n + 1) j=n+1 n Y Xj = P(X1 ∈ B1,...,Xn ∈ Bn) = P (Bj). j=1
∞ Xi X ∞ Xi By Exercise 5, the only measure satisfying this is ⊗i=1P , i.e. P = ⊗i=1P .
Now assume the converse and let J ⊆ N be a finite subset. Then there is an N ∈ N such that J ⊆ {1,...,N} and we have (let Bj = Ωj for j∈ / J)
∞ N X Y Xj P(Xj ∈ Bj, j ∈ J) = P (B1 × ... × BN × × Ωj) = P (Bj) j=N+1 j=1
Y Xj Y = P (Bj) = P(Xj ∈ Bj). j∈J j∈J which implies that (Xi)i∈N are independent.
Exercise 6 (Infinite and independent coin toss) . N∞ Let (Ω, A, P) = j=1 {0, 1}, P({0, 1}), Pj with Pj({0}) = p and Pj({1}) = 1 − p, 0 < p < 1, j ∈ N, the stochastic model of an infinite sequence of independent coin tosses with a not necessarily fair coin. We now continuously flip the coin and stop when the coin shows head (head = 1). Calculate the probabilities of the following events:
a) A: we flip the coin at least k times (k ∈ N); b) B: the amount of coin flips is even.
6 Solution: Let X :Ω → N be the random variable counting the amounts of flips of this experiment. By independence we get
P(X = 1) = P1({1}) = 1 − p, P(X = 2) = P1({0})P2({1}) = p(1 − p), 2 P(X = 3) = P1({0})P2({0})P3({1}) = p (1 − p), . . k−1 P(X = k) = P1({0}) ... Pk−1({0})Pk({1}) = p (1 − p), k ∈ N.
a) Using this observation we obtain
k−1 X j−1 P(A) = P(X ≥ k) = 1 − P(X ≤ k − 1) = 1 − p (1 − p) j=1 k−2 X 1 − pk−1 = 1 − (1 − p) pj = 1 − (1 − p) 1 − p j=0 = pk−1.
b) Similarly we get
∞ ∞ X X 2k−1 P(B) = P(X = 2k) = p (1 − p) k=1 k=1 ∞ X 1 = p(1 − p) p2j = p(1 − p) 1 − p2 j=0 p = . 1 + p
1 1 If we have a fair coin (p = 2 ) we get P(B) = 3 , which means that the probability of X being odd is twice as much as X being even.
7