Short Recap: Σ-Algebras Generated by Maps

Total Page:16

File Type:pdf, Size:1020Kb

Load more

Short recap: σ-algebras generated by maps 1) Let (X; A) and (Y; B) be measurable spaces and f : X ! Y be a map. Then we define the pull back σ-algebra as f −1(B) := ff −1(B): B 2 Bg This is the smallest σ-algebra on X such that f is measurable. In particular, f is (A; B)- measurable if and only if f −1(B) ⊆ A. 2) If (fi)i2I is a family of maps fi : X ! Yi, then [ −1 σ(fi; i 2 I) := σ fi (Bi) i2I S −1 is the σ-algebra generated by (fi)i2I . Please note that i2I fi (Bi) is not a σ-algebra in general, and as in 1) we can easily prove that σ(fi; i 2 I) is the smallest σ-algebra on X such that all fi are measurable. Exercise 4 (σ(X)-measurable random variables) . Let (Ω; A) be a measurable space. a) Let a1; : : : ; an 2 R be pairwise distinct and A1;:::;An 2 A be pairwise disjoint with Sn Pn 1 Ω = j=1 Aj. Let X := j=1 aj Aj and σ(X) be the σ-algebra generated by X. i) Determine σ(X). ii) Let Y be a σ(X)-measurable random variable. Show that Y is constant on each set Aj, j = 1; : : : ; n. iii) Show that Y can be written as a function of X. b) Let X :Ω ! R be an arbitrary random variable and let Y :Ω ! R be σ(X)- measurable. Show that there exists a function Φ such that Y = Φ(X): Hint: algebraic induction. Solution: a) i) In this particular case we obtain −1 n[ o σ(X) = X (B(R)) = σ fA1;:::;Ang = Aj : J ⊆ f1; : : : ; ng : j2J −1 −1 a) ii) We have Y (B) 2 σ(X) for all B 2 B(R), in particular Y (fzg) 2 σ(X) for −1 all z 2 R. Now assume that Y (fzg) 6= ; for some z 2 R. Then there exists a set −1 S A 2 σ(X) n f;g such that Y (fzg) = A = j2J Aj for some index set J ⊆ f1; : : : ; ng, i.e. Y (!) = z for all ! 2 A. This means, that Y is constant on each set Aj, j = 1; : : : ; n. a) iii) By part ii) we can find z1; : : : ; zn 2 R such that n n X 1 X 1 Y = zi Ai = zi fX=aig: i=1 i=1 1 Pn 1 By defining the map g : R ! R by g(x) = i=1 zi faig(x) we finally obtain n X 1 g(X(!)) = zi fX=aig(!) = Y (!): i=1 Pn 1 b) 1) Let Y be a simple function, i.e Y = i=1 zi Ai for some (zi) ⊆ R and (Ai) ⊆ σ(X). −1 Then there exist sets Bi 2 B(R) such that Ai = X (Bi), i = 1; : : : ; n. Now define n X 1 '(x) := zi Bi (x); x 2 R: i=1 Then we obtain n n X 1 X 1 '(X(!)) = zi Bi (X(!)) = zi Ai = Y: i=1 | {z } i=1 =1 −1 (!) X (Bi) 2) Let Y :Ω ! R be a positive function. Then there exists a sequence of simple functions Yn such that 0 ≤ Yn % Y pointwise, in particular Y = supn Yn. By part 1) we can find a sequence of functions 'n such that 'n(X) = Yn, n 2 N. Now take ' := supn2N 'n. Then we get '(X) = sup 'n(X) = sup Yn = Y: n n 3) Let Y be a general measurable map. Then Y = Y+ − Y− with Y+;Y− ≥ 0. By part 2) we can construct functions '+ and '− such that Y+ = '+(X) and Y− = '−(X). Defining ' := '+ − '− we finally get '(X) = '+(X) − '−(X) = Y+ − Y− = Y: Moreover, we obtain the following result: Lemma T2. Let fi : (Ω; A) ! (Ωi; Bi), i 2 I, and ': (Ω0; A0) ! (Ω; A) be maps. Then we have ' is (A0; σ(fi; i 2 I))-measurable () fi ◦ ' is (A0; Bi)-measurable for all i 2 I: Proof: First assume the left-hand side. Since ' is (A0; σ(fi))-measurable and fi is (σ(fi); Bi)-measurable for any fixed i 2 I, we trivially obtain that fi ◦ ' is (A0; Bi)- measurable for all i 2 I. S −1 Now assume the converse. Let M := i2I fi (Bi) be the generating system of σ(fi; i 2 I) −1 and A 2 M be any set. Then there exists an i 2 I and Bi 2 Bi with A = fi (Bi) satisfying −1 −1 −1 −1 ' (A) = ' (fi (Bi)) = (fi ◦ ') (Bi) 2 A0: Since A 2 M was arbitrary, the claim follows. 2 Exercise 5 (Product probability spaces) . Let (Ωj; Aj; Pj), j 2 N, be probability spaces, 1 1 O Ω := × Ωj; and A := Aj := σ(πj; j 2 N) j=1 j=1 the product σ-algebra generated by the projections πj :Ω ! Ωj (πj(!) = !j, j 2 N). Show that there exists a uniquely determined probability measure P on A satisfying 1 n Y P A1 × ::: × An × × Ωj = Pj(Aj) j=n+1 j=1 for any sets Aj 2 Aj, j = 1; : : : ; n. N1 N1 1 N1 N1 Notation: P = j=1 Pj and j=1(Ωj; Aj; Pj) := (×j=1 Ωj; j=1 Aj; j=1 Pj). Hints for the proof: 1) For n 2 N define 1 Fn := Bn × × Ωj : Bn 2 A1 ⊗ ::: ⊗ An j=n+1 and show that this is an ascending sequence of σ-algebras. S1 2) For F := n=1 Fn show that F ⊂ A and σ(F) = A. 3) On Fn define the probability measure 1 µn Bn × × Ωj := P1 ⊗ ::: ⊗ Pn(Bn) j=n+1 and on F the map P by P(A) := µn(A) if A 2 Fn: 4) Show that P(Ω) = 1 and P is σ-additive. 5) Finally, use Caratheodory's extension theorem as well as the measure uniqueness theorem to conclude the proof. Before we start with the proof of this result we shortly recall Caratheodory's extension theorem and the measure uniqueness theorem: Caratheodory's extension theorem. Let R be a semi-ring, µ: R! [0; 1] be a set function satisfying 1) µ(;) = 0 2) µ is σ-additive Then there exists a measureµ ~ on σ(R) with µ(A) =µ ~(A) for all A 2 R. 3 Measure uniqueness theorem. Let M ⊆ P(Ω) be an intersection stable generator of the σ-algebra A and let µ1, µ2 be measures on A such that µ1(A) = µ2(A) for all A 2 M: S If there exists an exhausting sequence of sets (An)n≥1 ⊆ M with Ω = n≥1 An with µ1(An) = µ2(An) < 1 for all n 2 N, then µ1 = µ2. 1 Solution: 1) Let Fn := Bn × ×j=n+1 Ωj : Bn 2 A1 ⊗ ::: ⊗ An , n 2 N. Using that n ⊗j=1Aj is a σ-algebra, it can be easily verified that Fn is a σ-algebra as well. Moreover, n+1 n since Bn × Ωn+1 2 ⊗j=1 Aj for any set Bn 2 ⊗j=1Aj we trivially obtain Fn ⊆ Fn+1. 2) Now define F := S F (which is not a σ-algebra in general). Then F is an algebra: n2N n i) Since Ω 2 Fn for all n 2 N, we obtain Ω 2 F. ii) Let A 2 F. Then there is an n 2 N such that A 2 Fn. Using that Fn is a σ-algebra C C we get A 2 Fn, i.e. A 2 F. iii) Let A; B 2 F. Then there are m; n 2 N such that A 2 Fn and B 2 Fm. Without loss of generality we may assume that n < m. Then A; B 2 Fm by part 1). Using again that Fm is a σ-algebra, we get A [ B 2 Fm, and this implies A [ B 2 F by definition. In particular, F is an intersection stable semi-ring. Consider now the maps pn :Ω ! Ω1 × ::: × Ωn; pn(!) = (!1;:::;!n): n Then pn is (A; ⊗i=1Ai)-measurable. This can be seen by considering the maps n n n πj : × Ωi ! Ωj; πj ((!1;:::;!n)) = !j; j = 1; : : : ; n i=1 n which has the property πj ◦ pn = πj, and this is (A; Aj)-measurable for each j = 1; : : : ; n. n By Lemma T2 pn is (A; σ(πj ; j = 1; : : : ; n))-measurable. | n{z } =⊗j=1Aj 1 For any set A 2 F we can find an n 2 N such that A = Bn × ×j=n+1 Ωj for some n Bn 2 ⊗j=1Aj. Using the measurability of pn above we obtain −1 A = pn (Bn) 2 A: This implies F ⊆ A. 1 Define the sets Rn := fA1 × :::An × ×j=n+1 Ωj : Aj 2 Ajg, n 2 N. Then we have 1 1 [ −1 [ πj (Aj) ⊆ Rj ⊆ F ⊆ A; j=1 j=1 which implies that σ(F) = A. 3) On Fn we define the probability measure µn by 1 n µn Bn × × Ωj := ⊗j=1Pj(Bn) j=n+1 4 and the set function P on F by P(A) := µn(A) if A 2 Fn: 4) By construction P is well-defined and it holds that P(Ω) = µ1(Ω1) = P1(Ω1) = 1: Now let A1;:::;An 2 F be disjoint sets. Then there is an m 2 N such that A1;:::;An 2 Fm. This implies n n n n [ [ X X P Aj = µm Aj = µm(Aj) = P(Aj): j=1 j=1 j=1 j=1 which means that P is finitely additive.
Recommended publications
  • Measure-Theoretic Probability I

    Measure-Theoretic Probability I

    Measure-Theoretic Probability I Steven P.Lalley Winter 2017 1 1 Measure Theory 1.1 Why Measure Theory? There are two different views – not necessarily exclusive – on what “probability” means: the subjectivist view and the frequentist view. To the subjectivist, probability is a system of laws that should govern a rational person’s behavior in situations where a bet must be placed (not necessarily just in a casino, but in situations where a decision must be made about how to proceed when only imperfect information about the outcome of the decision is available, for instance, should I allow Dr. Scissorhands to replace my arthritic knee by a plastic joint?). To the frequentist, the laws of probability describe the long- run relative frequencies of different events in “experiments” that can be repeated under roughly identical conditions, for instance, rolling a pair of dice. For the frequentist inter- pretation, it is imperative that probability spaces be large enough to allow a description of an experiment, like dice-rolling, that is repeated infinitely many times, and that the mathematical laws should permit easy handling of limits, so that one can make sense of things like “the probability that the long-run fraction of dice rolls where the two dice sum to 7 is 1/6”. But even for the subjectivist, the laws of probability should allow for description of situations where there might be a continuum of possible outcomes, or pos- sible actions to be taken. Once one is reconciled to the need for such flexibility, it soon becomes apparent that measure theory (the theory of countably additive, as opposed to merely finitely additive measures) is the only way to go.
  • 1.5. Set Functions and Properties. Let Л Be Any Set of Subsets of E

    1.5. Set Functions and Properties. Let Л Be Any Set of Subsets of E

    1.5. Set functions and properties. Let A be any set of subsets of E containing the empty set ∅. A set function is a function µ : A → [0, ∞] with µ(∅)=0. Let µ be a set function. Say that µ is increasing if, for all A, B ∈ A with A ⊆ B, µ(A) ≤ µ(B). Say that µ is additive if, for all disjoint sets A, B ∈ A with A ∪ B ∈ A, µ(A ∪ B)= µ(A)+ µ(B). Say that µ is countably additive if, for all sequences of disjoint sets (An : n ∈ N) in A with n An ∈ A, S µ An = µ(An). n ! n [ X Say that µ is countably subadditive if, for all sequences (An : n ∈ N) in A with n An ∈ A, S µ An ≤ µ(An). n ! n [ X 1.6. Construction of measures. Let A be a set of subsets of E. Say that A is a ring on E if ∅ ∈ A and, for all A, B ∈ A, B \ A ∈ A, A ∪ B ∈ A. Say that A is an algebra on E if ∅ ∈ A and, for all A, B ∈ A, Ac ∈ A, A ∪ B ∈ A. Theorem 1.6.1 (Carath´eodory’s extension theorem). Let A be a ring of subsets of E and let µ : A → [0, ∞] be a countably additive set function. Then µ extends to a measure on the σ-algebra generated by A. Proof. For any B ⊆ E, define the outer measure ∗ µ (B) = inf µ(An) n X where the infimum is taken over all sequences (An : n ∈ N) in A such that B ⊆ n An and is taken to be ∞ if there is no such sequence.
  • Probability and Statistics Lecture Notes

    Probability and Statistics Lecture Notes

    Probability and Statistics Lecture Notes Antonio Jiménez-Martínez Chapter 1 Probability spaces In this chapter we introduce the theoretical structures that will allow us to assign proba- bilities in a wide range of probability problems. 1.1. Examples of random phenomena Science attempts to formulate general laws on the basis of observation and experiment. The simplest and most used scheme of such laws is: if a set of conditions B is satisfied =) event A occurs. Examples of such laws are the law of gravity, the law of conservation of mass, and many other instances in chemistry, physics, biology... If event A occurs inevitably whenever the set of conditions B is satisfied, we say that A is certain or sure (under the set of conditions B). If A can never occur whenever B is satisfied, we say that A is impossible (under the set of conditions B). If A may or may not occur whenever B is satisfied, then A is said to be a random phenomenon. Random phenomena is our subject matter. Unlike certain and impossible events, the presence of randomness implies that the set of conditions B do not reflect all the necessary and sufficient conditions for the event A to occur. It might seem them impossible to make any worthwhile statements about random phenomena. However, experience has shown that many random phenomena exhibit a statistical regularity that makes them subject to study. For such random phenomena it is possible to estimate the chance of occurrence of the random event. This estimate can be obtained from laws, called probabilistic or stochastic, with the form: if a set of conditions B is satisfied event A occurs m times =) repeatedly n times out of the n repetitions.
  • A Bayesian Level Set Method for Geometric Inverse Problems

    A Bayesian Level Set Method for Geometric Inverse Problems

    Interfaces and Free Boundaries 18 (2016), 181–217 DOI 10.4171/IFB/362 A Bayesian level set method for geometric inverse problems MARCO A. IGLESIAS School of Mathematical Sciences, University of Nottingham, Nottingham NG7 2RD, UK E-mail: [email protected] YULONG LU Mathematics Institute, University of Warwick, Coventry CV4 7AL, UK E-mail: [email protected] ANDREW M. STUART Mathematics Institute, University of Warwick, Coventry CV4 7AL, UK E-mail: [email protected] [Received 3 April 2015 and in revised form 10 February 2016] We introduce a level set based approach to Bayesian geometric inverse problems. In these problems the interface between different domains is the key unknown, and is realized as the level set of a function. This function itself becomes the object of the inference. Whilst the level set methodology has been widely used for the solution of geometric inverse problems, the Bayesian formulation that we develop here contains two significant advances: firstly it leads to a well-posed inverse problem in which the posterior distribution is Lipschitz with respect to the observed data, and may be used to not only estimate interface locations, but quantify uncertainty in them; and secondly it leads to computationally expedient algorithms in which the level set itself is updated implicitly via the MCMC methodology applied to the level set function – no explicit velocity field is required for the level set interface. Applications are numerous and include medical imaging, modelling of subsurface formations and the inverse source problem; our theory is illustrated with computational results involving the last two applications.
  • Generalized Stochastic Processes with Independent Values

    Generalized Stochastic Processes with Independent Values

    GENERALIZED STOCHASTIC PROCESSES WITH INDEPENDENT VALUES K. URBANIK UNIVERSITY OF WROCFAW AND MATHEMATICAL INSTITUTE POLISH ACADEMY OF SCIENCES Let O denote the space of all infinitely differentiable real-valued functions defined on the real line and vanishing outside a compact set. The support of a function so E X, that is, the closure of the set {x: s(x) F 0} will be denoted by s(,o). We shall consider 3D as a topological space with the topology introduced by Schwartz (section 1, chapter 3 in [9]). Any continuous linear functional on this space is a Schwartz distribution, a generalized function. Let us consider the space O of all real-valued random variables defined on the same sample space. The distance between two random variables X and Y will be the Frechet distance p(X, Y) = E[X - Yl/(l + IX - YI), that is, the distance induced by the convergence in probability. Any C-valued continuous linear functional defined on a is called a generalized stochastic process. Every ordinary stochastic process X(t) for which almost all realizations are locally integrable may be considered as a generalized stochastic process. In fact, we make the generalized process T((p) = f X(t),p(t) dt, with sp E 1, correspond to the process X(t). Further, every generalized stochastic process is differentiable. The derivative is given by the formula T'(w) = - T(p'). The theory of generalized stochastic processes was developed by Gelfand [4] and It6 [6]. The method of representation of generalized stochastic processes by means of sequences of ordinary processes was considered in [10].
  • Measure, Integral and Probability

    Measure, Integral and Probability

    Marek Capinski´ and Ekkehard Kopp Measure, Integral and Probability Springer-Verlag Berlin Heidelberg NewYork London Paris Tokyo Hong Kong Barcelona Budapest To our children; grandchildren: Piotr, Maciej, Jan, Anna; Luk asz Anna, Emily Preface The central concepts in this book are Lebesgue measure and the Lebesgue integral. Their role as standard fare in UK undergraduate mathematics courses is not wholly secure; yet they provide the principal model for the development of the abstract measure spaces which underpin modern probability theory, while the Lebesgue function spaces remain the main source of examples on which to test the methods of functional analysis and its many applications, such as Fourier analysis and the theory of partial differential equations. It follows that not only budding analysts have need of a clear understanding of the construction and properties of measures and integrals, but also that those who wish to contribute seriously to the applications of analytical methods in a wide variety of areas of mathematics, physics, electronics, engineering and, most recently, finance, need to study the underlying theory with some care. We have found remarkably few texts in the current literature which aim explicitly to provide for these needs, at a level accessible to current under- graduates. There are many good books on modern probability theory, and increasingly they recognize the need for a strong grounding in the tools we develop in this book, but all too often the treatment is either too advanced for an undergraduate audience or else somewhat perfunctory. We hope therefore that the current text will not be regarded as one which fills a much-needed gap in the literature! One fundamental decision in developing a treatment of integration is whether to begin with measures or integrals, i.e.
  • Determinism, Indeterminism and the Statistical Postulate

    Determinism, Indeterminism and the Statistical Postulate

    Tipicality, Explanation, The Statistical Postulate, and GRW Valia Allori Northern Illinois University [email protected] www.valiaallori.com Rutgers, October 24-26, 2019 1 Overview Context: Explanation of the macroscopic laws of thermodynamics in the Boltzmannian approach Among the ingredients: the statistical postulate (connected with the notion of probability) In this presentation: typicality Def: P is a typical property of X-type object/phenomena iff the vast majority of objects/phenomena of type X possesses P Part I: typicality is sufficient to explain macroscopic laws – explanatory schema based on typicality: you explain P if you explain that P is typical Part II: the statistical postulate as derivable from the dynamics Part III: if so, no preference for indeterministic theories in the quantum domain 2 Summary of Boltzmann- 1 Aim: ‘derive’ macroscopic laws of thermodynamics in terms of the microscopic Newtonian dynamics Problems: Technical ones: There are to many particles to do exact calculations Solution: statistical methods - if 푁 is big enough, one can use suitable mathematical technique to obtain information of macro systems even without having the exact solution Conceptual ones: Macro processes are irreversible, while micro processes are not Boltzmann 3 Summary of Boltzmann- 2 Postulate 1: the microscopic dynamics microstate 푋 = 푟1, … . 푟푁, 푣1, … . 푣푁 in phase space Partition of phase space into Macrostates Macrostate 푀(푋): set of macroscopically indistinguishable microstates Macroscopic view Many 푋 for a given 푀 given 푀, which 푋 is unknown Macro Properties (e.g. temperature): they slowly vary on the Macro scale There is a particular Macrostate which is incredibly bigger than the others There are many ways more to have, for instance, uniform temperature than not equilibrium (Macro)state 4 Summary of Boltzmann- 3 Entropy: (def) proportional to the size of the Macrostate in phase space (i.e.
  • The Axiom of Choice and Its Implications

    The Axiom of Choice and Its Implications

    THE AXIOM OF CHOICE AND ITS IMPLICATIONS KEVIN BARNUM Abstract. In this paper we will look at the Axiom of Choice and some of the various implications it has. These implications include a number of equivalent statements, and also some less accepted ideas. The proofs discussed will give us an idea of why the Axiom of Choice is so powerful, but also so controversial. Contents 1. Introduction 1 2. The Axiom of Choice and Its Equivalents 1 2.1. The Axiom of Choice and its Well-known Equivalents 1 2.2. Some Other Less Well-known Equivalents of the Axiom of Choice 3 3. Applications of the Axiom of Choice 5 3.1. Equivalence Between The Axiom of Choice and the Claim that Every Vector Space has a Basis 5 3.2. Some More Applications of the Axiom of Choice 6 4. Controversial Results 10 Acknowledgments 11 References 11 1. Introduction The Axiom of Choice states that for any family of nonempty disjoint sets, there exists a set that consists of exactly one element from each element of the family. It seems strange at first that such an innocuous sounding idea can be so powerful and controversial, but it certainly is both. To understand why, we will start by looking at some statements that are equivalent to the axiom of choice. Many of these equivalences are very useful, and we devote much time to one, namely, that every vector space has a basis. We go on from there to see a few more applications of the Axiom of Choice and its equivalents, and finish by looking at some of the reasons why the Axiom of Choice is so controversial.
  • Topic 1: Basic Probability Definition of Sets

    Topic 1: Basic Probability Definition of Sets

    Topic 1: Basic probability ² Review of sets ² Sample space and probability measure ² Probability axioms ² Basic probability laws ² Conditional probability ² Bayes' rules ² Independence ² Counting ES150 { Harvard SEAS 1 De¯nition of Sets ² A set S is a collection of objects, which are the elements of the set. { The number of elements in a set S can be ¯nite S = fx1; x2; : : : ; xng or in¯nite but countable S = fx1; x2; : : :g or uncountably in¯nite. { S can also contain elements with a certain property S = fx j x satis¯es P g ² S is a subset of T if every element of S also belongs to T S ½ T or T S If S ½ T and T ½ S then S = T . ² The universal set ­ is the set of all objects within a context. We then consider all sets S ½ ­. ES150 { Harvard SEAS 2 Set Operations and Properties ² Set operations { Complement Ac: set of all elements not in A { Union A \ B: set of all elements in A or B or both { Intersection A [ B: set of all elements common in both A and B { Di®erence A ¡ B: set containing all elements in A but not in B. ² Properties of set operations { Commutative: A \ B = B \ A and A [ B = B [ A. (But A ¡ B 6= B ¡ A). { Associative: (A \ B) \ C = A \ (B \ C) = A \ B \ C. (also for [) { Distributive: A \ (B [ C) = (A \ B) [ (A \ C) A [ (B \ C) = (A [ B) \ (A [ C) { DeMorgan's laws: (A \ B)c = Ac [ Bc (A [ B)c = Ac \ Bc ES150 { Harvard SEAS 3 Elements of probability theory A probabilistic model includes ² The sample space ­ of an experiment { set of all possible outcomes { ¯nite or in¯nite { discrete or continuous { possibly multi-dimensional ² An event A is a set of outcomes { a subset of the sample space, A ½ ­.
  • Old Notes from Warwick, Part 1

    Old Notes from Warwick, Part 1

    Measure Theory, MA 359 Handout 1 Valeriy Slastikov Autumn, 2005 1 Measure theory 1.1 General construction of Lebesgue measure In this section we will do the general construction of σ-additive complete measure by extending initial σ-additive measure on a semi-ring to a measure on σ-algebra generated by this semi-ring and then completing this measure by adding to the σ-algebra all the null sets. This section provides you with the essentials of the construction and make some parallels with the construction on the plane. Throughout these section we will deal with some collection of sets whose elements are subsets of some fixed abstract set X. It is not necessary to assume any topology on X but for simplicity you may imagine X = Rn. We start with some important definitions: Definition 1.1 A nonempty collection of sets S is a semi-ring if 1. Empty set ? 2 S; 2. If A 2 S; B 2 S then A \ B 2 S; n 3. If A 2 S; A ⊃ A1 2 S then A = [k=1Ak, where Ak 2 S for all 1 ≤ k ≤ n and Ak are disjoint sets. If the set X 2 S then S is called semi-algebra, the set X is called a unit of the collection of sets S. Example 1.1 The collection S of intervals [a; b) for all a; b 2 R form a semi-ring since 1. empty set ? = [a; a) 2 S; 2. if A 2 S and B 2 S then A = [a; b) and B = [c; d).
  • (Measure Theory for Dummies) UWEE Technical Report Number UWEETR-2006-0008

    (Measure Theory for Dummies) UWEE Technical Report Number UWEETR-2006-0008

    A Measure Theory Tutorial (Measure Theory for Dummies) Maya R. Gupta {gupta}@ee.washington.edu Dept of EE, University of Washington Seattle WA, 98195-2500 UWEE Technical Report Number UWEETR-2006-0008 May 2006 Department of Electrical Engineering University of Washington Box 352500 Seattle, Washington 98195-2500 PHN: (206) 543-2150 FAX: (206) 543-3842 URL: http://www.ee.washington.edu A Measure Theory Tutorial (Measure Theory for Dummies) Maya R. Gupta {gupta}@ee.washington.edu Dept of EE, University of Washington Seattle WA, 98195-2500 University of Washington, Dept. of EE, UWEETR-2006-0008 May 2006 Abstract This tutorial is an informal introduction to measure theory for people who are interested in reading papers that use measure theory. The tutorial assumes one has had at least a year of college-level calculus, some graduate level exposure to random processes, and familiarity with terms like “closed” and “open.” The focus is on the terms and ideas relevant to applied probability and information theory. There are no proofs and no exercises. Measure theory is a bit like grammar, many people communicate clearly without worrying about all the details, but the details do exist and for good reasons. There are a number of great texts that do measure theory justice. This is not one of them. Rather this is a hack way to get the basic ideas down so you can read through research papers and follow what’s going on. Hopefully, you’ll get curious and excited enough about the details to check out some of the references for a deeper understanding.
  • Measure Theory and Probability

    Measure Theory and Probability

    Measure theory and probability Alexander Grigoryan University of Bielefeld Lecture Notes, October 2007 - February 2008 Contents 1 Construction of measures 3 1.1Introductionandexamples........................... 3 1.2 σ-additive measures ............................... 5 1.3 An example of using probability theory . .................. 7 1.4Extensionofmeasurefromsemi-ringtoaring................ 8 1.5 Extension of measure to a σ-algebra...................... 11 1.5.1 σ-rings and σ-algebras......................... 11 1.5.2 Outermeasure............................. 13 1.5.3 Symmetric difference.......................... 14 1.5.4 Measurable sets . ............................ 16 1.6 σ-finitemeasures................................ 20 1.7Nullsets..................................... 23 1.8 Lebesgue measure in Rn ............................ 25 1.8.1 Productmeasure............................ 25 1.8.2 Construction of measure in Rn. .................... 26 1.9 Probability spaces ................................ 28 1.10 Independence . ................................. 29 2 Integration 38 2.1 Measurable functions.............................. 38 2.2Sequencesofmeasurablefunctions....................... 42 2.3 The Lebesgue integral for finitemeasures................... 47 2.3.1 Simplefunctions............................ 47 2.3.2 Positivemeasurablefunctions..................... 49 2.3.3 Integrablefunctions........................... 52 2.4Integrationoversubsets............................ 56 2.5 The Lebesgue integral for σ-finitemeasure.................