Measures and all that — A Tutorial Ernst-Erich Doberkat Math ++ Software, Bochum [email protected] November 13, 2014 arXiv:1409.2662v3 [math.FA] 12 Nov 2014 Abstract This tutorial gives an overview of some of the basic techniques of measure theory. It in- cludes a study of Borel sets and their generators for Polish and for analytic spaces, the weak topology on the space of all finite positive measures including its metrics, as well as mea- surable selections. Integration is covered, and product measures are introduced, both for finite and for arbitrary factors, with an application to projective systems. Finally, the duals of the Lp-spaces are discussed, together with the Radon-Nikodym Theorem and the Riesz Representation Theorem. Case studies include applications to stochastic Kripke models, to bisimulations, and to quotients for transition kernels. Page 1 EED. Measures Contents 1 Overview 2 2 Measurable Sets and Functions 3 2.1 MeasurableSets .................................. 4 2.1.1 A σ-AlgebraOnSpacesOfMeasures . 10 2.1.2 The Alexandrov Topology On Spaces of Measures . 11 2.2 Real-ValuedFunctions . 17 2.2.1 Essentially Bounded Functions . 21 2.2.2 Convergence almost everywhere and in measure ............. 22 2.3 Countably Generated σ-Algebras ......................... 27 2.3.1 Borel Sets in Polish and Analytic Spaces . ..... 32 2.3.2 Manipulating Polish Topologies . 38 2.4 AnalyticSetsandSpaces . .. .. .. .. .. .. .. .. 41 2.5 TheSouslinOperation ............................. 51 2.6 UniversallyMeasurableSets . ..... 55 2.6.1 Lubin’s Extension through von Neumann’s Selectors . ........ 58 2.6.2 Completing a Transition Kernel . 61 2.7 MeasurableSelections . 64 2.8 Integration ..................................... 67 2.8.1 FromMeasuretoIntegral . 67 2.8.2 The Daniell Integral and Riesz’s Representation Theorem ....... 72 2.9 ProductMeasures ................................. 78 2.9.1 Fubini’sTheorem.............................. 81 2.9.2 Infinite Products and Projective Limits . ..... 84 2.9.3 Case Study: Continuous Time Stochastic Logic . ...... 89 2.10 TheWeakTopology ................................ 97 2.10.1 TheHutchinsonMetric . 103 2.10.2 CaseStudy: Bisimulation . 105 2.10.3 Case Study: Quotients for Stochastic Relations . ......... 112 2.11 Lp-Spaces ...................................... 117 2.11.1 ASpoonfulHilbertSpaceTheory. 118 2.11.2 The Lp-Spaces are Banach Spaces . 121 2.11.3 The Lebesgue-Radon-Nikodym Theorem . 126 2.11.4 Continuous Linear Functionals on Lp ................... 132 2.11.5 Disintegration.. .. .. .. .. .. .. .. .. 137 2.12 BibliographicNotes. 142 2.13Exercises ...................................... 143 References 148 Index 150 November 13, 2014 A Tutorial Page 2 EED. Measures 1 Overview Markov transition systems are based on transition probabilities on a measurable space. This is a generalization of discrete spaces, where certain sets are declared to be measurable. So, in contrast to assuming that we know the probability for the transition between two states, we have to model the probability of a transition going from one state to a set of states: point-to-point probabilities are no longer available due to working in a comparatively large space. Measurable spaces are the domains of the probabilities involved. This approach has the advantage of being more general than finite or countable spaces, but now one deals with a fairly involved mathematical structure; all of a sudden the dictionary has to be extended with words like “universally measurable” or “sub-σ-algebra”. Measure theory becomes an area where one has to find answers to questions which did not appear to be particularly involved before, in the much simpler world of discrete measures (the impression should not arise that this author thinks that discrete measures are kiddie stuff, they are sometimes difficult enough to handle. The continuous case, as it is called sometimes, offers questions which simply do not arise in the discrete context). Many arguments in this area are of a measure theoretic nature; this tutorial makes an attempt to introduce the necessary tools and techniques. It starts off with a discussion of σ-algebras, which have already been met in [Dob13, Section 1.6]1. We look at the structure of σ-algebras, in particular at its generators; it turns out that the underlying space has something to say about it. In particular we will deal with Polish spaces and their brethren. Two aspects deserve to be singled out. The σ-algebra on the base space determines a σ-algebra on the space of all finite measures, and, if this space has a topology, it determines also a topology, the Alexandrov topology. These constructions are studied, since they also affect the applications in logic, and in transition systems, in which measures are vital. Second, we show that we can construct measurable selections, which then enable constructions which are interesting from a categorical point of view [Dob14, 2.4.2, 2.6.1, 2.7.3]. After having laid the groundwork with a discussion of σ-algebras as the domains of measures, we show that the integral of a measurable function can be constructed through an approxima- tion process, very much in the tradition of the Riemann integral, but with a larger scope. We also go the other way: given an integral, we construct a measure from it. This is the elegant way P. J. Daniell did propose for constructing measures, and it can be brought to fruit in this context for a fairly simple proof of the Riesz Representation Theorem on compact metric spaces. Having all these tools at our disposal, we look at product measures, which can be introduced now through a kind of line sweeping — if you want to measure an area in the plane, you measure the line length as you sweep over the area; this produces a function of the abscissa, which then yields the area. One of the main tools here is Fubini’s Theorem. The product measure is not confined to two factors, we discuss the general case. This includes a discussion of projective systems, which may be considered as a generalization of sequences of products. A case study shows that projective systems arise easily in the study of continuous time stochastic logics. 1[Dob13] and [Dob14] are other tutorials in this series. This is not an installment of mysteries, so one can be read quite independently from the others. November 13, 2014 A Tutorial Page 3 EED. Measures Now that integrals are available, we turn back and have a look at topologies on spaces of mea- sures; one suggests itself — the weak topology which is induced by the continuous functions. This is related to the Alexandrov topology. It is shown that there is a particularly handy metric for the weak topology, and that the space of all finite measures is complete with this metric, so that we now have a Polish space. This is capitalized on when discussing selections for set-valued maps into it, which are helpful in showing that Polish spaces are closed under bisimulations. We use measurable selections for an investigation into the structure of quo- tients in the Kleisli monad, providing another example for the interplay of arguments from measure theory and categories. Finally, we take up a true classic: Lp-spaces. We start from Hilbert spaces, apply the rep- resentation of linear functionals on L2 to obtain the Radon-Nikodym Theorem through von Neumann’s ingenious proof, and derive from it the representation of the dual spaces. This is applied to disintegration, where we show that a measure on a product can be decomposed into a projection and a transition kernel (on the surface this does not look like an application area for Lp-spaces; the relationship derives from the Radon-Nikodym Theorem). Because we are driven by applications to Markov transition systems and similar objects, we did not strive for the most general approach to measure and integral. In particular, we usually formulate the results for finite or σ-finite measures, leaving the more general cases outside of our focus. This means also that we did not deal with complex measures (and the associated linear spaces over the complex numbers), but things are discussed in the realm of real numbers; we show, however, in which way one could start to deal with complex measures when the occasion arises. Of course, a lot of things had to be left out, among them a more careful study of the Borel hierarchy and applications to Descriptive Set Theory, as well as martingales. 2 Measurable Sets and Functions This section contains a systematic study of measurable spaces and measurable functions with a view towards later developments. A brief overview is in order. The measurable structure is lifted to the space of finite measures, which form a measurable set under the weak-*-σ-algebra. This is studied in Section 2.1.1. If the underlying space carries a topology, the topological structure is handed down to finite measures through the Alexandrov topology. We will have a look at it in Section 2.1.2. The measurable functions from a measurable space to the reals form a vector space, which is also a lattice, and we will show that the step functions,i.e., those functions which take only finite number of values, are dense with respect to pointwise convergence. This mode of convergence is relaxed in the presence of a measure in various ways to almost uniform convergence, convergence almost everywhere, and to convergence in measure (Sections 2.2.1 and 2.2.2), from which also various (pseudo-) metrics and norms may be derived. If the underlying measurable spaces are the Borel sets of a metric space, and if the metric has a countable dense set, then the Borel sets are countably generated as well. But the irritating observation is that being countably generated is not hereditary — a sub-σ-algebra of a count- able σ-algebra needs not be countably generated.