Computing Aspects of Problems in Non.Linear

Total Page:16

File Type:pdf, Size:1020Kb

Computing Aspects of Problems in Non.Linear COMPUTING ASPECTS OF PROBLEMS IN NON.LINEAR PREDICTION AND FILTERING by I. G. CUMMING A thesis submitted for the degree of Ph.D. in Engineering Centre for Computing and Automation, Imperial College, University of London, London, S.W.7. MAY 1967 _ 2 - ABSTRACT This thesis discusses some of the computational problems arising in the application of modern stochastic control theory. We deal with continuous time systems where two typical problems are the prediction of the future statistical behaviour of systems and the synthesis of systems designed from stochastic theory such as filters. In each case, computational problems occur if the system is non-linear or non-Gaussian. The non-linear prediction problem involves solving a parabolic partial differential equation, the Fokker-Planck equation, and we dis- cuss two numerical methods of solving this equation. Finding that these methods can only handle a restricted class of low-dimensional systems, we study Monte Carlo methods in the hopes of finding a more general solution procedure. We find these to be successful if we allow for accuracy limitations, and find that the theory of the Fokker- Planck equation can be extended to include the Monte Carlo solution of a wider class of parabolic equations than previous methods would accommodate. Monte Carlo methods involve the simulation of a stochastic system on a computer, and as the problem of synthesising a given system is the same as simulating it on a computer, the rest of the thesis centres around the theoretical and practical aspects of simulation techniques. We find in each case that the system we must simulate is a continuous Markov (diffusion) process, and that diffusion processes have properties which distinguish them from any process which can ,be constructed on a computer or in the physical world (we call these physical processes). Thus we discuss the statistical equivalence of physical and diffusion processes, and show how and under what conditions a physical process can be chosen to approximate a diffusion process, and vice versa. In this way, we clarify a controversy on the interpretation of limiting forms of physical processes, and give an example which confirms the accuracy of the approximation and illustrates that diffusion approxima- tions can provide a useful method of analysing the transient statistics of physical processes. On the practical side of the simulation problem, we discuss the choice of noise source and its proper characterisation on the analogue computer, and the convergence rates and efficiencies of discrete simulation formulae on the digital computer. Acknowledgements This thesis has resulted from research carried out in the Department of Electrical Engineering*, Imperial College, from October 1963 to November 1966. The author is deeply indebted to his supervisor, J. H. Westcott, Professor of Control Systems, for providing the facilities for research, and considerable personal encouragement during this period. Discussions with colleagues were helpful in clarifying the aims and certain specific points of the project, and the author would particularly like to thank J. M. C: Clark, G. S. Marliss and D. Q. Mayne in this regard. The financial support of the Ministry of Education, Province of Quebec (1963/64), and the National Research Council of Canada (NATO Scholarship 1964/65 and 1965/66) is gratefully acknowledged. Finsfly, the author is very thankful for the ever-willing help of Miss E. Stocker (typing), Miss M. Lancaster (diagrams) and hiss L. Hawkins (duplicating). * The Control Systems Group is now in the Centre for Computing and Automation - 4 - CONTENTS PAGE Abstract 2 Acknowledgements 3 Glossary of Symbols 1. INTRODUCTION 13 1.1 Scope 13 1.2 Preliminaries - the Fokker-Planck Equation 14 1.3 Outline of Thesis 19 2. THE DIRECT APPROACH TO PREDICTION PROBLEMS - SOLUTION OF THE FOKKER-PLANCK EQUATION 25 2.1 Fokker-Planck Equation for a Diffusion Process 25 2.2 Fokker-Planck Equation for a Non-Markovian Process 27 2.3 Numerical Solution by Finite Differences 38 1. Example of a Noisy Control System 39 2. Choice of Finite Difference Model 42 3. Solution Procedure and Boundary Conditions 45 4. An Application of the'Transient Solution 56 5. Solution for Higher Order Systems 65 6. Summary of Finite Difference Methods 69 2.4 Numerical Solution by Hermite Transforms 71 1. Characterization of a Random Process 71 2. Hermite Polynomial Expansions 73 3. Hermite Transformation of the FP Equation 83 4. Hermite Transformation of Normalized FP Equation 91 5. Summary of Hermite Transform Method 99 3. SIMULATION AND THE MONTE CARLO SOLUTION OF PARABOLIC EQUATIONS 103 3.1 Motivation for Simulation Techniques 103 3.2 The Monte Carlo Solution of Parabolic Equations 110 1. The FP Equation as an Equation of Conser- vation 112 2. Simulation of Parabolic Equations not of FP Form 129 3. Solution Procedure 137 4. Example: The Heat Conduction Equation 145 5. The Treatment of Spatial Discontinuities and Boundary Conditions 150 6. Numerical Results of the Heat Conduction Example 162 7. Summary of Monte Carlo Solutions 180 -5- 4. THE RELATION BETWEEN PHYSICAL AND DIFFUSION PROCESSES WITH APPLICATIONS TO SIMULATION 184 4.1 Choosing an Equivalent Diffusion Process for a Physical Process by Matching Finite Incremental Statistics 187 1. Derivation of E[oX iXtt] for a Physical Process c T i 189 2. Derivation of E[SXoX X,t] for a Physical Process 197 3. A Diffusion Model for the Physical Process 200 4. Experimental Results 203 4.2 A Limiting Form of a Physical Process 207 4.3 Applications to Linear Systems with Random Coefficients 219 4.4 The Simulation of Diffusion Processes 228 4.5 The Simulation,of Physical Processes 233 5. ANALOGUE SIMULATION 237 5.1 Some Useful Noise Sources and their Characteristic Matrices 238 1. Noises Generated by Linear Shaping Filters 238 2. Pseudo Random Sequences 244 5.2 Experimental Results Illustrating the Differing Biases of Physical Processes and Diffusion Processes 249 1. Example Illustrating the Scaling of an Independent Noise Source 250 2. Construction of a Non-Linear Filter 257 3. Example using an Asymmetrical Noise Source 263 6. DIGITAL SIMULATION 274 6.1 Digital Noise and the Form of the Ordinary Differential Equation 274 6.2 Digital Solution of the 0.D.E. and Convergence to the S.D.E. 280 1. Convergence of the Physical Process to the Diffusion Process 281 2. Discrete Approximation to the O.D.E. 286 6.3 Digital Data Smoothing by Orthogonal Functions 305 1. Orthogonal Polynomial Expansions 306 2. Data Smoothing by Finite Expansions 309 7. CONCLUSIONS 317 Appendix A The Stochastic Calculus 327 Appendix B The Normalised FP Equation 346 Appendix C Calculation of Flux Hitting Boundary in Heat Conduction Problem 353 Appendix D A White Noise Model of a Pseudo Random Binary Sequence 356 REFERENCES 396 - 6 - List of Figures 2.3.1 First Order Non-Linear Regulator with Disturbances 2.3.2 Variation of Limiting Boundary Condition Es with h 2.3.3 Variation of a Parameter of Gk Series with h 2.3.4 Transient Solution from a Delta Function 2.3.5 Time Solution of FP Equation, Noiseless Zero Measurement 2.3.6 Time Solution of FP Equation, Noisy Non-zero Measurement 2.3.7 Growth of System Uncertainty with Time (Output Variance) 2.3.8 Probability that System Exceeds Tolerance Band of t 2 2.3.9 Time Until Pr( (XI > 2) Exceeds 5% 2.4.1 Transient Solution of FP Equation by Hermite Transforms 3.2.1 Continuous Trajectories of a Markov Process 3.2.2 Solution of Heat Conduction Equation Across a Discontinuity 3.2.3 Imposed Boundary Conditions for K1 Discontinuity 3.2.4 Heat Conduction Example with Material Discontinuity 3.2.5 Behaviour of Trajectory near Material Boundary 3.2.6 Transient Solution of Heat Conduction Example 3.2.7 Average 'Temperature in Steel Region 4.1.1 Accuracy of Diffusion Model of Filtered PRBS 5.1.1 Generation of an Arbitrary Non-Stationary Noise Source 5.1.2 An Asymmetrical Noise Source 5.2.1 Analogue Simulation of Equation (5.2.2) 5.2.2 Analogue Simulation of Non-Linear Filter of Equation (5.2.23) 5.2.3 Analogue Simulation of Non-Linear Filter of Equation (5.2.24) 5.2.4 Analogue Simulation of Equation (5.2.29) 5.2.5 Experimental Determination of Characteristic Matrix 5.2.6 Normalised Correlation Function of Two Dimensional Noise Source 6.1.1 Correlation Function of Piecewise Constant Noise 6.2.1 Steps in the Convergence of a Digital Computer Simulation to a Diffusion Process 6.2.2 Absolute Sample Path Error vs. At 6.2.3 Accuracy of Estimated Distribution for Fixed Number of Samples 6.2.4 Sample Path Accuracy of Euler and Runge-Kutta Formulae Applied to Stochastic Equations 6.2.5 Distributions obtained from Correct and Incorrect Simulations of 6.3.1 RMS Value of Expansion Coefficients Eqn. 6.2.4. 6.3.2 Error in Density as a Function of Size of Expansion Coefficients 6.3.3 Monte Carlo Solution of Figure 2.3.5 Example - 7 - Glossary of Princizal Symbols A(t), A*(t) characteristic matrices of physical noise process (4.1.21, 30) a(x,t) second incremental moment of diffusion process (1.2.2) a coefficient of linear system (6.1.4) B(t) noise scaling matrix B BT = A + A* (4.1.39) ti b(x,t) first incremer_tal moment of diffusion process (1.2.2) b. coefficient of linear system (4.3.1) b coefficient of linear system (6.1.4) C noise scaling matrix (4.4.6) c(t) forcing function of linear system (4.3.1) c piecewise constant random coefficient (6.1.6), (6.2.13) 2D(t) intensity matrix of noise process = A + A* d.
Recommended publications
  • P</Emphasis>-Variation, Calculus, and Index Estimation
    Lithuanian Mathematical Journal, Vol. 46, No. 1, 2006 ROUGH FUNCTIONS: p-VARIATION, CALCULUS, AND INDEX ESTIMATION R. Norvaiša Institute of Mathematics and Informatics, Akademijos 4, LT-08663 Vilnius; Vilnius University, Naugarduko 24, LT-03225 Vilnius, Lithuania (e-mail: [email protected]) Abstract. In this paper, we give an overview of several dissipated results on the p-variation property of a function presented in a suitable way. More specifically, we attempt to show: (1) usefulness of this property in a calculus of rough functions; (2) a relatively thorough knowledge of the p-variation property of a sample function of basic stochastic processes; and (3) an almost unexplored area of statistical analysis seeking to estimate the p-variation index. Keywords: -variation, interval functions, refinement Young–Stieltjes integral, Kolmogorov integral, product integral, Nemyt- skii operator, integral equations, sample functions of stochastic processes, p-variation index, Orey index, oscillation summing index. 1. INTRODUCTION The p-variation is a generalization of the total variation of a function. More specifically, for 0 <p<∞ and −∞ <a<b<+∞,thep-variation of a real-valued function f on an interval [a,b] is vp(f ) := vp f ;[a,b] n p := sup f(ti) − f(ti−1) : a = t0 <t1 < ···<tn = b, n 1 . (1) i=1 We say that f has bounded p-variation if vp(f ) < ∞. Thus, a function has bounded total variation if it has bounded 1-variation. A regulated function f is called rough if it has infinite 1-variation, that is, if v1(f ) =+∞. The p-variation gives a convenient way to measure a degree of roughness.
    [Show full text]
  • Appendix Nonatomic Measure Spaces
    Appendix Nonatomic Measure Spaces In this appendix we collect some facts about finite measure spaces without (and with) atoms, which are applied in Chapter 7. Let (Ω, , µ) be a σ-finite measure space. Then an atom of µ is a set A with Sµ(A) > 0 such that for all C with C A, either µ(C) = 0 or µ(C∈) S = µ(A). By σ-finiteness, we have µ∈(A S) < + .(⊂Ω, , µ) or µ is called nonatomic if it has no atoms. ∞ S Proposition A.1. Let (Ω, , µ) be a nonatomic finite measure space with µ(Ω) > 0. Then for any cSwith 0 < c < µ(Ω), there is an A with µ(A) = c. ∈ S Proof. We can assume that µ(Ω) = 1. It will first be shown that for some C , 1/3 µ(C) 2/3. Suppose not. Let p := sup µ(B): µ(B) < 1/3 1/3.∈ SThen p≤ > 0 since≤Ω is not an atomand if 2/3 < µ({D) < 1, let B := Ω }D ≤. Take B with µ(B ) p. Let E := n B . It will be shown by induction\ n ∈ S n ↑ n j=1 j that µ(En) < 1/3 for all n. This is true for n = 1. Assuming it holds for a given n, we have µ(E ) = µ(E BS ) < (1/3)+(1/3) = 2/3. Thus by the n+1 n ∪ n+1 assumption that µ takes no values in [1/3, 2/3], µ(En+1) < 1/3, completing ∞ the induction. Let E := n=1 Bn.
    [Show full text]
  • FINITE ADDITIVITY VERSUS COUNTABLE ADDITIVITY: De FINETTI and SAVAGE
    FINITE ADDITIVITY VERSUS COUNTABLE ADDITIVITY: De FINETTI AND SAVAGE N. H. BINGHAM Electronic J. History of Probability and Statistics 6.1 (2010), 33p R´esum´e L'arri`ere-planhistorique, d'abord de l'additivit´ed´enombrable et puis de l'additivit´efinie, est ´etudi´eici. Nous discutons le travail de de Finetti (en particulier, son livre posthume, de Finetti (2008)), mais aussi les travaux de Savage. Tous deux sont surtout (re)connus pour leurs contributions au domaine des statistiques; nous nous int´eressonsici `aleurs apports du point de vue de la th´eoriedes probabilit´es.Le probl`emede mesure est discut´e{ la possibilit´ed'´etendreune mesure `a tout sous-ensemble d'un espace de proba- bilit´e. La th´eoriedes jeux de hasard est ensuite pr´esent´eepour illustrer les m´eritesrelatifs de l'additivit´efinie et d´enombrable. Puis, nous consid´eronsla coh´erencedes d´ecisions,o`uun troisi`emecandidat apparait { la non-additivit´e. Nous ´etudionsalors l’influence de diff´erents choix d'axiomes de la th´eoriedes ensembles. Nous nous adressons aux six raisons avanc´espar Seidenfeld (2001) `al'appui de l'additivit´efinie, et faisons la critique des plusi`eresapproches `a la fr´equencelimite. Abstract The historical background of first countable additivity, and then finite ad- ditivity, in probability theory is reviewed. We discuss the work of the most prominent advocate of finite additivity, de Finetti (in particular, his posthu- mous book de Finetti (2008)), and also the work of Savage. Both were most noted for their contributions to statistics; our focus here is more from the point of view of probability theory.
    [Show full text]
  • Burgin M. Hypernumbers and Extrafunctions.. Extending The
    SpringerBriefs in Mathematics SpringerBriefs in Mathematics Series Editors Krishnaswami Alladi Nicola Bellomo Michele Benzi Tatsien Li Matthias Neufang Otmar Scherzer Dierk Schleicher Benjamin Steinberg Yuri Tschinkel Loring W. Tu George Yin Ping Zhang SpringerBriefs in Mathematics showcase expositions in all areas of mathematics and applied mathematics. Manuscripts presenting new results or a single new result in a classical field, new field, or an emerging topic, applications, or bridges between new results and already published works, are encouraged. The series is intended for mathematicians and applied mathematicians. For further volumes: http://www.springer.com/series/10030 Mark Burgin Hypernumbers and Extrafunctions Extending the Classical Calculus Mark Burgin Department of Mathematics University of California Los Angeles, CA 90095, USA ISSN 2191-8198 ISSN 2191-8201 (electronic) ISBN 978-1-4419-9874-3 ISBN 978-1-4419-9875-0 (eBook) DOI 10.1007/978-1-4419-9875-0 Springer New York Heidelberg Dordrecht London Library of Congress Control Number: 2012935428 Mathematics Subject Classification (2010): 46A45, 46G05, 46G12, 46H30, 46F10, 46F30 # Mark Burgin 2012 This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. Exempted from this legal reservation are brief excerpts in connection with reviews or scholarly analysis or material supplied specifically for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work.
    [Show full text]
  • Author Index ______
    ______AUTHOR INDEX ______ a space; Homology group; Infinite­ Arellano, E. Ramirez de see: Ramirez de form in logarithms; Siegel theorem; dimensional space; Local decompo­ Arellano, E. Transcendental number sition; Metrizable space; Pontryagin __A __ Argand, J .R. see: Arithmetic; Complex Ball, R. see: Helical calculus duality; Projection spectrum; Suslin number; Imaginary number Balusabramanian, R. see: Waring prob­ theorem; Topological space; Width Aristotle see: Modal logic; Space-time lem Abel, N.H. see: Abel differential Alexander, J.W. see: Alexander dual­ Arkhangel'skil, A.V. see: Feathering Banach, S. see: Area; Banach indica­ equation; Abel-Goncharov prob­ ity; Alexander invariants; Duality; Arno I'd, V.I. see: Composite function; trix; Banach-Mazur functional; Ba­ lem; Abel problem; Abel theorem; Homology group; Jordan theorem; Quasi-periodic motion nach space; Banach-Steinhaus the­ Abel transformation; Abelian group; Knot theory; Manifold; Pontryagin Arsenin, V. Ya. see: Descriptive set the­ orem; Completely-continuous oper­ Abelian integral; Abelian variety; duality; Reaction-diffusion equation; ory ator; Contracting-mapping princi­ Algebra; Algebraic equation; Alge­ Topology of imbeddings Artin, E. see: Abstract algebraic ge­ ple; Franklin system; Hahn-Banach braic function; Algebraic geometry; Alexandrov, A.B. see: Boundary prop­ ometry; Algebra; Algebraic number theorem; Lacunary system; Linear Binomial series; Convergence, types erties of analytic functions theory; Alternative rings and alge­ operator; Luzin N -property; Non­ of; Elliptic function; Finite group; Alling, N.L. see: Surreal numbers bras; Commutative algebra; Con­ differentiable function; Nuclear op­ Galois theory; Group; Interpola­ Almgren, F.J. see: Plateau problem, gruence modulo a prime number; erator; Open-mapping theorem; Or­ tion; Inversion of an elliptic integral; multi-dimensional Divisorial ideal; Foundations of ge­ thogonal series; Tonelli plane vari­ Jacobi elliptic functions; Liouville­ Alvarez-Gaume, L.
    [Show full text]
  • Bibliographical and Historical Comments
    Bibliographical and Historical Comments One gets a strange feeling having seen the same drawings as if drawn by the same hand in the works of four schol- ars that worked completely independently of each other. An involuntary thought comes that such a striking, myste- rious activity of mankind, lasting several thousand years, cannot be occasional and must have a certain goal. Having acknowledged this, we come by necessity to the question: what is this goal? I.R. Shafarevich. On some tendencies of the develop- ment of mathematics. However, also in my contacts with the American Shake- speare scholars I confined myself to the concrete problems of my research: dating, identification of prototypes, direc- tions of certain allusions. I avoided touching the problem of personality of the Great Bard, the “Shakespeare prob- lem”; neither did I hear those scholars discussing such a problem between themselves. I.M. Gililov. A play about William Shakespeare or the Mystery of the Great Phoenix. The extensive bibliography in this book covers, however, only a small portion of the existing immense literature on measure theory; in particular, many authors are represented by a minimal number of their most character- istic works. Guided by the proposed brief comments and this incomplete list, the reader, with help of modern electronic data-bases, can considerably en- large the bibliography. The list of books is more complete (although it cannot pretend to be absolutely complete). For the reader’s convenience, the bibli- ography includes the collected (or selected) works of A.D. Alexandrov [15], R. Baire [47], S. Banach [56], E.
    [Show full text]
  • School of Economics, Mathematics and Statistics Birkbeck College
    MATHEMATICAL METHODS I MSC FINANCIAL ENGINEERING RAYMOND BRUMMELHUIS School of Economics, Mathematics and Statistics Birkbeck College Autumn Term 2004-2005 1. Introduction Market prices of liquidly traded financial assets depend on a huge number of factors: macro-economic ones like interest rates, inflation, balanced or unbalanced budgets, micro-economic and business-specific factors like flexibility of labor markets, sale numbers, investments, and also on more elusive psychological factors like the aggregate expec- tations, illusions and disillusions of the various market players, both professional ones (stock brokers, market makers, fund managers, banks and institutional investors like pension funds), and humble private in- vestors (like professors of finance, seeking to complement their modest revenue). Although many people have dreamed (and still do dream) of all-encompassing deterministic models for, for example, stock prices, the number of potentially influencing factors seems to high to realis- tically hope for such a thing. Already in the first half of the 20-th century researchers began to realize that a statistical approach to fi- nancial markets might be the best one. This started in fact right at the beginning of the century, in 1900, when a young French mathe- matician, Louis Bachelier, defended a thesis at the Sorbonne in Paris, France, on a probabilistic model of the French bourse. In his thesis, he developed the first mathematical model of what later came to be known as ”Brownian motion”, with the specific aim of giving a sta- tistical description of the prices of financial transactions on the Paris stock market. The phrase with which he ended his thesis, that ”the bourse, without knowing it, follows the laws of probability”, are still a guiding principle of modern quantitative finance.
    [Show full text]
  • Albanese C., Campolieti G. Advanced Derivatives Pricing and Risk
    Advanced Derivatives Pricing and Risk Management ThisPageIntentionallyLeftBlank ADVANCED DERIVATIVES PRICING AND RISK MANAGEMENT Theory, Tools and Hands-On Programming Application Claudio Albanese and Giuseppe Campolieti AMSTERDAM • BOSTON • HEIDELBERG • LONDON NEW YORK • OXFORD • PARIS • SAN DIEGO SAN FRANCISCO • SINGAPORE • SYDNEY • TOKYO Elsevier Academic Press 30 Corporate Drive, Suite 400, Burlington, MA 01803, USA 525 B Street, Suite 1900, San Diego, California 92101-4495, USA 84 Theobald’s Road, London WC1X 8RR, UK This book is printed on acid-free paper. Copyright © 2006, Elsevier Inc. All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Permissions may be sought directly from Elsevier’s Science & Technology Rights Department in Oxford, UK: phone: (+44) 1865 843830, fax: (+44) 1865 853333, e-mail: [email protected]. You may also complete your request online via the Elsevier homepage (http://elsevier.com), by selecting “Customer Support” and then “Obtaining Permissions.” Library of Congress Cataloging-in-Publication Data Application Submitted British Library Cataloguing in Publication Data A catalogue record for this book is available from the British Library ISBN 13: 978-0-12-047682-4 ISBN 10: 0-12-047682-7 The content of this book is presented solely for educational purposes. Neither the authors nor Elsevier/Academic Press accept any responsibility or liability for loss or damage arising from any application of the material, methods or ideas, included in any part of the theory or software contained in this book.
    [Show full text]
  • Finite Additivity Versus Countable Additivity N
    Journ@l Electronique d’Histoire des Probabilités et de la Statistique Electronic Journ@l for History of Probability and Statistics Vol 6, n°1; Juin/June 2010 www.jehps.net FINITE ADDITIVITY VERSUS COUNTABLE ADDITIVITY N. H. BINGHAM1 R´esum´e L’arri`ere-plan historique, d’abord de l’additivit´ed´enombrable puis de l’additivit´e finie, est ´etudi´eici. Nous discutons le travail de de Finetti, mais aussi les travaux de Savage. Tous deux sont surtout (re)connus pour leurs contributions au domaine des statistiques; nous nous int´eressons ici `aleurs apports du point de vue de la th´eorie des probabilit´es.Le probl`emede mesure est discut´e– la possibilit´ed’´etendre une mesure `a tout sous-ensemble d’un espace de probabilit´e. La th´eorie des jeux de hasard est ensuite pr´esent´eepour illustrer les m´erites relatifs de l’additivit´efinie et d´enombrable. Puis, nous consid´erons la coh´erence des d´ecisions, o`uun troisi`eme candidat apparait – la non-additivit´e. Nous ´etudions alors l’influence de diff´erents choix d’axiomes de la th´eorie des ensembles. Abstract The historical background of first countable additivity, and then finite additivity, in probability theory is reviewed. We discuss the work of the most prominent advocate of finite additivity, de Finetti, and also the work of Savage. Both were most noted for their contributions to statistics; our focus here is more from the point of view of probability theory. The problem of measure is then discussed – the possibility of extending a measure to all subsets of a probability space.
    [Show full text]