Stochastic Versus Uncertainty Modeling

Total Page:16

File Type:pdf, Size:1020Kb

Stochastic Versus Uncertainty Modeling Introduction Analytical Solutions The Cloud Model Conclusions Stochastic versus Uncertainty Modeling Petra Friederichs, Michael Weniger, Sabrina Bentzien, Andreas Hense Meteorological Institute, University of Bonn Dynamics and Statistic in Weather and Climate Dresden, July 29-31 2009 P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 1 / 21 Introduction Analytical Solutions Motivation The Cloud Model Outline Conclusions Uncertainty Modeling I Initial conditions { aleatoric uncertainty Ensemble with perturbed initial conditions I Model error { epistemic uncertainty Perturbed physic and/or multi model ensembles Simulations solving deterministic model equations! P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 2 / 21 Introduction Analytical Solutions Motivation The Cloud Model Outline Conclusions Stochastic Modeling I Stochastic parameterization { aleatoric uncertainty Stochastic model ensemble I Initial conditions { aleatoric uncertainty Ensemble with perturbed initial conditions I Model error { epistemic uncertainty Perturbed physic and/or multi model ensembles Simulations solving stochastic model equations! P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 3 / 21 Introduction Analytical Solutions Motivation The Cloud Model Outline Conclusions Outline Contrast both concepts I Analytical solutions of simple damping equation dv(t) = −µv(t)dt I Simplified, 1-dimensional, time-dependent cloud model I Problems P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 4 / 21 Introduction Perturbed Physics Analytical Solutions Stochastic Model The Cloud Model Conclusions Conclusions Equation of Motion Small particle of mass m with velocity v(t) Subject to damping force F (t) = −µm · v(t) dv(t) = −µv(t)dt Solution of deterministic problem v(t) = v0 exp(−µt) P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 5 / 21 Introduction Perturbed Physics Analytical Solutions Stochastic Model The Cloud Model Conclusions Conclusions 1.0 'Perturbed Physics' 0.8 deterministic γ is random variable normal 0.6 uniform gamma v 0.4 dv(t) = −γv(t)dt: 0.2 Solutions for different γ 0.0 0.0 0.5 1.0 1.5 2.0 t 2 2 σ 2 γN ∼ N (µ, σ ) E[vN (t)] = v0 exp − µt + t 2p p sinh( 3σt) γU ∼ U µ ± 3σ E[vU (t)] = v0 exp(−µt) p 3σt µ2 σ2 −µt −µ2/σ2 γ ∼ Γ ; E[v (t)] = v 1 − Γ σ2 µ Γ 0 µ2/σ2 P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 6 / 21 Introduction Perturbed Physics Analytical Solutions Stochastic Model The Cloud Model Conclusions Conclusions Stochastic Model Damping from small-scale stochastic process dv(t) = −µv(t)dt + v(t)σξdt; ξt : Langevin force with E[ξt ] = 0 and Cov[ξs ; ξt ] = δ(t − s) Stratonovich calculus dvt = −µvt dt + σvt ◦ dWt Solution vt = v0 exp − µt + σWt (exponential Brownian motion) P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 7 / 21 Introduction Perturbed Physics Analytical Solutions Stochastic Model The Cloud Model Conclusions Conclusions Exponential Brownian motion σ2 E[v ] = v exp − µ − t t 0 2 h σ2 i Varv = v 2 exp − 2µ − σ2t − exp − 2µ − t t 0 2 Three realisation of an exponential Brownian motion with µ=2, σ2=1 Three realisation of an exponential Brownian motion with µ=2, σ2=3 2 6 det. solution det. solution mean value mean value 1.8 5 1.6 1.4 4 1.2 t t v 1 v 3 0.8 2 0.6 0.4 1 0.2 0 0 0 0.5 1 1.5 2 2.5 3 0 1 2 3 4 5 6 Time t Time t P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 8 / 21 Introduction Perturbed Physics Analytical Solutions Stochastic Model The Cloud Model Conclusions Conclusions Non-delta Correlated Gaussian Noise dv(t) = −µdt + v(t)t v(t)dt Solution Z t vt = v0 exp − µt + s ds 0 Noise t with D E[ ] = 0; Cov[ ; ] = exp(−kjt − sj): t s t 2k is an Ornstein-Uhlenbeck process solving p dt = −kt dt + DdWt P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 9 / 21 Introduction Perturbed Physics Analytical Solutions Stochastic Model The Cloud Model Conclusions Conclusions Non-delta Correlated Gaussian Noise D 1 − e−kt E[v ] = v exp − µt + t − t 0 2k2 k D = 2k D = k2 1.0 1.0 deterministic deterministic 0.8 det. normal 0.8 det. normal Expon. Brownian Expon. Brownian OU(k=0.01) OU(k=0.01) 0.6 OU(k=1) 0.6 OU(k=1) OU(k=100) OU(k=100) v v 0.4 0.4 0.2 0.2 0.0 0.0 0.0 0.5 1.0 1.5 2.0 0.0 0.5 1.0 1.5 2.0 t t P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 10 / 21 Introduction Perturbed Physics Analytical Solutions Stochastic Model The Cloud Model Conclusions Conclusions D = 2k D = k2 P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 11 / 21 Introduction Perturbed Physics Analytical Solutions Stochastic Model The Cloud Model Conclusions Conclusions 'Perturbed physics' E[v(t)] ! 1 for t ! 1 for all parameter distributions with non-positive support Stochastic model Exponential Brownian motion: 2 2 I Non-stable solutions (σ > 2µ), increasing variance (σ > µ) OU noise: I Noise induced drift increases with 1=k (D = 2k) I 'Perturbed physics' solution for k ! 0 (D = 2k) 2 I Exponential Brownian motion for k ! 1 (D = k ) P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 12 / 21 Introduction Model Description Analytical Solutions Perturbed Physics The Cloud Model Stochastic Parameterization Conclusions 1-dimensional Cloud Model I Cylinder - constant radius I Horizontally homogen in constant environment I Prognostic equations for w(z), T (z), qv (z), qc (z), qr (z) Fig: Dynamics of Multiscale Earth Systems, C.Simmer(Eds.) P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 13 / 21 Introduction Model Description Analytical Solutions Perturbed Physics The Cloud Model Stochastic Parameterization Conclusions Koeln 04.07.1994 RR=11,723mm 10 g/kg 9 4 8 0.6 7 3 6 2 0.2 5 0.4 2 2 Hoehe in km 4 1.8 3 1.6 1.4 mm/h 1.2 1 1 2 0.8 40 0.4 0.2 30 1 20 10 0 0 0 0 10 20 30 40 50 60 70 80 90 Zeit in min P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 14 / 21 Introduction Model Description Analytical Solutions Perturbed Physics The Cloud Model Stochastic Parameterization Conclusions 1 @(ρw) 2 0 = − − u~ ρ @z R „ « @w @w 2 2 2 Tv − Tv;e = −w + α jwe − wj(we − w) + (w − w~ )~u + g − (qc + qr )g @t @z R R Tv;e @T @T 2 2 2 = −w + α jwe − wj(Te − T ) + (T − T~ )~u − Γ w + SS @t @z R R d T @qv @qv 2 2 2 dqv = −w + α jwe − wj(qv;e − qv ) + (qv − q~v )~u − @t @z R R dt @qc @qc 2 2 2 dqc = −w + α jwe − wj(qc;e − qc ) + (qc − q~c )~u − @t @z R R dt @qr @qr 2 2 2 dqr @r qr @(ρVR ) = −w + α jwe − wj(qr;e qr ) + (qr − q~r )~u − + V + @t @z R R dt R @z ρ @z | {z } | {z } | {z } | {z } advection turbulent entrainment dynamical entr. sources P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 15 / 21 Introduction Model Description Analytical Solutions Perturbed Physics The Cloud Model Stochastic Parameterization Conclusions Micro-physical processes after Kessler (1969) ... Fig: von der Emde, Kahlig (1989) P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 16 / 21 Introduction Model Description Analytical Solutions Perturbed Physics The Cloud Model Stochastic Parameterization Conclusions ? Condensation: dqv ? qv − qvws 1 − ? = 2 · for qv > qvws dt ? "Lc qvws ∆t qv ! qc VC 1 + 2 cpRaT ? dqc ? Conversion: − ? = kc (qc − qc;0) for qc > qc;0 dt ?CR q ! q AU 1 −3 c r qc;0 = ρ , kc = 10 ? dqc ? π −(3+βr ) − ? = Eαr n0;r qc · λ · Γ(3 + βr ) dt ? 4 Accretion: CRAC qc ! qr E = 1 collection efficiency, αr , βr ;n0;r : Marshall-Palmer (3+βr ) 4 λ−(3+βr ) = ρqr πρps n0;r P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 17 / 21 Introduction Model Description Analytical Solutions Perturbed Physics The Cloud Model Stochastic Parameterization Conclusions Perturbed Physics kc ! kc (1 + η) E ! E (1 + η) 15 15 14 14 13 13 12 12 11 11 10 10 9 9 8 8 7 7 rain in mm 6 rain in mm 6 5 5 4 4 3 3 2 2 1 Conversion 1 Accretion 0 0 −1 0 1 2 −1 0 1 2 P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 18 / 21 Introduction Model Description Analytical Solutions Perturbed Physics The Cloud Model Stochastic Parameterization Conclusions Perturbed Physics 0.05 Conversion 0.12 Accretion 0.10 0.04 0.08 0.03 0.06 density density 0.02 0.04 0.01 0.02 0.00 0.00 11.4 11.6 11.8 12 12.2 12.4 12.6 12.8 13 13.2 13.4 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 rain in mm rain in mm Introduction Analytical Solutions The Cloud Model = Conclusions P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 19 / 21 Introduction Model Description Analytical Solutions Perturbed Physics The Cloud Model Stochastic Parameterization Conclusions Stochastic Parameterization (solved with Milstein Scheme) kc ! kc (1 + ξt ) E ! E (1 + ξt ) 0.08 Conversion 0.05 Accretion 0.04 0.06 0.03 0.04 density density 0.02 0.02 0.01 0.00 0.00 11.64 11.68 11.72 11.76 11.8 11.2 11.4 11.6 11.8 12 12.2 12.4 rain in mm rain in mm P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 20 / 21 Introduction Analytical Solutions The Cloud Model Conclusions Conclusions and Outlook I 'Perturbed physics' ensembles do not represent realizations from real process I Stochastic parameterization may provide realistic distributions I Solutions strongly depend on covariance function of noise (in time and in space) I Stochastic parameterizations should be derived from microphysical processes P.Friederichs, M.Weniger, S.Bentzien, A.Hense Stochastic versus Uncertainty Modeling 21 / 21.
Recommended publications
  • A New Approach for Dynamic Stochastic Fractal Search with Fuzzy Logic for Parameter Adaptation
    fractal and fractional Article A New Approach for Dynamic Stochastic Fractal Search with Fuzzy Logic for Parameter Adaptation Marylu L. Lagunes, Oscar Castillo * , Fevrier Valdez , Jose Soria and Patricia Melin Tijuana Institute of Technology, Calzada Tecnologico s/n, Fracc. Tomas Aquino, Tijuana 22379, Mexico; [email protected] (M.L.L.); [email protected] (F.V.); [email protected] (J.S.); [email protected] (P.M.) * Correspondence: [email protected] Abstract: Stochastic fractal search (SFS) is a novel method inspired by the process of stochastic growth in nature and the use of the fractal mathematical concept. Considering the chaotic stochastic diffusion property, an improved dynamic stochastic fractal search (DSFS) optimization algorithm is presented. The DSFS algorithm was tested with benchmark functions, such as the multimodal, hybrid, and composite functions, to evaluate the performance of the algorithm with dynamic parameter adaptation with type-1 and type-2 fuzzy inference models. The main contribution of the article is the utilization of fuzzy logic in the adaptation of the diffusion parameter in a dynamic fashion. This parameter is in charge of creating new fractal particles, and the diversity and iteration are the input information used in the fuzzy system to control the values of diffusion. Keywords: fractal search; fuzzy logic; parameter adaptation; CEC 2017 Citation: Lagunes, M.L.; Castillo, O.; Valdez, F.; Soria, J.; Melin, P. A New Approach for Dynamic Stochastic 1. Introduction Fractal Search with Fuzzy Logic for Metaheuristic algorithms are applied to optimization problems due to their charac- Parameter Adaptation. Fractal Fract. teristics that help in searching for the global optimum, while simple heuristics are mostly 2021, 5, 33.
    [Show full text]
  • Introduction to Stochastic Processes - Lecture Notes (With 33 Illustrations)
    Introduction to Stochastic Processes - Lecture Notes (with 33 illustrations) Gordan Žitković Department of Mathematics The University of Texas at Austin Contents 1 Probability review 4 1.1 Random variables . 4 1.2 Countable sets . 5 1.3 Discrete random variables . 5 1.4 Expectation . 7 1.5 Events and probability . 8 1.6 Dependence and independence . 9 1.7 Conditional probability . 10 1.8 Examples . 12 2 Mathematica in 15 min 15 2.1 Basic Syntax . 15 2.2 Numerical Approximation . 16 2.3 Expression Manipulation . 16 2.4 Lists and Functions . 17 2.5 Linear Algebra . 19 2.6 Predefined Constants . 20 2.7 Calculus . 20 2.8 Solving Equations . 22 2.9 Graphics . 22 2.10 Probability Distributions and Simulation . 23 2.11 Help Commands . 24 2.12 Common Mistakes . 25 3 Stochastic Processes 26 3.1 The canonical probability space . 27 3.2 Constructing the Random Walk . 28 3.3 Simulation . 29 3.3.1 Random number generation . 29 3.3.2 Simulation of Random Variables . 30 3.4 Monte Carlo Integration . 33 4 The Simple Random Walk 35 4.1 Construction . 35 4.2 The maximum . 36 1 CONTENTS 5 Generating functions 40 5.1 Definition and first properties . 40 5.2 Convolution and moments . 42 5.3 Random sums and Wald’s identity . 44 6 Random walks - advanced methods 48 6.1 Stopping times . 48 6.2 Wald’s identity II . 50 6.3 The distribution of the first hitting time T1 .......................... 52 6.3.1 A recursive formula . 52 6.3.2 Generating-function approach .
    [Show full text]
  • 1 Stochastic Processes and Their Classification
    1 1 STOCHASTIC PROCESSES AND THEIR CLASSIFICATION 1.1 DEFINITION AND EXAMPLES Definition 1. Stochastic process or random process is a collection of random variables ordered by an index set. ☛ Example 1. Random variables X0;X1;X2;::: form a stochastic process ordered by the discrete index set f0; 1; 2;::: g: Notation: fXn : n = 0; 1; 2;::: g: ☛ Example 2. Stochastic process fYt : t ¸ 0g: with continuous index set ft : t ¸ 0g: The indices n and t are often referred to as "time", so that Xn is a descrete-time process and Yt is a continuous-time process. Convention: the index set of a stochastic process is always infinite. The range (possible values) of the random variables in a stochastic process is called the state space of the process. We consider both discrete-state and continuous-state processes. Further examples: ☛ Example 3. fXn : n = 0; 1; 2;::: g; where the state space of Xn is f0; 1; 2; 3; 4g representing which of four types of transactions a person submits to an on-line data- base service, and time n corresponds to the number of transactions submitted. ☛ Example 4. fXn : n = 0; 1; 2;::: g; where the state space of Xn is f1; 2g re- presenting whether an electronic component is acceptable or defective, and time n corresponds to the number of components produced. ☛ Example 5. fYt : t ¸ 0g; where the state space of Yt is f0; 1; 2;::: g representing the number of accidents that have occurred at an intersection, and time t corresponds to weeks. ☛ Example 6. fYt : t ¸ 0g; where the state space of Yt is f0; 1; 2; : : : ; sg representing the number of copies of a software product in inventory, and time t corresponds to days.
    [Show full text]
  • Monte Carlo Sampling Methods
    [1] Monte Carlo Sampling Methods Jasmina L. Vujic Nuclear Engineering Department University of California, Berkeley Email: [email protected] phone: (510) 643-8085 fax: (510) 643-9685 UCBNE, J. Vujic [2] Monte Carlo Monte Carlo is a computational technique based on constructing a random process for a problem and carrying out a NUMERICAL EXPERIMENT by N-fold sampling from a random sequence of numbers with a PRESCRIBED probability distribution. x - random variable N 1 xˆ = ---- x N∑ i i = 1 Xˆ - the estimated or sample mean of x x - the expectation or true mean value of x If a problem can be given a PROBABILISTIC interpretation, then it can be modeled using RANDOM NUMBERS. UCBNE, J. Vujic [3] Monte Carlo • Monte Carlo techniques came from the complicated diffusion problems that were encountered in the early work on atomic energy. • 1772 Compte de Bufon - earliest documented use of random sampling to solve a mathematical problem. • 1786 Laplace suggested that π could be evaluated by random sampling. • Lord Kelvin used random sampling to aid in evaluating time integrals associated with the kinetic theory of gases. • Enrico Fermi was among the first to apply random sampling methods to study neutron moderation in Rome. • 1947 Fermi, John von Neuman, Stan Frankel, Nicholas Metropolis, Stan Ulam and others developed computer-oriented Monte Carlo methods at Los Alamos to trace neutrons through fissionable materials UCBNE, J. Vujic Monte Carlo [4] Monte Carlo methods can be used to solve: a) The problems that are stochastic (probabilistic) by nature: - particle transport, - telephone and other communication systems, - population studies based on the statistics of survival and reproduction.
    [Show full text]
  • Random Numbers and Stochastic Simulation
    Stochastic Simulation and Randomness Random Number Generators Quasi-Random Sequences Scientific Computing: An Introductory Survey Chapter 13 – Random Numbers and Stochastic Simulation Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction permitted for noncommercial, educational use only. Michael T. Heath Scientific Computing 1 / 17 Stochastic Simulation and Randomness Random Number Generators Quasi-Random Sequences Stochastic Simulation Stochastic simulation mimics or replicates behavior of system by exploiting randomness to obtain statistical sample of possible outcomes Because of randomness involved, simulation methods are also known as Monte Carlo methods Such methods are useful for studying Nondeterministic (stochastic) processes Deterministic systems that are too complicated to model analytically Deterministic problems whose high dimensionality makes standard discretizations infeasible (e.g., Monte Carlo integration) < interactive example > < interactive example > Michael T. Heath Scientific Computing 2 / 17 Stochastic Simulation and Randomness Random Number Generators Quasi-Random Sequences Stochastic Simulation, continued Two main requirements for using stochastic simulation methods are Knowledge of relevant probability distributions Supply of random numbers for making random choices Knowledge of relevant probability distributions depends on theoretical or empirical information about physical system being simulated By simulating large number of trials, probability
    [Show full text]
  • Nash Q-Learning for General-Sum Stochastic Games
    Journal of Machine Learning Research 4 (2003) 1039-1069 Submitted 11/01; Revised 10/02; Published 11/03 Nash Q-Learning for General-Sum Stochastic Games Junling Hu [email protected] Talkai Research 843 Roble Ave., 2 Menlo Park, CA 94025, USA Michael P. Wellman [email protected] Artificial Intelligence Laboratory University of Michigan Ann Arbor, MI 48109-2110, USA Editor: Craig Boutilier Abstract We extend Q-learning to a noncooperative multiagent context, using the framework of general- sum stochastic games. A learning agent maintains Q-functions over joint actions, and performs updates based on assuming Nash equilibrium behavior over the current Q-values. This learning protocol provably converges given certain restrictions on the stage games (defined by Q-values) that arise during learning. Experiments with a pair of two-player grid games suggest that such restric- tions on the game structure are not necessarily required. Stage games encountered during learning in both grid environments violate the conditions. However, learning consistently converges in the first grid game, which has a unique equilibrium Q-function, but sometimes fails to converge in the second, which has three different equilibrium Q-functions. In a comparison of offline learn- ing performance in both games, we find agents are more likely to reach a joint optimal path with Nash Q-learning than with a single-agent Q-learning method. When at least one agent adopts Nash Q-learning, the performance of both agents is better than using single-agent Q-learning. We have also implemented an online version of Nash Q-learning that balances exploration with exploitation, yielding improved performance.
    [Show full text]
  • Stochastic Optimization,” in Handbook of Computational Statistics: Concepts and Methods (2Nd Ed.) (J
    Citation: Spall, J. C. (2012), “Stochastic Optimization,” in Handbook of Computational Statistics: Concepts and Methods (2nd ed.) (J. Gentle, W. Härdle, and Y. Mori, eds.), Springer−Verlag, Heidelberg, Chapter 7, pp. 173–201. dx.doi.org/10.1007/978-3-642-21551-3_7 STOCHASTIC OPTIMIZATION James C. Spall The Johns Hopkins University Applied Physics Laboratory 11100 Johns Hopkins Road Laurel, Maryland 20723-6099 U.S.A. [email protected] Stochastic optimization algorithms have been growing rapidly in popularity over the last decade or two, with a number of methods now becoming “industry standard” approaches for solving challenging optimization problems. This chapter provides a synopsis of some of the critical issues associated with stochastic optimization and a gives a summary of several popular algorithms. Much more complete discussions are available in the indicated references. To help constrain the scope of this article, we restrict our attention to methods using only measurements of the criterion (loss function). Hence, we do not cover the many stochastic methods using information such as gradients of the loss function. Section 1 discusses some general issues in stochastic optimization. Section 2 discusses random search methods, which are simple and surprisingly powerful in many applications. Section 3 discusses stochastic approximation, which is a foundational approach in stochastic optimization. Section 4 discusses a popular method that is based on connections to natural evolution—genetic algorithms. Finally, Section 5 offers some concluding remarks. 1 Introduction 1.1 General Background Stochastic optimization plays a significant role in the analysis, design, and operation of modern systems. Methods for stochastic optimization provide a means of coping with inherent system noise and coping with models or systems that are highly nonlinear, high dimensional, or otherwise inappropriate for classical deterministic methods of optimization.
    [Show full text]
  • 7. Concepts in Probability, Statistics and Stochastic Modelling
    wrm_ch07.qxd 8/31/2005 12:18 PM Page 168 7. Concepts in Probability, Statistics and Stochastic Modelling 1. Introduction 169 2. Probability Concepts and Methods 170 2.1. Random Variables and Distributions 170 2.2. Expectation 173 2.3. Quantiles, Moments and Their Estimators 173 2.4. L-Moments and Their Estimators 176 3. Distributions of Random Events 179 3.1. Parameter Estimation 179 3.2. Model Adequacy 182 3.3. Normal and Lognormal Distributions 186 3.4. Gamma Distributions 187 3.5. Log-Pearson Type 3 Distribution 189 3.6. Gumbel and GEV Distributions 190 3.7. L-Moment Diagrams 192 4. Analysis of Censored Data 193 5. Regionalization and Index-Flood Method 195 6. Partial Duration Series 196 7. Stochastic Processes and Time Series 197 7.1. Describing Stochastic Processes 198 7.2. Markov Processes and Markov Chains 198 7.3. Properties of Time-Series Statistics 201 8. Synthetic Streamflow Generation 203 8.1. Introduction 203 8.2. Streamflow Generation Models 205 8.3. A Simple Autoregressive Model 206 8.4. Reproducing the Marginal Distribution 208 8.5. Multivariate Models 209 8.6. Multi-Season, Multi-Site Models 211 8.6.1. Disaggregation Models 211 8.6.2. Aggregation Models 213 9. Stochastic Simulation 214 9.1. Generating Random Variables 214 9.2. River Basin Simulation 215 9.3. The Simulation Model 216 9.4. Simulation of the Basin 216 9.5. Interpreting Simulation Output 217 10. Conclusions 223 11. References 223 wrm_ch07.qxd 8/31/2005 12:18 PM Page 169 169 7 Concepts in Probability, Statistics and Stochastic Modelling Events that cannot be predicted precisely are often called random.
    [Show full text]
  • Music and Chance Reflection on Stodrastic Ideas in Music
    'I Dn. Arrnro Scxnrrnrn,Nruss ;d ''1: lft 'ti :il Music and Chance Reflection on stodrastic ideas in music It may surprise many readers to see the notions "music' and "chance" linked in the title by a simple, bold "and". Surely there is some incongruity here, they may think, not to say a downright contradiction. Music, subject in the main to strict rules of form, appears to be strictly opposed to any element of chance. Chance, on the other hand, may not, as Novalis said, be inscrutable, but the laws it obeys do not at all correspond to the application of principles of musical form. And yet there are remarkable mutual connections, as indicated, for instance, by such well-known examples frorn musical history as Mozart's Dice Minuets or John Cage's noise compositions, with their intentionai lack of rules. Are these extreme cases, incidental phenomena marginal to musical history, or can one in fact find on closer inspection significant relationships in them relevant to the understanding of music or the arts in general? In attempting to proceed further with this guestion, one would be well advised to begin by making a distinction be- tween two essentially different points of view from which the relation of music and chance can be analysed. The first cor- responds to the peßpective of statistics in the broader sense; here works of music of any kind are subjected to a stochastic analysis, that is, one derived from the theory of chance. The second differs from this inasmuch as it considers the use of chance phenornena as musical material, that is, of the rnusical maniDulation of chance.
    [Show full text]
  • Exact Stochastic Simulation of Coupled Chemical Reactions
    2340 Daniel T. Gillesple Exact Stochastic Simulation of Coupled Chemical Reactions Danlel T. Gillespie Research Department, Na Val Weapons Center, China Lake, California 93555 (Received May 72, 1977) Publication costs assisted by the Naval Weapons Center There are two formalisms for mathematically describing the time behavior of a spatially homogeneous chemical system: The deterministic approach regards the time evolution as a continuous, wholly predictable process which is governed by a set of coupled, ordinary differential equations (the “reaction-rate equations”);the stochastic approach regards the time evolution as a kind of random-walk process which is governed by a single dif- ferential-difference equation (the “master equation”). Fairly simple kinetic theory arguments show that the stochastic formulation of chemical kinetics has a firmer physical basis than the deterministic formulation, but unfortunately the stochastic master equation is often mathematically intractable. There is, however, a way to make exact numerical calculations within the framework of the stochastic formulation without having to deal with the master equation directly. It is a relatively simple digital computer algorithm which uses a rigorously derived Monte Carlo procedure to numerically simulate the time evolution of the given chemical system. Like the master equation, this “stochastic simulation algorithm” correctly accounts for the inherent fluctuations and correlations that are necessarily ignored in the deterministic formulation. In addition, unlike most procedures for numerically solving the deterministic reaction-rate equations, this algorithm never approximates infinitesimal time increments dt by finite time steps At. The feasibility and utility of the simulation algorithm are demonstrated by applying it to several well-known model chemical systems, including the Lotka model, the Brusselator, and the Oregonator.
    [Show full text]
  • Monte Carlo Simulation Approach to Stochastic Programming
    Proceedings of the 2001 Winter Simulation Conference B.A.Peters,J.S.Smith,D.J.Medeiros,andM.W.Rohrer,eds. MONTE CARLO SIMULATION APPROACH TO STOCHASTIC PROGRAMMING Alexander Shapiro School of Industrial & Systems Engineering Georgia Institute of Technology Atlanta, Georgia 30332, U.S.A. ABSTRACT If the space is finite, say := {ω1, ..., ωK } with respective probabilities pk, k = 1, ..., K ,then Various stochastic programming problems can be formulated as problems of optimization of an expected value function. K Quite often the corresponding expectation function cannot g(x) = pk G(x,ωk). (3) be computed exactly and should be approximated, say by k=1 Monte Carlo sampling methods. In fact, in many practical applications, Monte Carlo simulation is the only reasonable Consequently problem (1) can be viewed as a deterministic way of estimating the expectation function. In this talk we optimization problem. Note, however, that the number K discuss converges properties of the sample average approx- of possible realizations (scenarios) of the data can be very ω imation (SAA) approach to stochastic programming. We large. Suppose, for instance, that is a random vector with argue that the SAA method is easily implementable and 100 stochastically independent components each having 3 = 100 can be surprisingly efficient for some classes of stochastic realizations. Then the total number of scenarios is K 3 . programming problems. No computer in a foreseeable future will be able to handle that number of scenarios. 1 INTRODUCTION One can try to solve the optimization problem (1) by a Monte Carlo simulation. That is, by generating a random ω1, ..., ωN ∼ Consider the optimization problem (say iid) sample P one can estimate the expectation g(x) by the corresponding sample average min g(x) := EP [G(x,ω)] , (1) x∈X N −1 j gˆN (x) := N G(x,ω ).
    [Show full text]
  • A New American Development in Music: Some Characteristic Features Extending from the Legacy of Charles Ives
    Louisiana State University LSU Digital Commons LSU Historical Dissertations and Theses Graduate School 1976 A New American Development in Music: Some Characteristic Features Extending From the Legacy of Charles Ives. Joan Kunselman Cordes Louisiana State University and Agricultural & Mechanical College Follow this and additional works at: https://digitalcommons.lsu.edu/gradschool_disstheses Recommended Citation Cordes, Joan Kunselman, "A New American Development in Music: Some Characteristic Features Extending From the Legacy of Charles Ives." (1976). LSU Historical Dissertations and Theses. 2955. https://digitalcommons.lsu.edu/gradschool_disstheses/2955 This Dissertation is brought to you for free and open access by the Graduate School at LSU Digital Commons. It has been accepted for inclusion in LSU Historical Dissertations and Theses by an authorized administrator of LSU Digital Commons. For more information, please contact [email protected]. INFORMATION TO USERS This material was produced from a microfilm copy of the original document. While the most advanced technological means to photograph and reproduce this document have been used, the quality is heavily dependent upon the quality of the original submitted. The following explanation of techniques is provided to help you understand markings or patterns which may appear on this reproduction. 1. The sign or "target" for pages apparently lacking from the document photographed is "Missing Page(s)". If it was possible to obtain the missing page(s) or section, they are spliced into the film along with adjacent pages. This may have necessitated cutting thru an image and duplicating adjacent pages to insure you complete continuity. 2. When an image on the film is obliterated with a large round black mark, it is an indication that the photographer suspected that the copy may have moved during exposure and thus cause a blurred image.
    [Show full text]