Nonlinear Stochastic Dynamics and Chaos by Numerical Path Integration

Total Page:16

File Type:pdf, Size:1020Kb

Nonlinear Stochastic Dynamics and Chaos by Numerical Path Integration Nonlinear stochastic dynamics and chaos by numerical path integration Eirik Mo January 5, 2008 Acknowledgements The main gratitude goes to Professor Arvid Naess, who has been the advisor for this work, and given many valuable comments. The problem description was written by Naess, the development of path integration for stochastic differential equations is largely devoted to him, and he also applied for and received funding for the project. For four years, I have worked together with Dr. Hans Christian Karlsen, who also was a PhD student advised by Naess. Karlsen's work on running path integration for some specific problems was of great importance for the development of more stable and efficient code. His validation of accuracy and general comments have been very helpful for this work. From August 2004 until February 2005, I visited Professor Mircea Grigoriu at the Department of Structural Engineering at Cornell University, beautifully situated in Ithaca by the Finger Lakes, upstate New York. This was a wonderful stay, where I were warmly welcomed by PhD students at the department, and a lot of people in the area. I would especially like to mention Ms. (Kathleen) Misti Wilcox, who rented out rooms in her house, cooked wonderful meals, proudly presented Ithaca and the surrounding area, and motivated me for working. This visit was a big inspiration, and a turning point in the research. The Research Council of Norway funded the project and the visit to Cornell University, of which I'm very grateful. Motivating words from people around me have been important from time to time. I cannot mention everyone by name, but they basically consist of family, my colleagues at the Department of Mathematical Sciences, my best friends from the master programme who meet at the \cantina", the \ISFiT 2001 contact group", the interest organization for doctoral candidates at NTNU (DION), my housing cooperative, friends from charity organizations, and all my friends in the US. I would particularly like to thank my mother Linn Mo for reading through the thesis and correcting some basic language errors. i ii iii Preface The main purpose of this thesis is to study Stochastic Differential Equations (SDEs) using Path Integration (PI). Nonlinear dynamical systems is a main focus of this work, both because such systems present important challenges for the PI method, and because these systems are generally hard to analyze analytically and by means of other numerical meth- ods. More specifically, three kinds of systems will be discussed; simpler test cases where analytical solutions exist, systems that exhibit chaotic response, and systems with instan- taneous changes at fixed values for the variable. The last group consists of signum-kind nonlinearities, impact systems with completely elastic impact and contacting impacts, and absorbing boundaries in reliability studies. For some systems, especially the chaotic sys- tems, the random noise is basically a way to model small perturbations of the system. The role of this noise is to make theory and numerical methods from stochastic processes applicable, to model imperfections or noise in a physical system, or to account for the un- certainty in parameter estimates in such models. In other systems, the noise could be the main driving force, without which the system would just converge to one stability point. A lot of this work is based on research from three earlier PhD candidates, [20, 34, 50]. Some of the techniques developed there are continued, some observations are investigated more thoroughly, and some of the problems and challenges found in this process will be discussed and explained. This also means that some important issues like convergence, stability, choice of numerical methods etc. have already been answered, so only the con- clusions are referred here. In the beginning of this work, the main question was if PI could be used as a tool to study chaotic systems, and if so, in what sense. One of the main characteristics of chaotic systems are \strange attractors"; limit sets with a complicated structure and fractal dimen- sion. When adding noise, these limit sets are in some ways smeared out in the probability density over the state space, but this density could still have a very rugged structure. This is one of the challenges for PI, which requires a good approximative representation of the probability density by some interpolating surface. Different ways to perform a stable in- terpolation is discussed, and it is shown that the choice of interpolation could be crucial for the accuracy and convergence of the method, even for much simpler problems. The interpolation problem is related to the problem of discretizing the state space variables. Interpolation error seems to be the main reason for unstable results in earlier work, so this is the first challenge discussed in this thesis, and requires close attention from those who plan to follow up this method further. All interpolation methods used here have been written by the author, and are modified to attain the required stability and accuracy for the problems discussed. So this work is new. The second challenge is the nonlinearity of the system, which is extremely important to handle properly. Time stepping methods like the Euler method, Runge Kutta schemes, and Taylor will be discussed together with the problem of choosing the optimal time step length. The path integration itself also requires that the nonlinear effects are properly taken care of. Except for the Taylor method, the programming code for the time stepping method is written by the author, though using standard methods. A reason that library functions iv are not used, is that the time stepping method is highly integrated in the rest of the code to allow for optimization when many points are propagated forwards simultaneously. A third challenge is dimensionality. Solving a one-dimensional autonomous SDE is fairly trivial and can be done with high accuracy in short time. A differential equation with chaotic response will either have three or more dimensions, or contain terms that explicitely depend upon time, e.g. periodic forcing. It is also of interest to study sys- tems of coupled oscillators, filtered noise processes etc., which gives systems with a higher number of dimensions. Not only will computational time and memory requirements grow exponentially with the number of dimensions; even writing the computer code for such systems soon becomes an extremely challenging task. How do you write efficient computer code for a given problem with any number of dimensions and any choice of approximation method - without typing errors? One solution is to let the computer code be generated by yet another program, and this is a new development. This required describing the method of Path Integration and all its numerical structures in a generalized way. Some of the mathematical observations in this generalization and methods used to create efficient code is presented in this book. A milestone for the PI method, was the implementation and running of a stable system with six dimensions (6D), which was finally accomplished in April 2007. Six dimensions may not seem to be a lot for researchers from other fields, but to the authors' knowledge a full 6D response PDF of an SDE has not been computed by any numerical method earlier. It has not been a main focus to do detailed studies of a large number of differential equations with chaotic and non-chaotic response under the influence of various noise pro- cesses. This is a vast field with endless possibilities, and there are many articles discussing various topics related to this - often for some very specific differential equations. Partly because of the challenges described above, there is very little work performed earlier that allows for detailed comparizations to the results of the PI method. Some theory on chaos, chaotic and non-chaotic strange attractors is included. In addi- tion, some of the varieties of possible behaviour when such systems are affected by noise is described, and illustrated by the PI method. PI could also give more insight to the behaviour of a system through other statistics than the PDF. Since chaos was a main in- terest, a great deal of work has been done trying to obtain the maximal Lyapunov exponent (MLE) of a system. Also here, the main question is if the PI method can be used for this task. The MLE, and the Lyapunov spectrum, is not trivial to compute with the methods already proposed by other authors - for general systems. There are many different kinds of questions that could be asked about adding noise to a differential equation. In some cases, the problem is stability of the attractor, and the noise is just there to create a small perturbation kicking the system off from the deterministic path. For other applications, the qualities of the noise process could be of vital importance, and different noise levels or noise processes could give very different behaviour of the system. The latter case requires knowing that the numerical method can handle the stochastic terms with sufficient accuracy. In cooperation with professor Mircea Grigoriu at Cornell University, this question developed into some studies of the compound Poisson process, and the possibilities of implementing compound Poisson noise in PI. A master student at v NTNU, Tore Selland Kleppe, studied the implementation of L´evy processes in PI, partly in correspondance with the author [26]. The results from these attempts to use the PI method in other fields will however not be discussed in this work, due to space limitations. Many methods in the field of stochastic dynamical systems are limited to processes with Gaussian increments. In the implementation of PI, a main focus is to avoid this restraint. Comparing PI to other numerical algorithms is also beyond the scope of this study, but a brief description of some other methods can be found in sections 2.2 and 4.5.
Recommended publications
  • Using Standard Syste
    PHYSICAL REVIEW E VOLUME 55, NUMBER 6 JUNE 1997 Cumulative Author Index All authors of papers published in this volume are listed alphabetically. Full titles are included in each ®rst author's entry. For Rapid Communi- cations an R precedes the page number. The letters (C) and (BR) following the page number indicate that a paper is a Comment or a Brief Report, respectively. References with (E) are to Errata. Abarbanel, Henry D. I. — ͑see Huerta, Ramon͒ E 55, R2108 and Jin-Qing Fang — Synchronization of chaos and hyperchaos ͑see Liu, Clif͒ E 55, 6483 using linear and nonlinear feedback functions. E 55, 5285 Abdullaev, F. Kh. and J. G. Caputo — Propagation of an envelope Aliaga, J. — ͑see Gruver, J. L.͒ E 55, 6370 soliton in a medium with spatially varying dispersion. E 55, 6061 Alig, I. — ͑see Mayer, W.͒ E 55, 3102 Abel, T., E. Brener, and H. Mu¨ller-Krumbhaar — Three-dimensional Allahyarov, E. A., L. I. Podloubny, P. P. J. M. Schram, and S. A. growth morphologies in diffusion-controlled channel growth. Trigger — Damping of longitudinal waves in colloidal crystals E 55, 7789͑BR͒ of finite size. E 55, 592 Abramson, Guillermo — Ecological model of extinctions. E 55, 785 Allain, C. — ͑see Senis, D.͒ E 55, 7797͑BR͒ Acharyya, M., J. K. Bhattacharjee, and B. K. Chakrabarti Allegrini, M. — ͑see Bezuglov, N. N.͒ E 55, 3333 — Dynamic response of an Ising system to a pulsed field. E 55, 2392 Allen, Christopher K. and Martin Reiser — Bunched beam envelope Ackerson, Bruce J. — ͑see Paulin, S. E.͒ E 55, 5812 equations including image effects from a cylindrical pipe.
    [Show full text]
  • Fourth SIAM Conference on Applications of Dynamical Systems
    Utah State University DigitalCommons@USU All U.S. Government Documents (Utah Regional U.S. Government Documents (Utah Regional Depository) Depository) 5-1997 Fourth SIAM Conference on Applications of Dynamical Systems SIAM Activity Group on Dynamical Systems Follow this and additional works at: https://digitalcommons.usu.edu/govdocs Part of the Physical Sciences and Mathematics Commons Recommended Citation Final program and abstracts, May 18-22, 1997 This Other is brought to you for free and open access by the U.S. Government Documents (Utah Regional Depository) at DigitalCommons@USU. It has been accepted for inclusion in All U.S. Government Documents (Utah Regional Depository) by an authorized administrator of DigitalCommons@USU. For more information, please contact [email protected]. tI...~ Confers ~'t' '"' \ 1I~c9 ~ 1'-" ~ J' .. c "'. to APPLICAliONS cJ May 18-22, 1997 Snowbird Ski and Summer Resort • Snowbird, Utah Sponsored by SIAM Activity Group on Dynamical Systems Conference Themes The themes of the 1997 conference will include the following topics. Principal Themes: • Dynamics in undergraduate education • Experimental studies of nonlinear phenomena • Hamiltonian systems and transport • Mathematical biology • Noise in dynamical systems • Patterns and spatio-temporal chaos Applications in • Synchronization • Aerospace engineering • Biology • Condensed matter physics • Control • Fluids • Manufacturing • Me;h~~~~nograPhY 19970915 120 • Lasers and o~ • Quantum UldU) • 51a m.@ Society for Industrial and Applied Mathematics http://www.siam.org/meetingslds97/ds97home.htm 2 " DYNAMICAL SYSTEMS Conference Prl Contents A Message from the Conference Chairs ... Get-Togethers 2 Dear Colleagues: Welcoming Message 2 Welcome to Snowbird for the Fourth SIAM Conference on Applications of Dynamica Systems. Organizing Committee 2 This highly interdisciplinary meeting brings together a diverse group of mathematicians Audiovisual Notice 2 scientists, and engineers, all working on dynamical systems and their applications.
    [Show full text]
  • Hopf-Zero Bifurcation of the Ring Unidirectionally Coupled Toda Oscillators with Delay∗
    Nonlinear Analysis: Modelling and Control, Vol.26, No. 3, 375–395 https://doi.org/10.15388/namc.2021.26.23050 Press Hopf-zero bifurcation of the ring unidirectionally coupled Toda oscillators with delay∗ Rina Sua;b, Chunrui Zhangc;1 aCollege of Mechanical and Electrical Engineering, Northeast Forestry University, Harbin, 150040, China [email protected] bCollege of Mathematics and Physics, Inner Mongolia University for Nationalities, Tongliao, 028000, China cDepartment of Mathematics, Northeast Forestry University, Harbin 150040, China [email protected] Received: November 18, 2019 / Revised: November 11, 2020 / Published online: May 1, 2021 Abstract. In this paper, the Hopf-zero bifurcation of the ring unidirectionally coupled Toda oscillators with delay was explored. First, the conditions of the occurrence of Hopf-zero bifurcation were obtained by analyzing the distribution of eigenvalues in correspondence to linearization. Second, the stability of Hopf-zero bifurcation periodic solutions was determined based on the discussion of the normal form of the system, and some numerical simulations were employed to illustrate the results of this study. Lastly, the normal form of the system on the center manifold was derived by using the center manifold theorem and normal form method. Keywords: Toda oscillators, normal form, Hopf-zero. 1 Introduction In more recent decades, the bifurcation theory in dynamical system has become a research hotspot, which is widely used in the fields of physics, chemistry, medicine, finance, biol- ogy, engineering and so on [3,12,13,15,19,20,22,24,30–35]. In particular, the bifurcation phenomenon of the system is analyzed, and the dynamic characteristics of the nonlinear ∗This research was supported by the Science Research Funding of the Inner Mongolia University for the Nationalities under grant No.
    [Show full text]
  • Energy Transfer and Dissipation in Nonlinear Oscillators
    Energy transfer and dissipation in nonlinear oscillators Maaita Tzamal- Odysseas Physicist, MSc. Computational Physics A thesis submitted for the degree of Doctor of Philosophy in the Department of Physics School of Sciences Aristotle University of Thessaloniki Supervisor: Assistant Professor Efthymia Meletlidou March, 2014 To my grandmothers Mdallal Enayat and Polidou Marika 3 Abstract (In Greek) Sthn παρούσα didaktορική διατριβή μελετάμε èna σύσthma tri¸n suzeugmènwn talantwt¸n me τριβή, dύο grammik¸n me ènan mh γραμμικό. Tètoia susτήμαta talantwt¸n èqoun μεγάλο endiafèron idiaÐtera όtan h μάζα tou mh γραμμικού talantωτή eÐnai poλύ μικρόterh από touc γραμμικούc me sunèpeia o mh γραμμικός talantωτής na leitourgeÐ wc katαβόθρα enèrgeiac. Autού tou eÐdouc ta susτήματa, sta opoÐa συνυπάρχουν ènac αργός kai ènac γρήγορος χρόnoc mpoρούν na μελετηθούν me th βοήθεια thc singularity analysis, twn analloÐwtwn pollaploτήτwn, en¸ σημαντική plhroforÐa gia th δυναμική tou susτήματoc dÐnetai kai από thn δυναμική thc αργής ροής (Slow Flow) tou susτήματoc. Sthn παρούσα διατριβή melετάμε to σύσthma mèsw thc melèthc thc αργής analloÐwthc poλλαπλόthtac (Slow Invariant Manifold- SIM-). Me th βοήθεια tou θεωρήματoc tou Tikhonov kathgoriopoiούμε tic διάφορες peript¸seic thc αργής analloÐwthc poλλαπλόthtac kai orÐzoume αναλυτικά tic συνθήκες me tic opoÐec μπορούμε na οδηγηθούμε sthn κάθε perÐptwsh. Se επόμενο βήμα μελετάμε thn δυναμική thc argήc rοής kai παρατηρούμε όti h δυναμική thc eÐnai πλούσια αφού oi troqièc thc μπορούν na eÐnai kanonikèc, na κάνουν talant¸seic hremÐac (relaxation oscillations), ή na eÐnai qaotikèc. Από thn melèth thc enèrgeiac pou αποθηκεύετai ston mh γραμμικό talantωτή kai από ton ρυθμό απόσβεσης thc sunoλικής enèrgeiac tou susτήματoc παρατηρούμε όti tόσο h ύπαρξη diaklad¸sewn thc argής analloÐwthc poλλαπλόthtac, όσο kai h dunaμική thc αργής ροής paÐzoun kajorisτικό ρόlo sthn metαφορά enèrgeiac apό ton γραμμικό ston mh γραμμικό talantωτή.
    [Show full text]
  • Appendix a One-Dimensional Maps
    Appendix A One-Dimensional Maps A.I Introduction The objective of this Appendix is to provide an introduction to the theory of chaos. One-dimensional maps are used as a vehicle to convey the concepts required for study­ ing chaos, firstly because fewer concepts are involved compared to higher dimensional maps and differential equations and secondly because of the fact that one-dimensional maps and their evolutions may easily be visualized, which helps to grasp ideas in­ volved more rapidly. For generalization of these result s to, and additional result s on higher dimensional mappings and differential equations, the reader is referred to the bibliography. Some important theorems are stated in Appendix B without proof. Consider an arbitrary one dimensional, N-th order discrete dynamical system whose time evolution is described by the homogeneous recurrence relation X n+l = f( X n, Xn- l, .•. , X n - N + l ), where f is some function N f: R -t R, and X n is the dynamical system's evolution on the n-th discrete time inst ant , i.e. n = 0,1,2, .... In general f may be nonlinear and is usually at least piecewise differentiable. The function f which describ es some dynamical system is termed a mapping or simply a map. Example A.I Consider the logistic map described by Xn+l = f(x n ), (A.l) where f : I -t R, f(x) := Tx(l - x ), (A.2) 343 344 APPENDIX A. ONE-DIMENSIONAL MAPS 0.9 0.8 0.7 0.6 .-... ~ '-" 0.5 '+-.., 0.4 0.3 0.2 0.1 o x Figure A.I: The logistic map for r = 4 .
    [Show full text]
  • From Hilbert to Dilbert
    From Hilbert to Dilbert A non-orthodox approach to gravitation, psychosynthesis, economics, cosmology, and other issues Victor Christianto & Florentin Smarandache (editors) From Hilbert to Dilbert 1 From Hilbert to Dilbert A non-orthodox approach to gravitation, psychosynthesis, economics, cosmology, and other issues ISBN : Editors: • Victor Christianto, DDiv., Malang Institute of Agriculture (IPM), Indonesia. http://www.sci- 4God.com • Florentin Smarandache, PhD., Dept. Mathematics and Sciences, University of New Mexico, New Mexico, USA. Gallup, New Mexico 87301, USA; e-mail: [email protected] Publisher : Divine Publishing Jl. Sidomakmur No. 75 A Sengkaling Malang, INDONESIA 65151 Email: [email protected] ISBN : 978 - 1 - 59973 - 585 - 6 Cover design : d.v.n. project Layout : d.v.n. project No part of this book is allowed to be copied and distributed by any means, be it in print or electronically, without written permission from the Editors and/or the Publisher, except for citation and review purposes. 2 From Hilbert to Dilbert Dedication ~ A tribute to Mr. Scott Adams the creator of Dilbert’s cartoon series. To many people like us, Dilbert is the real anti-hero of this corporatocracym age… (our wish is that eminent directors such as Oliver Stone will someday create something like “Dilbert the Movie.” — don’t laugh, we’re serious) From Hilbert to Dilbert 3 4 From Hilbert to Dilbert Preface This book took an unconventional theme because we submit an unorthodox theme too. Karl Popper’s epistemology suggests that when the theory is refuted by observation, then it is time to look for a set of new approaches.
    [Show full text]
  • Solving Large Number of Non-Stiff, Low-Dimensional Ordinary
    Solving large number of non-stiff, low-dimensional ordinary differential equation systems on GPUs and CPUs: performance comparisons of MPGOS, ODEINT and DifferentialEquations.jl D´aniel Nagya, Lambert Plavecza, Ferenc Heged˝usa,∗ aDepartment of Hydrodynamic Systems, Faculty of Mechanical Engineering, Budapest University of Technology and Economics, Budapest, Hungary Abstract In this paper, the performance characteristics of different solution techniques and pro- gram packages to solve a large number of independent ordinary differential equation systems is examined. The employed hardware are an Intel Core i7-4820K CPU with 30.4 GFLOPS peak double-precision performance per cores and an Nvidia GeForce Ti- tan Black GPU that has a total of 1707 GFLOPS peak double-precision performance. The tested systems (Lorenz equation, Keller–Miksis equation and a pressure relief valve model) are non-stiff and have low dimension. Thus, the performance of the codes are not limited by memory bandwidth, and Runge–Kutta type solvers are efficient and suitable choices. The tested program packages are MPGOS written in C++ and specialised only for GPUs; ODEINT implemented in C++, which supports execution on both CPUs and GPUs; finally, DifferentialEquations.jl written in Julia that also supports execution on both CPUs and GPUs. Using GPUs, the program package MPGOS is superior. For CPU computations, the ODEINT program package has the best performance. Keywords: ordinary differential equations, non-stiff problems, GPU programming, CPU programming 1. Introduction Low dimensional ordinary differential equation (ODE) systems are still widely used in arXiv:2011.01740v1 [cs.DC] 2 Nov 2020 physics and non-linear dynamical analysis. Among the simplest models (second or third- order systems), one can still find many publications employing the classic Duffng [1–6], Morse [7–10], Toda [11–14], Brusselator [15, 16], van der Pol [17–19] and Lorenz [20–23] equations.
    [Show full text]
  • Appendix Fm =F~M =~(Am +Ibm)
    Appendix A.l Fourier Series [Benedetto 1996 B, Bracewell1986 B, Carslaw 1930 B] A .1.1 General Rules period: x(t) = x(t + T) basic circular frequency: OJ OJ 2n / T T = 2n / OJ = 2n / OJ1 = 1 = complex Fourier series: complex coefficients: m=oo 1 T x(t) = x(t+ T) = IJmexp(-imOJt) Fm = - f x(t) exp(+imOJt)dt m=-oo T o real periodic functions: coefficients: x(t) = x(t+ T) = x*(t) Fo = Fo* = llo = Ao Fm =F~m =~(am +ibm) =.!. ~exp(iam} 2 real Fourier series I: real coefficients: x(t) = x(t+ T) = x*(t) 1 T 00 00 ao = - f x(t)dt T o =ao+ Lamcos(mOJt) + Lbmsin(mOJt) m=1 m=1 2 T am = - f x(t)cos(mOJt)dt T o 2 T bm =-f x(t)sin(mOJt)dt T o real Fourier series TI: real parameters: x(t) = x{t+ T) = x*{t) Ao =ao 00 [2 2]112 = Ao + L~cos(mOJt-am} Am = am +bm ~O m=1 am = arc tan(bm / am} 480 real even periodic functions: coefficients: x{t) = x{t + T) = x * (t) = x{ -t) Fo = Fo* = ao = Ao 1 1 Fm =F-m =Fm *=-a 2 m =-A2 m um =O;bm =0 real odd periodie functions: coefficients: x{t) = x{t+ T) = x*{t) = -x{-t) Fo =ao =Ao = 0 Fm =-F-m =-Fm *=..!..ib 2 m um = ±tr 12;am = 0 bm = Am sign( Um) A .1. 2 Real Periodie Functions Norrnalized parameters: Cü =Cü, = 1 and T =2tr a) Square wave: x{t) = x{t + 2tr) = sign(sin t) = i[sint + ..!..sin 3t + ..!..sin 5t + ..
    [Show full text]
  • Lyapunov Potential Description for Laser Dynamics
    Lyapunov Potential Description for Laser Dynamics Catalina Mayol†,‡, Ra´ul Toral†,‡ and Claudio R. Mirasso† (†) Departament de F´ısica, Universitat de les Illes Balears (‡) Instituto Mediterr´aneo de Estudios Avanzados (IMEDEA, UIB-CSIC) E-07071 Palma de Mallorca, Spain. Web Page: http://www.imedea.uib.es We describe the dynamical behavior of both class A and class B lasers in terms of a Lyapunov potential. For class A lasers we use the potential to analyze both deterministic and stochastic dynamics. In the stochastic case it is found that the phase of the electric field drifts with time in the steady state. For class B lasers, the potential obtained is valid in the absence of noise. In this case, a general expression relating the period of the relaxation oscillations to the potential is found. We have included in this expression the terms corresponding to the gain saturation and the mean value of the spontaneously emitted power, which were not considered previously. The validity of this expression is also discussed and a semi-empirical relation giving the period of the relaxation oscillations far from the stationary state is proposed and checked against numerical simulations. PACs: 42.65.Sf, 42.55.Ah, 42.60.Mi, 42.55.Px I. INTRODUCTION This model for laser dynamics was constructed from the Maxwell-Bloch equations for a single-mode field interact- Even for non-mechanical systems, it is occasionally ing with a two-level medium. The semiclassical laser the- possible to construct a function (called Lyapunov func- ory ignores the quantum-mechanical nature of the elec- tion or Lyapunov potential) that decreases along trajec- tromagnetic field, and the amplifying medium is modeled tories [1].
    [Show full text]