Bridging Data Science and Dynamical Systems Theory

Total Page:16

File Type:pdf, Size:1020Kb

Bridging Data Science and Dynamical Systems Theory Bridging Data Science and Dynamical Systems Theory Tyrus Berry, Dimitrios Giannakis, and John Harlim Modern science is undergoing what might arguably be In this short review, we describe mathematical tech- called a “data revolution,” manifested by a rapid growth niques for statistical analysis and prediction of time- of observed and simulated data from complex systems, as evolving phenomena, ranging from simple examples such well as vigorous research on mathematical and computa- as an oscillator, to highly complex systems such as the tur- tional frameworks for data analysis. In many scientific bulent motion of the Earth’s atmosphere, the folding of branches, these efforts have led to the creation of statistical proteins, and the evolution of species populations in an models of complex systems that match or exceed the skill ecosystem. Our main thesis is that combining ideas from of first-principles models. Yet, despite these successes, sta- the theory of dynamical systems with learning theory pro- tistical models are oftentimes treated as black boxes, pro- vides an effective route to data-driven models of complex viding limited guarantees about stability and convergence systems, with refinable predictions as the amount of train- as the amount of training data increases. Black-box mod- ing data increases, and physical interpretability through els also offer limited insights about the operating mecha- discovery of coherent patterns around which the dynam- nisms (physics), the understanding of which is central to ics is organized. Our article thus serves as an invitation to the advancement of science. explore ideas at the interface of the two fields. This is a vast subject, and invariably a number of impor- tant developments in areas such as deep learning, reservoir Tyrus Berry is an assistant professor of mathematics at George Mason University. His email address is [email protected]. computing, control, and nonautonomous/stochastic sys- 1 Dimitrios Giannakis is an associate professor of mathematics at New York Uni- tems are not discussed here. Our focus will be on topics versity. His email address is [email protected]. drawn from the authors’ research and related work. John Harlim is a professor of mathematics and meteorology, and Faculty Fellow of the Institute for Computational and Data Sciences, at the Pennsylvania State Statistical Forecasting University. His email address is [email protected]. and Coherent Pattern Extraction 푡 Communicated by Notices Associate Editor Reza Malek-Madani. Consider a dynamical system of the form Φ ∶ Ω → Ω, where Ω is the state space and Φ푡, 푡 ∈ ℝ, the flow map. For For permission to reprint this article, please contact: [email protected]. 1See https://arxiv.org/abs/2002.07928 for a version of this article with DOI: https://doi.org/10.1090/noti2151 references to the literature on these topics. 1336 NOTICES OF THE AMERICAN MATHEMATICAL SOCIETY VOLUME 67, NUMBER 9 example, Ω could be Euclidean space ℝ푑, or a more general focus will be on nonparametric methods, which do not em- manifold, and Φ푡 the solution map for a system of ODEs ploy explicit parametric models for the dynamics. In- defined on Ω. Alternatively, in a PDE setting, Ω could be stead, they use universal structural properties of dynam- an infinite-dimensional function space and Φ푡 an evolu- ical systems to inform the design of data analysis tech- tion group acting on it. We consider that Ω has the struc- niques. From a learning standpoint, Problems 1 and 2 ture of a metric space equipped with its Borel 휎-algebra, can be thought of as supervised and unsupervised learning, playing the role of an event space, with measurable func- respectively. A mathematical requirement we will impose tions on Ω acting as random variables, called observables. on methods addressing either problem is that they have a In a statistical modeling scenario, we consider that avail- well-defined notion of convergence, i.e., they are refinable, able to us are time series of various such observables, sam- as the number 푁 of training samples increases. pled along a dynamical trajectory which we will treat as be- ing unknown. Specifically, we assume that we have access Analog and POD Approaches to two observables, 푋 ∶ Ω → 풳 and 푌 ∶ Ω → 풴, respec- Among the earliest examples of nonparametric forecast- tively referred to as covariate and response functions, to- ing techniques is Lorenz’s analog method [Lor69]. This simple, elegant approach makes predictions by tracking gether with corresponding time series 푥0, 푥1, … , 푥푁−1 and the evolution of the response along a dynamical trajectory 푦0, 푦1, … , 푦푁−1, where 푥푛 = 푋(휔푛), 푦푛 = 푌(휔푛), and 휔푛 = 푛 ∆푡 in the training data (the analogs). Good analogs are se- Φ (휔0). Here, 풳 and 풴 are metric spaces, Δ푡 is a pos- lected according to a measure of geometrical similarity be- itive sampling interval, and 휔0 is an arbitrary point in Ω initializing the trajectory. We shall refer to the collection tween the covariate variable observed at forecast initializa- tion and the covariate training data. This method posits {(푥0, 푦0), … , (푥푁−1, 푦푁−1)} as the training data. We require that 풴 be a Banach space (so that one can talk about expec- that past behavior of the system is representative of its fu- tations and other functionals applied to 푌), but allow the ture behavior, so looking up states in a historical record covariate space 풳 to be nonlinear. that are closest to current observations is likely to yield a Many problems in statistical modeling of dynamical sys- skillful forecast. Subsequent methodologies have also em- tems can be expressed in this framework. For instance, in phasized aspects of state space geometry, e.g., using the a low-dimensional ODE setting, 푋 and 푌 could both be training data to approximate the evolution map through the identity map on Ω = ℝ푑, and the task could be to patched local linear models, often leveraging delay coordi- build a model for the evolution of the full system state. nates for state space reconstruction. Weather forecasting is a classical high-dimensional appli- Early approaches to coherent pattern extraction include cation, where Ω is the abstract state space of the climate the proper orthogonal decomposition (POD), which is system, and 푋 a (highly noninvertible) map represent- closely related to principal component analysis (PCA, in- ing measurements from satellites, meteorological stations, troduced in the early twentieth century by Pearson), the and other sensors available to a forecaster. The response Karhunen–Loève expansion, and empirical orthogonal 푌 could be temperature at a specific location, 풴 = ℝ, il- function (EOF) analysis. Assuming that 풴 is a Hilbert 퐿 lustrating that the response space may be of considerably space, POD yields an expansion 푌 ≈ 푌퐿 = ∑푗=1 푧푗, 푧푗 = lower dimension than the covariate space. In other cases, 푢푗휎푗휓푗. Arranging the data into a matrix 퐘 = (푦0, … , 푦푁−1), e.g., forecasting the temperature field over a geographical the 휎푗 are the singular values of 퐘 (in decreasing order), region, 풴 may be a function space. The two primary ques- the 푢푗 are the corresponding left singular vectors, called tions that will concern us here are: EOFs, and the 휓푗 are given by projections of 푌 onto the 휓 (휔) = ⟨푢 , 푌(휔)⟩ Problem 1 (Statistical forecasting). Given the training EOFs, 푗 푗 풴. That is, the principal compo- 휓 ∶ Ω → ℝ data, construct (“learn”) a function 푍 ∶ 풳 → 풴 that pre- nent 푗 is a linear feature characterizing the un- 푡 {푦 , … , 푦 } dicts 푌 at a lead time 푡 ≥ 0. That is, 푍 should have the supervised data 0 푁−1 . If the data is drawn from a 푡 휇 푁 → ∞ property that 푍 ∘ 푋 is closest to 푌 ∘ Φ푡 among all functions probability measure , as the POD expansion is 푡 퐿2(휇) 푌 퐿2(휇) in a suitable class. optimal in an sense; that is, 퐿 has minimal error ‖푌 − 푌퐿‖퐿2(휇) among all rank-퐿 approximations of Problem 2 (Coherent pattern extraction). Given the train- 푌. Effectively, from the perspective of POD, the important ing data, identify a collection of observables 푧푗 ∶ Ω → 풴 components of 푌 are those capturing maximal variance. that have the property of evolving coherently under the dy- Despite many successes in challenging applications 푡 namics. By that, we mean that 푧푗 ∘ Φ should be relatable (e.g., turbulence), it has been recognized that POD may to 푧푗 in a natural way. not reveal dynamically significant observables, offering These problems have an extensive history of study limited predictability and physical insight. In recent years, from an interdisciplinary perspective spanning mathemat- there has been significant interest in techniques that ad- ics, statistics, physics, and many other fields. Here, our dress this shortcoming by modifying the linear map 퐘 to OCTOBER 2020 NOTICES OF THE AMERICAN MATHEMATICAL SOCIETY 1337 have an explicit dependence on the dynamics [BK86], or re- invariant measure supported on the famous “butterfly” placing it by an evolution operator [DJ99, Mez05]. Either fractal attractor; see Figure 1. L63 exemplifies the fact that a directly or indirectly, these methods make use of operator- smooth dynamical system may exhibit invariant measures theoretic ergodic theory, which we now discuss. with nonsmooth supports. This behavior is ubiquitous in models of physical phenomena, which are formulated in Operator-Theoretic Formulation terms of smooth differential equations, but whose long- The operator-theoretic formulation of dynamical systems term dynamics concentrate on lower-dimensional subsets theory shifts attention from the state-space perspective, of state space due to the presence of dissipation. Our meth- and instead characterizes the dynamics through its action ods should therefore not rely on the existence of a smooth on linear spaces of observables.
Recommended publications
  • CHAOS and DYNAMICAL SYSTEMS Spring 2021 Lectures: Monday, Wednesday, 11:00–12:15PM ET Recitation: Friday, 12:30–1:45PM ET
    MATH-UA 264.001 – CHAOS AND DYNAMICAL SYSTEMS Spring 2021 Lectures: Monday, Wednesday, 11:00–12:15PM ET Recitation: Friday, 12:30–1:45PM ET Objectives Dynamical systems theory is the branch of mathematics that studies the properties of iterated action of maps on spaces. It provides a mathematical framework to characterize a great variety of time-evolving phenomena in areas such as physics, ecology, and finance, among many other disciplines. In this class we will study dynamical systems that evolve in discrete time, as well as continuous-time dynamical systems described by ordinary di↵erential equations. Of particular focus will be to explore and understand the qualitative properties of dynamics, such as the existence of attractors, periodic orbits and chaos. We will do this by means of mathematical analysis, as well as simple numerical experiments. List of topics • One- and two-dimensional maps. • Linearization, stable and unstable manifolds. • Attractors, chaotic behavior of maps. • Linear and nonlinear continuous-time systems. • Limit sets, periodic orbits. • Chaos in di↵erential equations, Lyapunov exponents. • Bifurcations. Contact and office hours • Instructor: Dimitris Giannakis, [email protected]. Office hours: Monday 5:00-6:00PM and Wednesday 4:30–5:30PM ET. • Recitation Leader: Wenjing Dong, [email protected]. Office hours: Tuesday 4:00-5:00PM ET. Textbooks • Required: – Alligood, Sauer, Yorke, Chaos: An Introduction to Dynamical Systems, Springer. Available online at https://link.springer.com/book/10.1007%2Fb97589. • Recommended: – Strogatz, Nonlinear Dynamics and Chaos. – Hirsch, Smale, Devaney, Di↵erential Equations, Dynamical Systems, and an Introduction to Chaos. Available online at https://www.sciencedirect.com/science/book/9780123820105.
    [Show full text]
  • Dynamical Systems Theory for Causal Inference with Application to Synthetic Control Methods
    Dynamical Systems Theory for Causal Inference with Application to Synthetic Control Methods Yi Ding Panos Toulis University of Chicago University of Chicago Department of Computer Science Booth School of Business Abstract In this paper, we adopt results in nonlinear time series analysis for causal inference in dynamical settings. Our motivation is policy analysis with panel data, particularly through the use of “synthetic control” methods. These methods regress pre-intervention outcomes of the treated unit to outcomes from a pool of control units, and then use the fitted regres- sion model to estimate causal effects post- intervention. In this setting, we propose to screen out control units that have a weak dy- Figure 1: A Lorenz attractor plotted in 3D. namical relationship to the treated unit. In simulations, we show that this method can mitigate bias from “cherry-picking” of control However, in many real-world settings, different vari- units, which is usually an important concern. ables exhibit dynamic interdependence, sometimes We illustrate on real-world applications, in- showing positive correlation and sometimes negative. cluding the tobacco legislation example of Such ephemeral correlations can be illustrated with Abadie et al.(2010), and Brexit. a popular dynamical system shown in Figure1, the Lorenz system (Lorenz, 1963). The trajectory resem- bles a butterfly shape indicating varying correlations 1 Introduction at different times: in one wing of the shape, variables X and Y appear to be positively correlated, and in the In causal inference, we compare outcomes of units who other they are negatively correlated. Such dynamics received the treatment with outcomes from units who present new methodological challenges for causal in- did not.
    [Show full text]
  • A Gentle Introduction to Dynamical Systems Theory for Researchers in Speech, Language, and Music
    A Gentle Introduction to Dynamical Systems Theory for Researchers in Speech, Language, and Music. Talk given at PoRT workshop, Glasgow, July 2012 Fred Cummins, University College Dublin [1] Dynamical Systems Theory (DST) is the lingua franca of Physics (both Newtonian and modern), Biology, Chemistry, and many other sciences and non-sciences, such as Economics. To employ the tools of DST is to take an explanatory stance with respect to observed phenomena. DST is thus not just another tool in the box. Its use is a different way of doing science. DST is increasingly used in non-computational, non-representational, non-cognitivist approaches to understanding behavior (and perhaps brains). (Embodied, embedded, ecological, enactive theories within cognitive science.) [2] DST originates in the science of mechanics, developed by the (co-)inventor of the calculus: Isaac Newton. This revolutionary science gave us the seductive concept of the mechanism. Mechanics seeks to provide a deterministic account of the relation between the motions of massive bodies and the forces that act upon them. A dynamical system comprises • A state description that indexes the components at time t, and • A dynamic, which is a rule governing state change over time The choice of variables defines the state space. The dynamic associates an instantaneous rate of change with each point in the state space. Any specific instance of a dynamical system will trace out a single trajectory in state space. (This is often, misleadingly, called a solution to the underlying equations.) Description of a specific system therefore also requires specification of the initial conditions. In the domain of mechanics, where we seek to account for the motion of massive bodies, we know which variables to choose (position and velocity).
    [Show full text]
  • Arxiv:0705.1142V1 [Math.DS] 8 May 2007 Cases New) and Are Ripe for Further Study
    A PRIMER ON SUBSTITUTION TILINGS OF THE EUCLIDEAN PLANE NATALIE PRIEBE FRANK Abstract. This paper is intended to provide an introduction to the theory of substitution tilings. For our purposes, tiling substitution rules are divided into two broad classes: geometric and combi- natorial. Geometric substitution tilings include self-similar tilings such as the well-known Penrose tilings; for this class there is a substantial body of research in the literature. Combinatorial sub- stitutions are just beginning to be examined, and some of what we present here is new. We give numerous examples, mention selected major results, discuss connections between the two classes of substitutions, include current research perspectives and questions, and provide an extensive bib- liography. Although the author attempts to fairly represent the as a whole, the paper is not an exhaustive survey, and she apologizes for any important omissions. 1. Introduction d A tiling substitution rule is a rule that can be used to construct infinite tilings of R using a finite number of tile types. The rule tells us how to \substitute" each tile type by a finite configuration of tiles in a way that can be repeated, growing ever larger pieces of tiling at each stage. In the d limit, an infinite tiling of R is obtained. In this paper we take the perspective that there are two major classes of tiling substitution rules: those based on a linear expansion map and those relying instead upon a sort of \concatenation" of tiles. The first class, which we call geometric tiling substitutions, includes self-similar tilings, of which there are several well-known examples including the Penrose tilings.
    [Show full text]
  • Handbook of Dynamical Systems
    Handbook Of Dynamical Systems Parochial Chrisy dunes: he waggles his medicine testily and punctiliously. Draggled Bealle engirds her impuissance so ding-dongdistractively Allyn that phagocytoseOzzie Russianizing purringly very and inconsumably. perhaps. Ulick usually kotows lineally or fossilise idiopathically when Modern analytical methods in handbook of skeleton signals that Ale Jan Homburg Google Scholar. Your wishlist items are not longer accessible through the associated public hyperlink. Bandelow, L Recke and B Sandstede. Dynamical Systems and mob Handbook Archive. Are neurodynamic organizations a fundamental property of teamwork? The i card you entered has early been redeemed. Katok A, Bernoulli diffeomorphisms on surfaces, Ann. Routledge, Taylor and Francis Group. NOTE: Funds will be deducted from your Flipkart Gift Card when your place manner order. Attendance at all activities marked with this symbol will be monitored. As well as dynamical system, we must only when interventions happen in. This second half a Volume 1 of practice Handbook follows Volume 1A which was published in 2002 The contents of stain two tightly integrated parts taken together. This promotion has been applied to your account. Constructing dynamical systems having homoclinic bifurcation points of codimension two. You has not logged in origin have two options hinari requires you to log in before first you mean access to articles from allowance of Dynamical Systems. Learn more about Amazon Prime. Dynamical system in nLab. Dynamical Systems Mathematical Sciences. In this volume, the authors present a collection of surveys on various aspects of the theory of bifurcations of differentiable dynamical systems and related topics. Since it contains items is not enter your country yet.
    [Show full text]
  • Writing the History of Dynamical Systems and Chaos
    Historia Mathematica 29 (2002), 273–339 doi:10.1006/hmat.2002.2351 Writing the History of Dynamical Systems and Chaos: View metadata, citation and similar papersLongue at core.ac.uk Dur´ee and Revolution, Disciplines and Cultures1 brought to you by CORE provided by Elsevier - Publisher Connector David Aubin Max-Planck Institut fur¨ Wissenschaftsgeschichte, Berlin, Germany E-mail: [email protected] and Amy Dahan Dalmedico Centre national de la recherche scientifique and Centre Alexandre-Koyre,´ Paris, France E-mail: [email protected] Between the late 1960s and the beginning of the 1980s, the wide recognition that simple dynamical laws could give rise to complex behaviors was sometimes hailed as a true scientific revolution impacting several disciplines, for which a striking label was coined—“chaos.” Mathematicians quickly pointed out that the purported revolution was relying on the abstract theory of dynamical systems founded in the late 19th century by Henri Poincar´e who had already reached a similar conclusion. In this paper, we flesh out the historiographical tensions arising from these confrontations: longue-duree´ history and revolution; abstract mathematics and the use of mathematical techniques in various other domains. After reviewing the historiography of dynamical systems theory from Poincar´e to the 1960s, we highlight the pioneering work of a few individuals (Steve Smale, Edward Lorenz, David Ruelle). We then go on to discuss the nature of the chaos phenomenon, which, we argue, was a conceptual reconfiguration as
    [Show full text]
  • Homogeneous Dynamical Systems Theory Bijoy K
    462 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 47, NO. 3, MARCH 2002 Homogeneous Dynamical Systems Theory Bijoy K. Ghosh, Fellow, IEEE, and Clyde F. Martin, Fellow, IEEE Abstract—In this paper, we study controlled homogeneous dy- where the scalar output may be considered to be the slope namical systems and derive conditions under which the system is of the line spanned by the vector and where perspective controllable. We also derive conditions under which the system is observable in the presence of a control over the com- plex base field. In the absence of any control input, we derive a nec- essary and sufficient condition for observability of a homogeneous (1.3) dynamical system over the real base field. The observability crite- rion obtained generalizes a well known Popov–Belevitch–Hautus (PBH) rank criterion to check the observability of a linear dynam- ical system. Finally, we introduce rational, exponential, interpola- For a dynamical system of the form (1.1), (1.2), one is tion problems as an important step toward solving the problem of interested in controlling only the direction of the state vector realizing homogeneous dynamical systems with minimum state di- and such problems are, therefore, of interest in mensions. gaze control. To generalize the control problem, we consider a Index Terms—Author, please supply your own keywords or send dynamical system with state variable , control variable a blank e-mail to [email protected] to receive a list of suggested and observation function , the projective keywords. space of homogeneous lines in , where we assume that . The dynamical system is described as I.
    [Show full text]
  • Topic 6: Projected Dynamical Systems
    Topic 6: Projected Dynamical Systems Professor Anna Nagurney John F. Smith Memorial Professor and Director – Virtual Center for Supernetworks Isenberg School of Management University of Massachusetts Amherst, Massachusetts 01003 SCH-MGMT 825 Management Science Seminar Variational Inequalities, Networks, and Game Theory Spring 2014 c Anna Nagurney 2014 Professor Anna Nagurney SCH-MGMT 825 Management Science Seminar Projected Dynamical Systems A plethora of equilibrium problems, including network equilibrium problems, can be uniformly formulated and studied as finite-dimensional variational inequality problems, as we have seen in the preceding lectures. Indeed, it was precisely the traffic network equilibrium problem, as stated by Smith (1979), and identified by Dafermos (1980) to be a variational inequality problem, that gave birth to the ensuing research activity in variational inequality theory and applications in transportation science, regional science, operations research/management science, and, more recently, in economics. Professor Anna Nagurney SCH-MGMT 825 Management Science Seminar Projected Dynamical Systems Usually, using this methodology, one first formulates the governing equilibrium conditions as a variational inequality problem. Qualitative properties of existence and uniqueness of solutions to a variational inequality problem can then be studied using the standard theory or by exploiting problem structure. Finally, a variety of algorithms for the computation of solutions to finite-dimensional variational inequality problems are now available (see, e.g., Nagurney (1999, 2006)). Professor Anna Nagurney SCH-MGMT 825 Management Science Seminar Projected Dynamical Systems Finite-dimensional variational inequality theory by itself, however, provides no framework for the study of the dynamics of competitive systems. Rather, it captures the system at its equilibrium state and, hence, the focus of this tool is static in nature.
    [Show full text]
  • Applications of Dynamical Systems in Biology and Medicine the IMA Volumes in Mathematics and Its Applications Volume 158
    The IMA Volumes in Mathematics and its Applications Trachette Jackson Ami Radunskaya Editors Applications of Dynamical Systems in Biology and Medicine The IMA Volumes in Mathematics and its Applications Volume 158 More information about this series at http://www.springer.com/series/811 Institute for Mathematics and its Applications (IMA) The Institute for Mathematics and its Applications was established by a grant from the National Science Foundation to the University of Minnesota in 1982. The primary mission of the IMA is to foster research of a truly interdisciplinary nature, establishing links between mathematics of the highest caliber and important scientific and technological problems from other disciplines and industries. To this end, the IMA organizes a wide variety of programs, ranging from short intense workshops in areas of exceptional interest and opportunity to extensive thematic programs lasting a year. IMA Volumes are used to communicate results of these programs that we believe are of particular value to the broader scientific community. The full list of IMA books can be found at the Web site of the Institute for Mathematics and its Applications: http://www.ima.umn.edu/springer/volumes.html. Presentation materials from the IMA talks are available at http://www.ima.umn.edu/talks/. Video library is at http://www.ima.umn.edu/videos/. Fadil Santosa, Director of the IMA Trachette Jackson • Ami Radunskaya Editors Applications of Dynamical Systems in Biology and Medicine 123 Editors Trachette Jackson Ami Radunskaya Department of Mathematics Department of Mathematics University of Michigan Pomona College Ann Arbor, MI, USA Claremont, CA, USA ISSN 0940-6573 ISSN 2198-3224 (electronic) The IMA Volumes in Mathematics and its Applications ISBN 978-1-4939-2781-4 ISBN 978-1-4939-2782-1 (eBook) DOI 10.1007/978-1-4939-2782-1 Library of Congress Control Number: 2015942581 Mathematics Subject Classification (2010): 92-06, 92Bxx, 92C50, 92D25 Springer New York Heidelberg Dordrecht London © Springer Science+Business Media, LLC 2015 This work is subject to copyright.
    [Show full text]
  • Topological Dynamics: a Survey
    Topological Dynamics: A Survey Ethan Akin Mathematics Department The City College 137 Street and Convent Avenue New York City, NY 10031, USA September, 2007 Topological Dynamics: Outline of Article Glossary I Introduction and History II Dynamic Relations, Invariant Sets and Lyapunov Functions III Attractors and Chain Recurrence IV Chaos and Equicontinuity V Minimality and Multiple Recurrence VI Additional Reading VII Bibliography 1 Glossary Attractor An invariant subset for a dynamical system such that points su±ciently close to the set remain close and approach the set in the limit as time tends to in¯nity. Dynamical System A model for the motion of a system through time. The time variable is either discrete, varying over the integers, or continuous, taking real values. Our systems are deterministic, rather than stochastic, so the the future states of the system are functions of the past. Equilibrium An equilibrium, or a ¯xed point, is a point which remains at rest for all time. Invariant Set A subset is invariant if the orbit of each point of the set remains in the set at all times, both positive and negative. The set is + invariant, or forward invariant, if the forward orbit of each such point remains in the set. Lyapunov Function A continuous, real-valued function on the state space is a Lyapunov function when it is non-decreasing on each orbit as time moves forward. Orbit The orbit of an initial position is the set of points through which the system moves as time varies positively and negatively through all values. The forward orbit is the subset associated with positive times.
    [Show full text]
  • Glossary of Some Terms in Dynamical Systems Theory
    Glossary of Some Terms in Dynamical Systems Theory A brief and simple description of basic terms in dynamical systems theory with illustrations is given in the alphabetic order. Only those terms are described which are used actively in the book. Rigorous results and their proofs can be found in many textbooks and monographs on dynamical systems theory and Hamiltonian chaos (see, e.g., [1, 6, 15]). Bifurcations Bifurcation means a qualitative change in the topology in the phase space under varying control parameters of a dynamical system under consideration. The number of stationary points and/or their stability may change when varying the parameters. Those values of the parameters, under which bifurcations occur, are called critical or bifurcation values. There are also bifurcations without changing the number of stationary points but with topology change in the phase space. One of the examples is a separatrix reconnection when a heteroclinic connection changes to a homoclinic one or vice versa. Cantori Some invariant tori in typical unperturbed Hamiltonian systems break down under a perturbation. Suppose that an invariant torus with the frequency f breaks down at a critical value of the perturbation frequency !.Iff =! is a rational number, then a chain of resonances or islands of stability appears at its place. If f =! is an irrational number, then a cantorus appears at the place of the corresponding invariant torus. Cantorus is a Cantor-like invariant set [7, 12] the motion on which is unstable and quasiperiodic. Cantorus resembles a closed curve with an infinite number of gaps. Therefore, cantori are fractal. Since the motion on a cantorus is unstable, it has stable and unstable manifolds.
    [Show full text]
  • Dynamical Systems Theory
    Dynamical Systems Theory Bjorn¨ Birnir Center for Complex and Nonlinear Dynamics and Department of Mathematics University of California Santa Barbara1 1 c 2008, Bjorn¨ Birnir. All rights reserved. 2 Contents 1 Introduction 9 1.1 The 3 Body Problem . .9 1.2 Nonlinear Dynamical Systems Theory . 11 1.3 The Nonlinear Pendulum . 11 1.4 The Homoclinic Tangle . 18 2 Existence, Uniqueness and Invariance 25 2.1 The Picard Existence Theorem . 25 2.2 Global Solutions . 35 2.3 Lyapunov Stability . 39 2.4 Absorbing Sets, Omega-Limit Sets and Attractors . 42 3 The Geometry of Flows 51 3.1 Vector Fields and Flows . 51 3.2 The Tangent Space . 58 3.3 Flow Equivalance . 60 4 Invariant Manifolds 65 5 Chaotic Dynamics 75 5.1 Maps and Diffeomorphisms . 75 5.2 Classification of Flows and Maps . 81 5.3 Horseshoe Maps and Symbolic Dynamics . 84 5.4 The Smale-Birkhoff Homoclinic Theorem . 95 5.5 The Melnikov Method . 96 5.6 Transient Dynamics . 99 6 Center Manifolds 103 3 4 CONTENTS 7 Bifurcation Theory 109 7.1 Codimension One Bifurcations . 110 7.1.1 The Saddle-Node Bifurcation . 111 7.1.2 A Transcritical Bifurcation . 113 7.1.3 A Pitchfork Bifurcation . 115 7.2 The Poincare´ Map . 118 7.3 The Period Doubling Bifurcation . 119 7.4 The Hopf Bifurcation . 121 8 The Period Doubling Cascade 123 8.1 The Quadradic Map . 123 8.2 Scaling Behaviour . 130 8.2.1 The Singularly Supported Strange Attractor . 138 A The Homoclinic Orbits of the Pendulum 141 List of Figures 1.1 The rotation of the Sun and Jupiter in a plane around a common center of mass and the motion of a comet perpendicular to the plane.
    [Show full text]