Arxiv:2108.04181V2

Home , Rufus Bowen

arXiv:2108.04181v2 [nlin.CD] 12 Aug 2021 eopsn h yaiso h oez16 oe sn Unst using model 1963 Lorenz the of Dynamics the Decomposing lcso hoi yais uleltrdrvdthe derived later building first Ruelle essential [68] Gutzweller the dynamics. dynamical chaotic are UPOs. of weighted UPOs of blocks as set theory that averages full a demonstrated dynamical develop the UPOs. to write over neighbouring possible sum to of is allows it those that context with this trajectory Within properties the dynamical the the of identify their of to of decomposition enabling modal because dynamics, a repulsion provide trajectory another, UPOs of to The instability. UPO mechanism as one chaos. a considered of of undergoing neighbourhood landscape be the a can from in moves an UPOs order with of system islets [67]. they the [66], in accuracy attractor trajectory the arbitrary the in any reconstruct dense approximate to are can [65]. UPOs used system since dynamical be fact, chaotic In can dynamics a of they the properties that for statistical sense skeletal the investigation. the are to mathematical in orbits of key centre periodic the the Unstable UPOs be at then, might been Since have [64]. the and systems in chaotic dynamics of hidden understanding the skeleton rigid of of unstable a Poincaré,chaos a [63] properties represent by provide noticed orbits statistical early periodic they the As cases describe system. exhibit the some to that in tool systems powerful dynamical and of behaviour analysis chaotic the in role opeeudrtnigo h ulsto hr UPOs a short that known of well set is full sum It the weighted of UPOs. a of understanding as set complete system infinite the the of over measure natural the ∗ † [email protected] [email protected] ntbeproi ris(Ps lya important an play (UPOs) orbits periodic Unstable ζ iigpoessocrigi h ytmb aigadvantag pro taking by we system matrix the in Thr stochastic occurring states. processes corresponding mixing different the the as of between taken are eigenvectors transitions traje neighbourhood the forward its study the and then UPO of Each scattering UPOs. the various them the studying ap undersamples by local severely w chain best algorithm First, Markov the UPO-detecting provide our perspectives. overwhelmingly if different position UPOs two the period to from proximity longer process their to this according approximat study UPOs be can the orbit valu rank chaotic parameters’ a we distill how classic to investigate We the and with UPOs. system model of a 1963 Lorenz from the information here extract to one allow ucin[9 htalw n owrite to one allows that , [69] function ntbeproi ris(Ps r aubeto o stud for tool valuable a are (UPOs) orbits periodic Unstable .INTRODUCTION I. etefrteMteaiso lntErh nvriyo Re of University Earth, Planet of Mathematics the for Centre vrgs rniin,adQaiIvratSets Quasi-Invariant and Transitions, Averages, eateto ahmtc n ttsis nvriyo Re of University Statistics, and Mathematics of Department haaCclaMaiocchi Cecilia Chiara ∗ uda rniieAimAsse o h ups of purpose the for system.’ the system of A consider properties Axiom macroscopic to transitive computing allowing a as problem, fluid first the to general of The in predictability. contraction is hypothesis’ finite-time entropy, state and space of This phase nonequilibrium generation 78]. in by [77, out, characterised (NESS) died expansion. state have steady orbit transients systems after periodic such considered, live, of are systems conditions validity turbulent hypothesis A When the the is verify it for Axiom to flows, impossible, fluid required and not of if models hyperbolic difficult, complex often in as However, 76]. such [75, chaoticity 74], strong be exhibiting to [73, systems proven dynamical are for results of valid These approximation [70–72]. accurate averages an ergodic obtaining in suffice would eiso plctos[2 3 n eosrtdthat demonstrated dynamical and a the through 83] theory of procedure [72, expansion orbit this cycle applications tested periodic of of al. series solid et a applications Artuso provided the (POT). invariant and for the system dynamical measuring ground a for are of tool UPOs very properties practical that with argued optimal Cvitanović map [82] the Hénon paradigmadic accuracy. order high the strange the of of of entropy UPOs the attractor topological approximated and of they dimension set stabilities, fractal fact, their of complete In calculating capable and the trajectories. extracting that chaotic and proving of by accessible by structure [81], the experimentally in unfolding are al. et UPOs Auerbach by performed n aei Lucarini Valerio and rtapiaino eidcobtepninwas expansion orbit periodic of application first A .Usal eidcObt:Applications Orbits: Periodic Unstable A. ftecneto us-nain sets. quasi-invariant of concept the of e terms in dynamics its decompose and e uhteaayi ftesubdominant the of analysis the ough ieadffrn nepeaino the of interpretation different a vide igcatcdnmclsses They systems. dynamical chaotic ying eod ecntutafinite-state a construct we Second, . n ht oehtunexpectedly, somewhat that, find e t yaia tutr.W consider We structure. dynamical its di em fUO.A ahinstant, each At UPOs. of terms in ed tr ewe h egbuho of neighbourhood the between ctory rxmto otetaetr,even trajectory, the to proximation fteobti h hs pc.We space. phase the in orbit the of fGlaot 7,8]oesapsil solution possible a offers 80] [79, Gallavotti of osbesaeo h ytm We system. the of state possible a † dn and ading ading beProi Orbits: Periodic able ζ ucini instru- is function aturbulent ’a ’Chaotic n 2 mental for the analysis of deterministic chaos, even in B. This paper more generic settings than the ones required by [82], i.e. when the system is not uniformly hyperbolic nor Our research aims to give a contribution towards the the results depend on the assumption of the existence computational problems in the application of periodic of invariant measures or structural stability of the orbits theory. We believe that POT could indeed dynamics. Eckhardt and Ott [70] presented one of represent a very powerful tool allowing to gain insight the first numerical applications of the periodic orbit and simplify complex systems such as the climate, but formalism for studying the statistical and the dynamical its implementation is often hindered by the numerical properties of the Lorenz 1963 (L63) system [84]. A difficulties associated with UPOs search [93]. We subsequent analysis of the linear and nonlinear response consider the L63 model as a test case. The use of UPOs of the L63 to perturbations found that specific UPOs for averaging in L63 has been hugely debated in the were responsible for resonance mechanisms leading to an literature (See discussion in section II A 2 ). We will amplified response [85]. not delve into this matter, but we rather want to shed light on the shadowing mechanism and investigate its underpinning dynamics. In order to avoid confusion, Later on, periodic orbit theory found fruitful applica- since the term ”shadowing” can be used with the tions also within the context of higher dimension forced meaning given in [67], we specify that by ”shadowing” and dissipative non-equilibrium systems, specifically in we refer to the process of approximation of the chaotic the case of (geophysical) fluid dynamics. UPOs can be trajectory in terms of UPOs. In particular, at each considered as a mean to simplify and interpret qualitative point in time we rank UPOs based on their distance behaviour of a complex system [86], allowing to extract with respect to the given chaotic trajectory. We name information and distill its dynamical structure. This ob- this process ranked shadowing. Within this context, servation, together with the study of the stability and our approach is twofold. On the one side we aim at thus predictability properties of the tangent space, al- numerically understand how chaotic trajectories are lows to associate relevant dynamical features of the flow approximated in terms of UPOs. On the other side, we to specific UPOs or classes of UPOs. UPOs, true nonlin- study transitions between neighbourhood of UPOs. ear modes of flow, can be interpreted as a generalisation of the normal modes observed in a network of coupled linear oscillators, that allow for a study of the system In the first part of our work we analyse the shadowing in its complexity, without the necessity of considering a process by taking a local point of view and studying heavily truncated model. the shadowing statistics of a chaotic trajectory. Namely, we numerically implement the shadowing process, fo- Even though a periodic-orbit-theory-type expansion cusing on the point-wise dynamics along the trajectory, for turbulence is still a far reaching goal, many steps by locating the closest UPOs to each point, ordered have been made in this direction. The path towards the accordingly to their distance from the chaotic trajec- description of a turbulent flow in terms of UPOs is paved tory. Extending periodic search to higher dimensional with promising results [87]. Kawahara and Kida [88], systems still represents an open challenge [89] and who found a UPO embedded in the attractor of a nu- standard periodic averaging with an incomplete set of merical simulation of plane Couette flow, showed that one UPOs does not provide accurate results. A possible UPO only manages to capture in a surprisingly accurate strategy to overcome the aforementioned difficulties way the turbulence statistics. Chandler and Kerswell [89] has been proposed by Lasagna [94, 95], who found identified 50 UPOs of a turbulent fluid and used them to numerical evidence that long period orbits could be used reproduce the energy and dissipation probability density as proxies of chaotic trajectories. Following the idea functions of the system as dynamical averages over the that long UPOs might be able to capture statistical orbit. These encouraging results suggested that periodic properties of chaotic trajectories, periodic search could orbit theory could represent a valid investigation tool also be limited to few long UPOs, notably reducing the in the realm of climate systems. Lucarini and Gristun computational complexity of the problem. In line with [86] considered POT as a novel mathematical framework this work, we find that longer UPOs have the lion’s for investigating atmospheric, ocean and climate dynam- share in reproducing the invariant measure of the system. ics. Gritsun [90] numerically applied the theory of UPOs expansion [73, 91] to reconstruct the probability distri- In the second part of this paper, inspired by the work bution function of a simple atmospheric model based on of Froyland and Padberg on quasi-invariant sets [96, 97], the barotropic vorticity equation of the sphere. Gritsun we assume a global point of view on the dynamics and Lucarini [92] used the periodic orbit machinery for by extracting the dynamical behaviour of the system interpreting non trivial resonant responses to forcing by via a Markov model [98]. In doing this we abandon associating it to a set of extremely unstable UPOs. the classical Ulam’s partition [99] of the phase space 3 in virtue of a possibly novel one: each UPO is seen measure ρ, invariant and ergodic with respect to St, in as a unitary building block of the system, a spatially the following manner: extended state, and the shadowing process can be inter- T preted as transitions between different states. We will 1 t <ϕ>= ρ(dx)ϕ(x) = lim ϕ(S x0)dt (1) show that this new perspective on the dynamics allows T →∞ T 0 for a different interpretation of quasi-invariant sets [97] Z Z in terms of UPOs and provides a better understanding for almost all initial conditions x0 belonging to the basin of mass transport. Namely, by studying the spectral of attraction of Ω. properties of the discretised transfer operator, we obtain a partition of the phase space in different bundles of A periodic orbit of period T is defined as UPOs, each one identifying a quasi-invariant region. We T prove that UPOs represent a valid tool to investigate S (x)= x. (2) diffusion properties of the system, in fact, being exact solutions, they retain a memory of the geometrical This representation is not unique. In fact, if equation 2 nT N structure of the attractor. is satisfied, S (x) = x is verified as well ∀n ∈ . By the semigroup property of the evolution operator, we T s The structure of the rest of the document is as follows. also have that S (y) = y if y = S (x) for any choice We describe the ranked shadowing process in section II. of s. From now onward we will considered a periodic We introduce the mathematical framework, describing orbit to be identified by its prime period T and initial the characteristics of the selected database of UPOs. We condition x0. then discuss the statistics emerging from the shadowing of a chaotic trajectory. We prove the robustness of the results in dependence of the shadowing criteria. It emerges 2. The Model that longer period orbits play a major role in reproducing the invariant measure of the system. In section III we study the shadowing dynamics from a probabilistic point We choose as testing ground the L63 model, which of view. We introduce the discretised transfer operator represents one of the most paradigmatic chaotic systems, and describe transitions in terms of UPOs. We identify since for some parameters value it exhibits a strange quasi-invariant sets through the study of the spectrum attractor [100] densely populated by an infinite number of the transition matrix and recollect the mass diffusion of UPOs [101]. dynamics. In section IV we outline our conclusions and perspectives for future works. In the Appendix [34] we The set of equations of the model are given by: provide a more extensive description of the algorithms considered for our analysis. x˙ 1 = −σ(x1 + x2) x˙ 2 = ρx1 − x2 − x3x1

x˙ 3 = −βx3 + x1x2 II. SHADOWING MECHANISM where the three parameters σ,ρ,β are positive num- A. Experimental Setting bers respectively proportional to the Prandtl number, Rayleigh number and geometry of the considered re- In this section we numerically investigate the shadow- gion. In this work we consider the classical Saltzmann ing mechanism, with the aim of understanding whether parameter σ = 10, ρ = 28 and β = 8/3. For such it is possible to identify a set of key UPOs that capture values, the dynamics of the system is characterised by a the qualitative behaviour of the system. chaotic behaviour on a singularly hyperbolic attractor that supports an SRB measure [102]. With chaotic we indicate the property of sensitive dependence on initial conditions of the model. In particular, the first 1. Mathematical Framework Lyapunov exponent, that gives information on the asymptotic rate of divergence of the trajectories, is We consider a continuous-time autonomous dynami- positive [103]. cal systemx ˙ = f(x) on a compact manifold M ⊂ Rn, t where x(t) = S x0, with x0 = x(0) initial condition and Many studies on UPOs of the Lorenz system have been t S evolution operator defined for t ∈ Rt>0. We define carried out. It is known that a good understanding of the Ω ⊂ M as the compact attracting invariant set of the UPOs of the model plays a fundamental role in the char- dynamical system. A differentiable function (observable) acterisation of the system. In fact, the invariant measure ϕ : M → R is also given, and it specifies the probability of the system can be reconstructed through the use of 4 trace formulas [91] by considering the following expres- M¯ = 34191 orbits, whose statistics of prime periods is sion for the average of any measurable observable ϕ: shown in Fig. 1. The periods span from Tmin = 1.5587 to T = 17.1398. L63, being a chaotic system for the U p U p max U p,p≤t w ϕ¯ current choice of parameters’ value, is characterised by <ϕ>= lim p (3) t→∞ U P U p,p≤t w the presence of a positive Lyapunov exponent in its SRB

p measure, e.g. Λ1 > 0 [103]. The distribution of values where U p is a UPO of primeP period p, wU is its weight p of Λ1 > 0 among the UPOs included in the database is andϕ ¯U is the average of the observable along the or- presented in Figure 2, calculated as per [110]. As we see, bit. For uniformly hyperbolic dynamical systems this the distribution of values is peaked with a small spread of result is exact and the weight can be obtained, to a first just few percents, and, in particular, no UPO has a van- U p U p approximation, by w ∝ exp(−phks ) [65] , with hks ishing or negative value of Λ1 (which would go against being the Kolmogorov-Sinai entropy of the system. This the chaotic nature of the flow). Note that, as well known, quantity provides information on the rate of creation of the local instability of the L63 model varies wildly within information due to the chaoticity of the system. From its attractor, where regions with very high instability al- the knowledge of the Lyapunov exponents of the system ternate with regions where one observes return-of-skill Λi [103], which describe how linearised neighborhoods of for finite-time forecast [111]. Hence in this case, as op- the trajectory evolve in time, we can recollect an explicit posed to what observed in [86], the heterogeneity of the expression for hks via Pesin theorem [104] attractor in terms of instability cannot be explained using UPOs, possibly because we are considering here a hks ≤ Λi, (4) very low-dimensional flow. ΛXi>0 Our UPO sample does not present the characteristic where the left and right hand sides are equal if the in- exponential growth with the period [112] and is biased variant measure is of the SRB type (as in the case of L63 towards shorter UPOs, which is known are easier to be for the chosen parameters’ value). Eckhardt and Ott [70] found [86, 90]. This issue could be resolved by improving presented one of the first numerical applications of the the search algorithm and allocating more computational periodic orbit formalism by considering an approximate resources. Many numerical algorithms have been pro- symbolic coding [82] (UPOs with period up to 9) to cal- posed so far. Saiki [113] reviewed the Newton-Raphson- culate Hausdorff dimensions and Lyapunov exponents. Mees method, proposing a value for the damping coeffi- Franceschini, Giberti and Zheng [105] calculated a num- cient related to the stability exponent of the orbit, while ber of UPOs of the Lorenz attractor at both standard Barrio et al. [114] carried out an extensive high-precision and non standard parameter values and used them to numerical simulation in order to gather a benchmark approximate the topological entropy and Hausdorff di- database of UPOs for L63. Galias and Tucker [115], com- mension. Zoldi [106] investigated to what extent trace puted all the UPOs of symbolic dynamics period T ≤ 14. formulas can can predict the structure of the histogram However, we want to remark that our analysis is not in- of chaotic time series data extracted from the run of the tended as an extensive calculation of UPOs in L63, but L63 model with different parameter values. The use of aims at developing tools that would enable us to take ad- a correct weighting in the trace formula has been vastly vantage of the periodic orbits machinery even when the investigated, see for a debate [107–109]. symbolic dynamic is not known or when higher dimen- In this paper we do not want to improve the way UPOs sional systems are considered. In virtue of this motiva- are used to compute sample averages, nor enlarging the tion we thus decided to settle with the aforementioned already extensive database UPOs of the system, instead database. we wish to investigate how well an imperfect subset of UPOs can be used to reconstruct a long chaotic trajectory and interpret the transitions from one neighborhood 4. Shadowing the Chaotic Trajectory of the orbit to another. In this section we present results on how the UPOs shadow a chaotic trajectory. Since the system is er- 3. The Database godic and we consider a long trajectory compared to the timescale of the system, we assume that the statistics pre- In this section we describe some general characteristics sented here do not depend on the choice of the chaotic of the collected set of UPOs. The extrapolation of UPOs trajectory. represents a complex numerical challenge. One of the Let us denote the set of UPOs of the database as U = M¯ main obstacles in applying periodic orbits theory resides {Uk}k=1 where the UPO Uk is intended as a set of points dt∗Tk in fact in the intrinsic difficulty of numerically extract- in the system phase space Uk = {uk(s)}s=1 , with Tk ing the orbits from the model. Via Newton’s method being its period and dt the time step. We consider a (see Appendix [34] for more details) we obtain a set of numerical chaotic trajectory Xchaotic consisting of the set 5

9000 105

8000

7000 4 10

6000

5000 103 4000

3000 102 2000

1000 number of shadowing UPOs total number of UPOs in the database 101 0 100 101 102 103 104 105 2 4 6 8 10 12 14 16 18

FIG. 1. Number of detected UPOs vs their prime period FIG. 3. Number of shadowing UPOs as a function of the length of the shadowed chaotic trajectory

50 B. Statistics of the Shadowing 45

35 1. Shadowing time and Occupancy ratio

25 Our main goal is to shed light on the shadowing mecha-

20 nism. It is crucial to develop some tools that are capable

15 of measuring to what extent each UPO contributes in

10 the approximation of the chaotic trajectory. With this

5 purpose in mind, we deﬁne the shadowing time and oc-

0 cupancy ratio of a UPO. The shadowing time of a UPO 0.82 0.84 0.86 0.88 0.9 0.92 0.94 0.96 0.98 is defined as the amount of time that the UPO spends shadowing the chaotic trajectory. More precisely, if the FIG. 2. Distribution of the maximal Lyapunov exponent UPO Uk is selected as shadowing orbit tk times, its shadowing time will be rk = tk ∗ dt . This quantity is a good indicator for the absolute shadowing time, but it does Tmax not take into account the length of the UPO. It is sen- of points Xchaotic = {xt}t=1 where Tmax = Nchaotic ∗ dt , being Nchaotic the number of points of the chaotic sible that a longer period UPO corresponds to a longer trajectory and therefore, since it explores more exten- trajectory. We say that the UPO Uk¯ shadows the chaotic trajectory Xchaotic at time t if sively the phase space, it might shadows the trajectory for longer time. To measure the absolute shadowing time we introduce the occupancy ratio for the UPO Uk, defined min |uk¯(s) − x(t)| = min(min |uk(s) − x(t)|) (5) s k s as o = tk with T being the period of the UPO. In k Tk/dt k this way we are able to measure the shadowing time nor- This calculation was carried out using all available malised over the period of the UPO. periodic orbits, with an output time-step dt = 0.01 (See Appendix [34]). for more details on the algorithm specification). 2. Longer Period Orbits Shadow the Trajectory for a Longer Time It is clear from the definition that it is possible that not all the UPOs of the database would be considered in We find that higher period orbits have a major role the shadowing process. in reproducing the invariant measure of the system. In We can see from Fig. 3 that a chaotic orbit of length fact, not only the trajectory is shadowed for most of the 5 Tmax = 10 almost exhausts the database without sat- time by UPOs with period greater than 5.5 (Fig. 4), but urating the UPOs (98.6% of the UPOs of the database we also observe a positive correlation between occupancy are shadowing UPOs). We believe that this is the ideal ratio and UPOs period (Fig. 5b). This is even more length to produce reliable statistics. From now onward interesting if we note that longer period UPOs are less all the statistics produced are derived from data obtained represented in the database we considered (Fig. 1). We 5 by shadowing a chaotic trajectory of length Tmax = 10 also remark that for T < 5.5 the average occupancy with the full database. ratio has a magnitude of 10−1, while for T > 5.5 the 6

1 0.2

0.9 0.18

0.8 0.16

0.7 0.14

0.6 0.12

0.5 0.1

0.4 0.08

0.3 0.06

0.2 0.04

0.1 0.02

0 0 2 4 6 8 10 12 14 16 18 0 10 20 30 40 50 60 70 80

(a) FIG. 4. UPOs with period larger than 5.5 (which represent 20% of the shadowing UPOs) shadows the trajectory 80% of 3.5 the total time. 3

2.5 70 2 60 1.5 50 1 40 0.5 30 0 0 1 2 3 4 5 6 20

10 (b)

0 0 2 4 6 8 10 12 14 16 FIG. 6. Distribution of the shadowing time (panel (a)) and occupancy ratio (panel (b)). Dashed lines: UPOs with period (a) smaller than 5.5. Solid lines: UPOs with period greater than 5.5. 6

5 instead of limiting the selection to the minimum only. We want to test whether even allowing for a looser def- 4 inition of shadowing UPOs, the positive correlation be-

3 tween higher period and longer occupancy ratio remains consistent. 2 More precisely, for each point xt along the chaotic trajectory Xt we select a set of N ordered UPOs consisting 1 of the ﬁrst N UPOs that minimise the distance with xt.

0 In this context, we are interested in average quantities 0 2 4 6 8 10 12 14 16 over all tiers. Namely, we deﬁne the average occupancy (b) ratio at time t as

FIG. 5. Shadowing time (panel (a)) and occupancy ratio N (panel (b)) increase with the period of the UPO (2σ error 1 o¯ = o (6) bars). t N k Xk=1 where N is the number of tiers and ok is the UPO that average is of order 1 (See Fig. 6b). shadows the trajectory at time t. Similarly we deﬁne the average period at time t in tier k. Note that in each In order to assess the robustness of our results and tier the shadowing UPO is chosen among the full set of test the sensitivity with respect to numerical rounding, orbits, meaning that a cycle could shadow the trajectory we conduct a similar analysis, allowing for the shadow- at point t in more than one tier. ing algorithm to select N shadowing UPOs at each step Figure 7 conﬁrms the importance of higher period 7

8 45

7.5 40

7 35

6.5 30

6 25

5.5 20

5 15

4.5 10 Average period of the orbits of the database 4 0 0.5 1 1.5 2 2.5 3 5 10-3 0 0 2 4 6 8 10 12 14 16 FIG. 7. Solid line: Average period of the shadowing UPOs calculated over diﬀerent tiers. Each UPO is weighted propor- (a) tionally to how many times it is chosen as shadowing UPO. On the x-axis we indicate the percentage of UPO of the full 3.5 database in each tier. 3

2.5

UPOs. The average period of the shadowing UPOs 2 over all tiers is sensibly higher than the average period 1.5 of the set of shadowing UPO and it monotonically 1 decreases as orbits in further tiers are selected. This reﬂects the fact that longer period UPOs are indeed 0.5 prioritised in the shadowing process and this choice 0 is consistent over the full length of the chaotic trajectory. 0 2 4 6 8 10 12 14 16

(b) The robustness of the analysis is confirmed when reproducing the statistics presented in Fig. 5 with N shadow- FIG. 8. Shadowing time (panel (a)) and occupancy ra- ing UPOs. The results are presented in Fig. 8. Allowing tio (panel (b))averaged over first 10 (black), 30 (red) and 100(blue) tiers (2σ error bar). for more shadowing UPOs does not affect the correlation found in the previous section when considering average quantities. A. Extracting a Markov Chain from the Dynamics These results are robust when under sampling the set of UPOs down to 2 orders of magnitude. They provide an A very valuable tool to study transitions and evolution insight into the shadowing dynamics and are particularly of measures in dynamical systems is offered by the trans- useful in the applications of periodic orbits theory. In fer operator. Let F : Ω ∈ Rd → Rd be a smooth vector t fact, knowing a priori that longer UPOs play a major field, generating the dynamical system or flow {Φ }t∈R, role in reproducing the invariant measure of the system with Φt : Ω → Ω. We define [96] the Perron-Frobenius 1 1 could give a contribution to the optimisation of periodic operator or transfer operator Pt : L (Ω) → L (Ω) by search algorithms by addressing computational resources to a limited subset of UPOs. Hence our findings seem to Ptf(x)= f(Φ−t(x))|det(DΦ−t(x))|, (7) provide support to the approach proposed by Lasagna in [94, 95], nonetheless it is not clear to us why this might where DΦ−t(x) is the Jacobian matrix corresponding to hold true. the spatial derivatives of Φt. The transfer operator is a statistical tool that describes how the densities globally evolve with time. From the study of its spectral properties we can deduce significant statistical information about the system, such as mixing properties, invariant III. TRANSITIONS densities and decay of correlations [98, 116]. For instance, fixed points of Pt represent invariant densities for the dynamics, that remain unaltered by the flow. In this section we use UPOs as a tool to investigate the We need to define an appropriate numerical estimate of mixing properties of the system. The ranked shadowing the transfer operator Pt. In fact, in order to tackle the will be used to define the Markov process that describes problem from a numerical standpoint, we have to con- transitions between neighbourhood of UPOs. sider the transfer operator within a finite dimensional 8 setting, where the phase space is not interpreted as a We focus on the process of scattering that the forward continuum, but it is appropriately discretised into a finite trajectory undergoes by being repelled continuously be- collection of regions, with mass moving from one region tween the neighbourhood of the various UPOs. to the other at each iteration of the transfer operator. Let us recall a few basic properties of the spectrum It is important to notice that at this stage the dynam- of a general stochastic matrix. Its leading eigenvalue is ics occurring within each set of the partition is ignored, λ = 1, and its corresponding eigenvector w(1) , in the and we are just interested in the macroscopic movement case of an ergodic Markov chain, determines the unique of mass. Different methods for defining this approxima- invariant measure. The other eigenvalues, which can be tion have been developed. For the well-known Ulam’s proven to be inside the unit circle, fulfill the condition method [99] the approximation takes the form of a reg- w(λ) = 0. The subdominant eigenvalues , ordered ac- ular lattice covering the phase space. More precisely, let j j M cordingly to 1 > ℜ(λ2) ≥ ℜ(λ3) ≥ ... ≥ ℜ(λM ), can be {Bi}i=1 be a partition of the phase space in M boxes of P M thought of as modes of decay, as they determine the time identical size, so that Ω = i=1 Bi. Let χBi be the char- scale of convergence to the stationary probability mea- acteristic function of Bi ⊂ Ω. We consider the projection sure. We can quantify these time scales by defining the 1 S dt πM : L (Ω) → sp{χB1 , ..., χBM } given by corresponding decay rate as τ = − , where dt k log(ℜ(λk )) M 1 takes into account how we have discretised the dynam- πM f = f dm χB , (8) ics in the time domain. In particular, τ identifies the m(B ) i 2 i=1 i Bi X Z mixing time scale [103]. with m being the normalised Lebesgue measure on Ω. We consider a set of M UPOs and corresponding

The action of Pt on sp{χB1 , ..., χBM } admits the follow- neighbourhoods chosen at random from our database. ing matrix representation We present results for M = 300. The corresponding plots m(B ∩ Φ−τ B ) for M = 100, 1000 are displayed in the supplementary P τ = i j . (9) i,j m(B ) material [34] and indicate the robustness of our results. i Choosing a sufficiently large M makes sure that, with τ By construction we have that P is a stochastic overwhelming probability, we have a selection of UPOs τ M τ matrix. It follows that Pi,j ≥ 0 and i=1 Pi,j = 1 that has a distribution of periods that is comparable ∀j =1, ..., M, since P τ gives the probability of being in i,j P with the one of the full dataset. We remark that we are state i at time t+τ being the system in state j at time τ. unable to use the full set of M¯ UPOs because it leads to substantial computational difficulties. We derive the We propose here a different way to discretise the dy- matrix P dt following the procedure outlined in Section namics of the system. We select M numerical UPOs III A, by considering the shadowing of a chaotic trajec- 5 dt U1, ..., UM and we associate the states A1, ..., AM ob- tory with length Tmax = 10 . P is a stochastic matrix tained by considering the UPOs together with their by construction, its first eigenvalues are λ1 = 1, λ2 = neighbourhoods. Each Ai represents one of the possible 0.9931, λ3 = 0.9921, λ4 = 0.9907 and the corresponding discrete states of the system. We implement the shadow- decay rates are τ2 = 1.4443, τ3 = 1.2608, τ4 = 1.0154. ing algorithm: at each time step t the UPO Uk that min- We also verified that the associated stochastic process is imises the distance with the chaotic trajectory is selected Markovian and that for each matrix (corresponding to (See section II A 4 for more details on the algorithm). M = 100, 300, 100 UPOs) there exist a value Nˆ so that Hence we say that the system is in the state Ak at time t. Nˆ Pi,j 6=0 ∀ i, j, implying that the process is ergodic. The stochastic variable s : {1, ..., Nchaotic · dt}⊂ N → A describes the shadowing process just outlined as follows: We want to portray these modes in R3, in order to s(t)= Ak (10) understand the geometrical structure associated with the UPOs. We will proceed as follows. It is known [117] with Ak being the shadowing UPO at time t and corresponding neighbourhood. We then construct the stochas- that the attractor of the L63 model is contained in a R3 tic matrix along the lines of equation 9 as compact subset of , being it the Cartesian product P = [−20, 20] × [−27.5, 27, 5] × [1, 48]. We cover this #{k : (s(k)= Aj ) ∧ (s(k + dt)= Ai)} 103400 dt region with 103400 boxes D = {Di} of equal size Pi,j ≈ (11) i=1 Nchaotic 1. The boxes are built having adjacent sides, so that where # defines the cardinality of the set. D constitutes a partition of P. Each UPO and corresponding neighbourhood intersects a certain number of boxes and each box might contain contributions from B. Spectral Properties of the Transfer Operator different orbits. We would like to define a numerical quantity (mass) that weighs the contribution given In this section we use the spectrum of the stochastic by UPOs of different types within each box. We set matrix P dt to study the mixing properties of the system. a fixed number of points N¯ to be represented in the 9 phase space a priori. We then assign the points to each box, depending on the weight given by the different The adapted algorithm is set up as follows. We UPOs and corresponding neighbourhood from v(2). We calculate the transition matrix P dt with the method- consider the transformationv ˆ(2) = |v(2)|/||v(2)||. Each ology outlined in the previous paragraph. Let w(2) be state Ai will be awarded of a number of pointsn ¯i given the eigenvector associated with λ2. We consider the (2) ¯ (2) (2) w(2) byn ¯i =v î · N. We will sample these points uniformly mapping s : {w1 , ..., wM }→{1, −1} provided by : along the UPO trajectory. Thus, each states of the system (i.e. each periodic orbit and its neighbourhood) (2) will be characterised by two quantities: s(vi ), its (2) (2) −1 w ≤ 0 ”type”, andn ¯i, its weight. Let θ be a map θ : D → R i s(wi )= (2) (12) that associates a numerical value to each box, with the (1 wi > 0 aim of quantifying the proportion of orbits of each kind. (2) th We consider the box Dj . Let us call posj and negj the where wi indicates the i component of the eigen- number of positive and negative points contained in vector w(2) corresponding to the state i. Note that this the box. We define θ(Dj ) = posj + negj, to quantify mapping closely resembles what we have done in Section the mass contained in each cube. The results of the III B except that the weighting of the mass is removed, aforementioned decomposition are presented in Figure whereas the sign of the component is kept. This allows 9. Panel 9a describes the invariant measure, panels us to define two sets B1 and B2: 9b, 9c, 9d describe the subdominant eigenvalues. The latter show the geometrical structures describing how an (2) initial probability measure converges to the invariant one. B1 = Ai where I1 = {i : s(wi )=1} (13) ∈I1 i[ We wish to provide a somewhat alternative interpre- (2) B2 = Ai where I2 = {i : s(wi )= −1} (14) tation of the plots corresponding to the subdominant i∈I2 eigenvalues as follows, keeping in mind that UPOs are [ invariant sets and provide exact solutions of the evolu- We thus grouped the UPOs and corresponding neigh- tion equations. We propose that regions characterised bourhoods into two different bundles as discussed in by the same colour (red and blue in our figures) are as- [96]. These two sets heuristically identify quasi-invariant sociated with separate bundles of UPOs. The forward regions between which little communication is expected. trajectory undergoes transitions between the neighbourhood of the UPOs belonging to a bundle, and is repelled We test the heuristic procedure for three sets of states with low probability towards the neighbourhood of an of different size. Namely, we choose at random from our UPO belong to the other bundle. The closer to one the database a set of 100, 300 and 1000 UPOs. We found ro- real part of an eigenvalue, the less efficient is the exchange bustness with respect to the size of the sample and thus between regions of different colours in the corresponding present the results only for 300 states. The other two mode. We observe that the smaller the eigenvalue, thus cases can be found in the supplementary material [34]. associated to faster decay rate, the finer the geometrical For each set of UPOs and corresponding neighbourhoods structure associated with the mode. This agrees with our we calculate the transition matrix, its leading eigenval- intuition on how diffusion works. ues and the associated decay time. The result are presented in Figure 10. The second eigenvector w(2) provides information on slowest rate at which the system is C. Quasi-Invariant Sets mixing, defining the largest quasi-invariant macroscopic structures. We see a clear qualitative correspondence be- It is possible to provide further support to the in- tween the patterns observed in Fig. 9b and 10a. B1 terpretation given above to the geometrical structures and B2 - corresponding to the alternating red and blue determined by the subdominant modes. In fact, these regions - identify two quasi-invariant structures in the resemble the quasi-invariant sets studied by Froyland phase space between which we expect little diffusion. We and Padberg for L-63 [96]. Loosely speaking, quasi- now take a step further and extract information from the invariant sets are macroscopic dynamical structure such other subdominant eigenvalues λk of the transfer opera- that the probability of individual trajectories beginning tor. More precisely, the subdominant eigenvectors w(k) in the subset would leave it in short time is very little provide an ordering of the quasi-invariant structures in (see Appendix [34] for more details). Let us explore terms of ”leakiness” (See e.g. [119, 122, 123]) . In fact, the similarity more in details by adapting the heuristic we observe that also in this case, finer quasi-invariant approach implemented in [97, 118, 119] and originally structures are associated to eigenvalues with smaller real proposed by Dellnitz and Junge [120, 121] to detect part, which corresponds to faster diffusion (Fig.10b, 10c) quasi-invariant sets. . This correspondence is interesting but not surprising, 10

(a) (b)

FIG. 9. Invariant Measure of the system obtained by projection of λ1 (a). Distribution of mass in the phase space as a projection of: (b): λ2, (c): λ3, (d): λ4. because the physical process responsible for the slow de- trix controlling the shadowing of UPOs along the tra- cay described in Fig. 10 is indeed the slow mixing occur- jectory. In this context each UPO represents a possible ring in phase space between the regions described by the state of the system. We found that this perspective on quasi-invariant sets depicted in Fig. 9. the dynamics allows for a new interpretation of quasi- invariant structures in terms of UPOs. By looking at the eigenvectors corresponding to subdominant eigenvalues IV. CONCLUSION we are able to explain on the one side the geometrical pattern associated with the decay of perturbations with respect to the invariant measure and on the other side The theory of UPOs has found extensive applica- link this behaviour to the structure of the invariant sets. tions in the study of low-dimensional chaotic systems, This work prepares the path for different future lines of in particular as a mean to calculate dynamical averages research. We would like to extend this analysis to higher through the use of trace formulas [70, 105, 106]. In re- dimensional system of practical relevance, characterised cent times promising developments has been made in the by high variability in the number of unstable dimension. context of higher dimension dynamical systems [87–89]. In particular we would like to extend the work of Lucarini Our work wishes to provide a contribution towards the and Gritsun [86] on blocking events, investigating tran- goal of using UPOs to interpret the dynamics of com- sitions between zonal flow and blocking by applying the plex systems. The ranked shadowing, intended as the methodology developed in this paper on the Lucarini- representation of approximation of a chaotic trajectory Gritsun UPOs dataset, by investigating the dynamical through the nearest UPOs, was at the center of our in- properties between zonal and blocked states. vestigation which has been performed on L63. We found that longer UPOs, despite being underrepresented in our sample, are the most effective in shadowing the orbit of the system. We then proposed a discrete Markovian interpretation of the dynamics, defining the stochastic ma- 11

ACKNOWLEDGMENTS

(a)

(b)

The authors have benefitted from scientific exchanges with P. Cvitanović, J. Dorrington, G. Ducci, G. Froy- land, A. Gritsun, C. Nesbitt, M. Santos, N. Zagli, M. Zaks. VL acknowledges the support received from the (c) EPSRC project EP/T018178/1 and from the EU Hori- FIG. 10. Quasi-invariant bundles of UPOs obtained with zon 2020 project TiPES (grant no. 820970). CCM has the method outlined in Section III C. (a): λ2=0.9931, τ2 = been supported by an EPSRC studentship as part of the 1.4443; (b): λ3=0.9921, τ3 = 1.2608; (c): λ4=0.9902, τ4 = Centre for Doctoral Training in Mathematics of Planet 1.0154. Earth (grant number EP/L016613/1).

[1] Henri Poincaré. Les méthodes nouvelles de la mécanique chaotic attractors. Physical Review A, 37(5):1711, 1988. céleste: Méthodes de MM. Newcomb, Glydén, Lindstedt [4] J-P Eckmann and David Ruelle. Ergodic theory of chaos et Bohlin. 1893, volume 2. Gauthier-Villars it fils, 1893. and strange attractors. The theory of chaotic attractors, [2] Predrag Cvitanović. Periodic orbits as the skeleton of pages 273–312, 1985. classical and quantum chaos. Physica D: Nonlinear Phe- [5] Rufus Bowen. ω-limit sets for axiom a diffeomorphisms. nomena, 51(1-3):138–151, 1991. Journal of differential equations, 18(2):333–339, 1975. [3] Celso Grebogi, Edward Ott, and James A Yorke. Un- [6] Martin C Gutzwiller. Chaos in classical and quantum stable periodic orbits and the dimensions of multifractal mechanics, volume 1. Springer Science & Business Me- 12

dia, 2013. [28] A Gritsun. Statistical characteristics, circulation [7] David Ruelle. Thermodynamic formalism: the math- regimes and unstable periodic orbits of a barotropic ematical structure of equilibrium statistical mechanics. atmospheric model. Philosophical Transactions of the Cambridge University Press, 2004. Royal Society A: Mathematical, Physical and Engineer- [8] Bruno Eckhardt and Gerolf Ott. Periodic orbit analysis ing Sciences, 371(1991):20120336, 2013. of the lorenz attractor. Zeitschrift für Physik B Con- [29] Predrag Cvitanovic, Roberto Artuso, Ronnie Mainieri, densed Matter, 93(2):259–266, 1994. Gregor Tanner, Gábor Vattay, Niall Whelan, and An- [9] Predrag Cvitanović. Dynamical averaging in terms of dreas Wirzba. Chaos: classical and quantum. Chaos- periodic orbits. Physica D: Nonlinear Phenomena, 83(1- Book. org (Niels Bohr Institute, Copenhagen 2005), 3):109–123, 1995. 69:25, 2005. [10] Roberto Artuso, Erik Aurell, and Predrag Cvitanovic. [30] Andrey Gritsun and Valerio Lucarini. Fluctuations, re- Recycling of strange sets: I. cycle expansions. Nonlin- sponse, and resonances in a simple atmospheric model. earity, 3(2):325, 1990. Physica D: Nonlinear Phenomena, 349:62–76, 2017. [11] David Ruelle. Smooth dynamics and new theoretical [31] AS Gritsun. Unstable periodic trajectories of a ideas in nonequilibrium statistical mechanics. Journal barotropic model of the atmosphere. Russian Journal of of Statistical Physics, 95(1):393–468, 1999. Numerical Analysis & Mathematical Modelling, 23(4), [12] Anatole Katok and Boris Hasselblatt. Introduction to 2008. the modern theory of dynamical systems. Number 54. [32] Davide Lasagna. Sensitivity analysis of chaotic systems Cambridge university press, 1997. using unstable periodic orbits. SIAM Journal on Ap- [13] Stephen Smale et al. Differentiable dynamical sys- plied Dynamical Systems, 17(1):547–580, 2018. tems. Bulletin of the American mathematical Society, [33] Davide Lasagna. Sensitivity of long periodic orbits 73(6):747–817, 1967. of chaotic systems. Physical Review E, 102(5):052220, [14] Rufus Bowen. Periodic orbits for hyperbolic flows. 2020. American Journal of Mathematics, 94(1):1–30, 1972. [34] Chiara Cecilia Maiocchi and Valerio Lucarini. [15] Giovanni Gallavotti. Nonequilibrium and irreversibility. https://figshare.com/projects/Decomposing_the_Dynamics_of_the_Lorenz_1963_model_using_Unstable_Periodic_Orbits_Averages_Transitions_and_Quasi-Invariant_Sets/119907 Springer, 2014. [35] Gary Froyland and Kathrin Padberg. Almost-invariant [16] Valerio Lucarini, Richard Blender, Corentin Her- sets and invariant manifolds—connecting probabilistic bert, Francesco Ragone, Salvatore Pascale, and Jeroen and geometric descriptions of coherent structures in Wouters. Mathematical and physical ideas for climate flows. Physica D: Nonlinear Phenomena, 238(16):1507– science. Reviews of Geophysics, 52(4):809–859, 2014. 1523, 2009. [17] Giovanni Gallavotti. Chaotic dynamics, fluctuations, [36] Gary Froyland. Statistically optimal almost-invariant nonequilibrium ensembles. Chaos: An Interdisciplinary sets. Physica D: Nonlinear Phenomena, 200(3-4):205– Journal of Nonlinear Science, 8(2):384–392, 1998. 219, 2005. [18] Giovanni Gallavotti and Ezechiel Godert David Cohen. [37] Gary Froyland. Extracting dynamical behavior via Dynamical ensembles in nonequilibrium statistical me- markov models. In Nonlinear dynamics and statistics, chanics. Physical review letters, 74(14):2694, 1995. pages 281–321. Springer, 2001. [19] Ditza Auerbach, Predrag Cvitanović, Jean-Pierre Eck- [38] Stanislaw M Ulam. Problems in modern mathematics. mann, Gemunu Gunaratne, and Itamar Procaccia. Ex- Courier Corporation, 2004. ploring chaotic motion through periodic orbits. Physical [39] Warwick Tucker. The lorenz attractor exists. Review Letters, 58(23):2387, 1987. Comptes Rendus de l’Académie des Sciences-Series I- [20] Predrag Cvitanović. Invariant measurement of strange Mathematics, 328(12):1197–1202, 1999. sets in terms of cycles. Physical Review Letters, [40] Z Galias and P Zgliczyński. Computer assisted proof 61(24):2729, 1988. of chaos in the lorenz equations. Physica D: Nonlinear [21] Roberto Artuso, Erik Aurell, and Predrag Cvitanovic. Phenomena, 115(3-4):165–188, 1998. Recycling of strange sets: Ii. applications. Nonlinearity, [41] Warwick Tucker. A rigorous ode solver and smale’s 14th 3(2):361, 1990. problem. Foundations of Computational Mathematics, [22] Edward N Lorenz. Deterministic nonperiodic flow. 2(1):53–117, 2002. Journal of atmospheric sciences, 20(2):130–141, 1963. [42] Arkady Pikovsky and Antonio Politi. Lyapunov expo- [23] Valerio Lucarini. Evidence of dispersion relations for nents: a tool to explore complex dynamics. Cambridge the nonlinear response of the lorenz 63 system. Journal University Press, 2016. of Statistical Physics, 134(2):381–400, 2009. [43] Edward Ott. Chaos in dynamical systems. Cambridge [24] Valerio Lucarini and Andrey Gritsun. A new mathemat- university press, 2002. ical framework for atmospheric blocking events. Climate [44] Valter Franceschini, Claudio Giberti, and Zhiming Dynamics, 54(1):575–598, 2020. Zheng. Characterization of the lorentz attractor by un- [25] Predrag Cvitanović. Recurrent flows: the clockwork be- stable periodic orbits. Nonlinearity, 6(2):251, 1993. hind turbulence. Journal of Fluid Mechanics, 726:1–4, [45] Scott M Zoldi. Unstable periodic orbit analysis of his- 2013. tograms of chaotic time series. Physical review letters, [26] Genta Kawahara and Shigeo Kida. Periodic motion em- 81(16):3375, 1998. bedded in plane couette turbulence: regeneration cycle [46] Yoshitaka Saiki and Michio Yamada. Reply to “com- and burst. Journal of Fluid Mechanics, 449:291, 2001. ment on ‘time-averaged properties of unstable periodic [27] Gary J Chandler and Rich R Kerswell. Invariant recur- orbits and chaotic orbits in ordinary differential equa- rent solutions embedded in a turbulent two-dimensional tion systems’”. Physical Review E, 81(1):018202, 2010. kolmogorov flow. Journal of Fluid Mechanics, 722:554– [47] Yoshitaka Saiki and Michio Yamada. Time-averaged 595, 2013. properties of unstable periodic orbits and chaotic or- 13

bits in ordinary differential equation systems. Physical [66] J-P Eckmann and David Ruelle. Ergodic theory of chaos Review E, 79(1):015201, 2009. and strange attractors. The theory of chaotic attractors, [48] Michael A Zaks and Denis S Goldobin. Comment on pages 273–312, 1985. “time-averaged properties of unstable periodic orbits [67] Rufus Bowen. ω-limit sets for axiom a diffeomorphisms. and chaotic orbits in ordinary differential equation sys- Journal of differential equations, 18(2):333–339, 1975. tems”. Physical Review E, 81(1):018201, 2010. [68] Martin C Gutzwiller. Chaos in classical and quantum [49] Giancarlo Benettin, Luigi Galgani, Antonio Giorgilli, mechanics, volume 1. Springer Science & Business Me- and Jean-Marie Strelcyn. Lyapunov characteristic ex- dia, 2013. ponents for smooth dynamical systems and for hamilto- [69] David Ruelle. Thermodynamic formalism: the math- nian systems; a method for computing all of them. part ematical structure of equilibrium statistical mechanics. 1: Theory. Meccanica, 15(1):9–20, 1980. Cambridge University Press, 2004. [50] T.N. Palmer. Extended-range atmospheric prediction [70] Bruno Eckhardt and Gerolf Ott. Periodic orbit analysis and the lorenz model. Bulletin of the American Meteo- of the lorenz attractor. Zeitschrift für Physik B Con- rological Society, 74(1):49–65, 1993. densed Matter, 93(2):259–266, 1994. [51] Rufus Bowen. Topological entropy and axiom a. In Proc. [71] Predrag Cvitanović. Dynamical averaging in terms of Sympos. Pure Math, volume 14, pages 23–41, 1970. periodic orbits. Physica D: Nonlinear Phenomena, 83(1- [52] Y Saiki. Numerical detection of unstable periodic orbits 3):109–123, 1995. in continuous-time dynamical systems with chaotic be- [72] Roberto Artuso, Erik Aurell, and Predrag Cvitanovic. haviors. Nonlinear Processes in Geophysics, 14(5):615– Recycling of strange sets: I. cycle expansions. Nonlin- 620, 2007. earity, 3(2):325, 1990. [53] Roberto Barrio, Angeles Dena, and Warwick Tucker. A [73] David Ruelle. Smooth dynamics and new theoretical database of rigorous and high-precision periodic orbits ideas in nonequilibrium statistical mechanics. Journal of the lorenz model. Computer Physics Communica- of Statistical Physics, 95(1):393–468, 1999. tions, 194:76–83, 2015. [74] Anatole Katok and Boris Hasselblatt. Introduction to [54] Zbigniew Galias and Warwick Tucker. Symbolic dynam- the modern theory of dynamical systems. Number 54. ics based method for rigorous study of the existence of Cambridge university press, 1997. short cycles for chaotic systems. In 2009 IEEE Interna- [75] Stephen Smale et al. Differentiable dynamical sys- tional Symposium on Circuits and Systems, pages 1907– tems. Bulletin of the American mathematical Society, 1910. IEEE, 2009. 73(6):747–817, 1967. [55] Viviane Baladi. Positive transfer operators and decay of [76] Rufus Bowen. Periodic orbits for hyperbolic flows. correlations, volume 16. World scientific, 2000. American Journal of Mathematics, 94(1):1–30, 1972. [56] C Sparrow. The lorenz equations. Edited by Arun V. [77] Giovanni Gallavotti. Nonequilibrium and irreversibility. Holden, page 111, 1982. Springer, 2014. [57] Gary Froyland. Unwrapping eigenfunctions to discover [78] Valerio Lucarini, Richard Blender, Corentin Her- the geometry of almost-invariant sets in hyperbolic bert, Francesco Ragone, Salvatore Pascale, and Jeroen maps. Physica D: Nonlinear Phenomena, 237(6):840– Wouters. Mathematical and physical ideas for climate 853, 2008. science. Reviews of Geophysics, 52(4):809–859, 2014. [58] Gary Froyland and Michael Dellnitz. Detecting and [79] Giovanni Gallavotti. Chaotic dynamics, fluctuations, locating near-optimal almost-invariant sets and cycles. nonequilibrium ensembles. Chaos: An Interdisciplinary SIAM Journal on Scientific Computing, 24(6):1839– Journal of Nonlinear Science, 8(2):384–392, 1998. 1863, 2003. [80] Giovanni Gallavotti and Ezechiel Godert David Cohen. [59] Michael Dellnitz and Oliver Junge. On the approxima- Dynamical ensembles in nonequilibrium statistical me- tion of complicated dynamical behavior. SIAM Journal chanics. Physical review letters, 74(14):2694, 1995. on Numerical Analysis, 36(2):491–515, 1999. [81] Ditza Auerbach, Predrag Cvitanović, Jean-Pierre Eck- [60] Michael Dellnitz and Oliver Junge. Almost invariant mann, Gemunu Gunaratne, and Itamar Procaccia. Ex- sets in chua’s circuit. International Journal of Bifurca- ploring chaotic motion through periodic orbits. Physical tion and Chaos, 7(11):2475–2485, 1997. Review Letters, 58(23):2387, 1987. [61] Wilhelm Huisinga and Bernd Schmidt. Metastability [82] Predrag Cvitanović. Invariant measurement of strange and dominant eigenvalues of transfer operators. In New sets in terms of cycles. Physical Review Letters, algorithms for macromolecular simulation, pages 167– 61(24):2729, 1988. 182. Springer, 2006. [83] Roberto Artuso, Erik Aurell, and Predrag Cvitanovic. [62] Peter Deuflhard and Marcus Weber. Robust perron Recycling of strange sets: Ii. applications. Nonlinearity, cluster analysis in conformation dynamics. Linear al- 3(2):361, 1990. gebra and its applications, 398:161–184, 2005. [84] Edward N Lorenz. Deterministic nonperiodic flow. [63] Henri Poincaré. Les méthodes nouvelles de la mécanique Journal of atmospheric sciences, 20(2):130–141, 1963. céleste: Méthodes de MM. Newcomb, Glydén, Lindstedt [85] Valerio Lucarini. Evidence of dispersion relations for et Bohlin. 1893, volume 2. Gauthier-Villars it fils, 1893. the nonlinear response of the lorenz 63 system. Journal [64] Predrag Cvitanović. Periodic orbits as the skeleton of of Statistical Physics, 134(2):381–400, 2009. classical and quantum chaos. Physica D: Nonlinear Phe- [86] Valerio Lucarini and Andrey Gritsun. A new mathemat- nomena, 51(1-3):138–151, 1991. ical framework for atmospheric blocking events. Climate [65] Celso Grebogi, Edward Ott, and James A Yorke. Un- Dynamics, 54(1):575–598, 2020. stable periodic orbits and the dimensions of multifractal [87] Predrag Cvitanović. Recurrent flows: the clockwork be- chaotic attractors. Physical Review A, 37(5):1711, 1988. hind turbulence. Journal of Fluid Mechanics, 726:1–4, 2013. 14

[88] Genta Kawahara and Shigeo Kida. Periodic motion em- 81(16):3375, 1998. bedded in plane couette turbulence: regeneration cycle [107] Yoshitaka Saiki and Michio Yamada. Reply to “com- and burst. Journal of Fluid Mechanics, 449:291, 2001. ment on ‘time-averaged properties of unstable periodic [89] Gary J Chandler and Rich R Kerswell. Invariant recur- orbits and chaotic orbits in ordinary differential equa- rent solutions embedded in a turbulent two-dimensional tion systems’”. Physical Review E, 81(1):018202, 2010. kolmogorov flow. Journal of Fluid Mechanics, 722:554– [108] Yoshitaka Saiki and Michio Yamada. Time-averaged 595, 2013. properties of unstable periodic orbits and chaotic or- [90] A Gritsun. Statistical characteristics, circulation bits in ordinary differential equation systems. Physical regimes and unstable periodic orbits of a barotropic Review E, 79(1):015201, 2009. atmospheric model. Philosophical Transactions of the [109] Michael A Zaks and Denis S Goldobin. Comment on Royal Society A: Mathematical, Physical and Engineer- “time-averaged properties of unstable periodic orbits ing Sciences, 371(1991):20120336, 2013. and chaotic orbits in ordinary differential equation sys- [91] Predrag Cvitanovic, Roberto Artuso, Ronnie Mainieri, tems”. Physical Review E, 81(1):018201, 2010. Gregor Tanner, Gábor Vattay, Niall Whelan, and An- [110] Giancarlo Benettin, Luigi Galgani, Antonio Giorgilli, dreas Wirzba. Chaos: classical and quantum. Chaos- and Jean-Marie Strelcyn. Lyapunov characteristic ex- Book. org (Niels Bohr Institute, Copenhagen 2005), ponents for smooth dynamical systems and for hamilto- 69:25, 2005. nian systems; a method for computing all of them. part [92] Andrey Gritsun and Valerio Lucarini. Fluctuations, re- 1: Theory. Meccanica, 15(1):9–20, 1980. sponse, and resonances in a simple atmospheric model. [111] T.N. Palmer. Extended-range atmospheric prediction Physica D: Nonlinear Phenomena, 349:62–76, 2017. and the lorenz model. Bulletin of the American Meteo- [93] AS Gritsun. Unstable periodic trajectories of a rological Society, 74(1):49–65, 1993. barotropic model of the atmosphere. Russian Journal of [112] Rufus Bowen. Topological entropy and axiom a. In Proc. Numerical Analysis & Mathematical Modelling, 23(4), Sympos. Pure Math, volume 14, pages 23–41, 1970. 2008. [113] Y Saiki. Numerical detection of unstable periodic orbits [94] Davide Lasagna. Sensitivity analysis of chaotic systems in continuous-time dynamical systems with chaotic be- using unstable periodic orbits. SIAM Journal on Ap- haviors. Nonlinear Processes in Geophysics, 14(5):615– plied Dynamical Systems, 17(1):547–580, 2018. 620, 2007. [95] Davide Lasagna. Sensitivity of long periodic orbits [114] Roberto Barrio, Angeles Dena, and Warwick Tucker. A of chaotic systems. Physical Review E, 102(5):052220, database of rigorous and high-precision periodic orbits 2020. of the lorenz model. Computer Physics Communica- [96] Gary Froyland and Kathrin Padberg. Almost-invariant tions, 194:76–83, 2015. sets and invariant manifolds—connecting probabilistic [115] Zbigniew Galias and Warwick Tucker. Symbolic dynam- and geometric descriptions of coherent structures in ics based method for rigorous study of the existence of flows. Physica D: Nonlinear Phenomena, 238(16):1507– short cycles for chaotic systems. In 2009 IEEE Interna- 1523, 2009. tional Symposium on Circuits and Systems, pages 1907– [97] Gary Froyland. Statistically optimal almost-invariant 1910. IEEE, 2009. sets. Physica D: Nonlinear Phenomena, 200(3-4):205– [116] Viviane Baladi. Positive transfer operators and decay of 219, 2005. correlations, volume 16. World scientific, 2000. [98] Gary Froyland. Extracting dynamical behavior via [117] C Sparrow. The lorenz equations. Edited by Arun V. markov models. In Nonlinear dynamics and statistics, Holden, page 111, 1982. pages 281–321. Springer, 2001. [118] Gary Froyland. Unwrapping eigenfunctions to discover [99] Stanislaw M Ulam. Problems in modern mathematics. the geometry of almost-invariant sets in hyperbolic Courier Corporation, 2004. maps. Physica D: Nonlinear Phenomena, 237(6):840– [100] Warwick Tucker. The lorenz attractor exists. 853, 2008. Comptes Rendus de l’Académie des Sciences-Series I- [119] Gary Froyland and Michael Dellnitz. Detecting and Mathematics, 328(12):1197–1202, 1999. locating near-optimal almost-invariant sets and cycles. [101] Z Galias and P Zgliczyński. Computer assisted proof SIAM Journal on Scientific Computing, 24(6):1839– of chaos in the lorenz equations. Physica D: Nonlinear 1863, 2003. Phenomena, 115(3-4):165–188, 1998. [120] Michael Dellnitz and Oliver Junge. On the approxima- [102] Warwick Tucker. A rigorous ode solver and smale’s 14th tion of complicated dynamical behavior. SIAM Journal problem. Foundations of Computational Mathematics, on Numerical Analysis, 36(2):491–515, 1999. 2(1):53–117, 2002. [121] Michael Dellnitz and Oliver Junge. Almost invariant [103] Arkady Pikovsky and Antonio Politi. Lyapunov expo- sets in chua’s circuit. International Journal of Bifurca- nents: a tool to explore complex dynamics. Cambridge tion and Chaos, 7(11):2475–2485, 1997. University Press, 2016. [122] Wilhelm Huisinga and Bernd Schmidt. Metastability [104] Edward Ott. Chaos in dynamical systems. Cambridge and dominant eigenvalues of transfer operators. In New university press, 2002. algorithms for macromolecular simulation, pages 167– [105] Valter Franceschini, Claudio Giberti, and Zhiming 182. Springer, 2006. Zheng. Characterization of the lorentz attractor by un- [123] Peter Deuflhard and Marcus Weber. Robust perron stable periodic orbits. Nonlinearity, 6(2):251, 1993. cluster analysis in conformation dynamics. Linear al- [106] Scott M Zoldi. Unstable periodic orbit analysis of his- gebra and its applications, 398:161–184, 2005. tograms of chaotic time series. Physical review letters,