Multiplex Recurrence Networks

Deniz Eroglu1,2,∗ Norbert Marwan1, Martina Stebich3, and J¨urgen Kurths1,2,4 1Potsdam Institute for Climate Impact Research (PIK), 14473 Potsdam, Germany 2Department of Physics, Humboldt University, 12489 Berlin, Germany 3Senckenberg Research Station of Quaternary Palaeontology Weimar, Am Jakobskirchhof 4, 99423 Weimar, Germany 4Institute for Complex Systems and Mathematical Biology, University of Aberdeen, Aberdeen AB24 3UE, United Kingdom (Dated: March 9, 2020) (Preprint version of doi:10.1103/PhysRevE.97.012312) We have introduced a novel multiplex recurrence network (MRN) approach by combining recur- rence networks with the multiplex network approach in order to investigate multivariate time series. The potential use of this approach is demonstrated on coupled map lattices and a typical example from palaeobotany research. In both examples, topological changes in the multiplex recurrence networks allow for the detection of regime changes in their dynamics. The method goes beyond classical interpretation of pollen records by considering the vegetation as a whole and using the intrinsic similarity in the dynamics of the different regional vegetation elements. We find that the different vegetation types behave more similar when one environmental factor acts as the dominant driving force.

I. INTRODUCTION systems are important problems studied by time series analysis. For instance, we assume a dynamical system In order to understand the dynamical behavior of sys- ~x˙ = f(~x,r) (1) tems in a broad range of scientific fields such as physics, biology, medicine, climatology, economy etc., time series where ~x ∈ Rm, f : Rm → Rm and a control parame- analysis provides crucial techniques. Although investi- ter (r) that has not to be constant on time r = g(t). gation of time series can be done by various techniques, The purpose of the analysis is to detect possible dynam- such as basic statistics, symbolization, power spectra or ical regime changes in the time series caused by the time similarity analysis, phase space based methods have be- dependence of r. Transitions in the dynamics can be de- come an important role in dynamical systems’ analysis. tected by different RP based measures, which in general Recurrence of a trajectory in its phase space is one of are powerful to study complex, real-world systems [5– the most important fundamental features of dynamical 7]. Examples of their successful application to real-world systems. Related approaches have been used for several systems have been found in medicine [6, 8–12], Earth decades. The first recurrence based approach is known as science [7, 13–17], astrophysics [18, 19], electrochemistry the Poincar´erecurrence theorem introduced in 1890 [1]. [20], and others [21–23]. The theorem indicates that almost all trajectories of dy- In the last decade, transformation of a time series to a namical systems will turn back infinitesimally close to complex network has become a very powerful approach their previous positions after a sufficiently long but finite to analyze complex dynamical systems. There are sev- time [1]. Continuous dynamical systems can be defined eral ways to convert a time series to a network such as by a set of ordinary differential equations. These equa- symbolic dynamics based techniques [24, 25], visibility tion sets are called as flows and if the phase space of a graphs [26–28], cycle networks [29], or recurrence net- flow has a bounded volume, then the Poincar´erecurrence works (RN) [30–32]. In this work we consider recurrence theorem is always valid [2]. Among the many different based approaches, since it is well known that recurrences approaches of analyzing dynamical systems by their re- are thumbprint of characteristic properties of dynamical currence, the recurrence plot (RP) is a multifaceted and systems [22, 33–37]. Moreover, recently we have pre- powerful approach to study different aspects of dynami- sented a work on fundamental behavior of recurrence cal systems. Introduced by Eckmann et al. in 1987, the plot measures which proves that the Huberman-Rudnick arXiv:2003.03309v1 [physics.data-an] 6 Mar 2020 RP is a matrix to show the times of recurrences of a tra- unique scaling is valid for the RP measures, while chang- jectory in its phase space [3]. Afterwards, many statisti- ing the control parameter of a given dynamical system cal quantification methods based on RP were developed [38]. The adjacency matrix of a complex network rep- for characterizing dynamical properties, regime transi- resents the structure of the system and thus determines tions, synchronization, etc. [4]. the links between the nodes of a network. For unweighted Understanding underlying dynamics and detecting and undirected networks, the adjacency matrix is binary possible regime changes in the evolution of dynamical and symmetric, hence very similar to an RP. As a con- sequence, we know that there is a similar unique scaling behavior for RN measures and RNs have been used to investigate real-world systems such as the climate [7] or ∗ [email protected] the cardio-respiratory system [39]. 2

Naturally many real systems possess many degrees of II. METHODS freedom and such systems can be described by multivari- ate time series. Each component of these systems can Recurrence based techniques have been successfully be considered as a time series and we can reconstruct a used for time series analysis of physical, biological, eco- phase space with them. Meanwhile, when the number of nomical, climate systems. Multi-layer networks have components are huge, we need to have longer time series been recently introduced as a powerful representation of for enough occurrence of recurrences in the phase space a specific network of networks. In this section, we dis- in order to analyze system by the recurrences. How- cuss RNs and how to use them in multi-layer networks ever, in several disciplines like astrophysics, earth sci- in order to analyze multivariate time series. ences and economy, having long time series cannot be ensured. Therefore the components are analyzed one by one or some dimension reduction is applied, but these A. Recurrence Networks might result in further information loss from the system. N A time series {ui}i=1 can be reconstructed as a trajec- An increasing number of dimensions requires longer tory (Eq. 1) in its phase space with time delay embedding time series for traditional recurrence networks. Usu- [46] ally, the period of a trajectory in the phase space is ex- tending with an increasing number of dimensions. With xi = (ui, ui+τ , ..., ui+τ(M−1)), (2) other words, if the dimension of the phase space is in- creasing, we need longer and longer time series to have where M is the embedding dimension which can be found enough number of recurrences to analyze the given sys- by a false nearest neighbours approach and τ is the em- tem. Therefore, traditional RNs are not efficiently appli- bedding delay which can be computed by mutual infor- cable for short multivariate time series to interpret the mation or auto-correlation [47]. behavior of the system, because of the scarcity of recur- Two state vectors of the reconstructed time series are rences. In order to gain the maximum yield from data considered to be recurrent if the second vector falls into the neighbourhood (an -radius sphere) of the first vec- sets which has a many degrees of freedom, in this work M we introduce a multiplex network-based approach to an- tor. For the trajectory ~xi (i = 1, . . . , N, ~xi ∈ R ), the alyze multivariate time series. Network modeling is a adjacency matrix of RN, A, is defined as main tool in characterizing a broad range of problems in A () = Θ − k~x − ~x k
− δ , i, j = 1,...,N, (3) physics, biology, social interactions, Earth science, econ- i,j i j i,j omy etc. If there are interactions between components where N is the trajectory length, Θ(·) is the Heaviside of the system they can be modeled by a coupled net- function, k · k is the Euclidian norm and δi,j is the Kro- work structure. For example, the RN approach has been necker delta (δi,j = 1 if i = j, otherwise δi,j = 0) [31, 48]. used to identify the direction of inter-systems relation- A RN is constructed in the following way: Consider the ships between bivariate time series [40]. Now we repre- time points of a time series as nodes of a network; if the sent each component of the system as a separated RN nodes are sufficiently close to each other, in other words, and interpret it as a layer of a multiplex network [41– if the space vectors are neighbours, then a link between 45] that we call multiplex recurrence network (MRN). A them is drawn. A represents the network, where Ai,j = 1 similar approach based on visibility graphs was recently if i and j are connected, otherwise Ai,j = 0. discussed by Lacasa et al. [28], resulting in multiplex visi- In all recurrence based applications, the threshold  is bility graphs [28]. Using the measures given by Lacasa et an arbitrarily selected small number. The selection of  al. [28], we will show a comprehensive comparison of reg- can affect the results easily. In order to have a reason- ular RN and multiplex recurrence networks on coupled able analysis, some threshold selection techniques were chaotic systems. By employing the recurrence proper- proposed [4, 48, 49]. However none of them is a cer- ties of the dynamical system for the multiplex network tain way to choose the threshold. To be consistent, in construction, we focus on the dynamics, whereas the visi- this work we always used the way which depends on the bility graph is more restricted to the statistical properties standard deviation of the time series [50]. of the system (e.g., Hurst exponent) [27, 32]. We demon- strate our new method’s efficiency by investigating high dimensional systems which are not possible to be ana- B. Multiplex and Weighted Recurrence Networks lyzed by the traditional RN approach directly. Multiplex structure. In this work, an m-layer mul- As a real-world application, we analyze a palaeoclimate tiplex network is constructed by RNs. For m-dimensional record which is a multivariate data set of pollen taxa rep- multivariate time series, we can create m different RNs resenting the variability of past vegetation in NE China which have the same number of nodes and each node is over the Holocene and found significant variations in the labeled by its associated time. These networks will form congruence of the vegetation dynamics of the considered the different layers of a multilayer network. The lay- tree species. ers are connected each other with the same time labeled 3

multivariate time series recurrence network multiplex network weighted network of recurrence networks

x Lx Lx

t t-3 t-2 t-1 t+1 t+2 t+3 I x,y Ly

y Ly I t x,z t-3 t-2 t-1 t+1 t+2 t+3

Lz Iy,z z Lz

t t-3 t-2 t-1 t+1 t+2 t+3

time

FIG. 1. Illustration of the procedure for generating network structures from a multivariate time series: multivariate time series → recurrence networks → multiplex recurrence network → weighted network of recurrence networks. Dashed lines between multiplex network’s layers connect all layers to all.

nodes. This procedure requires that the time sampling Iκ,γ [28]: is the same for all of the used time series. If a multi- X X P (k[κ], k[γ]) layer network consists of m-layers which has the same I = P (k[κ], k[γ]) log (5) κ,γ P (k[κ])P (k[γ]) number of nodes and the connections between layers are k[κ] k[γ] only between a node and its counterpart in the other lay- [κ] [γ] ers, then we call such networks “multiplex”. Networks, where P (k ) and P (k ) are the degree distributions [κ] [γ] transformed from multivariate time series, are compat- of RNs at layer κ and γ respectively, and P (k , k ) ible with the definition of multiplex networks, because is the joint probability of the existence of nodes which [κ] [γ] each node is uniquely assigned to a certain time point of has k degree at layer-κ and k at layer-γ. The de- the multivariate time series, i.e., we will find the equally gree distribution P (k) is a probability distribution func- time-labelled nodes in all layers. tion which holds a general structure information that how We consider an m-dimensional multivariate time series many nodes have each degree. The mutual information N m measures how much a system is similar to another. In- {u(t)}t=1, with u(t) = (u1(t), u2(t), . . . , um(t)) ∈ R for any value of t. Then, the RN of the κth component of stead of computing mutual information between original u(t) is created and located into the associated layer κ time series, degree distributions are considered in Eq. 5. of the multiplex network. For an example with N = 3 The difference to the commonly used direct mutual in- time series these steps are illustrated in Fig. 1. First, we formation of time series is that Iκ,γ does not compare have three time series and construct a phase space for the probability of states (estimated from the time series) each signal. The RN of the κth component of the time but the topological structure in the phase space based series is calculated by Eqs. (2)–(3) and then placed in to on the recurrences (using the recurrence matrix). This layer κ. We denote the adjacency matrix of the κth layer similarity measure Iκ,γ quantifies the information flow [κ] between the multiplex networks and, thus, the charac- as A[κ] = a and aκ = 1 if nodes i and j are connected ij ij teristical behaviour of the system. The average of the in layer κ, aκ = 0 otherwise. The giant adjacency matrix ij quantity of I over all possible pairs of layers of MRN, describing the entire multiplex network is denoted by κ,γ gives a scalar variable I = hIκ,γ iκ,γ which captures the  [1]  A IN ... IN mean similarity of the degree distributions of the RNs, .  [2] .. .  i.e., the order of coherence in the system.  IN A . .  A =   (4) Another measure to quantify the coherence of the orig-  . .. ..   . . . IN  inal multivariate system by the MRN is the average edge [m] IN ... IN A overlap: [κ] where IN is the identity matrix of size N. P P P a ω = i j>i κ ij (6) In order to measure the similarity between layer κ and P P   m i j>i 1 − δ P [κ] γ of the MRN, we use the interlayer mutual information 0, κ aij 4 where δij is the Kronecker delta symbol. This measure coupled oscillators on a ring model of m sites. CMLs are represents the average number of identical edges over well-studied dynamical systems that model the behavior all layers of the multiplex network [28]. Like the inter- of non-linear systems and exhibit a variety of phenom- layer mutual information Eq. (5), ω estimates the similar- ena [53]. ity and coherence with averaged existence of overlapped links from node-i to j between all layers κ and γ. Note [κ] [κ] ε [κ−1] [κ+1]
that ω can take values in the interval [1/m, 1], if the link xt+1 = (1 − ε)f(xt ) + f(xt ) + f(xt ) , (9) between i and j occurs in only different layers ω = 1/m, 2 [κ] [γ] i.e., aij = 1 and aij = 0, ∀γ 6= κ. If all links are identical CMLs have been analyzed with various techniques to in all layers then ω = 1. quantify their very rich dynamics. Now we compare mul- Weighted structure. Another approach is the pro- tiplex and regular RN approaches for CMLs of m = 5 jection of all layers onto one weighted network represen- diffusely coupled chaotic logistic maps f(x) = 4x(1 − x), tation. Now we consider each single layer of an MRN as which show interesting dynamics in the range of the con- a node and weighted edges between nodes κ and γ are trol parameter ε ∈ [0, 0.4] studied here with an incre- determined by the quantity Iκ,γ , Eq. (5). ment of ∆ε = 0.005. For instance, pattern selections, In order to quantify high-dimensional systems, con- high-dimensional chaos regimes, many different forms of verting multilayer systems to weighted structures is com- partially synchronized chaotic states occur. We compute putationally a very efficient approach. The adjacency a time series of length N = 15, 000 for each value of ε. In matrix of the multiplex network A is a giant matrix order to discard transients, we delete the first 10,000 val- (Nm × Nm), but in the weighted network case the size ues, resulting in time series consisting of 5,000 values that of the matrix is only N × N. Furthermore, the quan- have been used for all analyses of the CMLs in this paper. tification of weighted networks is a well-developed analy- All simulations of CMLs are repeated and averaged over sis [51, 52]. Among many measures of weighted networks, 100 realizations, since the system strongly depends on we use the clustering coefficient Cw and the average path the initial conditions. In order to compare MRN and RN length Lw in order to detect the transitions between dif- techniques, we construct a five-dimensional phase space ferent dynamical regimes. The weighted network cluster- for regular RN and five separated single RN for each layer ing coefficient is given by of MRN. For consistency, we use a recurrence threshold that is 1 X 1 X X 1 Cw = (Iκ,γ Iκ,βIγ,β) 3 (7) proportional to the standard deviation σ of the data [4]. m kκ(kκ − 1) κ γ β In this work, we use  = 0.05σ. The logistic map is a one-dimensional dynamical system, therefore embedding where kκ is the degree of node κ. The average shortest is not required for applying recurrence networks in the path length of the weighted network is layers of MRN. Although both techniques could detect the transitions X d(κ, γ) L = , (8) from fully developed turbulence (FDT), ε ∈ [0.0, 0.15] w m(m − 1) κ,γ∈V and ε ∈ [0.19, 0.285], to periodic pattern selection (PPS), ε ∈ [0.15, 0.19], the RN approach cannot distinguish the where V is the set of nodes (layers of multiplex network) transition from FDT to spatio-temporal intermittency in the weighted network and d(κ, γ) is the weighted short- (STI), ε ∈ [0.285, 0.4] (Figs. 2, 3). Multiplex network’s est path length between nodes κ and γ. measures (I and ω) can recognize every single transition Both MRN measures, I and ω, represent the similari- and, especially ω, can distinguish splitting of trajecto- ties in the linking structures of the RNs and have higher ries into two attractors in STI at ε = 0.36 very clearly values for more similar ones. For example, for periodic (Fig. 2). The MRNs are more sensitive to regime changes systems, even if there is phase difference, the correspond- than the RNs as well as the MRNs are applicable on ing RNs would be rather similar, resulting in high values large system sizes when RNs are not suitable to deal with for I and ω. When the systems are more chaotic and have them. finally a more different recurrence structure, I and ω will Large systems. Simultaneous analysis of interact- decrease. This is similar for Cw, since in periodic cases ing components of a system is very important for deep the number of triangle structures in networks is increas- understanding of the underlying dynamics. The RN ap- ing. However, it is opposite for Lw because the diameter proach is not an appropriate technique to analyze such of a denser network is in general smaller. systems, because while the number of degrees of free- dom is increasing, the size (volume) of its phase space is getting larger as well. Therefore, in order to analyze III. COUPLED MAP LATTICES such systems, we need very long data sets proportional to the size of the dimension of the system for establish- As a first application, we consider multi-component ing recurrences. Although the recurrence based analyses dynamical systems, namely coupled map lattices nicely deals with analyzing short time series, finding long (CMLs), which are discrete-time models of diffusively data is a common problem in time series analysis. How- 5

(a) (a) FDT PPS FDT STI FDT PPS FDT STI

(b) (b)

FDT PPS FDT STI FDT PPS FDT STI

FIG. 2. Results for m = 5 CMLs (Eq. 9), (a) average mutual FIG. 3. Results for m = 5 diffusively coupled map lat- information (I), and (b) average edge overlap (w) of MRN. tices CMLs, (a) clustering coefficient C, and (b) average path length L of the (regular) recurrence network. ever, MRNs overcome this problem since they use each component of the system as a layer of the giant network. of the MRN are quite different. The BMD is a less chaotic In this application, we use the same parameters of the regime, thus, the single layers of the MRN are less dif- RN and the isolated dynamics as in the small system size ferent than in the FDT regime (increasing the inter-layer one. Fig. 4 presents the results of the MRN for m = 200 similarity). The PPS and STI regimes are closer to each diffusely coupled logistic maps, which possess one more other as both regimes exhibit periodic dynamics but at different regime than the small system, called Brownian different scales. Therefore, distinguishing the transition motion of defect (BMD), ε ∈ [0.12, 0.14]. FDT occurs between PPS and STI is the hardest task. Neverthe- for ε ∈ [0.0, 0.12] and ε ∈ [0.19, 0.30], STI is observed less, I and ω are able to detect the corresponding regime for ε ∈ [0.14, 0.16] and PPS for ε ∈ [0.16, 0.19]. These transitions. However, ω performs better, because it is a regimes were observed and presented in detail in [54, 55]. spatio-temporal measure, i.e., it checks the existence of The MRN distinguishes the transitions between different edges at the same locations in the different layers where regimes clearly and this analysis is the first recurrence the calculation for I does not take the nodes’ identities based approach to detect these transitions in a large cou- into account. pled system. Instead of analysing the giant adjacency matrix of MRN, we can investigate the same system with taking IV. REAL-WORLD EXAMPLE – advantage of the well-developed weighted network anal- MULTIVARIATE PALAEOCLIMATE ANALYSIS ysis. Among the weighted network measures, the clus- tering coefficient Eq. (7) and the average shortest path So far we have been testing the performance of the length Eq. (8) are computed for the associated network new MRN method using prototypical models. As a real- and the results are given in Fig. 5. As the results of world application with changing dynamics and with sev- MRN, the related weighted network shows the transition eral variables, we treat a palaeoclimate problem. The very clearly. For large enough multi-dimensional systems, investigation of the linkage between the climate condi- both approaches can be used. tions and specific environmental responses, as well as of The coupled maps are identical. In the fully developed changes in these relationships represent an important sci- chaotic regime they are not synchronized, i.e., the evo- entific challenge in palaeoclimatology and ecology in or- lution of the (chaotic) maps due to their distinct initial der to improve the understanding of climate impacts and conditions is different. Varying the coupling constant ε feedback mechanisms. Information on past vegetation is changes the dynamical regime of the maps. According to useful to understand the palaeoecological processes link- the high chaos in the FDT, each RN has a rather different ing climate and biosphere changes. Vegetation dynamics topology compared to the others, i.e., all the single layers depends strongly on the environmental conditions and 6

(a) (a) FDT BMD STI PPS FDT FDT BMD STI PPS FDT

(b) (b) FDT BMD STI PPS FDT FDT BMD STI PPS FDT

FIG. 4. Results for m = 200 diffusively coupled map lattices FIG. 5. Results for m = 200 diffusively coupled map lattices CMLs (a) average mutual information (I), (b) average edge CMLs (a) clustering coefficient of weighted network Cw, (b) overlap (w) of multiplex network. average path length of weighted network Lw changes in the vegetation dynamics can, therefore, indi- cate critical changes in the environment (anthropogenic Lake Sihailongwan or climate impact). 45°N Pollen assemblages collected from lake sediments are commonly used proxies for palaeoecological and palaeo- climate investigations. Here we focus on the pre- cisely dated Late Pleistocene-Holocene pollen record (last 30°N 16,500 years (16.5 kyr BP)) from the Sihailongwan Lake (42◦1700 N, 126◦3600 E), located in the Longgang vol- canic field, Jilin Province, NE China (Fig. 6) [56–58]. The Sihailongwan Lake is situated near the north- Pacific Ocean 15°N Bay of ern edge of the Asian summer monsoon system. Orig- inally the Sihailongwan pollen record consists of 103 dif- Bengal ferent pollen taxa, whereby several of them contain re- dundant information. We, therefore, selected seven tree 90°E 105°E 120°E 135°E 150°E pollen taxa (Pinus koraiensis, Betula, Carpinus, Juglans, Quercus, Ulmus, Fraxinus and one herbaceous genus FIG. 6. Location of the Lake Sihailongwan from where the (Artemisia), representing typical regional vegetation ele- pollen record for this study was sampled. ments with different sensitivities on specific environmen- tal conditions during the past 16.5 kyr BP (Fig. 7). Since, the pollen record is irregularly sampled, we first tivariate pollen data set reveals distinct fluctuations of interpolate the data into N = 3, 500 points leading to ω (Fig. 7). A bootstrapping statistical test is applied the time resolution ∆t = ti+1 − ti ≈ 4.95 years ∀ i ∈ to evaluate these variations with respect to the null- [0,N − 1]. In order to analyze the temporal variation in hypothesis that multivariate dynamics is constant over the environmental dynamics, we apply a sliding window time within 95% confidence [59]. approach consisting of 150 data points per window. By The considered measure ω quantifies the amount of this choice, each window covers about 740 years and is similar dynamics in the different pollen taxa. The higher suitable to represent regime changes in the environmental ω, the more similar vary the different vegetation types in dynamics. MRN is created for each window one by one as the sense of recurrence properties. This means, it is not the window slides over the time series with 90% overlap. necessary that the pollen abundances go into the same di- The application of the MRN technique to the mul- rections, but that, e.g., periodical variations are similar. 7

Selected pollen taxa of Sihailongwan Lake (%) Average edge measure (ω)

Artemisia Ulmus Juglans Betula 0 0 0 50 20 40 0 20 40 0 50 100 0.18 0.2 0.22 0.24

additional disturbances by begin human anthropogenic activity 2 influence

4

6 .)

8 8.2 event no significant impact of the climate event Age (kry B.P

10 transformation glacial-interglacial forest finished successional re-expansion of trees begin Holocene vegetation dynamics triggered by warming 12 vegetation dynamics likely triggered begin Younger Dryas by minor climate shift (stronger winter monsoon)

vegetation dynamics without 14 related climate change begin Late-glacial

competing disturbance factors 16

0 20 40 0 20 40 0 5 10 0 50 Fraxinus Quercus Carpinus Pinus k.

FIG. 7. Pollen data set from Sihalongwan Lake (left) and derived average edge measure ω calculated in moving windows (right). The basevalue of the shading (0.199) marks the upper 95% confidence interval, i.e., exceeding this value corresponds with highly significant increase of ω. The grey shaded bands mark important environmental and climate transitions (see text).

Low ω values indicate, in contrast, less similar behavior. general change in the regional vegetation to one of more This could happen, e.g., when the system is disturbed similar vegetation dynamics. The short positive excur- and some vegetation populations recover faster than oth- sion of ω at 13.6 kyr BP is, however, clearly not related ers. to a climate shift, but most likely results from a change The pollen assemblages reveal relatively open, cold- in interspecific competition after reaching a critical pop- dry adapted vegetation at Sihailongwan at the end of ulation density of Fraxinus [56]. the pleniglacial. Starting at 16.0 kyr BP, we find a de- The Younger Dryas temperature decline about 12.7 kyr crease of ω until 15.0 kyr BP. The apparent decrease of BP ago is one of the most prominent climate changes the similarity in the floristic response likely results from observed in Northern Hemisphere palaeoclimate records. rather instable environmental conditions or competing Noticeable changes in the Sihailongwan pollen record factors influencing the vegetation dynamics. The insta- provide a clear indication of a Younger-Dryas-like cooling ble environment at Sihailongwan is strongly evidenced by in NE China beginning at 12.7 kyr BP. Unlike the abrupt the sediment composition during this time interval. In termination of the Younger Dryas in the North Atlantic particular, the occurrence of graded event layers with re- evidence, the more gradual changes of pollen assemblages worked soil material implies prevailing permafrost condi- indicate a successive substitution of the prevailing boreal tions with reduced seepage and erosion events during the woodland by species-rich broadleaf deciduous forests at final stage of the last glacial period [56]. Moreover, the the Sihailongwan lake during the first millennium of the youngest Heinrich event (H1; 16.0 and 14.6 kyr BP), may Holocene (11.7 and 10.7 kyr BP). have resulted in stronger winter monsoon [60]. By con- Our MRN analysis reveals significant high values of ω trast, the ongoing change of CO2 from the glacial to the in the period between 12.7 and 10.5 kyr BP, which are in- interglacial level might have individually affected both terrupted by an abrupt drop in ω between about 12.3 and the physiology of the prevailing plants, and the vegeta- 11.7 kyr BP. The timing of this prominent change in veg- tion dynamics in an increasingly less moisture-stressed etation dynamics corresponds to the recently detected bi- environment [61, 62]. partition of the Younger Dryas at Suigetsu Lake (Japan) Subsequent to the H1 event, the environmental con- [63], but neither the composition of pollen assemblages ditions during the Late-glacial interstadial changed to nor the sediments of the Sihailongwan sequence reveal a warmer and moister climate, obviously related with a substantial environmental shift at 12.3 kyr BP. It is likely, 8 that the ecosystem at Sihailongwan Lake may not be as V. CONCLUSIONS sensitive to changes in winter conditions as the Japanese site [63], so that the climate shift may have influenced In this study we have introduced a novel multiplex re- the intrinsic vegetation dynamics at Sihailongwan, but currence network (MRN) approach which allows us to could not trigger substantial floristic and/or landcover analyze m-dimensional multivariate data simultaneously changes. via joining m recurrence networks (RNs) together. An- At approximately 10.7 kyr BP, the dynamic spread alyzing and understanding the characteristics of single of thermophilous Juglans and a more gradual increase or low dimensional data with RNs is a known approach of Quercus mark a shift in the vegetation composition [7, 37]. Nevertheless, RN analysis of high dimensional to oak- and walnut-rich mixed conifer hardwood forests. systems is not trivial, because the increasing dimension Subsequent to this transition, the MRN analysis data of the phase space would require longer time series. How- indicate persistent vegetation dynamics, but the general ever, studies of real-world problems are often linked with shift to lower ω values implies less similar behaviour of short time series and long time series are often not avail- the pollen taxa. Interestingly, a shift in ω can be observed able. Our new approach considers each observation vari- around 8.2 kyr BP, which might be related to the most able in its own phase space and combines them later on. prominent drop of the global temperatures during the Therefore, it is possible to analyze relatively short mul- Holocene. However, as its amplitude does not exceed tivariate time series with MRNs. that of other Holocene changes in vegetation dynamics, Our extensive tests of the method have demonstrated the shift does not prove a significant impact of the 8.2 that the MRN approach enables us to detect abrupt event on the vegetation in NE China. regime transitions accurately in large dimensional sys- While substantial human impact cannot be traced tems. It can be used to understand the underlying dy- by the pollen assemblages, monsoon changes, forest namical properties of prototypical models and real-world succession dynamics and flowering activity may there- applications. fore primarily drive the observed dynamics in the By analysing a pollen data set for the last 16 kyr, pollen values/vegetation at Sihailongwan throughout the we are able to identify periods when different vegeta- Holocene. Nevertheless, weak indication of farming ac- tion types behave more similar and periods of less simi- tivity in conjunction with fires and modest grazing may lar behaviour. The changes in the vegetation dynamics explain the minor shift to lower values from 1.8 yrs BP. coincide well with known climate transitions and the in- Taken together, in our example we find that the pat- creasing human impact. This analysis goes beyond the terns of vegetation dynamics are related to both intrin- classical interpretation of the pollen amplitude variation sic vegetation dynamics and external disturbance factors as a proxy of environmental conditions. This new view like climate changes, erosion or human impact. Obvi- can provide insights into plant communities and their dy- ously, the different vegetation types behave more similar namics with respect to climate responses. when one environmental factor acts as the dominant driv- Especially for some research fields such as palaeocli- ing force. This is particularly evident at the change to mate (pollen taxa, planktonic samples etc), neuroscience cooler and drier conditions at the beginning of Younger (short time crises in EEG), economics (stock markets, Dryas. Also the rapid mass expansion or the collapse of currencies), where many dependent signals are collected one or more tree species can have a similar effect on the at the same time, our method provides a quantitative and dynamics of vegetation, as detected in our example at objective way to investigate their dynamics and detects 13.6 kyrs BP and throughout the first millennium of the hidden regime changes. Holocene. On the other hand, less similar behaviour of the vegetation results from weaker or competing distur- bance factors. Our example demonstrates that the new ACKNOWLEGMENTS developed MRN technique goes beyond the classical in- terpretation of the pollen amplitude variation as a proxy This work has been supported by German-Israeli Foun- of environmental conditions. A better understanding of dation for Scientific Research and Development (GIF), this part of the climate-biosphere interaction is of crucial GIF Grant No. I-1298-415.13/2015 and the European importance as non-linear feedback mechanisms and tip- Union’s Horizon 2020 Research and Innovation pro- ping points cause high uncertainty and an unpredictable gramme under the Marie Sklodowska-Curie grant agree- future for humankind [64, 65]. ment No. 691037 (QUEST).

[1] H. Poincar´e,Acta Mathematica 13, 1 (1890). [3] J.-P. Eckmann, S. Oliffson Kamphorst, and D. Ruelle, [2] A. Katok and B. Hasselblatt, Introduction to the Mod- Europhysics Letters 4, 973 (1987). ern Theory of Dynamical Systems (Cambridge University [4] N. Marwan, M. C. Romano, M. Thiel, and J. Kurths, Press, Cambridge, 1995). Physics Reports 438, 237 (2007). 9

[5] L. L. Trulla, A. Giuliani, J. P. Zbilut, and C. L. Webber [30] X. Xu, J. Zhang, and M. Small, Proceedings of the Na- Jr., Physics Letters A 223, 255 (1996). tional Academy of Sciences 105, 19601 (2008). [6] N. Marwan, N. Wessel, U. Meyerfeldt, A. Schirdewan, [31] N. Marwan, J. F. Donges, Y. Zou, R. V. Donner, and and J. Kurths, Physical Review E - Statistical, Nonlinear, J. Kurths, Physics Letters A 373, 4246 (2009). and Soft Matter Physics 66, 1 (2002). [32] R. V. Donner, M. Small, J. F. Donges, N. Marwan, [7] J. Donges, R. Donner, M. Trauth, N. Marwan, Y. Zou, R. Xiang, and J. Kurths, International Jour- H. Schellnhuber, and J. Kurths, Proceedings of the Na- nal of Bifurcation and Chaos 21, 1019 (2011). tional Academy of Sciences 108, 20422 (2011). [33] P. Grassberger and I. Procaccia, Physical Review Letters [8] B. H. Jansen, International Journal of Bio-Medical Com- 50, 346 (1983). puting 27, 95 (1991). [34] V. Afraimovich, Chaos 7, 12 (1997). [9] D. Kaplan, M. Furman, S. Pincus, S. Ryan, L. Lipsitz, [35] B. Saussol, S. Troubetzkoy, and S. Vaienti, Journal of and A. Goldberger, Biophysical Journal 59, 945 (1991). Statistical Physics 106, 623 (2002). [10] M. A. Riley, R. Balasubramaniam, and M. T. Turvey, [36] B. Saussol and J. Wu, Nonlinearity 16, 1991 (2003). Gait & Posture 9, 65 (1999). [37] R. V. Donner, J. Heitzig, J. F. Donges, Y. Zou, N. Mar- [11] Y. Neuman, N. Marwan, and D. Livshitz, Complexity wan, and J. Kurths, European Physical Journal B 84, 15, 28 (2009). 653 (2011). [12] S. Carrubba, A. Minagar, A. L. Chesson Jr., C. Frilot II, [38] O. Afsar, D. Eroglu, N. Marwan, and J. Kurths, EPL and A. A.Marino, Neurological Research 34, 286 (2012). (Europhysics Letters) 112, 10005 (2015). [13] G. R. Richards, Quaternary Science Reviews 13, 709 [39] G. M. Ram´ırez Avila,´ A. Gapelyuk, N. Marwan, (1994). T. Walther, H. Stepan, J. Kurths, and N. Wessel, [14] N. Marwan, M. H. Trauth, M. Vuille, and J. Kurths, Philosophical Transactions of the Royal Society A 371, Climate Dynamics 21, 317 (2003). 20110623 (2013). [15] T. Matcharashvili, T. Chelidze, and J. Peinke, Nonlinear [40] J. H. Feldhoff, R. V. Donner, J. F. Donges, N. Mar- Dynamics 51, 399 (2008). wan, and J. Kurths, Physics Letters, Section A: Gen- [16] I. Ozken, D. Eroglu, T. Stemler, N. Marwan, G. B. Bagci, eral, Atomic and Solid State Physics 376, 3504 (2012), and J. Kurths, Physical Review E 91, 062911 (2015). arXiv:1301.0934. [17] D. Eroglu, F. H. McRobie, I. Ozken, T. Stemler, K.- [41] G. Bianconi, Physical Review E 87, 062806 (2013). H. Wyrwoll, S. F. M. Breitenbach, N. Marwan, and [42] V. Nicosia, G. Bianconi, V. Latora, and M. Barthelemy, J. Kurths, Nature communications 7, 1 (2016). Physical Review Letters 111, 058701 (2013), [18] N. Asghari, C. Broeg, L. Carone, R. Casas-Miranda, arXiv:1302.7126. J. C. C. Palacio, I. Csillik, R. Dvorak, F. Freistet- [43] M. De Domenico, A. Sol´e-Ribalta,E. Cozzo, M. Kivel¨a, ter, G. Hadjivantsides, H. Hussmann, A. Khramova, Y. Moreno, M. A. Porter, S. G´omez, and A. Arenas, M. Khristoforova, I. Khromova, I. Kitiashivilli, S. Ko- Physical Review X 3, 041022 (2013). zlowski, T. Laakso, T. Laczkowski, D. Lytvinenko, [44] M. Kivel¨a,A. Arenas, M. Barthelemy, J. P. Gleeson, O. Miloni, R. Morishima, A. Moro-Martin, V. Paksyu- Y. Moreno, and M. a. Porter, Journal of Complex Net- tov, A. Pal, V. Patidar, B. Pecnik, O. Peles, J. Pyo, works 2, 203 (2014), arXiv:1309.7233. T. Quinn, A. Rodriguez, M. C. Romano, E. Saikia, [45] V. Nicosia and V. Latora, Physical Review E 92, 032805 J. Stadel, M. Thiel, N. Todorovic, D. Veras, E. V. Neto, (2015). J. Vilagi, W. von Bloh, R. Zechner, and E. Zhuchkova, [46] N. H. Packard, J. P. Crutchfield, J. D. Farmer, and R. S. Astronomy & Astrophysics 426, 353 (2004). Shaw, Physical Review Letters 45, 712 (1980). [19] N. V. Zolotova, D. I. Ponyavin, N. Marwan, and [47] H. Kantz and T. Schreiber, Nonlinear Time Series Anal- J. Kurths, Astronomy & Astrophysics 505, 197 (2009). ysis (University Press, Cambridge, 1997). [20] D. Eroglu, T. K. D. M. Peron, N. Marwan, F. A. Ro- [48] D. Eroglu, N. Marwan, S. Prasad, and J. Kurths, Non- drigues, L. F. Costa, M. Sebek, and Z. Kiss, Physical linear Processes in Geophysics 21, 1085 (2014). Review E 042919, 1 (2014). [49] C. Ahlstrom, P. Hult, and P. Ask (2006) pp. III688– [21] N. Marwan, European Physical Journal – Special Topics III691. 164, 3 (2008). [50] S. Schinkel, O. Dimigen, and N. Marwan, European [22] P. Grassberger and I. Procaccia, Physica D 9, 189 (1983). Physical Journal: Special Topics 164, 45 (2008). [23] P. Grassberger and I. Procaccia, Physica D 13, 34 (1984). [51] A. Barrat, M. Barth´elemy, R. Pastor-Satorras, and [24] J. Zhang and M. Small, Physical Review Letters 96, 3 A. Vespignani, Proceedings of the National Academy (2006). of Sciences of the United States of America 101, 3747 [25] M. Small, 2013 IEEE International Symposium on Cir- (2004), arXiv:0311416 [cond-mat]. cuits and Systems (ISCAS2013) , 2509 (2013). [52] S. Boccaletti, V. Latora, Y. Moreno, M. Chavez, and [26] L. Lacasa, B. Luque, F. Ballesteros, J. Luque, and D. U. Hwang, Physics Reports 424, 175 (2006). J. C. Nu˜no,Proceedings of the National Academy of Sci- [53] K. Kaneko, Chaos 2, 279 (1992). ences of the United States of America 105, 4972 (2008), [54] K. Kaneko, Physica D: Nonlinear Phenomena 34 (1989), arXiv:0810.0920. 10.1016/S0378-4371(00)00431-3. [27] L. Lacasa, B. Luque, J. Luque, and J. C. Nu˜no,EPL [55] K. Kaneko and I. Tsuda, Complex Systems: Chaos and (Europhysics Letters) 86, 30001 (2009). Beyond (Springer-Verlag Berlin Heidelberg, 2001). [28] L. Lacasa, V. Nicosia, and V. Latora, Scientific Reports [56] M. Stebich, J. Mingram, J. Han, and J. Liu, Global and 5, 15508 (2015). Planetary Change 65, 56 (2009). [29] J. Zhang, J. Sun, X. Luo, K. Zhang, T. Nakamura, and [57] M. Stebich, K. Rehfeld, F. Schl¨utz,P. E. Tarasov, J. Liu, M. Small, Physica D 237, 2856 (2008). and J. Mingram, Quaternary Science Reviews 124, 275 10

(2015). C. L. Bryant, and P. E. Tarasov, Scientific Reports 7, [58] M. Stebich, K. Rehfeld, F. Schl¨utz,P. E. Tarasov, J. Liu, 44983 (2017). and J. Mingram, PANGAEA (2015), 10.1594/PAN- [64] T. M. Lenton, H. Held, E. Kriegler, J. W. Hall, W. Lucht, GAEA.852704. S. Rahmstorf, and H. J. Schellnhuber, Proceedings of [59] N. Marwan, S. Schinkel, and J. Kurths, Europhysics the National Academy of Sciences of the United States Letters 101, 20007 (2013). of America 105, 1786 (2008). [60] Y. J. Wang, Science 294, 2345 (2001). [65] J. Rockstrom, W. Steffen, K. Noone, A. Persson, F. S. [61] S. A. Cowling and M. T. Sykes, Quaternary Research 52, Chapin III, E. F. Lambin, T. M. Lenton, M. Scheffer, 237 (1999). C. Folke, H. J. Schellnhuber, B. Nykvist, C. A. de Wit, [62] E. Monnin, E. J. Steig, U. Siegenthaler, K. Kawamura, T. Hughes, S. van der Leeuw, H. Rodhe, S. Sorlin, P. K. J. Schwander, B. Stauffer, T. F. Stocker, D. L. Morse, Snyder, R. Costanza, U. Svedin, M. Falkenmark, L. Karl- J.-M. Barnola, B. Bellier, D. Raynaud, and H. Fischer, berg, R. W. Corell, V. J. Fabry, J. Hansen, B. Walker, Earth and Planetary Science Letters 224, 45 (2004). D. Liverman, K. Richardson, P. Crutzen, and J. A. Fo- [63] G. Schlolaut, A. Brauer, T. Nakagawa, H. F. Lamb, J. J. ley, Nature 461, 472 (2009). Tyler, R. A. Staff, M. H. Marshall, C. Bronk Ramsey,