Available online at www.sciencedirect.com ScienceDirect
Journal of Differential Equations 293 (2021) 313–358 www.elsevier.com/locate/jde
Dynamical systems under random perturbations with fast switching and slow diffusion: Hyperbolic equilibria ✩,✩✩ and stable limit cycles
∗ Nguyen H. Du a, Alexandru Hening b, Dang H. Nguyen c, George Yin d, a Department of Mathematics, Mechanics and Informatics, Hanoi National University, 334 Nguyen Trai, Thanh Xuan, Hanoi, Viet Nam b Department of Mathematics, Tufts University, Bromfield-Pearson Hall, 503 Boston Avenue, Medford, MA 02155, United States c Department of Mathematics, University of Alabama, 345 Gordon Palmer Hall, Box 870350, Tuscaloosa, AL 35487-0350, United States d Department of Mathematics, University of Connecticut, Storrs, CT 06269, United States Received 3 September 2019; revised 11 March 2021; accepted 9 May 2021
Abstract This work is devoted to the study of long-term qualitative behavior of randomly perturbed dynamical systems. The focus is on certain stochastic differential equations (SDE) with Markovian switching, when the switching is fast varying and the diffusion (white noise) is slowly changing. Consider the system
√ dXε,δ(t) = f(Xε,δ(t), αε(t))dt + δσ(Xε,δ(t), αε(t))dW(t), Xε,δ(0) = x, αε(0) = i,
ε where α (t) is a finite state Markov chain with irreducible generator Q = (qι). The relative chang- ing rates of the switching and the diffusion are highlighted by two small parameters ε and δ. Asso-
✩ The work of N.H. Du was supported in part by NAFOSTED n0 101.02 - 2011.21; the work of A. Hening was supported in part by the National Science Foundation under grant DMS-1853463; the work of D. Nguyen was supported in part by the National Science Foundation under grant DMS-1853467; the work of G. Yin was supported in part by the National Science Foundation under grant DMS-2114649. ✩✩ We thank an anonymous referee who read the original version of the manuscript and suggested the study of the more general setting of hyperbolic equilibria, which has significantly improved the paper. * Corresponding author. E-mail addresses: [email protected] (N.H. Du), [email protected] (A. Hening), [email protected] (D.H. Nguyen), [email protected] (G. Yin). https://doi.org/10.1016/j.jde.2021.05.032 0022-0396/© 2021 Elsevier Inc. All rights reserved. N.H. Du, A. Hening, D.H. Nguyen et al. Journal of Differential Equations 293 (2021) 313–358 ciated with the above stochastic differential equation, there is an averaged ordinary differential equa- tion (ODE)
dX(t) = f(X(t))dt, X(0) = x, · = m0 · where f() ι=1 f(, ι)νι and (ν1, ..., νm0 ) is the unique stationary distribution of the Markov chain with generator Q. Suppose that for each pair (ε, δ), the process has an invariant probability measure με,δ, and that the averaged ODE has a limit cycle in which there is an averaged occupation measure μ0 for the averaged equation. It is proved in this paper that under weak conditions, if f has finitely many stable or hyperbolic fixed points, then με,δ converges weakly to μ0 as ε → 0and δ → 0. Our results generalize to the setting where the switching process αε is state-dependent in that
ε ε ε,δ ε ε,δ P{α (t + ) = |α = ι,X (s), α (s), s ≤ t}=qι(X (t)) + o( ), ι =
d as long as the generator Q(·) = (qι(·)) is locally bounded, locally Lipschitz, and irreducible for all x ∈ R . Finally, we provide two examples in two and three dimensions to showcase our results. © 2021 Elsevier Inc. All rights reserved.
MSC: 34C05; 60H10; 92D25
Keywords: Random perturbation; Random dynamical system; Invariant probability measure; Hybrid diffusion; Rapid switching; Limit cycle
Contents
1. Introduction ...... 314 1.1. Assumptions and main results...... 317 1.2. An application of Theorem 1.1 ...... 320 1.3. Main ideas of proof of Theorem 1.1: a road map...... 322 2. Estimates of the first exit times...... 325 3. Proof of main result...... 334 4. Proof of Theorem 1.2 ...... 339 4.1. An example...... 350 4.2. Another example...... 352 Appendix A. Proofs of lemmas in Section 2 ...... 353 References...... 357
1. Introduction
Natural phenomena are almost always influenced by different types of random noise. In or- der to better understand the world around us, it is important to study random perturbations of dynamical systems. In the continuous dynamical systems setup, the focus then shifts from the study of the behavior of deterministic differential equations to that of differential equations with switching (piecewise deterministic Markov processes) or stochastic differential equations with switching. The long-term behavior of these systems can be analyzed by a careful study of the ergodic properties of the induced Markov processes.
314 N.H. Du, A. Hening, D.H. Nguyen et al. Journal of Differential Equations 293 (2021) 313–358
Quite often, the “white noise” in the system is small compared to the deterministic com- ponent. In such cases, one is usually interested in knowing how well the deterministic system approximates the stochastic one. It is common to model continuous-time phenomena by stochas- tic differential equations of the type √ dxδ(t) = f(xδ(t))dt + δσ(xδ(t))dW(t), (1.1) where f(·) and σ(·) are sufficiently smooth functions, W(·) is a standard m-dimensional Brow- nian motion, and δ>0is a small parameter. If we let δ → 0, one would expect that the solutions of (1.1) converge to that of a deterministic differential equation in an appropriate sense. Different aspects of the problem have been studied extensively starting with Freidlin and Wentzell [36,17], Fleming [16], Kifer [27] and Day [11]. If the process xδ(t) has a unique ergodic probability measure μδ for each δ>0 and the origin of the corresponding deterministic ODE
dx = f(x)dt, (1.2) is a globally asymptotic stable equilibrium point, Holland established in [21] asymptotic expan- sions of the expectation of the underlying functionals with respect to the unique ergodic proba- bility measures μδ. In addition, in [22], Holland considered the case when the ODE (1.2) has an δ asymptotically stable limit cycle and proved the weak convergence of the family (μ )δ>0 to the unique stationary distribution that is concentrated on the limit cycle of the process from (1.2). Our interest in the current work stems from applications in ecology. Quite often, one models the dynamics of populations with continuous-time processes. This way we implicitly assume that organisms can respond instantaneously to changes in the environment. However, in some cases the dynamics are better described by discrete-time models, in which demographic decisions are not made continuously. In order to model more complex systems, one has to analyze ‘hybrid’ systems where both continuous and discrete dynamics coexist. Such systems arise naturally in ecology, engineering, operations research, and physics as well as in emerging applications in wireless communications, internet traffic modeling, and financial engineering; see [38]for more references. Recently, there has been renewed interest in studying piecewise deterministic Markov pro- cesses (PDMP) [10]. One may describe a PDMP by the use of a two component process. The first component is a continuous state process represented by the solution of a deterministic dif- ferential equation, whereas the second component is a discrete event process taking values in a finite set. This discrete event process is often modeled as a continuous-time Markov chain with a finite state space. At any given instance, the Markov chain takes a value (say i in the state space), and the process sojourns in state i for a random duration. During this period, the continuous state follows the flow given by a differential equation associated with i. Then at a random instance, the discrete event switches to another state j = i. The Markov chain sojourns in j for a random dura- tion, during which, the continuous state follows another flow associated with the discrete state j. A careful study of such processes has recently led to a better understanding of predator-prey communities where the predator evolves much faster than the prey [9] and for a possible explana- tion of how the competitive exclusion principle from ecology, which states that multiple species competing for the same number of small resources cannot coexist, can be violated because of switching [6,20]. It is natural to study the stochastic differential equation (SDE) counter-part of PDMP, that is, SDEs with switching. Similarly to the piecewise deterministic Markov processes mentioned in
315 N.H. Du, A. Hening, D.H. Nguyen et al. Journal of Differential Equations 293 (2021) 313–358 the previous paragraph, in this setting one follows a specific system of SDEs for a random time after which the discrete event switches to another state, and the process is governed by a different system of SDE. The resulting stochastic process has a discrete component (that switches among a finite number of discrete states) and a continuous component (the solution of SDE associate with each fixed discrete event state). We refer the reader to [38]for an introduction to SDEs with switching. Most of the work inspired by Freidlin and Wentzell has been concerned with local phenomena that involve the exit times and exit probabilities from neighborhoods of equilibria. One usually uses the theory of large deviations to analyze the exit problem from the domain of attraction of a stable equilibrium point. Nevertheless, in applications such as those arising in ecology, one faces even more complex situations such as the one treated in this paper, in which large deviation techniques are not applicable, and one needs to analyze the distributional scaling limits for the exit distributions [2]. There have been some previous important studies for multi-scale systems with fast and slow scales [14,15]. These previous papers have looked at large deviations in the related setting where one has a slow diffusion and the coefficients are fast oscillating. However, in contrast to our framework, the fast oscillations come from having 1 periodic coefficients and inclusion of a factor ε into the periodic component of the coefficients. The way the fast oscillations are introduced in these previous papers is similar to how it is done when one does stochastic homogenization. In the present paper, the switching comes from a discrete random process αε. In this paper, we consider dynamic systems represented by switching diffusions, in which the switching is rapidly varying whereas the diffusion is slowly changing. To be more precise, let ( , F, {Ft }, P) be a filtered probability space satisfying the usual conditions. Consider the ε,δ process (X )t≥0 defined by √ dXε,δ(t) = f(Xε,δ(t), αε(t))dt + δσ(Xε,δ(t), αε(t))dW(t), Xε,δ(0) = x, αε(0) = i, (1.3) where W(t)is an m-dimensional standard Brownian motion, αε(t) is a finite-state Markov chain that is independent of the Brownian motion and that has a state space M ={1, ..., m0} and ε,δ d d d d generator Q/ε = qij /ε , X is an R -valued process, f : R × M → R , σ : R × m0×m0 M → Rd×m, and ε, δ>0are two small parameters. We assume that the matrix Q is irreducible. The irreducibility of Q implies that the Markov chain associated with Q, denoted by (α(t))˜ t≥0, is ε,δ ergodic thus has a unique stationary distribution (ν1, ..., νm0 ). We denote by Xx,i(t) the solution ≥ ε of (1.3)at time t 0 when the initial value is (x, i) and by αi (t) the Markov chain started at i. Let us explore, intuitively, what happens when ε and δ are very small. In this setting, αε(t) converges rapidly to its stationary distribution (ν1, ..., νm0 ), while the diffusion is asymptotically small. As a result, on each finite time interval [0, T ] for T>0, a solution of equation (1.3) can be approximated by the solution Xx(t) to
dX(t) = f(X(t))dt, X(0) = x, (1.4) = m0 where f(x) i=1 f(x, i)νi . However, if in lieu of a finite time horizon, we look at the process on the infinite time horizon [0, ∞), it is not clear that Xx(t) is a good approximation. Suppose that equation (1.4) has a stable limit cycle. A natural question is whether the invariant probability measures (με,δ) of the processes (1.3) converge weakly as ε → 0 and δ → 0, to the measure concentrated on the limit cycle. This is the main problem that we address in the current paper. In order to do this, we
316 N.H. Du, A. Hening, D.H. Nguyen et al. Journal of Differential Equations 293 (2021) 313–358 substantially extend the results of [22]by considering the presence of both small diffusion and rapid switching. Because of the presence of both the switching and the diffusion we need to develop new mathematical techniques. In addition, even if there is no switching and we are in the SDE setting of [22], our assumptions are weaker than those used in [22]. The rest of the paper is organized as follows. The main assumptions and results are given in Section 1.1. To provide an insight of the proofs and to connect different parts of the arguments so as to provide something like a “road map”, Section 1.3 presents the main ideas of proofs. In Section 2, we estimate the exit time of the solutions of (1.3) from neighborhoods around the stable manifolds of the equilibria of f . The proofs of the main results are presented in Section 3. In Section 4, we apply our results to a general predator-prey model. In addition to showcasing our result in a specific setting, the proofs in Section 4 are interesting on their own right as they are quite technical and require the development of new tools. Finally, in Section 4.1, we provide some numerical examples to illustrate our results from the predator-prey setting in Section 4.
1.1. Assumptions and main results
We denote by A the transpose of a matrix A, by | ·|the Euclidean norm of vectors in Rd , and by A := sup{|Ax| : x ∈ Rd , |x| = 1} the operator norm of a matrix A ∈ Rd×d . We also define a ∧ b := min{a, b}, a ∨ b := max{a, b}, and the closed ball of radius R>0 centered at the origin d BR := {x ∈ R :|x| ≤ R}. We recall some definitions due to Conley [8]. Suppose we are given a flow ( t (·))t∈R. A compact invariant set K is called isolated if there exists a neighborhood V of K such that K is the maximal compact invariant set in V . A collection of nonempty sets {M1, ..., Mk} is a Morse decomposition for a compact invariant set K if M1, ..., Mk are pairwise disjoint, compact, isolated sets for the flow restricted to K and the following properties hold: 1) For each x ∈ K there are integers l = l(x) ≤ m = m(x) for which the alpha limit set of x, ˆ = { ∈ −∞ ]} ˆ ⊂ ˆ := α(x) t≤0 s(x), s ( ,t , satisfies α(x) Ml and the omega limit set of x, ω(x) { ∈[ ∞ } ˆ ⊂ = ∈ = t≥0 s(x), s t, ) , satisfies ω(x) Mm 2) If l(x) m(x) then x Ml Mm.
Assumption 1.1. We impose the following assumptions for the processes modeled by systems (1.3) and (1.4).
(i) For each i ∈ M, f(·, i) and σ(·, i) are locally Lipschitz continuous. (ii) There is an a>0 and a twice continuously differentiable real-valued, nonnegative function (·) satisfying lim inf{ (x) :|x| ≥ R} =∞and (∇ ) (x)f (x, i) ≤ a( (x) + 1), for all R→∞ (x, i) ∈ Rd × M. · 1 { } (iii) The vector field f() is C and it has finitely many equilibrium points x1, ..., xn0−1 and a unique limit cycle . The equilibrium points are hyperbolic points. { ··· } (iv) There exists a Morse decomposition M1, M2, , Mn0 of the flow associated with f such = ={ } that Mn0 is the limit cycle and for any i
317 N.H. Du, A. Hening, D.H. Nguyen et al. Journal of Differential Equations 293 (2021) 313–358
Remark 1.1. We note that using Assumption (ii), we can work in a compact state space K ⊂ Rn if the diffusion term from (1.3)is zero. Assumptions (i) and (ii) are needed in order to deduce the existence and boundedness of a unique solution to equation (1.3)in the absence of the diffusion term. Assumption (iv) is used to make sure that there exist no heteroclinic cycles. Assumption (v) ensures that (1.3) has a unique solution that is strong Markov. Sufficient conditions that imply uniqueness and the strong Markov property exist in the literature [32,38].
Remark 1.2. In [22]the author studied (1.1) under the assumptions that
(A1) f, σ ∈ C2(Rd ). (A2) System (1.2) has a unique limit cycle. (A3) There exists at most a finite number of equilibria x∗ of f . At each equilibrium, the Jacobian matrix has only positive real parts and the matrix σ σ is positive definite. (A4) For any compact set B not containing equilibria and any u > 0 there exists T>0 such that if x ∈ B, then
0 ≥ d(xx (t), ) < u, for t T.
(A5) There exists δ0 > 0 such that for 0 <δ<δ0 the stochastic differential equation has a unique d ergodic measure μδ. Furthermore, the family (μδ)0<δ<δ0 is tight in R .
Our work generalizes [22] significantly in the following aspects. First, we work with two types of randomness - one comes from the diffusion term and the other from the switching mechanism. Second, Assumption 1.1 (i) is weaker than (A1). Third, we can have any hyperbolic fixed points whereas assumptions (A3)-(A4) imply that all fixed points are sources and the deterministic system converges uniformly to the limit cycle. In addition, we do not need σ σ to be positive definite at the equilibria.
Remark 1.3. There are several papers, which look at the exit time asymptotic behavior near hyperbolic fixed points of small perturbations of dynamical systems [27,1,2]. In contrast to these papers in which the noise is uniformly elliptic, we have to deal with the additional complications of a stable limit cycle as well as the switching due to αε.
0 Let T > 0be the period of the limit cycle . We can define a probability measure μ , which is independent of the starting point y ∈ , by