arXiv:2007.04539v2 [nlin.AO] 5 Nov 2020 erhshv eeldta h au of value the that revealed have searches r sntrlt s h nvraiycassi h coupled ex- the critical in the of classes ponent values universality through the models ask phase-oscillator to natural is rniin n fteciia xoet is exponents critical the of One transition. n ii h eodhroishstesm inwith sign same the has harmonics har- second harmonics, second the leading the the (iii) with (ii) and sign absent, opposite the is has harmonics monics second the val- (i) review exponent and critical most, the func- of at coupling ues harmonics on two distri- have focus which we frequency simplicity, tions For natural [7–17]. the and bution function coupling the nauieslt ls hr h rtclepnnsde- exponents critical point the critical the share around systems fea- class the fined remarkable universality classes; universality their a of of in existence One the is tures mechanics. statistical in [7–17]. function fre- coupling natural the the and on distribution con- quency depending is discontinuous, transition or synchronization tinuous The syn- (partially) states. to chronized state tran- non-synchronized synchronization the the from sition exhibit oscillators the creases, unydsrbto.We h opigstrength fre- coupling natural the When a from distribution. so-called drawn quency the randomly has peri- frequency, a oscillator by Each cou- natural expressed many function. is coupling of coupling odic describe the consists to and model oscillators, models This pled successful of [6]. one under- synchronization to is try model phase- to [4], coupled oscillator natural a metronomes is and theoretically, 3], It synchronization stand [2, [5]. frog rhythms fireflies as circadian of such and nature, flashing of have [1], fields synchronization choruses from various of in direction established opposite illustrations been the many in other, swung each wall a on hanging ∼ o h l-oaladuiomculn,etne re- extended coupling, uniform and all-to-all the For h rtclpeoeahv enetnieystudied extensively been have phenomena critical The vrsneHyesfudta w edlmclocks pendulum two that found Huygens since Ever ( K rtclepnnsi ope hs-siltrmdl ns on models phase-oscillator coupled in exponents Critical − β . K c ihuioa n ymti aua rqec distributio frequency coupling natural having symmetric models and considered unimodal the with universali in netwo of shared world number is the small exponent that in suggest results remains numerical m classes Our oscillators of universality a number in of the to di observed number proportional frequency also is links natural is of the transition number on synchronization the dependency perfec by Since the by yielded represented is orde interaction classes typical the a of In dependence strength classes. coupling by cr defined several exponent by characterized is transition st stu synchronization non-synchronized w widely the is between couples emerges model which of and type transition, This distribution function. probability coupling periodic a obeying frequency ) β ope hs-siltrmdlcnit fphase-oscill of consists model phase-oscillator coupled A where , .INTRODUCTION I. r rdaeSho fIfrais yt nvriy 606-850 University, Kyoto Informatics, of School Graduate steodrprmtr hs it Thus, parameter. order the is ysk oea ej aaa n ohyk .Yamaguchi Y. Yoshiyuki and Harada, Kenji Yoneda, Ryosuke β o h olwn he cases: three following the for K = K c facontinuous a of β β endby defined , eed on depends K in- siltrmdl eea eerhshv one out pointed exponent have critical researches the Several phase- that coupled paradigmatic model. a oscillator [7], model Kuramoto the oetindsrbto have distribution Lorentzian a u rniinocr 1] ec ecno en the define cannot discontinu- we a hence (iii), exponent [12], case critical occurs the transition in ous whereas transition, ous h eodlaigtr fisMcarnepnini of is expansion 2 Maclaurin order its the of that term fre- and second-leading natural symmetric, the and the unimodal that is assume distribution We quency harmonics. leading the n ie hr otatwt h ae(i.I h case the In (ii). model case exponent the Kuramoto critical with the the contrast (ii), of sharp a feature gives strong and a is dependence n hsvlei ugse ob nvra repcieof irrespective universal be to n suggested is value this and ycrnzto rniinapaswt h rtclex- critical The the [19], synchronization. with ponent the world appears for real network small-world transition the notable the synchronization a in on is ubiquitous it focus is and we it net- ran- particular, because small-world like In network and interests [18]. networks, of works scale-free are graphs, networks dom complex by sented ml-ol ewrsi l h ae i,(i,ad(iii) and universally (ii), is exponent (i), critical of cases value the the varying all with on in paper, transitions networks this synchronization small-world In the above. study mentioned numerically as we cases other in hidden ie nvraiysnei a rae nytecs (i) case the only treated has it con- with to since lacks universality however [20] sider research the previous while The synchronization [20], [20–22]. the lattice shows hardly one-dimensional lattice the one-dimensional to close very reyitouetesalwrdntokadcoupled and network small-world the introduce briefly inherited. is continuous, (iii) is case transition the the in where discontinuity (ii), while and (i) cases the ∈ ntecs i n i) h oe hw continu- a shows model the (ii), and (i) case the In pr rmtealt-l opig opig repre- couplings coupling, all-to-all the from Apart hsppri raie sflos nSc I we II, Sec. In follows. as organized is paper This tclepnns n efcso h critical the on focus we and exponents, itical N rp,a nnt ubro universality of number infinite an graph, t n t n atal ycrnzdsae.The states. synchronized partially and ate aua usini hte h infinite the whether is question natural a , idsnei ecie h synchronization the describes it since died ycasi eue ooeadtecritical the and one to reduced is class ty [12]. ns. ,weesohruieslt lse ih be might classes universality other whereas 1, = β tr,ec fwihhstenatural the has which of each ators, dlo ml-ol ewr,whose network, small-world a on odel t te siltr hog given a through oscillators other ith k repcieo h re flinks. of order the of irrespective rks ucin pt h eodharmonics second the to up functions tiuinadteculn function. coupling the and stribution aaee o eeln universality revealing for parameter r 1 = n where , / nsalwrdntok vni hyare they if even networks small-world in 2 β yt,Japan Kyoto, 1 ntecs i,temdlbecomes model the (i), case the In . n ∈ alwrdnetworks mall-world N n β asindsrbto and distribution Gaussian A . u eut ugs htthe that suggest results Our . β eoe for 1 becomes 1 = n β o instance. for 1 = 1 = / (2 / n o any for 2 71] This [7–10]. ) n [11–14], 1 = n ∈ N in n 2 phase-oscillator models on it. We also introduce a fam- ily of the natural frequency distributions, whose second- leading term is of the order 2n. In Sec. III, we show the finite-size scaling to calculate the critical exponent β. A similarity between systems on the small-world net- work and noisy systems is discussed in Sec. IV. Finally, in Sec. V, we summarize this paper and note some future works.
II. COUPLED PHASE-OSCILLATOR MODELS ON SMALL-WORLD NETWORKS FIG. 1. Comparison between the all-to-all network (left) and a small-world network (right) with 20 nodes. The small-world A coupled phase-oscillator model is defined by network is constructed from the k-nearest neighbour lattice (k = 3) with the rewriting probability p = 0.2. dθ K i = ω + f (θ − θ ), dt i 2k a j i jX∈Λi (1) f (θ) = sin θ + a sin 2θ, a n = 1 0.5 for i =1, ··· ,N. θi and ωi are the phase and the natural n = 2 frequency of the ith oscillator respectively, and ωi is ran- n = 3 0.4 domly drawn from a natural frequency distribution g(ω). n = 10 K > 0 is a coupling constant, describing how strong the n = ∞ )
ω 0.3 coupling between oscillators are. The index set Λi con- ( n tains the indexes of oscillators connecting to the ith os- g cillator, and it determines the network of couplings. For 0.2 instance, the all-to-all coupling gives Λi = {1, ··· ,N}, and the nearest neighbor coupling on the one-dimensional 0.1 lattice gives Λi = {i − 1,i +1}. N The coupling network represented by {Λi}i=1 is arbi- 0.0 trarily chosen. In this paper, we are interested in the −4 −2 0 2 4 small-world network, which possesses the property of a ω small diameter and a large clustering coefficient despite its sparsity. The small-world network can be seen in var- FIG. 2. Graphs of gn(ω) with n = 1, 2, 3, 10, and ∞, where ious fields of the real world, such as human relationships, we set ∆ = 1. gn(ω) converges to g∞(ω) in the limit n →∞. World Wide Web, citations of scientific papers, and so on. In 1998, Watts and Strogatz proposed a breakthrough network model showing the property of small-world net- work, which is created in the following algorithm [19]. We the width of the distribution. We note that n = 1 gives first make a periodic k-nearest neighbor network with N the Gaussian distribution. The distribution gn(ω) is uni- nodes, which results in kN links. Then we rewire each modal and symmetric with respect to ω = 0, and its link with probability p, keeping in mind that we do not Maclaurin expansion has the following form, allow self-loops or link duplications. Moreover, we use 2n only connected small-world networks: if a generated net- gn(ω)= gn(0) − Cnω + ··· , (3) work is disconnected, we discard it and generate another one until connected one is created. See Fig. 1 for a com- 2n+1 where Cn = n/(Γ(1/(2n))∆ ) is positive. We remark parison between the all-to-all network and a small-world that the generalized Lorentzian distribution introduced network. In this paper, we use the Watts–Strogatz small- in [23] also has the same expansion form up to the second world network with k = 3 and p = 0.2, following the leading term. In the limit n → ∞, gn(ω) converges to previous research [20] which shows emergence of the syn- 1 g∞(ω) in the L -norm, chronization transition on a small-world network. As the natural frequency distribution g(ω), we intro- 1/(2∆), ω ∈ (−∆, ∆), duce a family of distributions parametrized by a natural g∞(ω)= (4) 0, otherwise. number n ∈ N,
2 n −(ω/∆) n gn(ω)= e , (2) This distribution is a uniform distribution on a compact Γ(1/(2n))∆ support. See Fig. 2 for the graphs of the distributions ∞ z−1 −t gn(ω) and convergence to g∞(ω). where Γ(z) = 0 t e dt is the Gamma function de- fined on ℜ(z) >R 0. Here, ∆ > 0 is a parameter describing To visualize the extent of synchronization of oscillators, 3 we introduce the order parameter rN defined by The first assumption of our finite-size scaling theory is ex- istence of the coherent number Nc(K) [27] diverging at N the critical point K = Kc as 1 iθj rN = e . (5) N −ν¯ Xj=1 N (K) ∝ (K − K ) , (7) c c
The order parameter represents the centroid of the oscil- whereν ¯ is another unknown positive critical exponent. lators moving on the complex unit circle S1. When the The coherent number corresponds to the correlation oscillators are uniformly distributed on S1, which corre- length in a simple lattice model. The second assump- sponds to the non-synchronized state, rN gets close to tion is that the order parameter rN (K) depends on K 0. On the other hand, when the oscillators gather at only through the ratio a point on S1, which corresponds to the synchronized ν¯ state, rN equals to 1. The order parameter rN is there- N 1/ν¯ ∝ (K − Kc)N . (8) fore useful for monitoring synchronization of the coupled Nc(K) h i phase-oscillator models. In the next section, we will look into the dependency of the order parameter rN on the These assumptions imply that rN (K) can be represented coupling strength K. by The coupled phase-oscillator model on the small-world −β/ν¯ 1/ν¯ network represented by Eq. (1) has been considered pre- rN (K)= N F ((K − Kc)N ), (9) viously [24, 25], but we stress that the numbers of links are completely different from ours. From the construc- where the function F , which is called the scaling function, tion algorithm, a small-world network has kN links and must be k = 3 in our networks while k = O(N) in the litera- β ture. An advantage of networks with k = O(N) is that F (x) ∝ x for large x (10) they can be analyzed through the equation of continuity [26]. Nevertheless, this advantage implies at the same to reproduce the critical exponent β in the limit N → ∞. time that such a small-world network in the literature is We remark that the exponent β/ν¯ expresses the finite- essentially the same with the all-to-all coupling, and is size fluctuation of rN (K) at the critical point K = Kc. not suitable for detecting new universality classes. The finite-size scaling is widely used for numerical studies of critical phenomena in continuous phase transi- tions, including coupled phase-oscillator models [20, 28– III. NUMERICAL SIMULATIONS 33]. An important remark on Eq. (9) is that, on the 1/ν¯ β/ν¯ ((K−Kc)N ,N rN ) plane, observed values of rN (K) must collapse on a single graph of F for any values of N In the large population limit N → ∞, the coupled and K. The unknown values of K ,β, andν ¯ are deter- phase-oscillator model, Eq. (1), is expected to show a syn- c mined by detecting the best fit values. The detection chronization transition around a critical point K . For c will be performed by using the Bayesian scaling analysis K
β r(K) ∼ (K − Kc) , (6) We determine the value of the order parameter rN (K) for a given set of (N,K) through temporal evolution where β is one of the critical exponents. The critical ex- of the system and two steps of averaging. The model ponents are crucial to describe critical phenomena, and equation, Eq. (1), is numerically integrated by using the models are classified into universality classes, each of fourth-order Runge–Kutta algorithm with the time step which shares the same critical exponents. Calculating the δt = 0.1. Initial values of the phases {θi} are ran- critical exponents, including β, is therefore an important domly drawn from the uniform distribution on the in- topic from theoretical and numerical perspectives. terval [0, 2π), and the natural frequencies {ωi} are ran- domly drawn from the distribution function gn(ω). The order parameter rN defined by Eq. (5) depends on time A. Finite-size scaling t, and we take the time average in the time interval t ∈ [300, 500]. This is the first averaging. The critical exponent β is defined in the large popu- Further, we perform 400 realizations by changing lation limit N → ∞, but the limit cannot be achieved small-world networks, the initial values of {θi}, and {ωi} through the numerical simulations. To overcome this for a given set of (N,K). To compute the confidence in- difficulty, we use the finite-size scaling theory, which pro- terval of the order parameter, the resampling technique vides us the limit from observations in finite-size systems. is in use. We choose 200 samples out of 400 realizations, 4
(a) (b) (a) (b) 1.0 2.30 N = 1600 N = 1600 Nmin = 1600 Nmin = 1600 N N 2.25 N = 3200 N = 3200 0.8 = 3200 = 3200 min min N = 6400 N = 6400 Nmin = 6400 Nmin = 6400 N = 12800 N = 12800 2.20 0.6 ) N N = 25600 = 25600 c K (
K 2.15 N r 0.4 2.10 . 0 2 2.05
0.0 2.00 1.0 1.5 2.0 2.5 1.5 2.0 2.5 0.2 0.4 0.6 2.4 2.6 2.8 K K β ν¯
FIG. 3. Graphs of order parameter rN (K) with its confi- FIG. 4. Scattering plots of computed parameters (a)(β, Kc) dence interval for the model (1), where we take the coupling and (b)(¯ν, Kc), evaluated by the Bayesian scaling analysis. function fa(θ) with (a) a = 0 and (b) a = −0.2. As a nat- Here, we use (a, n) = (0, 1), and we set Nmin to 1600, 3200 ural frequency distribution, we use g1(ω) with ∆ = 1, and and 6400. N = 1600, 3200, 6400, 12800, and 25600 from top to bottom. rN (K) and its confidence interval are evaluated by the resam- pling technique. Errorbars are so small that they may not be N = 6400 visible. 3 N = 12800 ¯
ν N = 25600 and calculate the mean of the time-averaged order pa- β/
rameter in the chosen 200 samples. The mean of the ith N 2 (i) ) resampling is denoted by rN (K), and we perform the K (
resampling for S = 1000 times. The value rN (K) is de- N termined by taking the second averaging over S samples r (i) S 1 {rN (K)}i=1, which also provide the confidence interval of rN (K). See Fig. 3 for the obtained rN (K) for a = 0 and −0.2 with n = 1, where the condition a ≤ 0 is expected to give −20 −10 0 10 a continuous transition. In the following two sections, we 1/ν¯ (K − Kc)N compute the critical exponents for a = 0 and a = −0.2, and show discontinuity for a = 0.5, respectively. We remark that a = −0.2 and 0.5 are not special values. β/ν¯ They are arbitrarily chosen from a neighborhood of a =0 FIG. 5. Graph of scaled order parameter rN (K)N versus − 1/ν¯ to demonstrate differences among the three cases of (i) scaled coupling constant (K Kc)N for (a, n) = (0, 1), where we use β, ν¯ and K , obtained by the Bayesian scal- a = 0, (ii) a< 0, and (iii) a> 0. c ing analysis for Nmin = 6400. The values of β, ν¯, and Kc are shown in Table I. We see that the scaled data are well collapsed to the scaling function F . C. Critical exponents for continuous transition
The finite-size scaling, Eq. (9), is a powerful tool to representing the scaling function F for Nmin = 6400. compute the unknown values of Kc,β, andν ¯, but it The estimated values of Kc,β andν ¯ are summarized in is not perfect if N is not sufficiently large. We thus Table I. The row of Nmin = ∞ is obtained by extrapola- compute the unknown variables for three values of N ∈ tion from Nmin = 1600, 3200, and 6400 as demonstrated {Nmin, 2Nmin, 4Nmin}, and observe convergence by vary- in Fig. 6. We note that the extrapolated values of β are ing Nmin. Moreover, we use the resampling technique close to 1/2 and ones ofν ¯ are close to 5/2 irrespective again to estimate the unknown values with their confi- of the values of a and n. The universality is completely dence intervals. Consequently, we have S = 1000 sets of unlike the all-to-all interaction case. Here we note that the three values for a given Nmin as reported in Fig. 4 this result shares the same critical exponentν ¯ = 5/2 as (i) because each resampling set rN (K) determines them. the all-to-all interaction case for (a,n)=(0, 1) calculated Finally, the values and the confidence intervals of Kc,β, in [36]. andν ¯ are computed as the averages and the standard The valueν ¯ ≃ 5/2 is not in agreement with the value deviations over S = 1000 sets. The estimated values are ν¯ ≃ 2 previously reported for (a,n) = (0, 1) [20]. We verified in Fig. 5, where all the points lie on a single curve suppose that the discrepancy comes from the method to 5
TABLE I. Critical exponents β, ν¯ and the critical point Kc of (1) depending on the coupling function fa(θ) = sin θ + a sin 2θ and the natural frequency distribution gn(ω) in (2), for a = 0 and −0.2 and n = 1, 2, 3, and ∞. For each pair of (a, n), we use Nmin = 1600, 3200, 6400, and execute the Bayesian scaling analysis [34] to find the best parameters fitting (9). We extrapolate the critical values to Nmin = ∞ by using the least square method, and they are listed in the line of Nmin = ∞. Here, we show the confidence intervals for the last digit of the estimated values in parentheses; for example, 2.13(3) = 2.13 ± 0.03.
fa(θ) gn(ω) Nmin Kc β ν¯ a = 0 n = 1 1600 2.13(3) 0.33(4) 2.61(7) 3200 2.07(1) 0.42(3) 2.53(5) 6400 2.05(1) 0.47(3) 2.45(4) ∞ 2.02(2) 0.51(4) 2.40(6) n = 2 1600 1.85(1) 0.27(2) 2.67(5) 3200 1.78(1) 0.37(2) 2.53(3) 6400 1.755(9) 0.44(2) 2.50(3) ∞ 1.72(1) 0.49(2) 2.43(4) n = 3 1600 1.80(1) 0.28(2) 2.62(4) 3200 1.76(1) 0.33(2) 2.51(3) 6400 1.723(8) 0.44(2) 2.51(3) ∞ 1.69(1) 0.47(2) 2.46(4) n = ∞ 1600 1.83(1) 0.27(1) 2.50(4) 3200 1.79(1) 0.36(2) 2.52(3) 6400 1.780(8) 0.41(2) 2.46(3) ∞ 1.76(1) 0.46(2) 2.46(4) a = −0.2 n = 1 1600 2.43(5) 0.38(8) 2.67(9) 3200 2.35(2) 0.44(6) 2.58(7) 6400 2.34(1) 0.45(4) 2.42(6) ∞ 2.31(3) 0.48(6) 2.36(8) n = 2 1600 2.09(3) 0.31(4) 2.87(7) 3200 1.99(2) 0.41(4) 2.65(5) 6400 1.96(1) 0.47(3) 2.52(4) ∞ 1.91(2) 0.51(4) 2.41(6) n = 3 1600 2.04(3) 0.27(5) 2.85(8) 3200 1.96(2) 0.37(4) 2.65(5) 6400 1.91(1) 0.49(3) 2.59(4) ∞ 1.86(2) 0.55(4) 2.50(6) n = ∞ 1600 2.08(3) 0.25(4) 2.76(6) 3200 2.00(1) 0.38(4) 2.69(5) 6400 1.97(1) 0.43(3) 2.54(4) ∞ 1.94(2) 0.49(4) 2.49(6)
compute the critical exponents. In the literature, the D. Discontinuity of transition β/ν¯ authors used the fact that rN (K)N takes a constant value irrespective of N at the critical point K = Kc (See Eq. (9)). Using this fact, they first find the best fit values In the all-to-all interaction a positive a induces dis- continuity of the synchronization transition [12]. We re- of β/ν¯ and Kc by varying the system size N. One more equation is obtained by derivating the finite-size scaling, veal that the transition is discontinuous also in a small- Eq. (9), which produces world network. The discontinuity appears as a result of a subcritical transition, and a subcritical transition has metastability: A partially synchronized state is stable in dr 1 − β log N (K ) = log N + const. (11) addition to a stable nonsynchronized state for a fixed K dK c ν¯ close to the critical point. The metastability implies that the final state depends on choice of the initial state, and Plotting the left-hand side as a function of log N, one the dependency is extracted by observing hysteresis. has the slope (1 − β)/ν¯. A remarkable disadvantage of Fixing a = 0.5, we check existence of the hysteresis N this method is that the estimation relies on high preci- by preparing two sets of the initial phases {θi}i=1 for sion of rN (K) around the critical point K = Kc, while each K: (i) We start from K = Kstart, where Kstart is the Bayesian scaling analysis uses rN (K) in a wider in- sufficiently smaller than the critical value Kc, and the 1/ν¯ N terval of (K − Kc)N and provides persistence against initial phases {θi}i=1 are randomly drawn from the in- fluctuation. We, therefore, believe thatν ¯ ≃ 5/2 obtained terval [0, 2π). At a certain value of K, the final phases by the Bayesian scaling analysis is more reliable. at t = 500 is used as the initial phases at the successive 6
(a) a = 0 (a) a = 0 . 0.6 n = 1 0 6 (forward) rN (K) n = 2 n = 3 r(backward) K 0.5 N ( ) n = ∞ 0.4 ) K ( β 0.4 N r 0.2 0.3
0.2 1.8 1.9 2.0 2.1 2.2 2.3 2.4 (b) a = −0.2 (b) a = −0.2 r(forward) K 0.6 0.4 N ( ) (backward) rN (K) .
0.5 ) 0 3 K ( N
r . β 0.4 0 2 n = 1 0.1 0.3 n = 2 n = 3 n = ∞ 2.0 2.1 2.2 2.3 2.4 2.5 2.6 0.2 (c) a = 0.5 1/∞ 1/6400 1/3200 1/1600 1.0 1/Nmin (forward) rN (K) . 0 8 (backward) rN (K)
) 0.6 FIG. 6. Graphs of β as a function of 1/Nmin for (a) a = 0 K − ( 0.05 and (b) a = 0.2 in Eq. (1). Critical exponents obtained by N r 0.4 the finite-size scaling are shown with errorbars, and the least square method gives the extrapolations at the left boundary 0.2 0 of the panels. For each a, the resulting linear regression lines 1.6K 1.8 are drawn with the solid line for n = 1, the dashed line for 0.0 n = 2, the dot-dashed line for n = 3, and the dotted line for 1.5 1.6 1.7 1.8 1.9 n = ∞. K
FIG. 7. Graphs of rN (K) and its errorbar of (1) for (a) (a, n) =(0, 1), (b) (a, n)=(−0.2, 1), and (c) (a, n) =(0.5, 1) with two different types of initial phases, where we set the number of oscillators N = 25600. We see that, only in (c), rN (K) takes a different value depending on the choice of the value K + ∆K in the increasing direction. The increase initial phases around K ∈ (1.6, 1.8). The inset in (c) shows (backward) − (forward) of K is continued up to K = Kend, where Kend is suf- the graph of rN (K) rN (K). ficiently larger than the critical value Kc. We call the (forward) process (i) the “forward” process, and rN (K) de- notes its order parameter. (ii) Contrary to the “forward” N IV. SMALL-WORLD NETWORK AND NOISE process, we start with the random initial phases {θi}i=1 at K = Kend and decrease K up to K = Kstart following the same procedure with the “forward” process. We call We discuss similarity between systems on small-world (backward) networks and noise systems. For simplicity, we consider this process the “backward” process, and rN (K) denotes its order parameter. We have executed the nu- the Kuramoto model (a = 0) for a while. The steady merical simulations of Eq. (1) for a = 0, −0.2, and 0.5, state in the Kuramoto model is proportional to δ(ω − and n =1, 2, 3, and ∞. For the system size N = 25600, Kr sin θ) in the synchronized regime of ω [8, 37], where the hysteresis appears only for a = 0.5 regardless of n δ is the Dirac’s delta function. The δ function with the as exampled in Fig. 7 for n = 1. We have checked that integration over ω and symmetry of the natural frequency t = 500 is sufficiently long to pass the transient period, distribution yield the self-consistent equation of the order and simulations up to t = 800 do not affect the hystere- parameter r as sis. We therefore conclude that the system represented π/2 2 by Eq. (1) shows a discontinuous transition for a = 0.5 r = Kr gn(Kr sin θ)cos θdθ. (12) as the all-to-all interaction case. Z−π/2 7
(a) using the finite-size scaling method. We set the coupling 5.0 function as fa(θ) = sin θ + a sin 2θ, and the natural fre- quency distribution as gn(ω) defined in Eq. (2), and we 2.5 studied the (a,n)-dependency of the critical exponents. Our numerical results suggest β = 1/2 andν ¯ = 5/2 for
i . all gn(ω) and coupling function fa(θ) with a = 0 and ω 0 0 −0.2. This universality shows a sharp contrast with the −2.5 all-to-all interaction case, which has various values of β depending on the coupling function and the natural fre- −5.0 quency distribution. A possible explanation of the source −3 −2 −1 0 1 2 3 of contrast can be found in the number of links of con- (b) sidering networks: our small-world networks has O(N) links, while the all-to-all interaction have O(N 2) links. 5.0 We have also found that the model, Eq. (1), shows a dis- 2.5 continuous transition for a =0.5. The (dis)continuity is a weaker property than the values of the critical expo-
i . nents, and it is shared between the two types of networks: ω 0 0 networks with O(N) links and O(N 2) links. −2.5 We end this paper commenting on two future works. Firstly, we picked up two representative points of a from −5.0 a neighborhood of a = 0 to investigate universality of the −3 −2 −1 0 1 2 3 critical exponents. Studying a global phase diagram on θi the (K,a)-plane is a subject for future researches. Sec- ondly, we note universal value β =1/2 in the Kuramoto model which is recovered by adding noise regardless of FIG. 8. Snap shots of oscillators on the (θi,ωi) plane at t = 500. (a) The all-to-all network. (b) A small-world network. the natural frequency distribution [38]. A small-world The system size N = 6400. The coupling constant K = 4.5. network may play a role of noise due to inhomogeneous (a, n)=(0, 1). couplings, and another work to do is to make a bridge be- tween a noisy Kuramoto model and a model on a small- world network. The order parameter r is sufficiently small around the critical point and we perform the Maclaurin expansion of gn. The leading order of the expansion, which is of O(r), ACKNOWLEDGMENTS determines the celebrated critical point Kc =2/[πgn(0)]. The partially synchronized branch is obtained by balanc- 2n+1 In this research work we used the supercomputer of ing the second leading order of O(r ) with the first ACCMS, Kyoto University. R. Y. acknowledge the sup- leading order of O(r(K −Kc)), and the balance results to 1/(2n) port of Iwadare Scholarship from Iwadare Scholarship r ∝ (K −Kc) . We then obtain the critical exponent Foundation. Y. Y. Y. acknowledges the support of JSPS β =1/(2n). KAKENHI Grant No. 16K05472. To the contrary, on a small-world network, a steady state is not written in the form of the δ function and the synchronized oscillators are still “noisy” as shown in Appendix A: Bayesian Scaling Analysis Fig. 8. The synchronized oscillators no longer capture the flatness of gn(ω) around ω = 0, and the critical exponent β falls into the classical value 1/2 regardless of natural We briefly review the Bayesian scaling analysis [34, 35], frequency distribution gn(ω) as a noisy system [38]. a statistical method for estimating the values such as Moreover, in the model having the nonvanishing sec- β, ν,¯ and Kc in Eq. (9). We write these values as θp = ond harmonics of the coupling function with a < 0, the (β, ν,K¯ c). We assume that the scaling function F in noise recovers β =1/2 [11] whereas no noise system gives Eq. (9) obeys a Gaussian process β = 1 [39]. The universality of β =1/2 observed in sys- tems on small-world networks is therefore very similar to F ∼ GP(m, kθh ), (A1) the one in noisy systems. with mean function m(·) and covariance kernel kθh (·, ·). Here θh denotes the hyperparameters of covariance ker- V. CONCLUSION AND DISCUSSION nel. We also set m = 0 for simplicity. In the follow- ing, we also use the notation θ = (θh,θp). For the data M 1/ν¯ We calculated the critical exponents β andν ¯ for cou- {rNi (Ki)}i=1, the rescaled data Xθp,i = (Ki − Kc)Ni β/ν¯ pled phase-oscillator models on small-world networks by and Yθp,i = rNi (Ki)Ni must collapse on the scaling 8
function as Yθp,i = F (Xθp,i). Since F is a Gaussian pro- and using this gradient, the gradient method gives us the θ cess, Yθp obeys a M-dimensional Gaussian distribution, most probable parameters . and the probability of Y for the parameter θ is θ 0 p(Y | )= N (Yθp | ,Kθ) In this paper, we consider a kernel based on a radial basis function (RBF) kernel 1 1 T −1 = exp − Yθ Kθ Yθp . (A2) (2π)N/2[det Kθ]1/2 2 p
Here, [Kθ] = kθh (Xθp,i,Xθp,j) is M × M dimensional matrix. By assuming that the prior distribution of θ is uniform, we have (x − y)2 kθh (x, y)= θ1 exp − + θ3δ(x, y), (A6) θ2 p(θ | Y ) ∝ p(Y | θ), (A3) from Bayes’ theorem. The most probable parameters θ are, therefore, estimated by finding the minimum of like- lihood function given by which is parameterized by θh = (θ1,θ2,θ3) with θ1,2,3 > T −1 θ θ L = log(det K )+ Yθp Kθ Yθp , (A4) 0, and δ(x, y) = 1 when x = y, otherwise δ(x, y) = 0. Here, θ3 denotes the data fidelity. Roughly speaking, a which is obtained by taking log and discarding constants sample path of Gaussian process associated with a RBF in Eq. (A2). The gradient of Lθ for an element θ ∈ θ is kernel are known to be an infinitely differentiable func- given by tion; see [40, Corollary 4.13] for a rigorous statement. Therefore, the Bayesian scaling analysis only assumes the ∂Lθ −1 ∂Kθ −1 T ∂Kθ −1 smoothness of a scaling function, and it does not need an =tr Kθ − (Kθ Yθp ) (Kθ Yθp ) ∂θ ∂θ ∂θ explicit form. See the reference [34, 35] for more detailed T ∂Yθ discussions. +2Y K−1 p , θp θ ∂θ (A5)
[1] I. Aihara, T. Mizumoto, T. Otsuka, H. Awano, K. Nagira, ment of Globally Coupled Oscillators, Phys. Rev. Lett. H. G. Okuno, and K. Aihara, Spatio-Temporal Dynam- 74, 4341 (1995). ics in Collective Frog Choruses Examined by Mathemat- [12] H. Chiba and I. Nishikawa, Center manifold reduction for ical Modeling and Field Observations, Sci. Rep. 4, 3891 large populations of globally coupled phase oscillators, (2014). Chaos 21, 043103 (2011). [2] H. M. Smith, Synchronous flashing of fireflies, Science [13] M. Komarov and A. Pikovsky, Multiplicity of Singular 82, 151 (1935). Synchronous States in the Kuramoto Model of Coupled [3] J. Buck and E. Buck, Mechanism of rhythmic syn- Oscillators, Phys. Rev. Lett. 111, 204101 (2013). chronous flashing of fireflies, Science 159, 1319 (1968). [14] M. Komarov and A. Pikovsky, The Kuramoto model of [4] J. Pantaleone, Synchronization of metronomes, Am. J. coupled oscillators with a bi-harmonic coupling function, Phys. 70, 992 (2002). Physica D 289, 18 (2014). [5] A. T. Winfree, Biological Rhythms and the Behavior of [15] L. Basnarkov and V. Urumov, Phase transitions in the Populations of Coupled Oscillators, J. Theoret. Biol. 16, Kuramoto model, Phys. Rev. E 76, 057201 (2007). 15 (1967). [16] D. Paz´o, Thermodynamic limit of the first-order phase [6] Y. Kuramoto and H. Nakao, On the concept of dynamical transition in the Kuramoto model, Phys. Rev. E 72, reduction: the case of coupled oscillators, Phil. Trans. R. 046211 (2005). Soc. A 377, 20190041 (2019). [17] H. Daido, Intrinsic Fluctuations and a Phase Transition [7] Y. Kuramoto, Self-entertainment of a population of cou- in a Class of Large Populations of Interacting Oscillators, pled non-linear oscillators, International Symposium on J. Stat. Phys. 60, 753 (1990). Mathematical Problems in Theoretical Physics, Lecture [18] S. N. Dorogovtsev, A. V. Goltsev, and J. F. F. Mendes, Notes in Physics 39, 420 (1975). Critical phenomena in complex networks, Rev. Mod. [8] S. H. Strogatz, From Kuramoto to Crawford: exploring Phys. 80, 1275 (2008). the onset of synchronization in populations of coupled [19] D. J. Watts and S. H. Strogatz, Collective dynamics of oscillators, Physica D 143, 1 (2000). ‘small-world’ networks, Nature 393, 440 (1998). [9] H. Chiba, A proof of the Kuramoto conjecture for a bi- [20] H. Hong, M. Y. Choi, and B. J. Kim, Synchronization on furcation structure of the infinite-dimensional Kuramoto small-world networks, Phys. Rev. E 65, 026139 (2002). model, Ergod. Th. & Dynam. Sys. 35, 762 (2015). [21] H. Sakaguchi, S. Shinomoto, and Y. Kuramoto, Local [10] H. Daido, Susceptibility of large populations of coupled and global self-entrainments in oscillator lattices, Prog. oscillators, Phys. Rev. E 91, 012925 (2015). Theor. Phys. 77, 1005 (1987). [11] J. D. Crawford, Scaling and Singularities in the Entrain- [22] H. Daido, Lower critical dimension for populations of 9
oscillators with randomly distributed frequencies: A scaling, dynamic fluctuations, and hyperscaling relation renormalization-group analysis, Phys. Rev. Lett. 61, 231 in the Kuramoto model, Phys. Rev. E 92, 022122 (2015). (1988). [32] T. Coletta, R. Delabays, and P. Jacquod, Finite-size scal- [23] B. Pietras, N. Deschle, and A. Daffertshofer, First-order ing in the Kuramoto model, Phys. Rev. E 95, 042207 phase transitions in the Kuramoto model with com- (2017). pact bimodal frequency distributions, Phys. Rev. E 98, [33] R. Juh´asz, J. Kelling, and G. Odor,´ Critical dynamics 062219 (2018). of the Kuramoto model on sparse random networks, J. [24] H. Chiba, G. S. Medvedev, and M. S. Mizuhara, Bifur- Stat. Mech., 053403 (2019). cations in the Kuramoto model on graphs, Chaos 28, [34] K. Harada, Bayesian inference in the scaling analysis of 073109 (2018). critical phenomena, Phys. Rev. E 84, 056704 (2011). [25] G. S. Medvedev, Small-world networks of Kuramoto os- [35] K. Harada, Kernel method for corrections to scaling, cillators, Physica D 266, 13 (2014). Phys. Rev. E 92, 012106 (2015). [26] L. Lov´asz, Large networks and graph limits, (American [36] H. Hong, H. Chat´e, H. Park, and L-H. Tang, Entrain- Mathematical Society, Providence, Rhode Island, 2012). ment Transition in Populations of Random Frequency [27] R. Botet, R. Jullien, and P. Pfeuty, Size Scaling for In- Oscillators, Phys. Rev. Lett. 99, 184101 (2007). finitely Coordinated Systems, Phys. Rev. Lett. 49, 478 [37] J. D. da Fonseca and C. V. Abud, The Kuramoto model (1982). revisited, J. Stat. Mech., 103204 (2018). [28] A. Pelisseto and E. Vicari, Critical phenomena and [38] H. Sakaguchi, Cooperative Phenomena in Coupled Oscil- renormalization-group theory, Phys. Rep. 368, 549 lator Systems under External Fields, Prog. Theo. Phys. (2002). 79, 39 (1988). [29] M. Hasenbusch, Finite size scaling study of lattice models [39] H. Daido, Generic scaling at the onset of macroscopic in the three-dimensional Ising universality class, Phys. mutual entrainment in limit-cycle oscillators with uni- Rev. B 82, 174433 (2010). form all-to-all coupling, Phys. Rev. Lett. 73, 760 (1994). [30] A. Pikovsky and M. Rosenblum, Dynamics of globally [40] M. Kanagawa, P. Hennig, D. Sejdinovic, and B.K. coupled oscillators: Progress and perspectives, Chaos 25, Sriperumbudur, Gaussian Processes and Kernel Meth- 097616 (2015). ods: A Review on Connections and Equivalences, arXiv: [31] H. Hong, H. Chat´e, L-H. Tang, and H. Park, Finite-size 1807.02582.