arXiv:1901.11134v3 [math.GM] 16 Feb 2020 acls hscmiainpoue aypoiigadpot and has ro promising series many essential Taylor produces an combination classical This plays the calculus. series Interestingly, Taylor tool, function. powerful a a As field. Keywords: e the proposed validate fra is to of truncation presented properties via some scheme basis, approximation this numerical On order. Riemann–Liouv variable the the of and account into takes framework The expa time. by developed is series Taylor fractional for framework hspprfcsso h qiaetepeso ffraction of expression equivalent the on focuses paper This Abstract .Introduction 1. rpitsbitdt ple ahmtc n Computation and Mathematics Applied to submitted Preprint r on nteter n plcto ffatoa series fractional of application [18, and time theory discrete the and on found [17] unexplo are length completely memory yet fixed world with a calculus to mind reader’s the seri two opens The and [16]. derivative fractional constru describe was to function series In analytic discussed the of definitions. derivatives Riemann–Liouville and Gr¨unwald–Letnikov eiscmrsdo rcinlderivatives. h fractional on of have focused comprised papers mainly series results of a these volume However, large [9–14]. a see e then, few, Since a al. et [8]. Odibat case and instan Caputo [7] initial the problem s infinite theorem of value and validity mean finite related the for the both of [6], proof Hardy The by given publishing. Th for [5]. function intended analytic never an formulate to structure series a osatodrcs,tevral aeehbt oeeviden more exhibits case variable the b to case, desired order are constant properties Many ii) derivative. compact fractional A i) disciplines. non-engineering and engineering ∗ mi address: Email author Corresponding h rgnlie nfatoa eeaie alrsre c series Taylor generalized fractional on idea original The introduc its since developed intensively has series Taylor ept fsm ine okrpre,a h uhr nw i know, authors the as reported, work pioneer some of Despite di a suggested Spanier and Oldham Luckily, nnt eisrpeetto ffatoa acls the calculus: fractional of representation series Infinite c alrsre;fatoa acls iglrt;nonloca singularity; calculus; fractional series; Taylor h nttt o uoai oto n ope ytm,Un Systems, Complex and Control Automatic for Institute The [email protected] a eateto uoain nvriyo cec n Techno and Science of University Automation, of Department ff b colo niern,Uiest fClfri,Mre,M Merced, California, of University Engineering, of School cieesadpatcblt fteotie results. obtained the of practicability and ectiveness iegWei Yiheng Yn Wang) (Yong a agunChen YangQuan , ff rn esetv oepesfatoa acls[5,inc [15], calculus fractional express to perspective erent spoieapriua nih noa neetn researc interesting an into insight particular a provide es xlr ihtedvlpdsre.ii oprdwt the with Compared iii) series. developed the with explore e ssre a o rvnadterltdmnsrp probably manuscript related the and proven not was series is td pr rmti eis ak ta.etbihdanew a established al. et Samko series, this from Apart cted. ente oaohr30ya itr ol .. fractiona i.e., tool, history 300-year another to tied been dn naayi ucina h nta ntn rtecurr the or instant initial the at function analytic an nding n rcia eisrpeetto sdsrdfrteCapu the for desired is representation series practical and ersnain[20–22]. representation lintegrals al .Floigteepoerwr,Tuil ta.discussed al. et Trujillo work, pioneer these Following t. b toa aclsaecnre ovnety nintuitive An conveniently. confirmed are calculus ctional ini 0 er g n snwdy aueresearch mature a nowadays is and ago years 300 in tion eo h aua rpryo rcinlcluu,while calculus, fractional of property natural the on ce igGao Qing , nb ae akt 87 hnReanfral used formally Riemann when 1847, to back dated be an usqety ial,svrlilsrtv xmlsare examples illustrative several Finally, subsequently. wt ecieafnto rafatoa eiaiewith derivative fractional a or function a describe to ow nilapiain [1–4]. applications ential vriyo usugEsn usug407 Germany 47057, Duisburg Duisburg-Essen, of iversity c nepninfrcrancasso ucin was functions of classes certain for expansion an uch ei nltclaayi n ueia aclto of calculation numerical and analysis analytical in le tne h eutfo h imn–iuil aeto case Riemann–Liouville the from result the xtended ledfiiin h auodfiiin h osatorder constant the definition, Caputo the definition, ille e.Atrad,tesre ersnaino fractional of representation series the Afterwards, red. 9 eeivsiae.Bsds oepern papers preprint some Besides, investigated. were 19] enpbihdsqetal nti oi,t mention to topic, this on sequentially published been hsepeso,apwrsre novn integer involving series power a expression, this iy aibeorder. variable lity; a o e trce nuhatnini both in attention enough attracted yet not has t oyo hn,Hfi 306 China 230026, Hefei, China, of logy / eiaie iha nnt eis universal A series. infinite an with derivatives c ogWang Yong , re,933 USA 95343, erced, r n applications and ory a, ∗ eray1,2020 18, February luding area h ent to l related research is absent. Bearing these ideas in mind, this paper aims at deriving infinite series representations for fractional integrals/derivatives and addressing their underlying properties comprehensively. The remainder of the paper is divided in the following manner. Section 2 provides some preliminaries of fractional calculus. The theory and applications of series representation for fractional integrals/derivaters are investigated in Section 3. In Section 4, three numerical examples are presented to illustrate the validity of the developed method. This paper is concluded in Section 5.

2. Preliminaries

Fractional calculus could be treated as a natural generalization of classical integer calculus. There have been a number of different definitions for the fractional derivative, among which the Riemann–Liouville fractional derivative and the Caputo fractional derivative are most widely used. Definition 1. The α-th Riemann–Liouville fractional integral of a function f (t) is defined as

RI α , 1 t − α−1 a t f (t) Γ(α) Ra (t τ) f (τ)dτ, (1)

+∞ α> a Γ (x) = −ttx−1 t where 0 is the integral order, is the initial instant and R0 e d is the Gamma function. In the light of the fractional integral in (1), the following two different fractional derivatives could be established respectively [15]. Let n ∈ N+ and α ∈ (n − 1, n). RD α , Definition 2. The α-th Riemann–Liouville fractional derivative of a function f (t) is defined as a t f (t) dn RI n−α dtn a t f (t). CD α , RI n−α dn Definition 3. The α-th Caputo fractional derivative of a function f (t) is defined as a t f (t) a t dtn f (t). The singularity issue of fractional calculus can be directly concluded from (1), since there will be zero denominator in (1) as τ → t and 0 <α< 1. Similarly, for the derived derivatives, 0 < n − α< 1 also results in singularity. One can also read from the above definitions that a fractional derivative is actually a special fractional integral that depends on all the historical data. This nonlocality is also called the global correlation or history dependence [23], which signifies the essential difference between fractional calculus and classical integer calculus.

3. Main Results

This section proposes two series representations for fractional derivative and fractional integral, based on which several calculation properties of fractional calculus are deduced.

3.1. A universal framework If f (·) is an analytic function in an interval (a, b), then it can be represented as a convergent series f (t) = (k) +∞ f (a) (t − a)k. With this assumption, the α-th Caputo fractional derivative of f (t) can be calculated as Pk=0 k! CD α RI n−α dn a t f (t) = a t dtn f (t) RI n−α dn +∞ f (k)(a) k = a t dtn k=0 k! (t − a) P (k) = RI n−α +∞ f (a) (t − a)k−n a t Pk=n Γ(k−n+1) (2) +∞ f (k)(a) RI n−α k−n = k=n Γ(k−n+1) a t (t − a) P (k) = +∞ f (a) (t − a)k−α, Pk=n Γ(k−α+1) where n − 1 <α< n and n ∈ N+.

2 In (2), the Taylor series is expanded at the initial instant t = a. The corresponding case expanded at the current (k) time comes to mind intuitively. If f (·) can be expressed a convergent series f (τ) = +∞ f (t) (τ − t)k, τ ∈ (a, t), then Pk=0 k! another useful series representation can be achieved regarding the following deduction

CD α = 1 t − n−α−1 (n) a t f (t) Γ(n−α) Ra (t τ) f (τ) dτ (k+n) = 1 t +∞ − k f (t) − n+k−α−1 Γ(n−α) Ra k=0 ( 1) Γ(k+1) (t τ) dτ P (k+n) = 1 +∞ − k f (t) t − n+k−α−1 Γ(n−α) k=0 ( 1) Γ(k+1) Ra (t τ) dτ P (k+n) n+k−α (3) = 1 +∞ (−1)k f (t) (t−a) Γ(n−α) Pk=0 Γ(k+1) n+k−α +∞ (−1)k f (k)(t) k−α = k=n Γ(n−α)Γ(k−n−1)(k−α) (t − a) P (k) = +∞ α−n f (t) (t − a)k−α, Pk=n k−n
Γ(k−α+1) N π where n − 1 <α< n, n ∈ +, the reflection formula Γ (x) Γ (1 − x) = sin(xπ) is used and the binomial coefficient is defined as p = Γ(p+1) . q
Γ(q+1)Γ(p−q+1) Notably, from another perspective, the first class in (2) is derived by expanding f (·) before substituting into the specific definition and the second case in (3) is established by expanding f (·) after substituting into the specific definition. Note that with the adoption of f (k)(t), the second class is not a power series like the first class. Similar to the newly developed series representation in Caputo case, some existing results emerged in pioneering work (see (3.53), (5.2.4) and (5.2.9) of [15]; (15.4) of [16]; (2.215) and (2.223) of [24])

(k) RI α f (t) = +∞ f (a) (t − a)k+α, (4) a t Pk=0 Γ(k+α+1)

(k) RD α f (t) = +∞ f (a) (t − a)k−α, (5) a t Pk=0 Γ(k−α+1) (k) RI α f (t) = +∞ −α f (t) (t − a)k+α, (6) a t Pk=0 k
Γ(k+α+1) (i) RD α f (t) = +∞ ( α ) f (t) (t − a)i−α, (7) a t Pi=0 i Γ(i−α+1) where similar assumption on f (t) is made, α> 0 and t ∈ [a, b]. Interestingly, it can be observed that if we extend the range of α to (−∞, +∞), (4) and (5) share a same form. Likewise, (6) and (7) can also share a unified form with α ∈ (−∞, +∞). Notably, such a fact can also be verified through the following deduction (n − 1 <α< n ∈ N+)

RD −α = dn 1 t − n+α−1 a t f (t) dtn Γ(n+α) Ra (t τ) f (τ) dτ = 1 t − α−1 (8) Γ(α) Ra (t τ) f (τ) dτ RI α = a t f (t) ,

d t = t ∂ + where the formula dt Ra f (t, τ) dτ Ra ∂t f (t, τ) dτ f (t, t) is used repeatedly. Comparing (2) with (5), a well-known formula (n − 1 <α< n ∈ N+) follows

(k) RD α f (t) = CD α f (t) + n−1 f (a) (t − a)k−α. (9) a t a t Pk=0 Γ(k−α+1) RD α CD α With the representations in (3) with (7), the relationship between a t f (t) and a t f (t) cannot be expressed as a brief formula like (9). To improve the practicality, we reduce the requirement on f (·). If the function f ∈CN+1[a, b] can be expressed by (k) t a Taylor formula expanded at the initial instant, i.e., f (t) = N f (a) (t − a)k + 1 (t − τ)N f (N+1) (τ) dτ, N ∈ N, Pk=0 k! Γ(N+1) Ra RI α then a new equivalent form of a t f (t) can be obtained

(k) t RI α f (t) = RI α N f (a) (t − a)k + RI α 1 (t − τ)N f (N+1) (τ) dτ a t a t Pk=0 k! a t Γ(N+1) Ra (k) t x (10) = N f (a) (t − a)k+α + 1 (t − x)α−1 1 (x − τ)N f (N+1) (τ) dτdx. Pk=0 Γ(k+α+1) Γ(α) Ra Γ(N+1) Ra

3 The second term in the right hand of (10) can be further simplified as 1 t − α−1 1 x − N (N+1) Γ(α) Ra (t x) Γ(N+1) Ra (x τ) f (τ) dτdx = 1 t x − α−1 − N (N+1) Γ(α)Γ(N+1) Ra Ra (t x) (x τ) f (τ) dτdx t t = 1 (t − x)α−1(x − τ)N f (N+1) (τ) dxdτ Γ(α)Γ(N+1) Ra Rτ (11) = 1 t t − α−1 − N (N+1) Γ(α)Γ(N+1) Ra Rτ (t x) (x τ) dx f (τ)dτ t 1 = 1 (t − τ)N+α( − ξ)α−1ξN ξ f (N+1) (τ) τ Γ(α)Γ(N+1) Ra R0 1 d d = 1 t − N+α (N+1) Γ(N+α+1) Ra (t τ) f (τ)dτ. Substituting (11) into (10), a beautiful result can be obtained

(k) t RI α f (t) = N f (a) (t − a)k+α + 1 (t − τ)N+α f (N+1) (τ) dτ, (12) a t Pk=0 Γ(k+α+1) Γ(N+α+1) Ra where α> 0 and t ∈ [a, b]. Considering α ∈ (n − 1, n) and n ∈ N+, by using Definition 2, one has

(k) RD α = dn N f (a) − k+n−α + dn 1 t − N+n−α (N+1) a t f (t) dtn k=0 Γ(k+n−α+1) (t a) dtn Γ(N+n−α+1) Ra (t τ) f (τ) dτ P (k) = N f (a) − k−α + dn−1 1 t − N+n−α−1 (N+1) k=0 Γ(k−α+1) (t a) dtn−1 Γ(N+n−α) Ra (t τ) f (τ) dτ P N+n−α (N+1) (13) + dn−1 (t−t) f (t) dtn−1 Γ(N+n−α+1) (k) t = N f (a) (t − a)k−α + 1 (t − τ)N−α f (N+1) (τ) dτ, Pk=0 Γ(k−α+1) Γ(N−α+1) Ra where the differential formula for integral upper limit function is adopted repeatedly. When N ∈ N and N ≥ n, the Caputo case can be derived

n (k) n t CD α f (t) = RI n−α d N f (a) (t − a)k + RI n−α d 1 (t − τ)N f (N+1) (τ) dτ a t a t dtn Pk=0 k! a t dtn Γ(N+1) Ra (k) t = RI n−α N f (a) (t − a)k−n + RI n−α 1 (t − τ)N−n f (N+1) (τ) dτ (14) a t Pk=n Γ(k−n+1) a t Γ(N−n+1) Ra (k) t = N f (a) (t − a)k−α + 1 (t − τ)N−α f (N+1) (τ) dτ. Pk=n Γ(k−α+1) Γ(N−α+1) Ra Note that the remainder in (14) is equal to that in (13), which confirms the relationship in (9). Likewise, if the function f ∈CN+1[a, b] can be expressed by a Taylor formula expanded at the current time τ = t, (k) τ i.e., f (τ) = N f (t) (τ − t)k + 1 (τ − x)N f (N+1) (x) dx, τ ∈ (a, t), one has Pk=0 Γ(k+1) Γ(N+1) Ra (k) t RI α f (t) = N −α f (t) (t − a)k+α + 1 (t − τ)N+α f (N+1) (τ) dτ, (15) a t Pk=0 k
Γ(k+α+1) Γ(N+α+1) Ra where α> 0 and N ∈ N. When α ∈ (n − 1, n), n ∈ N+, N ∈ N and N ≥ n, the following equations follow from the relationship between fractional derivative and fractional integral immediately

(k) t RD α f (t) = N α f (t) (t − a)k−α + 1 (t − τ)N−α f (N+1) (τ) dτ, (16) a t Pk=0 k
Γ(k−α+1) Γ(N−α+1) Ra (k) t CD α f (t) = N α−n f (t) (t − a)k−α + 1 (t − τ)N+n−α f (N+n+1) (τ) dτ. (17) a t Pk=n k−n
Γ(k−α+1) Γ(N+n−α+1) Ra Remark 1. By now, the universal representation framework has been developed for fractional integral and fractional derivative, which includes the Taylor series representation and the Taylor formula representation. Compared with the Taylor series based formulas (2)-(7), lower requirements are needed for f (·) in the Taylor formula based ones (12)- (17). As a result, the latter ones provide more practicability. On the other side, the new representation can be divided into two kinds: the one expanded at the initial instant and the one expanded at the current time. In order to obtain a comprehensive understanding of the elaborated framework, several applications are presented in the remainder of this section. To be specifically, subsections 3.2-3.4 analyzes a situation where the first class of series is more convenient to use. Subsection 3.5 shows that we may need different series representations in different analysis stages of the same problem. In subsection 3.6, we provide a case when both the two kinds series are useful. The results on constant order α are extended to the variable order case in subsection 3.7. Consider an analytic function f (·) in an interval (a, b) unless otherwise specified. 4 3.2. Associative law (k) Assume f (·) can be expressed as a Taylor series at the initial instant, i.e., f (t) = +∞ f (a) (t − a)k, t ∈ [a, b]. The Pk=0 k! associate laws of fractional derivative in two cases are formulated as follows.

• Case 1: with fractional derivative.

Let α1, α2 > 0 and α1, α2 < N, one has

f (k)(a) RD α1 RD α2 f (t) = RD α1 +∞ (t − a)k−α2 a t a t a t Pk=0 Γ(k−α2+1) f (k)(a) = +∞ (t − a)k−α1−α2 Pk=0 Γ(k−α1−α2+1) (18) RD α1+α2 = a t f (t) RD α2 RD α1 = a t a t f (t) .

Let α1, α2 ∈ (n − 1, n) and n ∈ N+, one has

(k) CD α1 CD α2 f (t) = CD α1 +∞ f (a) (t − a)k−α2 a t a t a t k=n Γ(k−α2+1) P (k) = RI n−α1 +∞ f (a) (t − a)k−α2−n a t k=n Γ(k−n−α2+1) P(k) (19) = +∞ f (a) (t − a)k−α1−α2 Pk=n Γ(k−α1−α2+1) CD α2 CD α1 = a t a t f (t) .

Furthermore, if n = 1 and α1 + α2 ∈ (0, 1), one has

CD α1 CD α2 CD α2 CD α1 CD α1+α2 a t a t f (t) = a t a t f (t) = a t f (t) . (20) When β ∈ (0, 1) and m β = α + α , one has that k Pk=1 k 1 2

CD α1+α2 CD β1 CD β2 CD βm a t f (t) = a t a t ··· a t f (t) . (21)

For any α ∈ (n − 1, n), n ≤ m, n ∈ N+ and m ∈ N+, one has dm CD αCD m−α dtm f (t) = a t a t f (t) CD m−αCD α = a t a t f (t) RD αCD m−α = a t a t f (t) CD m−αRD α = a t a t f (t) RD m−αCD α (22) = a t a t f (t) CD αRD m−α = a t a t f (t) RD m−αRD α = a t a t f (t) RD αRD m−α = a t a t f (t) . With the special assumption on f (·), a handy result in (18) is obtained to replace the restricted result in subsection 2.3.6 of [24]. Compared with Theorems 3.3 and 3.4 of [25], the proposed results (19)-(21) are more general. Inspired by Property 6 in [26], formula (22) provides more effective alternatives.

• Case 2: with fractional integral.

For any α ∈ (n − 1, n), n ∈ N+ and β> 0, one has

RD αRI β RD α +∞ f (k)(a) k+β a t a t f (t) = a t k=0 Γ(k+β+1) (t − a) P (k) = +∞ f (a) (t − a)k+β−α Pk=0 Γ(k+β−α+1) (23) RI βRD α = a t a t f (t) RD α−β = a t f (t) , which implies RD αRI α RI αRD α a t a t f (t) = a t a t f (t) = f (t) . (24) 5 Similarly, formulas (4) and (2) give

CD αRI β CD α +∞ f (k)(a) k+β a t a t f (t) = a t k=0 Γ(k+β+1) (t − a) P (k) (25) = +∞ f (a) (t − a)k+β−α; Pk=0 Γ(k+β−α+1)

RI βCD α RI β +∞ f (k)(a) k−α a t a t f (t) = a t k=n Γ(k−α+1) (t − a) P (k) (26) = +∞ f (a) (t − a)k+β−α, Pk=n Γ(k+β−α+1) which imply the following special cases CD αRI α a t a t f (t) = f (t) ; (27)

(k) RI αCD α f (t) = f (t) − n−1 f (a) (t − a)k. (28) a t a t Pk=0 Γ(k+1) From definitions, the left hand of (26) can be expressed as

RI αCD α = 1 t − α−1CD α a t a t f (t) Γ(α) Ra (t τ) a t f (τ) dτ. (29) By applying the integral mean value theorem, there exists a variable ξ ∈ (a, t) such that

(k) CDα f (t) = n−1 f (a) (t − a)k + a t f (ξ) (t − a)α. (30) Pk=0 Γ(k+1) Γ(α+1) Note that the newly derived formula (30) is similar to the existing results (see (1.5) in [7], Corollary 7 in [27] and (3.12) in [8]), while they are essentially different.

3.3. The differentiability on the order (k) Assume f (·) can be expressed as a Taylor series at the initial instant, i.e., f (t) = +∞ f (a) (t − a)k, t ∈ [a, b]. Pk=0 k! Inspired by the discussion when the order tends to the edge of the interval [24, 25], the continuity of fractional derivatives with respect to the order α ∈ (n − 1, n), n ∈ N+ can be analyzed. For any constant ν ∈ (n − 1, n), it follows from the continuity of the Gamma function that

RD α RD α lim a f (t) = lim a f (t) α→ν− t α→ν+ t (k) = +∞ f (a) (t − a)k−ν (31) Pk=0 Γ(k−ν+1) RD ν = a t f (t) ; lim CD α f (t) = lim CD α f (t) α→ν− a t α→ν+ a t (k) = +∞ f (a) (t − a)k−ν (32) Pk=n Γ(k−ν+1) CD ν = a t f (t) , which means that both the Riemann–Liouvillefractional derivative and the Caputo fractional derivative are continuous with respect to their derivative order on the interval (n − 1, n), n ∈ N+. Now, the continuity near the boundaries can be obtained successfully

R α +∞ f (k)(a) k−n dn lim D f (t) = (t − a) = n f (t) , (33) α→n− a t Pk=n Γ(k−n+1) dt

RD α +∞ f (k)(a) k−n+1 dn−1 lim a t f (t) = k=n−1 (t − a) = n−1 f (t) ; (34) α→(n−1)+ P Γ(k−n+2) dt

C α +∞ f (k)(a) k−n dn lim D f (t) = (t − a) = n f (t) , (35) α→n− a t Pk=n Γ(k−n+1) dt CD α +∞ f (k)(a) k−n+1 dn−1 (n−1) lim a t f (t) = k=n (t − a) = n−1 f (t) − f (a) , (36) α→(n−1)+ P Γ(k−n+2) dt where Γ(−k) = ±∞, ∀k ∈ N is adopted here.

6 Equations (33)-(36) clearly indicate that the Riemann–Liouville fractional derivative is continuous with respect to the order α on the interval [n − 1, n], ∀n ∈ N+. Obviously, this conclusion still holds in the case that α ∈ [0, +∞); The Caputo fractional derivative is continuouswith respect to α on the interval (n−1, n] and is generally right discontinuous with respect to α at each integer point α = n. Let α1 ∈ (0, +∞) and α2 ∈ (n − 1, n), n ∈ N+. We have

k−α ∂ RD α1 f (t) = +∞ f (k) (a) ∂ (t−a) 1 ∂α1 a t k=0 ∂α1 Γ(k+1−α1) P (k) (37) +∞ f (a) k−α1 = (t − a) φ(k + 1, α1, t, a); Pk=0 Γ(k−α1+1) (k) ∂ C α2 +∞ f (a) k−α2 D f (t) = (t − a) φ(k + 1, α2, t, a), (38) ∂α2 a t Pk=n Γ(k−α2+1) ′ +∞ φ k, α, t, a = Γ (k−α) − (t − a) Γ′ (x) = −ttx−1 (t) t where ( ) Γ(k−α) ln and R0 e ln d . Such a formula can be used for identifying the order. Alternatively, from Definition 2 and Definition 3, one has

n t ∂ R α1 1 d n−α1−1 D f (t) = n (t − τ) f (τ) φ(n, α1, t, τ)dτ; (39) ∂α1 a t Γ(n−α1) dt Ra t ∂ C α2 1 n−α2−1 (n) D f (t) = (t − τ) f (τ) φ(n, α2, t, τ)dτ. (40) ∂α2 a t Γ(n−α2) Ra Considering that the initial conditions of the Caputo fractional derivative are irrelevant to the order α, one has α ∂ CD 2 f (t) = ∂ L −1 sα2 F (s) − n−1 sα2−k−1 f (k) (a) ∂α2 a t ∂α2 a  Pk=0 = L −1 ∂ {sα2 F (s)}− n−1 d sα2−k−1 f (k) (a) a  ∂α2 Pk=0 dα2 = L −1 sα2 ln (s) F (s) + sα2 ∂ F (s) (41) a  ∂α2 L −1 n−1 α2−k−1 (k) − a k=0 s ln (s) f (a) α  P = CD 2 f (t) ∗ L −1 {ln (s)} + L −1 sα2 ∂ F (s) , a t a a  ∂α2 , +∞ −s(t−a) where F (s) Ra e f (t) dt is the Laplace transform of f (t) with the initial instant a, the corresponding inverse β+j∞ L −1{F (s)} , 1 F (s) s(t−a) s ∗ Laplace transform a 2πj Rβ−j∞ e d , and stands for the convolution operation with the initial ∗ , t + − instant a, i.e., p (t) q (t) Ra p (τ) q (t a τ) dτ. After discussing the case of fractional derivative, let us focus on the Riemann-Liouville fractional integral case in the sequel. If ν is a constant satisfying n − 1 <ν< n, n ∈ N+, one has RI α +∞ f (k)(a) k+ν RI ν lim f (t) = = (t − a) = f (t) , (42) α→ν a t Pk 0 Γ(k+ν+1) a t

(k) lim RI α f (t) = +∞ f (a) (t − a)k+n = RI n f (t) , (43) α→n− a t Pk=0 Γ(k+n+1) a t

RI α +∞ f (k)(a) k+n−1 RI n−1 lim a t f (t) = k=0 (t − a) = a t f (t) , (44) α→(n−1)+ P Γ(k+n) which mean that the Riemann–Liouville fractional integral is continuous with respect to the order α on the interval [n − 1, n], ∀n ∈ N+ (or, to be more exact, [0, +∞)). In fact, the Riemann–Liouville fractional integral is differentiable with respect to the order α and the corresponding differential can be obtained from different angles as

+ ∂ RI α +∞ (k) ∂ (t−a)k α ∂α a t f (t) = k=0 f (a) ∂α Γ(k+α+1) P (k) (45) = − +∞ f (a) (t − a)k+αφ(k + 1, −α, t, a); Pk=0 Γ(k+α+1) ∂ RI α = − 1 t − α−1 − ∂α a t f (t) Γ(α) Ra (t τ) f (τ) φ(0, α, t, τ)dτ; (46) ∂ RI α ∂ L −1 −α ∂α a t f (t) = ∂α a {s F (s)} L −1 ∂ −α = a { ∂α s F (s)} L −1 −α −α ∂ (47) = a {−s ln (s) F (s) + s ∂α F (s)} RI α L −1 L −1 −α ∂ = −a t f (t) ∗ a {ln (s)} + a ns ∂α F (s)o . Compared with the related work in [24, 25], a more detailed investigation is made. Several practical results on the continuity and the differentiability with respect to the order are provided. 7 3.4. Scale transform (k) Assume f (·) can be expressed as a Taylor series at the initial instant, i.e., f (t) = +∞ f (a) (t − a)k, t ∈ [a, b]. By Pk=0 k! a scale transform of a function f (t) with respect to an initial instant a, it means to replace f (t) by f (x) with an initial instant c, where x = λt + γ, c = λa + γ, λ and γ are scaling factors. In the framework of the proposed series, an effective procedure will be constructed to evaluate the effect on fractional derivative operation. Let α ∈ (n − 1, n), n ∈ N+. One has the following two equations

k (k) RD α f (x) = +∞ λ f (c) (t − a)k−α; (48) a t Pk=0 Γ(k−α+1)

k (k) CD α f (x) = +∞ λ f (c) (t − a)k−α, (49) a t Pk=n Γ(k−α+1) dk = k (k) = k dk ff where the fact dtk f (x) λ f (x) λ dxk f (x) is adopted here. If the di erential variable t and the initial instant a are replaced by x and c respectively, one has

(k) RD α f (x) = +∞ f (c) (x − c)k−α; (50) c x Pk=0 Γ(k−α+1)

(k) CD α f (x) = +∞ f (c) (x − c)k−α. (51) c x Pk=n Γ(k−α+1) Combining (48)-(51) yields RD α αRD α a t f (x) = λ c x f (x) ; (52) CD α αCD α a t f (x) = λ c x f (x) . (53) In (52) and (53), if one sets a = 0, γ = 0, λ ∈ C and λ , 0, then x = λt, c = a and the scale transform operation reduces to a simple multiplication by a constant, namely,

RD α αRD α 0 t f (λt) = λ 0 λt f (λt) ; (54) CD α αCD α 0 t f (λt) = λ 0 λt f (λt) . (55) By setting a = −∞, γ = 0 and λ> 0, (52) and (53) could also be simplified as follows

RD α α RD α −∞ t f (λt) = λ −∞ λt f (λt) ; (56) CD α α CD α −∞ t f (λt) = λ −∞ λt f (λt) , (57) respectively. By setting λ = 1, γ = −c and g(t) = f (t − a), the following time shift property appears from (52) and (53) as follows RD α RD α a t g (t) = 0 t−ag (t) ; (58) CD α CD α a t g (t) = 0 t−ag (t) , (59) respectively.

Remark 2. In subsection 5.4 of [15], they focus on the scale transform with the same initial instant a and different variable λt−λa+a. In Lemma 2.3 of [28], the conversionson both t and a are considered, which are equal to formulas (52)-(53). In addition to providing a concise derivation process, the proposed series enriches the property of the scale transform. Several special and practical cases in (54)-(59) could lead to more useful applications.

8 3.5. The effect of the initial instant Let us look into the behaviour of fractional calculus near the initial instant, i.e., t → a+. From formulas (2), (4) and (5), we have

RD α f (a) −α lim a f (t) = lim (t − a) t→a+ t t→a+ Γ(1−α) 0 , α< 0, f (a) , ∞,  (60) =  f (a) , α = 0,   ±∞ , α> 0, α < N and f (a) , 0; 

(n) lim CD α f (t) = lim f (a) (t − a)n−α t→a+ a t t→a+ Γ(n−α+1) (61) (n) = 0, α ∈ (n − 1, n), n ∈ N+ and f (a) , ∞. where f (·) is assumed to be an analytic function in (a, b). Interestingly, the preceding equations show that when f (a) is nonzero, its Riemann–Liouville fractional derivative is singular at the initial instant with α> 0 and α < N, while the Caputo one equals to 0 for finite f (n) (a). This is why the Riemann–Liouville fractional derivative has strong singularity while the Caputo one performs weak singularity. Compared with the existing work in [15, 24], three critical prerequisites were newly provided for (60), namely, f (a) , ∞, α < N and f (a) , 0. The property in (61) was originally proposed. We shift our attention to the behaviour of fractional derivative far from the initial instant, i.e., t − a → +∞. (k) Recalling the relationship in (9), when α ∈ (n − 1, n), n ∈ N and t − a → +∞, n−1 f (a) (t − a)k−α = 0 is valid, + Pk=0 Γ(k+1−α) and therefore lim RD α f (t) = lim CD α f (t) . (62) t−a→+∞ a t t−a→+∞ a t This properly allows us to continue our discussion merely under Riemann–Liouville definition in the sequel. To further study this issue, the expansion at the current time instead of the initial instant is considered. Similarly, (62) becomes (k) RD α f (t) = +∞ α f (t) (t − a)k−α, (63) a t Pk=n k
Γ(k−α+1) as t − a → +∞. The characteristics of Riemann–Liouville fractional derivative with three different cases are discussed in the subsequence.

• Case 1: a is finite, t is sufficiently positive large.

In this case, t ≫|a|. One has −α k−α k−α a k (t − a) = t 1 − t  2 = tk−α 1 − (k − α) a + O a (64)  t t2
 ≈ tk−α − a (k − α) tk−α−1. The relationship α 1 = Γ(α+1) k
Γ(k−α+1) Γ(k+1)Γ(α−k+1)Γ(k−α+1) Γ(α+1) = k!(α−k)Γ(α−k)Γ(k−α+1) Γ(α+1) sin(απ−kπ) (65) = k!(α−k)π Γ(α+1) sin(απ) k = k!(α−k) π (−1) follows from the reflection formula. Substituting (64) and (65) into (63), one obtains

RD α RD α +∞ α f (k)(t) k−α−1 a t f (t) ≈ 0 t f (t) − k=0 k Γ(k−α+1) a (k − α) t P
(k) ≈ RD α f (t) + aΓ(α+1) sin(απ) +∞ (−1)k f (t) tk 0 t πtα+1 Pk=0 k! (66) = RD α + aΓ(α+1) sin(απ) 0 t f (t) πtα+1 f (0) RD α ≈ 0 t f (t) , 9 which indicates that the impact of the initial instant at the dynamic process f (t) vanishes as t → +∞. Hence, for large t the fractional derivative with the initial instant t = a can be replaced by, for instance, the counterpart with the initial instant t = 0. It is noted that case 1 is similar to the result given in [15, 24], while for the sake of completeness of this work, we make a discussion from a different viewpoint.

• Case 2: a is sufficiently negative large, t is finite.

In this case, −a ≫|t| and one has

− k−α k−α t k α (t − a) = (−a) 1 − a  = (−a)k−α 1 − (k − α) t + O t2 (67)  a a2
 ≈ (−a)k−α + t (k − α)(−a)k−α−1. Therefore, in a similar way, formula (67) becomes

RD α RD α +∞ α f (k)(t) k−α−1 a t f (t) ≈ t+a t f (t) − k=0 k Γ(k−α+1) t (k − α)(−a) P
(k) ≈ RD α f (t) − tΓ(α+1) sin(απ) +∞ f (t) ak t+a t π(−a)α+1 Pk=0 k! (68) = RD α f (t) − tΓ(α+1) sin(απ) f (t + a) t+a t π(−a)α+1 RD α ≈ t+a t f (t) . It can be concluded that, under certain conditions on f (t) with large negative value of a, the fractional derivative with RD α RD α a fixed initial instant a t f (t) can be replaced by the one with a moving initial instant t+a t f (t), whose memory RD α RD α length is fixed rather than being increasing with time. Notably, although a similar result a t f (t) ≈ t−a t f (t) was proposed in [24], it is somewhat incomplete. Accordingly, the discussion in case 2 was given.

• Case 3: a is sufficiently negative large, t is sufficiently positive large.

a a If lim t < 1, the situation is similar to case 1 ( t = 0) with a→−∞,t→+∞ RD α RD α a t f (t) ≈ 0 t f (t) . (69) a a If lim t > 1, the situation is similar to case 2 ( t =+∞) with a→−∞,t→+∞ RD α RD α a t f (t) ≈ t+a t f (t) . (70) Take into account the transitional case, i.e., lim a = 1, which can also be distinctly written as t + a = 0, one has a→−∞ t t→+∞ RD α RD α RD α a t f (t) ≈ t+a t f (t) = 0 t f (t) . (71) Note that case 3 is completely new. In fact, all the conclusions in the above three cases can be reached if the series in (3) is adopted instead of (63).

3.6. Derivative computation The provided series representation could contribute to fractional derivative calculation in two ways, that is to say, analytical computation and numerical approximation.

• Application 1: analytical computation

As an example, the Heaviside function H (t − a) occurring at t = a is selected. In view of the convergence domain of infinite series, it is established that

RD α +∞ H(k)(max{a,0}−a) k−α 0 t H (t − a) = k=0 Γ(k−α+1) (t − max{a, 0}) P −α (t−a) (72)  Γ(1−α) , a > 0, = −α  t Γ(1−α) , a ≤ 0.  10 After applying (5), the derivative of the exponential function appears

RD α λt +∞ λkeλa k−α a t e = k=0 Γ(k−α+1) (t − a) P −α (73) = (t − a) E1,1−α (λt − λa) ,

k where E (z) = +∞ z is the Mittag–Leffler function. For n ∈ N and n − 1 <α< n, with the adoption of (5), x,y Pk=0 Γ(kx+y) + one has CD α λt n−α a t e = (t − a) E1,1+n−α (λt − λa) . (74) Moreover, such a derivative can be also expressed as

RD α t +∞ ea k−α a t e = k=0 Γ(k−α+1) (t − a) P k = et(t − a)−αea−t +∞ (t−a) (75) Pk=0 Γ(k−α+1) = etg∗ (−α, t − a) ,

k where g∗ (c, x) = xce−x +∞ x is the auxiliary incomplete Gamma function [29]. By exploring the asymptotic Pk=0 Γ(k+c+1) behavior with a bounded constant |c|, i.e., lim g∗ (c, x) = 1, one has x→+∞

lim RD αet = et. (76) t−a→+∞ a t Revisiting the scale transform in (54), one has that

RD α λt α λt 0 t e = λ e (77) holds for sufficiently large t and λ ∈ C. It follows from the property in (56) that RD α λt α λt −∞ t e = λ e , (78) with λ> 0. A straight calculation on (77) yields

RD α (iλ)αei(λt+ϕ)−(−iλ)αe−i(λt+ϕ) 0 t sin (λt + ϕ) = 2i + + απ − + + απ α ei(λt ϕ 2 )−e i(λt ϕ 2 ) (79) = λ 2i α απ = λ sin λt + ϕ + 2  . Likewise, (78) leads to RD α α απ −∞ t sin (λt + ϕ) = λ sin λt + ϕ + 2  , (80) which coincides with the result on page 311 of [24]. It should point out that the developed series representation is helpful to calculating the fractional derivative of a given function. Compared with the existing results, more specific conditions are provided to deduce the related results.

• Application 2: numerical approximation

Unlike Application 1, it is generally difficult to access the analytic solution. At this point, it becomes reasonable and practical to consider numerical approximation, that is to say, only limited items will be reserved and the long tail is truncated. Similar to the method in [30], the following formulas follow from (2), (5), (3) and (7) immediately

(k) CD α f (t) ≈ N f (a) (t − a)k−α, (81) a t Pk=n Γ(k−α+1)

(k) RD α f (t) ≈ N f (a) (t − a)k−α, (82) a t Pk=0 Γ(k−α+1) (k) CD α f (t) ≈ N α−n f (t) (t − a)k−α, (83) a t Pk=n k−n
Γ(k−α+1) 11 (k) RD α f (t) ≈ N α f (t) (t − a)k−α, (84) a t Pk=0 k
Γ(k−α+1) where n − 1 <α< n, n ∈ N+ and N ∈ N+. To provide an intuitive analysis for the radius of convergence, we use (2) as an example. Suppose that the Taylor series expansion of f (t), i.e., (k) f (t) = +∞ f (a) (t − a)k (85) Pk=0 Γ(k+1) is convergent for |x − a| < R and (2) is convergent for x ∈ (a, a + Rˆ). Then,

ˆ f (k)(a) Γ(k−α+2) R = lim Γ( −α+ ) (k+1) k→+∞ k 1 f (a) (k−α+1) f (k)(a) = lim (k+1) k→+∞ f (a) (k+1) f (k)(a) (86) = lim (k+1) k→+∞ f (a) f (k)(a) Γ(k+ 2) = lim Γ( + ) (k+1) k→+∞ k 1 f (a) = R, which means that the series (2) shares the same convergence radius with the series in (85). The convergence of (85) implies that, for any given constant ǫ > 0, there exists an integer N = N(ǫ), such that

(k) +∞ f (a) (t − a)k < ǫ. (87) Pk=N+1 Γ(k+1)

Consequently, the truncation error of (81) satisfies

+∞ f (k)(a) k−α RD α +∞ f (k)(a) k k=N+1 Γ(k−α+1) (t − a) = a t k=N+1 Γ(k+1) (t − a) P P (k) ≤ RI −α +∞ f (a) (t − a) k a t Pk=N+1 Γ(k+1) (88) ǫ t − −α−1 < Γ(−α) Ra (t τ) dτ ǫ(t−a)−α = |Γ(1−α)| . Analogously, for any ǫ > 0, there exists an integer N = N(ǫ), such that

(k) +∞ f (t) (τ − t)k < ǫ. (89) Pk=N+1 Γ(k+1)

Correspondingly, the truncation error of (83) satisfies

(k) t (k) +∞ α f (t) (t − a)k−α = 1 +∞ (−1)k f (t) (t − τ)k−α−1dτ Pk=N+1 k
Γ(k−α+1) Γ(−α) Ra Pk=N+1 Γ(k+1) t (k) ≤ 1 (t − τ)−α−1 +∞ f (t) (t − τ)k d τ Γ(−α) Ra Pk=N+1 Γ(k+1) (90) ǫ t − −α−1 < Γ(−α) Ra (t τ) dτ ǫ(t−a)−α = |Γ(1−α)| . Note that the proposed formulas in (81)-(84) can be also be regarded as the approximation of (2), (5), (3) and (7) respectively. intuitively, the larger N, the smaller the approximation error.

3.7. Variable order case The previous discussions focus on fractional integral or derivative with constant order. To meet the strong demand in practical applications, this subsection investigates the variable order case. Definition 4. The α (t)-th Riemann–Liouville fractional integral of a function f (t) is defined as

RI α(t) , 1 t − α(t)−1 a t f (t) Γ(α(t)) Ra (t τ) f (τ)dτ, (91) where α (t) > 0 is the integral order and a is the initial instant.

12 Considering α (t) > 0 and ν> −1, then one has

RI α(t) − ν = 1 t − α(t)−1 − ν a t (t a) Γ(α(t)) Ra (t τ) (τ a) dτ 1 = 1 (t − a)α(t)−1( − u)α(t)−1(t − a)νuν (t − a) u Γ(α(t)) R0 1 d α(t)+ν 1 = (t−a) uν( − u)α(t)−1 u (92) Γ(α(t)) R0 1 d (t−a)α(t)+ν = Γ(α(t)) B (ν + 1, α (t)) Γ(ν+1) ν+α(t) = Γ(ν+α(t)+1) (t − a) ,

Γ(p)Γ(q) where τ = u (t − a) + a and B (p, q) = Γ(p+q) , p, q > 0 are adopted here. If f (t) can be expressed as a Taylor series expanded at t = a, then its α (t)-th Riemann–Liouville integral can be rewritten as (k) RI α(t) f (t) = RI α(t) +∞ f (a) (t − a)k a t a t Pk=0 k! +∞ f (k)(a) RI α(t) k = k=0 k! a t (t − a) (93) P (k) = +∞ f (a) (t − a)k+α(t), Pk=0 Γ(k+α(t)+1) where α (t) > 0. If f (τ) can be expressed as a Taylor series expanded at τ = t, then another useful representation can be derived as

RI α(t) = 1 t − α(t)−1 a t f (t) Γ(α(t)) Ra (t τ) f (τ) dτ t (k) = 1 +∞ (−1)k f (t) (t − τ)k+α(t)−1dτ Γ(α(t)) Ra Pk=0 Γ(k+1) (k) t = +∞ (−1)k f (t) (t − τ)k+α(t)−1dτ (94) Pk=0 Γ(α(t))Γ(k+1) Ra +∞ k f (k)(t) k+α(t) = k=0 (−1) Γ(α(t))Γ(k+1)(k+α(t)) (t − a) P (k) = +∞ −α(t) f (t) (t − a)k+α(t). Pk=0 k
Γ(k+α(t)+1) Similarly, with the help of such a fractional integral in (91), the corresponding fractional derivatives could be established, respectively. Let n (t) ∈ N+ and n (t) − 1 < α (t) < n (t) for any t ≥ a. RD α(t) , Definition 5. The α (t)-th Riemann–Liouville fractional derivative of a function f (t) is defined as a t f (t) dn(t) RI n(t)−α(t) dtn(t) a t f (t). CD α(t) , RI n(t)−α(t) dn(t) Definition 6. The α (t)-th Caputo fractional derivative of a function f (t) is definedas a t f (t) a t dtn(t) f (t). Notably, though the introduction of the time varying order extends the application of fractional calculus, many difficulties appear simultaneously. The Laplace transform of variable order fractional integrals/derivatives in Definitions 4-6 is not concise. Moreover, it is difficult or even impossible to derive the equivalent form in series. When n (t), n (t)−α (t) arenot differentiableor even not continuous, extra assumptions should be provided. Assume that α (t) is finite and piecewise constant, more specially, α (t) = αi, and n (t) = ni hold t ∈ [ti−1, ti), where t0 = a, t = tm. Then, for any t ∈ [ti−1, ti), one has

n(t) (k) RD α(t) f (t) = d +∞ f (a) (t − a)k+n(t)−α(t) a t dtn(t) Pk=0 Γ(k+n(t)−α(t)+1) n (k) d i +∞ f (a) k+ni−αi = n (t − a) (95) dt i k=0 Γ(k+ni−αi+1) P (k) = +∞ f (a) (t − a)k−αi . Pk=0 Γ(k−αi+1) Considering the whole interval [a, t], it follows

(k) RD α(t) f (t) = +∞ f (a) (t − a)k−α(t). (96) a t Pk=0 Γ(k−α(t)+1) Likewise, it follows

n(t) (k) RD α(t) f (t) = d +∞ α(t)−n(t) f (t) (t − a)k+n(t)−α(t) a t dtn(t) Pk=0 k
Γ(k+n(t)−α(t)+1) n (k) d i +∞ αi−ni f (t) k+ni−αi = n (t − a) (97) dt i k=0 k Γ(k+ni−αi+1) P (k)
= +∞ αi f (t) (t − a)k−αi , Pk=0 k
Γ(k−αi+1) 13 for t ∈ [ti−1, ti) and (k) RD α(t) f (t) = +∞ α(t) f (t) (t − a)k−α(t), (98) a t Pk=0 k
Γ(k−α(t)+1) for t ∈ [a, t]. In the case that n − 1 < α (t) < n, n ∈ N+, the α (t)-th Caputo fractional derivative of f (t) can be calculated from Definition 6 as CD α(t) RI n−α(t) dn a t f (t) = a t dtn f (t) +∞ f (n+k)(a) k+n−α(t) = k=0 Γ(k+n−α(t)+1) (t − a) (99) P (k) = +∞ f (a) (t − a)k−α(t). Pk=n Γ(k−α(t)+1) Additionally, one has CD α(t) = 1 t − n−α(t)−1 (n) a t f (t) Γ(n−α(t)) Ra (t τ) f (τ) dτ (k+n) = 1 t +∞ − k f (t) − n+k−α(t)−1 Γ(n−α(t)) Ra k=0 ( 1) Γ(k+1) (t τ) dτ P (k+n) = 1 +∞ − k t f (t) − n+k−α(t)−1 Γ(n−α(t)) k=0 ( 1) Ra Γ(k+1) (t τ) dτ P (k+n) n+k−α(t) (100) = 1 +∞ (−1)k f (t) (t−a) Γ(n−α(t)) Pk=0 Γ(k+1) n+k−α(t) +∞ (−1)k f (k)(t) k−α(t) = k=n Γ(n−α(t))Γ(k−n−1)(k−α(t)) (t − a) P (k) = +∞ α(t)−n f (t) (t − a)k−α(t). Pk=n k−n
Γ(k−α(t)+1) Remark 3. It should be noted that the variable order case is more complicated than the constant order case. To obtain concise results, some assumptions are made. Actually, more related work is expected to be done on this aspect. Additionally, the elaborated left-handed observations and discussions could adapt to the right-handed case, RI α RD α CD α RI α(t) RD α(t) CD α(t) i.e., t b f (t), t b f (t), t b f (t), t b f (t), t b f (t) and t b f (t). In pursuit of the clarity and brevity, the related context is not provided here. Remark 4. Before ending the main results, the main contributions are summarized as follows. i) Two kinds of Taylor series like representations are proposed for Caputo fractional derivative. ii) Two kinds of Taylor series like representations are summarized for Riemann–Liouville fractional integrals/derivatives. iii) Two kinds of Taylor formula like representations are presented for fractional integrals/derivatives. iv) Some interesting properties are confirmed or newly deduced with the help of the developed representations. v) Taylor series like representations are extended from the constant order case to the variable order case. vi) New numerical approximation algorithms for fractional derivative computing are introduced carefully.

4. Simulation Study

Example 1. Suppose that f (t) is a non-constant periodic function with a period T, i.e.,

f (t) = f (t + T) (101) for all t ≥ a. It follows from (3) that

(k) CD α f (t + T) = +∞ α−n f (t+T) (t + T − a)k−α a t+T Pk=n k−n
Γ(k−α+1) +∞ α−n f (k)(t) k−α = k=n k−n Γ(k−α+1) (t + T − a) P
(k) (102) , +∞ α−n f (t) (t − a)k−α Pk=n k−n
Γ(k−α+1) CD α = a t f (t) ,

N CD α which indicates that for any α ∈ (n − 1, n), n ∈ +, a t f (t) is not a periodic function anymore (see [31]). We here provide a way to construct a periodic fractional derivative for f (t). Let t − a → +∞, one has

2 (t + T − a)k−α = (t − a)k−α 1 + (k − α) T + O T  t−a (t−a)2
 (103) ≈ (t − a)k−α + (k − α) T(t − a)k−1−α,

14 which leads to CD α CD α T +∞ α−n (k−α) f (k)(t) k−α a t+T f (t + T) ≈ a t f (t) + t−a k=n+1 k−n Γ(k−α+1) (t − a) P
(k+n) = CD α f (t) − TΓ(α−n+1) sin(απ) +∞ f (t) (a − t)k a t π(t−a)α+1−n Pk=1 k! (104) = CD α f (t) − TΓ(α+1) sin(απ) [ f (n) (a) − f (n) (t)] a t π(t−a)α+1−n CD α ≈ a t f (t) . CD α It is ready to conclude that with the mentioned hypothesis, i.e., t − a → +∞, a t f (t) is a periodic function with the same period T, which confirms (79) and (80). To eliminate the effect caused by the remote historical data, fixed memory length is considered, hence CD α CD α t+T−L t+T f (t + T) = t−L t f (t) (105) holds for all t > L + a. Example 2. Consider a fractional order nonlinear system described by CD α a t x (t) = f (x (t)) , (106) where x(t) ∈ R, α ∈ (0, 1) and f (·) is continuous. It has been shown in [32] that the equilibrium of system (106) can never be finite-time stable. We here provide a different way to obtain this conclusion, by using the series representations developed in this paper. By reduction to absurdity, suppose that there exists a finite instant T > a, such that x(t) = 0, ∀t ≥ T. Then one can calculate that RI α x (t) = a t f (x (t)) + x (a) (k) = +∞ f (x(a))x˙(a) (t − a)k+α + x (a) (107) Pk=0 Γ(k+α+1) = 0.

Eliminating the nonzero common factor, one arrives at

(k) +∞ f (x(a)) (t − a)k+α = − x(a) . (108) Pk=0 Γ(k+α+1) x˙(a) N f (k)(x(a)) x(a) Select tk > T − a incrementally with the increase of k ∈ + and define zk = Γ(k+1+α) , c = − x˙(a) . An infinite- dimensional equation 1 tα ··· tα+k−1 ··· z c  1 1   1    1 tα ··· tα+k−1 ··· z c  2 2   2     . . . . .   .   .   ......   .  =  .  (109)        1 tα ··· tα+k−1 ···   z   c   k k   k     . . . .   .   .   . . ··· . ..   .   .   . . .   .   .  follows. Observe that the coefficient matrix A in (109) is a Vandermonde like matrix with full rank. As a result, (109) has a unique solution. Since the right hand of (109) is constant and A is time varying, the solution of (109) must be time varying, which leads to a contradiction regarding the fact that zk is time invariant. This conclusion coincides with Theorem 7 in [32]. Example 3. To evaluate the approximationprovided so far, the exponentialfunction e2t is considered as a test function. After computing the analytic solution via (73) with α = 0.5 and a = 0, the comparison results are illustrated in Fig. 1 and Fig. 2, where E is introduced for quantitative analysis defined as the norm of approximation error and the sampling period is 0.001 second. The two figures show that i) both (82) and (84) are effective approximations of Riemann–Liouville fractional derivative; ii) a larger N leads to a smaller approximation error; and iii) compared with (82), (84) performs better with the same N. Next, we will check the approximation performance on Caputo fractional derivative. With the relationship in (9), (81) is implied in (82) and Fig. 1. Consequently, only (83) is studied with the related results shown in Fig. 3. It can be 15 observed that such an approximation gives a satisfied degree of accuracy to that of (82), while it is slightly poorer than using (84). Another interesting point should be emphasized is that the Caputo fractional derivative of e2t is monotonic RD 0.5 2t 2k k−0.5 while the Riemann–Liouville one is not. The reason is that 0 t e includes the decreasing component Γ(k+0.5) t 2k k−0.5 with k < n and the increasing component Γ(k+0.5) t with k > n simultaneously.

5. Conclusions

In this paper, two kinds of infinite series composed of integer derivatives and power functions have been investigated for fractional derivative and fractional integral systematically. With the series representation established, several essential properties are established, such as singularity, additivity and differentiability, etc. Besides, theoretical results are vividly validated by numerical examples. It is anticipated that the elaborated results would enrich the understanding and utilizing of fractional calculus. The following interesting and promising topics should be investigated in the foreseeable future. i) Apply the truncated series for numerical computation of fractional differential equations. ii) Extend the results to the fractional integrals/derivatives of a function with distributed order. iii) Study the series representation of fractional derivatives for functions that are not analytic.

Acknowledgements

The authors would like to thank the Associate Editor and the anonymous reviewers for their keen and insightful comments which greatly improved the contents and the presentation of this paper. The work in this paper was supported by the National Natural Science Foundation of China (61601431, 61573332), the Anhui Provincial Natural Science Foundation (1708085QF141) and the fund of China Scholarship Council (201806345002).

References

References

[1] T. J. Osler, Taylor’s series generalized for fractional derivatives and applications, SIAM Journal on Mathematical Analysis 2 (1971) 37–48. [2] Y. Q. Chen, Q. Gao, Y. H. Wei, Y. Wang, Study on fractional order gradient methods, Applied Mathematics and Computation 314 (2017) 310–321. [3] I. Jaradat, M. Al-Dolat, K. Al-Zoubi, M. Alquran, Theory and applications of a more general form for fractional power series expansion, Chaos, Solitons & Fractals 108 (2018) 107–110. [4] A. Fernandez, D. Baleanu, H. M. Srivastava, Series representations for fractional-calculus operators involving generalised Mittag-Leffler functions, Communications in Nonlinear Science and Numerical Simulation 67 (2019) 517–527. [5] B. Riemann, The Collected Works of Bernhard Riemann, Dover, 1953. [6] G. Hardy, Riemann’s form of Taylor’s series, Journal of the London Mathematical Society 1 (1945) 48–57. [7] J. J. Trujillo, M. Rivero, B. Bonilla, On a Riemann–Liouville generalized Taylor’s formula, Journal of Mathematical Analysis and Applications 231 (1999) 255–265. [8] Z. M. Odibat, N. T. Shawagfeh, Generalized Taylor’s formula, Applied Mathematics and Computation 186 (2007) 286–293. [9] Z. Odibat, S. Momani, V. S. Erturk, Generalized differential transform method: application to differential equations of fractional order, Applied Mathematics and Computation 197 (2008) 467–477. [10] R. Tremblay, S. Gaboury, B. J. Fugere, Taylor-like expansion in terms of a rational function obtained by means of fractional derivatives, Integral Transforms and Special Functions 24 (2013) 50–64. [11] V. S. Krishnasamy, S. Mashayekhi, M. Razzaghi, Numerical solutions of fractional differential equations by using fractional Taylor basis, IEEE/CAA Journal of Automatica Sinica 4 (2017) 98–106. [12] M. Benjemaa, Taylor’s formula involving generalized fractional derivatives, Applied Mathematics and Computation 335 (2018) 182–195. [13] A. Fernandez, D. Baleanu, The mean value theorem and Taylor’s theorem for fractional derivatives with Mittag–Leffler kernel, Advances in Difference Equations (2018). Doi: 10.1186/s13662-018-1543-9. [14] J. F. Cheng, On multivariate fractional Taylor’s and Cauchy mean value theorem, Journal of Mathematical Study 52 (2019) 38–52. [15] K. Oldham, J. Spanier, The Fractional Calculus Theory and Applications of Differentiation and Integration to Arbitrary Order, Academic Press, San Diego, 1974. [16] S. G. Samko, A. A. Kilbas, O. I. Marichev, Fractional Integrals and Derivatives: Theory and Applications, 1993. [17] Y. H. Wei, Y. Q. Chen, S. S. Cheng, Y. Wang, A note on short memory principle of fractional calculus, Fractional Calculus and Applied Analysis 20 (2017) 1382–1404. [18] Y. H. Wei, Q. Gao, D. Y. Liu, Y. Wang, On the series representation of nabla discrete fractional calculus, Communications in Nonlinear Science and Numerical Simulation 69 (2019) 198–218. 16 [19] Y. H. Wei, T. Y. Liu, P. W. Tse, Y. Wang, Analytical and numerical representations for discrete Gr¨unwald–Letnikov fractional calculus, arXiv preprint arXiv:1901.09211 (2019). [20] A. Gladkina, G. Shchedrin, U. A. Khawaja, L. D. Carr, Expansion of fractional derivatives in terms of an integer derivative series: physical and numerical applications, arXiv (2018). Preprint arXiv:1710.06297. [21] J. Sousa, E. C. de Oliveira, Leibniz type rule: Ψ−Hilfer fractional derivative, arXiv (2018). Preprint arXiv:1811.02717. [22] G. Shchedrin, N. Smith, A. Gladkina, L. D. Carr, Fractional derivative of composite functions: exact results and physical applications, arXiv (2018). Preprint arXiv:1803.05018. [23] H. G. Sun, X. X. Hao, Y. Zhang, D. Baleanu, Relaxation and diffusion models with non-singular kernels, Physica A: Statistical Mechanics and its Applications 468 (2017) 590–596. [24] I. Podlubny, Fractional Differential Equations: an Introduction to Fractional Derivatives, Fractional Differential Equations, to Methods of Their Solution and Some of Their Applications, Academic Press, San Diego, 1999. [25] C. P. Li, W. H. Deng, Remarks on fractional derivatives, Applied Mathematics and Computation 187 (2007) 777–784. [26] L. Bai, D. Y. Xue, Universal block diagram based modeling and simulation schemes for fractional-order control systems, ISA Transactions 82 (2018) 153–162. [27] J. Munkhammar, Riemann-Liouville fractional derivatives and the Taylor-Riemann series, Technical Report, Uppsala University, 2004. [28] B. P. Duan, Z. S. Zheng, W. Cao, Spectral approximation methods and error estimates for caputo fractional derivative with applications to initial-value problems, Journal of Computational Physics 319 (2016) 108–128. [29] W. Gautschi, A computational procedure for incomplete gamma functions, ACM Transactions on Mathematical Software 5 (1979) 466–481. [30] T. Atanackovic, B. Stankovic, An expansion formula for fractional derivatives and its application, Fractional Calculus and Applied Analysis 7 (2004) 365–378. [31] M. S. Tavazoei, A note on fractional-order derivatives of periodic functions, Automatica 46 (2010) 945–948. [32] J. Shen, J. Lam, Non-existence of finite-time stable equilibria in fractional-order nonlinear systems, Automatica 50 (2014) 547–551.

17