ASYMPTOTIC METHODS Prof. N. S. Manton
Introduction
In this course, we will be interested in finding so-called asymptotic series, leading to approximations to the values of integrals depending on some parameter, or to the solutions of differential equations. For instance, consider Stirling’s Approximation
nn 2π 1/2 nn n! ∼ (2πn)1/2 as n → ∞ or Γ(n) = (n − 1)! ∼ e n e
We will also be interested in the Stieltjes Integral: let ρ(t) be a well-behaved non-negative function that decays sufficiently fast as t → ∞. Then
Z ∞ ρ(t) Z ∞ dt ∼ ρ(t) dt for small x > 0 0 1 + xt 0
The modified Bessel function of order zero, I0, solves the differential equation
d2y 1 dy + − y = 0 dx2 x dx and has the following expansion with infinite radius of convergence:
∞ X x2n I (x) = ∼ (2πx)−1/2ex as x → ∞ 0 22n(n!)2 n=0
Asymptotic expansions are widely used in applied mathematics and theoretical physics, e.g. when deriving the leading-order contribution to the electrostatic potential corresponding to a charge distribution of limited spatial extent when viewed from far away. In number theory, the prime number theorem states that the n number π(n) of primes at most n satisfies π(n) ∼ log n as n → ∞. In the above examples, the symbol ∼ means that the ratio of the two sides tends to unity in the appropriate limit. If we seek better approximations, we can derive asymptotic series, such as the Stirling series
2π 1/2 nn 1 1 Γ(n) ∼ 1 + + + ··· n e 12n 288n2 where the coefficients are known, but not elementary. The coefficients get smaller for a while, but eventually grow rapidly. The series does not converge for any n. Upon truncating, this series gives a sequence of approximations:
Γ(n) Γ(n) 1 1 − 1 = o(1), − 1 − = o ,... for large n 2π 1/2 nn 2π 1/2 nn 12n n n e n e
For n = 4, these approximations give 3! ≈ 5.877 and 3! ≈ 5.999. For n = 4, the approximation using six terms gives the best answer; with more terms, the error increases, since the series does not converge.
For the Stieltjes integral, we will show that, using the Taylor expansion (1 + xt)−1 = 1 − xt + x2t2 + ··· valid for t < 1/x,
∞ Z ∞ ρ(t) X Z ∞ dt ∼ (−1)nc xn where c = tnρ(t) dt 1 + xt n n 0 n=0 0
Mathematical Tripos Part II Page 1 of 20 Asymptotic Methods — Lent 2012 for small x > 0, provided that ρ(t) → 0 as t → ∞ fast enough for the moments in the series to exist. For the modified Bessel function, it is possible to show that
12 1 1232 1 123252 1 I (x) ∼ (2πx)−1/2ex 1 + + + + ··· 0 1! 8x 2! (8x)2 3! (8x)3
For instance, the five term approximation for x = 20 has an error of about 0.0009%. As before, the series does not converge, since the coefficients increase as n!.
The Rule of Thumb is to sum up the series as far as, but not including the smallest term. This term gives an estimate of the error. The place to stop depends on the value at which one wants to evaluate the series.
Asymptotic series used to be important for precise evaluation of special functions, but, in that area, they have now been superseded. Often, they give insight because they replace some sophisticated mathematical function by elementary functions, such as exponential, trigonometric functions or powers. They play a central role in computation techniques such as shooting methods. The behaviour of these functions can be rich, such as the behaviour of the Airy function shown below, which exhibits both trigonometric oscillations and exponential decay.
0.4
0.2
-20 -10 10 20
-0.2
-0.4
Another feature of asymptotic series that we will discuss in this course is Stokes’ phenomenon. Many classical and special functions, e.g. those satisfying second-order ordinary differential equations, are entire functions on the complex plane, so, unless they are constant, which is kind of duff, they are unbounded. We therefore look for asymptotic series of the form
s1(z) s2(z) f(z) ∼ c1e + c2e as z → ∞
The functions s1, s2 are Liouville–Green Functions, and we will discuss them later on. Interestingly, one finds that these expansions are only valid for a restricted range of the complex argument; the constants c1, c2 have different values in different sectors of this kind. The sector boundaries are called Stokes Lines. In fact, s1, s2 are often rational functions, i.e. not entire, in which case Stokes lines are inevitable. The analytic continuation of the asymptotic approximation fails to be an asymptotic approximation outside the sector.
Asymptotic Series
A real-valued function f(x) has an asymptotic series or asymptotic expansion around x0, written
∞ X n f(x) ∼ an(x − x0) as x → x0 n=0 where the series should be understood as a formal power series, if
N X n N f(x) − an(x − x0) (x − x0) for each N > 0 and for x − x0 small n=0 or, more formally, if N P n f(x) − an(x − x0) n=0 N → 0 as x → x0, for each N > 0. (x − x0)
Mathematical Tripos Part II Page 2 of 20 Asymptotic Methods — Lent 2012 For a truncated asymptotic series, there is just a finite number of inequalities or limits. Note that the definition only involves partial sums: the series itself need not converge. Also, we consider N to be fixed in the limit x → x0; this is the other way round for convergent power series. Similarly, a function f(x) has an asymptotic series about infinity, written
∞ X −n f(x) ∼ anx as x → ∞ n=0 if it holds that N X −n −N f(x) − anx x for all N > 0, as x → ∞. n=0
These definitions extend to complex functions, but it turns out that one needs to be more careful about regions of validity. One often needs to take out a prefactor to be able to use the definition; for instance,
I (x) 1 9 0 ∼ 1 + + + ··· as x → ∞ (2πx)−1/2ex 8x 128x2
This definition involves a function and its expansion. The expansion has little meaning by itself, and the function must be defined in its own right first, by contrast with Taylor series.
Lemma. A function has a most one asymptotic expansion about some given point, or about infinity.
Suppose that a function f(x) has two asymptotic expansions about some point x0, the argument for expan- sions about infinity being analogous, viz
∞ ∞ X n X n f(x) ∼ an(x − x0) and f(x) ∼ bn(x − x0) n=0 n=0
Suppose that, for some m > 0, am 6= bm, but an = bn for 0 6 n < m. Then
m m P n P n f(x) − an(x − x0) f(x) − bn(x − x0) n=0 n=0 m → 0, m → 0 as x → x0. (x − x0) (x − x0)
Upon subtracting these two limits, am − bm → 0, and thus am = bm, a contradiction. Hence the two asymptotic expansions are equal.
Note that there are plenty of functions with no asymptotic series, or with only a finite asymptotic series. For instance, it is easy to see that e−x does not have an asymptotic series around infinity, for all coefficients in the asymptotic expansion vanish. One says that e−x is ‘small beyond all orders’ in inverse powers of x. This also shows that two different functions can have the same asymptotic series: if f(x) has an asymptotic series about infinity, then f(x) + e−x has the same asymptotic series about infinity.
Elementary Properties
Consider two functions f(x) and g(x) with respective asymptotic expansions
∞ ∞ X n X n f(x) ∼ an(x − x0) and g(x) ∼ bn(x − x0) n=0 n=0 about x0. Then f(x) + g(x) and f(x)g(x) both have asymptotic expansions,
∞ ∞ n X n X n X f(x) + g(x) ∼ (an + bn)(x − x0) and f(x)g(x) ∼ cn(x − x0) where cn = akbn−k n=0 n=0 k=0
Mathematical Tripos Part II Page 3 of 20 Asymptotic Methods — Lent 2012 Assume furthermore that f(x) is integrable. Then
Z x ∞ X an f(ξ) dξ ∼ (x − x )n+1 as x → x n + 1 0 0 x0 n=0
Indeed, for any N > 0 and for any ε > 0, there exists η > 0 such that, whenever |x − x0| < ε,
N Z x X Z x η f(ξ) − a (ξ − x )n dξ η |ξ − x |N dξ = |x − x |N+1 n 0 6 0 N + 1 0 x0 n=0 x0
The claim then follows from the observation that
Z x N Z x N ! X an X f(ξ) dξ − (x − x )n+1 = f(ξ) − a (ξ − x )n dξ n + 1 0 n 0 x0 n=0 x0 n=0
Z x N X n 6 f(ξ) − an(ξ − x0) dξ x0 n=0
Asymptotics of Integrals
As an example, we consider the Stieltjes Integral more rigorously. Let ρ(t) be a non-negative function that does not vanish identically, and such that the moments
Z ∞ n cn = t ρ(t) dt exist for all n > 0. 0
We are interested in deriving an asymptotic series for the integral
Z ∞ ρ(t) I(x) = dt where x > 0. 0 1 + xt
Note that there is an exact expansion
1 (−1)N+1xN+1tN+1 = 1 − xt + x2t2 + ··· + (−1)N xN tN + 1 + xt 1 + xt
It follows that N X Z ∞ tN+1ρ(t) I(x) = (−1)nc xn + (−1)N+1xN+1 dt n 1 + xt n=0 0
But 1 + xt > 1 since x > 0, and thus
Z ∞ N+1 −N N+1 N+1 t ρ(t) x (−1) x dt 6 xcN+1 → 0 as x → 0. 0 1 + xt
We have thus derived the asymptotic expansion
∞ Z ∞ ρ(t) X I(x) = dt ∼ (−1)nc xn as x → 0. 1 + xt n 0 n=0
One way to see that this is not a convergent Taylor expansion is to note that the left-hand side is ill-defined for negative x, due to the pole of the integrand at t = −1/x. Alternatively, one can evaluate the moments explicitly for simple examples, such as ρ(t) = e−t.
Integration by Parts Formulae Integration by parts is useful for determining asymptotic expansions of integrals where the end point domi- nates. Let f (n)(t) denote the n-th derivative of a function f(t). (We shall always, in this course, assume that
Mathematical Tripos Part II Page 4 of 20 Asymptotic Methods — Lent 2012 functions are sufficiently smooth.) Integrating by parts n times gives
n Z b X h ib Z b f(t)g(n)(t) dt = (−1)k−1 f (k−1)(t)g(n−k)(t) + (−1)n f (n)(t)g(t) dt a a k=1 a
Example of an Asymptotic Expansion of an Integral Let a < b be fixed, and let f(t) be a smooth function such that f(b) 6= 0. We are interested in obtaining an asymptotic expansion, as x → ∞, for the integral
Z b I(x) = f(t)ext dt a
Observe that the endpoint t = b completely dominates in this integral. Integrating by parts gives
n X h ib (−1)n Z b I(x) = (−1)k−1 f (k−1)(t)extx−k + f (n)(t)ext dt a xn k=1 a " n n !# X (−1)n Z b X = exb (−1)k−1f (k−1)(b)x−k + f (n)(t)ex(t−b) dt − e−x(b−a) (−1)k−1f (k−1)(a)x−k xn k=1 a k=1
Since b − a > 0, the term in e−x(b−a) is small beyond all orders. What is more, ! Z b Z b 1 − e−x(b−a) (n) x(t−b) (n) x(t−b) (n) f (t)e dt 6 max f (t) e dt = max f (t) → 0 as x → ∞. a t∈[a,b] a t∈[a,b] x We thus have, provided that f(b) 6= 0, the asymptotic expansion
" n # Z b X I(x) = f(t)ext dt ∼ exb (−1)k−1f (k−1)(b)x−k as x → ∞. a k=1
Again, this cannot be an exact, or convergent, series, as the result is independent of a. The leading term in this approximation is
Z b Z b exb f(t)ext dt ∼ exbf(b)x−1 which arises from ext dt = a −∞ x More generally, we get any number of terms in this asymptotic series using a Taylor expansion of f(t) around t = b, and integrating from −∞ to b, making an error that is small beyond all orders.
Laplace’s Integral
The ideas of the above example are generalised by the Laplace Integral. Let f(t) be a smooth function with f(b) 6= 0. We are interested in expansions of
Z b I(x) = f(t)exφ(t) dt a
If φ0(t) does not change sign on [a, b], the Laplace integral just reduces to the integral in our above example: assume without loss of generality that φ0(t) > 0 in [a, b]. Change variables to u = φ(t), so that
Z φ(b) f(t) xu −1 I(x) = 0 e du where t = φ (u) φ(a) φ (t)
Having inverted this change of variables (which is pretty straightforward in examples), we obtain an expansion for the integral, which is rather messy in general. The leading-order approximation is
f(b) 1 I(x) ∼ exφ(b) φ0(b) x
Mathematical Tripos Part II Page 5 of 20 Asymptotic Methods — Lent 2012 If φ(t) attains its maximum value in [a, b], at t = b, with φ0(b) > 0 and f(b) 6= 0 as usual, this leading-order approximation is still valid: to leading order, the only relevant contribution to the integral comes from a neighbourhood of t = b. A variant of the simple Laplace integral we have been considering above is the following: suppose that f(t) is defined by a convergent power series in some neighbourhood of t = 0, viz
∞ X n f(t) = ant n=0
(n) Note that f (0) = n!an. Hence, adapting our previous results, for b > 0, we have the asymptotic series Z b ∞ −xt X −(n+1) f(t)e dt ∼ n!anx as n → ∞ 0 n=0
Watson’s Lemma
Before generalising the previous results, we need two preliminaries. First, note that, so far, we have on- ly considered asymptotic expansions with integral powers. Some functions have asymptotic expansions in fractional powers of their argument, of the form
∞ X α+βn f(x) ∼ cnx as x → 0+ n=0 where β > 0. Taking out the prefactor xα, and changing variables to ξ = xβ, we recover the standard definition of an asymptotic series.
Let us now make a few remarks about the Gamma function, which is defined for all complex numbers with Re z > 0 by the integral Z ∞ Γ(z) = tz−1e−t dt 0
Integrating by parts, one obtains Γ(z + 1) = zΓ(z)
Thus, it is possible to analytically continue the Gamma function to a meromorphic function on the entire complex plane, with poles at z = 0, −1, −2,... . 1 √ Clearly, Γ(1) = 1, so Γ(n+1) = n! by induction. Another special value that is sometimes useful is Γ 2 = π; it is obtained by evaluating a Gaussian integral.
Theorem (Watson’s Lemma). Let f(t) be a function such that f(t) is bounded on [t, 1], for any 0 < t < 1, and that f(t) < ect at large t, for some constant c. Let f(t) have the asymptotic series
∞ X α+βn f(t) ∼ cnt as t → 0+ n=0 where α > −1 and β > 0. Then
Z b ∞ −xt X −(α+βn+1) f(t)e dt ∼ Γ(α + βn + 1)cnx as x → ∞ 0 n=0
Observe that the conditions imposed on f(t) are sufficient for the integral to exist. Also notice that the result is independent of b, and that the case α = 0, β = 1 corresponds to our previous result. Fix N > 0, and take ε > 0. Then
Z ε Z b Z b e−xε −xt −xt −xt I(x) ∼ f(t)e dt with an error f(t)e dt 6 C e dt = O 0 ε ε x
Mathematical Tripos Part II Page 6 of 20 Asymptotic Methods — Lent 2012 which is small beyond all orders as x → ∞. Taking ε to be small enough,
Z ε N ! Z ε X α+βn −xt α+β(N+1) −xt I(x) ∼ cnt e dt + O t e dt 0 n=0 0
Watson’s Lemma then follows from the fact that, up to an error that is exponentially small,
Z ε Z εt Z ∞ tα+βne−xt dt = x−(α+βn+1) uα+βne−u du ∼ x−(α+βn+1) g(u) du = Γ(α + βn + 1)x−(α+βn+1) 0 0 | {z } 0 g(u)
5 1 3 Z −1/2 Γ( ) Γ( ) Example. I(x) = t2 + 2t e−xt dt ∼ 2 − 2 . 1/2 3/2 0 (2x) 2(2x)
Laplace’s Integral with Interior Maximum
We now consider the Laplace integral
Z b I(x) = f(t)exφ(t) dt as x → ∞ a where φ(t) has a smooth non-zero quadratic maximum at some c ∈ (a, b), i.e. φ0(c) = 0 and φ00(c) < 0, and where f(c) 6= 0. The integral is dominated by a neighbourhood of c, in which the integral becomes Gaussian 1 00 2 upon writing f(t) ≈ f(c) and φ(t) ≈ φ(c) + 2 φ (c)(t − c) . The leading-order asymptotics are
c+ε c+ε Z h i Z 1 00 2 1 00 2 xφ(c) 2 xφ (c)(t−c) I(x) ∼ f(c) exp x φ(c) + 2 φ (c)(t − c) dt = f(c)e e dt c−ε c−ε