<<

Mathematical (You Should Know)

Mathematical series representations are very useful tools for describing images or for solving/approximating the solutions to imaging problems. The may be used to “expand” a into terms that are individual monomial expressions (i.e., “powers”) of the coordinate

Geometric Series

Adjacent terms in a exhibit a constant , e.g., if the scale factor for adjacent terms in the series is t, the series has the form: ∞ 1+t + t2 + t3 + ···= tn n=0

If |t| < 1, this solution converges to a simple (and EASILY remembered) expression:

∞ tn 1 |t| < = − t if 1 n=0 1

This series pops up frequently in science and it is useful to remember the solution. We may “turn the problem around” by using a truncated series as an approximation for the ratio: ∞ N 1 tn ∼ tn − t = = 1 n=0 n=0 where N is some maximum power in the series

Examples:

1.

−1 1 1 0 1 2 3 (0.9) = = =(0.1) +(0.1) +(0.1) +(0.1) + ··· 0.9 1 − 0.1 −1 =1+0.1+0.01 + 0.001 + ···=1.11111 ···≡(0.9)

This particular series converges fairly quickly and because of the small value of t =0.1;thisseriesmay be truncated after a few terms and still obtain a fairly accurate value.

2. 1 =4 0.25 1 0 1 2 3 4 5 = =(0.75) +(0.75) +(0.75) +(0.75) +(0.75) +(0.75) + ··· 1 − 0.75 =(1+0.75 + 0.5625 + 0.421875 + 0.31640635) + ··· =3.05078125 + ···< 4

Note that this series converges slowly because t =0.25 is relatively “large;” the sum of a few terms is a poor approximation to the end result.

1 Finite Geometric Series

The truncated geometric series also may be rewritten into a simple expression. Consider the finite series that inclues N +1terms:

N tn =1+t + t2 + t3 + ···+ tN n=0 ∞ ∞ = tn − tn n=0 n=N+1 We may write this as the difference of two infinite geometric series: N     tn = 1+t + t2 + t3 + ···+ tN + tN+1 + ··· − tN+1 + tN+2 + ··· n=0 ∞ ∞ = tn − tn n=0 n=N+1 Now change the for the second infinite series from n to u ≡ n − (N +1) =⇒ n = u + N +1: ∞ ∞ ∞ ∞ tn tu+(N+1) tu · tN+1 tN+1 · tu tN+1 · 1 = = = = − t n=N+1 u=0 u=0 u=0 1 The expressions for the two series may now be combined: N ∞ ∞ tn = tn − tn n=0 n=0 n=N 1 1 = − tN+1 · 1 − t 1 − t N − tN+1 tn 1 |t| < = − t if 1 n=0 1

This is also often shown in the form where the maximum power in the series is N − 1 so that there are N terms: N−1 − tN tn 1 |t| < = − t if 1 n=0 1

Examples:

1. 4 n (0.1) =1+0.1+0.01 + 0.001 + 0.0001 = 1.1111 n=0 5 1 − tN+1 1 − (0.1) t =0.1,N =4 =⇒ = =1.1111 1 − t 1 − (0.1) 2. 3 n (0.75) =2.7344 n=0 4 1 − tN+1 1 − (0.75) = =2.7344 1 − t 1 − (0.75)

2 Binomial Expansion:

n 1 n n (n − 1) n (n − 1) (n − 2) n! (1 + x) = + x + x2 + x3 + ···+ xr + ··· 0! 1! 2! 3! (n − r)!r! n (n − 1) n (n − 1) (n − 2) =1+nx + x2 + x3 + ··· 2 6 The definition of the “binomial coefficient” is often substituted to make the expression more concise:   n n ≡ ! r (n − r)! · r!

          n n n n n n (1 + x) = + x + x2 + x3 + ···+ xn−rxr + ··· 0 1 2 3 r   ∞ n x n · xn−r · xr = (1 + ) = r r=0

If n is a positive , the series includes n +1 terms. If n is NOT a positive integer, the series converges if |x| < 1. If n>0, the series also converges if |x| =1.

n n (n − 1) 2 n (n − 1) (n − 2) 3 =⇒ (1 − x) =1+n (−x)+ (−x) + (−x) + ··· 2 6 n (n − 1) n (n − 1) (n − 2) =1− nx + x2 − x3 + ··· 2! 3! Again, the series may be truncated to approximate the result. In many of science, the series is often truncated after the second term, so the summation only includes the constant and the linear term (e.g., Fresnel approximation to optical diffraction) so that: n ∼ (1 ± x) = 1 ± nx if |x|  0

Examples:

1.

1 −1 (−1) (−2) (−1) (−2) (−3) =(1− x) =1− (−1) x + x2 − x3 + ··· 1 − x 2! 3! 2! − (3!) =1+x + x2 − x3 + ··· 2! 3! =1+x + x2 + x3 + ···

which demonstrates that the geometric series may be written as a binomial expansion. 2. Square root         1 1 1 1 3 1 1 − 2 − − 2 (1 + x) 2 = (1 + x)=1+ · x + 2 2 · x + 2 2 2 · x + ··· 2 2 6 1 1 1 =1+ · x − · x2 + · x3 + ··· 2 8 16 In words, this expresses the square root of 1+x as a series of the powers of x with decreasing weights. Truncation to two terms yields an approximation for the square root that is most accurate for |x|  0.

1 ∼ 1 1 2 ∼ 1 (1 + x) 2 = 1+ · x − · x = 1+ · x 2 8 2

3 17 1 =1.0625 = 1 + 16 16 17 =1.030776406 ··· 16   1 ∼ 1 1 33 first-order approximation: 1+ = 1+ · = =1.03125 16 2 16 32

   2 1 ∼ 1 1 1 1 2111 second-order approximation: 1+ = 1+ · − = =1.030761719 ··· 16 2 16 8 16 2048

3. root         1 2 1 2 5 1 1 − 2 − − 3 (1 − x) 3 = 3 (1 − x)=1+ · (−x)+ 3 3 · (−x) + 3 3 3 · (−x) + ··· 3 2 6 1 1 5 =1− · x − · x2 + · x3 + ··· 3 9 81 ∼ 1 1 2 ∼ 1 = 1+ · x − · x = 1+ · x 3 9 3

15 1 =1− 16 16   1 15 3 =0.97871691 ··· 16   1   1 3 ∼ 1 1 47 1 − = 1+ · − = =0.979166666 ··· 16 3 16 48   1    2 1 3 ∼ 1 1 1 1 2257 1 − = 1+ · − + · = =0.979600694 ··· 16 3 16 9 16 2304   1    2  3 1 3 ∼ 1 1 1 1 5 1 325 003 1 − = 1+ · − + · − + · − = =0.979585624 ··· 16 3 16 9 16 81 16 331 776

4 Exponential Series

Without proof, we state that we write e raised to a numerical power u as a series in the powers of u:

∞ un u eu exp [ ]= = n n=0 ! 1 u u2 u3 = + + + + ··· 0! 1! 2! 3! 1 1 =1+u + u2 + u3 + ··· 2 6 which may be easily generalized to any base: ∞ u · a n au u · a [ log [ ]] =exp[ log [ ]] = n n=0 ! Forexample,wecanwriteanypowerof10inthisform: ∞ n u [u · log [10]] 10 = n n=0 ! ∞ n ∼ (log [10]) · un = n n=0 ! ∼ where log [10] = 2.302585

Complex Exponential Series

The generalization of the exponential series for complex-valued powers:

∞ ±iθ n ±iθ ±iθ ( ) exp [ ]=exp[ ]= n n=0 ! 2 3 4 1 (iθ) (iθ) (iθ) (iθ) = ± + ∓ + ±··· 0! 1! 2! 3! 4! 1 2 1 3 1 4 1 5 =1± iθ + i2θ ∓ i3θ + i4θ ± i5θ + ···  2 6  24 120  θ2 θ4 θ3 θ5 = 1 − + −··· ± i · θ − + −··· 2 24 6 120 From Euler relation: exp [+iθ]=cos[θ]+i sin [θ] Equate real and imaginary parts: 2 4 2 4 1 θ θ θ θ cos [θ]= − + −···=1− + −··· 0! 2! 4! 2 24 lim cos [θ]=1 θ→0 θ3 θ5 θ3 θ5 sin [θ]=θ − + −···= θ − + −··· 3! 5! 6 120 lim sin [θ]=θ θ→0 The of the complex exponential is often used in diffraction theory: ∼ exp [+iθ] = 1+i · θ

5 Maclaurin Series:

“Predict” the value of the function f [x] based on its value and its evaluated at the origin of coordinates (x =0):

0 1 2 2 3 3 x x df x d f x d f f [x]= · f [0] + · + · + · + ··· 0! 1! dx 2! dx2 3! dx2  x=0 x=0 x=0 ∞ xn dnf · = n dxn n=0 ! x=0   x2 x3 ∞ xn f x · f  · f  · f  ··· · f (n) = [0] + [0] + [0] + [0] + = n [0] 2 6 n=0 ! where the “exponential” notation for differentiation has been used:

dn {f x } ≡ f (n) n [ ] [0] dx x=0

Taylor Series:

Generalization of the Maclaurin series to “predict” value of f [x + x0] based on the value of the function and its derivatives evaluated at x0:

0 1 2 2 3 3 x0 x0 df x0 d f x0 d f f [x + x0]= · f [x]|x=x + · + · + · + ··· 0! 0 1! dx 2! dx2 3! dx2 x=x0 x=x0 x=x0 x0 x df x2 d2f x3 d3f 0 · f x 0 · 0 · 0 · ··· = [ 0]+ + 2 + 2 + 0! 1! dx x=x 2! dx x=x 3! dx x=x 0 0 0 ∞ xn dnf 0 · = n dxn n=0 ! x=x0   x2 x3 ∞ xn f x x · f  x 0 · f  x 0 · f  x ··· 0 · f (n) x = [ 0]+ 0 [ 0]+ [ 0]+ [ 0]+ = n [ 0] 2 6 n=0 !

[Arfken, §1, Schey, Feynman V1 §2] Could also think of it as evaluating the value of f [x] based on the function and its derivatives evaluated at x − x0

x0 x1 df x2 d2f x3 d3f f x 0 · f x 0 · 0 · 0 · ··· [ ]= [ 0]+ + 2 + 2 + 0! 1! dx x=x−x 2! dx x=x−x 3! dx x=x−x 0 0 0 ∞ xn dnf 0 · = n dxn n=0 ! x=x−x0 2 3  x0  x0  = f [x − x0]+x0 · f [x − x0]+ · f [x − x0]+ · f [x − x0]+···   2 6 ∞ xn 0 · f (n) x − x = n [ 0] n=0 !

Again, it often is useful to truncate the to approximate the value of the function.

6