On Vector Sequence Transforms and Acceleration Techniques

Total Page:16

File Type:pdf, Size:1020Kb

On Vector Sequence Transforms and Acceleration Techniques Old Dominion University ODU Digital Commons Mathematics & Statistics Theses & Dissertations Mathematics & Statistics Winter 1989 On Vector Sequence Transforms and Acceleration Techniques Steven L. Hodge Old Dominion University Follow this and additional works at: https://digitalcommons.odu.edu/mathstat_etds Part of the Applied Mathematics Commons, and the Mathematics Commons Recommended Citation Hodge, Steven L.. "On Vector Sequence Transforms and Acceleration Techniques" (1989). Doctor of Philosophy (PhD), Dissertation, Mathematics & Statistics, Old Dominion University, DOI: 10.25777/fnyf- vb61 https://digitalcommons.odu.edu/mathstat_etds/81 This Dissertation is brought to you for free and open access by the Mathematics & Statistics at ODU Digital Commons. It has been accepted for inclusion in Mathematics & Statistics Theses & Dissertations by an authorized administrator of ODU Digital Commons. For more information, please contact [email protected]. ON VECTOR SEQUENCE TRANSFORMS AND ACCELERATION TECHNIQUES by Steven L. Hodge B.S., August 1982, University of South Alabama, Mobile, AL A Dissertation Submitted to the Faculty of Old Dominion University in Partial Fulfilment of the Requirements for the Degree of DOCTOR OF PHILOSOPHY in COMPUTATIONAL AND APPLIED MATHEMATICS December, 1989 Approved by: W JX^aki^jDirector) Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. ABSTRACT On Vector Sequence Transforms and Acceleration Techniques Steven Lee Hodge Old Dominion University, 1989 Director: Dr. William D. Lakin This dissertation is devoted to the acceleration of convergence of vector se­ quences. This means to produce a replacement sequence from the original se­ quence w ith higher rate of convergence. It is assumed that the sequence is generated from a linear m atrix iteration xi+i = Gxi + k where G is an n x n square m atrix and xI+ 1 , x,-, and k are n x 1 vectors. Acceleration of convergence is obtained when we are able to resolve approximations to low dimension invariant subspaces of G which contain large components of the error. When this occurs, simple weighted averages of iter­ ates x,+|, i = 1 ,2 ,... k where k < n are used to produce iterates which contain approximately no error in the selfsame low dimension invariant subspaces. We begin with simple techniques based upon the resolution of a simple dominant eigenvalue/eigenvector pair and extend the notion to higher dimensional invari­ ant spaces. Discussion is given to using various subspace iteration methods and their convergence. These ideas are again generalized by solving the eigenele- ment problem for a projection of G onto an appropiate subspace. The use of Lanzcos-type methods are discussed for establishing these projections. i Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. We produce acceleration techniques based on the process of generalized inver­ sion. The relationship between the minimal polynomial extrapolation technique (MPE) for acceleration of convergence and conjugate gradient type methods is explored. Further acceleration techniques are formed from conjugate gradient type techniques and a generalized inverse Newton’s method. An exposition is given to accelerations based upon generalizations of rational interpolation and Pade approximation. Further acceleration techniques using Sherman-Woodbury-Morrison type formulas are formulated and suggested as a replacement for the E-transform. We contrast the effect of several extrapolation techniques drawn from the dissertation on a nonsymmetric linear iteration. We pick the Minimal Polyno­ mial Extrapolation (MPE) as a representative of techniques based on orthogonal residuals, the Vector e-Algorithm (VEA) as a representative vector interpola­ tion technique and a technique formulated in this dissertation based on solving a projected eigenproblem. The results show the projected eigenproblem technique to be superior for certain iterations. ii Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. To Dawne iii Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. Acknowledgements I would like to thank Dr. William D. Lakin and the other members of the committee for their encouragement and friendly advice during the writing of this dissertation. I especially appreciate the mathematical insights provided to me by Dr. John Swetits and Dr. John Tweed. I would like to thank Dr. Stan Weinstein for his extensive proofreading of this dissertation at a time I had grown weary of it. I must also recognize Barbara Jeffrey for her help with this dissertation and, most of all, friendship. I owe a debt of gratitude to the Department of Mathematics at O.D.U., the ICAM program at O.D.U., and the Theoretical Aerodynamics Branch of the Transonics Division at the N.A.S.A. Langley Research Center for the use of their equipment and monetary support. My parents and brother never ceased to encourage me and I thank them. But most of all, I would like to thank my wife Dawne and son Daniel (5 years old) for their strength, patience, love and understanding during this seemingly infinite project which threatened to rend us apart. In closing, I would also like to thank my daughter Lauren (at present 10 months old and squalling in her crib) who—although she came a little late to be of much help—may in the future like to see her name in print. iv Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. Contents 1 Introduction 1 1.1 N o ta tio n ................................................................................................... 6 1.1.1 Spaces .......................................................................................... 6 1.1.2 Real and Complex N um bers ................................................... 7 1.1.3 Sequences ................................................................................... 7 2 Matrix Eigenvalue and Projection Techniques for Extrapolation 9 2.1 Extending Lusternik’s Method to a Subspace ................................. 14 2.1.1 Remarks on Methods Based upon Resolving Eigenspaces ............................................................. 19 2.2 Producing an Extrapolation Method from the Simultaneous Iteration Technique ............................................. 20 2.3 Extrapolation with Projection Methods .......................................... 25 2.3.1 Introduction ............................................................................. 25 2.3.2 Avoiding Amplification by the Incorporation of Eigenvectors ................................................ 27 2.3.3 On Approximate Eigenelements from Projections ................................................................................ 32 2.4 Extensions to Lanczos type m ethods ................................................. 34 v Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. 3 Extrapolations Based on Generalized Inverses 44 3.1 The M PE M e th o d ................................................................................. 44 3.2 A Generalization of M P E .................................................................... 52 3.2.1 On Generalized In v e rs io n ....................................................... 54 3.2.2 Weighted Generalized Inverses .............................................. 56 3.3 Pseudoinversion and Descent M ethods ............................................. 58 3.3.1 Descent Methods for Extrapolation ....................................... 59 3.3.2 The Steepest Descent P ro c e d u re .......................................... 61 3.3.3 Conjugate Direction and Conjugate Gradient M ethods ................................................................... 63 3.4 A More Sophisticated Gradient Extrapolation ................................ 65 3.4.1 Planar Conjugate Gradient Acceleration ............................. 66 3.5 A Generalized Inverse Extrapolation Based on Newton’s M e th o d ................................................................ 67 4 The Annihilation and Suppression of Spectral Terms 72 4.1 The Classical Shanks-Schmidt Approach and Generalizations ................................................................................ 72 4.1.1 Sylvester’s Id e n tity .................................................................... 75 4.2 Eigenvalue Problems, Analytic Continuation, and Rational Approximation ...................................... 81 4.2.1 Rational and Polynomial Approximation ............................. 82 4.2.2 Pade Approximation ................................................................ 84 4.2.3 On the Evaluation of Pade Approximants .......................... 85 4.2.4 On Acceleration Methods for Vector Sequences ................. 88 4.3 On the Formation of Extrapolations ................................................ 94 vi Reproduced with permission of the copyright owner. Further reproduction prohibited without permission. 5 Numerical Experiments with Selected Extrapolations 98 5.1 Preconditioning and the Formulation of Iterative Methods ................................................................................ 99 5.1.1 On the Formation of Classical Relaxation M ethods ....................................................................102 5.2 More on the S.O.R. M e th o d ...................................................................107
Recommended publications
  • Ries Via the Generalized Weighted-Averages Method
    Progress In Electromagnetics Research M, Vol. 14, 233{245, 2010 ACCELERATION OF SLOWLY CONVERGENT SE- RIES VIA THE GENERALIZED WEIGHTED-AVERAGES METHOD A. G. Polimeridis, R. M. Golubovi¶cNi¶ciforovi¶c and J. R. Mosig Laboratory of Electromagnetics and Acoustics Ecole Polytechnique F¶ed¶eralede Lausanne CH-1015 Lausanne, Switzerland Abstract|A generalized version of the weighted-averages method is presented for the acceleration of convergence of sequences and series over a wide range of test problems, including linearly and logarithmically convergent series as well as monotone and alternating series. This method was originally developed in a partition- extrapolation procedure for accelerating the convergence of semi- in¯nite range integrals with Bessel function kernels (Sommerfeld-type integrals), which arise in computational electromagnetics problems involving scattering/radiation in planar strati¯ed media. In this paper, the generalized weighted-averages method is obtained by incorporating the optimal remainder estimates already available in the literature. Numerical results certify its comparable and in many cases superior performance against not only the traditional weighted-averages method but also against the most proven extrapolation methods often used to speed up the computation of slowly convergent series. 1. INTRODUCTION Almost every practical numerical method can be viewed as providing an approximation to the limit of an in¯nite sequence. This sequence is frequently formed by the partial sums of a series, involving a ¯nite number of its elements. Unfortunately, it often happens that the resulting sequence either converges too slowly to be practically useful, or even appears as divergent, hence requesting the use of generalized Received 7 October 2010, Accepted 28 October 2010, Scheduled 8 November 2010 Corresponding author: Athanasios G.
    [Show full text]
  • Convergence Acceleration of Series Through a Variational Approach
    Convergence acceleration of series through a variational approach September 30, 2004 Paolo Amore∗, Facultad de Ciencias, Universidad de Colima, Bernal D´ıaz del Castillo 340, Colima, Colima, M´exico Abstract By means of a variational approach we find new series representa- tions both for well known mathematical constants, such as π and the Catalan constant, and for mathematical functions, such as the Rie- mann zeta function. The series that we have found are all exponen- tially convergent and provide quite useful analytical approximations. With limited effort our method can be applied to obtain similar expo- nentially convergent series for a large class of mathematical functions. 1 Introduction This paper deals with the problem of improving the convergence of a series in the case where the series itself is converging very slowly and a large number of terms needs to be evaluated to reach the desired accuracy. This is an interesting and challenging problem, which has been considered by many authors before (see, for example, [FV 1996, Br 1999, Co 2000]). In this paper we wish to attack this problem, although aiming from a different angle: instead of looking for series expansions in some small nat- ural parameter (i.e. a parameter present in the original formula), we in- troduce an artificial dependence in the formulas upon an (not completely) ∗[email protected] 1 arbitrary parameter and then devise an expansion which can be optimized to give faster rates of convergence. The details of how this work will be explained in depth in the next section. This procedure is well known in Physics and it has been exploited in the so-called \Linear Delta Expansion" (LDE) and similar approaches [AFC 1990, Jo 1995, Fe 2000].
    [Show full text]
  • Rate of Convergence for the Fourier Series of a Function with Gibbs Phenomenon
    A Proof, Based on the Euler Sum Acceleration, of the Recovery of an Exponential (Geometric) Rate of Convergence for the Fourier Series of a Function with Gibbs Phenomenon John P. Boyd∗ Department of Atmospheric, Oceanic and Space Science and Laboratory for Scientific Computation, University of Michigan, 2455 Hayward Avenue, Ann Arbor MI 48109 [email protected]; http://www.engin.umich.edu:/∼ jpboyd/ March 26, 2010 Abstract When a function f(x)is singular at a point xs on the real axis, its Fourier series, when truncated at the N-th term, gives a pointwise error of only O(1/N) over the en- tire real axis. Such singularities spontaneously arise as “fronts” in meteorology and oceanography and “shocks” in other branches of fluid mechanics. It has been pre- viously shown that it is possible to recover an exponential rate of convegence at all | − σ |∼ − points away from the singularity in the sense that f(x) fN (x) O(exp( q(x)N)) σ where fN (x) is the result of applying a filter or summability method to the partial sum fN (x) and q(x) is a proportionality constant that is a function of d(x) ≡ |x − xs |, the distance from x to the singularity. Here we give an elementary proof of great generality using conformal mapping in a dummy variable z; this is equiva- lent to applying the Euler acceleration. We show that q(x) ≈ log(cos(d(x)/2)) for the Euler filter when the Fourier period is 2π. More sophisticated filters can in- crease q(x), but the Euler filter is simplest.
    [Show full text]
  • Polylog and Hurwitz Zeta Algorithms Paper
    AN EFFICIENT ALGORITHM FOR ACCELERATING THE CONVERGENCE OF OSCILLATORY SERIES, USEFUL FOR COMPUTING THE POLYLOGARITHM AND HURWITZ ZETA FUNCTIONS LINAS VEPŠTAS ABSTRACT. This paper sketches a technique for improving the rate of convergence of a general oscillatory sequence, and then applies this series acceleration algorithm to the polylogarithm and the Hurwitz zeta function. As such, it may be taken as an extension of the techniques given by Borwein’s “An efficient algorithm for computing the Riemann zeta function”[4, 5], to more general series. The algorithm provides a rapid means of evaluating Lis(z) for¯ general values¯ of complex s and a kidney-shaped region of complex z values given by ¯z2/(z − 1)¯ < 4. By using the duplication formula and the inversion formula, the range of convergence for the polylogarithm may be extended to the entire complex z-plane, and so the algorithms described here allow for the evaluation of the polylogarithm for all complex s and z values. Alternatively, the Hurwitz zeta can be very rapidly evaluated by means of an Euler- Maclaurin series. The polylogarithm and the Hurwitz zeta are related, in that two evalua- tions of the one can be used to obtain a value of the other; thus, either algorithm can be used to evaluate either function. The Euler-Maclaurin series is a clear performance winner for the Hurwitz zeta, while the Borwein algorithm is superior for evaluating the polylogarithm in the kidney-shaped region. Both algorithms are superior to the simple Taylor’s series or direct summation. The primary, concrete result of this paper is an algorithm allows the exploration of the Hurwitz zeta in the critical strip, where fast algorithms are otherwise unavailable.
    [Show full text]
  • A Probabilistic Perspective
    Acceleration methods for series: A probabilistic perspective Jos´eA. Adell and Alberto Lekuona Abstract. We introduce a probabilistic perspective to the problem of accelerating the convergence of a wide class of series, paying special attention to the computation of the coefficients, preferably in a recur- sive way. This approach is mainly based on a differentiation formula for the negative binomial process which extends the classical Euler's trans- formation. We illustrate the method by providing fast computations of the logarithm and the alternating zeta functions, as well as various real constants expressed as sums of series, such as Catalan, Stieltjes, and Euler-Mascheroni constants. Mathematics Subject Classification (2010). Primary 11Y60, 60E05; Sec- ondary 33B15, 41A35. Keywords. Series acceleration, negative binomial process, alternating zeta function, Catalan constant, Stieltjes constants, Euler-Mascheroni constant. 1. Introduction Suppose that a certain function or real constant is given by a series of the form 1 X f(j)rj; 0 < r < 1: (1.1) j=0 From a computational point of view, it is not only important that the geo- metric rate r is a rational number as small as possible, but also that the coefficients f(j) are easy to compute, since the series in (1.1) can also be written as 1 X (f(2j) + rf(2j + 1)) r2j ; j=0 The authors are partially supported by Research Projects DGA (E-64), MTM2015-67006- P, and by FEDER funds. 2 Adell and Lekuona thus improving the geometric rate from r to r2. Obviously, this procedure can be successively implemented (see formula (2.8) in Section 2).
    [Show full text]
  • Hermite Functions
    Appendix A Hermite Functions Abstract Hermite functions play such a central role in equatorial dynamics that it is useful to collect information about them from a variety of sources. Hille-Watson- Boyd convergence and rate-of-convergence theorems, a table of explicit formulas for the Hermite coefficients of elementary functions, Hermite quadrature and inte- gral representations for the Hermite functions and so on are included. Another table lists numerical models employing Hermite functions for oceanographic and meteo- rological applications. Recurrence formulas are provided not only for the normalized Hermmite functions themselves, but also for computing derivatives and products of powers of y with Hermite functions. The Moore-Hutton series acceleration and Euler acceleration for slowly-converging Hermite series are also explained. Just because there’s an exact formula doesn’t mean it’s necessarily a good idea to use it. — Lloyd N. “Nick” Trefethen, FRS A.1 Normalized Hermite Functions: Definitions and Recursion The normalized Hermite functions ψn have the orthogonality property that ∞ ψn(y)ψm (y) dy = δmn (A.1) −∞ where δmn is the usual Kronecker δ, which is one when m = n and zero otherwise. The Hermite functions can be efficiently computed using a three-term recursion relation from two starting values: √ −1/4 2 −1/4 2 ψ0(y) ≡ π exp(−(1/2)y ); ψ1(y) ≡ π 2 y exp(−(1/2)y ) (A.2) 2 n ψ + (y) = y ψ (y) − ψ − (y) (A.3) n 1 n + 1 n n + 1 n 1 © Springer-Verlag GmbH Germany 2018 465 J.P. Boyd, Dynamics of the Equatorial Ocean, https://doi.org/10.1007/978-3-662-55476-0
    [Show full text]
  • Rapidly Convergent Summation Formulas Involving Stirling Series
    Rapidly Convergent Summation Formulas involving Stirling Series Raphael Schumacher MSc ETH Mathematics Switzerland [email protected] Abstract This paper presents a family of rapidly convergent summation formulas for various finite sums of analytic functions. These summation formulas are obtained by applying a series acceleration transformation involving Stirling numbers of the first kind to the asymptotic, but divergent, expressions for the corresponding sums coming from the Euler-Maclaurin summation formula. While it is well-known that the expressions ob- tained from the Euler-Maclaurin summation formula diverge, our summation formulas are all very rapidly convergent and thus computationally efficient. 1 Introduction In this paper we will use asymptotic series representations for finite sums of various analytic functions, coming from the Euler-Maclaurin summation formula [13, 17], to obtain rapidly convergent series expansions for these finite sums involving Stirling series [1, 2]. The key tool for doing this will be the so called Weniger transformation [1] found by J. Weniger, which transforms an inverse power series into a Stirling series. n For example, two of our three summation formulas for the sum √k, where n N, look k=0 ∈ like P n ∞ k l (2l−3)!! (1) l l 2 3 1 1 3 k l=1( 1) 2 (l+1)! B +1Sk (l) √k = n 2 + √n ζ + √n ( 1) − 3 2 − 4π 2 − P(n + 1)(n + 2) (n + k) arXiv:1602.00336v1 [math.NT] 31 Jan 2016 Xk=0 Xk=1 ··· 2 3 1 1 3 √n √n 53√n = n 2 + √n ζ + + + 3 2 − 4π 2 24(n + 1) 24(n + 1)(n + 2) 640(n + 1)(n + 2)(n + 3) 79√n + + ..., 320(n + 1)(n + 2)(n + 3)(n + 4) 1 or n ∞ k l (2l−1)!! (1) l 2 3 1 1 3 1 k l=1( 1) 2l+1(l+2)! B +2Sk (l) √k = n 2 + √n ζ + + ( 1) − 3 2 − 4π 2 24√n − P√n(n + 1)(n + 2) (n + k) Xk=0 Xk=1 ··· 2 3 1 1 3 1 1 1 = n 2 + √n ζ + 3 2 − 4π 2 24√n − 1920√n(n + 1)(n + 2) − 640√n(n + 1)(n + 2)(n + 3) 259 115 ..., − 46080√n(n + 1)(n + 2)(n + 3)(n + 4) − 4608√n(n + 1)(n + 2)(n + 3)(n + 4)(n + 5) − (1) where the Bl’s are the Bernoulli numbers and Sk (l) denotes the Stirling numbers of the first kind.
    [Show full text]
  • System Convergence in Transport Models: Algorithms Efficiency and Output Uncertainty
    View metadata,Downloaded citation and from similar orbit.dtu.dk papers on:at core.ac.uk Dec 21, 2017 brought to you by CORE provided by Online Research Database In Technology System convergence in transport models: algorithms efficiency and output uncertainty Rich, Jeppe; Nielsen, Otto Anker Published in: European Journal of Transport and Infrastructure Research Publication date: 2015 Document Version Publisher's PDF, also known as Version of record Link back to DTU Orbit Citation (APA): Rich, J., & Nielsen, O. A. (2015). System convergence in transport models: algorithms efficiency and output uncertainty. European Journal of Transport and Infrastructure Research, 15(3), 317-340. General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Issue 15(3), 2015 pp. 317-340 ISSN: 1567-7141 EJTIR tlo.tbm.tudelft.nl/ejtir System convergence in transport models: algorithms efficiency and output uncertainty Jeppe Rich1 Department of Transport, Technical University of Denmark Otto Anker Nielsen2 Department of Transport, Technical University of Denmark Transport models most often involve separate models for traffic assignment and demand.
    [Show full text]
  • Euler's Constant: Euler's Work and Modern Developments
    BULLETIN (New Series) OF THE AMERICAN MATHEMATICAL SOCIETY Volume 50, Number 4, October 2013, Pages 527–628 S 0273-0979(2013)01423-X Article electronically published on July 19, 2013 EULER’S CONSTANT: EULER’S WORK AND MODERN DEVELOPMENTS JEFFREY C. LAGARIAS Abstract. This paper has two parts. The first part surveys Euler’s work on the constant γ =0.57721 ··· bearing his name, together with some of his related work on the gamma function, values of the zeta function, and diver- gent series. The second part describes various mathematical developments involving Euler’s constant, as well as another constant, the Euler–Gompertz constant. These developments include connections with arithmetic functions and the Riemann hypothesis, and with sieve methods, random permutations, and random matrix products. It also includes recent results on Diophantine approximation and transcendence related to Euler’s constant. Contents 1. Introduction 528 2. Euler’s work 530 2.1. Background 531 2.2. Harmonic series and Euler’s constant 531 2.3. The gamma function 537 2.4. Zeta values 540 2.5. Summing divergent series: the Euler–Gompertz constant 550 2.6. Euler–Mascheroni constant; Euler’s approach to research 555 3. Mathematical developments 557 3.1. Euler’s constant and the gamma function 557 3.2. Euler’s constant and the zeta function 561 3.3. Euler’s constant and prime numbers 564 3.4. Euler’s constant and arithmetic functions 565 3.5. Euler’s constant and sieve methods: the Dickman function 568 3.6. Euler’s constant and sieve methods: the Buchstab function 571 3.7.
    [Show full text]
  • Fortran Optimizing Compiler 6
    Numerical Libraries for General Interest Seminars 2015 Scientific Computing April 1, 2015 Ge Baolai SHARCNET Faculty of Science Western University Topics . Numerical libraries for scientific computing . Numerical libraries at SHARCNET . Examples – Linear algebra – FFTW – ODE solvers – Optimization – GSL – Multiprecision with MPFUN – PETSc (PDE solvers) . Q&A Overview Numerical Libraries SEMINARS 2015 Numerical Computing . Linear algebra . Nonlinear equations . Optimization . Interpolation/Approximation . Integration and differentiation . Solving ODEs . Solving PDEs . FFT . Random numbers and stochastic simulations . Special functions Copyright © 2001-2015 Western University Seminar Series on Scientific and High Performance Computing, London, Ontario, 2015 Numerical Libraries SEMINARS 2015 More fundamental problems: . Linear algebra . Nonlinear equations . Numerical integration . ODE . FFT . Random numbers . Special functions Copyright © 2001-2015 Western University Seminar Series on Scientific and High Performance Computing, London, Ontario, 2015 Numerical Libraries SEMINARS 2015 Top Ten Algorithms for Science (Jack Dongarra 2000) 1. Metropolis Algorithm for Monte Carlo 2. Simplex Method for Linear Programming 3. Krylov Subspace Iteration Methods 4. The Decompositional Approach to Matrix Computations 5. The Fortran Optimizing Compiler 6. QR Algorithm for Computing Eigenvalues 7. Quicksort Algorithm for Sorting 8. Fast Fourier Transform 9. Integer Relation Detection 10. Fast Multipole Method Copyright © 2001-2015 Western University Seminar
    [Show full text]
  • Accelerating Convergence of Series
    ACCELERATING CONVERGENCE OF SERIES KEITH CONRAD 1. Introduction An infinite series is the limit of its partial sums. However, it may take a large number of terms to get even a few correct digits for the series from its partial sums. For example, 1 X 1 (1.1) n2 n=1 2 converges but the partial sums sN = 1 + 1=4 + 1=9 + ··· + 1=N take a long time to settle down, as the table below illustrates, where sN is truncated to 8 digits after the decimal point. The 1000th partial sum s1000 winds up matching the full series (1.1) only in 1.64. N 10 20 25 50 100 1000 sN 1.54976773 1.59616324 1.60572340 1.62513273 1.63498390 1.64393456 That the partial sums sN converge slowly is related to the error bound from the integral 1 X 1 test: = s + r where n2 N N n=1 1 X 1 Z 1 dx 1 (1.2) r = < = : N n2 x2 N n=N+1 N To approximate (1.1) by sN correctly to 3 digits after the decimal point means rN < :0001 = 1=104, so the bound in (1.2) suggests we make 1=N ≤ 1=104, so N ≥ 10000.1 In the era before electronic computers, computing the 1000th partial sum of (1.1) was not feasible. P Our theme is speeding up convergence of a series S = n≥1 an. This means rewriting P 0 0 P 0 S in a new way, say S = n≥1 an, so that the new tail rN = n>N an goes to 0 faster P than the old tail rN = n>N an.
    [Show full text]
  • Arxiv:Math/0702243V4
    AN EFFICIENT ALGORITHM FOR ACCELERATING THE CONVERGENCE OF OSCILLATORY SERIES, USEFUL FOR COMPUTING THE POLYLOGARITHM AND HURWITZ ZETA FUNCTIONS LINAS VEPŠTAS ABSTRACT. This paper sketches a technique for improving the rate of convergence of a general oscillatory sequence, and then applies this series acceleration algorithm to the polylogarithm and the Hurwitz zeta function. As such, it may be taken as an extension of the techniques given by Borwein’s “An efficient algorithm for computing the Riemann zeta function”[4, 5], to more general series. The algorithm provides a rapid means of evaluating Lis(z) for general values of complex s and a kidney-shaped region of complex z values given by z2/(z 1) < 4. By using the duplication formula and the inversion formula, the − range of convergence for the polylogarithm may be extended to the entire complex z-plane, and so the algorithms described here allow for the evaluation of the polylogarithm for all complex s and z values. Alternatively, the Hurwitz zeta can be very rapidly evaluated by means of an Euler- Maclaurin series. The polylogarithm and the Hurwitz zeta are related, in that two evalua- tions of the one can be used to obtain a value of the other; thus, either algorithm can be used to evaluate either function. The Euler-Maclaurin series is a clear performance winner for the Hurwitz zeta, while the Borwein algorithm is superior for evaluating the polylogarithm in the kidney-shaped region. Both algorithms are superior to the simple Taylor’s series or direct summation. The primary, concrete result of this paper is an algorithm allows the exploration of the Hurwitz zeta in the critical strip, where fast algorithms are otherwise unavailable.
    [Show full text]