Chebyshev Approximation by Exponential-Polynomial Sums (*)

Total Page:16

File Type:pdf, Size:1020Kb

Chebyshev Approximation by Exponential-Polynomial Sums (*) Chebyshev approximation by exponential-polynomial sums (*) Charles B. Dunham (**) ABSTRACT It is shown that best Chebyshev approximations by exponential-polynomial sums are character- ized by (a variable number of) alternations of their error curve and are unique. Computation of best approximations via the Remez algorithm and Barrodale approach is considered. Let [a, 3] be a closed finite interval and C[a, 3] be are distinct and nonzero (in the case m = 0 we will the space of continuous functions on [a, 3]. For permit one of a n + 1 ..... a2n to be zero). It is easily g ~ C [a, 3] define seen that any parameter has an equivalent standard parameter. The degeneracy d (A) of a standard parameter Itgll=max (Ig(x)l:a<x<3). A is the number of zero coefficients in a I ..... a n. The Let w be a positive element of C[a, 3], an ordinary degree of F at standard parameter A is defined to be multiplicative weight function. For given fLxed n > 0, 2n + m - d (A). m >/ 0 define n m k-1 Haar subspaces F (A, x) = k~=l a k exp (an + k x) + k Z=I a2n + kX Definition The Chebyshev problem is given f~ C[a, 3] to find a A linear subspace of C [a, 3] of dimension ~ is a Haar parameter A* to minimize IIw(f-F(A, .))II. Such a subspace on [a, 3] if only the zero element has ~ zeros parameter A* is called best and F(A*, .) is called a on [a, 31. best approximation to f. It might perhaps be thought that the case m > 0 is not Lemma I of practical interest. However, Spath has developed The linear space generated by algorithms for discrete L 2 approximation for the case (exp (aix), xexp (aix) ..... x m(i) exp (aix)), n = 1, m = 1 and 2 in Spath [26] and Spath [27] respectively. Further, the model n = 1, m = 2 has been i = 1 ..... n, a 1 < ... < a n , is a Haar subspace of dimen- found to apply to a biochemical system (Heitkamp n et al. [19] equation (17)) and Spath [27] states that sion Z (m(i)+l). it is often needed in chemistry and radiation chemistry. i=1 The author has been informed by Dr. Alan Miller of The lemma is given in Meinardus and Schwedt [25, p. CSIRO that models with m = 1, n = 2 were of interest. 313] and also proven in Meinardus [24, p. 177): Such a model was used by Cantraine and Jortay [6]. Models with m = 1 and n larger are given by Cook and Property Z Taylor [10] and by Lemaitre and Malenge [22]. Models which can be converted by change of variable into the Lemma 2 case n = 1, m = 1 or 2, are discussed by Shah and Let F be of degree £ at standard parameter A, then Khatri [29]. F (A, .) - F (B, .) has at most ~ -1 zeros or vanishes The same model with m -- 1 is used by Gregory [30]. identically. The case where m = 0, w = 1, has been studied by Meinardus and Schwedt [25, p. 312-313] and also Proof appears in Meinardus [24, p. 177-178]. We analyze F (A, .) - F (B, .) is a linear combination of (1 ..... x m -1 } our problem with a theory also due to Meinardus and and at most 2n-d (A) non-constant exponentials. Schwedt. By Lemma 1 it has at most 2n + m -1 - d (A) zeros or A parameter A will be called standard if an+ 1""' a2n vanishes identically. (*) This work has been assisted by a grant from the National Research Council of Canada. (**) Ch. B. Dunham, The University of Western Ontario, Dept. of Computer Science, London Ontario N6A 5B 9, Canada. Journal of Computational and Applied Mathematics, volume 5, no 1, 1979. 53 The partial derivatives (i) set j = 0 and choose {x0 ..... X2n + m ) ' Define the partial derivatives where a < x 0 < ... < X2n+m ~ 3, F k (A, x) = 8 F (A, x), (ii) solve the (non-linear) system of 2n + m + 1 levelling equations then they are seen to be continuous in A, x. (*) f(xi) - F(A, xi) - (-1)1X/w(xi) = 0, The tangent space i =.0 ..... .2n + m, for 2n + m + 1 unknowns AJ and XJ , Define (iii) find the alternating extrema of the error curve 2n+m D(A,B,x) = b k ~ F (A, x) k=l w(f - F (Aj , .)) and call them {x0 ..... X2n + m } . n n This process of simultaneous exchanges is described = ~ bkex p (an+ k x) + k~=ibn+kakxexp (an+k x) k=l in Meinardus [24, p. 107] (iv) add 1 to j and go to (ii). m k-1 + Y~ k x k =1 b2n + This process is an infinite process. In an actual program it is terminated when the extrema of the error curve Len'/ma 3 found in (iii) are sufficiently equal in absolute value. Let F be of degree J~ at standard parameter A, then Finding the alternating extrema can be done exactly (D (A .... ) } is a Haar subspace of dimension £. as in variants of the Remez algorithm for other approxi- This follows immediately from Lemma 1. mation problems, for example Cody, Fraser, and Hart [9] for rational approximation. The major difficulty is Characterization of best approximations in solving the levelling equations (*). The most straight- forward way to solve them is to use Newton's method Fundamental to much of the characterization theory directly. In the special case n = 1, it is also possible to of Chebyshev approximation, both linear and non- re-arrange the system (*) to make the unknowns enter linear, is the alternation (equioscillation, equal ripple) less nonlinearly and then apply Newton's method. property. The case n= m=l, w= 1, is considered in Dtinham [11] Definition and it is not difficult to see from this analysis how to cover the general case of n = 1. Both approaches appear g ~ C[a, ~] alternates £ times on [ct, 13] if there exists to work reasonably well in the case n = 1 in the author's (x 0 ..... x£}, where a < x 0 < ... < xj~ < ~, such that experiments. A problem with both approaches is that Newton's method may converge to a "pseudo-solu- Ig(xi)l = IIg[I g(x i) = (-1)ig(x0) i= 0 ..... 9~. tion". Pseudo-solutions for the case n = m = 1 are given in Dunham [11, p. 211] for the method with re- Such a set (x 0 ..... x£} is called an alternant of g. arrangement. Whether the levelling equations (*) can easily be solved in the case where n > 2 and optimal Theorem 1 {an+k } are not well separated is still an open question. Let F have degree £ at standard parameter A. A neces- It should be noted that the levelling equations may sary and sufficient condition that F (A,.) be best to f not even have a solution. is that w (f - F (A, .)) alternate J~ times on [ct,/~]. Best approximations are unique. Example The theorem follows from Lemma 2, continuity of Let n=l, m=0, w=l and f(x0)=-l, f(xl)= f(x2)=l. the partial derivatives, Lemma 3, and theory of Meinardus and Schwedt [25, theorems 13 and 14], Suppose a solution A, X to (*) exists. The first possi- als0 given in Meinardus [24, p. 144-147] in the case bility is that a I <~ 0, in which case F (A,.) ~ 0, and we w = 1. The extension to a general w follows from cannot have f (Xl) f(x2) > 0. The second possibility theorem 1 of Dunham [12]. is that a I > 0, in which case F (A, .) > 0 and it can be seen by drawing a diagram that f (x0), f (x 1) cannot Computation of best approximations take their values. In case the best approximation is of maximum degree The variant of Meinardus and Schwedt [25, p. 320 ff], (2n + m), its error curve alternates at least 2n + m also given in Meinardus [24, p. 150-151], uses one times. This suggests that best approximations can be iteration of Newton's method to approximately solve determined by a variant of the Remez algorithm, the levelling equations. Barrar and Loeb [1] have general versions of which are given by Barrar and Loeb proven that if the best approximation is of maximum ([1], p. 389) and Dunham ([12], p. 228). degree, and the starting point (estimate of the parameters The Remez algorithm for our problem proceeds rough- and deviation of the best approximation and an alter- ly as follows : nant) is sufficiently close, the Remez algorithm will Journal of Computational and Applied Mathematics, volume 5, no 1, 1979. 54 converge (neglecting analytical and numerical diffi- (X,) of finite sets fdling out [ct, ~]. This should work culties in solving the levelling equations). Dunham if i~e best approximation is of maximum degree [ 13]. [12] proves that under favorable conditions, the con- vergence of the Remez algorithm and the variant of Discrete approximation Meinardus and Schwedt is quadratic. The author has Consider instead approximation on a finite set programmed a version of the Remez algorithm for the case n = 1 which appears to work reasonably well, X=(x 1 ..... x j), j>2n+m, x l<...<xj.Define provided the parameters of the best approximation [[glIx= max {Ig(x)l : x~X). can be closely estimated. Another approach is to reduce part of the problem We wish to minimize Hw (f - F (A, .))[IX" to a linear problem. Associate with each set an + 1 ....
Recommended publications
  • A Short Course on Approximation Theory
    A Short Course on Approximation Theory N. L. Carothers Department of Mathematics and Statistics Bowling Green State University ii Preface These are notes for a topics course offered at Bowling Green State University on a variety of occasions. The course is typically offered during a somewhat abbreviated six week summer session and, consequently, there is a bit less material here than might be associated with a full semester course offered during the academic year. On the other hand, I have tried to make the notes self-contained by adding a number of short appendices and these might well be used to augment the course. The course title, approximation theory, covers a great deal of mathematical territory. In the present context, the focus is primarily on the approximation of real-valued continuous functions by some simpler class of functions, such as algebraic or trigonometric polynomials. Such issues have attracted the attention of thousands of mathematicians for at least two centuries now. We will have occasion to discuss both venerable and contemporary results, whose origins range anywhere from the dawn of time to the day before yesterday. This easily explains my interest in the subject. For me, reading these notes is like leafing through the family photo album: There are old friends, fondly remembered, fresh new faces, not yet familiar, and enough easily recognizable faces to make me feel right at home. The problems we will encounter are easy to state and easy to understand, and yet their solutions should prove intriguing to virtually anyone interested in mathematics. The techniques involved in these solutions entail nearly every topic covered in the standard undergraduate curriculum.
    [Show full text]
  • February 2009
    How Euler Did It by Ed Sandifer Estimating π February 2009 On Friday, June 7, 1779, Leonhard Euler sent a paper [E705] to the regular twice-weekly meeting of the St. Petersburg Academy. Euler, blind and disillusioned with the corruption of Domaschneff, the President of the Academy, seldom attended the meetings himself, so he sent one of his assistants, Nicolas Fuss, to read the paper to the ten members of the Academy who attended the meeting. The paper bore the cumbersome title "Investigatio quarundam serierum quae ad rationem peripheriae circuli ad diametrum vero proxime definiendam maxime sunt accommodatae" (Investigation of certain series which are designed to approximate the true ratio of the circumference of a circle to its diameter very closely." Up to this point, Euler had shown relatively little interest in the value of π, though he had standardized its notation, using the symbol π to denote the ratio of a circumference to a diameter consistently since 1736, and he found π in a great many places outside circles. In a paper he wrote in 1737, [E74] Euler surveyed the history of calculating the value of π. He mentioned Archimedes, Machin, de Lagny, Leibniz and Sharp. The main result in E74 was to discover a number of arctangent identities along the lines of ! 1 1 1 = 4 arctan " arctan + arctan 4 5 70 99 and to propose using the Taylor series expansion for the arctangent function, which converges fairly rapidly for small values, to approximate π. Euler also spent some time in that paper finding ways to approximate the logarithms of trigonometric functions, important at the time in navigation tables.
    [Show full text]
  • Approximation Atkinson Chapter 4, Dahlquist & Bjork Section 4.5
    Approximation Atkinson Chapter 4, Dahlquist & Bjork Section 4.5, Trefethen's book Topics marked with ∗ are not on the exam 1 In approximation theory we want to find a function p(x) that is `close' to another function f(x). We can define closeness using any metric or norm, e.g. Z 2 2 kf(x) − p(x)k2 = (f(x) − p(x)) dx or kf(x) − p(x)k1 = sup jf(x) − p(x)j or Z kf(x) − p(x)k1 = jf(x) − p(x)jdx: In order for these norms to make sense we need to restrict the functions f and p to suitable function spaces. The polynomial approximation problem takes the form: Find a polynomial of degree at most n that minimizes the norm of the error. Naturally we will consider (i) whether a solution exists and is unique, (ii) whether the approximation converges as n ! 1. In our section on approximation (loosely following Atkinson, Chapter 4), we will first focus on approximation in the infinity norm, then in the 2 norm and related norms. 2 Existence for optimal polynomial approximation. Theorem (no reference): For every n ≥ 0 and f 2 C([a; b]) there is a polynomial of degree ≤ n that minimizes kf(x) − p(x)k where k · k is some norm on C([a; b]). Proof: To show that a minimum/minimizer exists, we want to find some compact subset of the set of polynomials of degree ≤ n (which is a finite-dimensional space) and show that the inf over this subset is less than the inf over everything else.
    [Show full text]
  • Function Approximation Through an Efficient Neural Networks Method
    Paper ID #25637 Function Approximation through an Efficient Neural Networks Method Dr. Chaomin Luo, Mississippi State University Dr. Chaomin Luo received his Ph.D. in Department of Electrical and Computer Engineering at Univer- sity of Waterloo, in 2008, his M.Sc. in Engineering Systems and Computing at University of Guelph, Canada, and his B.Eng. in Electrical Engineering from Southeast University, Nanjing, China. He is cur- rently Associate Professor in the Department of Electrical and Computer Engineering, at the Mississippi State University (MSU). He was panelist in the Department of Defense, USA, 2015-2016, 2016-2017 NDSEG Fellowship program and panelist in 2017 NSF GRFP Panelist program. He was the General Co-Chair of 2015 IEEE International Workshop on Computational Intelligence in Smart Technologies, and Journal Special Issues Chair, IEEE 2016 International Conference on Smart Technologies, Cleveland, OH. Currently, he is Associate Editor of International Journal of Robotics and Automation, and Interna- tional Journal of Swarm Intelligence Research. He was the Publicity Chair in 2011 IEEE International Conference on Automation and Logistics. He was on the Conference Committee in 2012 International Conference on Information and Automation and International Symposium on Biomedical Engineering and Publicity Chair in 2012 IEEE International Conference on Automation and Logistics. He was a Chair of IEEE SEM - Computational Intelligence Chapter; a Vice Chair of IEEE SEM- Robotics and Automa- tion and Chair of Education Committee of IEEE SEM. He has extensively published in reputed journal and conference proceedings, such as IEEE Transactions on Neural Networks, IEEE Transactions on SMC, IEEE-ICRA, and IEEE-IROS, etc. His research interests include engineering education, computational intelligence, intelligent systems and control, robotics and autonomous systems, and applied artificial in- telligence and machine learning for autonomous systems.
    [Show full text]
  • A Rational Approximation to the Logarithm
    A Rational Approximation to the Logarithm By R. P. Kelisky and T. J. Rivlin We shall use the r-method of Lanczos to obtain rational approximations to the logarithm which converge in the entire complex plane slit along the nonpositive real axis, uniformly in certain closed regions in the slit plane. We also provide error esti- mates valid in these regions. 1. Suppose z is a complex number, and s(l, z) denotes the closed line segment joining 1 and z. Let y be a positive real number, y ¿¿ 1. As a polynomial approxima- tion, of degree n, to log x on s(l, y) we propose p* G Pn, Pn being the set of poly- nomials with real coefficients of degree at most n, which minimizes ||xp'(x) — X|J===== max \xp'(x) — 1\ *e«(l.v) among all p G Pn which satisfy p(l) = 0. (This procedure is suggested by the observation that w = log x satisfies xto'(x) — 1=0, to(l) = 0.) We determine p* as follows. Suppose p(x) = a0 + aix + ■• • + a„xn, p(l) = 0 and (1) xp'(x) - 1 = x(x) = b0 + bix +-h bnxn . Then (2) 6o = -1 , (3) a,- = bj/j, j = 1, ■•-,«, and n (4) a0= - E Oj • .-i Thus, minimizing \\xp' — 1|| subject to p(l) = 0 is equivalent to minimizing ||«-|| among all i£P„ which satisfy —ir(0) = 1. This, in turn, is equivalent to maximiz- ing |7r(0) I among all v G Pn which satisfy ||ir|| = 1, in the sense that if vo maximizes |7r(0)[ subject to ||x|| = 1, then** = —iro/-7ro(0) minimizes ||x|| subject to —ir(0) = 1.
    [Show full text]
  • Topics in High-Dimensional Approximation Theory
    TOPICS IN HIGH-DIMENSIONAL APPROXIMATION THEORY DISSERTATION Presented in Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the Graduate School of the Ohio State University By Yeonjong Shin Graduate Program in Mathematics The Ohio State University 2018 Dissertation Committee: Dongbin Xiu, Advisor Ching-Shan Chou Chuan Xue c Copyright by Yeonjong Shin 2018 ABSTRACT Several topics in high-dimensional approximation theory are discussed. The fundamental problem in approximation theory is to approximate an unknown function, called the target function by using its data/samples/observations. Depending on different scenarios on the data collection, different approximation techniques need to be sought in order to utilize the data properly. This dissertation is concerned with four different approximation methods in four different scenarios in data. First, suppose the data collecting procedure is resource intensive, which may require expensive numerical simulations or experiments. As the performance of the approximation highly depends on the data set, one needs to carefully decide where to collect data. We thus developed a method of designing a quasi-optimal point set which guides us where to collect the data, before the actual data collection procedure. We showed that the resulting quasi-optimal set notably outperforms than other standard choices. Second, it is not always the case that we obtain the exact data. Suppose the data is corrupted by unexpected external errors. These unexpected corruption errors can have big magnitude and in most cases are non-random. We proved that a well-known classical method, the least absolute deviation (LAD), could effectively eliminate the corruption er- rors.
    [Show full text]
  • Approximation of Π
    Lund University/LTH Bachelor thesis FMAL01 Approximation of π Abstract The inverse tangent function can be used to approximate π. When approximating π the convergence of infinite series or products are of great importance for the accuracy of the digits. This thesis will present historical formulas used to approximate π, especially Leibniz–Gregory and Machin’s. Also, the unique Machin two-term formulas will be presented and discussed to show that Machin’s way of calculate π have had a great impact on calculating this number. Madeleine Jansson [email protected] Mentor: Frank Wikstr¨om Examinator: Tomas Persson June 13, 2019 Contents 1 Introduction 2 2 History 2 2.1 – 500 Anno Domini . .2 2.2 1500 – 1800 Anno Domini . .5 2.3 1800 – Anno Domini . .6 2.4 Proofs . .7 2.4.1 Vi`ete’sformula . .7 2.4.2 Wallis’s formula . .9 2.4.3 Irrationality of π ............................. 11 3 Mathematical background 13 3.1 Precision and accuracy . 13 3.2 Convergence of series . 14 3.3 Rounding . 15 4 Gregory–Leibniz formula 17 4.1 History . 18 4.2 Proof . 18 4.3 Convergence . 20 4.4 x = √1 ....................................... 21 3 5 Machin’s formula 22 5.1 History . 22 5.2 Proof . 23 5.3 Convergence . 24 6 Machin-like formulas 26 6.1 Machin-like formula . 27 6.2 Two-term formula . 27 6.3 Complex factors . 28 6.3.1 Euler’s formula . 30 6.3.2 Machin’s formula . 30 6.3.3 Hermann’s formula . 30 6.3.4 Hutton’s formula .
    [Show full text]
  • On Complex Approximation
    Pacific Journal of Mathematics ON COMPLEX APPROXIMATION LAWRENCE CARL EGGAN AND EUGENE A. MAIER Vol. 13, No. 2 April 1963 ON COMPLEX APPROXIMATION L. C. EGGAN and E. A. MAIBR 1. Let C denote the set of complex numbers and G the set of Gaussian integers. In this note we prove the following theorem which is a two-dimensional analogue of Theorem 2 in [3]. THEOREM 1. If β,yeC, then there exists ueG such that I β — u 1 < 2 and (27/82 As an illustration of the application of Theorem 1 to complex approximation, we use it to prove the following result. THEOREM 2. If θeC is irrational and aeC, a Φ mθ + n where m,neG, then there exist infinitely many pairs of relatively prime integers x,yeG such that I x(xθ -y - a)\< 1/2 . The method of proof of Theorem 2 is due to Niven [6]. Also in [7], Niven uses Theorem 1 to obtain a more general result concerning complex approximation by nonhomogeneous linear forms. Alternatively, Theorem 2 may be obtained as a consequence of a theorem of Hlawka [5]. This was done by Eggan [2] using Chalk's statement [1] of Hlawka's Theorem. 2 Theorem 1 may be restated in an equivalent form. For u,b,ce C, define g(u, b, c) = \u — (b + c)\\ u — (b — c)\ . Then Theorem 1 may be stated as follows. THEOREM 1'. If b, ce C, then there exist ulf u2eG such that (i) I uλ - (6 + c) \< 2, I u2 - (6 - c) |< 2 and for i = 1,2, 27/32 ίf (nr )\ g(Ui,( b,c)K ^ < \ί M<l/Π/32 It is clear that Theorem 1' implies Theorem 1 by taking Received February 14, 1962.
    [Show full text]
  • Chapter 1. Finite Difference Approximations
    “rjlfdm” 2007/4/10 i i page 3 i i Copyright ©2007 by the Society for Industrial and Applied Mathematics This electronic version is for personal use and may not be duplicated or distributed. Chapter 1 Finite Difference Approximations Our goal is to approximate solutions to differential equations, i.e., to find a function (or some discrete approximation to this function) that satisfies a given relationship between various of its derivatives on some given region of space and/or time, along with some boundary conditions along the edges of this domain. In general this is a difficult problem, Q2 and only rarely can an analytic formula be found for the solution. A finite difference method proceeds by replacing the derivatives in the differential equations with finite difference approximations. This gives a large but finite algebraic system of equations to be solved in place of the differential equation, something that can be done on a computer. Before tackling this problem, we first consider the more basic question of how we can approximate the derivatives of a known function by finite difference formulas based only on values of the function itself at discrete points. Besides providing a basis for the later development of finite difference methods for solving differential equations, this allows us to investigate several key concepts such as the order of accuracy of an approximation in the simplest possible setting. Let u.x/ represent a function of one variable that, unless otherwise stated, will always be assumed to be smooth, meaning that we can differentiate the function several times and each derivative is a well-defined bounded function over an interval containing a particular point of interest xN.
    [Show full text]
  • Rational Approximations to Irrationals
    Rational Approximation Math 105 History of Mathematics Prof. D. Joyce, Clark University Early in the study of the history of mathematics, we come across various rational approx- imations to irrational numbers. What I mean by that is that when what we know to be an irrational number was used in a computation, a rational number was used instead. A 22 well known example of this is Archimedes’ approximation 7 of the irrational number π. Of 22 course, 7 is not exactly equal to π, but it’s pretty close. The question is, how did Archimedes ever come up with this approximation? The answer is known how Archimedes and the Greeks before him found these approximations, but you may not have seen it before. It’s sometimes called antenaresis or the method of continued fractions, and it’s related to Euclid’s algorithm for finding the greatest common divisor. Long before Archimedes, others used rational approximations in Egypt, Babylonia, India, and China. They may have used the same method, but in those cases, there is no record of the method. There are other methods that have been used in specific instances, but when you see a denominator, like 7, that has nothing to do with the numerical base—usually 10, sometimes 60—that’s a good indication that antenaresis was used. What is this method? Let’s take an example to see how it goes. Suppose we’re trying to “square the circle,” that is, find a square whose area equals the area of a given circle. The ratio of the side of the resulting square to the diameter of the original circle will be an irrational number, so an approximation will have to be used in computations.
    [Show full text]
  • Order Padé Approximation of Function and the Improvements
    mathematics Article A Few Iterative Methods by Using [1, n]-Order Padé Approximation of Function and the Improvements Shengfeng Li 1,* , Xiaobin Liu 2 and Xiaofang Zhang 1 1 Institute of Applied Mathematics, Bengbu University, Bengbu 233030, China; [email protected] 2 School of Computer Engineering, Bengbu University, Bengbu 233030, China; [email protected] * Correspondence: [email protected]; Tel.: +86-552-317-5158 Received: 15 November 2018; Accepted: 30 December 2018; Published: 7 January 2019 Abstract: In this paper, a few single-step iterative methods, including classical Newton’s method and Halley’s method, are suggested by applying [1, n]-order Padé approximation of function for finding the roots of nonlinear equations at first. In order to avoid the operation of high-order derivatives of function, we modify the presented methods with fourth-order convergence by using the approximants of the second derivative and third derivative, respectively. Thus, several modified two-step iterative methods are obtained for solving nonlinear equations, and the convergence of the variants is then analyzed that they are of the fourth-order convergence. Finally, numerical experiments are given to illustrate the practicability of the suggested variants. Henceforth, the variants with fourth-order convergence have been considered as the imperative improvements to find the roots of nonlinear equations. Keywords: nonlinear equations; Padé approximation; iterative method; order of convergence; numerical experiment 1. Introduction It is well known that a variety of problems in different fields of science and engineering require to find the solution of the nonlinear equation f (x) = 0 where f : I ! D, for an interval I ⊆ R and D ⊆ R, is a scalar function.
    [Show full text]
  • Big O Notation
    Big O notation (with a capital letter O, not a zero), also called Landau's symbol, is a symbolism used in complexity theory, computer science, and mathematics to describe the asymptotic behavior of functions. Basically, it tells you how fast a function grows or declines. Landau's symbol comes from the name of the German number theoretician Edmund Landau who invented the notation. The letter O is used because the rate of growth of a function is also called its order. For example, when analyzing some algorithm, one might find that the time (or the number of steps) it takes to complete a problem of size n is given by T(n) = 4 n2 - 2 n + 2. If we ignore constants (which makes sense because those depend on the particular hardware the program is run on) and slower growing terms, we could say "T(n) grows at the order of n2" and write:T(n) = O(n2). In mathematics, it is often important to get a handle on the error term of an approximation. For instance, people will write ex = 1 + x + x2 / 2 + O(x3) for x -> 0 to express the fact that the error is smaller in absolute value than some constant times x3 if x is close enough to 0. For the formal definition, suppose f(x) and g(x) are two functions defined on some subset of the real numbers. We write f(x) = O(g(x)) (or f(x) = O(g(x)) for x -> to be more precise) if and only if there exist constants N and C such that |f(x)| ≤ C |g(x)| for all x>N.
    [Show full text]