Polynomial Interpolation: Summary ∏

Total Page:16

File Type:pdf, Size:1020Kb

Polynomial Interpolation: Summary ∏ Polynomial Interpolation 1 Polynomial Interpolation: Summary • Statement of problem. We are given a table of n + 1 data points (xi,yi): x x0 x1 x2 ... xn y y0 y1 y2 ... yn and seek a polynomial p of lowest degree such that p(xi) = yi for 0 ≤ i ≤ n Such a polynomial is said to interpolate the data. • Finding the interpolating polynomial using the Vandermonde matrix. 2 n Here, pn(x) = ao +a1x +a2x +...+anx where the coefficients are found by imposing p(xi) = yi for each i = 0 to n. The resulting system is 2 n 1 x0 x0 ... x0 a0 y0 1 x x2 ... xn a y 1 1 1 1 1 1 x x2 ... xn a y 2 2 2 2 = 2 . . .. . . . . . 2 n 1 xn xn ... xn an yn The matrix above is called the Vandermonde matrix. If this was singular it would imply that for some nonzero set of coefficients the associated polynomial of degree ≤ n would have n + 1 zeros. This can’t be so this matrix equation can be solved for the unknown coefficients of the polynomial. • The Lagrange interpolation polynomial. n x − x p (x) = y ` (x) + y ` (x) + ... + y ` (x) where ` (x) = ∏ j n 0 0 1 1 n n i x − x j = 0 i j j 6= i • The Newton interpolation polynomial (Divided Differences) pn(x) = c0 + c1(x − x0) + c2(x − x0)(x − x1) + ... + cn(x − x0)(x − x1)···(x − xn−1) where these coefficients will be found using divided differences. It is fairly clear however that c0 = y0 and c = y1−y0 . For now, the remaining terms can be found by the recursive relationship described below. 1 x1−x0 Let p0(x) = y0 = c0, and k−1 k−1 pk(x) = pk−1(x) + ck ∏(x − xi) where ck = (yk − pk−1(xk))/(∏(xk − xi)) for 1 ≤ k ≤ n i=0 i=0 Polynomial Interpolation 2 • Existence and Uniqueness Theorem If x0,x1,...,xn are n + 1 distinct real numbers, then for arbitrary values y0,y1,...,yn, there is a unique polynomial pn of degree at most n such that pn(xi) = yi for 0 ≤ i ≤ n. Proof: We have proven the existence by finding such polynomials. To prove uniqueness suppose that qn and pn are two different polynomials of degree ≤ n which both interpolate the same data. Then the polynomial pn − qn is of degree ≤ n and the value of this polynomial is zero at n + 1 data points. But a polynomial of degree n has at most n zeros unless it is the zero polynomial. Therefore pn −qn = 0 and so pn = qn. ♦. Conclusion: All three methods of finding an interpolating polynomial result in the same polynomial, they are just expressed differently. • Approximation Error Theorem The error associated with approximating a function f (x) ∈ Cn+1[a,b] with a polynomial that interpolates f at n + 1 distinct points in [a,b] is given by f (x) = Pn(x) + En(x) (1) f (n+1)(η) E (x) = (x − x )(x − x ) ... (x − x ) (2) n 0 1 n (n + 1)! where η ∈ (a,b) and depends on x. proof: If x = xi for some i this is true because both sides = 0. Assume that x 6= xi for i = 0...n. Define w(t) = n ∏i=0(t − xi) and notice that w(x) 6= 0. Define φ(x) = f (x) − p(x) − λw(x) where λ = ( f (x) − p(x))/w(x) and notice that φ(x) ∈ Cn+1[a,b] and vanishes at n + 2 values of x. By Rolle’s theorem this implies that φ 0 vanishes at n + 1 points in (a,b). Continuing to generalized Rolle’s theorem: φ n+1 = 0 at (at least) one point, call it η. Now notice that φ n+1(η) = f n+1(η)−λ(n+1)! = 0. Recalling the value of λ and the form of w(x) gives the desired result. ♦ • Benefits of the various interpolation polynomials – Using the Vandermonde matrix is not a very good method for any situation. The system is ill- conditioned and therefore the coefficients may be calculated very inaccurately. Also the amount of work is excessive. – Using the Lagrange interpolating polynomial is well suited for using the same set of x-values for various y-values. In this case you could easily change the coefficients of the `i(x) functions to suit the desired y values. – Using the Newton interpolating polynomial is usually the best choice. It has the advantage that data pairs can be added and interpolated by merely adding one additional term to the previous interpolat- ing polynomial. Under other restrictions the coefficients give information about the derivatives of a function being approximated as well as the error. Polynomial Interpolation 3 • Chebyshev Polynomials T0(x) = 1 T1(x) = x Tn+1(x) = 2xTn(x) − Tn−1(x) It can be shown (not easily) that −1 Tn(x) = cos(n cos (x)) for x ∈ [−1,1] • Minimizing Error by Choosing Chebyshev Nodes In the Approximation Error Theorem we saw f (n+1)(η) n En(x) = ∏(x − xi) (n + 1)! i=0 The second term in the product on the right hand side can be minimized by choosing scaled values of the Chebyshev Nodes. These x values are chosen as the roots of Tn+1(x) with the result that 2i + 1 x = cos π for 0 ≤ i ≤ n where x ∈ [−1,1] i 2(n + 1) If we are dealing with a different interval: suppose [a,b] instead of [−1,1] we make the transformation: b − a t = a + (x + 1). i 2 i If we now choose ti as the nodes over which we interpolate our function, the error in the approximation should be minimized..
Recommended publications
  • Mathematical Construction of Interpolation and Extrapolation Function by Taylor Polynomials Arxiv:2002.11438V1 [Math.NA] 26 Fe
    Mathematical Construction of Interpolation and Extrapolation Function by Taylor Polynomials Nijat Shukurov Department of Engineering Physics, Ankara University, Ankara, Turkey E-mail: [email protected] , [email protected] Abstract: In this present paper, I propose a derivation of unified interpolation and extrapolation function that predicts new values inside and outside the given range by expanding direct Taylor series on the middle point of given data set. Mathemati- cal construction of experimental model derived in general form. Trigonometric and Power functions adopted as test functions in the development of the vital aspects in numerical experiments. Experimental model was interpolated and extrapolated on data set that generated by test functions. The results of the numerical experiments which predicted by derived model compared with analytical values. KEYWORDS: Polynomial Interpolation, Extrapolation, Taylor Series, Expansion arXiv:2002.11438v1 [math.NA] 26 Feb 2020 1 1 Introduction In scientific experiments or engineering applications, collected data are usually discrete in most cases and physical meaning is likely unpredictable. To estimate the outcomes and to understand the phenomena analytically controllable functions are desirable. In the mathematical field of nu- merical analysis those type of functions are called as interpolation and extrapolation functions. Interpolation serves as the prediction tool within range of given discrete set, unlike interpola- tion, extrapolation functions designed to predict values out of the range of given data set. In this scientific paper, direct Taylor expansion is suggested as a instrument which estimates or approximates a new points inside and outside the range by known individual values. Taylor se- ries is one of most beautiful analogies in mathematics, which make it possible to rewrite every smooth function as a infinite series of Taylor polynomials.
    [Show full text]
  • On Multivariate Interpolation
    On Multivariate Interpolation Peter J. Olver† School of Mathematics University of Minnesota Minneapolis, MN 55455 U.S.A. [email protected] http://www.math.umn.edu/∼olver Abstract. A new approach to interpolation theory for functions of several variables is proposed. We develop a multivariate divided difference calculus based on the theory of non-commutative quasi-determinants. In addition, intriguing explicit formulae that connect the classical finite difference interpolation coefficients for univariate curves with multivariate interpolation coefficients for higher dimensional submanifolds are established. † Supported in part by NSF Grant DMS 11–08894. April 6, 2016 1 1. Introduction. Interpolation theory for functions of a single variable has a long and distinguished his- tory, dating back to Newton’s fundamental interpolation formula and the classical calculus of finite differences, [7, 47, 58, 64]. Standard numerical approximations to derivatives and many numerical integration methods for differential equations are based on the finite dif- ference calculus. However, historically, no comparable calculus was developed for functions of more than one variable. If one looks up multivariate interpolation in the classical books, one is essentially restricted to rectangular, or, slightly more generally, separable grids, over which the formulae are a simple adaptation of the univariate divided difference calculus. See [19] for historical details. Starting with G. Birkhoff, [2] (who was, coincidentally, my thesis advisor), recent years have seen a renewed level of interest in multivariate interpolation among both pure and applied researchers; see [18] for a fairly recent survey containing an extensive bibli- ography. De Boor and Ron, [8, 12, 13], and Sauer and Xu, [61, 10, 65], have systemati- cally studied the polynomial case.
    [Show full text]
  • Easy Way to Find Multivariate Interpolation
    IJETST- Vol.||04||Issue||05||Pages 5189-5193||May||ISSN 2348-9480 2017 International Journal of Emerging Trends in Science and Technology IC Value: 76.89 (Index Copernicus) Impact Factor: 4.219 DOI: https://dx.doi.org/10.18535/ijetst/v4i5.11 Easy way to Find Multivariate Interpolation Author Yimesgen Mehari Faculty of Natural and Computational Science, Department of Mathematics Adigrat University, Ethiopia Email: [email protected] Abstract We derive explicit interpolation formula using non-singular vandermonde matrix for constructing multi dimensional function which interpolates at a set of distinct abscissas. We also provide examples to show how the formula is used in practices. Introduction Engineers and scientists commonly assume that past and currently. But there is no theoretical relationships between variables in physical difficulty in setting up a frame work for problem can be approximately reproduced from discussing interpolation of multivariate function f data given by the problem. The ultimate goal whose values are known.[1] might be to determine the values at intermediate Interpolation function of more than one variable points, to approximate the integral or to simply has become increasingly important in the past few give a smooth or continuous representation of the years. These days, application ranges over many variables in the problem different field of pure and applied mathematics. Interpolation is the method of estimating unknown For example interpolation finds applications in the values with the help of given set of observations. numerical integrations of differential equations, According to Theile Interpolation is, “The art of topography, and the computer aided geometric reading between the lines of the table” and design of cars, ships, airplanes.[1] According to W.M.
    [Show full text]
  • Spatial Interpolation Methods
    Page | 0 of 0 SPATIAL INTERPOLATION METHODS 2018 Page | 1 of 1 1. Introduction Spatial interpolation is the procedure to predict the value of attributes at unobserved points within a study region using existing observations (Waters, 1989). Lam (1983) definition of spatial interpolation is “given a set of spatial data either in the form of discrete points or for subareas, find the function that will best represent the whole surface and that will predict values at points or for other subareas”. Predicting the values of a variable at points outside the region covered by existing observations is called extrapolation (Burrough and McDonnell, 1998). All spatial interpolation methods can be used to generate an extrapolation (Li and Heap 2008). Spatial Interpolation is the process of using points with known values to estimate values at other points. Through Spatial Interpolation, We can estimate the precipitation value at a location with no recorded data by using known precipitation readings at nearby weather stations. Rationale behind spatial interpolation is the observation that points close together in space are more likely to have similar values than points far apart (Tobler’s Law of Geography). Spatial Interpolation covers a variety of method including trend surface models, thiessen polygons, kernel density estimation, inverse distance weighted, splines, and Kriging. Spatial Interpolation requires two basic inputs: · Sample Points · Spatial Interpolation Method Sample Points Sample Points are points with known values. Sample points provide the data necessary for the development of interpolator for spatial interpolation. The number and distribution of sample points can greatly influence the accuracy of spatial interpolation.
    [Show full text]
  • Comparison of Gap Interpolation Methodologies for Water Level Time Series Using Perl/Pdl
    Revista de Matematica:´ Teor´ıa y Aplicaciones 2005 12(1 & 2) : 157–164 cimpa – ucr – ccss issn: 1409-2433 comparison of gap interpolation methodologies for water level time series using perl/pdl Aimee Mostella∗ Alexey Sadovksi† Scott Duff‡ Patrick Michaud§ Philippe Tissot¶ Carl Steidleyk Received/Recibido: 13 Feb 2004 Abstract Extensive time series of measurements are often essential to evaluate long term changes and averages such as tidal datums and sea level rises. As such, gaps in time series data restrict the type and extent of modeling and research which may be accomplished. The Texas A&M University Corpus Christi Division of Nearshore Research (TAMUCC-DNR) has developed and compared various methods based on forward and backward linear regression to interpolate gaps in time series of water level data. We have developed a software system that retrieves actual and harmonic water level data based upon user provided parameters. The actual water level data is searched for missing data points and the location of these gaps are recorded. Forward and backward linear regression are applied in relation to the location of missing data or gaps in the remaining data. After this process is complete, one of three combinations of the forward and backward regression is used to fit the results. Finally, the harmonic component is added back into the newly supplemented time series and the results are graphed. The software created to implement this process of linear regression is written in Perl along with a Perl module called PDL (Perl Data Language). Generally, this process has demonstrated excellent results in filling gaps in our water level time series.
    [Show full text]
  • Bayesian Interpolation of Unequally Spaced Time Series
    Bayesian interpolation of unequally spaced time series Luis E. Nieto-Barajas and Tapen Sinha Department of Statistics and Department of Actuarial Sciences, ITAM, Mexico [email protected] and [email protected] Abstract A comparative analysis of time series is not feasible if the observation times are different. Not even a simple dispersion diagram is possible. In this article we propose a Gaussian process model to interpolate an unequally spaced time series and produce predictions for equally spaced observation times. The dependence between two obser- vations is assumed a function of the time differences. The novelty of the proposal relies on parametrizing the correlation function in terms of Weibull and Log-logistic survival functions. We further allow the correlation to be positive or negative. Inference on the model is made under a Bayesian approach and interpolation is done via the posterior predictive conditional distributions given the closest m observed times. Performance of the model is illustrated via a simulation study as well as with real data sets of temperature and CO2 observed over 800,000 years before the present. Key words: Bayesian inference, EPICA, Gaussian process, kriging, survival functions. 1 Introduction The majority of the literature on time series analysis assumes that the variable of interest, say Xt, is observed on a regular or equally spaced sequence of times, say t 2 f1; 2;:::g (e.g. Box et al. 2004; Chatfield 1989). Often, time series are observed at uneven times. Unequally spaced (also called unevenly or irregularly spaced) time series data occur naturally in many fields. For instance, natural disasters, such as earthquakes, floods and volcanic eruptions, occur at uneven intervals.
    [Show full text]
  • Multivariate Lagrange Interpolation 1 Introduction 2 Polynomial
    Alex Lewis Final Project Multivariate Lagrange Interpolation Abstract. Explain how the standard linear Lagrange interpolation can be generalized to construct a formula that interpolates a set of points in . We will also provide examples to show how the formula is used in practice. 1 Introduction Interpolation is a fundamental topic in Numerical Analysis. It is the practice of creating a function that fits a finite sampled data set. These sampled values can be used to construct an interpolant, which must fit the interpolated function at each date point. 2 Polynomial Interpolation “The Problem of determining a polynomial of degree one that passes through the distinct points and is the same as approximating a function for which and by means of a first degree polynomial interpolating, or agreeing with, the values of f at the given points. We define the functions and , And then define We can generalize this concept of linear interpolation and consider a polynomial of degree n that passes through n+1 points. In this case we can construct, for each , a function with the property that when and . To satisfy for each requires that the numerator of contains the term To satisfy , the denominator of must be equal to this term evaluated at . Thus, This is called the Th Lagrange Interpolating Polynomial The polynomial is given once again as, Example 1 If and , then is the polynomial that agrees with at , and ; that is, 3 Multivariate Interpolation First we define a function be an -variable multinomial function of degree . In other words, the , could, in our case be ; in this case it would be a 3 variable function of some degree .
    [Show full text]
  • Interpolation, Extrapolation, Etc
    Interpolation, extrapolation, etc. Prof. Ramin Zabih http://cs100r.cs.cornell.edu Administrivia Assignment 5 is out, due Wednesday A6 is likely to involve dogs again Monday sections are now optional – Will be extended office hours/tutorial Prelim 2 is Thursday – Coverage through today – Gurmeet will do a review tomorrow 2 Hillclimbing is usually slow m Lines with Lines with errors < 30 errors < 40 b 3 Extrapolation Suppose you only know the values of the distance function f(1), f(2), f(3), f(4) – What is f(5)? This problem is called extrapolation – Figuring out a value outside the range where you have data – The process is quite prone to error – For the particular case of temporal data, extrapolation is called prediction – If you have a good model, this can work well 4 Interpolation Suppose you only know the values of the distance function f(1), f(2), f(3), f(4) – What is f(2.5)? This problem is called interpolation – Figuring out a value inside the range where you have data • But at a point where you don’t have data – Less error-prone than extrapolation Still requires some kind of model – Otherwise, crazy things could happen between the data points that you know 5 Analyzing noisy temporal data Suppose that your data is temporal – Radar tracking of airplanes, or DJIA There are 3 things you might wish to do – Prediction: given data through time T, figure out what will happen at time T+1 – Estimation: given data through time T, figure out what actually happened at time T • Sometimes called filtering – Smoothing: given data through
    [Show full text]
  • Comparison of Spatial Interpolation Methods for the Estimation of Air Quality Data
    Journal of Exposure Analysis and Environmental Epidemiology (2004) 14, 404–415 r 2004 Nature Publishing Group All rights reserved 1053-4245/04/$30.00 www.nature.com/jea Comparison of spatial interpolation methods for the estimation of air quality data DAVID W. WONG,a LESTER YUANb AND SUSAN A. PERLINb aSchool of Computational Sciences, George Mason University, Fairfax, VA, USA bNational Center for Environmental Assessment, Washington, US Environmental Protection Agency, USA We recognized that many health outcomes are associated with air pollution, but in this project launched by the US EPA, the intent was to assess the role of exposure to ambient air pollutants as risk factors only for respiratory effects in children. The NHANES-III database is a valuable resource for assessing children’s respiratory health and certain risk factors, but lacks monitoring data to estimate subjects’ exposures to ambient air pollutants. Since the 1970s, EPA has regularly monitored levels of several ambient air pollutants across the country and these data may be used to estimate NHANES subject’s exposure to ambient air pollutants. The first stage of the project eventually evolved into assessing different estimation methods before adopting the estimates to evaluate respiratory health. Specifically, this paper describes an effort using EPA’s AIRS monitoring data to estimate ozone and PM10 levels at census block groups. We limited those block groups to counties visited by NHANES-III to make the project more manageable and apply four different interpolation methods to the monitoring data to derive air concentration levels. Then we examine method-specific differences in concentration levels and determine conditions under which different methods produce significantly different concentration values.
    [Show full text]
  • Polynomial Interpolation
    Numerical Methods 401-0654 6 Polynomial Interpolation Throughout this chapter n N is an element from the set N if not otherwise specified. ∈ 0 0 6.1 Polynomials D-ITET, ✬ ✩D-MATL Definition 6.1.1. We denote by n n 1 n := R t αnt + αn 1t − + ... + α1t + α0 R: α0, α1,...,αn R . P ∋ 7→ − ∈ ∈ the R-vectorn space of polynomials with degree n. o ≤ ✫ ✪ ✬ ✩ Theorem 6.1.2 (Dimension of space of polynomials). It holds that dim n = n +1 and n P P ⊂ 6.1 C∞(R). p. 192 ✫ ✪ n n 1 ➙ Remark 6.1.1 (Polynomials in Matlab). MATLAB: αnt + αn 1t − + ... + α0 Vector Numerical − Methods (αn, αn 1,...,α0) (ordered!). 401-0654 − △ Remark 6.1.2 (Horner scheme). Evaluation of a polynomial in monomial representation: Horner scheme p(t)= t t t t αnt + αn 1 + αn 2 + + α1 + α0 . ··· − − ··· Code 6.1: Horner scheme, polynomial in MATLAB format 1 function y = polyval (p,x) 2 y = p(1); for i =2: length (p), y = x y+p( i ); end ∗ D-ITET, D-MATL Asymptotic complexity: O(n) Use: MATLAB “built-in”-function polyval(p,x); △ 6.2 p. 193 6.2 Polynomial Interpolation: Theory Numerical Methods 401-0654 Goal: (re-)constructionofapolynomial(function)frompairs of values (fit). ✬ Lagrange polynomial interpolation problem ✩ Given the nodes < t < t < < tn < and the values y ,...,yn R compute −∞ 0 1 ··· ∞ 0 ∈ p n such that ∈P j 0, 1,...,n : p(t )= y . ∀ ∈ { } j j ✫ ✪ D-ITET, D-MATL 6.2 p. 194 6.2.1 Lagrange polynomials Numerical Methods 401-0654 ✬ ✩ Definition 6.2.1.
    [Show full text]
  • Sparse Polynomial Interpolation and Testing
    Sparse Polynomial Interpolation and Testing by Andrew Arnold A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Doctor of Philsophy in Computer Science Waterloo, Ontario, Canada, 2016 © Andrew Arnold 2016 I hereby declare that I am the sole author of this thesis. This is a true copy of the thesis, including any required final revisions, as accepted by my examiners. I understand that my thesis may be made electronically available to the public. ii Abstract Interpolation is the process of learning an unknown polynomial f from some set of its evalua- tions. We consider the interpolation of a sparse polynomial, i.e., where f is comprised of a small, bounded number of terms. Sparse interpolation dates back to work in the late 18th century by the French mathematician Gaspard de Prony, and was revitalized in the 1980s due to advancements by Ben-Or and Tiwari, Blahut, and Zippel, amongst others. Sparse interpolation has applications to learning theory, signal processing, error-correcting codes, and symbolic computation. Closely related to sparse interpolation are two decision problems. Sparse polynomial identity testing is the problem of testing whether a sparse polynomial f is zero from its evaluations. Sparsity testing is the problem of testing whether f is in fact sparse. We present effective probabilistic algebraic algorithms for the interpolation and testing of sparse polynomials. These algorithms assume black-box evaluation access, whereby the algorithm may specify the evaluation points. We measure algorithmic costs with respect to the number and types of queries to a black-box oracle.
    [Show full text]
  • Sparse Polynomial Interpolation Codes and Their Decoding Beyond Half the Minimum Distance *
    Sparse Polynomial Interpolation Codes and their Decoding Beyond Half the Minimum Distance * Erich L. Kaltofen Clément Pernet Dept. of Mathematics, NCSU U. J. Fourier, LIP-AriC, CNRS, Inria, UCBL, Raleigh, NC 27695, USA ÉNS de Lyon [email protected] 46 Allée d’Italie, 69364 Lyon Cedex 7, France www4.ncsu.edu/~kaltofen [email protected] http://membres-liglab.imag.fr/pernet/ ABSTRACT General Terms: Algorithms, Reliability We present algorithms performing sparse univariate pol- Keywords: sparse polynomial interpolation, Blahut's ynomial interpolation with errors in the evaluations of algorithm, Prony's algorithm, exact polynomial fitting the polynomial. Based on the initial work by Comer, with errors. Kaltofen and Pernet [Proc. ISSAC 2012], we define the sparse polynomial interpolation codes and state that their minimal distance is precisely the code-word length 1. INTRODUCTION divided by twice the sparsity. At ISSAC 2012, we have Evaluation-interpolation schemes are a key ingredient given a decoding algorithm for as much as half the min- in many of today's computations. Model fitting for em- imal distance and a list decoding algorithm up to the pirical data sets is a well-known one, where additional minimal distance. information on the model helps improving the fit. In Our new polynomial-time list decoding algorithm uses particular, models of natural phenomena often happen sub-sequences of the received evaluations indexed by to be sparse, which has motivated a wide range of re- an arithmetic progression, allowing the decoding for a search including compressive sensing [4], and sparse in- larger radius, that is, more errors in the evaluations terpolation of polynomials [23,1, 15, 13,9, 11].
    [Show full text]