Estimating Derivatives
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
A Short Course on Approximation Theory
A Short Course on Approximation Theory N. L. Carothers Department of Mathematics and Statistics Bowling Green State University ii Preface These are notes for a topics course offered at Bowling Green State University on a variety of occasions. The course is typically offered during a somewhat abbreviated six week summer session and, consequently, there is a bit less material here than might be associated with a full semester course offered during the academic year. On the other hand, I have tried to make the notes self-contained by adding a number of short appendices and these might well be used to augment the course. The course title, approximation theory, covers a great deal of mathematical territory. In the present context, the focus is primarily on the approximation of real-valued continuous functions by some simpler class of functions, such as algebraic or trigonometric polynomials. Such issues have attracted the attention of thousands of mathematicians for at least two centuries now. We will have occasion to discuss both venerable and contemporary results, whose origins range anywhere from the dawn of time to the day before yesterday. This easily explains my interest in the subject. For me, reading these notes is like leafing through the family photo album: There are old friends, fondly remembered, fresh new faces, not yet familiar, and enough easily recognizable faces to make me feel right at home. The problems we will encounter are easy to state and easy to understand, and yet their solutions should prove intriguing to virtually anyone interested in mathematics. The techniques involved in these solutions entail nearly every topic covered in the standard undergraduate curriculum. -
February 2009
How Euler Did It by Ed Sandifer Estimating π February 2009 On Friday, June 7, 1779, Leonhard Euler sent a paper [E705] to the regular twice-weekly meeting of the St. Petersburg Academy. Euler, blind and disillusioned with the corruption of Domaschneff, the President of the Academy, seldom attended the meetings himself, so he sent one of his assistants, Nicolas Fuss, to read the paper to the ten members of the Academy who attended the meeting. The paper bore the cumbersome title "Investigatio quarundam serierum quae ad rationem peripheriae circuli ad diametrum vero proxime definiendam maxime sunt accommodatae" (Investigation of certain series which are designed to approximate the true ratio of the circumference of a circle to its diameter very closely." Up to this point, Euler had shown relatively little interest in the value of π, though he had standardized its notation, using the symbol π to denote the ratio of a circumference to a diameter consistently since 1736, and he found π in a great many places outside circles. In a paper he wrote in 1737, [E74] Euler surveyed the history of calculating the value of π. He mentioned Archimedes, Machin, de Lagny, Leibniz and Sharp. The main result in E74 was to discover a number of arctangent identities along the lines of ! 1 1 1 = 4 arctan " arctan + arctan 4 5 70 99 and to propose using the Taylor series expansion for the arctangent function, which converges fairly rapidly for small values, to approximate π. Euler also spent some time in that paper finding ways to approximate the logarithms of trigonometric functions, important at the time in navigation tables. -
Approximation Atkinson Chapter 4, Dahlquist & Bjork Section 4.5
Approximation Atkinson Chapter 4, Dahlquist & Bjork Section 4.5, Trefethen's book Topics marked with ∗ are not on the exam 1 In approximation theory we want to find a function p(x) that is `close' to another function f(x). We can define closeness using any metric or norm, e.g. Z 2 2 kf(x) − p(x)k2 = (f(x) − p(x)) dx or kf(x) − p(x)k1 = sup jf(x) − p(x)j or Z kf(x) − p(x)k1 = jf(x) − p(x)jdx: In order for these norms to make sense we need to restrict the functions f and p to suitable function spaces. The polynomial approximation problem takes the form: Find a polynomial of degree at most n that minimizes the norm of the error. Naturally we will consider (i) whether a solution exists and is unique, (ii) whether the approximation converges as n ! 1. In our section on approximation (loosely following Atkinson, Chapter 4), we will first focus on approximation in the infinity norm, then in the 2 norm and related norms. 2 Existence for optimal polynomial approximation. Theorem (no reference): For every n ≥ 0 and f 2 C([a; b]) there is a polynomial of degree ≤ n that minimizes kf(x) − p(x)k where k · k is some norm on C([a; b]). Proof: To show that a minimum/minimizer exists, we want to find some compact subset of the set of polynomials of degree ≤ n (which is a finite-dimensional space) and show that the inf over this subset is less than the inf over everything else. -
IRJET-V3I8330.Pdf
International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395 -0056 Volume: 03 Issue: 08 | Aug-2016 www.irjet.net p-ISSN: 2395-0072 A comprehensive study on different approximation methods of Fractional order system Asif Iqbal and Rakesh Roshon Shekh P.G Scholar, Dept. of Electrical Engineering, NITTTR, Kolkata, West Bengal, India P.G Scholar, Dept. of Electrical Engineering, NITTTR, Kolkata, West Bengal, India ---------------------------------------------------------------------***--------------------------------------------------------------------- Abstract - Many natural phenomena can be more infinite dimensional (i.e. infinite memory). So for analysis, accurately modeled using non-integer or fractional order controller design, signal processing etc. these infinite order calculus. As the fractional order differentiator is systems are approximated by finite order integer order mathematically equivalent to infinite dimensional filter, it’s system in a proper range of frequencies of practical interest proper integer order approximation is very much important. [1], [2]. In this paper four different approximation methods are given and these four approximation methods are applied on two different examples and the results are compared both in time 1.1 FRACTIONAL CALCULAS: INRODUCTION domain and in frequency domain. Continued Fraction Expansion method is applied on a fractional order plant model Fractional Calculus [3], is a generalization of integer order and the approximated model is converted to its equivalent calculus to non-integer order fundamental operator D t , delta domain model. Then step response of both delta domain l and continuous domain model is shown. where 1 and t is the lower and upper limit of integration and Key Words: Fractional Order Calculus, Delta operator the order of operation is . -
High Order Gradient, Curl and Divergence Conforming Spaces, with an Application to NURBS-Based Isogeometric Analysis
High order gradient, curl and divergence conforming spaces, with an application to compatible NURBS-based IsoGeometric Analysis R.R. Hiemstraa, R.H.M. Huijsmansa, M.I.Gerritsmab aDepartment of Marine Technology, Mekelweg 2, 2628CD Delft bDepartment of Aerospace Technology, Kluyverweg 2, 2629HT Delft Abstract Conservation laws, in for example, electromagnetism, solid and fluid mechanics, allow an exact discrete representation in terms of line, surface and volume integrals. We develop high order interpolants, from any basis that is a partition of unity, that satisfy these integral relations exactly, at cell level. The resulting gradient, curl and divergence conforming spaces have the propertythat the conservationlaws become completely independent of the basis functions. This means that the conservation laws are exactly satisfied even on curved meshes. As an example, we develop high ordergradient, curl and divergence conforming spaces from NURBS - non uniform rational B-splines - and thereby generalize the compatible spaces of B-splines developed in [1]. We give several examples of 2D Stokes flow calculations which result, amongst others, in a point wise divergence free velocity field. Keywords: Compatible numerical methods, Mixed methods, NURBS, IsoGeometric Analyis Be careful of the naive view that a physical law is a mathematical relation between previously defined quantities. The situation is, rather, that a certain mathematical structure represents a given physical structure. Burke [2] 1. Introduction In deriving mathematical models for physical theories, we frequently start with analysis on finite dimensional geometric objects, like a control volume and its bounding surfaces. We assign global, ’measurable’, quantities to these different geometric objects and set up balance statements. -
Function Approximation Through an Efficient Neural Networks Method
Paper ID #25637 Function Approximation through an Efficient Neural Networks Method Dr. Chaomin Luo, Mississippi State University Dr. Chaomin Luo received his Ph.D. in Department of Electrical and Computer Engineering at Univer- sity of Waterloo, in 2008, his M.Sc. in Engineering Systems and Computing at University of Guelph, Canada, and his B.Eng. in Electrical Engineering from Southeast University, Nanjing, China. He is cur- rently Associate Professor in the Department of Electrical and Computer Engineering, at the Mississippi State University (MSU). He was panelist in the Department of Defense, USA, 2015-2016, 2016-2017 NDSEG Fellowship program and panelist in 2017 NSF GRFP Panelist program. He was the General Co-Chair of 2015 IEEE International Workshop on Computational Intelligence in Smart Technologies, and Journal Special Issues Chair, IEEE 2016 International Conference on Smart Technologies, Cleveland, OH. Currently, he is Associate Editor of International Journal of Robotics and Automation, and Interna- tional Journal of Swarm Intelligence Research. He was the Publicity Chair in 2011 IEEE International Conference on Automation and Logistics. He was on the Conference Committee in 2012 International Conference on Information and Automation and International Symposium on Biomedical Engineering and Publicity Chair in 2012 IEEE International Conference on Automation and Logistics. He was a Chair of IEEE SEM - Computational Intelligence Chapter; a Vice Chair of IEEE SEM- Robotics and Automa- tion and Chair of Education Committee of IEEE SEM. He has extensively published in reputed journal and conference proceedings, such as IEEE Transactions on Neural Networks, IEEE Transactions on SMC, IEEE-ICRA, and IEEE-IROS, etc. His research interests include engineering education, computational intelligence, intelligent systems and control, robotics and autonomous systems, and applied artificial in- telligence and machine learning for autonomous systems. -
A Rational Approximation to the Logarithm
A Rational Approximation to the Logarithm By R. P. Kelisky and T. J. Rivlin We shall use the r-method of Lanczos to obtain rational approximations to the logarithm which converge in the entire complex plane slit along the nonpositive real axis, uniformly in certain closed regions in the slit plane. We also provide error esti- mates valid in these regions. 1. Suppose z is a complex number, and s(l, z) denotes the closed line segment joining 1 and z. Let y be a positive real number, y ¿¿ 1. As a polynomial approxima- tion, of degree n, to log x on s(l, y) we propose p* G Pn, Pn being the set of poly- nomials with real coefficients of degree at most n, which minimizes ||xp'(x) — X|J===== max \xp'(x) — 1\ *e«(l.v) among all p G Pn which satisfy p(l) = 0. (This procedure is suggested by the observation that w = log x satisfies xto'(x) — 1=0, to(l) = 0.) We determine p* as follows. Suppose p(x) = a0 + aix + ■• • + a„xn, p(l) = 0 and (1) xp'(x) - 1 = x(x) = b0 + bix +-h bnxn . Then (2) 6o = -1 , (3) a,- = bj/j, j = 1, ■•-,«, and n (4) a0= - E Oj • .-i Thus, minimizing \\xp' — 1|| subject to p(l) = 0 is equivalent to minimizing ||«-|| among all i£P„ which satisfy —ir(0) = 1. This, in turn, is equivalent to maximiz- ing |7r(0) I among all v G Pn which satisfy ||ir|| = 1, in the sense that if vo maximizes |7r(0)[ subject to ||x|| = 1, then** = —iro/-7ro(0) minimizes ||x|| subject to —ir(0) = 1. -
Numerical Integration and Differentiation Growth And
Numerical Integration and Differentiation Growth and Development Ra¨ulSantaeul`alia-Llopis MOVE-UAB and Barcelona GSE Spring 2017 Ra¨ulSantaeul`alia-Llopis(MOVE,UAB,BGSE) GnD: Numerical Integration and Differentiation Spring 2017 1 / 27 1 Numerical Differentiation One-Sided and Two-Sided Differentiation Computational Issues on Very Small Numbers 2 Numerical Integration Newton-Cotes Methods Gaussian Quadrature Monte Carlo Integration Quasi-Monte Carlo Integration Ra¨ulSantaeul`alia-Llopis(MOVE,UAB,BGSE) GnD: Numerical Integration and Differentiation Spring 2017 2 / 27 Numerical Differentiation The definition of the derivative at x∗ is 0 f (x∗ + h) − f (x∗) f (x∗) = lim h!0 h Ra¨ulSantaeul`alia-Llopis(MOVE,UAB,BGSE) GnD: Numerical Integration and Differentiation Spring 2017 3 / 27 • Hence, a natural way to numerically obtain the derivative is to use: f (x + h) − f (x ) f 0(x ) ≈ ∗ ∗ (1) ∗ h with a small h. We call (1) the one-sided derivative. • Another way to numerically obtain the derivative is to use: f (x + h) − f (x − h) f 0(x ) ≈ ∗ ∗ (2) ∗ 2h with a small h. We call (2) the two-sided derivative. We can show that the two-sided numerical derivative has a smaller error than the one-sided numerical derivative. We can see this in 3 steps. Ra¨ulSantaeul`alia-Llopis(MOVE,UAB,BGSE) GnD: Numerical Integration and Differentiation Spring 2017 4 / 27 • Step 1, use a Taylor expansion of order 3 around x∗ to obtain 0 1 00 2 1 000 3 f (x) = f (x∗) + f (x∗)(x − x∗) + f (x∗)(x − x∗) + f (x∗)(x − x∗) + O3(x) (3) 2 6 • Step 2, evaluate the expansion (3) at x -
Quadrature Formulas and Taylor Series of Secant and Tangent
QUADRATURE FORMULAS AND TAYLOR SERIES OF SECANT AND TANGENT Yuri DIMITROV1, Radan MIRYANOV2, Venelin TODOROV3 1 University of Forestry, Sofia, Bulgaria [email protected] 2 University of Economics, Varna, Bulgaria [email protected] 3 Bulgarian Academy of Sciences, IICT, Department of Parallel Algorithms, Sofia, Bulgaria [email protected] Abstract. Second-order quadrature formulas and their fourth-order expansions are derived from the Taylor series of the secant and tangent functions. The errors of the approximations are compared to the error of the midpoint approximation. Third and fourth order quadrature formulas are constructed as linear combinations of the second- order approximations and the trapezoidal approximation. Key words: Quadrature formula, Fourier transform, generating function, Euler- Mclaurin formula. 1. Introduction Numerical quadrature is a term used for numerical integration in one dimension. Numerical integration in more than one dimension is usually called cubature. There is a broad class of computational algorithms for numerical integration. The Newton-Cotes quadrature formulas (1.1) are a group of formulas for numerical integration where the integrand is evaluated at equally spaced points. Let . The two most popular approximations for the definite integral are the trapezoidal approximation (1.2) and the midpoint approximation (1.3). The midpoint approximation and the trapezoidal approximation for the definite integral are Newton-Cotes quadrature formulas with accuracy . The trapezoidal and the midpoint approximations are constructed by dividing the interval to subintervals of length and interpolating the integrand function by Lagrange polynomials of degree zero and one. Another important Newton-Cotes quadrat -order accuracy and is obtained by interpolating the function by a second degree Lagrange polynomial. -
Topics in High-Dimensional Approximation Theory
TOPICS IN HIGH-DIMENSIONAL APPROXIMATION THEORY DISSERTATION Presented in Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the Graduate School of the Ohio State University By Yeonjong Shin Graduate Program in Mathematics The Ohio State University 2018 Dissertation Committee: Dongbin Xiu, Advisor Ching-Shan Chou Chuan Xue c Copyright by Yeonjong Shin 2018 ABSTRACT Several topics in high-dimensional approximation theory are discussed. The fundamental problem in approximation theory is to approximate an unknown function, called the target function by using its data/samples/observations. Depending on different scenarios on the data collection, different approximation techniques need to be sought in order to utilize the data properly. This dissertation is concerned with four different approximation methods in four different scenarios in data. First, suppose the data collecting procedure is resource intensive, which may require expensive numerical simulations or experiments. As the performance of the approximation highly depends on the data set, one needs to carefully decide where to collect data. We thus developed a method of designing a quasi-optimal point set which guides us where to collect the data, before the actual data collection procedure. We showed that the resulting quasi-optimal set notably outperforms than other standard choices. Second, it is not always the case that we obtain the exact data. Suppose the data is corrupted by unexpected external errors. These unexpected corruption errors can have big magnitude and in most cases are non-random. We proved that a well-known classical method, the least absolute deviation (LAD), could effectively eliminate the corruption er- rors. -
Interpolation Polynomials Which Give Best Order Of
transactions of the american mathematical society Volume 200, 1974 INTERPOLATIONPOLYNOMIALS WHICH GIVE BEST ORDER OF APPROXIMATIONAMONG CONTINUOUSLY DIFFERENTIABLE FUNCTIONSOF ARBITRARYFIXED ORDER ON [-1, +1] by A. K. VARMA Dedicated to Professor P. Turan ABSTRACT. The object of this paper is to show that there exists a poly- nomial Pn(x) of degree < 2n — 1 which interpolates a given function exactly at the zeros of nth Tchebycheff polynomial and for which \\f —Pn\\ < Ckwk(iln> f) where wfc(l/n, /) is the modulus of continuity of / of fcth order. 1. Introduction. The classical theorems of D. Jackson extend the Weierstrass approximation theorem by giving quantitative information on the degree of ap- proximation to a continuous function in terms of its smoothness. Specifically, Jackson proved Theorem 1. Let f(x) be continuous for \x\ < 1 and have modulus of continuity w(t). Then there exists a polynomial P(x) of degree n at most suchthat \f(x)-P(x)\ <Aw(l/n) for \x\ < 1, where A is a positive numer- ical constant. In 1951 S. B. Steckin [3] made an important generalization of the Jackson theorem. Theorem 2 (S. B. Steckin). Let k be a positive integer; then there exists a positive constant Ck such that for every fE C[-\, +1] we can find an algebraic polynomial Pn(x) of degree n so that (1.1) Hf-Pn\\<Ckwk(l/n,f), where wk(l/n, f) is the modulus of continuity of f(x) of kth order. During personal conversation in Poznan, S. B. Steckin raised the following Presented to the Society, April 20, 1973; received by the editors March 23, 1973 and, in revised form, December 7, 1973. -
"FOSLS on Curved Boundaries"
Approximated Flux Boundary Conditions for Raviart-Thomas Finite Elements on Domains with Curved Boundaries and Applications to First-Order System Least Squares von der Fakultät für Mathematik und Physik der Gottfried Wilhelm Leibniz Universität Hannover zur Erlangung des akademischen Grades Doktor der Naturwissenschaften Dr. rer. nat. genehmigte Dissertation von Dipl.-Math. Fleurianne Bertrand geboren am 06.06.1987 in Caen (Frankreich) 2014 2 Referent: Prof. Dr. Gerhard Starke Universität Duisburg-Essen Fakultät für Mathematik Thea-Leymann-Straße 9 45127 Essen Korreferent: Prof. Dr. James Adler Department of Mathematics Tufts University Bromfield-Pearson Building 503 Boston Avenue Medford, MA 02155 Korreferent: Prof. Dr. Joachim Escher Institut für Angewandte Mathematik Gottfried Wilhelm Leibniz Universität Hannover Welfengarten 1 30167 Hannover Tag der Promotion: 15.07.2014 Acknowledgement: This work was supported by the German Research Foundation (DFG) under grant STA402/10-1. 3 Abstract Optimal order convergence of a first-order system least squares method using lowest-order Raviart-Thomas elements combined with linear conforming elements is shown for domains with curved boundaries. Parametric Raviart-Thomas elements are presented in order to retain the optimal order of convergence in the higher-order case in combination with the isoparametric scalar elements. In particular, an estimate for the normal flux of the Raviart-Thomas elements on interpolated boundaries is derived in both cases. This is illustrated numerically for the Pois- son problem on the unit disk. As an application of the analysis derived for the Poisson problem, the effect of interpolated interface condition for a stationary two-phase flow problem is then studied. Keywords: Raviart-Thomas, Curved Boundaries, First-Order System Least Squares 4 Zusammenfassung Für Gebiete mit gekrümmten Rändern wird die optimale Konvergenzordnung einer Least Squares finite Elemente Methode für Systeme erster Ordnung mit Raviart-Thomas Elementen niedrig- ster Ordnung und linearen konformen Elementen gezeigt.