Numerical Integration of Ordinary Differential Equations Based on Trigonometric Polynomials

Total Page:16

File Type:pdf, Size:1020Kb

Numerical Integration of Ordinary Differential Equations Based on Trigonometric Polynomials Numerische Mathematik 3, 381 -- 397 (1961) Numerical integration of ordinary differential equations based on trigonometric polynomials By WALTER GAUTSCHI* There are many numerical methods available for the step-by-step integration of ordinary differential equations. Only few of them, however, take advantage of special properties of the solution that may be known in advance. Examples of such methods are those developed by BROCK and MURRAY [9], and by DENNIS Eg], for exponential type solutions, and a method by URABE and MISE [b~ designed for solutions in whose Taylor expansion the most significant terms are of relatively high order. The present paper is concerned with the case of periodic or oscillatory solutions where the frequency, or some suitable substitute, can be estimated in advance. Our methods will integrate exactly appropriate trigonometric poly- nomials of given order, just as classical methods integrate exactly algebraic polynomials of given degree. The resulting methods depend on a parameter, v=h~o, where h is the step length and ~o the frequency in question, and they reduce to classical methods if v-~0. Our results have also obvious applications to numerical quadrature. They will, however, not be considered in this paper. 1. Linear functionals of algebraic and trigonometric order In this section [a, b~ is a finite closed interval and C~ [a, b~ (s > 0) denotes the linear space of functions x(t) having s continuous derivatives in Fa, b~. We assume C s [a, b~ normed by s (t.tt IIxll = )2 m~x Ix~ (ttt. a=0 a~t~b A linear functional L in C ~[a, bl is said to be of algebraic order p, if (t.2) Lt': o (r : 0, 1 ..... p)' it is said to be of trigonometric order p, relative to period T, if (1.3) Lt=Lcos r 2z~ t =Lsln r ~-.t =0 (r=t,2 ..... p). Thus, a functional L is of algebraic order p if it annihilates all algebraic poly- nomials of degree =<p, and it is of trigonometric order p, relative to period T, if it annihilates all trigonometric polynomials of order =< p with period T. Functionals of trigonometric order p are comparable with those of algebraic order 2p, in the sense that both involve the same number of conditions. The * Oak Ridge National Laboratory, operated by Union Carbide Corporation for the U. S. Atomic Energy Commission, Oak Ridge, Tennessee. 382 WALTER GAUTSCtlI : relationship turns out to be much closer if we let L depend on the appropriate number of parameters. In fact, consider functionals of the form (1.4) L x=fll Ll X +... + ~2pL2p x + L2p+l x, where L~ (2 >--t) are fixed linear continuous functionals in Cs [a, bJ and //~ real parameters. Then the following theorem holds. Theorem 1. Let the ]unctionals L~ in (1.4) satis/y the /ollowing conditions: (i) L~t=0 (2=t,2 ..... 2p+t). (ii) There is a unique set o/ parameters, fla=flo, such that the/unctional L in (1.4) is o/algebraic order 2p, that is to say, (t.5) det (La~) . 0 (;~ row index, 2 column index I \z, 2=t,2 ..... 2p ] Then, /or T su//iciently large, there is also a unique set o/parameters, ~x=fl~ (T), such that L is o] trigonometric order p relative to period T. Furthermore, (1.6) &(r)-+~~ as r~ oo. Pro@ The main difficulty in the proof is the fact that in the limit, as T-+oc, equations (1.3) degenerate into one single equation, L t =0. We therefore trans- form (t.3) into an equivalent set of equations from which the behavior of the solution at T= oo can be studied more easily. In this connection the following trigonometric identities are helpful, r (1.7) sin2'~ = ~r -- cos r x) (r= t,2,3 .... ), 0=1 where ~,0 are suitable real numbers and r The existence of such numbers is obvious, if one observes that sin~' 2 =E(t--cosx)/21' can be written as a cosine-polynomial of exact order r. Differentiating both sides in (1.7) gives also (t.8) sin~r_l x cos-~- = 2 %o sin 0 x (r = t 2, 3 .... ) 2 2 ' ' o=1 where %0= Q~r~o/r, and in particular %,=cU, 4= 0. Equations (t.3) are equivalent to LI=0, L t--cosr-~t2~ ) =Lsmr. 2:rtT-t=O (r=l,2 ..... p). Because of assumption (i) the first of these equations is automatically satisfied. The remaining equations are equivalent to (1.9) a, oL t--cos~T~t = %oLsin~-T-t=0 (r=l,2 ..... p). 0=1 0=1 Numerical integration of ordinary differential equations 383 Using (t.7) and the linearity of L we have 2~ t)= L 2 a~o(l_ cos ~ T ,)_, [ ~, T ] " 0=1 0=1 Similarly, using (t.8), we find 2~ 2zrQLsin r Q=I Therefore, letting (t.10) u= ~ T' we can write (1.9), after suitable multiplications, as follows: L [( sinut)2r-lcosut} =0 (1.tl) (r= 1, 2 ..... p). This represents a system of 2p linear algebraic equations in the same number of unknowns/5~, the coefficient matrix and known vector of which both depend on the parameter u. We show that in the limit as u-~0 the system (t.tl) goes over into the system of equations Lt'=O (r=t, 2 ..... 2p). In fact, it is readily seen, by expansion or otherwise, that for any integers a~O, r>_t, as u--~O, da [( sin'~__ t )2r-l cos u ,] __> d~d a t2r-1, dt a d a (si~t) 2' d ~ ,~r, dt ~ .... § ~d~b- the convergence being uniform with respect to t in any finite interval. In par- ticular, ( sinu t ) 2r-1 /2r-1 cos u t -- --~ 0 (~ ~ 0), II \( sinuu~t/2"--1 ti" -+ 0 so that, by the continuity of the L a, also L sinut 2r--1 t2r_ 1 ~[(~ ) c~ L ~( sinutu )2r ->L~/2' From this our assertion follows immediately. Since the limiting system, by assumption, has a unique solution, flo, the matrix of the system (t.1t) is nonsingular for u=0, and hence remains so for u sufficiently small. It follows that for sufficiently large T there is a unique solution, fla(T), of (1.1t), satisfying (1.6). Theorem I is proved. 384 WALTER GAUTSCHI: Remark 1. Assumption (i) in Theorem t is not essential, but convenient for some of tile applications made later. The theorem holds without the assumption (i) if the functional L in (t.4) is made to depend on 2p+t parameters, (1.4') L x =/30 L o x +/51 L1 x +... + fl2p L2p x + L2p+l x, and assumption (t.5) is modified, accordingly, to (~ row index, ~ column index) (t.5') det (L~t~) ~ 0 \~,2=0, t ..... 2p " The proof remains the same. Remark 2. For particular choices of the La it may happen that the functional L can be made of higher algebraic order than the number of parameters would indicate. Even if the excess in order is a multiple of 2, this does not mean neces- sarily that a similar increase in trigonometric order is possible. For example, Lx=/5 x(0)+ x(t)--kx'(O)--~x'O), /5=--1 if of algebraic order 2, but in general cannot be made of trigonometric order 1, since 2. Linear multi-step methods Linear functionals in C 1 play an important r61e in the numerical solution of first order differential equations (2.t) x' = ! (t, x), x (to) = Xo, in that they provide the natural mathematical setting for a large class of numerical methods, the so-called linear multi-step methods. These are methods which define approximations x,~ to values x (to + mh) of the desired solution by a relation of the following form x~+ 1 + ~1 x~ +.-. + ~ x~+l_ k = h (/50 x'~+l +/51 x', +"" + & x:+l_k) (2.2) (n=k-- l,k,k + l .... ), where x~, =- ! (to + m h, xm). Once k "starting" values xo, x 1 ..... xk_ 1 are known, (2.2) is used to obtain successively all approximations x,~ (m_> k) desired. The integer k> 0 will be called the index of the multi-step method, assuming, of course, that not both ~k and/sk vanish. (2.2) is called an extrapolation method if/5o=-0, and an interpolation method if /5o =4= 0. Interpolation methods require the solution of an equation at each stage, because x'~+l in (2.2) is itself a function of the new approximation x~+ 1. It is natural to associate with (2.2) the linear functional k (2.3) gx=~',I~X(to+(n+l--2)h)--hfl~x'(to+(n+t--~)h)l (~0= t). A=0 The multi-step method (2.2) is called of algebraic order p, if its associated linear functional (2.3) is of algebraic order p; similarly one defines trigonometric order of a multi-step method. Numerical integration of ordinary differential equations 385 Since any linear transformation t' = at+ b (a =~ 0) of the independent variable transforms an algebraic polynomial of degree =<p into one of the same kind, it is clear that (2.2) is of algebraic order p if and only if the functional k (2.4) L 1 x = F, [~ x (k -- 4) -- fl~ x'(k -- 4)] A--0 is of algebraic order p. Here, the parameter h has dropped out, so that the coefficients ~, fl~ of a multi-step method of algebraic order do not depend on h. The situation is somewhat different in the trigonometric case, where a linear transformation other than a translation (or refiexion) changes the period of a trigonometric polynomial.
Recommended publications
  • Mathematical Construction of Interpolation and Extrapolation Function by Taylor Polynomials Arxiv:2002.11438V1 [Math.NA] 26 Fe
    Mathematical Construction of Interpolation and Extrapolation Function by Taylor Polynomials Nijat Shukurov Department of Engineering Physics, Ankara University, Ankara, Turkey E-mail: [email protected] , [email protected] Abstract: In this present paper, I propose a derivation of unified interpolation and extrapolation function that predicts new values inside and outside the given range by expanding direct Taylor series on the middle point of given data set. Mathemati- cal construction of experimental model derived in general form. Trigonometric and Power functions adopted as test functions in the development of the vital aspects in numerical experiments. Experimental model was interpolated and extrapolated on data set that generated by test functions. The results of the numerical experiments which predicted by derived model compared with analytical values. KEYWORDS: Polynomial Interpolation, Extrapolation, Taylor Series, Expansion arXiv:2002.11438v1 [math.NA] 26 Feb 2020 1 1 Introduction In scientific experiments or engineering applications, collected data are usually discrete in most cases and physical meaning is likely unpredictable. To estimate the outcomes and to understand the phenomena analytically controllable functions are desirable. In the mathematical field of nu- merical analysis those type of functions are called as interpolation and extrapolation functions. Interpolation serves as the prediction tool within range of given discrete set, unlike interpola- tion, extrapolation functions designed to predict values out of the range of given data set. In this scientific paper, direct Taylor expansion is suggested as a instrument which estimates or approximates a new points inside and outside the range by known individual values. Taylor se- ries is one of most beautiful analogies in mathematics, which make it possible to rewrite every smooth function as a infinite series of Taylor polynomials.
    [Show full text]
  • Stable Extrapolation of Analytic Functions
    STABLE EXTRAPOLATION OF ANALYTIC FUNCTIONS LAURENT DEMANET AND ALEX TOWNSEND∗ Abstract. This paper examines the problem of extrapolation of an analytic function for x > 1 given perturbed samples from an equally spaced grid on [−1; 1]. Mathematical folklore states that extrapolation is in general hopelessly ill-conditioned, but we show that a more precise statement carries an interesting nuance. For a function f on [−1; 1] that is analytic in a Bernstein ellipse with parameter ρ > 1, and for a uniform perturbation level " on the function samples, we construct an asymptotically best extrapolant e(x) as a least squares polynomial approximant of degree M ∗ given explicitly. We show that the extrapolant e(x) converges to f(x) pointwise in the interval −1 Iρ 2 [1; (ρ+ρ )=2) as " ! 0, at a rate given by a x-dependent fractional power of ". More precisely, for each x 2 Iρ we have p x + x2 − 1 jf(x) − e(x)j = O "− log r(x)= log ρ ; r(x) = ; ρ up to log factors, provided that the oversampling conditioning is satisfied. That is, 1 p M ∗ ≤ N; 2 which is known to be needed from approximation theory. In short, extrapolation enjoys a weak form of stability, up to a fraction of the characteristic smoothness length. The number of function samples, N + 1, does not bear on the size of the extrapolation error provided that it obeys the oversampling condition. We also show that one cannot construct an asymptotically more accurate extrapolant from N + 1 equally spaced samples than e(x), using any other linear or nonlinear procedure.
    [Show full text]
  • Numerical Solution of Ordinary Differential Equations
    NUMERICAL SOLUTION OF ORDINARY DIFFERENTIAL EQUATIONS Kendall Atkinson, Weimin Han, David Stewart University of Iowa Iowa City, Iowa A JOHN WILEY & SONS, INC., PUBLICATION Copyright c 2009 by John Wiley & Sons, Inc. All rights reserved. Published by John Wiley & Sons, Inc., Hoboken, New Jersey. Published simultaneously in Canada. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, (978) 750-8400, fax (978) 646-8600, or on the web at www.copyright.com. Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, (201) 748-6011, fax (201) 748-6008. Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts in preparing this book, they make no representations or warranties with respect to the accuracy or completeness of the contents of this book and specifically disclaim any implied warranties of merchantability or fitness for a particular purpose. No warranty may be created ore extended by sales representatives or written sales materials. The advice and strategies contained herin may not be suitable for your situation. You should consult with a professional where appropriate. Neither the publisher nor author shall be liable for any loss of profit or any other commercial damages, including but not limited to special, incidental, consequential, or other damages.
    [Show full text]
  • On Sharp Extrapolation Theorems
    ON SHARP EXTRAPOLATION THEOREMS by Dariusz Panek M.Sc., Mathematics, Jagiellonian University in Krak¶ow,Poland, 1995 M.Sc., Applied Mathematics, University of New Mexico, USA, 2004 DISSERTATION Submitted in Partial Ful¯llment of the Requirements for the Degree of Doctor of Philosophy Mathematics The University of New Mexico Albuquerque, New Mexico December, 2008 °c 2008, Dariusz Panek iii Acknowledgments I would like ¯rst to express my gratitude for M. Cristina Pereyra, my advisor, for her unconditional and compact support; her unbounded patience and constant inspi- ration. Also, I would like to thank my committee members Dr. Pedro Embid, Dr Dimiter Vassilev, Dr Jens Lorens, and Dr Wilfredo Urbina for their time and positive feedback. iv ON SHARP EXTRAPOLATION THEOREMS by Dariusz Panek ABSTRACT OF DISSERTATION Submitted in Partial Ful¯llment of the Requirements for the Degree of Doctor of Philosophy Mathematics The University of New Mexico Albuquerque, New Mexico December, 2008 ON SHARP EXTRAPOLATION THEOREMS by Dariusz Panek M.Sc., Mathematics, Jagiellonian University in Krak¶ow,Poland, 1995 M.Sc., Applied Mathematics, University of New Mexico, USA, 2004 Ph.D., Mathematics, University of New Mexico, 2008 Abstract Extrapolation is one of the most signi¯cant and powerful properties of the weighted theory. It basically states that an estimate on a weighted Lpo space for a single expo- p nent po ¸ 1 and all weights in the Muckenhoupt class Apo implies a corresponding L estimate for all p; 1 < p < 1; and all weights in Ap. Sharp Extrapolation Theorems track down the dependence on the Ap characteristic of the weight.
    [Show full text]
  • Numerical Integration
    Chapter 12 Numerical Integration Numerical differentiation methods compute approximations to the derivative of a function from known values of the function. Numerical integration uses the same information to compute numerical approximations to the integral of the function. An important use of both types of methods is estimation of derivatives and integrals for functions that are only known at isolated points, as is the case with for example measurement data. An important difference between differen- tiation and integration is that for most functions it is not possible to determine the integral via symbolic methods, but we can still compute numerical approx- imations to virtually any definite integral. Numerical integration methods are therefore more useful than numerical differentiation methods, and are essential in many practical situations. We use the same general strategy for deriving numerical integration meth- ods as we did for numerical differentiation methods: We find the polynomial that interpolates the function at some suitable points, and use the integral of the polynomial as an approximation to the function. This means that the truncation error can be analysed in basically the same way as for numerical differentiation. However, when it comes to round-off error, integration behaves differently from differentiation: Numerical integration is very insensitive to round-off errors, so we will ignore round-off in our analysis. The mathematical definition of the integral is basically via a numerical in- tegration method, and we therefore start by reviewing this definition. We then derive the simplest numerical integration method, and see how its error can be analysed. We then derive two other methods that are more accurate, but for these we just indicate how the error analysis can be done.
    [Show full text]
  • 3.2 Rational Function Interpolation and Extrapolation
    104 Chapter 3. Interpolation and Extrapolation do 11 i=1,n Here we find the index ns of the closest table entry, dift=abs(x-xa(i)) if (dift.lt.dif) then ns=i dif=dift endif c(i)=ya(i) and initialize the tableau of c’s and d’s. d(i)=ya(i) http://www.nr.com or call 1-800-872-7423 (North America only), or send email to [email protected] (outside North Amer readable files (including this one) to any server computer, is strictly prohibited. To order Numerical Recipes books or CDROMs, v Permission is granted for internet users to make one paper copy their own personal use. Further reproduction, or any copyin Copyright (C) 1986-1992 by Cambridge University Press. Programs Copyright (C) 1986-1992 by Numerical Recipes Software. Sample page from NUMERICAL RECIPES IN FORTRAN 77: THE ART OF SCIENTIFIC COMPUTING (ISBN 0-521-43064-X) enddo 11 y=ya(ns) This is the initial approximation to y. ns=ns-1 do 13 m=1,n-1 For each column of the tableau, do 12 i=1,n-m we loop over the current c’s and d’s and update them. ho=xa(i)-x hp=xa(i+m)-x w=c(i+1)-d(i) den=ho-hp if(den.eq.0.)pause ’failure in polint’ This error can occur only if two input xa’s are (to within roundoff)identical. den=w/den d(i)=hp*den Here the c’s and d’s are updated. c(i)=ho*den enddo 12 if (2*ns.lt.n-m)then After each column in the tableau is completed, we decide dy=c(ns+1) which correction, c or d, we want to add to our accu- else mulating value of y, i.e., which path to take through dy=d(ns) the tableau—forking up or down.
    [Show full text]
  • On the Numerical Solution of Equations Involving Differential Operators with Constant Coefficients 1
    ON THE NUMERICAL SOLUTION OF EQUATIONS 219 The author acknowledges with thanks the aid of Dolores Ufford, who assisted in the calculations. Yudell L. Luke Midwest Research Institute Kansas City 2, Missouri 1 W. E. Milne, "The remainder in linear methods of approximation," NBS, Jn. of Research, v. 43, 1949, p. 501-511. 2W. E. Milne, Numerical Calculus, p. 108-116. 3 M. Bates, On the Development of Some New Formulas for Numerical Integration. Stanford University, June, 1929. 4 M. E. Youngberg, Formulas for Mechanical Quadrature of Irrational Functions. Oregon State College, June, 1937. (The author is indebted to the referee for references 3 and 4.) 6 E. L. Kaplan, "Numerical integration near a singularity," Jn. Math. Phys., v. 26, April, 1952, p. 1-28. On the Numerical Solution of Equations Involving Differential Operators with Constant Coefficients 1. The General Linear Differential Operator. Consider the differential equation of order n (1) Ly + Fiy, x) = 0, where the operator L is defined by j» dky **£**»%- and the functions Pk(x) and Fiy, x) are such that a solution y and its first m derivatives exist in 0 < x < X. In the special case when (1) is linear the solution can be completely determined by the well known method of varia- tion of parameters when n independent solutions of the associated homo- geneous equations are known. Thus for the case when Fiy, x) is independent of y, the solution of the non-homogeneous equation can be obtained by mere quadratures, rather than by laborious stepwise integrations. It does not seem to have been observed, however, that even when Fiy, x) involves the dependent variable y, the numerical integrations can be so arranged that the contributions to the integral from the upper limit at each step of the integration, at the time when y is still unknown at the upper limit, drop out.
    [Show full text]
  • The Original Euler's Calculus-Of-Variations Method: Key
    Submitted to EJP 1 Jozef Hanc, [email protected] The original Euler’s calculus-of-variations method: Key to Lagrangian mechanics for beginners Jozef Hanca) Technical University, Vysokoskolska 4, 042 00 Kosice, Slovakia Leonhard Euler's original version of the calculus of variations (1744) used elementary mathematics and was intuitive, geometric, and easily visualized. In 1755 Euler (1707-1783) abandoned his version and adopted instead the more rigorous and formal algebraic method of Lagrange. Lagrange’s elegant technique of variations not only bypassed the need for Euler’s intuitive use of a limit-taking process leading to the Euler-Lagrange equation but also eliminated Euler’s geometrical insight. More recently Euler's method has been resurrected, shown to be rigorous, and applied as one of the direct variational methods important in analysis and in computer solutions of physical processes. In our classrooms, however, the study of advanced mechanics is still dominated by Lagrange's analytic method, which students often apply uncritically using "variational recipes" because they have difficulty understanding it intuitively. The present paper describes an adaptation of Euler's method that restores intuition and geometric visualization. This adaptation can be used as an introductory variational treatment in almost all of undergraduate physics and is especially powerful in modern physics. Finally, we present Euler's method as a natural introduction to computer-executed numerical analysis of boundary value problems and the finite element method. I. INTRODUCTION In his pioneering 1744 work The method of finding plane curves that show some property of maximum and minimum,1 Leonhard Euler introduced a general mathematical procedure or method for the systematic investigation of variational problems.
    [Show full text]
  • Bessel's Differential Equation Mathematical Physics
    R. I. Badran Bessel's Differential Equation Mathematical Physics Bessel's Differential Equation: 2 Recalling the DE y n y 0 which has a sinusoidal solution (i.e. sin nx and cos nx) and knowing that these solutions can be treated as power series, we can find a solution to the Bessel's DE which is written as: 2 2 2 x y xy (x p )y 0 . The solution is represented by a series. This series very much look like a damped sine or cosine. It is called a Bessel function. To solve the Bessel' DE, we apply the Frobenius method by mn assuming a series solution of the form y an x . n0 Substitute this solution into the DE equation and after some mathematical steps you may find that the indicial equation is 2 2 m p 0 where m= p. Also you may get a1=0 and hence all odd a's are zero as well. The recursion relation can be found as a a n n2 (n m 2)2 p 2 with (n=0, 1, 2, 3, ……etc.). Case (1): m= p (seeking the first solution of Bessel DE) We get the solution 2 4 p x x y a x 1 2(2p 2) 2 4(2p 2)(2p 4) This can be rewritten as: x p2n J (x) y a (1)n p 2n n0 2 n!( p n)! 1 Put a 2 p p! The Bessel function has the factorial form x p2n J (x) (1)n p 2n p , n0 n!( p n)!2 R.
    [Show full text]
  • Improving Numerical Integration and Event Generation with Normalizing Flows — HET Brown Bag Seminar, University of Michigan —
    Improving Numerical Integration and Event Generation with Normalizing Flows | HET Brown Bag Seminar, University of Michigan | Claudius Krause Fermi National Accelerator Laboratory September 25, 2019 In collaboration with: Christina Gao, Stefan H¨oche,Joshua Isaacson arXiv: 191x.abcde Claudius Krause (Fermilab) Machine Learning Phase Space September 25, 2019 1 / 27 Monte Carlo Simulations are increasingly important. https://twiki.cern.ch/twiki/bin/view/AtlasPublic/ComputingandSoftwarePublicResults MC event generation is needed for signal and background predictions. ) The required CPU time will increase in the next years. ) Claudius Krause (Fermilab) Machine Learning Phase Space September 25, 2019 2 / 27 Monte Carlo Simulations are increasingly important. 106 3 10− parton level W+0j 105 particle level W+1j 10 4 W+2j particle level − W+3j 104 WTA (> 6j) W+4j 5 10− W+5j 3 W+6j 10 Sherpa MC @ NERSC Mevt W+7j / 6 Sherpa / Pythia + DIY @ NERSC 10− W+8j 2 10 Frequency W+9j CPUh 7 10− 101 8 10− + 100 W +jets, LHC@14TeV pT,j > 20GeV, ηj < 6 9 | | 10− 1 10− 0 50000 100000 150000 200000 250000 300000 0 1 2 3 4 5 6 7 8 9 Ntrials Njet Stefan H¨oche,Stefan Prestel, Holger Schulz [1905.05120;PRD] The bottlenecks for evaluating large final state multiplicities are a slow evaluation of the matrix element a low unweighting efficiency Claudius Krause (Fermilab) Machine Learning Phase Space September 25, 2019 3 / 27 Monte Carlo Simulations are increasingly important. 106 3 10− parton level W+0j 105 particle level W+1j 10 4 W+2j particle level − W+3j 104 WTA (>
    [Show full text]
  • The Standard Form of a Differential Equation
    Fall 06 The Standard Form of a Differential Equation Format required to solve a differential equation or a system of differential equations using one of the command-line differential equation solvers such as rkfixed, Rkadapt, Radau, Stiffb, Stiffr or Bulstoer. For a numerical routine to solve a differential equation (DE), we must somehow pass the differential equation as an argument to the solver routine. A standard form for all DEs will allow us to do this. Basic idea: get rid of any second, third, fourth, etc. derivatives that appear, leaving only first derivatives. Example 1 2 d d 5 yx()+3 ⋅ yx()−5yx ⋅ () 4x⋅ 2 dx dx This DE contains a second derivative. How do we write a second derivative as a first derivative? A second derivative is a first derivative of a first derivative. d2 d d yx() yx() 2 dx dxxd Step 1: STANDARDIZATION d Let's define two functions y0(x) and y1(x) as y0()x yx() and y1()x y0()x dx Then this differential equation can be written as d 5 y1()x +3y ⋅ 1()x −5y ⋅ 0()x 4x dx This DE contains 2 functions instead of one, but there is a strong relationship between these two functions d y1()x y0()x dx So, the original DE is now a system of two DEs, d d 5 y1()x y0()x and y1()x +3y ⋅ 1()x −5y ⋅ 0()x 4x⋅ dx dx The convention is to write these equations with the derivatives alone on the left-hand side. d y0()x y1()x dx This is the first step in the standardization process.
    [Show full text]
  • A Brief Introduction to Numerical Methods for Differential Equations
    A Brief Introduction to Numerical Methods for Differential Equations January 10, 2011 This tutorial introduces some basic numerical computation techniques that are useful for the simulation and analysis of complex systems modelled by differential equations. Such differential models, especially those partial differential ones, have been extensively used in various areas from astronomy to biology, from meteorology to finance. However, if we ignore the differences caused by applications and focus on the mathematical equations only, a fundamental question will arise: Can we predict the future state of a system from a known initial state and the rules describing how it changes? If we can, how to make the prediction? This problem, known as Initial Value Problem(IVP), is one of those problems that we are most concerned about in numerical analysis for differential equations. In this tutorial, Euler method is used to solve this problem and a concrete example of differential equations, the heat diffusion equation, is given to demonstrate the techniques talked about. But before introducing Euler method, numerical differentiation is discussed as a prelude to make you more comfortable with numerical methods. 1 Numerical Differentiation 1.1 Basic: Forward Difference Derivatives of some simple functions can be easily computed. However, if the function is too compli- cated, or we only know the values of the function at several discrete points, numerical differentiation is a tool we can rely on. Numerical differentiation follows an intuitive procedure. Recall what we know about the defini- tion of differentiation: df f(x + h) − f(x) = f 0(x) = lim dx h!0 h which means that the derivative of function f(x) at point x is the difference between f(x + h) and f(x) divided by an infinitesimal h.
    [Show full text]