DOCSLIB.ORG

Function Approximation: Fourier, Chebyshev, Lagrange

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Function Approximation: Fourier, Chebyshev, Lagrange Function approximation: Fourier, Chebyshev, Lagrange ¾ Orthogonal functions ¾ Fourier Series ¾ Discrete Fourier Series ¾ Fourier Transform: properties ¾ Chebyshev polynomials ¾ Convolution ¾ DFT and FFT Scope: Understanding where the Fourier Transform comes from. Moving from the continuous to the discrete world. The concepts are the basis for pseudospectral methods and the spectral element approach. Orthogonal functions 1 Fourier Series: one way to derive them The Problem we are trying to approximate a function f(x) by another function gn (x) which consists of a sum over N orthogonal functions Φ(x) weighted by some coefficients an . N f()()() x≈ gN x =∑ i a i Φ x i=0 sn functiolanogOrtho 2 The Problem ... and we are looking for optimal functions in a least squares (l2 ) sense ... b 1 / 2 ⎡ 2 ⎤ f x()()()() g− x = f{} x − g x=Min dx ! N 2 ⎢∫ N ⎥ ⎣a ⎦ ... a good choice for the basis functions Φ(x) are orthogonal functions. are orthogonal functions? What Two functions f and g are said to be orthogonal in the interval [a,b] if b f( x∫ ) g ( x )= dx 0 a How is this related to the more conceivble concept of orthogonal a vectors? Let us look at the original definition of integrals: sn functiolanogOrtho 3 Orthogonal Functions b ⎛ N ⎞ (f ) x ( g ) x= dx limf⎜ xi g ( i Δ x )⎟ ( x ) ∫ N→ ∞∑ a ⎝ i=1 ⎠ ... where x0 =a and xN =b, and xi-x i-1 =Δx ... If we interpret f(xi) and g(xicomponents of an N component ) as the ith vector, then this sum corresponds directly to a scalar product of vectors. The vanishing of the scalar product is the condition for orthogonality of vectors (or functions). f• g = f g0 = g i i∑ i i fi i i sn functiolanogOrtho 4 Periodic functions Let us assume we have a piecewise continuous function of the form f( x 2+ π )= f ( x ) 40 30 f( x+ 2π ) = f ( x ) =2 x 20 10 0 -15 -10 -5 0 5 10 15 20 ... we want to approximate this function with a linear combination of 2π periodic functions: 1 , cos( ), sin( ),x cos( x 2 ), x sin( x 2nx ),..., nx cos( ), sin( ) 1 N f x⇒()() g ≈ xN a =0 ∑cos({} a +k ) kx+ k sin( b kx ) 2 k=1 sn functiolanogOrtho 5 Orthogonality ... are these functions orthogonal ? ⎧ 0 j≠ k π ⎪ cos(∫ jx ) cos( kx= dx⎨ 2 ) π j= k =0 − π ⎪ ⎩ π j= k >0 0⎧ j≠ k , j , k > 0 π ⎪ sin(∫ jx ) sin( kx= dx⎨ ) − π ⎪ ⎩π j= k >0 π cos(∫ jx ) sin( kx= dx )j≥ 00 , k > 0 − π ... YES, and these relations are valid for any interval of length 2π. this is an orthogNow we know that how can we obtain the onal basis, but coefficients for the basis functions? f(x)-g(x)from minimising sn functiolanogOrtho 6 Fourier coefficients optimal functions g(x) are given if (g ) x− ( f ) x = Minor ! ∂ g( ) x− ( f ) x = 0 n 2 ∂a k { n 2 } ... with the definition of g(x) we get ... 2 ⎡ π N ⎤ ∂ 2 ∂ ⎡ 1 ⎤ g()()n x− f x = a⎢ ⎢ 0 a+ ∑cos({}k kx )+ bk sin( kx− ) f⎥ x (⎥ ) dx ∂a 2 ∂a ∫ 2 k k ⎣⎢ − π ⎣ k =1 ⎦ ⎦⎥ leading to 1 N g xN()= a0 cos( +∑ a{}k ) kx+ k sin( b ) kx with 2 k =1 1 π a= ( f ) x cos( kx ) dx , 0k = , 1 ,...,N k ∫ π −π 1 π b= ( f ) x sin( kx ) dx , 1k ,= 2 ,...,N k ∫ π −π sn functiolanogOrtho 7 Fourier approximation of |x| ... Example ... f(), x= x −π ≤x ≤ π leads to the Fourier Serie 1 4⎧ cos(x cos( ) x 3cos( ) x 5 )⎫ g() x=π − ⎨ + + + ... ⎬ 2 π ⎩ 1 2 3 2 5 2 ⎭ .. and for n<4 g(x) looks like 4 3 2 1 0 -20 -15 -10 -5 0 5 10 sn functiolanogOrtho 8 Fourier approximation of x2 ... another Example ... (f ) x= 2 , x < 0x < π 2 leads to the Fourier Serie 4π 2 N ⎧ 4 4π ⎫ g() x cos(kx ) sin(kx ) N = +∑ ⎨ 2 − ⎬ 3 k =1 ⎩ k k ⎭ .. and for N<11, g(x) looks like 40 30 20 10 0 -10 -10 -5 0 5 10 sn functiolanogOrtho 9 discrete functionsFourier - ... what happens if we know our function f(x) only at the points 2π x = i i N it turns out that in this particular case the coefficients are given by 2 N a * = (f ) x cos( kx ) ,0k ,= 1 , 2 ,... k ∑ j j N j =1 2 N b * = (f ) x sin( kx ) ,1k ,= 2 , 3 ,... k ∑ j j N j =1 .. the so-defined Fourier polynomial is the unique interpolating function to the function f(xj) with N=2m 1 m −1 1 g x*() a=* a + cos(* kx )+ b* sin(+ kx* )cos( a ) kx m 0 ∑ {}k k m 2 k =1 2 sn functiolanogOrtho 10 Fourier - collocation points ... with the important property that ... * g()()m x i = fi x ... in our previous examples ... 3.5 3 2.5 2 1.5 1 0.5 0 -10 -5 0 5 f(x)=|x| => f(x) - blue ; g(x) - red; xi -‘+’ Orthogonal functions 11 Fourier series - convergence 2 f(x)=x => f(x) - blue ; g(x) - red; xi -‘+’ Orthogonal functions 12 Fourier series - convergence 2 f(x)=x => f(x) - blue ; g(x) - red; xi -‘+’ Orthogonal functions 13 Gibb’s phenomenon 2 f(x)=x => f(x) - blue ; g(x) - red; xi -‘+’ N = 16 N = 32 6 6 6 4 4 4 2 2 2 0 0 0 -2 -2 -2 -4 -4 -4 -6 -6 -6 0 0.5 1 1.5 0 0.5 1 1.5 0 0.5 N = 128 N = 256 6 6 4 4 The overshoot for equi- 2 2 spaced Fourier 0 0 interpolations is ≈14% of -2 -2 the step height. -4 -4 -6 -6 0 0.5 1 1.5 0 0.5 1 1.5 Orthogonal functions 14 Chebyshev polynomials We have seen that Fourier series are excellent for interpolating (and differentiating) periodic functions defined on a regularly spaced grid. In many circumstances physical phenomena which are not periodic (in space) and occur in a limited area. This quest leads to the use of Chebyshev polynomials. We depart by observing that cos(nϕ) can be expressed by a polynomial in cos(ϕ): cos( 2ϕ )= 22 ϕ cos− 1 cos( 3 )ϕ = 4 cosϕ3 − ϕ 3 cos cos( 4 )ϕ 8= cos4 ϕ − 2 8ϕ + cos 1 ... which leads us to the definition: Orthogonal functions 15 definitionpolynomials - Chebyshev cos( )nϕ = Tn (cos(ϕ T= n x))cos(= x ( ),ϕ ),x ∈ − [ 1 ,n 1∈ ], N for the Chebyshev polynomials T... n (x). Note that because of x=cos(ϕ) they are defined in the interval [-1,1] (which - however - can be extended to ℜ). The first polynomials are T(0 ) x= 1 T1() x= x 2 T(2 ) x= 2 x − 1 3 T(3 x )= 4 x − 3 x 4 2 T(4 ) x= 8 x − 8 x + 1 where ( ) 1Tn x ≤ forx∈ [ 1− , 1 ]n∈ and N0 sn functiolanogOrtho 16 Chebyshev polynomials - Graphical The first ten polynomials look like [0, -1] 1 0.5 0 T_n(x) -0.5 -1 0 0.2 0.4 0.6 0.8 x The n-th polynomial has extrema with values 1 or -1 at kπ x()ext =cos( ),0 ,k 1= , 2 , 3n ,..., k n Orthogonal functions 17 Chebyshev collocation points These extrema are not equidistant (like the Fourier extrema) k x(k) kπ x()ext =cos( ),0 ,k 1= , 2 , 3n ,..., k n Orthogonal functions 18 orthogonalityChebyshev polynomials - ... are the Chebyshev polynomials orthogonal? Chebyshev polynomials are an orthogonal set of functions in the interval [-1,1] with respect to the weight function 1 /− 1x2 such that ⎧ 0 for≠ k j⎫ 1 dx ⎪ ⎪ T()() x T x = π/ 2 for= k >0 j ,,k j∈ N ∫ k j 2 ⎨ ⎬ 0 −1 1 − x ⎪ ⎪ ⎩ π for= k =0 j ⎭ this can be easily... verified noting that x =cosϕ , dx = −sinϕdϕ ( )T xk cos(= kϕ ),j T (= )xϕ cos( j ) sn functiolanogOrtho 19 nterpolationiChebyshev polynomials - ... we are now faced with the same problem as with the Fourier series. We want to approximate a function f(x), this time not a periodical function but a function which is defined between [-1,1]. We are looking for gn (x) 1 n f x()() g≈ xn = c0()() T 0 + x∑ k k c T x 2 k =1 ... and we are faced with the problem, how we can determine the coefficients ck. Again we obtain this by finding the extremum (minimum) ∂ ⎡ 1 dx ⎤ g{}()() x− f2 x = 0 ⎢∫ n 2 ⎥ ∂ck ⎣−1 1− x ⎦ sn functiolanogOrtho 20 nterpolationiChebyshev polynomials - ... to obtain ... 2 1 dx c= f()() x T, x 0k ,= 1 , 2n ,..., k ∫ k 2 π −1 1 − x ... surprisingly these coefficients can be calculated with FFT techniques, noting that 2 π (cosc= ) f ϕ cosk ϕ d , ϕ = k 0 , 1n , 2 ,..., k ∫ π 0 ... and the fact that f(cosϕ) is a 2π-periodic function ... 1 π (cosc= ) f ϕ cosk ϕ d , ϕ = k 0 , 1n , 2 ,..., k ∫ π −π ... which means that the coefficients ck are the Fourier coefficients ak of the periodic function F(ϕ)=f(cos ϕ)! sn functiolanogOrtho 21 Chebyshev discrete functions- ... what happens if we know our function f(x) only at the points π x = cos i i N in this particular case the coefficients are given by 2 N c * = (cosf ϕ ) cos(k ϕ 0 ) ,k , 1= , 2 ,...N / 2 k ∑ j j N j =1 ..
Load more

Recommended publications
  • EOF/PC Analysis
    ATM 552 Notes: Matrix Methods: EOF, SVD, ETC. D.L.Hartmann Page 68 4. Matrix Methods for Analysis of Structure in Data Sets: Empirical Orthogonal Functions, Principal Component Analysis, Singular Value Decomposition, Maximum Covariance Analysis, Canonical Correlation Analysis, Etc. In this chapter we discuss the use of matrix methods from linear algebra, primarily as a means of searching for structure in data sets. Empirical Orthogonal Function (EOF) analysis seeks structures that explain the maximum amount of variance in a two-dimensional data set. One dimension in the data set represents the dimension in which we are seeking to find structure, and the other dimension represents the dimension in which realizations of this structure are sampled. In seeking characteristic spatial structures that vary with time, for example, we would use space as the structure dimension and time as the sampling dimension. The analysis produces a set of structures in the first dimension, which we call the EOF’s, and which we can think of as being the structures in the spatial dimension. The complementary set of structures in the sampling dimension (e.g. time) we can call the Principal Components (PC’s), and they are related one-to-one to the EOF’s. Both sets of structures are orthogonal in their own dimension. Sometimes it is helpful to sacrifice one or both of these orthogonalities to produce more compact or physically appealing structures, a process called rotation of EOF’s. Singular Value Decomposition (SVD) is a general decomposition of a matrix. It can be used on data matrices to find both the EOF’s and PC’s simultaneously.
    [Show full text]
  • Complete Set of Orthogonal Basis Mathematical Physics
    R. I. Badran Complete set of orthogonal basis Mathematical Physics Complete set of orthogonal functions Discrete set of vectors: ˆ ˆ ˆ ˆ ˆ ˆ The two vectors A AX i A y j Az k and B BX i B y j Bz k are 3 orthogonal if A B 0 or Ai Bi 0 . i1 Continuous set of functions on an interval (a, b): a) The two continuous functions A(x) and B (x) are orthogonal b on the interval (a, b) if A(x)B(x)dx 0. a b) The two complex functions A (x) and B (x) are orthogonal on b the interval (a, b) if A (x)B(x)dx 0 , where A*(x) is the a complex conjugate of A (x). c) For a whole set of functions An (x) (where n= 1, 2, 3,) and on the interval (a, b) b 0 if m n An (x)Am (x)dx a , const.t 0 if m n An (x) is called a set of orthogonal functions. Examples: 0 m n sin nx sin mxdx i) , m n 0 where sin nx is a set of orthogonal functions on the interval (-, ). Similarly 0 m n cos nx cos mxdx if if m n 0 R. I. Badran Complete set of orthogonal basis Mathematical Physics ii) sin nx cos mxdx 0 for any n and m 0 (einx ) eimxdx iii) 2 1 vi) P (x)Pm (x)dx 0 unless. m 1 [Try to prove this; also solve problems (2, 5) of section 6].
    [Show full text]
  • A Complete System of Orthogonal Step Functions
    PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 132, Number 12, Pages 3491{3502 S 0002-9939(04)07511-2 Article electronically published on July 22, 2004 A COMPLETE SYSTEM OF ORTHOGONAL STEP FUNCTIONS HUAIEN LI AND DAVID C. TORNEY (Communicated by David Sharp) Abstract. We educe an orthonormal system of step functions for the interval [0; 1]. This system contains the Rademacher functions, and it is distinct from the Paley-Walsh system: its step functions use the M¨obius function in their definition. Functions have almost-everywhere convergent Fourier-series expan- sions if and only if they have almost-everywhere convergent step-function-series expansions (in terms of the members of the new orthonormal system). Thus, for instance, the new system and the Fourier system are both complete for Lp(0; 1); 1 <p2 R: 1. Introduction Analytical desiderata and applications, ever and anon, motivate the elaboration of systems of orthogonal step functions|as exemplified by the Haar system, the Paley-Walsh system and the Rademacher system. Our motivation is the example- based classification of digitized images, represented by rational points of the real interval [0,1], the domain of interest in the sequel. It is imperative to establish the \completeness" of any orthogonal system. Much is known, in this regard, for the classical systems, as this has been the subject of numerous investigations, and we use the latter results to establish analogous properties for the orthogonal system developed herein. h i RDefinition 1. Let the inner product f(x);g(x) denote the Lebesgue integral 1 0 f(x)g(x)dx: Definition 2.
    [Show full text]
  • FOURIER ANALYSIS 1. the Best Approximation Onto Trigonometric
    FOURIER ANALYSIS ERIK LØW AND RAGNAR WINTHER 1. The best approximation onto trigonometric polynomials Before we start the discussion of Fourier series we will review some basic results on inner–product spaces and orthogonal projections mostly presented in Section 4.6 of [1]. 1.1. Inner–product spaces. Let V be an inner–product space. As usual we let u, v denote the inner–product of u and v. The corre- sponding normh isi given by v = v, v . k k h i A basic relation between the inner–productp and the norm in an inner– product space is the Cauchy–Scwarz inequality. It simply states that the absolute value of the inner–product of u and v is bounded by the product of the corresponding norms, i.e. (1.1) u, v u v . |h i|≤k kk k An outline of a proof of this fundamental inequality, when V = Rn and is the standard Eucledian norm, is given in Exercise 24 of Section 2.7k·k of [1]. We will give a proof in the general case at the end of this section. Let W be an n dimensional subspace of V and let P : V W be the corresponding projection operator, i.e. if v V then w∗ =7→P v W is the element in W which is closest to v. In other∈ words, ∈ v w∗ v w for all w W. k − k≤k − k ∈ It follows from Theorem 12 of Chapter 4 of [1] that w∗ is characterized by the conditions (1.2) v P v, w = v w∗, w =0 forall w W.
    [Show full text]
  • Function Spaces, Orthogonal Functions and Fourier Series
    Orthogonal Functions and Fourier Series University of Texas at Austin CS384G - Computer Graphics Spring 2010 Don Fussell Vector Spaces Set of vectors Closed under the following operations Vector addition: v1 + v2 = v3 Scalar multiplication: s v1 = v2 n Linear combinations: a v v ! i i = i=1 Scalars come from some field F e.g. real or complex numbers Linear independence Basis Dimension University of Texas at Austin CS384G - Computer Graphics Spring 2010 Don Fussell Vector Space Axioms Vector addition is associative and commutative Vector addition has a (unique) identity element (the 0 vector) Each vector has an additive inverse So we can define vector subtraction as adding an inverse Scalar multiplication has an identity element (1) Scalar multiplication distributes over vector addition and field addition Multiplications are compatible (a(bv)=(ab)v) University of Texas at Austin CS384G - Computer Graphics Spring 2010 Don Fussell Coordinate Representation Pick a basis, order the vectors in it, then all vectors in the space can be represented as sequences of coordinates, i.e. coefficients of the basis vectors, in order. Example: Cartesian 3-space Basis: [i j k] Linear combination: xi + yj + zk Coordinate representation: [x y z] a[x1 y1 z1]+ b[x2 y2 z2 ] = [ax1 + bx2 ay1 + by2 az1 + bz2 ] University of Texas at Austin CS384G - Computer Graphics Spring 2010 Don Fussell Functions as vectors Need a set of functions closed under linear combination, where Function addition is defined Scalar multiplication is defined Example: Quadratic polynomials Monomial (power) basis: [x2 x 1] Linear combination: ax2 + bx + c Coordinate representation: [a b c] University of Texas at Austin CS384G - Computer Graphics Spring 2010 Don Fussell Metric spaces Define a (distance) metric d( v 1 , v 2 ) ! R s.t.
    [Show full text]
  • On Orthogonal Polynomial Bases for Triangles and Tetrahedra Invariant Under the Symmetric Group
    ContemporaryContemporary Mathematics VolumeVolume 218218,, 1998 1998 B 0-8218-0988-1-03040-5 On Orthogonal Polynomial Bases for Triangles and Tetrahedra Invariant under the Symmetric Group Gary Man-Kwong Hui and Howard Swann 1. Introduction th We present an L2-orthonormal polynomial basis for triangles containing 10 degree polynomials in its span. The sixty-six basis functions are defined by using 35 generating functions Bk(x, y) with the property that Bk(x, y) is orthogonal { } to Bk(y,x) unless they are equal. For tetrahedra, we describe methods for con- structing a an L2-orthonormal basis by defining generating functions Bk(x, y, z) such that the action of S3 on the arguments of Bk can provide as many as six orthogonal basis functions. Thirty-five basis functions generated by 11 Bk have been computed. These bases are particularly useful for approximating the solution of partial differential equations using the Cell Discretization Algorithm (CDA). The CDA allows a user to partition the domain of a problem into ‘cells’, choose any basis on each cell, and then ‘glue’ the finite dimensional approximations on each cell together across cell interfaces to achieve a form of weak continuity using a method called ‘moment collocation.’ This method allows a user to select a basis tailored to the type of an equation or the geometry of the cells without having to worry about continuity of an approximation. If polynomial bases are used and we have planar interfaces between cells, we can impose sufficient collocation moments so that our approximations are continuous and we duplicate the h p finite element method [9].
    [Show full text]
  • Some Special Orthogonal Functions
    Lecture 4.6: Some special orthogonal functions Matthew Macauley Department of Mathematical Sciences Clemson University http://www.math.clemson.edu/~macaule/ Math 4340, Advanced Engineering Mathematics M. Macauley (Clemson) Lecture 4.6: Some special orthogonal functions Advanced Engineering Mathematics 1 / 13 Motivation Recall that every 2nd order linear homogeneous ODE, y 00 + P(x)y 0 + Q(x)y = 0 can be written in self-adjoint or \Sturm-Liouville form": d − p(x)y 0 + q(x)y = λw(x)y; where p(x), q(x), w(x) > 0. dx Many of these ODEs require the Frobenius method to solve. Examples from physics and engineering Legendre's equation: (1 − x2)y 00 − 2xy 0 + n(n + 1)y = 0. Used for modeling spherically symmetric potentials in the theory of Newtonian gravitation and in electricity & magnetism (e.g., the wave equation for an electron in a hydrogen atom). Parametric Bessel's equation: x2y 00 + xy 0 + (λx2 − ν2)y = 0. Used for analyzing vibrations of a circular drum. Chebyshev's equation: (1 − x2)y 00 − xy 0 + n2y = 0. Arises in numerical analysis techniques. Hermite's equation: y 00 − 2xy 0 + 2ny = 0. Used for modeling simple harmonic oscillators in quantum mechanics. Laguerre's equation: xy 00 + (1 − x)y 0 + ny = 0. Arises in a number of equations from quantum mechanics. Airy's equation: y 00 − k2xy = 0. Models the refraction of light. M. Macauley (Clemson) Lecture 4.6: Some special orthogonal functions Advanced Engineering Mathematics 2 / 13 Legendre's differential equation Consider the following Sturm-Liouville problem, defined on (−1; 1): d h d i h i − (1 − x2) y = λy; p(x) = 1 − x2; q(x) = 0; w(x) = 1 : dx dx The eigenvalues are λn = n(n + 1) for n = 1; 2;::: , and the eigenfunctions solve Legendre's equation: (1 − x2)y 00 − 2xy 0 + n(n + 1)y = 0: For each n, one solution is a degree-n \Legendre polynomial" n 1 d 2 n Pn(x) = (x − 1) : 2nn! dxn Z 1 They are orthogonal with respect to the inner product hf ; gi = f (x)g(x) dx.
    [Show full text]
  • Eigenfunction Expansions
    276 Chapter 12 Eigenfunction Expansions The Sturm-Liouville theory provides an infinite sequence of eigenvalue-eigen- function pairs. Among the triumphs of nineteenth-century mathematics was the realization that these sequences of eigenfunctions can be used to 1 1 represent arbitrary functions via infinite series. Thus if fungn=0 is the sequence of eigenfunctions of a Sturm-Liouville problem on an interval [a; b] of the real axis, and f is any function defined on this interval, one seeks a representation of f in the form 1 X f (x) = cnun (x) ; (12.1) 0 where the constants fcng must characterize the function f. This is the subject of the present chapter. 12.1 Kinds of Convergence For a sequence of functions ffkg, where each function fk (x) is defined on an interval I of the real axis, there is a variety of possibilities where convergence is concerned. Some examples are 1. The sequence converges to a function f at some points of the interval but not at others; 2. The sequence converges to a function f at each point of the interval; 3. The sequence converges to a function f uniformly on the entire interval. 1Well, almost arbitrary. 277 278 These examples make different mathematical demands on the convergence. The last kind of convergence, uniform convergence, demands that the pre- ceding kind (pointwise convergence) hold, and more. We have encountered it previously, in Chapter 6, and shall encounter it again below. What, if anything, can we make of convergence number 1 above? If the subset of points of the interval where convergence fails is not too large, there is a natural way to make sense of this situation.
    [Show full text]
  • Sturm-Liouville Theory and Orthogonal Functions H
    Sturm-Liouville Theory and Orthogonal Functions H. Azad and M. T. Mustafa Department of Mathematics and Statistics, King Fahd University of Petroleum & Minerals, Dhahran, Saudi Arabia [email protected], [email protected] ABSTRACT. We revisit basics of classical Sturm-Liouville theory and, as an application, recover Bochner's classification of second order ODEs with polynomial coefficients and polynomial solutions by a new argument. We also outline how a wider class of equations with polynomial solutions can be obtained by allowing the weight to become infinite at isolated points. For higher order equations, we also give the basic analysis required for determining the weight functions and constraints on the coefficients which make the differential operator defined by the equation self adjoint for even orders and anti self adjoint in odd orders. We also give explicit examples of such equations. 1. INTRODUCTION In this paper we revisit the basics of Sturm-Liouville theory- for all orders. As an application we determine all differential equations of order 2 which have polynomial coefficients and polynomial solutions. Problems of this type were first considered by Bochner [3]. A review of this paper is available in the Zentralblatt database [11]. The approach taken in this paper is quite different, and this is explained in detail in Section 3, where the reader will also find a summary of Bochner's method, extracted from the review in Zentralblatt. It is the duty of every generation to make mathematics as transparent as it can for its efficient transmission to the next generation. It is in this spirit that we have seen fit to put this paper in the public domain.
    [Show full text]
  • Representation of Signals As Series of Orthogonal Functions E
    Representation of Signals as Series of Orthogonal Functions E. Aristidi To cite this version: E. Aristidi. Representation of Signals as Series of Orthogonal Functions. Mathematical Tools for Instrumentation & Signal Processing in Astronomy, Sep 2016, Nice, France. pp.99-126, 10.1051/eas/1678006. hal-02476488 HAL Id: hal-02476488 https://hal.archives-ouvertes.fr/hal-02476488 Submitted on 12 Feb 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Title : will be set by the publisher Editors : will be set by the publisher EAS Publications Series, Vol. ?, 2016 REPRESENTATION OF SIGNALS AS SERIES OF ORTHOGONAL FUNCTIONS E Aristidi1 Abstract. This paper gives an introduction to the theory of orthogo- nal projection of functions or signals. Several kinds of decomposition are explored: Fourier, Fourier-Legendre, Fourier-Bessel series for 1D signals, and Spherical Harmonic series for 2D signals. We show how physical conditions and/or geometry can guide the choice of the base of functions for the decomposition. The paper is illustrated with several numerical examples. 1 Introduction Fourier analysis is one of the most important and widely used techniques of signal processing. Decomposing a signal as sum of sinusoids, probing the energy con- tained by a given Fourier coefficient at a given frequency, performing operations such as linear filtering in the Fourier plane: all these techniques are in the toolbox of any engineer or scientist dealing with signals.
    [Show full text]
  • Math 356 Lecture Notes Intro to Pdes the Heat Equation; Preliminaries
    MATH 356 LECTURE NOTES INTRO TO PDES THE HEAT EQUATION; PRELIMINARIES J. WONG (FALL 2019) Topics covered • Introduction ◦ Deriving the heat equation (conservation law) ◦ Fourier's problem (motivating example) • The heat equation ◦ Linear PDEs in general ◦ Initial boundary value problem ◦ Superposition principle • Linear algebra review ◦ Orthogonality, orthogonal bases ◦ Eigenvalues/vectors ◦ Solving Ax = b using the eigenvector basis ◦ Norms and inner products 1. Some context: PDEs from conservation laws Rather than pull the equation out of thin air, let's see how PDEs arise naturally out of fundamental models1. To do so, we introduce the concept of a conservation law, which is a way of stating that for an amount of stuff in a region, the change in the amount is due to stuff entering/exiting the region or being created/destroyed. For simplicity, assume the stuff is `heat' - but this argument is quite general (e.g. could be particle concentration, momentum, energy, density of fish, etc.) Consider a cylindrical tube with cross section A running along the x-direction and u(x; t) the temperature at position x and time t. The amount of heat in a section of the tube for x 1Adapted from Applied Partial Differential Equations, J. David Logan 1 2 J. WONG (FALL 2019) in some interval [a; b] is Z b u(x; t) A dx: a Let us further suppose there is a source g(x; t) that is the rate at which u is created or destroyed at position x along the tube. For instance, heat could leak out of the pipe at a rate g(x; t) if the pipe is poorly insulated.
    [Show full text]
  • L9-Orthogonal-Functions.Pdf
    © Diola Bagayoko (2012) ORTHOGONAL FUNCTIONS D. BAGAYOKO I. Introduction Orthogonal functions, to be defined below, are extensively utilized in Physics and related science and engineering disciplines. In a sense, the role of orthogonal functions is similar to that of unit vectors in 2, 3, or more dimensions. Indeed, the way an arbitrary vector, in three dimensions (3- D), can be written as a linear combination of the orthogonal basis vectors (i.e., unit vector r r r i , j, and k ), N r r r r r ˆ v = vx i + v y j + vz k (3-D) or v = ∑viii , in N dimensions (N-D) i=1 is the same way in which an arbitrary function that satisfies certain conditions can be written as ∞ G(x) = ∑ an f n (x), where f1 (x), f 2 (x),...are orthogonal functions. n=1 Please note, from the onset, that the expansion of G(x) in terms of orthogonal functions generally entails an infinite set of orthogonal functions f1(x), f2(x),…fn(x),…, unlike the case of the expansion of a vector vr where the set of orthogonal unit vectors is generally finite. II. Definition Functions f1(x), f2(x),…fn(x) are said to be orthogonal—over the interval [a,b] and with the density or weighting function w(x)—if and only if b * ∀i ,∀ j , fi (x) f j (x)w(x)dx = N ijδ ij , ∫a where Nij is a number. Note well that, because ofδij , the above integral is zero unlessi = j . For i = j , we get b * f i (x) f i (x)w(x)dx = N ii .
    [Show full text]