Discrete Periodic Extension Using an Approximate Step Function∗

Total Page:16

File Type:pdf, Size:1020Kb

Discrete Periodic Extension Using an Approximate Step Function∗ SIAM J. SCI. COMPUT. c 2014 Society for Industrial and Applied Mathematics Vol. 36, No. 2, pp. A668–A692 DISCRETE PERIODIC EXTENSION USING AN APPROXIMATE STEP FUNCTION∗ NATHAN ALBIN† AND SUREKA PATHMANATHAN‡ Abstract. The discrete periodic extension is a technique for augmenting a given set of uniformly spaced samples of a smooth function with auxiliary values in an extension region. If a suitable extension is constructed, the interpolating trigonometric polynomial found via an FFT will accurately approximate the original function in its original interval of definition. The discrete periodic extension is a key construction in the algorithm FC-Gram (Fourier continuation based on Gram polynomials) algorithm. The FC-Gram algorithm, in turn, lies at the heart of several recent efficient and high- order-accurate PDE solvers. This paper presents a new flexible discrete periodic extension procedure that performs at least as well as the FC-Gram method, but with somewhat simpler constructions and significantly decreased setup time. Key words. Fourier series, nonperiodic functions, Fourier continuation AMS subject classifications. 42A15, 65T40, 65T50 DOI. 10.1137/130932533 1. Introduction. The purpose of this paper is to offer a straightforward ap- proach for addressing the approximation problem illustrated in Figure 1. In the figure, the solid curve represents a smooth function f(x) on the interval [0, 1], and the solid circular dots represent N samples of f at uniformly spaced nodes in this interval. The problem addressed in this paper is summarized as follows: Main problem: By using only the first d and last d data points, how does one produce an additional M function values in an interval [1,b] with the property that the trigonometric polynomial interpolant of all N + M samples on [0,b] provides a highly accurate approximation of f(x) in the interval [0, 1]? In the figure, the trigonometric polynomial interpolant is represented by the union of the solid and dashed curves. For illustration purposes, the sizes of N, M,andd in the schematic are smaller than the values for these numbers used in practice. In the numerical comparisons presented in section 5, for example, M = 25, d = 10, and N ≥ 100. The algorithm presented can be viewed conceptually as a method for efficiently producing, for any choice of N ≥ d, a sparse (N +M)×N matrix Eper which maps the N samples of the original function to the N + M samples of its periodic extension. The sparseness of the matrix operator derives from the fact that only 2d samples are used to produce the extension, regardless the size of N. As will be shown 2 (see (2.8)), Eper has a very simple structure with only N +2d nonzero entries. Such a matrix, Eper, can be quite useful in practice, as it allows the high-precision approximation of a nonperiodic function f and its derivatives by means of FFT-based interpolation of the extended vector. Moreover, due to the sparsity of Eper and the efficiency of the FFT, the resulting algorithm will have O(N log N) complexity. The ∗Submitted to the journal’s Methods and Algorithms for Scientific Computing section August 12, 2013; accepted for publication (in revised form) November 27, 2013; published electronically April 10, 2014. http://www.siam.org/journals/sisc/36-2/93253.html †Department of Mathematics, Kansas State University, Manhattan, KS 66506 ([email protected]. edu). ‡Department of Mathematics and Statistics, Texas Tech University, Lubbock, TX 79409-1042 ([email protected]). A668 DISCRETE PERIODIC EXTENSION A669 d points d points N points M points 0 1 b Fig. 1. Schematic diagram of the main problem described in section 1. construction of Eper is modeled after a simple three-step procedure for solving the continuum version of the main problem: given a function f(x)onaninterval,how can one extend it to a smooth, periodic function f˜(x) on a slightly larger interval? The paper is organized as follows. The remainder of the introduction describes the solution to the continuum ex- tension problem and places the discrete extension problem in context with related constructions. Section 2 introduces the new discrete periodic extension algorithm, and section 3 explores the approximation properties of the new extensions. Section 4 discusses some of the finer details involved in implementing the described algorithm, section 5 presents numerical experiments demonstrating the effectiveness of the exten- sion in approximation, and section 6 summarizes the main conclusions of this work. 1.1. Periodic extension: Fourier methods for nonperiodic functions. The problem of periodic extension can be stated as follows. Problem 1. Let f be a smooth function defined on an interval [0, 1].Asmooth, periodic function f˜ on a larger interval [0,b] ⊃ [0, 1] is called a periodic extension of f if f˜(x)=f(x) for all x ∈ [0, 1]. In this paper, “smooth” will frequently be used as a general term representing some unspecified degree of differentiability. The reader desiring a more formal defini- tion may interpret “smooth” as C∞ or Cp with p ≥ 10. The solution of Problem 1 plays an important role in the generalization of FFT- based computational methods to the nonperiodic setting. Suppose that f is a smooth 1 function on the interval [0, 1]. In general, although the partial Fourier sums PN f, where N/2 b 2πikx/b PN f(x)= fˆke , k=−N/2 do converge pointwise to f on the open interval (0, 1), they do not converge uniformly. More significantly in the context of the present paper, if f is sampled at N uniformly spaced points in the interval (0, 1), then the interpolating trigonometric polynomial 1 IN f,where N/2−1 b 2πikx/b (1.1) IN f(x)= ake k=−N/2 with coefficients ak found by means of the FFT, will not provide a good approximation of f as a result of the associated Gibbs “ringing” artifacts. A670 NATHAN ALBIN AND SUREKA PATHMANATHAN However, if f can be smoothly extended to a periodic function f˜ with periodicity b on a larger interval [0,b], then the partial Fourier sums PN f˜ will converge uniformly and rapidly at a rate controlled by the smoothness of f˜. This implies that f can be b accurately approximated on its domain [0, 1] by the restriction of IN f˜ for sufficiently large N. Such constructions have numerous applications, including their use in high- order derivative approximations for numerical PDEs solvers [3, 4, 8, 11, 20, 22, 23]. 1.2. Periodic extension in the continuum. The periodic extension problem defined in Problem 1 may be more accurately termed periodic extension in the contin- uum in order to distinguish it from the discrete analogue discussed at the beginning of this paper and revisited in section 1.3. The distinction—which motivates the present paper—is that in the continuum version of the problem, one wishes to extend a func- tion to a periodic function on a larger interval, while in the discrete version, one wishes to extend a vector of discrete samples of a function to a vector of discrete samples of a smooth periodic function on a larger interval. The problem of continuum periodic extension (or approximate extension) has been treated in [1, 2, 6, 13], as well as in the related results presented in [7, 14]. In fact, although they are targeted at the case when f is already known on an ex- tended interval, the presentations in [7, 14] provide strong motivation for the last two steps of the following three-step periodic extension procedure. This procedure for the continuum problem, in turn, motivates the discrete constructions to follow. Smooth extension. Let f be a smooth (Cp) function on the interval [0, 1], that is, f along with several of its derivatives are continuous and bounded on [0, 1]. By using the Taylor polynomial approximations of f at x =0andx = 1, it is trivial to extend f as a smooth function on all of R, as in Figure 2(a). In what follows, E represents such a smooth extension operator. In other words, given a smooth function f on [0, 1], Ef is a smooth function on all of R with the property that Ef(x)=f(x)forx ∈ [0, 1]. In the present paper, we restrict our attention to the extension operator produced by the dth-degree Taylor polynomial approximation (with d<p) defined as follows: ⎧ ⎪ ∈ ⎪f(x)forx [0, 1] ⎪ d ⎨ (j) xj f (0) j! for x ∈ (−∞, 0) (1.2) Ef(x)= j=0 ⎪ ⎪ d j ⎪ (j) (x−1) ⎩ f (1) j! for x ∈ (1, ∞) j=0 Windowing. Once the function f is smoothly extended to Ef, the extension can easily be given compact support by multiplication with a smooth windowing function, W , as shown in Figure 2(b). Provided W is chosen with the properties that W (x)=1 for x ∈ [0, 1] and W (x)=0forx/∈ (−δ, 1+δ), the window can be combined with the extension operator to form a new windowed extension operator EW with the following properties (see Figure 2(c)): EWf = W ·Ef, EWf(x)=f(x)forx ∈ [0, 1], supp (EWf) ⊆ [−δ, 1+δ]. Periodization. Finally, the compactly supported smooth extension EWf can be periodized into a smooth, periodic extension Eperf with period b>0 through the DISCRETE PERIODIC EXTENSION A671 -δ 1+δ -δ 1+δ 3 1 2 0.8 1 0.6 0 0.4 -1 0.2 -2 0 -3 -0.5 0 0.5 1 1.5 -0.5 0 0.5 1 1.5 (a) (b) -δ 1+δ b 3 3 2 2 1 1 0 0 -1 -1 -2 -2 -3 -3 -0.5 0 0.5 1 1.5 -0.5 0 0.5 1 1.5 (c) (d) Fig.
Recommended publications
  • 7: Inner Products, Fourier Series, Convolution
    7: FOURIER SERIES STEVEN HEILMAN Contents 1. Review 1 2. Introduction 1 3. Periodic Functions 2 4. Inner Products on Periodic Functions 3 5. Trigonometric Polynomials 5 6. Periodic Convolutions 7 7. Fourier Inversion and Plancherel Theorems 10 8. Appendix: Notation 13 1. Review Exercise 1.1. Let (X; h·; ·i) be a (real or complex) inner product space. Define k·k : X ! [0; 1) by kxk := phx; xi. Then (X; k·k) is a normed linear space. Consequently, if we define d: X × X ! [0; 1) by d(x; y) := ph(x − y); (x − y)i, then (X; d) is a metric space. Exercise 1.2 (Cauchy-Schwarz Inequality). Let (X; h·; ·i) be a complex inner product space. Let x; y 2 X. Then jhx; yij ≤ hx; xi1=2hy; yi1=2: Exercise 1.3. Let (X; h·; ·i) be a complex inner product space. Let x; y 2 X. As usual, let kxk := phx; xi. Prove Pythagoras's theorem: if hx; yi = 0, then kx + yk2 = kxk2 + kyk2. 1 Theorem 1.4 (Weierstrass M-test). Let (X; d) be a metric space and let (fj)j=1 be a sequence of bounded real-valued continuous functions on X such that the series (of real num- P1 P1 bers) j=1 kfjk1 is absolutely convergent. Then the series j=1 fj converges uniformly to some continuous function f : X ! R. 2. Introduction A general problem in analysis is to approximate a general function by a series that is relatively easy to describe. With the Weierstrass Approximation theorem, we saw that it is possible to achieve this goal by approximating compactly supported continuous functions by polynomials.
    [Show full text]
  • Fourier Series
    Academic Press Encyclopedia of Physical Science and Technology Fourier Series James S. Walker Department of Mathematics University of Wisconsin–Eau Claire Eau Claire, WI 54702–4004 Phone: 715–836–3301 Fax: 715–836–2924 e-mail: [email protected] 1 2 Encyclopedia of Physical Science and Technology I. Introduction II. Historical background III. Definition of Fourier series IV. Convergence of Fourier series V. Convergence in norm VI. Summability of Fourier series VII. Generalized Fourier series VIII. Discrete Fourier series IX. Conclusion GLOSSARY ¢¤£¦¥¨§ Bounded variation: A function has bounded variation on a closed interval ¡ ¢ if there exists a positive constant © such that, for all finite sets of points "! "! $#&% (' #*) © ¥ , the inequality is satisfied. Jordan proved that a function has bounded variation if and only if it can be expressed as the difference of two non-decreasing functions. Countably infinite set: A set is countably infinite if it can be put into one-to-one £0/"£ correspondence with the set of natural numbers ( +,£¦-.£ ). Examples: The integers and the rational numbers are countably infinite sets. "! "!;: # # 123547698 Continuous function: If , then the function is continuous at the point : . Such a point is called a continuity point for . A function which is continuous at all points is simply referred to as continuous. Lebesgue measure zero: A set < of real numbers is said to have Lebesgue measure ! $#¨CED B ¢ £¦¥ zero if, for each =?>A@ , there exists a collection of open intervals such ! ! D D J# K% $#L) ¢ £¦¥ ¥ ¢ = that <GFIH and . Examples: All finite sets, and all countably infinite sets, have Lebesgue measure zero. "! "! % # % # Odd and even functions: A function is odd if for all in its "! "! % # # domain.
    [Show full text]
  • Contentscontents 2323 Fourier Series
    ContentsContents 2323 Fourier Series 23.1 Periodic Functions 2 23.2 Representing Periodic Functions by Fourier Series 9 23.3 Even and Odd Functions 30 23.4 Convergence 40 23.5 Half-range Series 46 23.6 The Complex Form 53 23.7 An Application of Fourier Series 68 Learning outcomes In this Workbook you will learn how to express a periodic signal f(t) in a series of sines and cosines. You will learn how to simplify the calculations if the signal happens to be an even or an odd function. You will learn some brief facts relating to the convergence of the Fourier series. You will learn how to approximate a non-periodic signal by a Fourier series. You will learn how to re-express a standard Fourier series in complex form which paves the way for a later examination of Fourier transforms. Finally you will learn about some simple applications of Fourier series. Periodic Functions 23.1 Introduction You should already know how to take a function of a single variable f(x) and represent it by a power series in x about any point x0 of interest. Such a series is known as a Taylor series or Taylor expansion or, if x0 = 0, as a Maclaurin series. This topic was firs met in 16. Such an expansion is only possible if the function is sufficiently smooth (that is, if it can be differentiated as often as required). Geometrically this means that there are no jumps or spikes in the curve y = f(x) near the point of expansion.
    [Show full text]
  • On the Real Projections of Zeros of Almost Periodic Functions
    ON THE REAL PROJECTIONS OF ZEROS OF ALMOST PERIODIC FUNCTIONS J.M. SEPULCRE AND T. VIDAL Abstract. This paper deals with the set of the real projections of the zeros of an arbitrary almost periodic function defined in a vertical strip U. It pro- vides practical results in order to determine whether a real number belongs to the closure of such a set. Its main result shows that, in the case that the Fourier exponents {λ1, λ2, λ3,...} of an almost periodic function are linearly independent over the rational numbers, such a set has no isolated points in U. 1. Introduction The theory of almost periodic functions, which was created and developed in its main features by H. Bohr during the 1920’s, opened a way to study a wide class of trigonometric series of the general type and even exponential series. This theory shortly acquired numerous applications to various areas of mathematics, from harmonic analysis to differential equations. In the case of the functions that are defined on the real numbers, the notion of almost periodicity is a generalization of purely periodic functions and, in fact, as in classical Fourier analysis, any almost periodic function is associated with a Fourier series with real frequencies. Let us briefly recall some notions concerning the theory of the almost periodic functions of a complex variable, which was theorized in [4] (see also [3, 5, 8, 11]). A function f(s), s = σ + it, analytic in a vertical strip U = {s = σ + it ∈ C : α< σ<β} (−∞ ≤ α<β ≤ ∞), is called almost periodic in U if to any ε > 0 there exists a number l = l(ε) such that each interval t0 <t<t0 + l of length l contains a number τ satisfying |f(s + iτ) − f(s)|≤ ε ∀s ∈ U.
    [Show full text]
  • Almost Periodic Sequences and Functions with Given Values
    ARCHIVUM MATHEMATICUM (BRNO) Tomus 47 (2011), 1–16 ALMOST PERIODIC SEQUENCES AND FUNCTIONS WITH GIVEN VALUES Michal Veselý Abstract. We present a method for constructing almost periodic sequences and functions with values in a metric space. Applying this method, we find almost periodic sequences and functions with prescribed values. Especially, for any totally bounded countable set X in a metric space, it is proved the existence of an almost periodic sequence {ψk}k∈Z such that {ψk; k ∈ Z} = X and ψk = ψk+lq(k), l ∈ Z for all k and some q(k) ∈ N which depends on k. 1. Introduction The aim of this paper is to construct almost periodic sequences and functions which attain values in a metric space. More precisely, our aim is to find almost periodic sequences and functions whose ranges contain or consist of arbitrarily given subsets of the metric space satisfying certain conditions. We are motivated by the paper [3] where a similar problem is investigated for real-valued sequences. In that paper, using an explicit construction, it is shown that, for any bounded countable set of real numbers, there exists an almost periodic sequence whose range is this set and which attains each value in this set periodically. We will extend this result to sequences attaining values in any metric space. Concerning almost periodic sequences with indices k ∈ N (or asymptotically almost periodic sequences), we refer to [4] where it is proved that, for any precompact sequence {xk}k∈N in a metric space X , there exists a permutation P of the set of positive integers such that the sequence {xP (k)}k∈N is almost periodic.
    [Show full text]
  • Fourier Transform for Mean Periodic Functions
    Annales Univ. Sci. Budapest., Sect. Comp. 35 (2011) 267–283 FOURIER TRANSFORM FOR MEAN PERIODIC FUNCTIONS L´aszl´oSz´ekelyhidi (Debrecen, Hungary) Dedicated to the 60th birthday of Professor Antal J´arai Abstract. Mean periodic functions are natural generalizations of periodic functions. There are different transforms - like Fourier transforms - defined for these types of functions. In this note we introduce some transforms and compare them with the usual Fourier transform. 1. Introduction In this paper C(R) denotes the locally convex topological vector space of all continuous complex valued functions on the reals, equipped with the linear operations and the topology of uniform convergence on compact sets. Any closed translation invariant subspace of C(R)iscalledavariety. The smallest variety containing a given f in C(R)iscalledthevariety generated by f and it is denoted by τ(f). If this is different from C(R), then f is called mean periodic. In other words, a function f in C(R) is mean periodic if and only if there exists a nonzero continuous linear functional μ on C(R) such that (1) f ∗ μ =0 2000 Mathematics Subject Classification: 42A16, 42A38. Key words and phrases: Mean periodic function, Fourier transform, Carleman transform. The research was supported by the Hungarian National Foundation for Scientific Research (OTKA), Grant No. NK-68040. 268 L. Sz´ekelyhidi holds. In this case sometimes we say that f is mean periodic with respect to μ. As any continuous linear functional on C(R) can be identified with a compactly supported complex Borel measure on R, equation (1) has the form (2) f(x − y) dμ(y)=0 for each x in R.
    [Show full text]
  • 6.436J / 15.085J Fundamentals of Probability, Homework 1 Solutions
    MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2018 Problem Set 1 Readings: (a) Notes from Lecture 1. (b) Handout on background material on sets and real analysis (Recitation 1). Supplementary readings: [C], Sections 1.1-1.4. [GS], Sections 1.1-1.3. [W], Sections 1.0-1.5, 1.9. Exercise 1. (a) Let N be the set of positive integers. A function f : N → {0, 1} is said to be periodic if there exists some N such that f(n + N)= f(n),for all n ∈ N. Show that the set of periodic functions is countable. (b) Does the result from part (a) remain valid if we consider rational-valued periodic functions f : N → Q? Solution: (a) For a given positive integer N,letA N denote the set of periodic functions with a period of N.Fora given N ,since thesequence, f(1), ··· ,f(N), actually defines a periodic function in AN ,wehave thateach A N contains 2N elements. For example, for N =2,there arefour functions inthe set A2: f(1)f(2)f(3)f(4) ··· =0000··· ;1111··· ;0101··· ;1010··· . The set of periodic functions from N to {0, 1}, A,can bewritten as, ∞ A = AN . N=1 ! Since the union of countably many finite sets is countable, we conclude that the set of periodic functions from N to {0, 1} is countable. (b) Still, for a given positive integer N,let AN denote the set of periodic func- tions with a period N.Fora given N ,since the sequence, f(1), ··· ,f(N), 1 actually defines a periodic function in AN ,weconclude that A N has the same cardinality as QN (the Cartesian product of N sets of rational num- bers).
    [Show full text]
  • Fourier Series
    Chapter 10 Fourier Series 10.1 Periodic Functions and Orthogonality Relations The differential equation ′′ y + 2y = F cos !t models a mass-spring system with natural frequency with a pure cosine forcing function of frequency !. If 2 = !2 a particular solution is easily found by undetermined coefficients (or by∕ using Laplace transforms) to be F y = cos !t. p 2 !2 − If the forcing function is a linear combination of simple cosine functions, so that the differential equation is N ′′ 2 y + y = Fn cos !nt n=1 X 2 2 where = !n for any n, then, by linearity, a particular solution is obtained as a sum ∕ N F y (t)= n cos ! t. p 2 !2 n n=1 n X − This simple procedure can be extended to any function that can be repre- sented as a sum of cosine (and sine) functions, even if that summation is not a finite sum. It turns out that the functions that can be represented as sums in this form are very general, and include most of the periodic functions that are usually encountered in applications. 723 724 10 Fourier Series Periodic Functions A function f is said to be periodic with period p> 0 if f(t + p)= f(t) for all t in the domain of f. This means that the graph of f repeats in successive intervals of length p, as can be seen in the graph in Figure 10.1. y p 2p 3p 4p 5p Fig. 10.1 An example of a periodic function with period p.
    [Show full text]
  • Fourier Series for Periodic Functions Lecture #8 5CT3,4,6,7
    Fourier Series for Periodic Functions Lecture #8 5CT3,4,6,7 BME 333 Biomedical Signals and Systems 2 - J.Schesser Fourier Series for Periodic Functions • Up to now we have solved the problem of approximating a function f(t) by fa(t) within an interval T. • However, if f(t) is periodic with period T, i.e., f(t)=f(t+T), then the approximation is true for all t. • And if we represent a periodic function in terms of an infinite Fourier series, such that the frequencies are all integral multiples of the frequency 1/T, where k=1 corresponds to the fundamental frequency of the function and the remainder are its harmonics. Tjkt 2 1 2 T aftedtk T () T 2 j22kt j kt j 2 kt j 2 kt TT T T ft() a00 [aakk e * e ] a k e a2Re[ a k e ] kkk11 jkt2 j k ftak( ) a0 C cos( kkk ), where 2aa Ce and 00 C k1 T BME 333 Biomedical Signals and Systems 3 - J.Schesser Another Form for the Fourier Series 2 kt ft() C0 Ckk cos( ) k1 T 22kt kt AA0 kkcos( ) B sin( ) k1 TT where Akk CBCACcos k and k - k sin k and 00 BME 333 Biomedical Signals and Systems 4 - J.Schesser Fourier Series Theorem • Any periodic function f (t) with period T which is integrable ( f ( t ) dt ) can be represented by an infinite Fourier Series • If [f (t)]2 is also integrable, then the series converges to the value of f (t) at every point where f(t) is continuous and to the average value at any discontinuity.
    [Show full text]
  • Periodic Linear Systems Lecture 17 Math 634 10/8/99
    Periodic Linear Systems Lecture 17 Math 634 10/8/99 We now consider x˙ = A(t)x (1) when A is a continuous periodic n n matrix function of t; i.e., when there × is a constant T>0 such that A(t + T )=A(t) for every t R . When that condition is satisfied, we say, more precisely, that A is T -periodic∈ .IfT is the smallest positive number for which this condition holds, we say that T is the minimal period of A. Let A be T -periodic, and let X(t) be a fundamental matrix for (1). Define ˜ n n ˜ ˜ R R X : R ( , )byX(t)=X(t + T ). Clearly, the columns of X are linearly→L independent functions of t. Also, d d X˜(t)= X(t + T )=X0(t + T )=A(t + t)X(t + T )=A(t)X˜(t), dt dt so X˜ solves the matrix equivalent of (1). Hence, X˜ is a fundamental matrix for (1). Because the dimension of the solution space of (1) is n, this means that there is a nonsingular (constant) matrix C such that X(t + T )=X(t)C for every t R . C is called a monodromy matrix. ∈ n n TB C Lemma There exists B (C , ) such that C = e . ∈L Proof. Without loss of generality, we assume that T = 1, since if it isn’t we can just rescale B by a scalar constant. We also assume, without loss of generality, that C is in Jordan canonical form. (If it isn’t, then use the fact 1 B PBP 1 that P − CP = e implies that C = e − .) Furthermore, because of the way the matrix exponential acts on a block diagonal matrix, it suffices to 1 show that for each p p Jordan block × λ 0 0 ··· ··· .
    [Show full text]
  • Fourier Transform
    Fourier Transform 1 The idea A signal can be interpreted as en electromagnetic wave. This consists of lights of different “color”, or frequency, that can be split apart usign an optic prism. Each component is a “monochromatic” light with sinusoidal shape. Following this analogy, each signal can be decomposed into its “sinusoidal” components which represent its “colors”. Of course these components in general do not correspond to visible monochromatic light. However, they give an idea of how fast are the changes of the signal. 2 Contents • Signals as functions (1D, 2D) – Tools • Continuous Time Fourier Transform (CTFT) • Discrete Time Fourier Transform (DTFT) • Discrete Fourier Transform (DFT) • Discrete Cosine Transform (DCT) • Sampling theorem 3 Fourier Transform • Different formulations for the different classes of signals – Summary table: Fourier transforms with various combinations of continuous/ discrete time and frequency variables. – Notations: • CTFT: continuous time FT: t is real and f real (f=ω) (CT, CF) • DTFT: Discrete Time FT: t is discrete (t=n), f is real (f=ω) (DT, CF) • CTFS: CT Fourier Series (summation synthesis): t is real AND the function is periodic, f is discrete (f=k), (CT, DF) • DTFS: DT Fourier Series (summation synthesis): t=n AND the function is periodic, f discrete (f=k), (DT, DF) • P: periodical signals • T: sampling period • ωs: sampling frequency (ωs=2π/T) • For DTFT: T=1 → ωs=2π • This is a hint for those who are interested in a more exhaustive theoretical approach 4 Images as functions • Gray scale images:
    [Show full text]
  • FOURIER ANALYSIS 1. the Best Approximation Onto Trigonometric
    FOURIER ANALYSIS ERIK LØW AND RAGNAR WINTHER 1. The best approximation onto trigonometric polynomials Before we start the discussion of Fourier series we will review some basic results on inner–product spaces and orthogonal projections mostly presented in Section 4.6 of [1]. 1.1. Inner–product spaces. Let V be an inner–product space. As usual we let u, v denote the inner–product of u and v. The corre- sponding normh isi given by v = v, v . k k h i A basic relation between the inner–productp and the norm in an inner– product space is the Cauchy–Scwarz inequality. It simply states that the absolute value of the inner–product of u and v is bounded by the product of the corresponding norms, i.e. (1.1) u, v u v . |h i|≤k kk k An outline of a proof of this fundamental inequality, when V = Rn and is the standard Eucledian norm, is given in Exercise 24 of Section 2.7k·k of [1]. We will give a proof in the general case at the end of this section. Let W be an n dimensional subspace of V and let P : V W be the corresponding projection operator, i.e. if v V then w∗ =7→P v W is the element in W which is closest to v. In other∈ words, ∈ v w∗ v w for all w W. k − k≤k − k ∈ It follows from Theorem 12 of Chapter 4 of [1] that w∗ is characterized by the conditions (1.2) v P v, w = v w∗, w =0 forall w W.
    [Show full text]