Lecture 9 ELE 301: Signals and Systems

Total Page:16

File Type:pdf, Size:1020Kb

Lecture 9 ELE 301: Signals and Systems Lecture 9 ELE 301: Signals and Systems Prof. Paul Cuff Princeton University Fall 2011-12 Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 1 / 16 Discrete-time Fourier Transform Represent a Discrete-time signal using δ functions Properties of the Discrete-time Fourier Transform I Periodicity I Time Scaling Property I Multiplication Property Periodic Discrete Duality DFT Constant-Coefficient Difference Equations Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 2 / 16 Fourier Transform for Discrete-time Signals Z x[n] = X (f )ei2πfndf ; 1 1 X X (f ) = x[n]e−i2πfn: n=−∞ X (f ) is always periodic with period 1. Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 3 / 16 Continuous-representation of a discrete-time signal 1 X x(t) , x[k]δ(t − k): k=−∞ Notice that 1 ! Z 1 X F[x(t)] = x[k]δ(t − k) e−i2πft dt −∞ k=−∞ 1 X Z 1 = x[k]δ(t − k)e−i2πft dt k=−∞ −∞ 1 X = x[k]e−i2πfk dt: k=−∞ Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 4 / 16 Properties of the Discrete-time Fourier Transform Inherits properties from continuous-time. Easy Properties: Linearity Conjugation Convolution = Multiplication in frequency domain Parseval's Theorem (integrate over one period) Time shift Properties that require care: Time-scaling Multiplication (circular convolution in frequency) Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 5 / 16 Time-scaling In continuous time we can scale by an arbitrary real number. In discrete-time we scale only by integers. For an integer k, define x[n=k] if n is a multiple of k; x [n] = k 0 if n is not a multiple of k: xk [n] , X (kf ): Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 6 / 16 Compressing in time Compressing in time requires decimation. Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 7 / 16 Discrete Difference What is the Fourier transform of y[n] = x[n] − x[n − 1]? Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 8 / 16 Dual Derivative Formula The dual to the continuous-time differentiation formula still holds. i nx[n] , X 0(f ): 2π Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 9 / 16 Accumulation Pn What is the Fourier transform of y[n] = m=−∞ x[m]? (Hint: Inverse of discrete difference) Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 10 / 16 Parseval's Theorem Theorem: 1 Z 1=2 X 2 2 Ex = jx[n]j = jX (f )j df : n=−∞ −1=2 Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 11 / 16 Multiplication Property Multiplication in time equates to circular convolution in frequency. Notice that multiplying δ functions is not well defined. This is dual to what we saw in the Fourier series. Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 12 / 16 Discrete Periodic Duality periodic signal = discrete transform (though not integer f ) discrete signal = periodic transform Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 13 / 16 Discrete Fourier Transform Notice that a discrete and periodic signal will have a discrete and periodic transform. This is convenient for numerical computation (computers and digital systems). The DFT is (almost) equivalent to the discrete-time Fourier series of the periodic extension. For period N, let 2 x[0] 3 6 x[1] 7 x = 6 7 6 . 7 4 . 5 x[N − 1] Then 2 3 a0 6 a1 7 DFT [x] = 6 7 6 . 7 4 . 5 aN−1 whereCuffak (Lectureare the 9) Fourier seriesELE coefficients.301: Signals and Systems Fall 2011-12 14 / 16 The DFT Matrix Since the Fourier transform is linear, the DFT can be encompassed in a matrix. DFT [x] = Fx: Matlab uses the fast-Fourier-transform algorithm to compute the DFT (using the fft command). Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 15 / 16 Constant-Coefficient Difference Equations n M X X ak y[n − k] = bk x[n − k]: k=0 k=0 Find the Fourier Transform of the impulse response (the transfer function of the system, H(f )) in the frequency domain. Cuff (Lecture 9) ELE 301: Signals and Systems Fall 2011-12 16 / 16.
Recommended publications
  • The Fast Fourier Transform
    The Fast Fourier Transform Derek L. Smith SIAM Seminar on Algorithms - Fall 2014 University of California, Santa Barbara October 15, 2014 Table of Contents History of the FFT The Discrete Fourier Transform The Fast Fourier Transform MP3 Compression via the DFT The Fourier Transform in Mathematics Table of Contents History of the FFT The Discrete Fourier Transform The Fast Fourier Transform MP3 Compression via the DFT The Fourier Transform in Mathematics Navigating the Origins of the FFT The Royal Observatory, Greenwich, in London has a stainless steel strip on the ground marking the original location of the prime meridian. There's also a plaque stating that the GPS reference meridian is now 100m to the east. This photo is the culmination of hundreds of years of mathematical tricks which answer the question: How to construct a more accurate clock? Or map? Or star chart? Time, Location and the Stars The answer involves a naturally occurring reference system. Throughout history, humans have measured their location on earth, in order to more accurately describe the position of astronomical bodies, in order to build better time-keeping devices, to more successfully navigate the earth, to more accurately record the stars... and so on... and so on... Time, Location and the Stars Transoceanic exploration previously required a vessel stocked with maps, star charts and a highly accurate clock. Institutions such as the Royal Observatory primarily existed to improve a nations' navigation capabilities. The current state-of-the-art includes atomic clocks, GPS and computerized maps, as well as a whole constellation of government organizations.
    [Show full text]
  • Fourier Series
    Academic Press Encyclopedia of Physical Science and Technology Fourier Series James S. Walker Department of Mathematics University of Wisconsin–Eau Claire Eau Claire, WI 54702–4004 Phone: 715–836–3301 Fax: 715–836–2924 e-mail: [email protected] 1 2 Encyclopedia of Physical Science and Technology I. Introduction II. Historical background III. Definition of Fourier series IV. Convergence of Fourier series V. Convergence in norm VI. Summability of Fourier series VII. Generalized Fourier series VIII. Discrete Fourier series IX. Conclusion GLOSSARY ¢¤£¦¥¨§ Bounded variation: A function has bounded variation on a closed interval ¡ ¢ if there exists a positive constant © such that, for all finite sets of points "! "! $#&% (' #*) © ¥ , the inequality is satisfied. Jordan proved that a function has bounded variation if and only if it can be expressed as the difference of two non-decreasing functions. Countably infinite set: A set is countably infinite if it can be put into one-to-one £0/"£ correspondence with the set of natural numbers ( +,£¦-.£ ). Examples: The integers and the rational numbers are countably infinite sets. "! "!;: # # 123547698 Continuous function: If , then the function is continuous at the point : . Such a point is called a continuity point for . A function which is continuous at all points is simply referred to as continuous. Lebesgue measure zero: A set < of real numbers is said to have Lebesgue measure ! $#¨CED B ¢ £¦¥ zero if, for each =?>A@ , there exists a collection of open intervals such ! ! D D J# K% $#L) ¢ £¦¥ ¥ ¢ = that <GFIH and . Examples: All finite sets, and all countably infinite sets, have Lebesgue measure zero. "! "! % # % # Odd and even functions: A function is odd if for all in its "! "! % # # domain.
    [Show full text]
  • 7 Image Processing: Discrete Images
    7 Image Processing: Discrete Images In the previous chapter we explored linear, shift-invariant systems in the continuous two-dimensional domain. In practice, we deal with images that are both limited in extent and sampled at discrete points. The results developed so far have to be specialized, extended, and modified to be useful in this domain. Also, a few new aspects appear that must be treated carefully. The sampling theorem tells us under what circumstances a discrete set of samples can accurately represent a continuous image. We also learn what happens when the conditions for the application of this result are not met. This has significant implications for the design of imaging systems. Methods requiring transformation to the frequency domain have be- come popular, in part because of algorithms that permit the rapid compu- tation of the discrete Fourier transform. Care has to be taken, however, since these methods assume that the signal is periodic. We discuss how this requirement can be met and what happens when the assumption does not apply. 7.1 Finite Image Size In practice, images are always of finite size. Consider a rectangular image 7.1 Finite Image Size 145 of width W and height H. Then the integrals in the Fourier transform no longer need to be taken to infinity: H/2 W/2 F (u, v)= f(x, y)e−i(ux+vy) dx dy. −H/2 −W/2 Curiously, we do not need to know F (u, v) for all frequencies in order to reconstruct f(x, y). Knowing that f(x, y)=0for|x| >W/2 and |y| >H/2 provides a strong constraint.
    [Show full text]
  • Discrete-Time Fourier Transform
    .@.$$-@@4&@$QEG'FC1. CHAPTER7 Discrete-Time Fourier Transform In Chapter 3 and Appendix C, we showed that interesting continuous-time waveforms x(t) can be synthesized by summing sinusoids, or complex exponential signals, having different frequencies fk and complex amplitudes ak. We also introduced the concept of the spectrum of a signal as the collection of information about the frequencies and corresponding complex amplitudes {fk,ak} of the complex exponential signals, and found it convenient to display the spectrum as a plot of spectrum lines versus frequency, each labeled with amplitude and phase. This spectrum plot is a frequency-domain representation that tells us at a glance “how much of each frequency is present in the signal.” In Chapter 4, we extended the spectrum concept from continuous-time signals x(t) to discrete-time signals x[n] obtained by sampling x(t). In the discrete-time case, the line spectrum is plotted as a function of normalized frequency ωˆ . In Chapter 6, we developed the frequency response H(ejωˆ ) which is the frequency-domain representation of an FIR filter. Since an FIR filter can also be characterized in the time domain by its impulse response signal h[n], it is not hard to imagine that the frequency response is the frequency-domain representation,orspectrum, of the sequence h[n]. 236 .@.$$-@@4&@$QEG'FC1. 7-1 DTFT: FOURIER TRANSFORM FOR DISCRETE-TIME SIGNALS 237 In this chapter, we take the next step by developing the discrete-time Fouriertransform (DTFT). The DTFT is a frequency-domain representation for a wide range of both finite- and infinite-length discrete-time signals x[n].
    [Show full text]
  • Short-Time Fourier Analysis Why STFT for Speech Signals Overview
    General Discrete-Time Model of Speech Production Digital Speech Processing— Lecture 9 Short-Time Fourier Analysis Methods- Voiced Speech: • AVP(z)G(z)V(z)R(z) Introduction Unvoiced Speech: 1 • ANN(z)V(z)R(z) 2 Short-Time Fourier Analysis Why STFT for Speech Signals • represent signal by sum of sinusoids or • steady state sounds, like vowels, are produced complex exponentials as it leads to convenient by periodic excitation of a linear system => solutions to problems (formant estimation, pitch speech spectrum is the product of the excitation period estimation, analysis-by-synthesis spectrum and the vocal tract frequency response methods), and insight into the signal itself • speech is a time-varying signal => need more sophisticated analysis to reflect time varying • such Fourier representations provide properties – convenient means to determine response to a sum of – changes occur at syllabic rates (~10 times/sec) sinusoids for linear systems – over fixed time intervals of 10-30 msec, properties of – clear evidence of signal properties that are obscured most speech signals are relatively constant (when is in the original signal this not the case) 3 4 Frequency Domain Processing Overview of Lecture • define time-varying Fourier transform (STFT) analysis method • define synthesis method from time-varying FT (filter-bank summation, overlap addition) • show how time-varying FT can be viewed in terms of a bank of filters model • Coding: • computation methods based on using FFT – transform, subband, homomorphic, channel vocoders • application
    [Show full text]
  • Fourier Analysis
    Fourier Analysis Hilary Weller <[email protected]> 19th October 2015 This is brief introduction to Fourier analysis and how it is used in atmospheric and oceanic science, for: Analysing data (eg climate data) • Numerical methods • Numerical analysis of methods • 1 1 Fourier Series Any periodic, integrable function, f (x) (defined on [ π,π]), can be expressed as a Fourier − series; an infinite sum of sines and cosines: ∞ ∞ a0 f (x) = + ∑ ak coskx + ∑ bk sinkx (1) 2 k=1 k=1 The a and b are the Fourier coefficients. • k k The sines and cosines are the Fourier modes. • k is the wavenumber - number of complete waves that fit in the interval [ π,π] • − sinkx for different values of k 1.0 k =1 k =2 k =4 0.5 0.0 0.5 1.0 π π/2 0 π/2 π − − x The wavelength is λ = 2π/k • The more Fourier modes that are included, the closer their sum will get to the function. • 2 Sum of First 4 Fourier Modes of a Periodic Function 1.0 Fourier Modes Original function 4 Sum of first 4 Fourier modes 0.5 2 0.0 0 2 0.5 4 1.0 π π/2 0 π/2 π π π/2 0 π/2 π − − − − x x 3 The first four Fourier modes of a square wave. The additional oscillations are “spectral ringing” Each mode can be represented by motion around a circle. ↓ The motion around each circle has a speed and a radius. These represent the wavenumber and the Fourier coefficients.
    [Show full text]
  • Arxiv:1801.05832V2 [Cs.DS]
    Efficient Computation of the 8-point DCT via Summation by Parts D. F. G. Coelho∗ R. J. Cintra† V. S. Dimitrov‡ Abstract This paper introduces a new fast algorithm for the 8-point discrete cosine transform (DCT) based on the summation-by-parts formula. The proposed method converts the DCT matrix into an alternative transformation matrix that can be decomposed into sparse matrices of low multiplicative complexity. The method is capable of scaled and exact DCT computation and its associated fast algorithm achieves the theoretical minimal multiplicative complexity for the 8-point DCT. Depending on the nature of the input signal simplifications can be introduced and the overall complexity of the proposed algorithm can be further reduced. Several types of input signal are analyzed: arbitrary, null mean, accumulated, and null mean/accumulated signal. The proposed tool has potential application in harmonic detection, image enhancement, and feature extraction, where input signal DC level is discarded and/or the signal is required to be integrated. Keywords DCT, Fast Algorithms, Image Processing 1 Introduction Discrete transforms play a central role in signal processing. Noteworthy methods include trigonometric transforms— such as the discrete Fourier transform (DFT) [1], discrete Hartley transform (DHT) [1], discrete cosine transform (DCT) [2], and discrete sine transform (DST) [2]—as well as the Haar and Walsh-Hadamard transforms [3]. Among these methods, the DCT has been applied in several practical contexts: noise reduction [4], watermarking methods [5], image/video compression techniques [2], and harmonic detection [2], to cite a few. In fact, when processing signals modeled as a stationary Markov-1 type random process, the DCT behaves as the asymptotic case of the optimal Karhunen–Lo`eve transform in terms of data decorrelation [2].
    [Show full text]
  • Comparison of FFT, DCT, DWT, WHT Compression Techniques on Electrocardiogram & Photoplethysmography Signals
    Special Issue of International Journal of Computer Applications (0975 – 8887) International Conference on Computing, Communication and Sensor Network (CCSN) 2012 Comparison of FFT, DCT, DWT, WHT Compression Techniques on Electrocardiogram & Photoplethysmography Signals Anamitra Bardhan Roy Debasmita Dey Devmalya Banerjee Programmer Analyst Trainee, B.Tech. Student, Dept. of CSE, JIS Asst. Professor, Dept. of EIE Cognizant Technology Solution, College of Engineering College of Engineering, WB, India Kolkata, WB, India Kolkata, WB, India, Bidisha Mohanty B.Tech. Student, Dept. of ECE, JIS College of Engineering, WB, India. ABSTRACT media requires high security and authentication [1]. This Compression technique plays an important role indiagnosis, concept of telemedicine basically and foremost needs image prognosis and analysis of ischemic heart diseases.It is also compression as a vital part of image processing techniques to preferable for its fast data sending capability in the field of manage with the data capacity to transfer within a short and telemedicine.Various techniques have been proposed over stipulated time interval. The therapeutic remedies are derived years for compression. Among those Discrete Cosine from the minutiae’s of the biomedical signals shared Transformation(DCT), Discrete Wavelet worldwide through telelinking. This communication of Transformation(DWT), Fast Fourier Transformation(FFT) exchanging medical data through wireless media requires high andWalsh Hadamard Transformation(WHT) are mostly level of compression techniques to cope up with the restricted used.In this paper a comparative study of FFT, DCT, DWT, data transfer capacity and rate. Compression of signals and and WHT is proposed using ECG and PPG signal, images can cause distortion in them. As the medical signals whichshows a certain relation between them as discussed in and images contains and relays information required for previous papers[1].
    [Show full text]
  • The Fractional Fourier Transform and Applications David H. Bailey and Paul N. Swarztrauber October 19, 1995 Ref: SIAM Review, Vo
    The Fractional Fourier Transform and Applications David H. Bailey and Paul N. Swarztraub er Octob er 19, 1995 Ref: SIAM Review,vol. 33 no. 3 (Sept. 1991), pg. 389{404 Note: See Errata note, available from the same web directory as this pap er Abstract This pap er describ es the \fractional Fourier transform", which admits computation by an algorithm that has complexity prop ortional to the fast Fourier transform algorithm. 2 i=n Whereas the discrete Fourier transform (DFT) is based on integral ro ots of unity e , 2i the fractional Fourier transform is based on fractional ro ots of unity e , where is arbitrary. The fractional Fourier transform and the corresp onding fast algorithm are useful for such applications as computing DFTs of sequences with prime lengths, computing DFTs of sparse sequences, analyzing sequences with non-integer p erio dicities, p erforming high-resolution trigonometric interp olation, detecting lines in noisy images and detecting signals with linearly drifting frequencies. In many cases, the resulting algorithms are faster by arbitrarily large factors than conventional techniques. Bailey is with the Numerical Aero dynamic Simulation (NAS) Systems Division at NASA Ames ResearchCenter, Mo ett Field, CA 94035. Swarztraub er is with the National Center for Atmospheric Research, Boulder, CO 80307, whichissponsoredby National Sci- ence Foundation. This work was completed while Swarztraub er was visiting the Research Institute for Advanced Computer Science (RIACS) at NASA Ames. Swarztraub er's work was funded by the NAS Systems Division via Co op erative Agreement NCC 2-387 b etween NASA and the Universities Space Research Asso ciation.
    [Show full text]
  • Fourier Analysis
    FOURIER ANALYSIS Lucas Illing 2008 Contents 1 Fourier Series 2 1.1 General Introduction . 2 1.2 Discontinuous Functions . 5 1.3 Complex Fourier Series . 7 2 Fourier Transform 8 2.1 Definition . 8 2.2 The issue of convention . 11 2.3 Convolution Theorem . 12 2.4 Spectral Leakage . 13 3 Discrete Time 17 3.1 Discrete Time Fourier Transform . 17 3.2 Discrete Fourier Transform (and FFT) . 19 4 Executive Summary 20 1 1. Fourier Series 1 Fourier Series 1.1 General Introduction Consider a function f(τ) that is periodic with period T . f(τ + T ) = f(τ) (1) We may always rescale τ to make the function 2π periodic. To do so, define 2π a new independent variable t = T τ, so that f(t + 2π) = f(t) (2) So let us consider the set of all sufficiently nice functions f(t) of a real variable t that are periodic, with period 2π. Since the function is periodic we only need to consider its behavior on one interval of length 2π, e.g. on the interval (−π; π). The idea is to decompose any such function f(t) into an infinite sum, or series, of simpler functions. Following Joseph Fourier (1768-1830) consider the infinite sum of sine and cosine functions 1 a0 X f(t) = + [a cos(nt) + b sin(nt)] (3) 2 n n n=1 where the constant coefficients an and bn are called the Fourier coefficients of f. The first question one would like to answer is how to find those coefficients.
    [Show full text]
  • The Discrete Fourier Transform
    Chapter 5 The Discrete Fourier Transform Contents Overview . 5.3 Definition(s) . 5.4 Frequency domain sampling: Properties and applications . 5.9 Time-limited signals . 5.12 The discrete Fourier transform (DFT) . 5.12 The DFT, IDFT - computational perspective . 5.14 Properties of the DFT, IDFT . 5.15 Multiplication of two DFTs and circular convolution . 5.19 Related DFT properties . 5.23 Linear filtering methods based on the DFT . 5.24 Filtering of long data sequences . 5.25 Frequency analysis of signals using the DFT . 5.27 Interpolation / upsampling revisited . 5.29 Summary . 5.31 DFT-based “real-time” filtering . 5.31 5.1 5.2 c J. Fessler, May 27, 2004, 13:14 (student version) x[n] = xa(nTs) Sum of shifted replicates Sampling xa(t) x[n] xps[n] Bandlimited: Time-limited: Sinc interpolation Rectangular window FT DTFT DFT DTFS Sum shifted scaled replicates X[k] = (!) != 2π k X j N Sampling X (F ) (!) X[k] a X Bandlimited: Time-limited: PSfrag replacements Rectangular window Dirichlet interpolation The FT Family Relationships FT Unit Circle • X (F ) = 1 x (t) e−|2πF t dt • a −∞ a x (t) = 1 X (F ) e|2πF t dF • a −∞R a DTFT • R 1 −|!n (!) = n=−∞ x[n] e = X(z) z=ej! • X π j Z x[n] = 1 (!) e|!n d! • 2πP −π X Sample Unit Circle Uniform Time-Domain Sampling X(z) • x[n] = x (RnT ) • a s (!) = 1 1 X !=(2π)−k (sum of shifted scaled replicates of X ( )) • X Ts k=−∞ a Ts a · Recovering xa(t) from x[n] for bandlimited xa(t), where Xa(F ) = 0 for F Fs=2 • P j j ≥ X (F ) = T rect F (2πF T ) (rectangular window to pick out center replicate) • a s Fs X s x (t) = 1 x[n] sinc t−nTs ; where sinc(x) = sin(πx) =(πx).
    [Show full text]
  • Discrete Cosine Transform Over Finite Prime Fields
    THE DISCRETE COSINE TRANSFORM OVER PRIME FINITE FIELDS M.M. Campello de Souza, H.M. de Oliveira, R.M Campello de Souza, M. M. Vasconcelos Federal University of Pernambuco - UFPE, Digital Signal Processing Group C.P. 7800, 50711-970, Recife - PE, Brazil E-mail: {hmo, marciam, ricardo}@ufpe.br, [email protected] Abstract - This paper examines finite field the FFFT have been found, not only in the fields trigonometry as a tool to construct of digital signal and image processing [3-5], but trigonometric digital transforms. In particular, also in different contexts such as error control by using properties of the k-cosine function coding and cryptography [6-7]. over GF(p), the Finite Field Discrete Cosine The Finite Field Hartley Transform, which is a Transform (FFDCT) is introduced. The digital version of the Discrete Hartley Transform, FFDCT pair in GF(p) is defined, having has been recently introduced [8]. Its applications blocklengths that are divisors of (p+1)/2. A include the design of digital multiplex systems, special case is the Mersenne FFDCT, defined multiple access systems and multilevel spread when p is a Mersenne prime. In this instance spectrum digital sequences [9-12]. blocklengths that are powers of two are Among the discrete transforms, the DCT is possible and radix-2 fast algorithms can be specially attractive for image processing, because used to compute the transform. it minimises the blocking artefact that results when the boundaries between subimages become Key-words: Finite Field Transforms, Mersenne visible. It is known that the information packing primes, DCT. ability of the DCT is superior to that of the DFT and other transforms.
    [Show full text]