Harmonic Regression Model

Total Page:16

File Type:pdf, Size:1020Kb

Harmonic Regression Model Statistics 910, #6 1 Harmonic Regression Overview 1. Example: periodic data 2. Regression at Fourier frequencies 3. Discrete Fourier transform (periodogram) 4. Examples of the DFT Example: Periodic Data Magnitude of variable star This integer time series is reported to be the magnitude of a variable star observed on 600 successive nights (Whittaker and Robinson, 1924, varstar.dat). Periodic model Classical example of \signal in noise," with a hidden (though not very hidden in this case) periodic signal. Model for periodic data with a single sinusoid is (Example 2.7) xt = A cos(2π!t + φ) + wt with amplitude A, frequency !, and phase φ. Don't confuse wt (white noise) for ! (frequency, the reciprocal of the period in t units). Caution: Aliasing and identifiability The frequency must be restricted to the range −1=2 < ! ≤ 1=2 in order for the model to be identified (or a translation of this range). For discrete-time, equally-spaced data, frequencies outside of this range are aliased into this range. For exam- ple, suppose that λ = 1 − δ; 0 < δ < 1=2, then for t = 1; 2;::: cos(2πλt) = cos(2π(1 − δ)t + φ) = cos(2πt + (−2πδt + φ)) = cos(2πt) cos(2πδt − φ) + sin(2πt) sin(2πδt + φ) = cos(2πδt − φ) : Thus, a sampled sinusoid with frequency ! > 1=2 appears as a sinusoid with frequency in the interval (−1=2; 1=2]. If the data is sampled at Statistics 910, #6 2 a spacing of ∆ time units, then the highest frequency observable in discrete data is 2=∆, which is known as the folding frequency or Nyquist frequency. Notation alert! Many books (including the ones I learned from) write the sinusoids using the angular frequency notation that embeds the 2π into the frequency as λ = 2π!. Thus, the sinusoidal model would look like xt = A cos(λt + φ) + wt Question How to estimate unknown parameters? the amplitude A, the frequency ! and the phase φ. Estimation by regression Convert the expression of the model into one in which the unknown parameters can be linearly estimated. (This is a common, and very useful theme.) Once the model is expressed with unknown that offer linear estimators, we can estimate them using regression and OLS. The conversion uses the first of the following two \double-angle" formulas: cos(a + b) = cos(a) cos(b) − sin(a) sin(b) even sin(a + b) = sin(a) cos(b) + cos(a) sin(b) odd Write it as the linear regression (sans intercept) xt = A cos(φ) cos(2π!t) + −A sin(φ) sin(2π!t) + wt | {z } | {z } β1 β2 2 2 2 Notice that β1 + β2 = A . The sum of the squared regression coef- ficients is the squared amplitude of the hidden sinusoid. This sum is also, as we'll see, proportional to the regression sum-of-squares asso- ciated with this pair of variables. Frequency The estimation is linear if ! is known. What's a good estimator for !? Hint: count cycles. The estimation of ! is non-standard: we can get an estimator within op(1=n) rather than the usual root-n rate. There's also a nice plot. If the period is M = 1=!, then plot xt on t mod M. This is useful as it introduces a nonparametric estimator for a general periodic function. Statistics 910, #6 3 What if the background is not white noise? Least squares provides good estimates (i.e., efficient) of β1 and β2 if wt in the regression yt = β1 cos 2π!t + β2 sin 2π!t + wt forms a stationary process. The expla- nation goes back to our comparison of OLS and GLS: OLS is fully efficient if the regression variable is an eigenvector of the covariance matrix of the process. Sinusoids at the Fourier frequences (next sec- tion) are just that { for any stationary process (asymptotically). Regression at the Fourier Frequencies Idea Rather than count peaks to guess the period or frequency (as in the variable star), fit regressions at many frequencies to find hidden sinu- soids (simulated data). Use the estimated amplitude at these frequen- cies to locate hidden periodic components. It is particularly easy to estimate the amplitude at a grid of evenly spaced frequencies from 0 to 1/2. Fourier frequencies determine the grid of frequencies. A frequency 0 ≤ ! ≤ 1=2 is known as a Fourier frequency if the associated sinusoid completes an integer number of cycles in the observed length of data, j ! = ; j = 0; 1; 2; : : : ; n=2; j n assuming n is an even integer. Because of aliasing, the set of j's stop at n=2. We also don't consider negative frequencies since cosine is an even function and sine is odd; these are redundant (aliased). Orthogonality Cosines and sines at the Fourier frequencies generate an orthogonal (though not orthonormal) set of regressors. Consider the n × n matrix (assuming n is even) given by 0 . 1 . ::: . B C X = B cos(2π!0t) cos(2π!1t) sin(2π!1t) ::: cos(2π!n=2−1t) sin(2π!n=2−1t) cos(2π!n=2t) C @ . A . ::: . Note that the first column is all 1's (!0 = 0) and the last column 1 alternates ±1 (!n=2 = 2 ). (There's no sine term at !0 or !n=2 since Statistics 910, #6 4 these are both identically zero; sin 0 = sin π = 0. It follows that 0 n 0 0 ::: 0 1 B 0 n=2 0 ::: 0 C B C 0 B . C X X = B 0 0 .. 0 0 C B C B C @ 0 ::: 0 n=2 0 A 0 ::: 0 0 n The non-constant columns are orthogonal to the constant (i.e.sum to zero) since n X X cos(2π!kt) = sin(2π!kt) = 0 t=1 at the Fourier frequencies. (Imagine summing the sine and cosines around the unit circle in the plane.) The cross-products between columns reduce to these since, for instance, n X 1 X cos(2π!kt) sin(2π!jt) = 2 sin(2π!k+jt) − sin(2π!k−jt) t=1 = 0; For diagonal terms, notice that (from the double-angle expressions) 1 cos(a) cos(b) = 2 (cos(a + b) + cos(a − b)) 1 sin(a) sin(b) = 2 (cos(a − b) − cos(a + b)) allow us handle the sums of squares as follows: X 2 1 X cos(2π!jt) = 2 cos(4π!jt) + 1 = n=2; j 6= 0; n=2 : Harmonic regression If we use Fourier frequencies in our harmonic re- gression, the regression coefficients are easily found since \X0X" is almost diagonal. Specifically, (with b2s on the cosine terms and b1s on the sines) X X t b0 = xt=n bn=2 = xt(−1) =n t t 2 X 2 X b = x cos 2π! t b = x sin 2π! t: 2j n t j 1j n t j t t Statistics 910, #6 5 Note that there is no sine component at 0 or n=2 since sin 0 = sin π = 0. 2 2 To find the hidden sinusoid, we now can plot b2j + b1j versus the \frequency" j. There should be a peak for frequencies near that of the hidden sinusoid. Estimated amplitude The sum of squares captured by a specific sine/cosine pair is (j 6= 0; n=2) n n (b2 + b2 ) = A2 : 2 1j 2j 2 j That is, the amplitude of the fitted sinusoid at frequency !j determines the variance explained by this term in a regression model. Since we have fit a regression of n parameters to n observations x1; : : : ; xn, the model fits perfectly. Thus the variation in the fitted values is ex- actly that of the original data, and we obtain the following decompo- sition of the variance: X n X X2 = n(A2 + A2 ) + A2; t 0 n=2 2 j t j where the weights on A0 and An=2 differ since there is no sine term at these frequencies. Thus 0 Vector space The data X = (x1; : : : ; xn) is a vector in n-dimensional space. The usual basis for this space is the set of vectors 0 ej = (0 ::: 0 1j 0 0 ::: 0) : P Thus we can write X = t Xtet. The harmonic model uses a different orthogonal basis, namely the sines and cosines associated with the Fourier frequencies. The \saturated" harmonic regression n=2−1 t X Xt = b0 + bn=2(−1) + (b2j cos(2π!jt) + b1j sin(2π!jt)) j=1 represents the vector X in this new basis. The coordinates of X in this basis are the coefficients b1j and b2j. Statistics 910, #6 6 Discrete Fourier transform Time origin When dealing with the Fourier transform, it is common to index time from t = 0 to t = n − 1. Definition Changing to complex variables via Euler's form exp(iθ) = cos θ + i sin θ (1) leads to the discrete Fourier transform. The discrete Fourier transform (DFT) of the real-valued n sequence y0; : : : ; yn−1 is defined as n−1 1 X d(! ) = D = y exp(−i2π! t); j = 0; 1; 2; : : : ; n − 1: j j n t j t=0 The DFT is the set of harmonic regression coefficients, written using n complex variables. For j = 0; 1;:::; 2 , n−1 1 X D = y exp(−i2π! t) j n t j t=0 n−1 1 X = y (cos 2π! t − i sin 2π! t) n t j j t=0 1 = (b − ib ) 2 2j 1j p Note: SS define the DFT using a divisor n rather than n; R defines the DFT with no divisor. Matrix form The DFT amounts to a change of basis transformation.
Recommended publications
  • Seasonality in Portfolio Risk Calculations
    UMEÅUNIVERSITET Department of Physics Master’s Thesis in Engineering Physics HT 2019, 30 Credits Seasonality in Portfolio Risk Calculations Empirical study on Value at Risk of agricultural commodities using conditional volatility models v1.0 Author Emil Söderberg Nasdaq Umeå University Supervisor: Anders Stäring Supervisor: Joakim Ekspong Examiner: Markus Ådahl Seasonality in Portfolio Risk Calculations Abstract In this thesis, we examine if the conditional volatility models GARCH(1,1) and eGARCH(1,1) can give an improved Value-at-Risk (VaR) forecast by considering seasonal behaviours. It has been shown that some markets have a shifting volatility that is dependent on the seasons. By including sinusoidal seasonal components to the original conditional models, we try to capture this seasonal dependency. The examined data sets are from the agricultural commodity market, corn and soybean, which are known to have seasonal dependencies. This study validates the volatility performance by in-sample fit and out-of-sample fit. Value-at-Risk is estimated using two methods; quantile estimation (QE) of the return series and filtered historical simulation (FHS) from the standardized return series. The methods are validated by a backtesting process which analyse the number of outliers from each model by the Kupiec’s POF-test (proportional of failures) and the Christoffersen’s IF-test (interval forecast). The results indicates that the seasonal models has an overall better volatility validation than the non-seasonal models but the effect from the distributional assumption of standardized returns varies depending on model. Both VaR methods, for non-seasonal and seasonal models, seems however to benefit from assuming that the standardized return series experience kurtosis.
    [Show full text]
  • Arithmetic I Activity Objectives
    Arithmetic I Activity Objectives Activity Title Mathematical Objectives Convert numbers in words into numbers in digits and vice versa Australia by the Numbers: Working with Identify the place value of a given digit Number and Place Value (p. 6) Round numbers Add and subtract positive and negative integers Borrowing Money: Interpret the practical meaning of sums and differences of Working with Negative Integers (p. 10) integers Round numbers Caring for Pets: Estimate the difference of two numbers Estimating by Rounding (p. 14) Estimate the product of two numbers Add whole numbers Coins in the United States: Convert dollars to cents Working with Money (p. 18) Determine which of two sums has greater value Read data values from a bar graph Country Populations: Round numbers to the nearest integer Using Bar Graphs (p. 22) Calculate the difference between two whole numbers Calculate the sum of two whole numbers Fruit Snacks: Find the average of a set of numbers Working with Averages (p. 26) Predict unknown results based on averages Divide a given number of items equally between a given Sharing Snacks: number of groups Dividing Whole Numbers (p. 30) Use long division to divide one integer by another Interpret the practical meaning of a fraction Use long division to divide one integer by another Interpret the practical meaning of a fraction Sharing Snacks #2: Factor an integer into its prime factors Dividing Whole Numbers (p. 34) Convert a percent into a fraction Determine the practical meaning of quotients and remainders Convert numbers in words into numbers in digits Convert numbers in digits into numbers in words South Africa by the Numbers: Working Identify the place value of a given digit with Number and Place Value (p.
    [Show full text]
  • Bayesian Interpolation in a Dynamic Sinusoidal Model with Application to Packet-Loss Concealment
    18th European Signal Processing Conference (EUSIPCO-2010) Aalborg, Denmark, August 23-27, 2010 BAYESIAN INTERPOLATION IN A DYNAMIC SINUSOIDAL MODEL WITH APPLICATION TO PACKET-LOSS CONCEALMENT Jesper Kjær Nielseny, Mads Græsbøll Christenseny, Ali Taylan Cemgilyy, Simon J. Godsillyyy, and Søren Holdt Jenseny yAalborg University yyBoğaziçi University yyyUniversity of Cambridge Department of Electronic Systems Department of Computer Engineering Department of Engineering Niels Jernes Vej 12, DK-9220 Aalborg 34342 Bebek Istanbul, TR Trumpington St., Cambridge, CB2 1PZ, UK {jkn,mgc,shj,tl}@es.aau.dk [email protected] [email protected] ABSTRACT white Gaussian state and observation noise sequences with 2 In this paper, we consider Bayesian interpolation and pa- covariance matrix Q and variance σw, respectively. We also rameter estimation in a dynamic sinusoidal model. This assume a Gaussian prior for the initial state vector s1 with model is more flexible than the static sinusoidal model since mean vector µ and covariance matrix P . For a non-zero it enables the amplitudes and phases of the sinusoids to be state covariance matrix, the dynamic sinusoidal model in (1) time-varying. For the dynamic sinusoidal model, we derive is able to model non-stationary tonal signals such as a wide a Bayesian inference scheme for the missing observations, range of speech and audio signal segments. We are here con- hidden states and model parameters of the dynamic model. cerned with the problem of performing interpolation and pa- The inference scheme is based on a Markov chain Monte rameter estimation in the model in (1) from a Bayesian per- Carlo method known as Gibbs sampler.
    [Show full text]
  • Estimation of Parameters of Partially Sinusoidal Frequency Model
    1 ESTIMATION OF PARAMETERS OF PARTIALLY SINUSOIDAL FREQUENCY MODEL SWAGATA NANDI1 AND DEBASIS KUNDU2 Abstract. In this paper, we propose a modification of the multiple sinusoidal model such that periodic data observed with the presence of a trend component can be analyzed. In particular, we work with a linear trend model. But it can be developed similarly for the polynomial trend and the frequency model also. We consider the problem of estimation of frequency and amplitude parameters observed with a linear trend and a stationary linear process. We apply the usual least squares method to the differenced data. It has been proved that the proposed estimators are strongly consistent and asymptotically normally distributed. Extensive simulations have been reported to justify the suitability of the model and the proposed method. One real dataset, the monthly airline passenger data, has been analyzed using the model. 1. Introduction The sinusoidal frequency model embedded in noise is an extensively important model be- cause of its wide applicability in many areas of science and engineering. For around last forty years, researchers have approached the model from different point of view mainly motivated by real life problems. It has been observed in many applications that the data exhibit the presence of a trend component as well as a combination of some periodic components. The problem of analyzing such datasets leads to our present work. In this paper, we consider the following model to capture the periodic phenomenon observed with a linear trend; Xp y(t) = a + bt + [Ak cos(!kt) + Bk sin(!kt)] + x(t); t = 1; : : : ; n + 1: (1) k=1 1Corresponding Author Date: August 20, 2010.
    [Show full text]
  • A Statistical and Spectral Model for Representing Noisy Sounds with Short-Time Sinusoids
    EURASIP Journal on Applied Signal Processing 2005:12, 1794–1806 c 2005 P. Hanna and M. Desainte-Catherine A Statistical and Spectral Model for Representing Noisy Sounds with Short-Time Sinusoids Pierre Hanna SCRIME, Laboratoire Bordelais de Recherche en Informatique (LaBRI), Universite Bordeaux 1, 33405 Talence Cedex, France Email: [email protected] Myriam Desainte-Catherine SCRIME, Laboratoire Bordelais de Recherche en Informatique (LaBRI), Universite Bordeaux 1, 33405 Talence Cedex, France Email: [email protected] Received 12 March 2004; Revised 10 March 2005; Recommended for Publication by Mark Kahrs We propose an original model for noise analysis, transformation, and synthesis: the CNSS model. Noisy sounds are represented with short-time sinusoids whose frequencies and phases are random variables. This spectral and statistical model represents infor- mation about the spectral density of frequencies. This perceptually relevant property is modeled by three mathematical parameters that define the distribution of the frequencies. This model also represents the spectral envelope. The mathematical parameters are defined and the analysis algorithms to extract these parameters from sounds are introduced. Then algorithms for generating sounds from the parameters of the model are presented. Applications of this model include tools for composers, psychoacoustic experiments, and pedagogy. Keywords and phrases: stochastic part of sounds, analysis and real-time synthesis of noisy sounds, spectral models, spectral density, musical transformations of sounds. 1. INTRODUCTION to be parts of the signal that cannot be represented with si- nusoids whose amplitude and frequency slowly vary with Computers offer new possibilities for sound processing. Ap- time and is implicitly defined as whatever is left after the plications are numerous in the musical field.
    [Show full text]
  • Using Cyclical Components to Improve the Forecasts of the Stock Market and Macroeconomic Variables Kenneth R
    Journal of Modern Applied Statistical Methods Volume 17 | Issue 1 Article 25 10-8-2018 Using Cyclical Components to Improve the Forecasts of the Stock Market and Macroeconomic Variables Kenneth R. Szulczyk Curtin University Malaysia, [email protected] Shibley Sadique University of Rajshahi, [email protected] Follow this and additional works at: https://digitalcommons.wayne.edu/jmasm Part of the Applied Statistics Commons, Social and Behavioral Sciences Commons, and the Statistical Theory Commons Recommended Citation Szulczyk, Kenneth R. and Sadique, Shibley (2018) "Using Cyclical Components to Improve the Forecasts of the Stock Market and Macroeconomic Variables," Journal of Modern Applied Statistical Methods: Vol. 17 : Iss. 1 , Article 25. DOI: Economic variables such as stock market indices, interest rates, and national output measures contain cyclical components. Forecasting methods excluding these cyclical components yield inaccurate out-of-sample forecasts. Accordingly, a three-stage procedure is developed to estimate a vector autoregression (VAR) with cyclical components. A Monte Carlo simulation shows the procedure estimates the parameters accurately. Subsequently, a VAR with cyclical components improves the root-mean-square error of out-of-sample forecasts by 50% for a stock market model with macroeconomic variables. Available at: https://digitalcommons.wayne.edu/jmasm/vol17/iss1/25 This Regular Article is brought to you for free and open access by the Open Access Journals at DigitalCommons@WayneState. It has been accepted for inclusion in Journal of Modern Applied Statistical Methods by an authorized editor of DigitalCommons@WayneState. Journal of Modern Applied Statistical Methods May 2018, Vol. 17, No. 1, eP2468 Copyright © 2018 JMASM, Inc.
    [Show full text]
  • Sinusoidal Modelling and Synthesis
    Sinusoidal Modelling and Synthesis Johannes Luig Amir Rahimzadeh Seminar Work for “Algorithmen in Akustik und Computermusik II, SE” June 2008 1 Introduction Sinusoidal modelling and Synthesis (SMS) is a signal analysis and synthesis framework where a speech- or music signal is represented as a sum of sinusoids each with time-varying amplitude, frequency and phase. The goal is modelling a signal by a reduced set of parameters yielding a more compact representation of the data. Once a time-frequency representation of the signal is available it is usefull in different ways. The reduced amount of data is of interest for transmission or storage purposes. Also various digital audio effects like pitch-shifting, time stretching and sound morphing could easily be applied using the time frequency data. It is common to analyze time varying signals framewise. A frame is a segment of the signal ranging from a few milliseconds up to 0.5 seconds depending on the application. These frames are analyzed in the frequency domain applying a Fast Fourier Transform (FFT). The relevant components are found by applying a peak picking algorithm to the spectra and the corresponding amplitudes, frequencies and phases are extracted. Then the individual analysis points on the resulting time-frequency map are connected to form tracks. For the syntesis the values between the analysis points have to be interpolated in order to get a timegrid that satisfies the original sampling rate. Finally the sound can be synthesized using a bank of oscillators which is fed with the parameters extracted before namely, the corresponding amplitudes, frequencies and phases.
    [Show full text]
  • 1. Exploratory Data Analysis
    1. Exploratory Data Analysis 1.Exploratory Data Analysis This chapter presents the assumptions, principles, and techniques necessary to gain insight into data via EDA--exploratory data analysis. 1. EDA Introduction 2. EDA Assumptions 1. What is EDA? 1. Underlying Assumptions 2. EDA vs Classical & Bayesian 2. Importance 3. EDA vs Summary 3. Techniques for Testing 4. EDA Goals Assumptions 5. The Role of Graphics 4. Interpretation of 4-Plot 6. An EDA/Graphics Example 5. Consequences 7. General Problem Categories 3. EDA Techniques 4. EDA Case Studies 1. Introduction 1. Introduction 2. Analysis Questions 2. By Problem Category 3. Graphical Techniques: Alphabetical 4. Graphical Techniques: By Problem Category 5. Quantitative Techniques 6. Probability Distributions Detailed Chapter Table of Contents References Dataplot Commands for EDA Techniques http://www.itl.nist.gov/div898/handbook/eda/eda.htm [11/13/2003 5:30:57 PM] 1. Exploratory Data Analysis 1. Exploratory Data Analysis - Detailed Table of Contents [1.] This chapter presents the assumptions, principles, and techniques necessary to gain insight into data via EDA--exploratory data analysis. 1. EDA Introduction [1.1.] 1. What is EDA? [1.1.1.] 2. How Does Exploratory Data Analysis differ from Classical Data Analysis? [1.1.2.] 1. Model [1.1.2.1.] 2. Focus [1.1.2.2.] 3. Techniques [1.1.2.3.] 4. Rigor [1.1.2.4.] 5. Data Treatment [1.1.2.5.] 6. Assumptions [1.1.2.6.] 3. How Does Exploratory Data Analysis Differ from Summary Analysis? [1.1.3.] 4. What are the EDA Goals? [1.1.4.] 5.
    [Show full text]
  • Spectral Analysis of Signals
    \sm2" i i 2004/2/22 page i i i SPECTRAL ANALYSIS OF SIGNALS Petre Stoica and Randolph Moses PRENTICE HALL, Upper Saddle River, New Jersey 07458 i i i i \sm2" i i 2004/2/22 page ii i i Library of Congress Cataloging-in-Publication Data Spectral Analysis of Signals/Petre Stoica and Randolph Moses p. cm. Includes bibliographical references index. ISBN 0-13-113956-8 1. Spectral theory (Mathematics) I. Moses, Randolph II. Title 512'{dc21 2005 QA814.G27 00-055035 CIP Acquisitions Editor: Tom Robbins Editor-in-Chief: ? Assistant Vice President of Production and Manufacturing: ? Executive Managing Editor: ? Senior Managing Editor: ? Production Editor: ? Manufacturing Buyer: ? Manufacturing Manager: ? Marketing Manager: ? Marketing Assistant: ? Director of Marketing: ? Editorial Assistant: ? Art Director: ? Interior Designer: ? Cover Designer: ? Cover Photo: ? c 2005 by Prentice Hall, Inc. Upper Saddle River, New Jersey 07458 All rights reserved. No part of this book may be reproduced, in any form or by any means, without permission in writing from the publisher. Printed in the United States of America 10 9 8 7 6 5 4 3 2 1 ISBN 0-13-113956-8 Pearson Education LTD., London Pearson Education Australia PTY, Limited, Sydney Pearson Education Singapore, Pte. Ltd Pearson Education North Asia Ltd, Hong Kong Pearson Education Canada, Ltd., Toronto Pearson Educacion de Mexico, S.A. de C.V. Pearson Education - Japan, Tokyo Pearson Education Malaysia, Pte. Ltd i i i i \sm2" i i 2004/2/22 page iii i i Contents 1 Basic Concepts 1 1.1 Introduction . 1 1.2 Energy Spectral Density of Deterministic Signals .
    [Show full text]
  • Spectral Analysis 1
    SPECTRAL ANALYSIS 1 Spectral and Cross-Spectral Analysis - a Tutorial for Psychologists and Social Scientists M.J. Vowels University of Surrey L.M. Vowels University of Southampton N.D. Wood University of Kentucky Author Note Matthew J. Vowels, Centre for Computer Vision, Speech and Signal Processing, University of Surrey; Laura M. Vowels, Department of Psychology, University of Southampton; Nathan D. Wood, Department of Family Sciences, University of Kentucky Correspondence concerning this article should be addressed to Laura M. Vowels, School of Psychology, University of Southampton, Highfield Campus, SO17 1BJ, UK. E-mail: [email protected] SPECTRAL ANALYSIS 2 Abstract Social scientists have become increasingly interested in using intensive longitudinal methods to study social phenomena that change over time. Many of these phenomena are expected to exhibit cycling fluctuations (e.g., sleep, mood, sexual desire). However, researchers typically employ analytical methods which are unable to model such patterns. We present spectral and cross-spectral analysis as means to address this limitation. Spectral analysis provides a means to interrogate time series from a different, frequency domain perspective, and to understand how the time series may be decomposed into their constituent periodic components. Cross-spectral extends this to dyadic data and allows for synchrony and time offsets to be identified. The techniques are commonly used in the physical and engineering sciences, and we discuss how to apply these popular analytical techniques to the social sciences while also demonstrating how to undertake estimations of significance and effect size. In this tutorial we begin by introducing spectral and cross-spectral analysis, before demonstrating its application to simulated univariate and bivariate individual- and group-level data.
    [Show full text]
  • An Analysis-By-Synthesis Approach to Sinusoidal Modeling Applied to Speech and Music Signal Processing
    An Analysis-by-Synthesis Approach to Sinusoidal Modeling Applied to Speech and Music Signal Processing A THESIS Presented to The Academic Faculty By E. Bryan George In Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy in Electrical Engineering Georgia Institute of Technology November. 1991 An Analysis-by-Synthesis Approach to Sinusoidal Modeling Applied to Speech and Music Signal Processing Approved: J - / -. Mark J. T^mi'ti^h airman Ronald W. Schafer ^ ^1——•&- M^rk Ai Richards \y Date approved by Chairman /2~f Z-/^/ Dedicated to the memories of: Eric Bryan George. Jr. Eugene L. Cornett, Sr. Ill Acknowledgments First and foremost, I would like to thank iy advisor, Professor Mark J. T. Smith, for providing guidance ihroughout my tenure as a graduate student. His extensive knowledge of digital signal processing has kept: me out of many blind research alleys, and his insightful comments on my various papers jarid this thesis have significantly enhanced the quality of my published work. Furthermore, his skill as a fencer was instrumental in my eventually leaving Georgia Tech.1 Many thanks go to the other members of my reading committee, Profs. Ronald W. Schafer and Mark A. Richards for their input on the thesis, and to the other members of my defense committee, Profs. Douglas B. Williams and Alfred D. Andrew. My appreciation and respect goes out to many past and present colleagues at Georgia Tech. particularly Beth Carlson, Dave Mazel, Brian Evans, Sam Liu, Kate Maloney, Dave Pepper, Janet Rutledge and Pete Wung. I would like to acknowledge the staff of the Georgia Tech Office of Graduate Studies, most notably Dr.
    [Show full text]
  • Sinusoidal Modeling Applied to Spatially Variant Tropospheric Ozone Air Pollution
    SINUSOIDAL MODELING APPLIED TO SPATIALLY VARIANT TROPOSPHERIC OZONE AIR POLLUTION By Nicholas Z. Muller and Peter C. B. Phillips January 2006 COWLES FOUNDATION DISCUSSION PAPER NO. 1548 COWLES FOUNDATION FOR RESEARCH IN ECONOMICS YALE UNIVERSITY Box 208281 New Haven, Connecticut 06520-8281 http://cowles.econ.yale.edu/ Sinusoidal Modeling Applied to Spatially Variant Tropospheric Ozone Air Pollution1 Nicholas Z. Muller School of Forestry and Environmental Studies Yale University 1773 Huntington Tpke. Trumbull, CT 06611 USA (203) 386-9314 [email protected] Peter C. B. Phillips Cowles Foundation, Yale University University of York & University of Auckland December 4th,2005 1 Phillips acknowledges support from the NSF under Grant No. SES 04-142254. Mr. Muller would like to thank the Glaser Progress Foundation for supporting this research. Abstract This paper demonstrates how parsimonious models of sinusoidal functions can be used to fit spatially variant time series in which there is considerable variation of a periodic type. A typ- ical shortcoming of such tools relates to the difficulty in capturing idiosyncratic variation in periodic models. The strategy developed here addresses this deficiency. While previous work has sought to overcome the shortcoming by augmenting sinusoids with other techniques, the present approach employs station-specific sinusoids to supplement a common regional compo- nent, which succeeds in capturing local idiosyncratic behavior in a parsimonious manner. The experiments conducted herein reveal that a semi-parametric approach enables such models to fit spatially varying time series with periodic behavior in a remarkably tight fashion. The methods are applied to a panel data set consisting of hourly air pollution measurements.
    [Show full text]