State-Space Multitaper Spectrogram Algorithms: Theory and Applications
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Spectrum Estimation Using Periodogram, Bartlett and Welch
Spectrum estimation using Periodogram, Bartlett and Welch Guido Schuster Slides follow closely chapter 8 in the book „Statistical Digital Signal Processing and Modeling“ by Monson H. Hayes and most of the figures and formulas are taken from there 1 Introduction • We want to estimate the power spectral density of a wide- sense stationary random process • Recall that the power spectrum is the Fourier transform of the autocorrelation sequence • For an ergodic process the following holds 2 Introduction • The main problem of power spectrum estimation is – The data x(n) is always finite! • Two basic approaches – Nonparametric (Periodogram, Bartlett and Welch) • These are the most common ones and will be presented in the next pages – Parametric approaches • not discussed here since they are less common 3 Nonparametric methods • These are the most commonly used ones • x(n) is only measured between n=0,..,N-1 • Ensures that the values of x(n) that fall outside the interval [0,N-1] are excluded, where for negative values of k we use conjugate symmetry 4 Periodogram • Taking the Fourier transform of this autocorrelation estimate results in an estimate of the power spectrum, known as the Periodogram • This can also be directly expressed in terms of the data x(n) using the rectangular windowed function xN(n) 5 Periodogram of white noise 32 samples 6 Performance of the Periodogram • If N goes to infinity, does the Periodogram converge towards the power spectrum in the mean squared sense? • Necessary conditions – asymptotically unbiased: – variance -
An Information Theoretic Algorithm for Finding Periodicities in Stellar Light Curves Pablo Huijse, Student Member, IEEE, Pablo A
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 1, NO. 1, JANUARY 2012 1 An Information Theoretic Algorithm for Finding Periodicities in Stellar Light Curves Pablo Huijse, Student Member, IEEE, Pablo A. Estevez*,´ Senior Member, IEEE, Pavlos Protopapas, Pablo Zegers, Senior Member, IEEE, and Jose´ C. Pr´ıncipe, Fellow Member, IEEE Abstract—We propose a new information theoretic metric aligned to Earth. Periodic drops in brightness are observed for finding periodicities in stellar light curves. Light curves due to the mutual eclipses between the components of the are astronomical time series of brightness over time, and are system. Although most stars have at least some variation in characterized as being noisy and unevenly sampled. The proposed metric combines correntropy (generalized correlation) with a luminosity, current ground based survey estimations indicate periodic kernel to measure similarity among samples separated that 3% of the stars varying more than the sensitivity of the by a given period. The new metric provides a periodogram, called instruments and ∼1% are periodic [2]. Correntropy Kernelized Periodogram (CKP), whose peaks are associated with the fundamental frequencies present in the data. Detecting periodicity and estimating the period of stars is The CKP does not require any resampling, slotting or folding of high importance in astronomy. The period is a key feature scheme as it is computed directly from the available samples. for classifying variable stars [3], [4]; and estimating other CKP is the main part of a fully-automated pipeline for periodic light curve discrimination to be used in astronomical survey parameters such as mass and distance to Earth [5]. -
An Overview of Psd: Adaptive Sine Multitaper Power Spectral Density Estimation in R
An overview of psd: Adaptive sine multitaper power spectral density estimation in R Andrew J. Barbour and Robert L. Parker June 28, 2020 Abstract This vignette provides an overview of some features included in the package psd, designed to compute estimates of power spectral density (PSD) for a univariate series in a sophisticated manner, with very little tuning effort. The sine multitapers are used, and the number of tapers varies with spectral shape, according to the optimal value proposed by Riedel and Sidorenko (1995). The adaptive procedure iteratively refines the optimal number of tapers at each frequency based on the spectrum from the previous iteration. Assuming the adaptive procedure converges, this produces power spectra with significantly lower spectral variance relative to results from less-sophisticated estimators. Sine tapers exhibit excellent leakage suppression characteristics, so bias effects are also reduced. Resolution and uncertainty vary with the number of tapers, which means we do not need to resort to either (1) windowing methods, which inherently degrade resolution at low-frequency (e.g. Welch’s method); or (2) smoothing kernels, which can badly distort important features without careful tuning (e.g. the Daniell kernel in stats::spectrum). In this regards psd is best suited for data having large dynamic range and some mix of narrow and wide-band structure, features typically found in geophysical datasets. Contents 1 Quick start: A minimal example. 2 2 Comparisons with other methods 5 2.1 stats::spectrum ............................................5 2.2 RSEIS::mtapspec ............................................7 2.3 multitaper::spec.mtm ........................................ 15 2.4 sapa::SDF ................................................ 15 2.5 bspec::bspec ............................................. -
Windowing Techniques, the Welch Method for Improvement of Power Spectrum Estimation
Computers, Materials & Continua Tech Science Press DOI:10.32604/cmc.2021.014752 Article Windowing Techniques, the Welch Method for Improvement of Power Spectrum Estimation Dah-Jing Jwo1, *, Wei-Yeh Chang1 and I-Hua Wu2 1Department of Communications, Navigation and Control Engineering, National Taiwan Ocean University, Keelung, 202-24, Taiwan 2Innovative Navigation Technology Ltd., Kaohsiung, 801, Taiwan *Corresponding Author: Dah-Jing Jwo. Email: [email protected] Received: 01 October 2020; Accepted: 08 November 2020 Abstract: This paper revisits the characteristics of windowing techniques with various window functions involved, and successively investigates spectral leak- age mitigation utilizing the Welch method. The discrete Fourier transform (DFT) is ubiquitous in digital signal processing (DSP) for the spectrum anal- ysis and can be efciently realized by the fast Fourier transform (FFT). The sampling signal will result in distortion and thus may cause unpredictable spectral leakage in discrete spectrum when the DFT is employed. Windowing is implemented by multiplying the input signal with a window function and windowing amplitude modulates the input signal so that the spectral leakage is evened out. Therefore, windowing processing reduces the amplitude of the samples at the beginning and end of the window. In addition to selecting appropriate window functions, a pretreatment method, such as the Welch method, is effective to mitigate the spectral leakage. Due to the noise caused by imperfect, nite data, the noise reduction from Welch’s method is a desired treatment. The nonparametric Welch method is an improvement on the peri- odogram spectrum estimation method where the signal-to-noise ratio (SNR) is high and mitigates noise in the estimated power spectra in exchange for frequency resolution reduction. -
Windowing Design and Performance Assessment for Mitigation of Spectrum Leakage
E3S Web of Conferences 94, 03001 (2019) https://doi.org/10.1051/e3sconf/20199403001 ISGNSS 2018 Windowing Design and Performance Assessment for Mitigation of Spectrum Leakage Dah-Jing Jwo 1,*, I-Hua Wu 2 and Yi Chang1 1 Department of Communications, Navigation and Control Engineering, National Taiwan Ocean University 2 Pei-Ning Rd., Keelung 202, Taiwan 2 Bison Electronics, Inc., Neihu District, Taipei 114, Taiwan Abstract. This paper investigates the windowing design and performance assessment for mitigation of spectral leakage. A pretreatment method to reduce the spectral leakage is developed. In addition to selecting appropriate window functions, the Welch method is introduced. Windowing is implemented by multiplying the input signal with a windowing function. The periodogram technique based on Welch method is capable of providing good resolution if data length samples are selected optimally. Windowing amplitude modulates the input signal so that the spectral leakage is evened out. Thus, windowing reduces the amplitude of the samples at the beginning and end of the window, altering leakage. The influence of various window functions on the Fourier transform spectrum of the signals was discussed, and the characteristics and functions of various window functions were explained. In addition, we compared the differences in the influence of different data lengths on spectral resolution and noise levels caused by the traditional power spectrum estimation and various window-function-based Welch power spectrum estimations. 1 Introduction knowledge. Due to computer capacity and limitations on processing time, only limited time samples can actually The spectrum analysis [1-4] is a critical concern in many be processed during spectrum analysis and data military and civilian applications, such as performance processing of signals, i.e., the original signals need to be test of electric power systems and communication cut off, which induces leakage errors. -
Understanding the Lomb-Scargle Periodogram
Understanding the Lomb-Scargle Periodogram Jacob T. VanderPlas1 ABSTRACT The Lomb-Scargle periodogram is a well-known algorithm for detecting and char- acterizing periodic signals in unevenly-sampled data. This paper presents a conceptual introduction to the Lomb-Scargle periodogram and important practical considerations for its use. Rather than a rigorous mathematical treatment, the goal of this paper is to build intuition about what assumptions are implicit in the use of the Lomb-Scargle periodogram and related estimators of periodicity, so as to motivate important practical considerations required in its proper application and interpretation. Subject headings: methods: data analysis | methods: statistical 1. Introduction The Lomb-Scargle periodogram (Lomb 1976; Scargle 1982) is a well-known algorithm for de- tecting and characterizing periodicity in unevenly-sampled time-series, and has seen particularly wide use within the astronomy community. As an example of a typical application of this method, consider the data shown in Figure 1: this is an irregularly-sampled timeseries showing a single ob- ject from the LINEAR survey (Sesar et al. 2011; Palaversa et al. 2013), with un-filtered magnitude measured 280 times over the course of five and a half years. By eye, it is clear that the brightness of the object varies in time with a range spanning approximately 0.8 magnitudes, but what is not immediately clear is that this variation is periodic in time. The Lomb-Scargle periodogram is a method that allows efficient computation of a Fourier-like power spectrum estimator from such unevenly-sampled data, resulting in an intuitive means of determining the period of oscillation. -
Spectral Estimation Using Multitaper Whittle Methods with a Lasso Penalty Shuhan Tang, Peter F
IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. , NO. , MONTH YEAR 1 Spectral Estimation Using Multitaper Whittle Methods with a Lasso Penalty Shuhan Tang, Peter F. Craigmile, and Yunzhang Zhu Last updated July 25, 2019 Abstract—Spectral estimation provides key insights into the can compromise estimation (see [1], ch.9, and references frequency domain characteristics of a time series. Naive non- therein). parametric estimates of the spectral density, such as the peri- A popular alternative approach is to consider a semipara- odogram, are inconsistent, and the more advanced lag window or multitaper estimators are often still too noisy. We propose metric model for the SDF, in which the log SDF is expressed an L1 penalized quasi-likelihood Whittle framework based on in terms of a truncated basis expansion, where the number multitaper spectral estimates which performs semiparametric of basis functions are allowed to increase with the sample spectral estimation for regularly sampled univariate stationary size. The statistical problem then becomes how to enforce time series. Our new approach circumvents the problematic sparsity by selecting the basis functions and estimating the Gaussianity assumption required by least square approaches and achieves sparsity for a wide variety of basis functions. We model parameters so that we adequately estimate the SDF, present an alternating direction method of multipliers (ADMM) but also have computational efficiency as the sample size algorithm to efficiently solve the optimization problem, and is increased. Gao [3] [4], Moulin [5] and Walden et al. [6] develop universal threshold and generalized information criterion enforce sparsity using a penalized least square (LS) approach (GIC) strategies for efficient tuning parameter selection that for estimating the log SDF with wavelet soft thresholding. -
Optimal and Adaptive Subband Beamforming
Optimal and Adaptive Subband Beamforming Principles and Applications Nedelko Grbi´c Ronneby, June 2001 Department of Telecommunications and Signal Processing Blekinge Institute of Technology, S-372 25 Ronneby, Sweden c Nedelko Grbi´c ISBN 91-7295-002-1 ISSN 1650-2159 Published 2001 Printed by Kaserntryckeriet AB Karlskrona 2001 Sweden v Preface This doctoral thesis summarizes my work in the field of array signal processing. Frequency domain processing comprise a significant part of the material. The work is mainly aimed at speech enhancement in communication systems such as confer- ence telephony and handsfree mobile telephony. The work has been carried out at Department of Telecommunications and Signal Processing at Blekinge Institute of Technology. Some of the work has been conducted in collaboration with Ericsson Mobile Communications and Australian Telecommunications Research Institute. The thesis consists of seven stand alone parts: Part I Optimal and Adaptive Beamforming for Speech Signals Part II Structures and Performance Limits in Subband Beamforming Part III Blind Signal Separation using Overcomplete Subband Representation Part IV Neural Network based Adaptive Microphone Array System for Speech Enhancement Part V Design of Oversampled Uniform DFT Filter Banks with Delay Specifica- tion using Quadratic Optimization Part VI Design of Oversampled Uniform DFT Filter Banks with Reduced Inband Aliasing and Delay Constraints Part VII A New Pilot-Signal based Space-Time Adaptive Algorithm vii Acknowledgments I owe sincere gratitude to Professor Sven Nordholm with whom most of my work has been conducted. There have been enormous amount of inspiration and valuable discussions with him. Many thanks also goes to Professor Ingvar Claesson who has made every possible effort to make my study complete and rewarding. -
Introduction to Time Series Analysis. Lecture 19
Introduction to Time Series Analysis. Lecture 19. 1. Review: Spectral density estimation, sample autocovariance. 2. The periodogram and sample autocovariance. 3. Asymptotics of the periodogram. 1 Estimating the Spectrum: Outline We have seen that the spectral density gives an alternative view of • stationary time series. Given a realization x ,...,x of a time series, how can we estimate • 1 n the spectral density? One approach: replace γ( ) in the definition • · ∞ f(ν)= γ(h)e−2πiνh, h=−∞ with the sample autocovariance γˆ( ). · Another approach, called the periodogram: compute I(ν), the squared • modulus of the discrete Fourier transform (at frequencies ν = k/n). 2 Estimating the spectrum: Outline These two approaches are identical at the Fourier frequencies ν = k/n. • The asymptotic expectation of the periodogram I(ν) is f(ν). We can • derive some asymptotic properties, and hence do hypothesis testing. Unfortunately, the asymptotic variance of I(ν) is constant. • It is not a consistent estimator of f(ν). 3 Review: Spectral density estimation If a time series X has autocovariance γ satisfying { t} ∞ γ(h) < , then we define its spectral density as h=−∞ | | ∞ ∞ f(ν)= γ(h)e−2πiνh h=−∞ for <ν< . −∞ ∞ 4 Review: Sample autocovariance Idea: use the sample autocovariance γˆ( ), defined by · n−|h| 1 γˆ(h)= (x x¯)(x x¯), for n<h<n, n t+|h| − t − − t=1 as an estimate of the autocovariance γ( ), and then use · n−1 fˆ(ν)= γˆ(h)e−2πiνh h=−n+1 for 1/2 ν 1/2. − ≤ ≤ 5 Discrete Fourier transform For a sequence (x1,...,xn), define the discrete Fourier transform (DFT) as (X(ν0),X(ν1),...,X(νn−1)), where 1 n X(ν )= x e−2πiνkt, k √n t t=1 and ν = k/n (for k = 0, 1,...,n 1) are called the Fourier frequencies. -
The Periodogram • Recall: the Discrete Fourier Transform D Ωj = N Xte , J = 0
The Periodogram • Recall: the discrete Fourier transform n −1=2 X −2πi! t d !j = n xte j ; j = 0; 1; : : : ; n − 1; t=1 • and the periodogram 2 I !j = d !j ; j = 0; 1; : : : ; n − 1; • where !j is one of the Fourier frequencies j ! = : j n 1 Sine and Cosine Transforms • For j = 0; 1; : : : ; n − 1, n −1=2 X −2πi! t d !j = n xte j t=1 n n −1=2 X −1=2 X = n xt cos 2π!jt − i × n xt sin 2π!jt t=1 t=1 = dc !j − i × ds !j : • dc !j and ds !j are the cosine transform and sine trans- form, respectively, of x1; x2; : : : ; xn. 2 2 • The periodogram is I !j = dc !j + ds !j . 2 Sampling Distributions • For convenience, suppose that n is odd: n = 2m + 1. • White noise: orthogonality properties of sines and cosines mean that dc(!1), ds(!1), dc(!2), ds(!2),..., dc(!m), ds(!m) 1 2 have zero mean, variance 2σw, and are uncorrelated. • Gaussian white noise: dc(!1), ds(!1), dc(!2), ds(!2),..., 1 2 dc(!m), ds(!m) are i.i.d. N 0; 2σw . 1 2 2 • So for Gaussian white noise, I !j ∼ 2σw × χ2. 3 • General case: dc(!1), ds(!1), dc(!2), ds(!2),..., dc(!m), ds(!m) have zero mean and are approximately uncorrelated, and h i h i 1 var dc !j ≈ var ds !j ≈ 2fx !j ; where fx !j is the spectral density function. • If xt is Gaussian, 2 2 Ix !j dc !j + ds !j = approximately 2 1 1 ∼ χ2; 2fx !j 2fx !j and Ix(!1), Ix(!2),..., Ix(!m) are approximately indepen- dent. -
Localized Spectral Analysis on the Sphere Mark Wieczorek, Frederik Simons
Localized spectral analysis on the sphere Mark Wieczorek, Frederik Simons To cite this version: Mark Wieczorek, Frederik Simons. Localized spectral analysis on the sphere. Geophysical Jour- nal International, Oxford University Press (OUP), 2005, 162 (3), pp.655-675. 10.1111/j.1365- 246X.2005.02687.x. hal-02458533 HAL Id: hal-02458533 https://hal.archives-ouvertes.fr/hal-02458533 Submitted on 30 Jul 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Geophys. J. Int. (2005) 162, 655–675 doi: 10.1111/j.1365-246X.2005.02687.x Localized spectral analysis on the sphere ∗ Mark A. Wieczorek1 and Frederik J. Simons2, 1D´epartement de G´eophysique Spatiale et Plan´etaire, Institut de Physique du Globe de Paris, France. E-mail: [email protected] 2Geosciences Department, Guyot Hall, Princeton University, Princeton, NJ 08540, USA Accepted 2005 May 13. Received 2005 May 9; in original form 2004 October 12 SUMMARY Downloaded from https://academic.oup.com/gji/article-abstract/162/3/655/2097585 by guest on 30 July 2020 It is often advantageous to investigate the relationship between two geophysical data sets in the spectral domain by calculating admittance and coherence functions. -
Comparing Open-Source Toolboxes for Processing and Analysis of Spike
bioRxiv preprint doi: https://doi.org/10.1101/600486; this version posted April 12, 2019. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made Unakafova et al. available under aCC-BY 4.0 International licenseOpen-source. spike and LFP toolboxes 1 Comparing open-source toolboxes for 2 processing and analysis of spike and local field 3 potentials data 4 5 Valentina A. Unakafova1,* and Alexander Gail1,2,3,4 6 1Cognitive Neurosciences Laboratory, German Primate Center, Goettingen, Germany 7 2Leibniz ScienceCampus, Primate Cognition, Goettingen, Germany 8 3Georg-Elias-Mueller-Institute of Psychology, University of Goettingen, Goettingen, Germany 9 4Bernstein Center for Computational Neuroscience, Goettingen, Germany 10 *Correspondence: [email protected] 11 ABSTRACT. 12 Analysis of spike and local field potential (LFP) data is an essential part of neuroscientific research. Today 13 there exist many open-source toolboxes for spike and LFP data analysis implementing various functionality. 14 Here we aim to provide a practical guidance for neuroscientists in the choice of an open-source toolbox best 15 satisfying their needs. We overview major open-source toolboxes for spike and LFP data analysis as well as 16 toolboxes with tools for connectivity analysis, dimensionality reduction and generalized linear modeling. We 17 focus on comparing toolboxes functionality, statistical and visualization tools, documentation and support 18 quality. To give a better insight, we compare and illustrate functionality of the toolboxes on open-access 19 dataset or simulated data and make corresponding MATLAB scripts publicly available.