Introduction to Time Series Regression and Forecasting (SW Chapter 14)
Total Page:16
File Type:pdf, Size:1020Kb
 
											Load more
										Recommended publications
									
								- 
												  Kalman and Particle FilteringAbstract: The Kalman and Particle filters are algorithms that recursively update an estimate of the state and find the innovations driving a stochastic process given a sequence of observations. The Kalman filter accomplishes this goal by linear projections, while the Particle filter does so by a sequential Monte Carlo method. With the state estimates, we can forecast and smooth the stochastic process. With the innovations, we can estimate the parameters of the model. The article discusses how to set a dynamic model in a state-space form, derives the Kalman and Particle filters, and explains how to use them for estimation. Kalman and Particle Filtering The Kalman and Particle filters are algorithms that recursively update an estimate of the state and find the innovations driving a stochastic process given a sequence of observations. The Kalman filter accomplishes this goal by linear projections, while the Particle filter does so by a sequential Monte Carlo method. Since both filters start with a state-space representation of the stochastic processes of interest, section 1 presents the state-space form of a dynamic model. Then, section 2 intro- duces the Kalman filter and section 3 develops the Particle filter. For extended expositions of this material, see Doucet, de Freitas, and Gordon (2001), Durbin and Koopman (2001), and Ljungqvist and Sargent (2004). 1. The state-space representation of a dynamic model A large class of dynamic models can be represented by a state-space form: Xt+1 = ϕ (Xt,Wt+1; γ) (1) Yt = g (Xt,Vt; γ) . (2) This representation handles a stochastic process by finding three objects: a vector that l describes the position of the system (a state, Xt X R ) and two functions, one mapping ∈ ⊂ 1 the state today into the state tomorrow (the transition equation, (1)) and one mapping the state into observables, Yt (the measurement equation, (2)).
- 
												  Lecture 19: Wavelet Compression of Time Series and ImagesLecture 19: Wavelet compression of time series and images c Christopher S. Bretherton Winter 2014 Ref: Matlab Wavelet Toolbox help. 19.1 Wavelet compression of a time series The last section of wavelet leleccum notoolbox.m demonstrates the use of wavelet compression on a time series. The idea is to keep the wavelet coefficients of largest amplitude and zero out the small ones. 19.2 Wavelet analysis/compression of an image Wavelet analysis is easily extended to two-dimensional images or datasets (data matrices), by first doing a wavelet transform of each column of the matrix, then transforming each row of the result (see wavelet image). The wavelet coeffi- cient matrix has the highest level (largest-scale) averages in the first rows/columns, then successively smaller detail scales further down the rows/columns. The ex- ample also shows fine results with 50-fold data compression. 19.3 Continuous Wavelet Transform (CWT) Given a continuous signal u(t) and an analyzing wavelet (x), the CWT has the form Z 1 s − t W (λ, t) = λ−1=2 ( )u(s)ds (19.3.1) −∞ λ Here λ, the scale, is a continuous variable. We insist that have mean zero and that its square integrates to 1. The continuous Haar wavelet is defined: 8 < 1 0 < t < 1=2 (t) = −1 1=2 < t < 1 (19.3.2) : 0 otherwise W (λ, t) is proportional to the difference of running means of u over successive intervals of length λ/2. 1 Amath 482/582 Lecture 19 Bretherton - Winter 2014 2 In practice, for a discrete time series, the integral is evaluated as a Riemann sum using the Matlab wavelet toolbox function cwt.
- 
												  The Open Chromatin Landscape of Non–Small Cell Lung CarcinomaPublished OnlineFirst June 17, 2019; DOI: 10.1158/0008-5472.CAN-18-3663 Cancer Genome and Epigenome Research The Open Chromatin Landscape of Non–Small Cell Lung Carcinoma Zhoufeng Wang1, Kailing Tu2, Lin Xia2, Kai Luo2,Wenxin Luo1, Jie Tang2, Keying Lu2, Xinlei Hu2, Yijing He2, Wenliang Qiao3, Yongzhao Zhou1, Jun Zhang2, Feng Cao2, Shuiping Dai1, Panwen Tian1, Ye Wang1, Lunxu Liu4, Guowei Che4, Qinghua Zhou3, Dan Xie2, and Weimin Li1 Abstract Non–small cell lung carcinoma (NSCLC) is a major cancer identified 21 joint-quantitative trait loci (joint-QTL) that type whose epigenetic alteration remains unclear. We ana- correlated to both assay for transposase accessible chroma- lyzed open chromatin data with matched whole-genome tin sequencing peak intensity and gene expression levels. sequencing and RNA-seq data of 50 primary NSCLC cases. Finally, we identified 87 regulatory risk loci associated with We observed high interpatient heterogeneity of open chro- lung cancer–related phenotypes by intersecting the QTLs matin profiles and the degree of heterogeneity correlated to with genome-wide association study significant loci. In several clinical parameters. Lung adenocarcinoma and lung summary, this compendium of multiomics data provides squamous cell carcinoma (LUSC) exhibited distinct open valuable insights and a resource to understand the land- chromatin patterns. Beyond this, we uncovered that the scape of open chromatin features and regulatory networks broadest open chromatin peaks indicated key NSCLC genes in NSCLC. and led to less stable expression. Furthermore, we found that the open chromatin peaks were gained or lost together Significance: This study utilizes state of the art genomic with somatic copy number alterations and affected the methods to differentiate lung cancer subtypes.
- 
												  Alternative Tests for Time Series Dependence Based on Autocorrelation CoefficientsAlternative Tests for Time Series Dependence Based on Autocorrelation Coefficients Richard M. Levich and Rosario C. Rizzo * Current Draft: December 1998 Abstract: When autocorrelation is small, existing statistical techniques may not be powerful enough to reject the hypothesis that a series is free of autocorrelation. We propose two new and simple statistical tests (RHO and PHI) based on the unweighted sum of autocorrelation and partial autocorrelation coefficients. We analyze a set of simulated data to show the higher power of RHO and PHI in comparison to conventional tests for autocorrelation, especially in the presence of small but persistent autocorrelation. We show an application of our tests to data on currency futures to demonstrate their practical use. Finally, we indicate how our methodology could be used for a new class of time series models (the Generalized Autoregressive, or GAR models) that take into account the presence of small but persistent autocorrelation. _______________________________________________________________ An earlier version of this paper was presented at the Symposium on Global Integration and Competition, sponsored by the Center for Japan-U.S. Business and Economic Studies, Stern School of Business, New York University, March 27-28, 1997. We thank Paul Samuelson and the other participants at that conference for useful comments. * Stern School of Business, New York University and Research Department, Bank of Italy, respectively. 1 1. Introduction Economic time series are often characterized by positive
- 
												  Time Series: Co-IntegrationTime Series: Co-integration Series: Economic Forecasting; Time Series: General; Watson M W 1994 Vector autoregressions and co-integration. Time Series: Nonstationary Distributions and Unit In: Engle R F, McFadden D L (eds.) Handbook of Econo- Roots; Time Series: Seasonal Adjustment metrics Vol. IV. Elsevier, The Netherlands N. H. Chan Bibliography Banerjee A, Dolado J J, Galbraith J W, Hendry D F 1993 Co- Integration, Error Correction, and the Econometric Analysis of Non-stationary Data. Oxford University Press, Oxford, UK Time Series: Cycles Box G E P, Tiao G C 1977 A canonical analysis of multiple time series. Biometrika 64: 355–65 Time series data in economics and other fields of social Chan N H, Tsay R S 1996 On the use of canonical correlation science often exhibit cyclical behavior. For example, analysis in testing common trends. In: Lee J C, Johnson W O, aggregate retail sales are high in November and Zellner A (eds.) Modelling and Prediction: Honoring December and follow a seasonal cycle; voter regis- S. Geisser. Springer-Verlag, New York, pp. 364–77 trations are high before each presidential election and Chan N H, Wei C Z 1988 Limiting distributions of least squares follow an election cycle; and aggregate macro- estimates of unstable autoregressive processes. Annals of Statistics 16: 367–401 economic activity falls into recession every six to eight Engle R F, Granger C W J 1987 Cointegration and error years and follows a business cycle. In spite of this correction: Representation, estimation, and testing. Econo- cyclicality, these series are not perfectly predictable, metrica 55: 251–76 and the cycles are not strictly periodic.
- 
												  Fan Chart – a Tool for NBP’S Monetary Policy MakingNBP Working Paper No. 241 Fan chart – a tool for NBP’s monetary policy making Paweł Pońsko, Bartosz Rybaczyk NBP Working Paper No. 241 Fan chart – a tool for NBP’s monetary policy making Paweł Pońsko, Bartosz Rybaczyk Economic Institute Warsaw, 2016 Paweł Pońsko – Economic Institute, NBP and Warsaw School of Economics; [email protected] Bartosz Rybaczyk – Economic Institute, NBP; [email protected] Published by: Narodowy Bank Polski Education & Publishing Department ul. Świętokrzyska 11/21 00-919 Warszawa, Poland phone +48 22 185 23 35 www.nbp.pl ISSN 2084-624X © Copyright Narodowy Bank Polski, 2016 Contents Introduction 5 The process 9 The choice of probability distribution 11 The central path of projection 14 Prediction uncertainty 15 Prediction asymmetry 17 Probability intervals 18 Yearly data 20 The fan chart procedure 21 An illustration 23 10.1 Scaling Factors 25 10.2 Ex-post forecasting errors of the endogenous variables 25 10.3 Corrected exogenous errors 26 10.4 Pure forecasting error 26 10.5 The asymmetry of the fan chart 27 Fan chart decomposition 30 References 32 Appendix A. The two-piece normal distribution and its properties 34 Appendix B. Determining the triple 36 Appendix C. Highest probability density regions 37 Appendix D. Variance estimations 38 NBP Working Paper No. 241 3 Abstract Abstract Introduction In this note we describe, in substantial detail, the methodology behind the Narodowy Bank Polski (NBP) is, by its mandate, an inflation-targeting central construction of NBP’s fan chart. This note is meant to help the readers interpret bank. However, monetary policy decisions rest on the shoulders of the Monetary information contained in the mid-term projection, understand the differences in the Policy Council (MPC) members, who make up an independent body of experts.1 predicted uncertainty between the projection rounds, and the usefulness of the Hence, the NBP staff role is to support the MPC with expertise without influencing projection for the monetary policy conduct.
- 
												  Generating Time Series with Diverse and Controllable CharacteristicsGRATIS: GeneRAting TIme Series with diverse and controllable characteristics Yanfei Kang,∗ Rob J Hyndman,† and Feng Li‡ Abstract The explosion of time series data in recent years has brought a flourish of new time series analysis methods, for forecasting, clustering, classification and other tasks. The evaluation of these new methods requires either collecting or simulating a diverse set of time series benchmarking data to enable reliable comparisons against alternative approaches. We pro- pose GeneRAting TIme Series with diverse and controllable characteristics, named GRATIS, with the use of mixture autoregressive (MAR) models. We simulate sets of time series using MAR models and investigate the diversity and coverage of the generated time series in a time series feature space. By tuning the parameters of the MAR models, GRATIS is also able to efficiently generate new time series with controllable features. In general, as a costless surrogate to the traditional data collection approach, GRATIS can be used as an evaluation tool for tasks such as time series forecasting and classification. We illustrate the usefulness of our time series generation process through a time series forecasting application. Keywords: Time series features; Time series generation; Mixture autoregressive models; Time series forecasting; Simulation. 1 Introduction With the widespread collection of time series data via scanners, monitors and other automated data collection devices, there has been an explosion of time series analysis methods developed in the past decade or two. Paradoxically, the large datasets are often also relatively homogeneous in the industry domain, which limits their use for evaluation of general time series analysis methods (Keogh and Kasetty, 2003; Mu˜nozet al., 2018; Kang et al., 2017).
- 
												  Chi-Squared Tests of Interval and Density Forecasts, and the Bank of England’S Fan ChartsEUROPEAN CENTRAL BANK WORKING PAPER SERIES ECB EZB EKT BCE EKP WORKING PAPER NO. 83 CHI-SQUARED TESTS OF INTERVAL AND DENSITY FORECASTS, AND THE BANK OF ENGLAND’S FAN CHARTS BY KENNETH F. WALLIS November 2001 EUROPEAN CENTRAL BANK WORKING PAPER SERIES WORKING PAPER NO. 83 CHI-SQUARED TESTS OF INTERVAL AND DENSITY FORECASTS, AND THE BANK OF ENGLAND’S FAN CHARTS BY KENNETH F. WALLIS* November 2001 * Acknowledgement The first version of this paper was written during a period of study leave granted by the University of Warwick and spent at the Economic Research Department, Reserve Bank of Australia and the Economics Program RSSS, Australian National University; the support of these institutions is gratefully acknowledged. This paper has been presented at the ECB workshop on ‘Forecasting Techniques’, September 2001. © European Central Bank, 2001 Address Kaiserstrasse 29 D-60311 Frankfurt am Main Germany Postal address Postfach 16 03 19 D-60066 Frankfurt am Main Germany Telephone +49 69 1344 0 Internet http://www.ecb.int Fax +49 69 1344 6000 Telex 411 144 ecb d All rights reserved. Reproduction for educational and non-commercial purposes is permitted provided that the source is acknowledged. The views expressed in this paper are those of the authors and do not necessarily reflect those of the European Central Bank. ISSN 1561-0810 Contents Abstract 4 1 Introduction 5 2 Unconditional coverage and goodness-of-fit tests 8 3 Tests of independence 10 4 Joint tests of coverage and independence 14 5 Bank of England fan chart forecasts 15 6 Conclusion 19 References 21 Tables and Figures 22 European Central Bank Working Paper Series 27 ECB • Working Paper No 83 • November 2001 3 Abstract This paper reviews recently proposed likelihood ratio tests of goodness-of-fit and independence of interval forecasts.
- 
												  Fanplot: Visualisation of Sequential Probability Distributions Using Fan ChartsPackage ‘fanplot’ August 2, 2021 Type Package Title Visualisation of Sequential Probability Distributions Using Fan Charts Version 4.0.0 Maintainer Guy J. Abel <[email protected]> Description Visualise sequential distributions using a range of plotting styles. Sequential distribution data can be input as either simulations or values corresponding to percentiles over time. Plots are added to existing graphic devices using the fan function. Users can choose from four different styles, including fan chart type plots, where a set of coloured polygon, with shadings corresponding to the percentile values are layered to represent different uncertainty levels. Full details in R Journal arti- cle; Abel (2015) <doi:10.32614/RJ-2015-002>. License GPL-2 URL http://guyabel.github.io/fanplot/ BugReports https://github.com/guyabel/fanplot/issues/ Imports methods Depends R (>= 2.10) Suggests shiny LazyData true NeedsCompilation no Author Guy J. Abel [aut, cre] (<https://orcid.org/0000-0002-4893-5687>) Repository CRAN Date/Publication 2021-08-02 09:20:02 UTC R topics documented: fanplot-package . .2 boe..............................................2 cpi..............................................5 1 2 boe dsplitnorm . .5 fan..............................................8 ips.............................................. 13 svpdx . 14 th.mcmc . 15 Index 17 fanplot-package Visualisation of Sequential Probability Distributions Using Fan Charts. Description Visualise sequential distributions using a range of plotting styles. Sequential distribution data can be input as either simulations or values corresponding to percentiles over time. Plots are added to existing graphic devices using the fan function. Users can choose from four different styles, including fan chart type plots, where a set of coloured polygon, with shadings corresponding to the percentile values are layered to represent different uncertainty levels.
- 
												  Visualizing Financial FuturesVisualizing Financial Futures SUSANNA HEYMAN DOCTORAL THESIS NO. 17. 2017 KTH ROYAL INSTITUTE OF TECHNOLOGY SCHOOL OF COMPUTER SCIENCE AND COMMUNICATION DEPT. OF MEDIA TECHNOLOGY AND INTERACTION DESIGN SE-100 44 STOCKHOLM, SWEDEN TRITA-CSC-A-2017:17 ISSN-1653-5723 ISRN KTH/CSC/A--17/17-SE ISBN 978-91-7729-471-9 AKADEMISK AVHANDLING SOM MED TILLSTÅND AV KTH I STOCKHOLM FRAMLÄGGES TILL OFFENTLIG GRANSKNING FÖR AVLÄGGANDE AV TEKNISK DOKTORSEXAMEN FREDAGEN DEN 8 SEPTEMBER 2017 KL. 13:00 I SAL F3, KTH, LINDSTEDTSVÄGEN 26, STOCKHOLM. Abstract Research on financial decision aids, systems designed to help people make financial decisions, is sparse. Previous research has often focused on the theoretical soundness of the advice that the systems provide. The original contribution of this doctoral thesis is a set of empirical studies of how non-expert people understand the advice provided by financial decision aids. Since every piece of advice must be interpreted by a receiver, the accuracy of the advice can be corrupted along the way if the receiver does not understand complicated terminology, probabilistic reasoning, or abstract concepts. The design concept resulting from the studies visualizes a unique combination of short-term and long-term variables that are usually treated as separate and not interacting with each other; loans and amortizations, insurance, retirement saving, and consumption. The aim is to visualize the consequences of different decisions and possible adverse events in terms of their effect on the user’s future consumption, rather than abstract numbers detached from the user’s lived experience. The design concept was tested and evaluated by personal finance experts and professional financial advisors, as well as students and people without financial education, who represented the target users of the system.
- 
												  Prediction Intervals for Macroeconomic Variables Based on Uncertainty MeasuresPrediction Intervals for Macroeconomic Variables Based on Uncertainty Measures Pei-Hua (Peggy) Hsieh ANR: 591577 Academic supervisor: Prof. Dr. Bertrand Melenberg Second reader: Prof. Dr. Pavel Ciˇzekˇ Internship supervisor: Dr. Adam Elbourne A thesis submitted in partial fulfillment of the requirements for the degree: Master of Science in Econometrics and Mathematical Economics Tilburg School of Economics and Management Tilburg University The Netherlands Date: September 26, 2016 Prediction Intervals for Macroeconomic Variables Based on Uncertainty Measures Pei-Hua (Peggy) Hsieh ∗ October 7, 2016 Abstract This paper develops a method for incorporating uncertainty measures into the formation of confidence intervals around predictions of macroeconomic variables. These intervals are used for plotting fan charts, a graphical rep- resentation of forecasts pioneered by the Bank of England, which is commonly employed by central banks. I demonstrate and evaluate the proposed method by using it to plot fan charts for real GDP growth rate in the Netherlands. This paper aims to provide concrete recommendations for the Centraal Planbureau (CPB). ∗I am indebted to Prof. Dr. Bertrand Melenberg for his inspiring guidance and support. I would also like to thank my supervisor from the CPB Dr. Adam Elbourne for providing me with data and helpful comments. Finally, I thank my family, instructors at Tilburg university and colleagues from the CPB. 1 Contents 1 Introduction6 2 Methodology 10 2.1 Step 1................................... 11 2.2 Step 2................................... 12 2.3 Step 3................................... 15 3 Data description 16 4 Summary Statistics 19 4.1 Dependent Variable............................ 19 4.2 Explanatory Variables.......................... 23 5 Empirical results 24 5.1 Short dataset: using data from Consensus Economics........
- 
												  Monte Carlo Smoothing for Nonlinear Time SeriesMonte Carlo Smoothing for Nonlinear Time Series Simon J. GODSILL, Arnaud DOUCET, and Mike WEST We develop methods for performing smoothing computations in general state-space models. The methods rely on a particle representation of the filtering distributions, and their evolution through time using sequential importance sampling and resampling ideas. In particular, novel techniques are presented for generation of sample realizations of historical state sequences. This is carried out in a forward-filtering backward-smoothing procedure that can be viewed as the nonlinear, non-Gaussian counterpart of standard Kalman filter-based simulation smoothers in the linear Gaussian case. Convergence in the mean squared error sense of the smoothed trajectories is proved, showing the validity of our proposed method. The methods are tested in a substantial application for the processing of speech signals represented by a time-varying autoregression and parameterized in terms of time-varying partial correlation coefficients, comparing the results of our algorithm with those from a simple smoother based on the filtered trajectories. KEY WORDS: Bayesian inference; Non-Gaussian time series; Nonlinear time series; Particle filter; Sequential Monte Carlo; State- space model. 1. INTRODUCTION and In this article we develop Monte Carlo methods for smooth- g(yt+1|xt+1)p(xt+1|y1:t ) p(xt+1|y1:t+1) = . ing in general state-space models. To fix notation, consider p(yt+1|y1:t ) the standard Markovian state-space model (West and Harrison 1997) Similarly, smoothing can be performed recursively backward in time using the smoothing formula xt+1 ∼ f(xt+1|xt ) (state evolution density), p(xt |y1:t )f (xt+1|xt ) p(x |y ) = p(x + |y ) dx + .