Forecasting: theory and practice 1, 2 3 4 Fotios Petropoulos ∗, Daniele Apiletti , Vassilios Assimakopoulos , Mohamed Zied Babai , Devon K. Barrow5, Souhaib Ben Taieb6, Christoph Bergmeir7, Ricardo J. Bessa8, Jakub Bijak9, John E. Boylan10, Jethro Browell11, Claudio Carnevale12, Jennifer L. Castle13, Pasquale Cirillo14, Michael P. Clements15, Clara Cordeiro16,17, Fernando Luiz Cyrino Oliveira18, Shari De Baets19, Alexander Dokumentov20, Joanne Ellison9, Piotr Fiszeder21, Philip Hans Franses22, David T. Frazier23, Michael Gilliland24, M. Sinan Gon¨ ul¨ 25, Paul Goodwin1, Luigi Grossi26, Yael Grushka-Cockayne27, Mariangela Guidolin26, Massimo Guidolin28, Ulrich Gunter29, Xiaojia Guo30, Renato Guseo26, Nigel Harvey31, David F. Hendry32, Ross Hollyman1, Tim Januschowski33, Jooyoung Jeon34, Victor Richmond R. Jose35, Yanfei Kang36, Anne B. Koehler37, Stephan Kolassa38,10, Nikolaos Kourentzes39,10, Sonia Leva40, Feng Li41, Konstantia Litsiou42, Spyros Makridakis43, Gael M. Martin23, Andrew B. Martinez44,45, Sheik Meeran1, Theodore Modis46, Konstantinos Nikolopoulos47, Dilek Onkal¨ 25, Alessia Paccagnini48,49, Anastasios Panagiotelis50, Ioannis Panapakidis51, Jose M. Pav´ıa52, Manuela Pedio53,54, Diego J. Pedregal55, Pierre Pinson56, Patr´ıcia Ramos57, David E. Rapach58, J. James Reade59, Bahman Rostami-Tabar60, Michał Rubaszek61, Georgios Sermpinis62, Han Lin Shang63, Evangelos Spiliotis3, Aris A. Syntetos60, Priyanga Dilini Talagala64, Thiyanga S. Talagala65, Len Tashman66, Dimitrios Thomakos67, Thordis Thorarinsdottir68, Ezio Todini69,70, Juan Ramon´ Trapero Arenas55, Xiaoqian Wang36, Robert L. Winkler71, Alisa Yusupova10, Florian Ziel72 1School of Management, University of Bath, UK 2Politecnico di Torino, Turin, Italy 3Forecasting and Strategy Unit, School of Electrical and Computer Engineering, National Technical University of Athens, Greece 4Kedge Business School, France 5Department of Management, Birmingham Business School, University of Birmingham, UK 6Big Data and Machine Learning Lab, Universite´ de Mons (UMONS), Belgium 7Faculty of Information Technology, Monash University, Melbourne, Australia 8INESC TEC – Institute for Systems and Computer Engineering, Technology and Science, Porto, Portugal 9Department of Social Statistics and Demography, University of Southampton, UK 10Centre for Marketing Analytics and Forecasting, Lancaster University Management School, Lancaster University, UK 11Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow, UK 12Department of Mechanical and Industrial Engineering, University of Brescia, Italy 13Magdalen College, University of Oxford, UK 14ZHAW School of Management and Law, Zurich University of Applied Sciences, Switzerland 15ICMA Centre, Henley Business School, University of Reading, UK 16Faculdade de Cienciasˆ e Tecnologia, Universidade do Algarve, Portugal 17CEAUL, Faculdade de Ciencias,ˆ Universidade de Lisboa, Portugal 18Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Brazil 19Department of Business Informatics and Operations Management, Faculty of Economics and Business Administration, Universiteit Gent, Belgium 20Let’s Forecast, Australia 21Faculty of Economic Sciences and Management, Nicolaus Copernicus University in Torun, Poland 22Econometric Institute, Erasmus School of Economics, Rotterdam, The Netherlands 23Department of Econometrics and Business Statistics, Monash University, Melbourne, Australia 24SAS, USA 25Newcastle Business School, Northumbria University, Newcastle upon Tyne, UK 26Department of Statistical Sciences, University of Padua, Italy 27Darden School of Business, University of Virginia, USA 28Finance Department, Bocconi University and 29 30 Baffi-CAREFIN Centre, Milan, Italy Department of Tourism and Service Management, MODUL University Vienna, Austria Robert H. Smith School of 31 32 Business, University of Maryland, USA Department of Experimental Psychology, University College London, UK Nuffield College and Institute for New Economic Thinking at the Oxford Martin School, University of Oxford, UK 33Amazon Research, Germany 34Korea Advanced Institute of Science and Technology, South Korea 35McDonough School of Business, Georgetown University, USA 36School of Economics and Management, Beihang University, Beijing, China 37Miami University, Ohio, USA 38SAP, Switzerland 39Skovde¨ Artificial Intelligence Lab, School of Informatics, University of Skovde,¨ Sweden 40Department of Energy, Politecnico di Milano, Italy 41School of Statistics and Mathematics, Central University of Finance and Economics, Beijing, China 42Manchester Metropolitan University Business School, UK 43M Open Forecasting Center & Institute for the Future, University of Nicosia, Nicosia, Cyprus 44 45 Office of Macroeconomic Analysis, US Department of the Treasury, Washington DC, USA GWU Research Program on Forecasting, Washington DC, USA 46Growth Dynamics, Lugano, Switzerland 47Durham University Business School, Durham University, UK 48Michael Smurfit Business School, University College Dublin, Ireland 49Centre for Applied Macroeconomic Analysis, Australia 50Discipline of Business Analytics, The University of Sydney Business School, Australia 51Department of Electrical and Computer Engineering, University of Thessaly, Volos, Greece 52GIPEyOP, UMMICS, Department of Applied 53 54 arXiv:2012.03854v2 [stat.AP] 3 Jun 2021 Economics, Universitat de Valencia, Spain Accounting and Finance Department, University of Bristol, UK Baffi-CAREFIN Centre, Bocconi University, Italy 55ETSI Industrial, Universidad de Castilla-La Mancha, Ciudad Real, Spain 56Department of Technology, Management and Economics, Technical University of Denmark, Denmark 57Polytechnic of Porto, Porto, Portugal 58Department of Economics, Saint Louis University, USA 59Department of 60 61 Economics, School of Politics, Economics and International Relations, University of Reading, UK Cardiff Business School, Cardiff University, UK SGH Warsaw School of Economics, Collegium of Economic Analysis, Poland 62Adam Smith Business School, University of Glasgow, UK 63Department of Actuarial Studies and Business Analytics, Macquarie University, Australia 64Department of Computational Mathematics, University of Moratuwa, Sri Lanka 65Department of Statistics, Faculty of Applied Sciences, University of Sri Jayewardenepura, Sri Lanka 66Foresight, International Institute of Forecasters, USA 67School of Economics and Political Science, National and Kapodistrian University of Athens, Greece 68Norwegian Computing Center, Oslo, Norway 69University of Bologna, Italy 70Italian Hydrological Society, Bologna, Italy 71Fuqua School of Business, Duke University, Durham, USA 72House of Energy Markets and Finance, University of Duisburg-Essen, Germany Preprint submitted to International Journal of Forecasting June 4, 2021 ∗Corresponding author: [email protected]; [email protected] 2 In theory, there is no difference between theory and practice. But, in practice, there is. Benjamin Brewster (1882) Abstract Forecasting has always been at the forefront of decision making and planning. The uncertainty that surrounds the future is both exciting and challenging, with individuals and organisations seeking to min- imise risks and maximise utilities. The large number of forecasting applications calls for a diverse set of forecasting methods to tackle real-life challenges. This article provides a non-systematic review of the the- ory and the practice of forecasting. We provide an overview of a wide range of theoretical, state-of-the-art models, methods, principles, and approaches to prepare, produce, organise, and evaluate forecasts. We then demonstrate how such theoretical concepts are applied in a variety of real-life contexts. We do not claim that this review is an exhaustive list of methods and applications. However, we wish that our encyclopedic presentation will offer a point of reference for the rich work that has been undertaken over the last decades, with some key insights for the future of forecasting theory and practice. Given its encyclopedic nature, the intended mode of reading is non-linear. We offer cross-references to allow the readers to navigate through the various topics. We complement the theoretical concepts and applications covered by large lists of free or open-source software implementations and publicly-available databases. Keywords: review; encyclopedia; methods; applications; principles; time series; prediction. 3 Contents 1 Introduction (Robert L. Winkler) 8 2 Theory 10 2.1 Introduction to forecasting theory (Anne B. Koehler) . 10 2.2 Pre-processing data . 11 2.2.1 Box-Cox transformations (Anastasios Panagiotelis) . 11 2.2.2 Time series decomposition (Alexander Dokumentov) . 12 2.2.3 Anomaly detection and time series forecasting (Priyanga Dilini Talagala) . 13 2.2.4 Robust handling of outliers in time series forecasting (Luigi Grossi) . 15 2.2.5 Exogenous variables and feature engineering (Jethro Browell) . 16 2.3 Statistical and econometric models . 17 2.3.1 Exponential smoothing models (Juan Ramon´ Trapero Arenas) . 17 2.3.2 Time-series regression models (Vassilios Assimakopoulos) . 18 2.3.3 Theta method and models (Dimitrios Thomakos) . 19 2.3.4 Autoregressive integrated moving average (ARIMA) models (Philip Hans Franses & Sheik Meeran) 21 2.3.5 Forecasting for multiple seasonal cycles (Bahman Rostami-Tabar) . 22 2.3.6 State-space models (Diego J. Pedregal) . 23 2.3.7 Models for population processes (Jakub Bijak) . 25 2.3.8 Forecasting count time series (Gael M. Martin) . 26 2.3.9 Forecasting with many variables (J.