KOF Working Papers, No
Total Page:16
File Type:pdf, Size:1020Kb
A Service of Leibniz-Informationszentrum econstor Wirtschaft Leibniz Information Centre Make Your Publications Visible. zbw for Economics Maag, Thomas Working Paper On the accuracy of the probability method for quantifying beliefs about inflation KOF Working Papers, No. 230 Provided in Cooperation with: KOF Swiss Economic Institute, ETH Zurich Suggested Citation: Maag, Thomas (2009) : On the accuracy of the probability method for quantifying beliefs about inflation, KOF Working Papers, No. 230, ETH Zurich, KOF Swiss Economic Institute, Zurich, http://dx.doi.org/10.3929/ethz-a-005859391 This Version is available at: http://hdl.handle.net/10419/50407 Standard-Nutzungsbedingungen: Terms of use: Die Dokumente auf EconStor dürfen zu eigenen wissenschaftlichen Documents in EconStor may be saved and copied for your Zwecken und zum Privatgebrauch gespeichert und kopiert werden. personal and scholarly purposes. Sie dürfen die Dokumente nicht für öffentliche oder kommerzielle You are not to copy documents for public or commercial Zwecke vervielfältigen, öffentlich ausstellen, öffentlich zugänglich purposes, to exhibit the documents publicly, to make them machen, vertreiben oder anderweitig nutzen. publicly available on the internet, or to distribute or otherwise use the documents in public. Sofern die Verfasser die Dokumente unter Open-Content-Lizenzen (insbesondere CC-Lizenzen) zur Verfügung gestellt haben sollten, If the documents have been made available under an Open gelten abweichend von diesen Nutzungsbedingungen die in der dort Content Licence (especially Creative Commons Licences), you genannten Lizenz gewährten Nutzungsrechte. may exercise further usage rights as specified in the indicated licence. www.econstor.eu KOF Working Papers On the Accuracy of the Probability Method for Quantifying Beliefs about Inflation Thomas Maag No. 230 July 2009 ETH Zurich KOF Swiss Economic Institute WEH D 4 Weinbergstrasse 35 8092 Zurich Switzerland Phone +41 44 632 42 39 Fax +41 44 632 12 18 www.kof.ethz.ch [email protected] On the Accuracy of the Probability Method for Quantifying Beliefs About Inflation∗ Thomas Maagy KOF Working Paper No. 230, July 2009 This Version: April 2010 Abstract This paper assesses the probability method for quantifying EU consumer survey data on perceived and expected inflation. Based on household level data from the Swedish consumer survey that asks for both qualitative and quantitative responses, it is found that the theoretical assumptions of the method do not hold. In particular, estimates of unrestricted response schemes indicate that response intervals are asymmetric and that qualitative inflation expectations are formed relative to perceptions of current inflation. Nevertheless, the probability method generates series that are highly correlated with the mean of actual quantitative beliefs. For quantifying the cross-sectional dispersion of beliefs, however, an index of qualitative variation is most accurate. JEL classification: C53, D84, E31. Keywords: quantification, inflation expectations, inflation perceptions, qualitative response data, belief formation. ∗I thank Simone Elmer, Sarah M. Lein, Christoph Moser, Rolf Schenker and seminar participants at the KOF Swiss Economic Institute for helpful comments and suggestions. I am grateful to the Swedish National Institute of Economic Research for providing access to the Consumer Tendency Survey data. Financial support by the Swiss National Science Foundation is gratefully acknowledged. yKOF Swiss Economic Institute, ETH Zurich, CH-8092 Zurich, Switzerland, E-mail: [email protected] 1 1 Introduction Surveys of households and firms are often qualitative. Rather than giving a quantitative estimate of a particular variable, respondents are asked to indicate their beliefs on qualitative scales. In the European Union (EU), beliefs of households about inflation are surveyed as part of the Joint Harmonized EU Consumer Survey programme. Within this framework, har- monized qualitative surveys are conducted in all member states, covering a national sample size of roughly 1,500 households on a monthly basis. The EU consumer survey thus provides an extensive and consistent dataset on beliefs about inflation.1 In particular, the EU con- sumer survey both asks for perceptions about current inflation and expectations about future inflation. Consequently, the response data has been investigated by a large literature. Only recently, the euro cash changeover and its effects on inflation perceptions of households has given rise to a new strand of research.2 Since the EU consumer survey is qualitative, most empirical applications rely on a method to quantify the qualitative response data in the first place. This paper assesses the validity of one particular method, the probability method for 5-category scales, and compares its accuracy to other quantification approaches. Possibly the most widely used quantification method is the balance statistic proposed by Anderson (1952). It is originally defined as the difference between the share of respondents that perceive or expect positive inflation rates and the share of respondents that perceive or expect negative inflation rates. Theil (1952) rationalizes the balance statistic, demonstrating that it is an appropriate measure of the population mean if quantitative beliefs are uniformly distributed. Furthermore, Theil (1952) suggests that the distributional assumption may be relaxed by imposing a normal distribution instead. Combined with the assumption that re- spondents perceive or expect prices to be constant in qualitative terms if their quantitative 1Currently, the Joint Harmonized EU Consumer Survey covers a monthly sample of roughly 40,000 con- sumers in 27 member states. The consumer survey consists of 15 qualitative questions pertaining to the household's financial situation, perceived economic conditions and planned savings and spending. The ques- tionnaire is translated into national languages and may include additional country specific questions, see European Commission (2007). 2This literature centers on the rise in perceived inflation coinciding with the euro cash changeover, as doc- umented in ECB (2005). Several explanations are being discussed, including increased information processing requirements due to conversion rates, overreaction to prices of frequently bought items and anchoring of per- ceptions to prior expectations. See, e.g., Ehrmann (2006), Aucremanne, Collin, and Stragier (2007), Doehring and Mordonu (2007), Dziuda and Mastrobuoni (2006), Aalto-Set¨al¨a(2006) and Fluch and Stix (2007). Ab- stracting from the euro cash changeover, other contributions use the EU consumer survey data to investigate belief formation in general, see, e.g., D¨opke, Dovern, Fritsche, and Slacalek (2008), Forsells and Kenny (2004), Lamla and Lein (2008) and Lein and Maag (2008). 2 belief is within an indifference interval around 0%, the mean and variance of the imposed distribution can be identified. The model of Theil (1952) has been rediscovered by Carl- son and Parkin (1975) and is known today as the Carlson-Parkin method or the 3-category probability method.3 Batchelor and Orr (1988) extend the probability method to response data on 5-category scales as it is available from the EU consumer survey. Taking into ac- count the particular wording of the EU consumer survey, Berk (1999) additionally suggests an identification scheme that links inflation expectations to inflation perceptions. The goal of this paper is to assesses the 5-category probability method and to derive lessons for applied research. The analysis relies on joining qualitative and quantitative response data on household-level, taken from the Swedish Consumer Tendency Survey. To the best of my knowledge, only two studies have investigated surveys that ask for both qualitative and quantitative responses. Defris and Williams (1979) consider a 5-year sample from an Australian consumer survey. They document that the balance statistic as well as the 3- category probability method generate series that are only weakly correlated with quantitative survey responses. Batchelor (1986) investigates micro-data from the University of Michigan Survey of Consumers. In line with Defris and Williams (1979), Batchelor (1986) finds that both the balance statistic and quantified expectations generated with the probability method are inaccurate, in particular in the short term. This result is in contrast to my findings for Sweden. This paper extends the literature in several respects. First, it provides a detailed as- sessment of the theoretical assumptions underlying the 5-category probability method. Ex- isting research focuses on the 3-category probability method and on testing distributional assumptions. Joining quantitative and qualitative responses on household-level allows to es- timate unrestricted response schemes. The restrictions imposed by the 5-category probability method can then be tested using likelihood theory. Second, the accuracy of the 5-category probability method relative to the mean and cross-sectional standard deviation of quantitative responses is assessed in a long sample of 154 monthly surveys spanning 01/1996{10/2008. The discussion centers on comparing correlation coefficients relying on the Fisher z-transformation and double block bootstrap confidence intervals. Accuracy is compared to a set of alternative 3A less common quantification method is the regression approach of Pesaran (1987). The regression method extends the balance statistic, allowing for a non-linear relation between response