The Global State of Democracy Indices Technical Procedures Guide, Version 3 The Global State of Democracy Indices Technical Procedures Guide, Version 3 Claudiu D. Tufis © 2019 International Institute for Democracy and Electoral Assistance International IDEA publications are independent of specific national or political interests. Views expressed in this publication do not necessarily represent the views of International IDEA, its Board or its Council members. References to the names of countries and regions in this publication do not represent the official position of International IDEA with regard to the legal status or policy of the entities mentioned. International IDEA encourages dissemination of its work and will promptly respond to requests for permission to reproduce or translate this publication. International IDEA Strömsborg SE–103 34 Stockholm Sweden Telephone: +46 8 698 37 00 Email: [email protected] Website: <http://www.idea.int> Design and layout: International IDEA Cover image based on an original design concept by Phoenix Design Aid DOI: <https://doi.org/10.31752/idea.2019.36> ISBN: 978-91-7671-279-5 This publication has received support from International IDEA’s Member States through the Institute’s core funding. Created with Booktype: <https://www.booktype.pro> International IDEA Contents Acknowledgements ....................................................................................................................... 6 About this document .................................................................................................................... 7 Introduction ................................................................................................................................... 8 1. Data sources ............................................................................................................................ 13 2. Coverage .................................................................................................................................. 15 3. Indicators ................................................................................................................................. 19 4. Assessing the unidimensionality of the Indices .................................................................. 21 5. Aggregating the indicators into Indices ................................................................................ 24 6. Scaling ..................................................................................................................................... 28 7. Confidence intervals ............................................................................................................... 29 8. Validity checks ........................................................................................................................ 30 Conclusion ................................................................................................................................... 31 References ................................................................................................................................... 32 Annex A. Sources ......................................................................................................................... 36 Annex B. Countries, regions and subregions included in International IDEA’s GSoD Indices .......................................................................................................................................... 37 Annex C. Regional organizations included in the data set ..................................................... 43 Annex D. Attributes, subattributes and indicators .................................................................. 44 Annex E. Dimensionality tests, factor loadings and Cronbach’s alpha values .................... 62 Annex F. Item–item correlations ................................................................................................ 71 Annex G. Comparisons with extant measures .......................................................................... 78 About the author ......................................................................................................................... 84 About International IDEA ............................................................................................................ 85 The Global State of Democracy Indices Acknowledgements International IDEA would like to thank everyone who has been involved in the production of the Global State of Democracy Indices. The Indices have benefited from the contributions of many individuals at International IDEA, and from the expert input of members of the Institute’s partner organizations. In particular, thanks to Mélida Jiménez, Victoria Perotti, Lina Antara and Joseph Noonan, Svend-Erik Skaaning and Claudiu D. Tufis for their contributions to the development of the Global State of Democracy Indices, and to the members of the Expert Advisory Board for their review of this methodology and related documentation. Methodology and data set development (Global State of Democracy Indices) Svend-Erik Skaaning, Professor at the Department of Political Science at Aarhus University, Co-Principal Investigator of the Varieties of Democracy (V-Dem) project Claudiu Tufis, Associate Professor, University of Bucharest, Political Science Department Expert Advisory Board (Global State of Democracy Indices) Michael Bernhard, Raymond and Miriam Ehrlich Chair, Professor at the Department of Political Science at the University of Florida Michael Coppedge, Professor at the Department of Political Science and Faculty Fellow at the Kellogg Institute of International Studies at the University of Notre Dame, Co-Principal Investigator of the Varieties of Democracy (V-Dem) project Carl-Henrik Knutsen, Professor at the Department of Political Science at the University of Oslo, Co-Principal Investigator of the Historical Varieties of Democracy (V-Dem) project Staffan Lindberg, Professor at the Department of Political Science at the University of Gothenburg, Director of the Varieties of Democracy (V-Dem) Institute Gerardo Munck, Professor at the School of International Relations at the University of Southern California 6 International IDEA About this document About this document The Global State of Democracy Indices: Technical Procedures Guide, Version 2 is the second in a series of documents prepared by International IDEA to present the Global State of Democracy (GSoD) Indices. It outlines the technical aspects of constructing the Indices, and complements The Global State of Democracy Indices Methodology: Conceptualization and Measurement Framework, Version 3 (Skaaning 2019), which presents the theoretical framework that guided the construction of the Indices, and The Global State of Democracy Indices Codebook, Version 3 (Tufis 2018), which presents information about the data set, including variables, attributes of democracy, subattributes, subcomponents and indicators. The GSoD Indices depict democratic trends at the country, regional and global levels across a broad range of different attributes of democracy in the period 1975– 2017 but do not provide a single index of democracy. The Indices produce data for 158 countries. The data underlying the Indices is based on 97 indicators developed by various scholars and organizations using different types of sources, including expert surveys, standards-based coding by research groups and analysts, observational data and composite measures. The Global State of Democracy is a biennial report that aims to provide policymakers with an evidence-based analysis of the state of global democracy, supported by the GSoD Indices, in order to inform policy interventions and identify problem-solving approaches to trends affecting the quality of democracy around the world. The 2019 edition of the report (International IDEA 2019), provides a global health check of democracy. The full publication, as well as the GSoD Indices Database, can be accessed online: <http://www.idea.int/gsod>. International IDEA 7 The Global State of Democracy Indices Introduction This Guide outlines the process of constructing the Global State of Democracy (GSoD) Indices, which informThe Global State of Democracy 2019: Addressing the Ills, Reviving the Promise (International IDEA 2019). It is written for readers who want a better understanding of the Indices, as well as researchers who may wish to use and build on the data contained within them. This Guide builds upon the GSoD Indices Methodology. For a detailed outline of the conceptual and measurement framework see The Global State of Democracy Indices Methodology: Conceptualization and Measurement Framework, Version 3 (Skaaning 2019). For each component of the construction of the GSoD Indices, the Guide provides information about the procedures followed, outlined in a step-by-step description to allow the interested reader to understand the research process. The eight steps can be summarized as follows: 1. Identifying the data sources (see Chapter 1); 2. Preparing the data sources for merger (see Chapter 2); 3. Preparing the indicators for merger (see Chapter 3); 4. Assessing the unidimensionality of the Indices (see Chapter 4); 5. Aggregating the indicators into Indices (see Chapter 5); 6. Scaling the Indices (see Chapter 6); 7. Computing the confidence intervals (see Chapter 7); and 8. Conducting validity checks (see Chapter 8). After a brief description of the theoretical structure that guided this project, the Guide