THE OPEN DATA INVENTORY METHODS 2016 REPORT Acknowledgements THE The Open Data Inventory is a team effort. We are pleased to OPEN DATA INVENTORY acknowledge the help of all who contributed to this work. methods Open Data Watch Shaida Badiee, Misha Belkindas, Eric Swanson, Deirdre Appel, Jamison Crowell, Reza Farivari, Martin REPORT Getzendanner, Chandrika Kaul, Amelia Pittman, Tawheeda Wahabzada. 2016 ODIN Project Team Eric Swanson, Director Jamison Crowell, Project Manager ODIN Assessors Sarah Belford, Hannah Krentler-Brown, Dominic Scerbo, Deirdre Appel, Janeen Rashmawi, Pikria Saliashvili, Maryan Carbuccia, Caitlin Vejby, Sydney Taylor, Elizabeth Rogers, and Molly Geiser. ODIN Reviewers Jamison Crowell, Chandrika Kaul, Tawheeda Wahabzada, Amelia Pittman, and Pikria Saliashvili. Website and Publication Design District Design Group Website Development Akron, Inc. Funding Provided by the William and Flora Hewlett Foundation Backcover Photograph Courtesy of Jonathan Torgovnik /Getty Images Reportage. Some rights reserved. Copyright 2017 Open Data Watch – Licensed under a Creative Commons Attribution 4.0 license Please cite any uses of these data as Open Data Watch – Open Data Inventory OPEN DATA WATCH, INC www.odin.opendatawatch.com OPENDATAWATCH.COM Table of Contents Introduction ODIN 2016 is an assessment of the coverage and openness of data provided on the websites ACKNOWLEDGEMENTS maintained by national statistical offices (NSOs) in 173 countries. Building on the previous year’s work, ODIN 2016 now includes most of the world’s high-income and OECD countries. The assessments TABLE OF CONTENTS 2 analyze datasets across 20 data categories that are the most pertinent to managing and monitoring INTRODUCTION 3 progress on the SDGs, as well as the social, economic, and environmental development of a country ODIN 2016 FAQS & Methodology Updates 8 more generally. DATA CATEGORIES AND INDICATORS 7 The ODIN 2016 assessments were carried out between June and September 2016. Assessment results Data Sources 7 were reviewed and, if necessary, revised between October and December 2016. All results are based on Data Categories 7 the data available from the principal NSO website during the assessment period. DATA COVERAGE 14 Coverage Element 1: Coverage and Disaggregation 14 Figure 1. ODIN global scores, 2016 Coverage Element 2: Data Availability for Last 5 Years 20 Coverage Element 3: Data Availability for Last 10 Years 20 Coverage Element 4: First Administrative Level 21 Coverage Element 5: Second Administrative Level 21 DATA OPENNESS 22 Openness Element 1: Machine Readability 22 Openness Element 2: Non-proprietary Format 22 Openness Element 3: Download Options 23 Openness Element 4: Metadata Availability 23 Openness Element 5: Free/Unrestricted Terms of Use 24 AGGREGATE SCORES 25 Standardized Scores 25 Weighting 25 Complete Country 173Assessments 2 ODIN 2016 Methods Report ODIN 2016 Methods Report 3 Introduction Introduction ODIN 2016 FAQs & Methodology Updates Why Assess National Statistical Offices? Between 2015 and 2016, there are comparable What is ODIN? metadata, and free to be used and reused for ODIN assessments begin with the websites data for 122 countries. (Three countries – The Open Data Inventory (ODIN) is an evaluation any purpose without limitations other than maintained by national statistical offices because, Afghanistan, Iran, and Sudan – were removed of the coverage and openness of data provided acknowledgement of the original source. These in most countries, the NSO is the lead agency from the 2016 assessment due to non-functioning on the websites maintained by national statistical requirements have been incorporated in the five of the national statistical system, coordinating websites). offices (NSOs). The overall ODIN score is an elements of the ODIN openness assessment. its work with other governmental bodies that indicator of how complete and open an NSO’s produce official statistics. If an official national Non-proprietary formats data offerings are. The summary scores for What Data Categories are Included? data source can be reached from the NSO’s In ODIN 2016 several file formats are scored as social, economic, and environmental statistics ODIN assessments review published statistics website, it is included in the ODIN assessment. non-proprietary which were treated as proprietary and summary scores for coverage and openness in twenty categories, grouped as social NSOs, as producers and caretakers of official in ODIN 2015. These changes have been made produce a picture of the national statistical statistics, economic and financial statistics, statistics, have a special obligation to maximize to align with international standards widely systems’ strengths and weaknesses. and environmental statistics. The ODIN overall their public benefit. NSOs can and should be the recognized by the open data community. The To see a video on ODIN 2016, visit www. score weights the three groups equally. In each leading advocate for and provider of high quality, following formats now receive full scores for opendatawatch.com/odin2016video. category, principal or sentinel indicators were official statistics to government, the public, and to non-proprietary format: XLSX, DOCX, PPTX, and selected because they are frequently needed for the international community. PDF. These changes had the effect of raising the public policies or private initiatives and because openness scores for many countries. What is ODIN’s Purpose? they provide evidence of underlying statistical Methodology Changes Since ODIN 2015 ODIN helps identify critical gaps, promote processes for which statistical offices are Assessment process Frequency criteria open data policies, improve data access, and responsible. In 2016 the ODIN research process recorded Many countries currently participate in the encourage dialogue between NSOs and data assessments using an online platform developed IMF’s Enhanced General Data Dissemination users. NSOs and their development partners can The twenty categories of ODIN are: for exclusive use of ODIN. This platform allows System (e-GDDS) or Special Data Dissemination use ODIN as part of a strategic planning process assessors immediate access to methodology Standard (SDDS). These standards provide and as a measuring rod for the development of 1. Population and Vital Statistics guidelines, examples of data they may encounter countries guidance on, among other things, the the statistical system. ODIN provides valuable 2. Education Facilities and FAQs. The platform has built-in functionality coverage, periodicity and timeliness of data. information to data users within the government 3. Education Outcomes designed to catch common mistakes and During this edition of ODIN, we incorporated the and private sectors and to the public about the 4. Health Facilities automate some of the scoring process to ensure IMF’s e-GDDS periodicity requirements for three availability of important statistical series. In 5. Health Outcomes comparability of scores across countries. The new economic data categories: National Accounts, addition to the ratings of coverage and openness 6. Reproductive Health platform also provides greater ease of use for Price Indexes, and International Trade. For in twenty statistical categories, ODIN assessments 7. Gender Statistics assessors and reviewers alike, making possible countries to score full points on the first coverage record the online location of key indicators in 8. Poverty Statistics the inclusion of additional countries without element for these categories, data published in each data category, permitting quick access to 9. National Accounts extending the research period. Because of the the last 5 years must be available on at least a hundreds of indicators. 10. Labor Statistics benefits of the new platform, combined with a quarterly basis. In future versions of ODIN, we 11. Price Indexes more extensive training program for country will extend this requirement to data published How are Open Data Defined? 12. Government Finance assessors, only one assessor was assigned per in the last 10 years and likely to additional data There is general agreement on the core meaning 13. Money and Banking country. Following the initial assessment, each categories. of open data. As summarized in the Open 14. International Trade country assessment underwent two layers of Definition, version 2.1, “Knowledge is open if 15. Balance of Payments review, as was the case for ODIN 2015. Indicator guidelines anyone is free to access, use, modify, and share 16. Land Use To greater align our representative indicators with it — subject, at most, to measures that preserve 17. Resource Use Greater coverage international guidelines and ensure comparability provenance and openness.” This definition has 18. Energy Use ODIN 2015 covered 125 countries in mostly low- with the additional countries added in ODIN been operationalized in the International Open 19. Pollution and middle-income countries. In ODIN 2016, this 2016, updates were made to the indicators and Data Charter. In practical terms, open data should 20. Built Environment scope was expanded to include many high-income disaggregation of those indicators within certain be machine readable in non-proprietary formats, and OECD countries; an addition of 51 countries. data categories. The following is a summary of selectable by users, accompanied by descriptive 4 ODIN 2016 Methods Report ODIN 2016 Methods Report 5 Introduction Data Categories and Indicators those substantive changes. IMF’s