Independent system-wide evaluation of operational activities for development EVALUATION OF THE CONTRIBUTION OF THE UNITED NATIONS DEVELOPMENT SYSTEM TO STRENGTHENING NATIONAL CAPACITIES FOR STATISTICAL ANALYSIS AND DATA COLLECTION TO SUPPORT THE ACHIEVEMENT OF THE MILLENNIUM DEVELOPMENT GOALS (MDGS) AND OTHER INTERNATIONALLY AGREED DEVELOPMENT GOALS TECHNICAL APPENDIX Table of Contents ACRONYMS AND ABBREVIATIONS ................................................................................................ 4 INTRODUCTION TO THE TECHNICAL APPENDIX ............................................................................. 1 SECTION 1: BACKGROUND, APPROACH AND IMPLEMENTATION ................................................... 2 1.1 JUSTIFICATION, PURPOSE AND USE OF THE EVALUATION ..................................................... 3 1.2 OBJECTIVES AND SCOPE OF THE EVALUATION ....................................................................... 5 1.3 APPROACH AND METHODOLOGY ........................................................................................... 7 1.4 DATA COLLECTION, ANALYSIS, SYNTHESIS AND VALIDATION .............................................. 11 1.5 MANAGEMENT ARRANGEMENTS ......................................................................................... 14 SECTION 2: NATIONAL STATISTICAL CAPACITY DEVELOPMENT .................................................... 16 2.1 CAPACITY, CAPACITY DEVELOPMENT AND STATISTICS ....................................................... 16 2.2 ELEMENTS OF A NATIONAL STATISTICAL SYSTEM ................................................................ 20 2.4 THE CHANGING CONTEXT FOR NATIONAL STATISTICAL CAPACITY ...................................... 31 SECTION 3: INTERNATIONAL SUPPORT TO NATIONAL STATISTICAL CAPACITY DEVELOPMENT ...... 35 3.1 THE GLOBAL AND REGIONAL STATISTICAL ARCHITECTURE .................................................. 35 3.2 AN OVERVIEW OF INTERNATIONAL SUPPORT TO NSCD ...................................................... 41 3.3 KEY ELEMENTS OF THE INTERNATIONAL SUPPORT .............................................................. 49 SECTION 4: FINDINGS ON THE ROLE AND CONTRIBUTION OF THE UNITED NATIONS SYSTEM TO NATIONAL STATISTICAL CAPACITY DEVELOPMENT ...................................................................... 52 4.1 UNITED NATIONS SYSTEM ENTITIES SUPPORTING NATIONAL STATISTICAL CAPACITY DEVELOPMENT .................................................................................................................................. 52 4.2 HOW THE UNITED NATIONS SYSTEM SUPPORTS NATIONAL STATISTICAL CAPACITY DEVELOPMENT .................................................................................................................................. 57 4.3 THE UNITED NATIONS SYSTEM CONTRIBUTION TO NATIONAL STATISTICAL CAPACITY DEVELOPMENT .................................................................................................................................. 60 4.4 THE POTENTIAL FOR UNITED NATIONS SYSTEM IMPACT ..................................................... 62 4.5 THE COMPARATIVE STRENGTHS OF THE UNITED NATIONS SYSTEM ................................... 66 SECTION 5: FINDINGS ON THE QUALITY OF THE UNITED NATIONS SYSTEM CONTRIBUTION TO NSCD .................................................................................................................................................. 69 5.1 THE RELEVANCE OF THE UNITED NATIONS SYSTEM CONTRIBUTION .................................. 69 5.2 THE SUSTAINABILITY OF THE RESULTS OF THE UNITED NATIONS SYSTEM CONTRIBUTION 73 5.3 ENSURING EFFICIENCY THROUGH COHERENCE AND COORDINATION ................................ 75 ANNEXES ................................................................................................................................... 81 ANNEX I:TERMS OF REFERENCE ........................................................................................................ 81 ANNEX II: CONSULTATIONS DURING DESIGN OF THE EVALUATION ................................................ 85 ANNEX III:BACKGROUND DOCUMENTS REVIEWED .......................................................................... 86 ANNEX IV: THE EVALUATION MATRIX ............................................................................................... 90 ANNEX V: COUNTRY STUDY SELECTION MATRIX .............................................................................. 91 ANNEX VI: LIST OF COUNTRY-LEVEL DOCUMENTS FOR SYSTEMATIC REVIEW ................................. 93 ANNEX VII: LIST OF DOCUMENTS FOR SYSTEMATIC REVIEW – GLOBAL AND REGIONAL LEVEL ...... 94 ANNEX VIII: KEY INFORMANT INTERVIEWS ...................................................................................... 96 ANNEX IX: ROLE AND MEMBERSHIP OF THE EMG, KSRG and ICM ................................................... 98 ANNEX X: EVALUATION TIME FRAME ............................................................................................. 103 ANNEX XII: SUMMARY OF THE VALIDATION SURVEY ..................................................................... 104 LIST OF BOXES, FIGURES AND TABLES: Boxes 1. Defining the Data Revolution 32 2. What makes the SDGs different? 33 3. Objectives of the World Data Forum 36 4. Principles Governing International Statistical Activities 47 5. Objectives and actions set out in the Busan Action Plan for Statistics (BAPS) 48 6. QCPR Survey of Partner government : Summary of answer to the question 70 7. Africa RRSF ideas for promoting sustainability 74 8. United Nations Coherence, Coordination and Integration 76 Figures 1. Levels of capacity: a systemic approach 17 2. Logical Model for strengthening national statistical capacities 19 3. Coordination Framework in a National Statistical System involving data producers, data 24 users, and data suppliers 4. Average Statistical Capacity Indicator (SCI) scores for 46 Least Developed Countries: 2005– 27 2009 and 2010–2015. 5. Number of countries in the MDG Indicators Database by number of MDG indicator series for 29 which trend analysis is possible 6. Support to National Statistical Capacity Development, by UN Institutions: 2003-2006; 2007- 55 2010; 2011-2014 7. Support to National Statistical Capacity Development, by UN system versus non-UN 56 organizations (in million USD and in Relative Share to Total): 2006-2014 Tables 1. Overview of data-collection methods 12 2. Implementation time frame 15 3. Areas of NSS capacity 25 4. Average Statistical Capacity Indicator (SCI) scores for 148 countries: 2005-2009; 2010-2015. 26 5. SCI Data Source Scores for 148 Countries: 2005-2009; 2010-2015. 28 6. Regional statistical commissions, conferences and committees by region 37 7. Staffing levels of United Nations global and regional statistical entities (2014) 39 8. Areas of NSCD support 42 9. UN Country Team Support to National Statistical Capacity Development 53 10. UN Specialized Agencies involved in NSCD 53 11. UN system funds, programmes and other entities involved in NSCD 54 3 ACRONYMS AND ABBREVIATIONS AU African Union BAPS Busan Action Plan for Statistics CCSA Committee for the Coordination of Statistical Activities CEB United Nations System Chief Executives Board for Coordination CRVS Civil Registration and Vital Statistics DAC Development Assistance Committee DaO Delivering as One DESA Department of Economic and Social Affairs (of the United Nations) DFID Department for International Development DOCO Development Operations Coordination Office ECA Economic Commission for Africa ECE Economic Commission for Europe ECLAC Economic Commission for Latin America and the Caribbean ESCAP Economic and Social Commission for Asia and the Pacific ESCWA Economic and Social Commission for Western Asia FAO Food and Agriculture Organization of the United Nations EMG Evaluation Management Group EU European Union ICAO International Civil Aviation Organization ICM Interim Coordination Mechanism ICP International Comparison Programme ILO International Labour Organization IMF International Monetary Fund ISWE Independent System-Wide Evaluation ITU International Telecommunication Union JIU Joint Inspection Unit KSRG Key Stakeholder Reference Group LDC Least Developed Country LLDC Land-locked Developing Country MAPS Marrakech Action Plan for Statistics MDA Ministries, Departments and Agencies MDB Multilateral Development Bank MDGs Millennium Development Goals MICS Multi-Indicator Cluster Survey NSS National Statistical System NSCD National Statistical Capacity Development NSDS National Strategies for the Development of Statistics NSO National Statistics Office OCHA Office for the Coordination of Humanitarian Affairs OECD Organisation for Economic Co-operation and Development OHCHR Office of the United Nations High Commissioner for Human Rights 4 OIC Organization of Islamic Cooperation OIOS United Nations Office of Internal Oversight Services PARIS21 Partnership in Statistics for Development in the 21st Century PRESS Partner Report on Support to Statistics PRSP Poverty Reduction Strategy Paper QCPR Quadrennial Comprehensive Policy Review SCI Statistical Capacity Indicator SDGs Sustainable Development Goals SDSN Sustainable Development Solutions Network SIAP Statistical Institute for Asia and the Pacific SIDS Small Island Developing State SNA System of National Accounts TCPR Triennial Comprehensive Policy Review ToR Terms of Reference UN United Nations UNCTAD United Nations Conference on Trade and Development UNCT United Nations country team UNDAF United Nations