Download "Independent Evaluation of Lessons Learned from Delivering As
Total Page:16
File Type:pdf, Size:1020Kb
INDEPENDENT EVALUATION OF LESSONS LEARNED FROM DELIVERING AS ONE MAIN REPORT 26 July 2012 1 2 Table of Contents Main Report Acronyms and abbreviations 1. Introduction 1.1 Report structure and content 1.2 The origins of Delivering as One 1.3 Mandate and modality of the independent evaluation 1.4 Purpose, objective and scope of the independent evaluation 1.5 Evaluation criteria used 1.6 Key evaluation questions 1.7 Defining the challenges that Delivering as One aimed to address 1.8 Evaluation methodology: using a theory of change analytical approach at country level 1.9 Methodology, data collection and analysis 1.10 Stakeholder consultations 1.11 Limitations 2. Context and configuration of Delivering as One as part of UN reform processes 2.1 Introduction 2.2 Delivering as One a part of a larger UN reform process 2.3 Configuration of Delivering as One in the pilot countries 3. Key findings from the eight pilots and the wider UN system 3.1 Introduction 3.2 Progress towards enhanced national ownership 3.3 Progress towards better delivery of support by the UN system to programme countries 3.4 Progress towards reduced transaction costs 3 4. Conclusions 4.1 Introduction 4.2 Conclusions on the strategies 4.3 Progress towards the immediate outcomes 4.4. Progress towards the intermediate states 4.5 Progress towards the overall objective of Delivering as One 4.6. Conclusions on the performance of Delivering as One against evaluation criteria: relevance, effectiveness, efficiency and sustainability 5. Recommendations 5.1 Enhancing national ownership and leadership 5.2 UN system to deliver better support to programme countries 5.3 Simplification and harmonization of business practices to reduce transaction costs 6. Lessons learned 6.1 Lessons from the performance of Delivering as One at country and systemic levels 6.2 Lessons of interest to senior management of the UN system within existing intergovernmental mandates 6.3 Lessons to be addressed through intergovernmental decision-making, e.g. the new quadrennial comprehensive policy review resolution 7. Final remarks 4 Annexes I. Note on the ad hoc arrangements for the independent evaluation of the Delivering as One pilot initiative endorsed by General Assembly resolution 64/289 II. Evaluation management group, evaluation team and evaluation secretariat III. Framework terms of reference for the independent evaluation IV. List of persons met V. Documents consulted VI. Questionnaire covering issues related to funding and business practices VII. Country information sheets VIII. Governance of resource allocation and programme management in pilot countries IX. Tables with evidence X. Reform of funding and business processes at country level as key elements of Delivering as One 5 6 Acronyms CCA Common country assessment CEB Chief Executives Board CET Core Evaluation Team CLE Country-led evaluation CPAP Country programme action plan CSO Civil society organization DaO Delivering as One DOCO Development Operations Coordination Office ECA Economic Commission for Africa ECE Economic Commission for Europe ECLAC Economic Commission for Latin America and the Caribbean ECOSOC Economic and Social Council EFW Expanded Delivering as One Funding Window for Achievement of the Millennium Development Goals EMG Evaluation Management Group EPTA Expanded Programme of Technical Cooperation ESCAP Economic and Social Commission for Asia and the Pacific ESCWA Economic and Social Commission for Western Asia FAO Food and Agriculture Organization FTOR Framework terms of reference HACT Harmonized approach to cash transfers HLCM High-Level Committee on Management HLCP High-Level Committee on Programmes HLP High Level Panel HR Human resources IADG Internationally agreed development goals IAEA International Atomic Energy Agency IASB International Accounting Standards Board IASC Inter-Agency Standing Committee ICAO International Civil Aviation Organization ICT Information and communication technology ICTR International Criminal Tribunal for Rwanda IDP Internally displaced person IFAD International Fund for Agricultural Development IFRS International Financial Reporting Standards ILO International Labour Organization IMF International Monetary Fund IMO International Maritime Organization 7 IOM International Organization for Migration IPSAS International Public Sector Accounting Standards ITC International Trade Centre ITU International Telecommunication Union JP Joint programme LTA Long-term agreement MCDGC Ministry of Community Development, Gender and Children (Tanzania) MDG Millennium Development Goal MDG-F Spanish Millennium Development Goal Development Fund MDTF Multi-Donor Trust Fund NGO Non-governmental organization OCHA Office for the Coordination of Humanitarian Affairs ODA Official development assistance OECD/DAC Organisation for Economic Co-operation and Development/Development Assistance Committee OHCHR Office of the High Commissioner for Human Rights OPEC Organization of the Petroleum Exporting Countries OSCE Organization for Economic Co-operation and Security in Europe PAHO Pan American Health Organization PMORALG Prime Minister’s Office: Regional Administration and Local Government (Tanzania) PUN Participating UN agency (Tanzania) QAP Quality Assurance Panel QCPR Quadrennial comprehensive policy review on operational activities for development RC Resident coordinator SWC (United Nations) System-Wide Coherence TCPR Triennial comprehensive policy review on operational activities for development UNAIDS Joint United Nations Programme on HIV/AIDS UNCDF United Nations Capital Development Fund UNCT United Nations country team UNCTAD United Nations Conference on Trade and Development UNDAF United Nations Development Assistance Framework UNDAP United Nations Development Assistance Plan UN-DESA United Nations Department for Economic and Social Affairs UNDG United Nations Development Group UNDP United Nations Development Programme UNDSS United Nations Department of Safety and Security UNEG United Nations Evaluation Group 8 UNEP United Nations Environment Programme UNESCO United Nations Educational, Scientific and Cultural Organization UNFPA United Nations Population Fund UN-Habitat United Nations Human Settlement Programme UNHCR United Nations High Commissioner for Refugees UNIC United Nations information centres UNICEF United Nations Children’s Fund UNIDO United Nations Industrial Development Organization UNIFEM United Nations Development Fund for Women UNODC United Nations Office on Drugs and Crime UNRWA United Nations Relief and Works Agency UNV United Nations Volunteers UN Women United Nations Entity for Gender Equality and the Empowerment of Women UPU Universal Postal Union USAID United States Agency for International Development WFP World Food Programme WHO World Health Organization WIPO World Intellectual Property Organization WMO World Meteorological Organization 9 10 1. Introduction 1.1 Report structure and content 1. This report summarizes the work of the independent evaluation of lessons learned from the Delivering as One pilot countries. Chapter 1 introduces the initiative and describes this evaluation, including its methodology. Chapter 2 presents the context of Delivering as One and the way it has been implemented across the eight pilot countries and in the wider UN system. Chapter 3 discusses the key findings of the evaluation 1. It aims to give an empirical account of the eight pilots. Chapter 4 presents the evaluation’s conclusions,2 Chapter 5 the recommendations and Chapter 6 the lessons learned from the pilots.3 Some final remarks are included as Chapter 7. 2. Chapters 1 to 4 reflect the work of the team of consultants tasked with the evaluation, which was overseen by the Evaluation Management Group.4 Chapters 5 to 7 (recommendations, lessons learned and final remarks) were crafted by the Evaluation Management Group on the basis of the evidence and analysis presented by the evaluation team. 1.2 The origins of Delivering as One 3. The Delivering as One approach emerged from a process of intergovernmental decision-making on the UN system’s operational activities. Triennial comprehensive policy review resolutions adopted in 2001, 2004 and 2007 5 called for a strengthening of the UN development system. Delivering as One initiatives can be considered attempts to respond to these provisions on a pilot basis. 1 According to the Organisation for Economic Co-operation and Development/Development Assistance Committee (OECD/DAC) glossary, “a finding uses evidence from one or more evaluations to allow for a factual statement.” 2 Conclusions are defined in the DAC glossary as follows: “Conclusions point out the factors of success and failure of the evaluated intervention, with special attention paid to the intended and unintended results and impacts, and more generally to any other strength or weakness. A conclusion draws on data collection and analyses undertaken, through a transparent chain of arguments.” 3 The DAC glossary defines these as: “Generalizations based on evaluation experiences with projects, programs, or policies that abstract from the specific circumstances to broader situations. Frequently, lessons highlight strengths or weaknesses in preparation, design, and implementation that affect performance, outcome, and impact.” 4 See section 1.3 for details on the modality of this evaluation. 5 General Assembly resolutions on the triennial comprehensive policy review of operational activities for development of the United Nations system: A/56/201 adopted on 21 December 2001, A/59/250 adopted on 22 December