Download "Independent Evaluation of Lessons Learned from Delivering As

Total Page:16

File Type:pdf, Size:1020Kb

Download INDEPENDENT EVALUATION OF LESSONS LEARNED FROM DELIVERING AS ONE MAIN REPORT 26 July 2012 1 2 Table of Contents Main Report Acronyms and abbreviations 1. Introduction 1.1 Report structure and content 1.2 The origins of Delivering as One 1.3 Mandate and modality of the independent evaluation 1.4 Purpose, objective and scope of the independent evaluation 1.5 Evaluation criteria used 1.6 Key evaluation questions 1.7 Defining the challenges that Delivering as One aimed to address 1.8 Evaluation methodology: using a theory of change analytical approach at country level 1.9 Methodology, data collection and analysis 1.10 Stakeholder consultations 1.11 Limitations 2. Context and configuration of Delivering as One as part of UN reform processes 2.1 Introduction 2.2 Delivering as One a part of a larger UN reform process 2.3 Configuration of Delivering as One in the pilot countries 3. Key findings from the eight pilots and the wider UN system 3.1 Introduction 3.2 Progress towards enhanced national ownership 3.3 Progress towards better delivery of support by the UN system to programme countries 3.4 Progress towards reduced transaction costs 3 4. Conclusions 4.1 Introduction 4.2 Conclusions on the strategies 4.3 Progress towards the immediate outcomes 4.4. Progress towards the intermediate states 4.5 Progress towards the overall objective of Delivering as One 4.6. Conclusions on the performance of Delivering as One against evaluation criteria: relevance, effectiveness, efficiency and sustainability 5. Recommendations 5.1 Enhancing national ownership and leadership 5.2 UN system to deliver better support to programme countries 5.3 Simplification and harmonization of business practices to reduce transaction costs 6. Lessons learned 6.1 Lessons from the performance of Delivering as One at country and systemic levels 6.2 Lessons of interest to senior management of the UN system within existing intergovernmental mandates 6.3 Lessons to be addressed through intergovernmental decision-making, e.g. the new quadrennial comprehensive policy review resolution 7. Final remarks 4 Annexes I. Note on the ad hoc arrangements for the independent evaluation of the Delivering as One pilot initiative endorsed by General Assembly resolution 64/289 II. Evaluation management group, evaluation team and evaluation secretariat III. Framework terms of reference for the independent evaluation IV. List of persons met V. Documents consulted VI. Questionnaire covering issues related to funding and business practices VII. Country information sheets VIII. Governance of resource allocation and programme management in pilot countries IX. Tables with evidence X. Reform of funding and business processes at country level as key elements of Delivering as One 5 6 Acronyms CCA Common country assessment CEB Chief Executives Board CET Core Evaluation Team CLE Country-led evaluation CPAP Country programme action plan CSO Civil society organization DaO Delivering as One DOCO Development Operations Coordination Office ECA Economic Commission for Africa ECE Economic Commission for Europe ECLAC Economic Commission for Latin America and the Caribbean ECOSOC Economic and Social Council EFW Expanded Delivering as One Funding Window for Achievement of the Millennium Development Goals EMG Evaluation Management Group EPTA Expanded Programme of Technical Cooperation ESCAP Economic and Social Commission for Asia and the Pacific ESCWA Economic and Social Commission for Western Asia FAO Food and Agriculture Organization FTOR Framework terms of reference HACT Harmonized approach to cash transfers HLCM High-Level Committee on Management HLCP High-Level Committee on Programmes HLP High Level Panel HR Human resources IADG Internationally agreed development goals IAEA International Atomic Energy Agency IASB International Accounting Standards Board IASC Inter-Agency Standing Committee ICAO International Civil Aviation Organization ICT Information and communication technology ICTR International Criminal Tribunal for Rwanda IDP Internally displaced person IFAD International Fund for Agricultural Development IFRS International Financial Reporting Standards ILO International Labour Organization IMF International Monetary Fund IMO International Maritime Organization 7 IOM International Organization for Migration IPSAS International Public Sector Accounting Standards ITC International Trade Centre ITU International Telecommunication Union JP Joint programme LTA Long-term agreement MCDGC Ministry of Community Development, Gender and Children (Tanzania) MDG Millennium Development Goal MDG-F Spanish Millennium Development Goal Development Fund MDTF Multi-Donor Trust Fund NGO Non-governmental organization OCHA Office for the Coordination of Humanitarian Affairs ODA Official development assistance OECD/DAC Organisation for Economic Co-operation and Development/Development Assistance Committee OHCHR Office of the High Commissioner for Human Rights OPEC Organization of the Petroleum Exporting Countries OSCE Organization for Economic Co-operation and Security in Europe PAHO Pan American Health Organization PMORALG Prime Minister’s Office: Regional Administration and Local Government (Tanzania) PUN Participating UN agency (Tanzania) QAP Quality Assurance Panel QCPR Quadrennial comprehensive policy review on operational activities for development RC Resident coordinator SWC (United Nations) System-Wide Coherence TCPR Triennial comprehensive policy review on operational activities for development UNAIDS Joint United Nations Programme on HIV/AIDS UNCDF United Nations Capital Development Fund UNCT United Nations country team UNCTAD United Nations Conference on Trade and Development UNDAF United Nations Development Assistance Framework UNDAP United Nations Development Assistance Plan UN-DESA United Nations Department for Economic and Social Affairs UNDG United Nations Development Group UNDP United Nations Development Programme UNDSS United Nations Department of Safety and Security UNEG United Nations Evaluation Group 8 UNEP United Nations Environment Programme UNESCO United Nations Educational, Scientific and Cultural Organization UNFPA United Nations Population Fund UN-Habitat United Nations Human Settlement Programme UNHCR United Nations High Commissioner for Refugees UNIC United Nations information centres UNICEF United Nations Children’s Fund UNIDO United Nations Industrial Development Organization UNIFEM United Nations Development Fund for Women UNODC United Nations Office on Drugs and Crime UNRWA United Nations Relief and Works Agency UNV United Nations Volunteers UN Women United Nations Entity for Gender Equality and the Empowerment of Women UPU Universal Postal Union USAID United States Agency for International Development WFP World Food Programme WHO World Health Organization WIPO World Intellectual Property Organization WMO World Meteorological Organization 9 10 1. Introduction 1.1 Report structure and content 1. This report summarizes the work of the independent evaluation of lessons learned from the Delivering as One pilot countries. Chapter 1 introduces the initiative and describes this evaluation, including its methodology. Chapter 2 presents the context of Delivering as One and the way it has been implemented across the eight pilot countries and in the wider UN system. Chapter 3 discusses the key findings of the evaluation 1. It aims to give an empirical account of the eight pilots. Chapter 4 presents the evaluation’s conclusions,2 Chapter 5 the recommendations and Chapter 6 the lessons learned from the pilots.3 Some final remarks are included as Chapter 7. 2. Chapters 1 to 4 reflect the work of the team of consultants tasked with the evaluation, which was overseen by the Evaluation Management Group.4 Chapters 5 to 7 (recommendations, lessons learned and final remarks) were crafted by the Evaluation Management Group on the basis of the evidence and analysis presented by the evaluation team. 1.2 The origins of Delivering as One 3. The Delivering as One approach emerged from a process of intergovernmental decision-making on the UN system’s operational activities. Triennial comprehensive policy review resolutions adopted in 2001, 2004 and 2007 5 called for a strengthening of the UN development system. Delivering as One initiatives can be considered attempts to respond to these provisions on a pilot basis. 1 According to the Organisation for Economic Co-operation and Development/Development Assistance Committee (OECD/DAC) glossary, “a finding uses evidence from one or more evaluations to allow for a factual statement.” 2 Conclusions are defined in the DAC glossary as follows: “Conclusions point out the factors of success and failure of the evaluated intervention, with special attention paid to the intended and unintended results and impacts, and more generally to any other strength or weakness. A conclusion draws on data collection and analyses undertaken, through a transparent chain of arguments.” 3 The DAC glossary defines these as: “Generalizations based on evaluation experiences with projects, programs, or policies that abstract from the specific circumstances to broader situations. Frequently, lessons highlight strengths or weaknesses in preparation, design, and implementation that affect performance, outcome, and impact.” 4 See section 1.3 for details on the modality of this evaluation. 5 General Assembly resolutions on the triennial comprehensive policy review of operational activities for development of the United Nations system: A/56/201 adopted on 21 December 2001, A/59/250 adopted on 22 December
Recommended publications
  • Guidelines on 'Common UN Procurement at the Country Level'
    Harmonizing UN Procurement Common UN Procurement at the Country Level High-Level Committee on Management Procurement Network in collaboration with the United Nations Development Group Coordinating author: HLCM PN Working Group on Harmonization March 2015, version 3.1 Contents Acronyms and abbreviations .................................................................................... iii Chapter 1 Introduction..................................................................................................1 1.1 Benefits of cooperation in procurement .....................................................................1 1.2 Changes from the first edition ...................................................................................3 1.3 Authority ...................................................................................................................3 Chapter 2 Options for common procurement .................................................5 2.1 Introduction .............................................................................................................5 2.2 Opportunities ............................................................................................................6 2.3 Minimal common procurement .................................................................................6 2.4 Using existing LTAs or contracts of other UN organizations (‘piggy-backing’) .............7 2.4.1 Process .........................................................................................................8 2.4.2
    [Show full text]
  • The Challenges of Delivering As One: Overcoming Fragmentation and Moving Towards Policy Coherence
    The challenges of Delivering as One: Overcoming fragmentation and moving towards policy coherence Working Paper No. 100 Gabriele Köhler Visiting Fellow, Institute for Development Studies (IDS), Sussex Policy Integration Department International Labour Office Geneva February 2011 Working papers are preliminary documents circulated to stimulate discussion and obtain comments Copyright © International Labour Organization 2011 First published 2011 Publications of the International Labour Office enjoy copyright under Protocol 2 of the Universal Copyright Convention. Nevertheless, short excerpts from them may be reproduced without authorization, on condition that the source is indicated. For rights of reproduction or translation, application should be made to ILO Publications (Rights and Permissions), International Labour Office, CH-1211 Geneva 22, Switzerland, or by email: [email protected]. The International Labour Office welcomes such applications. Libraries, institutions and other users registered with reproduction rights organizations may make copies in accordance with the licences issued to them for this purpose. Visit www.ifrro.org to find the reproduction rights organization in your country ILO Cataloguing in Publication Data Köhler, Gabriele The challenges of delivering as one : overcoming fragmentation and moving towards policy coherence / Gabriele Köhler ; International Labour Office, Policy Integration Department. - Geneva: ILO, 2011 1 v. (Working paper ; No.100) ISBN 978-92-2-124751-7 (print), 978-92-2-124752-4 (web pdf) International
    [Show full text]
  • Delivering As
    United Nations in Lesotho Delivering as One 2013 - 2014 Note The designations employed and the presentation of the material in this publication do not imply the expression of any opinion whatsoever on the part of the Secretariat of the United Nations concerning the legal status of any country, territory, city or area, or of its authorities, or concerning the delimitation of its frontiers or boundaries. 2015 United Nations All worldwide rights reserved Cover photo credits: UN CONTENTS FOREWORD ................................................................................................................................................................................ 03 WHAT IS DELIVERING AS ONE? ............................................................................................................................................. 04 What prompted the reform? ....................................................................................................................................................................... How is the reform structured? ..................................................................................................................................................................... The One UN Programme ............................................................................................................................................................. The One Office ..............................................................................................................................................................................
    [Show full text]
  • Driving the System Apart? a Study of United Nations Integration and Integrated Strategic Planning
    AUGUST 2013 Driving the System Apart? A Study of United Nations Integration and Integrated Strategic Planning ARTHUR BOUTELLIS Cover Image: An image of shattered ABOUT THE AUTHOR glass superimposed over a photograph of a street sign in front of the United ARTHUR BOUTELLIS is a Research Fellow and Adviser to Nations Secretariat Building in New the Peace Operations and Africa Programs at the York City. UN Photo/M. Design by International Peace Institute. Thong Nguyen. Disclaimer: The views expressed in this paper represent those of the author ACKNOWLEDGEMENTS and not necessarily those of IPI. IPI welcomes consideration of a wide IPI is grateful to Norway and the other generous donors to range of perspectives in the pursuit of its Coping with Crisis program, whose support makes a well-informed debate on critical publications like this one possible. policies and issues in international affairs. The author would like to thank Marc Jacquand, who offered analytical and drafting support, and Ian Martin, IPI Publications Adam Lupel, Editor and Senior Fellow Youssef Mahmoud, Michael v.d. Schulenburg, and Oliver Marie O’Reilly, Associate Editor Ulrich, who were interviewed for this report. The author is Thong Nguyen, Editorial Assistant also grateful to Sophie Broennimann, Charles Hunt, Carole Magnaschi, Tuesday Reitano, and IPI colleagues Francesco Suggested Citation: Arthur Boutellis, “Driving the System Mancini, Adam Smith, and Fiona Blyth, who provided Apart? A Study of United Nations feedback on earlier drafts, as well as Adam Lupel and Integration and Integrated Strategic Marie O’Reilly, who edited this report. Planning,” New York: International Peace Institute, August 2013.
    [Show full text]
  • UNDS and the 2016 QCPR: a VIEW from URUGUAY, a DAO COUNTRY UNDS and the 2016 QCPR: a View from Uruguay, a Dao Country
    UNDS AND THE 2016 QCPR: A VIEW FROM URUGUAY, A DAO COUNTRY UNDS and the 2016 QCPR: a view from Uruguay, a DaO country • The 2016 QCPR is a key milestone in setting the stage for the implementation of the 2030 Agenda over its first four years. • As the SG pointed out “Several new functions of the development system are emerging in the face of the changing world economy and the growing demand from Member States and the requirements of the 2030 Agenda. The Agenda’s universal nature, and its promise to leave no one behind, also have implications for the functions of the United Nations in middle and high income countries where different forms of inequality are deepening political, economic and social divides” A/71/63–E/2016/8 [298] • In this presentation, we draw attention to the work done by the UN in Uruguay, a DaO country since 2007, and to the opportunities and challenges related to the more general discussion at the QCPR level that emerge when analysed from a very field based, grounded view. 2 Uruguay • Surface: 176,215 sq km. • Population: 3.420.000 (2014). • GDP: $57.47 billion (2014; market prices; current US$) • GDP per capita: USD 16.807 (2014, current US$) • HDI: 0,793; 52th (2015). • Life expectancy at birth 77 (2014, total, years) • Adult literacy rate: 98% (2014). • Gini coefficient: 0,386 (2015). • Poverty 9.7 % (2014). • Extreme poverty 0,2 % (2015). • Infant mortality: 7.4 (2015). 3 Uruguay in the UN • Strong supporter of multilateralism. • Founding member. • Security Council non-permanent member (2016-2017).
    [Show full text]
  • III. Delivering As One: Other Multilateral Mechanisms for Sustaining Peace Emma Bjertén Günther, Marina Caparini and Yeonju Jung
    sustaining peace and sustainable development 233 III. Delivering as one: other multilateral mechanisms for sustaining peace emma bjertén günther, marina caparini and yeonju jung Beyond the reviews of the Peacebuilding Architecture, progress has been made in several other fields relevant to sustaining peace. This section reviews advances in three areas: (a) preventing violent extremism; (b) the linking of humanitarian action to development, particularly through the World Humanitarian Summit; and (c) the women, peace and security (WPS) agenda. Preventing violent extremism: the report of the Secretary-General In 2016 there was growing international momentum towards a broad, devel- opmental approach in ‘preventing violent extremism’ (PVE). Although the terminology used by actors varies, hard security approaches privileging intelligence, police and military means under counterterrorism tend to be referred to as ‘countering violent extremism’ (CVE). In contrast, PVE approaches seek to address the structural or root causes and drivers of vio- lent extremism, factors that have traditionally fallen under the category of development challenges. The emergence of PVE, specifically its intersection with aspects of human rights, peacebuilding and development agendas, has proven alarming to some actors within those communities, who perceive similar potential risks in PVE for manipulation, abuse and stigmatization as seen with counterterrorism.1 While some development actors have embraced PVE through attention to development-related causes and solutions to radi- calization, and the need for inclusive governance of diverse societies, others warn of the risk that development aid could become securitized.2 Never- theless, despite these concerns the international PVE agenda was further consolidated in 2016. The United States under the Obama Administration was at the forefront of advancing the preventative approach towards violent extremism and unveiled a joint Department of State–USAID Strategy on CVE in May 2016.3 With the CVE Strategy, the USA was perceived at the 1 See e.g.
    [Show full text]
  • Evaluation of Delivering As One
    INDEPENDENT EVALUATION OF DELIVERING AS ONE United Nations MAIN REPORT INDEPENDENT EVALUATION OF DELIVERING AS ONE United Nations MAIN REPORT CONTENTS Acronyms . v 1 . Introduction . 1 1.1 Report structure and content ..................................... 1 1.2 The origins of Delivering as One ................................... 1 1.3 Mandate and modality of the independent evaluation ............. 3 1.4 Purpose, objective and scope of the independent evaluation ...... 4 1.5 Evaluation criteria used ........................................... 4 1.6 Key evaluation questions .......................................... 5 1.7 Defining the challenges that Delivering as One aimed to address .. 5 1.8 Evaluation methodology: using a theory of change analytical approach at country level ......................................... 8 1.9 Methodology, data collection and analysis ......................... 13 1.10 Stakeholder consultations ........................................ 16 1.11 Limitations ........................................................ 16 2 . Context and configuration of Delivering as One as part of UN processes 17 2.1 Introduction ....................................................... 17 2.2 Delivering as One as part of a larger UN reform process ........... 17 2.3 Configuration of Delivering as One in the pilot countries ........... 21 3 . Key findings from the eight pilots and the wider UN system . 37 3.1 Introduction ....................................................... 37 3.2 Progress towards enhanced national ownership ..................
    [Show full text]
  • Disaster Risk Reduction in the United Nations
    Disaster Risk Reduction in the United Nations 2011 Roles, mandates and areas of work of key United Nations entities Disaster Risk Reduction in the United Nations 2011 Roles, mandates and areas of work of key United Nations entities Disaster Risk Reduction in the United Nations Introduction The secretariat of the International Strategy for Disaster Reduction (ISDR) was created in December 1999 through General Assembly resolution 54/219. In 2001, General Assembly resolution 56/195 mandated the secretariat to “serve as the focal point in the United Nations system for the coordination of disaster reduction and to ensure synergies among the disaster reduction activities of the United Nations system and regional organizations and activities in socio-economic and humanitarian fields”. In 2005, the General Assembly, through resolution 60/195, endorsed the “Hyogo Declaration” and the “Hyogo Framework for Action 2005–2015: Building the Resilience of Nations and Communities to Disasters” as adopted by the World Conference on Disaster Reduction, held in Kobe, Hyogo, Japan, in January 2005. The ISDR secretariat and the United Nations system as a whole were tasked to support countries in the implementation of the Hyogo Framework. Under the Secretary-General’s leadership, the United Nations system is gearing all efforts from global to national level to support countries own efforts to reduce the vulnerability of communities and building resilience of nations. Devastating recent disasters have highlighted that disaster-prone countries need an effective, efficient and well coordinated United Nations system. This is particularly the case in the area of disaster risk reduction, both in terms of institutional arrangements and levels of funding.
    [Show full text]
  • The “Delivering As One” UN Initiative: Reforming the UN System at the Country Level
    The “Delivering as One” UN Initiative: Reforming the UN System at the Country Level Luciana Campos, Center for Decision-Making Processes in International Poli- tics and Foreign Policy Introduction In order to understand the changes of how the UN system operational activities are structured at the country-level, this article contextualizes and presents the Delivering as One UN initiative (DaO) by describing the process by which it emerged and diffused throughout UN member states in the aftermath of the 2005 World Summit. This reform initiative aims to incite better coordina- tion and coherence throughout the system at the local level, tackling the deleterious effects of an overstretched, underfunded, and excessively fragmented institutional structure. Although these motivations to create the DaO initiative and its objectives are often clear, defining the initiative itself is less so. Thus, this article tries to explain the DaO’s real purpose and structure. Before introducing the DaO initiative itself, it is necessary to outline the origins of the UN system’s fragmented structure and briefly present previous debates and proposals for tack- ling its negative effects. This historically contextualizes the DaO initiative, identifying its predecessors, which serve as references to explain the initiative singularities in the face of previous reform cycles aimed at streamlining the UN system’s institutional framework. Therefore, my hypothesis is that the DaO initiative is not the simple sum of multiple institutional instruments previously established by scattered efforts to incite coherence within the UN system at the local level. Previous institutional innovations were brought about by different reform impetuses—such as Jackson’s 1969 Capacity Study and Secretary-General Kofi Annan`s reform agenda in the 1990s.
    [Show full text]
  • Working in United Nations Missions
    Working in United Nations Missions Deployee Guide Stabilisation Unit October 2014 Table of Contents Acronyms ................................................................................................................................................ 4 Introduction ............................................................................................................................................ 6 UN Missions ............................................................................................................................................ 8 Preparation for the Deployment ............................................................................................................ 9 General Preparation - Pre-Deployment Understanding ..................................................................... 9 Understanding United Nations peacekeeping and the wider UN family ........................................ 9 Structure of a typical Peace Support Mission ............................................................................... 10 Command and Control (C2) .......................................................................................................... 11 UN Agencies and Programmes and the UN Country Team .......................................................... 12 UN Standards of Conduct .............................................................................................................. 14 The legal framework for UN interventions, and its evolution .....................................................
    [Show full text]
  • MODULE 5: Programming at the Country Level PUBLISHED BY
    A Practitioner’s Toolkit on Women’s Access to Justice Programming MODULE 5: Programming at the Country Level PUBLISHED BY: The United Nations Entity for Gender Equality and the Empowerment of Women (UN Women) 220 East 42nd St, New York, NY 10017, USA and The United Nations Development Programme (UNDP), One United Nations Plaza, New York NY 10017, USA and The United Nations Office on Drugs and Crime (UNODC), Vienna International Centre, Wagramer Strasse 5, A 1400 Vienna, Austria and The Office of the United Nations High Commissioner for Human Rights (OHCHR), Palais Wilson, 52 rue des Paquis, CH-1201 Geneva, Switzerland UN Women: ISBN-13: 978-1-63214-116-3 OHCHR: HR/PUB/18/2 © 2018 United Nations The designations employed and the presentation of material throughout this publication do not imply the expression of any opinion whatsoever on the part of the United Nations Entity for Gender Equality and the Empowerment of Women (UN Women), the United Nations Development Programme (UNDP), the United Nations Office on Drugs and Crime (UNODC), and the Office of the United Nations High Commissioner for Human Rights (OHCHR), concerning the legal or development status of any country, territory, city or area of its authorities, or concerning the delimitation of its frontiers or boundaries. The views expressed in this publication are those of the authors and do not necessarily reflect the views or policies of the United Nations, including UN Women, UNDP, UNODC, OHCHR or the United Nations Member States. This publication may be freely used for non-commercial, fair use purposes, with proper acknowledgement of and attribution to UN Women, UNDP, UNODC and OHCHR.
    [Show full text]
  • Strategy for Denmark's Engagement with UNRWA
    Strategy for Denmark’s engagement with UNRWA 2017 – 2021 Strategy for Denmark’s engagement with UNRWA The work of UNRWA UNRWA is mandated by the UN General Assembly to provide protection and basic services, primarily education and health, to Palestine refugees in their region of origin, until a negotiated political solution to the Israel- Palestine conflict has been found. Due to the unsolved conflict - which has lasted for nearly 70 years - the number of Palestine refugees has grown to more than 5 million people since the establishment of UNRWA in 1949. Pal- estine refugees account for one quarter of the global number of refugees in 2016. Denmark supports UNRWA because It is the UN-mandated organization solely responsible for the well-being and protection of the Palestine refugees, who are part of the final status issues in a negotiated political solution; Relative size of contribution to core budget (2014) The organization contributes to curtailing the refugee flow towards Eu- Others rope, by offering humanitarian assistance and protection in the region of 19% USA 24% origin. In its nearly 70 years of existence UNRWA has proven to be ef- ficient in supporting and providing opportunities to millions of Pales- tine refugees, thus playing a stabilizing role in the region; Denmark 3% It has a strong track record of integrating humanitarian and develop- Netherlands ment approaches in protracted crises. 3% Australia Key challenges of UNRWA 3% Japan The demographic development of the Palestine refugee population in- 3% Switzerland EU creases demands for UNRWA services and funding - leading to recur- 4% 20% rent financial crises; Norway 4% The regional crisis has compounded the need for UNRWA assistance Sweden vis-à-vis Palestine refugees in Syria, Lebanon and Jordan; 7% UK 10% Increased number and intensity of crises globally also increases compe- tition over funds, making it harder to cover UN-mandated expenses.
    [Show full text]