Evaluation Reports, Country Audits Reports, Financial Reports and Other Documents That Could Provide Relevant Evidence
Total Page:16
File Type:pdf, Size:1020Kb
INDEPENDENT EVALUATION DIVISION OFFICE OF EVALUATION AND INTERNAL OVERSIGHT INDEPENDENT THEMATIC EVALUATION UNIDO FIELD NETWORK Vienna, 2019 The designations employed and the presentation of the material in this document do not imply the expression of any opinion whatsoever on the part of the Secretariat of the United Nations Industrial Development Organization (UNIDO) concerning the legal status of any country, territory, city or area or of its authorities, or concerning the delimitation of its frontiers or boundaries. Mention of company names and commercial products does not imply the endorsement of UNIDO. The views and opinions of the team do not necessarily reflect the views of the Governments and of UNIDO. This document has not been formally edited. Distr. GENERAL | ODG/EIO/IED/19/R.5 | December 2019 | Original: English TABLE OF CONTENTS ILLUSTRATIONS .................................................................................................................. IV ABBREVIATIONS AND ACRONYSMS .................................................................................... V GLOSSARY OF EVALUATION-RELATED TERMS ................................................................ VII EXECUTIVE SUMMARY ....................................................................................................... IX I. BACKGROUND AND INTRODUCTION ............................................................................. 1 1.1. UNIDO’S FIELD NETWORK ............................................................................. 2 1.2. EVALUATION: ITS PURPOSE AND SCOPE .......................................................... 3 1.3. METHODOLOGY ............................................................................................... 4 1.4. LIMITATIONS ................................................................................................... 7 II. FINDINGS .................................................................................................................... 8 2.1 DESIGN & RELEVANCE ..................................................................................... 9 2.2 EFFECTIVENESS .............................................................................................. 14 2.3 EFFICIENCY .................................................................................................... 30 2.4 IMPACT & SUSTAINABILITY ............................................................................ 36 2.5 HUMAN RIGHTS AND GENDER ........................................................................ 43 III. CONCLUSIONS ......................................................................................................... 45 IV. RECOMMENDATIONS ............................................................................................... 50 ANNEX I. THEORY OF CHANGE ...................................................................................... 52 ANNEX II. EVALUATION RESULTS MATRIX .................................................................. 53 ANNEX III. LIST OF KEY DOCUMENTS REVIEWED ........................................................ 56 ANNEX IV. DATA COLLECTION STRATEGY ................................................................... 58 ANNEX V. LIST OF STAKEHOLDERS ............................................................................... 61 ANNEX VI. INTERVIEW PROTOCOLS ............................................................................. 69 ANNEX VII. EVALUATION WORK PLAN 2019 ................................................................ 73 ANNEX VIII. ADDITIONAL DATA & ANALYSIS ............................................................. 74 ANNEX IX. TERMS OF REFERENCE ............................................................................... 81 iii ILLUSTRATIONS Chart 1. UNIDO's current Field Office Arrangements .............................................................. 2 Chart 2. Field missions ............................................................................................................... 5 Chart 3. Survey participant information ..................................................................................... 6 Chart 4. Perceived impact of field restructuring (staff) ............................................................. 9 Chart 5. Perceived impact of field restructuring (Member States) .......................................... 10 Chart 6. UNIDO staff experience with the field network ........................................................ 12 Chart 7. Expected and actual outcomes of the field network ................................................... 15 Chart 8. Stakeholders' assessment on UNIDO Field Network’s (UFN) core functions .......... 21 Chart 9. Usefulness of field network-related documents ......................................................... 22 Chart 10. UFN: Positions under regular and operational budgets (2014-21) ........................... 25 Chart 11. Typical time spent by URs/UCRs on various tasks ................................................. 25 Chart 12. Staff's assessment on UNIDO Field Network’s mutual contributions ..................... 30 Chart 13. Staff’s perception on efficiency and effectiveness of the UFN elements ................ 32 Chart 14. Proposed expenditure by region and category (2020-21) ........................................ 33 Chart 15. Overview of resources in the field in 2018 .............................................................. 33 Chart 16. Scatterplots of budget, projects and personnel for 2018 .......................................... 34 Chart 17. On-going projects by country in 2019: An overview ............................................... 35 Chart 18. Staff's recommendation on UFN .............................................................................. 36 Chart 19. Overall ratings of UNIDOs’ field network (Scale: 0-100) ....................................... 38 Chart 20. UNIDO staff by category and gender: numbers and percentage .............................. 44 Chart 21. SWOT Analysis of Field Network ........................................................................... 48 Chart 22. Staff’s assessment on UFN's core functions by category ......................................... 74 Chart 23. Project portfolio and available human resources (2018) .......................................... 75 Chart 24. 2020–2021 Programme and Budgets proposal for the field network (000’ Euros) . 79 Chart 25. Field presence of other UN organizations- an Overview ......................................... 80 iv ABBREVIATIONS AND ACRONYSMS CCA Common Country Analysis CP Country Programme CO Country Office DAC Development Assistance Committee DWT Decent Work Teams ETR Department of External Relations FAO Food and Agriculture Organization FO Field Office HRG Human rights and gender HQ Headquarters ILO International Labour Organization ISID Inclusive and sustainable industrial development LAC Latin America and Caribbean MoU Memorandum of Understanding MTPF Medium-term Programme Framework ODG/EIO/IED Office of Evaluation and Internal Oversight OECD Organization for Economic Cooperation and Development PCP Programme for Country Partnership PTC Directorate of Programme Development and Technical Cooperation RBM Results-based management RC Resident Coordinator RCO Resident Coordinator’s office RH Regional Hub RO Regional Office RPTC Regular Programme of Technical Cooperation SDG Sustainable Development Goal SWOT Strengths Weaknesses Opportunities Threats TC Technical Cooperation ToC Theory of Change TOR Terms of Reference UCR UNIDO Country Representative UFN UNIDO Field Network UN United Nations v UNCT United Nations Country Team UNDAF United Nations Development Assistance Framework UNDP United Nations Development Programme UNDS United Nations Development System UNEG United Nations Evaluation Group UNIDO United Nations Industrial Development Organization UNPDF United Nations Partnership for Development Framework UNRC United Nations Resident Coordinator UNSDCF United Nations Sustainable Development Cooperation Framework (UNDAF, previously) UNSDG United Nations Sustainable Development Group UNSDP United Nations Sustainable Development Partnership UR UNIDO Representative vi GLOSSARY OF EVALUATION-RELATED TERMS Term Definition The situation, prior to an intervention, against which progress can be Baseline assessed. Intended or unintended change due directly or indirectly to an Effect intervention. The extent to which the development intervention’s objectives were Effectiveness achieved, or are expected to be achieved. A measure of how economically resources/inputs (funds, expertise, Efficiency time, etc.) are converted to results. Positive and negative, intended and non-intended, directly and Impact indirectly, long term effects produced by a development intervention. Quantitative or qualitative factors that provide a means to measure Indicator the changes caused by an intervention. Lessons Generalizations based on evaluation experiences that abstract from learned the specific circumstances to broader situations. Management tool used to facilitate the planning, implementation and Logframe evaluation of an intervention. It involves identifying strategic (logical elements (activities, outputs, outcome, impact) and their causal framework relationships, indicators, and assumptions that may affect success or approach) failure. Based on RBM (results based management) principles. The likely or achieved (short-term and/or medium-term) effects of Outcome an intervention’s