Final Report I
Total Page:16
File Type:pdf, Size:1020Kb
FINAL REPORT I © UNICEF II FINAL REPORT This report was written by Universalia Management FINAL REPORT Group. The report represents the views of the consultant and should not be attributed to the UNICEF or to any other organization. © UNICEF FINAL REPORT III Independent Evaluation of UNICEF Nigeria Training Investments Final Report © United Nations Children’s Fund, Nigeria, 2016. United Nations Children’s Fund Plot 617/618, UN House, Diplomatic Zone, Central Area District Abuja, Nigeria UNICEF’s Nigeria Country Office manage evaluation and evaluative studies on a wide range of topics for the purpose of contributing to learning about what makes for effective development, as well as supporting accountability for results in Nigeria. These evaluations aim at identify what works and what does not in terms of achieving sustainable and equitable development results, and to throw light on how and why interventions succeed or not under various circumstances. In assessing UNICEF support to Nigeria government at Federal and State level and other development partners, these evaluations consider where, how and why progress is being made and the difference it is making in the lives of children, women in Nigeria. By publishing evaluation reports, the UNICEF Nigeria Country Office makes evaluation findings, lessons and conclusion available to a wide audience. Lessons learned from evaluation are expected to inform operational improvements and, ultimately, to support the achievement of better results. The publication of evaluation reports also supports accountability, by providing all interested parties with independently determined evidence relating to UNICEF’s performance. This provides a basis for informed dialogue and discussion, and helps to assure all stakeholders that the organization operates in an open and transparent manner. The content of this report do not necessarily reflect the policies or views of UNICEF. The text has not been edited to official publication standards and UNICEF accepts responsibility for error. The designations in this publication do not imply an opinion on the legal status of any country or territory, or of its authorities, or the delimitation of frontiers. The copyright for this report is held by the United Nations Children’s Fund – Nigeria Office. Permission is required to reprint/reproduce/photocopy or in any other way to cite or quote from this report in written form. UNICEF has a formal permission policy that requires a written request to be submitted. For non-commercial uses, the permission will normally be granted free of charge. Please write to the UNICEF Nigeria Country Office at the address below to initiate a permission request. For further information, please contact: UNICEF Nigeria Country Office United Nations Children’s Fund Plot 617/618, UN House, Diplomatic Zone, Central Area District Abuja, Nigeria [email protected] © UNICEF IV FINAL REPORT Foreword UNICEF Nigeria is a learning organization, at the heart of the work we do, is ensure that, at the round of Country Program Document (CPD) 2018-2021 development, we address and take lessons as well as incorporate these into next programmme. Since training interventions are a major component of our work in Nigeria, the Country Office commissioned this evaluation to inform discussions on the next CPD. The findings show that, as an organization, we have invested considerably in Nigeria for the delivery of trainings to facilitate the implementation of UNICEF’s Country Programme in Nigeria. Trainings which are delivered by UNICEF in Nigeria have been appreciated by partners and participants for the relevance and quality of the trainings. However, the planning process is not part of an overarching country strategy, which leads to a diversity of trainings that runs the risk of dispersal. The absence of an explicit Theory of Change and the lack of a strong results measurement framework also do not permit adequate monitoring of training activities and their expected results. The recommendations are; 1) UNICEF in Nigeria should develop a comprehensive country training strategy to design trainings proactively, as opposed to focusing on individual punctual training activities that support specific aspects of programme implementation; 2) UNICEF in Nigeria should further monitor and evaluate its trainings by adopting monitoring and evaluation mechanisms and developing M&E instruments, guidelines and templates for training activities that systematically collect data on all training activities, expenditures and results and ; 3) UNICEF in Nigeria should ensure appropriate data management through the establishment and management of a database on trainings. We will address the recommendations and provide adequate responses. I wish to express my personal thanks to all sections within UNICEF Nigeria and especially to the Monitoring and Evaluation team for managing this evaluation and supporting Universalia Management Group to give an in-depth insight that is well presented in this report on the effectiveness of the UNICEF Nigeria training investment. Mohamed Malick Fall Country Representative. © UNICEF FINAL REPORT V Acronyms CD Capacity Development CPD Country Programme Document DAC Development Assistance Committee DSA Daily Subsistence Allowance FAO Food and Agriculture Organization FGD Focus Group Discussion FO Field Office GM General Manager HACT Harmonized Approach to Cash Transfers IMEP Integrated Monitoring and Evaluation Plan KM Knowledge Management LGA Local Government Area M&E Monitoring and Evaluation NCO Nigeria Country Office NGO Non-Governmental Organization OECD Organization for Economic Cooperation and Development RAM Results Assessment Modules RBM Results Based Management RWP Rolling Work Plan ToC Theory of Change TORs Terms of Reference ToT Training of Trainers UMG Universalia Management Group UNDAF United Nations Development Assistance Framework UNDAP United Nations Development Assistance Programme UNDG United Nations Development Group UNESCO United Nations Educational, Scientific and Cultural Organization UNICEF United Nations Children’s Fund WASH Water, Sanitation and Hygiene WASHCOM Water, Sanitation and Hygiene Committee WASHIMS WASH Information Management System © UNICEF FINAL REPORT VII Contents EXECUTIVE SUMMARY ................................................................................................. 1 1 INTRODUCTION ..................................................................................................... 5 1.1 Evaluation Objectives .................................................................................................................... 5 1.2 Evaluation Context ........................................................................................................................ 6 2 METHODOLOGY .................................................................................................... 8 2.1 Evaluation Phases .......................................................................................................................... 8 2.2 Approach to Data Collection ......................................................................................................... 8 2.3 Theoretical Approaches .............................................................................................................. 12 2.4 Methodological Limitations......................................................................................................... 12 3 EVALUATION FINDINGS ....................................................................................... 14 3.1 Evaluability Assessment .............................................................................................................. 14 3.2 Relevance .................................................................................................................................... 17 3.3 Effectiveness................................................................................................................................ 22 3.4 Efficiency ..................................................................................................................................... 39 3.5 Sustainability ............................................................................................................................... 40 3.6 Cross-Cutting issues .................................................................................................................... 41 4 CONCLUSION AND RECOMMENDATIONS ............................................................. 42 4.1 Conclusion ................................................................................................................................... 42 4.2 Recommendations ...................................................................................................................... 42 © UNICEF VIII FINAL REPORT Figures Figure 2.1 Phases of the Evaluation .......................................................................................................... 8 Figure 2.2 Mapping of consulted UNICEF Offices ..................................................................................... 9 Figure 2.3 Number of respondents disaggregated by sector and region ............................................... 11 Figure 2.4 Respondents’ participation in a UNICEF training between 2014 and May 2016 ................... 11 Figure 2.5 Respondents’ participation in a UNICEF training before 2014 .............................................. 11 Figure 2.6 Gender of respondents .........................................................................................................