EVALUATION REPORT SOMALIA INDEPENDENT COUNTRY PROGRAMME EVALUATION 2011-2015 This report was prepared by Vision Quest Consultants. Disclaimer: This evaluation report was prepared for United Nations Population Fund Somalia Country Office by Vision Quest Consultants. The analysis and recommendations of this report do not necessarily reflect the views of UNFPA, its Executive Board or the United Nations Member States. ACKNOWLEDGEMENTS Vision Quest Consultants (VQC) extends its sincere field teams, led by Heads of Sub-Offices for gratitude to the UNFPA Somalia country office for Somaliland, Puntland and Mogadishu for their the opportunity to undertake this evaluation valuable support and guidance during planning and exercise. VQC is grateful for the support that the execution of the evaluation. We also extend special country office staff gave to the evaluation team at thanks to Simon-Pierre Tegang the Regional M&E every stage of the process. In particular, we Adviser- Arab States Regional Office and Yukari appreciate the support of Grace Kyeyune, the Horii, Programme Analyst (Monitoring and Deputy Representative, the entire management Evaluation) for the UNFPA Arab States Region, for team, and Ezekiel Kutto, the M&E Analyst for the their professional guidance during the Country country office for his technical support and Programme Evaluation (CPE) design and for their guidance during the evaluation period. We also valuable comments on the evaluation findings. recognise the efforts of Stella Kimani, UNFPA’s M&E intern who helped coordinate all the logistics during We are thankful to all key informants from UNFPA the evaluation. and its implementing partners for their dedication, for making themselves available for interviews, We would also like to extend our gratitude to Achu providing information, organising meetings with Lordfred, Reproductive Health and Rights (RHR) beneficiaries and working outside office hours to Technical Specialist; Samia Hassan, Programme ensure that we got all the information needed for Manager for the Humanitarian Response; Isatu the evaluation. We also extend our appreciation to Sesay-Bayoh Gender Advisor and Gender Based the beneficiaries and focus group discussions Violence (GBV) Technical Specialist; Eri Taniguchi, participants who contributed to our efforts to GBV Specialist; Mariam Alwi, Population and meaningfully understand the impact of UNFPA’s Development Programme Manager; and the UNFPA work in Somalia. i TABLE OF CONTENTS ACKNOWLEDGEMENTS .............................................................................................................................................. i ABBREVIATIONS AND ACRONYMS ........................................................................................................................... iv MAP OF SOMALIA .................................................................................................................................................... vi SOMALIA KEY FACTS ................................................................................................................................................ vii EXECUTIVE SUMMARY ........................................................................................................................................... viii 1.0 INTRODUCTION ............................................................................................................................................. 1 1.1 The Purpose and Objectives of the Country Programme Evaluation .............................................................. 1 1.2 Scope of the Evaluation ............................................................................................................................. 1 1.3 Evaluation Criteria and Questions ............................................................................................................. 2 1.4 Process and Methodology .............................................................................................................................. 4 2.0 COUNTRY CONTEXT ..................................................................................................................................... 20 2.1 Development Challenges and National Strategies ........................................................................................ 20 2.2 Role of External Assistance ........................................................................................................................... 23 3.0 UN/UNFPA RESPONSE AND PROGRAMME STRATEGIES ............................................................................. 23 3.1 UN and UNFPA Response .............................................................................................................................. 23 3.2 UNFPA Response through the Programme ................................................................................................... 23 4.0 EVALUATION FINDINGS ............................................................................................................................... 35 4.1 Introduction .................................................................................................................................................. 35 4.2 Reproductive Health & Rights Component ................................................................................................... 35 4.2.1 Relevance ........................................................................................................................................ 35 4.2.2 Effectiveness .................................................................................................................................... 40 4.2.3 Efficiency ......................................................................................................................................... 50 4.2.4 Sustainability ................................................................................................................................... 51 4.3 Population and Development ....................................................................................................................... 54 4.3.1 Relevance ........................................................................................................................................ 54 ii 4.3.2 Effectiveness .................................................................................................................................... 56 4.3.3 Efficiency ......................................................................................................................................... 59 4.3.4 Sustainability ................................................................................................................................... 61 4.4 Gender Component ...................................................................................................................................... 63 4.4.1 Relevance ........................................................................................................................................ 63 4.4.2 Effectiveness .................................................................................................................................... 64 4.4.3 Efficiency ......................................................................................................................................... 71 4.4.4 Sustainability ................................................................................................................................... 72 4.5 Management and Coordination .................................................................................................................... 75 4.6 Added Value .................................................................................................................................................. 79 4.7 Monitoring and Evaluation ........................................................................................................................... 82 5.0 CONCLUSIONS ............................................................................................................................................. 86 5.1 Strategic Level ............................................................................................................................................... 86 5.2 Programmatic Level ................................................................................................................................. 89 6.0 RECOMMENDATIONS .................................................................................................................................. 93 6.1 Strategic Recommendations ......................................................................................................................... 93 6.2 Programme Level .......................................................................................................................................... 94 ANNEXES .................................................................................................................................................................... I Annex 1: Terms of Reference ................................................................................................................................. I Annex 2: Summary of Findings of UNFPA Somalia 2nd CP Implementation Results (2011-2015) ...................... XV Annex 3: CP Evaluation Matrix ...........................................................................................................................