Evaluation of the Peacebuilding Fund (PBF) Project Portfolio In Somalia Evaluation Report 27 December 2019 Evaluation Team: • Dr. Terrence Jantzi (Team Leader) • Anara Alymkulova (Peacebuilding Specialist) • Mohamed Adnan (National Context Specialist) KonTerra Support: • Erisa Yzeiraj Pereira (Research Analyst) TABLE OF CONTENTS Executive Summary ........................................................................................... iii 1 Introduction ................................................................................................. 1 1.1 Country Context ............................................................................................................ 1 1.2 PBF Overview and History in Somalia ........................................................................ 2 1.3 PBF Portfolio of Support Response in Somalia: 2015-2019 ........................................ 4 1.4 PBF Portfolio Operationalization and Stakeholders ................................................... 6 2 Evaluation Features .................................................................................... 11 2.1 Evaluation Scope and Key Questions ......................................................................... 11 2.2 Evaluation Methodology ............................................................................................. 14 2.3 Evaluation Limitations ............................................................................................... 15 3 Evaluation Findings .................................................................................... 16 3.1 Relevance, Results and Contributions ........................................................................ 17 3.1.1 Relevance .................................................................................................................................. 17 3.1.2 Results and Contributions ...................................................................................................... 21 3.1.3 Catalytic and Cascade Effects ................................................................................................ 28 3.2 PBF Portfolio Structure and Management Processes ............................................... 32 3.2.1 Efficiency ................................................................................................................................. 32 3.2.2 Effectiveness ............................................................................................................................ 38 3.2.3 Portfolio Lessons Learned ...................................................................................................... 43 3.2.4 Sustainability and Future Directions .................................................................................... 47 4 Conclusions and Recommendations ........................................................... 51 4.1 Conclusions ................................................................................................................. 51 4.2 Recommendations ..................................................................................................... 53 4.2.1 Strategic Directions ................................................................................................................ 53 4.2.2 PBF Systems, Management and Coordination .................................................................... 54 5 Annexes ..................................................................................................... 55 5.1 Annex 1: Statement of Work ...................................................................................... 55 5.2 Annex 2: Project Summaries ...................................................................................... 71 5.2.1 Overall Summary .................................................................................................................... 71 5.2.2 Individual Project Briefs ........................................................................................................ 74 5.3 Annex 3: PPP and Individual Project Results Frameworks and Summaries ............ 94 5.3.1 Individual Project Logframe Output and Outcome Indicators ........................................... 94 5.3.2 PPP Results Framework ......................................................................................................... 97 5.3.3 PPP Theory of Change ............................................................................................................ 99 5.3.4 PBF Priority Area 1: Support to Implementation of Peace Agreements .......................... 100 5.3.5 PBF Priority Area 2. Promote coexistence and peaceful conflict resolution .....................110 5.3.6 PBF Priority Area 2. Promote coexistence and peaceful conflict resolution .....................110 5.3.7 PBF Priority Area 3: Revitalize the economy and immediate peace dividends ............... 117 5.3.8 PBF Priority Area 4: Essential administrative services and infrastructure .................... 119 5.4 Annex 4: Evaluation Matrix..................................................................................... 130 5.5 Annex 5: Evaluation Team Mission Schedule ......................................................... 138 5.6 Annex 6: List of Persons Interviewed ...................................................................... 140 5.7 Annex 7: Project by Project ToC Analysis ................................................................. 144 5.8 Annex 8: Documents Reviewed ................................................................................ 149 5.9 Annex 9: Data Collection Tools ................................................................................ 151 5.9.1 Document Review Tool Example .......................................................................................... 151 5.9.2 Semi-Structured Guides ....................................................................................................... 152 5.9.3 Thematic FGD Exercises ....................................................................................................... 166 5.9.4 Response Matrixes ................................................................................................................ 168 5.10 Annex 10:List of Acronyms ....................................................................................... 173 i List of Figures Figure 1: Chronology of Projects under Review .......................................................................................... 7 Figure 2: Field Visit Locations – Evaluation Team ................................................................................... 15 List of Tables Table 1: PPP Key Outcomes .......................................................................................................................... 5 Table 2: Overview PBF Portfolio Projects in Evaluation (2015-2018)........................................................ 8 Table 3: Stakeholder Categories in Analysis .............................................................................................. 16 Table 4: Relevance SoW Questions ............................................................................................................. 17 Table 5: Impact Related SoW Questions .................................................................................................... 21 Table 6: Project Contributions to Impact .................................................................................................. 24 Table 7: Efficiency related SoW Questions ................................................................................................ 32 Table 8: PBF Portfolio Efficiency Measures .............................................................................................. 33 Table 9: Project Expenditure Rates............................................................................................................. 33 Table 10: Effectiveness SoW Questions ..................................................................................................... 38 Table 11: Lessons Learned for Project Effectiveness ................................................................................. 45 Table 12: Sustainability SoW Questions .................................................................................................... 47 Table 13: Leveraged Funding by Project .................................................................................................... 48 ii Executive Summary Country Context and Peacebuilding Fund Support 1. Somalia has made important strides on its peacebuilding and state-building agenda. After 25 years of civil war, the country carried out an indirect election and established the Federal government in 2012. This development in combination with other military and political transitions created an opportunity for a new political agreement in the country.1 In 2013, the country signed the New Deal Compact2 as an agreement among all levels of the Somali government and the international community for inclusive political dialogue, reconciliation and rehabilitation of Somalia. The Compact focused on imperative political and socio-economic priorities: building inclusive politics, security, justice, the country's economic foundations, revenue collection and the provision of services.3 2. According to a study done by the Overseas Development Institute (2017), the New Deal Compact has contributed to key results such as the re-engagement of the International