FINAL EVALUATION Phase IV of Lobi Mokolo Ya Sika NOVEMBER 2018 A team of international consultants and national research assistants Contact: Johan Van der Linden Jessica BEST Country Director DM&E Manager Search for Common Ground Search for Common Ground 24, Tanganyika Avenue 104, Avenue la Corniche, Q. Les volcans, Bukavu | DR Congo Goma | DR Congo [email protected] [email protected] Table of Contents ACRONYMS ............................................................................................................................................. 4 EXECUTIVE SUMMARY ............................................................................................................................ 5 PROJECT BACKGROUND ........................................................................................................................ 15 BACKGROUND AND CONTEXT ............................................................................................................... 18 LMYS AND SSR IN DRC ............................................................................................................................. 18 CONTEXT ................................................................................................................................................. 19 METHODOLOGY ........................................................................................................................................ 22 PRESENTATION OF RESULTS .................................................................................................................. 29 OVERALL QUALITY OF PROGRAMME DESIGN .................................................................................................. 30 LOGICAL FRAMEWORK DESIGN ..................................................................................................................... 30 SUSTAINABILITY AND OTHER CROSS-CUTTING ISSUES .......................................................................................... 31 THEORY OF CHANGE ................................................................................................................................... 35 COST EXTENSION PHASE .............................................................................................................................. 36 PERSPECTIVES OF THE TARGET GROUPS .......................................................................................................... 38 EFFICIENCY ............................................................................................................................................... 47 IMPLEMENTATION OF ACTIVITIES ................................................................................................................... 47 PARTNERSHIPS .......................................................................................................................................... 52 MONITORING AND REPORTING ..................................................................................................................... 53 SYNERGY AND COORDINATION ...................................................................................................................... 54 EFFECTIVENESS.......................................................................................................................................... 55 PERCEPTIONS OF THE POPULATION TOWARD FARDC (OC 1.1 AND OC 1.2) .......................................................... 62 PERCEPTIONS OF THE POPULATION TOWARD PNC (OC 1.3 AND OC 1.4) .............................................................. 66 POPULAR PERCEPTIONS OF THE CHANGING SECURITY SITUATION ........................................................................... 69 PRODUCT QUALITY AND EFFECTIVENESS .......................................................................................................... 70 IMPACT ................................................................................................................................................... 72 DEFINING TRUST ........................................................................................................................................ 72 FACTORS ENABLING AND CONSTRAINING CIVIL-MILITARY TRUST AND COLLABORATION ............................................ 73 ACCOUNTABILITY ....................................................................................................................................... 77 INSTITUTIONAL CHANGE .............................................................................................................................. 79 2 CONCLUSION......................................................................................................................................... 85 RECOMMENDATIONS............................................................................................................................ 87 ANNEXES ............................................................................................................................................... 92 3 Acronyms CGA Common Ground Approach CNP Comité National de Pilotage/National Steering Committee CRP Cellule Réforme de la Police DfID Department for International Development DRC Democratic Republic of Congo FARDC Forces Armées de la République Démocratique du Congo FGD Focus Group Discussion IHL International humanitarian law ISSSS International Security and Stabilisation Support Strategy KII Key Informant Interview LMYS Lobi Mokolo ya Sika M&E Monitoring and Evaluation MONUSCO United Nations Organisation Stabilisation Mission in the DRC PM Police Militaire/Military Police PNC Police National du Congo RRSSJ Security and Justice Sector Reform Network SCIFA Service de Communication et d’Information des Forces Armées SECAS Service d’Éducation Civique, Patriotique et d’Action Sociale Search Search for Common Ground SGBV Sexual and Gender Based Violence SSR Security Sector Reform SSU Stabilisation Support Unit ToR Terms of Reference UK United Kingdom Executive Summary Search for Common Ground (Search) is a non-governmental organisation (NGO) operating in the Democratic Republic of Congo (DRC) since 2001. Search has a mission to transform the ways in which individuals, organisations and governments handle conflict, moving away from confrontational approaches and looking together for “common ground”. Search has been acting in the security sector reform (SSR) domain in the DRC since 2006 via different iterations of its Lobi Mokolo Ya Sika (LMYS) programme. The fourth phase of Lobi Mokolo ya Sika has been implemented with the support of the United Kingdom (UK)’s Department for International Development (DfID) over the period 2014 - 2017. The programme was proposed to be aligned with the International Security and Stabilisation Support Strategy (ISSSS/I4S) and M&E framework at the inception of its fourth phase in 2014, and its logical framework adapted to include relevant ISSSS indicators in 2016. In 2017 a cost extension agreement was signed between Search and DfID, extending the project to May 2018. The overall objective of this fourth phase of LMYS has been to “Strengthen mutual trust and confidence between civilians and security forces”. This document is the result of the final evaluation of the fourth phase of the LMYS programme, commissioned by Search, conducted by a team of external consultants. The evaluation had four key objectives: ● Evaluate the project’s impact in the targeted intervention zones; ● Determine if the intervention’s methods, assumptions and risks are true and adaptable to the context in the intervention zones and other potential zones; ● Understand if and to what extent the targeted groups have benefited from the intervention; ● Understand to what extent the programme has been integrated into local, provincial and national structures. In addition to reporting on the programme’s outcome indicators and the relevant research questions indicated in the evaluation’s Terms of Reference, the consultants were also asked to report on ISSSS indicators integrated into the programme’s log-frame, in stabilisation priority sites. A secondary study was therefore conducted in these priority sites utilising tools provided by the Stabilisation Support Unit (SSU), in addition to the primary evaluation tools. Table 1: Overview of Data Collection Sites Province LMYS Site LMYS and ISSSS priority Comment site Kinshasa Kinshasa North Kivu Goma; Masisi centre; Kitshanga Rutshuru 5 South Kivu Bukavu; Walungu; Luvungi Minova Ituri Bunia Kasenyi; Mambassa A fourth site: Mahagi, was initially planned in the preparatory phase of the evaluation that was dropped due to time limitations. Methodology The final evaluation of this fourth phase of “Lobi Mokolo ya Sika” adopted a mixed methods approach, combining qualitative and quantitative methods, engaging with multiple groups of beneficiaries, including: civilians, military personnel and police as well as other key stakeholders on national, provincial and local levels. The combination of qualitative and quantitative methods permitted a closer understanding of the degree and nature of change in civil-security relations engendered over the course of Phase IV of LMYS across implementation zones, importantly, as defined and experienced by communities targeted by the programme. Data collection was conducted in the programme’s four implementation provinces: Kinshasa, North Kivu, South Kivu, and Ituri. Tools were developed based on those used in the baseline and midterm evaluations and, to the degree possible,