FINAL REPORT OUTCOME EVALUATION OF THE COUNTRY PROGRAMME (2013 – 2017) OF UNDP SRI LANKA Submitted by: Multi Sector Development Solutions (Pvt): Ltd April 2017 0 Table of Contents 1. Executive Summary: ............................................................................................................................................. 3 2. Background to the Program: ................................................................................................................................ 6 3. Introduction to the Evaluation: ............................................................................................................................ 7 4. Evaluation Methodology: ..................................................................................................................................... 8 5. Analysis and Findings of the Evaluation: ............................................................................................................ 18 6. Conclusion and Recommendations: ................................................................................................................... 51 Annexures: Annexure 01 – Results Framework .............................................................................................................................. 56 Annexure 02 – Types of data collection methods focusing on different levels of stakeholders with specific questions ... 60 Annexure 03 – Terms of Reference ............................................................................................................................. 71 Annexure 04 - Schedule of data collection: National and Regional / Sub-national level ............................................ 76 Annexure 05 - List of supporting documents reviewed ……………………………………………………….…………………………………80 Figures: Figure 01: Entrepreneurs trained and engaged in business / livelihood interventions .............................................. 22 Figure 02: Participation of women in business skills development programmes ....................................................... 24 Figure 03: Membership in the POs and PGs ................................................................................................................ 25 Figure 04: YLD training content ................................................................................................................................... 27 Figure 05: Sub-national level training – content ......................................................................................................... 28 Figure 06: District / Divisional staff – participation in training .................................................................................... 29 Figure 07: YLD attendance at training ......................................................................................................................... 30 Figure 08: CBO participation in capacity building ....................................................................................................... 32 Figure 09: District / Divisional level Officials trained and engaged in District Development Planning Process .......... 42 Figure 10: Entire range of benefits to people: YED, Non-YED and YLD ....................................................................... 42 Figure 11: POs / PGs engaged in scaling-up, value additions, product diversifications and new productions in Anuradhapura District ................................................................................................................................................. 46 Figure 12: Trainees under YED: selected vs. attended the training ............................................................................ 46 Figure 13: District-wise distribution of livelihood development programme - Divineguma ....................................... 47 Figure 14: Community consultations held with regard to district development plans ............................................... 48 1 List of Abbreviations: Agro-Economic Development Project (ADP) Alliance Development Trust (ADT) The Batticaloa Seed Growers’ Association (BSGA) Capacity Development for Recovery in North (CADRIN) Country Programme Action Plan (CPAP) Country Programme Document (CPD) Citizen’s Charter (CC) Country Office (CO) Competency based Economies through Formation of Entrepreneurs (CEFE) Comprehensive Disaster Management Plan (CDMP) Department of Project Management and Monitoring (DPMM) District Review Board (DRB) District Coordination Committee (DCC) District Action Plan (DAP) Disaster Risk Reduction (DRR) Direct Implementation Modality (DIM) Enterprise Development Officer (EDO) Fund Authorization and Certificate of Expenditures (FACE) Governance for Empowerment and Social Inclusion (GESI) Governance for Local Economic Development (GLED) Global Facility for Disaster Risk Reduction (GFDRR) Gender Steering and Implementation Committee (GSIC) Human Rights Commission of Sri Lanka (HRCSL) Industrial Services Bureau (ISB) Kebithigollawa Integrated Rural Development Organization (KIRDO) Local Governance Programme (LoGoPro) Local Economic Development (LED) Livestock Integrated Breeder’s Cooperative (LIBCO) Micro, small and medium enterprises (MSMEs) Midterm review (MTR) Northern Livelihood Development Project (NLDP) National Implementation Modality (NIM) National Aquaculture Development Authority (NAQDA) National Design Council (NDC) Participatory Context and Needs Assessment (PCNA) Project Implementation Unit (PIU) Programme Board (PB) Producer Group (PG) Producer Organization (PO) Rebuilding Agricultural Livelihood Project (RALP) Results Oriented Annual Reports (ROAR) Results based Planning (RBP) Strengthening Enforcement of Law, Access to Justice and Social Integration (SELAJSI) Sexual and Gender Based Violence (SGBV) Industrial Training Institute (ITI) Youth Entrepreneurship Development (YED) Youth Leadership Development (YLD) Women’s Development Federation (WDF) 2 1. Executive Summary: 1.1 Brief overview of the purpose, objectives, scope and methods of the evaluation Purpose of the Evaluation To assess the extent to which the UNDP Country Programme outcomes 1, 2 and 3 have been achieved over the five years of the programme (2013-2017) To ensure accountability to stakeholders in managing for results Objectives of the Evaluation • To assess the extent to which the planned outputs have been or will be achieved by 2017 and the extent to which these output results have contributed to the planned outcomes to identify unintended positive or negative results of the three outcomes. • To assess the three outcomes and related outputs against Relevance, Effectiveness, Efficiency, Impact and Sustainability. • To assess the level of integration of gender equality, conflict sensitivity, environment concerns and results-based management in the programme implementation. Scope of the Evaluation This evaluation mainly reviewed outcomes of the Country Programme: Governance for Empowerment and Social Inclusion (GESI) and the extent to which the programmes under GESI contributed towards outcomes of the country programme. The programs that were mainly subjected to evaluation are the two core programmes of GESI: Governance for Local Economic Development (GLED) and Strengthening Enforcement of Law, Access to Justice and Social Integration (SELAJSI). In addition to these two, the other programs that have implications on the implementation of GESI: Programme Framework of Support for Policy, Systems and Institutional Development in Sri Lanka, Strategic Positioning of the Department of Project Management and Monitoring (DPMM) and HRC phase II / Support to Parliament / Strategic Support to Government of Sri Lanka for Constitutional, Legal and Institutional Reforms and the Resettlement Process in 2015, were also evaluated. Some of the programs are ongoing and due to end in 2016 / 17. Hence, the scope of the evaluation extended beyond reviewing outcomes, to include the “means to outcomes” – the Processes and Systems adopted in enabling those outcomes. In situations where the projects and programs are ongoing, the likeliness of achievement of outcomes was assessed by reviewing various processes, systems and strategies adopted by such programs. Evaluation Methodology The approach of the evaluation closely reflects outcome mapping principles. As said before, the scoping of the evaluation mainly focused on two distinct aspects of the programmes under evaluation: • Achievement of Outcomes of the programme, which are: Outcome 1: An enabled environment for equal opportunities to sustainable livelihoods, decent work and employability Outcome 2: Strengthened provision of access to and demand for equitable and quality social services delivery and enhanced capacity of national institutions for evidence based policy development Outcome 3: Communities empowered and institutions strengthened to support local governance and access to justice and • Strategies, systems and processes facilitating achievement of the outcomes The programmes completed by the time of this evaluation looked into both these aspects. Those still continuing were evaluated mainly based on their strategies, systems and processes. Evaluation questions in the framework have been formulated as per OECD-DAC criteria: relevance, efficiency, effectiveness, impact and sustainability. As mentioned before, the data collection has been explicitly focused on the indicators, and on the behavioural changes responding to these. Hence, the analysis adopted the core principles of outcome