ACCELERATED Programme Evaluation –
Total Page:16
File Type:pdf, Size:1020Kb
Summative Evaluation of the Enhanced and Accelerated WASH Programmes ACCELERATED Programme Evaluation – Final Report Scope: March 2015 to June 2019 30th January 2020, commissioned by UNICEF in Ghana Ipsos MORI & FCG Sweden 18-093236-01 | Version 4 | Internal Use Only | This work was carried out in accordance with the requirements of the international quality standard for Market Research, ISO 20252:2012, and with the Ipsos MORI Terms and Conditions which can be found at http://www.ipsos-mori.com/terms. © UNICEF 2020 Ipsos MORI & FCG Sweden | Accelerated Programme Evaluation Final Report 18-093236-01 | Version 4 | Internal Use Only | This work was carried out in accordance with the requirements of the international quality standard for Market Research, ISO 20252:2012, and with the Ipsos MORI Terms and Conditions which can be found at http://www.ipsos-mori.com/terms. © UNICEF 2020 18-093236-01 | Version 4 | Internal Use Only | This work was carried out in accordance with the requirements of the international quality standard for Market Research, ISO 20252:2012, and with the Ipsos MORI Terms and Conditions which can be found at http://www.ipsos-mori.com/terms. © UNICEF 2020 Ipsos MORI & FCG Sweden | Accelerated Programme Evaluation Final Report Contents Executive Summary ........................................................................................................................ 6 1 Introduction .............................................................................................................................. 13 1.1 The Accelerated WASH programme ............................................................................................................. 13 1.2 Background to the programme ..................................................................................................................... 14 1.3 Revised Theory of Change .............................................................................................................................. 15 1.4 Evaluation purpose, objectives and scope ................................................................................................... 18 1.5 Evaluation Criteria ........................................................................................................................................... 18 1.6 Evaluation Questions ....................................................................................................................................... 19 1.7 Methodology .................................................................................................................................................... 20 1.8 Challenges and limitations ............................................................................................................................. 25 2 Evaluation Findings & Preliminary Conclusions (by Criterion) ........................................... 28 2.1 Relevance .......................................................................................................................................................... 29 2.2 Effectiveness ..................................................................................................................................................... 35 2.3 Efficiency ........................................................................................................................................................... 78 3 Final Conclusions ...................................................................................................................... 86 4 Lessons Learned ......................................................................................................................... 88 5 Recommendations ..................................................................................................................... 90 Annexes .......................................................................................................................................... 99 List of Figures Figure 1: Programme timeline ....................................................................................................................................... 13 Figure 2: Revised Theory of Change ............................................................................................................................. 17 List of Tables Table 1: Summary of recommendations ...................................................................................................................... 12 Table 2: Key evaluation questions for the Accelerated programme ........................................................................ 19 Table 3: Interviews completed by stakeholder type for the Accelerated programme ......................................... 23 Table 4: Focus groups for the Accelerated programme ............................................................................................. 24 Table 5: Key evaluation questions for the Accelerated programme related to relevance ................................... 29 Table 6: Key evaluation questions for the Accelerated programme related to effectiveness ............................. 35 Table 7: ODF communities in Ghana by implementing organisation ...................................................................... 61 Table 8: Key evaluation questions for the Accelerated programme related to efficiency ................................... 78 Table 9: Strategic recommendations ............................................................................................................................ 91 Table 10: Operational recommendations ..................................................................................................................... 97 18-093236-01 | Version 4 | Internal Use Only | This work was carried out in accordance with the requirements of the international quality standard for Market Research, ISO 20252:2012, and with the Ipsos MORI Terms and Conditions which can be found at http://www.ipsos-mori.com/terms. © UNICEF 2020 Ipsos MORI & FCG Sweden | Accelerated Programme Evaluation Final Report Table of Acronyms BaSIS – Basic Sanitation Information System CLTS – Community-led total sanitation CONIWAS - Coalition of NGOs in Water and Sanitation CSO – Civil Society Organisation CWSA – Community Water and Sanitation Agency DAC – Development Assistance Committee DCD – Department for Community Development DCE - District Chief Executive DICCS – District Inter-Agency Coordinating Committee on Sanitation DHS – Demographics and Health Surveys DRP – District Resource Person EHSD – Environmental, Health and Sanitation Directorate EMIS – Education Management Information System GAC – Global Affairs Canada GES – Ghana Education Service GHS – Ghana Health Service GoG – Government of Ghana HHETPS – Health and Hygiene Education Through Play and Sports HWWS – Handwashing with Soap JMP - WHO/UNICEF Joint Monitoring Programme KEQ – Key Evaluation Question KNUST – Kwame Nkrumah University of Science and Technology KPM – Key Performance Measurement MDGs – Millennium Development Goals MICS - Multiple Indicator Cluster Surveys MHM – Menstrual Hygiene Management 18-093236-01 | Version 4 | Internal Use Only | This work was carried out in accordance with the requirements of the international quality standard for Market Research, ISO 20252:2012, and with the Ipsos MORI Terms and Conditions which can be found at http://www.ipsos-mori.com/terms. © UNICEF 2020 Ipsos MORI & FCG Sweden | Accelerated Programme Evaluation Final Report MMDA – Metropolitan, Municipal and District Assemblies NCWSP – National Community Water and Sanitation Programme NDPC – National Development Planning Commission NESSAP – National Environmental Sanitation Strategy and Action Plan NGO – Non-governmental organisation OD – Open defecation ODF – Open defecation free OECD – Organisation for Economic Cooperation and Development O&M – Operations and Maintenance RICCS – Regional Inter-Agency Coordinating Committee on Sanitation RSMS – Rural Sanitation Model and Strategy SDGs – Sustainable Development Goals SHEP – School Health Education Programme SIS – Sector Information System SKMI – Sanitation Knowledge Management Initiative STSM – Small Town Sanitation Model ToR – Terms of Reference ToC – Theory of Change WASH – Water, Sanitation and Hygiene WSUP - Water and Sanitation for the Urban Poor WinS – WASH in Schools 18-093236-01 | Version 4 | Internal Use Only | This work was carried out in accordance with the requirements of the international quality standard for Market Research, ISO 20252:2012, and with the Ipsos MORI Terms and Conditions which can be found at http://www.ipsos-mori.com/terms. © UNICEF 2020 Ipsos MORI & FCG Sweden | Accelerated Programme Evaluation - Final Report 6 Executive Summary 1. Introduction UNICEF in Ghana supported implementation of the Accelerated Water, Sanitation and Hygiene (WASH) programme from March 2015 to June 2019 in Ghana’s Northern region, where access to WASH-related services and related health outcomes are among the lowest in the country. At the start of the programme, only 68% of households and 37% of schools had access to improved water services in the Northern region. Additionally, open defecation was widely practiced (by 72% of the population). Subsequently, the Accelerated programme proposal identified three specific objectives: 1) to increase equitable access to suitable household and institutional sanitation facilities; 2) to facilitate the adoption of good hygiene practices for improved