ETHIOPIA MILLENNIUM WATER ALLIANCE EX-POST EVALUATION WASH Ex-Post Evaluation Series—Water Communications and Knowledge Management (CKM) Project
Total Page：16
File Type：pdf, Size：1020Kb
PHOTO CREDIT: KARI NELSON EVALUATION REPORT ETHIOPIA MILLENNIUM WATER ALLIANCE EX-POST EVALUATION WASH Ex-Post Evaluation Series—Water Communications and Knowledge Management (CKM) Project May 2018 THIS DOCUMENT WAS PREPARED BY ECODIT LLC AND SOCIAL IMPACT, INC. FOR USAID UNDER THE WATER CKM PROJECT IDIQ NO. AID-OAA-I-14-00069; TASK ORDER NO. AID-OAA-TO-15-00046. AUTHORITY Prepared for USAID under the Water and Development Indefinite Delivery Indefinite Quantity Contract No. AID-OAA-I-14-00069, Task Order No. AID-OAA-TO-15-00046, awarded September 17, 2015, entitled “Water Communications and Knowledge Management (CKM) Project.” This final report is made possible by the support of the American people through the United States Agency for International Development (USAID). The contents of this report are the sole responsibility of ECODIT LLC and do not necessarily reflect the views of USAID or the United States Government. This report was prepared by the Water CKM project team, comprised of ECODIT LLC and Social Impact, Inc. i | E3/WATER CKM: MWA-EP EX-POST EVALUATION USAID.GOV ACKNOWLEDGMENTS The evaluation team (ET) appreciates the keen involvement of the many stakeholders of the Millennium Water Alliance-Ethiopia Program. Notably, the ET gives thanks for the tireless support of Mussie Tezazu and the Millennium Water Alliance Ethiopia office throughout the entire evaluation process. The ET appreciates the participation and feedback of staff at each of the implementing partner organizations: CARE, Catholic Relief Services, Food for the Hungry, Lifewater International, Living Water International, Water Partners International (subsequently renamed Water.org), Hope 2020, World Vision, Relief Society of Tigray, Ethiopian Kale Hiwot Church, Water Action, and Ethiopian Evangelical Church Mekane Yesus-Development and Social Services Commission. Obtaining thorough documentation and insights into an activity that was completed nearly eight years ago can be very challenging. The thoughtful engagement of these organizations and their staff made this evaluation possible. The ET also thanks the staff at USAID, including Abigail Jones, Kathrin Tegenfeldt, Elizabeth Jordan, and Alison Macalady, for their steadfast support and feedback through the entire evaluation process. USAID.GOV E3/WATER CKM PROJECT – MWA-EP EX-POST EVALUATION | ii TABLE OF CONTENTS Authority ……………………………………………………………………………………………………………………………….. i Acknowledgments …………………………………………………………………………………………………..…………… ii Acronyms ……………………………………………………………………………….……………………………………………... v Executive Summary……………………………………………………………………………...………………………………vi Purpose and Overview …………………………………………………………………………………………………………….vi Scope ………………………………………………………….…………………………………………………………………………. vi Design ……………………………………………………………………………………………………………………………………vii Key Findings ………………………………………………………………………………………..………………………………….vii Discussion: Factors Affecting Sustainability …………………………………………………………………......……….viii Key Implications and Recommendations ………………………………………………………………………………..… x Introduction …………………………………………………………………………………………………………………………. 1 Overview of Activity and Budget …….………………………………………………………………………………………. 1 Evaluation Questions …….……………………………………………………………………………………………….…… 4 Methodology ………………………………………………………………….………………………………………………….… 5 Sampling ……………………………………………………………………………………………………………………………… 5 Data Collection Methods ……………………………………………………………………………………………………… 6 Quality Checks and Analysis …………………………………………………………………………………….…………… 7 Limitations …………………………………………………………………………………………………………………………… 7 Findings and Conclusions ……………………………………………………………………….………………………… 9 Water Points: Current Status And Use ………………………………………………………………..………………… 9 Water Points: Factors Affecting Sustainability ………………………………………………………………………… 14 Latrines: Current Status And Use ………………………………………………………………..………………………… 24 Handwashing: Current Status …………………………………………………………...…………………………………… 27 Latrines And Handwashing: Factors Affecting Sustainability …………………………………………..………… 27 Recommendations ………………………………………………………………………………………………..…………… 29 FIGURES Figure 1. MWA-EP Objectives ............................................................................................................................. 2 Figure 2. MWA-EP's Achievements .................................................................................................................... 3 Figure 3. Timeline of MWA-EP's Main Donors ............................................................................................... 4 Figure 4. Evaluation Data Sources ...................................................................................................................... 5 Figure 5. Locations Visited by the ET ................................................................................................................ 6 Figure 6. South Gondor WP Inventory Data: WP Functionality .............................................................. 11 Figure 7. Waiting at a USAID Water Point ................................................................................................... 14 Figure 8. WASHCO Operationality Statistics from WP Inventory in Amhara .................................... 15 Figure 9. WASHCOS with Maintenance Budget in South Gondar Zone of Amhara .......................... 17 Figure 10. Annual Per Capital Expenditure on Water in Ethiopia ............................................................ 18 Figure 11. Hydrogeological Map of Ethiopia .................................................................................................. 22 iii | E3/WATER CKM: MWA-EP EX-POST EVALUATION USAID.GOV TABLES Table 1. Informant Distribution .......................................................................................................................... 6 Table 2. Water Point Functionality by Type of Water Scheme ................................................................ 10 Table 3. Water Point Functionality by Region .............................................................................................. 10 Table 4. Water Fee Collection by Current Functionality Status .............................................................. 19 Table 5. Water Fee Recovery by Current Functionality Status ................................................................ 20 USAID.GOV E3/WATER CKM PROJECT – MWA-EP EX-POST EVALUATION | iv ACRONYMS CKM Communications and Knowledge Management CLTS Community-Led Total Sanitation CLTS-H Community-Led Total Sanitation and Hygiene CNHF Conrad N. Hilton Foundation CRS Catholic Relief Services E. coli Escherichia coli EECMY- Ethiopian Evangelical Church Mekane Yesus—Development and Social Services DASSC Commission EKHC Ethiopian Kale Hiwot Church ET Evaluation Team FH Food for the Hungry GOE Government of Ethiopia HEW Health Extension Worker HH Household IP Implementing Partner JMP Joint Monitoring Programme LI Lifewater International LWI Living Water International LPCD Liters Per Capita Per Day MPN Most Probable Number MWA-EP Millennium Water Alliance-Ethiopia Program NGO Non-Governmental Organizations PHAST Participatory Hygiene and Sanitation Transformation REST Relief Society of Tigray SI Social Impact SNNPR Southern Nations, Nationalities, and People’s Region WASH Water, Sanitation, and Hygiene WASHCO Community Water Management Approach WHO World Health Organization WP Water Point WV World Vision YHYH Your Health is in Your Hands Activity v | E3/WATER CKM: MWA-EP EX-POST EVALUATION USAID.GOV EXECUTIVE SUMMARY PURPOSE AND OVERVIEW Despite of decades of efforts to improve water, sanitation, and hygiene (WASH) in Ethiopia, its key WASH indicators remain some of the lowest in the world. As of 2015, only 30 percent of the rural Ethiopian population had access to water that meets its basic needs; 4 percent used improved, non- shared sanitation; and 99 percent lacked any handwashing facility.1 With well over 14,000 children under 5 dying from diarrheal disease annually in Ethiopia,2 it is imperative that WASH development activities are effective, efficient, and have long-lasting impacts. As in other sub-Saharan African countries, sustainability has been a challenge in Ethiopia. For example, a 2010/2011 national WASH inventory rated 25 percent of water points as non-functional.3 This reflects growing, though limited, evidence across the sector of high rates of water point failure, sometimes just a few years after construction.4 The consequences are wasted money and time, disappointed communities, and dangerous health conditions. USAID is committed to identifying sustainable approaches to WASH to avoid such pitfalls and ensure the long-term impact of its global WASH activities. By understanding the extent to which past project outcomes have been sustained and the factors that drove these outcomes, USAID hopes to learn lessons that can inform the design and implementation of future projects. This report presents findings from the third in a series of six ex-post evaluations designed to learn from completed USAID-funded WASH activities. The subject of this evaluation—the Millennium Water Alliance-Ethiopia Program (MWA-EP)—provides an opportunity to learn about the long-term outcomes related to rural water point construction and rehabilitation, community management of those water points, as well as participatory sanitation and hygiene education and construction activities. The Millennium Water Alliance (MWA) implemented MWA-EP in 24 rural woredas (districts) in Ethiopia between March 2004 and December 2009 with a budget of $4,677,670 from