EVALUATION REPORT End-Term Performance Evaluation for the USAID/Zambia School Water Supply and Hygiene (WASH) and Quality Education Project November 2013 This publication was produced at the request of the United States Agency for International Development. It was prepared independently by International Business & Technical Consultants, Inc. (IBTCI) under Task Order AID-611-TO-13-00005. It was authored by Joseph Limange, Matilda Shatunka, and Fidelis Don Chulu. The views expressed in this report do not necessarily reflect the views of the United States Agency for International Development or the United States Government. COVER PHOTO Credit: Joseph Limange Caption: A ninth grade pupil at Ndeka Basic School in Isoka District of Zambia pumps water from a conventional borehole provided by the USAID/Zambia School WASH and Quality Education Project. End-Term Performance Evaluation for the USAID/Zambia School Water Supply and Hygiene (WASH) and Quality Education Activity Joseph Limange (Team Leader) Matilda Shatunka Fidelis Don Chulu November 26, 2013 DISCLAIMER The authors’ views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government. ACKNOWLEDGEMENTS IBTCI is appreciative of the support received from numerous individuals, from the national to the community level, in successfully executing this evaluation. The support given particularly by the USAID Mission in Zambia was enormous and highly cherished. We particularly want to acknowledge the support given by Emma Sitambuli, Program Development Specialist/Mission Gender Focal Person, in getting the necessary documentation and authorizations. We also want to express appreciation to Chishimba Nkosha, Permanent Secretary for the Ministry of Education, Science, Vocational, Training and Early Education (MESVTEE), and Dr. Chileshe Mulenga, Permanent Secretary for the Ministry of Local Government and Housing, for supporting the evaluation team with authorization letters that aided a smooth data collection process. In addition, we would like to thank the District Education Board Secretariats in the twelve Districts covered by this evaluation, who have been highly supportive. Of particular note is the support from Stanley Mwanbazi, Nakonde District Education Board Secretary (DEBS); Edward Chiluba, Lowingu District Buildings Officer; Boniface Kaluba, District AIDS Coordinating Advisor; Leo Likuku, Area Pump Mender; William Luchele, Chansali District Building Officer; Christopher Katongo, Impika District Building Officer; and Arnold Simfukwe, Nakonde District Building Officer. We also thank Danicious Mulenga, Head Mistress for Chewe Primary School and Ngosa Katati, Provincial Education Officer for Northern Province, who have been very supportive to the team and assisted in overcoming challenges during data collection. Finally, we appreciate the support received from the DAPP team, who have supported the evaluation team in diverse ways. We particularly want to mention Elise Soerensen, Country Director; Amos Lwanda, Chief of Party; Mwila Chanda (Nakonde Office); Stanley Hampeyo and Rapheal Chifuwe (Isoka Office) for the active manner in which they supported the evaluation team. i TABLE OF CONTENTS ACRONYMS ...................................................................................................................................................................... iv EXECUTIVE SUMMARY .................................................................................................................................................. v Evaluation Purpose and Rationale ............................................................................................................................. v Project Background ...................................................................................................................................................... v Evaluation Methods and Limitations ......................................................................................................................... v Evaluation Findings ..................................................................................................................................................... vvi Conclusions ................................................................................................................................................................. viii Recommendations ......................................................................................................................................................... x 1.0 INTRODUCTION ..................................................................................................................................................... 1 1.1 Evaluation Purpose and Rationale ...................................................................................................................... 1 1.2 Evaluation Questions ............................................................................................................................................. 1 1.3 Project Background................................................................................................................................................ 2 2.0 EVALUATION METHODOLOGY ........................................................................................................................ 3 2.1 Evaluation Team Structure ................................................................................................................................... 3 2.2 Evaluation Design ................................................................................................................................................... 3 2.3 Ethical Clearance and Authorization ................................................................................................................. 4 2.4 Data Collection Methodology ............................................................................................................................. 4 2.4.1 Initial Discussion ............................................................................................................................................. 4 2.4.2 Data Collection Methods ............................................................................................................................. 4 2.5 Analysis of Research Data .................................................................................................................................... 7 2.6 Limitations ................................................................................................................................................................ 7 3.0 FINDINGS .................................................................................................................................................................... 9 3.1 Achievement of Target ......................................................................................................................................... 9 3.1.1 Condition of Project Activities and Facilities ........................................................................................... 9 3.1.2 Knowledge of Hygiene ................................................................................................................................ 11 3.1.3 Facility Usage and Incidence of Diarrhea Diseases .............................................................................. 15 3.1.4 Quality of Education .................................................................................................................................... 16 3.2 Innovative WASH Technology .......................................................................................................................... 18 3.2.1 Level of Functionality ................................................................................................................................... 18 3.2.2 Responsiveness of Beneficiaries ................................................................................................................ 21 3.2.3 Enablers to Innovative Technologies ....................................................................................................... 21 3.2.4 Barriers to Innovative Technologies ........................................................................................................ 22 3.2.5 Best Practices ................................................................................................................................................ 23 3.3 Replication and Management by Local Institutions ...................................................................................... 23 3.3.1 Replication of Technologies and Activities ............................................................................................. 23 3.3.2 Operation and Maintenance ...................................................................................................................... 25 3.3.3 Sustainability .................................................................................................................................................. 25 3.4 Linkage Between Wash Facilities in Schools, School Attendance and Teacher Retention ................ 27 3.4.1 Linkage between WASH Facilities and Pupils Attendance ................................................................. 27 4.0 CONCLUSIONS ......................................................................................................................................................