Khyber Pakhtunkhwa Reconstruction Program: Mid-Term Performance Evaluation Report October 20, 2014 This publication was produced at the request of the United States Agency for International Development by Tariq Husain, Aftab Ismail Khan, David Garner, and Ahmed Ali Khattak. It was prepared independently by Management Systems International (MSI) under the Monitoring and Evaluation Program (MEP). ACKNOWLEDGMENTS The authors would like to express their thanks to all those who facilitated the work of the team and enabled it to complete this evaluation. These include, but are not limited to, the following: Jamshed ul Hasan, Peshawar office Director of the Monitoring and Evaluation Program, who participated in evaluation team meetings, provided information and insight on institutional and infrastructure issues, and facilitated secondary data collection; Maqsood Jan, Shehla Said, and Hina Tabassum, who worked diligently under challenging conditions to collect qualitative data for the evaluation through individual interviews and focus group discussions; Officials of the Provincial Reconstruction, Rehabilitation and Settlement Authority (PaRRSA), Government of Khyber Pakhtunkhwa, who shared their valuable time and insights with the evaluation team, provided a wealth of information through discussion and relevant documents and arranged successful field visits in three districts of Malakand Division; Officials of the Elementary and Secondary Education Department, who provided school-level data from the Education Management Information System; Officials of the Flood Damages Restoration Directorate of the Department of Irrigation and the Pakhtunkhwa Highways Authority, who provided information on the headworks and bridges included in KPRP; Representatives of the Al-Kasib Group of Engineering Services and Associates in Development, the monitoring and evaluation consultants for KPRP, who responded to several queries and explained implementation modalities through interviews and electronic means; and, USAID officials responsible for KPRP, who facilitated the team’s work and shared their insights and information through interviews. KHYBER PAKHTUNKHWA RECONSTRUCTION PROGRAM MID-TERM PERFORMANCE EVALUATION REPORT Contracted under: Order No. AID-391-C-13-00005 Monitoring and Evaluation Program (MEP) DISCLAIMER The authors’ views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government. CONTENTS Project Summary .................................................................................................................................................................................... iii Executive Summary................................................................................................................................................................................. 1 Program Background .............................................................................................................................................................................. 5 Evaluation Purpose and Evaluation Questions ............................................................................................................................... 10 Evaluation Methods and Limitations ................................................................................................................................................. 11 Findings and Conclusions .................................................................................................................................................................... 14 Recommendations ................................................................................................................................................................................ 41 Bibliography ............................................................................................................................................................................................ 42 Annexes ................................................................................................................................................................................................... 44 Annex I: Evaluation Statement of Work ............................................................................................................................... 45 Annex II: Sources of Information ............................................................................................................................................ 81 Annex III: Data Collection Instruments ................................................................................................................................ 84 Annex IV: Bios of Team Members ........................................................................................................................................ 108 Annex V: Additional Information for Evaluation Question 1 ........................................................................................ 109 Annex VI: Additional Information for Evaluation Question 2 ....................................................................................... 119 Annex VII: Additional Information for Evaluation Question 3 ...................................................................................... 130 Annex VIII: Disclosure of Any Conflicts of Interest ........................................................................................................ 135 Tables and Figures Table 1: Program Summary ................................................................................................................................................................. iii Table 2: KPRP Components and Their Status, December 2013 ................................................................................................ 7 Table 3: KPRP Implementation and Monitoring Arrangements .................................................................................................. 8 Table 4: Schools Included in Focus Groups of Parents and Head Teachers of Children in KPRP-assisted Schools ..................................................................................................................................................................................................... 81 Table 5: Total Number of Focus Group Discussions and Participants by District .............................................................. 82 Table 6: Interviews in Islamabad, April 1, 2014 to April 5, 2014 .............................................................................................. 83 Table 7: Interviews in Peshawar, April 7, 2014 to April 12, 2014 ............................................................................................ 83 Table 8: Interviews in Malakand, April 15, 2014 to April 23, 2014 .......................................................................................... 83 Table 9: Number of Affected Schools in Malakand Division, 2009 ........................................................................................ 109 Table 10: Number of Affected Health Facilities in Malakand Division, 2009....................................................................... 110 Table 11: Number of Affected Water Supply and Sanitation Schemes in Malakand Division, 2009 ............................. 111 Table 12: Cost and Duration of the Project Unit in the C&W Department ...................................................................... 113 Table 13: Eight Educational Indicators for Government Schools in Buner, Lower Dir, and Swat, 2007-08 to 2012-13 ............................................................................................................................................................................................ 120 Table 14: Eight Educational Indicators for Government Primary Schools in Buner, Lower Dir, and Swat, 2007-08 to 2012-13 ............................................................................................................................................................................ 121 i Table 15: Enrollment (in ’000) in Government Schools in Buner, Lower Dir, and Swat, 2007-08 to 2012- 13 ............................................................................................................................................................................................................. 121 Table 16: Percentage of Government Schools in Buner, Lower Dir, and Swat with Basic Facilities, 2007- 08 to 2012-13....................................................................................................................................................................................... 122 Table 17: Comparison of Gross Enrollment Rates1 for Primary, Middle, and Matric Levels (All Types of Schools) 2, 2006-2011 ......................................................................................................................................................................... 123 Table 18: Number of Observations by District, School Type, and Year .............................................................................. 125 Table 19: Distribution of Percentage Change in Enrollment ................................................................................................... 126 Table 20: Composition of Sample ..................................................................................................................................................