Links to Learning: Education Support to Pakistan (Ed-Links) Evaluation Report
Total Page:16
File Type:pdf, Size:1020Kb
LINKS TO LEARNING: EDUCATION SUPPORT TO PAKISTAN (ED-LINKS) EVALUATION REPORT SEPTEMBER 2012 ED-LINKS Evaluation Team JBS/Aguirre International This report was made possible with support from the American people, through the U.S. Agency for International Development (USAID). The authors’ views expressed in this publication do not necessarily reflect the views of the United States Agency for Intern ational Development or the United States Government. LINKS TO LEARNING: Education Support to Pakistan (ED-LINKS) EVALUATION REPORT SEPTEMBER 2012 Marcia L. Odell, MBA, MS, PhD, Team Leader Suzanne Miric, MA Team Members in Pakistan Contracted Under No. AID 391-BC-12-00008 Table of Contents LIST OF FIGURES AND TABLES............................................................................................................................................. V ACKNOWLEDGEMENTS ........................................................................................................................................................ VII PROJECT SUMMARY ............................................................................................................................................................. VIII ACRONYMS ................................................................................................................................................................................. IX GLOSSARY ................................................................................................................................................................................... XI EXECUTIVE SUMMARY ......................................................................................................................................................... XII ORGANIZATION OF THE REPORT .............................................................................................................................................................. XXIV INTRODUCTION AND OVERVIEW ......................................................................................................................................... 1 ED-LINKS EVALUATION SOLICITATION ............................................................................................................................. 7 RESEARCH DESIGN AND EVALUATION METHODOLOGY ............................................................................................. 8 BACKGROUND ON EDUCATION IN PAKISTAN .............................................................................................................. 10 FIRST OBJECTIVE: STUDENT LEARNING AND THE LEARNING ENVIRONMENT ............................................... 13 SECOND OBJECTIVE: TEACHER TRAINING AND SUPPORT ...................................................................................... 21 GENDER-RELATED CHALLENGES AND TEACHER EDUCATION............................................................................................................... 29 THIRD OBJECTIVE: GOVERNANCE REFORM .................................................................................................................. 32 BENEFICIARY PERCEPTIONS OF ED-LINKS.................................................................................................................... 40 MANAGEMENT AND OVERSIGHT OF ED-LINKS ............................................................................................................ 46 EVALUATION OF ED-LINKS’ “ULTIMATE LINK” ........................................................................................................... 51 ADDRESSING THE EVALUATION QUESTIONS ............................................................................................................... 61 THE FIVE CORE EVALUATION QUESTIONS ................................................................................................................................................ 61 THE 20 SUPPORTING EVALUATION QUESTIONS ...................................................................................................................................... 65 CONCLUSIONS AND RECOMMENDATIONS ..................................................................................................................... 73 CONCLUDING REMARKS ............................................................................................................................................................................... 78 APPENDICES ................................................................................................................................................................................ 1 APPENDIX 1: ED-LINKS RESULTS FRAMEWORK ..................................................................................................................................... 2 APPENDIX 2: ED-LINKS FINAL PMP, GEOGRAPHIC SCOPE AND TIMELINE ....................................................................................... 3 APPENDIX 3: ED-LINKS STATEMENT OF WORK ..................................................................................................................................... 8 Work Management Plan and Timeline ....................................................................................................................................... 20 APPENDIX 4: THE EVALUATION’S ‘5 + 20’ QUESTIONS ......................................................................................................................... 27 APPENDIX 5: RESEARCH DESIGN AND EVALUATION METHODOLOGY ................................................................................................. 29 APPENDIX 6: EVALUATION INSTRUMENTS ............................................................................................................................................... 33 APPENDIX 7: BACKGROUND AND HISTORICAL CONTEXT OF EDUCATION AND REFORM IN PAKISTAN .......................................... 49 APPENDIX 8: STUDENT LEARNING AND THE LEARNING ENVIRONMENT ............................................................................................ 56 APPENDIX 9: TEACHER TRAINING AND SUPPORT ................................................................................................................................... 68 APPENDIX 10: GOVERNANCE REFORM...................................................................................................................................................... 71 APPENDIX 11: BENEFICIARY PERCEPTIONS OF ED-LINKS .................................................................................................................. 73 APPENDIX 12: STORIES FROM TEACHERS, MASTER TRAINERS AND OBSERVERS ............................................................................. 89 APPENDIX 13: EVALUATION & STATISTICAL REVIEW ........................................................................................................................ 103 A. Data Assessments ........................................................................................................................................................................ 103 B. General Modeling Framework ................................................................................................................................................ 107 ED-LINKS Program – Evaluation Report iii C. Data Catalogue ............................................................................................................................................................................. 112 D. Bibliography for Statistical Analysis ................................................................................................................................... 115 APPENDIX 14: EVALUATION DATA ......................................................................................................................................................... 116 Transcripts from FATA ................................................................................................................................................................... 150 APPENDIX 15: CONCLUSIONS AND RECOMMENDATIONS ON HIGHER EDUCATION PARTNERSHIPS ............................................ 166 Institutionalizing Project Interventions through Higher Education US/Pakistan Partnerships ...................... 166 Performance Indicators for Educational Partnerships ..................................................................................................... 168 APPENDIX 16: BIBLIOGRAPHY* ............................................................................................................................................................... 170 ED-LINKS Program – Evaluation Report iv LIST OF FIGURES AND TABLES Figure 1: Development Hypothesis (Abbreviated Version)...................................................................... 1 Figure 2: ED-LINKS Project Areas ................................................................................................................. 4 Figure 3: Stages of Devolution in Pakistan .................................................................................................. 33 Figure 4: Original and Revised Development Hypotheses, Compared ............................................... 66 Figure 5: District Education Department Hierarchy ................................................................................ 53 Table 1: ED-LINKS Project Summary ..........................................................................................................viii