Foreign Agricultural Service, United States Department of Agriculture HondurasA mother of a student answers survey McGovern-Dole questions Project Midterm Evaluation May 2019 This publication was produced at the request of the United States Department of Agriculture. It was prepared independently by individual authors. McGovern-Dole International Food for Education and Child Nutrition Program (MGD) Phase II Project – USDA The United States Department of Agriculture (USDA) McGovern-Dole (MGD) project in Honduras was implemented by Catholic Relief Services (CRS) from 2015 to 2020. It is a school feeding project focused on the strategic objective to improve the literacy of school-age children in 17 municipalities in the department of Intibucá. Agreement Number: No. FFE-522-2015/013-00 Project Duration: 2015-2020 Implemented by: CRS Evaluation Authored by: Thomas M. Crea, PhD Andrew Reynolds, PhD Anayeli Lopez, PhD Antonia Diaz-Valdes, MSW José Acevedo, PhD DISCLAIMER: The author’s views expressed in this publication do not necessarily reflect the views of the United States Department of Agriculture or the United States Government. MIDTERM EVALUATION REPORT MCGOVERN-DOLE INTERNATIONAL FOOD FOR EDUCATION AND CHILD NUTRITION PROGRAM (MGD) PHASE II PROJECT – USDA CRS HONDURAS Prepared by: Thomas M. Crea, PhD Andrew Reynolds, PhD Anayeli Lopez, PhD Antonia Diaz-Valdes, MSW José Acevedo, PhD November 2018 REVISED – May 2019 1 TABLE OF CONTENTS List of Tables, Figures, and Matrices ............................................................................................................. 4 Acronyms ....................................................................................................................................................... 5 Executive Summary ....................................................................................................................................... 6 Midterm Evaluation Report ........................................................................................................................ 16 Introduction .............................................................................................................................................. 16 Background ............................................................................................................................................... 16 MGD II Baseline Study Report .................................................................................................................. 17 Midterm Evaluation Purpose and Objectives ............................................................................................. 17 Overall Purpose and Objectives ............................................................................................................. 17 Evaluation Questions ............................................................................................................................. 18 Baseline Recommendations (2016) ....................................................................................................... 20 Methods ...................................................................................................................................................... 20 Target Population and Sampling Plan ...................................................................................................... 20 Measures and Data Collection Tools ........................................................................................................ 21 Results ......................................................................................................................................................... 26 Explanation of Midterm Evaluation Indicators and Means of Verification ................................................. 26 Result 1.0 – Improved Literacy of School-Age Children ........................................................................... 26 Result 2.0 – Increased Government Support ........................................................................................... 29 Result 3.0 – Increased Engagement of Local Organizations and Community Groups ............................. 30 Result 4.0 – Increased Capacity of Government Institutions ................................................................... 31 Result 5.0 – Improved Policy and Regulatory Framework ....................................................................... 32 Result 6.0 – More Consistent Teacher Attendance .................................................................................. 34 Result 7.0 – Better Access to School Supplies and Materials ................................................................... 36 Result 8.0 – Improved Literacy of Instructional Materials ....................................................................... 38 Result 9.0 – Increased Skills and Knowledge of Teachers ........................................................................ 39 Result 10.0 – Increased Skills and Knowledge of School Administrators ................................................. 41 Result 11.0 – Increased Access to Food (School Feeding) ........................................................................ 44 Result 12.0 – Improved Student Attendance ........................................................................................... 47 Result 13.0 – Increased Economic and Cultural Incentives (or Decreased Disincentives) ....................... 48 Result 14.0 – Improved School Infrastructure.......................................................................................... 49 Result 15.0 – Increased Student Enrollment ............................................................................................ 53 Result 16.0 – Increased Community Understanding of Benefits of Education ........................................ 55 Key Criteria .................................................................................................................................................. 59 Relevance ................................................................................................................................................ 59 Effectiveness ........................................................................................................................................... 61 Efficiency ................................................................................................................................................. 61 Impact ..................................................................................................................................................... 61 Sustainability ........................................................................................................................................... 63 2 Progress Made on Baseline Recommendations .......................................................................................... 72 Midterm Recommendations ....................................................................................................................... 75 References ................................................................................................................................................... 78 APPENDIX A: MGD Phase II Midterm Evaluation Indicators ....................................................................... 80 APPENDIX B: Means of Verifying CRS MEAL Results Indicators .................................................................. 86 APPENDIX C: Income, Expenses, and Decision-Making among Parents ..................................................... 87 APPENDIX D: Measurement Instruments Used in the Midterm Evaluation ............................................... 94 APPENDIX E: Terms of Reference, MGD II Midterm Evaluation – USDA .................................................... 95 APPENDIX F: Datasets from Midterm Evaluation ........................................................................................ 96 3 List of Tables, Figures, and Matrices Table 1. Critical MGD II Outcomes and Related Evaluation Questions ....................................................... 18 Table 2. Key Criteria and Related Evaluation Questions ............................................................................. 19 Table 3. Target Population and Sample ...................................................................................................... 20 Table 4: Child Survey Sample ...................................................................................................................... 22 Table 5: Parent Survey Sample .................................................................................................................... 22 Table 6: School Principal Survey Sample ..................................................................................................... 23 Table 7: Teacher Survey Sample ................................................................................................................. 24 Table 8. 2017 MIDEH Scores by Grade and Gender (n=2,568) ................................................................... 27 Table 9. Parent’s Use of Information on Child Academic Achievement ..................................................... 29 Table 10. School Type Disaggregated by Gender ........................................................................................ 34 Table 11. Results from SOE Teacher Observations (n=1,458) ....................................................................