Beoog Biiga Program Final Evaluation Report Authors: Michaela Gulemetova, Ph.D. Laurence Dessein, Ed.M. Kimberly Garasky December 2014 Submitted by: Submitted to: Project Manager: Laurence Dessein Project Manager: Neda Sobhani IMPAQ International, LLC Catholic Relief Services – Burkina Faso 10420 Little Patuxent Parkway, Suite 300 Zone Industrielle Gounghin, 01 BP 469, Columbia, MD 21044 Ouagadougou, Burkina Faso IMPAQ International, LLC Page i Beoog Biiga Final Evaluation Report ACKNOWLEDGEMENTS We would like to thank Catholic Relief Services (CRS) and the U.S. Department of Agriculture (USDA) for their financial support. We would also like to thank the Ministry of Education of Burkina Faso, its regional and provincial offices in the Sahel region, as well as CRS’s staff for supporting and facilitating the rollout of the evaluation. We would also like to acknowledge Dr. Jacob Benus, Roman Ponos, Dr. Andrea Beasley, Dr. Jean Paul Petraud, Maria Di Fuccia from IMPAQ International, and Neda Sobhani, Mr. Mamadou Salle, Mr. Souleymane Sogodogo, Ms. Marie Koalga Marie, Mr. Adama Romba, Mr. Fabris Compaoré from Catholic Relief Services for their support and advice. We would also like to thank Dr. Yiriyibin Bambio from the University of Ouagadougou and Edoxi Kindane for coordinating the field work. The findings, interpretations and conclusions expressed herein are entirely those of the authors. They do not necessarily represent the views of IMPAQ International nor do they reflect the views of CRS and USDA. IMPAQ International, LLC Page i Beoog Biiga Final Evaluation Report TABLE OF CONTENTS ACRONYM LIST ....................................................................................................................................... v EXECUTIVE SUMMARY ....................................................................................................................... vi CHAPTER 1. OVERVIEW OF THE BEOOG BIIGA PROGRAM ..................................................... 1 CHAPTER 2. EVALUATION APPROACH AND DATA ..................................................................... 3 2.1 Research Questions ....................................................................................................................... 3 2.2 Data Sources ................................................................................................................................. 3 CHAPTER 3. STUDY SAMPLES ............................................................................................................. 5 3.1 Schools .......................................................................................................................................... 5 3.2 Students ......................................................................................................................................... 6 3.3 Teachers ........................................................................................................................................ 7 3.4 Directors ........................................................................................................................................ 8 3.5 PTAs ............................................................................................................................................. 8 3.6 Households .................................................................................................................................... 8 3.7 Stakeholders/Beneficiary Sample ................................................................................................. 9 CHAPTER 4. FIELD WORK AND ANALYSIS ................................................................................... 10 4.1 Field Work .................................................................................................................................. 10 4.2 Quantitative Analysis .................................................................................................................. 10 4.3 Qualitative Analysis .................................................................................................................... 10 CHAPTER 5. FINDINGS ........................................................................................................................ 11 5.1 Relevance of the Program ........................................................................................................... 11 5.2 Program Implementation............................................................................................................. 14 5.3 Effects on School Outcomes ...................................................................................................... 18 5.4 Effects on Student Outcomes...................................................................................................... 23 5.5 Effects on Directors .................................................................................................................... 31 5.6 Effects on Teachers .................................................................................................................... 33 5.7 Effects on Parent-Teacher Associations ..................................................................................... 37 5.8 Effects on Households ................................................................................................................ 43 5.9 Stakeholder Perceptions on Program Successes and Challenges ............................................... 48 CHAPTER 6. CONCLUSIONS AND RECOMMENDATIONS ......................................................... 52 6.1 Key Findings................................................................................................................................ 52 6.2 Stakeholder and Beneficiary Recommendations ......................................................................... 53 APPENDIX 1. MAP OF SAMPLE INTERVENTION VILLAGES .................................................... 55 APPENDIX 2: LIST OF VILLAGES AND NUMBER OF RESPONDENTS BY CATEGORY ..... 56 APPENDIX 3: ATTENDANCE RATES WITH AND WITHOUT CANTEEN ................................. 60 REFERENCES .......................................................................................................................................... 62 IMPAQ International, LLC Page ii Beoog Biiga Final Evaluation Report TABLE OF EXHIBITS Exhibit 1: Students Using The Tippy Taps In A Program School In Bam. .................................... 1 Exhibit 2: Beoog Biiga Logic Model .............................................................................................. 2 Exhibit 3: Program School In Sanmatenga. .................................................................................... 4 Exhibit 4: M&E Sample Of Schools ............................................................................................... 5 Exhibit 5: Sample Replacements .................................................................................................... 6 Exhibit 6: Student Grades ............................................................................................................... 7 Exhibit 7: Sample Composition ...................................................................................................... 7 Exhibit 8: Qualitative Sample ......................................................................................................... 9 Exhibit 9: Tippy Taps At A Program School In Sanmatenga. ...................................................... 15 Exhibit 10: Students’ Containers For Lunch In A Program School In Bam. ............................... 17 Exhibit 11: Total Number Of Enrolled Students .......................................................................... 18 Exhibit 12: Average School Size .................................................................................................. 19 Exhibit 13: Monthly Enrollment By School And By Gender ....................................................... 20 Exhibit 14: Percentage Of Students Attending Less Than Half Of The Time By Year ............... 21 Exhibit 15: Percentage Of Students Attending Less Than Half Of The Time By Month ............ 22 Exhibit 16: Students In Class At A Program School In Bam. ...................................................... 23 Exhibit 17: Students’ Knowledge Of Nutritious Meals ................................................................ 24 Exhibit 18: Students’ Knowledge Of Vitamin A .......................................................................... 24 Exhibit 19: Students’ Knowledge Of Iron .................................................................................... 25 Exhibit 20: Students’ Hygiene Practices....................................................................................... 26 Exhibit 21: Students’ Hand-Washing Self-Reported Practices .................................................... 26 Exhibit 22: Students’ Reasons For Using Latrines ...................................................................... 27 Exhibit 23: Observed Practices Of Hand Washing Among Students ........................................... 27 Exhibit 24: Observed Presence Of Water Infrastructure .............................................................. 28 Exhibit 25: Observed Presence Of Latrines And Cleanliness Of Latrines In Schools ................. 29 Exhibit 26: Latrines At A Program School In Sanmatenga. ......................................................... 29 Exhibit 27: Schools With Active Clubs .......................................................................................