Mid-Term Performance Evaluation of the Selective Integrated Reading Activity (SIRA) in Mali
Total Page:16
File Type:pdf, Size:1020Kb
Mid-Term Performance Evaluation of the Selective Integrated Reading Activity (SIRA) in Mali May 2020 This publication was produced at the request of the United States Agency for International Development. It was prepared independently by The Mitchell Group, Inc., and EdIntersect with authors Dr. Karla Giuliano Sarr, Ms. Isabelle McMahon, Dr. Diane Prouty-Harris, Dr. Mary Faith Mount-Cors and Dr. Michel Rousseau. Cover photo taken by Isabelle McMahon. Mid-Term Performance Evaluation of the Selective Integrated Reading Activity (SIRA) in Mali May 13, 2020 SIRA Project Number: 72068820F00003 Evaluation Mechanism Number: 72068819R00011 DISCLAIMER The authors’ views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government. i ACKNOWLEDGMENTS This mid-term performance evaluation of the Selective Integrated Reading Activity (SIRA) required considerable efforts on the part of many individuals. The evaluation team wishes to thank all participants who took part in evaluation activities to share their experiences with us. At the regional and community level, we extend our gratitude first and foremost to students, parents, teachers and school directors, community members, local authorities, pedagogical counselors and regional education officers. We also wish to recognize stakeholders from the various departments within the Ministry of Education (Ministère de l’éducation national) in Bamako who shared their insights and who facilitated access under unprecedented circumstances. We are particularly appreciative of the collaboration with the implementing partners, EDC, Oeuvre Malienne d’Aide a l’Enfance du Sahel (OMAES), Save the Children, School to School International, and Cowater Sogema. The SIRA team assisted the evaluation team with coordination and responded in a timely and effective manner throughout the evaluation process. USAID/Mali colleagues were also extremely helpful and collaborative. In general, the evaluation team was impressed by the dedication of each of these individuals not only to the success of the evaluation, but for the improvement of early grade reading for children in Mali and their communities. Not least of all, this report reflects the high-quality contributions of four technical experts, Ms. Hawa Coulibaly, Mr. Dramane Djiiguiba, Ms. Maimouna Tapo, Mr. Makan Toutou Konaté, and TMG’s administrative and logistics coordinator, Mr. Cheick Oumar Coulibaly. These colleagues consistently strove to assure that the team had the necessary content and context to craft the most accurate and complete evaluation report possible. It was an honor to work with such professionals. We also wish to thank Mr. Michel Diawara and his team of data collectors from CEPROCIDE who served as the eyes and ears in the field for this process. We also recognize that our work coincided with the beginning of the COVID-19 pandemic and we soberly dedicate this report to those whose lives have been affected. We hope we have done justice to the efforts put forth by all involved and that this report provides indications of ways to build on SIRA’s successes to continue to strengthen the reading and writing skills of students for the benefit of all. With humility and gratitude, The SIRA Evaluation Team ii CONTENTS Mid-Term Performance Evaluation of the Selective Integrated Reading Activity (SIRA) in Mali ........................................ i Acknowledgments .............................................................................................................................................................................. ii Contents .............................................................................................................................................................................................. iii Figures ................................................................................................................................................................................................... v Acronyms ............................................................................................................................................................................................ vi Executive Summary ......................................................................................................................................................................... viii Evaluation Purpose and Evaluation Questions ................................................................................................................. viii Program Background ............................................................................................................................................................. viii Evaluation Design, Methods, and Limitations ................................................................................................................... viii Findings and Conclusions ...................................................................................................................................................... ix Summative Conclusion.......................................................................................................................................................... xii Key Recommendations ......................................................................................................................................................... xii Evaluation Purpose & Evaluation Questions ................................................................................................................................ 1 Evaluation Purpose ....................................................................................................................................................................... 1 Evaluation Questions .................................................................................................................................................................... 2 Project Background ........................................................................................................................................................................... 2 Evaluation Methods & Limitations .................................................................................................................................................. 4 Data Collection Methods ............................................................................................................................................................ 4 Sampling .......................................................................................................................................................................................... 4 Data Analysis .................................................................................................................................................................................. 5 Limitations ...................................................................................................................................................................................... 5 Evaluation question 1 ........................................................................................................................................................................ 6 Findings ............................................................................................................................................................................................ 6 Progress Towards Objectives ............................................................................................................................................... 6 Progress Towards Intermediate Results ............................................................................................................................. 8 Supporting and Impeding Factors ....................................................................................................................................... 10 Conclusions .................................................................................................................................................................................. 12 Evaluation question 2 ...................................................................................................................................................................... 13 Findings .......................................................................................................................................................................................... 13 Overview of SIRA’s Balanced Literacy Approach ........................................................................................................... 13 Classroom EGR Instruction ................................................................................................................................................. 14 Service Delivery System ....................................................................................................................................................... 21 Parent, Community and Private Support for EGR .......................................................................................................... 23 Conclusions .................................................................................................................................................................................. 24 Evaluation question 3 .....................................................................................................................................................................