Evaluation Report 12 June 2017 (Final Report) WFP Bangladesh Country Office Evaluation Manager: Denise Brennan
Total Page：16
File Type：pdf, Size：1020Kb
based based based decisiondecision making making - - ation for evidence ation Decentralized Evaluation Mid-Term Evaluation of McGovern-Dole-supported Decentralized evaluation for evalu evaluation evidence Decentralized Decentralized School Feeding Programme in Bangladesh (FFE-388-2014/048-00) October 2014 – September 2016 Draft Evaluation Report 12 June 2017 (final report) WFP Bangladesh Country Office Evaluation Manager: Denise Brennan Prepared by Iqbal Sobhan, Team Leader Rita Bhatia, Senior Evaluator (Public Health Nutrition) Christine M. Berger, Research Analyst/Evaluator Mid-Term Evaluation of McGovern-Dole School Feeding in Bangladesh 2014–2017 Evaluation Report (Final) ACKNOWLEDGEMENTS The Evaluation Team expresses its gratitude to all informants, including school children, teachers, parents, government officials at national, provincial and upazila levels, as well as to staff of various international development agencies, who kindly took the time to meet us and give us their view of the school feeding programme in Bangladesh. Their support, time, and hospitality is highly appreciated. A special thanks goes to the WFP Country Office staff, especially Mr. Ezaz Nabi, the focal point for this evaluation, for assisting with the planning and facilitation of the evaluation mission, and for supplying the necessary documentation. The Evaluation Team wishes to express its appreciation to the WFP Sub-Office in Rangpur, especially Ms Hafiza Khan, Ms Shaheen Sultana, and Mr Mamunur Rashid, for taking great care of us during the week of field visits in Gaibandha. Thanks also to Mr Muhammad Ashfaq Ur Rahman for his translation services during the field visit. Thank you to Clare Mbizule, former Regional Monitoring and Evaluation Advisor at the Regional Bureau in Bangkok (RBB), and to WFP’s Evaluation Manager, Denise Brennan, for their roles in mobilising the evaluation and facilitating the evaluation process. Finally, we wish to thank Mokoro's Technical Evaluation Manager, Stephen Lister, for his professional oversight, and Stephen Anderson for the additional Quality Support. DISCLAIMER The opinions expressed in this report are those of the Evaluation Team, and do not necessarily reflect those of the World Food Programme or the United States Department of Agriculture. Responsibility for the opinions expressed in this report rests solely with the authors. Publication of this document does not imply endorsement by WFP of the opinions expressed. The designations employed and the presentation of material in maps do not imply the expression of any opinion whatsoever on the part of WFP concerning the legal or constitutional status of any country, territory or sea area, or concerning the delimitation of frontiers. (i) Mid-Term Evaluation of McGovern-Dole School Feeding in Bangladesh 2014–2017 Evaluation Report (Final) TABLE OF CONTENTS Executive Summary _____________________________________________________________________ vi 1. Introduction ____________________________________________________________________ 1 1.1 Overview of the evaluation ______________________________________________________ 1 1.2 Context ______________________________________________________________________ 2 1.3 Overview of the MGD programme under evaluation _________________________________ 5 1.4 Evaluation methodology and limitations ___________________________________________ 8 2. Evaluation Findings _____________________________________________________________ 12 2.1 Introduction _________________________________________________________________ 12 2.2 How appropriate is the operation? _______________________________________________ 12 2.3 What are the results of the operation? ____________________________________________ 17 2.4 What factors have affected the results? ___________________________________________ 37 2.5 To what extent has sustainability been considered? _________________________________ 45 3. Conclusions and Recommendations ________________________________________________ 49 3.1 Overall Assessment / Conclusions _______________________________________________ 49 3.2 Lessons Learned and Good Practices ____________________________________________ 51 3.3 Recommendations ____________________________________________________________ 52 ANNEXES _____________________________________________________________________________ 56 Annex A Terms of Reference _____________________________________________________________ 57 Annex B McGovern-Dole School Feeding Programme ________________________________________ 74 Introduction _________________________________________________________________________ 74 School Feeding Context ________________________________________________________________ 74 Programme Design ____________________________________________________________________ 76 Annex C Key Findings from Previous Evaluations ____________________________________________ 91 Annex D Maps ________________________________________________________________________ 111 Annex E Methodology __________________________________________________________________ 114 Annex F Evaluation Matrix _____________________________________________________________ 130 Annex G Gender Analysis _______________________________________________________________ 139 Annex H Performance Data _____________________________________________________________ 144 Data sources ________________________________________________________________________ 144 Overall performance data _____________________________________________________________ 145 Utilisation of wheat from the USA and understanding shortfalls in utilisation of HEB ___________ 167 Annex I Evaluation Process _____________________________________________________________ 169 Annex J Supplementary Information _____________________________________________________ 180 Annex K Findings, Conclusions and Recommendations _______________________________________ 194 Annex L Bibliography __________________________________________________________________ 203 Acronyms___________________________________________________________________________ 212 (ii) Mid-Term Evaluation of McGovern-Dole School Feeding in Bangladesh 2014–2017 Evaluation Report (Final) Tables Table 1 MGD Contributions to WFP SF in Bangladesh 2012–2016 ......................................................... 5 Table 2 Summary of MGD Strategic Objectives and Outcomes ................................................................ 6 Table 3 Summary of MGD SFP objectives, activities and partners ........................................................... 6 Table 4 Agreements and Modifications ..................................................................................................... 8 Table 5 Site selection criteria ....................................................................................................................10 Table 6 Number of schools and number of students by upazila, 2016 ......................................................19 Table 7 Number of students (by sex) by school type ................................................................................20 Table 8 Beneficiaries: selected summary data ..........................................................................................20 Table 9 HEB Distribution from 01/10/2014 – 30/09/2016 ........................................................................21 Table 10 Factors affecting HEB utilisation .................................................................................................21 Table 11 Selected activity/output indicators for FY2016 ............................................................................25 Table 12 Food preparation and storage: baseline and follow-up .................................................................26 Table 13 School infrastructure comparison baseline and follow-up ...........................................................28 Table 14 Teaching and learning techniques used by teachers .....................................................................29 Table 15 Attendance Rate (%) 2015 and 2016 ............................................................................................31 Table 16 Validity of ToC Assumptions ......................................................................................................43 Table 17 Recommendations ........................................................................................................................53 Table 18 WFP School Feeding in Bangladesh – location and donors .........................................................74 Table 19 MGD Contributions to WFP SF in Bangladesh 2012 - 2016 .......................................................76 Table 20 Geographical location, implementing partners, types and number of schools .............................76 Table 21 Strategic Objectives and Activities of the MGD-funded SFP ......................................................78 Table 22 Planned Outputs ...........................................................................................................................78 Table 23 Summary of MGD Strategic Objectives and Outcomes ...............................................................79 Table 24 Agreements and Modifications ....................................................................................................80 Table 25 Partners under the MGD-funded SFP in Bangladesh ...................................................................81 Table 26 Summary of WFP Partner FLAs ..................................................................................................81