Decentralized Evaluation for Evaluation Evidence Decentralized
Total Page:16
File Type:pdf, Size:1020Kb
based based decision making - Decentralized evaluation for evaluation evidence Decentralized Decentralized Evaluation USDA McGovern Dole Food for Education Program in Nepal 2014-2017 End-line Evaluation Report April 2019 Nepal Country Office Evaluation Manager- Kanta Khanal Prepared by Sambodhi Research and Communications Pvt. Ltd Narma Consulting Pvt. Ltd Acknowledgements The “Endline Evaluation for USDA Supported McGovern Dole Food for Education Programme 2014-2017” has been conducted by Sambodhi Research & Communications Pvt. Ltd in partnership with NARMA consulting Pvt. Ltd. We are grateful to World Food Programme Country Office, Nepal who provided us with the necessary funds and technical support to carry out the study successfully. This report has also been greatly benefited by the guidance provided by WFP’s Monitoring and Evaluation and programme team. Their dedication and valuable guidance is highly appreciated. Special thanks to the implementing partners, government partners and development partners of WFP who took time to meet with us and contributed with valuable insights into Nepal development context, especially education. The evaluation would not be possible without the tremendous effort of our research team who did an excellent job in interviewing all key officials and collecting the required information and meeting our deadlines. We are grateful to the students, school staff and parents who spoke with us despite their busy schedule. FY14 Endline Evaluation Report i | P a g e Disclaimer The opinions expressed in this report are those of the Evaluation Team, and do not necessarily reflect those of the World Food Programme. Responsibility for the opinions expressed in this report rests solely with the authors. Publication of this document does not imply endorsement by WFP of the opinions expressed. The designation employed and the presentation of material in maps do no imply the expression of any opinion whatsoever on the part of WFP concerning the legal or constitutional status of any country, territory or sea area, or concerning the delimitation of frontiers. FY14 Endline Evaluation Report ii | P a g e Table of Contents Acknowledgements ................................................................................................................. i Disclaimer .............................................................................................................................. ii Table of Figures ...................................................................................................................... iv List of Tables .......................................................................................................................... iv Executive Summary ................................................................................................................ 1 Key Findings ....................................................................................................................................................... 1 Conclusion ......................................................................................................................................................... 3 Recommendations ............................................................................................................................................ 3 1. Introduction .................................................................................................................... 4 1.1 Overview of the Evaluation Subject ............................................................................................................ 4 1.2 Context .......................................................................................................................................................... 7 1.3 Evaluation Methodology and Limitations ................................................................................................. 9 2. Evaluation Findings........................................................................................................... 11 2.1 Relevance: How appropriate is the operation? ........................................................................................ 12 2.2 Effectiveness and Impact: What are the Output Outcome and Impact of the intervention? ................ 15 2.3 Efficiency: What is the cost benefit of the programmes implemented? ................................................. 31 2.4 Sustainability: To what extent does the intervention’s implementation strategy include considerations for sustainability? .................................................................................................................. 35 3. Conclusions and Recommendations .................................................................................. 37 3.1 Conclusions................................................................................................................................................. 37 3.2 Recommendations .................................................................................................................................... 39 Annexures ............................................................................................................................ 42 Annex 1: Terms of Reference ................................................................................................ 43 Annex 2 : Stakeholder Mapping ........................................................................................... 64 Annex 3: Map of Project Districts ......................................................................................... 68 Annex 4: Results framework ................................................................................................. 71 Annex 5: Evaluation Matrix ................................................................................................... 74 Annex 6: Evaluation Criteria and Areas of Enquiry............................................................... 78 Annex 7: Data Collection Tools and Methods ....................................................................... 80 Annex 8: Sampling Strategy .................................................................................................. 81 Annex 9: EGRA Methodology ............................................................................................... 83 Annex 10: Performance Indicators for Evaluation of FY14- Comparative estimates for baseline 2015 and endline 2018 ............................................................................................ 86 Annex 12: Documents Gathered and Reviewed .................................................................... 88 Annex 13: List of Sampled Schools, VDC and Districts ......................................................... 89 Annex 14: Data Collection Tools ........................................................................................... 98 Annex 15: Bibliography ........................................................................................................ 98 List of Acronyms ................................................................................................................. 100 FY14 Endline Evaluation Report iii | P a g e Table of Figures Figure 1: Caste Category of Respondents ........................................................................................................... 13 Figure 2: Sources of Information on SMP .......................................................................................................... 16 Figure 3: Availability of resources for cooking School Meals ............................................................................ 17 Figure 4: Sub-task Mean Score by programme combination ........................................................................... 22 Figure 5: Overall EGRA Score ............................................................................................................................ 22 Figure 6:Teaching aids used by teachers during classroom session ................................................................ 23 Figure 7: Type of lesson taught .......................................................................................................................... 24 Figure 8: Teachers interaction with the student ............................................................................................... 25 Figure 9:Students identified as inattentive by teachers.................................................................................... 25 Figure 10: Student Attentiveness ....................................................................................................................... 26 Figure 11: Dietary Diversity Status of Students .................................................................................................. 27 Figure 12: Dietary Practices of Students ............................................................................................................. 27 Figure 13: Exploring Gender Perspective ........................................................................................................... 31 List of Tables Table 1: SMP Beneficiaries as planned ................................................................................................................ 6 Table 2: Number of Project Schools by District .................................................................................................. 6 Table 3: Knowledge on Food preparation and Safety Practices