Decentralized Evaluation Evidence Decentralized For
Total Page:16
File Type:pdf, Size:1020Kb
BASED MAKING DECISION - DECENTRALIZED EVALUATIONDECENTRALIZED EVIDENCE FOR Decentralized Evaluation MID-TERM EVALUATION OF ZAMBIA COUNTRY PROGRAMME 200891 2016-2020 Final Evaluation Report EvaluationJuly 2018 Report Prep WFP Zambia Evaluation Manager, Jennifer Sakwiya Prepared by Catherine Longley, Team Leader Sithabiso Gandure, International Evaluator Abraham Chilemu Ngombe, National Researcher Nathan Horst, Evaluation Manager (The KonTerra Group) Acknowledgements The Evaluation Team is very grateful to the WFP Country Office in Zambia as well as the Regional Bureau in Johannesburg (RBJ) for the support provided throughout the evaluation. In particular, we thank the many respondents from Government departments, non-governmental organisations, the private sector and donor agencies who provided inputs into this evaluation. We are particularly indebted to the beneficiaries at community and school levels (the Parent Teacher Association executive members, teachers, parents, boys and girls) who took based decision making time to talk to us and answer our many questions. We also wish to thank the three Field Assistants: Angela Chile, - Francis Mbusopo, and Samuel Greshan Banda. Disclaimer The opinions expressed in this report are those of the Evaluation Team, and do not necessarily reflect those of the World Food Programme. Responsibility for the opinions expressed in this report rests solely with the authors. Publication of this document does not imply endorsement by WFP of the opinions expressed. The designation employed and the presentation of material in maps do no imply the expression of any opinion whatsoever on the part of WFP concerning the legal or constitutional status of any country, territory or sea area, or concerning the delimitation of frontiers. Decentralized evaluation for evidence for evaluation Decentralized MID-TERM EVALUATION OF ZAMBIA COUNTRY PROGRAMME 200891 (2016-2020) i Table of Contents Executive Summary ................................................................................................................................................ vii Context ……………………………………………………………………………………………………………………………………….………….vii Methodology………………………………………………………………………………………………………………………….……………….vii Key findings…………………………………………………………………………………………………………………………………………….vii Overall conclusions………………………………………………………………………………………………………………………………....x Recommendations………………………………………………………………………………………………………………………………….xi Introduction ...................................................................................................................................................... 1 1.1. Overview of the Evaluation Subject ................................................................................................................... 1 1.2. Context .................................................................................................................................................................. 3 1.3. Evaluation Methodology and Limitations ......................................................................................................... 6 Evaluation Findings .......................................................................................................................................... 7 2.1. Relevance / Appropriateness (EQs 1-5, Annex 8) ............................................................................................. 7 2.2. Effectiveness (EQs 6-10, Annex 8) .................................................................................................................... 11 2.3. Efficiency (EQs 11-16, Annex 8) ........................................................................................................................ 25 2.4. Sustainability (EQs 17-18, Annex 8) ................................................................................................................. 32 Conclusions and Recommendations ............................................................................................................ 36 3.1. Overall Assessment/Conclusions ..................................................................................................................... 36 3.2. Recommendations ............................................................................................................................................. 37 Annex 1 Terms of Reference ....................................................................................................................... 44 Annex 2 Stakeholders interviewed ............................................................................................................ 89 Annex 3 Maps indicating CP components ................................................................................................. 93 Annex 4 Details of the Evaluation Subject ................................................................................................ 95 Annex 5 Beneficiaries and Outputs ........................................................................................................... 99 Annex 6 Outcome Indicators for the Evaluation Period ........................................................................ 104 Annex 7 Financial Resources ……………………………………………………………………………………………..……… 108 Annex 8 Evaluation Matrix ........................................................................................................................ 110 Annex 9 Documents Reviewed ................................................................................................................. 121 Annex 10 Methodology and Field Schedule .............................................................................................. 134 Annex 11 Maps to illustrate CP targeting .................................................................................................. 137 Annex 12 HGSM costings supplied by CO .................................................................................................. 138 Annex 13 Bibliography ................................................................................................................................. 139 List of Acronyms ................................................................................................................................................... 141 MID-TERM EVALUATION OF ZAMBIA COUNTRY PROGRAMME 200891 (2016-2020) ii List of Tables Table 1: CP 200891: Key features at design stage .............................................................................................................. 2 Table 2: Planned and Actual Budgets, 2016-2017 .............................................................................................................. 2 Table 3: WFP recommended nutritional values of rations for half-day schools ........................................................... 12 Table 4: Zambia HGSM costings ......................................................................................................................................... 26 Table 5: Procurement cost comparison for standard school meal delivery vs Maano school feeding delivery ...... 28 Table 6: Overview of the Country Programme: Summary Activities, Key Outputs and Outcomes ............................ 97 Table 7: HGSM Beneficiary Data for Evaluation Period by Activity ................................................................................ 99 Table 8: HGSM Commodity Distributions for Evaluation Period .................................................................................... 99 Table 9: Resilience Beneficiary Data for Evaluation Period (Jan 2016 – Dec 2017) ....................................................... 99 Table 10 Output indicators for HGSM, Nutrition and Resilience Building ................................................................... 100 Table 11: Gender indicators .............................................................................................................................................. 102 Table 12: Partnership Indicators ...................................................................................................................................... 102 Table 13: Outcome Level Indicators for Component 1 - HGSM .................................................................................... 104 Table 14: Outcome Level Indicators for Component 2 –Nutrition ............................................................................... 105 Table 15: Outcome Level Indicators for Component 3 - Resilience Building .............................................................. 105 Table 16: SUN Business Network: Progress against Outputs/Outcomes .................................................................... 107 Table 17: Planned budget and actual amounts received (2016-2017) ........................................................................ 108 Table 18: Summarized mission schedule ........................................................................................................................ 135 Table 19: HGSM budget requirements for 2018 (based on 1.5 million children) ....................................................... 138 List of Figures Figure 1: HGSM - Enrolment outcomes ............................................................................................................................. 13 Figure 2: HGSM – Local food purchases ............................................................................................................................ 15 Figure 3: Livelihood Coping