\\` Strategic Evaluation of Funding Wfp’s Work Evaluation Report – Volume II Annexes Commissioned by the WFP Office of Evaluation 10 April 2020 Acknowledgements The evaluation team would like to express gratitude to the myriad stakeholders that contributed of their time and knowledge to inform this evaluation report. The Office of Evaluation provided dedicated support to the team throughout the evaluation, most notably from the Evaluation Manager, Michael Reynolds and Evaluation Analysts, Enrico Piano and Lia Carboni. A wide array of divisions and departments at headquarters provided important access to information and data throughout the evaluation. The many World Food Programme offices visited graciously hosted the evaluation team and provided documents, access to key stakeholders and other important support to inform the evaluation. The Internal Reference Group provided insightful feedback on drafts to improve this report. Disclaimer The opinions expressed are those of the evaluation team, and do not necessarily reflect those of the World Food Programme. Responsibility for the opinions expressed in this evaluation report rests solely with the authors. Publication of this document does not imply endorsement by WFP of the opinions expressed. The designation employed and the presentation of material in the maps do not imply the expression of any opinion whatsoever on the part of WFP concerning the legal or constitutional status of any country, territory or sea area, or concerning the delimitation of frontiers. April 2020 | OEV/2019/018 Key Personnel for the Evaluation Office of Evaluation Andrea Cook Director of Evaluation Michael Reynolds Evaluation Manager Enrico Piano Evaluation Analyst Lia Carboni Evaluation Analyst Avenir Analytics evaluation team Brian Majewski Team Leader Charlotte Lattimer Senior Evaluator Anton Bilaver Senior Evaluator Rob Tew Senior Evaluator Dima Hatuqa Evaluator Paule Herodote Evaluator Niklas Rieger Senior Analyst Hannah Watson Data Analyst Hetty van Doorn Expert Adviser April 2020 | OEV/2019/018 Contents Annex 1: Terms of Reference ...................................................................................................................................... 1 Annex 2: People Met and Interviewed ..................................................................................................................... 25 Annex 3: Bibliography ................................................................................................................................................ 41 Annex 4: WFP Reporting Platforms ........................................................................................................................... 48 Annex 5: Detailed Conceptual Framework .............................................................................................................. 49 Annex 6: Glossary of Terms ....................................................................................................................................... 55 Annex 7: Evaluation Matrix ........................................................................................................................................ 68 Annex 8: Methodology ............................................................................................................................................... 80 Annex 9: Comparative Study ..................................................................................................................................... 89 Annex 10: Final Field Work Schedule ........................................................................................................................ 97 Annex 11: Analysis of Headquarters’ Programme Support and Administrative Budget ................................... 98 Annex 12: Mapping of Findings, Conclusions and Recommendations .............................................................. 100 Annex 13: Evaluation Team Roles and Responsibilities ....................................................................................... 112 Acronyms ................................................................................................................................................................... 116 Photo Credit ............................................................................................................................................................... 117 April 2020 | OEV/2019/018 Annex 1: Terms of Reference EVALUATION QUALITY ASSURANCE SYSTEM Office of Evaluation Measuring Results, Sharing Lessons TERMS OF REFERENCE STRATEGIC EVALUATION OF FUNDING WFP’S WORK TABLE OF CONTENTS 1. Background .............................................................................................................................................. 2 1.1. Introduction .......................................................................................................................................... 2 1.2. SDG Funding Context and Strategy ................................................................................................... 2 1.3. WFP Funding Context .......................................................................................................................... 3 2. Reasons for the Evaluation ................................................................................................................... 6 2.1. Rationale ............................................................................................................................................... 6 2.2. Objectives .............................................................................................................................................. 7 2.3. Stakeholders and Users of the Evaluation ....................................................................................... 7 3. Subject of the Evaluation ....................................................................................................................... 8 3.1. Strategic and Policy Framework ......................................................................................................... 8 3.2. Overview of Relevant WFP Activities ................................................................................................. 9 3.3. Scope of the Evaluation ..................................................................................................................... 11 4. Evaluation Approach, Questions and Methodology ......................................................................... 11 4.1. Overview of Evaluation Approach ................................................................................................... 12 4.2. Evaluability Assessment .................................................................................................................... 12 4.3. Evaluation Questions ......................................................................................................................... 12 4.4. Methodology ....................................................................................................................................... 14 4.5. Quality Assurance .............................................................................................................................. 15 5. Organization of the Evaluation ............................................................................................................ 15 5.1. Phases and Deliverables ................................................................................................................... 15 5.2. OEV Roles and Responsibilities ........................................................................................................ 16 5.3. Evaluation Team Composition ......................................................................................................... 16 5.4. WFP Roles and Responsibilities ........................................................................................................ 17 5.5. Evaluation Governance ..................................................................................................................... 17 5.6. Communication .................................................................................................................................. 18 5.7. Budget ................................................................................................................................................. 18 Annexes ...................................................................................................................................................... 47 April 2020 | OEV/2019/018 1 1. Background 1.1. Introduction 1. Strategic Evaluations focus on strategic and systemic issues of corporate relevance, including new WFP strategic directions and the associated policy, operations and activities. They evaluate the quality of work being done in relation to the new strategic direction as well as its results and seek to explain why and how these results occurred. 2. The Terms of Reference (ToR) were prepared by the WFP Office of Evaluation (OEV) evaluation manager, Michael Reynolds, Senior Evaluation Advisor, based on a document review and discussions with stakeholders. The purpose of the ToR is to provide key information to stakeholders about the proposed evaluation, to guide the evaluation team and specify expectations that the evaluation team should fulfil. The ToR are also used as the basis for consulting companies to prepare proposals for undertaking