Timor Leste: an Evaluation of WFP's Portfolio (2008
Total Page：16
File Type：pdf, Size：1020Kb
measuring results, sharing lessons sharing measuring results, COUNTRY PORTFOLIO EVALUATION Timor Leste: An evaluation of WFP’s Portfolio (2008 - 2012) May 2013 Evaluation Report Prepared by Mokoro Limited Stephen Lister, Team Leader Jane Keylock Trish Silkin Commissioned by the WFP Office of Evaluation OE/2013/001 Report number: OE/20XX/XXX Acknowledgements The evaluation team would like to thank all the staff of WFP in Timor-Leste for their unstinting helpfulness. Thanks also to all our many interviewees, and a special mention to Lorraine de Limelette, who joined the inception visit as well as demonstrating mastery of documents and data. We received valuable Quality Support from Chris Tanner (Mokoro) and Stephen Anderson (Food Economy Group), and research support from Zoe Driscoll (Mokoro). Benicia Magno’s support during the field work was invaluable and we missed her wisdom when preparing this report. Disclaimer The opinions expressed are those of the Evaluation Team, and do not necessarily reflect those of the World Food Programme. Responsibility for the opinions expressed in this report rests solely with the authors. Publication of this document does not imply endorsement by WFP of the opinions expressed. The designations employed and the presentation of material in the maps do not imply the expression of any opinion whatsoever on the part of WFP concerning the legal or constitutional status of any country, territory or sea area, or concerning the delimitation of frontiers. Evaluation Management Director, Office of Evaluation: Helen Wedgwood Evaluation Manager: Marian Read, Senior Evaluation Officer Lorraine de Limelette Junior Professional Officer Table of Contents Fact Sheet i Executive Summary ii 1. Introduction 1 1.1 Evaluation Features ________________________________________ 1 1.2 Context _________________________________________________ 2 1.3 WFP's Portfolio ___________________________________________ 8 2. Evaluation Findings 13 2.1 Alignment and Strategic Positioning __________________________ 13 2.2 Making Strategic Choices ___________________________________ 17 2.3 Portfolio Performance and Results ____________________________ 23 3. Conclusions and Recommendations 52 3.1 Overall Assessment _______________________________________ 52 3.2 Wider Lessons from the Evaluation ___________________________ 55 3.3 Recommendations ________________________________________ 56 Annexes 60 Annex I Terms of Reference ________________________________________ 61 Annex II Methodology ____________________________________________ 77 Annex III Evaluation Matrix ________________________________________ 86 Annex IV People Consulted _________________________________________ 93 Annex V Timor-Leste Background Information ___________________________ 99 Annex VI Portfolio Analysis _______________________________________ 105 Annex VII Additional Data on Portfolio Performance _______________________ 114 Annex VIII Gender _____________________________________________ 130 Annex IX The MDG-F Joint Programme _______________________________ 132 Annex X The COMPASIS Joint Programme _____________________________ 133 Annex XI Strategic directions in the PRRO (2008) and CP (2011) ______________ 134 Annex XII DPs’ capacity development experiences in Timor-Leste _____________ 135 Annex XIII The UN Role in Timor-Leste _______________________________ 136 Annex XIV Comoro Declaration: “Putting an end to hunger and malnutrition” _____ 136 Annex XV Concept Note for Transition and Handover of MCHN Responsibilities, ___ 137 Annex XVI Explaining successful capacity development ____________________ 138 Annex XVII Additional Information about Recommendations 3 & 5 ____________ 139 Annex XVIII Bibliography ________________________________________ 140 Acronyms ___________________________________________________ 149 List of Boxes Box 1 Principles for Good International Engagement in Fragile States & Situations ................14 Box 2 Main Evaluation Questions .......................................................................................................... 77 Box 3 Triangulation and Complementarity ......................................................................................... 78 Box 4 A Possible Framework for the Assessment of Capacity ......................................................... 85 Box 5 Fragility and Capacity in Timor-Leste ..................................................................................... 100 Box 6 Goals of the Strategic Development Plan 2011–2030 ........................................................... 101 Box 7 Timor-Leste’s human development ranking in context ........................................................ 101 Box 8 Structure of Health Services ...................................................................................................... 102 Box 9 MCHN – Reported CP implementation status in 2012 ........................................................ 119 Box 10 2012 Joint Rapid Assessment .................................................................................................... 120 Box 11 Timor Vita specification .............................................................................................................. 123 Box 12 Agenda for SISCa review (relates to recommendation 3) ................................................... 139 Box 13 Agenda for strategic review of school feeding (relates to recommendation 5) .............. 139 List of Tables Table 1 Top ten ODA donors 2006–2010 ................................................................................................ 4 Table 2 Timor-Leste international ranking on nutrition indicators ................................................... 6 Table 3 Nutrition indicators in Timor-Leste in 2003 and 2009 ......................................................... 6 Table 4 Timor-Leste Portfolio 2008–2012 by Programme Category................................................. 9 Table 5 Portfolio vs. WFP Strategic Objectives ...................................................................................... 11 Table 6 Beneficiaries in Timor-Leste ....................................................................................................... 12 Table 7 Facilities included in supplementary feeding programme 2008–2012 ............................ 31 Table 8 MCHN: Targeted and Delivered Food, Targeted and Reached Beneficiaries 2008-12 . 36 Table 9 Health Indicators 2003 and 2009/10 ...................................................................................... 38 Table 10 Share of Timor Vita in food distribution for MCHN ........................................................... 42 Table 11 Assessment of capacity development under the Special Operation ................................. 47 Table 12 Planned and actual MCHN training, 2008–2012 ................................................................ 48 Table 13 Assessment of MCHN-related capacity development in MoH .......................................... 49 Table 14 Interviewees and FGDs by affiliation and gender ................................................................ 93 Table 15 List of Interviewees ..................................................................................................................... 93 Table 16 Field Site Visits ............................................................................................................................ 97 Table 17 Health Indicators for Timor-Leste ......................................................................................... 102 Table 18 Trends in childhood mortality ................................................................................................ 103 Table 19 Nutrition indicators in rural and urban settings 2009/2010 .......................................... 103 Table 20Under-5 Nutrition Indicators by District ............................................................................. 103 Table 21 WFP Country Offices by Size Category ................................................................................. 105 Table 22 WFP operations 1999-2012 .................................................................................................... 106 Table 23 Main additional activities supported by grants/trust funds (US$) ............................... 106 Table 24 Timor Leste Portfolio 2008–2012: Financing Sources .................................................... 107 Table 25 Factsheet/Timeline 2008–2012 ............................................................................................ 108 Table 26 Overview of Major Operations ............................................................................................... 109 Table 27 Details of WFP component of MDG-F Joint Programme ................................................. 110 Table 28 Planned Budget for WFP component of MDG-F Joint Programme ............................... 111 Table 29 COMPAS results & resources framework: outputs & activities for WFP component.112 Table 30 MCHN outputs 2008–2012 .................................................................................................... 117 Table 31 Monthly deliveries of Timor Vita from Tim0r Global to WFP ......................................... 121 Table 32 Monthly deliveries of Timor Vita from WFP to MOH stores (July 2010 – Feb 2013) 121 Table 33 School feeding outputs 2008–2011 ...................................................................................... 122 Table 34 Sphere standards for