Mid-Term Evaluation of the FAO-EU FLEGT Programme, Phase III
Total Page:16
File Type:pdf, Size:1020Kb
Project evaluation series Mid-term evaluation of the FAO-EU FLEGT Programme, phase III PROJECT EVALUATION SERIES Mid-term evaluation of the FAO-EU FLEGT Programme, phase III FOOD AND AGRICULTURE ORGANIZATION OF THE UNITED NATIONS Rome, 2019 Required citation: FAO. 2019. Mid-term evaluation of the FAO-EU FLEGT Programme, phase III. Rome. The designations employed and the presentation of material in this information product do not imply the expression of any opinion whatsoever on the part of the Food and Agriculture Organization of the United Nations (FAO) concerning the legal or development status of any country, territory, city or area or of its authorities, or concerning the delimitation of its frontiers or boundaries. The mention of specific companies or products of manufacturers, whether or not these have been patented, does not imply that these have been endorsed or recommended by FAO in preference to others of a similar nature that are not mentioned. The views expressed in this information product are those of the author(s) and do not necessarily reflect the views or policies of FAO. © FAO, 2019 Some rights reserved. This work is made available under the Creative Commons Attribution- NonCommercial-ShareAlike 3.0 IGO licence (CC BY-NC-SA 3.0 IGO; https://creativecommons.org/ licenses/by-nc-sa/3.0/igo/legalcode/legalcode). Under the terms of this licence, this work may be copied, redistributed and adapted for non-commercial purposes, provided that the work is appropriately cited. In any use of this work, there should be no suggestion that FAO endorses any specific organization, products or services. The use of the FAO logo is not permitted. If the work is adapted, then it must be licensed under the same or equivalent Creative Commons licence. If a translation of this work is created, it must include the following disclaimer along with the required citation: “This translation was not created by the Food and Agriculture Organization of the United Nations (FAO). FAO is not responsible for the content or accuracy of this translation. The original [Language] edition shall be the authoritative edition.” Disputes arising under the licence that cannot be settled amicably will be resolved by mediation and arbitration as described in Article 8 of the licence except as otherwise provided herein. The applicable mediation rules will be the mediation rules of the World Intellectual Property Organization http:// www.wipo.int/amc/en/mediation/rules and any arbitration will be conducted in accordance with the Arbitration Rules of the United Nations Commission on International Trade Law (UNCITRAL). Third-party materials. Users wishing to reuse material from this work that is attributed to a third party, such as tables, figures or images, are responsible for determining whether permission is needed for that reuse and for obtaining permission from the copyright holder. The risk of claims resulting from infringement of any third-party-owned component in the work rests solely with the user. Sales, rights and licensing. FAO information products are available on the FAO website (www.fao. org/publications) and can be purchased through [email protected]. Requests for commercial use should be submitted via: www.fao.org/contact-us/licence-request. Queries regarding rights and licensing should be submitted to: [email protected]. Cover photo credits (top to bottom): ©FAO/H. Null, ©FAO/Sean Gallagher, ©FAO/Giulio Napolitano, ©FAO/Sean Gallagher, ©FAO Contents Acknowledgements ...................................................................................................................................................... v Acronyms and abbreviations .................................................................................................................................. vi Executive summary ................................................................................................................................................... vii 1. Introduction........................................................................................................................... 1 1.1 Purpose of the evaluation ........................................................................................................................1 1.2 Intended users ..............................................................................................................................................1 1.3 Scope and objective of the evaluation ................................................................................................1 1.4 Methodology .................................................................................................................................................2 1.5 Structure of the report ...............................................................................................................................4 2. Background and context of the project ............................................................................ 5 2.1 Context of the Programme ......................................................................................................................5 2.2 Theory of Change ........................................................................................................................................8 3. Evaluation questions: key findings .................................................................................. 11 3.1 Evaluation Question 1: Relevance ...................................................................................................... 11 3.2 Evaluation Question 2: Design............................................................................................................. 13 3.3 Evaluation Question 3: Communication .......................................................................................... 14 3.4 Evaluation Question 4: Partnerships? ............................................................................................... 17 3.5 Evaluation Question 5: Comparative advantage 3.6 Evaluation Question 6: Efficiency ........................................................................................................ 20 3.7 Evaluation Question 7: Effectiveness ................................................................................................. 22 3.7.1 Outcome 1: Support to VPA Countries....................................................................................... 23 3.7.2 Outcome 2: Support to non-VPA countries.............................................................................. 25 3.7.3 Outcome 3: Increasing the capacity of the private sector, particularly micro, small and medium enterprises .............................................................................................................................. 27 3.7.4 Outcome 4: Communication and knowledge management .............................................. 29 3.7.5 Outcome 5: Impact monitoring ..................................................................................................... 31 3.8 Evaluation Question 8: Sustainability ................................................................................................ 32 3.9 Evaluation Question 9: Impact ............................................................................................................. 33 3.10 Evaluation Question 10: Gender ......................................................................................................... 35 4. Conclusions and recommendations ................................................................................. 39 4.1 Conclusions ................................................................................................................................................. 39 4.2 Recommendations ................................................................................................................................... 40 Appendix. List of people interviewed ...................................................................................... 43 iii Mid-term Evaluation of the FAO-EU FLEGT Programme, Phase III Figures and tables Figures Figure 1: Programme level Theory of Change for Phase III ................................................................... 9 Figure 2: Theory of change – example from the Philippines .............................................................. 10 Figure 3: Analysis of cost-drivers of Phase II and Phase III of FAO-EU FLEGT Programme ....... 22 Tables Table 1: List of countries supported by Phase III of the FAO-EU FLEGT Programme .................... 6 iv Mid-term Evaluation of the FAO-EU FLEGT Programme, Phase III Acknowledgements The FAO Office of Evaluation (OED) would like to thank the FAO-EU FLEGT Programme team, who were able to facilitate field visits, team meetings and constant requests for information, reports and documentation. The evaluation was managed by Ahmedou Ould Abdallahi from the FAO Office of Evaluation; the evaluation team was composed of Tom Blomley (Team Leader), James Gasana and Abidah Setyowati. Particular thanks go to Bob Simpson (former programme manager), Marc Vandenhaute (acting programme manager) and Daphne Hewitt (private sector support). At the regional and country level, the Office wishes to thank FAO staff for organizing and hosting field visits, with special thanks to Bruno Cammaert, Jhongsathit Aungvitayatorn, Josil Murray, Erica Pohnan, Karl Villegas, Sarah Fumey, Godwin Codjoe, Guillermo Navarro and Nhaydu Bohorques. Finally,