United Nations Environment Programme
Total Page:16
File Type:pdf, Size:1020Kb
United Nations Environment Programme Terminal Evaluation of UNEP/GEF project on Strengthening the Network of Training Centres for Protected Area Management through Demonstration of a Tested Approach Svetlana Kozlova Mikhail Paltsyn Evaluation Office October 2012 1 Contents Acronyms ......................................................................................................................................................... 5 Executive summary ........................................................................................................................................ 6 I. Evaluation background ............................................................................................................................. 10 1.1. Context................................................................................................................................................ 10 1.2. The project ......................................................................................................................................... 11 1.2.1. Overview ........................................................................................................................................ 11 1.2.2. Project costs and financing ............................................................................................................ 12 1.2.3. Executing arrangements, target groups and main partners ......................................................... 12 1.2.4. Main modifications made in the project design ............................................................................ 13 1.3. Evaluation objectives, scope and methodology ........................................................................... 13 1.3.1. Evaluation purpose, key questions, criteria and timeframe ......................................................... 13 1.3.2. Limitations of the evaluation ......................................................................................................... 15 II. Project performance and impact ............................................................................................................ 15 2.1. Attainment of objectives and planned results ............................................................................... 15 2.1.1. Achievement of outputs and activities .......................................................................................... 15 2.1.2. Relevance ....................................................................................................................................... 16 2.1.3. Effectiveness: achievement of the project goal and of main component objectives ................... 17 2.1.4. Efficiency ........................................................................................................................................ 21 2.1.5. Review of outcomes to impacts (ROtI) .......................................................................................... 22 2.2. Sustainability and catalytic role ....................................................................................................... 25 2.2.1. Socio-political sustainability .......................................................................................................... 25 2.2.2. Financial resources ........................................................................................................................ 26 2.2.3. Institutional framework ................................................................................................................. 27 2.2.4. Environmental sustainability ......................................................................................................... 27 2.2.5. Catalytic role and replication ......................................................................................................... 27 2.3. Processes affecting the attainment of project results .................................................................. 28 2.3.1. Preparation and readiness ............................................................................................................ 28 2.3.2. Implementation approach and adaptive management ................................................................ 29 2.3.3. Stakeholder participation and public awareness .......................................................................... 30 2.3.4. Country ownership and driven-ness .............................................................................................. 31 2.3.5. Financial planning and management ............................................................................................ 31 2.3.6. UNEP supervision and backstopping ............................................................................................. 32 2.3.7. Monitoring and evaluation ............................................................................................................ 32 2 2.4. Complementarities with UNEP programmes and strategies ...................................................... 33 III. Conclusions, lessons learned and recommendations ....................................................................... 34 3.1. Conclusions........................................................................................................................................ 34 3.2. Lessons learned ................................................................................................................................ 37 3.3. Recommendations ............................................................................................................................ 40 Annex 1. Glossary of terms ......................................................................................................................... 42 Annex 2. Stakeholder analysis ................................................................................................................... 43 Annex 3. Original project indicators ........................................................................................................... 45 Annex 4. Lograme (version 2007) .............................................................................................................. 47 Annex 5. The review of the project design ................................................................................................ 50 Annex 6. Logframe revised by the evaluation consultants ..................................................................... 58 Annex 7. The list of the documents available for the Terminal Evaluation .......................................... 63 Annex 8. Evaluation methodology .............................................................................................................. 66 Annex 9. The evolution of the project outcomes ...................................................................................... 72 Annex 10. Limitations of the evaluation..................................................................................................... 75 Annex 11. Project outputs and immediate outcomes delivery analysis ............................................... 76 Annex 12. Stakeholder participation and public awareness analysis ................................................... 89 Annex 13. Country ownership and driven-ness analysis ........................................................................ 90 Annex 14. UNEP supervision and backstopping analysis ...................................................................... 91 Annex 15. Monitoring and evaluation framework analysis ..................................................................... 92 Annex 16. Criteria to the overall evaluation ratings table ....................................................................... 93 Annex 17. Results rating of the UNEP project ......................................................................................... 95 Annex 18. Evaluation TOR .......................................................................................................................... 96 Annex 19. Country mission schedule ...................................................................................................... 131 Annex 20. List of people interviewed during the country mission ....................................................... 133 Annex 21. List of people for the distribution of the First Draft Report ................................................. 138 Annex 22. CVs of the evaluation consultants ......................................................................................... 139 3 Acknowledgements The Team Leader, Mrs. Svetlana Kozlova, thanks the Supporting Consultant, Mr. Mikhail Paltsyn, who has contributed extensively to writing the Inception Report, to the Evaluation Mission and to the preparation of the Evaluation Report. The evaluation team thanks Carla DeGregorio and Sylvana Rudith King, UNEP Evaluation Office, Nairobi, for effective supervision of the evaluation work, valuable advices on evaluation process, for the documents they provided, and for their careful review of Evaluation Report submissions. The evaluation team especially thanks John R. Mathiason, the Managing Director of Associates for International Management Services (AIMS), Visiting Lecturer at the Cornell Institute for Public Affairs (CIPA) of Cornell University, and Adjunct Professor at the College of Environmental Sciences and Forestry of the State University of New York, for his consultations during the writing