Project Terminal Evaluation UNDP-supported, GEF -funded Project ‘Improving the Financial Sustainability of the Carpathian System of Protected Areas’ Romania GEF Project ID: 3849 UNDP PIMS ID: 3458 Designated Institution: Ministry of Environment and Climate Change Implementing Partner: National Forest Administration ‘Romsilva’ Focal Area: Biodiversity (GEF 4) Operational Programme: Financial sustainability August 2014 Evaluator Michael R Appleton Contents Acknowledgements ............................................................................................................................................... 3 Acronyms and abbreviations used in the text ....................................................................................................... 4 Executive summary............................................................................................................................................... 5 Project summary and description ...................................................................................................................... 5 Evaluation results .............................................................................................................................................. 6 Summary of conclusions, recommendations and lessons ................................................................................. 6 Medium to long term recommendations for future directions underlining main objectives ............................. 9 ‘Lessons learned’ from addressing issues relating to relevance, performance and success ........................... 10 1 Introduction ................................................................................................................................................ 11 1.1 Purpose of the evaluation .................................................................................................................... 11 1.2 Scope and methodology ...................................................................................................................... 11 1.3 Structure of the evaluation report ....................................................................................................... 12 2 Project description and development context ............................................................................................. 12 2.1 Project start and duration .................................................................................................................... 12 2.2 Context ................................................................................................................................................ 12 2.3 Problems that the project sought to address ........................................................................................ 13 2.4 Overall objective of the project ........................................................................................................... 14 2.5 Main stakeholders ............................................................................................................................... 14 2.6 Overall approach ................................................................................................................................. 16 2.7 Expected results and indicators ........................................................................................................... 16 3 Findings ...................................................................................................................................................... 17 3.1 Project design/formulation .................................................................................................................. 17 3.1.1 Analysis of logical framework/results framework ...................................................................... 17 3.1.2 Assumptions and risks ................................................................................................................ 18 3.1.3 Lessons from other relevant projects (e. g. same focal area) incorporated into project design .. 19 3.1.4 Planned stakeholder participation ............................................................................................... 20 3.1.5 Replication approach .................................................................................................................. 20 3.1.6 UNDP comparative advantage .................................................................................................... 20 3.1.7 Linkages between project and other interventions within the sector .......................................... 20 3.1.8 Management arrangements ......................................................................................................... 21 3.2 Project Implementation ....................................................................................................................... 21 3.2.1 Implementation context .............................................................................................................. 21 3.2.2 Partnership arrangements with stakeholders ............................................................................... 22 3.2.3 Monitoring and evaluation .......................................................................................................... 22 3.2.4 Project Finance ........................................................................................................................... 25 3.2.5 Implementation by UNDP and implementation partners ............................................................ 28 3.3 Project Results .................................................................................................................................... 31 3.3.1 Evaluation of achievement of the Project Objective ................................................................... 31 3.3.2 Evaluation of Outcome 1. ........................................................................................................... 36 Terminal Evaluation: Improving the Financial Sustainability of the Carpathian System of Protected Areas 2 3.3.3 Evaluation of Outcome 2 ............................................................................................................ 48 3.4 Summary assessment based on UNDP evaluation criteria ................................................................. 52 3.4.1 Relevance .................................................................................................................................... 52 3.4.2 Effectiveness ............................................................................................................................... 52 3.4.3 Efficiency .................................................................................................................................... 52 3.4.4 Country ownership ...................................................................................................................... 53 3.4.5 Mainstreaming ............................................................................................................................ 53 3.4.6 Sustainability .............................................................................................................................. 53 3.4.7 Impact ......................................................................................................................................... 54 4 Conclusions, recommendations & lessons .................................................................................................. 55 4.1 Summary and overall evaluation ........................................................................................................ 55 4.2 Recommendations for short term measures to follow up/reinforce initial benefits from the project . 56 4.3 Medium to long term recommendations for future directions underlining main objectives ............... 57 4.4 ‘Lessons learned’ from addressing issues relating to relevance, performance and success ............... 57 Annexes .............................................................................................................................................................. 59 Annexe 1 Terms of reference ...................................................................................................................... 59 Annexe 2 Itinerary ....................................................................................................................................... 59 Annexe 3 List of persons consulted ............................................................................................................ 59 Annexe 4 List of documents reviewed ........................................................................................................ 61 Annexe 5 Evaluation Question Matrix ........................................................................................................ 62 Annexe 6 Questionnaire used and summary of results ............................................................................... 64 Annexe 7 Evaluation ratings table............................................................................................................... 69 Annexe 8 Evaluation Consultant Agreement Form..................................................................................... 72 Acknowledgements The author thanks all those consulted in the course of the evaluation process for their helpful responses and constructive contributions. Particular thanks