Mid-Term Review UNDP/GEF Improving Coverage and Management Effectiveness of Marine and Coastal Protected Areas Project PIMS 4225 GEF ID:3997 Albania Peter Whalley October 2014 Contents Acknowledgements ................................................................................................................................ iii Acronyms and Abbreviations ................................................................................................................. iv Executive Summary ................................................................................................................................. v 1 Introduction .................................................................................................................................... 1 1.1 Purpose of the evaluation ....................................................................................................... 1 1.2 Scope and methodology ......................................................................................................... 1 1.3 Structure of the evaluation report .......................................................................................... 2 2 Project description and development context ............................................................................... 3 2.1 Project Start and duration ...................................................................................................... 3 2.2 The Project .............................................................................................................................. 3 2.2.1 Objectives of the project ................................................................................................. 5 2.2.2 Main Components and Outputs ...................................................................................... 5 2.2.3 Baseline indicators .......................................................................................................... 5 2.2.4 Project Budget ................................................................................................................. 6 2.3 Main stakeholders................................................................................................................... 6 2.4 Expected results ...................................................................................................................... 6 3 Findings ........................................................................................................................................... 7 3.1 Project design .......................................................................................................................... 7 3.1.1 Project M&E design ......................................................................................................... 7 3.1.2 Assumptions and risks ..................................................................................................... 8 3.1.3 Lessons from other relevant projects incorporated into the project design .................. 8 3.1.4 Planned stakeholder participation .................................................................................. 8 3.1.5 Replication approach ...................................................................................................... 8 3.1.6 UNDP comparative advantage ........................................................................................ 8 3.1.7 Linkages between project and other interventions within the sector ........................... 8 3.1.8 Management arrangements ........................................................................................... 9 3.2 Project implementation .......................................................................................................... 9 3.2.1 Adaptive management .................................................................................................. 10 3.2.2 Partnership arrangements ............................................................................................ 10 3.2.3 Feedback from the M&E activities and adaptive management ................................... 10 3.2.4 Project Finance .............................................................................................................. 11 3.2.5 Monitoring and evaluation ........................................................................................... 12 3.2.6 UNDP Implementation .................................................................................................. 12 3.2.7 Ministry of Environment Execution .............................................................................. 12 i 3.3 Project results ....................................................................................................................... 13 3.3.1 Overall results (attainment of objectives) .................................................................... 13 3.3.2 Relevance ...................................................................................................................... 17 3.3.3 Effectiveness ................................................................................................................. 17 3.3.4 Efficiency ....................................................................................................................... 18 3.3.5 Country ownership ........................................................................................................ 19 3.3.6 Mainstreaming .............................................................................................................. 19 3.3.7 Sustainability ................................................................................................................. 19 3.3.8 Communication ............................................................................................................. 21 3.3.9 Impact ........................................................................................................................... 21 4 Conclusions, Ratings, Recommendations and Lessons ................................................................. 22 4.1 Overall Conclusions ............................................................................................................... 22 4.2 MTE Ratings .......................................................................................................................... 22 4.3 Recommendations ................................................................................................................ 23 4.3.1 Corrective actions for the design, implementation and M&E of the project ............... 23 4.3.2 Actions to follow-up or reinforce initial benefits from the project .............................. 24 4.3.3 Proposals for future directions underlining main objectives ........................................ 24 4.4 Best and worst practices in addressing issues relating to relevance, performance and success .............................................................................................................................................. 25 Annexes ................................................................................................................................................. 27 Annex 1 - Mid Term Evaluation Terms of Reference ............................................................................ 28 Annex 2 – Documents reviewed ........................................................................................................... 46 Annex 3 - Inception Report ................................................................................................................... 47 Annex 4 – Persons Met ......................................................................................................................... 65 Annex 5 - Financial data ........................................................................................................................ 66 Annex 6 - Evaluation Consultant Code of Conduct and Agreement Form............................................ 67 ii Acknowledgements This independent Mid-Term Evaluation has been prepared by Dr Peter Whalley. The views expressed and comments made are his own. He would like to express his gratitude to all those who have assisted during the mission by offering their time to present their perspective on the Project’s activities and performance. In particular, he would like to thank Ms Violeta Zuna (Project Manager), Mr Eno Dodbiba (Project Expert) and Ms Ema Moci (Administration / Financial) from the Project Co-ordination Unit for their assistance in organising and facilitating the mid-term evaluation mission. iii Acronyms and Abbreviations BD Biodiversity (GEF Focal Area) CBD Convention on Biodiversity CEO (GEF) Chief Executive Officer EA Executing Agency (MoE) EU European Union GEF Global Environment Facility ha Hectare IA Implementing Agency (UNDP) IW International Waters (GEF Focal Area) M&E Monitoring and Evaluation MCPA Marine and Coastal Protected Area METT Management and Effectiveness Tracking Tool MoE Ministry of Environment MoU Memorandum of Understanding MPA Marine Protected Area MTE Mid-Term Evaluation NGO Non-Governmental Organisations NIM National Implementation PA Protected Area PCU Programme Co-ordination Unit PIR Project Implementation Review ProDoc Project Document PSC Project Steering Committee (Project Board) SMART Specific, Measurable, Achievable, Relevant and Time-bound (targets) SP Strategic Programme (GEF) ToR Terms of Reference UNDP United Nations Development