Outcome Evaluation of Barcelona Convention/ United Nations Environment Programme - Mediterranean Action Plan (UNEP - MAP) Five Year Programme of Work 2010-2014
Total Page:16
File Type:pdf, Size:1020Kb
Outcome Evaluation of Barcelona Convention/ United Nations Environment Programme - Mediterranean Action Plan (UNEP - MAP) Five Year Programme of Work 2010-2014 Sarah Humphrey and Sarah Lucas Evaluation Office March 2015 Contents Contents ................................................................................................................................................ i Acronyms and Abbreviations .............................................................................................................. iii Executive Summary ............................................................................................................................... 1 1. Introduction ....................................................................................................................................... 5 2. The Evaluation................................................................................................................................... 6 3. The Programme ................................................................................................................................. 8 3.1. Context ............................................................................................................................................. 8 3.2. Objectives and Components ............................................................................................................ 9 3.3. Target Areas/Groups ...................................................................................................................... 10 3.4. Milestones/Key dates in Programme Design and Implementation ................................................ 10 3.5. Implementation Arrangements ....................................................................................................... 11 3.6. Programme Financing .................................................................................................................... 12 3.7. Programme Partners ...................................................................................................................... 12 3.8. Changes in Design during Implementation .................................................................................... 13 3.9. Reconstructed Theory of Change of the Programme .................................................................... 13 4. Evaluation Findings ........................................................................................................................ 15 4.1. Strategic Relevance ....................................................................................................................... 15 4.2. Achievement of Outputs ................................................................................................................. 18 4.2.1. Description of Delivery ................................................................................................... 18 4.2.2. Perceptions of Performance ........................................................................................... 29 4.2.3. Reflections on Delivery .................................................................................................. 30 4.3. Effectiveness: Attainment of Programme Objectives and Results ................................................. 31 4.3.1. Direct outcomes from reconstructed ToC ...................................................................... 33 4.3.2. Likelihood of impact based on reconstructed ToC ......................................................... 38 4.3.3. Achievement of programme goal and planned objectives ............................................. 39 4.4. Sustainability .................................................................................................................................. 40 4.5. Efficiency ........................................................................................................................................ 43 5. Factors Affecting Performance ..................................................................................................... 45 5.1. Preparation and Readiness ............................................................................................................ 45 5.2. Programme Implementation and Management .............................................................................. 46 5.2.1. Roles and Responsibilities ............................................................................................. 46 5.2.2. Management Mechanisms ............................................................................................. 47 5.3. Stakeholder Participation and Public Awareness ........................................................................... 50 5.4. Country Ownership and Driven-Ness ............................................................................................. 52 5.5. Financial Planning and Management ............................................................................................. 54 5.5.1. Budgeting, Allocations and Expenditure ........................................................................ 54 5.5.2. Financial Management ................................................................................................... 57 5.5.3. Human Resources.......................................................................................................... 57 5.6. Monitoring and Evaluation .............................................................................................................. 58 6. Conclusions and Recommendations ............................................................................................ 62 6.1. Conclusions .................................................................................................................................... 62 6.2. Lessons Learned ............................................................................................................................ 64 6.3. Recommendations ......................................................................................................................... 66 Outcome Evaluation MAP Programme of Work 2010-2014 i Annexes ............................................................................................................................................. 69 Annex 1. Response to Stakeholder Comments .................................................................................. 70 Annex 2. Evaluation Terms of Reference............................................................................................ 84 Annex 3. List of Interviewees .............................................................................................................. 96 Annex 4. Evaluation Schedule ............................................................................................................ 98 Annex 5. List of documents reviewed or consulted ............................................................................. 99 Annex 6. Results of the Questionnaire Survey to MAP and RAC Focal Points ................................ 100 Annex 7. Summary of Delivery against PoW Output Indicators and Targets ................................... 119 Annex 8. Summary of Financial Information ..................................................................................... 134 Annex 9. Brief CVs of the Consultants .............................................................................................. 138 Outcome Evaluation MAP Programme of Work 2010-2014 ii Acronyms and Abbreviations ACCOBAMS Agreement on the Conservation of Cetaceans of the Black Sea, Mediterranean Sea and contiguous Atlantic area AECID Spanish Agency for International Development Cooperation BC Barcelona Convention BOD Biological oxygen demand BP/RAC Blue Plan RAC CAMPs Coastal Area Management Programmes CBD Convention on Biological Diversity ClimVar & ICZM Integration of climate variability and change into national strategies for the implementation of the ICZM Protocol in the Mediterranean (GEF project) COP Conference of Parties CP/RAC Cleaner Production RAC (now SCP /RAC) DEPI Division of Environmental Policy Implementation (UNEP) EC European Commission EcAp Implementation of the Ecosystem Approach in the Mediterranean (EU Project) ECP Executive Coordination Panel (MAP) EEA European Environment Agency EMSA European Maritime Safety Agency EU European Union FAO Food and Agriculture Organization of the United Nations FFEM French Global Environment Fund (Fonds Français pour l’Environnement Mondial) GEF Global Environment Facility GES Good Environmental Status GFCM General Fisheries Commission for the Mediterranean (FAO) GWP-Med Global Water Partnership - Mediterranean HELCOM Baltic Marine Environment Protection Commission - Helsinki Commission ICZM Integrated coastal zone management IAEA International Atomic Energy Agency IHP International Hydrological Programme (UNESCO) InfoMAP UN Mediterranean knowledge platform INFO/RAC Regional Activity Centre for Information and Communication IUCN International Union for Conservation of Nature MAP Action Plan for the Protection and Development of the Mediterranean Basin MARPOL International Convention for the Prevention of Pollution from Ships MED POL Programme for the Assessment and Control of Marine Pollution in the Mediterranean MedPAN Network of Managers of Marine Protected Areas in the Mediterranean MedPartnership Strategic Partnership for the Mediterranean Sea Large Marine Ecosystem (GEF Project also referred to