Evaluation Report
Total Page:16
File Type:pdf, Size:1020Kb
(GEF ID 6959) Final Report ;;;,;,kkolkllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllll i This report is a product of the Planning, Performance Monitoring, and Evaluation Unit of UNITAR, and the findings, conclusions and recommendations expressed therein do not necessarily reflect the opinion of the partners of the “Strengthen National Decision Making Towards Ratification of the Minamata Convention and Build Capacity Towards Implementation of Future Provisions” project. The evaluation was conducted by Mr. Patrick Breard. The report is issued without formal copy editing. The designation employed and the presentation of material in this publication do not imply the expression of any opinion whatsoever on the part of the United Nations Institute for Training and Research concerning the legal status of any country, city or area or its authorities or concerning the delimitation of its frontiers or boundaries. ii Preface The “Strengthen National Decision Making Towards Ratification of the Minamata Convention and Build Capacity Towards Implementation of Future Provisions” project aimed to undertake a Mercury Initial Assessment (MIA) to enable the Governments of Bangladesh, Guinea Bissau, Mauritania, Mozambique and Samoa to determine the national requirements and needs for the ratification of the Minamata Convention and establish a national foundation to undertake future work towards the implementation of the Convention. Implemented from 2015 to 2019, the project was executed by UNITAR, and was funded by the GEF with UNDP as the implementing partner. This evaluation assessed the project’s performance against expectations set out in the project’s results framework, which provides performance and impact indicators for project implementation along with their corresponding means of verification. The evaluation covered the criteria of relevance, effectiveness, efficiency, sustainability and to the extent possible impact. Overall, the evaluation found the project outcomes to be moderately satisfactory. This report issues a set of five recommendations and four lessons learned. The evaluation was managed by the UNITAR Planning, Performance Monitoring, and Evaluation Unit (PPME) and was undertaken by Mr. Patrick Breard, consultant and independent evaluator. The Unit provided guidance, oversight and quality assurance, as well as logistical support for fieldwork. The evaluation was managed in close coordination with the project management. The PPME Unit is grateful to Patrick Breard, UNITAR’s Chemicals and Waste Management Unit, UNDP and the project’s country partners, and the other evaluation stakeholders for providing important input into this evaluation. Brook Boyer Director, Division for Strategic Planning and Performance Manager, Planning, Performance Monitoring and Evaluation Unit iii Acknowledgements This terminal evaluation was prepared for the Planning, Performance Monitoring, and Evaluation Unit (PPME) of UNITAR by Dr Patrick Breard. The report benefits from a peer review conducted by PPME . The consultant would like to thank UNITAR Project Team, UNDP, and national partners and stakeholders in Bangladesh, Guinea Bissau, Mauritania, Mozambique, and Samoa for their contribution and collaboration during the evaluation process. Their valuable insights and frank perspectives have contributed to inform the evaluation with rich findings and lessons learned. iv Executive Summary TABLE 1: PROJECT SUMMARY TABLE Project Title Strengthen National Decision Making Towards Ratification of the Minamata Convention and Build Capacity Towards Implementation of Future Provisions GEF Project ID 6959 UNDP PIMS ID 5410 UNDP Award ID 00088155 UNDP Project ID 00094931 Countries Bangladesh, Guinea Bissau, Mauritania, Mozambique, Samoa Region Global GEF Focal Area Chemicals and Wastes FA Objectives, (OP/SP) GEF Agency United Nation Development Programme (UNDP) Executing Agency United Nations Institute for Training and Research (UNITAR) Other Project People’s Republic of Bangladesh: Department of Environment of Bangladesh; Partners Bangladesh University of Engineering and Technology; Eco-Social Development Organization (ESDO) Republic of Guinea-Bissau: Secretariat of State for the Environment Mauritania: Ministry of Environment and Sustainable Development Mozambique: Ministry of Land, Environment, and Rural Development Samoa: Ministry of Natural Resources and Environment at endorsement (million US$) at completion (million US$) GEF Financing 1.00 1.00 IA/EA Own - - Government 0 0 Other 0 0 Total co-financing 0 0 Total Project Cost 1.00 1.00 Project Document Signature (date project began) 1 July 2015 (Operational) Closing Proposed: Actual: Date 30 May 2017 30 June 2019 PROJECT DESCRIPTION Initiated in 2014, the overall goal of the “Strengthen National Decision Making Towards Ratification of the Minamata Convention and Build Capacity Towards Implementation of Future Provisions” (Global MIA) project was for the Governments of Bangladesh, Guinea Bissau, Mauritania, Mozambique and Samoa to ratify the Minamata Convention on Mercury. The project’s immediate objective was for the countries to undertake a Mercury Initial Assessment (MIA) to determine the national requirements and needs for the ratification of the Minamata Convention, and to establish a national foundation to undertake future work towards the implementation of the Convention. The project was structured around two components, (1) Establishment of enabling environment for decision-making on the ratification of the Minamata Convention, and (2) Development of National Mercury Profile and Mercury Initial Assessment Report. v The Global MIA project was funded by the Global Environment Facility (GEF) with US$1 million. The United Nations Development Programme (UNDP) was the implementing partner and United Nations Institute for Training and Research (UNITAR) the executing agency. The main achievements of the project per outcome are summarized as follows: Table 2: Achievements of the project per outcome Outcome Reported achievements Outcome 1.1: National Coordination / Consultation Awareness on Mercury issues created among all project Mechanism on Mercury operational stakeholders. One global inception workshop attended by two countries and five national Inception Workshops organized. National Coordination/Consultation Mechanism on Mercury established or mainstreamed in existing structures Outcome 1.2: Policy and regulatory framework, and Assessment Reports finalized for four countries; drafted for institutional and capacity needs in regard to the Mozambique implementation of Convention provisions assessed. Outcome 1.3: Awareness raised on the Awareness on the health effects of Mercury increased among environmental and health impacts of Mercury. decision makers, the general public and population groups at risk Outcome 1.4: Project countries equipped and Socio-economic study on Mercury priority(ies) completed in prepared for the mainstreaming of national four project countries; drafted in Mozambique Mercury Priorities Awareness of decision makers raised. Mainstreaming road maps developed for four project countries; not developed for Mozambique Sample text for mainstreaming prepared for four countries Outcome 2.1: National capacity built to undertake Five teams of national experts trained on conducting Mercury Mercury inventories. Inventories National technical experts (consultants and Mercury Focus Group members) trained on data collection methodologies, reliability, credibility and data analysis. Outcome 2.2: National Mercury Profile available. Mercury profile finalized for four project countries. Outcome 2.3: National MIA Report available. Bangladesh: Final stage - MIA Report drafted and submitted to UNITAR and reviewed. Submitted to UNDP for review. Guinea Bissau: Final stage - MIA Report finalized and being formatted. Mauritania: Final stage – finalized and being formatted. Mozambique: Medium stage – Legal report almost finalized; all other outputs are at the initial phase. Samoa: MIA Report finalized completed – formatted and submitted to the Minamata Secretariat. National reporting/validation review and meetings organized to approve/adopt the project’s outputs (Inventory, Mercury Profile, MIA Report, Mainstreaming Roadmap) in four countries. The project faced several challenges, constraints or shortcomings, among which the following ones are highlighted: Originally planned to be implemented over a period of 23 months, the project was extended twice and spanned over a period of 46 months; There was limited robustness in the methodologies used to assess learning needs and to monitor the outcomes of training activities; The project delivered one mercury inventory level 2 and three inventories level 1, while five level 2 inventories were initially targeted; At project closure, four MIA reports have been prepared (one fully completed, two finalized and being formatted, and one under final revision), while the project expected to deliver five MIA reports. vi TABLE 3: EVALUATION RATING TABLE Evaluation Ratings:1 1. Monitoring and Evaluation rating 2. IA & EA Execution rating M&E design at entry 4 (MS) Quality of UNDP Implementation 4 (MS) M&E Plan Implementation 4 (MS) Quality of Execution - Executing Agency 4 (MS) Overall quality of M&E 4 (MS) Overall quality of Implementation / Execution 4 (MS) 3. Assessment of Outcomes rating 4. Sustainability rating Relevance 2 (R) Financial resources: 4 (L) Effectiveness 5 (S) Socio-political: 4 (L)