OFFICE OF EVALUATION Project evaluation series Mid-term evaluation of the Integrated Management of the Ilha Grande Bay Ecosystem (BIG) project Final Report May 2015 PROJECT EVALUATION SERIES Mid-term evaluation of the Integrated Management of the Ilha Grande Bay Ecosystem (BIG) project FINAL Report FOOD AND AGRICULTURE ORGANIZATION OF THE UNITED NATIONS OFFICE OF EVALUATION May 2015 i Food and Agriculture Organization of the United Nations Office of Evaluation (OED) This report is available in electronic format at: http://www.fao.org/evaluation The designations employed and the presentation of material in this information product do not imply the expression of any opinion whatsoever on the part of the Food and Agriculture Organization of the United Nations (FAO) concerning the legal or development status of any country, territory, city or area or of its authorities, or concerning the delimitation of its frontiers or boundaries. The mention of specific companies or products of manufacturers, whether or not these have been patented, does not imply that these have been endorsed or recommended by FAO in preference to others of a similar nature that are not mentioned. The views expressed in this information product are those of the author(s) and do not necessarily reflect the views or policies of FAO. © FAO 2015 FAO encourages the use, reproduction and dissemination of material in this information product. Except where otherwise indicated, material may be copied, downloaded and printed for private study, research and teaching purposes, or for use in non-commercial products or services, provided that appropriate acknowledgement of FAO as the source and copyright holder is given and that FAO’s endorsement of users’ views, products or services is not implied in any way. All requests for translation and adaptation rights, and for resale and other commercial use rights should be made via www.fao.org/contact-us/licence-request or addressed to [email protected]. For further information on this report, please contact: Director, Office of Evaluation (OED) Food and Agriculture Organization Viale delle Terme di Caracalla 1, 00153 Rome Italy Email: [email protected] GCP/BRA/078/GFF ii Mid-term evaluation of the Integrated Management of the Ilha Grande Bay Ecosystem (BIG) project Contents Acknowledgements ......................................................................................................................................vi Acronyms and abbreviations ....................................................................................................................vii Executive summary ..................................................................................................................1 1. Introduction ..........................................................................................................................6 1.1 Project description .........................................................................................................6 1.1.1 Project objectives ..................................................................................................6 1.2 The Brazilian general context ......................................................................................7 1.3 Purpose of the mid-term evaluation and scope of evaluation...........................8 1.3.1 Purpose ....................................................................................................................8 1.3.2 Criteria for the evaluation and key issues to be analysed ........................9 1.4 Evaluation methodology ............................................................................................10 2. Analysis of the Project Concept and Design .............................................................11 2.1 Project design ................................................................................................................11 2.1.1 Project formulation ............................................................................................11 2.1.2 Logical frame analysis .......................................................................................12 2.1.3 Identification of the project partners and beneficiaries ..........................12 3. Project implementation analysis .................................................................................13 3.1 Project management ...................................................................................................14 3.1.1 Internal functioning ..........................................................................................14 3.1.2 Implementation arrangements ......................................................................16 3.1.3 Monitoring ............................................................................................................16 3.2 Financial resources management ............................................................................18 3.3 Institutional arrangements and partnerships ......................................................19 3.3.1 Institutional arrangements with co-management participation forums .....19 4. Analysis of the project products/results and contributions with the final objective .................................................................................................................. 22 4.1 Products/results in relation to the project components................................... 22 4.1.1 Component 1: planning, policy and institutional strengthening ........ 22 4.1.2 Component 2: Biodiversity and protected areas ......................................24 4.1.3 Component 3: Analysis of threats, mitigation and monitoring ............26 4.1.4 Component 4: Public awareness-raising and environmental education .....28 4.1.5 Component 5: Project management ........................................................... 29 4.2. Results and their contribution to the final objectives ....................................... 30 4.3. Results of successful experiences, lessons learned, replication and dissemination of data ...........................................................................................................31 4.4. Results of the feedback on M&E activities – adaptive management: use of the METT Tool ............................................................................................................32 iii Mid-term evaluation of the Integrated Management of the Ilha Grande Bay Ecosystem (BIG) project 5. Analysis according to the evaluation criteria ......................................................... 34 5.1 Relevance ....................................................................................................................... 34 5.2 Efficiency ........................................................................................................................ 34 5.3 Effectiveness ...................................................................................................................35 5.4 Impact ..............................................................................................................................35 5.5 Sustainability ................................................................................................................. 36 5.5.1 Appropriation by the country and integration of agendas ................... 36 5.6 The GEF ranking table .................................................................................................37 6. Conclusions and recommendations .......................................................................... 38 6.1 Conclusions .................................................................................................................... 38 6.2 Recommendations ...................................................................................................... 40 Recommendation 1 to FAO and Government ..................................................... 40 Recommendation 2 to FAO ........................................................................................41 Recommendation 3 to FAO ........................................................................................41 Recommendation 4 to FAO and Government ......................................................42 iv Mid-term evaluation of the Integrated Management of the Ilha Grande Bay Ecosystem (BIG) project Tables and figures Table Table 1: Total score of the METT to each CU in 2010 and 2014 ................................32 Figures Figure 1. Density of industrial activities in the Ilha Grande Bay Region ..................8 Figure 2: Institutional arrangements to implement the project BIG .......................14 Figure 3: Percentage expenses by budget line ..............................................................18 v Mid-term evaluation of the Integrated Management of the Ilha Grande Bay Ecosystem (BIG) project Acknowledgements The evaluation team would like to thank all that collaborated with the elaboration of this Mid-Term Evaluation Report (MTE) with their knowledge and opinions. The findings and recommendations ensuing from the analysis of data collected during evaluation are expected to contribute to improve the project implementation and the fulfillment of its objectives. Evaluation team Mary Dayse Kinzo, Team Leader Marisete Catapan, Team Member Raquel Cabello, Evaluation Manager (OED) vi Mid-term evaluation of the Integrated Management of the Ilha Grande Bay Ecosystem (BIG) project Acronyms and abbreviations ABC Brazilian Cooperation Agency