Integrated Management of the Yallahs and Hope River Watershed Management Areas Project GRT/FM-14607-JA
Total Page:16
File Type:pdf, Size:1020Kb
Integrated Management of the Yallahs and Hope River Watershed Management Areas Project GRT/FM-14607-JA Mid-Term Evaluation Final Report Submitted to National Environment and Planning Agency By Dr. Alicia A. Hayman Mid-term Evaluator May 20, 2018 (revds. May 28, 2018) Acknowledgements The Yallahs-Hope Watershed Management Areas Project Mid-term Evaluator wishes to express gratitude to the following institutions and individuals whose contributions were essential to the successful preparation of this report: • The Executing Agency and Implementing Partners • Project Manager, Mrs. Nelsa English Johnson and her team • Inter-American Development Bank • Supporting host government agencies • Participating non-government and community groups • Project beneficiaries from the respective watersheds The evaluator also acknowledges the technical inputs of Mr. Maurice Mason, Ms. Karyll Johnston, Ms. Felicia Whyte and Ms. Elizabeth Morrison, provided in a timely and professional manner. MTE Report: Integrated Management of the Yallahs and Hope River Watershed Management Areas Project ii Table of Contents Acronyms and Abbreviations ................................................................................................. v Executive Summary ............................................................................................................. viii 1 Introduction and Background ........................................................................................1 1.1 Objectives and Components of the Project ...................................................................1 2 MTE Approach and Methodology .................................................................................4 2.1 MTE Limitations and Constraints ...................................................................................6 3 Findings ..........................................................................................................................7 3.1 Design and Relevance ..................................................................................................10 3.1.1 Project Objective and Logical Framework ........................................................... 10 3.2 Efficiency of Implementation ......................................................................................22 3.2.1 Efficiency of Implementation of Project Components ........................................ 25 3.2.2 Financial Planning ................................................................................................ 46 3.2.3 Efficiency of spend and schedule performance .................................................. 47 3.2.4 Inflationary analysis ............................................................................................. 50 3.2.5 Project Procurement ........................................................................................... 51 3.2.6 Project risk management .................................................................................... 55 3.2.7 Adaptive management ........................................................................................ 59 3.2.8 Catalytic Role and Replication ............................................................................. 60 3.2.9 Monitoring and Evaluation .................................................................................. 62 3.3 Effectiveness – Achievement of outputs against planned results ..............................67 3.4 Impact ..........................................................................................................................71 3.5 Sustainability ................................................................................................................71 4 Good practices and lessons learnt, key findings and recommendations....................75 4.1 Good practices .............................................................................................................75 4.2 Lessons Learned ...........................................................................................................75 4.3 MTE Major Findings .....................................................................................................77 4.4 Findings summarized in the GEF indicator tracking tool .............................................82 4.5 MTE Recommendations ...............................................................................................83 4.6 Immediate Next Steps .................................................................................................94 List of Annexes Annex A-1: Copyright Page................................................................................................. i Annex A-2: MTE Recommended Revision of the Results Matrix ...................................... ii Annex A-3: Project Timelines ........................................................................................... vi Annex A-4: IDB No-Objections- Request and Response Dates ........................................ xi Annex A-5: Summary Findings of Project External Audits ............................................ xvii Annex A-6: Procurement Summary Tables .................................................................... xxi Annex A-7: Procurement Process Flow ....................................................................... xxvii Annex A-8: GEF Tracking Tool Assessment ................................................................... xxx Annex B-1. References .................................................................................................. lxiv Annex B-2. MTE Terms of Reference .......................................................................... lxxiii Annex B-3. Data gathering instruments for primary data collection ........................ lxxxvi MTE Report: Integrated Management of the Yallahs and Hope River Watershed Management Areas Project iii Annex B-4. List of stakeholders engaged for the MTE .................................................. cvii Annex B-5. MTE Implementation timeline (contract March 2018) ............................... cix List of Tables Table 1. Sources of Financing for the Integrated Management of the Yallahs-Hope Watershed Management Area Project (JA-G1001) ................................................................1 Table 2: Project Status Using IDB’s Monitoring Indices .........................................................8 Table 3: Project Status Using GEF’s Monitoring Indices.........................................................8 Table 4. Project design methods and approaches and their relevance ...............................15 Table 5. Project Indicators (by Result Matrix Elements) ......................................................19 Table 6: Status of Component 3 implementation as at April 2018 ......................................30 Table 7. Analysis of levels of governance for the Yallahs-Hope WMU Project ....................32 Table 8. Project Steering Committee Meetings held to date (from PSC Minutes 2015-2017) …………………………………….. .....................................................................................................34 Table 9. PEU staffing engagements ......................................................................................35 Table 10. Analysis of PEU capacity for project implementation ..........................................37 Table 11. Partnership agreements signed for the Yallahs-Hope WMU Project ...................44 Table 12. Analysis of the project’s Cost Performance Index (CPI) and Schedule Performance Index (SPI) .......................................................................................................48 Table 13: Inflationary impact ...............................................................................................50 Table 14: Inflation Adjusted Budget .....................................................................................50 Table 15: Summary of Current Procurement Plan ...............................................................54 Table 16: Changing Profile of Risks Identified at the Start of Project Implementation .......56 Table 17: Number and Types of Risks Identified at Beginning of Project and in January 2018 .....................................................................................................................................57 Table 18: Summary of Risk Management and Reporting (2014- 2018) ...............................57 Table 19. Elements of the Project’s M&E System ...............................................................63 Table 20. M&E Implementation Actions Taken ...................................................................65 Table 21. Achievement of outputs against planned results as of December 2017 (Source: PMR January – December 2017) ..........................................................................................69 Table 22: Conditions that Affect continuation of Benefits post-project implementation ...71 Table 23. Project Rating using the GEF tracking tools eleven indicators .............................82 List of Figures Figure 1. Geographical representation of the Yallahs River and Hope River WMUs ............ 2 Figure 2. Integrated Management of the Yallahs Hope WMU Mid-term evaluation purpose ............................................................................................................................................... 5 Figure 3. Steps in the Project MTE process ........................................................................... 6