Draft Terminal Evaluation Report
Total Page:16
File Type:pdf, Size:1020Kb
Biodiversity Conservation in Multiple Use Forest Landscapes in Sabah, Malaysia (GEF ID [PIMS] 4182) Draft Terminal Evaluation Report Prepared by: James T. Berdach, Lead Expert and Evaluator (International) Bee Hong Yeo, Environmental Economist (National) Pei Sin Tong, Biodiversity & Forest Expert (National) Prepared for: United Nations Development Programme, Malaysia Draft of 08 October 2019 Disclaimer: The views and opinions expressed in this report are solely those of the authors, and do not reflect official positions of the Government of Malaysia, Sabah State Government, the United Nations Development Programme, or Global Environment Facility. Cover photo: Waterfalls, area of Maliau Basin, Sabah, Borneo. (photo: J. Berdach) ii List of Acronyms and Abbreviations APR Annual progress report CPAP Country Programme Action Plan (UNDP) FSC Forest Stewardship Council GEF Global Environment Facility HCVF High conservation value forest IR Inception Report ITP Industrial timber plantation KATS Kementerian Air, Tanah dan Sumber Asli (Ministry of Water, Land and Natural Resources; formerly Ministry of Natural Resources and Environment [NRE]) MFL Multiple-use forest landscape MOU Memorandum of understanding MSPO Malaysia Sustainable Palm Oil MTCS Malaysia Timber Certification Scheme MTR mid-term review NNL No net loss NRO Natural Resources Office PA Protected area PB Project board PES Payment for ecosystem services PIF Project identification form PIR Project implementation review PMU Project management unit PPG Project preparation grant ProDoc Project document RBJ Rakyat Berjaya Sdn Bhd RSPO Roundtable for Sustainable Palm Oil SEPU State Economic Planning Unit SFD Sabah Forestry Department SFMLA Sustainable Forest Management License Agreement TE Terminal Evaluation TER Terminal evaluation report TOR Terms of reference TWG Technical working group UNDP United Nations Development Programme YS Yayasan Sabah (Sabah Foundation) iii TABLE OF CONTENTS List of Acronyms and Abbreviations ................................................................................................................. iii Opening Page (Basic Report and Project Information) ................................................................................... vi Executive Summary............................................................................................................................................ vii Description of the Project and the Terminal Evaluation....................................................................................vii Summary of Lessons, Recommendations, and Conclusion.............................................................................xii 1 INTRODUCTION......................................................................................................................................... 1 1.1 Purpose of the Evaluation ............................................................................................................. 1 1.2 Methodology .................................................................................................................................. 1 1.2.1 Information Gathering ................................................................................................................. 1 1.2.2 Analysis, Documentation, and Delivery ...................................................................................... 2 1.3 Summary of the Methodological Approach ................................................................................... 2 1.4 Structure of the Evaluation Report ................................................................................................ 2 2 PROJECT DESCRIPTION AND DEVELOPMENT CONTEXT .................................................................. 4 2.1 Project Start and Duration ............................................................................................................. 4 2.2 Significance of the Project Area .................................................................................................... 4 2.3 Problems that the Project Sought to Address ............................................................................... 6 2.4 Immediate and Development Objectives of the Project ................................................................ 6 2.5 Baseline Indicators Established .................................................................................................. 11 2.6 Main Stakeholders....................................................................................................................... 11 2.7 Expected Results......................................................................................................................... 13 3 FINDINGS ................................................................................................................................................. 14 3.1 Project Design / Formulation ....................................................................................................... 15 3.1.1 Results Framework: Objective, Outcomes, and Outputs.......................................................... 15 3.1.2 Indicators and Targets .............................................................................................................. 18 3.1.3 Assumptions and Risks............................................................................................................. 19 3.1.4 Lessons from Other Relevant Projects ..................................................................................... 27 3.1.5 Planned Stakeholder Participation............................................................................................ 27 3.1.6 Replication Approach................................................................................................................ 29 3.1.7 UNDP Comparative Advantage ................................................................................................ 29 3.1.8 Linkages Between the Project and Other Interventions Within the Sector ............................... 30 3.1.9 Project Finance ......................................................................................................................... 30 3.2 Project Implementation / Project Management ........................................................................... 36 3.2.1 Management Arrangements ..................................................................................................... 36 3.2.2 Monitoring and Evaluation ........................................................................................................ 37 3.2.3 Adaptive Management .............................................................................................................. 39 3.2.4 Partnership Arrangements and Stakeholder Engagement ....................................................... 44 3.2.5 Project Finance ......................................................................................................................... 45 3.2.6 UNDP and Implementing Partner Execution/Implementation................................................... 45 3.3 Project Results ............................................................................................................................ 46 3.3.1 Overall Results: Project Outcomes ........................................................................................... 46 3.3.2 Relevance ................................................................................................................................. 49 3.3.3 Effectiveness............................................................................................................................. 50 3.3.4 Efficiency................................................................................................................................... 52 3.3.5 Sustainability ............................................................................................................................. 53 3.3.6 Impact........................................................................................................................................ 55 3.3.7 Project Rating............................................................................................................................ 57 4 LESSONS AND RECOMMENDATIONS.................................................................................................. 57 4.1 Lessons ....................................................................................................................................... 57 4.2 Recommendations....................................................................................................................... 59 iv 5 CONCLUSION...........................................................................................................................................62 ANNEXES .............................................................................................................................................................64 Annex A Consultants’ Terms of Reference ................................................................................................65 Annex B List of Persons Interviewed..........................................................................................................73 Annex C TE Mission Schedule ...................................................................................................................76 Annex D List of Documents Reviewed .......................................................................................................82