FINAL REPORT UNDP Project IDs: 00101607 & 00105819 UNDP - Lao UXO Program 2017 - 2021 Moving towards achieving SDG 18 Removing the UXO obstacle to development in Lao PDR MID TERM EVALUATION END EVALUATION OF EU CONTRIBUTION FORWARD LOOKING OPPORTUNITIES December 2019 Steve Raaymakers & Latsany Phakdisoth Evaluation Team FINALREPORT UNDP Project IDs: 00101607 & 00105819 UNDP - Lao UXO Program 2017-2021: Mid Term Evaluation, End Evaluation of EU Contribution & Forward Looking Opportunities - Dec 2019. EVALUATION TEAM CONTACTS • Steve Raaymakers International Evaluation Consultant [email protected] www.eco-strategic.com Tel: +61 40 9909 422 • Latsany Phakdisoth National Evaluation Consultant [email protected] Tel: +856 20 5560 2281 CLIENT (UNDP) CONTACTS • Justin Shone Team Leader Natural Resources Management, Climate Change, Disaster Risk Reduction & Unexploded Ordnance UNDP Lao PDR [email protected] Tel: +856 (21) 267 709 • Phetsamone Southalack Planning & Reporting Officer - UXO Unit UNDP Lao PDR [email protected] Tel: +856 (21) 267 764 REPORT CITATION Please cite this report as: • Raaymakers, S. & Phakdisoth, L., 2019. UNDP - Lao UXO Program 2017-2021: Mid Term Evaluation, End Evaluation of EU Contribution & Forward Looking Opportunities - Dec 2019. Report to the United Nations Development Programme and the Government of the Lao People’s Democratic Republic. Cover images: • Left: Evaluation Team inspecting UXO survey and clearance activities by the Lao People’s Army Humanitarian Demining Unit 58 at Khamkeuth District, Bolikamxay Province, November 2019. • Right: Icon for Lao PDR Sustainable Development Goal (SDG) No. 18 – ‘Lives Safe From UXO’. Cover logos: • Top row: UNDP, Government of Lao PDR, National Regulatory Authority for UXO/Mine Action Sector in Lao PDR (NRA), Lao National Unexploded Ordnance Programme (UXO Lao) and Lao People’s Army Humanitarian Demining Unit 58. • Bottom row: Development partners that have provided funding for UXO activities through UNDP since June 2017. [copyright will be removed from Final once payment for report production is received] Copyright © 2019, EcoStrategic Consultants, www.eco-strategic.com Page 2 of 138 (including cover) FINALREPORT UNDP Project IDs: 00101607 & 00105819 UNDP - Lao UXO Program 2017-2021: Mid Term Evaluation, End Evaluation of EU Contribution & Forward Looking Opportunities - Dec 2019. Figure 1: Administrative Divisions of Lao PDR (source: www.decide.la/en/publications#reports) [copyright will be removed from Final once payment for report production is received] Copyright © 2019, EcoStrategic Consultants, www.eco-strategic.com Page 3 of 138 (including cover) FINALREPORT UNDP Project IDs: 00101607 & 00105819 UNDP - Lao UXO Program 2017-2021: Mid Term Evaluation, End Evaluation of EU Contribution & Forward Looking Opportunities - Dec 2019. Figure 2: The contribution of UXO action to the United Nations Sustainable Development Goals(SDGs) (source: GICHD) [copyright will be removed from Final once payment for report production is received] Copyright © 2019, EcoStrategic Consultants, www.eco-strategic.com Page 4 of 138 (including cover) FINALREPORT UNDP Project IDs: 00101607 & 00105819 UNDP - Lao UXO Program 2017-2021: Mid Term Evaluation, End Evaluation of EU Contribution & Forward Looking Opportunities - Dec 2019. CONTENTS DISCLAIMER ............................................................................................................................................................................. 7 ACKNOWLEDGEMENTS ........................................................................................................................................................... 7 ACRONYMS ............................................................................................................................................................................... 8 EXECUTIVE SUMMARY (ES) .................................................................................................................................................. 11 ES 1: Background .................................................................................................................................................................. 11 ES 2: Key Conclusions .......................................................................................................................................................... 11 Key Conclusion 1: Overall MTE - UNDP strategic positioning, role & comparative advantage ............................................ 11 Key Conclusion 2: Overall MTE - Suggested strengthening at UNDP ................................................................................. 11 Key Conclusion 3: Overall MTE - Need for major efficiency gains in MoU process ............................................................. 12 Key Conclusion 4: End Evaluation of EU contribution ......................................................................................................... 13 Key Conclusion 5: The path forward ................................................................................................................................... 13 ES 3: Summary of Donor Contributions ................................................................................................................................. 14 ES 4: Summary Findings - Scope 1: MTE of Overall UNDP Program .................................................................................... 14 ES 5 Summary Findings - Scope 1: End Evaluation of EU Contribution ................................................................................. 17 ES 6: Summary Findings - Scope 2: Forward Looking Opportunities ..................................................................................... 18 ES 7: Lessons Learned ......................................................................................................................................................... 19 1. INTRODUCTION .................................................................................................................................................................. 21 1.1 Background & context ...................................................................................................................................................... 21 1.2 Evaluation purpose, objectives & scope ........................................................................................................................... 23 1.3 Evaluation standards ....................................................................................................................................................... 23 2. EVALUATION METHODS .................................................................................................................................................... 24 3. DONOR CONTRIBUTIONS .................................................................................................................................................. 26 4. FINDINGS - SCOPE 1: MTE OF UNDP PROGRAM ............................................................................................................ 29 4.1 Adequacy of evaluation arrangements ............................................................................................................................. 29 4.2 Program relevance .......................................................................................................................................................... 29 4.3 Program concept & design ............................................................................................................................................... 30 4.4 Program management, coordination & partnerships ........................................................................................................ 32 4.5 Monitoring, evaluation & risk management ...................................................................................................................... 35 4.6 Effectiveness (including progress towards results) ........................................................................................................... 36 4.6.1 Effectiveness of the sector overall.............................................................................................................................. 36 4.6.2 UNDP Program - progress towards results ................................................................................................................ 36 4.6.3 UNDP Program - delivery rate by expenditure ........................................................................................................... 37 4.7 Efficiency (including value for money) .............................................................................................................................. 40 4.8 Gender mainstreaming .................................................................................................................................................... 42 4.9 Technical & tactical Issues ............................................................................................................................................... 43 4.10 Financial management................................................................................................................................................... 44 4.11 Visibility ........................................................................................................................................................................