EVALUATION OF UNICEF’S SUPPORT TO MINE ACTION UNICEF Ref: EMER ICC 2005-005 Prepared by: Ms. Taz Khaliq Deputy Director, Humanitarian Resilience Resilience Centre, DDMSA, Cranfield University, Shrivenham, Wiltshire SN6 8LA, UK Commissioned by: Mr. Dermot Carty Senior Programme Officer UNICEF Landmines and Small Arms Team UNICEF House, United Nations, New York, NY 10017, USA June 2006 Evaluation of UNICEF’s Support to Mine Action Contents Acronyms / Abbreviations ......................................................................................................................... iv Executive Summary ...................................................................................................................................1 Introduction ................................................................................................................................................6 Aim, Objectives and Scope of Evaluation ................................................................................................11 Findings....................................................................................................................................................12 Appropriateness, relevance and sustainability of the strategy and approach .....................................12 Effectiveness and impact of the strategy and approach ......................................................................32 Risks and sustainability of the strategy and approach.........................................................................58 Conclusions and Lessons Learned..........................................................................................................63 Recommendations ...................................................................................................................................67 Methodology.............................................................................................................................................69 Project approach and methodology .....................................................................................................69 Stage 1: Scoping study ........................................................................................................................70 Stage 2: Desk review ...........................................................................................................................71 Stage 3: Field visits ..............................................................................................................................71 Stage 4: Draft report.............................................................................................................................72 Limitations of the methods used ..........................................................................................................72 Figures Figure 1: 2004/5 spending in UNICEF supported mine action according to questionnaires. ............ 25 Figure 2: 2004/5 spending in UNICEF managed mine action according to questionnaires. ............. 25 Figure 3: Relevancy of UNICEF goals to stakeholders...................................................................... 31 Figure 4: Performance towards the MRE goal at CO, RO and HQ.................................................... 34 Figure 5: Performance towards the advocacy goal at CO, RO and HQ. ........................................... 37 Figure 6: Performance towards the VA goal at CO, RO and HQ level. ............................................. 40 Figure 7: Activities of UNICEF supported mine action according to questionnaires.......................... 53 Figure 8: Inputs and processes of UNICEF support in mine action. .................................................. 57 Figure 9: Risks affecting UNICEF managed mine action................................................................... 59 Figure 10: Risks affecting UNICEF supported mine action.................................................................. 59 Figure 11: UNICEF support to mine action and its environment.......................................................... 62 Figure 12: UNICEF internal support to mine action. ............................................................................ 65 Figure 13: Schedule of the evaluation of UNICEF support to mine action........................................... 69 Figure 14: Process behind the evaluation of UNICEF support to mine action..................................... 70 Boxes Box 1: UNICEF mine action organisation............................................................................................. 9 Box 2: UNICEF consistency with requirements of mine action stakeholders. ................................... 14 Box 3: UNICEF ability to tailor mine action to local and international needs. .................................... 16 Box 4: Summary Stakeholder Analysis: UNICEF mine action staff interviews. ................................. 16 Box 5: Summary Stakeholder Analysis: UNICEF non-mine action staff interviews........................... 17 Box 6: The relationship between inputs and outputs of UNICEF support to mine action. ................. 19 ii Evaluation of UNICEF’s Support to Mine Action Box 7: Viability of the current UNICEF mine action approach within UNICEF................................... 21 Box 8: UNICEF mine action as part of a reformed UN effort. ............................................................ 24 Box 9: Summary Stakeholder Analysis: Donor interviews. ................................................................ 25 Box 10: UNICEF mine action inputs and scope of the strategy. .......................................................... 27 Box 11: Organisational sustainability of UNICEF mine action. ............................................................ 28 Box 12: Realism of UNICEF mine action goals within the 2005 timeframe. ........................................ 30 Box 13: Implementation of mine action and the original intent. ........................................................... 41 Box 14: Quality, time and cost of UNICEF mine action........................................................................ 42 Box 15: Summary Stakeholder Analysis: other UN agency mine action staff interviews. ................... 43 Box 16: Summary Stakeholder Analysis: implementing organisation and partner interviews. ............ 44 Box 17: Coordination of UNICEF mine action...................................................................................... 46 Box 18: Activities in UNICEF mine action. ........................................................................................... 50 Box 19: Impact of UNICEF support to mine action. ............................................................................. 56 Box 20: Risks to sustainability of UNICEF mine action........................................................................ 61 Appendices Appendix A UNICEF Evaluation Terms of Reference Appendix B UNICEF Mine Action Strategy 2002 - 2005 Appendix C Summary Stakeholder Analysis Appendix D Analysis of Data from UNICEF Support to Mine Action Appendix E Overall Performance of UNICEF Support to Mine Action Appendix F HRBAP and UNICEF Support to Mine Action Appendix G Information Collection and Analytical Approach Appendix H Bibliography Appendix I People Contacted and Met Appendix E Tables Table 1: MRE Performance indicators generated by UNICEF............................................................ 2 Table 2: Advocacy Performance indicators generated by UNICEF.................................................... 3 Table 3: VA Performance indicators generated by UNICEF............................................................... 4 Table 4: Objective 1.1 Performance indicators generated by UNICEF. ............................................. 6 Cranfield University 2006 iii Evaluation of UNICEF’s Support to Mine Action ACRONYMS / ABBREVIATIONS AusAID Australian Agency for International Development AP Anti-Personnel BCPR Bureau of Conflict Prevention and Recovery CABDIC Capacity Building of People with Disability in the Community CAP Consolidated Appeals Process CBL Campaign to Ban Landmines CBR Community-Based Rehabilitation CBMRR Community Based Mine Risk Reduction CCA Common Country Assessment CCC Core Commitments for Children in Emergencies CCW United Nations Convention on Certain Conventional Weapons CDC Centre for Disease Control, Atlanta, Georgia, US CIDA Canadian International Development Agency CMAA Cambodian Mine Action Authority CMAC Cambodian Mine Action Centre CO UNICEF Country Office CPC Country Programmes of Cooperation of UNICEF CRC Convention on the Rights of the Child CSO Civil Society Organisation CU Cranfield University DAC Development Assistance Committee DfID Department For International Development (UK) DPKO Department of Peace Keeping Operations EAPRO East Asia and Pacific Regional Office EMAO Ethiopian Mine Action Office EMOPS Office of Emergency Programmes ERW Explosive Remnants of War ESARO Eastern and Southern Africa Regional Office FPDO Friends of Peace and Development Organisation (Sudan) GICHD Geneva International Centre for Humanitarian Demining HI Handicap International HRBAP Human Rights Based Approach to Programming HRU Human Rights Unit ICBL International Campaign to Ban Landmines ICRC International Committee of the Red Cross IDP Internally Displaced Person IEC Information Education and Communication IECD Integrated Early Childhood Development IHL International