Cmvis External Evaluation Report
Total Page:16
File Type:pdf, Size:1020Kb
CMVIS EXTERNAL EVALUATION REPORT Elke Hottentot March 2006 ACKNOWLEDGEMENTS The success of any evaluation depends on the willingness of people to share their knowledge and experiences. The CMVIS staff have been superbly helpful, cooperative and done more than their share to ensure that I was given every possible bit of understanding of the CMVIS project. My special thanks go to Mr. Lim, who as the project manager of the project answered the bulk of my questions, Mr. Loo and Mr. Sovanna, who took me on their trails to the provinces, and Handicap International Technical Advisors, Mr. Vannarin and Mr. Vuthy, whose insights into the project were invaluable. The CMVIS Data Gathers never tired of sharing their experience, whether this was in the field or in the PP office. This evaluation would not have reached to the same depths if it wasn’t for my assistant/interpreter/translator Ranine. Mr. Christian Provoost, who left his post at the end of January, set me off on the right track with his introduction to the project. The kind feedback from Mr. Bruno Leclerq, HI-B Country Director and various other staff at HI-B filled in the remaining gaps. The insights of many other people were solicited during this interview, including those of a variety of mine action agencies, the Cambodian Mine Action Authority and NGOs. Specifically, I want to thank Andy Kervell for sharing his wealth of understanding on how the CMVIS project could best meet the needs of the Mine Action Planning Units. Lastly, my thanks go the all the mine/UXO casualties we visited and whose welcoming smiles always made me feel at home. It is my sincere hope that this evaluation will strengthen CMVIS’ ability to provide them with support, as well as CMVIS’ ability to even better meet the needs of its end-users so that ultimately, they are better able to prevent mine/UXO incidents from happening in the future. Elke Hottentot March 22nd, 2006 ii CONTENT Executive Summary .........................................................................................................................1 PART A – Evaluation Framework...................................................................................................4 1. INTRODUCTION........................................................................................................................4 2. BRIEF PROJECT DESCRIPTION..............................................................................................4 3. PROJECT SETTING ...................................................................................................................5 4. RATIONALE FOR EVALUATION ...........................................................................................6 5. PURPOSE and OBJECTIVES OF THE EVALUATION ...........................................................6 6. EVALUATION OBJECTIVES and RELATED QUESTIONS ..................................................7 6.1 To analyze the consistency of the chain of operations from staff/volunteer deployment to final reporting and dissemination.................................................................................7 6.2 To assess the CMVIS management capacity with the objective to ultimately work independently from HI-B Technical Assistance (TA); analyze existing internal management tools, set conditions and draft plan for the transfer of responsibilities.......8 6.3 To assess the CMVIS deployment scheme and it's expected responsiveness towards beneficiaries (i.e. mine/UXO victims and their families); propose a revised scheme of intervention if required making the best use of CRC volunteer network.........................9 6.4 To assess the humanitarian impact of the project on mine action practitioners' work in terms of strategy formulation and priority deployment... This includes demining agencies, HMA NGOs, CMAA, PMAC, MAPU, CBMRR … .....................................10 6.5 To develop a benchmark outlining the minimum technical, managerial requirements and best political ownership/support to export the model..............................................10 7. CONCEPTUAL FRAMEWORK and METHODOLOGY........................................................11 8. EXPECTED OUTPUTS ............................................................................................................11 PART B – Evaluation Results........................................................................................................13 1. Current Situation, Main Findings and Recommendations .....................................................13 1.1 CONSISTENCY OF CHAIN OF OPERATIONS........................................................13 1.1.1 Current Situation....................................................................................................13 1.1.2 Main Findings........................................................................................................16 1.1.2.1 Collection of data ...............................................................................................17 1.1.2.2 Submission of data .............................................................................................20 1.1.2.3 Entry of data.......................................................................................................20 1.1.2.4 Analysis of data..................................................................................................21 1.1.2.5 Dissemination of data.........................................................................................21 1.1.3 Recommendations .........................................................................................................22 1.1.3.1 Collection of data ...............................................................................................22 1.1.3.2 Analysis of data..................................................................................................24 1.2 CMVIS CAPACITY .....................................................................................................26 1.2.1 Current Situation....................................................................................................26 1.2.2 Main Findings........................................................................................................27 1.2.2.1 CRC HQ intent for future involvement with CMVIS........................................28 1.2.2.2 CRC HQ and HI-B relations ..............................................................................29 1.2.2.3 HI-B support to CMVIS with developing and using a logic framework ...........29 1.2.2.4 CMVIS management capacity...........................................................................31 iii 1.2.2.5 CMVIS current staff capacity to operate without HI-B TAs .............................33 1.2.2.6 HI-B capacity.....................................................................................................35 1.2.3 Recommendations .........................................................................................................37 1.2.3.1 HI-B to formulate strategic plan for CMVIS and to increase cooperation with ... partner agency....................................................................................................37 1.2.3.2 Review and revise CMVIS logic framework .....................................................38 1.2.3.3 Strengthen CMVIS management tools...............................................................38 1.2.3.4 Consider reducing number of CMVIS staff at DMO.........................................39 1.2.3.5 Train CMVIS staff in selected topics.................................................................40 1.2.3.6 Strengthen role of HI-B TAs..............................................................................40 1.2.3.7 TMO TA to transfer monitoring capacity to field supervisors and data gatherers ............................................................................................................................41 1.3 CMVIS DEPLOYMENT SCHEME AND RESPONSIVENESS TOWARDS BENEFICIARIES ..........................................................................................................42 1.3.1 Current Situation ...........................................................................................................42 1.3.2 Main Findings ...............................................................................................................43 1.3.2.1 DG deployment and responsiveness toward beneficiaries.................................43 1.3.2.2 Victim assistance activities of data gathers........................................................43 1.3.2.3 Data gathers victim assistance success stories ...................................................44 1.3.2.4 CMVIS – UNICEF partnership..........................................................................45 1.3.2.5 MRE activities of data gatherers ........................................................................46 1.3.2.6 EOD referral activities of data gatherers............................................................46 1.3.2.7 Training and monitoring of VA and MRE components.....................................46 1.3.2.8 Consideration of gender .....................................................................................46 1.3.2.9 Data gatherers perceived lack of resources........................................................47 1.3.3 Recommendations .........................................................................................................47 1.3.3.1 Clarify intent