Microtraining and the Sierra Leone Police: an Evaluation of the Effectiveness of Cascade Training
Total Page:16
File Type:pdf, Size:1020Kb
Microtraining and the Sierra Leone Police: An Evaluation of the Effectiveness of Cascade Training December 2012 This publication was produced at the request of the United States Agency for International Development. It was prepared independently by Amber Davis, Luca Etter and Mark Fiorello for Social Impact, Inc. PHOTO CAPTION This photo was taken in Makeni Police Headquarters, Sierra Leone, on October 17, 2012. It shows a Level 3 training session during a routine morning roll call that is attended by local police officers. Photo credit goes to Luca Etter (Social Impact, Inc.). ACKNOWLEDGEMENTS The authors of this report, Amber Davis, Luca Etter, and Mark Fiorello, would like to thank many individuals and organizations for the guidance, expertise, and support throughout this evaluation. We are especially grateful to Victoria Gellis of USAID’s Center of Excellence on Democracy, Human Rights, and Governance for her leadership and direction from the evaluation’s very beginning. Abdulai Jalloh and Robert Hanchett from USIAD/Sierra Leone were instrumental in providing updated information about the SLP training program and key contacts to facilitate the evaluation. We must also thank Eric Beinhart, Bryan Atkins, and Rick Collinge from the International Criminal Investigative Training Assistance Program for their openness and flexibility in helping us design the evaluation and allowing us to observe their staff at work. We could not have accomplished as much as we did without the expertise of the Center for Economic and Social Policy Analysis staff, including Sullay Kamara, Diana Ofori Owusu, Musa Kamara, and Ishmail Kamara, whose intimate knowledge of Sierra Leone only added to the richness of the evaluation. From Social Impact, we are thankful to Mike Duthie for his technical guidance and to Kyle Block for his assistance with a variety of critical tasks. Of course, we extend our upmost gratitude to those Sierra Leonean police officers and Master Trainers who allowed the evaluation team to observe trainings and conduct the necessary investigative interviews. David Yang, Director, The Center of Excellence on Democracy, Human Rights, and Governance Altin Ilirjani, Learning Lead, The Center of Excellence on Democracy, Human Rights, and Governance 1 MICROTRAINING AND THE SIERRA LEONE POLICE: AN EVALUATION OF THE EFFECTIVENESS OF CASCADE TRAINING December 3, 2012 Order No. AID-OAA-TO-11-00057; Contract No. AID-OAA-I-10-00003 DISCLAIMER The author’s views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government. 2 TABLE OF CONTENTS Acronyms ............................................................................................................................................................................................4 Executive Summary ...........................................................................................................................................................................5 Evaluation Purpose, Background & Questions ........................................................................................................................ 10 Project Background ....................................................................................................................................................................... 13 Evaluation Design, Methods & Limitations ............................................................................................................................... 16 Findings, Conclusions and Recommendations ......................................................................................................................... 21 Epilogue ............................................................................................................................................................................................ 39 Annex A: Data Collection Instruments .................................................................................................................................... 40 Instrument 1. Focus Group Discussions with Level Two Trainers .............................................................................. 40 Instrument 2. Key Informant Interview with ICITAP Representative .......................................................................... 43 Instrument 3. Direct Observation of Level 2 Training .................................................................................................... 46 Instrument 4. Key Informant Interviews with Level 2 Trainees .................................................................................... 50 Instrument 5. Direct Observation of Level 3A Training .................................................................................................. 52 Instrument 6. Key Informant Interviews with Level 3A Trainees .................................................................................. 56 Instrument 7. Key Informant Interview Local Unit Commander and/or Leader of the Morning Parade ............ 60 Instrument 8. Key Informant Interviews with Level 3B “Trainees” ............................................................................. 63 Instrument 9. Key Informant Interviews with SLP Master Trainers .............................................................................. 66 Instrument 10. Level 3 Data Collection Plan ...................................................................................................................... 70 Annex B: Sources of Information ............................................................................................................................................... 72 LIST OF FIGURES AND TABLES Figure 1. Microtraining Cascade Structure .............................................................................................................................. 17 Table 1. Level 2 Attendance by Region .................................................................................................................................... 25 Figure 2. Prior Knowledge of Training Modules ..................................................................................................................... 26 Table 2. Direct Observations of Morning Parades ................................................................................................................ 29 Table 3. Percentage of Respondents Giving Correct Answers to Learning Questions, by Station/Post that Did or Did Not Implement Level 3 Trainings ....................................................................................................................................... 32 Table B-1. Data Collection Methods ......................................................................................................................................... 72 Table B-2. Interviews Conducted ............................................................................................................................................... 73 Table B-3. Analysis of Attendance Sheets ................................................................................................................................ 75 Table B-4. Selection of Divisions for Level 3 Data Collection ............................................................................................ 76 Table B-5. Summary of Level 3 Observations ......................................................................................................................... 77 Map B-2. Level 3 Evaluation Sites ............................................................................................................................................... 79 3 ACRONYMS ADS Automated Directives System APPC Area Policing Partnership Committee CEPPS Consortium for Elections and Political Process Strengthening CESPA Center for Economic and Social Policy Analysis DoJ Department of Justice DRG Center USAID’s Center of Excellence on Democracy, Human Rights, and Governance EDGE-IE Evaluating DRG Effectiveness- Impact Evaluations EMB Executive Management Board ESP-SL Elections Security Program in Sierra Leone EU European Union FGD Focus Group Discussion HQ Headquarters ICITAP International Criminal Investigative Training Assistance Program IFES International Foundation for Electoral Systems IGP Inspector General of Police KI Key Informant KII Key Informant Interview LPPB Local Police Partnership Board LUC Local Unit Commander PIE Promoting Inclusive Elections SI Social Impact SLEA Senior Law Enforcement Advisor SLP Sierra Leone Police USAID United States Agency for International Development USAID/W United States Agency for International Development / Washington 4 EXECUTIVE SUMMARY The USAID Elections Security Program in Sierra Leone (ESP-SL) was designed to promote election security around the Sierra Leonean presidential, parliamentary, and local elections scheduled for November 2012. The program was intended to be “truly integrated,” combining targeted capacity building for the Sierra Leone Police (SLP) provided by the Department of Justice’s International Criminal Investigative Training Assistance Program (ICITAP) with civic education activities (including on the role of the SLP in promoting election security) implemented by the International Foundation for Electoral Systems (IFES). The design for ESP-SL also included an evaluation component to enable USAID to learn about the factors driving success or lack thereof and incorporate such evidence