Thematic Evaluation of European Commission Support to Justice and Security System Reform
Total Page:16
File Type:pdf, Size:1020Kb
Thematic Evaluation of European Commission Support to Justice and Security System Reform Final Report Volume I – Main Report November 2011 Evaluation for the European Commission Framework contract for Multi-country thematic and regional/country-level strategy European Group for evaluation studies and synthesis in the area of external co- Evaluation EEIG Germany operation LOT 2: Multi-country evaluation studies on social/human development issues of EC external co-operation PARTICIP GmbH Germany Ref.: EuropeAid/122888/C/SER/Multi Request for Service: 2010/234349 Aide à la Décision Economique Belgium Thhematic Evaluation of European Commission Support to Justice and Security Italy System Reform Deutsches Institut für Entwicklungspolitik Germany European Centre for Development Policy Management Final Report Belgium Volume I – Main Report Overseas Development Institute, United Kingdom South Research November 2011 Belgium A consortium of EGEVAL II (Particip & ADE) –DRN-DIE– ECDPM-ODI c/o Particip GmbH, leading Thhis evaluation was carried out by company: Headquarters Merzhauser Str. 183 D - 79100 Freiburg / Germany Phone: +49-761-79074-0 Fax: +49-761-79074-90 [email protected] The evaluation has been managed by the Joint Evaluation Unit in DG DEVCO. The author accepts sole responsibility for this report, drawn up on behalf of the Commission of the European Union. The report does not necessarily reflect the views of the Commission. Thematic Evaluation of the European Commission Support to Justice and Security System Reform ADE - EGEVAL II Table of Contents LIST OF ACRONYMS EXECUTIVE SUMMARY 1. INTRODUCTION ................................................................................................... 1 1.1 OVERALL OBJECTIVE, MANDATE AND SCOPE OF THE EVALUATION .......................... 1 1.2 KEY PHASES OF THE EVALUATION .................................................................................. 3 1.3 STRUCTURE OF THE FINAL REPORT ................................................................................ 3 2. BACKGROUND AND CONTEXT ............................................................................. 5 2.1 EVOLUTION OF JSSR POLICIES AT INTERNATIONAL AND EU LEVELS ...................... 5 2.1.1 International context ................................................................................................ 5 2.1.2 EU policy context ..................................................................................................... 6 2.2 OVERVIEW OF COMMISSION FINANCIAL SUPPORT TO JSSR OVER THE PERIOD 2001-2009 ............................................................................................................................ 7 3. METHODOLOGY .................................................................................................. 9 3.1 STRUCTURED EVALUATION APPROACH .......................................................................... 9 3.1.1 Intervention logic .................................................................................................... 10 3.1.2 The set of Evaluation Questions .......................................................................... 13 3.2 TOOLS AND SOURCES OF INFORMATION ...................................................................... 15 3.3 CHALLENGES AND LIMITATIONS ................................................................................... 18 4. ANSWERS TO THE EVALUATION QUESTIONS ..................................................... 19 EVALUATION QUESTION 1 ON RELEVANCE AND ADDED VALUE ....................................... 20 EVALUATION QUESTION 2 ON NATIONAL OWNERSHIP OF JSSR PROCESSES .................... 26 EVALUATION QUESTION 3 ON CIVIL MANAGEMENT BODIES & CIVIL OVERSIGHT MECHANISMS ................................................................................................................................ 32 EVALUATION QUESTION 4 ON JUSTICE REFORM ................................................................... 39 EVALUATION QUESTION 5 ON LAW ENFORCEMENT (INCL. BORDER MANAGEMENT) ..... 46 EVALUATION QUESTION 6 ON SUPPORT TO DDR ................................................................ 53 EVALUATION QUESTION 7 ON REGIONAL STABILITY ........................................................... 60 EVALUATION QUESTION 8 ON STATE SECURITY AND HUMAN SECURITY .......................... 66 EVALUATION QUESTION 9 ON COST-EFFECTIVENESS ......................................................... 75 EVALUATION QUESTION 10 ON COORDINATION AND COMPLEMENTARITY ................... 85 5. CONCLUSIONS ................................................................................................... 95 5.1 OVERALL ASSESSMENT .................................................................................................... 95 5.2 POLICY COMMITMENT AND FRAMEWORK ................................................................... 96 5.3 STRATEGY AND IMPLEMENTATION ............................................................................... 99 5.4 RESULTS AND IMPACT .................................................................................................. 102 5.5 INSTITUTIONAL CAPACITY AND PARTNERSHIPS ...................................................... 104 Final Report – Volume I November 2011 Table of Contents Thematic Evaluation of the European Commission Support to Justice and Security System Reform ADE - EGEVAL II 6. RECOMMENDATIONS ....................................................................................... 109 6.1 POLICY COMMITMENT AND FRAMEWORK ................................................................ 110 6.2 STRATEGY AND IMPLEMENTATION ............................................................................ 111 6.3 RESULTS AND IMPACT .................................................................................................. 115 6.4 INSTITUTIONAL CAPACITY AND PARTNERSHIPS ...................................................... 116 LIST OF FIGURES FIGURE 1 – EVALUATION PROCESS ................................................................................................ 3 FIGURE 2 – PYRAMID OF THE EVALUATION EXERCISE ................................................................ 9 FIGURE 3 – INTERVENTION LOGIC AND EQ COVERAGE ......................................................... 12 FIGURE 4 – COVERAGE OF EVALUATION CRITERIA AND KEY ISSUES BY EQ ......................... 14 FIGURE 5 – MAIN INFORMATION SOURCES AND TOOLS ............................................................ 15 FIGURE 6 – PERCENTAGE OF JSSR FUNDING COVERED BY EACH EVALUATION TOOL ....... 18 FIGURE 7 – CONCLUSIONS ............................................................................................................. 95 FIGURE 8 – RECOMMENDATIONS ............................................................................................... 109 LIST OF TABLES TABLE 1 – SET OF EVALUATION QUESTIONS .............................................................................. 13 TABLE 2 – TYPE OF PRINCIPLES REFERRED TO IN CSPS/RSPS REVIEWED ............................ 22 TABLE 3 – CROSS-CUTTING ISSUES REFERRED TO IN CSPS/RSPS REVIEWED ....................... 24 LIST OF BOXES BOX 1 – MAIN INVENTORY RESULTS ............................................................................................ 7 BOX 2 – PROMOTING DEMOCRATIC SECURITY THROUGH CIVIL SOCIETY CONTROL OF GOVERNMENT SECURITY SERVICES IN GUATEMALA ....................... 38 BOX 3 – COMMISSION SUPPORT TO JUSTICE REFORM IN GEORGIA ........................................ 42 BOX 4 – COMMUNITY POLICING IN INDONESIA ........................................................................ 50 BOX 5 – THE COMMISSION’S POTENTIAL ADDED VALUE IN THE DDR DOMAIN ................. 56 BOX 6 – BUILDING THE AFRICAN UNION (AU) CAPACITIES IN SSR ...................................... 64 BOX 7 – FACTORS IDENTIFIED IN THE EVALUATION WHICH HAVE CONTRIBUTED TO POSITIVE IMPACT ON CITIZENS’ WELFARE ................................................................... 74 BOX 8 – COMMISSION STAFF VIEWS ON CHANGES BROUGHT ABOUT BY THE EEAS ........... 80 BOX 9 – SUCCESSFUL COMBINATION OF INSTRUMENTS FOR SUPPORTING CRIMINAL JUSTICE REFORM IN GEORGIA ....................................................................................... 81 BOX 10 – SUCCESSFUL COORDINATION AND COMPLEMENTARITY BETWEEN THE COMMISSION AND COUNCIL JSSR INTERVENTIONS IN ACEH, INDONESIA ........... 90 Final Report – Volume I November 2011 Table of Contents Thematic Evaluation of the European Commission Support to Justice and Security System Reform ADE - EGEVAL II LIST OF ANNEXES IN VOLUME II ANNEX 1 : TERMS OF REFERENCE ANNEX 2 : TOOLS AND SOURCES FOR THE STRUCTURED EVALUATION QUESTIONS ANNEX 3 : DESCRIPTION FICHES OF THE 24 SELECTED INTERVENTIONS ANNEX 4 : COMPILED DATA COLLECTION GRIDS ANNEX 5 : DATA COLLECTION GRID FOR META-ANALYSIS OF EVALUATIONS ANNEX 6 : RESULTS OF CSP/RSP REVIEW ANNEX 7 : SURVEY TO EU DELEGATIONS AND RESULTS ANNEX 8 : ROM ANALYSIS ANNEX 9 : INVENTORY AND TYPOLOGY OF COMMISSION JSSR FUNDS (2001-2009) ANNEX 10 : JUSTICE AND SECURITY INDICATORS AT COUNTRY LEVEL ANNEX 11 : DEBRIEFING PRESENTATIONS OF FIELD MISSIONS ANNEX 12 : LIST OF PERSONS MET ANNEX 13 : BIBLIOGRAPHY Final Report – Volume I November 2011 Table of Contents Thematic Evaluation of the European Commission Support to Justice and Security System Reform ADE - EGEVAL II List of Acronyms1 ACP African, Caribbean and Pacific countries ACR Alta Consejeria para la Reintegracion, Presidencia de la Republica, Colombia