Mid-Term Performance Evaluation of the Justice for All Program
Total Page:16
File Type:pdf, Size:1020Kb
Insert high-quality photograph representing the project being evaluated to replace this instruction and fill this text box. Mid-term Performance Evaluation of the Justice for All Program November 2015 This publication was produced at the request of the United States Agency for International Development. It was prepared independently by Marilyn Zelin, Kyra Buchko, Dr. Uttam Das, and Naim Mostafa for Social Impact, Inc. Cover Photo: JFA Program participants in a focus group discussion. Photo Credit: Marilyn Zelin) MID-TERM PERFORMANCE EVALUATION OF THE JUSTICE FOR ALL PROGRAM November 17, 2015 USAID Contract AID-OAA-I-10-00003 Task Order AID-388-TO-12-00001 DISCLAIMER The authors’ views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government. CONTENTS Acronyms............................................................................................................................................................................ iv Executive Summary .......................................................................................................................................................... vi Introduction ................................................................................................................................................................... vi The Development Problem and USAID’s Response ........................................................................................... vi Purpose of the Evaluation ......................................................................................................................................... vii Evaluation Methodology ............................................................................................................................................ vii Findings and Conclusions .......................................................................................................................................... vii Recommendations ....................................................................................................................................................... ix Lessons Learned ........................................................................................................................................................... xi Introduction ........................................................................................................................................................................ 1 The Development Problem and USAID’s Response ................................................................................................. 3 The Development Problem ........................................................................................................................................ 3 USAID’s Response ........................................................................................................................................................ 4 Development Hypothesis ............................................................................................................................................ 5 Purpose of the Evaluation ................................................................................................................................................ 7 Evaluation Purpose ........................................................................................................................................................ 7 Evaluation Questions .................................................................................................................................................... 7 Evaluation Methodology ................................................................................................................................................... 8 Data Collection Methods ............................................................................................................................................ 8 Limitations....................................................................................................................................................................... 9 Evaluation Process ........................................................................................................................................................ 9 Findings and Conclusions ............................................................................................................................................... 11 Recommendations ........................................................................................................................................................... 28 EQ Results and Effectiveness (Objective 1) .......................................................................................................... 28 EQ Results and Effectiveness (Objective 2) .......................................................................................................... 28 EQ Results (Objective 3) .......................................................................................................................................... 29 EQ Management .......................................................................................................................................................... 29 EQ Relevance ............................................................................................................................................................... 30 EQ Client Satisfaction ................................................................................................................................................ 30 Lessons Learned ............................................................................................................................................................... 32 Annexes ............................................................................................................................................................................. 34 Annex I: Evaluation Scope of Work ....................................................................................................................... 35 Mid-term Performance Evaluation of the Justice for All Program ii Annex II: Evaluation Design Matrix ......................................................................................................................... 49 Annex III: Data Collection Instruments ................................................................................................................. 54 Annex IV: Documents Reviewed............................................................................................................................. 61 Annex V: Map of Evaluation Sites ............................................................................................................................ 63 Annex VI: Persons Interviewed ............................................................................................................................... 64 Annex VII: Disclosure of any Conflicts of Interest ............................................................................................. 73 Tables and Figures Figure 1. JFA’s Results Framework ................................................................................................................................ 4 Table 1. Summary of KIIs and FGDs Conducted ....................................................................................................... 8 Mid-term Performance Evaluation of the Justice for All Program iii ACRONYMS ADR Alternative Dispute Resolution BDGPE Bangladesh Democracy and Governance Programs’ Evaluations BLAST Bangladesh Legal Aid and Services BWJA Bangladesh Women Judges Association CCN Cooperating Country National CG Caretaker Government COP Chief of Party DCOP Deputy Chief of Party DLAC District Legal Aid Committee DLAO District Legal Aid Officer EQ Evaluation Question FGD Focus Group Discussion GiZ German Society for International Cooperation GOB Government of Bangladesh IFCE International Framework for Court Excellence IP Implementing Partner IR Intermediate Result JATI Judicial Administration Training Institute JFA Justice for All JSF Justice Sector Facility JUST Judicial Strengthening KI Key Informant KII Key Informant Interviews LASA Legal Aid Services Act M&E Monitoring and Evaluation MOLJPA Ministry of Law, Justice, and Parliamentary Affairs NCSC National Center for State Courts NGO Non-Governmental Organization NLASO National Legal Aid Services Organization Mid-term Performance Evaluation of the Justice for All Program iv ODG Office of Democracy and Governance PMP Performance Management Plan RFA Request for Applications SOW Scope of Work TOT Training of Trainers ULAC Upazila Legal Aid Committee UNDP United Nations Development Program UP Union Parishad UPLAC Union Parishad Legal Aid Committee USAID United States Agency for International Development USG United States Government WiJI Women in Justice Initiative Mid-term Performance Evaluation of the Justice for All Program v EXECUTIVE SUMMARY INTRODUCTION The United States Agency for International Development (USAID)’s Bangladesh Office of Democracy and Governance contracted with Social Impact, Inc. to undertake a mid-term performance evaluation of the Justice for All (JFA) Program, implemented by the National Center for State Courts (NCSC). The JFA Program has a performance period of five years, from