FINAL IN-DEPTH EVALUATION “Implementation of the Doha declaration: Towards the promotion of a culture of lawfulness” GLO/Z82 November 2020 UNITED NATIONS OFFICE ON DRUGS AND CRIME ~ INDEPENDENT EVALUATION SECTION UNITED NATIONS OFFICE ON DRUGS AND CRIME Vienna FINAL IN-DEPTH EVALUATION OF THE GLOBAL PROGRAMME “IMPLEMENTATION OF THE DOHA DECLARATION: TOWARDS THE PROMOTION OF A CULTURE OF LAWFULNESS” GLO/Z82 GLOBAL NOVEMBER 2020 UNITED NATIONS New York, 2020 UNITED NATIONS OFFICE ON DRUGS AND CRIME ~ INDEPENDENT EVALUATION SECTION This independent evaluation report was prepared by an evaluation team consisting of Punit Arora (Team Leader), Arvinder Sambei (judicial integrity expert), Sorin Dumitrașcu (prisoner rehabilitation and crime prevention expert), Ruta Avulyte (education for justice expert), Emanuel Lohninger (IES) and Katharina Kayser (IES). The Independent Evaluation Section (IES) of the United Nations Office on Drugs and Crime (UNODC) provides normative tools, guidelines and templates to be used in the evaluation process of projects. Please find the respective tools on the IES web site: http://www.unodc.org/unodc/en/evaluation/evaluation.html The Independent Evaluation Section of the United Nations Office on Drugs and Crime can be contacted at: United Nations Office on Drugs and Crime Vienna International Centre P.O. Box 500 1400 Vienna, Austria Telephone: (+43-1) 26060-0 Email: [email protected] Website: www.unodc.org Disclaimer The views expressed in this independent evaluation report are those of the evaluation team. They do not represent those of UNODC or of any of the institutions or Member States referred to in the report. All errors and omissions remain the responsibility of the evaluation team. © United Nations, November 2020. All rights reserved worldwide. The designations employed and the presentation of material in this publication do not imply the expression of any opinion whatsoever on the part of the Secretariat of the United Nations concerning the legal status of any country, territory, city or area, or of its authorities, or concerning the delimitation of its frontiers or boundaries. This publication has not been formally edited. CONTENTS CONTENTS .......................................................................................................................................................................2 LIST OF TABLES AND FIGURES ........................................................................................................................................3 ABBREVIATIONS AND ACRONYMS ................................................................................................................................4 MANAGEMENT RESPONSE .............................................................................................................................................5 EXECUTIVE SUMMARY ................................................................................................................................................10 SUMMARY MATRIX OF FINDINGS, EVIDENCE AND RECOMMENDATIONS ................................................................16 I. INTRODUCTION .........................................................................................................................................................19 BACKGROUND AND CONTEXT ...........................................................................................................................................19 EVALUATION METHODOLOGY ...........................................................................................................................................22 LIMITATIONS TO THE EVALUATION .....................................................................................................................................23 II. EVALUATION FINDINGS...........................................................................................................................................25 DESIGN AND RELEVANCE .................................................................................................................................................25 EFFICIENCY ..................................................................................................................................................................30 EFFECTIVENESS ..............................................................................................................................................................33 COHERENCE ..................................................................................................................................................................43 IMPACT........................................................................................................................................................................45 SUSTAINABILITY .............................................................................................................................................................48 HUMAN RIGHTS, GENDER EQUALITY AND LEAVING NO ONE BEHIND ........................................................................................50 III. CONCLUSIONS .........................................................................................................................................................52 IV. RECOMMENDATIONS .............................................................................................................................................55 V. LESSONS LEARNED AND BEST PRACTICES ...............................................................................................................57 LESSONS LEARNED .........................................................................................................................................................57 BEST PRACTICES ............................................................................................................................................................57 ANNEX I: EVALUATION FOLLOW-UP PLAN ..................................................................................................................59 ANNEX II: TERMS OF REFERENCE .................................................................................................................................65 ANNEX III: EVALUATION TOOLS: QUESTIONNAIRES AND INTERVIEW GUIDES .........................................................88 ANNEX IV: DESK REVIEW LIST ......................................................................................................................................91 ANNEX V: STAKEHOLDERS CONTACTED DURING THE EVALUATION..........................................................................95 ANNEX VI: SUPPORTING EVIDENCE .............................................................................................................................97 2 IN-DEPTH EVALUATION OF THE IMPLEMENTATION OF THE DOHA DECLARATION: TOWARDS THE PROMOTION OF A CULTURE OF LAWFULNESS (GLOZ82) LIST OF TABLES AND FIGURES Figure 1. UDP financial outlays at a glance ............................................................................................................ 21 Table 1. Evaluation survey participants at a glance .............................................................................................. 24 Figure 2. UDP: Overall stakeholder survey ratings ............................................................................................... 25 Figure 3. Words that best describe the UDP ......................................................................................................... 30 Table 2. Activities at a glance................................................................................................................................... 31 Table 3. UDP Staff at a glance .................................................................................................................................. 31 Table 4. Expected and actual outcome results ..................................................................................................... 33 Figure 4. Survey respondents' perspective on outcomes accomplished .......................................................... 36 Figure 5. Use and usefulness of UDP products ..................................................................................................... 37 Figure 6. Purpose for using publications ................................................................................................................ 37 Figure 7. Purpose for using capacity development ............................................................................................. 37 Figure 8. Interviewees' ratings for achievement on various aspects ................................................................. 45 Table 5. Illustrative anecdotal evidence on impact .............................................................................................. 46 Figure 9. Satisfaction reported on the feedback collected by the UDP............................................................. 97 Figure 10. Theory of Change .................................................................................................................................... 98 Figure 11. Results framework used for the Evaluation ........................................................................................ 99 Figure 12. Satisfaction with the UDP publications .............................................................................................. 108