Mid-Term Evaluation of NGO Programmes Under EEA Grants 2009-2014
Total Page:16
File Type:pdf, Size:1020Kb
Mid-term evaluation of NGO Programmes under EEA Grants 2009-2014 Evaluation report 1/2015 Photo credit: School of Success, Lithuanian NGO Programme OUT OF THE BOX: Providing Oxygen to Civil Society MID TERM EVALUATION OF THE NGO PROGRAMMES UNDER THE EEA AND NORWAY GRANTS (2009-2014) PART ONE: MAIN EVALUATION REPORT Sofia, December 2014 Evaluation team: Mariana Milosheva-Krushe (Team leader) Anna Ivanova, Andres Falconer, Czeslaw Walek, Georgi Genchev, David Krushe, Ioana Derscanu, Jennifer Tanaka, Jolanta Blažaitė, Magdalena Arczewska, Zinta Miezaine Strategic Review Group Assya Kavrukova, Dolores Neagoe, Rayna Gavrilova This report has been prepared as a result of an independent external review by CREDA Consulting Ltd., commissioned by the Financial Mechanism Office of the EEA and Norway Grants. The views expressed in the document are those of the expert team of CREDA Consulting Ltd. and do not necessarily reflect those of the Financial Mechanism Office. TABLE OF CONTENTS EXECUTIVE SUMMARY .............................................................................................................V INTRODUCTION ....................................................................................................................... XII CHAPTER 1: STRATEGIC RELEVANCE AND COHERENCE ............................................ 1 I. Why Civil Society Programmes? ............................................................................................................................... 1 1. Key contextual trends .............................................................................................................................................. 1 2. Civil Societies in beneficiary countries: key assets, gaps and challenges ............................................................... 2 II. The Response: EEA Grants NGO Programmes’ Strategies .................................................................................. 5 1. The New Focus and Overall Strategic Framework of the EEA Grants Support to Civil Society 2009-2014 ......... 5 2. NGO Programmes Strategy Frameworks in the Beneficiary Countries .................................................................. 8 3. Relevance of the strategies .................................................................................................................................... 12 CHAPTER 2. EFFICIENCY AND EFFECTIVENESS OF MANAGEMENT SET UP AND PROCEDURES ............................................................................................................................. 15 I. The Operators of the NGO Programmes ............................................................................................................... 15 1. The Process of Selection and Appointing of the Operators of the NGO Programme............................................ 15 2. The Results of the Selection .................................................................................................................................. 17 3. Profile of the Management Set Up on Country Level: Strengths and Challenges. ................................................ 18 4. Challenges of management provisions and resources ........................................................................................... 21 5. Interaction with the National Focal Points and linkage with other EEA and Norway Grants Programmes .......... 24 II. The FMO as a Programme Operator .................................................................................................................... 28 1. The challenges of the task ..................................................................................................................................... 28 2. The human resource challenges ............................................................................................................................. 29 3. Who has the responsibility?................................................................................................................................... 30 4. Feedback on the performance of the FMO as a PO of the NGO Programmes ...................................................... 32 5. Advantages of direct contracting of the NGO Programmes .................................................................................. 32 CHAPTER 3. GRANT SYSTEMS AND PROCESSES ............................................................ 34 I. Application process .................................................................................................................................................. 34 1. Promotion .............................................................................................................................................................. 34 2. Calls for application process: design, organization and assistance to applicants .................................................. 34 II. Efficiency and Effectiveness of Project Selection ................................................................................................. 35 1. The Overall Guiding Procedures ........................................................................................................................... 35 2. Organization of the Selection Process in the Different Countries ......................................................................... 36 3. Efficiency and Effectiveness of the Selection Procedures ..................................................................................... 37 III. Contracting and Reporting Processes .................................................................................................................. 42 CHAPTER 4. EFFECTIVENESS OF SUPPORT TO PROJECTS ......................................... 47 I. Mapping Results ....................................................................................................................................................... 47 II. So what? Mapping progress towards planned outcomes ..................................................................................... 50 1. The Overall Outcome Map .................................................................................................................................... 50 2. Distribution per horizontal concerns and crosscutting issues ................................................................................ 52 3. The outcomes and outputs challenges ................................................................................................................... 53 4. Data Sources for the Programme Monitoring: The Challenges of the Documentation Reporting and Information System (DoRIS) ........................................................................................................................................................ 56 5. An Attempt to Cluster the Existing Outcomes ...................................................................................................... 57 6. Potential Effects of supported projects towards the outcomes .............................................................................. 58 7. Visibility ................................................................................................................................................................ 64 8. Potential long term results and effects from provided support as seen from Project promoters ............................ 66 9. Sustainability ......................................................................................................................................................... 68 CHAPTER 5. EFFECTIVENESS OF SPECIFIC COMPONENTS COMMON FOR ALL COUNTRIES ................................................................................................................................. 71 I. Effectiveness of Capacity Building .......................................................................................................................... 71 1. Effectiveness of capacity building approaches applied by Operators ................................................................... 71 ii 2. Feedback from NGOs on Capacity Building – what works? ................................................................................. 74 3. Effectiveness of the Capacity Building Matrix Developed Centrally and Applied Locally .................................. 75 II. Bilateral relations .................................................................................................................................................... 77 1. Why Bilateral cooperation among civil societies .................................................................................................. 77 2. Implementation and Results .................................................................................................................................. 78 3. Effectiveness and Bottlenecks ............................................................................................................................... 79 4. Rethinking and redesigning Bilateral Cooperation................................................................................................ 80 III. Complementary Action ......................................................................................................................................... 81 CHAPTER 6. MAKING A DIFFERENCE? CONCLUSIONS AND EMERGING LESSONS LEARNED. ...................................................................................................................................