Evaluation of Four NGO Implemented Programmes in Georgia
Total Page:16
File Type:pdf, Size:1020Kb
2018:23 Sida Decentralised Evaluation Pierre Walther Vera Devine Nino Partskhaladze Mikheil Kukava Evaluation of four NGO implemented programmes in Georgia Final Report Evaluation of four NGO implemented programmes in Georgia Final Report October 2018 Pierre Walther Vera Devine Nino Partskhaladze Mikheil Kukava Sida Decentralised Evaluation 2018:23 Sida Authors: Pierre Walther, Vera Devine, Nino Partskhaladze, Mikheil Kukava The views and interpretations expressed in this report are the authors’ and do not necessarily reflect those of the Swedish International Development Cooperation Agency, Sida. Sida Decentralised Evaluation 2018:23 Commissioned by Sida Copyright: Sida and the authors Date of final report: 2018-10-11 Published by Nordic Morning 2018 Art. no. Sida62173en urn:nbn:se:sida-62173en This publication can be downloaded from: http://www.sida.se/publications SWEDISH INTERNATIONAL DEVELOPMENT COOPERATION AGENCY Address: SE-105 25 Stockholm, Sweden. Office: Valhallavägen 199, Stockholm Telephone: +46 (0)8-698 50 00. Telefax: +46 (0)8-20 88 64 E-mail: [email protected]. Homepage: http://www.sida.se Table of contents Abbreviations and Acronyms .............................................................................................. viii Preface ..................................................................................................................................... ix Executive Summary ................................................................................................................. x 1 Introduction ......................................................................................................................... 1 1.1 Background .................................................................................................................. 1 1.2 Mandate ....................................................................................................................... 1 1.3 Implementation of the mandate .................................................................................... 2 1.4 Methodology ................................................................................................................. 3 1.5 Presention of the Results ............................................................................................. 3 2 Key results at the project level .......................................................................................... 4 2.1 General ......................................................................................................................... 4 2.2 Project NDI ................................................................................................................... 4 2.3 Project Orbeliani ........................................................................................................... 5 2.4 Core Funding TI Georgia .............................................................................................. 6 2.5 Project Clean-up Georgia, Phase III ............................................................................. 6 3 Key results at the program level ....................................................................................... 8 3.1 General ......................................................................................................................... 8 3.2 Effectiveness ................................................................................................................ 8 3.3 Contribution to Result Areas ......................................................................................... 9 3.4 Sustainability of the results ......................................................................................... 11 4 Potential for more synergies ........................................................................................... 13 4.1 General ....................................................................................................................... 13 4.2 Sector dialogue........................................................................................................... 14 4.3 Gender ....................................................................................................................... 14 4.4 Perspective of the poor ............................................................................................... 15 4.5 Human Rights Based Approach ................................................................................. 16 4.6 Environment Integration ............................................................................................. 16 4.7 Conflict sensitivity ....................................................................................................... 16 5 Other lessons learnt ......................................................................................................... 18 T A B L E O F C O N T E N TS 5.1 Keep a good mix......................................................................................................... 18 5.2 Selection criteria ......................................................................................................... 18 5.3 Expertise in planning .................................................................................................. 19 5.4 Aid modalities ............................................................................................................. 19 6 Main conclusions .............................................................................................................. 23 6.1 Program Level ............................................................................................................ 23 6.2 Project Level ............................................................................................................... 24 7 Recommendations to Embassy of Sweden .................................................................... 25 7.1 Program Level ............................................................................................................ 25 7.2 Project Level ............................................................................................................... 25 Annex 1 – Terms of Reference.............................................................................................. 26 Annex 2 – Program of the mission ....................................................................................... 36 Annex 3 – Methods applied ................................................................................................... 37 Annex 4 – List of persons met .............................................................................................. 38 Annex 5 – List of documents reviewed ................................................................................ 39 Annex 6 – Evaluation Report NDI ......................................................................................... 40 Annex 7 – Evaluation Report Orbeliani ................................................................................ 101 Annex 8 – Evaluation Report TI Georgia .............................................................................. 138 Annex 9 – Clean-Up Georgia, Phase III ................................................................................ 170 Annex 10 – Overview Sida result areas ............................................................................... 223 Abbreviations and Acronyms AA Association Agreement CSO Civil Society Organisations CT Consultant Team DAC Development Assistance Committee ET Evaluation Team EU European Union GFSIS Rondeli Foundation HRB Human Rights Based M&E Monitoring and Evaluation MEAL Monitoring, evaluation, accountability, learning NDI National Democratic Institute NGO Non-governmental Organisation OECD Organisation for Economic Co-operation and Development SEK Swedish Krona Sida Swedish International Development Cooperation Agency TI Transparency International ToC Theory of Change UFE Utilization-Focused Evaluation UN United Nations USAID United States Agency for International Development Preface NIRAS Indevelop was contracted by the Embassy of Sweden in Georgia to con- duct and evaluation of the Swedish support to four NGOs in Georgia. Instead of con- ducting these evaluations in parallel, the Embassy of Sweden decided to join the evaluations into one single evaluation mandate, thereby allowing the Evaluation Team (ET) to also draw some overall conclusions and recommendations on the Em- bassy of Sweden’s support to Civil Society Organisations (CSO) in Georgia. The evaluation was undertaken between June and September 2017. Separate eval- uations was undertaken for the following four NGO projects: National Democratic Institute (NDI) Georgia; Orbeliani; Transparency International (TI) Georgia, and Clean-Up Georgia. The latter is implemented by three environmental NGOs (Geor- gian Society of Nature Explorers ”Orchis”, Greens Movement of Georgia/Friends of Earth Georgia, and Ecological Awareness and Waste Management). The main text in the present report summarises the key findings and recommenda- tions related to the program level. It is addressed mainly to the Embassy of Sweden, as an input into the development of principles and strategies of how to work with CSO in Georgia. For each of the above mentioned NGO projects, there is a separate evaluation re- port, addressed both to Sida and the concerned NGO, and to be commented upon as a stand-alone report. These evaluation reports are presented in Annexes 6 to 9 of the present