Terminal Evaluation of Support to Rural Development in Georgia
Total Page:16
File Type:pdf, Size:1020Kb
TERMINAL EVALUATION OF SUPPORT TO RURAL DEVELOPMENT IN GEORGIA Hamid R. Chaudhry Team Leader/International Evaluation Consultant and Kartlos Gviniashvili – Local Consultant December 2018 CONTENTS Acknowledgement …………………………………………………….…………………………… Acronym and abbreviation ………………………………………………………………...….…… Executive summary ………………………………………………………………………...……… 1 1. INTRODUCTION AND BACKGROUND ……………………….……………..………………. 4 1.1. Introduction …………………………………………………………………………………… 4 1,2. Description of intervention …… ………………………….…………………………...……… 4 1.3. Contextual information ……………………………………………………………..………… 6 1.4. Evaluation purpose and objective ..……………….…………………………………………… 7 1.5 Evaluation scope ……………………………………………………………………………….. 8 1.6. Evaluation approach and methodology ……………………………...………………………… 9 2. EVALUATION FINDINGS ……………………………………………………………………… 12 2.1. Relevance and appropriateness …..…………………………………………………….……… 12 2.2. Efficiency ……………………………………………………………………………………… 13 2.2.1. Financial resources and management ………………………………………………..……. 14 2.2.2. Human resources (Staff input) ………………………………………………………...……. 17 2.2.3. Organization and management ………………………………………………………...…… 18 2.2.4. Monitoring and evaluation …………………………………………………………….……. 19 2.3. Effectiveness ………………………………………………… ……..………………………… 21 2.3.1. Output 1: Institutional capacity in place for the development and implementation of a 22 National Policy on Rural Development in Georgia. …………….......…………….…………………… 2.3.2. Output 2: Institutional capacity in place for the implementation of the Rural Development 25 in Ajara AR ..……………………………………………………………………………………………....... 2.4. Impact ………………………..……………….……………………………………………..… 28 2.5. Sustainability ……………………………………………………….……………………….… 30 2.6. Visibility …………………………………………………………..……………………...…… 31 2.7. Cross-cutting issues …...………………………………………………………………….…… 32 2.7.1. Gender equality ……………………………………………………………………….………. 32 2.7.2. Human rights …………………………………………………………………………..……… 32 2.7.3. Vulnerable …………………………………………………………………………….….……. 33 2.7.4. Environment/Climate change ……………………………………………………..………… 33 2.8. Theory of change ……………………………………………………………………………… 34 2.9. Synergy with other projects and donors ………………………………………………………. 34 2.10. Internal and external factors affecting the project …………………………………………… 36 3. CONCLUSION AND RECOMMENDATIONS ………………………………………………… 38 3.1. Conclusion ……………………………………………………………………………..……… 38 3.2. Key lessons learnt ……………………………………………………………………….…….. 38 3.3. Recommendations ……………………………………………………………………..….…… 40 Annexes …………………………………………………………………………………….…….…… 44 Annex 1: Terms of Reference ………………………………………………………………………… 45 Annex 2: Evaluation Matrix ………………………………………………………………..….……… 55 Annex 3: Documents cited ……………………………………………………………………………. 57 Annex 4a: Questionnaire for participating Ministry ……………………………………………………………... 58 Annex 4b: Questionnaire for FGD with participation of rural development IACC working group members …... 60 Annex 4c: Questionnaire for participating municipalities ……………………………………………………….. 61 Annex 5: List of persons met …………………………………………….……………………...….…. 63 Annex 6: Summary of meetings ………..……………………………………………………………... 66 Annex 7: Resource and Results Framework ...…………………………………………….…….……. 78 i Terminal Evaluation of Support to Rural Development in Georgia Acknowledgements Many persons contributed to this terminal evaluation their names are listed in Annex 4 with heartfelt thanks. Evaluation Team wishes to express its gratitude to United Nations Development Programme (UNDP) Country Office Georgia for its support on this evaluation. The evaluation team extends its sincere thanks to Mr. George Nanobashvili, Economic Development Team Leader UNDP CO for his rational comments. The team also owes thanks to Ms. Ketevan Khutsishvili, Programme Manager for Rural Development, European Union Delegate in Georgia. The Consultant is also indebted to Mr. Nodar Kereselidze, Project Manager, Georgia and Vakhtang Kontselidze Coordinator for Ajara Component, Support to Rural Development in Georgia (SRDG) Project and their teams is greatly appreciated for the constant support and providing the needed input to the mission. Special thanks of the Evaluation Team also go to Ms. Natia Berdzenishvili, Monitoring and Evaluation Coordinator SRDG who organized meetings and interviews with stakeholders and accompanied to the Ajara field visits. The cooperation extended by the representatives of the national and Ajara partner ministries, mayors, institutions and their staff during this evaluation was of great help and is gratefully acknowledged. The completion of this evaluation became possible only because of the freely given time and consideration of the Local Action Groups and AMAG beneficiary groups. And finally, the Team owes special thanks to Mr. Dimitri Mushtarauli who was instrumental in making our meetings succe4ssful with stakeholders in Tbilisi and visit to Ajara. In accordance with normal practice, the contents of this report are the sole responsibility of the author and can in no way be taken to reflect the views of the United Nations Development Programme. Evaluation Team Terminal Evaluation of Support to Rural Development in Georgia Acronyms and Abbreviations AA Association Agreement ACDA Agriculture Cooperatives Development Agency AMAG Georgian acronym meaning Active Citizens’ Local Group AP Action Plan APMA Agriculture Projects Management Agency AR Autonomous Republic CO Country Office CPD Country Programme Document CSOs Civil society organizations ENPARD The European Neighborhood Programme for Agriculture and Rural Development ERDN European Rural Development Network ESC ENPARD Steering Committee EStC ENPARD Stakeholder Committee EU European Union EUR Euro EU European Union FAO Food and Agriculture Organization FGD Focus group discussion GALAG Georgian Association of Local Action Groups GNTA Georgian National Tourism Administration GoG Government of Georgia GRDN Georgian Rural Development Network IACC Inter-Agency Coordination Council KPI Key Performance Indicator LAG Local Action Group LEADER A French acronym meaning Links between actions for the development of the rural economy LEPL Legal Entity of Public Law MEPA Ministry of Environmental Protection and Agriculture MRDI Ministry of Regional Development and Infrastructure MESD Ministry of Economy and Sustainable Development MoA Ministry of Agriculture NGO Non-Governmental Organization GRDN Georgian Rural Development Network RDC Rural Development Council RDS Rural Development Strategy RDP Rural Development Programmes SADG Strategy for Agriculture Development in Georgia SDG Sustainable Development Goal SRDG Support to Rural Development of Georgia ToC Theory of change ToR Terms of Reference UNDAF United Nations Development Assistance Framework UNDP United Nations Development Programme UNEG United Nations Evaluation Gro Terminal Evaluation of Support to Rural Development in Georgia Map of Georgia Terminal Evaluation of Support to Rural Development in Georgia EXECUTIVE SUMMARY Background The terminal evaluation of the ENPARD II ‘Support to Rural Development in Georgia’ (SRDG) Project commissioned by the United Nations Development Programme (UNDP) Country Office (CO) Georgia was undertaken by an independent evaluation team. The evaluation was conducted from 30th November to 31st December 2018. The country mission was carried out from 15th to 27th December. Substantive interviews and meetings were held with the project team, partner ministries and key stakeholders in Tbilisi and Ajara. SRDG with an input of US$ 2.90 million was implemented from July 2016 to December 2018. The main donor was European Union (EU) with an input of US$ 2.76 million and co-financed by the Ajara Autonomous Republic (AR) with a contribution of US$ 135,610. The Project was part of a wider range of the activities funded by the European Neighborhood Partnership Agriculture and Rural Development (ENPARD II). The overall purpose or the evaluation was to provide an independent assessment of the project in terms of progress and challenges, measure achievement of the project results, assess gaps and lessons learned and provide recommendations to guide implementation of the next phase of the project. The evaluation scope covered the project period from inception in June 2016 to December 2018. Methodology The evaluation of Project followed a mixed method approach through multiple methods to satisfactorily respond to the requirements of the evaluation. The primary data was collected through extensive interviews, vigorous consultations and focus group discussions with the Project team, various cadres of staff of lead and line ministries and institutions, local governments, Local Action Groups (LAGs)/ Active Citizens' Local Unions (AMAG), Civil Society Organizations (CSOs) and active citizens and all categories of the project beneficiaries. The secondary data for evaluation was drawn through desk review of relevant documents and reports produced by the project, UNDP, Governments of Georgia (GoG) and Ajara AR, development partners and other donors. The evaluation team did not encounter any major challenge during the process of evaluation except the limited time available that did not allow the mission to cover more stakeholders. Main Findings Relevance of the project objective and the strategy to the national and regional was strong, as it appropriately addressed the national and regional priorities and needs. In the course of achieving these objectives, the project effectively responded the Strategy for Agricultural Development in Georgia 2015-2020 (SADG) and he