Evaluation of the UNICEF Albania Country Programme 2017-2021

Total Page:16

File Type:pdf, Size:1020Kb

Evaluation of the UNICEF Albania Country Programme 2017-2021 Evaluation of the UNICEF Albania Country Programme 2017-2021 Final Report December 2020 Disclaimer: This is a publication by the independent evaluation team of IOD PARC. The analysis and recommendations of this report do not necessarily reflect the views of UNICEF. Readers are encouraged to use material from this report for their own publications. As copyright holder, UNICEF in Albania requests due acknowledgement and a copy of the publication. For further information, please contact: UNICEF Albania Country Office Skenderbej Street, UN House Bld, 3rd floor Tirana, Albania Telephone: +355 4 45 48 400 Email: [email protected] Suggested Citation of the Report: O’Callaghan, B. Duci, V. Kacapor-Dzihic, Z. (2020) “Evaluation of the UNICEF Albania Country Programme 2017-2021”. UNICEF / IODPARC / IMC Worldwide. Evaluation of the UNICEF Albania Country Programme 2017-2021 Final Report December 2020 Acknowledgements Sincere thanks to Ashley Wax at UNICEF Europe and Central Asia Regional Office, Dr Roberto De Bernardi, UNICEF Albania Country Representative, Elda Hallkaj and the staff members of the UNICEF Albania Country Office, as well as the members of the Evaluation Reference Group for providing the evaluation team with feedback, information and support throughout the evaluation period. The evaluation was undertaken by IOD PARC’s consortium consisting of IMC Worldwide, Child Frontiers, Development Analytics and M-Vector. The evaluation team members are Brian O’Callaghan (Team Leader, IMC Worldwide), Veronika Duci and Zehra Kacapor-Dzihic. Additional research was carried out by Joy McCarron. The evaluation was supported by Project Managers - Karolina Mclellan and Elisa Radaelli. The evaluation direction and quality assurance were provided by Jo Kaybryn. Contents Acronyms and Abbreviations vi Executive Summary viii Overview of the Country Programme viii Purpose of the Evaluation and its Audiences viii Evaluation Methodology ix Key Findings ix Relevance ix Effectiveness x Efficiency xii Sustainability xii Synergies and coherence xiii Conclusions xiv Lessons Learned xvi Recommendations xvi 1. Introduction 1 1. 1 Purpose, objectives and scope of the evaluation 1 1. 2 Country context 3 1.2.1 Geographic and demographic context 3 1.2.2 Political context and government priorities 4 1.2.3 Social development and gender profile 6 1.2.4 Children, youth and families 7 1.2.5 Governance and civil society 9 1. 3 Country Programme components and goals 9 2. Methodology 12 2.1 Evaluation framework 12 2.1.1 Departures from the Terms of Reference 12 2.2 Data collection, data analysis and sampling strategy 13 2.3 Limitations and constraints faced by the evaluation 14 2.4 Management of the evaluation 15 2.5 Ethical considerations 15 3. Findings of the Evaluation 17 3.1 Relevance 17 3.1.1 Evaluation Question 1 UNICEF’s strategic positioning 17 3.1.2 Evaluation Question 2 Implementation strategies 23 3.2 Effectiveness 26 3.2.1 Evaluation Question 3 Organizational structure 26 3.2.2 Evaluation Question 4 Achievement of results 30 3.2.3 Evaluation Question 5 Gender mainstreaming 52 3.3 Efficiency 55 3.3.1 Evaluation Question 6 Resourcing 55 3.4 Sustainability 61 3.4.1 Evaluation Question 7 Long-term alignment of programming 61 3.5 Synergies/Coherence 64 3.5.1 Evaluation Question 8 Internal coherence 64 3.5.2 Evaluation Question 9 Coordination 66 4. Conclusions 70 5. Lessons Learned 74 6.Recommendations 76 Annexes 80 1. Terms of Reference 2. Reconstructed Theory of Change/Evaluation Matrix 3. List of Interviewees 4. Documentary Evidence 5. Data Collection Instruments 6. Evolution of UNICEF Albania CPD Priority Results Areas 7. UNICEF Albania Programme Locations 8. Gender Integration and Targeting in AWPs, COARs, RAMs and SMQs 2017–2019 9. Results Reporting Analysis 10. UNICEF Albania Stakeholders 11. Evaluation Reference Group Members 12. Human Rights Analysis 13. Evaluation Team List of Tables Table 1: UNICEF Albania country programme outcomes and outputs 2017–2021 11 Table 2: Progress in realization of child rights reported by UNICEF stakeholders 31 Table 3: Summary of UNICEF Albania results assessment module reporting against indicators 32 Table 4: Selected UNICEF Albania results assessment module indicators 33 Table 5: UNICEF Albania expenditure by programme area (2017–2019) 56 Table 6: UNICEF Albania donor funding in 2017–2019 58 Table 7: UNICEF Albania financial breakdown by partners 60 List of Figures Figure 1: Map of Albania 3 Figure 2: Young persons’ perspectives on rights in Albania (U-Report Survey 2020) 35 Figure 3: UNICEF Albania planned vs. utilized annual budgets 2016–2019 56 Figure 4: UNICEF Albania regular resources vs other resources vs management/admin 56 Figure 5: UNICEF Albania budgets 2017–2019 by programme outcome 57 Figure 6: UNICEF Albania financial allocations by partner type 60 Acronyms and Abbreviations C4D Communication for Development CEDAW Convention on the Elimination of all Forms of Discrimination Against Women CFC Child Friendly City CFS Child Friendly Spaces CO Country Office (UNICEF) COAR Country Office Annual Report COVID-19 Coronavirus Disease 2019 CP Country Programme CPD Country Programme Document CPE Country Programme Evaluation CRC Committee on the Rights of the Child CRM Child Rights Monitoring CSO Civil Society Organization DAC Development Assistance Committee DaO Delivering as One DCM Decisions of the Council of Ministers DFID Department for International Development DHS Demographic and Health Survey DRR Disaster Risk Reduction ECARO Europe and Central Asia Regional Office (UNICEF) ECD Early Childhood Development ER Emergency Response ERG Evaluation Reference Group ESRC Economic and Social Research Council EU European Union EUROSTAT Statistical Office of the European Union EVAW End Violence Against Women FP Focal Point GAP Gender Action Plan GDP Gross Domestic Product GPR Gender Programmatic Review HACT Harmonized Approach to Cash Transfer HCT Humanitarian Cash Transfers HDI Human Development Index IFI International Financial Institution ILO International Labour Organization INSTAT Instituti Shqiptar i Statistikës (Albanian Institute of Statistics) IOM International Organization for Migration IR Inception Report JWP Joint Working Plan KAP Knowledge, Attitudes and Practices LNB Leave No One Behind M&E Monitoring and Evaluation MAPS Mainstreaming, Acceleration, and Policy Support MCH Maternal and Child Health MESY Ministry of Education, Sports and Youth MoHSP Ministry of Health and Social Protection of the Population MNCH Maternal, Newborn and Child Health Care NSDI National Strategy for Development and (European) Integration NGO Non-governmental Organization OECD Organisation for Economic Co-operation and Development OOSC Out-of-School Children OR Other Resources PF4C Public Finance for Children PoCSD Programme of Cooperation for Sustainable Development PSS Psychosocial Support RAM Results Assessment Module RO Regional Office RR Regular Resources SDGs Sustainable Development Goals SitAn Situation Analysis SMQ Strategic Monitoring Questions SMR Strategic Moment of Reflection SRH Sexual and Reproductive Health TB Tuberculosis ToC Theory of Change ToR Terms of Reference UMIC Upper Middle-Income Country UN United Nations UNDAF United Nations Development Assistance Framework UNEG United Nations Evaluation Group UNFPA United Nations Population Fund UNICEF United Nations Children’s Fund WB World Bank WHO World Health Organization 10 EVALUATION OF THE UNICEF ALBANIA PROGRAMME 2017-2021 EXECUTIVE SUMMARY FINAL REPORT 11 12 EVALUATION OF THE UNICEF ALBANIA PROGRAMME 2017-2021 his report presents the findings of the contributions to realization of child rights in Albania, evaluation covering the entire UNICEF portfolio including inequities and gender; and during the first four years (2017- August 2020) 3. Identify good practices and lessons and draw T of the five-year programme as articulated in its forward-looking recommendations that can inform 2017–2021 Country Programme Document (CPD), and the development of the next country programme. successive implementation strategies derived from this. The intended primary users of this evaluation are the UNICEF Albania Country Office and the Government Overview of the Country of Albania, as well as other United Nations agencies, Programme UNICEF partners, and other UNICEF offices in the region, including the UNICEF Europe and Central Asia With the initial budget of US$ 16,345,000, and in Regional Office (ECARO). partnership with government ministries, agencies and departments at national, regional and district level, the overall goal of the Albania Country Programme by 2021 Evaluation Methodology is “the progressive realization of rights of all children in Albania, accompanied by the reduction of equity The evaluation Terms of Reference proposed nine key gaps, to be based on effective child-focused policies, evaluation questions (EQs), focusing on the OECD systematically enforced accountabilities with adequate Development Assistance Committee (DAC) criteria of public resources, and strengthened respect for and relevance, effectiveness, efficiency, sustainability and protection of children’s rights”. synergies and coherence. In the inception phase, some revisions were made to the evaluation sub-questions to With an equity focus on vulnerable and marginalized streamline data collection and analysis, with review and children (for example children with disabilities, from approval from the Evaluation Reference Group (ERG). ethnic minorities and/or out-of-school), the intended long-term
Recommended publications
  • Speakers Bios 11 October 2019
    Annual Conference co-organized by the Bank of Albania and the London School of Economics and Political Science (LSE) RETHINKING THE FUTURE SIZE, STRUCTURE, OF BANKING OWNERSHIP, POLICIES in Emerging Europe AND INCENTIVES SPEAKER’S BIOS Gent SEJKO Governor Bank of Albania Mr. Gent Sejko is the Governor of the Bank of Albania and Chairman of its Supervisory Council, as of February 2015. He was voted in as Governor by the Parliament of the Republic of Albania on 5 February 2015, upon the Decree of the President of the Republic of Albania. Mr. Sejko graduated from the Faculty of Economics, University of Tirana, in 1991, in industrial economics. He earned a Master's degree in International Accounting and Financial Management (MAcc) from the University of Glasgow, Scotland, in 1997, with his thesis on the "Role of banks and privatisation of banks in economies in transition". Mr. Sejko started his banking career in 1992 as Head of Credit Division of the National Commercial Bank. Then he worked as an Inspector at the Supervision Department of the Bank of Albania, until 1998, while pursuing his post-university studies. During 1998-2000, Mr. Sejko worked for Deloitte & Touche as senior auditor and consultant, responsible for the management of audit procedures. In the years 2001-2002, he worked for the American Bank of Albania as Head of Internal Audit and Compliance Division, and engaged in extending the branches network of the bank. During 2002-2004, Mr. Sejko returned to the Bank of Albania's Supervision Department as Head of Division for on-site examinations.
    [Show full text]
  • Evaluation of the UNICEF Albania Country Programme 2017-2021
    Evaluation of the UNICEF Albania Country Programme 2017-2021 Final Report December 2020 Disclaimer: This is a publication by the independent evaluation team of IOD PARC. The analysis and recommendations of this report do not necessarily reflect the views of UNICEF. Readers are encouraged to use material from this report for their own publications. As copyright holder, UNICEF in Albania requests due acknowledgement and a copy of the publication. For further information, please contact: UNICEF Albania Country Office Skenderbej Street, UN House Bld, 3rd floor Tirana, Albania Telephone: +355 4 45 48 400 Email: [email protected] Suggested Citation of the Report: O’Callaghan, B. Duci, V. Kacapor-Dzihic, Z. (2020) “Evaluation of the UNICEF Albania Country Programme 2017-2021”. UNICEF / IODPARC / IMC Worldwide. Evaluation of the UNICEF Albania Country Programme 2017-2021 Final Report December 2020 Acknowledgements Sincere thanks to Ashley Wax at UNICEF Europe and Central Asia Regional Office, Dr Roberto De Bernardi, UNICEF Albania Country Representative, Elda Denaj and the staff members of the UNICEF Albania Country Office, as well as the members of the Evaluation Reference Group for providing the evaluation team with feedback, information and support throughout the evaluation period. The evaluation was undertaken by IOD PARC’s consortium consisting of IMC Worldwide, Child Frontiers, Development Analytics and M-Vector. The evaluation team members are Brian O’Callaghan (Team Leader, IMC Worldwide), Veronika Duci and Zehra Kacapor-Dzihic. Additional research was carried out by Joy McCarron. The evaluation was supported by Project Managers - Karolina Mclellan and Elisa Radaelli. The evaluation direction and quality assurance were provided by Jo Kaybryn.
    [Show full text]
  • ALBANIA TOURISM for SOLIDARITY and SUSTAINABILITY 14Th January 2020 HOTEL MARITIM PLAZA , TIRANA - ALBANIA
    ALBANIA TOURISM FOR SOLIDARITY AND SUSTAINABILITY 14th January 2020 HOTEL MARITIM PLAZA , TIRANA - ALBANIA O rganized by the Ministry of Tourism and Environment of Albania in cooperation with the UNWTO SUMMIT ON TOURISM FOR SOLIDARITY AND SUSTAINABILITY The natural disasters creates sometimes humanitarian crisis in which thousand of people are in need of an immediate shelter. The earthquake of 26 November 2019 in Albania, where thousands of people lost their homes and more then 5000 people where accommodated within 24 hours in hotels, is an example that the Tourist Industry is not just to make profit and create income for the country but with its structures it is also a solid and valuable support in handling of humanitarian crisis. This can be a value that through UNWTO all of us should cherish and develop further. Participants are welcomed to address their views on this subject. The earthquake of 26 November 2019 in Albania, left behind a lot of damages in houses, buildings and structures. Luckily enough, the Tourist Industry Structures resisted without damage the earthquake and moreover where able within 24 hours to mobilize their staff and accommodate more then 5000 people in need of a shelter. The experiences faced during this period of time will be part of the discussions from the participants. H.E Edi Rama Prime Minister Albania Mr. Blendi Klosi Executive Director Alessandra Priante Mr.Harry Theoharis Minister of Tourism and UNWTO Director of Department for Europe Minister of Tourism Environment UNWTO Greece Albania Mrs. Anna Laura Orrico Mr.Zdravko Pocivalsek Mr. Kreshnik Bekteshi Mr. Lyuben Kanchev State Secretary Minister of Economic Dev & Minister of Economy Dep.
    [Show full text]
  • LOCAL THIRD SECTOR ORGANIZATIONS: a MISSING LINK in GLOBAL DEVELOPMENT the Case of Albania
    LOCAL THIRD SECTOR ORGANIZATIONS: A MISSING LINK IN GLOBAL DEVELOPMENT The case of Albania Lorna Qesteri The Bartlett School of Planning, University College London (UCL) This thesis is submitted in support of the Ph.D. degree 23 July 2020 1 I, Lorna Qesteri, confirm that the work presented in this thesis is my own. Where information has been derived from other sources, I confirm that this has been indicated in the thesis. London, 23 July 2020 Signature: 2 Abstract Global development started nearly seventy years ago, led by global north governments towards the development of the global south, continues to generate heated debates regarding its most effective approaches. These approaches have changed significantly from the initial growth- centered and linear to become more human-centered and context-driven, including a new array of actors from global south governments themselves, to private and third sectors. The latter grew particularly in size and relevance in the early nineties with the fall of communist regimes across Central and Eastern Europe and the economic crisis in Sub - Saharan Africa. At this time international third sector organizations became the main channel of absorbing and implementing bi-lateral funding in the global south. The rise of the third sector has also been accompanied with increased skepticism from both the media and the public regarding its efficiency and effectiveness. Examples include their high administrative costs (as a ratio to their activities) or being donor-led as compared to needs-led. While research and data on international third sector organizations are increasing, very little is known about local third sector organization and their role in development.
    [Show full text]
  • Conference Brochure
    INTEGRATION OF PUBLIC HEA L T H SER V ICES INT O PRIMA R Y H EAL T H C A R E th 1 Integration of Public Health Services into Primary Health Care 2021 INTEGRATION OF PUBLIC HEA L T H SER V ICES INT O PRIMA R Y H EAL TINH CTEGRA R E ATION OF PUBLIC HEA L T H SER V ICES th INT O PRIMA R Y H EAL T H C A R E th INTEGRATION OF PUBLIC HEA L T IHN SETEGRR V ICES AINTIOTEGRN ATION OF PUBLIC HEA L TOFH SEPUBLICR V ICE HES A L T H SER V ICES INT O PRIMA R Y H EAINLT TOH PRIM C A RAER Y H INEATLOT HPRIM C A RAER Y H EAL T H C A R E th th th 7th INTERNATIONAL PUBLIC HEALTH CONFERENCE, ALBANIA, 2021 “Integration of Public Health services into Primary Health Care” TIRANA, 23 MARCH 2021 Organization The International Public Health Conference is organized by the Institute of Public Health under the auspices of the Albanian Ministry of Health and Social Protection. Scientific Committee Albana Fico Alban Ylli Gentiana Qirjako Silva Bino Arben Luzati Arben Gjata Xheladin Draçini Suela Këlliçi Ulrich Laaser, Germany Helmut Brand, the Netherlands Charles Hardy, USA Greg Evans, USA Jadranka Bozikov, Croatia Organizing Committee Vesna Bjegovic, Serbia Gentiana Qirjako Doncho Donev, FYROM Rudina Çumashi Naser Ramadani, Kosovo Ervin Toçi Shaban Mehmeti, FYROM Jolanda Hyska Albana Ahmeti Secretariat Blerina Kodra Malvina Pisli Romina Hala 2021 Integration of Public Health Services into Primary Health Care 4 w Organizing Committee Gentiana Qirjako Rudina Çumashi Ervin Toçi Jolanda Hyska Albana Ahmeti 5 Integration of Public Health Services into Primary Health Care 2021 International Public Health Conference The 7th International Public Health Conference is themed “Integration of Public Health services into Primary Health Care” and it is held on 23 March 2021 in Tirana, Albania.
    [Show full text]
  • Book Proceedings of ICSNS XV, Brussels – June 16 2021
    Conference proceedings ICSNS XV - 2021 FIFTEENTH INTERNATIONAL CONFERENCE ON: “SOCIAL AND NATURAL SCIENCES – GLOBAL CHALLENGE 2021” 16 June Brussels Organized by International Institute for Private- Commercial- and Competition Law (Austria) in Partnership with Bielefeld University of Applied Sciences (Germany), Keiser University (USA), Institute of History and Political Science of the University of Białystok (Poland) and School of American Law (Greece) Book of proceedings FIFTEENTH INTERNATIONAL CONFERENCE ON: “SOCIAL AND NATURAL SCIENCES – GLOBAL CHALLENGE 2021” (ICSNS XV-2021) Brussels, 16 June 2021 Organized by International Institute for Private- Commercial- and Competition Law (Austria) in Partnership with Institute of History and Political Science of the University of Białystok (Poland-EU), Keiser University (USA), Bielefeld University of Applied Sciences (Germany), School of American Law (Greece) Edited by: Dr. Lena Hoffman 1 International Scientific Committee ICBLAS III-2015 ICBLASICSNS(ICSNSICIS V- IVXII-2021) I- 2016 -2017 2016 Prof. Dr. Helmut Flachenecker, Universität Wuerzburg (Germany) Prof. Dr. John Rowley Gillingham, University of Missouri (USA) Prof. Dr. Jürgen Wolfbauer, Montanuniversitaet Leoben (Austria) Prof. Dr. Jürgen Wolfb auer, Montanuniversität Leoben (Austria) Prof.Prof. Dr. Dr. John H. Rowley Ekkehard Gillingham, Wolff , Universität University Leipzigof Missouri (Germany) (USA) Prof.Prof. Em. Dr. LinditaDr. Karl Milo Otwin (Lati) Becker,, University Universität of Tirana Graz (Albania) (Austria) TWELFTH INTERNATIONAL
    [Show full text]
  • 2019Eir-ALBANIA.Pdf
    EUROPEAN y gathering 35 local scholars, experts, and civil society activists specialized in ISLAMOPHOBIA racism and human rights, the fifth edition of theEuropean Islamophobia Report addresses a still timely and politically important issue. All 32 country reports REPORT includedB in this book follow a unique structure that is convenient, first, for comparing countries and, second, for selected readings on a particular topic such as politics, em- 2019 ployment, or education with regard to Islamophobia across Europe. The present report investigates in detail the underlying dynamics that directly or indirectly ENES BAYRAKLI • FARID HAFEZ (Eds) support the rise of anti-Muslim racism in Europe. This extends from Islamophobic state- ments spread in national media to laws and policies that restrain the fundamental rights of European Muslim citizens and threaten the whole of society. As a result, the European Islamophobia Report 2019 discusses the impact of anti-Muslim racism on human rights, multiculturalism, and the state of law in Europe. This fifth edition of our report highlights how European societies are progressively over- whelmed by the Islamophobic discourse of the “Great Replacement” and other far-right conspiracy theories. The 32 country reports demonstrate how governments and main- stream media participate in reproducing such discourses that put the fundamental rights of millions of European citizens in jeopardy and how one can counteract these developments. This compendium of useful insights and data aims to provide European policy-makers, institutions, and NGOs with recommendations on how to tackle anti-Muslim racism in Europe seriously. EUROPEAN ISLAMOPHOBIA REPORT 2019 About SETA Foundation for Political, Economic and Social Research (SETA) is a non-profit research ds) institute based in Turkey dedicated to innovative studies on national, regional and in- ternational issues.
    [Show full text]