Evaluation of the 3Rd and 4Th UNFPA Country Programme for Kazakhstan (2010-2018) EVALUATION REPORT
Total Page:16
File Type:pdf, Size:1020Kb
Evaluation of the 3rd and 4th UNFPA Country Programme for Kazakhstan (2010-2018) EVALUATION REPORT November, 2019 EVALUATION REPORT: The 3rd and 4th UNFPA Country Programmes for Kazakhstan (2010-2018) Kazakhstan Country Map1 Evaluation team Evaluation Team Leader Lyubov Palyvoda Evaluator Baurzhan Zhussupov Evaluator Jamila Asanova 1 https://www.un.org/Depts/Cartographic/map/profile/kazakhst.pdf ii EVALUATION REPORT: The 3rd and 4th UNFPA Country Programmes for Kazakhstan (2010-2018) Acknowledgements The authors wish to acknowledge with their sincere thanks the numerous staff members from the various Government of Kazakhstan Ministries and related institutions, the UN collaborating agencies, donor agencies and a wide range of CSOs for providing time, resources and materials to permit the development and implementation of this evaluation. We appreciate the participation of members of the Evaluation Reference Group, especially those who took time to attend briefings and provided comments. We are particularly grateful to the United Nations Population Fund (UNFPA) Kazakhstan staff members of country and regional offices who, despite a very heavy load of other pressing commitments, were so responsive to our repeated requests, often on short notice. We would also like to acknowledge the many other Kazakh stakeholders and client/beneficiaries, including experts in P&D, health, youth, gender and the dedicated staff at the visited centers, who helped the implementation of this evaluation despite their busy schedules. It is the team's hope that this evaluation and recommendations presented in this report will positively contribute to building a sound foundation for future UNFPA Kazakhstan supported programs in collaboration with the Government of Kazakhstan. Disclaimer This evaluation report was prepared by a team of three consultants, namely: Lyubov Palyvoda, Evaluation Team Leader; Jamilya Asanova and Baurzhan Zhussupov, Evaluators. The content, analysis and recommendations of this report do not necessarily reflect the views of the United Nations Population Fund, its Executive Committee or member states. iii EVALUATION REPORT: The 3rd and 4th UNFPA Country Programmes for Kazakhstan (2010-2018) Table of contents EXECUTIVE SUMMARY 1 CHAPTER 1: Introduction 1.1 Purpose and objectives of the country programme evaluation 8 1.2 Scope of the evaluation 8 1.3 Methodology and process 8 CHAPTER 2: Country context 2.1 Development challenges and national strategies 16 2.2 The role of external assistance 18 CHAPTER 3: UNFPA strategic response and country programme 3.1. UNFPA strategic response 20 3.2 UNFPA response through the country programme 22 3.2.1 Brief description of UNFPA previous cycle strategy, goals and achievements 22 3.2.2 Current UNFPA country programme 23 3.2.3 The financial structure of the programme 25 CHAPTER 4: Findings: answers to the evaluation questions Evaluation question 1: Relevance 28 Evaluation question 2: Effectiveness 31 Evaluation question 3: Effectiveness 39 Evaluation question 4: Effectiveness 43 Evaluation question 5: Efficiency 46 Evaluation question 6: Sustainability 49 Evaluation question 7: Sustainability 51 Evaluation question 8: Sustainability 53 Evaluation question 9: Coordination within the UNCT 54 Evaluation question 10: Added value of UNFPA country programme 57 CHAPTER 5: Conclusions 5.1 Strategic level 60 5.2 Programmatic level 61 CHAPTER 6: Recommendations 6.1 Strategic Recommendations 64 6.2 Programmic Recommendations 65 ANNEXES Annex 1. Terms of Reference 68 Annex 2. List of persons/institutions met 79 Annex 3. List of documents consulted 80 Annex 4. The evaluation matrix 83 Annex 5. Abstract of the evaluation report 122 Annex 6. Stakeholders’ mapping 124 Annex 7. UNFPA Intervention logic for 3rd and 4th CPs by programme components 127 iv EVALUATION REPORT: The 3rd and 4th UNFPA Country Programmes for Kazakhstan (2010-2018) Abbreviations and Acronyms AIDS Acquired Immune Deficiency Syndrome AWP(s) Annual Work Plan(s) BCC Behaviour Change Communication BOS Business Operation Strategy CA Central Asia CEDAW Convention on the Elimination of all Forms of Discrimination against Women CEMD Confidential Enquiry into Maternal Deaths CEPD Confidential Enquiry into Perinatal Deaths CO Country Office CP Country Programme CPE Country Programme Evaluation CPAP Country Programme Action Plan CPD Country Programme Document CSA Country Situational Analysis CSOs Civil society organizations CSPS Centers for socio-psychological support DVS Domestic violence survey ERG Evaluation reference group ESP Essential service package EQA Evaluation quality assessment FBOs Faith – based organizations GBV Gender-Based Violence GDP Gross domestic products HIV Human Immunodeficiency Virus ICPD International Conference on Population and Development IEC Information, Education and Communication ILO International Labour Organization IP(s) Implementing Partner(s) KZT Kazakh tenge MCH Maternal and Children’s Health MDGs Millennium Development Goals M&E Monitoring and Evaluation MICS Multiple indicator cluster survey MOH Ministry of Health NGO Non-Government Organization NMCR Near-Miss Cases Review ODA Official development assistance OMT Operation management team P&D Population & Development PHC Primary Health Care PSA Population situation analysis QA Quality assessment SDGs Sustainability Development Goals SOP Standard operating procedure SRH Sexual and Reproductive Health STI Sexually Transmitted Infection TOR Term of reference UNAIDS Joint United Nations Programme on HIV/AIDS UNCT UN country team UNDAF UN Development assistance framework UN PFD UN Partnership Framework for Development UNDP United Nations Development Programme UNFPA United Nations Population Fund UNICEF United Nations Children’s Fund VCT Voluntary counseling and testing WHO World Health Organization v EVALUATION REPORT: The 3rd and 4th UNFPA Country Programmes for Kazakhstan (2010-2018) List of tables Table 1. KAZAKHSTAN: Key facts Table 2. Data sources by collection methods Table 3. Sample disaggregation by categories Table 4. The UNFPA financial commitment for 2010-2015 (in USD millions) by priority areas/ outputs Table 5. Expenditure evaluation for the 3rd Country Programme (2010-2015), USD Table 6. The UNFPA financial commitment for 2016-2020 (in USD millions) by outcome /output areas Table 7. Expenditure evaluation for three years of the 4th Country Programme (2016-2020), USD Table 8. Status of achievement of output SRH indicators of the 3rd UNFPA CP, 2010-2015 Table 9. Status of achievement of output SRH indicators of the 4th UNFPA CP, 2016-2020 Table 10. Status of the outcome indicators for SRH area of the 3rd and 4th CPs Table 11. Status of achievement of output Gender indicator of the 3rd UNFPA CP, 2010-2015 Table 12. Status of achievements of outputs Adolescents, youth and gender indicators of the 4rd UNFPA CP, 2016- 2020 Table 13. Status of the outcome indicators for Adolescents, youth and gender area of the 3rd and 4th CPs Table 14. Status of achievement of output P&D indicators of the 3rd UNFPA CP, 2010-2015 Table 15. Status of achievement of output P&D indicators of the 4th UNFPA CP, 2016-2020 Table 16. Status of the outcome indicators for P&D area of the 3rd and 4th CPs Table 17. UNFPA roles and indicative resources by 2016-2020 PFD Results Table 18. The UNFPA participation in UNCT working groups, June 2019 List of Figures Figure 1. UNFPA sites visited during evaluation, June – July of 2019 Figure 2. ODA key statistics: Kazakhstan Figure 3. The 3rd Country Programme (2010-2015) budget utilization by priority areas, in USD Figure 4. Three-year budget utilization of the 4th Country Programme (2016-2020) by priority areas, USD Figure 5. Three-year budget utilization of the 4th Country Programme (2010-2015) as of the UNFPA financial commitment for 2016-2020 by priority areas, USD Figure 6. UNFPA Coordination and Assistance v. Programme Expenditures by 3rd and three years of 4th CPs, % Figure 7. Logic model of SRH Programme, 2010-2015 Figure 8. Logic model of SRH Programme, 2016-2020 Figure 7. Logic model of Gender Programme, 2010-2015 Figure 7. Logic model of Adolescent&Youth and Gender Programmes, 2016-2020 Figure 7. Logic model of P&D Programme, 2010-2015 Figure 7. Logic model of P&D Programme, 2016-2020 vi EVALUATION REPORT: The 3rd and 4th UNFPA Country Programmes for Kazakhstan (2010-2018) Table 1. KAZAKHSTAN: Key facts Key Facts and Figures Source The Republic of Kazakhstan is a unitary state with the presidential system of government. Covering an area of 2.724 million square kilometers, the country has the ninth largest territory in the world. In the north and the west, the country shares border with Russia (7,591 km), with China in the east (1,783 km), with Kyrgyzstan (1,242 km), with Uzbekistan (2,351 km) and Turkmenistan (426 km) in the south. The total length of land border of Kazakhstan with other states amounts to 13,200 km. Surface area 2,724,902 sq. km World Bank, 2018 Population Population (inhabitants) 18,395,660, 2019 Population as of 1 January 2019 (Committee on Statistics of the Ministry of National Economy of the Republic of Kazakhstan). Urban population 10,638,681, 2019 Urban population as of 1 January 2019. (Committee on Statistics of the Ministry of National Economy). Population growth rate 1.4 (2017) World Bank data Government Type of government The Republic of Kazakhstan is a The Constitution of the Republic of unitary state with a presidential Kazakhstan form of government. Key political events/dates: 1991 - Kazakhstan gained its independence 1992 – Kazakhstan joined the United Nations. 1993 - First Constitution of independent Kazakhstan. 2016 - Kazakhstan’s election as a non-permanent member of the UN Security Council. Seats held by women in the 21.7% (2016) Draft VNR Report national parliament Economy GDP per capita (PPP USD) 9,030.4 (2017) World Bank Data GDP growth rate 4.1 (2017) World Bank Data Main industries: The primary drivers of the country’s economy are ore, manganese, chromite, lead, and zinc among others. Agriculture is also very essential accounting for 5%, industry 35%, and service 60%. The country also produces and exports oil and gas in hundreds of thousands of metric tons.