Ilo Evaluation
Total Page:16
File Type:pdf, Size:1020Kb
ILO EVALUATION o Evaluation Title: Final Evaluation of Addressing Decent Work Deficits in the Tobacco Sector of Zambian and Tanzania Project (DWiT). o ILO DC/SYMBOL ZMB 18/02/RBS and TZA/18/01/RBS o Type of Evaluation Independent Cluster Final Evaluation o Country(ies) United Republic of Tanzania and Zambia o P&B outcome(s): 5, 7, 8 and 10 o SDG(s): 2 and 8 o Date of the evaluation August–September 2020 o Name of consultant(s) CLIFF BERNARD NUWAKORA (Team Leader) GREGORY CHANDA CHILUFYA (National consultant; Zambia), and MGENDI MSANGYA ZACHARIA (National Consultant; Tanzania) o ILO Administrative Office ILO Country Office for Zambia, Malawi and Mozambique, and ILO Country Office for the United Republic of Tanzania, Kenya, Uganda, Rwanda and Burundi o ILO Technical Backstopping Office: SECTOR, FUNDAMENTALS, ENTERPRISE and LABADMIN /OSH o Other agencies involved in joint evaluation: Nil o Date project ends: August 2020 o Donor: country and budget US$: ILO RBSA USD 920,448(Zambia) and 892,896 (Tanzania) o Evaluation Manager: Benson Mange’ni o Evaluation budget: US$ 29,830 o Key Words: Decent work, Livelihoods, Covid-19, Tobacco, Occupational Safety, Gender equality, Child labour and Tripartite. This evaluation has been conducted according to ILO’s evaluation policies and procedures. It has not been professionally edited, but has undergone quality control by the ILO Evaluation Office. Acknowledgement The evaluation team would like to extend its sincere thanks to the stakeholders who participated and supported the evaluation work in various ways. Special mention goes to the Evaluation Manager (Mr. Mange’ni Benson) and all the project teams in both countries that provided valuable support at various stages of the evaluation. Special mention too, to the generous participation and contribution of all government institutions, implementing partners as well as the beneficiaries who invested their valuable time to respond to the evaluation questions during in-depth interviews and FGDs/workshops. Despite your busy schedules, you all agreed to attend multiple consultative meetings and provided all the guiding documents. The contributions of all you participants was invaluable for the success of this evaluation. i | P a g e Table of Contents List of Abbreviations ....................................................................................................... v Executive Summary ...................................................................................................... vii 1.0 Introduction .............................................................................................................. 1 1.1 Project Background ....................................................................................................... 1 1.2 The evaluation background ............................................................................................ 4 Evaluation purpose and objectives ........................................................................................................... 4 Targeted clients and the main audience of the evaluation report ........................................................ 6 Dates, events and operation sequence of this terminal evaluation ..................................................... 6 1.3 Evaluation Methodology ................................................................................................. 6 Data collection .............................................................................................................................................. 9 Analysis ....................................................................................................................................................... 11 Evaluation limitations ................................................................................................................................. 11 2.0.Evaluation Findings ................................................................................................. 13 2.1. Relevance ................................................................................................................. 13 Project alignment to government programmes, ILO DWiT programming and SDGs ..................... 15 Focus on the needs of beneficiaries ....................................................................................................... 16 Project alignment with global development agenda (UNDAF & SDGs) ............................................ 17 2.2. Validity of the design .................................................................................................. 19 Strengths and weaknesses of Project Concept and Design ............................................................... 22 Weaknesses of the concept and design ................................................................................................ 23 Project management, partnerships and coordination mechanisms........................................... 23 Project management mechanisms .......................................................................................................... 23 Partnerships arrangements ...................................................................................................................... 25 Coordination mechanism .......................................................................................................................... 27 Strengths and weaknesses of management arrangements, partnerships and coordination mechanisms ................................................................................................................................................ 28 2.3. Effectiveness ............................................................................................................. 29 2.4 Facilitators and inhibitors of performance of the DWiT project ........................................... 44 2.5. Efficiency .................................................................................................................. 45 ii | P a g e Project budget and expenditure to date ................................................................................................. 45 Cost minimization strategies adopted ..................................................................................................... 47 Weaknesses of the adopted cost minimization strategies................................................................... 48 2.6. Impact Orientation and Project sustainability .................................................................. 49 Project impact .................................................................................................................. 49 2.7 Programmatic sustainability .......................................................................................... 49 Institutional sustainability .......................................................................................................................... 51 Financial sustainability .............................................................................................................................. 53 Environmental sustainability ..................................................................................................................... 53 Opportunities and threats to sustainability ............................................................................................. 54 3.Cross cutting issues ................................................................................................... 54 3.1. Gender mainstreaming ............................................................................................... 54 3.2 Results Based Management (RBM) and efficacy of M&E systems ................................. 55 3.3 Human Rights Based Approach ................................................................................ 56 4. Conclusions ................................................................................................................. 57 5 Lessons learnt ............................................................................................................... 59 6 Good practices .............................................................................................................. 61 7 Recommendations ......................................................................................................... 63 List of annexes Annex 1:Terms of Reference ........................................................................................................................... 65 Annex 2: Lessons Learnt and Good Practices .............................................................................................. 79 Annex 3: Data capture tool for effectiveness ................................................................................................. 96 Annex 4: Key informant Interview guide for Project personnel ................................................................. 108 Annex 5: Key informant Interview guide for Government officials ........................................................... 111 Annex 6: FGD guide for beneficiaries ........................................................................................................... 113 Annex 7: References ....................................................................................................................................... 115 Annex 8: Abridged list of respondents .........................................................................................................