Evaluation of the Pilot MEND and RISE Cash Transfer Programmes in St. Kitts and Nevis UNICEF Office for the Eastern Caribbean Area Final Evaluation Report Prepared by Plan Evaluation June 29, 2018 rev 4 Evaluation Team Fabrizio Rigout Evaluators Melissa A. Costa Peter Smith Cost-Benefit Analyst Pauline Mauclet Research Assistant Rebeca Mansur Cândido Espinheira 396 — Perdizes 05004-000 São Paulo SP — Brazil +55 (11) 3020-5800 www.plan-eval.com 2 “I learned I’m a strong woman, and that I need to keep pushing myself.” — Head of beneficiary household, 33, Single mother of 5 “It’s because of the program that I got to where I am right now, because I used to live in a rented house. They gave me motivation to get my own, so it’s a good thing. They push you to get a job, and get your own house, and feel like you can do it. They open your mind so that you want to go out and get things done. Right now, I am looking to own my own business.” — Head of beneficiary household, 41, mother of 8 3 Table of Contents List of Figures......................................................................................................................................... 5 List of Photos ......................................................................................................................................... 5 List of Tables .......................................................................................................................................... 6 Acknowledgements ............................................................................................................................ 7 Acronyms ................................................................................................................................................ 8 Executive Summary ............................................................................................................................ 9 1. Country Context ......................................................................................... 21 2. Programme Description .............................................................................. 29 2.1 Background ............................................................................................................................... 29 2.2 Purpose and Objectives ....................................................................................................... 30 2.3 Design ......................................................................................................................................... 31 2.4 Theory of Change ................................................................................................................... 35 3. Evaluation Context ..................................................................................... 38 3.1 Evaluation Scope .................................................................................................................... 40 3.2 Evaluation Approach ............................................................................................................ 41 3.3 Evaluation Matrix .................................................................................................................. 44 3.4 Evaluation Design and Methodology ............................................................................ 50 3.5 Justification .............................................................................................................................. 51 3.6 Stakeholder Analysis ............................................................................................................. 51 3.7 Field Work ................................................................................................................................. 54 3.8 Limitations ................................................................................................................................ 55 4. Findings ...................................................................................................... 56 4.1 Human Rights and Gender Equality ............................................................................... 56 4.2 Relevance................................................................................................................................... 58 4.3 Effectiveness ............................................................................................................................ 63 4.4 Efficiency ................................................................................................................................... 79 4.5 Sustainability ........................................................................................................................... 80 5. Impact ........................................................................................................ 83 5.1 MEND .......................................................................................................................................... 84 5.2 RISE .............................................................................................................................................. 88 4 5.3 Cost-Benefit Analysis ............................................................................................................ 92 6. Conclusion ................................................................................................ 109 7. Lessons Learned ........................................................................................ 113 8. Recommendations .................................................................................... 114 9. References ................................................................................................ 119 Appendix A: Documents Reviewed ......................................................................................... 120 Appendix B: Research Instruments ......................................................................................... 120 Appendix C: Team Description and Qualifications ........................................................... 129 Appendix D: List of Interviewees .............................................................................................. 131 Appendix E: Terms of Reference ............................................................................................... 132 List of Figures Figure 1 – Map of St. Kitts and Nevis ......................................................................................... 21 Figure 2 – Poverty Rate in SKN ..................................................................................................... 25 Figure 3 – Poverty and Population Shares ............................................................................... 25 Figure 4 – Theory of Change ......................................................................................................... 35 Figure 5 – Do you think that the program should continue? .......................................... 59 Figure 6 – Would you say that you and your family are worse off or better off after participating in the programme? ................................................................................................ 66 Figure 7 – Do you think that your Social Assistance Officer was knowledgeable about your family's situation? ...................................................................................................... 67 Figure 8 – Medical Check-ups Since End of Programme ................................................... 70 Figure 9 – Did you find work during the programme? ....................................................... 72 Figure 10 – What is your current housing situation? ......................................................... 72 Figure 11 – Impact-Generating Process ................................................................................... 94 List of Photos Photo 1 – Ferry landing on Nevis ................................................................................................. 22 Photo 2 – Beneficiary house pre-MEND ................................................................................... 24 Photo 3 – RISE family workshop .................................................................................................. 32 5 Photo 4 – View of Basseterre, St. Kitts ...................................................................................... 38 Photo 5 – RISE Team members .................................................................................................... 43 Photo 6 – Field visit to home of MEND beneficiary ............................................................. 54 Photo 7 – Beneficiary family ......................................................................................................... 74 Photo 8 – Youth focus group participants, Nevis ................................................................. 93 Photo 9 – MEND Beneficiary ......................................................................................................... 95 Photo 10 – Beneficiary mother and daughter .................................................................... 113 List of Tables Table 1 – Recommendations ........................................................................................................ 16 Table 2 – Cash and In-kind Social Assistance Programmes in St. Kitts and Nevis .. 26 Table 3 – Evaluation Matrix .........................................................................................................