Somalia Youth Livelihoods Program Final Evaluation
Total Page:16
File Type:pdf, Size:1020Kb
SOMALIA YOUTH LIVELIHOODS PROGRAM FINAL EVALUATION February 17, 2012 This publication was produced for review by the United States Agency for International Development. It was prepared by Gayla Cook and Abdi Younis, International Business & Technical Consultants, Inc. 0 SOMALI YOUTH LIVELIHOODS PROGRAM FINAL EVALUATION SOMALIA YOUTH LIVELIHOODS PROGRAM FINAL EVALUATION International Business & Technical Consultants, Inc. 8618 Westwood Center Drive Suite 220 Vienna, VA 22182 USA Contracted under AID-RAN-I-00-09-00016, Order No. AID-623-TO-11-00002; Monitoring & Evaluation Program for Somalia (MEPS) DISCLAIMER The authors‘ views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government. Contents ACRONYMS AND ABBREVIATIONS ii ACKNOWLEDGEMENTS iii EXECUTIVE SUMMARY iv 1.0 INTRODUCTION 1 1.1 Purpose of the Evaluation 1 1.2 Key Evaluation Questions 1 Somalia: Conflict Overview 2 1.3 Background Information 2 1.4 Approach/Methodology 4 2.0 EVALUATION FINDINGS 5 2.1 To what extent did SYLP improve employment opportunities for at-risk youth? 5 2.2 What were stakeholder perceptions about positive and negative program outcomes and any changes in government provision of services? 9 2.3 How effective was EDC implementation performance of SYLP? 11 2.4 What was the quality of SYLP outcomes and products and impact on human and institutional capacity improvements? 13 2.5 What were other SYLP successes or results? 19 2.6 Were the underlying program hypotheses, principles and assumptions accurate, were they followed, and did they change over time? 20 3.0 OVERARCHING LESSONS LEARNED AND RECOMMENDATIONS 22 3.1 What steps could have been taken to improve SYLP? 22 3.2 What are the three most important lessons learned from SYLP that could be applied to USAID‘s new Somali Youth Leaders Initiative? 22 3.3 What, if any, indicators would better reflect program results and longer-term impact of youth development programming in Somalia? 23 ANNEXES 25 ANNEX A: EVALUATION SCOPE OF WORK 25 ANNEX B: TEAM COMPOSITION 32 ANNEX C: INDIVIDUALS AND AGENCIES CONTACTED 34 ANNEX D: SYLP NUMBERS SUMMARY 59 ANNEX E: SYLP IMPLEMENTING PARTNERS 60 ANNEX F: DOCUMENTS CONSULTED 62 ANNEX G: CAPTIONED PHOTOGRAPHS IDENTIFYING LOCATION AND SUBJECT 64 ANNEX H: DISCUSSION GUIDES 66 Somali Youth Livelihoods Program Final Evaluation i ACRONYMS AND ABBREVIATIONS AOTR Agreement Officer‘s Technical Representative BAC Business Advisory Council EDC Education Development Center EU European Union IAI Interactive Audio Instruction IBTCI International Business & Technical Consultants, Inc. ICDSEA Integrated Capacity Development for Somali Education Administrations ICT Information and Communications Technology INGO International non-governmental organization LRC Livelihoods Resource Center M&E Monitoring and evaluation MOE Ministry of Education MOLYS Ministry of Labor, Youth and Sports MOLSA Ministry of Labor and Social Affairs MP3 A widely-used format for audio transfer, storage and playback of music and programs on digital audio players NGO Non-governmental organization RFA Request for application Shaqodoon Somali for jobseeker (Somali language name for SYLP) SIFY Somali International Fund for Youth SBI Somaliland Beverage Industry SCZ South/Central Zone SMS Short message service SYLP Somali Youth Livelihood Program SYLI Somali Youth Leaders Initiative TAP Training and Placement TVET Technical Vocational Education and Training USAID United States Agency for International Development U.S. United States USG United States Government Somali Youth Livelihoods Program Final Evaluation ii ACKNOWLEDGEMENTS The evaluation team for this report were Gayla Cook and Dr. Abdi Younis – with Fatima Abdallah Abdi and Mohamed Ahmed Hirabe. Together, the team designed and conducted data collection and analysis. Without the excellent interview and facilitation skills, and country knowledge of the three Somali-speaking team members, this report would have been far less substantial. The team would like to thank the staff of IBTCI, EDC, the implementing partners and the Somali authorities who facilitated the team‘s work in Somalia and Kenya. The evaluation team would also like to extend thanks to the students, trainees, parents, community members and the many individuals who gave their time and shared their perspectives on SYLP in Somalia. The valuable information they provided enabled the evaluation team to comprehend and closely examine the outcomes resulting from SYLP and extract recommendations for improving design and implementation of future programs. Special thanks are extended to the personnel from the donor and development partner community, especially, USAID/Somalia staff, whose views helped form a more complete understanding of the context in which SYLP was designed and implemented. The report authors appreciate the dedication of the USAID AOTR for the SYLP, Mary Beth McKeever, for meeting about the evaluation while she was on leave. Representatives of the EU and other agencies with experience working in Somalia added to this understanding. Particular thanks go to the EDC ICT experts who provided the invaluable technical assistance that enabled the cell phone survey. Without this professional competence, the work of the evaluation team would have been much harder. Finally, the team would like to thank the IBTCI staff in Nairobi, headed by Ms. Gaelle Le Pottier, as well as IBTCI home office staff, for dependable logistical support in a difficult environment. Somali Youth Livelihoods Program Final Evaluation iii EXECUTIVE SUMMARY Based on a review of quantitative and qualitative information and data, it can be concluded that the Somali Youth Livelihoods Program (SYLP) – known locally as Shaqodoon (Somali for ―jobseeker‖) - achieved its objective ―To establish systems that bridge supply and demand with necessary support to young people and employers,‖ and contributed to the goal ―To provide Somali youth with a greater opportunity to access work opportunities.‖ The program succeeded in providing internships or paid job placements in the private and public sectors for 87 percent of the 9,280 youth who completed the Training and Placement component – exceeding targets. Youth, parents, business owners, and government authorities considered the training effective and the placement opportunities beneficial for youth‘s long-term employment prospects. Purpose - The purpose of this summative evaluation is to provide information and lessons learned to USAID on the program performance of SYLP and the prime implementer, the Education Development Center, and recommendations for implementation of the new Somali Youth Leadership Initiative (SYLI), and, to inform the USAID Education Strategy 2011-2015, Goal Three: Increased equitable access to education in crisis and conflict environments for 15 million learners by 2015, with particular reference to Somalia. Background - The collapse of the Somalia state in 1991 and the subsequent civil wars have had their toll on an education system that was already weak. The lack of provision of education and training opportunities in Somalia for the past two decades has produced a youth population that has neither the education nor the skills needed for becoming gainfully employed productive members of their communities. This situation has heightened the sense of hopelessness and despair among the youth and increased their vulnerability to dangerous influences from extremist groups, risky adventures in the seas and unsafe migration. SYLP is a skills development program funded by USAID aimed at reducing insecurity by putting Somali youth to work. Locally known as Shaqodoon (Somali for ―jobseeker‖), SYLP was developed to provide youth ages 15-24 with skills that increased their opportunities for internships and/or job placements or self employment. SYLP was a nearly four-year (3/2008- 12/2011), $10,2 million program implemented by Education Development Center (EDC). Nearly 60 organizations, predominantly Somali NGOs with a small number of INGOs, served as the Implementing Partners (IPs) that delivered training and placement services, with considerable monitoring and capacity building support where needed from EDC. Information technology was a prominent program feature; innovative cellphone and internet applications connected trainees with prospective employers and cellphones and MP3s were used to deliver educational programs. SYLP was in line with the USAID strategy for Somalia: respond to Somalia‘s key challenges by supporting peace-building and national reconciliation initiatives; building the capacity of governance institutions and civil society groups; improving the delivery of social services; and meeting humanitarian and early recovery needs.1 According to the evaluation Statement of Work (see Annex A), the development hypothesis of SYLP was to: ―decrease insecurity and increase stability in the long run; to decrease vulnerabilities - marginalization of youth for the short term gain and finally; and to increase social services delivery by the regional governments (skills training, employment, and other 1 http://www.usaid.gov/locations/sub-saharan_africa/countries/somalia/ Somali Youth Livelihoods Program Final Evaluation iv education). Meanwhile, the output is envisaged to identify market needs and increase capacities of local organizations to provide services.‖ Approach/Methodology - The four-person evaluation team (see Annex B), including three native speakers of Somali,