Final Performance Evaluation of the Fararano Development Food Security Activity in Madagascar March 2020 |Volume I IMPEL | Implementer-Led Evaluation & Learning Associate Award ABOUT IMPEL The Implementer-led Evaluation & Learning Associate Award works to improve the design and implementation of Food for Peace (FFP) funded development food security activities (DFSAs) through implementer-led evaluations and knowledge sharing. Funded by the USAID Office of Food for Peace (FFP), the Implementer-led Evaluation & Learning Associate Award will gather information and knowledge in order to measure performance of DFSAs, strengthen accountability, and improve guidance and policy. This information will help the food security community of practice and USAID to design projects and modify existing projects in ways that bolster performance, efficiency and effectiveness. The Implementer-led Evaluation & Learning Associate Award is a two-year activity (2019-2021) implemented by Save the Children (lead), TANGO International, and Tulane University in Haiti, the Democratic Republic of Congo, Madagascar, Malawi, Nepal, and Zimbabwe. RECOMMENDED CITATION IMPEL. (2020). Final Performance Evaluation of the Fararano Development Food Security Activity in Madagascar (Vol. 1). Washington, DC: The Implementer-Led Evaluation & Learning Associate Award PHOTO CREDITS Three-year-old child, at home in Mangily village (Toliara II District), after recovering from moderate acute malnutrition thanks to support from the Fararano Project. Photo by Heidi Yanulis for CRS. DISCLAIMER This report is made possible by the generous support of the American people through the United States Agency for International Development (USAID). The contents are the responsibility of the Implementer-Led Evaluation & Learning (IMPEL) award and do not necessarily reflect the views of USAID or the United States Government. CONTACT INFORMATION IDEAL Activity c/o Save the Children 899 North Capitol Street NE, Suite #900 Washington, DC 20002 www.fsnnetwork.org [email protected] PREPARED BY Final Performance Evaluation of the Fararano DFSA in Madagascar ACKNOWLEDGMENTS The Fararano Evaluation Team would like to thank all those individuals who gave of their time and knowledge during the fieldwork undertaken for this evaluation. First of all, we would like to thank the more than 600 individuals who participated in the focus group discussions conducted in the 10 fokontany that served as core sites for the qualitative evaluation, in addition to the many household survey respondents. We would also like to thank the nearly 50 individuals who participated in key informant interviews, both during fieldwork and in the capital Antananarivo, including representatives of four of Catholic Relief Services’ (CRS) Government of Madagascar partners. Many CRS staff participated in and/or supported the evaluation; this support covered the gamut from planning and logistics, to site selection, accompanying the qualitative team during fieldwork, and participation in KIIs and the Validation Workshop. Special thanks go to James Hazen, Chief of Party and Lanto Rafanomezantsoa, Deputy Chief of Party, as well as Noro Hasina Ratsimbazafy, Mahefa Ravalison, and Olivier Ranaivomanana, who accompanied us during the field work in the three project zones. Without all the support provided by the CRS team, the evaluators would never have been able to complete our very ambitious program of fieldwork according to plan. We would also like to thank CRS’s four local implementing partner organizations: Conseil Diocésain pour le Développement, Bureau du Développement de l’Ecar Mananjary, CARITAS Morombe, and Organe de Développement du Diocèse de Toamasina. These partner organizations contributed in multiple ways to the work of the qualitative team, including providing input into the site selection process, arranging and organizing site visits, accompanying the evaluators during the fieldwork, and participating in the Validation Workshop. CRS’s local implementing partners played an important role in the qualitative study, as they had through the life of the Fararano project, from design through implementation. While in the field, the evaluation team’s work was greatly facilitated by the interpreters, note-takers and drivers provided by Agence CAPSULE. They played an essential role in the completion of the fieldwork portion of the qualitative study. We also thank Heritiana Rabarijaona and others at Agence CAPSULE who provided invaluable assistance in organizing the staff, training, and logistics for the quantitative and qualitative surveys. In addition, we would like to thank Dr. Onja Holisoa Rahamefy, the independent survey monitor for the quantitative survey. Extensive support was provided to the evaluation team throughout the process by multiple colleagues at TANGO International, as well as Douglas R. Brown, the Team Leader for the ASOTRY final evaluation, who also led the quantitative, population-based survey conducted for both the Fararano and ASOTRY projects. Behind the scenes at TANGO HQ we have appreciated the guidance and support of Jeanne Downen, Mark Langworthy, Monica Mueller, Elizabeth Cuellar, Carrie Presnall, and Robin Al-haddad. Donor staff from the United States Agency for International Development also provided input into the qualitative study at various stages in the process. Thanks to all who contributed to the work that led to this report, and apologies to any contributors omitted from this acknowledgement. The authors of the report accept full responsibility for the content and any unintended errors or omissions therein. Sincerely, Kevin Henry, Independent Consultant (Team Leader) Bernard Crenn, Independent Consultant Dr. Nasoavina Veromanitra Andrianjafitrimo, Independent Consultant Jennifer Loucks, Independent Consultant Acknowledgments i IMPEL | Implementer-Led Evaluation and Learning TABLE OF CONTENTS Acknowledgments .................................................................................................................. i List of Figures ........................................................................................................................ v List of Tables ......................................................................................................................... v Acronyms ............................................................................................................................. vi Executive Summary ............................................................................................................. viii Evaluation Purpose and Evaluation Questions .................................................................................... viii Project Background ............................................................................................................................. viii Methodology ....................................................................................................................................... viii Findings and Conclusions ...................................................................................................................... ix Purpose 1 ....................................................................................................................................... ix Purpose 2 ........................................................................................................................................ x Purpose 3 ........................................................................................................................................ x Gender and Youth ......................................................................................................................... xi Targeting....................................................................................................................................... xii Factors Contributing to Outcomes ............................................................................................... xii Contribution to Mitigation, Adaptation to, and Recovery from Shocks and Stresses ................. xii Beneficiary Satisfaction ................................................................................................................ xii Coordination .................................................................................................................................xiii Sustainability ................................................................................................................................xiii Recommendations................................................................................................................................xiii Overall ..........................................................................................................................................xiii Purpose 1 ...................................................................................................................................... xiv Purpose 2 ...................................................................................................................................... xiv Purpose 3 ...................................................................................................................................... xiv Gender and Youth ........................................................................................................................ xiv 1. Introduction ...................................................................................................................