Download Final Performance Evaluation of the ASOTRY Development Food Security Activity in Madagascar
Total Page:16
File Type:pdf, Size:1020Kb
Final Performance Evaluation of the ASOTRY Development Food Security Activity in Madagascar March 2020 |Volume I IMPEL | Implementer-Led Evaluation & Learning Associate Award ABOUT IMPEL The Implementer-Led Evaluation & Learning Associate Award works to improve the design and implementation of Food for Peace (FFP) funded development food security activities (DFSAs) through implementer-Led evaluations and knowledge sharing. Funded by the USAID Office of Food for Peace (FFP), the Implementer-Led Evaluation & Learning Associate Award will gather information and knowledge in order to measure performance of DFSAs, strengthen accountability, and improve guidance and policy. This information will help the food security community of practice and USAID to design projects and modify existing projects in ways that bolster performance, efficiency and effectiveness. The Implementer-Led Evaluation & Learning Associate Award is a two-year activity (2019-2021) implemented by Save the Children (lead), TANGO International, and Tulane University, in Haiti, the Democratic Republic of Congo, Madagascar, Malawi, Nepal, and Zimbabwe. RECOMMENDED CITATION IMPEL. (2020). Final Performance Evaluation of the ASOTRY Development Food Security Activity in Madagascar (Vol. 1). Washington, DC: The Implementer-Led Evaluation & Learning Associate Award PHOTO CREDITS Douglas R. Brown. Rice fields in central Madagascar at various stages of planting. September 2019. DISCLAIMER This report is made possible by the generous support of the American people through the United States Agency for International Development (USAID). The contents are the responsibility of the Implementer-Led Evaluation & Learning (IMPEL) award and do not necessarily reflect the views of USAID or the United States Government. CONTACT INFORMATION IDEAL Activity c/o Save the Children 899 North Capitol Street NE, Suite #900 Washington, DC 20002 www.fsnnetwork.org [email protected] PREPARED BY: Final Performance Evaluation of the ASOTRY DFSA in Madagascar ACKNOWLEDGMENTS The ASOTRY Qualitative Evaluation Team would like to express their appreciation to all those individuals who willingly gave of their time and shared their knowledge during this final evaluation. First of all, we would like to thank all those who participated in the focus group discussions and key informant interviews conducted in the 28 fokontany that served as the sites for the qualitative study. We would also like to thank those individuals who participated in interviews, both during the course of fieldwork and in the capital Antananarivo, including representatives of the Government of Madagascar. Patrice Charpentier, Chief of Party, and Tsarafidy Rasendraharison, Deputy Chief of Party, as well as several other ADRA staff participated in and/or supported this qualitative evaluation; this support covered the gamut from planning and logistics, to site selection, accompanying the Evaluation Team during fieldwork, and participation in interviews and the validation workshop. Without all the support provided by Mr. John Ravelomanantsoa and Mr. Zafy Martin, two members of the ADRA team who accompanied us in the field, it would have been impossible for the evaluators to complete the program of fieldwork according to plan. We would also like to thank ADRA’s two local implementing partner organizations, Land O’Lakes and Association Intercooperation Madagascar, who shared their insights with the qualitative team and participated in the validation workshop. While in the field, the team’s work was greatly facilitated by the interpreters, notetakers and drivers provided by Agence CAPSULE. They played an essential role in the completion of the fieldwork portion of the qualitative evaluation. We also thank Heritiana Rabarijaona and others at Agence CAPSULE who provided invaluable assistance in organizing the staff, training, and logistics for the quantitative survey and qualitative study, and to Elizabeth Cuellar, who co-led the survey training. In addition, we would like to thank Dr. Onja Holisoa Rahamefy, the independent survey monitor for the quantitative survey. The qualitative team wishes to acknowledge the excellent support of our field assistants. Extensive support was provided to the Evaluation Team throughout the process by multiple colleagues at TANGO International. Behind the scenes at TANGO HQ we have appreciated the guidance and support of Jeanne Downen, Mark Langworthy, Monica Mueller, Elizabeth Cuellar, Carrie Presnall, Robin Al-haddad, and Padraic Finan. Finally, we appreciate the guidance and interest from USAID Food for Peace Washington in this project: Arif Rashid and Adam Trowbridge. Thanks to all who contributed to the work that led to this report, and apologies to any contributors omitted from this acknowledgement. The authors of the report accept full responsibility for the content and any unintended errors or omissions therein. Sincerely, Douglas R Brown, PhD, Independent Consultant (Team Leader) Bernard Crenn, Independent Consultant Dr. Onja Holisoa Rahamefy, Independent Consultant Dr. Haingo Lalaina Ralaison, Independent Consultant Acknowledgments i IMPEL | Implementer-Led Evaluation and Learning TABLE OF CONTENTS Acknowledgments ............................................................................................................................. i List of Figures .................................................................................................................................... iv List of Tables ...................................................................................................................................... v Acronyms ......................................................................................................................................... vi Executive Summary ......................................................................................................................... viii 1. Introduction ................................................................................................................................1 1.1 Program Background ...................................................................................................................... 1 1.2 Theory of Change ........................................................................................................................... 2 2. Evaluation Overview ....................................................................................................................3 2.1 Evaluation Purpose......................................................................................................................... 3 2.2 Evaluation Questions ..................................................................................................................... 3 3. Evaluation Methods .....................................................................................................................5 3.1 Quantitative Data Collection .......................................................................................................... 5 3.1.1 Overview ....................................................................................................................... 5 3.1.2 Survey Team .................................................................................................................. 5 3.1.3 Population-Based Sample Design ................................................................................. 5 3.1.4 Data Analysis ................................................................................................................. 7 3.2 Qualitative Data Collection ............................................................................................................ 9 3.2.1 Overview ....................................................................................................................... 9 3.2.2 Sample Design ............................................................................................................... 9 3.2.3 Evaluation Team .......................................................................................................... 10 3.2.4 Methods ...................................................................................................................... 10 3.2.5 Analysis, Coding, and Interpretation Methods ........................................................... 11 3.3 Integration of Quantitative and Qualitative Findings .................................................................. 11 3.4 Limitations .................................................................................................................................... 11 4. Evaluation Findings .................................................................................................................... 13 4.1 Targeting ...................................................................................................................................... 13 4.2 Purpose 1: Improved health and nutrition status of women of reproductive age and children under five (CU5) ................................................................................................................................... 14 4.2.1 Introduction ................................................................................................................ 14 4.2.2 Results ......................................................................................................................... 14 4.2.3 Conclusions ................................................................................................................