ADRA ASOTRY Joint Midterm Review July 2017 Acknowledgements The members of the review team wish to thank the staff of Adventist Development and Relief Agency (ADRA) and partners Land O’Lakes and Association Intercooperation Madagascar (AIM), as well as USAID Madagascar Mission staff and management and ASOTRY Chief of Party Patrice Charpentier for all their support during the review. We extend our gratitude to Bridget Ralyea, Agreement Officer’s Representative of the ASOTRY program, who played an instrumental role in facilitating this review and making it possible. Special thanks go to the many ASOTRY field staff who did their utmost to facilitate the team’s schedule and other needs. This was invaluable in allowing us to carry out the review in as complete a manner as possible. Hopefully we've listened well, our observations are grounded in reality and our suggestions are realistic and practical. We appreciate that many people have labored long and hard in the ASOTRY project to improve project performance. We thank ADRA Country Office staff, ADRA and CRS management in the headquarters and all of those who gave freely of their time to discuss project processes, challenges, ideas and suggestions, as well as accompany the team in the field. Thanks to Monica Mueller from TANGO International for assembling and editing team contributions and finalizing the evaluation reports. A special thanks to Viviane Voahanginirina who organized the logistics for USAID staff. To the more than 15 communities in 10 communes that took time from their long, busy days to participate in the midterm review, it is our hope that the review team’s recommendations are used to develop and improve the program and policies that enhance their food security and livelihoods. ADRA ASOTRY Joint Midterm Review Team Core Team Members: Adam Reinhart USAID Food for Peace, Agriculture/Food Security Advisor Arif Rashid USAID Food for Peace, Senior M&E Advisor, Review Team Leader Chris Seremet Catholic Relief Services, Technical Advisor, WASH Elizabeth Brown USAID Food for Peace, Nutrition Security Team Lead Jefferson Shriver Catholic Relief Services, Senior Technical Advisor, Value Chain and Markets Justin Mupeyiwa USAID Zimbabwe Mission, M&E Specialist Julien Rougerie USAID Madagascar Mission, Food Security and Nutrition Specialist Melanie Thurber USAID Food for Peace, Nutrition Advisor Natsayi Nembaware ADRA, Senior Technical Advisor for Nutrition Nicole Van Abel USAID Food for Peace, WASH Advisor Case Studies: Elizabeth Ceryak USAID Food for Peace, Grants Management Specialist i Table of Contents Acronyms .......................................................................................................................................................... iv Executive Summary .......................................................................................................................................... v Introduction to the ASOTRY Project .......................................................................................................... 1 Project Overview ......................................................................................................................................... 1 Project Purpose, Sub-purposes, and Intermediate Outcomes ........................................................... 2 Midterm Review Objectives ........................................................................................................................... 3 Methodology ...................................................................................................................................................... 4 Limitations and Challenges ......................................................................................................................... 7 Findings ................................................................................................................................................................ 8 Program Quality ........................................................................................................................................... 8 Program Quality: Recommendations .................................................................................................... 10 Component 1: Improved Health and Nutrition of Women of Reproductive Age and CU5 .. 11 Component 1: Recommendations......................................................................................................... 27 Component 2: Increased Access to Food for Vulnerable Households ........................................ 30 Component 2: Recommendations......................................................................................................... 40 Component 3: Improved Disaster Mitigation, Preparedness, and Response in Vulnerable Communities .............................................................................................................................................. 43 Program Monitoring ................................................................................................................................. 50 Program Monitoring: Recommendations ............................................................................................. 56 Conclusion ...................................................................................................................................................... 57 Annex 1: Evaluation Protocol ......................................................................................................................... i Annex 2: Additional Case Studies ............................................................................................................. lxiv ii Table of Tables Table 1: Baseline values for key WASH indicators ................................................................................ 22 Table 2: Area, yield and production, selected crops, 2016 .................................................................. 35 Table 3: Sales and income data, selected crops, 2016 ........................................................................... 35 Table of Figures Figure 1: JMTR sample sites ............................................................................................................................ 5 Figure 2: Venn diagram showing participant-level integration of interventions.................................. 9 Table of Case Studies Case study 1: FFA program helps household improve food security and nutrition though participants want more food and food preparation training ............................................................... 14 Case study 2: Woman benefits from agricultural advice and VSLA ................................................... 33 Case study 3: Farmer learns from farmer field school; literacy is a barrier to enrollment .......... 37 Case study 4: Four family members participate in VSLA ...................................................................... 39 Case study 5: Participant in the FFA road rehabilitation ...................................................................... 43 Case study 6: Two women are familiar with the program but receive minimal benefit from it lxiv Case study 7: Woman begins participating in farmer field school and farmer business school . lxiv Case study 8: A husband is unfamiliar with the program but wife and grown daughter benefit from the program .......................................................................................................................................... lxv Case study 9: A wife and husband participate in the program; they and their children benefit . lxvi Case study 10: Fokontany chief participates in FFA road rehabilitation ......................................... lxvii Case study 11: Elderly female farmer is unfamiliar with the programs ........................................... lxvii iii Acronyms AIM Association Inter-cooperation Madagascar Ar Ariary (Malagasy currency) AUE Association des Usagers d’Eau AUP Association des Usagers de Pistes BNGRC Bureau National de Gestion de Risques et Catastrophes CMAM Community-based Management of Acute Malnutrition CNV Community nutrition volunteer CRS Catholic Relief Services CU2 Children under two CU5 Children under five CHV Community health volunteer CLTS Community-led total sanitation CNV Community nutrition volunteer DQA Data quality assessment DRM Disaster risk management DRMC Disaster Risk Management Committee F2F Farmer-to-farmer (approach) FBA Farmer Business Association FFA Food for Assets FFP Food for Peace FFS Farmer Field School GMP Growth monitoring and promotion GoM Government of Madagascar IPTT Indicator Performance Tracking Table JMTR Joint midterm review M&E Monitoring and evaluation MoH Ministry of Health MUAC Mid-upper-arm circumference NRM Natural resource management O&M Operations and maintenance PIRS Performance Indicator Reference Sheet PLW Pregnant and lactating women PMU Project Management Unit RUTF Ready-to-use food(s) SBCC Social behavior change communication Surveillance and Education for Schools and Communities on Food SECALINE and General Nutrition TSIKONINA (Name of ASOTRY cooking and feeding model) Unité de Programme National de Nutrition Communautaire/ National UPNNC Community-based Nutrition Program Unit VSLA Village Savings and Loan Association WASH Water, sanitation, and hygiene iv Executive Summary This is the report of the midterm review of ASOTRY, a five-year, USAID Food for Peace (FFP) Title II award whose goal is to reduce food insecurity