Food and Enterprise Development (FED) Project Impact Survey
Total Page:16
File Type:pdf, Size:1020Kb
Food and Enterprise Development (FED) Project Impact Survey February 14, 2017 This publication was produced at the request of the United States Agency for International Development. It was prepared independently by International Development Group LLC. FOOD AND ENTERPRISE DEVELOPMENT (FED) PROJECT IMPACT SURVEY LEARNING EVALUATION AND ANALYSIS PROJECT-II (LEAP-II) ACTIVITY ORDER #25: Contract Number: AID-OAA-I-12-00042/AID-OAA-TO-14-00046 DISCLAIMER The author’s views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government. Photo credits: Richard Rousseau. Clockwise from upper left: Lowland rice beneficiary group, goat shelter, cassava field, newly planted vegetable field. The Evaluation Team included: Richard Rousseau (Team Leader), Nicholai Lidow (Senior Analyst/ Statistician), Tamara Glazer (Research Analyst), Hyosun Bae (Research Analyst), Daniel Mwero (Senior Field Survey Specialist), Emmanuel Nimbuen (Agriculture Economist), Alice Perkins (Field Survey Specialist), Joseph Duawo (CAPI Specialist), Dexter Merchant (CAPI Specialist), Alvin Teezoe (CAPI Specialist), Dickerson Williams (CAPI Specialist), and Mohammed Sheriff (Finance/Operations Manager). International Development Group LLC (IDG) worked in collaboration with African Development Associates (ADEAS) – a Liberian organization to manage and implement the Impact Survey. TABLE OF CONTENTS Evaluation Purpose ...................................................................................................................................................... 13 Evaluation Questions .................................................................................................................................................. 13 Project Overview ........................................................................................................................................................ 15 Project Implementation Overview .......................................................................................................................... 17 FED Performance monitoring .................................................................................................................................. 18 Constraints to agricultural development in targeted regions .......................................................................... 18 Targeted Value Chains: Assistance ......................................................................................................................... 20 Targeted Regions ........................................................................................................................................................ 20 1. Quantitative Research ...................................................................................................................................... 22 2. Qualitative Research ......................................................................................................................................... 30 Design Limitations ....................................................................................................................................................... 33 Implementation Limitations ...................................................................................................................................... 34 1. Estimated Number of Beneficiaries (Direct and Indirect) ........................................................................ 36 2. Have beneficiary farmers aPPLIED new practices, technologies, and/or crops? ................................ 38 3. How much have beneficiary farmers invested (cash or equivalent in-kind) compared to the comparison group?...................................................................................................................................................... 44 4. How profitable and productive are beneficiary farmers compared to the comparison group? ..... 47 5. What are the household incomes of beneficiary farmers compared to the comparison group? ... 56 6. What is the quality of life of beneficiary farmers and their families compared to the comparison group?............................................................................................................................................................................. 61 Annex I: Evaluation Statement of Work ................................................................................................................ 69 Annex II: Evaluation Methods and Limitations ..................................................................................................... 75 Annex III: Understanding the Average Treatment Effect (ATE) Estimator ................................................... 79 Annex IV: Survey Questionnaire ............................................................................................................................. 84 Annex V: Key Informant Interview (KII) Guide ................................................................................................ 144 Annex VI: Focus Group Discussion (FGD) Protocol ...................................................................................... 146 ii Annex VII. List of FED Technologies and Practices ......................................................................................... 147 Annex VIII: Disclosure of any Conflicts of Interest ......................................................................................... 150 iii LIST OF TABLES Table 3.1.1 Stratification of Surveys: Target Number of Surveys (Number of Locations in parenthesis) . 24 Table 3.1.2 Response Rates and Sample Sizes .......................................................................................................... 28 Table 3.1.3 Demographics ............................................................................................................................................. 29 Table 3.2.1 Focus Group Discussions with Beneficiary Farmer Groups ............................................................ 31 Table 3.2.2 Key Informant Interviews by Value Chain, County, and Role in Program ................................... 31 Table 3.2.3 Key Informant Interviews by Role in Program and County ............................................................ 32 Table 5.1.1 Estimated Direct Beneficiaries from Impact Survey and FED M&E Data ..................................... 36 Table 5.1.2 Reported Source of Improved Practices among Comparison Farmers and Farmers Screened out due to Contact with FED ....................................................................................................................................... 37 Table 5.2.1 Improved Farming Practices (Percent of Population) ........................................................................ 39 Table 5.2.2 Improved Practices by FY Cohort and Value Chain .......................................................................... 40 Table 5.2.3 Land area under new management/technology practices (FED Beneficiaries) ............................ 40 Table 5.2.4 Hectares under new or improved/rehabilitated irrigation or drainage services as a result of USG assistance ................................................................................................................................................................. 41 Table 5.3.1 Expenditure on capital equipment during the past year ................................................................... 44 Table 5.3.2 Capital Equipment Expenditures by FY and Value Chain ................................................................. 44 Table 5.3.3 Farm Equipment (number of pieces owned) ....................................................................................... 45 Table 5.3.4 Savings, Loans, and Debt .......................................................................................................................... 46 Table 5.4.1 Total Production (TP, kg or animals) .................................................................................................... 48 Table 5.4.2 Total value of sales (VS) of value chain commodity ........................................................................... 48 Table 5.4.3 Sales Value by FY Cohort and Value Chain ......................................................................................... 49 Table 5.4.4 Total Quantity of Sales (QS, kg or animals) ........................................................................................ 49 Table 5.4.5 Sales Quantity by FY Cohort and Value Chain ................................................................................... 50 Table 5.4.6 Total Recurrent Cash Input Costs (IC) ................................................................................................ 50 Table 5.4.7 Units of Production (UP, hectares cultivated or number of animals) and Yields (kg / ha) ...... 51 Table 5.4.8 Gross margin of value chain commodity .............................................................................................. 52 Table 5.4.9 Gross Margin by FY and Value Chain .................................................................................................... 52 Table 5.4.10 Propensity score matching estimates of gross margin of value chain commodity ................... 53 Table 5.4.11 Average Gross Margins of Beneficiary and Comparison Villages ................................................