Final Report May 21, 2018
Total Page:16
File Type:pdf, Size:1020Kb
Participatory Development in Fragile and Conflict-affected Contexts: An Impact Evaluation of the Tuungane 1 Program in the Democratic Republic of the Congo Final Report May 21, 2018 Ann Laudati (UC Berkeley) Eric Mvukiyehe (World Bank Research Group) Peter van der Windt (New York University Abu Dhabi) Table of Contents Executive summary ........................................................................................................................................................ 5 Acknowledgements ........................................................................................................................................................ 7 Background ..................................................................................................................................................................... 8 3.1 Introduction and preview of findings ...................................................................................................... 8 3.2 The Tuungane 1 program: goals and components ................................................................................ 9 3.3 Study’s empirical basis and objectives ................................................................................................ 13 3.4 Hypotheses and outcomes of interest ................................................................................................. 15 Evaluation strategy ....................................................................................................................................................... 17 4.1 Randomization to get at the causal impact of Tuungane 1 .................................................................. 17 4.2 The units under study .......................................................................................................................... 18 4.3 Quantitative data collection ................................................................................................................. 18 4.4 Qualitative data collection .................................................................................................................... 21 4.5 Independence of the research team .................................................................................................... 24 4.6 Interpretation of results and threats to validity ..................................................................................... 24 Results ........................................................................................................................................................................... 26 5.1 Service provision ................................................................................................................................. 26 5.2 Health, education and economic welfare ............................................................................................. 36 5.3 Women’s empowerment ...................................................................................................................... 40 5.4 Results from additional analyses ......................................................................................................... 42 Discussion ..................................................................................................................................................................... 44 6.1 Building and equipping primary schools and health facilities ............................................................... 44 6.2 Barriers to women’s empowerment ..................................................................................................... 47 6.3 Community expectations of infrastructure ........................................................................................... 48 Conclusion and implications ....................................................................................................................................... 51 7.1 Summary ............................................................................................................................................. 51 7.2 Implications in terms of program delivery ............................................................................................ 53 7.3 Implications on social downstream effects .......................................................................................... 54 7.4 Implications beyond local service provision ......................................................................................... 54 7.5 Implications on female empowerment ................................................................................................. 55 7.6 The future of CDD programs ............................................................................................................... 55 References ..................................................................................................................................................................... 57 Appendix ........................................................................................................................................................................ 59 9.1 Balance Tuungane 1 treatment and control areas ............................................................................... 59 9.2 Threats to validity ................................................................................................................................ 60 9.3 Exposure and reception among populations ....................................................................................... 61 9.4 The impact of gender parity ................................................................................................................. 64 9.5 Additional social outcomes .................................................................................................................. 65 Final Report of the Tuungane 1 (2007-2011) Program Impact Evaluation 2 9.6 Governance ......................................................................................................................................... 66 9.7 Intra-village cohesion ........................................................................................................................... 70 9.8 Inter-village cohesion ........................................................................................................................... 71 9.9 Heterogeneous effects of the Tuungane program ............................................................................... 72 9.10 Exposure to the Tuungane program .................................................................................................... 75 9.11 List of qualitative villages visited .......................................................................................................... 78 List of Figures Figure 1: Tuungane 1 implementation and data collection .................................................................................... 12 Figure 2: Piloting Instruments ............................................................................................................................... 20 Figure 3: Teams on the Road ............................................................................................................................... 23 Figure 4. Exam related to Mathematics, Science, and French .............................................................................. 38 Figure 5. Overall Summary Statistics Results ....................................................................................................... 52 List of Tables Table 1: Tuungane 1 VDC projects by sector and province .................................................................................. 10 Table 2. Tuungane 1 CDC projects by sector and province .................................................................................. 10 Table 3: Tuungane units per province ................................................................................................................... 11 Table 4: Tuungane 1 primary hypotheses ............................................................................................................. 15 Table 5: Eight dimensions of service quality ......................................................................................................... 16 Table 6: Example results table .............................................................................................................................. 24 Table 7: Dimension 1 – Presence service provider. Health .................................................................................. 27 Table 8: Dimension 1 – Presence service provider. Education ............................................................................. 27 Table 9: Dimension 2 - Building condition. Health................................................................................................. 28 Table 10: Dimension 2 - Building condition. Education ......................................................................................... 28 Table 11: Dimension 3 - Capacity. Health ............................................................................................................. 29 Table 12: Dimension 3 - Capacity. Education ....................................................................................................... 30 Table 13: Dimension 4 - Presence of material and supplies. Health ....................................................................