Nepal Pavitra Vegetable Seed Cooperative Project
Total Page:16
File Type:pdf, Size:1020Kb
OXFAM IMPACT EVALUATION REPORT MAY 2014 Impact Evaluation Report Nepal – Pavitra Vegetable Seed Cooperative Project Enterprise Development Programme (EDP) Oxfam GB Bet Caeyers Global Impact Evaluation Advisor, Oxfam GB May 2014 Oxfam Research Reports are written to share research results, to contribute to public debate and to invite feedback on development and humanitarian policy and practice. They do not necessarily reflect Oxfam policy positions. The views expressed are those of the author and not necessarily those of Oxfam. www.oxfam.org Table of Contents Executive Summary ...................................................................................................................... 4 1. Introduction and Purpose ......................................................................................................... 9 2. The Enterprise Development Programme in Nepal .................................................................. 10 2.1. Enterprise Development Programme (EDP) .............................................................................. 10 2.2. EDP in Nepal – the Pavitra Vegetable Seed Cooperative project .............................................. 10 2.2.1. Cooperative selection process ............................................................................................ 10 2.2.2. Cooperative background ..................................................................................................... 12 2.2.3. EDP intervention ................................................................................................................. 13 2.2.4. Expected project beneficiaries ............................................................................................ 15 2.2.5. Expected intermediate and final project outcomes ........................................................... 15 3. Evaluation Approach .............................................................................................................. 18 4. Data ....................................................................................................................................... 19 4.1. Data source and sample ............................................................................................................. 19 4.2. List of caveats ............................................................................................................................. 20 5. Main Results .......................................................................................................................... 21 5.1. Guide to the interpretation of results........................................................................................ 21 5.2. Results on intermediate project outcomes ............................................................................... 21 5.2.1. Access to quality services .................................................................................................... 21 5.2.2. Adoption of improved agricultural practices ...................................................................... 24 5.2.3. Agricultural use of land and labour ..................................................................................... 25 5.2.4. Yields ................................................................................................................................... 27 5.2.5. Revenue from cooperative (dividends and sales) ............................................................... 27 5.3. Results on final project outcomes ............................................................................................. 30 5.3.1. Livelihoods .......................................................................................................................... 30 5.3.2. Food security ....................................................................................................................... 33 5.3.3. Women’s empowerment .................................................................................................... 34 5.3.3.1. Intra-household attitudes towards women ................................................................. 34 5.3.3.2. Women’s perceptions of their community- and cooperative- influencing capability . 36 5.3.3.3. Women’s self-efficacy .................................................................................................. 36 6. New Members and Non-member Seed Suppliers: Descriptive Analysis .................................... 38 7. Conclusions ............................................................................................................................ 40 7.1. General findings ......................................................................................................................... 40 7.2. Learning considerations ............................................................................................................. 42 Appendix A1. Details about the Choice of Evaluation Strategy ..................................................... 44 Appendix A2. Detailed Guide to the Interpretation of Results ..................................................... 52 Appendix A3. Descriptive Statistics on Characteristics of Other Beneficiaries ............................... 55 Table of figures Figure 1. EDP's Change Model's logic in words ..................................................................................... 10 Figure 2. Ranking economic activities based on EDP's priority objectives ........................................... 11 Figure 3. Area of Pavitra’s operations at baseline (2011) ..................................................................... 12 Figure 4. EDP Pavitra Nepal Change Model .......................................................................................... 17 Figure 5. Location of intervention and comparison VDCs .................................................................... 18 Table of tables Table 1. List of expected intermediate and final project outcomes ..................................................... 16 Table 2. Summary of the study sample................................................................................................. 19 Table 3. Access to quality services ........................................................................................................ 22 Table 4. Credit and savings ................................................................................................................... 23 Table 5. Adoption of improved agricultural practices .......................................................................... 25 Table 6. Agricultural use of land and labour ......................................................................................... 26 Table 7. Yields ....................................................................................................................................... 27 Table 8. Revenue from cooperative (dividends and sales) ................................................................... 29 Table 9. Subjective perceptions of changes in the value of sales ......................................................... 30 Table 10. Livelihoods ............................................................................................................................. 31 Table 11. Subjective perceptions of well-being .................................................................................... 32 Table 12. Food security ......................................................................................................................... 33 Table 13. Intra-household attitudes towards women .......................................................................... 35 Table 14. Women’s perceptions of their community- and cooperative-influencing capability ........... 36 Table 15. Women's self-efficacy ........................................................................................................... 37 Table 16. Difference-in-difference intervention effect estimate – example ........................................ 45 Table 17. Estimating the propensity score – non-parsimonious model ............................................... 49 Table 18. Estimating the propensity score – Restricted model ............................................................ 50 Table 19. Balancing test ........................................................................................................................ 51 Table 20. Fictitious data to illustrate the interpretation of results ...................................................... 53 Table 21. Descriptive statistics on demographic characteristics of other beneficiaries (endline) ....... 55 Table 22. Descriptive statistics on access to cooperative services by other beneficiaries (endline) ... 55 Table 23. Descriptive statistics on intermediate outcomes of other beneficiaries (endline) ............... 56 Table 24. Descriptive statistics on final outcomes of other beneficiaries (endline) ............................. 57 Acknowledgments I would like to thank the staff of the Pavitra Vegetable Seed Cooperative and the Oxfam team in Nepal for being incredibly supportive during this review. Particular thanks are due to Anthony Scott Faiia, Karuna Amatya, Rigendra Khadka, Buddhi Raj Tamang, Shyam Paudyal, Mahendra Narayan Mahato, Sudha Khadka, Susan Parajuli, Suravi Gurung, Krishna Prasad Dhakal and Naul Singh Khatri. I also greatly recognise the invaluable cooperation and support provided by the EDP team in Oxford – Hugo