EVALUATION of FARMER- LED AGRICULTURAL INNOVATION for RESILIENCE 2010-2012 Final
Total Page:16
File Type:pdf, Size:1020Kb
OXFAM AMERICA Evaluation Report EVALUATION OF FARMER- LED AGRICULTURAL INNOVATION FOR RESILIENCE 2010-2012 Final Ludovic Pommier External Evaluator 4th March 2014 To promote both accountability and learning, Oxfam will share evaluation conclusions and recommendations with relevant stakeholders, both within the Oxfam system and externally in accessible language and ensuring that stakeholders have an opportunity to participate in discussion of those results in meaningful ways. In addition, to ensure transparency, Oxfam will publish the evaluation reports on our webpage. As a rights-based organization, accountability, particularly to the communities we seek to serve, is of the highest importance to us. For Oxfam, accountability requires Oxfam to regularly and honestly assess the quality of its work, share and learn from its findings with primary stakeholders, and apply that learning in future work. This is an evaluation of Oxfam America’s Farmer-Led Agricultural Innovation for Resilience. The program has been operating in 2 countries since 2010 and this evaluation covers the work undertaken between 2010-2012 (and some of 2013) within Cambodia and Vietnam. The evaluation was commissioned by Brian Lund, Director of Oxfam America East-Asia Regional Office, with funding from Oxfam America. The evaluation process was managed by Ly Yann Kauv, former Program Coordinator from Oxfam America. The major evaluation activities took place between October 2013 and March 2014. The evaluation was carried out by Ludovic Pommier, External Evaluator through a competitive process and reflects the findings as reported by him in validation with stakeholders. For additional information regarding the evaluation Terms of Reference, please refer to the report appendices. i CONTENTS Author’s Preface and Acknowledgements .............................................................................. v List of Tables ......................................................................................................................... vi List of Figures ........................................................................................................................ vi List of abbreviations and Acronyms ...................................................................................... vii Executive Summary .............................................................................................................. 1 Overview Of The Farm-Led Agricultural Innovation For Resilience ........................................ 1 Brief Description Of Evaluation .............................................................................................. 2 Evaluation Methodology ........................................................................................................ 2 Summary Of Findings ............................................................................................................ 2 Main Recommendations ........................................................................................................ 5 Introduction ........................................................................................................................... 6 Overview of FLAIR ................................................................................................................ 6 Program Goal and Objectives ......................................................................................... 6 Theory of Change and impact domains .......................................................................... 6 Evaluation of the first phase of FLAIR (2010-2012) ............................................................... 7 An unusual evaluation ........................................................................................................... 7 Approach ............................................................................................................................... 8 Limitations ............................................................................................................................. 8 Document structure ............................................................................................................... 9 Overview of FLAIR progresses and impact ...........................................................................10 Discussion on impact domains .............................................................................................10 Ordering ........................................................................................................................10 Remarks on impact domains .........................................................................................10 Vietnam ................................................................................................................................11 Impact domain 5. Adoption rates of technologies that are likely to improve farmer resilience (whether innovated among farmers or introduced from outside) ....................12 Impact domain 1. Household income and food security .................................................15 ii Impact domain 2. Environmentally sustainable increases in production .........................17 Impact domain 3. Farmer adaptive capacity (originally 'level of investment by farmers in innovations') ..................................................................................................................18 Impact domain 4. System adaptive capacity (originally 'farmers' innovations taken up by the system') ...................................................................................................................20 Impact domain 6. Farmer voice and influence (degree of satisfactory response/solution to SSFs agriculture-related demand) .............................................................................21 Impact domain 7. Women's empowerment (originally 7. women leadership and 8.joint household decision) ......................................................................................................22 Impact domain 8. National policy and budgets ..............................................................23 Cambodia .............................................................................................................................26 Impact domain 5. Adoption rates of technologies that are likely to improve farmer resilience (whether innovated among farmers or introduced from outside) ....................27 Impact domain 1. Household income and food security .................................................29 Impact domain 2. Environmentally sustainable increases in production .........................31 Impact domain 3. Farmer adaptive capacity (originally 'level of investment by farmers in innovations') ..................................................................................................................32 Impact domain 4. System adaptive capacity (originally 'farmers' innovations taken up by the system') ...................................................................................................................33 Impact domain 6. Farmer voice and influence (degree of satisfactory response/solution to SSFs agriculture-related demand) .............................................................................35 Impact domain 7. Women's empowerment (originally 7. women leadership and 8.joint household decision) ......................................................................................................36 Impact domain 8. National policy and budgets ..............................................................37 Review of key aspects of program design and TOC .............................................................39 Targeting and partners .........................................................................................................39 Vietnam .........................................................................................................................39 Cambodia ......................................................................................................................40 Theory of Change and key design issues .............................................................................40 A difficult gestation: conflicting perspectives ..................................................................40 Lack of partners’ involvement in the design and nature of partnerships .........................41 Review of key assumptions/logical articulation within the Theory of Change .................41 Program implementation and management ..........................................................................45 Program structure .................................................................................................................45 Management and standards .................................................................................................46 iii Finance and budgeting .........................................................................................................46 Consulting use ..............................................................................................................48 Return on investment ....................................................................................................49 Human resources and budgeting ...................................................................................49 Monitoring and evaluation: PMEL is not MEL .......................................................................50 Conclusion