FOSTERING BOSNIA AND HERZEGOVINA’S AGRICULTURAL SECTOR PERFORMANCE EVALUATION OF USAID/SWEDEN FOSTERING AGRICULTURAL MARKETS ACTIVITY II (FARMA II) MAY 2018, FINAL REPORT This document is made possible by the generous support of the American people through the United States Agency for International Development (USAID). The contents are the responsibility of a and do not necessarily reflect the views of USAID or the United States Government. MONITORING AND EVALUATION SUPPORT ACTIVITY (MEASURE-BIH) FOSTERING BOSNIA AND HERZEGOVINA’S AGRICULTURAL SECTOR PERFORMANCE EVALUATION OF USAID/SWEDEN FOSTERING AGRICULTURAL MARKETS ACTIVITY II (FARMA II) May 2018, FINAL REPORT Prepared under the USAID Monitoring and Evaluation Support Activity (MEASURE-BiH), Contract Number AID-168-C-14-00003 Submitted to: USAID/Bosnia and Herzegovina Submitted by: IMPAQ International, LLC 2 | PERFORMANCE EVALUATION OF FARMA II USAID.GOV ABSTRACT This performance evaluation of the USAID/Sweden Fostering Agricultural Markets Activity II (FARMA II) assesses progress on the Activity’s contractual obligations to date. FARMA II is currently near the midpoint of implementation and based on the evaluation findings, conclusions, and recommendations from this evaluation, USAID/Sweden will be able to make adjustments to the Activity as needed. The evaluation focuses on four research questions. The first question examines FARMA II’s progress to date on key performance indicators and the prospects for meeting life of Activity targets. The second question examines whether the approach included in FARMA II’s 2017 work plan, which includes the addition of AgMentor, has produced results on key indicators and how this approach has been implemented. The third question examines how public sector stakeholders perceive the relevance of FARMA II and how the Activity’s assistance to this group has been implemented. Finally, the fourth evaluation question assesses whether FARMA II’s TA has led to progress in the adoption of the Rural Development Strategy and how this assistance has been implemented. The evaluation team employed a mixed methods approach to answer each of the evaluation questions through triangulation. In addition to reviewing FARMA II documentation, the team conducted 74 semi-structured interviews and conducted an online survey of FARMA II producer organization (PO) beneficiaries. This evaluation shows that it is likely that given past and present growth trends, FARMA II’s export and jobs targets will be met at the end of the Activity’s implementation. Reaching the sales-related life of activity targets will prove to be a more challenging task since FARMA II has underperformed on these indicators and the other beneficiary POs that have the potential to move into the assisted beneficiary category are relatively small compared to the existing pool of assisted beneficiaries. Therefore, it is expected that the rate of progress toward life of activity targets on performance indicators related to business results will slow in the coming years. Generally, beneficiaries are satisfied with the technical assistance (TA) provided by FARMA II and feel that it meets their business needs. Additionally, all types of TA provided by FARMA II are perceived as useful. However, among some beneficiaries, FARMA II’s approach to TA delivery is not perceived as demand driven. Additionally, many beneficiaries are not familiar with FARMA II’s TA options, approach, and strategy. To expand their reach, FARMA II’s 2017 approach relies on the multiplication of TA through AgMentor. While most stakeholders believe this could be a useful channel to access information, knowledge, and extension and advisory services, there are concerns about implementation to date, ownership, and sustainability. There was satisfaction with the public-sector certification and training received from FARMA II and many stakeholders noted that there was effective communication and collaboration with FARMA II around this TA. However, among others, there were higher expectations of the scope of assistance that would be provided and the extent to which demands would be addressed. While the services provided by FARMA II generally reflect public-sector stakeholders’ needs, stakeholders do not always know about these services or feel that they are part of the process for identifying these needs. FARMA II provided substantial TA in drafting the Strategic Plan for Rural Development (SPRD) and facilitating the process of its design. This included drafting documents, organizing working groups, coordinating public meetings, and mediating between international and domestic and state institutions. Adoption of the SPRD by the BiH Council of Ministers and BiH Parliament was a major structural achievement that met one of required preconditions for BiH to gain access to EU financial assistance for agriculture sector development. However, there are substantial divisions among public institutions in perceptions of FARMA II’s role and efficacy in the development of this policy. Based on these lessons learned, the evaluation team makes nine recommendations to be considered in FARMA II implementation moving forward. 3 | PERFORMANCE EVALUATION OF FARMA II USAID.GOV TABLE OF CONTENTS ABSTRACT .........................................................................................................................................................................................3 TABLE OF CONTENTS..................................................................................................................................................................4 LIST OF EXHIBITS ............................................................................................................................................................................5 ACKNOWLEDGEMENTS ..............................................................................................................................................................7 ACRONYMS ......................................................................................................................................................................................8 EXECUTIVE SUMMARY .................................................................................................................................................................9 EVALUATION PURPOSE AND QUESTIONS ................................................................................................................9 EVALUATION METHODS AND LIMITATIONS ...........................................................................................................9 FINDINGS AND CONCLUSIONS .................................................................................................................................. 10 MAIN RECOMMENDATIONS ......................................................................................................................................... 11 1. EVALUATION PURPOSE AND EVALUATION QUESTIONS ................................................................................ 13 1.1. EVALUATION PURPOSE .......................................................................................................................................... 13 1.2. EVALUATION QUESTIONS .................................................................................................................................... 13 2. FARMA II BACKGROUND ............................................................................................................................................... 14 3. EVALUATION METHODS AND LIMITATIONS ........................................................................................................ 19 3.1. METHODOLOGY AND DATA COLLECTION ................................................................................................ 19 3.2. EVALUATION LIMITATIONS ................................................................................................................................. 22 4. FINDINGS AND CONCLUSIONS .................................................................................................................................. 23 4.1. EVALUATION QUESTION 1 - FINDINGS .......................................................................................................... 23 4.2. EVALUATION QUESTION 1 - CONCLUSIONS .............................................................................................. 27 4.3. EVALUATION QUESTION 2 – FINDINGS ......................................................................................................... 29 4.4. EVALUATION QUESTION 2 - CONCLUSIONS .............................................................................................. 39 4.5. EVALUATION QUESTION 3 - FINDINGS .......................................................................................................... 40 4.6. EVALUATION QUESTION 3 - CONCLUSIONS .............................................................................................. 42 4.7. EVALUATION QUESTION 4 - FINDINGS .......................................................................................................... 43 4.8. EVALUATION QUESTION 4 - CONCLUSIONS .............................................................................................. 44 5. RECOMMENDATIONS ................................................................................................................................................. 44 ANNEXES .......................................................................................................................................................................................