Framework Contract SIEA 2018 – Lot 1 – Rural Development EuropeAid/138778 /DH/SER/multi Ref: 2018/404595/1 FINAL EVALUATION OF THE PROGRAMME “Accelerate Progress Towards Millennium Development Goal 1C (MDG1.C Programme )” Final Report (Annexes) January 2020 This project is funded by the European Union Implemented by EUROPEAN UNION DELEGATION to MOZAMBIQUE Framework Contract SIEA 2018 – Lot 1 – Rural Development EuropeAid/138778/DH/SER/multi Contract N°: 2018/404595/1 FINAL EVALUATION OF THE PROGRAMME “Accelerate Progress Towards Millennium Development Goal 1C (MDG1.C Programme)” Final Report (Annexes) January 2020 Team Composition: TEAM LEADER: MR SIMONE ARZENI EXPERT 2: MR BERT LOF EXPERT 3: MS MARGARITA LOVÓN CASTRO This preparation of this report was funded by the European Union. The views expressed are those of the consultant and do not necessarily represent any official view of the Commission or the Government of this country Final Evaluation of the MDG1c Programme in Mozambique – Annexes of the Final Report | ii ANNEXES 0) Results Components assessment 1) Terms of Reference 2) Team composition and resumed CVs of the experts 3) List of districts and activities 4) Revised workplan 5) Field itinerary 6) List of persons contacted 7) List of documents 8) Evaluation matrix and Questions for Results Components 9) Overview of Evaluability of impact and outcome level indicators 10) Theory of Change and Logframes 11) Humanitarian assistance data 12) Intermediary Note PPT presentation to Reference Group Final Evaluation of the MDG1c Programme in Mozambique – Annexes of the Final Report | iii ANNEX 0 Results Components Assessment Final Evaluation of the MDG1c Programme in Mozambique – Annexes of the Final Report ACHIEVEMENTS BY RESULT COMPONENT (Main achievements, key findings & factors leading to the achievements, key specific lesson learned) RC1 – Support to seed sector ..................................................................................................................... 2 RC2 – Access to agriculture inputs (e-Vouchers) ..................................................................................... 5 RC3 – Relevant advisory services (FAO and IFAD) ................................................................................ 10 RC4 – Vaccination of Chickens against New Castle disease ................................................................ 15 RC5 – ProAQUA: Aquaculture................................................................................................................... 19 RC6 – ProPESCA: Artisanal Fisheries ..................................................................................................... 23 RC7a – PROMER: Market access for improved incomes ....................................................................... 25 RC7b – Dynamic market intermediaries in small-scale agriculture established ................................. 28 RC8 – Reduction of Post-harvest losses (Gorongosa silos) ................................................................. 31 RC9 – Higher value fish produced and marketed by artisanal fisher folks .......................................... 33 RC10 – Economic and market infrastructure improved for agriculture and fisheries sectors .......... 36 RC11 – Access to Financial Services ....................................................................................................... 38 RC12 – Commodity Exchange and Market information ......................................................................... 40 RC 13 – Food Fortification ......................................................................................................................... 43 RC 14b– Social Behaviour Change Communication (SBCC) - WFP ..................................................... 48 RC 16a– Nutrition education and home gardens (FAO) ......................................................................... 53 RC 16b – Nutrition education in schools (FAO) ...................................................................................... 57 RC 16c – Nutrition education in PROMER, ProPESCA and PSP (IFAD) ............................................... 59 1 RC1 – Support to seed sector Outcome indicator: The main goal of Component 1 is the “Increased availability in the market and use by farmers of high-quality seed of adapted varieties.”. The increased availability of high-quality seeds is expected to contribute to ’enhanced agricultural production’. Outputs Indicators Baseline Target Achieved Percentage of smallholder farmers using 5% 25% Not reported improved seeds Number of new varieties released - 50 47 (94%) The verification means to assess progress on these outcomes were mentioned to be: 1) Baseline survey and impact study, 2) Seed component progress reports, and 3) Trial reports. Only the progress reports (2) have been produced. Whereas a total of 10 output indicators have been monitored (and some even in detail per crop), two out of three outcome indicators have not been monitored and reported. The implication is that the impact of this component on agricultural production cannot be assessed in a quantitative way, but only qualitatively. In terms of outputs, the achievements have been 168% for the production of pre-basic seeds (21.2 tons produced) and 111% for basic seed production (173.4 tons produced). Rationale The Result Component 1 “support to the seed sector” has been implemented by FAO in 17 districts in five provinces. The component has focused on 1) strengthening the institutional and policy framework, 2) the introduction and multiplication of improved varieties, and 3) improvement of seed production by small-scale producers. The budget of the component was € 1.592.429 according to the 2016 addendum. The 2017 USAID study on the Mozambique seed sector identified about 10 programmes to support the seed sector, including Feed the Future, AGRA, InovAgro, SEMEAR, ISSD, etc. The FAO documentation and half- yearly reports mention that they are collaborating with a number of them in particular in the Institutional Strengthening element of the RC 1. The FAO documents do not fully analyse the specific role and contribution of FAO in relation to the other stakeholders in the national seed sector, but it is clear that its role is complementary and intends to avoid duplications. However, it is difficult to assess what the unique contribution of FAO has been to the strengthening of the seed sector. Furthermore, there has been some overlap with other projects and programmes; for instance the SDC supported InovAgro project worked with seed companies and agro-dealers in 11 districts of three northern provinces including four covered by FAO (Gurué, Alto Molocué, Ribaué and Malema districts); Feed the Future and SEMEAR also have an overlap with regard to target districts. Main achievements (whenever possible comparing to indicators) The main achievements of this result component (RC 1) “support to the seed sector” are assessed to be the following: Seed institutional and policy framework. In the context of MDG1c FAO has been one of the technical and financial partners to contribute to the strengthening of the seed institutional and policy framework. In close collaboration with relevant donors (USAID/ Feed the Future, AGRA, SDC/ InovAgro) support has been provided to the strengthening of the institutional and policy framework of the Ministry of Agriculture and Food Security MASA/DINAS. As FAO has been one of the partners closely collaborating with and providing assistance to the National Seed Department of DINAS, it is not possible to attribute the achievements only to FAO; but the Ministry through the DINAS director asserted that the contribution of FAO to the seed sector institutional strengthening was substantial. In the first place, the support to the alignment with SADC’s Harmonised Seed Regulatory System (HSRS). This harmonisation is essential to ensure that the quality of Mozambican seeds meets international standards. Support to the National Seed Department of DINAS included amongst others of training on seed quality control, an important element in the seed sector. A second element of FAO’s institutional support (technical advice and financial support) has been its contribution – together with other stakeholders - to the establishment of a National Seed Dialogue Platform in which the National Seed Department, private sector 2 seed producers and other relevant partners are represented. The National Platform mainly serves to exchange information related to the seed sector between parties involved. FAO also provides support to the Association to Promote the Seed Sector, APROSE (FAO finances its executive secretariat). FAO further contributed to the operationalisation of the private sector seed inspector’s model, in particular the training and accreditation of inspectors. Two national studies on the seed sector and one regional study have been produced with support of FAO/ MDG1c: 1) a study of June 2016 analyses the seed market, in particular the source of seeds being used; and 2) a recent study of June 2019 undertaken by APROSE has analysed the share of subsidized and free seed distribution by government, NGOs and FAO, and 3) a study on the seeds markets in the Zambézia and Nampula provinces of June 2018. All three studies give a good (qualitative and quantitative) overview of the seed sector in Mozambique indicating that the use of certified seeds is increasing but that preserved own local varieties are still the main source of seeds. The studies