External Evaluation Improving Living Conditions for Coastal Farmers in a Changing Environment, Thatta District, Sindh Province, Pakistan Funded by the Japanese Social Development Fund & the World Bank Yameen Memon, April 2012

Th is report is commissioned by Action Against Hunger | ACF International. Th e comments contained herein refl ect the opinions of the Evaluator only.

Table of Contents

Executive Summary ...... 4 Acknowledgement ...... 7 Acronyms ...... 8 1. Background Information ...... 9 1.1 Context ...... 9 1.2 Specific Objective & Expected Results ...... 10 1.3 Project Target Area ...... 11 1.4 Selection Criteria for Project Beneficiary ...... 12 2. Methodology ...... 13 2.1 Evaluation Objectives ...... 13 2.2 Evaluation Methodology ...... 13 2.2.1 Prior to the Field ...... 13 2.2.2 Project Base Office, Thatta ...... 13 2.2.3 With Project Beneficiaries ...... 14 2.2.4 Meetings with Middlemen/Government Officers/NGOs ...... 14 3. Findings & Discussions ...... 16 3.1 Increase Autonomy/ Self Sufficiency on Agricultural Inputs ...... 16 3.1.1 Village and Beneficiary Identification/selection ...... 16 3.1.2 Community Mobilization ...... 16 3.1.3 Project Coverage ...... 17 3.1.4 Soil Testing ...... 18 3.1.5 Distribution Saline Tolerant Seeds...... 18 3.1.6 Seed Saving Technology ...... 20 3.1.7 Farmer Capacity Building Programs ...... 21 3.2 Reinforce Agricultural Wholesale Markets ...... 23 3.3 Dissemination of Market Price Information ...... 26 3.4 Development Collaboration ...... 27 3.5 Integration of Project Components ...... 29 3.6 Partnership with Pakistan Agricultural Research Center ...... 29 3.7 Project Management and Staff ...... 30 3.8 Impact Assessments ...... 32 3.8.1 Impact ...... 32 3.8.2 Sustainability ...... 32 3.8.3 Replication of Activities and Outputs ...... 33 3.8.4 Project Cost Efficiency ...... 34

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 2]

4. Conclusions and Recommendations ...... 36 Annexures ...... 38 Annex I - Best Practice (Wheat Germination Test Trainings) ...... 38 Annex II (DAC-Based Rating Table) ...... 39 Annexure – III: TORs ...... 41 Annexure – IV: Project Target Villages ...... 53 Annexure: V - Inputs distribution in 2010 ...... 54 Annexure: VI - Inputs distribution in 2011 ...... 55 Annexure – VII: Checklist of Questions for Focus Group Discussion (FGD) ...... 56 Annexure – VIII: KII – Cooperative Management ...... 58 Annexure – IX: Questionnaire - Individual Farmer ...... 60 Annexure – X: KII – Project Staff ...... 63 Annexure – XI - List of people contacted during project evaluation ...... 64

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 3]

Executive Summary

This report presents the findings and recommendations of an evaluation of the JSDF funded three-year project “Improving the Living Conditions in a Changing Environment – Thatta Coastal Farmers” (March 2009 – March 2012). This independent evaluation is aimed at better understanding the results of the applied research of the project and to issue a set of recommendations for future considerations. The evaluation was carried out by an independent consultant from 5th February, 2012 to 29th March, 2012. The overall methodology for the project evaluation was based on a consultative approach with relevant stakeholders. Out of 23 project intervention villages, the evaluation mission in consultation with the ACF field team randomly selected 10 villages (five from each Tehsil). These villages were selected on the basis of wheat, paddy and vegetable group farmers to cover all interventions of the project. The feedback of the beneficiaries was recorded through focus group discussions with farmers, key informant interviews with leader farmers, one ordinary farmer beneficiary from each village and office bearers of the cooperatives. The evaluator also met with several government officials and middlemen to evaluate possibilities of small scale local vegetable market establishment.

The local community was consulted before initiation of the project and the key objectives of the project were shared with the expected beneficiaries. 100% of the beneficiaries that were consulted during the evaluation accepted that they had been consulted about the intervention and had agreed to participate in the project. To assess the soil fertility, soil samples were taken on January 25, 2010 from 15 villages. The soil reports were received back without proper recommendations and due to non functional MoU with PARC, the ACF team introduced saline tolerant seeds on the general assumptions of efficacy for saline soils during the year 2010 and 2011. The majority of the farmers were satisfied with the saline tolerant seed of rice and wheat. However, they were not satisfied with the results of saline tolerant seeds of the vegetables and requested to introduce new and better varieties best matching to the project area.

The best training which is successfully adopted by the farmers is seed germination ratio test method. The farmers were provided this training in November 2011 for wheat crop and farmers were satisfied and assured evaluator that they will apply this method of seed testing each year before applying any seed. In addition, the farmers were also provided extensive trainings from crop cultivation, harvesting and post harvest management. On an overall basis, 336 training sessions were organized where 402 beneficiaries participated from them. The farmers were also provided 162 seed saving containers by December 31, 2011 as against target of 400 seed saving containers. The seed saving containers have left a positive impact on the livelihood of the farmers as they were storing seed through their traditional methods and were losing around 10% of stored seed (as reported by the farmers).

In order to facilitate local wholesale market activity for wheat and rice crop, ACF mobilized local farmers and conducted meetings with wholesale buyers in Garho city. The wholesale marketing activity was organized twice against the target of six wholesale marketing activities. The target could not be achieved mainly due to crop loss during floods of 2010 and 2011. The farmers fetched around Pak Rs.20 per maund (40 kg) higher than if they had sold on individual basis in the nearby town to their village. The

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 4]

evaluator is of the opinion that however, the collective marketing efforts have resulted in higher price but it is not so much effective. On average each farmer brought 18 maunds of wheat crop that means he earned extra profit of Rs. 180/- only by spending full day in the market. This amount is less than daily wage of unskilled labour in the area because of the small quantity of cereal that beneficiaries sell. Hence, evaluator does not see any remarkable impact on the livelihood of the farmers. Keeping in view small difference in the price, evaluator is afraid that collective market efforts may not be repeated after exit of ACF project.

The beneficiaries from all villages appreciated the efforts of the cooperative marketing. These efforts for wheat and rice are worthwhile, but the main need of the area is local vegetable market. The beneficiaries suggested Mirpur Sakro or Garho city as most suitable places. Based on in-depth meetings with ACF and PARC staff, the evaluator is of the opinion that ACF staff had done its best to establish working cooperation with PARC and after a considerable delay the MoU was signed but it did not work well and finally declined by the PARC. However, it would have been better if ACF had hired services of a senior agronomist having field research competence.

As a whole, the project has been successful in achieving the desired objectives. Most of the benefits of the project are expected to remain in the long run. Even in the short run, the ACF project has left a positive impact at macro (community) and micro (household) level. Beneficiaries assured that their income has increased up to 10-15% through introduction of better yielding saline tolerant seed varieties, seed saving container and other farming techniques.

On an overall basis, the available financial resources to the project have been applied efficiently in order to produce the planned results. The project geographical coverage was appropriate as per baseline and the poorest farmers were selected as project beneficiaries. The project activities were also coherent with project objectives and were adequately integrated in between ACF and other local actors. The project has also been very much cost effective and budget has been very wisely spent. As a whole, the project was focused on action research and skills transfer that will benefit farmers in the long run. On the basis of the evaluation, the following recommendations are placed for consideration during the remaining period of the project: Keeping in view the available balance of the project budget, the ACF project should be extended for at least two more years from March 2012 to March 2014. During the remaining period, the project should focus on establishing small scale vegetable market preferably in Mirpur Sakro. The target of distribution of seed saving containers should be completed in the remaining period of the project. ACF needs to provide additional institutional training to staff in agribusiness, social mobilization, marketing mechanism and improve the overall planning of activities and management of deliverables. During the remaining time of the project, the majority of the assistance should cover vegetables because these are cash crop for the project area and wheat and rice has already been given considerable attention during the three years. Therefore, major focus should be on

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 5]

the introduction of better seeds for vegetables during the remaining period of the project. Because of the presence of several local and international NGOs in the area, a Coastal Community Coordination Committee (CCCC) should be established by ACF with the objective of improving coordination and minimizing duplications. The committee will comprise one member from each of the development organization working in the project area. Three members should also be selected from the ACF’s established cooperatives to avoid duplication of development interventions / schemes in the project villages.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 6]

Acknowledgement

The evaluator would like to thank the ACF Teams in Islamabad and Thatta for their generous support and professional contributions to the evaluation exercise. Special thanks go to the project beneficiaries, business representatives, government officials, NGO representatives who had supported to accomplish this assignment within the specified time. Special appreciation goes to Paola Valdettaro, Food Security and Livelihoods (FSL) Coordinator, Senthil Sinnath Ex - FSL Programme Manager, Abdul Uyoob Alabdeen, FSL Programme Manager, Ali Kunbhar – Ex - FSL Deputy Programme Manager, and other field staff at Garho, who have provided information to complete the report. The Evaluator is also thankful to Ghulam Qadir Arbab who supported in the evaluation field activities.

Yameen Memon

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 7]

Acronyms

ACF Action Against Hunger / ACF International ADB Asian Development Bank AKPBS Aga Khan Planning & Building Service CBO Community Based Organization CCCC Coastal Community Coordination Committee DRC Drainage Reclamation Center EDO Executive District Officer EMP Environmental Management Plan FGDs Focus Group Discussion FSL Food Security and Livelihoods HQ Head Quarter JSDF Japanese Social Development Fund MoU Memorandum of Understanding NGO Non Governmental Organization NOC No Objection Certificate NRSP National Rural Support Programme OWFM On Farm Water Management PARC Pakistan Agricultural Research Council PCRWR Pakistan Council for Research in Water Resources PFF Pakistan Fisher folk Forum SAFWCO Sindh Agricultural and Forestry Workers Coordinating Organization SCAD Sindh Coastal Area Development SCCDP Sindh Coastal Community Development Project SWD Solar Water Desalination TOR Term of References TOT Training of Trainers UC Union Council WASH Water and Sanitation and Hygiene Promotion

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 8]

1. Background Information

1.1 Context

ACF (Action Against Hunger / ACF International) is funded by the World Bank through the Japanese Social Development Fund (JSDF) to implement a three-year (March 2009 – March 2012) pilot programme named “Improving the Living Conditions in a Changing Environment – Thatta Coastal Farmers”. A socio-economic study conducted in 2005 by the World Bank and the Government of Sindh in Badin and Thatta districts recommended livelihood improvement intervention based on the findings that their livelihood in these districts are constantly under threat from a number of factors including: Recurring natural disasters; Decreasing flow of fresh water to the Indus delta; Increasing salinity in water; and Poor infrastructure to drain off storm water, and inequities in the land and water distribution.

High investments in agricultural inputs at household level, unsustainable cultivation practices increasing salinity of agricultural lands, lack of basic infrastructure and adequate credit facilities have made small and tenant farmers dependent on high interest loans to sustain their daily livelihood activities with poor returns. High investments in inappropriate agricultural inputs, poor returns on agricultural activities and high health care costs from the incidence of waterborne diseases have created low standards of living for coastal farmers in the district Thatta. Thatta district consists of 9 Tehsils (also called Taluka) i.e. Thatta, Sujawal, Jati Mirpur Bathoro, Shah Bunder, Kharochan, Keti Bunder, Ghorabari and Mirpur Sakro. Many small farmers and tenants are dependent on loans not only to procure agricultural inputs to sustain their livelihood activities but also to meet daily basic needs. Although coastal areas in Pakistan in general face similar challenges, the problem of salinity in the coastal areas of district Thatta (with 40% of the total farmlands affected) is a serious threat to life. Factors underlying the chronic exposure in the area include: Irreversible salinization of agricultural areas; High dependence on inappropriate and untested seeds in the area (normally the seed supply is coming from the international markets while certified seeds by Government of Pakistan are not available in the local market); Nonexistence of physical or formal wholesale markets for agricultural produce (this sometimes result in price differences of 250%. Because the local farmers market their vegetables to Karachi and the local market retailers from project area buy vegetables & fruits from Karachi market. The two way transportation and many different channels result in comparatively higher prices and sometime the price difference reaches up to 250% due to higher demand); and Reduced access to clean and safe drinking water.

With the support of the JSDF and the World Bank, ACF is working in two Tehsils of coastal areas of district Thatta, namely Keti Bunder and Kharo Chan. The project duration is 36 months – starting from March 2009 to March 2012. The main objective of the project is to improve the living conditions of 6,500 small farmer households (farmers with 1-10 cultivatable acres of land) and tenant (indentured farmers to

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 9]

landlords) by increasing household income and decreasing household expenditure and burdens.

1.2 Specific Objective & Expected Results

The specific objective of the project is to improve the living conditions of the selected households in the two Tehsils of Thatta district’s coastal area by increasing household income and decreasing household expenditure and burdens. The specific objectives and expected results of the project are:

Result 1: Increase in autonomy/self-sufficiency on agricultural inputs i. To mobilize 400 farming households for introduction of saline tolerant seeds and seed saving techniques in cooperation with Pakistan Agricultural Research Council. ii. To conduct soil analysis within 2 Union Councils to identify appropriate certified saline tolerant seeds. iii. To distribute certified saline tolerant seeds and required inputs to 400 households and conduct an Environmental Management Plan (EMP) to identify/mitigate any potential adverse environmental impact. iv. To integrate local Agricultural Department and 3-5 Farmer Organizations in improved agricultural techniques trainings and on-farm natural resource management (e.g. seed saving techniques and mesquite harvesting). v. To distribute vouchers for community seed saving containers among 20 farming communities.

Result 2: Reinforcement of agricultural wholesale markets i. To establish 6 wholesale markets within targeted zones within 3 years. ii. To mobilize 3-5 Farmer Organizations for cooperative marketing of agricultural products. iii. To mobilize 4-6 wholesale buyers to participate in wholesale market. iv. To transport agricultural products to major transportation lines 6 times(it seems incomplete)

Result 3: Renewal of access to boreholes turned saline i. To select 400 interested households that live near a saline borehole. ii. To rehabilitate all non-functioning boreholes located near the selected households. iii. To select/design the most appropriate low-cost desalination unit for each household. iv. To distribute the selected units to each household. v. To train households in operation and maintenance of the units. vi. To setup/train a water committee for each borehole. vii. To conduct hygiene education sessions for all households viii. To identify local businesses to manufacture/sell these units.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 10]

Result 4: Enhancement of knowledge and analysis skill in the livelihood sector for Thatta district coastal areas i. To conduct livelihood surveys at the beginning and at the end of the project ii. To present the results to the main stakeholders involved in the area iii. To disseminate the reports

1.3 Project Target Area

ACF carried out a detailed baseline study of the targeted areas in two Tehsils of Thatta district in order to assess the criteria and process of selection of the beneficiaries. Based on ACF study, 23 villages were selected with 402 farmer households what represents a population of around 3,230 as direct beneficiaries of the project.

Table: 1 – Project Target Villages & Beneficiaries Taluka/UC No. of Villages No. of Households Household Members Kharo Chan 11 181 1,314 Keti Bander 12 221 1,916 Total 23 402 3,230 Source: ACF Field Office, Garho

The maps of the FSL Project area are given below:

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 11]

1.4 Selection Criteria for Project Beneficiary

The ACF project followed a practical approach in the selection of the villages and beneficiaries. In depth baseline survey was conducted in October 2009 to select most vulnerable villages and beneficiaries. The selection of the beneficiary households was based on the criteria that the household should be involved and dependant on agriculture. Out of nine Tehsils in district Thatta, ACF project selected two Teshils i.e. Keti Bunder and Kharochan on the rationale that these Tehsils are located on the south-western coastlines of the district where the salinity problem has adversely affected the livelihoods of the agro-based communities. A total of 30 villages, 15 from Keti Bunder and 15 from Kharochan Tehsils were identified during the baseline survey. In addition, Focus Group Discussions at eight villages were also carried out i.e. five villages in Keti Bunder and three villages in Kharochan by ACF baseline survey team. Out of these 38 villages, 23 villages were selected. Beneficiaries have been selected taking into consideration the characteristics of the villages where they lived, condition of access to land, size of the land cultivated, access to irrigation and salinity. Additional criteria were also established for the selection of farm leaders and the selection of the CBOs.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 12]

2. Methodology

This evaluation is aimed at better understanding the results of the applied research and pilot approach of the project and to issue a set of recommendations regarding potential scale-up.

2.1 Evaluation Objectives

The specific objectives of the evaluation were: To focus on assessing results 1 and 2 of the programme, using standard evaluation criteria; To specifically consider the resilience of the piloted approach to the exceptionally harsh and disaster-prone natural environment of coastal Sindh (environmental resilience/impact; disaster risk reduction); To capture lessons learnt in order to feed ongoing programming; and To reinforce integrated programming and to support with appropriate operational recommendations for future, in line with ACF International Strategy.

2.2 Evaluation Methodology The evaluation was conducted from 5th February, 2012 to 29th March, 2012. Specifically the evaluation focused on the following main areas: Reviewing critically the assessment of the project strategy, approach and staff capacity; Assessment of the project implementation activities and conclude whether the project implemented the most appropriate type of interventions and in relation to small farmers’ need in project areas; and Provide specific guiding strategy and approach to accomplish in remaining period of the project.

The evaluator used the following tools/ methods to accomplish the evaluation task:

2.2.1 Prior to the Field Travel to Islamabad for briefing; Briefing HQ (teleconference); Briefing mission, review of documents, and preparation of fieldwork + evaluation framework; Review of secondary data, review project proposal & budget, quarterly reports, baseline surveys, monitoring reports, event reports, market survey reports, and other relevant project reports.

2.2.2 Project Base Office, Thatta Meetings with Project staff including WaSH team at Thatta. Planning the field evaluation schedule in consultation with ACF project staff.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 13]

2.2.3 With Project Beneficiaries Visit to ten randomly selected villages out of 23 project targeted villages. Conduct focus group discussions at village level and in-depth interviews with the farmer beneficiaries and members of marketing cooperatives. Conduct focus group discussion in four villages for WaSH (Water and Sanitation and Hygiene) promotion related activities.

2.2.4 Meetings with Middlemen/Government Officers/NGOs Meetings with the middlemen and for market analysis with rice traders. Meeting with officials of agriculture department and officials of NGOs. Interviews with officials of Pakistan Agricultural Research Council (PARC), Government of Pakistan. Presentation of draft findings to Project Staff team.

The overall methodology for the project evaluation was based on a consultative approach with relevant stakeholders such as farmer beneficiaries, leader farmers, members/office bearers of the cooperatives, household (particularly women) under WaSH component, project staff, officials of the government organizations and agencies, members of the private marketing channels such as middlemen and buyers through key informant interviews, focus group discussions and individual interviews. Checklists and semi-structured field instruments were employed for this purpose. The qualitative and quantitative collected data were analyzed and presented in this report.

Out of 23 project targeted villages in two Tehsils, the evaluation mission in consultation with the ACF field team randomly selected 10 villages (five from each Tehsil). These villages were selected on the basis of wheat, paddy and vegetable group farmers to cover all interventions of the project. In order to get perceptions from the farmers at least 10 farmers were invited from each village for focus group discussions. In addition, for the in-depth beneficiary interviews, a leader farmer and a farmer from the same village were also interviewed using the questionnaire. This was done mainly to see the difference of farming practices adopted by the leader farmers and the ordinary farmer beneficiaries of the project. By default each village has one leader farmer, therefore, as such there was no criteria for selection of leader farmer; however, the ordinary farmer was selected based on the criteria that he actively participated in the ACF interventions. The available office bearers of the three Cooperative Marketing Organizations formed under project were interviewed in order to evaluate their collective efforts to market the crop produce on cooperative basis. The evaluator also met with the Director Agriculture Marketing, Government of Sindh in order to assess the possibilities of establishing local vegetable market. A local vegetable market at Khawaja Goth near Mirpurkhas city was also visited in order to assess the process of evolution of the market. The seasonal middlemen of tomatoes were also interviewed at Mirpur Sakro city to gauge the possibilities of establishing seasonal vegetable market in the area. The cereals were sold on collective cooperative marketing basis to two rice mills in the Garho city. The evaluator interviewed one wholesaler to evaluate the price difference by selling product individually or cooperative basis.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 14]

The evaluator was also requested to look at the Water and Sanitation and Hygiene (WaSH) promotion component. The evaluator focused on four villages out of ten villages where WaSH component is being implemented and inquired about the benefits of the WaSH activities during focus group discussions with male beneficiaries. As the direct beneficiaries of WaSH activities were female, two female field investigators were also hired to conduct the focus group discussions with women in the same four villages.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 15]

3. Findings & Discussions

The local community actively participated in male and female focus group discussions during the entire process of evaluation. The findings of the evaluation are summarized below:

3.1 Increase Autonomy/ Self Sufficiency on Agricultural Inputs

3.1.1 Village and Beneficiary Identification/selection

Out of nine Tehsils in district Thatta, ACF project selected two Teshils i.e. Keti Bunder and Kharochan considering these Tehsils are located on the south-western coastlines of the district where the salinity problem has adversely affected the livelihoods of the agro-based communities. Before starting baseline survey, a list of villages prepared in both the Tehsils by the ACF staff. As per details from the Revenue Department, Government of Sindh, there 82 villages in Keti Bunder Tehsil and 105 villages in Kharo Chan Tehsil.

Since the criteria for selection of villages was that each of the selected village must have at least 25 to 30 households dependant on agriculture, small land holding and lands are affected by salinity. The ACF project followed a practical approach in the selection of the villages and beneficiaries. In depth baseline survey was conducted in October 2009 to select most vulnerable villages. Since the majority of the villages derive their livelihood from fishing in Tehsil Keti Bunder and Kharo Chan. Therefore, out of total 187 villages in both Tehsils, only 30 villages dependant on agriculture were selected for in-depth baseline survey. These 30 villages comprised 15 villages from each of the Tehsil Keti Bunder and Kharo Chan. In addition, Focus Group Discussions at eight villages were also carried out i.e. five villages in Keti Bunder and three villages in Kharochan by ACF baseline survey team. Out of these 30 villages, 23 villages were selected for the project implementation.

The beneficiaries have been selected taking into consideration the criteria that each of the beneficiary is a share cropper, owns less than 10 acres of cultivable irrigated land, and the land is affected by the salinity. In addition to beneficiaries selection, a leader farmer and a CBO was also selected from each of the village keeping in view the criteria for selection of Leader Farmer and CBO. The ACF staff conducted several consultative meetings in the selected villages and sought willingness of the beneficiary to cooperate throughout the project cycle. After successful completion of the beneficiaries and the CBO selection, the demonstration lands were also identified in each of the selected village considering that the land has proper irrigation and drainage facilities and the land is available for training and demonstration purposes for all beneficiaries in that village.

3.1.2 Community Mobilization

In order to start project implementation, the project team mobilized the farming community of the targeted area which was selected after a baseline survey. Community mobilization process took longer than projected mainly due to the unexpected delays in the baseline study and the low level of education of

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 16]

the rural community. The local community was consulted before initiation of the project and the key objectives of the project were shared with the expected beneficiaries. While replying to questions of the evaluator, 100% of the selected beneficiaries accepted that they were consulted about the project interventions and they agreed to participate fully in the project. The mobilization process included meetings with the farmers and seeking their willingness to be a part of the development of the project and to spare time for project interventions. The ACF team described to the beneficiaries that the demo plots would be set up on their land to test saline tolerant seeds of wheat, rice and vegetables with their full involvement.

The ACF team observed that the beneficiaries had high expectations from ACF with provision of inputs for one or two acres rather than demo plots. Therefore, ACF team decided to provide inputs for half acre for the cultivation of rice and wheat crop per beneficiary. Even some of the beneficiaries also complained to the evaluator about the low volume of inputs of half acre provided to them by ACF in terms of time spent with ACF on demo plots and trainings. However, the majority of the beneficiaries were happy with the ACF intervention and extended full of their cooperation by providing time for on-farm training sessions. On an average, each beneficiary was given two on-farm trainings per month and the majority of the beneficiaries participated in the trainings. The involvement of the beneficiaries in trainings proves effective mobilization of the community by the ACF team. Moreover, in each of the 10 selected villages for the project evaluation more than 90% of the beneficiaries participated in the focus group discussions despite the fact that this coincided with the peak tomato picking season.

3.1.3 Project Coverage

Keeping in view the overall performance of the project from March 2009, the evaluator is of the opinion that project has successfully covered the needs of the area more than 80% as per criteria laid down in the TORS of the Project. Moreover, these Tehsils also fulfill the “beneficiary” criteria as laid out by the donor; small farmers and tenants holding one to ten acres of agriculture land. The beneficiaries selected were also worst affected and were selected purely on merit. The geographical coverage of the project also seems fully justified as most of the villages in the two Tehsils derive their livelihood from fishing occupation. Hence, only those villages were selected which have at least 25 to 30 households mainly dependant on agriculture for their living. More than enough trainings were provided to the beneficiaries in the field and in other cities in order to improve their knowledge about farming business. During focus group discussions and individual interviews with the beneficiaries, the evaluators clearly observed a higher degree of knowledge among the beneficiaries of the project as compared to non beneficiaries. The project has brought many positive changes in the farming practices leading to increased yield of the crop, proper post harvest management and marketing tactics.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 17]

3.1.4 Soil Testing

To assess the soil fertility, soil samples at the depths of 0 – 15 cm and 15 – 30 cm 30-45 cm and 45-60 cm were taken on January 25, Soil Testing (Comment 1) 2010 from four corners and centre of the field from 15 villages We don’t know where soil including demo and control plots. Special tests like pH, ECe, testing is done. We presume that it is done somewhere mS/cm, Anions Meq/l, Cations, Meq/l, SAR and ESP were done at else not in our country. the Drainage Reclamation Center (DRC) of PCRWR, Tando Jam on recommendation of PARC. The ACF staff informed that based Villager from Village Yaqoob on soil analysis reports, the ACF team introduced saline tolerant Murghur seeds including Compost (Organo Plus), Bio fertilizer (Bio Plant) and Bio fertilizer (Pro Plant) in the project area.

However, the evaluator observed that the saline tolerant seeds were provided on general assumptions of efficacy for saline soils. Soil Testing (Comment 2) However, it would have been better if the seeds and inputs have We don’t need soil testing been provided based on the soil in each village. There were no because we know our land as recommendations on soil testing. This was also one of the reasons; we are cultivating it since ancestors. ACF did not share the results of the soil testing with the beneficiaries and the opportunity of promoting the benefits of the Villager from Village Muhammad soil testing among the beneficiaries was also lost due to Hashim Sholani unavailability of recommendations based on soil analysis done by Pakistan Council for Research in Water Resources (PCRWR). However, there is need to circulate the soil testing results among the beneficiaries in order to create awareness and habit to analyse their soil samples after appropriate interval. This should be done in the extended period of the project.

3.1.5 Distribution Saline Tolerant Seeds

The biggest challenge faced by the ACF team was the introduction of saline tolerant seeds, best suited to the climate and saline soils. The project implementation was slightly delayed due to delayed livelihood baseline survey which was conducted twice in the year 2009 as the first consultant resigned and had to be replaced. This also affected the hiring of ACF project staff. The discussions of modalities of MoU with PARC also caused delay on the implementation of the project. ACF distributed saline tolerant seeds during year 2010 and 2011 for paddy, vegetables and wheat crops. The detail on distribution of saline tolerant seeds and inputs is given in table - 2 below:

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 18]

Table 2: Input Distribution to Beneficiaries and Demo Plots During the Year 2010 and 20111 Distribution 2010 Distribution in October 2011 S# Input Name Unit Per Half Acre Demo Plot Per Half Acre Demo Plot Benf. Qty Plots Qty Benf. Qty Plots Qty 1 Paddy (IRRI - 9) Kg 354 2,390 40 13.36 200 1,350 2 Compost (Organo Plus) Kg 354 14,160 20 180 - - 38 9 3 Bio fertilizer (Bio Plant) ml 354 88,500 20 1,250 - - - - 4 Bio fertilizer (Pro Plant) ml 354 132,750 20 1,874 - - - - 5 Tomato Seed Gram 160 4,000 40 198 - - - - 6 Chili seed Gram 160 12,000 40 494 - - 36 15 7 Pumpkin Seed Gram 160 42,400 40 2,100 - - - - 8 Cow Dung Kg - - - - 401 601,500 - - 9 Wheat Seed (Inqalab - 91) Kg - - - - 202 4,020 6 1.25

Table -2 reveals that the saline tolerant seed distribution started in 2010 with paddy crop variety IRRI-9 and benefited 354 beneficiaries. Forty demo plots were made in the land of the selected beneficiaries in their villages in order to analyze the seed performance and educate the beneficiaries about improved farming techniques. In addition to demo plots, the selected 354 beneficiaries were also given IRRI-9 seeds and organic inputs of compost (Organo Plus), Bio & Pro Plant (Bio Fertilizer) for half acre as an incentive to enhance the involvement of the beneficiaries with project interventions. Saline tolerant seeds of vegetables (Tomato, Chili, and Pumpkin) were distributed among another 160 vegetable growing beneficiaries. Almost all (99%) farmers during the focus group discussions and key informant interviews loudly accepted that the rice variety IRRI-9 introduced by ACF provided high yield as compared to IRRI- 6 variety which has been cultivated since long time in the area. Some of the beneficiaries were also continuing cultivating IRRI-6 as they did not save the seed for next season. However, majority of the beneficiaries confirmed that they replaced IRRI-6 with cultivation of IRRI-9 variety introduced by ACF in the project area.

The beneficiaries were of the view that the imported vegetable seeds provided by ACF team were not matching with the requirements of the project area, hence, could not deliver the desirable results. The tomato crop’s yield was higher as compared to local varieties but due to softness of the tomato, it could not get better price in Karachi market. This was mainly due to the reason that the wastage ratio would be more if transported to Karachi. Hence, the middlemen did not offer better price for tomato crop. The chili seed was not good as its size was very small and it has not germinated well in some of the villages. The pumpkin seed could not generate expected results. Based on the results of vegetable crops, ACF did not give vegetable seed during 2011.

The beneficiaries were provided regular trainings on different crop production practices for wheat and rice. Therefore, the beneficiaries were divided into two main groups of paddy (200 beneficiaries) and wheat growers (202 beneficiaries) in order to effectively organize the collective trainings for wheat and

1 Paddy seed was distributed during the month of April-May during 2010 and 2011. The seed of vegetables were distributed during the month of September 2010. The wheat seed distributed in October 2011.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 19]

paddy groups. Keeping in view comparatively higher prices of bio fertilizers and compost (Organo plus), ACF provided cow dung to the beneficiaries of wheat and paddy groups.

After comparing the wheat seed germination test on two wheat varieties (i.e. Sahar-6 and Inqelab-91) conducted in ACF field office Garho, it was concluded that Inqelab-91 variety was better as compared to Sahar-6. Therefore, six demo plots were set up in November 2011 on selected plots in the land of beneficiaries. In addition, 202 beneficiaries of wheat group were also provided seed of Inqelab-91 at the rate of 20 kg per half acre with 1500 kg of cow dung to each beneficiary. The beneficiaries were given proper training on wheat seed germination test. The beneficiaries informed the evaluator that the wheat seed germination stood in between 95 and 100% and the crop growth is also comparatively better than their own cultivated variety of Rustam. The wheat crop has not been harvested yet, but the majority of the beneficiaries during focus group discussions and key informant interviews have shown their satisfaction on the existing growth of the crop. More than 95% of the beneficiaries were happy enough by learning about the seed testing method and some of the beneficiaries also informed that they had used the testing method technique on cotton crop seed and they would also follow the seed testing method for rice crop next year. The beneficiaries accepted the fact that before they were using any seed on just verbal assurance of seed supplier or any other grower from the area. But after learning an easy technique to test the seed, they will now be able to cultivate good quality seed in future.

The single most popular and successful activity implemented under this project has been the promotion of better ways of making compost. Farmers are now able to utilize increasing quantities of compost in their fields. Compost making trainings and technical support was most frequently appreciated by respondents during the FGDs as being among the more effective interventions that ACF supported. The strengthening or revival of compost making at a time when chemical fertilizer prices have risen is indeed a very significant and noteworthy accomplishment.

As a whole, the beneficiaries were happy enough with the extensive trainings provided to them from growing to harvesting and post harvest management. They learned many techniques for efficient farming and informed to the evaluator that they are utilizing those techniques for crop maximisation. However, some of the beneficiaries also requested to increase the volume of inputs from half acre to one to two acres because of their poverty.

3.1.6 Seed Saving Technology

Traditionally, the local farmers store wheat and rice for home consumption. They make container on the surface of the land at a Seed Saving Container Seed containers have given us new suitable place in their homes by using locally made mat (made ways of preserving seeds. We will from palm leaves) and then cover it with clay keeping an opening now cultivate crops from our own saved seed. Thanks ACF for helping point at the top. The container is opened frequently during the us. year for home consumption of wheat and rice. Moreover, the Villager from Village Abu Baker beneficiaries also informed the evaluator that as these were built Khaskheli on the surface of the land, the traditional seed containers were

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 20]

destroyed by the floods in 2010 and 2011, . As a consequence they faced serious loss of their stored cereals for the year.

In order to effectively save the seeds for consumption and future cultivation, ACF planned to distribute technically improved seed saving containers among the selected beneficiaries. Although ACF aimed at distributing 400 seed containers based on farmers’ requirements, only 162 containers had been distributed among the beneficiaries by the 12th quarter of the project ending on December 31, 2011. The remaining target of the seed containers are expected to be distributed during the current quarter from January to March 2012. The evaluator is of the opinion that the seed saving containers distribution needs to be ensured because the seed saving container will enable the farmers to preserve the seeds that ACF will distribute for next season.

On inquiry about the benefits of the seed saving container from the beneficiaries, the absolute majority of the beneficiaries consulted appreciated their provision. This has allowed them to store their own seed for future consumption and cultivation. Moreover, the seed saving container is placed on the height which saves the seed from mouse, insects and decay. The seed saving containers helped to maintain the quality of stored seeds and reduced the loss of around 10% that beneficiaries had when using the traditional storage method. The beneficiaries informed that although they have been storing wheat and rice for home consumption since ancestors, they did not know the efficient that ACF has introduced . The evaluator observed that the beneficiaries have shared the benefits of the seed saving containers with their fellow farmers in others villages. Moreover, it was also been observed that the intervention was directly relevant to the need of the local community and it may also not face any problem of sustainability because of the reduced cost of the setting up of this seed saving containers.

Traditional method of seed storage ACF introduced method of seed storage

3.1.7 Farmer Capacity Building Programs

After successful completion of the beneficiary selection, the project mainly focused on capacity building of the farmers. The majority of the selected beneficiaries was interested in the training sessions and acquired essential knowledge and skills to implement a step-by-step technique for crop production, identifying the saline tolerant varieties, post harvest management, and marketing mechanism. The trainings were imparted by ACF field staff at village level and other places. The selected farmers were

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 21]

taken to other places like Hyderabad for integrated trainings on advance farming practices and handling of crop produce. The summary of the trainings is given in Table -3 below:

Table: 3 - ACF Training Modules and Number of Beneficiaries # Major Field Total Events Total Beneficiaries 1 Production Technology 210 2,185 2 Marketing 48 696 3 Mobilization 48 554 4 Record Keeping 25 176 5 Farmer Field Days 5 128 Total 336 3,739

The most important achievement of the ACF project is mobilization of the beneficiaries towards new methods of farming Leader Farmer and use of improved saline tolerant seeds. This all happened Now I have competence to serve as mainly due to the integrated trainings. On an overall basis, 336 resource person delivering the lectures and disseminating training sessions were organized from which 400 project information to my fellow farmers in beneficiaries participated repeatedly throughout the project cycle. different villages on various learned techniques of agricultural These trainings also included training of trainers as well in order to production practices. provide master trainers within the community. Trainings of Mr. Yaqoob Murghur Leader Farmer trainers were organized in order to enable local farmers to share the benefits of improved techniques among the local community members. In addition, several information sharing sessions with farmers were also organized by ACF. Efforts were also made to provide training on sensitization/mobilization of agriculture marketing cooperatives including membership process and mobilization sessions. In the trainings the following topics were covered: Agricultural marketing Post Harvest Management of Vegetables Calculating cost of production Preparation of Neem Bio Pesticide Chili cultivation techniques Preparing Bordeaux Mixture Compost making Seed production techniques Cooperative marketing and process seed production technology Depog Nursery Management Seed Storage containers Community base natural resource Sensitization mobilization of saline tolerant management seeds Farmer Field Days Wheat cultivation techniques Record keeping TOT - Paddy Nursery preparation on Depog Improved Agricultural Techniques Method Land preparation for paddy cultivation TOT - Paddy transplantation and fertilizer Nursery Establishment application Paddy Dapog Nursery Management and TOT - Post harvest management of Transplantation vegetable Paddy Transplantation TOT - Seed Storage containers

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 22]

Educational presentations were also given on findings of various research conducted by the ACF like market survey. Five farmers’ Seed Germination Test We will never forget hands-on field days were also organized by ACF in order to share practice done for germination test achievements and progress on demonstration plots for rice and to select seed for any crop like wheat seed where 100 seeds were wheat crops. sown in a pot for 3-4 days and counted its germination ratio. We are now advocating the benefits of "The efforts made so far by ACF in capacity building program are seed germination to other villagers. commendable as we have now established confidence ourselves to Several Farmers of the Area educate our own fellow farmers in nearby villages on learned Villager from Village Abu Baker techniques. We have been answering questions and clarifying Khaskheli queries of the participants while imparting training" (Leader farmer / Resource Person).

The trainings have improved beneficiaries cropping practices. The beneficiaries said that now they are using grading techniques to Collective Crop Selling improve the quality of their product what allows them to obtain I always used to think how we can get better price? I am higher yields. In order to assess the adoption, the evaluator asked member of ACF’s sponsored about the application of learnt techniques such as transplantation of marketing cooperative and I rice crop etc. The beneficiaries informed that they have been sold wheat through ACF sponsored collective selling adopting many techniques learned through trainings provided by efforts and I earned more. ACF such as seed testing technique, preserving seed in seed Thanks ACF who made my container, proper land levelling, and efficient post harvest dream come true. management. The evaluator also observed that the beneficiaries are Muhammad Hashim Murghur, not adopting some of the major techniques such as rice village Ali Abux Murghor transplantation method of sowing. However, the beneficiaries admitted that there is no doubt that transplantation method of sowing rice is comparatively better in terms of yield, however, they cannot adopt it because it requires more time and labour which they cannot afford. Also, the beneficiaries also recognized the benefits of cow dung but they informed that they will not be able to adopt it because cow dung is purchased on cash and they cannot afford it. However, they can purchase chemical fertilizer for the local market on credit.

3.2 Reinforce Agricultural Wholesale Markets

Farmers in Thatta District mainly grow vegetables, betel (pan) leaves and cereals at large scale. These crops are then sold to middlemen on farm gate as well as at markets. Currently, marketing system is not producer friendly as major part of benefit goes to the other actors of the market. ACF, under its World Bank funded project, is focusing on the reinforcement of the wholesale market at local level so that local small farmers may be self sufficient and have more bargaining power. In order to achieve these goals, ACF mobilized the beneficiaries and facilitated the setting up of three farmer Cooperative Organizations with the composition of office bearers as Chairman, Vice Chairman, General Secretary and Finance Secretary with other general body members from the villages. In order to cover representation from the entire project area of 23 villages, each Cooperative Organization is covering around eight villages. The

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 23]

body of one cooperative organization, operating from the village Muhammad Hashim Sholani was dissolved by ACF as some of the office bearers were not active in the affairs of the organization and nominated an acting committee to look after the organization until the new body is elected by local farmers. The evaluator also met with acting committee members of the organization to evaluate the performance of the organization.

The establishment of the wholesale market in the local area is an ambitious process involving various actors and organizations, no doubt even establishment of one market particularly in Mirpur Sakro in the long run will benefit small growers by enabling them to transport their farm produce in the market and sell directly to the buyers. Most of the beneficiaries said that they cultivate wheat and rice crop mainly for home consumption and sell if there is surplus crop. But keeping in view small quantity, they sell it to the local middlemen in nearby town at comparatively lower price than price offered by rice mills in Garho city.

In order to facilitate local wholesale market activity for wheat and rice crop, ACF mobilized local farmers and conducted meetings with wholesale buyers in Garho city. The wholesale marketing activity was organized two times against the target of six wholesale marketing activities. The target could not be achieved mainly due to crop loss during floods of 2010 and 2011. These cooperative organizations took active participation in mobilizing the local farmers to sell wheat and rice crops produce on collective basis to the wholesale buyers in Garho City. ACF provided an incentive by bearing 50% of the cost of transportation in order to increase the net returns from the sale proceeds. The cooperative marketing efforts increased the bargaining power of the small farmers as they were in the position to negotiate the price with several buyers due to bulk quantity of the crop and the farmers fetched around Pak Rs.20 per maund (40 kg) higher than if they had sold on individual basis in the nearby town to their village. The wholesale buyers in Garho city also confirmed to the evaluator that they pay comparatively higher price on bulk purchasing. The table 4 reveals that five and seven farmers participated in the collective marketing activity for wheat and rice respectively. The rice was sold six times on different dates from November 22, 2011 to December 09, 2011. On average each farmer brought 18 maunds of wheat and 38 maunds of rice for sale in the market and received average price of Rs. 900/40 kg for wheat and Rs. 786/40 kg for rice.

Table: 4 – Wholesale Marketing Results Crop Date Quantity sold Total Average produce per Average (maunds) farmers farmer (maunds) Price Wheat 19th April, 2011 91.675 5 18 900

Rice From Nov 22, 11 to 265.675 7 38 786 December 09, 2011 Source: ACF Field Office, Garho.

As such there is no wholesale market for cereals in rural areas. The farmers mostly sell their wheat and rice crop to middlemen, mill owners or government food department. ACF has also utilized the marketing channel of mill owner and facilitated the farmers by transporting their cereals to the mill. Hence, the

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 24]

collective marketing efforts have resulted in higher price but do not appear to be effective. On an average each farmer brought 18 maunds of wheat crop that means he earned extra profit of Rs. 180/- only by spending full day in the market. As the activity was organized for the small farmers and they normally sell a very small quantity of cereals. Hence, no remarkable impact has been observed on the livelihood of the farmers. Keeping in view lower price difference, collective market efforts are at risk of not being repeated after exit of ACF project. The beneficiaries from all villages appreciated the efforts of the cooperative marketing. These efforts for wheat and rice are worthwhile, but the main need of the area is local vegetable market. Therefore, evaluator is of the opinion that focus should be given on establishing a small vegetable market in Mirpur Sakro town which is center point to the farming community of the area.

Proposed Working Model for Local Vegetable Market

In order to explore possibilities of local vegetable market, a meeting was held with Director, Agricultural Marketing, of the Government of Sindh. Based on these discussions, the following working model for local vegetable market is proposed.

There are different ways to start a vegetable market: a) Market Committee, Department of Agricultural Extension, Government of Sindh purchases the land and starts vegetable market by making shops/sheds; or

b) Local community, farmers or any NGO can acquire the land on rent or by purchasing the land and then start the vegetable market

In order to get legal status of the organization, there are few Acts/ Ordinances of the Government of Pakistan to register the organization such as: Societies Act 1860, Charitable and Endowment Act 1890, Voluntary Social Welfare Agencies (Registration and Control) Ordinance1961, Trust Act 1882, Co- operative Societies Act 1925, Companies Ordinance 1984 and Local Government Ordinance 2001. The organizations formed with the facilitation of ACF need to be registered with one of the appropriate government registration bodies to enable them to further correspond with the donors and government organizations. The registration process can be initiated at district level government office.

Steps of Market Registration

In all cases as mentioned in a & b above, the market to be established is called Feeder Market. After acquiring the land, permission will be sought from Government of Sindh under APM Act 1993. The market layout plan with maps of shops, sheds, roads, toilets, water and parking facilities will be submitted to Agricultural Marketing of Agricultural Extension Department, Government of Sindh. As such there is no need to construct shops in the beginning. The small temporary wooden sheds can be built for the purpose. (Director Agricultural Marketing gave example of vegetable market which was established through his efforts around 10 years before. He organized some local farmers and rented a piece of land on monthly rent of

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 25]

Rs.10,000. Then 12 temporary shops were made in the market and were given on monthly rent of Rs. 2,000/- each. This created extra amount to facilitate market activities). The officials of Agricultural Marketing Agricultural Extension Department, Government of Sindh will visit the area and will give their No Objection Certificate (NOC). After NOC is given, the Agricultural Marketing Department will notify the establishment of market.

Market Operations

Market promotion campaign will run through banners, local announcements on loud speakers and FM Radio. The middlemen from Karachi and other local markets will be invited to participate in auction of the market. The market will start working with one or two middlemen in the beginning. At the start, the target buyers will be local retailers who purchase vegetables from Karachi In case, the vegetables brought in the market are not sold, the management of the market will buy it and will sell it in the Karachi vegetable market. With the passage of time, the market operations will increase and there will be need to deploy at least two persons in Karachi vegetable market to sell the abundant market produce from local market and purchase fruit from Karachi vegetable market and send that to local market to meet local demands.

Market Establishment Process

ACF may conduct a deeper analysis of establishing market strategy and its implementation process in order to ensure successfully setting-up a market. ACF may conduct a field survey for the suitability of the market location and implementation strategy. Based on feedback and evaluator observation, Mirpur Sakro is the ideal location for the local vegetable market. ACF may organize some local farmers or cooperative organizations and then rent out the piece of land and initiate market process.

3.3 Dissemination of Market Price Information

The market price is of great importance for the small farmers in the project area in order to facilitate the sale of produce at comparatively higher prices. Unfortunately, there is no mechanism for the dissemination of market information in the project area. Agriculture farm produce include cereals (wheat and rice), vegetables and fruits. The cereals are either stored by the small farmers for home consumption or sell to middlemen in small town nearby to their villages. Majority of the beneficiaries informed evaluator that they store wheat and rice for home consumption throughout the year. Moreover, if some of the farmers have to sell the cereals, they sell small quantity to local middleman on a lower price than wholesale buyers in Garho city. This is mainly due to the reason that they cannot afford or spare time to

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 26]

transport small quantity to sell in Garho city. Therefore, price information of cereals has lower impact on the earning of the small farmers of the area.

On the other hand, the vegetables are grown on a higher scale in the project area as cash crop and most of the vegetables are sold in Karachi market either transported by the farmers or through middlemen. The beneficiaries informed the evaluator that they also want to explore other markets such as Hyderabad and Mirpurkhas but they don’t have access to latest market information about demand and price of different vegetable crops. While stressing upon the need of the latest market information, one of the beneficiaries informed to the evaluator during the FDG that once he was offered Rs. 1,800 per 40 kgs of chili from Karachi market. Fortunately, he got information from a friend that the price in Hyderabad market is higher i.e. Rs. 2,400 per 40 kgs. Therefore, he transported his farm produce in Hyderabad and earned a considerable amount.

The beneficiaries while appreciating the collective marketing efforts of ACF to sell their cereals requested the provision of current market prices of vegetables in different regional and local markets in order to equip them to sell their farm produce on comparatively better price. The information on weekly vegetable price trends in different regional markets such as Karachi, Hyderabad, Peshawar, Quetta and Rawalpindi will help local producers to bargain price for their vegetables more effectively with the middlemen. Therefore, FM 92 radio is recommended as an ideal and cost effective solution to promote market price information on daily basis at fixed time in the morning. FM 92 radio is listened in villages of coastal areas (Badin and Thatta Districts) with great interest as being main source of entertainment.

3.4 Development Collaboration

During the field visits organized for this evaluation, a number of other development activities were observed in the ACF project’s targeted villages by prominent local NGOs and a government department. These activities are implemented by national / local NGOs and Government Organization like Pakistan Fisherfolk Forum (PFF), Sindh Agricultural and Forestry Workers Coordinating Organization (SAFWCO), National Rural Support Programme (NRSP), SEWA-PAK, Aga Khan Planning & Building Service (AKPBS) and On Farm Water Management (OWFM), Directorate of Agricultural Engineering & Water Management, Government of Sindh (OFWM). The brief detail of intervention by each of these organizations in the targeted villages of ACF project is given below in the table 5.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 27]

Table: 5 – Other Organizations Working in ACF Project Targeted Villages S# Organization Type of Schemes No. of Village (s) Keti Bunder Kharo-Chan 1. Fisherfolk Food, shelter, education, computer 12 - center, health, fishing equipments, and Community mobilization 2. SAFWCO WaSH, link roads, solar electrification 10 - and health center 3. NRSP WaSH, education, link roads 5 1

4. OFWM Directorate Concrete Water Courses 4 9

5. SEWA-PAK WaSH - 7

6. AKPBS WaSH, solar energy, and community 6 - mobilization

The table reveals that more focus is given on the villages of Keti Bunder Tehsil. The focus areas are food, shelter, education, link roads, solar energy and WaSH activities. All civil society organizations mobilize community and form a community based organizations (CBOs) in the village before starting any intervention. Some of the CBOs were active enough and have managed to get development projects from more than one NGO. There is a need to develop a coordinated link with the all NGOs active in these areas to avoid duplication of efforts in the project villages. This can be achieved by organizing coordination meetings on regular basis in Garho city.

Moreover, some members of the local CBOs informed that they are working since last 20 years and grabbed several community development projects from different NGOs. This proves and creates need of capacity development of the local community for coordinated efforts with other development organizations by the ACF. This will help all organizations to launch the projects based on the needs of the area and minimize the duplication of activities. Moreover, this will also help ACF prepare for a smooth exit from the project. There is also a need to improve the capacity of the local CBOs with short training such as writing of small grant/donor funding proposal, mobilization of the local community for self help, etc. Some of the farmer leaders also supported this as they feel that after capacity building trainings facilitated by ACF, they have become more confident and proactive in getting projects from other. Focused capacity building trainings should be provided also on how to develop working relation with local as well as international NGOs such as SCCDP, SCAD (PPAF), AKPBS, NRSP, SAFWCO, and Sewa Pak. This can be achieved by establishing a coastal community coordination committee (CCCC) with one member from each of these organizations and ACF’s established cooperatives.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 28]

3.5 Integration of Project Components

By focusing on two targeted Talukas of Thatta district, ACF has been able to ensure that the project objectives are accomplished as designed. Following participatory approach, the project team has been able to work at the grassroots level to identify the major development needs and priorities as recommended in the project baseline survey. This, in turn, provided a solid basis for the successful implementation of the community based project. Income generating opportunities have been created through the introduction of saline tolerant seeds, sponsoring collective marketing efforts, distribution of seed saving containers, capacity development programmes, and implementation of WaSH activities. The interventions have created extra sources of income for the small farmers through improved varieties of wheat, rice and collective whole sale marketing efforts. The capacity building trainings have also enabled farmers to reduce their losses by adopting techniques of proper grading of vegetables, seed saving containers, seed testing etc. The WaSH activities have also helped poor farmers by reducing their routine family expenses on health hazards.

In general it was found that communities actively participated during the entire cycle of implementation of the project. In a few instances, implementation suffered some delays because of unavailability of irrigation water, floods in 2010 and heavy rains in 2011. The evaluator could not find any evidence of non cooperation of the beneficiaries with ACF staff. This proves good quality performance of ACF staff even though the inputs provided to farmers in some occasions were not fulfilling their expectations.

3.6 Partnership with Pakistan Agricultural Research Center

The ACF project has not been successful in establishing an effective partnership with the Pakistan Agricultural Research Council (PARC) owing to several factors. In fact, the partnership was initiated through a Memorandum of Understanding (MOU) signed on January 09, 2010 between ACF and the PARC for a period of 3 years. PARC was supposed to provide a framework for technical partnership in achieving following objectives:

1) Soil analysis 2) Identification of appropriate certified saline tolerant seeds 3) Identification of appropriate certified organic fertilizers and pesticides 4) Ensure optimum return on agricultural activities in relation to other local plant species, communities, ecosystems, areas, and other landscape features important to reclamation and conservation of soil through: (i) On-farm agricultural techniques trainings (e.g. seed saving techniques and mesquite harvesting) and, (ii) On-farm natural resource management trainings 5) Implementation of integrated inventory, monitoring, and data sharing 6) Implementation of joint applied research 7) Sharing of scientific information important to the successful completion of the programme

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 29]

It was also agreed to enter into specific agreements or contracts to provide support for the implementation of project and make resources available to accomplish the objectives of MOU. Unfortunately, this agreement could not be effectively materialized except for the identification of some relevant agencies like the Drainage Reclamation Center (DRC), and NIAB and one or two visits of the project area and meetings with the ACF staff by the focal person and a consultant of PARC. In order to explore reasons of failure of MoU and possibilities of revival of MOU with PARC, the evaluator paid facts finding visits to Karachi and met with Ms Hamida Masood Shah, the Ex Director Gender and Social Development Directorate, PARC Karachi, who facilitated discussions on MoU in between PARC and the ACF. She is currently working as Director, Women Development Department, Government of Sindh, Karachi. The evaluator also met with Syed Asim Rehan Kazmi, the Director Costal Agricultural Research Station, PARC, Karachi.

ACF started negotiation for technical cooperation with Director, Coastal Agricultural Research Station, Karachi. In the meanwhile, ACF was informed to coordinate with Director Gender Development (a department of PARC in Karachi) for further discussion on the modalities of the MoU. Due to routine delaying working practices of government departments, the discussions took more than enough time to establish final understanding on the MoU. Finally, MoU was signed in Head Office of PARC on January 09, 2010. The Director Gender Development Ms Hamida Shah informed the evaluator that after the MoU was signed, soil testing was done by PCRWR on recommendations of PARC. The senior consultants of PARC also visited ACF office in Thatta and suggested several training modules and also conducted some trainings as well. She informed the evaluator that the consultants have also suggested ACF several saline tolerant seeds and bio fertilizers, however ACF purchased those fertilizers at their own from open market without any consultation with PARC. While commenting on the failure of MoU, she was of the opinion that ACF team wanted the PARC technical persons to work free of charges with them, which was quite impossible as some times their consultants had to stay for few days in field.

The Director Gender Development was serving in PARC on deputation from another government department and she was brought in PARC by the then Chairman. When the new Chairman took over PARC, the Director Gender Development was sent back to her parent department and the new administration has not owned the MoU as official document by giving the reason that, “they want to focus on their own internal research based activities. So, they are no more able to keep continue the external MoUs and so, they are dissolving all the external MoUs”. After conducting in depth meetings with ACF and PARC staff, the evaluator is of the opinion that ACF staff had done its best to establish working cooperation with PARC and after a considerable delay the MoU was signed but it did not work well. However, it would have been better if ACF had hired services of a senior consultant with research background in agronomy with special attention on saline soils as it would have delivered better results as compared to non functional MoU with PARC.

3.7 Project Management and Staff

The project implementation initiated from March 2009 with the baseline survey. Soon after baseline survey, the project staff was hired and were given detailed orientation on the project goals and objectives.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 30]

During the evaluator’s visit to the field and Thatta office, the staff made dedicated and committed efforts to facilitate the evaluation process. The ACF’s expat professional staff provided specialized capacity building sessions which worked very well in developing an effective ACF team at Thatta. The evaluator is of the opinion that the project set-up seems simple, transparent and effective with no obvious superfluous elements. However, it would have also been much better if some research oriented senior agronomists have been hired in order to facilitate effectively the research process of the project.

There was overall good value for money. The no cost extension was requested by ACF and it is learnt through ACF staff it has been approved for one year from March 2012 to March 2013. The time-frame of the project at early stage was not clearly conceptualized, particularly research on soil tolerant varieties, adoption of research results by farmers, the long process of establishment of local markets and cooperative farming. It would be unrealistic to expect the project to achieve full sustainability and institutionalization of results during no cost extension from March 2012 to March 2013. Therefore, the evaluator is of the opinion that project period should be extended at least two more years (till March 2014), based on the facts that project has sufficient available balance of the budget.

Since project initiation, ACF project focused principally on in-house training of the project staff and provided orientation to the staff in adapting ACF intervention methodology to support farmers. Most of these trainings were given by ACF Programme Manager. However, it would have been better if the project staff have also been given opportunity of learning at institutional level. The implantation of the project went smoothly throughout the project cycle mainly due to the committed efforts of the project staff. However, if they have been provided better training opportunities at professional agricultural research centers in the country, the results of the project research activities would have been much better.

A list of trainings provided to the field staff is given below:

Trainings by FSL Programme Manager 14. Organizing effective corporative structure 1. Compost Fertilizer application 2. Bio Plant & pro plant application Trainings by Agronomist 3. Record keeping of agronomic practices 1. Seed production technology 4. Paddy transplantation 2. Vegetable seed production technology 5. Soil fertility 3. Compost making techniques 6. Vegetable nursery preparation & 4. Dapog method nursery preparation management 5. Paddy transplantation and fertilizer 7. Seed storage techniques application 8. Chili cultivation in demo plots 9. Quality rice seed production techniques Institutional Training 10. Wheat cultivation 1. Hands on Training on "Modern 11. Vegetable post harvest management Techniques in Research on Abiotic Stress 12. Measuring the soil salinity in field and Tolerance in Plants", held at Nuclear identification of soil salinity Institute of Agriculture and Biology - 13. Kitchen garden and women involvement Faisalabad.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 31]

3.8 Impact Assessments

3.8.1 Impact

As a whole, the project has been successful in achieving the desired project objectives. However, the project time is too short for most impacts to be measured especially those contributing to the improvement of farmers’ income. Most of the benefits of the project are expected to result in the long run. However, in the short run, beneficiaries reported that the ACF project has left a positive impact at macro (community) and micro (household) level because it has increased their income up to 10-15% from farming activity through introduction of better yielding saline tolerant seed varieties, seed saving container and other farming techniques.

The farmers are now aware of benefits of best agronomic practices and have adopted some of them. The most important among them is proper land levelling before cultivation. Most of the farmers in the project area use water pumping machines for watering the farm land. The farmers informed that ACF trainings of land levelling have helped them level their land properly and now water is utilized properly in the land. This has left a positive impact on proper irrigation application on the one hand and saving of fuel on the other hand. The successful implementation of WaSH activities undoubtedly has improved access to a basic service and therefore a plausible positive impact on living standards by reducing routine expenditure that was incurred on health expenses before.

The project has been successful in mobilizing the community, introducing saline tolerant seeds, organizing them under cooperatives, establishing wholesale marketing efforts, and a number of trainings on introduction of new farming methods. However, the establishment of local vegetable market is important to leave a long lasting impact on the livelihood of the local community. The market can be established with focused efforts and extensive research during the no cost extended year i.e. from March 2012 to March 2013.

3.8.2 Sustainability

The project has been successful in creating awareness on benefits of saline tolerant seeds. The farmers are now curious about new seeds and seed testing training has given them confidence to test any new variety with germination test well before applying the seed in the field. The farmers also recognized the benefits of cow dung but shown their inability to continue using cow dung in future due to comparatively higher prices than chemical fertilizer, which they cannot afford due to lack of funds.

The project has very effectively introduced seed saving containers with sufficient trainings to the farmers on how to utilize seed saving container. The seed saving containers have not only provided opportunity to preserve seed of new varieties at home and also resulted in reducing cost of inputs.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 32]

The project has introduced effectively the wholesale market process through cooperatives. The beneficiaries informed the evaluator that they will continue selling their crop produce through collective efforts in the future in order to generate more income from their farm produce sales.

The collective marketing efforts through cooperatives have enabled the local farmers to negotiate price with different wholesale buyers and sell their produce to the highest bidder. The linkages developed through this process will help farmers to sell their farm produce in the future. The project advocacy efforts on brining local government authorities closer to the farming community have proved beneficial for the local community. The cooperative office bearers have also informed that they are now more proactive in contacting local authorities on their farming challenges they face and getting those resolved.

The successful implementation of the ACF project will be a role model for other NGOs and local authorities for their development projects in surrounding of Keti Bunder and Garho. It can also be seen that the two and half years time-frame of the project was probably not sufficient to produce most of the planned outputs as it was solely on the research, however, cooperation extended from the small farmers was crucial and is commendable but sustainability is unlikely to be achieved without at least a two years extension.

ACF is also working on project exit plan. The following questions should be kept in mind while preparing the exit plan: Have saline tolerant seeds been identified and recommended to the farmers particularly for vegetables? Will the process of registration of cooperative marketing organizations be started or left working without any registration? How and from where the farmers will get the saline tolerant seeds after completion of ACF’s FSL project? What efforts are being taken to develop linkages with any research based institution to provide technical support in future after completion of ACF’s FSL project?

3.8.3 Replication of Activities and Outputs

It was evident that the opportunities for replication of the findings of the project in similar socio- economic context exist. The project has a great potential for all the so-called neglected crops where production could be boosted after introduction of soil tolerant varieties particularly cash crop i.e. vegetables, after the analysis of their status is done using the established methodology. Activities like seed storage, technique for seed germination test and soil testing can be replicated in other areas to benefit farmers.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 33]

3.8.4 Project Cost Efficiency

The project analysis reveals that the project funds were utilized efficiently during the project cycle from March 2009 to February 2012. Detailed project cost efficiency is presented in table 6 and 7 below:

Table: 6 – Project Cost Statement from March 2012 to February 2012 Proposed Budget Actual Expenses Description Available Budget % Expenses % Balance Consultant Services 1,170,814 59.20% 1,084,552 93% 86,262 Goods & Non Consultants Services 218,600 11.05% 80,514 37% 138,086 Training 488,740 24.71% 25,010 5% 463,730 Operational Expenses 99,496 5.03% 49,953 50% 49,543 Total Expenses 1,977,650 100% 1,240,030 62.70% 737,620

The table 6 reveals that on an overall basis, 62.7% of proposed budget amount has been spent so far from March 2009 to February 2012. Around 93% amount of the proposed budget of consulting services has been spent during the three years. The important items of consulting services included transportation of goods, PARC consultancy, soil analysis, marketing, boreholes, baseline survey, Project Team, stationery and hardware purchase, vehicle rental, and office rental etc. one of the major reasons of consumption of 93% budget was over expected spending on services of Water Officer, Food Security Officer, Programme Coordinator/Head of Mission and Administration Coordinator. The expenses on their services exceeded from 107% to 238% and this was mainly due to the reason of inflationary trends in the country.

The next major item of budget was “Goods & Non Consultants Services” which included saline tolerant seeds, fertilizer, seed containers, hygiene kits, and desalination units. Total of around 37% have been spent during the three years from March 2009 to February 2012. The budget on training was not utilized as it was expected as we can see that only 5% of the proposed budget was utilized during the last three years. The main reason of this under spending was the over-estimation of the line during the budget design phase. While the farmers were provided enough training but the project staff had not been provided any technical training from well reputed agricultural institutions.

This is evident from table 6 that the project was cost effective as none of the budget head exceeded projected amount. In terms of logistics/admin procedures, few beneficiaries complained that ACF is providing low volume of inputs in relation to time spent by the beneficiaries in different programmes of the ACF such as on farm trainings, demo plot trainings, and other agribusiness management trainings. However, the majority of the beneficiaries were satisfied with the ACF admin procedures and invaluable trainings and support provided to them. The evaluator also observed that there is efficient internal coordination and communication among FSL team members and communities.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 34]

Table: 7 - Statement of Quarterly Expenses from March 2009 to February 2012 Quarter Amount Expended % of Proposed Budget Upto Dec 2009 355,222 17.96% 2010 Qtr-1 105,986 23.32% 2010 Qtr-2 168,050 31.82% 2010 Qtr-3 107,790 37.27% 2010 Qtr-4 70,570 40.84% 2011 Qtr-1 58,238 43.78% 2011 Qtr-2 101,050 48.89% 2011 Qtr-3 93,004 53.59% 2011 Qtr-4 124,584 59.89% 2012 Qtr-1 (upto Feb) 55,536 62.70% Total Expenditure 1,240,030 - Total Budget 1,977,650 - Available Budget 737,620 - Projected Annual Expenses 385,642 -

The proposed budget for ACF project’s components A, B, C, and D was US $ 1,977,650. Total expenditures as of February 2012 were US $ 1,240,030 leaving behind balance of US $ 737,620. Based on expenditure trends during last three years, the annual expenses are US $ 385,642 and hence, the balance amount of the project (US $ 737,620) would be sufficient for next two years requiring adjustments in the budget. The un-utilized budget of training can be transferred to consulting services hence revised budget would be sufficient for extension of project for two years from March 2012 to March 2014.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 35]

4. Conclusions and Recommendations

4.1 Conclusions

The project geographical coverage was appropriate as per baseline and the poorest farmers were selected as project beneficiaries. The project activities were also coherent with project objectives and were adequately integrated in between ACF and other local actors. As a whole, the project was focused on action research and skill transfer which will benefit farmers in the long run. The project implemented properly planned activities and the interventions were in line with requirements of the small farmers. However, farmers concluded that the volume of inputs provided as an incentive was not enough but it was the quality of the ACF staff to mobilize and involve effectively the farmers during the entire project cycle. The project activities enabled farmers to keep record of their farming activity, select variety of seeds by using germination test technique, adopt cooperative marketing, use seed saving techniques, and develop leadership skills. Most of the project objectives and outcomes were attained through the completion of the planned activities and outputs in the area, however, adoption of some of the new farming techniques learned by the farmers need more time as generally adoption process by farmers is slow. The slow rate of adoption is not unique to sustainable agricultural systems but is common in the adoption of new technologies in the farming sector of developing countries. For example, studies on the adoption of sustainable farming systems have found that the adoption of new methods has rarely been successful over a short period of time due to imperfect market information, income constraints and other reasons. Even these obstacles can be overcome and the adoption of new farming practices can benefit local farmers if long-run benefits outweigh the short-term costs of adoption. The project made its maximum efforts to get materialized the MoU with PARC, but the same could not work well and finally regretted from PARC. This created gap in the project staff on technical expertise such as research based senior agronomist and soil scientist etc. Different local and international NGOs are also working in the project area with several interventions including wash, education, awareness raising and health without a good coordination among them. Collective efforts of establishing wholesale market by mobilising cooperatives provided some encouraging results but these efforts were focused on cereal crops (wheat & rice) which are grown by small farmers mainly for home consumption. The mainstay of the small farmers is vegetable cultivation which is sold in Karachi vegetable market on comparatively lower price. Based on feedback of the local community, there is potential of establishing small scale vegetable market in Mirpur Sakro.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 36]

4.2 Recommendations

It is learnt that the project received a no cost extension for one more year from March 2012 to March 2013. However, the project may be extended for at least two more years based on the fact that the available balance of budget will be sufficient to meet the project expenses during next two years. During the remaining period, the project should focus on establishing small scale vegetable market preferably in Mirpur Sakro. Services of professional marketing consultant with experience of establishment of several vegetable markets should be hired for a fixed period with the task of initiating the process, organizing the farmers, contacting the buyers, and starting the market operations. He will coordinate with other organizations for registration of market on behalf of ACF. After the market establishment arrangement should be made for proper dissemination of the daily price information through FM radio The target of distribution of seed saving containers should be completed in the remaining period of the project. There is need to circulate the soil testing results among the beneficiaries in order to create awareness and habit to analyse their soil samples after appropriate interval. This should be done in the extended period of the project. ACF needs to provide additional institutional training to staff in agribusiness, social mobilization, marketing mechanism and improve the overall planning of activities and management of deliverables. The majority of the assistance needs to be focused on increased production and productivity of vegetable crops in order to ensure that there is enough benefit from cash crop. Therefore, major focus should be on the introduction of better seeds for vegetables during the remaining period of the project. Financially strengthen the Marketing Cooperative Organizations developed by the ACF FSL team to ensure long term sustainability of the cooperatives. Because of the presence of several local and international NGOs in the area, a Coastal Community Coordination Committee (CCCC) should be established by ACF with the objective of improving coordination and minimizing duplications of interventions. The committee will comprise one member from each of the development organization working in the project area. Three members should also be selected from the ACF’s established cooperatives to avoid duplication of development services in the same village.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 37]

Annexures

Annex I - Best Practice (Wheat Germination Test Trainings)

High quality wheat seed with good germination ratio is important for successful agriculture. Traditionally, majority of the local farmers in Keti Bunder and Kharo Chan use their own wheat seed year after year, or farmers having no education go to the market and purchase seed on the trust of the supplier/middlemen without knowing the purity and germination percentage of the seed which affects the yield of wheat crop. Thatta Costal farmers of Taluka Keti Bander and Kharo-Chan have been cultivating paddy, wheat and vegetable crops since many years. The major problem that farmers face is the increasing salinity in their farm land mainly due to increasing sea intrusion, continuous application of chemical fertilizers and hybrid seeds in the weak soils. Consequently, crop yield is lower than other areas. Keeping in view these factors ACF FSL team planned introducing wheat germination tests among the beneficiaries in order to create awareness about how to measure the quality of the seeds. Samples of different wheat seeds were collected and germination tests of the samples were done at Garho office. Based on results it was concluded that INQALAB –91 wheat variety had a good germination ratio. Therefore, ACF decided to introduce the variety in the zone of implementation of the project. Before seed was distributed, ACF conducted training sessions on proper wheat germination test for 200 beneficiaries of the wheat group.

During the trainings, the beneficiaries (farmers) were divided into group of five to eight people. Each group was assigned task of conducting separate wheat germination test. Each group was given one plate made from clay, soil to prepare at least one layer of three inches in the pot, and randomly collected seeds from the seed bag. The following steps were taken while wheat germination tests by the groups: 1. Soil was placed in the pot with proper levelling 2. 10 lines were drawn in the pot at proper distance 3. 100 grains of wheat was put in a disposition of 10 grains in a row 4. Water was poured with very light spray 5. The edges of lines were pressed to cover the grain and ensure that all the seeds were air tightened 6. The pots were placed in the shadow for 3 to 4 days 7. The pots were properly covered to save from birds and rodents 8. The germination ratio was calculated after 3 to 4 days 9. The best germination ratio result was of 80%

The training was imparted in an efficient way that almost every participant remembered the process of the germination test. The farmers are now aware of the germination test of the wheat seed and loudly appreciated the effective way of training and the new technique of seed testing introduced by the ACF. They informed the evaluator that they have also applied the seed germination ratio test method on the seeds of cotton and obtained good results. Moreover, they also assured the evaluator that they will follow same test for rice seed in the coming season.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 38]

Annex II (DAC-Based Rating Table)

Rating Criteria Rationale (1 low, 5 high) Impact 4 The project has been successful with many positive impacts on livelihood of poor farmers. The income of the farmers has increased upto 10-15% (as reported by the beneficiaries) through better yielding saline tolerant seeds. Other important impacts are: The seed saving containers has enabled them to store seed for future consumption. The project has trained the farmers with many agronomic practices and helped positively in the existing cropping pattern of the farmers. WaSH activities have improved access to a basic services and had positive impact on reduction of expenditures on health services. The collective wholesale market efforts of the project have induced the farmers to sell their farm produce through cooperatives in the future. Sustainability 4 The project has been successful in introducing better varieties of saline tolerant seeds for wheat and rice and seed saving container will help farmers store seed for future consumption. Hence, as such there will not be any issue of sustainability on saline tolerant seeds. The farmers have gone through extensive trainings including on-farm trainings and in other cities with in-depth knowledge of agronomic practices which will serve as strong basis for changing farming trends in the area in future. The cooperative organizations may not sustain longer mainly because of the reason that these are not registered entities. Local vegetable market should be established and these cooperatives should be involved in the operations of the market in order ensure their long term sustainability. ACF is preparing a project exit plan and it is expected that the plan will also ensure long term sustainability of the project interventions. Coherence 4 It was evident that the opportunities for replication of the findings of the project in similar socio-economic context existed. The project has a great potential for all the so-called neglected crops where production could be boosted after introduction of soil tolerant varieties particularly cash crop i.e. vegetables after the analysis of their status is done using the established methodology. Activities like seed storage, technique for seed germination test and soil testing can be replicated in other areas to benefit farmers. Coverage 4 The coverage of the project has been appropriate as out of surveyed 38 villages the project has focused in 23 villages. The main criteria for village selection required to select a village with farming community and having at least 20-25 households. Hence, the fulfilling 23 villages were finally selected on this criterion.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 39]

Relevance / 4 The project interventions have been directly relevant with Appropriateness the requirements of the project area. The farmers of the area needed effective farming trainings and the project sufficiently addressed this issue. The saline tolerant has been introduced and for rice and wheat it has been successful. However, the vegetables seeds need more attention based on past performance of the project. WaSH activities have also resulted in positive impact on the living conditions of the farmer households in the project area. Effectiveness 5 The project has been very much effective in mobilizing the farmers, involving them in action research on their own farms, enhancing their capacity. The provisions of seed saving containers and seed germination test method have also been very much effective in improving the farming practices of the local community. Efficiency 3 Enough resources were allocated to each component of the project. The budget have also been utilized effectively except one observation that the project staff were not provided professional training opportunities instead of having sufficient allocated budget.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 40]

Annexure – III: TORs

TERMS OF REFERENCE For the External Evaluation of ACF’s Programme Improving Living Conditions for Coastal Farmers in a Changing Environment, Thatta District, Sindh Province, Pakistan Programme Funded by

Japanese Social Development Fund and the World Bank Contract Reference [TF093387]

October 2011 1. CONTRACTUAL DETAILS OF THE EVALUATION 1.1. Key Evaluation Dates Expected Start Date: 01/12/11 End Date: 17/01/2011 Submission of Draft Report 06/01/2011 Submission of Final Report 17/01/2011

1.2. Language of the Evaluation

Language Requirements for the Evaluation: English Language of the Report: English

1.3. Work plan & Timetable

Activities Working Days Briefing HQ (teleconference) 1 Travel to mission 2 Briefing mission, review of documents, preparation of fieldwork + evaluation 3 framework. Detailed methodology to be proposed to ACF prior to commencing fieldwork. Field work 15 Collection of secondary information in capital 1 Data analysis and preparation of the draft report, common editing of the report with 7 ACF Pakistan Debriefing and presentation of preliminary findings in-country on the basis of the draft 1 report Travel back from mission 1 HQ debriefing with desk officer 1 Finalization of the report on the basis of Field, HQ and ACF-UK Feedback 3 Total 35

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 41]

2. DETAILS OF THE PROGRAMME

Name of the Programme: Improving Living Conditions for Coastal Farmers in a Changing Environment Location: Keti Bandar and Kharo Chan Talukas of District Thatta, Sindh Province Starting Date: 3/11/2009 End Date: 3/11/2012

2.1. Map of Programme Area

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 42]

2.2. Programme Overview

High investments in inappropriate agricultural inputs, poor returns on agricultural activities and high health care costs from the incidence of waterborne diseases have created low standards of living for coastal farmers in district Thatta. As a result many small farmers and tenants are dependent on loans not only to procure agricultural inputs to sustain their livelihood activities but also to meet daily needs. Although many coastal areas of Pakistan face similar challenges, the salinity problem in Thatta (with 40% of the total farmlands affected) is particularly severe.

Factors underlying the chronic vulnerability in the area include: Irreversible salinization of agricultural areas High dependency on inappropriate and untested seeds for the area (seeds supply is coming from the international markets. Government of Pakistan certified seeds are not available) Nonexistence of physical or formal wholesale market for agricultural produce (sometimes resulting in price differences of 250%) Lack of access to clean drinking water

With the support of the Japanese Social Development Fund and the World Bank, ACF is working in coastal Thatta since March 2009 with the overall objective of improving the living conditions of 6,500 small farmer households (farmers with 1-10 cultivatable acres of land) and tenant (indentured farmers to landlords) by increasing household income and decreasing household expenditure and burdens.

2.3. General Objective

To improve the living conditions in coastal Thatta of approximately 6,500 small farmer (farmers with 1-10 cultivatable acres of land) and tenant (indentured farmers to landlords) households by increasing household income and decreasing household expenditure and burdens

2.4. Specific Objectives/Results

Result 1: Increase autonomy/self-sufficiency on agricultural inputs

1.1 Mobilize 400 farming households for introduction of saline tolerant seeds and seed saving techniques in cooperation with Pakistan Agricultural Research Council 1.2 Conduct soil analysis within 2 Union Councils to identify appropriate certified saline tolerant seeds 1.3 Distribute certified saline tolerant seeds and required inputs to 400 households and conduct an Environmental Management Plan (EMP) to identify/mitigate any potential adverse environmental impact

1.4 Integrate local Agricultural Department and 3-5 Farmer Organizations in improved agricultural techniques trainings and on-farm natural resource management (e.g. seed saving techniques and mesquite harvesting) 1.5 Distribute vouchers for community seed saving containers to 20 farming communities

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 43]

Result 2: Reinforce agricultural wholesale markets

2.1 Establish 6 wholesale markets within targeted zones within 3 years 2.2 Mobilize 3-5 Farmer Organizations for cooperative marketing of agricultural products. 2.3 Mobilize 4-6 wholesale buyers to participate in wholesale market. 2.3 Transport agricultural products to major transportation lines 6 times

Result 3: Renew access to boreholes turned saline

3.1 Select 400 interested households that live near a saline borehole. 3.2 Rehabilitate all non-functioning boreholes located near the selected households 3.3 Select/design the most appropriate low-cost desalination unit for each household. 3.4 Distribute the selected units to each household. 3.5 Train households in operation and maintenance of the units. 3.6 Setup/Train a water committee for each borehole. 3.7 Conduct hygiene education sessions for all households 3.8 Identify local businesses to manufacture/sell these units.

Result 4: Increase knowledge and analysis in the livelihood sector for Thatta district coastal areas

4.1 Conduct livelihood surveys at the beginning and the end of the project 4.2 Presentation of the results to the main actors involved in the area 4.3 Dissemination of the reports

3. AIM OF THE EVALUATION

3.1. Target User(s) of the Evaluation

ACF Desk Officer, FSL Technical Advisor Implementing HQ Desk Officer, FSL Technical Advisor Field Level Country Director, Deputy Country Director, MEAL Manager, FSL Program Coordinator, FSL Program Manager Other GoP, PARC, WB, local communities, other stakeholders operating in coastal Sindh area

3.2. Overall Objective of the Evaluation

This evaluation is aimed at better understanding the results of the applied research and pilot approach of the project and to issue a set of recommendations regarding potential scale-up.

3.3. Specific Objectives of the Evaluation

► The evaluation will focus on assessing results 1 and 2 of the program, using standard evaluation criteria. ► The evaluation will specifically consider the resilience of the piloted approach to the exceptionally harsh and disaster-prone natural environment of coastal Sindh (environmental resilience/impact; disaster risk reduction) ► The evaluation will concentrate on capturing lessons learnt in order to feed ongoing

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 44]

programming. ► This review is part of ACF Strategy to reinforce integrated programming, and will support it with appropriate and operational recommendations serving that purpose. Further Factors to be taken into Account

o A number of natural disaster events in 2011 disrupted project activities including a cyclone and major monsoon flooding which partly compromised the kharif season paddy crop. o The evaluated programme is to continue another 4 months after the evaluation; therefore it is not an end term evaluation, which means recommendations can be translated directly, but also that some results might not yet be fully achieved.

3.4. Scope of the Evaluation

Impact The evaluator will assess the broad effects of the program. Impact may be over the short, medium or long term, intentional or not, positive or negative, macro (at the level of the community) or micro (household), economic, agronomic or social.

 What are the indications, direct or indirect that the action has contributed to the achieving the project objective?  Have the project objectives and indicators as presented in the LFA been achieved, at least in part?  Are the means and indicators used to evaluate the impact of the program adequate? Is there a way to improve both the impact of the project and its measurement?  What are the economic, agronomic, social and any other impacts of the program on the short, medium and long term, both at the level of the household and the level of the community?  Is the approach piloted in this project expected to sustainably improve the livelihoods of saline soil farmers in the area? If not, what are the adjustments to the approach that should be brought in order to increase the impact? Relevance The evaluator will assess the appropriateness of the objective and results pursued by the program in relation to the identified needs.  Was the contextual analysis and identification of priority needs of target communities adequate (methodology, findings, conclusion and recommendations)? Were the risks correctly identified?  Was the involvement of beneficiaries ensured in the design and implementation phases?  Did this analysis lead to the elaboration of adequate objectives in relation to the priority needs identified?  Are the activities relevant and appropriate? Coverage The evaluator will assess the coverage of the program in relation to the identified needs.  Is an adequate percentage of the needs covered (>80%)?  Were the worst-affected, poorest or most marginalized groups correctly identified?  Was there appropriate geographical coverage?  Was there fair targeting of beneficiaries?  What is the degree of knowledge of beneficiaries and non-beneficiaries on the program, its

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 45]

objectives and its targeting criteria?

Coherence The evaluator will assess the adequacy of the activities that were implemented in relation to the objectives and results pursued by the program.  Did the activities have a direct relationship with the objectives and results pursued?  Were the activities adequately coordinated with other development and local actors, in particular the Pakistan Agricultural Research Council (PARC) and the Pakistan Nuclear Institute of Agriculture and Biology (NIAB)?  Were the activities adequately integrated between ACF WaSH and FSL departments at each of the following stages of the program: Assessment of needs Project proposal Targeting of communities and beneficiaries Implementation of activities Monitoring  Did the authorities and communities understand, accept and welcome ACF program?  What were the main constraints faced with regard to coherence and coordination, how were they managed and how could ACF have improved on their management?  Will the program reach the intended results and objectives?  If not, what are the factors and constraints for the risk of non-achievement? What hampered the achievement of the targets? Has the organisation anticipated the constraints? Has the organisation reacted adequately to unforeseen events and re-adjusted/ adapted the program to ensure the achievement or the readjustment of the objective and results pursued by the program?  Is the information correctly passed onto the communities and authorities?

Efficiency The evaluator will assess the cost-efficiency of the program  Was the program cost-effective?  Are the log / admin procedures well understood, accepted and respected by everyone in particular the target communities, partners and authorities?  Is the internal coordination and communication efficient?

Sustainability The evaluator will assess the extent to which the following sustainability objectives have been reached in the framework of the project or are expected to be reached by project end:  Farmers have the technical capabilities to identify appropriate seeds and manage agricultural activities; such as fertilizer and pesticide applications  Farmers have the technical capabilities to save seeds in order to lower annual expenditures on agricultural inputs  Farmers have the capacity to better manage natural resources on the farm (such as capitalizing on mesquite trees and maintaining drainage channels)  A market process is established and reinforced for three years thereby creating a habit for selling future harvests  Target communities/groups have been able to establish backward and forward market linkages to their advantage  Communities and local authorities have a guideline on livelihoods profiles and programming recommendations for reference and advocate tools.  Development actors (NGOs, local authorities etc…) have the possibility of duplicating the

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 46]

project to other areas that face similar challenges based on ACF’s experience in Keti Bunder and Garho.

Monitoring and Evaluation The evaluator will assess whether appropriate M&E systems were established and implemented in the framework of the project.  What are the progress and impact tools that were used? Were they effectively utilized? How might they be improved?  Are the indicators well adapted, and if not, what are the recommendations for improving them?  Have the achievements of the project been effectively documented and analysed?  Were the results of the monitoring available in a timely manner in order to effectively inform decision-making? If not, what were the constraints faced and how might they be addressed?  Have the results of the monitoring been used to improve the program?

Cross cutting issues The evaluator will assess how the following cross-cutting issues have been taken into account at all stages of program implementation so far:  Disaster risk reduction and Preparedness;  Environmental impact: in particular, the evaluator will assess the implementation and impact of the environmental Management Plan (EMP) that was established at project start which includes measures to eliminate/reduce/offset potential negative environmental impacts.  Gender  Participation

3.4. Evaluation Criteria ACF subscribes to the Development Assistance Committee (DAC) criteria for evaluation: Impact, Sustainability, Coherence, Coverage, Relevance / Appropriateness, Effectiveness and Efficiency. ACF also promotes systematic analysis of the monitoring system and cross cutting issues (gender, HIV/AIDS etc). All external evaluations are expected to use DAC criteria in data analysis and reporting. In particular, the evaluation must complete the following table and include it as part of the final report.

The evaluator will be expected to use the following table to rank the performance of the overall intervention using the DAC criteria. The table should be included as an Annex to the report

Criteria Rating Rationale (1 low, 5 high) 1 2 3 4 5 Impact Sustainability Coherence Coverage Relevance/Appropriateness Effectiveness Efficiency

3.5. Best Practices The evaluation is expected to provide one (1) key example of Best Practice from the project/programme.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 47]

This example should relate to the technical area of intervention, either in terms of processes or systems, and should be potentially applicable to other contexts where ACF operates. This example of Best Practice should be presented as an Annex to the report.

3.6. Evaluation Outputs The result of this evaluation should be presented in a written report and through several oral presentations One on the mission (to Head of Mission and relevant technical staff) One at HQ (in person or via teleconference).

3.7. Methodology

3.7.1. Preparation

Review of project documents (proposal, logical framework, donor reports, activity and monitoring reports, assessment reports, capitalisation documents, budget follow-up, etc.)

3.7.2. Briefing

Prior to the evaluation taking place, the evaluator is expected to attend a briefing at HQ level, and at field level with the Head of Mission and/or the relevant technical focal point. Briefings by telephone must be agreed in advance

3.7.3. Field activities

Consultants are expected to collect an appropriate range of data. This includes (but not limited to): Direct information : Primary data collection using standard and participatory evaluation methods (e.g. semi structured interviews, FGD and observation) in households and communities. Indirect information : Interviews with local representatives; interviews with project staff expatriate and national staff; meeting with local and provincial authorities (NIAB, PARC, Department of Agriculture), groups of beneficiaries, humanitarian agencies, donor representatives and other stakeholders. For indirect data collection, standard and participatory evaluation methods are expected to be used (HH interviews and FGDs with beneficiaries, non-beneficiaries, key informants – health workers, teachers and leaders). Secondary information analysis : including analysis of project monitoring data or of any other relevant statistical data related to saline soils agriculture in the Indus River Delta.

3.7.4. Report

The report shall follow the following format. Cover Page Table of Contents Executive Summary: must be a standalone summary, describing the programme, main findings of the evaluation, and conclusions and recommendations. This will be no more than

2 pages in length.

Main Body: The main body of the report shall elaborate the points listed in the Executive Summary. It will include references to the methodology used for the evaluation and the context of the action. In particular, for each key conclusion there should be a corresponding recommendation. Recommendations should be as realistic, operational and pragmatic as possible; that is, they should take careful account of the circumstances currently prevailing in the context of

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 48]

the action, and of the resources available to implement it both locally and in the commissioning HQ. Annexes: Listed and correctly numbered. Format for the main body of the report is:

o Background Information o Methodology o Findings & Discussions o Conclusions Recommendations o Annex I (Best Practice) o Annex II (DAC-based Rating Table)

The report should be submitted in the language specified in the ToR. The report should not be longer than 30 pages excluding annexes. The draft report should be submitted no later than 10 calendar days after departure from the field. The final report will be submitted no later than the end date of the consultancy contract. Annexes to the report will be accepted in the working language of the country and programme subject to the evaluation

3.7.5. Debriefing & Learning Workshop

The evaluator should facilitate a learning workshop: To present the draft report and the findings of the evaluation to the ACF Pakistan Team and other stakeholders. To gather feedback on the findings and build consensus on recommendations. To develop action-oriented workshop statements on lessons learned and proposed improvements for the future. 3.7.6. Debriefing with ACF HQ The evaluator should provide a debriefing with ACF HQ in New York on her/his draft report, and on the main findings, conclusions and recommendations of the evaluation. Relevant comments should be incorporated in the final report

6. RESOURCES AND DOCUMENTATION The following documentation will be made available: Project proposal Budget Quarterly reports Baseline Livelihood Survey Report Baseline Conventional Farmer Practices Monitoring Reports Market Survey Report Marketing Strategy Any other relevant document SPHINX software for data analysis

4. PROFILE OF THE EVALUATOR

Advanced experience in Agronomy or Rural Development with recognized experience (one or more scientific reports/publications) Advanced experience in Agronomy or Rural Development with recognized experience (one or more scientific reports/publications)

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 49]

Significant field experience in the evaluation of humanitarian / development projects for major donors. Relevant degree / equivalent experience related to the evaluation to be undertaken Significant experience in coordination, design, implementation, monitoring and evaluation of programmes Good communications skills and experience of workshop facilitation

Ability to write clear and useful reports (may be required to produce examples of previous work) Fluent in English Understanding of donor requirements Ability to manage the available time and resources and to work to tight deadlines Independence from the parties involved

5. RIGHTS

The ownership of the draft and final documentation belong to the agency and the funding donor exclusively. The document, or publication related to it, will not be shared with anybody except ACF before the delivery by ACF of the final document to the donor.

ACF is to be the main addressee of the evaluation and its results might impact on both operational and technical strategies. This being said, ACF is likely to share the results of the evaluation with the following groups: Donor(s) Governmental partners Various co-ordination bodies

Intellectual Property Rights All documentation related to the Assignment (whether or not in the course of the evaluator’s duties) shall remain the sole and exclusive property of the Charity

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 50]

Logical Framework of Analysis

Title of the Action Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers

Principal To improve the living conditions in coastal Thatta of approximately 6,500 small farmer (farmers with 1-10 cultivatable acres of land) and tenant (indentured Objective farmers to landlords) households by increasing household income and decreasing household expenditure and burdens.

Intervention Logic Objectively Verifiable Indicators Sources of Risks and Assumptions Verification

R1: Increase autonomy/self 400 agricultural households receive Baseline Reports Natural disasters such as sufficiency on agricultural certified saline tolerant seeds and other Monitoring/Impact floods, cyclones and droughts inputs inputs Reports have been known to strike 400 agricultural households receive Post-Market Reports Thatta coastal areas on an Final Livelihood improved agricultural techniques annual or bi-annual basis; Assessment trainings which could adversely affect Reports and on-farm natural resource the project outputs management This project will compete with the established system for 20 farming communities receive seed money lending for agricultural saving containers inputs. 400 households practice seed saving

techniques and improved on-farm natural resource management Decrease livelihood expenditures by 5 Results to 10 percent R2: Reinforce agricultural 3 to 5 Farmer Organizations received wholesale markets marketing cooperative training 6 wholesale markets are organized at harvest time with transportation support Sales increased at least by 10% for the farmers R3: Renew access to 400 households use low-cost desalination boreholes units to treat saline groundwater turned saline for Thatta 400 households attend hygiene education district coastal areas sessions At least 10% decrease in healthcare costs for 400 households 2 livelihood surveys are conducted Surveys are presented and disseminated

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 51]

As per result 1 1.1 Mobilize 400 farming households for introduction of saline tolerant seeds and seed saving techniques in cooperation with Pakistan Agricultural Research Council 1.2 Conduct soil analysis within 2 Union Councils to identify appropriate certified saline tolerant seeds 1.3 Distribute certified saline tolerant seeds and required inputs to 400 households and conduct an Environmental Management Plan (EMP) to identify/mitigate any potential adverse environmental impact 1.4 Integrate local Agricultural Department and 3-5 Farmer Organizations in improved agricultural techniques trainings and on-farm natural resource management (e.g. seed saving techniques and mesquite harvesting) 1.5 Distribute vouchers for community seed saving containers to 20 farming communities As per result 2 2.5 Establish 6 wholesale markets within targeted zones within 3 years 2.6 Mobilize 3-5 Farmer Organizations for cooperative marketing of agricultural products. Activities 2.7 Mobilize 4-6 wholesale buyers to participate in wholesale market. 2.8 Transport agricultural products to major transportation lines 6 times As per result 3 3.9 Select 400 interested households that live near a saline borehole. 3.10 Rehabilitate all non-functioning boreholes located near the selected households. 3.11 Select/design the most appropriate low-cost desalination unit for each household. 3.12 Distribute the selected units to each household. 3.13 Train households in operation and maintenance of the units. 3.14 Setup/Train a water committee for each borehole. 3.15 Conduct hygiene education sessions for all households 3.16 Identify local businesses to manufacture/sell these units. As per result 4 4.4 Conduct livelihood surveys at the beginning and the end of the project 4.5 Presentation of the results to the main actors involved in the area 4.6 Dissemination of the reports

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 52]

Annexure – IV: Project Target Villages S. No Name of village U/C

1 Abu Bakar Khaskheli Keti Bander 2 Ayoob Gujrrio Keti Bander 3 Saleh jat Keti Bander 4 Khuda Bux Sakani Keti Bander 5 Suleman Mallah Keti Bander 6 Mehar Shaikh Keti Bander 7 Rab Dino shah Keti Bander 8 Allah Bux Shah Keti Bander 9 Mohammad Ali Bharj Keti Bander 10 Meeran khan Murghur Keti Bander 11 Haji Haroon Lanjar Keti Bander 12 Muhammad Jokhio Keti Bander 13 Yar Mohammad Sholani Kharo Chan 14 Hashim Sholani Kharo Chan 15 Yar Mohammad Bharj Kharo Chan 16 Sukhio Murghur Kharo Chan 17 Yaqoob Memon Kharo Chan 18 Saleh Galhro Kharo Chan 19 Shamboo Murghar Kharo Chan 20 Ali Bux Murghur Kharo Chan 21 Aaitbar Shah Kharo Chan 22 Yaqoob Murghur Kharo Chan 23 Malah Khan Murghur Kharo Chan

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 53]

Annexure: V - Inputs distribution in 2010

Distribution in 2010 Distributed for Demo Per recipient

plots

# Input Name Per GRAND Source of purchase

Total Demo Total TOTAL Recipient

QTY Plots plot QTY

DistributionUnit QTY TotalQTY

1 Paddy (IRRI - 9) Kg 354 6.75 2,390 40 0.334 13.36 2,403 Punjab Seed Corporation

2 Paddy research varieties (10) Kg - - - 10 - - - IRRI – Philippines Individual Supplier from 3 Compost (Organo Plus) Kg 354 40 14,160 20 9.00 180 14,340 Karachi Individual Supplier from 4 Bio fertilizer (Bio Plant) ml 354 250 88,500 20 62.50 1,250 89,750 Karachi Individual Supplier from 5 Bio fertilizer (Pro Plant) ml 354 375 132,750 20 93.70 1,874 134,624 Karachi Procured by New York 6 Tomato Seed Gram 160 25 4,000 40 4.95 198 4,198 Head quarters Procured by New York 7 Chili seed Gram 160 75 12,000 40 12.35 494 12,494 Head quarters Procured by New York 8 Pumpkin Seed Gram 160 265 42,400 40 52.50 2,100 44,500 Head quarters Individual Supplier from 9 Cow Dung Kg ------Karachi

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 54]

Annexure: VI - Inputs distribution in 2011

Distribution in 2011

Distributed for Demo Per recipient

plots

S.# Input Name Per GRAND Source of GRAND

Source of purchase

Total Demo Total TOTAL purchase TOTAL Recipient

QTY Plots plot QTY DistributionUnit

QTY TotalQTY

1 Paddy (IRRI - 9) Kg 200 6.75 1,350 - 1,350 3,753 Punjab Seed Corporation Paddy research varieties 2 (10) Kg - 46 0.4 18 18 18 IRRI – Philippines

3 Compost (Organo Plus) Kg - 38 9 342 342 14,682 Individual Supplier from Karachi

4 Bio fertilizer (Bio Plant) ml - - - 89,750 Individual Supplier from Karachi

5 Bio fertilizer (Pro Plant) ml - - - 134,624 Individual Supplier from Karachi

6 Tomato Seed Gram - - - 4,198 Procured by NewYork Head quarters Local Grower 7 Chili seed Gram - 36 15 540 540 donated 13,034 Procured by NewYork Head quarters

8 Pumpkin Seed Gram - - - 44,500 Procured by NewYork Head quarters

9 Cow Dung Kg 401 1,500.00 601,500 - 601,500 601,500 Individual Supplier from Karachi

10 Wheat Seed (Inqalab - 91) Kg 201 20.00 4,020 6 1.25 8 4,028 4,028 Individual Supplier from Karachi

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 55]

Annexure – VII: Checklist of Questions for Focus Group Discussion (FGD)

Name of Village: ______Union Council:______

Date of FGD:______ID Code:______

S# Question Component A - Increase autonomy/self sufficiency on agricultural inputs 1. What benefits have you received from the saline tolerant seeds? Have ACF been successful in improving yields? How and why? 2. What changes you see after getting training on improved agricultural techniques? Have you been able to implement them? If yes - which techniques and what was impact? If no – what were the reasons? Due to technology cost, lack of knowhow, or else? 3. What are the positive impacts of the trainings you received on improved agricultural techniques trainings and on-farm natural resource management? 4. How many seed saving containers have been provided in your village? What benefits you have got from these containers? 5. Gender Perspective - How have been women involved in the interventions? (seed container management, Wash Activities) 6. Have soil testing been done in your village? How many people have conducted them and what benefits got from the results of soil testing? 7. Are you applying the learned techniques for enhancement of crop yields? Which ones? 8. Demonstration plot – which crop demonstration plots were set up in your village? What you have learnt from demonstration plots? Have you been able to replicate them in your plot? Why? 9. Is there any positive impact of these interventions, or what suggestions you want to share to improve these efforts? What are the challenges that ACF has been able to address through this project? What are the challenges that ACF has not been able to address through this project? Why? 10. Is there any Environmental Impact due to saline tolerant seeds? Which ones? How trainings have been able to address unexpected environmental impacts? Component B - Reinforcing agricultural wholesale markets 11. Is there any Farmer Organization in your village? How many? If yes, are you involved any of them and what are the goods and services that the organization facilitated or provided?? Why are you involved in it? What are the advantages of farmers' organizations? 12. Where do you sell the crop produced? Rice Middlemen Rice Mill Wholesaler Retailer Wheat Middleman Wholesaler Government

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 56]

S# Question Retailer Vegetable Middleman from Karachi Local Middleman Vegetable market Wholesaler Retailer 13. Either selling individually or with organized cooperative? a) Individually b) Through Cooperative If through Cooperative, then sale return increased or decreased? (Try to get answer in percentage i.e. 10%) General Questions 14. Have you been consulted before project implementation? If yes, are the interventions are in line with community suggestions? What is the level of your involvement in the decision making process of the CBO and project? Please give concrete example? 15. Did the IEC material help you learn new things? Is there any need for more material with other information on farming and marketing? 16. How many trainings people from your village got? Please share positive impact? Is there need of other trainings? 17. What support are you getting from local authorities in relation to this project? How you make efforts to get support from government departments? Do CBOs have easy access to governmental institutions and traders? 18. Do you feel any change in your life style after this project? If yes, how and why? Provide concrete examples. Suggestions 19. Have the interventions contributed to existing farming practices? Please list positive and negative impacts? 20. How to improve farming and marketing practices in your area? 21. How many Households were selected from your village as beneficiary of this project? Do you think that beneficiary selection process was done on merit? How did farmers and / or lead farmers participate on the process? How well they have been informed on the process? 22. Any Other suggestions for future interventions.

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 57]

Annexure – VIII: KII – Cooperative Management

I - Respondent Profile 1. Name of Respondent: 2. Age: 3. Sex: 4. Village & UC: Kharo Chan / Keti Bunder 5. Cooperative Name: 6. Date of Interview 7. Level of Education: a) Illiterate b) Primary c) Secondary d) Other 8. Marital Status: a) Single b) Married c) Widow c) Divorced 4) Other 9. Family Members: 10. Land Holding: 11. Land Holding: a) Total Holding b) Cultivable Land 12. Status: a) Owner b) Share Cropper c) Tenant 13. Crops Cultivated: a) Crop names: b)

II - Checklist of Questions for Key informant Interview No. Question 1. How and when the Cooperative was formed, process? 2. When the you became member of the cooperative? 3. How do you sell your crop produce? a) Advance before harvest in case of need of credit for inputs/emergency b) After harvest on cash payment 4. To whom you sell your crop produce? a) To middlemen at farm gate: b) To Middlemen in nearby town c) Rice Mill (For Paddy crops only) d) Wholesale Market/vegetable market e) Government Agency (Wheat, Rice) f) Retailer 5. What is the means of transport you use? (Please also mention name of the market & distance) a) Own animal Cart b) Own Vehicle (Tractor Trolley, Other) c) Rented Transport d) Other 6. Is there any wholesale market in your area? Yes / No If yes,

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 58]

No. Question a) for which crop (s): Rice / Wheat / Vegetables b) Distance of the market from your village: 7. Were you involved in ACF’s efforts on setting up wholesale market in the area? Yes / No If yes a) How many Times you sold the crop in that market? b) Which Crops you sold in that market? c) Who paid transportation cost? The Cooperative ( %), / ACF ( %) d) Are you satisfied with results of wholesale market? Yes / No 8. What are the hindrances in successful establishment of wholesale market in the area? For a) Wheat b) Rice c) Vegetables 9. Did your cooperative members get training (s)? Yes / No If yes, Please list below the Training Name: 10. What trainings were imparted to the office bearers of your Cooperative? 11. Do you need further capacity building programs? Yes __ No__. If yes please described what type of programs? 12. How you see your organization will be sustainable after project ends? 13. Any contribution from members for the Cooperative organization? 14. Suggestions

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 59]

Annexure – IX: Questionnaire - Individual Farmer

I - Respondent Profile 1. Name: 2. Age: 3. Sex: Male / Female 4. Date of Interview: 5. Village & UC: ______Kharo Chan / Keti Bunder 6. Religion: 7. Level of Education: a) Illiterate b) Primary c) Secondary d) Other 8. Marital Status: a) Single b) Married c) Widow c) Divorced 4) Other 9. Family Members: 10. Land Holding: a) Total Holding b) Cultivable Land 11. Status: a) Owner b) Share Cropper c) Tenant 12. Crops Cultivated: a) Crop names: b) 13. Clan Sindhi / Punjabi / Pathan / Baloch II - General Questions No. Question Answer 1. Have you been Yes / No If yes, provided Saline a) Which crop: Rice, Vegetables, Wheat Tolerant seed and other inputs? b) How much seed you got for which crop per acre Rice:______Vegetables:______Wheat:______Other (specify) c) Are you satisfied with the quantity provided? Yes / No d) Why? e) Are you satisfied with the quality of the seed got? Yes / No f) Why? g) What was germination ratio of crop? Paddy:______Vegetables:______Wheat:______h) Seed was given on time or delayed? If delayed, impact on yield? Paddy:______Vegetables:______Wheat:______i) What you got in other inputs? FYM (Cow Dung):______Bio Plant:______Other:______j) Any Other:______2. Have your soil Yes / No been test? Who tested it?

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 60]

No. Question Answer If Yes, how many times and in which seasons? Are you willing to continue soil testing in future? Yes / No If no, Why? 3. Have you been Yes / No provided seed Why? saving Container What are economic benefits from Seed Container? 4. Have you sold Yes / No your crop If yes, which crops? produce in Paddy:______Vegetables:______Wheat:______wholesale market organized by Project? 5. Have you been Yes / No provided i. If yes, how many?______training? ii. Please inform, where you got training (s) a) Field Office Garho:_____ b) Makli:____ c) Other City:_____ Who provided it? iii. Please enlist the training names: a) b) c) d) How have you applied the knowledge acquired in the trainings? 6. Were Yes / No If no, Why demonstration plots made in Any economic benefit from the Demo plots? your land? 7. Are you Yes / No If No, why? member of any Member since (year) CBO? Why you became member? Any social / economic benefit of the organization? 8. Are you Yes / No member of Member since (year) Cooperative Why you became member? Body Any benefit from being the member of FO? 9. Have you sold How do you sell your production? your crop Has it changed as a consequence of the project? How? produce Yes / No through If no, why Cooperative? Do you think cooperative is beneficial for members? Yes __ No__ if yes how? 10. Is there any Yes / No Borehole in If yes, your village? a) Is it functional?

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 61]

No. Question Answer b) Who made if functional? c) Quality of Water now? 11. Have you Yes / No received IEC What was it useful for? Material? 12. Have you been Yes / No provided What benefits you perceive from market information? regular market Do you understand the information provided? Do you use it to take information? decisions? 13. Have you been Yes / No consulted How? Provide examples? about the Intervention? 14. Project Yes / No Interventions Why? are in line with What are main needs addressed? community needs? What are not addressed needs?

------

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 62]

Annexure – X: KII – Project Staff

I – Staff Detail Name Designation Station

II - Checklist of Questions for Key informant Interview No. Question 1. Provide reasons for delay occurred in performing project activities? 2. Strength of your staff with relevant to the project objectives? 3. Do you think staff is appropriate in number and qualification etc. ? 4. How about turnover of the staff over the time period of the project so far? 5. How many and what type of orientation and training received by the staff ? (if list is available)? 6. Further need of the training to the staff? 7. How you perceive working in the field with the communities? Any examples? 8. Describe the strengths of the rural communities you are working with. 9. What are the weaknesses of the rural communities and how these could be overcome? 10. IEC material given to the participants of trainings, do you think they need material and what type? And kind? Etc. 11. What are real problems for slow adoption of the technologies? 12. What are other training needs of the rural communities particularly for adoption of technologies introduced in the field? 13. What was the process of formation of Cooperatives? Do you think to any additional support to be needed for their sustainability? 14. Describe benefits and hindrances of establishing market in the area? 15. Your perception working with the government and other organizations? 16. Are you satisfied with the overall performance of the project in delivery of the desired objectives? 17. Any suggestions for future working of the project activities to benefit farmers? 18. Do you believe program has been going on efficiently with regard to the team, cost, and resources? If not? Any suggestions to improve. 19. Were the project activities completed on time and cost effectively? 20. How would you rate the FSL internal coordination and communication system? Please suggest if you may like to 21. Suggestions

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 63]

Annexure – XI - List of people contacted during project evaluation a) The List of Participants (beneficiaries) who participated in FGDs S# Name Village/ City UC Date 1 M. Moosa Khaskheli (Leader Farmer) 2 Ilyas Khaskheli 3 M. Adam Khaskheli 4 Abdul Rehman Khaskheli 5 Jaffar Khaskheli 6 Karim Dino Khaskheli Abu Bakar Khaskheli Keti Bunder 14/2/2012 7 Suleman Khaskheli 8 M. Siddique Khaskheli 9 Ghulam Qadir Khaskheli 10 Dauod Khaskheli 11 Hanif Khaskheli 12 Ghulam Mustafa 13 Muhammad Jat 14 Ibrahim Jat 15 Haji Umer Jat 16 Ali Asghar Jat 17 Ahmed Khan Jat 18 Wasim Sajjad Jat 19 Javed Jat 20 Muhammad Zaman Jat 21 Muhammad Hassan Jat 22 Rasool Bux Jat Saleh Jat Keti Bunder 15/2/2012 23 Abdul Kareem 24 Haji Noor Jat 25 Ameer Ahmed Jat 26 Mumtaz Jat 27 Altaf Hussain Jat 28 Wazir Ahmed Jat 29 Ali Murad Jat 30 Haji Urs Jat 31 Haji Moosa 32 Muhammed Hassan sholani 33 Muhammed moosa Sholani 34 Ghulam Abbas 35 Ameer Hamza 36 Abdul Aziz 37 Sikander 38 Mian Wasayo (Leader Farmer) Haji Hashim Sholani Kharo Chhan 16/2/2011 39 Mehrab Khan 40 Suleman 41 Khuda Bux 42 Abdul Ghani 43 Manzoor Ahmed 44 Gul Muhammed Sholani 45 Ali Gohar Shahkhani 46 Muhammed Yousif Shahkhani khuda bux shahkhani Keti Bunder 17/2/2012 47 Abdul Aziz Shahkhani 48 Muhammed Hassan Shahkhani

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 64]

S# Name Village/ City UC Date 49 Noor Muhmmed Shahkhani 50 Punhoon Shahkhani (Leader Farmer) 51 Muhammed Mitho Shahkhani 52 Ali Ahmed Shahkhani 53 Muhammed Akram 54 Muhammed Haroon 55 Haji Ishaq 56 Abdul Ghani 57 Gul Muhammed Murghar 58 Muhammed Ramzan 59 Nabi Bux 60 Najeebullah 61 Shafi Muhammed 62 Adnan Ghoto 63 Abdul Sattar 64 Muhammed Khan Murghar Ali Bux Murghor Kharo Chhan 18/2/2012 65 Umer khan Murghar 66 Punhal Ghoto 67 Bakhash Ali Murghar 68 Abdul Majeed Ghoto 69 Rahim Bux Murghar 70 Asadullah Murghar 71 Allah Bux Murghar Ghulam Abbas Galhro (Leader 72 Farmer) 73 Allah Dino Galhro 74 Bilawal Galhro 75 Ilyas Galhro Haji Saleh Galhro Kharo Chhan 19/2/2012 76 Wali Muhammed Galhro 77 Muhammed Hayat Galhro 78 Yaqoob Khaskheli Galhro 79 Haji Muhammed Rhim Galhro 80 Muhammed Usman (Leader Farmer) 81 Muhammed Amin 82 Muhammed Khan 83 Gul Hassan 84 Muhammed Amin Usman Meeran Khan Keti Bunder 22/2/2012 85 Haibat Khan 86 Allah Bux 87 Muhammed Moosa 88 Azeem 89 Muhammed Sharif 90 Murad Ali Shah 91 Allah bux Shah 92 Anwar shah 93 Gul Hassan Shah 94 Ameer Shah Allah bux Shah Keti Bunder 22/2/2012 95 Ghulam Hyder Shah 96 Ghulam Rasool shah 97 Yaqoob shah 98 Haji shah 99 Usman Shah

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 65]

S# Name Village/ City UC Date 100 Muhammed Hassan Shah 101 Saleem Shah (Leader Farmer) 102 Ghulam Rasool Murghur 103 Abdul Kareem Murghur 104 Muhammad Hassan Murghur 105 Saeendad Murghur 106 Hussain Murghur 107 Abdul Sattar Murghur 108 Sabir Murghur (Leader Farmer) Shamboo Murghur Kharo Chhan 23/2/2012 109 Muhammad Hassa 110 Rasool Bux Murghur 111 Makbool Murghur 112 Latif Murghur 113 Rashid Murghur 114 Hamzo Khan Murghur 115 Muhammad Malook Murghur 116 Azeem Murghur (Leader Farmer) 117 Yaqoob Murghur 118 Soofan Murghur 119 Khameso Malah 120 Noor Muhammad Murghur Yaqoob Murghur Kharo Chhan 23/2/2012 121 Aslam Murghur 122 Mehboob Murghur 123 Raza Muhammad Murghur 124 Abdul Rehman Murghur 125 Ghulam Mustafa b) Meetings with Cooperative Office Bearers S# Name Cooperative Name Village & UC Date 1 Muhammad Yaqoob Marketing Cooperative Muhammad Yaqoob UC Baloch (Chairman) Kharo Chan 2 Muhammad Usman Marketing Cooperative (Finance Muhammad Yaqoob UC Secretary) Kharo Chan 3 Shafi Muhammad Marketing Cooperative Ali Bux Murghor UC Khaor 15-02- Murghor (Chairman) Chan 12 4 Muhammad Hashim Marketing Cooperative (Voice Ali Bux Murghor UC Khaor 15-02- Murghor Chairman) Chan 12 5 Allah Bux Murghur Marketing Cooperative (General Ali Bux Murghor UC Khaor 15-02- Secretary) Chan 12 6 Sabir Ali Marketing Cooperative (Finance Ali Bux Murghor UC Khaor 15-02- Secretary) Chan 12 7 Muhammad Amir CBO Member Ali Bux Murghor UC Khaor 15-02- Chan 12 8 Mian Wasayo Sholani Marketing Cooperative Haji Hashim Sholani UC 16-02- Kharo Chan 12 9 Saleem Shah General Secretary Muhammad Yaqoob UC 16-02- Kharo Chan 12 10 Nazeer Shah Muhammad Yaqoob UC 16-02- Kharo Chan 12 11 Ghulam Abbas General Body Member Haji Hashim Sholani UC 16-02- Kharo Chan 12 12 Manzoor Haji Hashim Sholani UC 16-02- Kharo Chan 12 13 Ameer Hamza Haji Hashim Sholani UC 16-02- Kharo Chan 12

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 66]

c) Meetings with FSL Project Staff S# Name Designation Station Date 1 Sainthel Program Manager, FSL Thatta 27, Feb, 2012 2 Ali Kumbhar Deputy Program Manager, FSL Thatta 27, Feb, 2012 3 Sajad Khaskheli Field Research Technican, FSL Garho, Field Office 27, Feb, 2012 4 Abdul Aziz Field Research Technican, FSL Garho, Field Office 27, Feb, 2012 5 Mohsan Fiedl Research Supervisor, FSL Garho, Field Office 27, Feb, 2012 6 Jack Program Manager, Wash Garho, Field Office 27, Feb, 2012 7 Mir Jan Team Leader WASH Garho, Field Office 27, Feb, 2012 Agri Market Development 8 Ashfaque Garho, Field Office 27, Feb, 2012 Technician, FSL 9 MS Nazia Shakoor Hygiene Promoter WASH Garho, Field Office 27, Feb, 2012

d) Meetings with middlemen and Government Officers

S# Name Designation Station Date 1 Mujeeb u Rehman MEAL Coordinator, ACF Islamabad 09, Feb, 2012 2 Beesham Das Jholi Lal Rice Mill Owner Garho 21, Feb, 2012 3 Amir Jan Seasonal Tomato Middle men Mirpur Sakro 24, Feb, 2012 4 Habbat Khan Seasonal Tomato Middle men Mirpur Sakro 24, Feb, 2012 Vegetable Broker, Vegetable Market, Khawaja 5 Akbar Ali Near Mirpurkhas 28, Feb, 2012 Goth Vegetable Broker, Vegetable Market, Khawaja 6 Shamasudin Near Mirpurkhas 28, Feb, 2012 Goth 7 Fazal Junejo Director Agriculture Hyderabad Hyderabad 28, Feb, 2012 Director Women Development Project Govt. of 8 Hameed Shah Karachi 29, Feb, 2012 Sindh 9 Mr. Qazim Coastal Agriculture Research Center Karachi 29, Feb, 2012

e) Meetings with Islamabad Team Dr. Yameen Sahib S# Name Designation Station Date 1 Muriel Calo Advisor Islamabad 2 Onno van Manen Country Director Islamabad 3 Michael Newell Logistic Coordinator Islamabad 4 Paola Maria Valdettaro FSL Coordinator Islamabad 5 Eric Rheinstein WASH Coordinator Islamabad February 5 to 6 Mujibor Rahman MEAL Coordinator Islamabad 8, 2012 7 John Sec Coordinator Islamabad 8 Mike Logistic Coordinator Islamabad 10 Dewi Dwiyanti Admin Coordinator Islamabad

External Evaluation of ACF’s Programme - “Improving Living Conditions in a Changing Environment – Thatta Coastal Farmers” Province of Sindh, Pakistan - Final Report –April, 2012 [Page 67]