ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
PAKISTAN1
Objectives
1. The thematic evaluation study aims to assess Asian Development Bank’s (ADB’s) support for gender and development (GAD) by examining (i) the relevance of ADB’s gender and development (GAD) policy and its strategic priorities in promoting gender equity in the region, (ii) the responsiveness of ADB’s country partnership strategies (CPS) and operations to promoting gender equity and women’s empowerment, and (iii) the results of ADB’s operations in realizing gender equity outcomes and targets. The evaluation covers 2005–2015. The country portfolio assessment of Pakistan adopts the same objectives and examines the relevance of ADB’s GAD objectives and strategic priorities to the country context, the responsiveness of the CPS and ADB operations to the gender challenges facing Pakistan, and the results of ADB operations in Pakistan on gender equity.
Methodology for the Country Portfolio Assessment
2. The country portfolio assessments utilized an evaluation framework developed by the Independent Evaluation Department (IED)2 to assess the adoption and implementation of ADB’s GAD policy and operational guidelines in the CPS, portfolio, and technical assistance (TA) program to answer the key evaluation questions specified in the Evaluation Approach Paper:
How relevant are ADB’s corporate policies and strategies in promoting gender and development in Asia and the Pacific? How responsive are ADB’s country strategies and operations to the existing corporate policies and strategies, and new challenges relating to gender equity? How effective are ADB’s operations in achieving gender equity outcomes and targets? How can ADB improve the delivery of its gender equity agenda?
3. The Pakistan assessment relied on a combination of data collection methods, including (i) desk reviews of all relevant documents, project reports and data; (ii) a country mission3 from 15–27 August 2016 to solicit feedback from counterpart agencies, development partners, and other stakeholders on ADB’s strategy and overall support for gender and development, and more targeted feedback on selected projects with gender mainstreaming or gender equity objectives; (iii) in-country fieldwork involving site visits to two ADB projects, and feedback from beneficiaries and field level implementing personnel to get a first-hand overview of the challenges faced and progress achieved in realizing intended gender outcomes; and (iv) focus group discussions with beneficiaries of two ADB projects.
4. The desk review covered CPSs 2009–2013 and 2015–2019; 2008 country gender assessments (CGAs)4 for 2008 and 2013–2014 CGA5; portfolio analysis and review of project documentation and assessment reports for 2005–2015; and self-assessments or related reports produced by government agencies, implementing agencies, think tanks, and other development partners. This assessment did not repeat the gender diagnostics undertaken by the recent Pakistan CGA. It focused instead on the assistance provided by ADB to promote GAD in Pakistan to assess its relevance, responsiveness, and
1 This assessment was authored by Anis Dani (Consultant). Asian Development Bank Central and West Asia Department’s comments during interdepartmental circulation were considered in finalizing the same. 2 The framework for country portfolio assessments was finalized during a preparatory workshop held at ADB headquarters in June 2016. 3 The country mission to Pakistan was led by Hyun Son, Principal Evaluation Specialist, and included Anis Dani, Country/Gender Specialist, and Alexis Garcia, Research Analyst/Consultant. 4 ADB. 2008. Releasing Women’s Potential Contribution to Inclusive Economic Growth: Country Gender Assessment—Pakistan. Manila. 5 ADB. 2014. Promoting Gender Inclusive Growth in Central and West Asia. PAK: Country Gender Assessment. Manila (prepared in collaboration with the World Bank; Australian Government; Canada Department of Foreign Affairs, Trade, and Development; and Islamic Development Bank).
1 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) effectiveness. In addition to projects approved during the review period, the assessment also drew on findings from project validation reports (PVR) completed during the review period for projects approved earlier which had significant gender objectives, as they enabled a more complete picture of ADB’s country strategy and assistance for Pakistan.
5. Based on the desk review of the portfolio, the mission selected a set of projects to examine more deeply during the mission. Most of these were gender equity and mainstreaming (GEM) projects from public sector management (PSM) which includes social protection, agriculture, natural resources and rural development sector, health sector, and disaster risk management. In addition, the mission also held discussions with government representatives and development partners on the transport sector, which alone constitutes 18% of the portfolio by number of projects (second to the energy sector which is 26% of the portfolio). Transport has the largest share of projects with some gender elements (SGE).
6. At the operational level, the evaluation team focused on the following projects more intensively during the country mission:
Access to Justice Program (2001) Decentralization Support Program (2002) Sustainable Livelihoods in Barani Areas Project (2004) National Highway Development Sector Investment Program, Project 1 (2006), (findings are relevant to the remaining tranches of the multitranche financing facility [MFF], and the National Trade Corridor Highway Investment Program [2014] being implemented by the National Highway Authority) Earthquake-Displaced People Livelihood Assistance Restoration Program (2007) Sindh Coastal Community Development Project (2007) Punjab Millenium Development Goals Program (2008/2010) (2 subprograms) Social Protection Development Project (2013)
7. The field visits were more selective and focused on two projects classified as having gender equity theme (GEN) objectives: the Social Protection Development Project, which is financing the government’s safety net—Benazir Income Support Program (BISP)—and the completed Earthquake-Displaced People Livelihood Assistance Restoration Program. Field visits were carried out in two of the nine districts where these two programs overlapped—Bagh District (Azad Jammu and Kashmir) and Mansehra District (Khyber Pakhtunkhwa Province). This enabled the team to meet with more than 60 people, including beneficiaries and implementing agency staff, The field visit was also used to pretest the focus group evaluation instrument and to train the two teams of national researchers who were to undertake the focus group discussions (FGDs) subsequent to the mission. The field visit was thus followed by additional FGDs6 with 115 beneficiaries, undertaken by the two teams to provide additional coverage of beneficiaries from each of those districts.
I. Country Context
8. Pakistan’s development trajectory has been replete with contradictions and has suffered from several episodes of policy reversals and weak follow-through in implementation. As a result, the country remains a development conundrum.
9. While poverty ratios have declined in Pakistan, human development indicators perform poorly and gender inequality remains pervasive. Pakistan is a lower middle income country with a population of 188 million and gross domestic product (GDP) per capita of $1,429 in 2015.7 The poverty headcount ratio at $190 per day (2011 purchasing power parity [PPP]) as a percentage of the population went down
6 The methodology and consolidated district-level findings from the FGDs are attached as Appendix 4 of this report. 7 World Bank. World Development Indicators. http://data.worldbank.org/data-catalog/world-development-indicators
2 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) from 28.7% in 2001 to 6.1% in 2013 but the GINI Index grew marginally from 30.4 to 30.7 over the same period.8 The national poverty headcount was redefined in 2016 using a consumption-based model to estimate poverty at 29.5% using the 2013 household income and expenditure survey. Pakistan’s performance on human development lags significantly behind most of its peers9 and, with a ranking of 147 out of 188, it is the only South Asian country other than Afghanistan (ranked 171) classified as having low human development. Performance on human development is further exacerbated by gender disparity in human development indicators. Consequently, Pakistan is ranked poorly on the United Nations Development Programme (UNDP) gender development index10 (GDI) where its ratio of 0.726 also lags behind all comparators except for Afghanistan.
10. On UNDP’s gender inequality index (GII), Pakistan lags most South Asian countries too. Pakistan received a score 0.536 on the GII in 2014 and ranked 121 out of 155 countries, ahead only of India (130) and Afghanistan (152) in South Asia. Pakistan’s efforts to foster gender inequality are hindered by slow progress in improving literacy, slow adoption of safe health practices, obstacles to female mobility, and women’s limited access to economic opportunities. Gender parity varies across provinces but there are even vast differences across districts within provinces.11 The impact of these challenges is manifested in the low labor force participation rate of females, estimated by UNDP to be 25% compared to 83% for males in 2013. In practice, some 75% of women work on the land as informal agricultural workers or domestic workers but this is not captured by labor statistics, and remains undervalued in the economy. This tendency is further reinforced by the relatively slow transformation from agriculture to industry in the Pakistan economy. Informal agricultural work and domestic work offer low returns and by keeping women trapped in traditional economic roles, often within household economies, hinders women’s ability to overcome gender inequality constraints.
11. Lack of alternate economic opportunities is further aggravated by the pervasiveness of gender- based violence (GBV), which remains one of the grievous manifestations of a patriarchal and culturally conservative society, common to Pakistan and some of its neighboring countries. More than 7,000 cases of GBV have been recorded each year between 2008 and 2012 in Pakistan. GBV in Pakistan includes honor killing, domestic violence, human trafficking, sexual violence, and other harmful practices such as bonded labor which render women vulnerable. GBV affects women across class, religion, and ethnic lines but is even more acute among women from traditional tribal or feudal cultures where GBV is further reinforced by informal legal systems.
12. GBV has also become an instrument of terrorism in Pakistan. Islamic militants have frequently bombed girls’ schools and targeted female schoolteachers and health workers in a deliberate attempt to discourage female education and social transformation. The most well-known of these cases is the assassination attempt on Malala Yousufzai, who was grievously wounded in one such attack in Swat but was repatriated and recovered to continue her studies and her campaign for female education overseas. At 17, she become the youngest winner of the Nobel Prize for her advocacy of female education. Not everyone is so fortunate, and many women and girls have paid for their aspirations with their lives.
13. Responsibility for provision of basic services and the distribution of revenues among different levels of government has remained in flux over the years. Although envisaged as a federation in the 1973 Constitution, most powers were initially retained by the federal government. Three attempts were made to introduce and strengthen local government organizations, unfortunately all three were by military rulers whose legitimacy did not outlast their tenure. The last of these was in 2001, when the 17th amendment provided greater autonomy to local governments and devolved key functions like education and health to the local government level and supported them by fiscal transfers. Two elections were held
8 World Bank estimates based on individual consumption data. 9 Comparative data are presented in the tables in Appendix 1. 10 The GDI is the ratio of the Human Development Index (HDI) for females compared to males. 11 Punjab Commission on the Status of Women. 2016. Punjab Gender Parity Report. Lahore.
3 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) in 2001 and 2005 under that system but these powers lapsed in 2009 and the amendment was officially repealed and replaced by the 18th amendment in April 2010.
14. The 18th amendment to the Constitution resulted in the elimination of 17 federal ministries and departments, including the ministries of education, health, social welfare, labor and manpower, and women’s development. Their responsibilities were devolved to the provinces along with transfer of the budgets for providing these services to citizens. The National Finance Commission constituted under the Constitution determines the distribution of the net proceeds of all taxes between the federation and the provinces. While decentralization of authority to the provinces has brought benefits and greater ownership among provincial governments, it increased the challenges of implementing reforms which are now dependent on multiple decision-making bodies with varying capacities and governance systems. Progress in many areas mandated by the Constitution has therefore become even more uneven.
Diagnostic Studies
15. Since 2000 there has been a plethora of studies on gender issues in Pakistan. Multilateral and bilateral aid agencies have invested in comprehensive diagnostic studies, and women’s activists and advocacy organizations within Pakistan have tended to focus largely on current issues and on analysis and advocacy for legislative and institutional reform. Clearly knowledge gaps are not to blame for lack of progress on gender equality in Pakistan.
16. The National Commission on the Status of Women (NCSW) has produced several studies on legal systems in Pakistan, including A Policy Framework for Women’s Equal Rights: Issues, Concerns, and Recommendations for Gendered Policy; 12 A Study of Formal & Informal Legal Systems Prevalent in Pakistan; 13 Review of Muslim Family Laws; 14 and Litigation Related to Women under Nizam-e-Adl, Malakand Division. 15 These studies have been consistent with the mandate of NCSW to advise the government on gender policy and legislation, and have been aimed at advocacy and policy dialogue on pro-gender legislation. Such efforts have contributed to the approval of several key laws between 2010– 2014 to protect women and strengthen their role, which will be discussed in the next section of the report.
17. A more substantive diagnostic report is the Punjab Gender Parity Report 2016 produced by the Punjab Commission on the Status of Women (footnote 10). This is a useful reference document which provides data at the provincial and district level on a wide range of indicators including demographic trends, female participation in political activities and governance, health, education, economic participation and opportunities, legal and judicial protection, violence against women, and special initiatives to promote gender equity. The data show that despite relative progress in education, health, and access to economic opportunities in Punjab Province during the past decade, the gender gap remains large and there has been an increase in the reported cases of violence against women. The report reveals that although the 69% male literacy rate in Punjab Province is slightly lower than the national average of 71% for males, the gender parity index (GPI) for adult literacy for Punjab Province (0.7246) is better than Pakistan’s GPI on adult literacy (0.65). Yet there is huge disparity on gender within Punjab: literacy rates are lowest, especially female literacy in the southwestern districts Rajanpur (19%) and Dera Ghazi Khan (26%), and Rajanpur has by far the lowest GPI (0.42) on adult literacy. Even Punjab needs to pay special attention to gender equity. The report recommends continued focus on (i) improving policy and
12 Afiya S. Zia. 2010. A Policy Framework for Women’s Equal Rights: Issues, Concerns and Recommendations for Gendered Policy. Study for the National Commission on the Status of Women, Pakistan. Islamabad. 13 NCSW. 2011. A Study of Formal and Informal Legal Systems Prevalent in Pakistan. Islamabad. 14 NCSW. 2011. Review of Muslim Family Laws. Islamabad. 15 Provincial Commission on the Status of Women, Khyber Pakhtunkhwa. 2014. Litigation Related to Women under Nizam-e-Adl, Malakand Division. Islamabad.
4 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) legislation and implementation, (ii) capacity building and institutional strengthening of public agencies and service providers, (iii) social advocacy to change attitudes towards women’s role in public life, and (iv) strengthening data collection and research.
18. Non-governmental organizations (NGOs) like Shirkat Gah and Aurat Foundation are activist organizations that also undertake gender research. Shirkat Gah tends to focus on policy research while Aurat Foundation engages directly in development process and conducts applied research. For instance, Aurat Foundation played a very active role in capacity building of local councilors, with a particular focus on women elected to local councils in local government elections in 2001 and 2005.16 They produced comprehensive reports of the citizen’s campaigns to enhance the representation and role of women in local government. Those decentralization efforts received substantial support from ADB during those years, which predate the evaluation period.
19. Gender studies is integrated within two universities in Pakistan. The University of Karachi has a Center for Excellence on Women’s Studies which offers Bachelors and Masters degrees in Gender Studies. Since 2008 it has been publishing the Pakistan Journal of Gender Studies annually to provide an outlet for related research. Quaid-i-Azam University, Islamabad also established a Centre of Excellence in Gender Studies in 2004, which offers an M.Sc. degree in Gender Studies and supports gender equality through advocacy and policy dialogue with the government due to its proximity to the capital. But they have not produced any diagnostic studies.
20. On health and demographic issues, the Population Council has been the most consistent in undertaking relevant research. The Population Council focuses on issues that are most relevant to family planning and maternal health, which are among the key constraints to gender equality in Pakistan. Their research is however not directly amenable to the kind of development interventions that ADB supports.
21. The World Bank last undertook a comprehensive CGA in 2005.17 This was informed by data from the Pakistan Rural Household Survey (2004) and a series of background papers, including a 2005 background paper on “Gender and Poverty in Pakistan” by Khawar Mumtaz.18 The CGA presented new evidence collected by the Pakistan Institute for Development Economics to discuss the policy implications to improve gender inequality, girls’ schooling, health outcomes for women and children, and participation of women in the work force. Since then gender issues have been integrated within the poverty assessment and the socioeconomic survey to improve poverty means-tested targeting of the safety net but the CGA has not been updated by the World Bank.
22. Three more gender assessments are worth mentioning—a 2008 study by the Sustainable Development Policy Institute (SDPI), Pakistan: A Country Gender Profile;19 a 2012 study sponsored by United Nations (UN) Women which focused on rural and urban gender differences across provinces by wealth quintiles; 20 and a comparative study of gender indicators sponsored by U.S. Agency for International Development (USAID).21
16 Aurat Foundation is also one of the implementing partners of the BISP with financing from USAID. BISP is cofinanced by the World Bank and the Department for International Development and receives parallel funding from ADB. 17 World Bank. 2005. Pakistan: Country Gender Assessment, Bridging the Gender Gap, Opportunities and Challenges. Washington https://openknowledge.worldbank.org/handle/10986/8453 18 Khawar Mumtaz was the most recent chairperson of the NCSW. Her term ended in December 2015, and the appointment of her successor is still awaited. 19 SDPI. 2008. Pakistan: Country Gender Profile. Islamabad. 20 Zaidi, Yasmin. 2013. Baseline Study on the Status of Women and Men in Pakistan, 2012. Islamabad: Center of Gender and Policy Studies, Management Development Institute. 21 Spevacek, Anne Marie, Esther Kim, and Nawal Mustafa. Pakistan Gender Overview. Arlington, VA: USAID Knowledge Services Center.
5 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
23. ADB too has been proactive in undertaking gender diagnostics in Pakistan. ADB undertook CGAs in Pakistan in 2000 and 2008, and drew on a regional TA to support another CGA, finalized in July 2015. These CGAs and their policy and operational recommendations are discussed under ADB support for gender equality later in this report. Thus even before the most recent CGA, a considerable body of diagnostic studies was available to inform country strategy formulation. The real measure of success will be whether the recommendations were relevant and appropriately designed and supported to achieve gender equality results.
II. Government Strategy on Gender Equality
24. The Constitution of Pakistan clearly states that: “Steps shall be taken to ensure full participation of women in all spheres of national life” (Article 34). The devolution of authority to the provinces under the 18th Constitutional amendment has increased the challenge of implementing reforms, such as those promoting gender equality. Devolution has increased the number of decision-making bodies, and support for gender reforms, which by definition challenge patriarchal norms and values, remains uneven across provinces. Capacity for implementation also varies across provinces. In that sense, the 18th amendment has created further hurdles in achieving gender objectives.
25. The government’s medium-term strategy document, Vision 2025 approved in 2014, makes a commitment to support gender equality and women’s development. In terms of committed actions this is listed as one of 25 goals of the country’s development vision under Pillar I: Putting People First– Developing Human and Social Capital. The goal aims to improve primary and secondary GPI to 1, and increase female labor force participation rate from 24% to 45%. If achieved, this would indeed be a remarkable achievement given the weak track record of the country in terms of gender and human development outcomes.
26. Historically, the government’s strategy has been more focused on promoting gender equality in a top-down manner. While some of the fundamental actions to support human development capacity of girls and empower women have lacked strong ownership and sustained support, in other areas such as enacting quotas in political office and approving legislation to protect women, and in promoting certain sectors, such as microfinance, where gender targeting was feasible, the government has been more effective. In formulating the 2001 and 2010 Poverty Reduction Strategy Papers, the government committed itself to supporting the Millennium Development Goals (MDGs), which included education, health, and gender targets and empowering women to increase their participation in the work force. Inadequate budget allocations and insufficient attention to implementation quality and demand-side factors prevented the government from achieving most of its MDG goals, especially for females. Together with slower economic growth since 2007, this has further impeded the strategic objective of enhancing the labor force participation rate for females.
27. At the political level, however, efforts were more successful, although even here some gains have been reversed. Female representation in parliament has reached 20%, which is the highest proportion in South Asia. The devolution program launched in 2001 included reservation of 33% seats for women in all local councils, with direct elections for women at the lowest tier of local government, the union council level. The first election in 2001 was held on non-party basis and resulted in the emergence of new leadership among males and females. Over 32,000 women were elected to these union councils. NGOs like the Aurat Foundation and South Asia Partnership played an active role in building capacity of newly elected councilors to participate more effectively in local council meetings and decision-making. The second round of elections in 2005 faced some setbacks as provincial governments reasserted themselves and political parties tried to influence elections behind the scenes. Resultant violence and disruption of voting in some constituencies discouraged weaker segments of society, including women from openly
6 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) confronting these pressures.22 The local government system suffered a further setback when national elections were held in 2008 and political parties reasserted themselves, effectively reversing the local government system established by the 2001 devolution program. Local government elections have been held in two provinces but power and budget resources remain in the hands of the provincial governments.
28. The Constitution also requires the State to provide “maternity benefits for women in employment” (Article 37) and promote social and economic well-being by “secure[ing] the well-being of the people, irrespective of sex, caste, creed or race, by raising their standard of living,” and “provide basic necessities of life, such as food, clothing, housing, education and medical relief, for all citizens, irrespective of sex, caste, creed or race, as are permanently or temporarily unable to earn their livelihood on account of infirmity, sickness or unemployment” (Article 38).
29. In 2007, the government adopted a policy of reserving 10% of positions in the government for women. Unfilled vacancies are left vacant until a suitable female candidate is found. In practice, however, the government has only been able to implement this quota at more senior levels in government employment where it exceeded this target. In terms of total government employment, however, the pressure to employ male breadwinners seems to prevail and the aggregate ratio remains under 6%.
30. GBV has become a growing menace with an increasing frequency reported in the media. Over the past 10 years, GBV has grown from domestic violence and female victims of informal legal practices to criminal violence and attacks on women by Islamic fundamentalists. Recognizing the need to confront GBV directly, the civilian government which took over in 2008 enacted several important laws designed to discourage some manifestations of GBV:
The Protection Against Harassment of Women at the Workplace Act 2010 The Criminal Law Act (Second Amendment, 2011), referred to as the Acid Control and Acid Crime Prevention Act The Criminal Law Act (Third Amendment, 2011), referred to as Prevention of Anti-Women Practices Act Women in Distress and Detention Fund Bill 2011 National Commission on the Status of Women Act 2012 Sindh Child Marriage Restraint Bill 2013 Punjab Fair Representation of Women Act 2014
31. Passing a law is however only the first step. Implementation and monitoring challenges remain, and are some of the reasons for the approval of the 2012 Act upgrading the NCSW as a statutory body with a Board that includes representatives from all the provinces and other administrative units in Pakistan. At the provincial level, NCSW is complemented by Provincial Commissions on the Status of Women and Women’s Development Departments. However, none of these have responsibility for implementation.
32. The NCSW was declared an autonomous special commission by the Parliamentary Act of 2012, with a chairperson reporting to the Parliament and the Prime Minister. Its mandate includes “review and assessment of laws, government policies, programmes and measures and their implementation, and make recommendations to achieve gender equality and women’s empowerment and eliminate discrimination”23 (emphasis added). NCSW was administratively placed under the Ministry of Human Rights (MOHR)24 and expected to formulate its own rules of business and staffing. But the Ministry was
22 Aurat Publication and Information Service Foundation. n.d. Citizens’ Campaign for Women’s Representation in Local Government in Pakistan, 2001 and 2005: Backdrop, Glimpses of the Campaigns, Overall Results. Lahore. 23 NCSW. 2013. Annual Report 2013. Islamabad. 24 MOHR was merged with the Ministry of Law and Justice under the previous government but has recently been declared a separate ministry. NCSW remains administratively under MOHR.
7 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) not supportive of the autonomy of NCSW and effectively prevented it from recruiting its own staff and managing its own budget, thereby limiting its effectiveness.
33. NCSW was also given the responsibility to track and report on compliance with international commitments on gender equality, such as the Convention on the Elimination of All forms of Discrimination Against Women (CEDAW). Pakistan ratified CEDAW in 1996, with a declaration making the compliance subject to its Constitution and a reservation under Article 29, para 1. There is lack of public awareness about CEDAW and civil society organizations have not been involved in implementation of its provisions. So far Pakistan has submitted four reports to CEDAW, the fourth report was adopted by the committee at its 54th session held on 11 February–1 March 2013. The Committee welcomed the adoption of legislation aimed at eliminating discrimination against women and acknowledged the challenges faced by the country due to natural disasters, the devolution of powers under the 18th Constitutional amendment which limits powers of the federal government, and to increased violence and attacks by non-state actors. But the committee expressed concern that with the transfer of responsibility for integration and coordination of policies aimed at the advancement of women to the provinces, the government lacks the capacity to put in place an efficient mechanism to ensure that the provincial governments establish legal and other measures to fully implement the Convention in a coherent and consistent manner. The Committee communicated a long list of actions to be taken by the State party, i.e. government of Pakistan, to comply with the various provisions of CEDAW.
34. The term of the chairperson NCSW ended in December 2015, and the Board members ended in April. Replacements have not yet been appointed. NCSW is being run by a Secretary who cannot exercise the financial powers that were vested in the chairperson, so activities have slowed down even further.
35. While the gender benefits of decentralization have not been sustained, civilian governments have undertaken several strategic initiatives since 2008 to empower women. The BISP is an important vehicle for cash transfers to women and is now covering 4.8 million households. The Sindh Government’s Landless Haris Project providing land titles to the landless awarded 70.6% of land titles to women beneficiaries. The Prime Minister also announced a Youth Business Loan Scheme which earmarked 50% of loans for females, and the Punjab Government has also made budget allocations for a women’s empowerment package. It is too soon to know the results of the most recent initiatives.
III. ADB Support for Gender Equality
36. The evaluation period spans across three CPS cycles governed by the later part of the country strategy for 2002–2006, which was extended by updates up to 2008; the span of CPS 2009–2013; and the early part of CPS 2015–2019. The CPSs treated gender equality as an integral part of inclusive growth, one of the essential pillars of ADB’s corporate strategy.
37. The objectives of the country strategy in 2002 originally had three main objectives: the promotion of good governance, sustainable pro-poor growth, and inclusive human development. These led to support for agriculture and natural resources, health and education, water supply and municipal services, transport, energy, and finance sector development. Later this was expanded to include PSM and governance, including judicial and police reform, decentralization of government to local levels and devolution of social services, and public resource management programs, including budget support and TA for Punjab and Baluchistan provinces.
38. The 2002–2006 strategy targeted gender issues by focusing on (i) targeting the specific needs of women through devolved social service delivery programs, water supply and sanitation projects, integrated rural development interventions, and support for microfinance; (ii) mainstreaming gender across all projects; and (iii) promoting policy and institutional reforms for awareness and enforcement of women’s rights and representation in all aspects of economic and social development. The 2013 Country
8 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
Assistance Program Evaluation (CAPE) found that the Country Strategy Program (CSP) listed several gender indicators, but lacked targets and milestones.
39. CSP updates between 2004 and 2008 shifted the emphasis to the pursuit of higher sustained growth, rather than human development. Higher priority was given to improving economic infrastructure in power, large-scale irrigation, national highways and corridors, as well as in urban development. The 2005 earthquake also led to an emergency assistance program followed by a 2007 program aimed at restoring livelihoods of earthquake-affected people. Economic growth was sustained until 2007 but the portfolio performed poorly especially in the later part of the CSP, when the country went through a tumultuous period leading to the ousting of the serving general as head of state and restoration of civilian rule.
40. CPS, 2009–2013 narrowed ADB support to four main areas: (i) energy and infrastructure, (ii) institutional reform and private sector development, (iii) development of basic urban services, and (iv) more effective implementation and capacity building. The CPS included a gender assessment which reported that the most significant results under ADB’s previous country strategy were achieved through the policy and institutional reforms linked to the ADB Decentralization Support Program (which promoted gender equity by reserving 33% seats for women), and the implementation of the Gender Reform Action Plans (GRAPs) 25 within that framework. Mainstreaming gender concerns in rural development and agriculture projects also produced results for women. The CSP also described shortcomings in achieving gender equality. It reiterated the need for gender mainstreaming in all ADB operations in Pakistan, integrating gender in the design of projects and specifying provisions for women’s participation in and benefits from a project in a Gender Action Plan (GAP), including a gender specialist in all project assessments, and enhancing links to outcomes. The CPS also indicated that Pakistan should benefit from regional TA programs on gender mainstreaming and proposed that the results framework of projects should include gender-disaggregated data.
41. CPS, 2015–2019 was informed by ADB’s 2013–2014 CGA, which was cofinanced by the Government of Australia, and conducted in collaboration with the governments of Australia and Canada, and the Islamic Development Bank. The Gender Analysis in the CPS highlights Pakistan’s poor performance on gender parity on human development and labor force participation, and the prevalence of GBV as acute challenges, despite progress in political representation, the only indicator where Pakistan’s performance is better than other countries in the region. The gender assessment reported that rural development projects with targeted interventions have been quite successful in promoting women’s empowerment, and emergency response projects provided tangible benefits to women. Projects from both categories were identified for further investigation by this assessment.
42. CPS, 2015–2019 pledges to continue its focus on infrastructure with gender mainstreaming as the primary strategy of ADB support. The CPS intends to provide the highest share of lending in support of the energy sector, followed by transport; natural resources and irrigation; urban services; PSM including public–private partnerships; and public administration and finance. In most of them the strategy seems to be satisfied with a gender mainstreaming approach, which has not borne good results in Pakistan so far.
43. In energy, the CPS promises to maximize women’s access to energy benefits but other than gender-sensitive recruitment programs and improving contact with female consumers, the only actions proposed are studies and documentation of energy use to “promote evidence-based policy making.” In transport, the CPS recommends development of gender-sensitive roadside facilities, developing gender- responsive resettlement and land acquisition plans, and encourage women’s employment and capacity building. In natural resources and irrigation, ADB intends to improve women’s access to water and
25 GRAPs were prepared for the federal and all provincial governments with TA from ADB approved in 2002 for the Gender Reform Program.
9 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) livelihood opportunities by engaging women in water-related decision-making bodies, linking women farmers to livelihood opportunities, and documenting gender impacts. In water supply and sanitation, ADB will enhance women’s representation in water and sanitation boards and steering committees, establish gender-responsive customer care systems and a sex-disaggregated complaint mechanism.
44. Of all the sectors, only two—urban transport and social protection—appear to have a deliberate strategy of identifying and responding to the special needs of women. In urban transport, ADB intends to improve women’s ridership by identifying women’s needs and mobility concerns, and integrating gender design features in projects. In social protection (classified under PSM), ADB intends to continue support for the government’s safety net program which provides cash transfers to women and is designed to have a direct impact on their empowerment and wellbeing. It is too soon to assess the results of the urban transport projects but this assessment has undertaken an in-depth assessment of the social protection project’s support for BISP.
45. The review of these three CPSs indicates that in terms of strategy, ADB’s ambition to promote gender equality has become much more modest as it sought to restructure a poorly performing portfolio. ADB has fallen back on infrastructure sectors where it believes it has a comparative advantage. In most of them its efforts to mainstream gender are very modest as shown by the gender categories in the operations approved in 2005–2015 (Figure 1).
IV. Assessment of ADB Support for Gender Equality
A. Relevance of the CPSs
46. ADB’s lending activities approved during 2005–2015 consisted of 66 loan and grant operations with a total commitment amount of $12.4 billion in ADB financing out of total project financing of $16.6 billion. The largest sectors of operations were energy (32.7% of total loan amounts approved) and transport (22.5%), followed by PSM (19%), and finance (12.4%). Eight operations were classified as projects with a GEN and 11 as projects with Effective Gender Mainstreaming (EGM). Over the review period, the operations designed with GEM objectives constituted 29% of new approvals by number of projects, and 25% of ADB financing (Appendix 2, Table 2.2). The portfolio was distributed across a wide range of sectors but energy and transport sectors, which consisted of 47% of the projects and 55% of the financing volume, and the finance sector, whose operations were the largest in financing volume26, were the least likely to have significant gender elements (Figure 1). Human development was underrepresented in the Pakistan portfolio but both health and the lone education project were classified as GEN projects, and the social protection project is classified under PSM.
47. ADB also approved $21 million for 28 TA activities during 2010–2015. Of these, one for the Social Protection Development Project, was classified as GEN and designed to provide TA to BISP’s health insurance program. Four TAs were classified as EGM—two for urban transport in Karachi and Peshawar, one for urban water and sanitation in Punjab intermediate cities, and one for renewable energy. TA for operations classified as gender equity and mainstreaming thus amounted to 18% of the number of TAs and 29% of the financial commitment for TAs during this period. (Appendix 2, Tables 2.3 and 2.4). At the same time, 13 of the TAs were classified as having no gender elements (NGE), and three were not classified. Consequently, 64% of the TAs by number and 60% of the financial commitment for TA had no relevance for gender objectives. Among TA activities approved prior to 2010, two TAs for the Decentralization Support Program and Gender Reform Program (approved in 2002 and kept open until 2009), and one project preparatory TA for the Punjab Millennium Development Goals Program and Access to Justice Program (approved in 2008) had GEN objectives.
26 The five operations from finance sector averaged $307 million each compared to an average size of $188 million.
10 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
Figure 1: Number of Approved Sovereign Loans & Grants in Pakistan, by Sector and Gender Equity and Mainstreaming (GEM) classification, 2005–2015
ANR = agriculture and natural resources, EDU = education, EGM = effective gender mainstreaming, ENE = energy, FIN = finance, GEN = gender equity as theme, HLT = health, IND = industry and trade, NC = not categorized, NGE = no gender elements, PSM = public sector management, SGE = some gender elements, TRA = transport, WUS = water and other urban infrastructure and services. Source: Independent Evaluation Department.
48. This aggregate description, which treats the entire evaluation period (2005–2015) as one block, masks the trend towards infrastructure projects that have been further removed from the goal of gender equality. The 2002–2006 country strategy had emphasized human development, decentralization and rural development projects that had stronger gender targeting potential. As the country strategy evolved towards infrastructure, private sector, and urban services in CPS 2009–2013, gender mainstreaming in these sectors was considered an acceptable strategy. The main exception was ADB support for the government’s safety net program (BISP), whose primary beneficiaries were women who met specified criteria to be deemed eligible for cash transfers. This trend appears to have continued into the latest CPS, 2014–2019 dominated by highways and energy projects that tend to have little substantive gender impact.
49. Among the cohort of 2005–2010 approvals that have been completed, only two closed projects (18%) were rated successful on gender impacts: one was a rural development project (Sindh Coastal Community Development Project) and the other was the Earthquake-Displaced People Livelihood Restoration Project. In comparison, when the portfolio is expanded to include projects approved since 2001 which closed during the evaluation period, we find four more projects—two rural community development and two PSM projects for access to justice and decentralization rated successful on gender impacts, bringing the gender success rate to 29%. Not only have the CPSs become less relevant to gender objective in recent years, the aggregate performance of the portfolio on gender has also deteriorated. The projects being supported by the two most recent CPSs have an established record of being less ambitious in terms of supporting gender equality and are less likely to achieve their gender objectives. As such, the CPSs as a whole have become noticeably less relevant in terms of their support for gender equality in Pakistan.
B. Complementarity of ADB Gender Strategy with Other Development Partners
50. It could be argued that ADB’s lending strategy complements other development partners, and that ADB has pulled back from human development sectors where the World Bank and bilateral agencies are more active. However, that justification does not extend to local governance and community development where ADB was more proactive than other partners, and has not been replaced by others.
11 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
ADB has simply chosen to move away from those sectors which are arguably more difficult and need greater attention to institutional design. ADB appears to have a preference for projects with large lending volumes—highways and economic corridors, energy projects, disaster relief, safety nets. Even in some of those sectors, ADB appears to be missing opportunities to collaborate with other partners to increase its relevance and effectiveness, as illustrated by the following projects which were investigated in greater detail than the rest of the portfolio both through interviews with development partners and on-site fieldwork to get feedback from beneficiaries and implementing agency staff:
Following a $385 million Emergency Earthquake Assistance Project (2005), ADB supported the Earthquake-Displaced People Livelihood Restoration Program (2007) with $400 million financing to the Earthquake Reconstruction and Relief Agency (ERRA). ERRA received parallel financing of $638 million during the same period from three World Bank projects but there is little evidence of collaboration with the World Bank. Even more relevant, the Canadian International Development Agency (CIDA) provided two gender specialists to work closely with ERRA to help it adopt a gender-sensitive approach to disaster relief. Other than preparation of a Gender and Vulnerability Action Plan, there is no evidence of collaboration between ADB and CIDA in implementation of the gender aspect of the program.
ADB approved $430 million in financing in 2013 to expand coverage of BISP’s safety net program. The program was established by the government in 2008 and received $150 million in financing from the World Bank, and GBP 300 million in cofinancing from the Department of International Development (DFID) and substantial TA from both of those agencies and USAID who are collaborating closely with each other. The World Bank and DFID share a common program framework with disbursement-linked indicators (DLIs) for tranche releases, undertake joint supervision missions, and collaborate with USAID in implementation and program monitoring. ADB has opted out of formal collaboration with these partners, although it is supporting the same implementing agency, BISP. As a result, ADB is unable to contribute meaningfully to the technical design of the program and is unable to benefit from the joint missions to the detriment of the ADB project.
51. Interviews with the World Bank team leaders of both projects revealed considerable tension with their ADB counterparts. Some of the challenges faced by ADB projects could perhaps have been overcome by a more collaborative approach, which might also have helped to increase their gender results.
C. Responsiveness of ADB Operations
52. To derive a more grounded picture of the relevance, responsiveness, and results of ADB’s assistance to gender, we undertook a more in-depth review of eight projects from the portfolio under implementation during the evaluation period. Feedback on these projects was obtained from government counterparts, ADB staff, and in-country stakeholders. For two projects—one earthquake rehabilitation project, and one social protection project—this was supplemented by on-site visits including interviews and FGDs with beneficiaries, and feedback from staff of implementing agencies.
53. Access to Justice Program (AJP) (2001). The AJP focused on judicial (including reforms relating to administrative justice institutions) and police reforms. The program was expected to deliver benefits in three components—policy, institutions, and budget and expenditure management. The key development objective was to assist the government in improving access to justice by: (i) providing a legal basis for judicial, policy, and administrative reforms; (ii) improving the efficiency, timeliness, and effectiveness of judicial and police services; (iii) supporting greater equity and accessibility to justice services to the vulnerable and poor; (iv) improving predictability and consistency between fiscal and human resource allocations and the mandates of reformed judicial and police institutions at the federal, provincial, and local levels; and (v)ensuring greater transparency and accountability in the performance of justice sector
12 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) agencies. The program was approved in December 2001, and comprised two loans in the amount of $330 million to be released in four tranches, a TA loan for $20 million, and a TA grant for $900,000.
54. The program was expected to contribute to the nationwide effort to influence the exercise of political, administrative, and judicial powers in order to improve accessibility to public entitlements for all citizens, in particular the poor, women, and minorities. The AJP intended to tackle gender issues through the creation of competent legal, judicial, and police institutions through which existing basic and constitutional rights could be implemented fairly and accountably. Although the project completion report (PCR) and the PVR rated the project partly successful overall, the PVR found that the program helped mainstream gender reforms into the justice sector. Ministry of Law, Justice, Human Rights and Parliamentary Affairs (MOL) partnered with the Ministry of Women Development to implement the national GRAP. The number of women judges in different courts nearly doubled between 2001 and 2007. Greater awareness of the rights of women and human rights was incorporated into police training programs. As a result, the project which had a gender classification of GEN, also received a gender rating of successful.
55. Decentralization Support Program (DSP) (2002). The objectives of the DSP were to improve local government representation, and efficiency, leading to improved service delivery through fiscal support for reforms in policy, legal, technical, and fiscal domains. The DSP supported the government’s reforms aimed at re-engineering the role of federal, provincial, and local government. It supported political decentralization by helping to create a third tier of government comprising democratically elected councils at district, tehsil, and union council levels, and supported devolution of power for local development and service delivery through these local councils. The DSP consisted of four loans totaling $300 million, to expedite poverty reduction, and improve governance in Pakistan. It was designed to finance the medium-term costs of implementing fiscal decentralization, and to develop capacity in priority areas including gender reforms. Signaling the importance of equity in decentralization, one of the key reforms was reservation of one-third of the seats in local councils for women representatives.
56. The DSP was ambitious but seized a policy opportunity that emerged with the installation of a new government in 1999 seeking to establish a record of good governance. The reform agenda was structured around three policy outcomes (i) improved federal support for decentralization including gender and social development reforms, (ii) effective and sustainable province–local intergovernmental relations, and (iii) strengthened local government institutions managing resources accountably and equitably. Two TA loans, totaling $30 million, were approved to support capacity development of federal agencies, provincial agencies, and local governments to strengthen planning, financial management, procurement, and auditing. The first TA (1937) was for the DSP, the second (1938) was for the GRAP. Both TAs were underutilized, and only 1.8% of the second TA loan for GRAP support, was used.
57. The PCR rated the project highly relevant and highly effective. The ratings were scaled back in the PVR to relevant because of the ambitious nature of the program, and effective because of the lack of information on achievement of some of the program outputs in the program results framework. The PCR and PVR agreed on ratings of less efficient in achieving outputs and outcomes and in utilization of the TA provided, and sustainability as less likely. Borrower and ADB performance were deemed satisfactory. The overall assessment of successful by the PCR was downgraded to partly successful in the PVR. Despite the slow progress on utilization of the TA supporting the GRAPs, the success in meeting the 33% representation of women in local government representation led to a gender rating of successful. The program shows that even such a complex and ambitious governance reform program can include achievable gender goals if it pays enough attention to program design. Unfortunately, some of these gains were undermined by the political economy when the civilian government took over in 2008 and gave primary responsibility to provincial governments instead of local councils.
58. Sustainable Livelihoods in Barani Areas Project (SLBAP) (2004). The SLBAP was designed for the rainfed, agricultural regions in the Punjab which are often characterized by higher rates of poverty. In
13 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) addition to constraints on water for crops and livestock these areas also suffer from limited access to inputs and markets, electricity and drinking water, and few alternative sources of income. The SLBAP addressed these constraints by seeking to enhance water storage and conservation, improve access to inputs and markets, and diversify sources of income while at the same time overcoming fundamental barriers to development such as illiteracy. ADB approved $41 million for the project in 2004. The expected project’s objective was to enhance access to land, water, markets, services, agricultural inputs, technologies, and jobs for the people in the barani (rainfed) areas to increase income, improve quality of life, and ultimately, reduce poverty among vulnerable groups. The project included support for medium- scale infrastructure (MSI) identified by beneficiaries; targeted small-scale interventions for community mobilization, microcredit and off-farm employment for beneficiary or community groups; enhanced literacy program for poor women and girls through skills training; and institutional and implementation support.
59. The project was formulated within the context of the devolution of powers to local governments, focusing on the improvement of economic livelihood and quality of life of people in rural Punjab’s barani areas, and the PCR rated the project highly relevant. A number of design changes were necessary to overcome implementation constraints, including waiving the community contribution requirement, which was slowing the uptake of the MSI component, and the addition of more district level project management units for better management of the multisector interventions. For that reason, the PVR revised the rating downward to relevant. Decentralized project management was essential to ensure the success of this multisector project targeted at local communities in multiple districts. The PCR and PVR found the project to be effective and highly efficient. The project was completed at 72% of appraisal cost, with key targets for all components met. At completion, the overall project economic internal rate of return (EIRR) was estimated at 25.3%, higher than the appraisal estimate of 20%. A total 619 MSI schemes were undertaken, directly benefiting 858,654 beneficiaries. The MSI schemes were undertaken in 1,814 villages by 11,464 community organizations and/or village groups, exceeding the appraisal target of 1,800 community organizations. The key targets for the poverty alleviation component were surpassed with 8,918 community-based organizations (CBOs) formed (188% of appraisal target) with a total membership of 144,157 (112% of appraisal target). An average of 17 small-scale infrastructure (SSI) schemes were undertaken in each of the 206 unions, higher than the 10–12 SSI schemes in each of the 200 unions targeted at appraisal. The project was determined by the PCR and the PVR as being most likely sustainable. Borrower and ADB performance was found by the PCR to be highly successful and by the PVR to be successful.
60. In terms of gender outcomes, 13,868 women and girls (116% of appraisal target) completed a 6-month literacy and livelihood skills program. The final evaluation report found that female unemployment dropped from 79% to 36% after the training. The training was organized in a culturally sensitive manner and whetted women’s appetite for further education, 92% of those receiving training said they would like to obtain formal education. Women were the main beneficiaries of the microcredit scheme, although 77% of the borrowers said they were advised to take the loans by male members of their family who sometimes utilized the loans obtained. The majority of loans were used for livestock and dairy development, although some also used them for other businesses. With clear objectives, customized project design, and course corrections during implementation, the project achieved its gender objectives and the gender rating was successful.
61. National Highway Development Sector Investment Program (NHDSIP) (2005). The program consists of a project approved in 2005 for $180 million in ordinary capital resources (OCR) funds with an accompanying loan of SDR2,080,000 ($3 million equivalent) for institutional strengthening of the National Highway Authority (NHA). This was the first phase of an MFF with loans of up to $770 million for NHDSIP approved in December 2005. The findings are equally relevant to the National Trade Corridor Highway Investment Program (2014) being implemented by the NHA.
14 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
62. The NHDSIP had two objectives. The first was to improve transport efficiency by (i) adopting a national transport policy, (ii) strengthening NHA performance in managing the national highway network, (iii) improving road safety, and (iv) improving road maintenance and funding. The second was to increase private sector participation in road subsector investments by (i) increasing outsourcing of road works, and (ii) exploring opportunities for private operation of NHA assets and activities along its right-of-way.
63. The project was designed to reduce transport costs and travel times. An additional objective was to relieve congestion in urban and industrial areas. Three highway subprojects had originally been identified in Baluchistan and Punjab provinces involving construction and improvement of 366 kilometers of national highways. The contract for one subproject was dropped and coverage reduced to 166 km of highway and $56.7 million cancelled from the loan. Although there were modifications to the original plan, by loan closing all three highway subprojects were completed according to design specifications. Actual disbursements were $123,117,439 (68%) from the investment project with SDR435,425 (21%) from the institutional strengthening loan at the closing date.
64. The PCR concluded that the scope of the interventions under this project was relevant to NHA‘s needs, particularly development of the national transport policy, public private partnership projects, road maintenance planning, and road safety. Although the overall framework was agreed between ADB and the NHA, the components of the institutional strengthening project were designed without strong buy- in from the NHA, which subsequently amended the areas of focus.
65. The highway improvement project was rated as relevant, highly effective, efficient, and likely to be sustainable, with likely significant impact. The institutional strengthening project was rated as relevant, less effective, less efficient, and less likely to be sustainable, with modest impact. Despite the shortcomings in institutional strengthening the overall assessment of the combined project by the PCR was successful.
66. The project was classified as SGE. On gender impacts, the PCR states that “The project did not envisage any substantial impacts on gender. The PCR mission did not find any specific gender impacts that could be attributed to the project” (p.13).
67. Interviews with the NHA confirmed that NHA is taking the CPS recommendation to develop gender-responsive resettlement and land acquisition plans seriously but that considerations of gender are limited exclusively to the safeguard policy. The safeguards team in NHA has been strengthened by adding a gender specialist on its staff, in addition to having a female as deputy director of the safeguards team. The NHA team was under the impression that compliance with ADB’s safeguard policy was the sole requirement on gender and that by strengthening their capacity to implement safeguards they were in full compliance with ADB’s expectations on gender too. There was no evidence or even awareness of the CPS recommendation to develop gender-sensitive roadside facilities. And no thought had been given to any other activities that could be integrated within highways projects to increase their gender impact.
68. Sindh Coastal Community Development Project (SCCDP) (2007). The SCCDP aims to improve the economy and livelihoods of rural communities residing in the highly fragile and rapidly changing ecosystem of the coastal areas of the Indus delta. The intended project impact was a reduction in poverty for households in Sindh Province. The outcomes designed included improved, ecologically sustainable income opportunities and access to services for poor residents in the eight coastal talukas (subdistricts) of Thatta and Badin districts with a population of 1.2 million. Besides institutional capacity building and project management, the main components are community development and improved coastal management. The project was the last ADB-funded community development project in Pakistan before they were discontinued by the CPS, 2009–2013.
15 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
69. The project outcomes were highly relevant to the government’s agenda of poverty reduction in coastal areas and its integrated coastal zone management strategy. The project brought coastal development into the mainstream of the Sindh development agenda. The project adopted lessons from previous similar projects: (i) a project needs to be simple to be effective, (ii) should use institutions with built-in capacity, (iii) adopt a demand-driven approach to community development, and (iv) balance civil works construction with effective social mobilization. The Sindh Coastal Development Authority was the executing agency but implementation of social mobilization and the SSI schemes was contracted out to the National Rural Support Programme (NRSP), an NGO with proven implementation capacity.
70. The project was highly effective in achieving the appraised results, including: (i) increase in participant household incomes of 7% per year; (ii) increase of 40% in household access to drinking water, high platform for safety against floods, and roads; and (iii) implementation by CBOs of sustainable management plans for natural resource areas under their control. The project was highly efficient. The project was completed on schedule, surpassed the appraisal targets for all key components, and was completed for 83% of the projected cost at appraisal. The subprojects were pro-poor. The overall project EIRR was 22.3%, compared to the appraisal estimate of 16%. The higher rate of return was mainly due to the implementation cost being lower and the outputs higher than expected. The project is most likely sustainable. All 1,291 small-scale schemes were executed and maintained by CBOs. All 168 MSI schemes were operated and maintained by the district governments and municipal administrations. All the community organizations and apex structures established under the project qualify for assistance from NRSP, district governments, and other funding agencies. The operations and maintenance for mangrove plantations has been added to the recurrent budget of Sindh Forest Department (SFD), which will work with local communities. The PCR rated the project’s overall performance as highly successful. The project has not been validated but the evidence suggests that its outcome rating is justified.
71. The gender strategy provided in the design and GAP developed during implementation worked as an effective tool to achieve GAD results. The gender issues were addressed through increased representation of women and targeted interventions such as the establishment of women’s CBOs, training, physical infrastructure schemes with primary GAD objectives, and access to microfinance and markets. Participation of women in community organizations grew from 26% to 46%, and 56% of the microcredit loan beneficiaries were women.
72. Punjab Millennium Development Goals Program (PMDGP) (2008–2010), Subprograms 1 and 2. The PMDGP was approved in 2008 and envisaged as a $500 million three-tranche program from the Asian Development Fund (ADF). The program’s objective was to improve access to quality health services and make them more equitable, and the program was classified as GEN. The expected impact was to help the government achieve MDG 4 (reduction of the infant mortality rate [IMR] from 77 to 40 per 1,000 live births) and MDG 5 (reduction of the maternal mortality ratio [MMR] from 300 to 140 per 100,000 live births) in Punjab Province. The program was expected to improve availability and quality of primary and secondary health services, and achieve better management of health service delivery, and sustainable pro-poor healthcare financing. ADB released the first tranche of $100 million in January 2009 for Subprogram 1 and $150 million in June 2010 for Subprogram 2. The third tranche of $250 million was not released, in part because the International Monetary Fund (IMF) program was off track. However, ADB did not disburse any of the TA funds approved for the program.
73. The program’s objectives of achieving better management of health service delivery and sustainable pro-poor healthcare financing were not achieved. Although ADB disbursed $250 million (PRs20.5 billion) in two tranches from ADF resources, funds were not transferred to the district level in a timely manner, nor were the funds that were provided utilized efficiently. In 5 years (FY2009–FY2013) only PRs12.8 billion was transferred to 36 districts and only 30% of the funds transferred to the district governments for use as conditional grants, could be utilized by them. The unutilized amount was returned to the finance department. The executing agency was the Health Department of Punjab Province but the implementing arrangements involving multiple institutions at different levels proved to be
16 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) inadequate for the complex program design. The PCR was not available when the 2013 CAPE was prepared, and it provisionally concluded that the PMDGP generally improved minimal service delivery standards, despite little progress against health indicators. The PCR and the PVR rated the program less than relevant. The program was under-resourced, needed more time, and management resources for implementation. The program’s implementation arrangements were inadequate to achieve the program’s expected results on sustainability of pro-poor health care financing and on improving the availability and quality of primary and secondary health services. Although the budget allocation for healthcare in Punjab doubled from PRs38.5 billion to PRs79.6 billion, most of the increased funding went to tertiary care rather than primary or secondary care.
74. In 2007, ADB approved $900,000 for a project preparatory TA with GEN objectives (TA 7004- PAK) mapped to public sector governance. The TA was designed to support the formulation of the proposed PMDGP and AJP clusters through policy dialogue, diagnostic assessments, and stakeholder consultations. The projects were to Focus on improving service delivery through enhanced public financial management, public administration and sustainable sector financing. The TA was officially closed in 2010 but neither the project data sheet nor the PCR is available indicating that even the project preparatory TA was not utilized.
75. The program was rated ineffective, efficient, and less than likely sustainable. Inadequate attention to program and institutional design, absence of TA for implementation support, lack of attention to monitoring results combined to provide for failure. Both borrower and ADB performance were rated less than satisfactory. Although the program’s original objectives justified its GEN category, its inability to delivery results led to a gender rating of not successful. The main shortcomings were in the lack of rigor in the risk assessment and mitigation measures, underestimation of design complexity and institutional capacity, absence of structured TA to support such a complex program, and inadequate assessment of the policies and ownership of the reform program.
76. Earthquake-Displaced People Livelihood Assistance Restoration Program (2007). This $400 million program was the second ADB loan for earthquake reconstruction and rehabilitation in Pakistan following the devastation caused by the October 2005 earthquake. The concessional emergency assistance loan was to finance the ERRA Housing Program for the reconstruction of houses in earthquake- affected areas. This was a follow-up to an Earthquake Emergency Assistance Project27 financed in 2005, shortly after the earthquake, by a $385 million special assistance loan from ADB, primarily for reconstruction of roads and other community infrastructure. That project was categorized as an EGM project. Although the project was deemed to be successful, its gender rating was unsuccessful. The new project was expected to be more responsive to gender equality and was categorized as a GEN project.
77. Under the new project, rural housing was to be provided to some 30,000 people who were living in tents, and to 3.5 million more living in temporary or semi-permanent shelters. The intended impact of the program was the restoration and improvement of the livelihood of the earthquake-displaced people in Azad Jammu and Kashmir (AJK), as well as the North-West Frontier Province (NWFP, since renamed as the Khyber Pakhtunkhwa province). The loan proceeds were designed to flow to the government’s central budget with the government contributing funds to ERRA through the budget allocation process. ERRA adopted an owner-driven implementation approach, which required providing money to many individual households for procuring needed materials and for building their own houses based on seismically compliant housing designs provided by ERRA. An accompanying TA—Capacity Building of Institutions Related to Earthquake Reconstruction and Rehabilitation—was financed to support capacity building of ERRA and other related institutions in seismic training, financial and strategic management, and environmental and social protection.
27 The 2005 project was rated successful by the PCR and the PVR, although the 2013 CAPE reported that poor management and cumbersome procedures contributed to significant delays in the project.
17 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
78. The intended outcome was for most affected people to be living in seismically compliant houses with greater safety and security. By the end of 2010, the program expected (i) at least 85% of the 3.5 million affected people have moved into seismically compliant houses; and (ii) of the people who have moved into seismically compliant houses, more than 23% of the households in NWFP and 31% in AJK will be headed by women. The performance indicators were that at least 85% of 585,000 houses would be rebuilt and seismically compliant by June 2010, and that at least 50,000 additional house owners would have been trained by May 2008, including women and other vulnerable groups. The program was expected to support several activities to benefit women elaborated in a Gender and Vulnerability Action Plan (GVAP). The ADB program financing had a tight time frame and was to be completed by May 2008, while the TA was expected to continue until 2010 but was closed even later, in June 2011.
79. ERRA paid housing subsidies to the targeted affected people based on the extent of damage caused to houses to enable individual households to carry out housing reconstruction based on standards and designs specified by ERRA. ERRA is reported to have provided training to 783,314 people in seismically compliant construction, part of it supported by an ADB-supported TA project designed to finance community-based training on seismically compliant construction by beneficiaries, as well as build institutional capacity for financial management, and environmental and social protection through compliance with ADB’s environmental and social safeguards and use of environmental audits.
80. The rapid scale-up of a bottom-up housing program made it very difficult for ERRA to achieve the program’s gender objectives and targets. Although ERRA used the services of national and international NGOs to augment its training of a cadre of skilled individuals in earthquake-affected areas, the PCR states that by the time the project was completed in June 2011, TA utilization and results in terms of outputs and outcomes were well below the expectations and performance indicators specified at appraisal:
The PCR reports that the TA project was used to strengthen ERRA’s financial management capacity; financing of training by NGOs in 18 union councils of KP and AJK in seismically- compliant building design; establishing a monitoring and evaluation (M&E) system at ERRA; undertaking a targeted vulnerability survey; and strengthening environmental and social capacity in earthquake-affected areas. Notwithstanding comments to the contrary by the project team, the TA completion report clearly acknowledges that only $220,271.04 (11%) of the $2 million approved for the TA-4943 (PAK) in June 2007 was utilized even though the closing date of the TA was extended to 2011. The TA completion report does not specify how much of the planned activities were achieved. But with only 11% of the planned budget utilized, the TA could not have provided the coverage it was designed to. One of the activities reported to have been financed by the TA was a targeted household survey by ERRA with sex-disaggregated data in all earthquake-affected areas. As per GVAP, the survey was to be carried out at least twice a year and released to relevant stakeholders but it was carried out only once in November 2007. Women were to have 10% representation in senior management positions in ERRA and 20% representation in technical positions ERRA and the two counterpart agencies in AJK and Khyber Pakhtunkhwa (KP). The PCR reported that there was minimal representation at senior management level and technical positions in ERRA, with 12% representation in SERRA and 8% in PERRA at the end of the project. Instead of 85% of 3.5 million people, only 1.46 million people (50% of the 2.91 million in the reduced ERRA program) had moved into seismically compliant houses; Of the 319,304 houses reconstructed, 55,000 (16%) were female-headed households with 21,388 homes (7% compared to the target of 23%) in KP and 33,612 (11% compared to the target of 31%) in AJK.
81. The program objective was highly relevant but the design suffered from an overestimation of capacity and underestimation of the time and effort needed to implement such a large-scale program
18 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) using new construction standards. Relevance of design, and the overall rating was therefore assessed by the PCR and the PVR as relevant. On the positive side, the owner-driven approach has fostered self- confidence and self-reliance of the communities that participated in the program. Most people in the earthquake-affected regions now have access to and knowledge of the formal banking system, as a result of their having opened more than 600,000 bank accounts to receive subsidies from the program. Villages are now more familiar with community-based approaches to address their needs. The PCR states that housing training was completed as planned on 31 May 2008, with 786,314 beneficiaries trained in seismic-resistant construction techniques and social organization. Over 55,000 households with female heads (owning 16% of all houses reconstructed by ERRA) now have land titles, own houses, and enjoy higher status in their communities. An ADB case study28 of gender outcomes claims that over 20,000 women received training in housing reconstruction. However, not enough attention was given to outcome and impact monitoring, a key implementation activity that was to be supported by the TA project. While the PVR concurred with the completion report’s overall rating of successful, it modified some of the other ratings: the program was rated as less than effective, efficient and likely sustainable, with an overall impact rating of significant and ADB performance as less than satisfactory.
82. The gender rating of the program was assessed by ADB as being successful. However, during the country mission, the client29 attributed work on gender equality at ERRA primarily to the gender equality TA provided by CIDA who took the lead on gender and helped ERRA develop a gender policy for earthquake affected areas. In addition, the client identified the Pakistan Poverty Alleviation Fund (PPAF, an agency created and financed by the World Bank) as the lead agency providing skills training for women in many sectors. The project team has clarified that ADB led activities in education, health, power and road. Many thematic activities like gender, safeguards, financial management, and M&E were led by other development agencies, but financing to implement even the thematic work (including gender) came from multiple sources. The PCR does not acknowledge the primary role of other development partners in the gender activities within ERRA’s program.
83. The assessment team visited field sites and conducted interviews and FGDs with beneficiaries (Box 1) and staff of implementing partners to obtain direct feedback from earthquake-affected areas. The fieldwork revealed that although most public facilities (schools, water supply systems, rural roads, health centers) have been reconstructed, and most people provided with some assistance to reconstruct their homes, the training programs imparting construction skills were not offered to women in any of the 12 locations visited in the two districts, Bagh and Malakand, which were selected in consultation with the project team and where the NGOs contracted by ADB were to deliver training. Livelihood programs and related training by NGOs were made available to slightly less than 20% of households among the beneficiaries interviewed. Although the program envisaged training women in housing reconstruction, the evaluation team was informed by the beneficiaries that it was the men of the household who went to receive the training. At least based on the findings from the sample locations in Bagh and Malakand districts, we found no evidence for the claim that over 200,000 women have been trained in construction skills.
28 https://www.adb.org/results/pakistan-women-step-after-earthquake-2012 29 Interview with Lt. Gen. Nadeem, former Deputy Chairman and Chief Operating Officer, ERRA and Director General of the National Disaster Management Authority.
19 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
Box 1. Findings on Earthquake-Displaced Livelihood Restoration Program
Six focus group discussions (FGDs) each were conducted in Bagh district (Azad Jammu and Kashmir) and Mansehra district (Khyber Pakhtunkhwa), two of the nine districts most affected by the earthquake, with most housing, infrastructure, and services destroyed:
FGDs in Bagh district: Houses of 84% of FGD participants were destroyed completely, 14% destroyed partially 16% lost members of immediate family; 20% lost livestock In three of six locations majority of women suffered personal injuries from the earthquake Roads, water supply schemes, schools, and health centers were destroyed or badly damaged Training in house reconstruction was provided to men only; women were not invited Women worked with men in reconstructing their homes but decisions on construction design were taken mainly by men Most households received full payment (all installments) for reconstruction of homes, except for those whose houses were partly destroyed Most damaged schools and dispensaries were reconstructed to higher standards by ERRA Roads rebuilt by city or local government, and water supply schemes by nongovernmental organizations (NGOs) or World Bank Skills training and inputs for livelihoods provided in two locations; training only in one
FGDs in Mansehra district: Almost all the women were affected by the earthquake; 20% have been relocated to other villages and tehsils of Mansehra and 29% are still living in shelters/ incomplete or rented houses Houses of 78% of FGD participants were destroyed completely, 19% destroyed partially 23% had casualties in the form of deaths, 77% suffered major injuries and disabilities 64% of the livestock were killed in the earthquake Most of the public infrastructure, schools, roads, hospitals, water source, mosques, and government buildings were completely destroyed 48% reported household male (but no women) received training in house reconstruction, and 28% reported construction of seismic compliant homes 36% of households received three checks for reconstruction (but not the fourth) Schools, roads, and water supply schemes reconstructed by ERRA, NGO, and a philanthropist Health facilities are still lacking in most locations; patients have to go to Mansehra Participants did not recall any government assistance for livelihoods; a few reported NGO assistance for livestock, kitchen gardening, etc. and asked for more systematic support
Source: Focus group discussions conducted by Asian Development Bank, Independent Evaluation Department in Bagh district (Azad Jammu and Kashmir) and Mansehra district (Khyber Pakhtunkhwa province).
84. There are two major deficiencies in ADB’s reporting of results. First, ADB reports on the entire performance of ERRA without acknowledging the fact that ERRA received parallel financing of $638 million from the World Bank, in addition to support from the UN and many other development partners. The largest NGO providing training to local communities (National Rural Support Programme) was financed entirely by World Bank, which also financed housing reconstruction. The attribution of results to ADB’s Earthquake-Displaced People Livelihood Restoration Program alone is therefore extremely problematic and should be qualified.
85. Second, the PCR acknowledges that gender results are considerably below appraisal estimates. Although the GVAP was prepared as a compliance mechanism, implementation was not systematically addressed during ADB review missions.30 The PCR acknowledges that the covenants pertaining to the
30 Ouellette, C. and Ummar, F. 2009. Making a Difference: Promoting Gender Equality in Pakistan’s Response to the 2005 Earthquake. Islamabad.
20 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
GVAP were only partially complied with. Even so, several of the claims reported in the PCR could not be substantiated during the fieldwork:
The GVAP for the program envisaged that all new houses would be registered under both the wife’s name and the husband’s. This has not been done. Only 55,000 new houses belonging to female-headed households were registered in their names. Women were to have 50% representation in all Village Reconstruction Committees but women participated only in 29% of the committees. Of the 5,595 committees formed, 22% were women only and 7% were mixed. Women were to compose 50% of the participants trained in housing reconstruction. The PCR claims that 200,000 women (28% of trainees) received such training. The evaluation team could not find a single woman who received such training in any of the 12 FGD locations where fieldwork was undertaken. FGD participants said training was provided to males only. Women were to compose 50% of the participants in nontraditional skills training. The PCR reported that 200,000 women (27% of trainees) participated in such training. In Mansehra district, none of the FGD participants had received any skills training. In Bagh district (AJK) some participants from three of six FGDs received skills training but inputs (livestock, gardening kits, etc.) to use the skills were provided in only two villages, so training was utilized only in those two locations. While the fieldwork sample size is small, it was unable to validate these training achievements and there was little evidence that the training had been utilized effectively.
86. Based on the findings from in-country fieldwork and the feedback from beneficiaries, implementing agency staff, and development partners, this assessment concludes that the program has been overrated both in the PCR and the PVR, in terms of achievement of its gender objectives. The PCR states that the obligations in the loan agreement on the GVAP were partially complied with, and the PVR rates the project as less than effective. This evaluation concludes that the program is rated high on relevance of objectives; substantial on relevance of design; substantial on responsiveness to country and beneficiary needs; moderate on gender results; and moderate on ADB performance in promoting gender outcomes especially because of the absence of any acknowledgment of the very substantial contribution of other development partners, and the lack of follow-up on the GVAP during implementation.
87. Social Protection Development Project (SPDP) (2013). The $430 million project supports the Government of Pakistan's national social safety net program, the BISP.31 The project was approved to enable the expansion of the unconditional cash transfer (UCT) program (paid to the female head of targeted poor families) by registering an additional 2.4 million eligible families and financing the first 5 quarters of their cash transfers from a base of 4.5 million women. In addition, it committed to support the strengthening and phased expansion of the pilot health insurance and skills development programs to increase income and good health for targeted families. The project intended to provide TA and finance part of the scaling-up costs of both programs. The substantial fiduciary risk of the project was to be mitigated through the strengthening of BISP financial management systems and capacity.
88. The UCT program design has evolved with substantial TA from the World Bank and DFID since it was first launched in 2008. While initially beneficiaries were identified by parliamentarians that has been replaced by beneficiaries identified by a national Socioeconomic Survey (SES) conducted in 2010 which uses a proxy means-tested approach. The SES identified 7.2 million households (23% of the total population) under a predetermined threshold in the Poverty Scorecard eligible for the social safety net. Cash transfers are released quarterly to the female head of eligible households.32 To minimize leakage, BISP beneficiaries have to be in possession of a computerized national identity card (CNIC). The payment
31 ADB has also provided initial assistance through Accelerating Economic Transformation Program (AETP, 2008–2009) which earmarked $150 million (15% of AETP) for social protection. The AETP was unsuccessful although some of the social protection outputs were reported as achieved. 32 The original cash transfer was Rs 1,000 per month (about $30 per quarter) and has been increased gradually to $47 per quarter. Eligibility is limited to households that fall within the range of 0–16.17 on the Poverty Scorecard.
21 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) modality has also evolved from initial transfers made through the post office to payments made through debit cards issued to eligible women for withdrawals at ATMs. A by-product of the program has been an increase in the number of women who have legal status through the CNIC, have access to disposable incomes, and have greater possibility of using formal banking systems.
89. Of the 7.2 million people who met BISP’s eligibility criteria for the cash transfer, 2.4 million eligible poor households were not receiving the cash transfer because the female head did not possess a CNIC. The ADB project targeted this 2.4 million, in addition to supporting a health insurance and a skills development component. The financial closing date of the project is June 2019. To meet this target date, all new UCT beneficiaries would have to be enrolled by December 2017, so that their cash transfers can be disbursed before the closing date. ADB and BISP had agreed that any beneficiary enrolled after 1 July 2013 would receive five installments from ADB project funds.
90. The two other components included in the ADB project were financing and scale-up of BISP’s Waseela-e-Sehat health insurance scheme; and the Waseela-e-Rozgar training program. A project preparation TA of $0.875 million was approved in 2013. Its major outputs included review of BISP’s health insurance scheme and BISP’s vocational training and skills development projects to prepare the operational designs of the conditional cash transfer (CCT) program for health and an alternate vocational training program. The project included ambitious targets to increase enrollment in the health insurance scheme from 37,525 in 2013, to 786,423 in 2018, and increase beneficiaries trained from 56,600 in 2013, to 577,294 in 2018, of which at least 50% were to be women. The main targets in the GAP included payment of regular quarterly cash transfers to all eligible BISP women; 95% of eligible beneficiaries (2.4 million new beneficiaries) have CNICs by 2018 (baseline is 70%) with debit cards issued to all new registered women; health insurance cards issued to all BISP women (577,294) in 16 districts by 2018; and courses designed to provide skills training through a community level delivery approach which can be used by women for a broad range of local income earning activities.
91. In November 2015, both the health insurance scheme and the skills development program were discontinued by the BISP Board of Directors which did not feel the programs were viable or in keeping with BISP’s comparative advantage. While this cancellation could not have been anticipated at appraisal, and there may have been political economy pressures from competing interests at play, clearly the 2013 TA did not lead to a design that was credible enough to achieve ownership of these programs by the BISP Board of Directors. ADB has no choice but to restructure the project and is attempting to develop an alternative program design for ultra-poor BISP beneficiaries. At the time of this evaluation the alternative design was still in early stages of discussion.
92. The mission held several meetings with BISP personnel, including the chairperson, board members, and senior managers to obtain updates on the BISP program and feedback on ADB’s support. By August 2016, $121.92 million (30% of the loan amount) had been utilized and 162,000 beneficiaries provided cash transfers with ADB funds (BISP Director General, cash transfers, and M&E). This is far below the expectation of 2.4 million new beneficiaries to the program, suggesting that scaling up the UCT program remains a challenge.
93. Meetings with BISP staff revealed that BISP receives substantial technical support from the World Bank and DFID for the UCT and for a CCT program for schooling children. USAID has provided financing to pay for Aurat Foundation, an NGO, to undertake a program of social mobilization in 32 districts to organize local beneficiaries into BISP Beneficiary Committees (BBC), and monitoring of school attendance by the children of CCT beneficiaries. Over 50,000 BBCs had been established in 30 months by the social mobilization program, and they served as a forum for information exchange among beneficiaries and with BISP regional offices. TA from other development partners included support for program and institutional design, the design of the 2010 and the 2016 SES, strengthening BISP’s monitoring and evaluation capability and the program’s results framework, and financing of an external impact
22 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) evaluation to assess results. The World Bank and DFID support the program with a shared set of DLIs, and conduct joint supervision missions, adopting the discipline of a results-based approach.
94. While other development partners have clearly collaborated with each other in supporting BISP, ADB has functioned in isolation. ADB is thus benefiting from the TA provided by others without acknowledging their roles and without making any substantive contribution to the design of their TA. Nor has ADB set up any independent mechanism to monitor results.
95. The FGDs shed light on several implementation challenges (Box 2), including inaccuracies in the SES, ease and cost of accessing funds through the ATMs, as well as the benefits of the CCTs, and the value of social mobilization. Beneficiary feedback from the FGDs revealed that there were significant errors of exclusion (deserving women being left out) and inclusion (of undeserving women) in the 2010 round of the 2010 socioeconomic survey from which BISP’s beneficiary base is derived. A new round of survey is scheduled to take place in mid-2016. But ADB appears to have no role in the design of the new survey either. Nor does ADB participate in joint supervision missions or meetings among other development partners.
96. Although the Social Protection Development Project and its accompanying TA are still ongoing, ADB’s role can be assessed against the institution building aspects and results achieved to date. Relevance of objectives was high. Somewhat in contrast, relevance of design is moderate. ADB’s appraisal design was clearly off the mark. ADB’s project design targeted what it saw as low-hanging fruit by scaling up the UCT program developed by other partners but it overestimated BISP’s ability to scale up the program. ADB also prematurely committed to include BISP’s health insurance and skills training components which were at an incipient stage. Responsiveness is low. Apart from the financial tranche, ADB has not made any substantive contribution to the design of Pakistan’s social safety net program. Nor has ADB been able to provide the TA that BISP needed to develop credible technical designs for health and skills training, and both programs have been discontinued. Gender results to date are far behind the pace needed to achieve end-of-project targets and are rated moderate. The limited results to date are because ADB has essentially benefited from the UCT design and the survey and monitoring systems put in place by other development partners. To date, ADB’s performance is clearly deficient and is rated low. Ironically, a program which other donors consider their most successful flagship project in Pakistan, is floundering under ADB aegis due to insufficient attention to implementation design and the quality of ADB’s technical support, and ADB’s inability to enter into a collaborative partnership with other donors who are financing BISP.
23 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
Box 2. Findings on Social Protection Development Project
Six focus group discussions (FGDs) each were conducted in Bagh district (Azad Jammu and Kashmir) and Mansehra district (Khyber Pakhtunkhwa), three in small towns and nine in rural settlements. Participants were 51 from Bagh and 64 from Mansehra districts. All of them were receiving unconditional cash transfers (UCT) from Benazir Income Support Program (BISP), while 73% from Bagh and 67% from Mansehra were also receiving conditional cash transfers (CCT) for school going children.
FGDs in Bagh district: The majority (73%) felt the 2010 survey was accurate, while 27% said it had errors 84% feel that most BISP beneficiaries deserve the cash transfers but 71% feel some deserving women (including female-headed households and widows) are excluded from BISP benefits Most beneficiaries receive quarterly cash transfers regularly, but when debit cards are blocked or captured by the ATM there are long delays in receiving replacement cards All participants receive cash transfers via debit cards but only 7 of 51 are able to use the ATMs themselves; 80% depend on family members to withdraw cash 84% incur higher transportation costs to reach ATMs but 73% said ATM was better than postal service where staff extorted bribes and sometimes did not release payments Most participants use cash transfers for food purchase and children’s education; a few saved money to start home-based business selling poultry, eggs, and milk Participants feel the BISP Beneficiary Committee (BBC) is an important platform for information sharing and networking where they learn about BISP programs and other development initiatives; they were concerned that nongovernmental organization (NGO) support for these committees was being discontinued
FGDs in Mansehra district: Most FGD participants reported the surveyor did the survey sitting in the house of influential or community center; only 33% of participants said the survey was conducted in their homes Over 30% of deserving families headed by women/widows are excluded from the program either because they were left out of the survey or deemed ineligible to receive cash transfers 10% of beneficiaries are from households that should have been ineligible as their men are migrant workers in the Middle East or in the army The UCT is received regularly by beneficiaries but only 40% of entitled beneficiaries are receiving the education CCT regularly The majority prefer payment through debit cards at ATMs or through Ufone; one-fifth said the post office was more accessible even though they had to pay Rs 50–200 to postal workers 55% women go to the ATM/Ufone themselves but 91% seek help from staff and pay a fee to withdraw funds from their account; 45% rely on males of their household for withdrawals 75% of cash transfer is used for groceries, children’s expenses, or loan repayments; 20% used for health expenses; only 5% for income-generating activities Social networking is the main benefit of BBC; 50% feel the BBC helps them gain more knowledge about BISP programs; only 20% visit the BISP office personally
Source: Focus group discussions conducted by Asian Development Bank, Independent Evaluation Department in Bagh district (Azad Jammu and Kashmir) and Mansehra district (Khyber Pakhtunkhwa province).
V. Overall Findings and Recommendations
A. Relevance
97. ADB’s country strategy has evolved from a more diverse range of sector interventions to a stronger focus on the energy, transport, and infrastructure sectors, with one major intervention in social protection under public sector management. Most of these sectors are typically not considered suitable to promote gender equality, the assumption being that such infrastructure development will equally benefit men and women. ADB’s strategy in the early 2000s was highly relevant in terms of targeting
24 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) gender equality through more ambitious institution building programs—e.g., the Access to Justice Program, and the Decentralization Support Program. Those were high risk, high reward programs, and even those that were deemed partly successful in achieving their development objective, were successful in achieving gender outcomes.
98. Under CPS, 2004–2006, ADB financed creative community-based rural development interventions—the Sustainable Livelihoods in Barani Areas Project (SLBAP) and the Sindh Coastal Community Development Project (SCCDP)—that were also successful in mobilizing women to participate in development activities and in economically empowering them. Both sets of programs benefited from detailed attention to program design and relatively ambitious gender objectives. Interviews with implementing partners and ADB country office staff confirmed that both community development projects (SLBAP and SCCDP) were far more effective in achieving gender outcomes than most of the other ADB programs concurrently in the portfolio. Two noteworthy impacts were identified during the interviews at NRSP. First, in order to achieve their gender targets the institutional design needed to be modified to allow female extension workers to reach remote coastal communities. With that adaptation the gender targeting in SCCDP proved to be so successful that NRSP has learned from that approach and scaled it up in its programs in other districts. Second, although the ADB project has ended, the beneficiary communities of the SCCDP are continuing to be supported by the NRSP with its own resources, further enhancing the sustainability of the community-based interventions in that fragile environment.
99. Relevance of objectives in CPS, 2004–2006 was thus matched by relevance of design. On the other hand, the Gender Reform Program, which led to the formulation of GRAPs by the federal and provincial governments lacked ownership and yielded less successful results. Even the modest target of 5% females in all public sector employment has been difficult to achieve.
100. With the new CPS, 2009–2013 and CPS, 2015–2019, ADB’s leverage in promoting gender equity has been reduced further by its withdrawal from the education and health sectors. The social protection program remains most relevant to gender but with the exception of urban transport projects whose results are not yet available, there is little evidence of serious attempts to mainstream gender in the infrastructure portfolio.
101. ADB’s strategy commits the Bank to a target of 45% GEM projects among new approvals. ADB has exceeded this target in the Asia Pacific region (51% in ADB and 57% ADF projects), but Pakistan’s portfolio has lagged behind the regional target. During the evaluation period (2005–2015), of the 66 ADB projects approved for Pakistan, only 29% had GEM objectives. After 2009, ADB moved away from targeted gender equity programs and expanded its infrastructure portfolio which was even less likely to have GEM objectives. With the exception of water, most of these projects had little gender content and were classified as SGE or NGE. In recent years, the gap has grown even wider and only 20% of projects approved in 2010–2015 had GEM objectives (Appendix 2, Table 2.5).
102. The relevance of design of ADB’s assistance program was also affected by the choice of lending modality, which evolved from project lending to program lending. ADB supported the Earthquake Emergency Assistance Program (2005), the Earthquake-Displaced Livelihoods Restoration Program (2007), and the Punjab MDGs Program (2008) by financing part of the government’s budget. These national programs had relevant gender objectives but the programs suffered from flawed designs that allowed disbursements without clearly identified performance criteria, and excessive dependence on implementing agencies who were less interested in the TA needed to build their institutional capacity. ADB was completely dependent on self-reporting by implementing agencies and did not institute third party monitoring to verify results. ADB’s inability to develop partnerships with other development partners who were working with the same agencies reduced its leverage and resulted in less relevant design than should have been possible.
25 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
B. Responsiveness
103. ADB’s lukewarm responsiveness to the gender challenges facing Pakistan declined further over the evaluation period. From being at the cutting edge of efforts to support gender equality, ADB has become even narrower in the strategic objectives it supports, and more inhibited in providing analytical and technical advice to its clients on gender responsive program design. During 2010–2015 (i.e., after CPS, 2009–2013 was finalized), ADB approved 30 new lending operations of which 60% (10 energy and 8 transport) were for hard sectors, which typically have very few GEM projects. PSM (including social protection), and agricultural and natural resources had five projects each, with one each in health and water and urban projects (Appendix 2, Table 2.6). Of these 30 operations, only 20% had GEM objectives (4 GEN and 2 EGM) (Appendix 2, Table 2.5). In contrast, the 36 projects approved during 2005–2009 had a lower share of transport (8) and energy (5) projects (36%). Of even greater relevance, 36% of the projects approved during 2005–2009 were GEM projects (7 GEN and 6 EGM), demonstrating a somewhat higher commitment to promote gender equality.
104. The 2013–2014 CGA was a useful attempt to bring ADB back as an intellectual leader in the gender debate. The collaborative effort to produce the CGA had promise but that has not been matched by donor coordination at the operational level. The analytical insights of the CGA by themselves cannot ensure responsiveness in operations without more substantial engagement with other development partners who are working in the same sector with the same agencies. ADB needs to take a hard look at its current strategy of isolationism and competitiveness, particularly when it supports national programs which other development partners are also interested in, and where the results of ADB financing depend in part on the contributions of other partners. TA needs to be coordinated to ensure more effective donor coordination and synergies and to ensure more credible monitoring and attribution of results.
105. In recent projects, the rhetoric in ADB’s appraisal documents sounds more grandiose than the effort it is putting in to achieve these lofty objectives. ADB’s contribution to project design is inadequate and depends heavily, without giving due credit, on designs initiated by the government or assistance from other development partners. This evaluation found that contrary to the CPS commitment of making transport more sensitive and responsive to the needs of females, the capacity building at the NHA has been limited to gender sensitivity in safeguard implementation. Constraints on female mobility are a huge obstacle to their participation in the labor market. The ring-fencing of gender within the confines of the safeguard policy misses the point about designing the transport network in a manner that makes it safe and practical for women to use public or private transportation services.
106. Finally, ADB has underinvested in M&E and, even though it is not cofinancing programs with other donors, has not put in place any mechanism to track its results as distinct from those of other donors. Nor has ADB adopted third party monitoring for independent feedback on program performance.
107. As a whole, during the review period the country program remains one that is less than responsive to the gender challenges facing the country. Despite the higher level commitments in the CPS and the effort made in undertaking the CGA, to the extent that this evaluation has been able to detect any change, the responsiveness of ADB’s assistance program has deteriorated over the evaluation period.
C. Results
108. Among the 11 projects approved in 2005–2015 that have gender ratings, only two were listed as successful on gender: the Sindh Coastal Community Development Project (ANR) and the Earthquake- Displaced People Livelihood Restoration Program (FIN) (Appendix 2, Table 2.7). Both were also deemed to be successful overall. Interviews with implementing partners and ADB country office staff confirmed that both community development projects were far more effective in achieving gender outcomes than most of the other ADB programs concurrently in the portfolio. Two noteworthy impacts were identified
26 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment) during the interviews at NRSP. First, in order to achieve their gender targets the institutional design needed to be modified to allow female extension workers to reach remote coastal communities. With that adaptation the gender targeting in SCCDP proved to be so successful that NRSP has learned from that approach and scaled it up in its programs in other districts. Second, although the ADB project has ended, the beneficiary communities of the SCCDP are continuing to be supported by the NRSP with its own resources, further enhancing the sustainability of the community-based interventions in that fragile environment.
109. The earthquake rehabilitation project was also substantially responsive, justifying the successful rating overall. However, like its predecessor the 2005 Emergency Earthquake Assistance Project (2005), its performance on gender equality objectives was moderate and merits a rating of not successful (Table 1).
110. To provide some comparison, the 2005–2015 cohort was compared with the cohort of projects approved between 1999-2010. Among the earlier cohort, 27 projects had gender ratings, out of which all of the 21 projects from education and hard sectors were unsuccessful in achieving gender outcomes, but 50% of the ANR and PSM portfolio approved was successful on gender (Appendix 2, Table 2.9). Due to the overlapping time period, the FIN earthquake rehabilitation project is also found in the earlier cohort. Excluding this FIN project from both cohorts, only 10% of the projects from 2005–2015 (the evaluation period) had successful gender outcomes, compared to 19% from the 1999–2010 cohort.
111. Of the 28 new TAs approved in 2010–2015, one was classified as GEN, while four were classified as EGM. The share of TA projects with gender equity and mainstreaming was 18% by number of TA projects and 29% by ADB financing for those TA projects. Even though the TA associated with a lending operation covers much more than support for gender equality, the total size of the TA is small and the attention given to gender by those TA is even smaller. This is further compounded by the fact that, as described earlier in the report, utilization of TA funds has been poor in most projects where it directly targeted gender equity objectives. The TA project (1938) for the Gender Reform Program, which was intended to support preparation and implementation of the federal and provincial GRAPs was only able to utilize 1.8% of the TA loan despite extension of the closing date, and GRAP implementation remained weak. Similarly, the TA supporting the Punjab MDGs Program was bot utilized. While the TA funds for the SPDP have been largely utilized, they have been misdirected at components that have been cancelled, and the deficiencies identified by this study have not yet been addressed.
112. Table 1 summarizes the findings from the projects assessed in greater detail by this assessment. Relevance in this table is assessed for projects at two levels: relevance of objectives, and relevance of design in relation to gender mainstreaming. All of these projects assessed were found have high or substantial relevance of objectives. But weaknesses in the technical or institutional design of many of these projects or programs lowered relevance of design, particularly among those approved in the latter half of the decade.
27 ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
Table 1. Gender Assessment of Selected ADB-Supported Operations ADB Approval Financing Gender PCR PVR Gender Relevance of Relevance Gender ADB Name of Project Year ($ million) Category Rating Rating Rating Objectivea of Designa Responsivenessa Resultsa Performancea Access to Justice Program 2001 350 GEN PS PS S H H S S S Decentralization Support Program 2002 270 GEN S PS S S H S S S Sustainable Livelihoods in Barani Areas Project 2004 41 EGM HS S S S S S S S National Highway Development Sector Investment Programb- Project 1 2006 180 SGE S S n.a. S M M L M Sindh Coastal Community Development Project 2007 36 EGM HS n.a. S S H H S S Earthquake-Displaced People Livelihood Assistance Restoration Program 2007 402 GEN S S S H S S M M Punjab Millennium Development Goals 2008, Programc 1 & 2 2010 250 GEN U U NS H M M L L Social Protection Development Project 2013 430 GEN n.a. n.a. n.a. H M M M L ADB = Asian Development Bank, EGM = effective gender mainstreaming, GEN = gender equity as theme, HS = highly successful, n.a. = not applicable, PCR = project completion report, PS = partially successful, PVR = project validation report, S = successful, SGE = some gender elements, U = unsuccessful. a Relevance, Responsiveness, Gender Results, and Asian Development Bank (ADB) Performance are rated by the Gender and Development evaluation team on a 4-point scale (H=High; S=Substantial; M=Moderate; L=Low). ADB Performance is assessed in terms of ADB’s actions to promote gender outcomes. b Relevant to National Highway Development Sector Investment Program MFF (2006) and National Trade Corridor Highway Investment Program (2014). c The Punjab Millennium Development Goals Program was expected to have three tranches. The first two ($100 million in 2008, $250 million in 2010) were disbursed. The third was not released as Pakistan’s International Monetary Fund program went off-track. The assessment covers the first two tranches. Source: Asian Development Bank. ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
113. In terms of gender results, four of the eight projects scrutinized in greater depth were found to be successful. Two of these were the public sector reform projects approved in 2001 and 2002, prior to the evaluation period, to reform the justice system in Pakistan, and to support decentralization of authority to a new local government system. Implementation continued into the evaluation period and the PCRs finalized in 2009 found both to be successful in promoting gender equality. One of the noteworthy contributions of the decentralization program was the reservation of 33% quota for women in all local government councils. While the local government structure is going through reforms, the very substantial reservation of women’s seats in local government has survived these structural changes. The AJP faced difficulties in implementing the ambitious police reforms but did succeed in creating acceptance of the need to recruit women into the police service and to provide dedicated service desks and services for women. Having ambitious objectives in non-traditional areas has left a lasting effect on gender equality. The other two projects with successful gender outcomes were the community-based development projects from the ANR sector. By organizing women into community groups at the local level, those projects were able to reach women, provide skills training, and offer microloans and TA to induce their participation in local economic development. An innovative institutional design and sustained assistance by local support organizations proved to be effective in promoting economic empowerment of women.
114. The grand schemes which involved state largesse were less effective because they did not attempt to modify social norms and power structures. While the earthquake rehabilitation projects contributed to reconstruction of roads, housing and community infrastructure, they were less effective in achieving their gender objectives.
115. The SPDP has the most promise and the evaluation fieldwork yielded credible examples of the empowerment effect of providing cash directly to women. But the ADB project suffered from a misjudgment about the feasibility of two components—health and skills development—during appraisal and an overestimation of the ability to scale up the cash transfer program. ADB’s financing also suffers from its isolation from the remaining program which is receiving TA from the World Bank, DFID, and USAID. Attribution of results to the ADB project is still very tenuous and not easily separable from the assistance of other donors. The Bank would do well to recognize this and be more proactive in joining hands with other development partners to ensure achievement of the project’s results and gender results.
D. Recommendations
116. Pakistan’s track record shows that while it compares favorably with regional comparators in other development indicators, it lags behind most of them (except Afghanistan) in addressing gender inequality. The gender deficit has been adversely affected by inadequate attention to gender equity and mainstreaming in ADB’s CSP. The findings of this evaluation lead to the following recommendations to enable ADB to make a meaningful contribution to gender equality in Pakistan:
117. ADB should be much more proactive in integrating gender equity and mainstreaming (GEM) objectives across the CSP by expanding the share of operations with GEM objectives and the depth of gender integration within those operations. The Pakistan portfolio needs to catch up with ADB’s global targets on the share of GEM projects and should begin from a default that all projects will integrate gender mainstreaming or gender equity objectives. Any project that is unable to mainstream gender should explain why it needs an exemption.
118. ADB should invest more heavily up front in technical design to ensure integration of GEM objectives, and in assessment of institutional capacity and client ownership to enhance the likelihood of success and sustained impact. While this is true of all operations, its need is most acute when ADB provides budget support to national or subnational programs. ADB Support for Gender and Development (2005–2015) Supplementary Linked Document E (Country Portfolio Assessment)
119. To enhance program effectiveness and achievement of gender objectives, ADB should replace unconditional budget support for national and subnational programs with results-based lending, and should ensure integration of GEM outputs and outcomes within the program’s results framework. The experience of budget support without linking disbursements to predetermined indicators has not been justified and should be replaced by the results-based lending instrument with clearly established DLIs, including gender DLIs for all GEM programs.
120. ADB should be more proactive in coordinating with other donors and should formalize partnerships and cofinancing arrangements with development partners who are providing finance or TA to programs being considered for ADB funding. ADB should be an active contributor in the design of the program and its M&E systems, and should seek to establish joint supervision missions to ensure consistency and synergies across their programs.
121. ADB should invest more, whether individually or in collaboration with development partners, in M&E of the programs that it supports, including through independent third party monitoring and impact evaluations to assess the achievement of project/program objectives and gender outcomes. Contrary to current practice where ADB relies solely on progress monitoring by the client and impact evaluations by other donors, ADB needs to be involved in the design and oversight of these M&E systems to ensure that results claimed by ADB can actually be attributed to ADB.
30 Appendix 1
COUNTRY COMPARISONS
Table A1.1 Comparative Country and Gender Indicators for South Asia Indicators Pakistan Afghanistan Bangladesh India Nepal Sri Lanka Gross National Income per capita, Atlas method (current $) 1,440 630 1,190 1,590 730 3,800 Gross Domestic Product growth (annual %) 4.7 1.3 6.1 7.3 5.4 4.5 Net official development assistance and official aid received (current 3.6 4.8 2.4 3.0 0.8 0.5 $ billion) Youth literacy rate, population 15–24 years, gender parity index 0.8 0.5 1.1 0.9 0.9 1.0 Youth literacy rate, population 15–24 years, female (%) 64.5 32.1 83.3 81.8 80.2 98.6 School enrollment, secondary (gross), gender parity index 0.8 0.6 1.1 1.0 1.1 1.0 Expected years of schooling, female 7.4 7.6 10.1 11.9 12.7 14.3 Gender Development Index (GDI) 0.726 0.600 0.917 0.795 0.908 0.948 Gender Inequality Index (GII) 0.536 0.693 0.503 0.563 0.489 0.370 Human Development Index (female) 0.436 0.328 0.541 0.525 0.521 0.730 Human Development Index (male) 0.601 0.546 0.590 0.660 0.574 0.769 Sources: Economic and education indicators from World Development Indicators (2015); Gross Development Index and Gender Inequality Index from United Nations Development Programme’s Human Development Report. Data are from 2015 or any of the previous five years when data were available.
Table A1.2 Comparative Gender Empowerment Indicators for South Asia Indicators Pakistan Afghanistan Bangladesh India Nepal Sri Lanka Health Empowerment Life expectancy at birth, total (years) 66.2 60.4 71.6 68.0 69.6 74.8 Maternal mortality ratio (modeled estimate, per 100,000 live births) 184 425 188 181 275 31 Births attended by skilled health staff (%) 52.1 38.6 42.1 52.3 55.6 98.6 Fertility rate, total (births per woman) 3.6 4.8 2.2 2.4 2.2 2.1 Contraceptive prevalence, any methods (% of women ages 15-49) 35.4 21.2 62.4 54.8 49.6 68.4 Economic Empowerment Ratio of female to male labor force participation rate (%) (modeled 29.9 20.1 68.6 33.8 91.8 46.1 International Labour Organization estimate) Labor force participation rate, female (% of females ages 15+) 24.8 15.9 57.6 27.0 79.9 35.1 (modeled ILO estimate) Borrowed money from a financial institution, female (% age 15+) 0.3 0.7 9.8 4.9 9.6 17.3 Saved any money in the past year, female (% age 15+) 6.7 10.3 26.2 16.8 16.0 35.3 Social Empowerment Proportion of seats held by women in national parliaments (%) 20.7 27.7 19.8 11.4 29.5 5.8 Female legislators, senior officials and managers (% of total) 3.0 n.a. 5.4 13.8 18.3 28.4 Final say in all decisions (%) 38.2 n.a. 46.0 39.3 45.5 n.a. Source: World Development Indicators. Data are from 2014 or from previous 6 years when data were available; asterisks indicate older data of ADB’s actions to promote gender outcomes.
31 Appendix 2
STATISTICAL TABLES
Table A2.1. Number of Approved Loans and Grants in Pakistan, 2005–2015, by Sector and Gender Equity and Mainstreaming (GEM) category Gender Equity and Mainstreaming (GEM) Categories Primary Sectors GEN EGM SGE NGE NC Total ANR 2 3 2 4 11 EDU 1 1 ENE 1 14 15 FIN 1 1 3 5 HLT 2 2 IND 1 1 PSM 1 3 2 4 2 12 TRA 2 3 11 16 WUS 1 2 3 Total 8 11 9 36 2 66 ANR = agriculture and natural resources, EDU = education, ENE = energy, EGM = effective gender mainstreaming, FIN = finance, GEN = gender equity as theme, HLT = health, IND = industry and trade, NC = not categorized, NGE = no gender elements, PSM = public sector management, SGE = some gender elements, TRA = transport, WUS = water and other urban infrastructure and services. Source: Independent Evaluation Department.
Table A2.2. ADB Financing for Loans & Grants in Pakistan ($ million), 2005–2015 by Sector and Gender Equity and Mainstreaming (GEM) category Gender Equity and Mainstreaming (GEM) Categories Primary Sectors GEN EGM SGE NGE NC Total ANR 80.20 228.00 270.77 400.57 979.54 EDU 205.00 205.00 ENE 50.00 4,005.31 4,055.31 FIN 402.00 10.00 1,124.00 1,536.00 HLT 250.00 250.00 IND 5.00 5.00 PSM 430.00 770.00 700.00 481.35 6.00 2,387.35 TRA 578.19 1,047.40 1,169.10 2,794.69 WUS 60.00 137.10 197.10 Total 1,427.20 1,718.29 2,078.17 7,180.33 6.00 12,409.99 ADB = Asian Development Bank, ANR = agriculture and natural resources, EDU = education, ENE = energy, EGM = effective gender mainstreaming, FIN = finance, GEN = gender equity as theme, HLT = health, IND = industry and trade, NC = not categorized, NGE = no gender elements, PSM = public sector management, SGE = some gender elements, TRA = transport, WUS = water and other urban infrastructure and services. Source: Independent Evaluation Department.
Table A2.3. Number of Approved Technical Assistance in Pakistan, 2010–2015, by Sector and Gender Equity and Mainstreaming (GEM) category Gender Equity and Mainstreaming (GEM) Categories Primary Sectors GEN EGM SGE NGE NC Total ANR 5 1 1 7 ENE 1 5 1 7 FIN 1 1 PSM 1 2 1 4 TRA 2 2 4 8 WUS 1 1 Total 1 4 7 13 3 25 ANR = agriculture and natural resources, ENE = energy, EGM = effective gender mainstreaming, FIN = finance, GEN = gender equity as theme, NC = not categorized, NGE = no gender elements, PSM = public sector management, SGE = some gender elements, TRA = transport, WUS = water and other urban infrastructure and services. Source: Independent Evaluation Department.
32 Appendix 2
Table A2.4. ADB Financing for Technical Assistance in Pakistan ($ million), 2010–2015 by Sector and Gender Equity and Mainstreaming (GEM) category Gender Equity and Mainstreaming (GEM) Categories Primary Sectors GEN EGM SGE NGE NC Total ANR 2.25 0.23 1.00 3.48 ENE 1.50 5.03 0.55 7.08 FIN 0.23 0.23 PSM 0.88 0.72 0.23 1.82 TRA 2.33 0.23 4.50 4.75 WUS 1.30 1.30 Total 0.88 5.13 2.48 10.70 1.78 20.95 ADB = Asian Development Bank, ANR = agriculture and natural resources, ENE = energy, EGM = effective gender mainstreaming, FIN = finance, GEN = gender equity as theme, NC = not categorized, NGE = no gender elements, PSM = public sector management, SGE = some gender elements, TRA = transport, WUS = water and other urban infrastructure and services. Source: Independent Evaluation Department.
Table A2.5. Number of Projects by GEM Category & Approval Year Gender Equity and Mainstreaming (GEM) Category Approval Year GEN EGM SGE NGE NC Total 2005 2 1 1 4 8 2006 1 2 3 4 10 2007 1 1 4 6 2008 2 1 1 4 8 2009 2 2 4 2010 1 1 2 1 5 2011 1 2 1 4 2012 1 2 3 2013 1 2 3 2014 1 1 6 8 2015 1 6 7 Total 8 11 9 36 2 66 EGM = effective gender mainstreaming, GEN = gender equity as a theme, NC = not classified, NGE = no gender element, SGE = some gender elements. Source: Independent Evaluation Department.
Table A2.6. Number of Projects by Primary Sector & Approval Year Primary Sector Approval ANR EDU ENE FIN HLT IND PSM TRA WUS Total Year 2005 1 1 1 4 1 8 2006 3 2 3 1 1 10 2007 1 1 2 1 1 6 2008 1 1 1 3 1 1 8 2009 1 2 1 4 2010 2 1 2 5 2011 1 1 1 1 4 2012 1 1 1 3 2013 2 1 3 2014 2 2 1 3 8 2015 1 2 4 7 Total 11 1 15 5 2 1 12 16 3 66 ANR = agriculture and natural resources, EDU = education, ENE = energy, FIN = finance, HLT = health, IND = industry and trade, PSM = public sector management, TRA = transport, WUS = water and other urban infrastructure and services. Source: Independent Evaluation Department.
33 Appendix 2
Table A2.7. Gender Rating for Loans and Grants, 2005–2015* by PCR Rating PCR Rating Gender Rating HS LS PS S U Total Percent Successful** 1 1 2 18% Not Successful 1 2 6 9 82% Total 1 1 3 6 11 100% HS = highly successful, LS = less than successful, PCR = project completion report, PS = partly successful, S = successful, U = unsuccessful. * Includes projects for which both project completion report and gender rating were available. ** The two projects with successful gender ratings are the Sindh Coastal Community Development Project (agriculture and natural resources) and the Earthquake-Displaced People Livelihood Restoration Program (finance); the gender rating for the latter is not supported by fieldwork results (see Table 1). Source: Independent Evaluation Department.
Table A2.8. Gender Rating for Loans and Grants, 1999–2010* PCR Rating Gender Rating HS LS PS S U Total Percent Successful** 2 1 3 6 22% Not Successful 1 4 4 12 21 78% Total 2 1 5 7 12 27 100% HS = highly successful, LS = less than successful, PCR = project completion report, PS = partly successful, S = successful, U = unsuccessful. * Includes projects for which both project completion report and gender rating were available. ** The six projects with successful gender ratings in the projects database include three agriculture and natural resources projects, 2 public sector management projects and one finance project which overlaps with Table A2.7. Source: Independent Evaluation Department.
Table A2.9. Gender Rating for Loans and Grants, 2005–2015* by Primary Sector Gender Rating Percentage Primary Sector Successful Not Successful Total Successful ANR 3 3 6 50% EDU 6 5 0% ENE 1 1 0% FIN** 1 1 100% HLT 2 2 0% IND 1 1 0% PSM 2 4 6 50% TRA 2 2 0% WUS 2 2 0% Total 6 21 27 22% ANR = agriculture and natural resources, EDU = education, ENE = energy, FIN = finance, HLT = health, IND = industry and trade, PSM = public sector management, TRA = transport, WUS = water and other urban infrastructure and services. * Includes projects for which both project completion report and gender rating were available ** The finance project is the Earthquake-Displaced People Livelihood Restoration Program also listed in Table A2.7, whose gender rating of successful is not supported by the fieldwork results. Source: Independent Evaluation Department.
Table A2.10. Gender Category/ADB Financing for new TAs, 2010-2015 ADB Financing Gender Category Count of Gender category (in $ million) GEN 1 0.875 EGM 4 5.125 SGE 7 2.475 NGE 13 10.695 NC 3 1.775 Total 28 20.95 Percent GEN + EGM 18% 29% ADB = Asian Development Bank, EGM = effective gender mainstreaming, GEN = gender equity as theme, NC = not categorized, NGE = no gender elements, SGE = some gender elements, TA = technical assistance. Source: Independent Evaluation Department.
34 Appendix 3
EVIDENCE FROM PROJECT VALIDATION REPORTS OF EARLIER PROJECTS WITH GENDER EQUITY AND MAINSTREAMING (GEM) OBJECTIVES
Creating a New Industry: the Khushhali Microfinance Bank Story Project Number: 29229, Loan Number: 1805-PAK (SF)
1. Financial inclusion in Pakistan lags far behind regional comparators. The Khushhali Microfinance Bank was founded in 2000 as the first-ever commercial microfinance bank in the country with Asian Development Bank (ADB) support from the $70 million Microfinance Sector Development Program (MSDP). It was incorporated through the Khushhali Bank Ordinance, 2000 as a corporate body with limited liability and commenced its business with issuance of a license by the State Bank of Pakistan on 11 August 2000. A $68 million credit line from MSDP supported its microfinance outreach program.
2. The Khushhali Bank was established to mobilize funds to provide microfinance services to lesser privileged persons, particularly poor women for mitigating poverty and promoting social welfare and economic justice through community building and social mobilization with the ultimate objective of poverty alleviation.
3. Shortly after incorporation of the Khushhali Bank, the government enacted a new law—the Microfinance Institutions Ordinance 2001—which is recognized globally as providing a world class legal environment for the microfinance industry which has grown rapidly. Pakistan now has 10 microfinance banks with 2.6 million active borrowers. ADB provided further assistance to the Government of Pakistan through the Improving Access to Financing Services Program approved in 2008 to improve governance of the microfinance sector. As part of this assistance all microfinance institutions were required to operate under the Microfinance Institutions Ordinance 2001. Consequently, with the approval of the State Bank of Pakistan, the Khushhali Bank Limited was incorporated in 2008 as a public limited company with the Securities and Exchange Commission under the Companies Ordinance, 1984, and all assets and liabilities were transferred to the new entity.
4. The macro trend in the microfinance sector in Pakistan shows an increase in deposits and decrease in reliance on debt in the year 2015. The microfinance sector as a whole successfully mobilized Rs 60 billion at the end of 2015, an increase of 51% over the 2014 figure of Rs 43 billion. With a gross loan portfolio of PRs 90.2 billion, in 2015 the microfinance industry in Pakistan serviced 3.6 million active borrowers, 54% of which were in rural areas and 55% (2 million) were women1.
5. Khushhali Bank is the second largest microfinance lender in the country. In 2015, it had total assets of PRs 26.6 billion ($254 million) and net assets of PRs 3.9 billion ($37.6 million). The bank improved market share in deposit from 20.0% to 24.1% with accelerated growth of 79% year-on-year. The growth trajectory helped it reach over a million clients and achieve more than PRs One billion in pre- tax profit, amongst the highest in the sector. By the end of 2015, the bank had 1,128,901 active clients and 520,517 active borrowers.
6. The project validation report (PVR) for the MSDP, which was rated partly successful, indicates that Khushhali Bank expanded slower than estimated at appraisal. Actual loan disbursements for credit at the loan’s conclusion in February 2006 totaled PRs 5.5 billion ($93.66 million) against an appraisal estimate of PRs9.29 billion ($165.9 million). Outstanding loans were $43.5 million, also significantly lower than the estimated $153 million. As of 31 December 2007, Khushhali Bank had 283,695 active borrowers, 50% of the target of 560,000 households. On the positive side, the PVR validated the project completion report (PCR) finding that the financial performance of Khushhali Bank indicated a fast-
1 Pakistan Microfinance Network. Pakistan Microfinance Review 2015: An Annual Assessment of the Microfinance Industry. Islamabad.
35 Appendix 3 growing, commercially solvent and highly liquid institution with a rapidly growing network of branches covering 88 districts that included some of the most marginalized areas in the country.
7. The MSDP project was partly successful in helping Pakistan develop its microfinance industry. From the perspective of the GAD evaluation, the investment loan had targeted 40% female borrowers. In actuality, female borrowers from Khushhali Bank declined from 32.1% in 2001 to 15.7% in 2007 due to a change in the gender-targeting policy which midway through the project specified that only those women should quality for lending who are actually users of loan funds. Elimination of surrogate borrowings by women for loan funds actually used by their male relatives led to a decline in female lending but allowed Khushhali Bank to adhere to its commitment to use microfinance as an instrument of poverty reduction among women who owned and managed their own business.
8. Although the microfinance industry tracks its borrowers and reports annually on the gender distribution of active borrowers in the industry, Khushhali Bank does not routinely report on its client base. Its publications focus primarily on financial results and profitability of the sector. Monitoring of beneficiaries and gender outcomes does not seem to have been part of the ADB assistance to the sector, consequently their annual reports do not include updates on gender distribution of their lending activities.
Access to Justice Program (AJP) Program Number: 32023, Loan Numbers: 1897/1898/1899(SF)
9. The AJP’s key development objective was to assist the government in improving access to justice by supporting five inter-related governance objectives: (i) providing a legal basis for judicial, policy, and administrative reforms; (ii) improving the efficiency, timeliness, and effectiveness of judicial and police services; (iii) supporting greater equity and accessibility to justice services to the vulnerable and poor; (iv) improving predictability and consistency between fiscal and human resource allocations and the mandates of reformed judicial and police institutions at the federal, provincial, and local levels; and (v)ensuring greater transparency and accountability in the performance of the judiciary, the police, and administrative justice institutions.
10. The AJP focused on judicial reforms (including reforms relating to administrative justice institutions) and police reforms. The program was expected to deliver benefits in three components— policy, institutions, and budget and expenditure management.
11. The program was approved in December 2001, and comprised two loans in the amount of $330 million to be released in four tranches, a technical assistance (TA) loan for $20 million, and a TA grant for $900,000. Capacity development activities were to be accomplished through the TA loan and grants. The Ministry of Law, Justice, Human Rights, and Parliamentary Affairs (MOL) was the executing agency.
12. The PCR adequately described the complexity of the implementation arrangements between different branches of government (judiciary and the executive branch) and across different layers of implementation (federal, provincial, and district offices). The PCR also noted a high degree of compliance with the loan conditions, with the exception of the setting up of citizen police liaison committees, which was waived due to a lack of ownership. In all, there were 64 policy actions: 58 of these were fully complied with, 5 were substantially complied with, and 1 was waived.
13. The expected impact was to contribute to the nationwide efforts to influence the exercise of political, administrative and judicial powers in order to improve accessibility to public entitlements for all citizens, in particular the poor, women, and minorities. The AJP intended to tackle gender issues through the creation of competent legal, judicial, and police institutions through which existing basic and constitutional rights could be implemented fairly and accountably. The AJP was expected to promote research and debate on the quality and equality of existing laws through the reformed Law Commission,
36 Appendix 3 as well as the Women's Commission, and help build constituencies for change and elicit consensus for reform.
14. Although the PCR and the PVR rated the project partly successful overall, the PVR found that the program helped mainstream gender reforms into the justice sector. MOL partnered with the Ministry of Women Development to implement the national Gender Reform Action Plan. The number of women judges in different courts nearly doubled between 2001 and 2007. Greater awareness of the rights of women and human rights was incorporated into police training programs.
37 Appendix 4
FOCUS GROUP DISCUSSIONS
Methodology
In consultation with the government, Asian Development Bank (ADB) staff, and other stakeholders, the evaluation identified two districts—District Bagh in Azad Jammu and Kashmir and District Mansehra in Khyber Pakhtunkhwa—of the nine earthquake-affected districts as suitable for the assessment fieldwork since Benazir Income Support Programme (BISP) had a substantial beneficiary base in those two districts and they were among the most seriously affected districts which had subsequently received ADB assistance for housing reconstruction. The fieldwork was thus designed to provide feedback on ADB assistance for the Social Protection Development Project and the Earthquake-Displaced People Livelihood Support Program.
In each of the selected districts, six focus group discussions (FGDs) were organized by two separate teams working in parallel. Each team consisted of a district supervisor responsible for quality assurance and synthesizing the individual FGD reports, and a two-person team of facilitators (one male, one female) to conduct and document the FGD meetings. The six locations were identified from the locations where BISP Beneficiary Committees (BBC) had been established under the BISP program. The existence of BBCs made it easier to convene the FGDs and, since all participants were members of these BBCs, it ensured that the FGD participants were females who were aware of the BISP program and who resided in villages that had been affected by the earthquake.
The locations were selected in consultation with the district BISP offices to ensure balanced coverage of the districts—two near urban centers, and four more distant villages—to achieve a broader range of opinions about the two programs. In Bagh district this included one location inhabited by recent immigrants displaced by the border conflict. In Mansehra this included two villages where a substantial portion of households had been displaced from their original villages and resettled after the earthquake.
Most focus groups consisted of 6-12 participants, except for one village in Mansehra district which had only 4 participants since the research team arrived late in the afternoon by which time other women living in more distant parts of the village had returned to their homes.
The FGDs followed a template that was pretested during the fieldwork conducted by the evaluation mission. The FGDs covered the following topics:
Beneficiary feedback on BISP eligibility Regularity of cash transfer payments Ease and cost of receiving cash transfer payments Use of funds Benefits of the BBC Impact of the 2005 earthquake Assistance for housing reconstruction Assistance for reconstructing public works Additional benefits or programs for women Participant recommendations to improve future programs
The discussion of each FGD was documented and reviewed by the district supervisors who sought additional clarificiations from the field facilitators as appropriate, and then prepared a synthesis district report.
38 Appendix 4
Summary Report: Bagh District, Azad Jammu and Kashmir 1
District Profile Bagh is located 80 kilometers (km) from Muzaffarabad, the capital of Azad Kashmir. It is 160 km from Islamabad, the capital of Pakistan. Bagh City is the main town and district headquarters of Bagh District. The town is situated on the confluence of two small nullahs, Malwani & Mall which flow all year. The locally recognized "Haji Peer Pass" is about 32 km from Bagh City. In 2011–2012, the population was 287,523 (47,920 households with an average household size of 6). Middle-standard hotels and forest resthouses are available for visitors, and basic necessities are available in the Bagh bazaars. In district Bagh, 23% of households are BISP beneficiaries.
Selection of Focus Groups The FGDs were organized in areas spread across the district at an approximate distance of 20-km radius away from the city. Only one FGD was done in an urban location because urban results seemed good. Urban people are living near the facilities and they don’t face a lot of problems in both programs (unconditional cash transfer [UCT] and conditional cash transfer [CCT] for children’s education) as compared to people from rural areas.
A total of six villages, one from each union council, from all the three tehsils of Bagh were included for FGDs where Army/ERRA and National Rural Support Programme (NRSP) implemented the rehabilitation process as well as BISP survey. Out of selected six villages, the residents of five villages are permanent residents of Azad Jammu & Kashmir while one village named ‘Mong Bajri’ consists of migrants (migration from Indian Occupied Kashmir) who migrated during 1990–1998. The government of AJK allotted to these migrants this specific area for their residence. The residents of the villages Seri Bandi, Bangran, and Dhall Qazian belong to very poor families while the residents of the Village Kanna Mohri & Village Jaglari Shehar are well-off compared to the other villages. Aurat Foundation worked with the BISP beneficiaries of these selected villages from May 2013–July 2016. Out of 6 villages, only two villages ‘Mong Bajri & Jaglari Shehar’ are located on the main road where public transport is available while other four villages are linked with the main road via small link roads and public transport is not available for the residents of these villages. However, taxi service is available to access the city or travel from city to the village. This not only increases their traveling expense, but also limits their fluent mobility to city as compared to the residents of the villages at main road. Except one village ‘Mong Bajri,’ all remaining villages are situated in mountainous locations.
Findings from FGDs
A total of 51 participated in 6 FGDs conducted in the selected outreach of district Bagh. All 51 participants are the beneficiaries of UCT Programme of BISP. Out of 51 participants, 37 beneficiaries are also the beneficiaries of Waseela-e-Taleem Programme (CCT) which shows that 73% of beneficiaries have their children under the bracket of 5–12 years and families have gone through the process of registration of children followed by their enrollment in schools under the BISP Waseela-e-Taleem Programme.
The participants of the FGDs have diverse experience; the majority of the participants (65%) were from middle age bracket, i.e., 36–49 years while 25% participants were up to 35 years of age and 10% participants were over 50 years of age.
1 This summary report was prepared by Aftab Ahmad Qayyum, District Supervisor for Bagh, Azad Jammu and Kashmir.
39 Appendix 4
Table A4.1. Village-wise Participant Profile Participant Age Number of Number of UCT Number of CCT Up to Above Village/Union Council (UC) participants beneficiaries beneficiaries 35 36–50 50 Dhall Qazian, UC Banipasari 12 12 6 3 7 2 Kanna Mohri, UC Bagh 8 8 7 1 6 1 Seri Banid, UC Topi 7 7 6 2 5 0 Bangran, UC Thub 8 8 5 3 5 0 Jaglari Shehar, UC Jaglari 6 6 5 1 4 1 Mong Bajri, UC Mallot 10 10 8 3 6 1 CCT = conditional cash transfer, UCT = unconditional cash transfer. Source: Independent Evaluation Department.
FGD Questions on BISP
1. Beneficiary feedback on eligibility
Most of the participants of the FGDs in all six locations were of the opinion that the poverty score card survey conducted in 2010 was accurate and most of the beneficiary households who are getting UCT actually deserve for BISP UCT programme. However, they are also of the opinion that there are still a lot of poor households who do not receive UCT who should be considered for the programme. These include female-headed families, families with disabled persons, widows, and others living below the poverty line. Similarly some of the participants were of the opinion that there are many households who belong to well-off families but are getting UCT under BISP-NCTP and this shows inclusion as well as exclusion errors of the poverty score card survey. The survey was conducted by NRSP and Pak Army in district Bagh while five villages out of total six (selected for FGDs) were surveyed by NRSP and one village covered by Pak Army. The majority of the participants said surveyors (data collection team) visited door-to-door to complete the survey while some indicated that surveyors did not go door-to-door and gathered information of the whole village from one place, particularly for remote areas.
The salient findings of this section are: 37 out of 51 (73%) participants responded that the poverty score card survey was conducted accurately and selection of beneficiaries for UCT was on merit while remaining 27% participants were of the opinion that survey was not conducted properly which led to inclusion and exclusion errors. Participants were reluctant to name the households who should not receive UCT as per their opinion though. 43 out of 51 (84%) participants said that the beneficiary households who are getting UCT actually deserve this cash transfer and meet the eligibility criteria. The majority of participants (36 out of 51, 71%) share the opinion that there are many households who actually deserve the UCT programme but were not included. It includes female headed families, families with disabled persons, widows, and orphan families. Some of the participants also mentioned that some of the families were not surveyed due to their seasonal migration or computerized national identity card (CNIC)-related issues (but these are very few in number). five out of six locations selected for FGDs were surveyed by NRSP while remaining one was covered by Pak Army.
2. Regularity of cash transfer payments
The BISP beneficiaries are categorized into two types: those entitled for UCT only and those who are getting both UCT and CCT. All UCT beneficiaries receive CCT if they have children within the age bracket of 5–12 years who are enrolled in school. The CCT payment is transferred if a child complies with a minimum 70% attendance in each quarter. Both the UCT and CCT are released on quarterly basis. The participants of all six FGDs said they are getting UCT and CCT payments on time. CCT payments are
40 Appendix 4 released after validation of children’s school attendance. However, the CCT beneficiaries faced problems due to nonfunctional case management system at BISP tehsil office level. For example, if a child changed schools (which is common at the end of an academic year and even in middle of the session), payments cannot be processed at tehsil office level due to nonfunctional case management system. This results in non-generation of payment for that particular case. Similarly, problems with the beneficiary debit cards or ATM machines (mostly due to the use of wrong PIN code) cause delays in getting cash.
Key findings of this section are summarized as follows; UCT and CCT are received on time. However, beneficiaries face problems in cases of blocked debit cards or in ATM machines due to the use of wrong PIN code. Retrieval of ATM cards takes long and blocked cards are very common in these areas. Another issue was highlighted by a beneficiary who was under Sanity Check2 from BISP since December 2014 and her card has been blocked since then. The participants revealed that the BISP case management system for CCT programme is not yet functional at tehsil level which resulted in many beneficiaries’ children being deprived of CCT payments. 4 out of 37 CCT beneficiaries (11%) said that they changed their children’s schools and informed the respective BISP tehsil offices through an application. No response has been received from BISP Office although 1 year has passed. Until these particular cases are properly resolved by BISP Tehsil office through case management system, the families of these children will not receive CCT even though they attend school on regular basis. Another important issue was beneficiaries who had children turning 5 years old in 2015 at the time when Aurat Foundation performed the registration and admission of children. These children have now reached the 5+ years of age and are now eligible for schooling. Parents are worried about where to register when respective tehsil offices do not have the knowledge and skills to entertain these families. A beneficiary said she enrolled 3-4 months ago to the BISP office and was told she would receive the CCT but that this has not yet been added to her entitlements. Similarly, a beneficiary’s child registration was not done since the parents don’t know where to go for new registration of children after the Aurat Foundation office closed. The relevant BISP tehsil office does not know how registration procedures for new beneficiries.
3. Ease and cost of access of payment
The responses of the participants from all 6 locations revealed that currently all 51 participants (100%) are getting their quarterly payments via debit cards using ATM machines. Most of the participants seek help from their family members (husbands, daughters, or sons) to withdraw cash from ATM machines as they do not know how to use a debit card themselves. A very small number of beneficiaries (7 out of 51) are able to use ATM machines and do not depend on others. It is also noted that some beneficiaries who don’t know how to operate ATMs visit the banks themselves and seek assistance from strangers to withdraw their cash. Mostly these beneficiaries request bank security guards to help them in withdrawal of cash from the ATM. Payment through BISP Debit Cards is more costly in terms of transportation cost particularly for those who are living far from cities and consumes more time as compare to postal payment. Still majority of the beneficiaries are of the opinion that ATM is much better than the postal payment method as previously postmen used to charge money from beneficiaries on each payment. The key findings of this section are as follows:
Majority of the participants 41 out of 51 (80%) do not visit ATM machines and seek help from their close family members (husbands, sons or daughters) to withdraw cash from ATM. 14% beneficiaries (7 out of 51) know how to use ATM machines and they withdraw cash on their own without depending on others. While 6% (3 out of 51) request strangers to help them in withdrawal of cash from ATM. Mostly these beneficiaries seek cooperation from bank security guards.
2 In early 2015, BISP launched a Data Sanity Check with the help of NADRA to weed out undeserving cases from the system. About 125,000 beneficiary payments were blocked and these beneficiaries need to provide necessary documents to prove their eligibility.
41 Appendix 4
The responses of the participants revealed that payment through post offices was less costly compared to ATM method since post offices were located closer to their homes. The transportation cost for majority of the participants who previously used to receive their quarterly payments from post offices was zero while only 31% (13 out of 42) said that they have to spend an average of 70- 175 rupees on transportation. However, 55% participants (23 out of 42) claimed that respective postmen used to receive an average of 116-200 rupees from each beneficiary for each quarter’s payment. The remaining 45% never paid any amount to postmen. The participants’ responses also revealed that receiving cash from ATM involved higher transport costs than postal payment. 84% (43 out of 51) said that they have to bear an average cost of Rs. 150 to 240 each time on transport. Most of the participants said they had to go more than twice for withdrawal of cash from ATMs [either because the money had not yet arrived or because some ATMs had limits on the amount that could be withdrawn on one day]. The remaining 16% who do not bear transportation cost actually live in cities or near to ATM machines; otherwise everyone has to bear this cost. Though cash received through debit cards is comparatively costly as well as consumes more time than postal payment, still 73% of participants (37 out of 51) prefer the debit card/ATM mode to the previous mode of payments through the post office. Some of the beneficiaries also said that previously when they used to receive quarterly payments through the post some of them were not paid the initial amount of Rs. 10,000, as the postal staff said their payments had not arrived, although the BISP office said the payments had been sent. It is possible that someone in the post office signed the receipts on their behalf and kept the payments.
4. Use of funds
The responses of all participants reveal that almost all use UCT payments on food items and children’s education. A very small number said they saved some for emergencies while some started small home- based businesses after saving some quarterly payments. This includes poultry and eggs business as well as selling out of buffalo’s milk at the local market. The most common use of UCT and CCT is:
Education-related expenses including books, stationary, school uniform, shoes, and monthly fees. Food expense, health, and other house necessities including washing machines, gas cylinders, and to some extent, furniture and fixtures, etc.
5. Benefits of BISP Beneficiary Committee
It was noted that all participants considered the BBCs as a very important forum. This is the only platform where they meet and share information pertaining to BISP initiatives. They also use it to discuss day-to- day issues pertaining to UCT and CCT including, but not limited to, issues relating to use of BISP Debit Cards, debit card blockage, release of quarterly payments, cases of pending beneficiaries, and provision of necessary guidance which help them with their pending cases. Another very important thing which was came into light was that the platform of BBCs actually bridges the prevailing gaps between beneficiaries and BISP tehsil offices and helped in developing the linkages between service providers and beneficiaries. As BBC members are expected to meet on a monthly basis, it is a bit alarming that four out of the six BBCs where FGDs were organized are not confident about their ability to conduct their meetings monthly after Aurat Foundation. They were of the opinion that the foundation’s representatives were the major source of providing updated information about the BISP programme and the meetings are worthless as the foundation is no longer working in the field. The most common benefits of BBCs discussed by the participants are described below:
It provides an opportunity for beneficiaries to discuss and learn about the different initiatives of BISP. It is the most effective forum for BISP beneficiaries to gather/attain information about the prevailing issues and possible solutions.
42 Appendix 4
It is the major source of timely information about the release of UCT and CCT quarterly payments by BISP. It is the source of developing linkages and communication with development agents and other stakeholders. It provides a platform to all beneficiaries where they exchange views with each other and learn from the experiences of others particularly pertaining to the best use of UCT and CCT. Using the BBCs, the beneficiaries communicate their issues to relevant BISP tehsil office; and their issues have been resolved more frequently when they approach the BISP tehsil office as BBC members than meeting with BISP staff in their individual capacity.
FGD Questions on Earthquake Reconstruction and Livelihoods Support
6. Impact of the 2005 earthquake
District Bagh was one of the three main districts affected by the disastrous earthquake of 8 October 2005. Basic infrastructure including hospitals, schools, and roads were badly damaged and rescue services including police and armed forces were paralyzed. Bagh was the second-most-affected district, and accounted for 15% of the total casualties (ERRA report). The FGDs responses revealed that 84% of participants (43 out of 51) lost their houses completely, and 14% (7 out of 51) of participants’ houses were partially damaged. Only 1 out of 51 respondents (2%) said that her house remained safe during this earthquake. The responses of the FGD participants revealed that 16% of them (8 out of 51) lost their immediate family members (husbands, sons and daughters) and 20% (10 out of 51) also lost their livestock. In three of the six locations, most participants suffered injuries from the earthquake. Public infrastructure including roads, water schemes, schools and hospitals in the respective villages of these beneficiaries were also badly damaged or demolished completely. The damages caused by the earthquake in the respective communities where FGDs were carried out are summarized below:
Table A4.2. Losses from the 2005 Earthquake Loss or injury to Village & Union Loss/damage to member of Loss of Damage to public services Council (UC) participants’ house household livestock (such as roads, schools, etc) Dhall Qazian, 11 fully damaged; 1 woman lost 2 3 women lost Primary school, two high UC Banipasari 1 partially daughters at livestock schools (one for girls, one damaged but home; most for boys), mosque, road, uninhabitable suffered injuries water tanks destroyed Kanna Mohri, UC 7 fully damaged; 1 1 woman lost 1 1 woman lost Two high schools (one for Bagh not damaged son and 1 lost her livestock girls, one for boys), one husband; most middle school (for girls) suffered injuries mosque, road, water tanks destroyed Seri Banid, 7 fully damaged; 1 woman lost her 1 woman lost one primary school, UC Topi husband and 1 8 goats and 1 electricity posts lost her son; cow while 1 most suffered lost 2 injuries buffaloes Bangran, 8 fully damaged; 1 woman lost her No losses one primary school and one UC Thub brother-in-law and middle School, dispensary, 1 lost her son; two madrassas 1 female suffered injuries Jaglari Shehar, 4 fully damaged; No loss of life 1 female lost one primary school, two UC Jaglari 2 partially occurred; 1 female a cow and high schools, one damaged suffered injuries one ox; dispensary 1 lost a goat
43 Appendix 4
Loss or injury to Village & Union Loss/damage to member of Loss of Damage to public services Council (UC) participants’ house household livestock (such as roads, schools, etc) Mong Bajri, 6 fully damaged; 1 woman lost her No loss. one high school UC Mallot 4 partially husband and a damaged child; no injuries Source: Independent Evaluation Department.
7. Assistance for house reconstruction
The FGDs revealed that ERRA provided financial assistance to the respective villages of the respondents. As far as technical assistance is concerned, except for one location where training was not conducted, technical training sessions were conducted in the remaining areas for affected communities by NRSP or Army. However, FGD participants revealed that only men participated in these trainings. On the whole, both males and females of the respective households took part in the reconstruction of their houses. Due to joint family systems, some individuals did not receive any compensation from ERRA, and some of these families are still living in shelters or mud/kucha houses.
Key findings of the discussions are: The training sessions on reconstruction of the houses were conducted for male participants only, females were not invited to attend these sessions. In most cases, both males and females worked on reconstructing their houses but decisions were mostly taken by male members; females were not consulted in the process of new construction. Majority of the households received their full payments for house reconstruction. ERRA released the installments after verifying the completion of reconstruction phases and techniques. However due to joint family systems some individuals did not receive any compensation from ERRA. Some of these families are still living in temporary shelters or mud houses. The households with partial damage received compensation ranging from Rs 25,000 to 75,000. Model houses in some areas were also constructed for the most vulnerable families so that others could copy the construction techniques.
8. Assistance for reconstructing public works
Public infrastructure damaged during earthquake 2005 included schools, health facilities, water supply schemes, roads and mosques. Discussion with the participants of FGDs revealed that reconstruction of public works has been mostly completed in the respective villages of these participants. All participants were of the opinion that the schools constructed are better than the previous ones. Roads have been constructed by the local government as well as under the City Development Project (CDP) 3, while water supply schemes were reconstructed or rehabilitated by NGOs. There are some water schemes which have been completed with funds from the World Bank. The salient findings of this section are:
Most of the damaged schools have been reconstructed by ERRA. Newly constructed school buildings are constructed on the basis of earthquake resistance technology, as well as with more capacity than the previous one. However some school buildings have still been not reconstructed although 11 years have passed since the earthquake. Some health facilities which were damaged during the earthquake have been reconstructed but in one of the villages, a dispensary has not yet been constructed. Most of the damaged roads have been reconstructed again. This was done under city development project and in some areas they were reconstructed by local government.
3 In 2008, an umbrella contract was signed between ERRA and Government of the People’s Republic of China (PRC) for rehabilitation of earthquake affected areas in AJK under which the PRC extended a $300 million loan for rehabilitation works. Three cities were selected for rehabilitation: Muzaffarabad, Rawalakot, and Bagh. The works were contracted to two state owned firms—China International Water and Electricity Corporation (CWE) and China Xinjiang Beixin Group (CXB). The work included both design and construction of infrastructure facilities.
44 Appendix 4
Water supply schemes have been rehabilitated or reconstructed. Most of the rehabilitation or reconstruction of damaged schemes has been done by NGOs. In some cases, World Bank financial assistance has been utilized for this purpose.
9. Additional benefits or programs for women
The findings of the discussions with all six groups revealed that some additional projects were implemented in four out of six villages (where FGDs were conducted) which directly or indirectly benefited the women of that area. In the remaining two villages no additional assistance for women was provided by government or non-governmental actors. Key additional interventions alongside earthquake reconstruction efforts for women in those four villages selected for FGDs are:
In two of the villages different initiatives relating to the restoration of livelihood included training on kitchen gardening and vocational skills, provision of seeds, provision of livestock, and credit to selected women etc. were provided by some NGOs. The participants did not know whether it was NRSP or another NGO. However, beneficiaries from another FGD who were provided training said they did not receive further support to make use of the training. “I have attended the 15 days training on vegetable farming and livestock management but nothing in terms of seeds or cash grant has been provided to me.” In one of the villages, a community center was built and later a dispensary was also established for the local community in two rooms of the existing community center building In one of the villages, a new road was constructed which connected the villagers to the nearest market. “This newly constructed road linked us to the nearest market and increased females’ accessibility to the market compared to our previous life,” stated one of the beneficiaries.
10. Participant recommendations to improve future programs
Participants suggested that a representative from the BBC should be involved in the next survey because they know all the households in the village and can identify deserving households left out of the BISP beneficiary during the previous survey. BBC participation can also help to increase the accuracy of survey, as suggested by another group. Most of the participants suggested that skill development programs for youth (children of beneficiaries) should be launched by BISP (revival of Waseela-e-Rozgar program) Some beneficiaries suggested that health cards should be provided to beneficiaries so that they can receive timely treatment in hospitals when household members fall sick. (implementation of Waseela-e-Sehat Programme) One of the beneficiaries suggested that soft loans should be issued to beneficiaries so that they can initiate small business; this would also decrease their dependency on BISP in the longer run.
Observations and Comments by the Evaluation Team:
It was observed that although beneficiaries are of the opinion that some who are receiving UCT are actually not entitled to it, they are reluctant to provide names. It was also observed that CCT beneficiaries are worried about the future of CCT payment as this is conditional on the validation of 70% attendance of children. At the end of the social mobilization programme implemented by Aurat Foundation, no mechanism has been put in place to collect and report the attendance of children to process the quarterly payments.
45 Appendix 4
Summary Report: Mansehra District, Khyber Pakhtunkhwa 4
District Profile: District Mansehra is located at the eastern border of Khyber Pakhtunkhwa Province, 4 hours away from Peshawar and 3 hours away from Islamabad. The district is located at 34°-12' and 35°-50' and 47°-07' longitude and mostly hilly areas with difficult terrains. Mansehra shares its borders with numerous other districts: the Kohistan and Diamir districts to the north, Abbottabad District to the south, the Neelum District of Azad Kashmir to the east, Swat district to the west and Batagram District to the northeast. Its total area is 4,579 square kilometers with population of 1,152,839 (1998 census) with an average annual growth rate of 2.4%, household size 6.7 persons, literacy rate 36.3 and disabled population 1.6%. Most of the population (84.3%) owned their houses. Only 32.1% of the population has the facility of drinking water inside their homes.
Culturally, the residents of Mansehra district consist of a mixed population which historically has been more patriarchal and conservative than those of Bagh district.
In October 2005 an earthquake of 7.6 magnitude struck the northern areas of Pakistan including district Mansehra which was the worst affected district of NWFP in terms of 15,997 human lives loss, 9,903 major injuries, and great destruction to physical infrastructure and livestock. The district also suffered a significant loss of livelihood due to the earthquake that has caused damage to the land, crops, livestock, and infrastructure.
The district consists of three tehsils, which are divided into 59 Union Councils (UCs) 1. Balakot (12 UCs) 2. Mansehra (36 UCs) 3. Oghi (11UCs)
The total number of BISP beneficiaries in district Mansehra is 60,383, with over 135,000 children between the ages of 5-12 years. More than 40,000 beneficiaries and 60,000 children are admitted/ verified under the BISP CCT program.
Selection of Focus Groups The FGD survey targeted the BISP beneficiaries of district Mansehra. The beneficiaries were randomly selected to ensure they are 1) BISP beneficiaries getting UCT as well as CCT grant from government (BISP), 2) members of BISP Beneficiary Committee (BBC), 3) earthquake affectees 4) and mixed groups from both urban and rural settlements of district Mansehra. A total of 6 FGDs were planned, two from urban and four from rural settlements. The FGDs were conducted for feedback of rehabilitation and reconstruction work, livelihood support and other gender sensitive intervention undertaken and the status of BISP unconditional cash transfer (UCT) and the conditional cash transfer (CCT) cash grant to encourage children’s education. For each FGD, 4-12 participants selected to have a manageable group with maximum attention to get the participants feedback/ views.
4 This summary report was prepared by Dr. Nasira Malik, District Supervisor for Mansehra, Khyber Pakhtunkhwa.
46 Appendix 4
Findings from Focus Group Discussions:
Table A4.3. Village-Wise Participant Profile Village/Union Council Number of Number of UCT Number of CCT Age profile of participants (UC) participants beneficiaries beneficiaries Up to 35 36–50 Above 50 Dhaka Mohalla, Chitta 12 12 11 2 10 0 Bhatta, UC Sandesar Babar Colony, Village 4 4 2 1 3 0 and UC Garhi Habibullah Gran Thalli/ 12 12 5 1 7 4 Bhogarmang village, UC Bhogar Mang Kotli Bala, UC Ichrian 12 12 10 1 10 1 Ochri (Ochir+Bari), 12 12 8 4 6 2 UC Mohandri Sandu (Sangar), 12 12 7 4 6 2 UC Ghanool CCT = conditional cash transfer, UCT = unconditional cash transfer. Source: Independent Evaluation Department.
A total of 64 women between the ages of 35–60 years (up to 35 years-30, between 35 to 50 years-66 and above 50 years-14) were selected at two urban and 4 rural locations from over 90 beneficiaries who were approached for the focus group discussions. Most of the women were of 35-50 yrs. age group. All were getting UCT, while only 43 were receiving CCT for school going children between the ages of 5-12 years. All the participants were affected by the October 2005 earthquake.
FGD Questions on BISP
1. Beneficiary feedback on eligibility
For eligibility criteria of BISP grant-UCT question related to survey methodology, inclusion and exclusion of deserving beneficiaries and undeserved beneficiaries were asked. The majority of the participants (67%) were of the opinion that the Poverty score card survey conducted in 2010 was not up to mark in relation to the methodology, (door to door). It was performed in clusters with political influence and biases. At most of the places communities were gathered at one main point/house of well-known person / community center etc by the surveyor, “The surveyor sat in one location and asked us to come and enroll in the survey [did not visit door-to-door]”, “we all were called at Qari Hameed’s house at main Balakot-Naran Road for survey”. Only 33 % participants stated that the surveyor visited their houses. “Survey was done door to door, but results are not transparent”, “Door-to-door survey was conducted and they came to our house”. Over 30% deserving families headed by women/widows were either left out of the survey or not included in cash grant due to ineligibility, “All women were included in the survey, all received survey receipt, but many are not receiving Cash from BISP”, “More than 30 most deserving and poorest women are not receiving BISP grant”, “my mother and brother live separately but do not receive BISP benefits, while I do”, “About 80 HHs are deserving but not receiving cash, they were surveyed but are not in eligible category”. 10 % undeserving women who are well off and have male members in armed forces or abroad etc were included in the survey for cash grant, “There are people in our village who should not be entitled but are included in BISP list. Most of them are from families of people who are working in Saudia (Saudi Arabia) or in the army and are still receiving BISP grants”, sardar caste is living in our near-by mountain, most of their women are receiving BISP grant, while in our village out of 150, only 15 women are receiving BISP grant.” The survey conducted in 2010 has more errors of exclusion of deserving women than errors of inclusion of undeserved ones.
47 Appendix 4
2. Regularity of cash transfer payments
The UCT payment is received quite regularly by all women but CCT payment is irregular. Only 40% of participants reported they were receiving CCT payments on regular basis, “UCT Regularly received.” “The CCT is received when the attendance is verified. The first installment was received with the UCT but one received it after six months, while the majority receive both in time on quarterly basis.” 50 % have irregular payment, “I have received only first installment of CCT”, “only received two instalments.” 10 % did not receive it at all even their children are admitted in schools, “our children are registered and we also received admission slips, by we did not receive CCT”, “and don’t receive CCT while our children were registered”. Furthermore the CCT payment is not received with UCT and they have to visit the ATM point separately, “Do not get it with UCT, and comes separately.”
3. Ease and cost of access of payment
Initially all the women received payment through Post office and they were charged Rs. 50-500 depending upon the amount paid; if large amount then more deduction, “We used to go to the post office to collect our money. The postal worker used to charge us Rs. 50-200 to give us our BISP money.” 19% of the women considered it better option as they had easy access to the post office in the village even they had to wait for quite some time and pay the amount to PO staff, “Post office was very good, no wait, no time, no rush”. 81% of the women preferred ATM/ Ufone even though an average of 2 visits are needed for cash withdrawal, difficulty in travel, biased attitude of bank and Ufone staff and payment of Rs. 50-500 to facility staff, “The debit card is better than payment through the post office. The post office made us wait till late and used to charge more money”, “ATM & Ufone is better than post office”. 55% of the women themselves visit the Bank/ Ufone and 91% draw amount with the assistance of staff by paying the fee, while 9% by themselves. 45% of the cash withdrawal through ATM/Ufone is made by male members of the family.
4. Use of funds
The BISP grant is used mainly for children’s expenses, groceries, loan repayments, and health expenses. 75% of the grant is for groceries, children expenses, loan payment, “My husband is handicapped, his one leg was amputated in the earthquake. Due to poverty, I sent my two sons in Madrassa (Balakot) and other two are studying in the village. My whole cash is spent on my children and grocery”, “we always wait for our installment, upon receipt, we purchase food and other household stuff to pass our time. 20% is for personal and family’s treatment and health expenses, “I am sick, BISP money is totally used on medicines”, “I am suffering from hepatitis C, all is spent on my treatment, that cost 8000- 9000/month”, “My husband is suffering from epilepsy, I use my cash on his treatment.” “My daughter- in-law is also BISP beneficiary and she has cancer, her installment is also used for her treatment”, “My husband is suffering from mental disorder, he works casually to earn money.” Only 5% of the cash is spent on livelihood and income generation, “I purchased 1 hen, I now have three; they lay eggs and full fill our food and nutritional needs”, “we purchased goats a year ago from our installments, both goats have 2 baby goats each, after about 1 year, we will sell them, from each we will earn Rs. 12,000/- besides the number of goats, we get milk for our home use.
5. Benefit of the BISP Beneficiary Committee
All the participants (100%) mentioned the main benefit of the BBC is the opportunity for social networking, “we got introduced especially with Bari Mohalla Beneficiaries”, “BBC has organized us and gave chance to meet each other”, “We get to know each other and also get information about surroundings”.
50% have the benefit of better communication with the BISP program staff for solving their issues and exchange of information about program benefits and problems: “We go to BISP office
48 Appendix 4
for any issue related to debit card and payment“, My daughter in law is a women’s leader (president of BBC) she attended the Women leaders Training and learned a lot about BISP and its waseelas (channels) and she shared all of her learning with the rest of us”. 50 % of beneficiaries have never visited BISP office but know about the programme. 80 % of the BBCs are not mature enough and still need assistance to conduct their meetings and also to visit BISP office at tehsil for resolving their issues. 20% have been visiting the offices with their women’s leader and are confident to run the BBC meetings on their own.
FGD Questions on Earthquake Reconstruction and Livelihoods Support
6. Impact of the 2005 earthquake:
In October 2005 an earthquake of 7.6 magnitude struck the northern areas of Pakistan. District Mansehra which was the worst affected district of NWFP in terms of 15,997 human lives lost, 9,903 major injuries and great destruction to physical infrastructure: 108,283 (71%) houses were completely damaged/destroyed and 34,001 (22%) were partially damaged, while 10,673 (7%) were negligibly damaged. Education sector faced very heavy losses in terms of destruction of school buildings. Besides, loss of lives of the students and teachers was unimaginably higher. There were 935 institutions recorded as fully destroyed and some 624 partially damaged by the earthquake. The district also suffered significant loss of livelihood due to the earthquake that has caused damage to the land, crops, livestock, and infrastructure. The earthquake created thousands of widows due to death of the husbands. Many became the household head and bread earner due to disabilities of men in the family.
The table below shows the overall and personal damage and loss of infrastructure, deaths, injuries, livestock and socioeconomic impact of earthquake in the villages where FGDs were conducted.
Table A4.4. Damages from 2005 Earthquake Village & Loss or injury to member Damage to public services Union Council Loss/damage to house of household Loss of livestock (such as roads, schools, etc) Dhaka 11 houses fully 5 households suffered loss 9 households All public infrastructure was Mohalla, destroyed and people of life, and one injured. suffered loss of destroyed for 11 households Chitta Bhatta, relocated; 1 home One extended family from livestock and UC Sandesar partially destroyed Balakot lost 14 people property Temporary camp after earthquake washed away by flood; two families lost all belongings in the flood Babar Colony 1 house fully damaged 3 households suffered No livestock Hospital UC 3 houses partially from Injuries School Garhi damaged 3 people died in 1 UC Office Habibullah household Road Gran Thalli & 9 houses were fully 2 died in two beneficiaries Did not have School, Mosque dispensary Botang UC damaged and houses livestock at Bhogarmang Bhogar Manag destroyed, 3 were 9 injured in 4 HHs damaged but were not 1 participant injured due livable to leg fracture Kotli Bala, 5 houses of 5 injured in 4 HH 0 School, Ichrian participants totally Drinking Water Supply destroyed Scheme 5 houses partial 2 women were tenants/houses destroyed
49 Appendix 4
Village & Loss or injury to member Damage to public services Union Council Loss/damage to house of household Loss of livestock (such as roads, schools, etc) 2 children of 1 woman came under school wall but remained safe Ochri+Bari 12 houses fully 4 died in 4 HH 2 cows School, destroyed 3 women injured in 3 HH, 2 goats Drinking Water Supply 1 woman’s son’s arm Scheme (DWSS) separated, he is disabled and can’t do anything Sandu 12 houses fully 1-2 deaths and injuries in All cows and GPS,GGPS (Sangar), destroyed all participants’ houses goats Ghanool
Almost all the women were earthquake affectees; 20% have been relocated to other villages and tehsils of Mansehra and 29 % are still living in shelters/ incomplete or rented houses. After the earthquake they were shifted to camps for over 6 months and later relocated due to floods to other camp areas. 81 % of the infrastructure was completely damaged and destroyed. 19% was partially damaged but was not in livable condition. 23% of the families had casualties in the form of deaths, 77% suffered major injuries and disabilities. 64% of the livestock and property destroyed. Most of the public infrastructure, schools, roads, hospitals, water source, mosques and government buildings were completely destroyed.
7. Assistance for house reconstruction
20% of the women do not recall who provided the assistance after the earthquake, “we don’t know, as we were in tents away from here”. 80% reported that ERRA, Army, NGOS and Mr. Adnan (a philanthropist) provided support for reconstruction, rehabilitation and livelihood restoration. 23 families received 3 cheques (25, 000, 50,000 &75,000) for construction of houses according to seismic specification. 31 male members were trained and only 18 constructed houses as per specification.
8. Assistance for reconstructing public works
At almost all the places schools, roads, mosque, water supply and other public facilities were reconstructed by ERRA, Army, an NGO and a philanthropist. No hospital facility is available at most of the places. At Ghari Habibullah, one Rural Health Centre was reconstructed but there is no doctor in the hospital and patients have to travel to Mansehra for treatment, No health facility and roads constructed except the jeep road was repaired”, “Not much work done apart from houses reconstruction”. At Jared Balakot children are still studying under shelter and in open places.
9. Additional benefits or programs for women
No formal additional measures and programs by the government were initiated specifically for women’s involvement in income generation. Few NGOs provided support of livestock (cows, goats), skill development for tailoring, gardening and donated sewing machines, gardening kits, seeds etc. Water supply schemes provided at one or two location save time spent on bringing water from nearby streams. The few vocational centers established are located far away, and young girls and women cannot access it due to security reasons, “One vocational Training center was established but cannot go as it is far and not safe to go there. (Garhi Habibullah)”
10. Participant recommendations to improve future programs:
The next survey should be conducted door-to-door, or gather all of us in one place so that we can answer all the questions correctly. That will ensure that the poor women who are left out of BISP can be enrolled.
50 Appendix 4
Political agents should be avoided during survey to avoid favoritism, so that all deserving could be surveyed properly and non-deserving could be prevented from becoming eligible. Undeserved families should be excluded from BISP grants BBCs should be involved in the survey as they know all the people in the village Schools for boys and girls should be reconstructed (Jared, Sandu) Livelihoods support and trainings for women should be focused in future, e.g. household level income generation activities, hand embroidery, food preservations, marketing (Jared) Hospital facilities should be provided along with Doctors and staff Multiple ATMs should be installed at places for easy access A vocational center (for tailoring training) is needed in the village, where we and our daughters can learn sewing and cutting, which will help us to save dress sewing costs. We will also start tailoring on commercial basis”
Observations and Comments by Evaluation Team:
BISP In most locations more women than expected participated in the FGDs. Many visited just to record their concerns pertaining to poverty and issuance of BISP grant. Women even waited for hours to meet the team. BISP cash grant has provided many families with means of living, and improved their social status, mobility and empowered them to raise their voices for their betterment and resolving their issues. However in one location only 4 members of the BBC could attend the FGD because the research team arrived late and other women had to return to their homes located at greater distance from the main village.
In the 2010 national socioeconomic survey many deserving families were missed and some undeserving women were included. The future survey should be monitored more carefully and conducted door-to- door to reduce the errors of inclusion and exclusion.
The irregularity in CCT payment may be due to delay in release of payment by BISP, or school change by the beneficiaries, leading to lengthy process of case management, or sometimes due to attendance compliance for two quarters being combined due to vacations (summer and winters) in schools.
Earthquake assistance Apart from the infrastructure damage, human lives and livestock loss in participants’ houses many village infrastructure was completely destroyed along with other livestock and public infrastructure as in Sandu, Ochri and Kotli Bala. The rehabilitation and reconstruction work was undertaken in the earthquake-affected areas of Mansehra but still many villages are lacking basic public facilities, safe drinking water, schools, hospitals and proper roads. The houses were not reconstructed as per seismic specification due to lack of training and funds provision. Negligible support was provided for livelihood restoration and women’s skill enhancement. Training was not provided to most of the women.
51 Appendix 5
List of Persons/Organizations Met
Ministries and Government Agencies
Ministry of Finance Tariq Bajwa, Secretary Economic Affairs Division Anjum Assad Amin, Additional Secretary-I, Economic Affairs Division Amjad Mahmood, Joint Secretary, Finance Division
Ministry of Planning, Development & Reform Yousaf Naseem Khokhar, Secretary Nisar Ahmed, Deputy Chief, Planning Commission, Planning and Development Division Naeem uz Zafar, Member Social Sectors, Planning Commission
Ministry of Human Rights Humera Azam Khan, Joint Secretary Arshad Mahmood, Director General
Ministry of Law & Justice Nayla Qureshi, Acting Secretary Raja Naeem, Legislative Advisor Moazzam Warraich, Assistant Director Iftikhar Anjum, Deputy Secretary Development, Development Wing
National Commission on the Status of Women (NCSW) Khawar Mumtaz, former Chairperson, NCSW Samina A. Hasan, Secretary, NCSW Shahid Iqbal Khan, Director, NCSW, Ministry of Human Rights Suleman, Director Programmes Shahid Iqbal Khan, Director Administration and Finance Khalid Imran, Programme Officer Fareeha Bajwa, Consultant, Research Alam Bajwa, Consultant, Research
Benazir Income Support Programme (BISP) Marvi Memon, Chairperson Dr. Muhammad Tahir Noor, Director General – National Socio-Economic Registry/Management Information System (NSER/MIS) Humaira Mufti, Director General (Cash Transfers) Dr Muhammad Najeeb Khan, Director, Waseela-e-Taleem (Education) Dr. Iram Shaikh, Director, Waseela-e-Sehat (Health) Syed Asif Ali, Director, Waseela-e-Rozgar (Livelihoods) Syed Ahmad Mumtaz, Director, Donor Coordination Zeba Sathar, Country Director, Population Council, Pakistan, and Member, BISP Board of Directors
National Highway Authority Abdul Ghaffar, General Manager (EALS) Aamera Riaz, Deputy Director (LM&S) (focal point for ADB) Shaukat Ali Shahid, Resettlement Specialist (SSMC) Saira Roohi, Gender Specialist (SSMC)
Earthquake Reconstruction and Rehabilitation Authority Lt. Gen Nadeem Ahmed, Managing Director & CEO Mari Petroleum Company Ltd. (former Director General, Earthquake Reconstruction and Rehabilitation Authority and Director General National Disaster Management Authority)
52 Appendix 5
National Institute of Management Muhammad Naeemul Haq, Director General (former member National Reconstruction Bureau)
Quaid-i-Azam University, Islamabad Dr. Farzana Bari, Director, Gender Studies Department,
Government of Punjab Dr. Mahmood Khalid Qamar, Member (Social Sectors), Planning and Development Department Muhammad Irfan Elahi, Secretary, Cabinet Secretariat (Aviation Division), former Chair, Planning & Development Department, Government of Punjab Fauzia Viqar, Chairperson, Punjab Commission on the Status of Women
Development Partners
The World Bank Illango Patchamuthu, Country Director, Pakistan Anthony Cholst, Operations Adviser Imtiaz Alvi, Senior Rural Development Specialist Amena Raja, Operations Officer Sana Shahid Ahmed, Operations Analyst
Department for International Development Dr. Louise Walker, Group Head, Economic Growth Group Mazhar Siraj, Team Leader and Social Development Adviser, Economic Inclusion and Poverty Shamas Bajwa, Infrastructure Adviser, Economic Growth Group
UN Women Fareeha Ummar, Programme Specialist – WLSR, UN Women
Pakistan Poverty Alleviation Fund Qazi Azmat Isa, Chief Executive Officer Samia Liaquat Ali Khan, Group Head, Compliance and Quality Assurance
National Rural Support Programme Dr. Rashid Bajwa, Chief Executive Officer Jawad Ahmed, Director Operations Malik Fateh Ali, Manager Operations (former Project Director, Sustainable Livelihoods Barani Areas Development Project)
Rural Support Programmes Network (RSPN) Shoaib Sultan Khan, Chairman, Board of Directors, RSPN/NRSP Khalil Ahmed Tetlay, Acting Chief Executive Officer/Chief Operating Officer, RSPN Muzaffar Ud Din, General Manager, Aga Khan Rural Support Programme
Aurat Foundation M. Younas Khalid, Chief Strategy & Policy Simi Kamal, Chief of Party, Gender Equity Programme
Asian Development Bank, Pakistan Resident Mission (PRM) Sunil Mitra, Deputy Country Director Donneth A. Walton, Unit Head, Project Administration Guntur Sugiyarto, Principal Economist Ismat Shahjehan, Project Officer (former Gender Specialist PRM) Munir Abro, Head, Social Sectors M. Shaukat Shafi, Disaster Relief Management Specialist Uzma Altaf, Gender Consultant
53 Appendix 5
Field Visits
District Bagh, Azad Jammu and Kashmir Ms. Afandi, Assistant Director, Benazir Income Support Programme, Bagh Mohammad Ajmal Khan, Assistant Compliance Officer, BISP Bagh Raja Maroof, Data Entry Operator, NADRA (based at BISP Bagh) Syed Shafqat Gardezi, District Programme Officer, National Rural Support Programme Shabbir Sheikh, District Programme Officer, AJK Community Development Programme Masood Ahmed, Manager, SAMBA Bank Members of BISP Beneficiary Committee at one urban and one rural location
District Mansehra, Khyber Pakhtunkwa Mohammad Ali, Assistant Director, Balakot Muhammad Hussain, Assistant Director, Mansehra Members of BISP Beneficiary Committee at one urban and one rural location
54