Completion Report Project Number: 26326 Loan Number: 1534-PAK[SF] November 2007 PAKISTAN: Second Science Education Sector Project CURRENCY EQUIVALENTS Currency Unit – Pakistan rupee/s (PRe/PRs) At Appraisal At Project Completion (31 July 1997) (30 June 2007) PRe1.00 = $0.025 $0.017 $1.00 = PRs40.56 PRs60.00 ABBREVIATIONS ADB – Asian Development Bank BME – benefit monitoring and evaluation EA – executing agency ECNEC – Executive Committee of the National Economic Council FATA – Federally Administered Tribal Areas FCU – federal coordinating unit IPSET – Institute for the Promotion of Science Education and Training M&E – monitoring and evaluation MOE – Ministry of Education MPL – multipurpose laboratory MRR – mathematics resource room NEEC – National Education Equipment Center NISTE – National Institute for Science and Technical Education NSAC – National Scientific Advisory Committee NSC – National Steering Committee NWFP – North-West Frontier Province OECF – Overseas Economic Cooperation Fund PCC – provincial coordination committee PC-I – Planning Commission Proforma I PED – provincial education department PIU – project implementation unit RRP – report and recommendation of the President SAP – Social Action Programme SEC – science education center SHS – science high school NOTES (i) The fiscal year (FY) of the Government of Pakistan and its agencies ends on 30 June. FY before a calendar year denotes the year in which the fiscal year ends, e.g., FY2007 ends on 30 June 2007. (ii) In this report, "$" refers to US dollars. (iii) “Government” refers to the Government of Pakistan. Vice President L. Jin, Operations 1 Director General J. Miranda, Central and West Asia Regional Department Director P. Fedon, Pakistan Resident Mission Team leader S. Abbas, Senior Project Implementation Officer, Pakistan Resident Mission Team member N. Islam, Associate Project Analyst, Pakistan Resident Mission CONTENTS Page BASIC DATA ii MAP vi I. PROJECT DESCRIPTION 1 II. EVALUATION OF DESIGN AND IMPLEMENTATION 1 A. Relevance of Design and Formulation 1 B. Project Outputs 3 C. Project Costs 7 D. Disbursements 8 E. Project Schedule 8 F. Implementation Arrangements 9 G. Conditions and Covenants 9 H. Consultant Recruitment and Procurement 10 I. Performance of Consultants, Contractors, and Suppliers 10 J. Performance of the Borrower and the Executing Agencies 11 K. Performance of the Asian Development Bank 11 III. EVALUATION OF PERFORMANCE 12 A. Relevance 12 B. Effectiveness in Achieving Outcome 12 C. Efficiency in Achieving Outcome and Outputs 13 D. Preliminary Assessment of Sustainability 13 E. Impact 13 IV. OVERALL ASSESSMENT AND RECOMMENDATIONS 13 A. Overall Assessment 13 B. Lessons 13 C. Recommendations 14 APPENDIXES 1. Project Framework 15 2. List of Facilities Upgraded 24 3. Staff Development Program 57 4. Project Costs 59 5. Disbursement Schedule 60 6. Project Implementation Schedule 62 7. Status of Compliance with Loan Covenants 65 8. Consulting Services 77 9. Project Rating 79 BASIC DATA A. Loan Identification 1. Country Pakistan 2. Loan Number 1534-PAK[SF] 3. Project Title Second Science Education Sector Project 4. Borrower Islamic Republic of Pakistan 5. Executing Agency (a) Ministry of Education, Federal (b) Department of Education, Balochistan (c) Department of Education, Federally Administered Tribal Areas (FATA) (d) Department of Education, North-West Frontier Province (NWFP) (e) Department of Education, Punjab 6. Amount of Loan SDR29,442,000 7. Project Completion Report PCR: PAK 1008 Number B. Loan Data 1. Appraisal – Date Started 3 April 1997 – Date Completed 28 April 1997 2. Loan Negotiations – Date Started 30 July 1997 – Date Completed 8 August 1997 3. Date of Board Approval 11 September 1997 4. Date of Loan Agreement 7 September 1998 5. Date of Loan Effectiveness – In Loan Agreement 6 December 1998 – Actual 1 March 1999 – Number of Extensions 1 6. Closing Date – In Loan Agreement 30 June 2004 – Actual 28 June 2007 – Number of Extensions 3 7. Terms of Loan – Interest Rate 1% – Maturity (years) 35 – Grace Period (years) 10 8. Disbursements a. Dates iii Initial Disbursement Final Disbursement Time Interval 6 August 1999 28 June 2007 94 months Effective Date Original Closing Date Time Interval 1 March 1999 30 June 2004 64 months b. Amount (SDR million) Last Net Original Revised Amount Amount Amount Undisbursed Category Allocation Allocation Canceled Available Disbursed Balance 01 7.64 7.84 (0.20) 7.84 7.84 0.00 02 5.68 3.96 1.72 3.96 3.96 0.00 03 5.17 3.41 1.76 3.41 3.41 0.00 04 0.49 0.27 0.22 0.27 0.27 0.00 05 5.48 0.79 4.69 0.79 0.79 0.00 06 3.87 0.94 2.94 0.94 0.94 0.00 07 1.11 0.56 0.55 0.56 0.56 0.00 Total 29.44 17.77 11.68 17.77 17.77 0.00 9. Local Costs (Financed) - Amount ($ million) 19.3 - Percent of Local Costs 61.5 - Percent of Total Cost 64.3 C. Project Data 1. Project Cost ($ million) Cost Appraisal Estimate Actual Foreign Exchange Cost 15.0 5.0 Local Currency Cost 60.0 25.0 Total 75.0 30.0 2. Financing Plan ($ million) Cost Appraisal Estimate Actual Implementation Costs Borrower Financed 15.0 5.7 ADB Financed 37.5 23.5 Other External Financing 20.0 0.0 Total 72.5 29.2 IDC Costs Borrower Financed 0.0 0.0 ADB Financed 2.5 0.8 Other External Financing 0.0 0.0 Total 75.0 30.0 ADB = Asian Development Bank, IDC = interest during construction. iv 3. Cost Breakdown by Project Component ($ million) Component Appraisal Estimate Actual Civil Works 26.0 11.4 Furniture, Equipment, and Vehicles 17.2 6.6 Staff Development 8.3 5.5 Consulting Services 1.3 0.4 Instructional Materials 11.8 1.1 Federal Areas 1.9 1.7 Project Implementation 3.5 1.4 Incremental Salary 2.5 1.1 Service Charge 2.5 0.8 Total 75.0 30.0 4. Project Schedule Item Appraisal Estimate Actual Date of Contract with Consultants 1 April 1998 1 September 2003 Completion of Engineering Designs Civil Works Contract Date of Award 1 January 1998 1 January 2000 Completion of Work 31 December 2002 30 December 2006 Equipment and Supplies Dates First Procurement 1 January 1999 15 November 2000 Last Procurement 30 June 2003 31 October 2006 Completion of Equipment Installation 31 December 2006 Start of Operations Completion of Tests and Commissioning Beginning of Start-Up Other Milestones 5. Project Performance Report Ratings Ratings Development Implementation Implementation Period Objectives Progress From 29 November 1998 to 31 December 2000 Satisfactory Satisfactory From 1 January 2001 to 28 February 2001 Satisfactory Highly Satisfactory From 1 March 2001 to 31 March 2001 Satisfactory Incomplete From 1 April 2001 to 31 December 2005 Satisfactory Satisfactory From 1 January 2005 to 30 April 2005 Satisfactory Unsatisfactory From 1 May 2005 to 31 December 2006 Satisfactory Satisfactory v D. Data on Asian Development Bank Missions No. of No. of Specialization Name of Mission Date Persons Person-Days of Membersa Appraisal 3–28 April 1997 5 67 a, b, c, d, g Inception 1–16 December 1999 2 32 c, e Review 19–29 September 2000 1 11 c Review 12 April–5 May 2001 2 8 e, f Midterm Review 29 April–20 May 2002 2 24 e, f Review 5–29 March 2003 2 18 e, f Review 17–18 March 2004 2 3 e, f Review 22 December 2005– 2 10 e, h 31 January 2006 Review 10–19 May 2006 2 12 e, h Project Completion Review 28 May–15 June 2007 2 25 e, h a a = counsel, b = economist, c = education specialist, d = project economist, e = project analyst, f = project implementation officer, g = senior personnel officer, h = senior project implementation officer. vi I. PROJECT DESCRIPTION 1. Pakistan’s social indicators are among the poorest in the world, reflecting low levels of investment in education and health. This situation deprives the country of the requisite human capital to sustain economic growth. Cognizant of the importance of education in improving basic employment skills and household welfare, the Government of Pakistan undertook initiatives to improve elementary education through the Social Action Programme (SAP). 1 It also sought to improve secondary education with a view to increasing the number of graduates capable of understanding problems related to the environment, technology, health, and population. One of these efforts was the Science Education for Secondary Schools Sector Project2 (the first project) financed by the Asian Development Bank (ADB). Following its successful completion, the Government requested ADB financing for a second project. 2. The rationale for the Second Science Education Sector Project (the Project) was to build on the achievements of its predecessor, which introduced a new science curriculum and textbooks, as well as teacher training in science, in about 20% of secondary schools with science programs. The Project was to introduce the science curriculum in all secondary schools with science programs, and extend the coverage of existing public secondary schools eligible for science facilities in the three participating provinces of Balochistan, North-West Frontier Province (NWFP), and Punjab, and in the Federally Administered Tribal Areas (FATA). 3. The Project’s objective was to increase the number of grade 10 graduates who have received better science training through the implementation of an improved and sustainable system of science and teaching for grades 6–10, especially for girls. This required linking the curriculum and textbook content with teaching practice and testing through a network of federal and provincial institutions and staff. The Project also intended to further refine policies in secondary education to emphasize general access to the new curriculum for girls, encourage quality improvements over expansion, promote public–private school partnerships via facility sharing, give recognition to master trainers, and strengthen monitoring and coordination.