The World Bank Report No: ISR14108

Implementation Status & Results , Republic of RY Higher Education Quality Improvement (P110733)

Operation Name: RY Higher Education Quality Improvement (P110733) Project Stage: Implementation Seq.No: 10 Status: ARCHIVED Archive Date: 10-May-2014 Country: Yemen, Republic of Approval FY: 2010

Public Disclosure Authorized Product Line:IBRD/IDA Region: MIDDLE EAST AND NORTH AFRICA Lending Instrument: Specific Investment Loan Implementing Agency(ies): MOHESR PMU Key Dates Board Approval Date 29-Apr-2010 Original Closing Date 31-Aug-2016 Planned Mid Term Review Date 15-Apr-2013 Last Archived ISR Date 18-Nov-2013 Public Disclosure Copy Effectiveness Date 01-Sep-2010 Revised Closing Date 31-Dec-2017 Actual Mid Term Review Date 23-Mar-2013

Project Development Objectives Project Development Objective (from Project Appraisal Document) The Project Development Objective (PDO) is to create enabling conditions for the enhancement of quality of university programs and graduate employability.

Has the Project Development Objective been changed since Board Approval of the Project?

Yes No Public Disclosure Authorized Component(s)

Component Name Component Cost Quality Improvement for University Programs 8.30 Quality Assurance 1.30 Institutional Capacity Development 0.70 M&E and Project Management 2.70

Overall Ratings Previous Rating Current Rating Progress towards achievement of PDO Moderately Satisfactory Moderately Satisfactory Overall Implementation Progress (IP) Moderately Satisfactory Moderately Satisfactory Public Disclosure Authorized Overall Risk Rating Substantial

Implementation Status Overview The Ministry of Higher Education and Scientific Research (MOHESR), the Project Management Unit (PMU), and the implementing entities continue to show strong commitment to the project objectives and associated activities despite challenging country conditions. Public Disclosure Copy

Page 1 of 9 Public Disclosure Authorized The World Bank Report No: ISR14108

There is a clear appreciation by universities of the paradigm shift which HEQIP brings to the sector in relation to the linkages between university program design and delivery and the job market, and the development of a quality assurance culture. Locations Country First Administrative Division Location Planned Actual Yemen Not Entered Republic of Yemen

Yemen Muhafazat Ta`izz Ta`izz

Yemen Amanat Al Asimah Sanaa

Yemen Muhafazat Ibb Ibb

Public Disclosure Copy Yemen Muhafazat Hadramawt Muhafazat Hadramawt

Yemen Muhafazat Dhamar Dhamar

Yemen Omran `Amran

Yemen Muhafazat al Hudaydah Al Hudaydah ✔

Yemen Aden Aden

Results

Project Development Objective Indicators Indicator Name Core Unit of Measure Baseline Current End Target QIF programs adopting mechanisms to ensure Percentage Value 0.00 75.00 65.00 the quality of undergraduate program Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 development and delivery. Comments 9 out of 12 programs are adopting agreed mechanisms as per indicator definition. Three of the programs: Computer Since Program – Hajja University, Computer Network Program – and E-learning Program – Hodiedah University) are lagging behind but taking serious steps to catch up. QIF programs adopting mechanisms to Percentage Value 0.00 66.00 65.00 Public Disclosure Copy enhance graduate employability Date 21-Sep-2010 21-Apr-2014 31-Dec-2017

Page 2 of 9 The World Bank Report No: ISR14108

Comments 8 out of 12 programs fulfill the agreed elements of the definition; while the remaining 4 (Computer Science Program – Hajja University; Computer Networking and Distribution System - Taiz University, Basic Education Program – Sana’a University, and E-learning Program - Hodiedah University) are taking conducive steps

Public Disclosure Copy towards graduate employability as per the definition. Public universities with functioning QA Percentage Value 0.00 0.00 75.00 mechanisms Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 Comments A number of steps were taken: 10 quality weeks training modules developed and being delivered in universities; the QA standards andManual for Level 1 and 2 have been finalized; 80 assessors have been trained to apply Level 1 standards and are ready to assist theHEIs for self-assessments; Level 1 standards and manual are being applied by several colleges. Direct project beneficiaries Number Value 0.00 3025.00 0.00 Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 Comments these include:

1. Students enrolled in the 12 QIF programs. 2. University academic staff receiving professional development eitheraffiliated to QIT or UQAT.

Public Disclosure Copy 3. CAQAY council members receiving capacity

Page 3 of 9 The World Bank Report No: ISR14108

building 4. MOHESR staff trained 5. Taiz University fiduciarystaff trained Female beneficiaries Percentage Value 0.00 17.00 0.00 Sub Type Supplemental Female Beneficiaries Number Value 0.00 504.00 Sub Type Supplemental Public Disclosure Copy 5. Taiz University fiduciary staff trained Number Value 0.00 63.00 Sub Type Supplemental 4. MOHESR staff trained Number Value 0.00 0.00 Sub Type Supplemental 3. CAQAY council members receiving Number Value 0.00 16.00 capacity building Sub Type Supplemental 2. University academic staff receiving Number Value 0.00 1521.00 professional development either affiliated to Sub Type QIT or UQAT. Supplemental 1. Students enrolled in the 12 QIF Number Value 0.00 1425.00 programs. Sub Type Supplemental

Intermediate Results Indicators Public Disclosure Copy

Page 4 of 9 The World Bank Report No: ISR14108

Indicator Name Core Unit of Measure Baseline Current End Target QIF procedures manual developed Yes/No Value No Yes Yes Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 Comments It was also agreed to further elaborate the M&E section in the QIF manual to ensure effective engagement of the QITs and consistency between the project results framework and the program's log frame.

Public Disclosure Copy PIRC established Yes/No Value No Yes Yes Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 Comments The Bank team notes that the Project Identification and Review Committee (PIRC) is taking an active role in monitoring and guiding project implementation, and strongly supports this initiative. QIF proposals approved by MOHESR Yes/No Value No Yes Yes Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 Comments QIF Programs with timely achievement of Percentage Value 0.00 66.00 65.00 annual Performance Agreement targets Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 Comments 8 out of 12 programs have shown consistent commitment to PA, while 4 would require more intensive follow-up from PMU. It was agreedto amend the PA as detailed in the attached Aide Memoire. QIF Programs establishing a formal Number Value 0.00 5.00 8.00 arrangement for professional development with Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 regional and/or international universities Comments Five QIF programs signed MOUs with regional/ international HEIs and follow

Public Disclosure Copy through with specific

Page 5 of 9 The World Bank Report No: ISR14108

agreements towards professional development, peer review, etc... Quality Assurance Council (CAQAY) Yes/No Value No Yes Yes established Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 Comments For the purpose of promoting a quality culture, CAQAY has at least one media event every month. CAQAY developed and distributed a brochure to the universities in January 2014, which focused Public Disclosure Copy on the Quality Week Program at Yemeni Universities. CAQAY will develop a tracking system for QA activities, and a contract is currently being negotiated for this, to be signed on April 30, 2014. Quality assurance strategic plan developed Yes/No Value No No Yes and finalized by CAQAY Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 Comments The strategic plan for CAQAY was developed and has gone through an external review process. The strategic plan is expected to be finalized and adopted by June 2014. Standards and procedural manual for Yes/No Value No No Yes implementing internal QA reviews prepared by Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 CAQAY Comments (i) The Quality Assurance Standards and Manual for Level 1 and 2 have been finalized; (ii) 80 assessors have been trained to apply Level 1 standards and are ready to assist the HEIs for self-assessments; (iii) Level 1 standards and manual are being applied by several colleges. Public Disclosure Copy

Page 6 of 9 The World Bank Report No: ISR14108

Trained peer reviewers conduct regular on-site Yes/No Value No No Yes visits as part of internal review process Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 verification Comments Response to self-assessment is low so far. This can potentially improve with further clarification of the purpose of self-assessment and its value added to program quality. Quality Week Training Modules to develop Number Value 0.00 8.00 12.00 project universities’ capacity in quality Date 21-Sep-2010 21-Apr-2014 31-Dec-2017

Public Disclosure Copy assurance concepts and practices developed and delivered by CAQAY Comments 8 out of 12 Quality Modules have been developed - to be reviewed. Since the September 2013 mission, Quality Weeks (QWs) were conducted in Sana’a University, , and . Over 100 faculty members were trained. Four more QWs are planned for Taiz University, , Aden University and Hodeidha University. Higher education KPIs formally endorsed by Yes/No Value No Yes Yes MOHESR Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 Comments Higher education statistical yearbook produced Yes/No Value No No Yes by MOHESR Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 Comments TOR cleared in November 1, 2013; with only one response to the advertisement. Contract to be awarded by August 2014. Satisfactory results of fiduciary capacity Yes/No Value No No Yes assessment of Taiz University Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 Comments Manual for the new procedures in the areas of Public Disclosure Copy financial management, procurement, and internal

Page 7 of 9 The World Bank Report No: ISR14108

audit approved by the University Council. Specific action items were agreed for MOF approval of the Manual of Procedures. This would facilitate the adoption of the new procedures at the university level. In addition, it was agreed to proceed with: (i) manual piloting of the new procedures, and (ii) moving to an automated system once the procedures are Public Disclosure Copy adequately implemented. Quarterly progress reports produced on time Yes/No Value No Yes Yes Date 21-Sep-2010 21-Apr-2014 31-Dec-2017 Comments Q1/ 2014 draft report was discussed during the mission and will be finalized by April 30, 2014. Annually audited financial statements Yes/No Value Yes Yes submitted on time Date 21-Apr-2014 31-Dec-2017 Comments

Data on Financial Performance (as of 13-Mar-2014)

Financial Agreement(s) Key Dates Project Ln/Cr/Tf Status Approval Date Signing Date Effectiveness Date Original Closing Date Revised Closing Date P110733 IDA-H5580 Effective 29-Apr-2010 28-Jun-2010 01-Sep-2010 31-Aug-2016 31-Dec-2017

Disbursements (in Millions) Project Ln/Cr/Tf Status Currency Original Revised Cancelled Disbursed Undisbursed % Disbursed P110733 IDA-H5580 Effective XDR 8.50 8.50 0.00 3.31 5.19 39.00

Disbursement Graph Public Disclosure Copy

Page 8 of 9 The World Bank Report No: ISR14108 Public Disclosure Copy

Key Decisions Regarding Implementation An action plan for the coming six months was agreed and the World Bank team will continue to intensify its implementation support including regular audio meetings with the PMU. The Bank Team will return for a mission in Sana's in September/ October 2014.

Restructuring History Level 2 CD Decision on 29-Jul-2013

Related Projects P150129-RY Higher Education Quality Improvement Project - Additional Financing Public Disclosure Copy

Page 9 of 9