Project Performance Audit Report
Total Page:16
File Type:pdf, Size:1020Kb
ASIAN DEVELOPMENT BANK PPA: INO 15059 PROJECT PERFORMANCE AUDIT REPORT ON THE MARINE SCIENCES EDUCATION PROJECT (Loans 894-INO/895-INO[SF]) IN INDONESIA July 2000 CURRENCY EQUIVALENTS Currency Unit – Rupiah (Rp) At Approval At Completion At Operations Evaluation Rp1.00 = $0.000607 $0.000425 $0.0002 $1.00 = Rp1,647 Rp2,348 Rp4,185 ABBREVIATIONS ADB – Asian Development Bank AR – appraisal report BAPPENAS – Badan Perencanaan Pembangunan Nasional (National Development Planning Agency) BME – benefit monitoring and evaluation CPIU – Central Project Implementation Unit DGHE – Directorate General of Higher Education EA – executing agency IPB – Institut Pertanian Bogor (Institute of Agriculture) LPIU – local project implementation unit MSc – master of science MSE – marine sciences education MSEP – Marine Sciences Education Project O&M – operation and maintenance OEM – Operations Evaluation Mission PBME – project benefit monitoring and evaluation PCR – project completion report PhD – doctor of philosophy PPAR – project performance audit report REPELITA IV – Rencana Pembangunan Lima Tahun IV (Fourth Five-Year Development Plan) RRP – report and recommendation of the President S1 – bachelor’s degree S2 – master’s degree S3 – doctoral degree TA – technical assistance UNDIP – University of Diponegoro UNHAS – University of Hasanuddin UNPATTI – University of Pattimura UNRI – University of Riau UNSRAT – University of Sam Ratulangi NOTES (i) The fiscal year (FY) of the Government ends on 31 March. (ii) The school year (SY) in Indonesia starts in September and ends in June of the following year. (iii) In this report, “$” refers to US dollars. Operations Evaluation Office, PE - 547 CONTENTS Page BASIC PROJECT DATA ii EXECUTIVE SUMMARY iii MAP v I. BACKGROUND 1 A. Rationale 1 B. Formulation 1 C. Objectives and Scope at Appraisal 1 D. Financing Arrangements 2 E. Completion 2 F. Operations Evaluation 3 II. IMPLEMENTATION PERFORMANCE 3 A. Design 3 B. Contracting, Construction, and Commissioning 5 C. Organization and Management 5 D. Actual Costs and Financing 6 E. Implementation Schedule 7 F. Technical Assistance 7 G. Compliance with Loan Covenants 7 III. PROJECT RESULTS 7 A. Operational Performance 7 B. Institutional Development 9 C. Financial Performance 10 D. Socioeconomic and Sociocultural Results 10 E. Gender and Development 11 F. Environmental Impacts and Control 11 G. Gestation and Sustainability 11 IV. KEY ISSUES FOR THE FUTURE 12 A. Project Design 12 B. Local vs. Central Ownership 12 C. Program Sustainability 13 D. Resource Utilization 13 E. Management 13 F. National Coordination 14 V. CONCLUSIONS 14 A. Overall Assessment 14 B. Lessons Learned 15 C. Follow-Up Actions 16 APPENDIXES 17 BASIC PROJECT DATA Marine Sciences Education Project (Loans 894-INO and 895-INO[SF]) PROJECT PREPARATION Person- TA No. TA Name Type Months Amount Approval Date 844-INO Marine Sciences PPTA 17.5 $350,000 12 January 1987 Education As per ADB KEY PROJECT DATA ($ million) Loan Documents Actual Total Project Cost 91.6 75.6 Foreign Currency Cost 54.5 46.8 ADB Loan Amount/Utilization 73.3 66.3 ADB Loan Amount/Cancellation 8.8 KEY DATES Expected Actual Fact-Finding 9-27 Nov 1987 Appraisal 7-25 Mar 1988 Loan Negotiations 14-22 Jun 1988 Board Approval 14 Jul 1988 Loan Agreement 4 Nov 1988 Loan Effectiveness 2 Feb 1989 24 Feb 1989 Project Completion 30 Sep 1994 30 Nov 1995 Loan Closing 31 Mar 1995 28 Jan 1997 Months (effectiveness to completion) 68 82 BORROWER Republic of Indonesia EXECUTING AGENCY Directorate General of Higher Education, Ministry of Education and Culture (now Ministry of National Education) MISSION DATA Type of Mission Missions (no.) Person-Days (no.) Fact-Finding 1 19 Appraisal 1 18 Loan Inception 1 10 Project Administration - Loan Review 12 74 - Loan Disbursement 1 9 - Project Completion 1 15 Operations Evaluation 1 26 ________________________ ADB = Asian Development Bank, PPTA = project preparatory technical assistance, TA = technical assistance. EXECUTIVE SUMMARY Great expectations, mixed outcomes The shortage of marine scientists and technicians has hindered the full utilization of Indonesia’s ample marine resources. Under the Fourth Five-Year Development Plan special attention was to be given to tertiary level programs in science and technology, particularly in the outer islands. The Marine Sciences Education Project was formulated to diversify the economy away from oil products, improve nutrition, and train professional-level human resources in marine sciences to optimize the utilization of marine resources under sustainable conditions. Strategies to achieve these objectives were to establish a new marine sciences education program, improve academic and other support services, develop research capacity, and upgrade existing facilities and construct new facilities at six universities. Beneficiaries were to be undergraduate students, university personnel, public and private employers of marine science graduates, coastal communities, and the population as a whole. Components included consultant services, fellowships, civil works, equipment, educational media and software, and funds for operation and research. Two loans were provided for a total of $73.3 million on 14 July 1988—$43.2 million from ordinary capital resources and $30.1 million equivalent from Special Funds resources. The Project was completed on 30 November 1995 after a delay of 14 months. The project completion report (PCR), circulated in September 1997, rated the Project as successful. The geographic spread of project universities suited the Government’s thrust to develop the outer islands. Significantly more fellowships and consultant inputs were provided than specified, and research funds were provided in excess of the target. Civil works, furniture, and equipment were provided essentially as designed, but with some buildings being poorly constructed and even dangerous. Vessels and vehicles may have all been procured, but some have been lost to the Project. Operation and maintenance obligations of the Government were not fully met, partly due to the effects of the Asian financial crisis. The Project did not meet expectations in the development of employable human resources. On average, only about half of the graduates have been able to find jobs in marine sciences or related fields; the other half are either unemployed or work in unrelated fields. Research output has been variable, and benefit monitoring and evaluation (BME) deficient. The Operations Evaluation Mission (OEM) had no success at some universities, nor at the Directorate General of Higher Education, in obtaining basic data. Fellows’ feedback indicated overall satisfaction at having obtained an overseas qualification. While they were critical of their inability to participate in equipment ordering and facilities design, they rated highly the level of encouragement from their superiors, the appropriateness of project teaching materials, and improvements in conservation stemming from the Project. They rated poorly the maintenance of equipment and facilities, and cooperation with the private sector. At some universities, the OEM found a high incidence of absence of students, faculty, and administrators, and serious underutilization and deterioration of civil works, equipment, books, and vessels. The worst case was the destruction of one of the six field stations due to civil unrest. Very iv little research was ongoing, and libraries were often devoid of users. The OEM did not see much evidence of a fertile academic atmosphere promoting significant research and excellence in teaching. Returned fellows occupied generally the same positions and did basically the same work as before their advanced studies. The few productive links with other institutions are ad hoc. There is no integrative element among project universities. Employment generated by the Project has been marginal, and the hoped-for modernization of marine industries is not occurring. The Project’s effects on gender and development have been minimal. While the PCR made recommendations to ensure project benefits, the OEM could find little evidence that they had been heeded. A key issue stemming from the Project’s design is the efficacy of advanced degree training as preparation for teaching and research management. This issue had been researched and discussed in the literature long beforehand but was not addressed in project formulation. Another issue is centralization versus localization. The universities were not consulted sufficiently during centralized procurement. And the local project implementation units had an anomalous position, reporting to the Central Project Implementation Unit in Jakarta but ostensibly being under their university administrations. The appraisal report gives almost no attention to management issues, which proved to be critical. A positive lesson learned from the Project is the crucial role of selecting, supervising, and preparing fellows for training. This aspect was well implemented. Failure to comply with several loan covenants, viz., those on midterm review, BME, and private sector involvement, hurt the Project. While its relevance was high and its efficacy satisfactory, in terms of efficiency and sustainability of project benefits and the extent to which its major purposes and goals have been achieved, the OEM has reservations and thus rates the Project as partly successful. I. BACKGROUND 1. As early as 1984, the Asian Development Bank (ADB) was exploring the possibility of a project in Indonesia for developing higher education