Romanian Agency for Quality Assurance in Higher Education (Aracis)
Total Page:16
File Type:pdf, Size:1020Kb
ENQA AGENCY REVIEW 2018 ENQA AGENCY REVIEW: ROMANIAN AGENCY FOR QUALITY ASSURANCE IN HIGHER EDUCATION (ARACIS) David William Cairns, Agnes Leinweber, Hannele Marjatta Niemi, Simona Dimovska 13 September 2018 ............................................................................................................ 3 ................................................................................................................................ 5 ............................... 5 BACKGROUND OF THE REVIEW .............................................................................................................. 5 MAIN FINDINGS OF THE 2013 REVIEW ................................................................................................... 5 REVIEW PROCESS ................................................................................................................................ 6 ........................... 7 HIGHER EDUCATION SYSTEM ................................................................................................................. 7 QUALITY ASSURANCE ........................................................................................................................... 8 ............................................................................................................................................ 9 ARACIS’S ORGANISATION/STRUCTURE .................................................................................................. 9 ARACIS’S FUNCTIONS, ACTIVITIES, PROCEDURES ................................................................................... 10 ARACIS’S FUNDING .......................................................................................................................... 13 .............. 14 ........................................................................ 14 ESG 3.1 ACTIVITIES, POLICY, AND PROCESSES FOR QUALITY ASSURANCE ................................................... 14 ESG 3.2 OFFICIAL STATUS .................................................................................................................. 18 ESG 3.3 INDEPENDENCE .................................................................................................................... 19 ESG 3.4 THEMATIC ANALYSIS ............................................................................................................. 20 ESG 3.5 RESOURCES ......................................................................................................................... 22 ESG 3.6 INTERNAL QUALITY ASSURANCE AND PROFESSIONAL CONDUCT ................................................... 24 ESG 3.7 CYCLICAL EXTERNAL REVIEW OF AGENCIES ................................................................................ 26 ........................................................................ 26 ESG 2.1 CONSIDERATION OF INTERNAL QUALITY ASSURANCE .................................................................. 26 ESG 2.2 DESIGNING METHODOLOGIES FIT FOR PURPOSE ........................................................................ 27 ESG 2.3 IMPLEMENTING PROCESSES .................................................................................................... 30 ESG 2.4 PEER-REVIEW EXPERTS .......................................................................................................... 33 ESG 2.5 CRITERIA FOR OUTCOMES ...................................................................................................... 36 ESG 2.6 REPORTING ......................................................................................................................... 38 ESG 2.7 COMPLAINTS AND APPEALS.................................................................................................... 43 ..................................................................................................... 46 ....................................................................................................................... 46 1/72 ................................................................................................................................. 47 ............................................................................................. 47 .................................................... 47 ........................................................................ 49 ............................................................................................................................................ 50 ............................................................................. 50 ................................................................ 59 ................................................................................................................... 66 ............................................................... 67 .......................................................................................................................................................... 69 ........................... 71 2/72 This report reviews the compliance of the Romanian Agency for Quality Assurance in Higher Education (Agenţia Română pentru Asigurarea Calităţii în Învăţământul Superior) (ARACIS, the Agency) with the Standards and Guidelines for Quality Assurance in the European Higher Education Area (ESG). It is based on an ENQA-coordinated external review with a site visit to Bucharest undertaken between 4 and 7 March 2018. This is the third external review of ARACIS by ENQA, the previous reviews being in 2009 and 2013. ARACIS has been a full member of ENQA and has been listed on the European Quality Assurance Register since 2009.1 The governance of ARACIS is headed by its Council. This consists of 21 members including two students, a representative of Romanian employers, and a representative of the trade-unions in higher education. Of the remaining members five (including the President of the Council) form the Executive Board of ARACIS with the President of the Council fulfilling the role of Chief Executive. This dual role is permitted by the legal framework under which ARACIS operates; nonetheless, that the President of the Council acts as the Chief Executive of ARACIS compromises the ability of the Council to hold the Executive Board to account for its management and leadership of the Agency. The report of the 2013 ENQA review of ARACIS commented on the predominance of males at senior levels in the governance and management of ARACIS and recommended action to deal with this gender imbalance.2 In 2018 this continues to be a problem. Since 2013, ARACIS has continued to carry out a substantial programme of reviews and accreditations across Romania at institutional level, for undergraduate programmes and more recently for Masters’ programmes by subject domain. There is also the prospect that ARACIS will undertake reviews of doctoral programmes, again by subject domain. In 2015, when the revised ESG were approved, ARACIS had already set up an internal working group to revise its existing review methods and procedures which dated from 2007. After 2015, ARACIS extended the focus of the same working group to ensure the continuing compliance of ARACIS with the new version of the ESG.3 The role of this working group was later further extended to planning the self-assessment for this review.4 ARACIS has taken care to map its own procedures and arrangements against the requirements of the revised ESG. The review panel cannot be sure, however, to what extent the reviews that ARACIS undertakes test whether institutions have adopted learning outcomes. Since 2013 ARACIS has tendered for and undertaken a programme of pilot reviews of law programmes for the Moldovan Government. In all these activities (other than with respect to learning outcomes) there is clear evidence of attention to the ESG. Likewise, ARACIS has been an active contributor to the wider work of ENQA and has participated in several of its technically demanding activities. Within Romania, ARACIS has continued to publish issues of its ‘Quality Barometers’: thematic reviews of higher education, which the 2013 ENQA report highlighted then as good practice. The Council, Executive Board and staff of ARACIS work diligently each year to carry out a large number of higher education reviews and other activities. The arrangements ARACIS has made for Permanent Specialty Commissions to act as coordinators for review activities in particular subject domains, 1 ARACIS SAR, p.2; ARACIS self-evaluation, 2013 2 E.g, p.13 3 SAR, pp.31-2 4 SAR p.3 3/72 together with the work of its two Departments for Accreditation, and for Evaluation, enable ARACIS to supervise and manage its review work effectively. There is evidence that ARACIS manages its financial and other resources prudently, to keep its expenditure in step with the fees it charges higher education institutions for its review activities, and changes in legislation. At present, however, ARACIS does not have a strategic plan that spans several years; that describes why and how it intends to become more efficient and effective in supporting Romanian higher education and sets targets against which the Council (and others) can assess the progress of ARACIS and the performance of its CEO and Executive Board. ARACIS should now develop such a strategic plan. The 2013 report recommended that ARACIS take steps to make all the reports it publishes machine- readable so that they can be indexed by internet search engines. This would make their contents more accessible to students and others