Holy See's Agency for the Evaluation and Promotion of Quality in Ecclesiastical Universities and Facilities (Avepro)
Total Page:16
File Type:pdf, Size:1020Kb
ENQA AGENCY REVIEW HOLY SEE'S AGENCY FOR THE EVALUATION AND PROMOTION OF QUALITY IN ECCLESIASTICAL UNIVERSITIES AND FACILITIES (AVEPRO) OLIVER VETTORI, RONNY HEINTZE, HANNELE NIEMI, MATTHEW KITCHING 18 JUNE 2020 ENQA AGENCY REVIEW 2020 CONTENTS EXECUTIVE SUMMARY ........................................................................................................................................... 3 INTRODUCTION ..................................................................................................................................................... 3 BACKGROUND OF THE REVIEW AND OUTLINE OF THE REVIEW PROCESS 4 Background of the review........................................................................................................ 4 Main findings of the 2014 review.............................................................................................. 4 Review process ...................................................................................................................... 5 HIGHER EDUCATION AND QUALITY ASSURANCE SYSTEM OF THE AGENCY 7 Higher education system ......................................................................................................... 7 Quality assurance ................................................................................................................... 9 AVEPRO 9 AVEPRO’s organisation/structure .................................................................................................................. 10 AVEPRO’s functions, activities, procedures .................................................................................................. 11 AVEPRO’s funding ................................................................................................................ 13 FINDINGS: COMPLIANCE OF AVEPRO WITH THE STANDARDS AND GUIDELINES FOR QUALITY ASSURANCE IN THE EUROPEAN HIGHER EDUCATION AREA (ESG) ........................... 15 ESG PART 3: QUALITY ASSURANCE AGENCIES 15 ESG 3.1 Activities, policy, and processes for quality assurance .................................................... 15 ESG 3.2 Official status ........................................................................................................... 16 ESG 3.3 Independence .......................................................................................................... 17 ESG 3.4 Thematic analysis ..................................................................................................... 19 ESG 3.5 Resources ............................................................................................................... 21 ESG 3.6 Internal quality assurance and professional conduct ...................................................... 23 ESG 3.7 Cyclical external review of agencies ............................................................................ 25 ESG PART 2: EXTERNAL QUALITY ASSURANCE 26 ESG 2.1 Consideration of internal quality assurance.................................................................. 26 ESG 2.2 Designing methodologies fit for purpose ..................................................................... 30 ESG 2.3 Implementing processes ............................................................................................ 31 ESG 2.4 Peer-review experts ................................................................................................. 33 ESG 2.5 Criteria for outcomes ............................................................................................... 35 ESG 2.6 Reporting ................................................................................................................ 36 ESG 2.7 Complaints and appeals ............................................................................................ 38 ADDITIONAL OBSERVATIONS ......................................................................................................................... 40 CONCLUSION 41 1/57 SUMMARY OF COMMENDATIONS 41 OVERVIEW OF JUDGEMENTS AND RECOMMENDATIONS 41 SUGGESTIONS FOR FURTHER DEVELOPMENT 42 ANNEXES 44 ANNEX 1: PROGRAMME OF THE SITE VISIT 44 ANNEX 2: TERMS OF REFERENCE OF THE REVIEW 49 ANNEX 3: GLOSSARY 54 ANNEX 4. DOCUMENTS TO SUPPORT THE REVIEW 55 Documents provided by AVEPRO ......................................................................................... 55 Other sources used by the review panel ................................................................................. 57 2/57 EXECUTIVE SUMMARY This report results from an external review assessing the compliance of Holy See’s Agency for the Evaluation and Promotion of Quality in Ecclesiastical Universities and Faculties (Agenzia della Santa Sede per la Valutazione e la Promozione della Qualità delle Università e Facoltà Ecclesiastiche (AVEPRO)) against the 2015 Standards and Guidelines for Quality Assurance in the European Higher Education Area (ESG). As it is already the second review of AVEPRO, the review approach also reflects the developmental dimension and considers the legal changes relevant to quality assurance of the Holy See’s higher education system, particularly Veritatis Gaudium. AVEPRO is a member of the European Association for Quality Assurance in Higher Education (ENQA) since 2014. AVEPRO is in charge of evaluation of all ecclesiastical higher education institutions belonging to the Holy See. Due to its unique nature this implies a global scale of AVEPRO’s activities. This external review report is based on the review process that primarily used AVEPROS’s self-assessment report, a site visit of the ENQA appointed review panel to the Vatican, and published information available on AVEPROS’s website. AVEPRO’s mission is twofold, as it includes the evaluation of ecclesiastical institutions, but also the promotion of quality in the higher education system of the Holy See. AVEPRO is not assigned with the task to accredit institutions, as this remains the responsibility of the Congregation for Catholic Education (CCE). While AVEPRO is funded from the budget of the Holy See, the operational use of the funds remains within its self governing responsibility. AVEPRO does not charge any fees to institutions. Based not only on the written documentation and numerous evidences reviewed by the panel of experts, but considering the stakeholder interviews and impressions while talking to AVEPRO staff, it became obvious that AVEPRO is a well-respected institution in the HE system of the Holy See which enjoys trust by institutions and stakeholders. In the past years, AVEPRO has continued to intensify its activities in the promotion of quality in order to build trust on the side of the institutions. Benefiting from the unique culture of the higher education system of the Holy See, AVEPRO may make use of volunteer work to a much larger extent than comparable structures elsewhere. By doing so, the agency manages to increase the efficiency in the use of available resources. At the same time, it became obvious that in the future further resources will be required for the agency to fully achieve its mission. The panel wishes to underline that the fair assessment of the agency according to the clear and focused requirements of the ESG occurred within the unique situation and complexity of the Holy See’s higher education system, of which AVEPRO is an institutional body. The panel found AVEPROS’s level of alignment with the ESG to be the following: Fully compliant with the following ESGs – 3.1, 3.2, 3.3, 3.4, 3.7, 2.1, and 2.2 Substantially compliant with the following ESGs – 3.6, 2.3, 2.4, 2,5, and 2.7 Partially compliant: 3.5 and 2.6 The panel believes that AVEPRO has succeeded very well over the past years to establish and develop its role as a trusted partner in supporting the quality enhancement of the ecclesiastical higher education institutions. The panel hopes that its analyses and recommendations will support AVEPRO in continuing to do so. 3/57 INTRODUCTION This report analyses the compliance of the Holy See’s Agency for the Evaluation and Promotion of Quality in Ecclesiastical Universities and Faculties (Agenzia della Santa Sede per la Valutazione e la Promozione della Qualità delle Università e Facoltà Ecclesiastiche (AVEPRO)) with the Standards and Guidelines for Quality Assurance in the European Higher Education Area (ESG). It is based on an external review conducted in May 2019-March 2020. BACKGROUND OF THE REVIEW AND OUTLINE OF THE REVIEW PROCESS BACKGROUND OF THE REVIEW ENQA’s regulations require all member agencies to undergo an external cyclical review, at least once every five years, in order to verify that they act in substantial compliance with the ESG as adopted at the Yerevan ministerial conference of the Bologna Process in 2015. As this is AVEPRO’s second review, the panel is expected to provide clear evidence of results in all areas and to acknowledge progress from the previous review. The panel has adopted a developmental approach, as the Guidelines for ENQA Agency Reviews aim for constant enhancement of the agencies. MAIN FINDINGS OF THE 2014 REVIEW In its 2014 report, the panel concluded that the Holy See’s Agency for the Evaluation and Promotion of Quality in Ecclesiastical Universities and Faculties is in substantial compliance with the ENQA Membership provisions. The panel therefore recommended to the Board of ENQA that AVEPRO should become a member of ENQA for a period of five years. The 2014 report recognised AVEPRO as an agency breathing the air of confidence and openness with which the Agency