AUN-QA Assessment – from Program to Institutional Level VULII Leadership and Best Practices Forum 18 &19 May 2016 Ho Chi Minh City, Vietnam
Total Page:16
File Type:pdf, Size:1020Kb
AUN-QA Assessment – From Program to Institutional Level VULII Leadership and Best Practices Forum 18 &19 May 2016 Ho Chi Minh City, Vietnam Johnson Ong Chee Bin AUN-QA Expert (Singapore) AUN-QA Assessment 1 [email protected] ASEAN University Network (AUN) 1992 Initiation of ASEAN University Network at the 4th ASEAN Summit 1995 Establishment of the ASEAN University Network Charter 2008 Became one of the ASEAN Sectoral Ministerial Bodies responsible for higher education cooperation and development. Brunei Darussalam Myanmar Cambodia The Philippines Indonesia Singapore Lao PDR Thailand Malaysia Viet Nam Source: QA Development in ASEAN_09 Dec 2014 AUN-QA Assessment 2 [email protected] ASEAN University Network (AUN) AUN Mandate Strengthen the existing network of cooperation among universities in ASEAN and beyond; Promote collaborative study, research and educational programmes in the priority areas identified by ASEAN; Promote cooperation and solidarity among scholars, academicians and researchers in the ASEAN Member States; and Serve as the policy-oriented body in higher education in the ASEAN region. Source: QA Development in ASEAN_09 Dec 2014 AUN-QA Assessment 3 [email protected] ASEAN University Network (AUN) A S E A N C o m m u n i t y Socio-Cultural Economic Political Community Community Community Promote deeper Narrow Invest in People Narrow digital divide regional awareness development gap AUN AUN China-AUN ACTS AUNIP IAI Policy Level Student Exchange Scholarship AUN-QA Distinguished Scholar Initiative for ASEAN Collaborative Research AUNILO AUN-HREN AUN/SEED-Net Integration Programme Academic International College Special Education Forum & ASEAN Youth Cultural ASEAN Studies AGBEP Taskforce Young Speaker Contest Forum Conference Student Programme Source: QA Development in ASEAN_09 Dec 2014 AUN-QA Assessment 4 [email protected] AUN-QA Network • AUN-QA was established in 1998 • Bangkok Accord in 2000 • Network of Chief Quality Officers (CQOs) • 30 AUN Members and 31 AUN-QA Associate Members AUN-QA Assessment 5 [email protected] AUN-QA Network • Strengthen QA Professionals in ASEAN • Uplift quality of education at institutional and programme 1.(U-U) level through AUN-QA Assessment • Engage with the international/national QA networks for 2.(G-G) system development and recognition • Expand AUN-QA Cooperation with dialogue partners (ASEAN+3) 3.(R-R) • Jointly developed “Institutional Assessment” with ASEAN and EU partners under “EU-SHARE Programme” Source: QA Development in ASEAN_09 Dec 2014 AUN-QA Assessment 6 [email protected] AUN-QA Network AUN-QA Assessment 7 [email protected] AUN-QA Model Strategic QA (Institutional) Programme QA Institutional QA Assessment since Assessment 2007 commencing Systemic QA Oct 2016 (Internal QA System) Functional QA (Education, Research and Service) AUN-QA Assessment 8 [email protected] AUN-QA Model AUN-QA Assessment (for the purpose of improving the effectiveness of QA system) • De facto QA framework in ASEAN • Non-prescriptive • Focus on improvement • Principles-based framework AUN-QA Assessment 9 [email protected] AUN-QA Model Characteristics Principles-Based Rules-Based View of Quality System Integrated & Systemic Standalone & Ad-hoc Focus Improvement Compliance Feedback Formative Summative Improvement Objective Continuous & Contextualisation Static & Standardisation Reference Framework & Non-Prescriptive Standards & Prescriptive Assessors Skilled Peers Technical Experts Assessment Climate Mutual Respect & Trust Fearful and Suspicious Motivation for Intrinsic Extrinsic Assessment Methodology Assessment or Evaluation Audit Adapted from source: “Principles-based accreditation: the way forward?” by Lindsay H Heywood AUN-QA Assessment 10 [email protected] AUN-QA Model Source: “Principles-based accreditation: the way forward?” by Lindsay H Heywood AUN-QA Assessment 11 [email protected] AUN-QA Programme Assessment AUN-QA Assessment 12 [email protected] AUN-QA Programme Assessment AUN-QA Assessment 13 [email protected] AUN-QA at Programme Level Version 0 Version 1 Version 2 Version 3 2007 – 2010 2011 – 2016 2016/17 18 Criteria 15 Criteria onwards 11 Criteria AUN-QA Assessment 14 [email protected] AUN-QA Programme Assessment Results 1st AUN-QA Assessment Analysis 2007 – 2012 4 Countries, 7 universities, 37 Programmes AUN-QA Assessment 15 [email protected] AUN-QA at Programme Level (1st Version) Stakeholder Satisfaction Program Programme Programme Didactic Student Specification Content Organisation Concept Assessment A c h Expected Staff Quality Quality of the Quality of Student i Support Staff the Students Facilities e Advice v Learning e Outcomes Quality m Assurance Student Curriculum Staff Feedback e Teaching/ Development Stakeholders n Learning Evaluation Design Activities t s Graduate Drop Out Graduation Pass Rates Employability Profile Rates Time Quality Assurance and (Inter)national benchmarking AUN-QA Assessment 16 [email protected] AUN-QA at Programme Level (2nd Version) Stakeholders Satisfaction Programme Programme Teaching & Learning Student Structure & Specification Strategy Assessment Content A c h Student Facilities & Expected Academic Staff Support Staff Student i Advice & Infrastructure e Quality Quality Quality Support v Learning e m Outcomes Staff Quality Assurance of Stakeholders e Teaching & Learning Development n Activities Feedback t s Pass Drop Out Graduation Employability Research Rates Rates Time Quality Assurance and (Inter)national benchmarking AUN-QA Assessment 17 [email protected] AUN-QA Assessment Rating Scale Score Interpretation 1 Absolutely inadequate; immediate improvements must be made 2 Inadequate, improvements necessary 3 Inadequate, but minor improvements will make it adequate 4 Adequate as expected (meeting the AUN-QA guidelines and criteria) 5 Better than adequate (exceeding the AUN-QA guidelines and criteria) 6 Example of best practices 7 Excellent (world-class or leading practices) AUN-QA Assessment 18 [email protected] AUN-QA Programme Assessment Results (2007 – 2012, N = 37) AUN-QA Assessment 19 [email protected] AUN-QA Programme Assessment Results (2007 – 2012, N = 37) AUN-QA Assessment Results (by Ratings) AUN-QA Assessment 20 [email protected] AUN-QA Programme Assessment Results (2007 – 2012, N = 16) AUN-QA Assessment 21 [email protected] AUN-QA Programme Assessment Results (2007 – 2012, N = 8) AUN-QA Assessment 22 [email protected] AUN-QA Programme Assessment Results (2007 – 2012, N = 11) AUN-QA Assessment 23 [email protected] AUN-QA Programme Assessment Results 2nd AUN-QA Assessment Analysis 2007 – 2014 8 Countries, 27 Universities, 107 Programmes AUN-QA Assessment 24 [email protected] AUN-QA Programme Assessment Results (2007 – 2014, N = 107) AUN-QA Assessment 25 [email protected] AUN-QA Programme Assessment Results (2007 – 2014, N = 107, Mean Scores) Criteria No. of Programmes 107 2 45 1 5 1 19 4 30 1. Expected Learning Outcomes 4.5 3.1 4.6 2.5 4.3 5.0 4.7 4.1 4.4 2. Programme Specification 4.4 3.8 4.4 3.3 4.4 5.0 4.5 4.0 4.4 3. Programme Structure & Content 4.5 3.5 4.5 3.6 4.6 4.0 4.8 4.0 4.6 4. Teaching and Learning Strategy 4.6 3.5 4.7 3.3 4.1 4.0 4.8 4.1 4.6 5. Student Assessment 4.4 3.0 4.4 3.6 4.4 4.0 4.7 4.2 4.5 6. Academic Staff Quality 4.8 3.3 4.8 3.1 5.0 4.0 5.0 4.5 4.7 7. Support Staff Quality 4.3 3.4 4.2 4.3 4.5 4.0 4.7 4.3 4.3 8. Student Quality 4.9 4.1 4.9 4.0 4.8 5.0 5.0 4.5 4.9 9. Student Advice and Support 4.6 3.3 4.8 2.5 4.8 4.0 5.0 4.8 4.4 10. Facilities and Infrastructure 4.3 3.8 4.3 3.0 5.0 3.0 4.5 4.5 4.1 11. Quality Assurance of Teaching and Learning Process 4.4 3.1 4.5 3.0 4.6 4.0 4.5 3.8 4.4 12. Staff Development Activities 4.3 3.0 4.3 4.5 4.7 3.0 4.5 4.6 4.4 13. Stakeholders Feedback 4.2 3.2 4.1 2.3 4.2 3.0 4.2 4.1 4.4 14. Output 4.7 2.9 4.8 4.0 5.0 5.0 5.1 4.6 4.6 15. Stakeholders Satisfaction 4.8 3.1 4.7 5.0 4.6 4.0 5.1 5.0 5.0 Overall Verdict 4.6 3.5 4.5 3.5 4.7 4.1 4.8 4.4 4.5 AUN-QA Assessment 26 [email protected] Closing the Gaps – Constructive Alignment ELOs Student Student Teaching Teaching & Learning & Learning Assessment Assessment AUN-QA Assessment 27 [email protected] Constructive Alignment Source: Dr. Andres Winston C. Oreta, Professor in Civil Engineering, De La Salle University-Manila at http://digitalstructures.blogspot.sg/2012/01/outcomes-based-education-as-i-see-it.html AUN-QA Assessment 28 [email protected] Constructive Alignment AUN-QA Assessment 29 [email protected] Constructive Alignment © LivingBetter Vertical Alignment of Learning Outcomes and Stakeholders’ Needs QA at Programme Level 30 Constructive Alignment QA at Programme Level 31 Constructive Alignment • Educational Philosophy Culture • Articulation & Communication • Rewards & Recognition Ready • Quality Enhancement & Benchmarking • Classroom Engagement • Assessment & Feedback Teaching • Coaching & Mentoring People Learning and • Teaching & Learning Ready Outcomes Learning Competences • Pedagogical Research & Development • Facilities & Infrastructure • Technology System • Constructive Alignment in Ready Curriculum • Monitoring & Evaluation AUN-QA Assessment 32 [email protected] Constructive Alignment AUN-QA Assessment 33 [email protected] Constructive Alignment AUN-QA Assessment 34 [email protected] AUN-QA at Programme Level (3rd Version, 2017) Stakeholders’ Needs Programme Programme Structure & Teaching & Learning Student Specification Assessment Content Approach A c h Academic Staff Facilities & i Expected Support Staff Student Quality & e Quality Quality Support Infrastructure v Learning e m Outcomes e Quality Enhancement n t s Output Quality Assurance and (Inter)national benchmarking AUN-QA Assessment 35 [email protected] 1.