sign in sign up
<<
Home , Kendal College, University of Sheffield

Strategy, Planning & Governance.

Potential Teaching Excellence Framework Measures.

Professor Wyn Morgan Dr Tony Strike February 2016 2 Potential Teaching Excellence Framework Measures Contents

Introduction 3 1 Average Tariff 4 2 UG degree outcomes 6 3 Student/Staff ratio (SSRs) 8 4 Destination of leavers: Positive destinations 10 5 Salaries for new graduates 12 6 NSS: Overall Satisfaction 14 7 NSS: Teaching on my course 16 8 NSS: Learning resources 18 9 International Staff 20 10 Students no longer in HE after 1 year 22 11 Students from LPN (low participation neighbourhoods) 24 12 Applications per registration 26 13 Proportion from state sector 28 14 About the data 30

1 The University of

2 Potential Teaching Excellence Framework Measures Introduction

This is a consultation document for internal use only.

The next step in the building of national proposals for a By providing a set of available measures with data, Strategy, Teaching Excellence Framework (TEF) is to be a technical Planning & Governance aims to stimulate an internal debate consultation. In anticipation of universities being invited to on which, if any, of these measures the University might seek submit comments later in 2016, the university can develop to support over others if metrics are still to be a part of and strengthen its own view. In the first year it is likely the TEF. By showing the data for the University of Sheffield, the TEF will be based on results from Quality Assurance. by comparing it to the rest of the and to the Subsequently, it is proposed the TEF will include metrics sector, it may be possible to identify defining strengths and used as proxies to indicate teaching excellence. This necessary areas for improvement. suggestion has already produced a series of responses to the government’s Green Paper as to why this approach Working closely as we are with colleagues in the Department could be viewed as problematic. of Business, Innovation and Skills, who are based in Sheffield, on the development of the TEF, we recognise we do not The University of Sheffield Students’ Union has been have a determining influence on the national policy. We can clear that much of what students come to recognise as provide greater clarity on what the University of Sheffield educational excellence in higher education is in the ethos means by high quality teaching and educational excellence and values of the learning community, which is tangible but and how we intend to evidence that to others. resistant to objectification and measurement. In showing some possible proxy measures, we are preparing for the Results are shown here at an institutional level of analysis; TEF technical consultation without wanting to fall into aware that students often make decisions at the subject the epistemological trap of legitimising the object of our level and that there are subject level variances in the concerns. This pamphlet shows potential measures that may underlying data. be incorporated into the TEF, but does not propose that such measures are used. The commentary provided with Dr Tony Strike each measure offers a critical appraisal.

3 Potential Teaching Excellence Framework Measures 1. Average Tariff on Entry

This is an input measure and might say something about the seen reputation of the University and its ability to attract academically able students.

Being part of a student group which is academically able may of a measure of entry tariff might be to discourage access influence the quality of the educational experience for those in favour of elitism. If linked to learning gain; measured by students through the level and pace of the teaching and comparing degree classification to average entry tariff, through peer learning. However, if tariff is simply measuring the incentive could be for institutions to accept lower tariff reputation and the University is adding no value then teaching students and award more good honours degrees. excellence is not indicated by this measure. Universities which have a specific policy of accepting students with lower The Russell Group performs well on this measure. grades as part of an access policy will tend to have their The University of Sheffield does well on this measure in the average score depressed. The unintended consequence sector and sits in the middle of the Russell Group.

4 Potential Teaching Excellence Framework Measures

Average Tariff

Top 5 Russell Group 1 The University of 601.0 1 The 601.0 2 The 570.8 2 The University of Oxford 570.8 3 Imperial College of Science, Technology and Medicine 566.8 3 Imperial College of Science, Technology and Medicine 566.8 4 London School of Economics and Political Science 531.4 4 London School of Economics and Political Science 531.4 5 University of Durham 522.4 5 University of Durham 522.4 7 University College London 505.2 Sheffield +/- 3 8 The 484.6 21 The 430.6 9 The 482.2 22 The 429.8 10 The 479.7 23 Glasgow School of Art 426.6 12 The 464.8 24 The University of Sheffield 425.6 13 The 460.2 25 425.4 15 King’s College London 452.3 26 The 425.2 19 The 433.9 27 University of Newcastle-upon-Tyne 423.6 21 The University of Manchester 430.6 22 The University of Leeds 429.8 Bottom 5 24 The University of Sheffield 425.6 149 Birkbeck College 221.2 25 University of Nottingham 425.4 150 220.0 26 The University of Birmingham 425.2 151 University College Birmingham 218.7 27 University of Newcastle-upon-Tyne 423.6 152 London Metropolitan University 217.7 29 421.2 153 Institute of Education 203.6 32 Queen Mary 408.8 33 The University of Southampton 407.5 35 The 402.8 45 The Queen’s University of Belfast 378.8

Definition: Average tariff of all subjects taken; home students only Source: HESA sector data, 2013/14

5 The University of Sheffield 2. UG degree outcomes

This is an output measure and might indicate the effectiveness of teaching at an institution in enabling students to achieve good degree results.

The QAA ensures high academic standards across all Including undergraduate degree outcomes as a measure in higher education institutions, and so measuring degree the TEF could promote grade inflation, as institutions would classifications would demonstrate the number of students be able to succeed in the TEF by lowering the standards that achieved a certain standard of education. However, required for higher level degree classifications. It could also degree outcomes are influenced by the quality of students disadvantage those institutions that are successful in widening recruited by an institution, and does not indicate the quality participation, as there is evidence that some WP students are of the education that they receive or the value added to less likely to achieve higher degree classifications. a student’s education. While the QAA ensures standards, institutions still set and mark their own exams, so data The Russell Group performs well on this measure. on undergraduate degree outcomes is not comparable The University of Sheffield does well on this measure in the between institutions. sector and sits in the middle of the Russell Group.

6 Potential Teaching Excellence Framework Measures

Good Honours

Top 5 % Russell Group % 1 Courtauld Institute of Art 90.2 4 The University of Oxford 87.7 2 Central School of Speech and Drama 87.9 5 University of Durham 87.4 3 87.8 14 London School of Economics and Political Science 82.1 4 The University of Oxford 87.7 16 The University of Exeter 81.3 5 University of Durham 87.4 17 University College London 80.3 19 The University of York 79.8 Sheffield +/- 3 22 The University of Warwick 78.7 32 Royal Holloway and Bedford New College 75.9 25 The University of Leeds 77.8 33 Leeds College of Art 75.5 27 The University of Birmingham 76.6 34 The University of East Anglia 75.4 28 The University of Bristol 76.4 35 The University of Sheffield 75.4 31 The University of Southampton 76.0 36 75.2 35 The University of Sheffield 75.4 37 The 74.9 42 Imperial College of Science, Technology and Medicine 73.7 38 74.5 43 University of Nottingham 73.6 47 Cardiff University 71.9 Bottom 5 50 The University of Cambridge 71.1 148 Royal Conservatoire of Scotland 59.4 51 University of Newcastle-upon-Tyne 71.0 149 The 39.4 52 King’s College London 70.6 150 SRUC (Scotland’s Rural College) 30.4 55 The University of Manchester 70.1 151 University of the Highlands and Islands 19.8 58 The Queen’s University of Belfast 69.7 152 The University of the West of Scotland 19.3 68 The University of Edinburgh 67.8 76 The University of Liverpool 66.9 84 Queen Mary University of London 65.5 100 The University of Glasgow 62.9

Definition: Good honours defined as 1st and 2.1 Source: HESA sector data, 2013/14

7 The University of Sheffield 3. Student/Staff ratio (SSRs)

There is evidence that students particularly value time spent learning in small groups.

A greater proportion of staff to students might allow students Measuring SSRs could also reward inefficiency, as institutions to benefit from more direct contact with their teachers, could perform better in the TEF by assigning more staff to and allow staff a greater capacity to focus on the needs of teach than is optimal for student learning. The measure might individual students. However, data on SSRs between forms also simply reflect the wealth of institutions, as those who can of provision is not comparable. Full-time, part-time, distance afford to employ more teaching staff will achieve better SSRs. learning and study in the workplace may all require different forms of provision and different SSRs would be appropriate The Russell Group has a lower staff to student ratio in in each case. There are also issues with the data as collected comparison with the sector as a whole. The University of by HESA, as it does not account for the wide range in the Sheffield sits within the bottom third of the Russell Group. proportion of time spent on teaching by academics.

8 Potential Teaching Excellence Framework Measures

SSRs

Top 5 Ratio Russell Group Ratio 1 Institute of Education 1.71 5 London School of Economics and Political Science 4.82 2 Courtauld Institute of Art 3.57 7 University College London 5.86 3 Royal Academy of Music 4.30 9 The University of Oxford 6.39 4 Guildhall School of Music and Drama 4.72 10 Imperial College of Science, Technology and Medicine 6.51 5 London School of Economics and Political Science 4.82 14 The University of Cambridge 7.22 15 King’s College London 7.26 Sheffield +/- 3 19 The University of Warwick 8.81 38 The University of Glasgow 10.84 22 The University of Edinburgh 8.88 39 Cardiff University 10.86 23 The University of Southampton 8.93 40 The University of Birmingham 10.92 28 Queen Mary University of London 9.29 41 The University of Sheffield 10.93 30 The University of Manchester 9.89 42 University of Nottingham 10.93 32 The University of Bristol 10.63 43 The 11.02 35 The University of Liverpool 10.73 44 The University of East Anglia 11.08 38 The University of Glasgow 10.84 39 Cardiff University 10.86 Bottom 5 40 The University of Birmingham 10.92 150 Bishop Grosseteste University 22.81 41 The University of Sheffield 10.93 151 University Campus Suffolk 24.01 42 University of Nottingham 10.93 152 The 29.76 45 The University of Leeds 11.13 153 Ravensbourne 31.84 51 University of Durham 11.61 154 University of the Highlands and Islands 360.27 52 The University of York 11.61 58 University of Newcastle-upon-Tyne 12.30 64 The Queen’s University of Belfast 12.89 65 The University of Exeter 13.00 Definition: Student staff ratio; includes all UG students (first degree & other UG) and staff on both T&R and T only contracts Source: HEIDI 2013/14

9 The University of Sheffield 4. Destination of leavers: Positive destinations

This is an output measure which could show those institutions which best prepare their students for graduate employment through teaching, course design and links with employers.

Students increasingly cite the importance of job prospects The measure could damage widening participation, as as a measure of their time at university. However, research universities could recruit students whose existing education suggests that information about graduate employment and socio-economic background increase the chances of rates tells higher education applicants little about the them finding graduate employment. It could also incentivise quality of education they can expect to receive, as the data universities to focus on the provision of professional courses is influenced by factors such as institutional reputation, which may have better employment outcomes. league table position, and students’ entry grades and socio- economic background. The data only indicates if the students’ The Russell Group performs well on this measure. destinations were positive as currently defined; it does not The University of Sheffield is positioned at the lower end of reveal the extent to which the teaching they received and the Russell Group rank. the qualifications they gained helped them find employment. Furthermore, the data will vary widely between subjects, and knowing an institutional average will not help a student pick a particular course.

10 Potential Teaching Excellence Framework Measures

Positive Destinations

Top 5 % Russell Group % 1 100.0 4 Imperial College of Science, Technology and Medicine 91.4 2 Royal Academy of Music 95.6 5 The University of Cambridge 89.8 3 St George’s Hospital Medical School 93.1 8 The University of Oxford 87.3 4 Imperial College of Science, Technology and Medicine 91.4 10 King’s College London 86.9 5 The University of Cambridge 89.8 11 The University of Birmingham 86.7 16 University College London 84.4 Sheffield +/- 3 17 University of Durham 84.4 55 Glyndwr University 76.8 25 University of Nottingham 82.5 56 The University of Liverpool 76.6 26 The University of Warwick 82.1 57 The University of York 76.5 31 Cardiff University 80.4 58 The University of Sheffield 76.2 32 The University of Exeter 80.3 59 The 75.9 33 The University of Glasgow 80.1 60 The University of Huddersfield 75.6 34 London School of Economics and Political Science 79.9 61 The 75.3 35 University of Newcastle-upon-Tyne 79.7 36 The University of Southampton 79.7 Bottom 5 37 The University of Bristol 79.6 150 Leeds College of Art 52.6 41 The University of Leeds 78.8 151 London Metropolitan University 51.9 43 The University of Manchester 78.8 152 University of the Highlands and Islands 50.2 44 The University of Edinburgh 78.7 153 The University of East London 49.0 45 The Queen’s University of Belfast 78.7 154 SRUC (Scotland’s Rural College) 30.9 56 The University of Liverpool 76.6 57 The University of York 76.5 58 The University of Sheffield 76.2 64 Queen Mary University of London 73.9 Definition: Positive destination is defined using the HESA positive destination marker and excludes N/A, refused and unknown Source: HESA sector data from DLHE 2013/14

11 The University of Sheffield 5. Salaries for new graduates

This is an output measure which could show whether institutions prepare their students for the highest earning graduate jobs through teaching, course design and links with employers. Students with income-dependent educational loans to pay back may be more concerned about likely salaries on graduation.

The measure could damage widening participation, as third sector, or graduates who go on to study for a doctorate. institutions recruit students whose existing education It could also penalise institutions that are based in regions and socio-economic background increase the chances of with lower average salaries, but who have enabled their them finding higher paid employment. It could incentivise students to find employment within their region. institutions to focus on the provision of professional courses targeted at higher paying sectors. It may provide The Russell Group has a range of outcomes on this measure. a disincentive for universities to produce civically minded The University of Sheffield does not perform particularly well, graduates who might take lower paid work in the public or positioned at the lower end of the Russell Group rank.

12 Potential Teaching Excellence Framework Measures

Average Salary

Top 5 £ Russell Group £ 1 Birkbeck College 35,861 2 Imperial College of Science, Technology and Medicine 29,648 2 Imperial College of Science, Technology and Medicin 29,648 5 London School of Economics and Political Science 28,144 3 The Open University 28,678 7 The University of Warwick 26,677 4 Institute of Education 28,214 8 The University of Oxford 26,087 5 London School of Economics and Political Science 28,144 9 King's College London 25,951 10 The University of Cambridge 25,718 Sheffield +/- 3 16 University College London 24,423 60 The University of Exeter 21,677 18 Queen Mary University of London 24,110 61 21,659 21 The University of Bristol 23,927 62 University of Northumbria at Newcastle 21,656 28 The University of Edinburgh 23,355 63 The University of Sheffield 21,609 30 University of Durham 23,170 64 The University of Lancaster 21,601 32 The University of Glasgow 22,746 65 The University of York 21,428 34 University of Nottingham 22,676 66 21,424 36 The University of Southampton 22,568 40 University of Newcastle-upon-Tyne 22,416 Bottom 5 42 The University of Birmingham 22,253 150 Glasgow School of Art 14,800 51 Cardiff University 21,957 151 Royal Northern College of Music 13,714 56 The University of Manchester 21,769 152 Conservatoire for Dance and Drama 13,182 59 The University of Liverpool 21,729 153 Royal College of Music 12,077 60 The University of Exeter 21,677 154 Trinity Laban Conservatoire of Music and Dance 12,053 63 The University of Sheffield 21,609 65 The University of York 21,428 67 The Queen's University of Belfast 21,392 74 The University of Leeds 20,890 Definition: Average salary from all employed DLHE respondents; graduate and non-graduate employment Source: HESA sector data from DLHE 2013/14

13 The University of Sheffield 6. NSS: Overall Satisfaction

This measure could indicate students' overall satisfaction with their university experience, a large part of which is the teaching that they receive.

Final year undergraduates give feedback with high rates of If FE colleges are included along with HE institutions, a participation in the NSS, so universities should respect and different rank is obtained than when only HE institutions are take seriously the results given. However, student satisfaction included. Both ranks have been shown – the first including is a difficult measure to interpret and there is no evidence FE colleges and the second excluding them – to allow for that satisfaction is linked to teaching quality or learning variation in the scope of the TEF. This has also been applied gains. There is not much differentiation between institutions to the following two NSS measures. in terms of NSS scores, and scores vary between subjects within institutions. The level of granularity needed to provide The University performs well on this measure, both within the useful information can be foiled by small sample sizes and sector and within the Russell Group. missing data.

14 Potential Teaching Excellence Framework Measures

NSS: Overall Satisfaction

Top 5 Top 5 Russel Group =1 Italia Conti Academy of Theatre Arts 100 1 St Mary's University College 96 =43 University of Oxford 91 =1 South Thames College 100 =2 The University of Keele 95 =43 University of Newcastle-upon-Tyne 91 =1 Hartlepool College of Further Education 100 =2 95 =58 The University of Leeds 90 =1 College 100 4 Courtauld Institute of Art 94 =58 University of Cambridge 90 =1 Spirit SSR Limited 100 =5 Harper Adams University 93 =58 University of Glasgow 90 =58 The University of Sheffield 90 Sheffield +/- 3 Sheffield +/- 3 =58 University of Durham 90 =58 Oxford Brookes University 90 =20 The University of Leeds 90 =58 University of Exeter 90 =58 The College of Animal Welfare Limited 90 =20 Cardiff University 90 =58 Cardiff University 90 =58 The 90 =20 90 =79 The University of Birmingham 89 =58 The University of Sheffield 90 =20 The University of Sheffield 90 =105 The University of York 88 =58 University of Durham 90 =20 University of Exeter 90 =105 Queen's University Belfast 88 =58 University of Exeter 90 =20 University of Durham 90 =105 88 =58 Cardiff University 90 =20 University of Glasgow 90 =105 Queen Mary University of London 88 =105 The University of Southampton 88 Bottom 5 Bottom 5 =125 The University of Warwick 87 363 Shockout Arts 47 =146 Bournemouth University 78 =142 The University of Nottingham 86 364 Shrewsbury College of Arts & Technology 45 =146 Trinity Saint David 78 =142 The University of Manchester 86 365 Halesowen College 33 150 The Royal Central School =162 The University of Liverpool 85 366 Carshalton College 26 of Speech & Drama 77 =183 University of Bristol 84 367 City of Glasgow College 18 =151 Writtle College 75 =183 University of Edinburgh 84 =151 University of the Arts, London 75 =197 University College London 83 =233 King's College London 81 =233 London School of Economics & Political Science 81 Note: Excluding all FE colleges Definition: NSS institutional level responses to Overall Satisfaction; all full-time undergraduates Source: NSS 2015

15 The University of Sheffield 7. NSS: Teaching on my course

This metric could be seen as a direct measure of teaching quality from a student perspective.

An institution could be gaining positive feedback from This measure could incentivise institutions to promote a style students on its teaching because the teaching is high quality. of teaching which satisfies and entertains students, rather However, there is evidence that students assess lecturers than engaging and challenging them. on how entertained they felt in classes rather than on the substance of what they were taught, which could negatively The University performs relatively well on this measure and is impact on how staff teach. The NSS does not sufficiently positioned towards the top of the Russell Group. account for student engagement with learning, which is not fully captured by this measure.

16 Potential Teaching Excellence Framework Measures

NSS: Teaching on my course

Top 5 Top 5 Russel Group =1 Italia Conti Academy of Theatre Arts 100 =1 St Mary's University College 95 =33 University of Oxford 93 =1 South Thames College 100 =1 The 95 =42 The University of Leeds 92 =3 Hartlepool College of Further Education 99 =3 University of Buckingham 94 =42 University of Cambridge 91 =3 Kendal College 99 =3 Courtauld Institute of Art 94 =42 The University of York 91 =3 Spirit SSR Limited 99 =5 University of Oxford 93 =42 University of Glasgow 91 =42 The University of Birmingham 91 Sheffield +/- 3 Sheffield +/- 3 =83 Queen's University Belfast 90 =83 Oxford Brookes University 90 =15 Stranmillis University College 91 =83 The University of Sheffield 90 =83 The College of Animal Welfare Limited 90 =27 Queen's University Belfast 90 =83 University of Exeter 90 =83 The University of Bath 90 =27 90 =83 University of Durham 90 =83 The University of Sheffield 90 =27 The University of Sheffield 90 =105 Imperial College London 89 =83 University of Durham 90 =27 University of Exeter 90 =105 University of Newcastle-upon-Tyne 89 =83 University of Exeter 90 =27 University of Durham 90 =105 Cardiff University 89 =83 Northampton College 90 =27 90 =105 University of Bristol 89 =130 The University of Southampton 88 Bottom 5 Bottom 5 =130 The University of Warwick 88 364 Shrewsbury College of Arts & Technology 59 =146 London School of Economics =130 The University of Nottingham 88 365 Newham Training and Education Centre 56 & Political Science 81 =130 Queen Mary University of London 88 366 City of Glasgow College 50 =149 University of the Arts, London 80 =172 The University of Manchester 87 367 Carshalton College 46 =149 Writtle College 80 =172 University of Edinburgh 87 368 Shockout Arts 45 =151 SRUC (Scotland's Rural College) 79 =203 King's College London 86 =151 The University of Westminster 79 =203 The University of Liverpool 86 =230 University College London 85 =305 London School of Economics & Political Science 81 Note: Excluding all FE colleges Definition: NSS institutional level responses to Teaching on my Course; all full-time undergraduates Source: NSS 2015

17 The University of Sheffield 8. NSS: Learning Resources

This measure could be used as a proxy for the investment that an institution has made into teaching, and the importance that it places on teaching its students.

It could also indicate how well an institution is placed to This measure could incentivise institutions to shift funding enable engagement with their course and in their learning. towards developing its learning resources at the expense of However, learning resources are not necessary, or in some hiring and training teaching staff. It could also penalise less cases even an important factor in the provision of excellent wealthy institutions. teaching. A good score on this measure may also simply reflect the wealth of an institution and how much it can afford The University does relatively well on this measure, and is to invest in its facilities. positioned in the middle of the Russell Group.

18 Potential Teaching Excellence Framework Measures

NSS: Learning Resources

Top 5 Top 5 Russel Group =1 Leeds College of Building 100 1 St Mary's University College 97 =6 University of Cambridge 95 =1 Edinburgh's Telford College 100 =2 Royal Northern College of Music 95 =6 University of Oxford 95 3 Brighton and Sussex Medical School 99 =2 University of Cambridge 95 =6 Imperial College London 95 4 The College of Animal Welfare Limited 98 =2 University of Oxford 95 =13 Queen's University Belfast 92 5 St Mary's University College 97 =2 Imperial College London 95 =19 The University of Leeds 92 =19 The University of Southampton 92 Sheffield +/- 3 Sheffield +/- 3 =25 University of Newcastle upon Tyne 91 =48 Coventry University 89 =32 89 =25 Cardiff University 91 =48 Bangor University 89 =32 Liverpool Hope University 89 =33 The University of York 90 =48 University of Glasgow 89 =32 University of Ulster 89 =33 The University of Manchester 90 =48 The University of Sheffield 89 =32 The University of Sheffield 89 =48 The University of Sheffield 89 =48 University of Durham 89 =32 University of Exeter 89 =48 University of Exeter 89 =48 University of Exeter 89 =32 Liverpool John Moores University 89 =48 University of Durham 89 =48 Liverpool Hope University 89 =32 University for the Creative Arts 89 =48 University of Glasgow 89 =48 The University of Warwick 89 Bottom 5 Bottom 5 =48 The University of Nottingham 89 364 Halesowen College 51 =148 Glasgow School of Art 74 =48 University of Edinburgh 89 365 Bournville College 49 =148 Goldsmiths' College 74 =71 The University of Liverpool 88 366 Italia Conti Academy of Theatre Arts 47 =148 University of the Highlands & Islands 74 =109 King's College London 86 367 Somerset SCITT Consortium 41 151 Glyndwr University 73 =153 The University of Birmingham 84 368 Newham Training and Education Centre 36 152 University of Wales Trinity Saint David 70 =153 University of Bristol 84 =153 University College London 84 =202 London School of Economics & Political Science 81 =219 Queen Mary University of London 80 Note: Excluding all FE colleges Definition: NSS institutional level responses to Learning Resources; all full-time undergraduates Source: NSS 2015

19 The University of Sheffield 9. Percentage of International Staff

Students who are being taught by the best academics from around the world will arguably experience teaching excellence.

However, research intensive institutions tend to have higher consequence could be that institutions begin to look not for numbers of international staff, brought to the UK for their the best academic they can find but to prefer non-UK hires. research contribution and not because they are necessarily the best teachers. There may be a bias by institutional type. The Russell Group performs well on this measure. The measure could also favour institutions based in urban The University of Sheffield performs well in the sector but not centres who attract more international staff. The unintended so well compared to the Russell Group.

20 Potential Teaching Excellence Framework Measures

International Staff

Top 5 % Russell Group % 1 81.8 3 London School of Economics and Political Science 63.5 2 St Mary's University College 75.0 5 Imperial College of Science, Technology and Medicine 50.1 3 London School of Economics and Political Science 63.5 7 The University of Oxford 42.0 4 The School of Oriental and African Studies 53.5 8 The Queen's University of Belfast 41.4 5 Imperial College of Science, Technology and Medicine 50.1 10 University College London 40.4 13 The University of Cambridge 39.5 Sheffield +/- 3 14 King's College London 39.4 47 Heythrop College 29.4 17 The University of Warwick 38.6 48 The 29.3 18 Queen Mary University of London 38.3 49 The 29.1 25 The University of Edinburgh 35.7 50 The University of Sheffield 28.6 28 University of Durham 35.2 51 The University of East London 28.5 34 The University of Southampton 32.1 52 University of Newcastle-upon-Tyne 27.7 35 University of Nottingham 31.8 53 Liverpool Hope University 27.6 38 The University of Birmingham 30.4 42 The University of York 30.0 Bottom 5 43 The University of Glasgow 29.8 158 3.7 44 The University of Manchester 29.8 159 Newman University 3.3 45 The University of Exeter 29.7 160 Leeds College of Art 3.1 46 The University of Bristol 29.7 161 Bishop Grosseteste University 0.0 50 The University of Sheffield 28.6 162 University of the Highlands and Islands 0.0 52 University of Newcastle-upon-Tyne 27.7 58 The University of Liverpool 26.3 59 The University of Leeds 26.1 65 Cardiff University 22.6

Definition: Percentage of International Staff, including EU & OS (non-UK) Source: HEIDI 2013/14

21 The University of Sheffield 10. Percentage of full-time First Degree entrants no longer in Higher Education after a year

A university or a subject that has a high student dropout (or non-retention) rate could be the sign of a difficult, challenging programme and tough assessment criteria or of poor quality admissions criteria.

It could also be a sign of poor student support or poor to incentivise them staying on their course if it’s no longer teaching. As different student groups from particular right for them. A very high or low retention rate might be a backgrounds have different rates of retention, substantially signal to investigate further. influenced by the quality of those students, it is possible this measure is a proxy for student type rather than measuring The measure used is a HESA Performance Indicator, any characteristic of the programme they are on. It is a which only measures retention after one year and not after measure open to unintended consequences: incentivising subsequent years of study. providers to keep students on programmes regardless of progress or suitability. If students seek to leave a programme The Russell Group performs well on this measure. for the right reasons; whether moving home, changing subject, The University of Sheffield performs well on this measure in moving institution or accepting a job offer, we wouldn’t want the sector and in the Russell Group.

22 Potential Teaching Excellence Framework Measures

Students no longer in HE after one year

Top 5 % Russell Group % 1 The University of Buckingham 0.0 3 The University of Cambridge 1.4 2 Royal Academy of Music 0.0 4 The University of Oxford 1.4 3 The University of Cambridge 1.4 5 University of Durham 1.6 4 The University of Oxford 1.4 10 The University of Bristol 1.8 5 University of Durham 1.6 12 The University of Exeter 1.9 14 The University of Sheffield 2.4 Sheffield +/- 3 14 University of Newcastle-upon-Tyne 2.4 12 The University of Exeter 1.9 17 The University of Southampton 2.5 13 St Mary's University College 2.3 18 The University of Birmingham 2.5 14 Courtauld Institute of Art 2.4 19 Cardiff University 2.6 14 The University of Sheffield 2.4 20 The University of York 2.7 14 University of Newcastle-upon-Tyne 2.4 22 University of Nottingham 2.8 17 The University of Southampton 2.5 24 University College London 2.9 18 The University of Birmingham 2.5 27 The University of Leeds 3.0 36 Imperial College of Science, Technology and Medicine 3.5 Bottom 5 37 The University of Manchester 3.5 148 London South Bank University 13.7 39 The University of Warwick 3.7 149 London Metropolitan University 14.0 40 The University of Edinburgh 3.8 150 The University of the West of Scotland 14.4 45 King's College London 4.0 151 The 14.5 47 The Queen's University of Belfast 4.1 152 Heythrop College 15.2 48 The University of Liverpool 4.2 64 The University of Glasgow 5.0 68 London School of Economics and Political Science 5.2 76 Queen Mary University of London 5.7 Definition: Percentage of full-time first degree entrants who are no longer in HE after one year (young entrants only) Source: HEIDI Performance Indicators 2013/14

23 The University of Sheffield 11. Students from LPN (low participation neighbourhoods)

This measure, when combined with other measures, could indicate which institutions are best at teaching students from a diversity of backgrounds.

Achieving excellence is about providing opportunity to a risks penalising more selective institutions who find it harder wide variety of people, not simply educating an elite group to recruit students from LPNs by virtue of their higher entry of students. However, the measure could be seen as making requirements. universities responsible for failures in earlier stages of the education system. It could incentivise the recruitment of On this measure the University does not do particularly well students from LPN at the expense of students who might within the higher education sector, but is positioned near the have more ability but who are not from a target area. It also top of the Russell Group.

24 Potential Teaching Excellence Framework Measures

LPN

Top 5 % Russell Group % 1 30.57 63 The University of Liverpool 10.40 2 The 29.26 70 The University of Leeds 8.97 3 University Campus Suffolk 27.93 71 The University of Sheffield 8.91 4 The University of Bolton 25.68 74 Cardiff University 8.70 5 Glyndwr University 25.28 81 The University of Manchester 8.35 82 University of Newcastle-upon-Tyne 8.34 Sheffield +/- 3 85 The University of Southampton 8.16 68 The Arts University Bournemouth 9.72 90 University of Nottingham 7.69 69 Buckinghamshire New University 9.30 95 The University of York 7.16 70 The University of Leeds 8.97 99 The Queen's University of Belfast 7.06 71 The University of Sheffield 8.91 102 The University of Birmingham 6.79 72 The 8.87 120 The University of Warwick 5.32 73 University of Abertay Dundee 8.84 123 University of Durham 5.20 74 Cardiff University 8.70 124 The University of Exeter 5.17 125 The University of Glasgow 4.93 Bottom 5 127 Queen Mary University of London 4.41 149 Glasgow School of Art 2.48 128 University College London 4.39 150 The University of Oxford 2.25 131 London School of Economics and Political Science 4.12 151 Royal College of Music 1.64 132 King's College London 3.97 152 Institute of Education 1.11 133 The University of Bristol 3.86 153 Harper Adams University 0.00 135 The University of Cambridge 3.82 136 The University of Edinburgh 3.76 141 Imperial College of Science, Technology and Medicine 3.52 150 The University of Oxford 2.25 Definition: Percentage of first year undergraduate students from low participation neighbourhoods, defined by postcode; excluding unknowns Source: HESA sector data 2013/14

25 The University of Sheffield 12. Applications per registration

This measure could indicate how popular and desirable an institution is to applicants.

A measure of desirability with potential students could signal entry requirements in order to attract more applicants, which the quality of its teaching provision. However, the number of would mislead applicants and lead to wasted applications. applications could be affected by the entry requirements of an institution. Higher entry standards could deter potential The Russell Group performs well on this measure. students from applying as many are unlikely to be accepted The University of Sheffield performs well within the higher onto a course. This measure could penalise more selective education sector, but is positioned in the lower third of the universities and incentivise institutions to lower their stated Russell Group.

26 Potential Teaching Excellence Framework Measures

Applications per registration

Top 5 Russell Group 1 The Royal Central School of Speech and Drama 26.43 4 London School of Economics and Political Science 12.36 2 The Liverpool Institute for Performing Arts 15.92 7 The University of Edinburgh 9.58 3 Rose Bruford College 14.22 9 The University of Bristol 8.58 4 London School of Economics and Political Science 12.36 10 King's College London 7.95 5 The University of Aberdeen 11.71 14 University College London 7.50 16 Queen Mary University of London 7.34 Sheffield +/- 3 19 University of Nottingham 7.09 36 Leeds College of Art 6.32 21 The University of Southampton 6.99 37 The University of York 6.29 22 The University of Leeds 6.97 38 University of Durham 6.28 24 The University of Glasgow 6.93 39 The University of Sheffield 6.23 26 The University of Manchester 6.83 40 The University of Leicester 6.17 29 The University of Warwick 6.61 41 The 6.17 30 The University of Birmingham 6.60 42 Royal Holloway and Bedford New College 6.13 34 Imperial College of Science, Technology and Medicine 6.41 37 The University of York 6.29 Bottom 5 38 University of Durham 6.28 136 The University of Sunderland 2.41 39 The University of Sheffield 6.23 137 University of South Wales 2.38 43 The University of Liverpool 6.13 138 University Campus Suffolk 2.34 48 The Queen's University of Belfast 5.78 139 University College Birmingham 1.92 51 The University of Exeter 5.69 140 University of the Highlands and Islands 1.11 52 Cardiff University 5.64 59 The University of Oxford 5.41 61 University of Newcastle-upon-Tyne 5.37 Notes: There is more competition to gain a place at institutions 86 The University of Cambridge 4.75 higher up in the ranking Definition: Number of UCAS applications in 2013/14 to number of FT first year undergraduate students in 2013/14 Source: HEIDI 2013/14

27 The University of Sheffield 13. Proportion from state schools

This measure, when combined with other measures, could indicate which institutions are best at teaching students from a diversity of backgrounds.

Achieving excellence is about providing opportunity to a institutions who recruit more students from private schools wide variety of people, not simply educating an elite group by virtue of their higher entry requirements or because of of students. However, the measure could be seen as making their location in the country. universities responsible for inequality in the opportunities provided to students in earlier stages of their education. The University of Sheffield performs less well within the It could incentivise the recruitment of students from state higher education sector, but is positioned towards the top of schools and the expense of students who might have ability the Russell Group. but who are privately educated. It also risks penalising

28 Potential Teaching Excellence Framework Measures

% State School

Top 5 % Russell Group % 1 St Mary's University College 100.0 21 The Queen's University of Belfast 98.6 2 Stranmillis University College 100.0 108 The University of Glasgow 88.2 3 University of Ulster 100.0 110 The University of Liverpool 87.6 4 Institute of Education 99.5 113 Queen Mary University of London 86.8 5 Teesside University 99.5 114 The University of Sheffield 86.5 116 The University of Southampton 85.8 Sheffield +/- 3 118 Cardiff University 85.5 111 Heythrop College 87.3 123 The University of Manchester 83.1 112 The University of Reading 86.9 128 The University of York 81.4 113 Queen Mary University of London 86.8 129 The University of Birmingham 81.4 114 The University of Sheffield 86.5 132 The University of Leeds 80.1 115 Royal Conservatoire of Scotland 86.0 133 University of Nottingham 78.9 116 The University of Southampton 85.8 134 King's College London 78.2 117 St George's Hospital Medical School 85.8 136 The University of Warwick 76.6 138 University of Newcastle-upon-Tyne 75.4 Bottom 5 139 London School of Economics and Political Science 72.0 149 Courtauld Institute of Art 58.5 140 University College London 71.0 150 The University of Oxford 57.4 141 The University of Edinburgh 71.0 151 Royal Agricultural University 55.4 142 The University of Exeter 70.1 152 Royal College of Music 51.3 144 Imperial College of Science, Technology and Medicine 65.9 153 Royal Academy of Music 32.9 145 University of Durham 62.0 146 The University of Cambridge 61.5 147 The University of Bristol 60.9 150 The University of Oxford 57.4

Definition: Percentage of known UG home student population from state schools Source: HESA sector data 2013/14

29 The University of Sheffield About the Data

This data has been collected from the following sources:

HESA sector data 2013/14 1. Average Tariff 2. UG Degree outcomes 4. Destination of leavers: Positive destinations 5. Salaries for new graduates 11. Students from LPN 13. Proportion from state sector

HEIDI 2013/14 3. Student/Staff ratio 9. International staff 12. Applications per registration

NSS 2015 6. NSS: Overall satisfaction 7. NSS: Teaching on my course 8. NSS: Learning resources

HEIDI Performance Indicators 2013/14 10. Students no longer in HE after 1 year

For any queries about data definitions, please contact Catherine Spencer: [email protected]

30

Potential Teaching Excellence Framework Measures

33