Social Research Number: 8/2018 Publication Date: 05/02/2018 Seren Network Evaluation Final Report Mae’r ddogfen yma hefyd ar gael yn Gymraeg. This document is also available in Welsh. © Crown Copyright Digital ISBN 978-1-78903-461-5 Seren Network Evaluation Author: Nia Bryer, OB3 Research with contributions from Rhys Davies and Suhaer Yunus, ADRC-Wales, Cardiff University Views expressed in this report are those of the researcher and not necessarily those of the Welsh Government For further information please contact: Heledd Jenkins Knowledge and Analytical Services Social Research and Information Division Welsh Government Cathays Park Cardiff Email: [email protected] ISBN: 978-1-78903-461-5 © Crown Copyright 2018 Contents List of tables .......................................................................................................... 6 List of Figures ........................................................................................................ 6 Glossary .......................................................................................................................... 7 1. Introduction ..................................................................................................................... 7 Structure of this report .......................................................................................... 9 2. Evaluation Methodology ............................................................................................ 10 Method ................................................................................................................. 10 Methodological considerations .......................................................................... 12 Profile of survey respondents ............................................................................ 12 3. Introduction to the Seren Network ........................................................................... 16 Policy context ...................................................................................................... 16 The HEI context .................................................................................................. 19 The Oxbridge Ambassador Research .............................................................. 20 Seren Network’s aims and objectives ............................................................... 20 Structure and delivery model ............................................................................. 24 4. Published Data............................................................................................................. 27 Top A Level attainment ...................................................................................... 27 Oxbridge applications, offers and enrolments.................................................. 28 Other top university applications, offers and enrolments ................................ 31 Welsh domiciled students at UK HEIs .............................................................. 32 UCAS Applicant Data ......................................................................................... 33 Conclusions ......................................................................................................... 34 5. Design, Rationale and Evidence of Need .............................................................. 35 Aims and Objectives ........................................................................................... 35 Design and Rationale ......................................................................................... 37 Complementarity of provision ............................................................................ 39 6. Delivery model and management ............................................................................ 43 Hub Boundaries .................................................................................................. 43 Collaboration between hubs .............................................................................. 44 Seren Funding ..................................................................................................... 45 Role of Co-Ordinator .......................................................................................... 47 3 Governance ......................................................................................................... 48 Role of the Welsh Government ......................................................................... 48 Seren Network Co-ordinators meeting ............................................................. 49 Data collection and reporting ............................................................................. 50 Brilliant Club ........................................................................................................ 52 Promotion and Communications ....................................................................... 53 7. Awareness, recruitment and engagement ............................................................. 55 Reasons for engagement ................................................................................... 55 Selection criteria ................................................................................................. 56 Attendance .......................................................................................................... 60 Awareness and understanding .......................................................................... 62 Communication ................................................................................................... 65 8. Programme of provision and how local hubs are working ................................. 67 Nature of Provision ............................................................................................. 67 Quality of Provision ............................................................................................. 69 Areas for improvement ....................................................................................... 71 Timings of Provision ........................................................................................... 72 Location and accessibility .................................................................................. 73 Frequency of provision ....................................................................................... 74 Views on hub management ............................................................................... 75 Usefulness of provision ...................................................................................... 76 Welsh language .................................................................................................. 78 National Conference ........................................................................................... 80 9. Engagement with HEIs .............................................................................................. 82 Nature of engagement ........................................................................................ 82 Feedback from HEIs ........................................................................................... 83 Feedback from non-engaged HEIs ................................................................... 85 The way forward to engaging HEIs ................................................................... 86 10. Difference Made .......................................................................................................... 88 Positive effects .................................................................................................... 88 Unintended effects .............................................................................................. 93 11. Final impact Evaluation .............................................................................................. 94 Introduction .......................................................................................................... 94 4 Sources of Data to Support the Evaluation of Seren ...................................... 96 Identifying Seren Participants within Administrative Data............................. 101 Assessing the Impact of the Seren Scheme .................................................. 106 Conclusion ......................................................................................................... 111 12. Conclusions and Recommendations .................................................................... 113 Annex A Survey Questionnaires .......................................................................................... 123 Annex B Data sources ............................................................................................................ 148 Annex C HEIs interviewed ..................................................................................................... 151 5 List of tables Table 3.1: Number of Participants by Seren hub ...................................................... 26 Table 4.1: A level results by grade ........................................................................... 27 Table 4.2: Welsh domiciled offer and acceptance rates at University of Oxford compared with other UK regions .............................................................................. 29 Table 4.3: Welsh domiciled applicants and acceptances at University of Oxford ..... 29 Table 4.4: Welsh domiciled applicants, offers and acceptances to University of Cambridge ...............................................................................................................