Evaluation of the Education Maintenance Allowance (EMA): Technical Appendix
Total Page:16
File Type:pdf, Size:1020Kb
Ymchwil gymdeithasol Social research Number: 91/2014 Evaluation of the Education Maintenance Allowance (EMA) and Assembly Learning Grant (FE): Technical Appendix 1 Evaluation of the Education Maintenance Allowance (EMA): Technical Appendix Authored by Nia Bryer with inputs from Gareth Williams and Rhys Davies Old Bell 3 Ltd and Cardiff University Views expressed in this report are those of the researcher and not necessarily those of the Welsh Government For further information please contact: Sara James Department: Knowledge and Analytical Services Welsh Government Cathays Park Cardiff CF10 3NQ Tel: 0300 025 6812 [email protected] Welsh Government Social Research, 23 October 2014 ISBN: 978-1-4734-2438-8 © Crown Copyright 2014 Table of contents ANNEXE A: EVALUATION WORK PROGRAMME ....................................... 3 ANNEXE B: PROFILE OF EVALUATION PARTICIPANTS ......................... 12 ANNEXE C: ANALYSIS OF EMA RECIPIENTS WITH THE WIDENING ACCESS DATABASE ................................................................................... 18 ANNEXE D: EVALUATION RESEARCH INSTRUMENTS ........................... 33 ANNEXE E: AN OVERVIEW OF FE FUNDING INITATIVES OR SCHEMES AVAILABLE TO STUDENTS AGED 16 TO 19 YEARS OLD ACROSS THE FE SECTOR .................................................................................................. 94 2 ANNEXE A: EVALUATION WORK PROGRAMME Overview of work programme 1.1 Our work programme for undertaking this evaluation has involved the following stages and activities: Inception (November 2013 – April 2014) 1.2 Attending an Inception meeting with the Evaluation Steering Group to discuss the requirements of the evaluation and our proposed methodology, and preparing an Evaluation Inception Report. 1.3 Accessing the following documents relating to the administration and promotion of the EMA and ALG(FE) in Wales: Student Finance Wales Publications EMA ‘Coming soon …’ Promotional poster for EMA 2013/14 ‘Education Maintenance Allowance 2013/14 Eligibility’ Leaflet ‘Apply now for EMA’ Promotional Poster for 2013/14 ‘The little book of EMA’ for 2013/14 ‘EMA Next Steps Leaflet’ for 2013/14 ‘EMA Standard Application Form’ for 2013/14 EMA School and College Education Maintenance Allowance Guidance Notes for 2013/14 ALG FE ‘Coming soon...’ Promotional Leaflet for ALG FE 2013/14 ‘Coming soon … ‘ Promotional poster for ALG FE 2013/14 ‘ALG FE Application Form for academic year 2013/14 ‘Assembly Learning Grant Guidance Notes for academic year 2013/14’ ‘Apply now for ALG FE’ Leaflet for 2013/14 ‘Apply now for ALG FE’ Poster for 2013/14 ALG FE Guidance Notes for Learning Centres Academic Year 2013/14 Welsh Government published statistics Education Maintenance Allowances Awarded in Wales 2012/13 (September 2013) Assembly Learning Grants Awarded to Welsh Domiciled Students in Further Education 2012/13 (October 2013) 3 1.4 Accessing the following policy, research and evaluation documents/reports relating to FE student finance across Wales and the UK: Wales a) Welsh Assembly Government (October 2009) ‘Investing in Skills: Sector Priorities Funding, Fees Policy and Financial Support for Learners’ Consultation document b) Welsh Assembly Government (2010) Response to a consultation on Investing in Skills: Sector Priorities Funding, Fees Policy and Financial Support for Learners’ c) Arad Consulting and GfK NOP Social Research (June 2008) ‘First Stage Evaluation of the Education Maintenance Allowance in Wales: A report for the Department for Children, Education Lifelong Learning and Skills’ d) National Assembly For Wales Enterprise and Learning Committee (April 2009) Various oral and written evidence received and the Welsh Assembly Government Response1 e) National Assembly for Wales (2013) Website petition EMA for all2 f) National Assembly for Wales (2013) Inquiry into educational Outcomes for Children from Low Income Households3 g) Estyn (July 2011) The impact of deprivation on learners’ attainment in further education and work-based learning h) Estyn Annual Report 2011 - 2012 England a. Department for Education and Skills Research Report (2005) No 678 ‘Evaluation of Education Maintenance Allowance Pilots: Young People Aged 16 to 19 Years Final Report of the Quantitative Evaluation’ (Centre for Research in Social Policy and Institute for Fiscal Studies) b. House of Commons Library (January 2011) Education Maintenance Allowance (EMA) Statistics c. Institute for Fiscal Studies (November 2007) ‘Education Maintenance Allowance: Evaluation with Administrative Data The impact of the EMA pilots on participation and attainment in post-compulsory education’ d. Institute for Fiscal Studies (April 1999) Education Maintenance Allowance (EMA)evaluation e. National Centre for Social Research ‘Research Report No 411(2003) The reflections of Early Leavers and second year participants on the Education Maintenance Allowance Scheme. A Qualitative Study’ f. Research and Consultancy Service (2007) Evaluation of the EMA National Roll-out – Final Report g. CfBT Education Trust (April 2009) Should we end the Education Maintenance Allowance; h. Institute for Fiscal Studies (December 2010) Observations: reflections on 4 current events 1 http://www.assemblywales.org/bus-home/bus-third-assembly/bus-committees/bus-committees- scrutiny-committees/bus-committees-third-els-home/bus-committees-third-els-report/bus-committees- third-el-report-el3-09-r06.htm 2 http://www.senedd.assemblywales.org/mgIssueHistoryHome.aspx?IId=6523&Opt=0 3 http://www.senedd.assemblywales.org/mgIssueHistoryHome.aspx?IId=6996 4 http://www.ifs.org.uk/publications/5370 4 Scotland a. The Scottish Government (2008) Consultation Document – 16+ Learning Choices: First Step Activity and Financial Support b. The Scottish Government (2007) Young People’s Awareness and Experience of Educational Maintenance Allowances (EMAs) and their Impact on Choices and Pathways c. Various publications (2002 and 2005) from the Centre for Educational Sociology Evaluation of Education Maintenance Allowance Pilots in Scotland Phase I and 25 Northern Ireland a. Northern Ireland Assembly (September 2011) Committee for Employment and Learning Review of Education Maintenance Allowance Departmental Briefing6 International a. The National Bureau of Economic Research (NBER) Working Paper No 19227 (July 2013) ‘Turning a Shove into a Nudge? A ‘Labeled Cash Transfer’ For Education 1.5 Accessing various other sources providing information on the administration and take up of other FE student financial support in Wales and England such as the Financial Contingency Fund, Army Further Education Bursary Scheme (FEBS), Royal Air Force Sixth Form Scholarship, Tuition fee support, Professional and Career Development Loan (PCDL), City and Guilds bursaries, Dance and Drama Awards (DaDA), General Federation of Trade Unions Education Trust grants, 24+ Advanced Learning Loan (England only), 16 to 19 Bursary Fund (England only), Discretionary Learner Support (for childcare) (England only), Childcare Grant (England only) and Care to Learn (England only). Details for these schemes are presented in Annexe E of this Technical Appendix. 1.6 Liaising with the Welsh Government and the Students Loans Company (SLC) to discuss evaluation data requirements and resolving data sharing issues. Data Sharing Agreements were put in place between the SLC and the Welsh Government to enable the sharing of SLC data with the Welsh Government. Two Data Access Agreements were also put in 5 http://www.ces.ed.ac.uk/research/Recent%20projects/EMA/publications.html 6 Note that as yet we have been unable to access the PricewaterhouseCoopers review of the EMA in Northern Ireland 5 place to enable the Welsh Government to share anonymised SLC datasets with WISERD and to share EMA and ALG (FE) previous recipient contact data (where these students had consented to this) with Old Bell 3. The data was transferred to WISERD and to Old Bell 3 via the secure Welsh Government portal (DEWI) and accessed in April 2014 by contracted providers. Furthermore the SLC made available to Old Bell 3, two databases of learning centres responsible for administering both EMA and ALG (FE) schemes in order to select a cross-section of institutions to include in our fieldwork. 1.7 Undertaking a scoping study for the analysis of administrative data held by SLC, relating to recipients of EMA/ALG (FE) and data held by the Welsh Government, about school pupils and student participation in post-compulsory education. The findings of this scoping study were set out in an Evaluation Inception Report. 1.8 Agreeing a list of key stakeholders to be interviewed and receiving contact data for them. 1.9 Undertaking scoping interviews with policy officials from the Higher Education Division of the Welsh Government and discussing our proposed methodology with stakeholders from the sector at the FE Student Services Network on 12th of December 2013. 1.10 Providing a form of wording for the Welsh Government, the SLC and other members of the Evaluation Steering Group to use as appropriate to brief stakeholders and learning centres about this evaluation. Desk Research and Development of Research Tools (January – May 2014) 1.11 Reviewing key documentation relating to the administration of the EMA/ALG (FE) in Wales, identifying key changes to the schemes over time and take-up amongst the student population. 6 1.12 Reviewing UK and WG policies to understand how EMA/ALG (FE) contributes towards WG student finance commitments and how the wider policy context for FE student finance has