Minority Ethnic Language and Achievement Project Evaluation
Total Page:16
File Type:pdf, Size:1020Kb
Social research Number: 17/2014 Minority Ethnic Language and Achievement Project Evaluation Minority Ethnic Language and Achievement Project Evaluation ICF GHK in association with Arad Consulting Views expressed in this report are those of the researcher and not necessarily those of the Welsh Government For further information please contact: Martina Aumeyr Knowledge and Analytical Services Welsh Government Cathays Park Cardiff CF10 3NQ Tel: 02920 801125 Email: [email protected] Welsh Government Social Research, 2014 ISBN 978-1-4734-1004-6 © Crown Copyright year Table of Contents Table of tables .............................................................................................................. i Table of boxes ............................................................................................................. ii Table of figures ........................................................................................................... iii Glossary of acronyms ................................................................................................. iv Executive Summary .................................................................................................... 1 1 Introduction ........................................................................................................... 14 2 Understanding support for EAL pupils .................................................................. 31 3 Implementation of MELAP .................................................................................... 41 4 Outputs and outcomes ......................................................................................... 70 5 Added value of the project ...................................................................................105 6 Conclusions and recommendations ....................................................................124 Annex 1 Case studies ...........................................................................................134 Annex 2 Detailed information from Management Information ...............................161 Annex 3 Activities delivered ..................................................................................167 Annex 4 Achievement of non-EAL learners in MELAP areas ...............................172 Annex 5 Interview guides for qualitative research .................................................174 Annex 6 Pupil Survey............................................................................................191 Annex 7 Staff Survey ............................................................................................195 Table of tables Table 2.1Funding allocated and spent by Local Authority area at 10/2013 (£) ......... 39 Table 3.1 Schools providing support through MELAP ............................................. 41 Table 3.2 Number of EAL pupils supported through MELAP ................................... 43 Table 3.3 Average spend per participant receiving support ..................................... 44 Table 3.4 Age of beneficiary when entered on the MELAP management information database ............................................................................................................ 45 Table 3.5 Most common ethnic groups supported through MELAP ......................... 46 Table 3.6 Staff who have received training and achieved qualifications through MELAP .............................................................................................................. 48 Table 3.7 Activities delivered through MELAP ......................................................... 55 Table 3.8 Full time equivalent (FTE) staff providing services through MELAP (total staff) .................................................................................................................. 58 Table 4.1 Number of pupils supported through MELAP compared to target............ 73 Table 4.2 Number of pupils achieving a home language qualification through MELAP compared to targets........................................................................................... 74 Table 4.3 Number of pupils achieving a positive outcome through MELAP compared to target ............................................................................................................. 75 Table 4.4 Analysis of Change in EAL language stage by Local Authority................ 78 Table 4.5 Analysis of changes in EAL language stage by gender ........................... 79 Table 4.6 Analysis of changes in EAL language stage by EAL stage when MELAP support began ................................................................................................... 80 Table 4.7 Analysis of changes in EAL language stage by number of years support 81 Table 4.8 Total PASS results, average scores ........................................................ 89 Table 4.9 Total PASS results, number of flags issued ............................................. 90 Table 4.10 Pupils taking part in every wave of PASS, average scores ................... 91 Table 4.11 Pupils taking part in every wave of PASS, number of flags issued ........ 92 Table 4.12 Views of MELAP staff on support provided ............................................. 99 Table 5.1 Additionality of MELAP ...........................................................................107 Table 6.1 Consideration of design and development issues...................................125 Table 6.2 Consideration of delivery and performance issues .................................127 Table 6.3 Consideration of added value issues ......................................................128 i Table of boxes Box 1: Aims of the interim evaluation phase ............................................................. 19 Box 2: Aims of the final evaluation phase ................................................................. 20 Box 3: PAR data source ........................................................................................... 23 Box 4: Pass data source ........................................................................................... 25 ii Table of figures Figure 1.1 Minority Ethnic Language and Achievement Project Evaluation Logic Model ..................................................................................................... 29 Figure 3.1 Number of pupils reporting the type of activities received ...................... 51 Figure 3.2 Number of staff reporting the number of pupils supported ...................... 60 Figure 3.3 Activities carried out by EAL staff ........................................................... 61 Figure 4.1 Pupils’ views of the impact of support ..................................................... 83 Figure 4.2 Pupils views on the level of support they receive ................................... 85 Figure 4.3 Impact of activities on pupils reported by delivery staff ........................... 97 Figure 5.1 Achievement of all EAL pupils taking GCSE examinations in MELAP areas, 2010-2012 .................................................................................110 Figure 5.2 Difference between the achievement of EAL learners and non-EAL learners taking GCSE examinations in MELAP areas, 2010-2012 .......112 Figure 5.3 Achievement of EAL pupils taking GCSE examinations in MELAP areas (excluding pupils with SEN and FSM entitlement), 2010-2012 .............114 Figure 5.4 Difference between the achievement of EAL learners and non-EAL learners taking GCSE examinations in MELAP areas, 2010-2012 (excluding pupils with SEN and FSM entitlement) ................................116 Figure 5.5 Percentage point difference between the achievement of EAL learners and non-EAL learners at level 1 (excluding SEN and FSM entitled learners), 2010-2012 ............................................................................118 Figure 5.6 Difference between the achievement of EAL learners and non-EAL learners at level 2 (excluding SEN and FSM entitled learners), 2010-2012 .............................................................................................................119 Figure 5.7 Difference between the achievement of EAL learners and non-EAL learners at level 2 EW&M (excluding SEN and FSM entitled learners), 2010-2012 ............................................................................................120 Table of tables i Table of boxes ii Table of figures iii Glossary of acronyms vi Executive Summary 1 iii 1 Introduction 14 2 Understanding support for EAL pupils 31 3 Implementation of MELAP 41 4 Outputs and outcomes 70 0% 81 0% 81 1% 81 71% 81 26% 81 1% 81 0% 81 100% 81 0% 81 0% 81 0% 81 56% 81 39% 81 4% 81 1% 81 100% 81 0% 81 0% 81 1% 81 47% 81 46% 81 6% 81 1% 81 100% 81 0% 81 0% 81 1% 81 55% 81 40% 81 4% 81 0% 81 iv 100% 81 5 Added value of the project 105 6 Conclusions and recommendations 124 v Glossary of acronyms AWEMA: All Wales Ethnic Minority Association BME: Black and Minority Ethnic EAL: English as an Additional Language EMAS: Ethnic Minority Achievement Service ESF: European Social Fund EW&M: English, Welsh and mathematics FTE: Full Time Equivalent GCSE: General Certificate of Secondary Education GRT: Gypsy, Roma and Traveller LA: Local Authority MEAG: Minority Ethnic Achievement Grant MELAP: Minority Ethnic Language and Achievement Project NEET: Not in Employment, Education or Training PAR: Pupil Achievement Record PASS: Pupil Attitudes to Self and School PLASC: Pupil Level Annual School Census UN: United Nations WEFO: Welsh European Funding