Inventory of Language Certification in Europe a Report to the European
Total Page:16
File Type:pdf, Size:1020Kb
National Foundation for Educational Research Inventory of Language Certification in Europe A Report to the European Commission Directorate General for Education and Culture Jenny Bradshaw Catherine Kirkup March 2006 Acknowledgements We would like to thank the individuals and organisations mentioned below. All the individuals who responded to the online questionnaire, and the organisations which assisted in their distribution. The Eurydice units which provided information on the use of certification in their countries. The Association of Language Testers in Europe The European Association for Language Testing and Assessment We are also very grateful to the following providers, who supplied information on their certificates: Anglia Examinations Syndicate Assessment and Qualifications Alliance Basque Government Cambridge ESOL Centre de Langues Luxembourg Centre for Advanced Language Learning, Hungary Centre for the Greek Language Centre international d'études pédagogiques Centro Linguistico Italiano Dante Alighieri Citogroep CNaVT (Katholieke Universiteit Leuven, België/Universiteit van Amsterdam, Nederland) Welsh Joint Education Committee Danish Language Testing Consortium Department of Lithuanian Studies, Vilnius University Escola Oficial de Idiomas (Catalunya) Escuela Oficial de Idiomas (Madrid) European Consortium for the Certificate of Attainment in Modern Languages Finnish National Board of Education Generalitat de Catalunya Goethe-Institut IELTS Consortium Institute of Linguists Educational Trust UK Instituto Cervantes National Examination and Qualification Centre, Estonia NUI Maynooth Österreichisches Sprachdiplom Deutsch Republic of Latvia Naturalisation Board State Commission for Polish as a Foreign Language Certification Stockholms Universitet Teacher Professional Development Centre, Lithuania TestDaF-Institut The English Speaking Board Trinity College Università per Stranieri di Perugia Università per Stranieri di Siena University of Athens University of Lisbon University Of Ljubljana, Centre For Slovene As A Second/Foreign Language University of Michigan English Language Institute University of Sofia, Bulgaria Weiterbilduns-Testsysteme GmbH The NFER Project Team Project Director Chris Whetton Project Leader Jenny Bradshaw Project Researchers Catherine Kirkup Katie Pyle Hanna Vappula Helen Foster Brenda Cunnane Eurydice Unit Sigrid Boyd Statistician Emma Scott Online Questionnaire Edward Wallis Website Design George Tsverik Project Administrator Pat Bhullar CONTENTS 1 Introduction........................................................................................1 1.1 Aims and background..................................................................................2 1.2 An inventory of certificates and providers ................................................3 1.3 Methodology .................................................................................................4 1.4 Structure of the report.................................................................................5 2 Uses of language certification ...........................................................6 2.1 State recognition of certificates in national languages .............................6 2.2 Use of foreign language certificates from other countries .......................7 2.3 Uses of language certificates for study.......................................................9 2.3.1 Certificates for study purposes...............................................................9 2.3.2 Requirements for study in different countries .......................................9 2.3.3 The proficiency level required for study..............................................10 2.4 Citizenship ..................................................................................................11 2.5 Extent of certification ................................................................................13 2.6 Choice of certification................................................................................15 2.7 Cost of certification....................................................................................16 2.8 Summary.....................................................................................................17 3 Survey of teachers and learners .....................................................18 3.1 Background of respondents ......................................................................18 3.2 Language certificates.................................................................................22 3.2.1 Certificates taught................................................................................22 3.2.2 Reasons learners choose certificates....................................................28 3.2.3 Teachers’ opinions...............................................................................30 3.2.4 Learners’ opinions...............................................................................39 3.3 Summary.....................................................................................................48 4 Quality assurance.............................................................................49 4.1 Quality standards.......................................................................................49 4.2 Background of test writers........................................................................54 4.3 Test marking...............................................................................................55 4.4 Investigation of the properties of tests .....................................................56 4.5 Setting level cut scores or pass marks......................................................60 1 4.6 Information for test users..........................................................................62 4.7 Summary.....................................................................................................66 5 The Common European Framework.............................................67 5.1 Background ................................................................................................67 5.2 Information from providers on levels ......................................................69 5.2.1 Development of objectives ..................................................................70 5.2.2 Research studies...................................................................................70 5.2.3 Comparison with other level frameworks............................................72 5.2.4 Comparison with other tests.................................................................73 5.2.5 Expert judgment...................................................................................74 5.3 Summary.....................................................................................................75 6 Conclusions and recommendations................................................77 6.1 Uses of language certificates .....................................................................77 6.1.1 The extent of learners’ use and choice of certificates..........................77 6.1.2 Use of external certificates within educational systems ......................79 6.3 The quality of certificates..........................................................................79 6.4 The way forward........................................................................................80 6.4.1 Collaboration.......................................................................................80 6.4.2 Common European Framework reference levels................................82 6.4.3 Usability of the CEF ...........................................................................83 6.5 Conclusion ..................................................................................................83 7 References .........................................................................................84 Appendix A Online questionnaire 86 Appendix B Test development and validation 92 Appendix C List of certificates 97 Appendix D Summary of certificates by level 113 2 1 Introduction This report is one of the products of the Inventory of Language Certification Systems in Europe project. The second main product is a searchable online inventory on the website of the European Commission. This project had several information-gathering phases. The first was the identification and collation of e-mail addresses of language schools and language teaching organisations across Europe. This resulted in a database of approximately 3000 addresses. After these contacts had been collated, an e-mailed invitation was sent to complete an online questionnaire which was hosted on the NFER website, with a request to pass on the invitation to appropriate colleagues. The questionnaire was available in English, French, German and Spanish and was online from April to June 2005, with reminders sent to those who did not complete the questionnaire. The results of this questionnaire are described in Chapter 3. In a concurrent information-gathering phase, the languages in which certificates should be sought were decided, and the names of certificates in these languages and of certificate providers were researched. This was done initially through information already available to the team, through websites such as that of the Association of Language Testers in Europe (ALTE), and through other web searches. This stage was ongoing, with more providers being added to the provider database, and more contacts made, as additional