Ari Huhta Innovations in Diagnostic Assessment and Feedback

Total Page:16

File Type:pdf, Size:1020Kb

Ari Huhta Innovations in Diagnostic Assessment and Feedback ARI HUHTA INNOVATIONS IN DIAGNOSTIC ASSESSMENT AND FEEDBACK: AN ANALYSIS OF THE USEFULNESS OF THE DIALANG LANGUAGE ASSESSMENT SYSTEM Ari Huhta Innovations in diagnostic assessment and feedback: An analysis of the usefulness of the DIALANG language assessment system Esitetään Jyväskylän yliopiston humanistisen tiedekunnan suostumuksella julkisesti tarkastettavaksi yliopiston Villa Rana –rakennuksen Paulaharjun salissa helmikuun 27. päivänä 2010 kello 12. Academic dissertation to be publicly discussed, by permission of the Faculty of Humanities of the University of Jyväskylä, in the Buiding Villa Rana, Auditorium Paulaharju, on February 27 th at 12 o’clock noon. ii ABSTRACT The thesis analyses the quality of DIALANG, which is a multilingual language assessment system that provides learners with immediate, on-line feedback about the strengths and weaknesses in their proficiency. Some of the evidence for its quality is provided by the present author in the articles appended to this thesis; other evidence comes from a range of studies summarized in the synthesis part of the thesis. The quality evidence divides into theoretical arguments that were presented in the design documents of DIALANG and into empirical evidence that was collected in the piloting and operational stages of the system. All this evidence is presented and analysed with reference to the Bachman and Palmer (1996) framework on test usefulness that uses usefulness as the super-ordinate term that characterizes the quality of a test or assessment system. According to Bachman and Palmer several factors contribute to the usefulness of a test for its intended purpose(s): reliability, construct validity, authenticity, interactiveness, impact, and practicality. In principle, the better the quality of each of these aspects is, the more useful the test is. Available evidence does not allow us to obtain a balanced picture of all the aspects of test usefulness for DIALANG, neither are all its languages equally covered. The most comprehensive evidence concerns impact and construct validity. Overall, the system appears reasonably useful for the purposes that concern individual learners and their teachers – such as finding out the learners’ level of proficiency and their profile of strengths and weaknesses. A survey of over 550 DIALANG users by the author showed that a significant majority of the informants reacted positively to the system and found the feedback they got useful. User statistics show that hundreds of thousands of learners have taken DIALANG tests or visited its website – and even more must have been informed about the system by their teachers and institutions. The impact of DIALANG is greatest in the Netherlands, Germany, France, and Finland. Many institutions use the system for placing their students on language courses even though it was not developed for that purpose and thus lacks many features that would be useful for a proper placement test. Evidence also indicates certain problems with the system, most notably with the placement test, as well as with some technical aspects of the system, at least with some learners and institutions. In the longer term the most important impact of DIALANG is probably its scientific impact on applied linguistics: it brought to researchers’ attention the fact how little we in fact know about diagnosing foreign language learning, which has spurred a considerable amount of new, interesting research into the diagnosis of language learning. Keywords: language assessment, diagnosis of foreign language proficiency, diagnosis of foreign language learning, feedback, computerised testing, self-assessment iii Author’s address Ari Huhta Centre for Applied Language Studies University of Jyväskylä Box 35 40014 University of Jyväskylä Finland [email protected] Supervisors Prof. Hannele Dufva Department of Languages University of Jyväskylä Reviewers Prof. emeritus Mats Oscarson Institutionen för pedagogik och didaktik Göteborgs Universitet Sverige Prof. Angela Hasselgreen Senter for utdanningsforskning Høgskolen i Bergen / Universitetet i Bergen Norge Opponents Prof. emeritus Mats Oscarson Institutionen för pedagogik och didaktik Göteborgs Universitet Sweden iv PREFACE This work is based on the DIALANG project (1996-2004), in which my own department, the Centre for Applied Language Studies (CALS) was involved, first as the coordinator and then as one of the four core project partners. I had the fortune to work in the project in many different roles, as is described in Appendix 2 of the synthesis part of this thesis. None of us who were involved in DIALANG at its early stages could foresee how long the project would last, nor how laborious and, sometimes, how frustrating the whole venture could be. However, designing this multilingual assessment system also turned out to be highly stimulating and rewarding for those participating in its development, as we had to face and solve a number of truly interesting and challenging problems along the way. Although we were able to tackle many questions about diagnosing strengths and weaknesses in language learners’ proficiency, ironically, the most important lesson we learned from the work on DIALANG was how little we in fact know about diagnosing second / foreign language proficiency and learning. Hopefully this realization will lead to more research into diagnosing proficiency so that if anything like DIALANG gets designed in the future, the result will be something that is significantly more useful to the individual learner than what DIALANG can be. Considerable amount of research was carried out during the development of DIALANG to address the challenges facing the project, and studies on the system have continued after the project came to an end in 2004. Much of the earlier research is reported in Alderson’s 2005 book that brought our lack of knowledge on diagnosing second / foreign language learning to the attention of the language testing world. There is, however, no comprehensive account of the different kinds of studies that have analysed different features of DIALANG or that have used DIALANG as a tool to study other things and have, as a byproduct, yielded interesting information about its quality. The synthesis part of my thesis is an attempt to bring together as much information as possible about how DIALANG has succeeded (or in some cases, failed) to meet different expectations and to fulfill the purposes it was created for. No study is possible without the professional and other support of many people. In addition to being lucky enough to participate in the design of DIALANG, I have been fortunate in having a chance to work in a very stimulating and supporting environment. I would like to warmly thank my former and present colleagues in the CALS and its predecessor, the Language Centre for Finnish Universities, and also elsewhere in the University of Jyväskylä as well as in several other universities and organizations in Finland and abroad, for countless meetings, discussions, and other exchange of ideas that have directly and indirectly contributed to my work on DIALANG and everything else that I have done during my career. I would like to single out three persons who have profoundly influenced not only DIALANG but also my study on that system, as well as my own professional development in general: The late Professor and Director of CALS Kari Sajavaara, Professor emeritus Sauli Takala, and Professor J. Charles Alderson. I was first a student of Kari Sajavaara and Sauli Takala in the 1980s and then worked with them for about 15 years in numerous projects from the late 1980s until their retirement in the early 2000s. Our joint projects included, for example, the development of a national test for business and administration purposes (the TKD or Työelämän kielidiplomi), the National Certificates examination system, the IEA Language Education Study, and, finally, DIALANG. Our co-operation continued even after their retirement, although, naturally, on a much smaller scale. My co-operation with Charles v Alderson also goes back a long time: it started with an international survey of standards in language testing in the mid 1990s, and was followed by other international projects, the most important of which was obviously DIALANG. Our collaboration continues in a research project aiming to shed more light on the diagnosis of second / foreign language learning. I owe Kari, Sauli and Charles much of what I know about applied linguistics, language test and research design, international networking, and project management. I am indebted to a large number of people who helped me in the collection of the data for my own empirical studies on DIALANG. I am particularly grateful to the 557 language learners in Finland and Germany who took the trouble to fill in the extensive questionnaire that I used in my data collection. Some of them also consented to be interviewed by me. Equally important were the language teachers in numerous institutions who were already, or became during the study, interested in using DIALANG as part of their teaching and who encouraged their students to fill in my questionnaire. Some of the teachers, too, were kind enough to let me interview them about their experiences in using the system. Another vital group in the data gathering was the roughly 30 teachers and colleagues around Finland and at the CALS who volunteered to assist in the concept mapping study of self-assessment that is partly reported in one of the articles that form my thesis. Several students who worked at the CALS as trainees at different times helped me in getting my questionnaire and interview data ready for analyses – their assistance was simply invaluable and is gratefully acknowledged here. Without the love, support and patience of my wife Anne and my sons Otto and Riku I could not have carried out my work. They have also shown me how there is life outside work by providing opportunities to relax at home in the evenings and on our trips to Lapland and even further away. I have been very fortunate in having a wife who is an academician and understands what research is like and the burden it often places on the family.
Recommended publications
  • A Pattern Language for Teaching in a Foreign Language - Part 2
    A Pattern Language for Teaching in a Foreign Language - Part 2 Christian K¨oppe and Mari¨elle Nijsten Hogeschool Utrecht, Institute for Information & Communication Technology, Postbus 182, 3500 AD Utrecht, Netherlands {christian.koppe,marielle.nijsten}@hu.nl http://www.hu.nl Abstract. Teaching a technical subject in a foreign language is not just switching to the foreign language. There are specific problems related to the integration of content and learn- ing. This paper is part of ongoing work with mining of patterns which address these problems and intends to offer practical help to teachers by working towards a pattern language for technical instructors who teach students in a second language, and who are not trained in language pedagogy. This is the pre-conference version for the PLoP'12 conference. Note to workshop participants: for the PLoP 2012 conference we would like to focus on following patterns: Content-Compatible Language, Commented Action, and Language Monitor. We also would like to work on the list of related educational patterns. However, feedback on the other patterns is more than welcome, they are therefore all included in this workshop version of the paper. 1 Introduction The set of patterns introduced in this paper is aimed at instructors who occasionally want | or have | to teach a class in a foreign language instead of their mother tongue. The patterns are meant to support these instructors in preparing for these classes in such a way that a foreign language will not be a barrier to students' understanding of the course content. This set of patterns is part of a larger project for developing a pattern language for teaching in a foreign language.
    [Show full text]
  • Aurora Tsai's Review of the Diagnosis of Reading in a Second Or Foreign
    Reading in a Foreign Language April 2015, Volume 27, No. 1 ISSN 1539-0578 pp. 117–121 Reviewed work: The Diagnosis of Reading in a Second or Foreign Language. (2015). Alderson, C., Haapakangas, E., Huhta, A., Nieminen, L., & Ullakonoja, R. New York and London: Routledge. Pp. 265. ISBN 978-0-415-66290-1 (paperback). $49.95 Reviewed by Aurora Tsai Carnegie Mellon University United States http://www.amazon.com In The Diagnosis of Reading in a Second or Foreign Language, Charles Alderson, Eeva-Leena Haapakangas, Ari Huhta, Lea Nieminen, and Riikka Ullakonoja discuss prominent theories concerning the diagnosis of reading in a second or foreign language (SFL). Until now, the area of diagnosis in SFL reading has received little attention, despite its increasing importance as the number of second language learners continues to grow across the world. As the authors point out, researchers have not yet established a theory of how SFL diagnosis works, which makes it difficult to establish reliable procedures for accurately diagnosing and helping students in need. In this important contribution to reading and diagnostic research, Alderson et al. illustrate the challenges involved in carrying out diagnostic procedures, conceptualize a theory of diagnosis, provide an overview of SFL reading, and highlight important factors to consider in diagnostic assessment. Moreover, they provide detailed examples of tests developed specifically for diagnosis, most of which arise from their most current research projects. Because this book covers a wide variety of SFL reading and diagnostic topics, researchers in applied linguistics, second language acquisition, language assessment, education, and even governmental organizations or military departments would consider it an enormously helpful and enlightening resource on SFL reading.
    [Show full text]
  • An Introduction to Applied Linguistics This Page Intentionally Left Blank an Introduction to Applied Linguistics
    An Introduction to Applied Linguistics This page intentionally left blank An Introduction to Applied Linguistics edited by Norbert Schmitt Orders: please contact Bookpoint Ltd, 130 Milton Park, Abingdon, Oxon OX14 4SB. Telephone: (44) 01235 827720. Fax: (44) 01235 400454. Lines are open from 9.00 to 5.00, Monday to Saturday, with a 24-hour message answering service. You can also order through our website www.hoddereducation.co.uk If you have any comments to make about this, or any of our other titles, please send them to [email protected] British Library Cataloguing in Publication Data A catalogue record for this title is available from the British Library ISBN: 978 0 340 98447 5 First Edition Published 2002 This Edition Published 2010 Impression number 10 9 8 7 6 5 4 3 2 1 Year 2014, 2013, 2012, 2011, 2010 Copyright © 2010 Hodder & Stoughton Ltd All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher or under licence from the Copyright Licensing Agency Limited. Further details of such licences (for reprographic reproduction) may be obtained from the Copyright Licensing Agency Limited, of Saffron House, 6–10 Kirby Street, London EC1N 8TS. Hachette UK’s policy is to use papers that are natural, renewable and recyclable products and made from wood grown in sustainable forests. The logging and manufacturing processes are expected to conform to the environmental regulations of the country of origin.
    [Show full text]
  • The Correlation Between Self- Assessment Reports and CEFR Levels According to Standardized Assessment
    The Correlation between Self- Assessment Reports and CEFR Levels according to Standardized Assessment The DIALANG Vocabulary Test and the Cambridge General English Online Test in relation to two Self-Assessment Procedures: Likert Scale Ratings and the Employment of CEFR Descriptors Master’s Thesis – MA Linguistics: Language and Communication Coaching Radboud University, Nijmegen Student: Laura Buuts Student Number: 4423194 Date of Submission: 21-06-2020 Supervisor: J. Klatter-Folmer Second Reader: E. Krikhaar ABSTRACT This thesis concerns an investigation into the correlation between self-assessment reports regarding vocabulary knowledge and actual levels of vocabulary knowledge according to two standardized assessments. The experiment in this study was conducted by means of a questionnaire consisting of a language testing component and a self-assessment component. The participants in this study are speakers of Dutch as a native language. With the help of regression analyses, it has been shown that the result of this study is that the Common European Framework of Reference (CEFR) levels of vocabulary knowledge according to both the DIALANG Vocabulary Test and the Cambridge General English Online Test correlate with the estimated levels of the self-assessment component. There are differences in the correlation coefficients of both tests and the self-assessment components. Unfortunately, the sample size impeded the confirmation of demographic discrepancies, such as gender, educational background, and use of English in daily life and in the workplace or educational context. Nonetheless, the fact that in general the language testing component correlates with the self- assessment component indicates that in terms of vocabulary, participants are generally able to predict their language skills.
    [Show full text]
  • Evaluation, Testing and Assessment
    Case Study 4 – Evaluation, testing and assessment “May I help you, madam?” – English for office communication in an adult education centre The use of current evaluation, assessment and testing instruments in a VOLL course Anthony Fitzpatrick with Inge-Anna Koleff, Wiener Volkshochschulen, Austria, and Manfred Thönicke, Hamburger Institut für Berufliche Bildung – HIBB, Germany 1. Introduction Within the context of the February 2009 workshop, a sub-group dealt with evaluation, assessment and testing, basing its work on some of the tools referred to and made available by the animator. The group took as its point of departure the situation of one of the workshop participants, who was in the process of setting up a (VOLL) English language course for employees in her organisation. The group members explored the different assessment systems available to decide on their potential for language testing and assessment procedures for the envisaged target group. They then set up a step-by-step system for evaluating the proficiency of course participants from entry level to achievement of course objectives. By documenting the steps taken, they hope to give colleagues working in VOLL a practical introduction to available tools which they found useful for testing, assessment and evaluation, and guidelines as to how and when to deploy those tools. 2. The setting The language department of the Viennese Adult Education Association (Wiener Volkshochschulen) had decided to set up and offer a new English course for employees in the administration of its 16+ member institutes throughout the city. The course was to address the needs of those operatives, all native speakers of German, who had contact with potential learners/customers in face-to-face or telephone settings.
    [Show full text]
  • Diagnosing Foreign Language Proficiency: the Interface Between Learning and Assessment
    Diagnosing Foreign Language Proficiency: The Interface between Learning and Assessment J. Charles Alderson Continuum Diagnosing Foreign Language Proficiency This page intentionally left blank Diagnosing Foreign Language Proficiency The Interface between Learning and Assessment J. Charles Alderson continuum Continuum The Tower Building, 11 York Road, London SE1 7NX 15 East 26th Street, New York, NY 10010 © J. Charles Alderson 2005 All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or any information storage or retrieval system, without prior permission in writing from the publishers. First published 2005 British Library Cataloguing-in-Publication Data A catalogue record for this book is available from the British Library. ISBN: 0-8264-8503-0 (hardback) Library of Congress Cataloging-in-Publication Data A catalog record for this book is available from the Library of Congress. Typeset by Aarontype Limited, Easton, Bristol Printed and bound in Great Britain by Contents Acknowledgements vi Introduction 1 1 Diagnosing foreign language proficiency: a teaching/testing interface 4 2 Diagnosis in other fields 13 3 Introduction to DIALANG 26 4 The history of DIALANG 36 5 Piloting in DIALANG 44 6 Setting standards 61 7 The Vocabulary Size Placement Test 79 8 The role of self-assessment in DIALANG 97 9 Reading 119 10 Listening 138 11 Writing 154 12 Grammar 170 13 Vocabulary 191 14 The value of feedback and advice 208 15 Experimental Items 221 16 Experiments in the use of self-assessment 243 17 The future of diagnostic testing 254 References 269 Index 276 Acknowledgements No book is produced by the author alone, but this book could never have been conceived, let alone produced, had it not been for an enormous number of people throughout Europe.
    [Show full text]
  • A Memorial Volume in Honour of Sauli Takala
    Ari Huhta, Gudrun Erickson, Neus Figueras (eds.) Developments in Language Education: A Memorial Volume in Honour of Sauli Takala EALTA – European Association for Language Testing and Assessment University of Jyväskylä, Centre for Applied Language Studies Developments in Language Education: A Memorial Volume in Honour of Sauli Takala Developments in Language Education: A Memorial Volume in Honour of Sauli Takala Edited by Ari Huhta, Gudrun Erickson, Neus Figueras University of Jyväskylä/Centre for Applied Language Studies EALTA - European Association for Language Testing and Assessment Jyväskylä & EALTA, 2019 © authors, photographers, University of Jyväskylä/Centre for Applied Language Studies and EALTA ˗ European Association for Language Testing and Assessment Cover photograph (Köklot Island, Kvarken Strait) and the photograph of Sauli Takala by Paula Bertell Cover and layout Sinikka Lampinen ISBN 978-951-39-7748-1 (PDF) ISBN 978-951-39-7747-4 (pbk) University Printing House, Jyväskylä, Finland 2019 Table of contents Ari Huhta, Gudrun Erickson and Neus Figueras Introduction ............................................................................................................... 7 Veronica Benigno and John de Jong Linking vocabulary to the CEFR and the Global Scale of English: A psychometric model ............................................................................................... 8 Sarah Breslin, Susanna Slivensky and Michael Armstrong Intellectual, insightful, inspiring – the ECML remembers Sauli Takala ...................
    [Show full text]
  • Lancaster University Unit of Assessment
    Impact case study (REF3b) Institution: Lancaster University Unit of Assessment: 29: English Literature and Language Title of case study: Language Testing: Assessing Proficiency and Improving Education 1. Summary of the impact (indicative maximum 100 words) The global workplace means that the staff at your local hospital, the pilot of your aeroplane or your teacher may be operating in a foreign language. Establishing their foreign language proficiency is crucial to ensuring effective communication. Not only this, establishing what one knows and does not know enables appropriately targeted teaching. We have enabled institutions and individuals throughout Europe to better understand the nature of foreign language proficiency, and, moreover, provided the means of measuring it. Our research led to the production of an on-line language assessment system, DIALANG, made publically available from 2001 in 14 European languages. 2. Underpinning research (indicative maximum 500 words) The initial DIALANG research was funded by the European Commission, Directorate General of Education and Culture, through Socrates Lingua Action D [G1, G2]. The research team consisted of 20 prominent academic and non-academic institutions in Europe. It was coordinated by Professor Kari Sajavaara (University of Jyväskylä, Finland) and Professor Wolfgang Mackiewicz (Free University of Berlin, Germany). Charles Alderson, from the Department of Linguistics and English Language (LAEL), played a key role in this team, acting as academic consultant on the steering committee (1996-2004), scientific coordinator (1999-2004), and managing director of the software team (1996-1999). Dr. Caroline Clapham, also from LAEL, coordinated the analysis of data (1999-2004). Dr Dianne Wall and Dr Jayanti Banerjee (both from LAEL) participated, along with other members of the Lancaster Language Testing Research Group, in the development of a standard setting methodology to establish links with the Common European Framework of Reference.
    [Show full text]
  • Book of Abstracts
    BOOK OF ABSTRACTS Contents 1 Welcome to Eurosla 21! .................................................................... 1 2 Committees ......................................................................................... 3 3 Plenary presentations ........................................................................ 5 4 Papers ................................................................................................. 11 5 Posters .............................................................................................. 159 6 Thematic Colloquia ......................................................................... 179 7 Language Learning Roundtable ................................................... 199 8 Doctoral Workshop ......................................................................... 205 9 The IRIS Project ............................................................................. 227 Index .......................................................................................................... 229 1 Welcome to Eurosla 21! The EuroSLA 21 Organising Committee warmly welcomes you to Stockholm for this year’s annual conference of the European Second Language Association, 8-10 September 2011. We hope that the fruits of our labour, especially during the last six months, will meet with everyone's expectations of a rewarding and enjoyable conference. Over 340 proposals were submitted by 15 February and we are happy to announce that approximately 50% have been accepted, of which 147 are papers, 18 poster presentations
    [Show full text]
  • The Routledge Handbook of Language Testing
    The Routledge Handbook of Language Testing The Routledge Handbook of Language Testing offers a critical and comprehensive overview of language testing and assessment within the fields of applied linguistics and language study. An understanding of language testing is essential for applied linguistic research, language education, and a growing range of public policy issues. This handbook is an indispensable introduction and reference to the study of the subject. Specially commissioned chapters by leading academics and researchers of language testing address the most important topics facing researchers and practitioners, including: An overview of the key issues in language testing Key research methods and techniques in language test validation The social and ethical aspects of language testing The philosophical and historical underpinnings of assessment practices The key literature in the field Test design and development practices through use of practical examples The Routledge Handbook of Language Testing is the ideal resource for postgraduate students, language teachers and those working in the field of applied linguistics. Glenn Fulcher is Reader in Education (Applied Linguistics and Language Testing) at the University of Leicester in the United Kingdom. His research interests include validation theory, test and rating scale design, retrofit issues, assessment philosophy, and the politics of testing. Fred Davidson is a Professor of Linguistics at the University of Illinois at Urbana-Champaign. His interests include language test development
    [Show full text]
  • Common European Framework of Reference for Languages: Learning, Teaching, Assessment
    COMMON EUROPEAN FRAMEWORK OF REFERENCE FOR LANGUAGES: LEARNING, TEACHING, ASSESSMENT Language Policy Unit, Strasbourg www.coe.int/lang-CEFR CONTENTS Prefatory Note Notes for the user Synopsis Chapter 1: The Common European Framework in its political and educational context Chapter 2: Approach adopted Chapter 3: Common Reference Levels Chapter 4: Language use and the language user/learner Chapter 5: The user/learner’s competences Chapter 6: Language learning and teaching Chapter 7: Tasks and their role in language teaching Chapter 8: Linguistic diversification and the curriculum Chapter 9: Assessment General Bibliography Appendix A: developing proficiency descriptors Appendix B: The illustrative scales of descriptors Appendix C: The DIALANG scales Appendix D: The ALTE ‘Can Do’ statements Index PREFATORY NOTE This restructured version of the Common European Framework of reference for language learning, teaching and assessment represents the latest stage in a process which has been actively pursued since 1971 and owes much to the collaboration of many members of the teaching profession across Europe and beyond. The Council of Europe therefore acknowledges with gratitude the contribution made by: • The Project Group Language Learning for European Citizenship, representing all member countries of the Council for Cultural Co-operation with Canada as a participating observer, for their general oversight of its development. • The Working Party set up by the Project Group, with twenty representatives from member countries representing the different professional interests concerned, as well as representatives of the European Commission and its LINGUA programme, for their invaluable advice and supervision of the project; • The Authoring Group set up by the Working Party, consisting of Dr.
    [Show full text]
  • Diagnostic Assessment in Language Teaching and Learning
    VOLUME 10 ISSUE 2 fall 2006 Featured THEME: Diagnostic Assessment in Language ASSESSMENT Teaching and Learning By Daniel Reed Language teachers have perhaps always known that diagnosing their students’ strengths and weaknesses early on in a foreign language course would, in principle, greatly facilitate their efforts to tailor instruction to the needs of particular students, or at least help them plan class activities appropriate for the general skill levels of the class as a whole. This, of course, is one of those many pedagogical insights that is much easier to talk about than act upon. Many of us forego diagnostics altogether and simply start teaching our class with Chapter 1 of whatever textbook we happen to be using, or perhaps by conducting some activity that has worked well for us in the past—all the while thinking that we’ll get to know the students pretty well in time. A common problem is that while strengths and weaknesses may become apparent as students complete their regular coursework throughout the semester, by the time you get to really know what the students need most, it is often simply too late to do much about it. This is why, years ago, such prominent foreign language scholars as the late Paul Pimsleur began to emphasize the importance of “knowing your students in advance” (Pimsleur and Struth, 1968). More recently, J. Charles Alderson published a book called Diagnosing Foreign Language Proficiency, in which he calls for a greater emphasis on diagnostic assessment in both research and practice. The implication is that diagnostic assessment is an important area that is not as well developed as other types of language assessment such as proficiency and achievement testing.
    [Show full text]