Computationally Modeling the Impact of Task-Appropriate Language Complexity and Accuracy on Human Grading of German Essays

Total Page:16

File Type:pdf, Size:1020Kb

Computationally Modeling the Impact of Task-Appropriate Language Complexity and Accuracy on Human Grading of German Essays Computationally Modeling the Impact of Task-Appropriate Language Complexity and Accuracy on Human Grading of German Essays Zarah Weissa Anja Riemenschneiderb Pauline Schroter¨ b Detmar Meurersa;b a Dept. of Linguistics & LEAD b Institute for Educational Quality Improvement University of Tubingen¨ Humboldt-Universitat¨ zu Berlin [email protected] [email protected] [email protected] [email protected] Abstract to other education systems, such as the German one, where so far there is hardly any discus- Computational linguistic research on the lan- sion of automating the assessment of learning out- guage complexity of student writing typi- cally involves human ratings as a gold stan- comes and no high-stakes testing industry. In the dard. However, educational science shows that German Abitur examination, the official school- teachers find it difficult to identify and cleanly leaving state examination that qualifies students separate accuracy, different aspects of com- for admission to university, teachers grade lan- plexity, contents, and structure. In this paper, guage performance and content in essays without we therefore explore the use of computational technical assistance, using grading templates that linguistic methods to investigate how task- specify content and language expectations. In the appropriate complexity and accuracy relate to language arts and literacy subject-matters (Ger- the grading of overall performance, content performance, and language performance as as- man, English, French, etc.), language performance signed by teachers. is a crucial component of the overall grade across Based on texts written by students for the offi- all states. Yet, unlike content, language require- cial school-leaving state examination (Abitur), ments are only loosely specified in the education we show that teachers successfully assign standards, mentioning complex and diverse syn- higher language performance grades to essays tax and lexis, and a coherent argumentation struc- with higher task-appropriate language com- ture as indicators of high-quality language perfor- plexity and properly separate this from content mance (KMK, 2014b). The exact implementa- scores. Yet, accuracy impacts teacher assess- tion of these language requirements is left to the ment for all grading rubrics, also the content discretion of the teachers. Educational science score, overemphasizing the role of accuracy. has questioned to which extent teachers are biased Our analysis is based on broad computational by construct-irrelevant text characteristics while linguistic modeling of German language com- grading. There is evidence that mechanical ac- plexity and an innovative theory- and data- driven feature aggregation method inferring curacy over-proportionally influences grades and task-appropriate language complexity. even affects the evaluation of unrelated concepts such as content (Cumming et al., 2002; Rezaei 1 Introduction and Lovorn, 2010). Differences in lexical sophis- tication and diversity have been shown to impact Official state education standards highlight the rel- teachers’ evaluation of grammar and essay struc- evance of language complexity for the evalua- ture (Vogelin¨ et al., 2019). This is a potentially tion of text readability and reading skills(CCSSO, severe issue for the German education system. 2010) and academic writing proficiency in stu- dents first and second language (KMK, 2014a,b). We pick up on this issue by investigating which The highly assessment-driven U.S. public edu- role language complexity and accuracy play in cation system has long recognized the benefits teachers’ grading of German Abitur essays. For of automating the evaluation of student learn- this, we build upon previous work on complex- ing outcomes, including very substantial research, ity and accuracy in the context of the Complexity, development, and commercial applications tar- Accuracy, and Fluency (CAF) framework (Wolfe- geting automatic essay scoring (AES, Shermis Quintero et al., 1998; Bulte´ and Housen, 2012) and Burstein, 2013; Vajjala, 2018; Yannakoudakis employed in Second Language Acquisition (SLA) et al., 2018). This situation is not transferable research to model different types of language per- 30 Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications, pages 30–45 Florence, Italy, August 2, 2019. c 2019 Association for Computational Linguistics formance (McNamara et al., 2010; Vajjala and and Meurers, 2019). Complexity has also been in- Meurers, 2012; Bulte´ and Housen, 2014). We es- vestigated in relation to (academic) writing profi- tablish an automatically obtained measure of task- ciency of native speakers (Crossley et al., 2011; appropriate overall language complexity. With McNamara et al., 2010). Research on languages this, we identify texts of more and less appropri- other than English, remains rather limited, with ate language complexity, which we then manually some work on German, Russian, Swedish, Italian, assess for their accuracy. We use this to exper- and French (Weiss and Meurers, 2018; Reynolds, imentally examine teaching experts’ grading be- 2016; Pilan´ et al., 2015; Dell’Orletta et al., 2014; haviour and how it is influenced by accuracy and Franc¸ois and Fairon, 2012). complexity. Our results show that while teachers Recently, research has increasingly focused on seem to successfully identify language complexity the influence of task effects on language complex- and include it in their grading when appropriate, ity in writing quality and language proficiency as- they are heavily biased by accuracy even when it sessment, both in terms of their influence on CAF is construct-irrelevant. development in the context of the two main frame- Our work innovates in exploiting computational works (Robinson, 2001; Skehan, 1996) as well as linguistic methods to address questions of broader its implications for AES systems and other forms relevance from the domain of educational science of language proficiency modeling (Yannakoudakis by using sophisticated language complexity mod- et al., 2018; Dell’Orletta et al., 2014). Alex- eling. This is the first computational linguistic opoulou et al.(2017) show that task complexity analysis of German Abitur essays and their hu- and task type strongly affect English as a Foreign man grading, illustrating the potential of cross- Language (EFL) essay writing complexity. Topic disciplinary work bringing together computational and text type, too, have been found to impact CAF linguistics and empirical educational science. The constructs in EFL writing and in particular lan- novel approach presented for the assessment of guage complexity (Yoon and Polio, 2016; Yoon, appropriate overall language complexity also pro- 2017; Yang et al., 2015). Vajjala(2018) demon- vides valuable insights into the task- or text type- strates task effects across EFL corpora to the ex- dependence of complexity features. This is of di- tent that text length strongly impacts essay quality rect relevance for the current discussion of task- negatively on one and positively on the other data effects in CAF research (Alexopoulou et al., 2017; set. Her results further corroborate the importance Yoon, 2017). of accuracy for essay quality across data sets. Ac- The article is structured as follows: We briefly curacy has overall received considerably less at- review related work on complexity assessment tention in SLA research than complexity (Larsen- and insights from educational science into human Freeman, 2006; Yoon and Polio, 2016). grading behavior. We then present our data set and how we automatically extract language complex- An orthogonal strand of research investigates ity measures. Section5 elaborates on the construc- the quality of human judgments of writing qual- tion of appropriate overall language complexity ity and how complexity and accuracy impact them. including a qualitative analysis of task-wise dif- It has been demonstrated that teachers are bi- ferences between document vectors. Section6 re- ased by accuracy and in particular spelling even ports our experiment on teacher grading behavior. when it is irrelevant for the construct under evalu- We close in Section7 with an outlook. ation such as content quality (Rezaei and Lovorn, 2010; Cumming et al., 2002; Scannell and Mar- 2 Related Work shall, 1966). Other studies showed that charac- teristics such as syntactic complexity, text length, Language complexity, commonly defined as “[t]he and lexical sophistication impact inter-rater agree- extent to which the language produced in perform- ment (Lim, 2019; Wind et al., 2017; Wolfe et al., ing a task is elaborate and varied” (Ellis, 2003, 2016).V ogelin¨ et al.(2019) experimentally ma- p. 340), has been studied extensively in the context nipulate the lexical diversity and sophistication of of second language development and proficiency EFL learners’ argumentative essays and let Swiss and text readability in particular with regard to English teachers rate them for their overall qual- the English language (Vajjala and Meurers, 2012; ity, grammar, and essay frame. Their findings Guo et al., 2013; Bulte´ and Housen, 2014; Chen show that when the lexical diversity and sophis- 31 tication of an essay was manually reduced, it re- ceived lower grades not only for its overall quality but also for grammar and the essay’s frame, i.e., the structured presentation of the writing objective through introduction and conclusion. 3 The Abitur Data We analyzed 344 essays that were written
Recommended publications
  • Exploring the Dynamics of Second Language Writing
    CY147/Kroll-FM CY147/Kroll 0 521 82292 0 January 15, 2003 12:46 Char Count= 0 Exploring the Dynamics of Second Language Writing Edited by Barbara Kroll California State University, Northridge v CY147/Kroll-FM CY147/Kroll 0 521 82292 0 January 15, 2003 12:46 Char Count= 0 published by the press syndicate of the university of cambridge The Pitt Building, Trumpington Street, Cambridge, United Kingdom cambridge university press The Edinburgh Building, Cambridge CB2 2RU, UK 40 West 20th Street, New York, NY 10011-4211, USA 477 Williamstown Road, Port Melbourne, VIC 3207, Australia Ruiz de Alarcon´ 13, 28014 Madrid, Spain Dock House, The Waterfront, Cape Town 8001, South Africa http://www.cambridge.org C Cambridge University Press 2003 This book is in copyright. Subject to statutory exception and to the provisions of relevant collective licensing agreements, no reproduction of any part may take place without the written permission of Cambridge University Press. First published 2003 Printed in the United States of America Typefaces Sabon 10.5/12 pt. and Arial System LATEX2ε [TB] A catalog record for this book is available from the British Library. Library of Congress Cataloging in Publication data Exploring the dynamics of second language writing / edited by Barbara Kroll. p. cm. – (The Cambridge applied linguistics series) Includes bibliographical references and index. ISBN 0-521-82292-0 (hardback) – ISBN 0-521-52983-2 (pbk.) 1. Language and languages – Study and teaching. 2. Composition (Language arts) 3. Rhetoric – Study and teaching. I. Kroll,
    [Show full text]
  • Studies and Essays on Learning, Teaching and Assessing L2 Writing in Honour of Alister Cumming
    Studies and Essays on Learning, Teaching and Assessing L2 Writing in Honour of Alister Cumming Studies and Essays on Learning, Teaching and Assessing L2 Writing in Honour of Alister Cumming Edited by A. Mehdi Riazi, Ling Shi and Khaled Barkaoui Studies and Essays on Learning, Teaching and Assessing L2 Writing in Honour of Alister Cumming Edited by A. Mehdi Riazi, Ling Shi and Khaled Barkaoui This book first published 2020 Cambridge Scholars Publishing Lady Stephenson Library, Newcastle upon Tyne, NE6 2PA, UK British Library Cataloguing in Publication Data A catalogue record for this book is available from the British Library Copyright © 2020 by A. Mehdi Riazi, Ling Shi and Khaled Barkaoui and contributors All rights for this book reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, without the prior permission of the copyright owner. ISBN (10): 1-5275-4814-7 ISBN (13): 978-1-5275-4814-5 TABLE OF CONTENTS Preface ..................................................................................................... viii Section 1: Learning to Write in a Second Language Introduction ................................................................................................ 2 On the Interface between Second Language Writing and Learning A. Mehdi Riazi, Macquarie University Chapter 1 .................................................................................................... 8 L2 Writing and L2 Learning:
    [Show full text]
  • New Directions for L2 Research
    NEW DIRECTIONS FOR L2 RESEARCH Edited by SARAH RANSDELL Florida Atlantic University, USA & MARIE-LAURE BARBIER University of Lyon, France II TABLE OF CONTENTS PREFACE v Gert Rijlaarsdam AN INTRODUCTION TO NEW DIRECTIONS 1 FOR RESEARCH IN L2 WRITING Sarah Ransdell & Marie-Laure Barbier CRITICAL EXAMINATION OF L2 WRITING 11 PROCESS RESEARCH Julio Roca De Larios, Liz Murphy, & Javier Marin BUILDING AN EMPIRICALLY-BASED MODEL 49 OF EFL LEARNERS’ WRITING PROCESSES Miyuki Sasaki THE RELATIONSHIPS BETWEEN BILINGUAL 81 CHILDREN’S READING AND WRITING IN THEIR TWO LANGUAGES Aydin Durgunoğlu, Montserrat Mir, & Sofia Ariño-Martin LINGUISTIC KNOWLEDGE, METACOGNITIVE KNOWLEDGE 101 AND RETRIEVAL SPEED IN L1, L2, AND EFL WRITING: A structural equation modelling approach Rob Schoonen, Amos van Gelderen, Kees de Glopper, Jan Hulstijn, Patrick Snellings, Annegien Simis, & Marie Stevenson EARLY EXPOSURE TO AN L2 PREDICTS GOOD L1 123 AS WELL AS GOOD L2 WRITING Rosario Arecco & Sarah Ransdell THE EFFECTS OF TRAINING A GOOD WORKING 133 MEMORY STRATEGY ON L1 and L2 WRITING Sarah Ransdell, Beverly Lavelle, & Michael Levy A COMPARISON BETWEEN NOTETAKING IN L1 145 AND L2 BY UNDERGRADUATE STUDENTS Martine Faraco, Marie-Laure Barbier & Annie Piolat AN INTRODUCTION TO NEW DIRECTIONS FOR RESEARCH IN L2 WRITING iii COLLABORATIVE WRITING IN L2: 169 THE EFFECT OF GROUP INTERACTION ON TEXT QUALITY Folkert Kuiken & Ineke Vedder INVESTIGATING LEARNERS’ GOALS 179 IN THE CONTEXT OF ADULT SECOND-LANGUAGE WRITING Alister Cumming, Michael Busch, & Ally Zhou WHEN AND WHY TALKING CAN MAKE WRITING HARDER 179 Margaret Franken & Stephen Haslett A PROBLEM-POSING APPROACH TO USING 179 NATIVE LANGUAGE WRITING IN ENGLISH LITERACY INSTRUCTION Elizabeth Quintero REFERENCES 179 AUTHOR INDEX 179 SUBJECT INDEX 179 LIST OF CONTRIBUTORS 179 PREFACE GERT RIJLAARSDAM University of Amsterdam & Utrecht University, the Netherlands Multilingualism is becoming the default in our global world.
    [Show full text]
  • The Hallmarks of L2 Writing Viewed Through the Prism of Translation Universals
    Linguistic Research 35(Special Edition), 171-205 DOI: 10.17250/khisli.35..201809.007 The hallmarks of L2 writing viewed through the prism of translation universals*1 Younghee Cheri Lee (Yonsei University) Lee, Younghee Cheri. 2018. The hallmarks of L2 writing viewed through the prism of translation universals. Linguistic Research 35(Special Edition), 171-205. Rooted in a perception that second language (L2) writing bears neither resemblance with nontranslated counterparts nor relation to translation, this article explores the untested terrain of revealing lexical and textual attributes unique to L2 writers' texts, thus identifying their linguistic qualities from the angle of translation universals. Setting plausible parameters to discern translational instances related to lexical and syntactical choices, this article argues that idiosyncratic properties shared by translated English may typify the hallmarks of L2 writing produced by non-anglophone scholars in English disciplines. By compiling the comparable corpora of English journal abstracts consisting of 638,764 tokens, it is shown how salient translational features arise in expert L2 writers' texts in compliance with corpus linguistics. Kruskal-Wallis tests are applied to evaluate linguistic indices that make Korean scholars' L2 writing distinct from native scholars’ original writing. On a substantial level, a general presumption on the interrelatedness between expert L2 writers' English and translational English has turned out to be warranted, meaning that Korean scholars' L2 writing can be marked by universals of simplification, normalization, explicitation, and convergence in their broad outlines. It can be deducible from the findings that regardless of L2 proficiency levels, second language writers may be destined to go through a ‘mental translation' as an inescapable cognitive mechanism during the L2 writing process, which in turn renders translational manifestations pervasive in the ‘product’ of L2 writing.
    [Show full text]
  • Introduction
    Dana Ferris, who was not even born when some of the veteran contributors to this collection began their teaching careers, is nonetheless considerably older than Paul Kei Matsuda, the other “junior” contributor, who wrote the epilogue. Starstruck while attending the 1996 TESOL colloquium, which initiated the work leading to this collection, Dana has since moved on to the more mature stage of simple respect and admiration. Introduction Dana Ferris California State University, Sacramento Beware of “complacency that puts our critical faculties to sleep.”—Ilona Leki Ask students what they want, think, and need.—Joy Reid A “questionable practice”: Error correction and identi‹cation. —Alister Cumming “The ‹ve-paragraph essay: Tool, or torpedo?”—Ann M. Johns I had “a tendency to overload students.”—Melinda Erickson We need to “value qualitative research.” —Linda Lonon Blanton “I can’t believe I did that!”—Barbara Kroll How a “New Kid on the Block” Ended Up in This Book These wonderful “sound bites,” and other provocative quotations and ideas, were swirling through my head as I left the 1996 TESOL colloquium on writing that gave rise to this collection. Like any veteran conference-goer, I have experi- enced papers and panels that have been good, bad, and indif- ferent. Over the years, I have arrived at the view that if at a professional conference I hear just one really memorable 2 ESL Composition Tales paper or colloquium panel, a presentation that stimulates or challenges my thinking or teaching, the trip is a success. I left that Chicago colloquium, orchestrated by Barbara Kroll, with a sigh of satisfaction, knowing that my modest hopes had once again been ful‹lled and that the money spent, the time away (I missed my younger daughter’s second birthday), and the frozen toes and ‹ngertips (a lifelong Californian, I have limited tolerance for a Chicago winter) had been justi‹ed.
    [Show full text]
  • Lourdes Ortega Curriculum Vitae
    Lourdes Ortega Curriculum Vitae Updated: August 2019 Department of Linguistics 1437 37th Street NW Box 571051 Poulton Hall 250 Georgetown University Washington, DC 20057-1051 Department of Linguistics Fax (202) 687-6174 E-mail: [email protected] Webpage: https://sites.google.com/a/georgetown.edu/lourdes-ortega/ EDUCATION 2000 Ph.D. in Second Language Acquisition. University of Hawai‘i at Mānoa, Department of Second Language Studies, USA. 1995 M.A. in English as a Second Language. University of Hawai‘i at Mānoa, Department of Second Language Studies, USA. 1993 R.S.A. Dip., Diploma for Overseas Teachers of English. Cambridge University/UCLES, UK. 1987 Licenciatura in Spanish Philology. University of Cádiz, Spain. EMPLOYMENT since 2012 Professor, Georgetown University, Department of Linguistics. 2004-2012 Professor (2010-2012), Associate Professor (2006-2010), Assistant Professor (2004-2006), University of Hawai‘i at Mānoa, Department of Second Language Studies. 2002-2004 Assistant Professor (tenure-track), Northern Arizona University, Department of English. 2000-2002 Assistant Professor (tenure-track). Georgia State University, Department of Applied Linguistics and ESL. 1999-2000 Visiting Instructor of Applied Linguistics, Georgetown University, Department of Linguistics. 1994-1998 Research and Teaching Graduate Assistant, University of Hawai‘i at Mānoa, College of Languages, Linguistics, and Literature. 1987-1993 Instructor of Spanish, Instituto Cervantes of Athens, Greece. FELLOWSHIPS 2018: Distinguished Visiting Fellow at the Graduate Center, City University of New York, Advanced Research Collaborative (ARC). August through December, 2018. 2010: External Senior Research Fellow at the Freiburg Institute of Advanced Studies (FRIAS), University of Freiburg. One-semester residential fellowship at FRIAS to carry out project titled Pathways to multicompetence: Applying usage-based and constructionist theories to the study of interlanguage development.
    [Show full text]
  • Conference Program Includes a Wide Range of Stimulating Papers, Posters and Works-In-Progress, and Other Presentations
    IELTS Research Reports Online Series IELTS Partnership Research Papers IELTS Research Reports IELTS Partnership Online Series Research Papers Exploring performance across two delivery modes for the same Investigating IELTS Academic Writing Task 2: Relationships between L2 speaking test: Face-to-face and video-conferencing delivery cognitive writing processes, text quality, and working memory A preliminary comparison of test-taker and examiner behaviour Andrea Révész, Marije Michel and Minjin Lee Fumiyo Nakatsuhara, Chihiro Inoue, Vivien Berry and Evelina Galaczi available now at ielts.org/research CER_6355_V1_FEB19_LTRC_2019_IELTS_advert_AB_prf3.indd 1 30/01/2019 15:37 Thank you to our sponsors! Platinum Sponsors Gold Sponsors Silver Sponsors TABLE OF CONTENTS Message from the ILTA President………………………………………………… 2 Welcome from the Co-Chairs………………………………………………………. 4 Venue Information……………………………………..……………………………….. 5 Conference Organization……………………………………..……………………… 6 ILTA Executive Board & Committee Members 2019…………………….. 7 Awards……………………………………………………………………………………..…. 8 Conference Schedule Overview……………………………………..……………. 10 The Cambridge/ILTA Distinguished Achievement Award……………… 25 Keynote Speakers The Alan Davies Lecture……………………………………..….…………………. 27 The Samuel J. Messick Memorial Lecture…………………...………………… 28 Pre-Conference Workshops…………………………………………………………. 30 Symposia Abstracts……………………………………..……………………………... 34 Paper Abstracts……………………………………..……………………………………. 50 Demo Abstracts……………………………………..……………………………………. 109 Works-in-Progress Abstracts……………………………………………………….
    [Show full text]
  • Programme Overview
    SSLW 2010: Crossing Disciplinary Boundaries University of Murcia, Spain ‐ May 20‐22 PROGRAMME OVERVIEW STRANDS: ASS Assessment ACW Academic Writing CMW Computer-mediated Writing EC Error and Error Correction FEED Feedback FLW Foreign Language Writing PED Pedagogy RES Research Methodology SLA Second Language Acquisition TEXT Textual Analyses WFS Writing from Sources WPR Writing Processes Wednesday 19th, afternoon Sala Jorge Guillén (Facultad de Letras) 15.30-19.30 Registration 1 SSLW 2010: Crossing Disciplinary Boundaries University of Murcia, Spain ‐ May 20‐22 PROGRAMME OVERVIEW Thursday 20th, morning Paraninfo Hall 8.00-19.30 Registration Paraninfo 8.30 Official opening Paraninfo 9.00- 9.55 Plenary 1: Tony Silva The Disciplinary Development of Second Language Writing Studies 9.55- Coffee break 10.25 Hemiciclo Jorge Guillén Mariano Baquero Antonio Soler Sala de Juntas (Dcho.) Paraninfo CMW FEED PED ACW ASS Chair: Rea Chair: Dyson Chair: Turner Chair: Curry Chair: Panahi Lam Hernández-García Furneaux Effects of two portfolio Corpora-research benefits Bitchener Breeze Mastering academic writing within 10.30 assessment approaches on Special for L2 writing: error Supervisor feedback in the Teaching legal writing: voice, one discipline in one year: from ‘in 11.00 writing processes and Session: analysis and the use of thesis-writing process attitude, value the middle of nowhere’ to ‘I can products of EFL pre-university FL writing: grammar checkers do anything!’ Reflections on students O'Brien Theory and Nurmukhamedov & Gimenez ESL student writers’ Rouillon Research Racelis Crossing boundaries in L2 11.05 experiences with written Raters' assessment Teacher, please read! academic writing: Issues of 11.35 feedback received on discourses and talks: A Learners’ email writing disciplinarity, authority, and Convener: Rosa academic coursework on a qualitative approach behavior identity in health sciences M.
    [Show full text]
  • Collaborative Writing in a Computer-Supported Classroom: Mediation, and Self-Assessed Beliefs and Attitudes About Writing
    Collaborative Writing in a Computer-Supported Classroom: Mediation, and Self-Assessed Beliefs and Attitudes about Writing by Meng-ying Daphne Lin A thesis submitted in conformity with the requirements for the degree of Doctor of Philosophy Graduate Department of Curriculum, Teaching and Learning Ontario Institute for Studies in Education University of Toronto © Copyright by Meng-ying Daphne Lin 2015 Collaborative writing in a computer-supported classroom: Mediation and self-assessed beliefs and attitudes about writing Doctor of Philosophy, 2015 Meng-ying Daphne Lin Department of Curriculum, Teaching and Learning University of Toronto ABSTRACT This classroom study investigated how computer-based writing tools and collaborative writing tasks mediated the development of individual writing competencies among 35 graduate students during a 4-week course in Taiwan focused on English tests like the TOEFL. I prepared a unique platform of writing tools for the course and then quantified the types of writing knowledge generated from students' collaborative writing (CW) and uses of these mediation tools, then associated these with the students’ CW performance and then individual writing performance on 3 drafts of 4 TOEFL writing tasks over the duration of the course. Data included collaborative writers’ dialogues and online browsing histories and all compositions produced during the course. Supplementary data were questionnaires and interviews on students’ perceived changes in communications, reflections on CW, and self-assessed beliefs about their writing abilities. A comparison class of 26 students, which I also taught a year later, served as a control condition with the same course content, and writing tasks written individually (rather than collaboratively). Analyses identified symbolic and material mediation tools in Language-Related Episodes (LREs) in CW writers’ dialogues and uses of Internet writing resources.
    [Show full text]
  • Research for and Within Literacy Instruction in Secondary Schools Reviewed Work(S): Reclaiming the Local in Language Policy and Practice by A
    Review: Essay Review: Research for and within Literacy Instruction in Secondary Schools Reviewed Work(s): Reclaiming the Local in Language Policy and Practice by A. Suresh Canagarajah: English-Only Instruction and Immigrant Students in Secondary Schools: A Critical Examination by Lee Gunderson: Effective Literacy Instruction: Building Successful Reading and Writing Programs by Judith A. Langer: Secondary School Literacy: What Research Reveals for Classroom Practice by Leslie S. Rush, A. Jonathan Eakle and Allen Berger: Research on Composition: Multiple Perspectives on Two Decades of Change by Peter Smagorinsky Review by: Alister Cumming Source: Curriculum Inquiry , Sep., 2008, Vol. 38, No. 4 (Sep., 2008), pp. 401-416 Published by: Taylor & Francis, Ltd. Stable URL: https://www.jstor.org/stable/25475916 JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about JSTOR, please contact [email protected]. Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at https://about.jstor.org/terms Taylor & Francis, Ltd. is collaborating with JSTOR to digitize, preserve and extend access to Curriculum Inquiry This content downloaded from 96.32.137.202 on Fri, 18 Sep 2020 15:15:17 UTC All use subject to https://about.jstor.org/terms Essay Review Research for and Within Literacy Instruction in Secondary Schools Reclaiming the Local in Language Policy and Practice (A. Suresh Canagarajah, Ed. 2005. Mahwah, NJ: Lawrence Erlbaum.
    [Show full text]
  • Evidence-Based Teaching Changing Your Mind
    English Language Learning Magazine CONTACT Evidence-based teaching August 2015 Changing your mind VOLUME 41, NUMBER 3, AUGUST, 2015 ISSN # 0227-2938 Teachers of English as a Second Language Association of Ontario www.teslontario.net/publication/contact-magazine - 1 - IN THIS ISSUE In this issue . 2 Calendar Editor’s Note . 3 September 18–20 The third world congress on Contact Magazine . 4 extensive reading (Dubai, UAE) September 19 BCTEAL: Bridging the Cultural Gap Articles in the EAL Classroom October 2 International Student Success Teaching research-based literacy skills . 5 Symposium Repeated Reading . 11 October 2–3 Ontario Modern Language Teachers Mentoring TESL Students . 16 Association Fall Conference Reflecting Effectively . 21 October 5 International World Teachers' Day Enhance Your Skills with 1-on-1 ESL Tutoring . 28 October 24 TESL Windsor’s Fall workshop Grit: It’s Role in Student Success . 32 October 29–31 TESL Canada Conference (Lake Louise) Changing Minds November 4–5 Educational Computing The role of the teacher in language teaching . 36 Organization of Ontario & the Ontario Association of School Because grammar (and cats) . 38 Business Officials Conference Finding the backbone of a text . 42 November 7 People for Education Annual Mastering the Skill of L2 Writing? . 44 Conference Pronunciation instruction . 47 November 8–14 ESL Week Finding the hidden curriculum . 50 November 12–13 TESL Ontario’s 43rd Annual Conference: “Expanding horizons: Drawing on Viva la Lingua Franca experience and knowledge” Pass The Cultural Hot Potato Part 2 . 52 November 18–20 York Region District School Board Conference Conference November 20–22 American Council on the Teaching of Foreign Languages; ACTFL Annual TESOL Ontario 2015 Conference .
    [Show full text]
  • A New Angle on L2 Writers' Texts: a Statistical Approach to Translation Universals
    PACLIC 32 A New Angle on L2 Writers’ Texts: A Statistical Approach to Translation Universals Younghee Cheri Lee Yong-hun Lee Yonsei University Chungnam National University 50 Yonsei-ro, Seodaemun-gu 99 Daehak-ro, Yuseong-gu Seoul 03722, S. Korea Daejeon 34134, S. Korea [email protected] [email protected] of empirical research queries in L2 text-based Abstract studies such as L2 writing and translation studies. A vast array of research on L2 writers’ texts to Studies on the second language (L2) writing from the angle of translation universals (TU) date has been mostly dependent on the cognitive have substantial empirical research prospects, behavior models of the second language writing but as yet only limited literature explains what process to lay the theoretical groundwork (see Lee, linguistic factors shape non-nativeness in L2 2017). In particular, crosslinguistic influences have writing. This article claims to prove that key been the focus of ongoing research endeavors in TU indices may predict non-nativeness, more second language writing (Cumming, 1990). Key particularly translationese in L2 writers’ texts. research strands include interruptions, transfer, The ultimate aim is thus to classify texts using code-switching, positive interplay, and translation the indices of translationese, which will, in turn, strategy (e.g. Bagheri & Fazel, 2011; Connor, signify shared, universal features detectable in 1999; Cumming, 1990; Grabe, 2001; Jarvis & L2 texts. To that end, we used a collection of multi-factorial analysis methods to compare Pavlenko, 2008; Kellog, 1987; Reid & Findlay, native scholars' L1 corpora, respectively with 1986; Sasaki, 2000; Swales, 1990; Silva, 1993; two varieties of non-Anglophone scholars’ non- Uzawa, 1996; Ventola & Mauranen, 1991; Wang translated L2 corpora (L1 English vs.
    [Show full text]