DOCSLIB.ORG

Dirt Cheap Web-Scale Parallel Text from the Common Crawl Jason R

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Dirt Cheap Web-Scale Parallel Text from the Common Crawl Jason R Dirt Cheap Web-Scale Parallel Text from the Common Crawl Jason R. Smith1,2 Herve Saint-Amand3 Magdalena Plamada4 [email protected] [email protected] [email protected] Philipp Koehn3 Chris Callison-Burch1,2,5 Adam Lopez1,2 [email protected] [email protected] ∗ [email protected] 1Department of Computer Science, Johns Hopkins University 2Human Language Technology Center of Excellence, Johns Hopkins University 3School of Informatics, University of Edinburgh 4Institute of Computational Linguistics, University of Zurich 5Computer and Information Science Department, University of Pennsylvania Abstract are readily available, ordering in the hundreds of millions of words for Chinese-English and Arabic- Parallel text is the fuel that drives modern English, and in tens of millions of words for many machine translation systems. The Web is a European languages (Koehn, 2005). In each case, comprehensive source of preexisting par- much of this data consists of government and news allel text, but crawling the entire web is text. However, for most language pairs and do- impossible for all but the largest compa- mains there is little to no curated parallel data nies. We bring web-scale parallel text to available. Hence discovery of parallel data is an the masses by mining the Common Crawl, important first step for translation between most a public Web crawl hosted on Amazon’s of the world’s languages. Elastic Cloud. Starting from nothing more The Web is an important source of parallel than a set of common two-letter language text. Many websites are available in multiple codes, our open-source extension of the languages, and unlike other potential sources— STRAND algorithm mined 32 terabytes of such as multilingual news feeds (Munteanu and the crawl in just under a day, at a cost of Marcu, 2005) or Wikipedia (Smith et al., 2010)— about $500. Our large-scale experiment it is common to find document pairs that are di- uncovers large amounts of parallel text in rect translations of one another. This natural par- dozens of language pairs across a variety allelism simplifies the mining task, since few re- of domains and genres, some previously sources or existing corpora are needed at the outset unavailable in curated datasets. Even with to bootstrap the extraction process. minimal cleaning and filtering, the result- ing data boosts translation performance Parallel text mining from the Web was origi- across the board for five different language nally explored by individuals or small groups of pairs in the news domain, and on open do- academic researchers using search engines (Nie main test sets we see improvements of up et al., 1999; Chen and Nie, 2000; Resnik, 1999; to 5 BLEU. We make our code and data Resnik and Smith, 2003). However, anything available for other researchers seeking to more sophisticated generally requires direct access mine this rich new data resource.1 to web-crawled documents themselves along with the computing power to process them. For most 1 Introduction researchers, this is prohibitively expensive. As a consequence, web-mined parallel text has become A key bottleneck in porting statistical machine the exclusive purview of large companies with the translation (SMT) technology to new languages computational resources to crawl, store, and pro- and domains is the lack of readily available paral- cess the entire Web. lel corpora beyond curated datasets. For a handful of language pairs, large amounts of parallel data To put web-mined parallel text back in the hands of individual researchers, we mine parallel ∗ This research was conducted while Chris Callison- Burch was at Johns Hopkins University. text from the Common Crawl, a regularly updated 1github.com/jrs026/CommonCrawlMiner 81-terabyte snapshot of the public internet hosted 1374 Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, pages 1374–1383, Sofia, Bulgaria, August 4-9 2013. c 2013 Association for Computational Linguistics on Amazon’s Elastic Cloud (EC2) service.2 Us- into a sequence of start tags, end tags, ing the Common Crawl completely removes the and text chunks. bottleneck of web crawling, and makes it possi- (b) Align the linearized HTML of candidate ble to run algorithms on a substantial portion of document pairs. the web at very low cost. Starting from nothing (c) Decide whether to accept or reject each other than a set of language codes, our extension pair based on features of the alignment. of the STRAND algorithm (Resnik and Smith, 2003) identifies potentially parallel documents us- 3. Segmentation: For each text chunk, perform ing cues from URLs and document content ( 2). sentence and word segmentation. § We conduct an extensive empirical exploration of 4. Sentence Alignment: For each aligned pair of the web-mined data, demonstrating coverage in text chunks, perform the sentence alignment a wide variety of languages and domains ( 3). § method of Gale and Church (1993). Even without extensive pre-processing, the data improves translation performance on strong base- 5. Sentence Filtering: Remove sentences that line news translation systems in five different lan- appear to be boilerplate. guage pairs ( 4). On general domain and speech § translation tasks where test conditions substan- Candidate Pair Selection We adopt a strategy tially differ from standard government and news similar to that of Resnik and Smith (2003) for find- training text, web-mined training data improves ing candidate parallel documents, adapted to the performance substantially, resulting in improve- parallel architecture of Map-Reduce. ments of up to 1.5 BLEU on standard test sets, and The mapper operates on each website entry in 5 BLEU on test sets outside of the news domain. the CommonCrawl data. It scans the URL string for some indicator of its language. Specifically, 2 Mining the Common Crawl we check for: The Common Crawl corpus is hosted on Ama- 1. Two/three letter language codes (ISO-639). zon’s Simple Storage Service (S3). It can be downloaded to a local cluster, but the transfer cost 2. Language names in English and in the lan- is prohibitive at roughly 10 cents per gigabyte, guage of origin. making the total over $8000 for the full dataset.3 If either is present in a URL and surrounded by However, it is unnecessary to obtain a copy of the non-alphanumeric characters, the URL is identi- data since it can be accessed freely from Amazon’s fied as a potential match and the mapper outputs Elastic Compute Cloud (EC2) or Elastic MapRe- a key value pair in which the key is the original duce (EMR) services. In our pipeline, we per- URL with the matching string replaced by *, and form the first step of identifying candidate docu- the value is the original URL, language name, and ment pairs using Amazon EMR, download the re- full HTML of the page. For example, if we en- sulting document pairs, and perform the remain- counter the URL www.website.com/fr/, we ing steps on our local cluster. We chose EMR be- output the following. cause our candidate matching strategy fit naturally into the Map-Reduce framework (Dean and Ghe- Key: www.website.com/*/ mawat, 2004). • Value: www.website.com/fr/, French, Our system is based on the STRAND algorithm • (Resnik and Smith, 2003): (full website entry) The reducer then receives all websites mapped 1. Candidate pair selection: Retrieve candidate to the same “language independent” URL. If two document pairs from the CommonCrawl cor- or more websites are associated with the same key, pus. the reducer will output all associated values, as 2. Structural Filtering: long as they are not in the same language, as de- termined by the language identifier in the URL. (a) Convert the HTML of each document This URL-based matching is a simple and in- 2commoncrawl.org expensive solution to the problem of finding can- 3http://aws.amazon.com/s3/pricing/ didate document pairs. The mapper will discard 1375 most, and neither the mapper nor the reducer do Sentence Filtering Since we do not perform any anything with the HTML of the documents aside boilerplate removal in earlier steps, there are many from reading and writing them. This approach is sentence pairs produced by the pipeline which very simple and likely misses many good potential contain menu items or other bits of text which are candidates, but has the advantage that it requires not useful to an SMT system. We avoid perform- no information other than a set of language codes, ing any complex boilerplate removal and only re- and runs in time roughly linear in the size of the move segment pairs where either the source and dataset. target text are identical, or where the source or target segments appear more than once in the ex- Structural Filtering A major component of the tracted corpus. STRAND system is the alignment of HTML docu- ments. This alignment is used to determine which 3 Analysis of the Common Crawl Data document pairs are actually parallel, and if they are, to align pairs of text blocks within the docu- We ran our algorithm on the 2009-2010 version ments. of the crawl, consisting of 32.3 terabytes of data. Since the full dataset is hosted on EC2, the only The first step of structural filtering is to lin- cost to us is CPU time charged by Amazon, which earize the HTML. This means converting its DOM came to a total of about $400, and data stor- tree into a sequence of start tags, end tags, and age/transfer costs for our output, which came to chunks of text. Some tags (those usually found roughly $100. For practical reasons we split the within text, such as “font” and “a”) are ignored run into seven subsets, on which the full algo- during this step.
Load more

Recommended publications
  • Machine-Translation Inspired Reordering As Preprocessing for Cross-Lingual Sentiment Analysis
    Master in Cognitive Science and Language Master’s Thesis September 2018 Machine-translation inspired reordering as preprocessing for cross-lingual sentiment analysis Alejandro Ramírez Atrio Supervisor: Toni Badia Abstract In this thesis we study the effect of word reordering as preprocessing for Cross-Lingual Sentiment Analysis. We try different reorderings in two target languages (Spanish and Catalan) so that their word order more closely resembles the one from our source language (English). Our original expectation was that a Long Short Term Memory classifier trained on English data with bilingual word embeddings would internalize English word order, resulting in poor performance when tested on a target language with different word order. We hypothesized that the more the word order of any of our target languages resembles the one of our source language, the better the overall performance of our sentiment classifier would be when analyzing the target language. We tested five sets of transformation rules for our Part of Speech reorderings of Spanish and Catalan, extracted mainly from two sources: two papers by Crego and Mariño (2006a and 2006b) and our own empirical analysis of two corpora: CoStEP and Tatoeba. The results suggest that the bilingual word embeddings that we are training our Long Short Term Memory model with do not improve any English word order learning by part of the model when used cross-lingually. There is no improvement when reordering the Spanish and Catalan texts so that their word order more closely resembles English, and no significant drop in result score even when applying a random reordering to them making them almost unintelligible, neither when classifying between 2 options (positive-negative) nor between 4 (strongly positive, positive, negative, strongly negative).
    [Show full text]
  • Student Research Workshop Associated with RANLP 2011, Pages 1–8, Hissar, Bulgaria, 13 September 2011
    RANLPStud 2011 Proceedings of the Student Research Workshop associated with The 8th International Conference on Recent Advances in Natural Language Processing (RANLP 2011) 13 September, 2011 Hissar, Bulgaria STUDENT RESEARCH WORKSHOP ASSOCIATED WITH THE INTERNATIONAL CONFERENCE RECENT ADVANCES IN NATURAL LANGUAGE PROCESSING’2011 PROCEEDINGS Hissar, Bulgaria 13 September 2011 ISBN 978-954-452-016-8 Designed and Printed by INCOMA Ltd. Shoumen, BULGARIA ii Preface The Recent Advances in Natural Language Processing (RANLP) conference, already in its eight year and ranked among the most influential NLP conferences, has always been a meeting venue for scientists coming from all over the world. Since 2009, we decided to give arena to the younger and less experienced members of the NLP community to share their results with an international audience. For this reason, further to the first successful and highly competitive Student Research Workshop associated with the conference RANLP 2009, we are pleased to announce the second edition of the workshop which is held during the main RANLP 2011 conference days on 13 September 2011. The aim of the workshop is to provide an excellent opportunity for students at all levels (Bachelor, Master, and Ph.D.) to present their work in progress or completed projects to an international research audience and receive feedback from senior researchers. We have received 31 high quality submissions, among which 6 papers have been accepted as regular oral papers, and 18 as posters. Each submission has been reviewed by
    [Show full text]
  • ALW2), Pages 1–10 Brussels, Belgium, October 31, 2018
    EMNLP 2018 Second Workshop on Abusive Language Online Proceedings of the Workshop, co-located with EMNLP 2018 October 31, 2018 Brussels, Belgium Sponsors Primary Sponsor Platinum Sponsors Gold Sponsors Silver Sponsors Bronze Sponsors ii c 2018 The Association for Computational Linguistics Order copies of this and other ACL proceedings from: Association for Computational Linguistics (ACL) 209 N. Eighth Street Stroudsburg, PA 18360 USA Tel: +1-570-476-8006 Fax: +1-570-476-0860 [email protected] ISBN 978-1-948087-68-1 iii Introduction Interaction amongst users on social networking platforms can enable constructive and insightful conversations and civic participation; however, on many sites that encourage user interaction, verbal abuse has become commonplace. Abusive behavior such as cyberbullying, hate speech, and scapegoating can poison the social climates within online communities. The last few years have seen a surge in such abusive online behavior, leaving governments, social media platforms, and individuals struggling to deal with the consequences. As a field that works directly with computational analysis of language, the NLP community is uniquely positioned to address the difficult problem of abusive language online; encouraging collaborative and innovate work in this area is the goal of this workshop. The first year of the workshop saw 14 papers presented in a day-long program including interdisciplinary panels and active discussion. In this second edition, we have aimed to build on the success of the first year, maintaining a focus on computationally detecting abusive language and encouraging interdisciplinary work. Reflecting the growing research focus on this topic, the number of submissions received more than doubled from 22 in last year’s edition of the workshop to 48 this year.
    [Show full text]
  • Using Morphemes from Agglutinative Languages Like Quechua and Finnish to Aid in Low-Resource Translation
    Using Morphemes from Agglutinative Languages like Quechua and Finnish to Aid in Low-Resource Translation John E. Ortega [email protected] Dept. de Llenguatges i Sistemes Informatics, Universitat d’Alacant, E-03071, Alacant, Spain Krishnan Pillaipakkamnatt [email protected] Department of Computer Science, Hofstra University, Hempstead, NY 11549, USA Abstract Quechua is a low-resource language spoken by nearly 9 million persons in South America (Hintz and Hintz, 2017). Yet, in recent times there are few published accounts of successful adaptations of machine translation systems for low-resource languages like Quechua. In some cases, machine translations from Quechua to Spanish are inadequate due to error in alignment. We attempt to improve previous alignment techniques by aligning two languages that are simi- lar due to agglutination: Quechua and Finnish. Our novel technique allows us to add rules that improve alignment for the prediction algorithm used in common machine translation systems. 1 Introduction The NP-complete problem of translating natural languages as they are spoken by humans to machine readable text is a complex problem; yet, is partially solvable due to the accuracy of machine language translations when compared to human translations (Kleinberg and Tardos, 2005). Statistical machine translation (SMT) systems such as Moses 1, require that an algo- rithm be combined with enough parallel corpora, text from distinct languages that can be com- pared sentence by sentence, to build phrase translation tables from language models. For many European languages, the translation task of bringing words together in a sequential sentence- by-sentence format for modeling, known as word alignment, is not hard due to the abundance of parallel corpora in large data sets such as Europarl 2.
    [Show full text]
  • A Massively Parallel Corpus: the Bible in 100 Languages
    Lang Resources & Evaluation DOI 10.1007/s10579-014-9287-y ORIGINAL PAPER A massively parallel corpus: the Bible in 100 languages Christos Christodouloupoulos • Mark Steedman Ó The Author(s) 2014. This article is published with open access at Springerlink.com Abstract We describe the creation of a massively parallel corpus based on 100 translations of the Bible. We discuss some of the difficulties in acquiring and processing the raw material as well as the potential of the Bible as a corpus for natural language processing. Finally we present a statistical analysis of the corpora collected and a detailed comparison between the English translation and other English corpora. Keywords Parallel corpus Á Multilingual corpus Á Comparative corpus linguistics 1 Introduction Parallel corpora are a valuable resource for linguistic research and natural language processing (NLP) applications. One of the main uses of the latter kind is as training material for statistical machine translation (SMT), where large amounts of aligned data are standardly used to learn word alignment models between the lexica of two languages (for example, in the Giza?? system of Och and Ney 2003). Another interesting use of parallel corpora in NLP is projected learning of linguistic structure. In this approach, supervised data from a resource-rich language is used to guide the unsupervised learning algorithm in a target language. Although there are some techniques that do not require parallel texts (e.g. Cohen et al. 2011), the most successful models use sentence-aligned corpora (Yarowsky and Ngai 2001; Das and Petrov 2011). C. Christodouloupoulos (&) Department of Computer Science, UIUC, 201 N.
    [Show full text]
  • A Corpus-Based Study of Unaccusative Verbs and Auxiliary Selection
    To be or not to be: A corpus-based study of unaccusative verbs and auxiliary selection Master's Thesis Presented to The Faculty of the Graduate School of Arts and Sciences Brandeis University Department of Computer Science James Pustejovsky, Advisor In Partial Fulfillment of the Requirements for Master's Degree By Richard A. Brutti Jr. May 2012 c Copyright by Richard A. Brutti Jr. 2012 All Rights Reserved ABSTRACT To be or not to be: A corpus-based study of unaccusative verbs and auxiliary selection A thesis presented to the Department of Computer Science Graduate School of Arts and Sciences Brandeis University Waltham, Massachusetts Richard A. Brutti Jr. Since the introduction of the Unaccusative Hypothesis (Perlmutter, 1978), there have been many further attempts to explain the mechanisms behind the division in intransitive verbs. This paper aims to analyze and test some of theories of unac- cusativity using computational linguistic tools. Specifically, I focus on verbs that exhibit split intransitivity, that is, verbs that can appear in both unaccusative and unergative constructions, and in determining the distinguishing features that make this alternation possible. Many formal linguistic theories of unaccusativity involve the interplay of semantic roles and temporal event markers, both of which can be analyzed using statistical computational linguistic tools, including semantic role labelers, semantic parses, and automatic event classification. I use auxiliary verb selection as a surface-level indicator of unaccusativity in Italian and Dutch, and iii test various classes of verbs extracted from the Europarl corpus (Koehn, 2005). Additionally, I provide some historical background for the evolution of this dis- tinction, and analyze how my results fit into the larger theoretical framework.
    [Show full text]
  • The Translation Equivalents Database (Treq) As a Lexicographer’S Aid
    The Translation Equivalents Database (Treq) as a Lexicographer’s Aid Michal Škrabal, Martin Vavřín Institute of the Czech National Corpus, Charles University, Czech Republic E-mail: [email protected], [email protected] Abstract The aim of this paper is to introduce a tool that has recently been developed at the Institute of the Czech National Corpus, the Treq (Translation Equivalents) database, and to explore its possible uses, especially in the field of lexicography. Equivalent candidates offered by Treq can also be considered as potential equivalents in a bilingual dictionary (we will focus on the Latvian–Czech combination in this paper). Lexicographers instantly receive a list of candidates for target language counterparts and their frequencies (expressed both in absolute numbers and percentages) that suggest the probability that a given candidate is functionally equivalent. A significant advantage is the possibility to click on any one of these candidates and immediately verify their individual occurrences in a given context; and thus more easily distinguish the relevant translation candidates from the misleading ones. This utility, which is based on data stored in the InterCorp parallel corpus, is continually being upgraded and enriched with new functions (the recent integration of multi-word units, adding English as the primary language of the dictionaries, an improved interface, etc.), and the accuracy of the results is growing as the volume of data keeps increasing. Keywords: InterCorp; Treq; translation equivalents; alignment; Latvian–Czech dictionary 1. Introduction The aim of this paper is to introduce one of the tools that has been developed recently at the Institute of the Czech National Corpus (ICNC) and which could be especially helpful to lexicographers: namely, the Treq translation equivalents database1.
    [Show full text]
  • The Pile: an 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding
    The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe Charles Foster Jason Phang Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy EleutherAI [email protected] Abstract versity leads to better downstream generalization capability (Rosset, 2019). Additionally, large-scale Recent work has demonstrated that increased training dataset diversity improves general language models have been shown to effectively cross-domain knowledge and downstream gen- acquire knowledge in a novel domain with only eralization capability for large-scale language relatively small amounts of training data from that models. With this in mind, we present the domain (Rosset, 2019; Brown et al., 2020; Carlini Pile: an 825 GiB English text corpus tar- et al., 2020). These results suggest that by mix- geted at training large-scale language mod- ing together a large number of smaller, high qual- els. The Pile is constructed from 22 diverse ity, diverse datasets, we can improve the general high-quality subsets—both existing and newly cross-domain knowledge and downstream general- constructed—many of which derive from aca- demic or professional sources. Our evalua- ization capabilities of the model compared to mod- tion of the untuned performance of GPT-2 and els trained on only a handful of data sources. GPT-3 on the Pile shows that these models struggle on many of its components, such as To address this need, we introduce the Pile: a academic writing. Conversely, models trained 825:18 GiB English text dataset designed for train- on the Pile improve significantly over both ing large scale language models.
    [Show full text]
  • Semantic Role Annotation of a French-English Corpus
    Semantic Role Annotation of a French-English Corpus Lonneke van der Plas, James Henderson, Paola Merlo Distribution: Public CLASSiC Computational Learning in Adaptive Systems for Spoken Conversation 216594 Deliverable 6.2 Feb 2010 Project funded by the European Community under the Seventh Framework Programme for Research and Technological Development The deliverable identification sheet is to be found on the reverse of this page. Project ref. no. 216594 Project acronym CLASSiC Project full title Computational Learning in Adaptive Systems for Spoken Conversation Instrument STREP Thematic Priority Cognitive Systems, Interaction, and Robotics Start date / duration 01 March 2008 / 36 Months Security Public Contractual date of delivery M24 = March 2010 Actual date of delivery Feb 2010 Deliverable number 6.2 Deliverable title Semantic Role Annotation of a French-English Corpus Type Report Status & version Draft 1.0 Number of pages 53 (excluding front matter) Contributing WP 2 WP/Task responsible UNIGE Other contributors Author(s) Lonneke van der Plas, James Henderson, Paola Merlo EC Project Officer Philippe Gelin Keywords semantic role annotation corpus French English The partners in CLASSiC are: Heriot-Watt University HWU University of Cambridge UCAM University of Geneva GENE Ecole Superieure d’Electricite SUPELEC France Telecom/ Orange Labs FT University of Edinburgh HCRC EDIN For copies of reports, updates on project activities and other CLASSIC-related information, contact: The CLASSIC Project Co-ordinator: Dr. Oliver Lemon School of Mathematical and Computer Sciences (MACS) Heriot-Watt University Edinburgh EH14 4AS United Kingdom [email protected] Phone +44 (131) 451 3782 - Fax +44 (0)131 451 3327 Copies of reports and other material can also be accessed via the project’s administration homepage, http://www.classic-project.org c 2010, The Individual Authors.
    [Show full text]
  • Standard Test Collection for English-Persian Cross-Lingual Word Sense Disambiguation
    Standard Test Collection for English-Persian Cross-Lingual Word Sense Disambiguation Navid Rekabsaz, Serwah Sabetghadam, Mihai Lupu, Linda Andersson, Allan Hanbury Vienna University of Technology Favoritenstrasse 9 1040 Vienna Austria [email protected] Abstract In this paper, we address the shortage of evaluation benchmarks on Persian (Farsi) language by creating and making available a new benchmark for English to Persian Cross Lingual Word Sense Disambiguation (CL-WSD). In creating the benchmark, we follow the format of the SemEval 2013 CL-WSD task, such that the introduced tools of the task can also be applied on the benchmark. In fact, the new benchmark extends the SemEval-2013 CL-WSD task to Persian language. Keywords: Persian, Farsi, Cross Lingual Word Sense Disambiguation, test collection 1. Introduction 2. Resources in Persian Language Persian is a member of the Indo-European language fam- Word Sense Disambiguation (WSD)—the task of automat- ily, and uses Arabic letters for writing. Seraji et al. (2012) ically selecting the most related sense for a word occurring provide a comprehensive overview on the main characteris- in a context—is considered as a main step in the course tics of the language. For instance, the diacritic signs are not of approaching language understanding beyond the surface written—it is expected that the reader can read the text in of the words. WSD has been intensively studied in Natu- the absence of the short vowels. This characteristic causes ral Language Processing (NLP) (Navigli, 2012), Machine a special kind of word ambiguity in writing, such that some Translation (Chan et al., 2007; Costa-Jussa` and Farrus,´ words are pronounced differently while their written forms 2014), and Information Retrieval (Zhong and Ng, 2012).
    [Show full text]
  • The Syntax and Semantics of Prepositions in the Task of Automatic Interpretation of Nominal Phrases and Compounds: a Cross-Linguistic Study
    The Syntax and Semantics of Prepositions in the Task of Automatic Interpretation of Nominal Phrases and Compounds: A Cross-Linguistic Study Roxana Girju∗ University of Illinois at Urbana-Champaign In this article we explore the syntactic and semantic properties of prepositions in the context of the semantic interpretation of nominal phrases and compounds. We investigate the problem based on cross-linguistic evidence from a set of six languages: English, Spanish, Italian, French, Portuguese, and Romanian. The focus on English and Romance languages is well motivated. Most of the time, English nominal phrases and compounds translate into constructions of the form N PN in Romance languages, where the P (preposition) may vary in ways that correlate with the semantics. Thus, we present empirical observations on the distribution of nominal phrases and compounds and the distribution of their meanings on two different corpora, based on two state-of-the-art classification tag sets: Lauer’s set of eight prepositions and our list of 22 semantic relations. A mapping between the two tag sets is also provided. Furthermore, given a training set of English nominal phrases and compounds along with their translations in the five Romance languages, our algorithm automatically learns classification rules and applies them to unseen test instances for semantic interpretation. Experimental results are compared against two state-of-the-art models reported in the literature. 1.Introduction Prepositions are an important and frequently used category in both English
    [Show full text]
  • Language Teaching Raising Teachers' Awareness of Corpora
    Language Teaching http://journals.cambridge.org/LTA Additional services for Language Teaching: Email alerts: Click here Subscriptions: Click here Commercial reprints: Click here Terms of use : Click here Raising teachers' awareness of corpora Ana Frankenberg­Garcia Language Teaching / Volume 45 / Issue 04 / October 2012, pp 475 ­ 489 DOI: 10.1017/S0261444810000480, Published online: Link to this article: http://journals.cambridge.org/abstract_S0261444810000480 How to cite this article: Ana Frankenberg­Garcia (2012). Raising teachers' awareness of corpora. Language Teaching,45, pp 475­489 doi:10.1017/S0261444810000480 Request Permissions : Click here Downloaded from http://journals.cambridge.org/LTA, by Username: anafrankenberg, IP address: 79.168.189.157 on 23 Aug 2012 Lang. Teach. (2012), 45.4, 475–489 c Cambridge University Press 2010 doi:10.1017/S0261444810000480 First published online 6 December 2010 Raising teachers’ awareness of corpora Ana Frankenberg-Garcia Instituto Superior de Lınguas´ e Administrac¸ao˜ – Lisboa [email protected] The last couple of decades have seen a dramatic increase in corpus availability and a steady growth in the number of supporters of the use of corpora in language teaching. Yet there still seems to be a long way to go before corpora can be understood and used by language teachers in general. Novice corpus users often fail to grasp that corpora do not work in the same way as the more familiar language learning resources – such as dictionaries, grammar books and textbooks – that they are accustomed to using. I therefore propose a series of task-based, consciousness-raising exercises to help teachers (who are not corpus linguists) understand the basics of corpora.
    [Show full text]