Computational Sociolinguistics: a Survey the field of Sociolinguistics Is to Identify Questions That This Massive but Messy Data Would Enable Them to Answer
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Newcastle University Eprints
Newcastle University ePrints Knight D, Adolphs S, Carter R. CANELC: constructing an e-language corpus. Corpora 2014, 9(1), 29-56. Copyright: The definitive version of this article, published by Edinburgh University Press, 2014, is available at: http://dx.doi.org/10.3366/cor.2014.0050 Always use the definitive version when citing. Further information on publisher website: www.euppublishing.com Date deposited: 23-07-2014 Version of file: Author Accepted Manuscript This work is licensed under a Creative Commons Attribution-NonCommercial 3.0 Unported License ePrints – Newcastle University ePrints http://eprint.ncl.ac.uk CANELC – Constructing an e-language corpus ___________________________________________________________________________ Dawn Knight1, Svenja Adolphs2 and Ronald Carter2 This paper reports on the construction of CANELC: the Cambridge and Nottingham e- language Corpus 3 . CANELC is a one million word corpus of digital communication in English, taken from online discussion boards, blogs, tweets, emails and SMS messages. The paper outlines the approaches used when planning the corpus: obtaining consent; collecting the data and compiling the corpus database. This is followed by a detailed analysis of some of the patterns of language used in the corpus. The analysis includes a discussion of the key words and phrases used as well as the common themes and semantic associations connected with the data. These discussions form the basis of an investigation of how e-language operates in both similar and different ways to spoken and written records of communication (as evidenced by the BNC - British National Corpus). Keywords: Blogs, Tweets, SMS, Discussion Boards, e-language, Corpus Linguistics 1. Introduction Communication in the digital age is a complex many faceted process involving the production and reception of linguistic stimuli across a multitude of platforms and media types (see Boyd and Heer, 2006:1). -
RASLAN 2015 Recent Advances in Slavonic Natural Language Processing
RASLAN 2015 Recent Advances in Slavonic Natural Language Processing A. Horák, P. Rychlý, A. Rambousek (Eds.) RASLAN 2015 Recent Advances in Slavonic Natural Language Processing Ninth Workshop on Recent Advances in Slavonic Natural Language Processing, RASLAN 2015 Karlova Studánka, Czech Republic, December 4–6, 2015 Proceedings Tribun EU 2015 Proceedings Editors Aleš Horák Faculty of Informatics, Masaryk University Department of Information Technologies Botanická 68a CZ-602 00 Brno, Czech Republic Email: [email protected] Pavel Rychlý Faculty of Informatics, Masaryk University Department of Information Technologies Botanická 68a CZ-602 00 Brno, Czech Republic Email: [email protected] Adam Rambousek Faculty of Informatics, Masaryk University Department of Information Technologies Botanická 68a CZ-602 00 Brno, Czech Republic Email: [email protected] This work is subject to copyright. All rights are reserved, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, re-use of illustrations, recitation, broadcasting, reproduction on microfilms or in any other way, and storage in data banks. Duplication of this publication or parts thereof is permitted only under the provisions of the Czech Copyright Law, in its current version, and permission for use must always be obtained from Tribun EU. Violations are liable for prosecution under the Czech Copyright Law. Editors ○c Aleš Horák, 2015; Pavel Rychlý, 2015; Adam Rambousek, 2015 Typography ○c Adam Rambousek, 2015 Cover ○c Petr Sojka, 2010 This edition ○c Tribun EU, Brno, 2015 ISBN 978-80-263-0974-1 ISSN 2336-4289 Preface This volume contains the Proceedings of the Ninth Workshop on Recent Advances in Slavonic Natural Language Processing (RASLAN 2015) held on December 4th–6th 2015 in Karlova Studánka, Sporthotel Kurzovní, Jeseníky, Czech Republic. -
With Dialect It's Not What You
26 MONDAY, MAY 25, 2015 Eastern Daily Press Like us at: OPINION and comment www.facebook.com/edp24 Eastern Daily Press READER’S PICTURE OF THE DAY SERVING THE COMMUNITY SINCE 1870 Enjoy this day City fans – it doesn’t come around very often Today’s the day. Thousands are deserting our region and heading for Wembley – 30 years since Norwich City last made an appearance there. Coaches, cars and trains will be packed with fans as they head for the traditional home of football and the dramatic sight of the arch which dominates the new stadium. A small army of loyal long-distance followers have jetted in from Canada, South Africa, Thailand, Australia, Vietnam, Hong Kong and Dubai to see the Canaries’ biggest game in decades. Many thousands more will be at home or in the pub watching the play-off final against Middlesbrough. The excitement has built up to fever pitch and nerves will be stretched to their limits as the team strives to regain its place in the Premier League. Middlesbrough have beaten Norwich in the league, but none of that will matter when the teams take to the pitch this afternoon. Experts estimate that promotion is worth as much as £130m to the club. For the fans there is the mouth-watering prospect of playing against some of the game’s biggest names. For the city and the region there is the extra morale boost and status attached to being in the top flight. I Val Bond sent in this colourful meadow in Gisleham. If you would like to submit a picture for possible publication in the EDP, visit www. -
Translating Sociolect in the Works of Charles Dickens Master’S Diploma Thesis
Masaryk University Faculty of Arts Department of English and American Studies English-language Translation Bc. Tereza Rotterová Translating Sociolect in the Works of Charles Dickens Master’s Diploma Thesis Supervisor: Ing. Mgr. Jiří Rambousek, Ph. D. 2017 I declare that I have worked on this thesis independently, using only the primary and secondary sources listed in the bibliography. …………………………………………….. Author’s signature I would like to thank my supervisor Ing. Mgr. Jiří Rambousek, Ph.D. for valuable advice. Table of Contents INTRODUCTION ............................................................................................................... 5 1) THEORETICAL BACKGROUND FOR ANALYZING DIALECT IN TRANSLATION....................................................................................................................... 7 1.1 KEY TERMINOLOGY IN ANALYZING DIALECT TRANSLATION .................................... 7 1.2 THE NOTION OF STANDARD: CZECH AND ENGLISH ............................................... 10 1.2.1 THE NOTION OF STANDARD: ENGLISH ................................................................ 10 1.2.2 THE NOTION OF STANDARD: CZECH ................................................................... 13 1.3 STRUCTURAL DIFFERENCES BETWEEN ENGLISH AND CZECH ................................. 18 1.4 APPROACHES TO TRANSLATING DIALECT AND SOCIOLECT..................................... 19 2) DICKENS AND THE LITERARY DIALECT ....................................................... 24 3) METHODOLOGY OF RESEARCH ...................................................................... -
Opinion&Comment
20 OPINION www.EDP24.co.uk/news Eastern Daily Press, Wednesday, August 29, 2012 OPINION&COMMENT (DVWHUQ'DLO\3UHVV READER’S PICTURE OF THE DAY No 43,968 Plenty of stirrings in Conservative ranks Page Five A prime minister may cast aside attacks from the Opposition benches of the Commons with a show of strength and a flash of wit; but when the assault is from his own party, it is a different kettle of fish. In the next few weeks David Cameron will face several assaults from within his own ranks which will help clarify his chances of winning the next general election. Managing the politics of coalition with the Liberal Democrats, with whom relations have crashed over constitutional reform, must be sapping, even if Mr Cameron does get on well personally with their leader Nick Clegg – and there is a danger of it becoming a growing distraction from getting across the real policies and messages he wants people to listen to. Former minister Tim Yeo hardly held back yesterday when he challenged Mr Cameron to be “man or mouse” and spoke of a “dignified slide towards insignificance” with voters unable to see his priorities and passions. The context was a third Heathrow runway. The code was blatantly obvious. Mr Cameron’s dinner with parliamentary colleagues next week and William Hague’s appearance at the 1922 committee of Tory backbenchers are unlikely to be very comfortable. Rail fares, planning, Sunday trading laws, not to mention runways… Or even the coalition… Or Europe… Or the economy. There are plenty of stirrings in Conservative ranks. -
Children Online: a Survey of Child Language and CMC Corpora
Children Online: a survey of child language and CMC corpora Alistair Baron, Paul Rayson, Phil Greenwood, James Walkerdine and Awais Rashid Lancaster University Contact author: Paul Rayson Email: [email protected] The collection of representative corpus samples of both child language and online (CMC) language varieties is crucial for linguistic research that is motivated by applications to the protection of children online. In this paper, we present an extensive survey of corpora available for these two areas. Although a significant amount of research has been undertaken both on child language and on CMC language varieties, a much smaller number of datasets are made available as corpora. Especially lacking are corpora which match requirements for verifiable age and gender metadata, although some include self-reported information, which may be unreliable. Our survey highlights the lack of corpus data available for the intersecting area of child language in CMC environments. This lack of available corpus data is a significant drawback for those wishing to undertake replicable studies of child language and online language varieties. Keywords: child language, CMC, survey, corpus linguistics Introduction This survey is part of a wider investigation into child language and computer-mediated communication (CMC)1 corpora. Its aim is to assess the availability of relevant corpora which can be used to build representative samples of the language of children online. The Isis project2, of which the survey is a part, carries out research in the area of online child protection. Corpora of child and CMC language serve two main purposes in our research. First, they enable us to build age- and gender-based standard profiles of such language for comparison purposes. -
British Accents and Dialects
British Accents and Dialects www.bl.uk/british-accents-and-dialects Resources consulted in creating British Accents and Dialects Books Bauer, L. & Trudgill, P. 1998. Language Myths. Harmondsworth: Penguin Beal, J. 2006. Language and Region. London: Routledge Beard, A. 2004. Language Change. London: Routledge Crystal, D. 2002. The English Language: A Guided Tour of the Language, 2nd Edn. Harmondsworth: Penguin Crystal, D. 2003. English as a Global Language, 2nd Edn. Cambridge: Cambridge University Press Crystal, D. 2004. The Stories of English. Harmondsworth: Penguin Crystal, D. 2011. Evolving English: One Language, Many Voices. London: British Library Chambers, J. & Trudgill, P. 1998. Dialectology, 2nd Edn. Cambridge: Cambridge University Press Cruttenden, A. 2001. Gimson's Pronunciation of English, 6th Edn. London: Hodder Arnold Dent, S. 2011. How to Talk Like a Local: From Cockney to Geordie. London: Random House Elmes, S. 2005. Talking for Britain. Harmondsworth: Penguin Foulkes, P., & Gerard D. (eds.) 1999. Urban Voices: Accent Studies in the British Isles. London: Arnold Hughes, A., Trudgill, P. & Watt, D. 2005. English Accents and Dialects: An Introduction to Social and Regional Varieties of English in the British Isles, 4th edn. London: Hodder Arnold Kortmann, B. & Upton, C. (eds.) 2008. Varieties of English 1: The British Isles. Berlin: Mouton de Gruyter Opie, I. & P. 1987. The Lore and Language of Schoolchildren. Oxford: Oxford University Press Orton, H. 1962. Survey of English Dialects (A): An Introduction. Leeds: E J Arnold and Son Ltd. Orton, H., Halliday, W. & Barry, M. (eds.) 1962-1971. Survey of English Dialects (B): The Basic Material, Vols.1- 4. Leeds: E.J. -
Email in the Australian National Corpus
Email in the Australian National Corpus Andrew Lampert CSIRO ICT Centre, North Ryde, Australia and Macquarie University, Australia 1. Introduction Email is not only a distinctive and important text type but one that touches the lives of most Australians. In 2008, 79.4% of Australians used the internet, ahead of all Asia Pacific countries except New Zealand (Organisation for Economic Co-operation and Development, 2008). A recent Nielsen study suggests that almost 98% of Australian internet users have sent or received email messages in the past 4 weeks (Australian Communications and Media Authority, 2008), making email the most used application on the internet by a significant margin. It seems logical to embrace a communication medium used by the vast majority of Australians when considering the text types and genres that should be included in the Australian National Corpus. Existing corpora such as the British National Corpus (2007) and the American National Corpus (Macleod, Ide, & Grishman, 2000) provide many insights and lessons for the creation and curation of the Australian National Corpus. Like many existing corpora, the British National Corpus and the American National Corpus contain language data drawn from a wide variety of text types and genres, including telephone dialogue, novels, letters, transcribed face-to-face dialogue, technical books, newspapers, web logs, travel guides, magazines, reports, journals, and web data. Notably absent from this list are email messages. In many respects, email has replaced more traditional forms of communication such as letters and memoranda, yet this reality is not reflected in existing corpora. This lack of email text is a significant gap in existing corpus resources. -
C 2014 Gourab Kundu DOMAIN ADAPTATION with MINIMAL TRAINING
c 2014 Gourab Kundu DOMAIN ADAPTATION WITH MINIMAL TRAINING BY GOURAB KUNDU DISSERTATION Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Computer Science in the Graduate College of the University of Illinois at Urbana-Champaign, 2014 Urbana, Illinois Doctoral Committee: Professor Dan Roth, Chair Professor Chengxiang Zhai Assistant Professor Julia Hockenmaier Associate Professor Hal DaumeIII, University of Maryland Abstract Machine learning models trained on labeled data of a domain degrade performance severely when tested on a different domain. Traditional approaches deal with this problem by training a new model for every new domain. In Natural language processing, top performing systems often use multiple interconnected models and therefore training all of them for every new domain is computationally expensive. This thesis is a study on how to adapt to a new domain, using the system trained on a different domain, avoiding the cost of retraining. This thesis identifies two key ingredients for adaptation without training: broad coverage re- sources and constraints. We show how resources like Wikipedia, VerbNet, WordNet that contain comprehensive coverage of entities, semantic roles and words in English can help a model adapt to a new domain. For the task of semantic role labeling, we show that in the decision phase, we can replace a linguistic unit (e.g. verb, word) with another equivalent linguistic unit residing in the same cluster defined in these resources (e.g. VerbNet, WordNet) such that after replacement, text becomes more like text on which the model was trained. We show that the model's output is more accurate on the transformed text than on original text. -
Investigating Regional Speech in Yorkshire: Evidence from the Millennium Memory Bank
Investigating Regional Speech in Yorkshire: Evidence from the Millennium Memory Bank Sarah Elizabeth Haigh A thesis submitted to the University of Sheffield for the degree of Master of Philosophy in the School of English Literature, Language and Linguistics January 2015 1 Abstract In this thesis I investigate the extent to which accent variation existed in Yorkshire at the turn of the millennium. I do this by examining the speech of a number of speakers from different locations around the region, recorded in 1998-9 as part of the Millennium Memory Bank oral history project conducted by the BBC and British Library. I also use this data to study change over time by comparing two generations of speakers from the Millennium Memory Bank, and also comparing those speakers with data from the Survey of English Dialects. I conduct the study focussing on two phonological variables: the GOAT vowel, and the PRICE vowel. I discuss the changes and variation found, both over time and with regard to place, with reference to dialect levelling as it has previously been described within the region, considering the possibility of the development of a „pan-Yorkshire‟ variety. My findings suggest that, although changes have clearly occurred in Yorkshire since the time of the SED, some variation within the region remains robust, and there may even be evidence of new diversity arising as urban varieties in Yorkshire cities continue to evolve. I also assess the potential of an oral history interview collection such as the Millennium Memory Bank for use in linguistic research, discussing the advantages and drawbacks of such data, and describing ways in which the collection as it currently stands could be made more accessible to linguists. -
CS224N Section 3 Corpora, Etc. Pi-Chuan Chang, Friday, April 25
CS224N Section 3 Corpora, etc. Pi-Chuan Chang, Friday, April 25, 2008 Some materials borrowed from Bill’s notes in 2006: http://www.stanford.edu/class/cs224n/handouts/cs224n-section3-corpora.txt Proposal for Final project due two weeks later (Wednesday, 5/7) Look for interesting topics? Æ go through the syllabus : http://www.stanford.edu/class/cs224n/syllabus.html Æ final projects from previous years : http://nlp.stanford.edu/courses/cs224n/ Æ what data / tools are out there? Æ collect your own dataset 1. LDC (Linguistic Data Consortium) o http://www.ldc.upenn.edu/Catalog/ 2. Corpora@Stanford o http://www.stanford.edu/dept/linguistics/corpora/ o Corpus TA: Anubha Kothari o The inventory: http://www.stanford.edu/dept/linguistics/corpora/inventory.html o Some of them are on AFS; some of them are available on DVD/CDs in the linguistic department 3. http://nlp.stanford.edu/links/statnlp.html 4. ACL Anthology o http://aclweb.org/anthology-new/ 5. Various Shared Tasks o CoNLL (Conference on Computational Natural Language Learning) 2006: Multi-lingual Dependency Parsing 2005, 2004: Semantic Role Labeling 2003, 2002: Language-Independent Named Entity Recognition 2001: Clause Identification 2000: Chunking 1999: NP bracketing o Machine Translation shared tasks: 2008, 2007, 2006, 2005 o Pascal Challenges (RTE, etc) o TREC (IR) o Senseval (Word sense disambiguation) o … Parsing Most widely-used : Penn Treebank 1. English: (LDC99T42) Treebank-3 (see Bill’s notes) 2. In many different languages, like Chinese (CTB6.0), Arabic Other parsed corpora 1. Switchboard (spoken) 2. German: NEGRA, TIGER, Tueba-D/Z • There’s an ACL workshop on German Parsing this year… 3. -
Machine Learning Approaches To
Slides adapted from Dan Jurafsky, Jim Martin and Chris Manning ` This week x Finish semantics x Begin machine learning for NLP x Review for midterm ` Midterm ◦ October 27th, ◦ Where: 1024 Mudd (here) ◦ When: Class time, 2:40-4:00 ◦ Will cover everything through semantics ◦ A sample midterm will be posted ◦ Includes multiple choice, short answer, problem solving ` October 29th ◦ Bob Coyne and Words Eye: Not to be missed! ` TBD: Class outing to Where the Wild Things Are ` A subset of WordNet sense representation commonly used ` WordNet provides many relations that capture meaning ` To do WSD, need a training corpus tagged with senses ` Naïve Bayes approach to learning the correct sense ◦ Probability of a specific sense given a set of features ◦ Collocational features ◦ Bag of words ` A case statement…. ` Restrict the lists to rules that test a single feature (1-decisionlist rules) ` Evaluate each possible test and rank them based on how well they work. ` Glue the top-N tests together and call that your decision list. ` On a binary (homonymy) distinction used the following metric to rank the tests P(Sense1 | Feature) P(Sense2 | Feature) ` This gives about 95% on this test… ` In vivo versus in vitro evaluation ` In vitro evaluation is most common now ◦ Exact match accuracy x % of words tagged identically with manual sense tags ◦ Usually evaluate using held-out data from same labeled corpus x Problems? x Why do we do it anyhow? ` Baselines ◦ Most frequent sense ◦ The Lesk algorithm ` Wordnet senses are ordered in frequency order ` So “most