DOCSLIB.ORG

Cognate Identification Using Machine Translation

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Cognate Identification Using Machine Translation Cognate Identification using Machine Translation Shervin Malmasi Mark Dras Centre for Language Technology Centre for Language Technology Macquarie University Macquarie University Sydney, NSW, Australia Sydney, NSW, Australia [email protected] [email protected] Abstract The identification of such cognates have also been tackled by researchers in NLP. English and In this paper we describe an approach to French are one such pair that have received much automatic cognate identification in mono- attention, potentially because it has been posited lingual texts using machine translation. that up to 30% of the French vocabulary consists This system was used as our entry in the of cognates (LeBlanc and Seguin,´ 1996). 2015 ALTA shared task, achieving an F1- This paper describes our approach to cognate score of 63% on the test set. Our pro- identification in monolingual texts, relying on sta- posed approach takes an input text in a tistical machine translation to create parallel texts. source language and uses statistical ma- Using the English data from the shared task, the chine translation to create a word-aligned aim was to predict which words have French cog- parallel text in the target language. A ro- nates. In x2 we describe some related work in this bust measure of string distance, the Jaro- area, followed by a brief description of the data Winkler distance in this case, is then ap- in x3. Our methodology is described in x4 and re- plied to the pairs of aligned words to de- sults are presented in x5. tect potential cognates. Further extensions to improve the method are also discussed. 2 Related Work 1 Introduction Much of the previous work in this area has re- lied on parallel corpora and aligned bilingual texts. Cognates are words in different languages that Such approaches often rely on orthographic simi- have similar forms and meanings, often due to a larity between words to identify cognates. This common linguistic origin from a shared ancestor similarity can be quantified using measures such language. as the edit distance or dice coefficient with n- Cognates play an important role in Second Lan- grams. Brew and McKelvie (1996) applied such guage Acquisition (SLA), particularly between re- orthographic measures to extract English-French lated languages. However, although they can ac- cognates from aligned texts. celerate vocabulary acquisition, learners also have Phonetic similarity has also been shown to be to be aware of false cognates and partial cognates. useful for this task. Kondrak (2001), for example, False cognates are similar words that have distinct, proposed an approach that also incorporates pho- unrelated meanings. In other cases, there are par- netic cues and applied it to various language pairs. tial cognates: similar words which have a common Semantic similarity information has been em- meaning only in some contexts. For example, the ployed for this task as well; this can help iden- word police in French can translate to police, pol- tify false and partial cognates which can help im- icy or font, depending on the context. prove accuracy. Frunza and Inkpen (2010) com- Cognates are a source of learner errors and the bine various measures of orthographic similarity detection of their incorrect usage, coupled with using machine learning methods. They also use correction and contextual feedback, can be of word senses to perform partial cognate between great use in computer-assisted language learning two languages. All of their methods were applied systems. Additionally, cognates are also useful for to English-French. Wang and Sitbon (2014) com- estimating the readability of a text for non-native bined orthographic measures with word sense dis- readers. ambiguation information to consider context. Shervin Malmasi and Mark Dras. 2015. Cognate Identification using Machine Translation . In Proceedings of Australasian Language Technology Association Workshop, pages 138−141. Cognate information can also be used in other source language and identifies potential cognates tasks. One example is Native Language Identi- in a target language. The source and target lan- fication (NLI), the task of predicting an author’s guages in our work are English and French, re- first language based only on their second language spectively. writing (Malmasi and Dras, 2015b; Malmasi and The underlying motivation of our approach is Dras, 2015a; Malmasi and Dras, 2014). Nicolai et that many of the steps in this task, e.g. those re- al. (2013) developed new features for NLI based quired for WSD, are already performed by statis- on cognate interference and spelling errors. They tical machine translation systems and can thus be propose a new feature based on interference from deferred to such a pre-existing component. This cognates, positing that interference may cause a allows us to convert the text into an aligned trans- person to use a cognate from their native language lation followed by the application of word similar- or misspell a cognate under the influence of the ity measures for cognate identification. The three L1 version. For each misspelled English word, the steps in our method are described below. most probable intended word is determined using spell-checking software. The translations of this 4.1 Sentence Translation word are then looked up in bilingual English-L1 dictionaries for several of the L1 languages. If the In the first step we translate each sentence in a doc- spelling of any of these translations is sufficiently ument. This was done at the sentence-level to en- similar to the English version (as determined by sure that there is enough context information for the edit distance and a threshold value), then the effectively disambiguating the word senses.1 It word is considered to be a cognate from the lan- is also a requirement here that the translation in- guage with the smallest edit distance. The authors clude word alignments between the original input state that although only applying to four of the 11 and translated text. languages (French, Spanish, German, and Italian), For the machine translation component, we em- the cognate interference feature improves perfor- ployed the Microsoft Translator API.2 The service mance by about 4%. Their best result on the test is free to use3 and can be accessed via an HTTP was 81:73%. While limited by the availability of interface, which we found to be adequate for our dictionary resources for the target languages, this needs. The Microsoft Translator API can also ex- is a novel feature with potential for further use in pose word alignment information for a translation. NLI. An important issue to consider is that the au- We also requested access to the Google Trans- thors’ current approach is only applicable to lan- late API under the University Research Program, guages that use the same script as the target L2, but our query went unanswered. which is Latin and English in this case, and can- not be expanded to other scripts such as Arabic or 4.2 Word Alignment Korean. The use of phonetic dictionaries may be one potential solution to this obstacle. After each source sentence has been translated, the alignment information returned by the API is used to create a mapping between the words in the two 3 Data sentences. An example of such a mapping for a sentence from the test set is shown in Figure 1. The data used in this work was provided as part of the shared task. It consists of several English arti- This example shows a number of interesting cles divided into an annotated training set (11k to- patterns to note. We see that multiple words in the kens) as well as a test set (13k tokens) used for source can be mapped to a single word in the trans- evaluating the shared task. lation, and vice versa. Additionally, some words in the translation may not be mapped to anything in the original input. 4 Method 1We had initially considered doing this at the phrase-level, Our methodology is similar to those described but decided against this. 2 in x2, attempting to combine word sense disam- http://www.microsoft.com/en-us/ translator/translatorapi.aspx biguation with a measure of word similarity. Our 3For up to 2m characters of input text per month, which proposed method analyzes a monolingual text in a was sufficient for our needs. 139 The volunteers were picked to reflect a cross section of the wider population. Les volontaires ont été choisis pour refléter un échantillon représentatif de l'ensemble de la population. Figure 1: An example of word alignment between a source sentence from the test set (top) and its translation (bottom). 4.3 Word Similarity Comparison Using Jaro-Winkler Distance pr tp tp F 1 = 2 where p = ; r = In the final step, words in the alignment mappings p + r tp + fp tp + fn are compared to identify potential cognates using the word forms. Here p refers to precision and r is a measure of For this task, we adopt the Jaro-Winkler dis- recall.5 Results that maximize both will receive a tance which has been shown to work well for higher score since this measure weights both recall matching short strings (Cohen et al., 2003). This and precision equally. It is also the case that aver- measure is a variation of the Jaro similarity met- age results on both precision and recall will score ric (Jaro, 1989; Jaro, 1995) that makes it more ro- higher than exceedingly high performance on one bust for cases where the same characters in two measure but not the other. strings are positioned within a short distance of each other, for example due to spelling variations. 5 Results and Discussion The measure computes a normalized score be- tween 0 and 1 where 0 means no similarity and Our results on the test set were submitted to the 1 denotes an exact match.
Load more

Recommended publications
  • Interdisciplinary Approaches to Stratifying the Peopling of Madagascar
    INTERDISCIPLINARY APPROACHES TO STRATIFYING THE PEOPLING OF MADAGASCAR Paper submitted for the proceedings of the Indian Ocean Conference, Madison, Wisconsin 23-24th October, 2015 Roger Blench McDonald Institute for Archaeological Research University of Cambridge Correspondence to: 8, Guest Road Cambridge CB1 2AL United Kingdom Voice/ Ans (00-44)-(0)1223-560687 Mobile worldwide (00-44)-(0)7847-495590 E-mail [email protected] http://www.rogerblench.info/RBOP.htm This version: Makurdi, 1 April, 2016 1 Malagasy - Sulawesi lexical connections Roger Blench Submission version TABLE OF CONTENTS TABLE OF CONTENTS................................................................................................................................. i ACRONYMS ...................................................................................................................................................ii 1. Introduction................................................................................................................................................. 1 2. Models for the settlement of Madagascar ................................................................................................. 2 3. Linguistic evidence...................................................................................................................................... 2 3.1 Overview 2 3.2 Connections with Sulawesi languages 3 3.2.1 Nouns..............................................................................................................................................
    [Show full text]
  • Cognate Words in Mehri and Hadhrami Arabic
    Cognate Words in Mehri and Hadhrami Arabic Hassan Obeid Alfadly* Khaled Awadh Bin Mukhashin** Received: 18/3/2019 Accepted: 2/5/2019 Abstract The lexicon is one important source of information to establish genealogical relations between languages. This paper is an attempt to describe the lexical similarities between Mehri and Hadhrami Arabic and to show the extent of relatedness between them, a very little explored and described topic. The researchers are native speakers of Hadhrami Arabic and they paid many field visits to the area where Mehri is spoken. They used the Swadesh list to elicit their data from more than 20 Mehri informants and from Johnston's (1987) dictionary "The Mehri Lexicon and English- Mehri Word-list". The researchers employed lexicostatistical techniques to analyse their data and they found out that Mehri and Hadhrmi Arabic have so many cognate words. This finding confirms Watson (2011) claims that Arabic may not have replaced all the ancient languages in the South-Western Arabian Peninsula and that dialects of Arabic in this area including Hadhrami Arabic are tinged, to a greater or lesser degree, with substrate features of the Pre- Islamic Ancient and Modern South Arabian languages. Introduction: three branches including Central Semitic, Historically speaking, the Semitic language Ethiopian and Modern south Arabian languages family from which both of Arabic and Mehri (henceforth MSAL). Though Arabic and Mehri descend belong to a larger family of languages belong to the West Semitic, Arabic descends called Afro-Asiatic or Hamito-Semitic that from the Central Semitic and Mehri from includes Semitic, Egyptian, Cushitic, Omotic, (MSAL) which consists of two branches; the Berber and Chadic (Rubin, 2010).
    [Show full text]
  • Comparing the Cognate Effect in Spoken and Written Second Language Word Production
    1 Short title: Cognate effect in spoken and written word production Comparing the cognate effect in spoken and written second language word production 1 2 1 Merel Muylle , Eva Van Assche & Robert J. Hartsuiker 1Department of Experimental Psychology, Ghent University, Ghent, Belgium 2 Thomas More University of Applied Sciences, Antwerp, Belgium Address for correspondence: Merel Muylle Department of Experimental Psychology Ghent University Henri Dunantlaan 2 B-9000 Gent (Belgium) E-mail: [email protected] 2 Abstract Cognates – words that share form and meaning between languages – are processed faster than control words. However, it is unclear whether this effect is merely lexical (i.e., central) in nature, or whether it cascades to phonological/orthographic (i.e., peripheral) processes. This study compared the cognate effect in spoken and typewritten production, which share central, but not peripheral processes. We inquired whether this effect is present in typewriting, and if so, whether its magnitude is similar to spoken production. Dutch-English bilinguals performed either a spoken or written picture naming task in English; picture names were either Dutch-English cognates or control words. Cognates were named faster than controls and there was no cognate-by-modality interaction. Additionally, there was a similar error pattern in both modalities. These results suggest that common underlying processes are responsible for the cognate effect in spoken and written language production, and thus a central locus of the cognate effect. Keywords: bilingualism, word production, cognate effect, writing 3 Converging evidence suggests that bilinguals activate both their mother tongue (L1) and their second language (L2) simultaneously when processing linguistic information (e.g., Dijkstra & Van Heuven, 2002; Van Hell & Dijkstra, 2002).
    [Show full text]
  • 1 Roger Schwarzschild Rutgers University 18 Seminary Place New
    Roger Schwarzschild Rutgers University 18 Seminary Place New Brunswick, NJ 08904 [email protected] to appear in: Recherches Linguistiques de Vincennes November 30, 2004 ABSTRACT In some languages, measure phrases can appear with non-compared adjectives: 5 feet tall. I address three questions about this construction: (a) Is the measure phrase an argument of the adjective or an adjunct? (b) What are we to make of the markedness of this construction *142lbs heavy? (c) Why is it that the markedness disappears once the adjective is put in the comparative (2 inches taller alongside 2lbs heavier)? I claim that because degree arguments are ‘functional’, the measure phrase has to be an adjunct and not a syntactic argument of the adjective. Like event modifiers in extended NP’s and in VPs, the measure phrase predicates of a degree argument of the adjective. But given the kind of meaning a measure phrase must have to do its job in comparatives and elsewhere, it is not of the right type to directly predicate of a degree argument. I propose a lexically governed type-shift which applies to some adjectives allowing them to combine with a measure phrase. KEY WORDS adjective, measure phrase, degree, functional category, lexical, adjunct, argument, antonymy. Measure Phrases as Modifiers of Adjectives1 1. Introduction There is a widely accepted account of expressions like five feet tall according to which the adjective tall denotes a relation between individuals and degrees of height and the measure phrase, five feet, serves as an argument of the adjective, saturating the degree-place in the relation2.
    [Show full text]
  • Palatalization/Velar Softening: What It Is and What It Tells Us About the Nature of Language Morris Halle
    Palatalization/Velar Softening: What It Is and What It Tells Us about the Nature of Language Morris Halle This study proposes an account both of the consonantal changes in- volved in palatalization/velar softening and of the fact that this change is encountered before front vowels. The change is a straightforward case of feature assimilation provided that segments/phonemes are viewed as complexes of features organized into the ‘‘bottle brush’’ model illustrated in example (4) and elsewhere in the text, and that the universal set of features includes, in addition to the familiar binary features, six unary features, which specify the designated articulator(s) for every segment (not only for consonants). Keywords: phonetics, palatalization, velar softening, features, articula- tors For Ken Stevens, friend and colleague, on his 80th birthday My purpose in this study is to present an account of the very common alternation between dorsal and coronal consonants often referred to as palatalization or velar softening. This alternation, exemplified by English electri[k] ϳ electri[s]ity, occurs most often before front vowels. In spite of its extremely common occurrence in the languages of the world, to this time there has been no proper account of palatalization that would relate it to the other properties of language, in particular, to the fact that it is found most commonly before front vowels. In the course of working on these remarks, it became clear to me that palatalization raises numerous theoretical questions about which there is at present no agreement among phonologists. Since these include matters of the most fundamental importance for phonology, I start by exten- sively discussing the main issues and the views on them that seem to me most persuasive at this time (section 1).
    [Show full text]
  • Jicaque As a Hokan Language Author(S): Joseph H
    Jicaque as a Hokan Language Author(s): Joseph H. Greenberg and Morris Swadesh Source: International Journal of American Linguistics, Vol. 19, No. 3 (Jul., 1953), pp. 216- 222 Published by: The University of Chicago Press Stable URL: http://www.jstor.org/stable/1263010 Accessed: 11-07-2017 15:04 UTC REFERENCES Linked references are available on JSTOR for this article: http://www.jstor.org/stable/1263010?seq=1&cid=pdf-reference#references_tab_contents You may need to log in to JSTOR to access the linked references. JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about JSTOR, please contact [email protected]. Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at http://about.jstor.org/terms The University of Chicago Press is collaborating with JSTOR to digitize, preserve and extend access to International Journal of American Linguistics This content downloaded from 12.14.13.130 on Tue, 11 Jul 2017 15:04:26 UTC All use subject to http://about.jstor.org/terms JICAQUE AS A HOKAN LANGUAGE JOSEPH H. GREENBERG AND MORRIS SWADESH COLUMBIA UNIVERSITY 1. The problem 2. The phonological equivalences in Hokan 2. Phonological note have been largely established by Edward 3. Cognate list Sapir's work.3 The Jicaque agreements are 4. Use of lexical statistics generally obvious. A special point is that 5.
    [Show full text]
  • Cognet: a Large-Scale Cognate Database
    CogNet: a Large-Scale Cognate Database Khuyagbaatar Batsuren† Gábor Bella† Fausto Giunchiglia†§ DISI, University of Trento, Trento, Italy† Jilin University, Changchun, China§ {k.batsuren; gabor.bella; fausto.giunchiglia}@unitn.it Abstract IELex2, or ABVD (Greenhill et al., 2008), cover only the small set of 225 Swadesh basic concepts, This paper introduces CogNet, a new, although with an extremely wide coverage of up to large-scale lexical database that provides 4000 languages. Secondly, in these databases, lex- cognates—words of common origin and ical entries that belong to scripts other than Latin meaning—across languages. The database or Cyrillic mostly appear in phonetic transcription currently contains 3.1 million cognate pairs instead of using their actual orthographies in their across 338 languages using 35 writing sys- tems. The paper also describes the automated original scripts. These limitations prevent such re- method by which cognates were computed sources from being used in real-world computa- from publicly available wordnets, with an tional tasks on written language. accuracy evaluated to 94%. Finally, statistics This paper describes CogNet, a new large-scale, and early insights about the cognate data high-precision, multilingual cognate database, as are presented, hinting at a possible future well as the method used to build it. Our main exploitation of the resource1 by various fields technical contributions are (1) a general method of lingustics. to detect cognates from multilingual lexical re- sources, with precision and recall parametrable ac- 1 Introduction cording to usage needs; (2) a large-scale cognate database containing 3.1 million word pairs across Cognates are words in different languages that 338 languages, generated with the method above; share a common origin and the same meaning, (3) WikTra, a multilingual transliteration dictio- such as the English letter and the French lettre.
    [Show full text]
  • Phonetics in Phonology
    Phonetics in Phonology John J. Ohala University of California, Berkeley At least since Trubetzkoy (1933, 1939) many have thought of phonology and phonetics as separate, largely autonomous, disciplines with distinct goals and distinct methodologies. Some linguists even seem to doubt whether phonetics is properly part of linguistics at all (Sommerstein 1977:1). The commonly encountered expression ‘the interface between phonology and phonetics’ implies that the two domains are largely separate and interact only at specific, proscribed points (Ohala 1990a). In this paper I will attempt to make the case that phonetics is one of the essential areas of study for phonology. Without phonetics, I would maintain, (and allied empirical disciplines such as psycholinguistics and sociolinguistics) phonology runs the risk of being a sterile, purely descriptive and taxonomic, discipline; with phonetics it can achieve a high level of explanation and prediction as well as finding applications in areas such as language teaching, communication disorders, and speech technology (Ohala 1991). 1. Introduction The central task within phonology (as well as in speech technology, etc.) is to explain the variability and the patterning -- the “behavior” -- of speech sounds. What are regarded as functionally the ‘same’ units, whether word, syllable, or phoneme, show considerable physical variation depending on context and style of speaking, not to mention speaker-specific factors. Documenting and explaining this variation constitutes a major challenge. Variability is evident in several domains: in everyday speech where the same word shows different phonetic shapes in different contexts, e.g., the release of the /t/ in tea has more noise than that in toe when spoken in isolation.
    [Show full text]
  • Working Paper on Exonyms
    UNITED NATIONS E/CONF.98/CRP.32 ECONOMIC AND SOCIAL COUNCIL 13 July 2007 Ninth United Nations Conference on the Standardization of Geographical Names New York, 21 - 30 August 2007 Item 10 of the provisional agenda* Exonyms Working Paper on Exonyms Submitted by Lebanon** * E/CONF.98/1. ** Prepared by Amal Husseini (Lebanon), Head of Aerial Photography Section in the Photogrammetry Department, Lebanese Army – Geographic Affairs Directorate. WORKING PAPER ON EXONYMS (Submitted under item #10 of the Provisional Agenda E/CONF.98/1) By Amal HUSSEINI (LEBANON) Head of Aerial photography section in the photogrammetry department Lebanese army – Geographic Affairs Directorate Survey Engineering Diploma – ESGT - Le Mans (France). High Studies Diploma in Remote Sensing & GIS - Paul Sabatier University (Toulouse III) – (France). The problem of the standardization of geographical names, of which the discussion of exonyms forms a large part, is an extensive and complex one. United Nations resolutions recommend the reduction of the number of exonyms as far and as quickly as possible. An exonym is a name for a place that is not used within that place by the local inhabitants, or a name for a people or language that is not used by the people or language to which it refers. The name used by the people or locals themselves is an endonym or autonym 1. For all Semitic people, including Arabic people, place names are related to an expression of a religious or an emotional thought. Like wishing and seeking blessings. Geographic names are as old as humanity, and more mysterious, because they date back to far periods when human discovered the agriculture as food resources.
    [Show full text]
  • First Name Americanization Patterns Among Twentieth-Century Jewish Immigrants to the United States
    City University of New York (CUNY) CUNY Academic Works All Dissertations, Theses, and Capstone Projects Dissertations, Theses, and Capstone Projects 2-2017 From Rochel to Rose and Mendel to Max: First Name Americanization Patterns Among Twentieth-Century Jewish Immigrants to the United States Jason H. Greenberg The Graduate Center, City University of New York How does access to this work benefit ou?y Let us know! More information about this work at: https://academicworks.cuny.edu/gc_etds/1820 Discover additional works at: https://academicworks.cuny.edu This work is made publicly available by the City University of New York (CUNY). Contact: [email protected] FROM ROCHEL TO ROSE AND MENDEL TO MAX: FIRST NAME AMERICANIZATION PATTERNS AMONG TWENTIETH-CENTURY JEWISH IMMIGRANTS TO THE UNITED STATES by by Jason Greenberg A dissertation submitted to the Graduate Faculty in Linguistics in partial fulfillment of the requirements for the degree of Master of Arts in Linguistics, The City University of New York 2017 © 2017 Jason Greenberg All Rights Reserved ii From Rochel to Rose and Mendel to Max: First Name Americanization Patterns Among Twentieth-Century Jewish Immigrants to the United States: A Case Study by Jason Greenberg This manuscript has been read and accepted for the Graduate Faculty in Linguistics in satisfaction of the thesis requirement for the degree of Master of Arts in Linguistics. _____________________ ____________________________________ Date Cecelia Cutler Chair of Examining Committee _____________________ ____________________________________ Date Gita Martohardjono Executive Officer THE CITY UNIVERSITY OF NEW YORK iii ABSTRACT From Rochel to Rose and Mendel to Max: First Name Americanization Patterns Among Twentieth-Century Jewish Immigrants to the United States: A Case Study by Jason Greenberg Advisor: Cecelia Cutler There has been a dearth of investigation into the distribution of and the alterations among Jewish given names.
    [Show full text]
  • Testing the Efficacy of a Cognate Curriculum
    CREATE 2009 10/5/09 Empirical and Theoretical Background: Considerable previous work (García, 1991; Nagy, TESTING THE EFFICACY OF 1997; National Reading Panel, 2000; Verhoeven, 1990) suggests that one major determinant of poor A COGNATE CURRICULUM reading comprehension, for Latino children and for other lagging readers, is low vocabulary. Lack of knowledge of the middle and lower Maria Carlo, University of Miami frequency 'academic' words encountered in Diane August, Center for Applied Linguistics middle and secondary school texts impedes comprehension of those texts, which in turn Chris Barr, University of Houston impedes the natural process of learning new Ana Pazos-Rego, St. Thomas University word meanings from exposure during reading (Stanovich, 1986). Austin, CREATE Conference, October 5-6, 2009 Continued… Research Questions One strategy believed to be successful in promoting the rapid acquisition of vocabulary by ELLs involves Can an intervention developed to teach teaching children about the morphological structure of cognate awareness to Spanish/English words. bilingual 3rd and 5th graders improve their Researchers believe that it is beneficial for ELLs if instruction on the structural analysis of words includes learning of English words that have cognate making students aware of the cross-linguistic status in Spanish? morphological relationships between words in their two languages (García & Nagy, 1993; Nagy, García, Does the cognate recognition strategy transfer Durgunoglu, & Hancin-Bhatt,1993; Jiménez et al., 1996; to other cognates that have not been Nation 2001). instructed? This involves making students aware of words that are cognates (words that are spelt alike and have similar meanings in two languages), and making them aware of similarities between derivational morphemes in the two languages (e.g, motivación-motivation).
    [Show full text]
  • Identification of Cognates and Recurrent Sound Correspondences
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Directory of Open Access Journals Identification of Cognates and Recurrent Sound Correspondences in Word Lists Grzegorz Kondrak Department of Computing Science, University of Alberta, Edmonton, AB T6G 2E8, Canada. E-mail: [email protected]. ABSTRACT. Identification of cognates and recurrent sound correspondences is a component of two principal tasks of historical linguistics: demonstrating the relatedness of languages, and reconstructing the histories of language families. We propose methods for detecting and quan- tifying three characteristics of cognates: recurrent sound correspondences, phonetic similarity, and semantic affinity. The ultimate goal is to identify cognates and correspondences directly from lists of words representing pairs of languages that are known to be related. The proposed solutions are language independent, and are evaluated against authentic linguistic data. The results of evaluation experiments involving the Indo-European, Algonquian, and Totonac lan- guage families indicate that our methods are more accurate than comparable programs, and achieve high precision and recall on various test sets. The results also suggest that combining various types of evidence substantially increases cognate identification accuracy. RÉSUMÉ. L’identification de mots apparentés et des correspondances de sons récurrents inter- vient dans deux des principales tâches de la linguistique historique: démontrer des filiations linguistiques et reconstruire l’histoire des familles de langues. Nous proposons des méthodes de détection et de quantification de trois caractéristiques des mots apparentés: les correspon- dances de sons récurrents, la ressemblance phonétique et l’affinité sémantique. Le but ultime est d’identifier les mots apparentés et les correspondances directement à partir de listes de mots représentant des paires des langues dont la filiation est connue.
    [Show full text]