Building a Morphological Analyser for Laz
Total Page:16
File Type:pdf, Size:1020Kb
Building a Morphological Analyser for Laz Esra Önal Francis M. Tyers Cognitive Science, Department of Linguistics Boğaziçi University Indiana University Istanbul, Turkey Bloomington, United States [email protected] [email protected] Abstract writing system for Laz based on Latin alphabet and later ‘Lazuri Alboni’ (Laz Alphabet) and only after This study is an attempt to contribute to 1990s, the written texts started to come out as sev- documentation and revitalization efforts of eral associations were founded for the preservation endangered Laz language, a member of of Laz language and culture. Now with all these South Caucasian language family mainly efforts, Laz has been thought in public schools in spoken on northeastern coastline of Turkey. Turkey as an elective language course since 2013 It constitutes the first steps to create a gen- (Kavaklı, 2015; Haznedar, 2018). eral computational model for word form There is not much research on lexicon and syntax recognition and production for Laz by of Laz and the first academic level research studies building a rule-based morphological anal- began by the end of 20th century. In 1999, the first yser using Helsinki Finite-State Toolkit dictionary for Laz (Turkish—Laz) was prepared (HFST). The evaluation results show that and published by İsmail Bucaklişi and Hasan Uzun- the analyser has a 64.9% coverage over a hasanoğlu. The following years, Bucaklişi also pub- corpus collected for this study with 111,365 lished the first Laz grammar book (Kavaklı, 2015) tokens. We have also performed an error and has begun teaching Laz at Boğaziçi University analysis on randomly selected 100 tokens in İstanbul as an elective course since 2011. The from the corpus which are not covered by foundation of the Lazika Publishing Collective in the analyser, and these results show that the 2011 has given rise to the publication of more than errors mostly result from Turkish words in 70 books on Laz language and literature (Kavaklı, the corpus and missing stems in our lexicon. 2015). 1 Introduction Laz language is only one of many that faces the danger of extinction. By the end of this century, The Laz language, which is mainly spoken on the many will not survive with the decreasing number of northeastern coastline of Turkey and also in some the native speakers of such languages (Riza, 2008). parts of Georgia has been recorded as a ‘defi- This has alarmed not only native speakers of these 1 nitely endangered ’ language in UNESCO Atlas of languages but also research community to direct the World’s Languages in Danger. It belongs to their attention for language documentation as well 2 South Caucasian language family with the number as preservation and revitalization studies for these of speakers estimated to be between 130,000 and languages (Ćavar et al., 2016; Gerstenberger et al., 150,000 according to UNESCO 2001 records and 2017). Bird (2009) calls out for a ‘new kind of com- between 250,000 and 500,000 according to more putational linguistics’ in his paper that would protect recent studies (Haznedar, 2018). Until the 1920s it this endangered invaluable cultural heritage by help- was a spoken language with only some written col- ing to accelerate these studies, and he ends his paper lection of Laz grammar and folklore studies. Later, with these words ‘Who knows, we may even post- İskender Tzitaşi became the pioneer in developing a pone the day when these languages utter their last 1UNESCO defines the degree of definitely endangered as words.’ which emphasizes the importance of each the situation in which “children no longer learn the language as and every attempt to keep these languages alive. mother tongue in the home”. 2The Southwest Caucasian language family consists of four Riza (2008) gives accounts on language diversity languages: Svans, Mingrelians, Georgian and Laz. on the Internet by pointing to the fact that many en- 869 Proceedings of Recent Advances in Natural Language Processing, pages 869–877, Varna, Bulgaria, Sep 2–4, 2019. https://doi.org/10.26615/978-954-452-056-4_101 dangered languages lacks access to Information and Flag diacritics for representing Laz verbal complex Communication Technology and the representation and for generating complex verbal word forms. of these languages on digital environment is rather low. Considering Laz resources online, there are 2 Laz some online dictionaries and only a couple of web There are eight dialects of the Laz language, none sites that give information about the Laz language of which is considered to be normative or ‘standard’. and culture, and many of them are mostly in Turkish Even though underlyingly the structure of these di- or English. He suggests that regarding ‘digital lan- alects is the same, they show lexical and morpholog- guage divide’ such small regional languages must be ical, as well as phonological differences. There are represented more by creating and using resources in two main groups. The Western dialects (Gyulva), digital format. such as Pazar (Atina), Çamlıhemşin (Furthunaşi One of the drawbacks while working with these gamayona), Ardeşen (Arthaşeni) and the Eastern languages is clearly the small amount of data to dialects (Yulva) as Fındıklı (Viʒe), Arhavi (Arkabi), begin with (written or spoken, annotated or non- Hopa (Xopa), Borçka-İçkale (Çxala).3 annotated) (Riza, 2008). Current dominant compu- For the purposes of this initial study we have cho- tational methods and tools are mostly used on lan- sen to base the analyser on the Pazar dialect. The guages with large corpora, following a statistical ap- reasons for this are twofold: Firstly the Pazar dialect proach to train their systems according to a rele- is less irregular in terms of verbal inflection and sec- vant task. However, with little data at hand these ondly a separate and well-documented grammar of methods may not present a good solution. There- Laz written in English is based only on this dialect.4 fore, Gerstenberger et al. (2017) suggests a rule- Unfortunately, there is no study yet that would pro- based morpho-syntactic modelling for annotating vide an analysis of Laz grammar to be treated as small language data. On their study of Komi lan- ‘standard’ (Haznedar, 2018). guage, his results show by-far significant advantages of rule-based approaches for endangered languages 2.1 Verbs by providing much more precise results in tagging as In terms of morphosyntactic alignment, Laz is an well as ‘full- fledged grammatical description based ergative–absolutive language. It marks the subject on broad empirical evidence’ and a future develop- of unergative predicates and transitives with agen- ment for computer-assisted language learning sys- tive/causer subjects with ergative case while the tems. subject of unaccusative predicates and the direct ob- In this study, the aim is to create a morphologi- ject of transitive and ditransitive verbs are inflected cal analyzer using the Helsinki Finite State Toolkit with nominative case. These patterns are marked (HFST) that will help to overcome manual anno- differently on the verbal complex, depending on tation of a potential Laz corpus. Additionally, as their case markings which also indicate their argu- Gerstenberger et al. (2017) suggest, these may later ment types. The verb encodes person information help developing programs to be able to facilitate both preverbally and postverbally as seen in Table 1 learning of Laz, considering the increase of inter- and Table 2 and 3.5 While we can observe verbs est in Laz courses not only in secondary schools but agreeing with agent-like arguments and sole argu- also in universities such as Boğaziçi University and 3 İstanbul Bilgi University (Haznedar, 2018). From We exclude the Sapanca dialect as the region in which it is spoken is further away from the other dialects. Speakers of spelling and grammar-checkers to machine transla- the Sapanca dialect are considered to be migrated from Batum, tion systems and language learning materials, this Georgia to Sapanca, Turkey (Bucaklişi and Kojima, 2003) 4 small study will hopefully lead to further develop- The main grammar book used for this study is Pazar Laz written by Öztürk and Pöchtrager (2011) which is based on ments on Laz language in the field of Computational courses given by İsmail Bucaklişi in Boğaziçi University and it Linguistics. is the most recent and only complete study on a dialect of Laz written in English which would enable us to define grammat- The remainder of the paper is laid out as follows: ical rules for the morphological analyser. The grammar book in Section 2, the grammatical structure of Laz is by René Lacroix (2009) was also referred to several times but discussed and later, in Section 3.1 and 3.2 the pro- since it is mostly based on Arhavi (Arkabi) dialect and writ- ten in French, we used it when we needed to look for more cess of preparing a lexicon and corpus for Laz is de- examples for certain structures and specific details, especially scribed. The Section 4 gives and explains the details valency-related vowels on the verbal complex and verb classes. of the morphological analyzer and the usefulness of 5It should be noted that post-verbal person markers encode tense information as well. 870 ments in both positions at the same time, we can or a non-core argument8 respectively. All these only observe theme-patient (of mono-transitive and operations commonly mark the verb with different ditransitive verbs) and dative marked recipient-goal valency-related vowel in the same preverbal posi- or applied non-core argument agreement in pre- tion. Therefore, under conditions where the verb verbal position. Additionally, Laz applies a hierar- is needed to be inflected both applicativization and chical selection rule among arguments while mark- causativization at the same time, vowel i/u- ing person in -2 pre-verbal position seen in Table 1.