Grammatical Disambiguation in The Tatar Language Corpus

Bulat Khakimov Rinat Gilmullin Ramil Gataullin Research Institute of Research Institute of Research Institute of Applied Semiotics Applied Semiotics Applied Semiotics of the of the Tatarstan of the Tatarstan Academy of Sciences, Academy of Sciences, Academy of Sciences, Federal University, , Kazan Federal University, Kazan, Russia Kazan, Russia Kazan, Russia [email protected] [email protected] [email protected]

A corpus was developed [4]. Research on bstract specification and improvement of the This article concerns the issues of corpus-oriented metalanguage for the description of a Tatar study of the most frequent types of grammatical wordform is currently carried out [5]. The homonymy in the Tatar language and the general conception of the corpus is presented possiblities for automation of the disambiguation in [6]. To implement the grammatical process in the corpus. The authors determine the disambiguation in the Tatar National Corpus, relevance of alternative parses generated in the developers have conducted a study of process of automatic morphological analysis in contextual constraints of different types of terms of real linguistic ambiguity. This work grammatical homonyms, involving statistical presents a variant of classification of frequent homoforms and methods for their disambiguation, corpus data, and suggest the methods of and it estimates the potential impact on the corpus. automatic grammatical disambiguation for the Tatar language. Keywords: linguistic corpus, Tatar language, grammatical homonymy, homoform, 2 Statistical Characteristics of the disambiguation Corpus At the initial stage of work we obtained the 1 Introduction statistical data on the frequency of wordforms The problem of grammatical ambiguity and its with alternative parses, presented in Table 1, resolution is one of the most pressing problems from the database of texts of the Tatar National in modern computer and corpus linguistics [1]. Corpus [2]. The total volume of the corpus is “Tugan Tel” Tatar National Corpus, that was 21,940,452 word usages, the proportion of developed in the “Applied semiotics” Research Word usages with alternative parses is 25.75%. Institute of the Tatarstan Academy of Sciences [2], employs the system of automatic № Alternative Amount Proportio morphological annotation on the basis of our parses n in the own morphological analyzer [3]. In order to corpus adequately reflect the specifics of the Tatar 1 Wordforms with 5650820 25,75% language, a morphological standard of the alternative

Gönderme ve kabul tarihi: 12.09.2014-25.10.2014

TÜRKøYE BøLøùøM VAKFI BøLGøSAYAR BøLøMLERø VE MÜHENDøSLøöø DERGøSø (Cilt:7 - SayÕ:2) - 26 parses wordforms was experimentally determined for of which: them. 2 2 parses 4282108 19,51% The suggested measures on the exclusion of 3 3 parses 1045392 4,76% irrelevant types of homonymy have reduced the 4 4 parses 296547 1,35% number of homonymous parses in the corpus 5 5 and more 26773 0,12% by about 8.5% (2.1% of the total volume of parses texts in the corpus). 6 Wordforms with 21940452 100% alternative parses in the 4 Most Frequent Types of sample Grammatical Homonymy Table-1. Some statistical charasteristics of Corpus For the most frequent linguistically relevant types of homonyms we have made a To identify the most frequent types of classification, which groups separate homonymy in the corpus and to assess their automatically determined subtypes. The relevance in terms of real language homonymy, following frequent types of homonyms were a sample of 500 most frequent combinations singled out: of alternative parses was created. On its basis 1. Noun vs Pronoun 150 types with two parsing options were 2. Verb vs Noun/Adjective selected for further analysis, because this 3. Pronoun vs Numeral parsing type is presented in the corpus in the 4. Noun vs Adjective biggest proportion. 5. Postposition vs Noun/Numeral 6. Noun vs Adverb 3 Relevance Evaluation of Types 7. Adjective vs Noun with attributive affix of Homonyms 8. Noun/Adjective vs Noun with possessive In the first phase of work, irrelevant affix combinations of homonyms were identified. In 9. Adjective vs Noun in aditive case such combinations alternative parses often 10. Adjective vs Verb appear because of the errors of the 11. Verb vs Verb morpholoical analyzer, that is due to the 12. Adjective vs Adverb redundancy in the stem set or in the model of 13. Pronoun vs Pronoun in locative-temporal inflection. Some cases are caused by incorrect case morphonological rules of the analyzer; 14. Noun vs Adjective with affix -chA correction of these rules also allows to exclude 15. Pronoun vs Noun the cases of ambiguity belonging to the All types except type 1, 3, 5, 6, 9 and 15, are specified types. represented by a set of regularly formed wordforms, which possess a certain number of The cases conditioned by the disuse of one of grammatical features. Contextual the parsing options present special interest. We disambiguation rules for these types are refer to such cases as irrelevant, because the conditioned by these characteristics and the potential wordforms, which are automatically characteristics of the disambiguating context. generated during the work of the Type 1 is represented by a single frequent word morphological analyzer, are not represented in ul (‘he/son’). Different context principles work the actual speech use. A corresponding set of for each of the part-of-speech alternatives.

TÜRKøYE BøLøùøM VAKFI BøLGøSAYAR BøLøMLERø VE MÜHENDøSLøöø DERGøSø (Cilt:7 - SayÕ:2) - 27 Type 3 is also represented by only one frequent 5 Context Rules for Automatic word ber, which is used both in the meaning of Grammatical Disambiguation the numeral ‘one’ and in the function of the indefinite pronoun, that is close to the function In order to make use of classical methods of of the indefinite article. Each part-of-speech grammatical disambiguation based on context alternative has its own context patterns. rules, we classified the types of homonyms, of Type 5 includes four subtypes. Each of them is which homoforms represent the biggest part. represented by one word – postposition: öçen The full classification of types of homonyms (‘for’), turında (‘about’) and buyınça (‘on’), or (analysis of the full range of types) is an pronoun: tege (‘that’). Each of these words has extremely time-consuming and pragmatically a homonym, which is a noun in a definite form. unreasonable task, as the Tatar language Grammatical characteristics of homonymous belongs to the agglutinative languages, where words and syntactic functions of the respective the number of morphemes that can be attached postpositions define context rules for this type. to the stem is theoretically unlimited. For Types 6 and 9 are represented by the lexemes example, in the above mentioned corpus of bik (‘very/bolt’) and başka (‘other/head+ Tatar texts, which includes more than 21 DIR’), respectively. million Word usages, there are more that 7000 Type 15 is also an example of one wordform types of homoforms. homonymy; it is represented by the word bez On the other hand, the use of classical (‘we/awl’). statistical methods is complicated by the The total number of all types of word usages is sparseness of data and the lack of a standard 1624839. The proportion in the corpus sample annotated disambiguated corpus. Thus, the use is 7,4% (21940452 word usages). The of each of these methods is not sufficiently proportion among the homonymous parses is effective. 28,7% (5650820 in the indicated corpus One possible solution to this problem is sample). described in [7]. The method was used for This variant of classification does not include disambiguation of texts on the Turkish another special case of verb forms homonymy, language, where the number of wordforms with which is related to the multifunctionality of multiple parsing options, reaches 40%. voice affixes. Thus, a statistical study of corpus According to the results of this work, the data has shown that the total number of such accuracy of the method for the Turkish cases of homonymy in the analyzed sample of language reached 96% (with an accuracy of texts is 408346 word usages (1.8% of the total classical statistical methods of 91%). volume of texts and 7.2% of all the alternative Typological and genetic proximity of the parses). The most frequent subtype among Turkish and the Tatar language suggests that them is the V - V + REFL subtype, where one this method is able to show good results for the and the same verbal form can stand both for a Tatar language. separate lexeme, which is included on its own As well as in the Tatar language, in the Turkish in the stem set, and the voice form of another language the number of possible types of lexeme. For example, ezlänergä, totınırga, homonymy is not limited, which in turn leads yaşerenergä, seltänergä, ağulanırğa, alınırğa. to failure when using classical statistical Disambiguation of this type is not a trivial task, methods due to the sparseness of data. To and in many cases requires consideration of not avoid this, instead of searching for the only morpho-syntactic, but also semantic contextual constraints for each type of characteristics of the disambiguating context. homoforms, the algorithm searches for contextual constraints for each morpheme, the

TÜRKøYE BøLøùøM VAKFI BøLGøSAYAR BøLøMLERø VE MÜHENDøSLøöø DERGøSø (Cilt:7 - SayÕ:2) - 28 number of which is limited, in contrast to the a complete annotation of the model fragment of number of types of homoforms: 126 the corpus. morphemes for the Turkish language [1] and 120 morphemes for the Tatar language [4]. It is 6 Software Modules for Context obvious that this approach significantly reduces Rules Developement data sparseness. According to this method, training data is collected for each morpheme from the sample As part of this research, we have developed a of wordforms, which contain the given software tool designed to create, edit and test morpheme at least in one of the possible the database of context rules for the tasks of morphological parses. The received data are automatic grammatical disambiguation in the classified as “positive” or “negative”, Tatar language [8]. depending on whether the morpheme is This module can be used both separately (for included into the contextually suitable this, contextual disambiguation rules should be paradigm. On the basis of these data and using designed for all types of homonyms), and in a special algorithm, the grammatical combination with the probabilistic and disambiguation rules are trained [1]. statistical methods. The second part of the In order to predict a suitable parsing option of toolkit “LangRuleBase-PMM module” [8] uses an unfamiliar wordform, the morphological this database of context rules for grammatical analyzer firstly analyzes the wordforms to the disambiguation in texts. This kind of toolkit, greatest possible extend by all possible which takes into account the particularities of paradigms. Next, on the basis of rules, for each the Tatar language, was developed fort he first morpheme a certain probability of its presence time. It is aimed at assisting the research work or absence in the given wordform in the given of a philologist. context is defined. The final result is calculated To facilitate the annotation process of the Tatar taking into account the accuracy of each rule, language corpus (including manual and ultimately the most likely parse is selected disambiguation), as well as to provide [1]. A distinguishing characteristic of this convenient access to the statistical data of the model and the learning algorithm (GPA corpus, we developed a web application that algorithm) is their high resistance to irrelevant makes the work with corpus texts more and redundant features. convenient and flexible for statistical research. The problem of the lack of a fully annotated This software module, in addition to the disambiguated corpus of the Tatar language, possibility of expanding the corpus and which would be used as training data, can be morphological annotation, supports the option partially solved by choosing for analysis not of manual grammatical disambiguation. the homoforms with a certain morpheme, but on the contrary, the wordforms with the given 7 Conclusion morpheme and a single parsing option. This Formal context-oriented classification of will allow to identify the contextual constraints homoforms and development of context rules directly for the morpheme. However, this for grammatical disambiguation using approach does not cover the entire set of experimental statistical data in the Tatar morphemes (e.g., the morphemes, for which language have been carried out for the first there have not been found worforms with a time. Linguistic resources and software single parsing option). In such cases, modules developed on the basis of the contextual rules are designed manually or after classification and context rules allow to

TÜRKøYE BøLøùøM VAKFI BøLGøSAYAR BøLøMLERø VE MÜHENDøSLøöø DERGøSø (Cilt:7 - SayÕ:2) - 29 perform disambiguation in the Tatar National tatarskogo yazyka [Two-level description of Corpus and other applications. Estimated the Tatar language morphology]. Proceedings cumulative effect in the case of disambiguation of “Language semantics and image of the of the identified frequent types of homonymy world” International Scientific Conference. Kazan: Ed. Kazan State University, 1997. Vol in the Tatar language corpus can be up to 50%. 2. Pp. 65-67. (rus) Our future research will be focused, on the one hand, on the study of disambiguating contexts [5] Suleymanov D.Sh., Gilmullin R.A., Gataullin and the development of contextual R.R. Programmnyy instrumentariy dlya disambiguation rules and, on the other hand, on razresheniya morfologicheskoy mnogoznachnosti v tatarskom yazyke [Software the analysis of statistical regularities in the toolkit for morphologic disambiguation in the field of polysemy at different language levels Tatar language]. Proceedings of OSTIS-2014 and the search for effective approaches to IV International scientific and technical disambiguation taking into account the conference. Minsk, 2014. Pp. 503-508. (rus) particular characteristics of the Tatar language. [6] Suleymanov D.Sh., Khakimov B.E., Gilmullin R.A. Korpus tatarskogo yazyka: 8 Acknowledgements kontseptualnyye i lingvisticheskiye aspekty The work is supported by the Russian Foundation of [Tatar language corpus: conceptual and Basic Research and the Government of the Republic linguistic aspects]. Bulletin of Tatar State of Tatarstan, (project # 12-07-97015) Humanitarian Pedagogical University. 2011. № 4 (26). Pp.211-216. (rus) [7] “Tugan Tel” Tatar National Corpus. – URL: 9 References http://web- [1] Yuret D., Ture F. Learning Morphological corpora.net/TatarCorpus/search/?interface_lang Disambiguation Rules for Turkish. uage=ru. Proceedings of the Human Language [8] Khakimov B.E., Gilmullin R.A. K razrabotke Technology Conference of the North American morfologicheskogo standarta dlya sistem Chapter of the ACL. NewYork, 2006. Pp. avtomaticheskoy obrabotki tekstov na 328–334. tatarskom yazyke [Notes on the development of [2] Galieva A.M., Khakimov B.E., Gatiatullin A.R. a morphological standard for automatic text Metayazyk opisaniya struktury tatarskoy processing systems in the Tatar language]. slovoformy dlya korpusnoy grammaticheskoy System analysis and semiotic modeling: annotatsii [Metalanguage of description of a Proceedings of all-Russia conference with Tatar wordform for corpus-based grammatical international participation (SASM-2011). annotation]. Proceedings of the Kazan Kazan, 2011. PP. С. 209-214. (rus) University, Ser. Human sciences, 2013. V. 155, b. 5. Pp. 287-296. (rus) [3] Nevzorova O.A., Zinkina Yu.V., Pyatkin N.V. Razresheniye funktsionalnoy omonimii v russkom yazyke na osnove kontekstnykh pravil [Resolution of functional homonymy in the based on context rules]. Proceedings of “Dialog'2005” International Conference. : Nauka, 2005. Pp. 198- 202. (rus) [4] Suleymanov D.Sh., Gilmullin R.A. Dvukhurovnevoye opisaniye morfologii

TÜRKøYE BøLøùøM VAKFI BøLGøSAYAR BøLøMLERø VE MÜHENDøSLøöø DERGøSø (Cilt:7 - SayÕ:2) - 30