Lrec2010-Indowordnet.Pdf

Total Page:16

File Type:pdf, Size:1020Kb

Lrec2010-Indowordnet.Pdf IndoWordnet Pushpak Bhattacharyya Department of Computer Science and Engineering Indian Institute of Technology Bombay E-mail: [email protected] Abstract India is a multilingual country where machine translation and cross lingual search are highly relevant problems. These problems require large resources- like wordnets and lexicons- of high quality and coverage. Wordnets are lexical structures composed of synsets and semantic relations. Synsets are sets of synonyms. They are linked by semantic relations like hypernymy (is-a) , meronymy (part-of), troponymy (manner-of) etc. IndoWordnet is a linked structure of wordnets of major Indian languages from Indo-Aryan, Dravidian and Sino-Tibetan families. These wordnets have been created by following the expansion approach from Hindi wordnet which was made available free for research in 2006. Since then a number of Indian languages have been creating their wordnets. In this paper we discuss the methodology, coverage, important considerations and multifarious benefits of IndoWordnet. Case studies are provided for Marathi, Sanskrit, Bodo and Telugu, to bring out the basic methodology of and challenges involved in the expansion approach. The guidelines the lexicographers follow for wordnet construction are enumerated. The difference between IndoWordnet and EuroWordnet also is discussed. matrix rows represent word meanings and columns the 1. Introduction forms . For example, in Table 1, the column F2 shows Wordnets have emerged as crucial resources for Natural different meanings of bank , i.e. , the polysemy of bank , Language Processing (NLP). Wordnets are lexical while the rows M1 and M2 show different synonyms of bank . structures composed of synsets and semantic relations (Fellbaum, 1998). Synsets are sets of synonyms. They are linked by semantic relations like hypernymy (is-a) , Word Word Forms meronymy (part-of), troponymy (manner-of) etc. The first Meanings F1 F2 F3 … F k wordnet in the world was built for English at Princeton M1 depend bank Rely University 1 . Then followed wordnets for European M2 bank embankment Languages: Eurowordnet 2 (Vossen, 1998). Since 2000, M3 wordnets for a number of Indian languages are getting … bank 3 built, led by the Hindi wordnet (Narayan et. al. , 2001) Mn effort at Indian Institute of Technology Bombay 4 (IITB). Table 1: Lexical matrix showing the word bank In wordnet creation, the focus shifts from words to It is clear from the presence of other words in the same concepts. For example, सूयϕ (Sun ), पृवी (Earth ), जल , पानी row ( e.g. , depend in M1 and embankment in M2) what (Water ) etc. are very common concepts . After selecting a these meanings or senses are. This is the principle of concept, all the words standing for that concept are stored relational semantics. Words when put together in a as the set of synonymous words. common set disambiguate each other. Such sets are In what follows we first describe the general known as synsets. methodology used in wordnet construction in section 2. There are three principles the synset construction The points made therein are substantiated through a case process must adhere to. Minimality principle insists on study of Hindi and Marathi wordnets construction in capturing that minimal set of the words in the synset section 3. Section 4 is on the process details of which uniquely identifies the concept. For example IndoWordnet construction. Section 5 describes the {family, house} uniquely identifies a concept ( e.g. “he is experiences of a few Indian languages in expanding from from the house of the King of Jaipur”} . Coverage Hindi wordnet. Section 6 enumerates some guiding principle then stresses on the completion of the synset, i.e., capturing ALL the words that stand for the concept principles of IndoWordnet construction. Section 7 is on expressed by the synset ( e.g., {family, house, household, difference between IndoWordnet (IWN) and ménage} completes the synset ). Within the synset the EuroWordnet (EWN). Section 8 concludes the paper and words should be ordered according their frequency in the points to future directions. corpus. Replaceability demands that the most common words in the synset, i.e., words towards the beginning of 2. General methodology for wordnet the synset should be able to replace one another in the creation example sentence associated with the synset. The foundation of wordnet construction is relational Wordnets are constructed by following either the merge semantics (Cruse, 1986) . Words and concepts can be approach or the expansion approach (Vossen, 1998). In looked upon as forming entries in a structure called the the former- which can be said to be wordnet construction Lexical Matrix. Table 1 illustrates this. In the lexical from first principles- exhaustive sense repository of each word is first recorded. Then the lexicographers constructs 1 a synset for each sense, obeying the above three principles. http://www.wordnet.princeton.edu In the expansion approach, the synsets of the wordnet of a 2 http:// http://www.illc.uva.nl/EuroWordNet/ 3 given source language LS are provided. Each synset is http://www.cfilt.iitb.ac.in/wordnet/webhwn carefully studied for its meaning. Then the words of the 4 http://www.iitb.ac.in target language LT, representing that meaning are ‘tree’ . Hindi and Marathi being close members of the collected and put together in a set in frequency order. same language family, many Hindi words have the same meaning in Marathi. This is especially so for tatsam 2.1 Comparing merge and expansion words, which are directly borrowed from Sanskrit. The approaches to wordnet building semantic relations can be transferred directly, thus saving time and effort. Both the merge and expansion approaches have their advantages and disadvantages. In the former, there is no HWN entry : distracting influence of another language, which happens {पेड़ , वृϓ , पादप , Lुम , तď , िवटप , Đϓ , Đख , अिMप , तďवर } when the lexicographer encounters culture and region ‘tree ’ specific concepts of the source language. The quality of peR, vriksh, paadap, drum, taru, viTap, ruuksh, ruukh, the wordnet is good, provided the synset maker is well 5 adhrip, taruvar versed with the nuances of the language. But the process synset is typically slow. In the latter approach, the whole wordnet making process is well guided in the sense of जड़ , ताना , शाखा , तथा पिēयĪ से युŎ बćवषĖय वनपित following the synsets of the source language. Also it has jaR,tanaa, shaakhaa, tathaa pattiyo se yukt bahuvarshiya the advantage of being able to borrow the semantic vanaspati ‘perennial woody plant having root, stem, relations of the given wordnet. This saves an enormous branches and leaves ’ amount of time. However, the lexicographer oftentimes is Gloss distracted by synsets standing for highly culture and region specific concepts. Also common is the problem of peR manushya ke lie bahut hi upayogii hai not finding the target language’s “own concepts” . पेड़ मनुय के िलए बćत ही उपयोगी है ‘trees are very One finds the predominance of the expansion useful to men ’ approach in the wordnet building community. Many Example sentence concepts are common across languages. Creating synsets for these universal concepts should be the first step in the MWN entry : construction of any wordnet. If a language has already { झाड , वृϓ , तďवर , Lुम , तĐ , पादप } ‘tree ’ done this job, it makes sense to leverage from this work. jhaaR, vriksh, taruvar, drum, taruu, paadap This fact and the fact of being able to borrow the semantic relations from the source language tilt the balance in मुले, खोड़, फाघा , पाने इयादीनी योŎ असा वनपितिवशेष favour of the expansion approach. If the source and target mule, khoR, phaanghaa, pane ityaadiinii yokt asaa languages happen to have strong kinship relationship, the vanaspativishesh ‘perennial woody plant having root, expansion approach becomes all the more attractive, since stem, branches and leaves ’ distracting influences of culture and region specific concepts is minimal in this case. ती दमून झाडाϢया सावलीत बसली tii damuun jhaadacyaa In the next section, we present a case study to saavlit baslii ‘Being exhausted she sat under the shadow elucidate the above ideas. of the tree’ 3. A case study: creation of Hindi Figure 1: MWN synset creation from HWN wordnet (HWN) and Marathi wordnet (MWN) 3.1 Synset making We follow Chakrabarty et. al. (2007) in this section. We The principles of minimality , coverage and replaceability have, for long, been engaged in building lexical resources govern the creation of the synsets: for Indian languages with focus on Hindi and Marathi (http://www.cfilt.iitb.ac.in). The Hindi and Marathi (i) Minimality : Only the minimal set that uniquely wordnets (HWN and MWN) and the Hindi Verb identifies the meaning is first used to create the sysnet, Knowledge Base (HVKB) (Chakrabarty et. al ., 2007) e.g. , have been given special attention. The wordnets more or {ghar, kamaraa} (room) less follow the design principles of the Princeton Wordnet ghar- which is ambiguous- is not by itself sufficient to for English while paying particular attention to language denote the concept of a room. The addition of kamaraa to specific phenomena (such as complex predicates ) the synset brings out this meaning uniquely. whenever they arise. While HWN has been created by manually looking (ii) Coverage : Next, the synset should contain all the up the various listed meanings of words in different words denoting a particular meaning. The words are listed dictionaries, MWN has been created by expansion from in order of decreasing frequency of their occurrence in the HWN. That is, the synsets of HWN are adapted to MWN corpus. via addition or deletion of synonyms in the synset. {ghar, kamaraa, kaksh} (room) Figure 1 shows the creation of the synset for the word peR ‘tree’ in MWN via addition and deletion of synonyms (iii) Replaceability : The words forming the synset should from HWN.
Recommended publications
  • An Efficient Database Design for Indowordnet Development Using
    An Efficient Database Design for IndoWordNet Development Using Hybrid Approach Venkatesh Prabhu2 Shilpa Desai1 Hanumant Redkar1 N eha Prabhugaonkar1 Apurva N agvenkar1 Ramdas Karmali1 (1) GOA UNIVERSITY, Taleigao - Goa (2) THYWAY CREATIONS, Mapusa - Goa [email protected], [email protected], [email protected], [email protected], [email protected], [email protected] ABSTRACT WordNet is a crucial resource that aids in Natural Language Processing (NLP) tasks such as Machine Translation, Information Retrieval, Word Sense Disambiguation, Multi-lingual Dictionary creation, etc. The IndoWordNet is a multilingual WordNet which links WordNets of different Indian languages on a common identification number given to each concept. WordNet is designed to capture the vocabulary of a language and can be considered as a dictionary cum thesaurus and much more. WordNets for some Indian Languages are being developed using expansion approach. In this paper we have discussed the details and our experiences during the evolution of this database design while working on the Indradhanush WordNet Project. The Indradhanush WordNet Project is working on the development of WordNets for seven Indian languages. Our database design gives an efficient plan for storage of WordNet data for all languages. In addition it extends the design to hold specific concepts for a language. KEYWORDS: WordNet, IndoWordNet, synset, database design, expansion approach, semantic relation, lexical relation. Proceedings of the 3rd Workshop on South and Southeast Asian Natural Language Processing (SANLP), pages 229–236, COLING 2012, Mumbai, December 2012. 229 1 Introduction 1.1 WordNet and its storage methods WordNet (Miller, 1993) maintains the concepts in a language, relations between concepts and their ontological details.
    [Show full text]
  • Exploring Resources in Word Sense Disambiguation for Marathi Language Amit Patil1, Chhaya Patil2, Dr
    www.rspsciencehub.com Volume 02 Issue 10S October 2020 Special Issue of First International Conference on Advancements in Management, Engineering and Technology (ICAMET 2020) Exploring Resources in Word Sense Disambiguation for Marathi Language Amit Patil1, Chhaya Patil2, Dr. Rakesh Ramteke3, Dr. R. P. Bhavsar4, Dr. Hemant Darbari5 1,2 Assistant Professor, Department of Computer Application, RCPET’s IMRD, Maharashtra, India 3,4Professor, School of Computer Sciences, KBC North Maharashtra University, Maharashtra, India 5Director General, Centre for Development of Advanced Computing (C-DAC), Maharashtra, India Abstract Word Sense Disambiguation (WSD) is one of the most challenging problems in the research area of natural language processing. To find the correct sense of the word in a particular context is called Word Sense Disambiguation. As a human, we can get a correct sense of the word given in the sentence because of word knowledge of that particular natural language, but it is not an easy task for the machine to disambiguate the word. Developing any WSD system, it required sense repository and sense dictionary. It is very costly and time-consuming to build these resources. Many foreign languages have available these resources, that is why most of the foreign languages like English, German, Spanish etc lot of work is done in these Natural languages. When we look for Indian languages like Hindi, Marathi, Bengali etc. very less work is done. The reason behind this is resource-scarcity. In this paper, we majorly focus on Marathi Language Word Sense Disambiguation because of very less work is done in the Marathi Language as compared to Hindi and other Indian Languages.
    [Show full text]
  • WWDS Apis: Application Programming Interfaces for Efficient Manipulation of World Wordnet Database Structure
    Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (AAAI-16) WWDS APIs: Application Programming Interfaces for Efficient Manipulation of World WordNet Database Structure Hanumant Redkar1, Sudha Bhingardive1, Kevin Patel1, Pushpak Bhattacharyya1 Neha Prabhugaonkar2, Apurva Nagvenkar2, Ramdas Karmali2 1Indian Institute of Technology Bombay, Mumbai, India 2Goa University, Goa, India {hanumantredkar, bhingardivesudha, kevin.svnit, pushpakbh}@gmail.com {nehapgaonkar.1920, apurv.nagvenkar, ramdas.karmali}@gmail.com Abstract example, developers can potentially extract information WordNets are useful resources for natural language from other WordNets through WWDS and its APIs that is processing. Various WordNets for different languages have missing in their source WordNet. The WWDS and WWDS been developed by different groups. Recently, World APIs are explained in the following sections. WordNet Database Structure (WWDS) was proposed by Redkar et. al (2015) as a common platformm to store these different WordNets. However, it is underutilized due to lack World WordNet Database Structure of programming interface. In this paper, we present WWDS APIs, which are designed to address this shortcoming. These WWDS is an efficient storage mechanism which uses WWDS APIs, in conjunction with WWDS, act as a wrapper that enables developers to utilize WordNets without multiple databases to accommodate different WordNets. Its worrying about the underlying storage structure. The APIs design is based on IndoWordNet database structure are developed in PHP, Java, and Python, as they are the (Prabhu et al., 2012). The language independent preferred programming languages of most developers and information such as semantic relations, ontology details, researchers working in language technologies. These APIs etc. is stored in a single master database named can help in various applications like machine translation, word sense disambiguation, multilingual information wordnet_master.
    [Show full text]
  • Comparative Study on Currently Available Wordnets
    International Journal of Applied Engineering Research ISSN 0973-4562 Volume 13, Number 10 (2018) pp. 8140-8145 © Research India Publications. http://www.ripublication.com Comparative Study on Currently Available WordNets Sreedhi Deleep Kumar Reshma E U PG Scholar PG Scholar Department of Computer Science and Engineering Department of Computer Science and Engineering Vidya Academy of Science and Technology Vidya Academy of Science and Technology Thrissur, India. Thrissur, India. Sunitha C Amal Ganesh Associate Professor Assistant Professor Department of Computer Science and Engineering Department of Computer Science and Engineering Vidya Academy of Science and Technology Vidya Academy of Science and Technology Thrissur, India. Thrissur, India. Abstract SinoTibetan, Tibeto-Burman and Austro-Asiatic. The major ones are the Indo-Aryan, spoken by the northern to western WordNet is an information base which is arranged part of India and Dravidian, spoken by southern part of India. hierarchically in any language. Usually, WordNet is The Eighth Schedule of the Indian Constitution lists 22 implemented using indexed file system. Good WordNets languages, which have been referred to as scheduled available in many languages. However, Malayalam is not languages and given recognition, status and official having an efficient WordNet. WordNet differs from the encouragement. dictionaries in their organization. WordNet does not give pronunciation, derivation morphology, etymology, usage notes, A Dictionary can be called as are source dealing with the or pictorial illustrations. WordNet depicts the semantic relation individual words of a language along with its orthography, between word senses more transparently and elegantly. In this pronunciation, usage, synonyms, derivation, history, work, a general comparison of currently browsable WordNets etymology, etc.
    [Show full text]
  • Improving Semantic Similarity with Cross-Lingual Resources: a Study in Bangla—A Low Resourced Language
    informatics Article Improving Semantic Similarity with Cross-Lingual Resources: A Study in Bangla—A Low Resourced Language Rajat Pandit 1,* , Saptarshi Sengupta 2, Sudip Kumar Naskar 3, Niladri Sekhar Dash 4 and Mohini Mohan Sardar 5 1 Department of Computer Science, West Bengal State University, Kolkata 700126, India 2 Department of Computer Science, University of Minnesota Duluth, Duluth, MN 55812, USA; [email protected] 3 Department of Computer Science & Engineering , Jadavpur University, Kolkata 700032, India; [email protected] 4 Linguistic Research Unit, Indian Statistical Institute, Kolkata 700108, India; [email protected] 5 Department of Bengali, West Bengal State University, Kolkata 700126, India; [email protected] * Correspondence: [email protected] Received: 17 February 2019; Accepted: 20 April 2019; Published: 5 May 2019 Abstract: Semantic similarity is a long-standing problem in natural language processing (NLP). It is a topic of great interest as its understanding can provide a look into how human beings comprehend meaning and make associations between words. However, when this problem is looked at from the viewpoint of machine understanding, particularly for under resourced languages, it poses a different problem altogether. In this paper, semantic similarity is explored in Bangla, a less resourced language. For ameliorating the situation in such languages, the most rudimentary method (path-based) and the latest state-of-the-art method (Word2Vec) for semantic similarity calculation were augmented using cross-lingual resources in English and the results obtained are truly astonishing. In the presented paper, two semantic similarity approaches have been explored in Bangla, namely the path-based and distributional model and their cross-lingual counterparts were synthesized in light of the English WordNet and Corpora.
    [Show full text]
  • A Sentiment Analysis of Gujarati Text Using Gujarati Senti Word Net
    International Journal of Innovative Technology and Exploring Engineering (IJITEE) ISSN: 2278-3075, Volume-8 Issue-9, July 2019 A Sentiment Analysis of Gujarati Text using Gujarati Senti word Net Lata Gohil, Dharmendra Patel Abstract: Sentiment Analysis plays vital role in decision II. RELATED WORK making. For English language intensive research work is done in this area. Very less work is reported in this domain for Indian Sentiment analysis is useful method to understand opinion languages compared to English language. Gujarati language is expressed in text. “It is one of the most active research areas almost unexplored for this task. More data in form of movie in natural language processing and is also widely studied in reviews, product reviews, social media posts etc are available in data mining, web mining, and information retrieval” [7]. regional languages as people like to use their native language on Beginning research work on sentiment analysis was mostly Internet which leads to need of mining these data in order to understand their opinion. Various tools and resources are focused on English language. However increasing developed for English language and few for Indian languages. non-English language content on Internet led demand to work Gujarati is resource poor language for this task. Motive of this towards other languages. There are two approaches namely paper is to develop sentiment lexical resource for Gujarati Lexicon and Machine Learning are widely explored for language which can be used for sentiment analysis of Gujarati sentiment analysis. Large amount of annotated data is the key text. Hindi SentiWordNet (H-SWN) [1] and synonym relations of requirement of Machine learning approach.
    [Show full text]
  • S.ARULMOZI Assistant Professor Mobile: +91-9441330510 Dept
    S.ARULMOZI Assistant Professor Mobile: +91-9441330510 Dept. of Dravidian & Computational Linguistics Residence: +91-8570-278214 Dravidian University, Kuppam 517426, India Email: [email protected] EDUCATION Ph.D., Applied Linguistics, University of Hyderabad, 1999. PGDTS, Translation Studies, University of Hyderabad, 1995 (66%) M.Phil., Applied Linguistics, University of Hyderabad, 1992 (70.8%) M.A., Linguistics, Bharathiar University, 1990 (64.4%) B.Sc., Chemistry, Bharathiar University, 1988. (54.6%) H.Sc., Board of Higher Secondary Education, Tamil Nadu, 1985 (61.75%) S.S.L.C., Board of Secondary Education, Tamil Nadu, 1983 (64.5%) EMPLOYMENT Designation Department University/Institution Period Assistant Professor Department of Dravidian Dravidian University 29 Dec 2005 and Computational onwards Linguistics Guest Faculty Centre for ALTS University of Hyderabad 19 Jan 2005 to 28 Dec 2005 Member Research AU-KBC Research Centre Anna University 29 Dec 2000 to Staff 15 Jan 2005 Project Fellow Department of Linguistics Tamil University 21 Jan 1999 to 2 Jul 2000 Language Assistant- DoE Project Central Institute of Indian 8 Jun 1998 to Tamil Languages 31 Oct 1998 RESEARCH EXPERIENCE Course Topic Research Guide Year University Ph.D. Aspects of Inflectional Prof. Probal Dasgupta 1998 University of Morphophonology: A & Dr. N. Krupanandam Hyderabad Computational Approach M.Phil. Dynamics of Translation in Prof. Probal Dasgupta 1992 University of Reconstructing Sci-Tech Hyderabad Terminologies M.A. Advertisement Headlines Prof. C.Shanmugom 1990 Bharathiar University 1 ACADEMIC OUTREACH S.No. Role Topic Event Place Date 1. Resource Person BIS Tagset for Workshop on Tamil Madurai 03-03-2013 Tamil POS POS Tagging Kamaraj Tagging University 2.
    [Show full text]
  • An Online Interface for Synset Creation with Special Reference to Sanskrit
    Introduction to Synskarta: An Online Interface for Synset Creation with Special Reference to Sanskrit Hanumant Redkar, Jai Paranjape, Nilesh Joshi, Irawati Kulkarni, Malhar Kulkarni, Pushpak Bhattacharyya Center for Indian Language Technology, Indian Institute of Technology Bombay, India. [email protected], [email protected], [email protected], [email protected], [email protected], [email protected] In this paper, we have taken reference of San- Abstract skrit WordNet 3. Sanskrit is an Indo-Aryan lan- guage and is one of the ancient languages. It has WordNet is a large lexical resource express- vast literature and a rich tradition of creating ing distinct concepts in a language. Synset is léxica. The roots of all languages in the Indo Euro- a basic building block of the WordNet. In this pean family in India can be traced to Sanskrit paper, we introduce a web based lexicogra- (Kulkarni et al., 2010). Sanskrit WordNet is con- pher's interface ‘Synskarta’ which is devel- structed using expansion approach where Hindi oped to create synsets from source language to target language with special reference to WordNet is used as a source (Kulkarni et al., Sanskrit WordNet. We focus on introduction 2010). and implementation of Synskarta and how it While developing Sanskrit WordNet, lexicogra- can help to overcome the limitations of the phers create Sanskrit synsets by referring to Hindi existing system. Further, we highlight the fea- synsets and by following the three principles of tures, advantages, limitations and user evalua- synset creation (Bhattacharyya, 2010). Since San- tions of the same. Finally, we mention the skrit came into existence much before Hindi, it has scope and enhancements to the Synskarta and many words which are not present in Hindi its usefulness in the entire IndoWordNet WordNet.
    [Show full text]
  • Gujarati Language: Research Issues, Resources and Proposed Method on Word Sense Disambiguation
    International Journal of Recent Technology and Engineering (IJRTE) ISSN: 2277-3878, Volume-8, Issue-2S11, September 2019 Gujarati Language: Research Issues, Resources and Proposed Method on Word Sense Disambiguation Tarjni Vyas, Amit Ganatra B. GUJARATI GRAMMAR Abstract: Gujarati Word Sense Disambiguation (WSD) is an There are 32 consonants and 8 vowels in Gujarati language. exceptionally complex when it comes to Natural language handling because it needs to manage complexities found in a No Components Number Details language. In this paper, the discussion has put forward about 1 Consonants 32 Fig2 Guajarati language, Gujarati Wordnet and Gujarati word sense disambiguation. Accordingly, the deep learning approach is 2 Vowels 8 Fig2 found to perform better in Gujarati WSD yet one of its weakness is 3 Tenses 3 Past,Present, Future the prerequisite of enormous information sources without which 4 Vachans 2 Singular,Plural preparing is close to impossible. On the other hand, utilizes 5 Sentence Structure 3 Subject,object,Verb information sources to choose the meanings of words in a specific setting. Provided with that, deep learning approaches appear to be Sentence structure is made in the order of Subject, Object and more suitable to manage word sense disambiguation; however, the process will always be challenging given the ambiguity of Verb in Gujarati language. natural languages. There are three Tenses in Gujarati Past Tense, Present Tense Keywords: Word Sense Disambiguation, Gujarati Language, and Future Tense. There are two types of Vachans in Deep learning, Natural language processing, Lesk Gujarati.Singular and Plural. Gujarati Language includes Algorithm, Wordnet. following cases.(Table 1) I.
    [Show full text]
  • Adding a Sense-Annotated Telugu Lexicon
    Enrichment of OntoSenseNet: Adding a Sense-annotated Telugu lexicon Sreekavitha Parupalli and Navjyoti Singh Center for Exact Humanities (CEH) International Institute of Information Technology, Hyderabad, India [email protected] [email protected] Abstract The paper describes the enrichment of OntoSenseNet- a verb- centric lexical resource for Indian Languages. This resource contains a newly developed Telugu-Telugu dictionary. It is important because na- tive speakers can better annotate the senses when both the word and its meaning are in Telugu. Hence efforts are made to develop a soft copy of Telugu dictionary. Our resource also has manually annotated gold standard corpus consisting 8483 verbs, 253 adverbs and 1673 adjectives. Annotations are done by native speakers according to defined annotation guidelines. In this paper, we provide an overview of the annotation proce- dure and present the validation of our resource through inter-annotator agreement. Concepts of sense-class and sense-type are discussed. Addi- tionally, we discuss the potential of lexical sense-annotated corpora in improving word sense disambiguation (WSD) tasks. Telugu WordNet is crowd-sourced for annotation of individual words in synsets and is compared with the developed sense-annotated lexicon (OntoSenseNet) to examine the improvement. Also, we present a special categorization (spatio-temporal classification) of adjectives. 1 Introduction Lexically rich resources form the foundation of all natural language processing (NLP) tasks. Maintaining the quality of resources is thus a high priority issue [5]. Hence, it is important to enhance and maintain the lexical resources of any language. This is of significantly more importance in case of resource poor languages like Telugu [19].
    [Show full text]
  • Indowordnet and Its Linking with Ontology
    IndoWordNet and its Linking with Ontology Brijesh Bhatt Pushpak Bhattacharyya Center For Indian Language Technology, Center For Indian Language Technology, Department of Computer Science and Engineering, Department of Computer Science and Engineering, Indian Institute of Technology, Mumbai Indian Institute of Technology, Mumbai [email protected] [email protected] Abstract hierarchical structure of concepts related by sub- sumption relation, which can be shared between Reasoning about natural language requires applications. Though WordNet is often considered combining semantically rich lexical re- as an ontology (the synset corresponds to concept sources with world knowledge, provided and ‘hypernymy-hyponymy’ relation is similar to by ontologies. In this paper, we describe subsumption), it is a language specific resource linking of WordNets of Indian languages which may vary from language to language. The with an upper ontology SUMO (Sug- ontological issues in WordNet discussed in (pease gested Upper Merged Ontology). This and Fellbaum, 2010; Gangemi et al., 2003; Niles creates multilingual resource for Indian and Pease, 2003) are as follows, languages which can be used in various natural language processing applications. This paper presents the architecture of 1. Confusion between concept and individual: IndoWordNet- Linking of WordNets of WordNet synsets do not distinguish between seventeen different Indian languages and concept and individual. For example, both provides a method to link it with upper on- ‘Martial Art’ and ‘Karate’ are considered as tology SUMO. Two different systems: In- concept. doWordNet navigator and SIGMAKEE in- terface for Indian languages are developed 2. Confusion between object level and meta to access this resource. level concept: WordNet covers both object level and meta level concepts as hyponymy 1 Introduction of same concept.
    [Show full text]
  • Development of Assamese Wordnet
    Development of Assamese WordNet Iftikar Hussain, Navanath Saharia and Utpal Sharma Department of Computer Science & Engineering Tezpur University, Napaam, India-784028 [email protected], [email protected], [email protected] Abstract. An important challenge in the task of semantic analysis is the fact that in natural languages several words may denote the same concept, and a single word form may denote different concepts. WordNet is a repository of information about such characteristics of words, in a readily accessible format. A WordNet may be developed for a language for which computational processing is attempted. It calls for efforts in the domain of linguistics as well as computer science. In this paper we describe our works towards the development of WordNet for Assamese language, an official language of India. We cover proposed formats for the WordNet database text files and also an Application Programming Interface (API) of the Assamese WordNet. 1 Introduction One of the main challenges in Natural Language Processing (NLP) is determining the appropriate sense of each word that occurs in input expressions. Words in natural languages often have multiple senses, and often several distinct words denote the same sense. WordNet helps to overcome such challenges. WordNet is a database that consists of words or collocations. Words having similar senses are grouped together and the groups are interconnected through some lexical and semantic relations. Users or their applications can make queries on it and can find out appropriate senses of words distinctly. Assamese is one of the 22 official languages in India, spoken by nearly 30 million people.
    [Show full text]