DOCSLIB.ORG

A Perspective from Computation in Presence of Ambiguity, Resource Constraint and Multilinguality

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
A Perspective from Computation in Presence of Ambiguity, Resource Constraint and Multilinguality Pushpak Bhattacharyya 1 : 3 Natural Language Processing: A Perspective from Computation in Presence of Ambiguity, Resource Constraint and Multilinguality Pushpak Bhattacharyya Professor of Computer Science and Engineering at IIT Bombay Language is a hallmark of intelligence, and endowing computers with the ability to analyze and generate language- a field of research known as Natural Language Processing (NLP)- has been the dream of Artificial Intelligence (AI). In this paper we give a perspective of NLP from the point of view of ambiguity processing and computing under resource constraint. Language is fraught with ambiguity at all levels, be they morphemes, words, phrases, sentences or paragraphs. We first discuss these ambiguities with examples. Then we take a particular case of disambiguation- word sense disambiguation (WSD)- and discuss its solution in the face of multilinguality and resource constraint, namely, scarcity of annotated data. Multilinguality is one of the powerful instruments of leveraging shared resource. Index Terms — Ambiguity, Annotated Data, Multilingual Computation, Wordnets, Word Sense Disambiguation I. Introduction NATURAL language processing is the task of analyzing and generating by computers, languages that humans speak, Problem read and write [1][2][3].NLP is concerned with questions involving three dimensions: language, algorithm and problem. Semantics NLP Figure 1 expresses this point. On the language axis are different Trinity natural languages and linguistics. The problem axis mentions Parsing different NLP tasks like morphology, part of speech tagging etc. The algorithm axis depicts mechanisms like HMM, MEMM, Part of Speech CRF etc. for solving problems. Tagging The goal of natural language analysis is to produce Morph knowledge representation structures like predicate calculus Analysis Marathi French expressions, semantic graphs or frames [4]. This processing makes use of foundational tasks like morphology analysis, Part HMM of Speech Tagging, Named Entity Recognition, both shallow and Hindi English Language deep Parsing, Semantics Extraction, Pragmatics and Discourse CRF Processing. The example below illustrates these tasks: MEMM Example 1 : Conversation between a mother and her son: Mother: Son, get up quickly. The school is open today. Should you Algorithm bunk? Father will be angry. Father John complained to your father yesterday. Aren’t you afraid of the principal? Fig. 1 : Three dimensions of NLP Son: Mummy, it’s a holiday today! Processing of the above text involves the following: meanings of get and up cannot be composed to decipher 1. Son in the first sentence has ambiguity of sense. Wordnet the meaning. The combination is a phrasal verb, also called, 2.1 [5] records two senses of son: male offspring (the multiword [6]. commonly occurring meaning) and Son of God, i.e., Jesus. 3. As a unit, Get up is ambiguous, meaning to wake up or to The first sense applies here. rise. Finally note that in get up the ladder the combination is 2. Get up is non compositional in the sense that individual not a phrasal verb. CSI Journal of Computing | Vol. 1 • No. 2, 2012 Natural Language Processing: A Perspective from Computation in Presence of 1 : 4 Ambiguity, Resource Constraint and Multilinguality 4. Open is ambiguous, firstly with respect to part of speech be male or female (English does not mark gender on the (POS), i.e., noun, verb, adjective or adverb. Here open is an verb); the number could be both singular and plural (I/ adjective, and wordnet records 21 senses of adjective open. We, he/they). Linguistically speaking, English displays high The 21st sense: open -- (ready for business; “the stores are syncretism, i.e., overloading of morphological forms. Hence, open”) applies here. even at the level of words, ambiguity needs to be dealt with. 5. Should you bunk? is a sentence with ellipsis [7], i.e., gap or In what follows, in section II we give an account of the omission which needs to be filled with text from an earlier traditionally accepted view of stages of NLP and the sentences. Bunk what? Bunk the school. Additionally, Bunk associated ambiguities. In section III, we describe a is ambiguous with respect to both POS and sense. particular kind of ambiguity - the ambiguity of word sense 6. There are three mentions of father. The first father is most and its solution in a multilingual resource constrained likely the boy’s father. This is a matter involving pragmatics. setting. This section also mentions India’s large scale The ambiguity here needs to be resolved with situation activity on multilingual wordnet development, the specific information, speaker intent etc. Understanding why Indowordnet project. Section IV concludes the paper and father will be angry is a complex inferencing process (not points to future directions. studying leading to bleak future etc.). II. Stages of NLP and associated ambiguities 7. The second father is an appellation to John who most likely is the principal of the school (again a pragmatics question). Traditionally, NLP - of both spoken and written language- The three words father, John and Principal refer to the same has been regarded as consisting of the following stages: individual. This is the case of co-reference disambiguation. a. Phonology and Phonetics (processing of sound) Pronoun to noun binding is a classic case of coreference b. Morphology (processing of word forms) resolution and is commonly known as anaphora resolution c. Lexicon (Storage of words and associated knowledge) [8]. For example, in the sentence the dog went near the d. Parsing (Processing of structure) cat, and it bit it, it is not clear who bit whom. When the e. Semantics (Processing of meaning) reference to an entity is in the forward direction, instead of the more common backward direction, e.g. in that he will f. Pragmatics (Processing of user intention, modeling etc.) win was clear to Sam, where he is forward bound to Sam, the g. Discourse (Processing of connected text) binding is called cataphora. We describe each stage and the associated ambiguity. 8. John in the text is a proper noun. It is important to detect A. Phonology and Phonetics proper nouns in NLP- a problem known as Named Entity At this stage utterances are processed. Apart from many Recognition (NER) [9]. In English the NER problem is to challenges due to noise, two common problems are homophony an extent ameliorated, since proper nouns are capitalized. and word boundary recognition. In German where all nouns are in capital and in Indian languages where there is no capitalization, separating Homophony arises when two words sound the same, proper nouns from common nouns is a non-trivial task. An though their meanings are widely different, e.g., bank example of this from Hindi is given below: (embankment of a water body) and bank (an institution where financial transactions are held). Homophony, it is surmised, Example 2: originates in borrowing and adapting of words from a foreign पूजा ने पूजा के िलए फूल तोड़ा language (e.g.,bank in the financial sense in English came from puujaa ne puujaa ke liye phuul todaa banque in German). puujaa_ERG worship_for flowers plucked Near homophony is more common and causes difficulty, Puujaa plucked flowers for worship especially in rapid speech. e.g. fox and folks. We normally do not falter in understanding, because syntactic clues, context and 9. Here the first puujaa is the name of a girl and the second world knowledge comes to the rescue. puujaa means worship. Translating this as worship plucked Word boundary detection, similarly, is a challenge in case flowers for worshipis strange, though puujaa plucked flowers of rapid speech. Consider the following example in Hindi: for puujaa is passable. 10. This is not to say that NER is easy in English. In Washington Example 3: voted Washington to power, first Washington is the capital of आजायेंगे USA (place name), while the second is George Washington, ( will come today or will come) the first President of USA (person name). Person-place- आज आयेंगे आ जायेंगे organization ambiguity in NER is typical in languages. aajaayenge 11. Finally, there are problems of sentencification, tokenization (aaj aayenge or aa jaayenge) and morphology in any NLP task. These basic tasks too are not free of ambiguity. For example, the verb group will be The string can be broken in two ways as shown above with going is indeterminate with respect to the grammatical two completely different meanings. features of Gender, Number and Person (GNP). The goer A similar example in English is I got up late vs. I got a plate, could be in 1st/2nd/3rd person (I, you, he); the gender could both of which sound very much the same. CSI Journal of Computing | Vol. 1 • No. 2, 2012 Pushpak Bhattacharyya 1 : 5 B. Morphology falling of tree and falling of a kingdom. Words form from root words or lexemes through Word sense or lexical disambiguation refers to the processes of inflexion, derivation, back formation, clitics and identification of the meaning of an ambiguous word from clues portmanteauing [7]. Languages differ in their morphological in the context. For example, in I will withdraw some money from richness. Dravidian languages, Turkish, Hungarian and Slavic the bank, the most likely sense of bank is the financial institution languages are examples of morphologically rich languages. sense. The senses typically come from a sense repository like Chinese and English are examples of relatively simpler the wordnet [5]. morphology. The predominant approach in WSD is supervised learning, The main ambiguity at the level of morphology arises from where a machine is trained with sense annotated corpora choices available in breaking the word into stem and suffix [10] [11]. But sense annotated corpora are a costly resource. as well as from choices of features. Here is an example from Our research shows that we can leverage multilinguality and Marathi: multilingual linked wordnets to reduce demand on annotated corpora.
Load more

Recommended publications
  • PRASHANT KUMAR SHARMA 173059007 Computer Science & Engineering M.Tech
    PRASHANT KUMAR SHARMA 173059007 Computer Science & Engineering M.Tech. Indian Institute of Technology Bombay Male Specialization: Computer Science and Engineering DOB: 24/12/1993 Examination University Institute Year CPI / % Post Graduation IIT Bombay IIT Bombay 2020 7.53 Undergraduate Specialization : Computer Science and Engineering Dr. A.P.J. Abdul Kalam Technical Kamla Nehru Institute of Technology, Graduation University Sultanpur 2016 84.02 Intermediate/+2 CBSE Kendriya Vidyalaya AFS Gorakhpur 2011 83.40 Matriculation CBSE Kendriya Vidyalaya AFS Gorakhpur 2009 90.80 FIELDS OF INTEREST • Machine Learning, Deep Learning, Natural Language Processing, Computer Vision, Reinforcement Learning M.TECH THESIS AND SEMINAR • Explainable Artificial Intelligence (M.Tech Project) Guide: Prof. Pushpak Bhattacharyya | Industry Collaborator: IBM (May’19 - Present) ◦ Product Objective : To develop an explainability framework which takes a trained deep learning model as input and interprets it with state-of-the-art methods like Integrated Gradients and LIME algorithm. This framework will be distributed as a python package, which can be used either as a command-line tool or as a web service. ◦ Research Objective : To develop a model to capture causal relationships in natural languages, and differentiate between causal and correlated factors using knowledge graphs and deep learning techniques. • Explainable Artificial Intelligence (M.Tech Seminar) Guide: Prof. Pushpak Bhattacharyya | Industry Collaborator: IBM (Sprint’19) ◦ Objective: : Conducted extensive research literature survey of explainability of deep neural networks: Need, Scope, Challenges and state-of-the-art methods. ◦ Involved comprehensive study of explainability of deep neural network representation, output and algorithms for explainability: Sensitivity Analysis, Layer-wise Relevance Propagation, LIME, Integrated Gradients, Influence Functions, Sanity Checks for Saliency maps, Attention mechanism, Semantically Equivalent Rules.
    [Show full text]
  • IITK Chronicle IITK Newsletter || Volume 2 Issue 2, April 2018 Highlights from the Director’S Desk
    Indian Institute of Technology Kanpur IITK Chronicle IITK Newsletter || Volume 2 Issue 2, April 2018 Highlights From the Director’s Desk e are once again at the end of another academic session and in the last two months, we have Prof. Abhay Karandikar, Department of successfully organized some of the most awaited annual events of our campus. Techkriti, our Electrical Engineering, IIT Bombay annual technological fest, saw record participation and the Institute Flower Show had the entire appointed as the Director, IIT Kanpur. W campus coming together for a fun show and fete. The institute's Women's Cell also organized great initiatives in the past month for gender sensitization. With Prof. Monika Katiyar appointed Head of these events, IIT Kanpur strives to set an example for a zero-tolerance policy towards sexual harassment on the Department of Materials Science & campus. Several of our faculty members have won notable awards and recognitions and the SIDBI Engineering. Innovation and Incubation Centre won the Platinum Award under the "Smart Incubator of the Year" category by India Smart Grid Forum. Prof. Amalendu Chandra appointed Head of the Department of Chemistry. For the coming months, we have many exciting things in the pipeline – the start of the new academic session and the Convocation always create a special buzz on campus. But most of all, we look forward to welcoming our new Director, Prof. Abhay Karandikar, and working with him to take IIT Kanpur to greater heights. New Colleagues Prof. Manindra Agrawal Officiating Director, Prof. Subrahmanyam Saderla IIT Kanpur Aerospace Engineering Prof. Ankush Sharma In Focus Electrical Engineering Techkriti 2018 Prof.
    [Show full text]
  • Word Sense Disambiguation Using Indowordnet
    Word Sense Disambiguation Using IndoWordNet Sudha Bhingardive Department of Computer Science and Engineering, Indian Institute of Technology-Bombay, Powai, Mumbai, India. Email: [email protected] Pushpak Bhattacharyya Department of Computer Science and Engineering, Indian Institute of Technology-Bombay, Powai, Mumbai, India. Email: [email protected] Abstract Word Sense Disambiguation (WSD) is considered as one of the toughest problem in the field of Natural Language Processing. IndoWordNet is a linked structure of WordNets of major Indian languages. Recently, several IndoWordNet based WSD approaches have been proposed and implemented for Indian languages. In this chapter, we present the usage of various other features of IndoWordNet in performing WSD. Here, we have used features like linked WordNets, semantic and lexical relations, etc. We have followed two unsupervised approaches, viz., (1) use of IndoWordNet in bilingual WSD for finding the sense distribution with the help of Expectation Maximization algorithm, (2) use of IndoWordNet in WSD for finding the most frequent sense using word and sense embeddings. Both these approaches justifies the importance of IndoWordNet for word sense disambiguation for Indian languages, as the results are found to be promising and can beat the baselines. Keywords: IndoWordNet, WordNet, Word Sense Disambiguation, WSD, Bilingual WSD, Unsupervised WSD, Most Frequent Sense, MFS 1. Introduction 1.1. What is Word Sense Disambiguation? Word Sense Disambiguation or WSD is the task of identifying the correct meaning of a word in a given context. The necessary condition for a word to be disambiguated is that it should have multiple senses. Generally, in order to disambiguate a given word, we should have a context in which the word has been used and knowledge about the word, otherwise it becomes difficult to get the exact meaning of a word.
    [Show full text]
  • ANNUAL REPORT 2019-20 IIT Bombay Annual Report 2019-20 Content
    IIT BOMBAY ANNUAL REPORT 2019-20 IIT BOMBAY ANNUAL REPORT 2019-20 Content 1) Director’s Report 05 2) Academic Programmes 07 3) Research and Development Activities 09 4) Outreach Programmes 26 5) Faculty Achievements and Recognitions 27 6) Student Activities 31 7) Placement 55 8) Society For Innovation And Entrepreneurship 69 9) IIT Bombay Research Park Foundation 71 10) International Relations 73 11) Alumni And Corporate Relations 84 12) Institute Events 90 13) Facilities 99 a) Infrastructure Development b) Central Library c) Computer Centre d) Centre For Distance Engineering Education Programme 14) Departments/ Centres/ Schools and Interdisciplinary Groups 107 15) Publications 140 16) Organization 141 17) Summary of Accounts 152 Director's Report By Prof. Subhasis Chaudhuri, Director, IIT Bombay Indian Institute of Technology Bombay acknowledged for their research contributions. (IIT Bombay) has a rich tradition of pursuing We have also been able to further our links with excellence and has continually re-invented international and national peer universities, itself in terms of academic programmes and enabling us to enhance research and educational research infrastructure. Students are exposed programmes at the Institute. to challenging, research-based academics and IIT Bombay continues to make forays into a host of sport, cultural and organizational newer territories pertinent to undergraduate activities on its vibrant campus. The presence and postgraduate education. At postgraduate of world-class research facilities, vigorous level, a specially designed MA+PhD dual institute-industry collaborations, international degree programme in Philosophy under the exchange programmes, interdisciplinary HSS department has been introduced. IDC, the research collaborations and industrial training Industrial Design Centre, celebrated 50 years opportunities help the students of IIT Bombay to of its golden existence earlier this year.
    [Show full text]
  • 1 Practical Training Cell, IIT Bombay
    Practical Training Cell, IIT Bombay 1 Director’s Message Prof. Devang Khakkar Director IIT Bombay IIT Bombay has proved to be the most pre- ferred destination for aspiring technologists from across the country. The institute con- sistently attracts the finest faculty and the best of students for its Bachelors, Masters and Doctoral Programs. IIT Bombay has a rich tradition of pursuing excellence and has con- tinually re-invented itself in terms of academic programs and research infrastructure. The presence of world class research facili- ties, institute industry collaborations, inter- national exchange programs, interdisciplinary research collaborations and industrial train- ing opportunities help the students of IIT Bombay to excel and be ahead in the com- petitive professional environment. We highly value our partnership with recruiters, alumni and friends of IIT Bombay and remain com- mitted to making your recruiting experience productive and positive. I invite recruiting or- ganizations and graduation students to find best match between their need and capabili- ties. Wish you all the best. 2 Practical Training Cell, IIT Bombay Dean’s Message Prof. Shiva Prasad Dean Academic Program IIT Bombay IIT Bombay offers perhaps the most flexible engineering curricula in the country to its students. The diverse skill of the student pop- ulation and the extensive theoretical knowl- edge they have will definately make them as assest to any organisation. At IIT Bombay, we believe that Practical Training or Internship is an integral portion of a student’s overall de- velopment and we encourage students to take up projects in industry and academia so that they can be better prepared for their future careers.
    [Show full text]
  • Visit to Stanford: a Report Dr
    Visit to Stanford: a Report Dr. Pushpak Bhattacharyya, Professor, Department of Computer Science and Engineering, IIT Bombay. [email protected] This summer (May-July, 2004), I visited Stanford University and other research organizations. Given below is a report of this visit. The description is divided into 7 parts: A. Visit to Stanford University. B. One day visit to Microsoft Research, Seattle. C. One day Visit to the Development Gateway Foundation, World Bank, Washington DC. D. One day visit to Honda Research Institute, Sunnyvale, California. E. Titles and Abstracts of talks delivered. F. Conclusions. G. The home page of the Stanford Natural Language Processing Group A. Stanford University The host institution for the visit was Stanford University. The objective of the visit was to set up collaborative research in Natural Language Processing and related areas between the research groups of IIT Bombay and Stanford University. The facts pertaining to this visit are as under: 1. Visitor: Dr. Pushpak Bhattacharyya, Professor, Computer Science and Engineering Department, Indian Institute of Technology, Bombay, India. 2. Place of Visit: Computer Science Department, Stanford University. 3. Duration: May-July, 2004. 4. Host and Principal Collaborator: Prof. Christopher Manning, Computer Science Department, Stanford University. 5. Research Group: Natural Language Processing Group of Prof. Manning. 6. Research group members interacted with (topics in parentheses): a) Roger Levy ("Probabilistic Parsing", "Psycholinguistic Experiments on Hindi Clauses"). b) Dan Klein ("Lexicalized and Unlexicalized Parsing"). c) Kristina Toutanova ("Word Dependencies", "PP Attachement"). d) Galen Andrews ("Implementation and Installantion of Stanford Parsers"). e) Teg Grenagar ("Probabilistic Context Free Grammar"). f) Iddo Lev ("Universal Networking Language", "Logic Puzzles").
    [Show full text]
  • 09.14-Bhattacharyya.Pdf
    Department of Computer Science University of Houston DISTINGUISHED LECTURER SEMINAR 2012 WHEN: FRIDAY, SEPTEMBER 14, 2012 WHERE: PGH 232 TIME: 3:00 PM SPEAKER: Dr. Pushpak Bhattacharyya, IIT Bombay Host: Dr. Ioannis Kakadiaris TITLE: Word Sense Disambiguation- a Multilingual Resource Conscious Perspective Abstract: Word Sense Disambiguation (WSD) is a fundamental problem in Natural Language Processing (NLP). Amongst various approaches to WSD, it is the supervised machine learning (ML) based approach that is the dominant paradigm today. However, ML based techniques need significant amount of resource in terms of sense annotated corpora which takes time, energy and manpower to create. Not all languages have this resource, and many of the languages cannot afford it. We discuss ways of doing WSD under resource constraint. We describe a novel scoring function and an iterative algorithm based on this function to do WSD. This function separates the influence of the annotated corpus (corpus parameters) from the influence of wordnet (wordnet parameters), in deciding the sense. Next we describe how the corpus of one language can help WSD of another language, i.e., LANGUAGE ADAPTATION. This is presented in three setting of "complete", "some" and "no" annotation. The talk is presented in a multilingual setting of Indian languages. The presentation is based on work done with PhD and Masters students and researchers: Rajat, Mitesh, Salil, Saurabh, Anup, Sapan and Piyush, and published in fora like ACL, COLING, EMNLP, GWC, ICON and so on. BIO: Dr. Pushpak Bhattacharyya is a Professor of Computer Science and Engineering at IIT Bombay. He received his B.Tech from IIT Kharagpur, M.Tech from IIT Kanpur and PhD from IIT Bombay.
    [Show full text]
  • Leveraging Cognitive Features for Sentiment Analysis
    Leveraging Cognitive Features for Sentiment Analysis Abhijit Mishray, Diptesh Kanojiay,|, Seema Nagar ?, Kuntal Dey?, Pushpak Bhattacharyyay yIndian Institute of Technology Bombay, India |IITB-Monash Research Academy, India ?IBM Research, India yfabhijitmishra, diptesh, [email protected] ?fsenagar3, [email protected] Abstract e.g., finding appropriate senses of a word given the context (e.g., His face fell when he was dropped Sentiments expressed in user-generated from the team vs The boy fell from the bicycle, short text and sentences are nuanced by where the verb “fell” has to be disambiguated) (3) subtleties at lexical, syntactic, semantic Domain Dependency, tackling words that change and pragmatic levels. To address this, polarity across domains. (e.g., the word unpre- we propose to augment traditional features dictable being positive in case of unpredictable used for sentiment analysis and sarcasm movie in movie domain and negative in case of un- detection, with cognitive features derived predictable steering in car domain). Several meth- from the eye-movement patterns of read- ods have been proposed to address the different ers. Statistical classification using our en- lexical level difficulties by - (a) using WordNet hanced feature set improves the perfor- synsets and word cluster information to tackle lex- mance (F-score) of polarity detection by ical ambiguity and data sparsity (Akkaya et al., a maximum of 3:7% and 9:3% on two 2009; Balamurali et al., 2011; Go et al., 2009; datasets, over the systems that use only Maas et al., 2011; Popat et al., 2013; Saif et al., traditional features. We perform feature 2012) and (b) mining domain dependent words significance analysis, and experiment on (Sharma and Bhattacharyya, 2013; Wiebe and Mi- a held-out dataset, showing that cognitive halcea, 2006).
    [Show full text]
  • Word Sense Disambiguation Algorithms in Hindi
    Word Sense Disambiguation Algorithms in Hindi Drishti Wali (13266) Nirbhay Modhe (13444) Department of Computer Science and Engineering, IIT Kanpur April 18, 2015 Abstract Word sense disambiguation (WSD) is the task of automatic identification of the sense of a polysemous word in a given context. Quite a lot of work has been done for WSD in English, inspired mainly by the Senseval and SemEval tasks. In this project we use the model of word representation stated in the paper by Chen, Liu and Sun3 for a Hindi corpus. This model represents the context and each sense of the target word as a vector in a high dimensional space and measures their similarity. The most similar sense is the chosen as the correct sense of the target word in the given context. 1 Contents 1 Motivation3 2 Resources and Corpus3 2.1 Hindi Wordnet..........................3 2.2 Hindi Corpus...........................3 3 Methodology3 3.1 Word2vec : Skip-Gram Model..................4 3.2 Sense and Context Representation...............4 3.3 Similarity using Cosine Distance................4 4 Results5 4.1 Threshold Analysis........................5 4.2 Example Cases..........................5 4.3 Insights..............................6 5 Future Work6 6 Conclusion6 2 1 Motivation Word sense disambiguation has lot of applications in improving search en- gines, machine translation, resolution of Anaphora etc. The first work in Hindi word sense disambiguation was done by Pushpak Bhattacharyya in 2004.8 Following this paper other works using bilingual methods and graph based approaches have been researched. The dearth of resources in Hindi has prevented the successful application of supervised algorithms in Hindi.
    [Show full text]
  • Machine Learning for Machine Translation
    Machine Learning for Machine Translation Pushpak Bhattacharyya CSE Dept., IIT Bombay ISI Kolkata, Jan 6, 2014 Jan 6, 2014 ISI Kolkata, ML for MT 1 NLP Trinity Problem Semantics NLP Trinity Parsing Part of Speech Tagging Morph Analysis Marathi French HMM Hindi English Language CRF MEMM Algorithm Jan 6, 2014 ISI Kolkata, ML for MT 2 NLP Layer Discourse and Corefernce Increased Semantics Extraction Complexity Of Processing Parsing Chunking POS tagging Morphology Jan 6, 2014 ISI Kolkata, ML for MT 3 Motivation for MT MT: NLP Complete NLP: AI complete AI: CS complete How will the world be different when the language barrier disappears? Volume of text required to be translated currently exceeds translators’ capacity (demand > supply). Solution: automation Jan 6, 2014 ISI Kolkata, ML for MT 4 Taxonomy of MT systems MT Approaches Data driven; Knowledge Machine Based; Learning Rule Based MT Based Example Based Statistical MT Interlingua Based Transfer Based MT (EBMT) Jan 6, 2014 ISI Kolkata, ML for MT 5 Why is MT difficult? Language divergence Jan 6, 2014 ISI Kolkata, ML for MT 6 Why is MT difficult: Language Divergence One of the main complexities of MT: Language Divergence Languages have different ways of expressing meaning Lexico-Semantic Divergence Structural Divergence Our work on English-IL Language Divergence with illustrations from Hindi (Dave, Parikh, Bhattacharyya, Journal of MT, 2002) Jan 6, 2014 ISI Kolkata, ML for MT 7 Languages differ in expressing thoughts: Agglutination Finnish: “istahtaisinkohan” English: "I wonder if
    [Show full text]
  • Webinar on 27 April by Prof Pushapak Bhattacharya: "Recent Trends in Chatbot : a Sentiment Perspective "
    Webinar on 27 April by Prof Pushapak Bhattacharya: "Recent trends in Chatbot : a sentiment perspective " Register for the session of Webinar on, " Recent trends in Chatbot : a sentiment perspective", to be presented on Monday 27 April 2020 at 11:00-12:30 IST on the behalf of Computer Science and Engineering Department, MNIT, Jaipur by Prof. Pushapak Bhattacharya, FNAE, Abdul Kalam Fellow, Director, IIT Patna. Note : You can also stream this webinar on your mobile device, including smartphone and tablet. The registration link is given below: Meeting link: Meeting link: https://mnitjaipur.webex.com/mnitjaipur/j.php?MTID=md357eba5d573704803a8791908555bef Meeting number: 580 162 228 Password: Chatbot Join by phone +91-11-6480-0114 India Toll (Delhi) +91-22-6480-0114 India Toll (Mumbai) Access code: 580 162 228 Abstract: The talk suggest how sentiment and emotion analysis is gaining increasing importance in dialogue systems whose practical applications are in the form of chatbots. The talk starts with a description involving the foundations of sentiment and emotion analysis and will proceed by explaining how to incorporate sentiments and emotions in these chatbots. Duration : 1.5 hours (including audience Q&A) Presenter Prof. Pushpak Bhattacharyya is a computer scientist and a Professor at Computer Science and Engineering Department, IIT Bombay. Currently, he is also the Director of Indian Institute of Technology Patna. Prof. Pushpak Bhattacharyya has completed his undergraduate studies from IIT Kharagpur (B. Tech.) and Masters from IIT Kanpur (M.Tech). He finished his Ph.D. from IIT Bombay in 1994. He is a past President of Association for Computational Linguistics (2016- 17), and Ex-Vijay and Sita Vashee Chair Professor.
    [Show full text]
  • Summer Workshop on Ontology, NLP, Personalization and IE/IR Inaugural
    Summer Workshop on Ontology, NLP, Personalization and IE/IR IIT Bombay conducted a Summer Workshop on Ontology, NLP, Personalization and IE/IR sponsored by HP Labs, Bangalore on 16-18th July, 2008. The workshop faculty consisted of renowned experts in their respective fields. The participants were students and faculty of academic institutions from all corners of the country and also researchers from top search engine and NLP industries like Yahoo, Rediff, IBM and MSR. 130 participants were selected from approximately 400 applicants from all over India with the following distribution: Students: 70 Faculty from academic institutes: 23 Professionals: 37 The Workshop addressed the cutting edge technology areas of: 1. Ontology (hierarchical knowledge organization) 2. Bridge between text and Ontology 3. Semantic Relation Extraction. 4. Mathematical aspects of Information Retrieval. 5. Graphical Models. 6. Web Corpora Processing. 7. Sentiment Analysis. 8. Cross-Lingual Search. 9. Summarization Inaugural Session The workshop was inaugurated with an invocation to Goddess Saraswati sung by Mr. Abhisekh Sankaran, a PhD student of the CSE, Depatrent, IIT Bombay. During the inaugural, Prof. Pushpak Bhattacharyya- workshop chair- introduced the workshop by underlining the importance and the relevance of the event in the context of the multilingual web. Prof. Vasi- Deputy Director IIT Bombay- mentioned that IIT Bombay was celebrating its golden jubilee this year, and a number of important events including lectures by Nobel Laureates were taking place in the institute. Prof. Ramamritham- Dean R & D, IIT Bombay- underlined the importance of doing interdisciplinary research in today’s world which sees immense growth and complexity of knowledge. Dr.
    [Show full text]