DOCSLIB.ORG

Termsuite: Terminology Extraction with Term Variant Detection

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Termsuite: Terminology Extraction with Term Variant Detection TermSuite: Terminology Extraction with Term Variant Detection Damien Cram Beatrice´ Daille LINA - UMR CNRS 6241 LINA - UMR CNRS 6241 Universite´ de Nantes, France Universite´ de Nantes, France [email protected] [email protected] Abstract This last question has always been a pain in the neck for TET. We introduce, TermSuite, a JAVA and The current generation of TET improves on var- UIMA-based toolkit to build terminolo- ious aspects. As an example, TermoStat1 deals gies from corpora. TermSuite follows with several Romance languages, reaches to treat the classic two steps of terminology ex- text up to 30 megabytes, and proposes a first traction tools, the identification of term structuring based on lexical inclusion. Term- candidates and their ranking, but imple- Suite goes a step forward: it is multilingually ments new features. It is multilingually designed, scalable, and handles term variants. It designed, scalable, and handles term vari- is able to perform term extraction from languages ants. We focus on the main compo- that behave differently from the linguistic point of nents: UIMA Tokens Regex for defining view. Complex terms in languages such as Ger- term and variant patterns over word anno- man and Russian are mostly compounds, while in tations, and the grouping component for Roman languages they are MWT. TermSuite clustering terms and variants that works extracts single terms and any kind of complex both at morphological and syntactic levels. terms. For some generic domains and some ap- plications, large amounts of data have to be pro- 1 Introduction cessed. TermSuite is scalable and has been applied to corpora of 1.1 gigabytes using a per- Terminologies play a central role in any NLP ap- sonal computer configuration. Finally, Term- plications such as information retrieval, informa- Suite identifies a broad range of term variants, tion extraction, or ontology acquisition. A ter- from spelling to syntactic variants that may be minology is a coherent set of terms that consti- used to structure the extracted terminology with tutes the vocabulary of a domain. It also reflects various conceptual relations. the conceptual system of that domain. A term Since the first TermSuite release (Rocheteau could be a single term (SWT), such as rotor, or and Daille, 2011), several enhancements about a complex term. Complex terms are either com- TET have been made. We developed UIMA To- pounds such as broadband, or multi-word terms kens Regex, a tool to define term and variant pat- (MWT) such as frequency band. Terms are func- terns using word annotations within the UIMA tional classes of lexical items used in discourse, framework (Ferrucci and Lally, 2004) and a group- and as such they are subjected to linguistic varia- ing tool to cluster terms and variants. Both tools tions such as modification or coordination. are designed to treat in an uniform way all linguis- As specialized domains are poorly covered by tic kinds of complex terms. general dictionaries, Term Extraction Tools (TET) After a brief reminder of TermSuite gene- that extract terminology from corpora have been ral architecture, we present its term spotting tool developed since the early nineties. This first gen- UIMA Tokens Regex, its variant grouping tool, eration of TET (Cabre´ et al., 2001) was mono- and the variant specifications we design for En- lingually designed, not scalable, and they were glish, French, Spanish, German, and Russian. Fi- not handling term variants, except for ACABIT (Daille, 2001) and FASTR (Jacquemin, 2001). 1http://termostat.ling.umontreal.ca/ 13 Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics—System Demonstrations, pages 13–18, Berlin, Germany, August 7-12, 2016. c 2016 Association for Computational Linguistics nally, we provide some figures and considerations define rules over a sequence of UIMA annota- about TermSuite resources and behaviour. tions, ie. over tokens of the corpus, each rule being in the form of a regular expression. Com- 2 TermSuite architecture pared to RUTA (Kluegl et al., 2016), UIMA To- TET are dedicated to compute the termhood and kens Regex operates only on annotations that ap- the unithood of a term candidate (Kageura and pear sequentially, which is the case for word an- Umino, 1996). Two steps make up the core of notations. The occurrence recognition engine has the terminology extraction process (Pazienza et been thus implemented as a finite-state machine al., 2005): with linear complexity. 1. Spotting: Identification and collection of 3.1 Syntax term-like units in the texts, mostly a subset UIMA Tokens Regex syntax is formally de- of nominal phrases; fined by an ANTLR3 grammar and inspired by Stanford TokensRegex (Chang and Man- 2. Filtering and sorting: Filtering of the ex- ning, 2014). tracted term-like units that may not be terms, syntactically or terminologically; Sorting of Matchers Before defining regular expressions the term candidates according to their unit- over annotations, each annotation needs to be hood, their terminological degree and their atomically matchable. That is why UIMA Tokens most interest for the target application. Regex defines a syntax for matchers.A matcher can be of three types: TermSuite adopts these two steps. Term- [Boolean Exp] an expression matching like units are collected with the following NLP the values of annotation pipeline: tokenization, POS tagging, lemmatiza- attributes. tion, stemming, splitting, and MWT spotting with /String RegExp/ A valid Java regular ex- UIMA Tokens Regex. They are ranked according pression matching against to the most popular termhood measure. But in or- the text covered by the an- der to improve the term extraction process and to notation. provide a first structuring of the term candidates, a The dot ”.” matches any annotation. component dedicating to term variant recognition The Boolean Exp within brackets is a combination has been added. Indeed, term variant recognition of atomic boolean expressions, boolean operators improves the outputs of term extraction: the rank- & and , and parentheses. An atomic boolean k ing of the term candidates is more accurate and expression is of the form: more terms are detected (Daille and Blancafort, property op literal 2013). Figure 2 shows the output of TermSuite TET Where property is an annotation feature de- within the graphical interface. The main win- fined in TermSuite UIMA type system, op is dow shows the terms rank according to termhood. one of ==, !=, <, <=, >, and >=, and literal A term candidate may group miscellaneous term is either a string, a boolean (true or false), or variants. When a term is highlighted, the occur- a number (integer or double). rences spot by UIMA Tokens Regex are showed Rules Rules are named regular expressions that in the bottom window and the term features in the are defined as follows: right window. term "rule name": TokensRegex; 3 Spotting multiword terms Where TokensRegex is a sequence of quantified We design a component in charge of spotting matchers. The quantifiers are: ? multi-word terms and their variants in text, which 0 or 1 is based on UIMA Tokens Regex2, a concise and * 0 or several + expressive language coupled with an efficient rule at least 1 n exactly n engine. UIMA Tokens Regex allows the user to { } m,n between m and n 2http://github.com/JuleStar/ { } uima-tokens-regex/ 3http://antlr.org/ 14 3.2 Engine Lexical filtering Matcher A above shows an ex- ample of lexical filtering that prohibits occur- UIMA Tokens Regex engine parses the list of rules rences of the listed lemma in the pattern. For ex- and creates for each of these rules a finite-state ample, Rule an will not match the term candidate automaton. The engine provides automata with same energy. the sequence of UIMA annotations of the prepro- cessed input document. UIMA Tokens Regex en- Contextual filtering Contextual POS are pre- gine implements the default behaviour of a regu- ceded by tilde ( ). Rule acan shows an example ∼ lar expression engine: it is greedy, backtracking, of contextual filtering. A determinant should oc- picking out the first alternative, and impatient. cur for the pattern to be matched, but it will be not Every time an automaton (ie. a rule) matches, part of collected MWT. TermSuite generates a rule occurrence and stores the offset indexes of the matched text. 4 Variant grouping 3.3 Application to terminology extraction TermSuite is able to gather terms according to syntactic and morphological variant patterns that Example In TermSuite type system, the val- are defined with YAML syntax (Ben-Kiki et al., ues of the feature category are the part-of- 2005). speech (POS) tags. Rule an below extracts MWT composed of one or several adjectives followed by 4.1 Syntax a noun. A variant rule states a set of conditions that two term "an": [category=="adjective"]+ term candidates must fulfil to be paired. It consists [category=="noun"] ; of: Matcher predefinition For the sake of both a rule name a string expression between double readability and reusability, UIMA Tokens Regex quotes ("), ended by a colon (:), allows the user to predefine matchers. Thus, Rule an can be expressed concisely as A+ N using the a source pattern and a target pattern, which are matchers N and A: sequences of matcher labels. matcher N: [category=="noun"]; matcher Vpp: [V & mood=="participle" a boolean expression a logical expression on & tense=="past"]; matcher A: [(Vpp | category=="adjective") source and target term features, denoted by & lemma!="same" rule. The field rule is interpreted by a & lemma!="other"]; Groovy engine and must be defined in valid matcher C: /ˆ(and|or)$/; matcher D: [category=="determiner" Groovy syntax. & subCategory != "possessive"]; matcher P: [category=="adposition" Example The example below is the simplest & subCategory=="preposition"]; variant grouping rule defined for English. term "an": A+ N ; "S-I-NN-(N|A)": term "npn": N P D? N ; source: N N term "acan": ˜D A C A N ; target: N N N, N A N rule: s[0]==t[0] && s[1]==t[2] Rule acan extracts coordination variants that This rule is named S-I-NN-(N A).
Load more

Recommended publications
  • A Comparison of Knowledge Extraction Tools for the Semantic Web
    A Comparison of Knowledge Extraction Tools for the Semantic Web Aldo Gangemi1;2 1 LIPN, Universit´eParis13-CNRS-SorbonneCit´e,France 2 STLab, ISTC-CNR, Rome, Italy. Abstract. In the last years, basic NLP tasks: NER, WSD, relation ex- traction, etc. have been configured for Semantic Web tasks including on- tology learning, linked data population, entity resolution, NL querying to linked data, etc. Some assessment of the state of art of existing Knowl- edge Extraction (KE) tools when applied to the Semantic Web is then desirable. In this paper we describe a landscape analysis of several tools, either conceived specifically for KE on the Semantic Web, or adaptable to it, or even acting as aggregators of extracted data from other tools. Our aim is to assess the currently available capabilities against a rich palette of ontology design constructs, focusing specifically on the actual semantic reusability of KE output. 1 Introduction We present a landscape analysis of the current tools for Knowledge Extraction from text (KE), when applied on the Semantic Web (SW). Knowledge Extraction from text has become a key semantic technology, and has become key to the Semantic Web as well (see. e.g. [31]). Indeed, interest in ontology learning is not new (see e.g. [23], which dates back to 2001, and [10]), and an advanced tool like Text2Onto [11] was set up already in 2005. However, interest in KE was initially limited in the SW community, which preferred to concentrate on manual design of ontologies as a seal of quality. Things started changing after the linked data bootstrapping provided by DB- pedia [22], and the consequent need for substantial population of knowledge bases, schema induction from data, natural language access to structured data, and in general all applications that make joint exploitation of structured and unstructured content.
    [Show full text]
  • A Combined Method for E-Learning Ontology Population Based on NLP and User Activity Analysis
    A Combined Method for E-Learning Ontology Population based on NLP and User Activity Analysis Dmitry Mouromtsev, Fedor Kozlov, Liubov Kovriguina and Olga Parkhimovich ITMO University, St. Petersburg, Russia [email protected], [email protected], [email protected], [email protected] Abstract. The paper describes a combined approach to maintaining an E-Learning ontology in dynamic and changing educational environment. The developed NLP algorithm based on morpho-syntactic patterns is ap- plied for terminology extraction from course tasks that allows to interlink extracted terms with the instances of the system’s ontology whenever some educational materials are changed. These links are used to gather statistics, evaluate quality of lectures’ and tasks’ materials, analyse stu- dents’ answers to the tasks and detect difficult terminology of the course in general (for the teachers) and its understandability in particular (for every student). Keywords: Semantic Web, Linked Learning, terminology extraction, education, educational ontology population 1 Introduction Nowadays reusing online educational resources becomes one of the most promis- ing approaches for e-learning systems development. A good example of using semantics to make education materials reusable and flexible is the SlideWiki system[1]. The key feature of an ontology-based e-learning system is the possi- bility for tutors and students to treat elements of educational content as named objects and named relations between them. These names are understandable both for humans as titles and for the system as types of data. Thus educational materials in the e-learning system thoroughly reflect the structure of education process via relations between courses, modules, lectures, tests and terms.
    [Show full text]
  • Information Extraction Using Natural Language Processing
    INFORMATION EXTRACTION USING NATURAL LANGUAGE PROCESSING Cvetana Krstev University of Belgrade, Faculty of Philology Information Retrieval and/vs. Natural Language Processing So close yet so far Outline of the talk ◦ Views on Information Retrieval (IR) and Natural Language Processing (NLP) ◦ IR and NLP in Serbia ◦ Language Resources (LT) in the core of NLP ◦ at University of Belgrade (4 representative resources) ◦ LR and NLP for Information Retrieval and Information Extraction (IE) ◦ at University of Belgrade (4 representative applications) Wikipedia ◦ Information retrieval ◦ Information retrieval (IR) is the activity of obtaining information resources relevant to an information need from a collection of information resources. Searches can be based on full-text or other content-based indexing. ◦ Natural Language Processing ◦ Natural language processing is a field of computer science, artificial intelligence, and computational linguistics concerned with the interactions between computers and human (natural) languages. As such, NLP is related to the area of human–computer interaction. Many challenges in NLP involve: natural language understanding, enabling computers to derive meaning from human or natural language input; and others involve natural language generation. Experts ◦ Information Retrieval ◦ As an academic field of study, Information Retrieval (IR) is finding material (usually documents) of an unstructured nature (usually text) that satisfies an information need from within large collection (usually stored on computers). ◦ C. D. Manning, P. Raghavan, H. Schutze, “Introduction to Information Retrieval”, Cambridge University Press, 2008 ◦ Natural Language Processing ◦ The term ‘Natural Language Processing’ (NLP) is normally used to describe the function of software or hardware components in computer system which analyze or synthesize spoken or written language.
    [Show full text]
  • A Terminology Extraction System for Technology Related Terms
    TEST: A Terminology Extraction System for Technology Related Terms Murhaf Hossari Soumyabrata Dev John D. Kelleher ADAPT Centre, Trinity College ADAPT Centre, Trinity College ADAPT Centre, Technological Dublin Dublin University Dublin Dublin, Ireland Dublin, Ireland Dublin, Ireland [email protected] [email protected] [email protected] ABSTRACT of applications [6], ranging from e-mail spam filtering, advertising Tracking developments in the highly dynamic data-technology and marketing industry [4, 7], and social media. Particularly, in landscape are vital to keeping up with novel technologies and tools, these realm of online articles and blog articles, the growth in the in the various areas of Artificial Intelligence (AI). However, It is amount of information is almost in an exponential nature. Therefore, difficult to keep track of all the relevant technology keywords. In it is important for the researchers to develop a system that can this paper, we propose a novel system that addresses this problem. automatically parse the millions of documents, and identify the key This tool is used to automatically detect the existence of new tech- technological terms. Such system will greatly reduce the manual nologies and tools in text, and extract terms used to describe these work, and save several man-hours. new technologies. The extracted new terms can be logged as new In this paper, we develop a machine-learning based solution, AI technologies as they are found on-the-fly in the web. It can be that is capable of the discovery and extraction of information re- subsequently classified into the relevant semantic labels and AIdo- lated to AI technologies.
    [Show full text]
  • Ontology Learning and Its Application to Automated Terminology Translation
    Natural Language Processing Ontology Learning and Its Application to Automated Terminology Translation Roberto Navigli and Paola Velardi, Università di Roma La Sapienza Aldo Gangemi, Institute of Cognitive Sciences and Technology lthough the IT community widely acknowledges the usefulness of domain ontolo- A gies, especially in relation to the Semantic Web,1,2 we must overcome several bar- The OntoLearn system riers before they become practical and useful tools. Thus far, only a few specific research for automated ontology environments have ontologies. (The “What Is an Ontology?” sidebar on page 24 provides learning extracts a definition and some background.) Many in the and is part of a more general ontology engineering computational-linguistics research community use architecture.4,5 Here, we describe the system and an relevant domain terms WordNet,3 but large-scale IT applications based on experiment in which we used a machine-learned it require heavy customization. tourism ontology to automatically translate multi- from a corpus of text, Thus, a critical issue is ontology construction— word terms from English to Italian. The method can identifying, defining, and entering concept defini- apply to other domains without manual adaptation. relates them to tions. In large, complex application domains, this task can be lengthy, costly, and controversial, because peo- OntoLearn architecture appropriate concepts in ple can have different points of view about the same Figure 1 shows the elements of the architecture. concept. Two main approaches aid large-scale ontol- Using the Ariosto language processor,6 OntoLearn a general-purpose ogy construction. The first one facilitates manual extracts terminology from a corpus of domain text, ontology engineering by providing natural language such as specialized Web sites and warehouses or doc- ontology, and detects processing tools, including editors, consistency uments exchanged among members of a virtual com- checkers, mediators to support shared decisions, and munity.
    [Show full text]
  • Translate's Localization Guide
    Translate’s Localization Guide Release 0.9.0 Translate Jun 26, 2020 Contents 1 Localisation Guide 1 2 Glossary 191 3 Language Information 195 i ii CHAPTER 1 Localisation Guide The general aim of this document is not to replace other well written works but to draw them together. So for instance the section on projects contains information that should help you get started and point you to the documents that are often hard to find. The section of translation should provide a general enough overview of common mistakes and pitfalls. We have found the localisation community very fragmented and hope that through this document we can bring people together and unify information that is out there but in many many different places. The one section that we feel is unique is the guide to developers – they make assumptions about localisation without fully understanding the implications, we complain but honestly there is not one place that can help give a developer and overview of what is needed from them, we hope that the developer section goes a long way to solving that issue. 1.1 Purpose The purpose of this document is to provide one reference for localisers. You will find lots of information on localising and packaging on the web but not a single resource that can guide you. Most of the information is also domain specific ie it addresses KDE, Mozilla, etc. We hope that this is more general. This document also goes beyond the technical aspects of localisation which seems to be the domain of other lo- calisation documents.
    [Show full text]
  • Generating Domain Terminologies Using Root- and Rule-Based Terms1
    Generating Domain Terminologies using Root- and Rule-Based Terms1 Jacob Collard1, T. N. Bhat2, Eswaran Subrahmanian3,4, Ram D. Sriram3, John T. Elliot2, Ursula R. Kattner2, Carelyn E. Campbell2, Ira Monarch4,5 Independent Consultant, Ithaca, New York1, Materials Measurement Laboratory, National Institute of Standards and Technology, Gaithersburg, MD2, Information Technology Laboratory, National Institute of Standards and Technology, Gaithersburg, MD 3, Carnegie Mellon University, Pittsburgh, PA4, Independent Consultant, Pittsburgh, PA5 Abstract Motivated by the need for flexible, intuitive, reusable, and normalized terminology for guiding search and building ontologies, we present a general approach for generating sets of such terminologies from natural language documents. The terms that this approach generates are root- and rule-based terms, generated by a series of rules designed to be flexible, to evolve, and, perhaps most important, to protect against ambiguity and standardize semantically similar but syntactically distinct phrases to a normal form. This approach combines several linguistic and computational methods that can be automated with the help of training sets to quickly and consistently extract normalized terms. We discuss how this can be extended as natural language technologies improve and how the strategy applies to common use-cases such as search, document entry and archiving, and identifying, tracking, and predicting scientific and technological trends. Keywords dependency parsing; natural language processing; ontology generation; search; terminology generation; unsupervised learning. 1. Introduction 1.1 Terminologies and Semantic Technologies Services and applications on the world-wide web, as well as standards defined by the World Wide Web Consortium (W3C), the primary standards organization for the web, have been integrating semantic technologies into the Internet since 2001 (Koivunen and Miller 2001).
    [Show full text]
  • Terminology Extraction, Translation Tools and Comparable Corpora
    Terminology Extraction, Translation Tools and Comparable Corpora: TTC concept, midterm progress and achieved results Tatiana Gornostay, Anita Gojun, Marion Weller, Ulrich Heid, Emmanuel Morin, Beatrice Daille, Helena Blancafort, Serge Sharoff, Claude Méchoulam To cite this version: Tatiana Gornostay, Anita Gojun, Marion Weller, Ulrich Heid, Emmanuel Morin, et al.. Terminology Extraction, Translation Tools and Comparable Corpora: TTC concept, midterm progress and achieved results. LREC 2012 Workshop on Creating Cross-language Resources for Disconnected Languages and Styles (CREDISLAS), May 2012, Istanbul, Turkey. 4 p. hal-00819909 HAL Id: hal-00819909 https://hal.archives-ouvertes.fr/hal-00819909 Submitted on 9 May 2013 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Terminology Extraction, Translation Tools and Comparable Corpora: TTC concept, midterm progress and achieved results Tatiana Gornostaya, Anita Gojunb, Marion Wellerb, Ulrich Heidb, Emmanuel Morinc, Beatrice Daillec, Helena Blancafortd, Serge Sharoffe, Claude Méchoulamf Tildea, Institute
    [Show full text]
  • Tbxtools: a Free, Fast and Flexible Tool for Automatic Terminology Extraction
    TBXTools: A Free, Fast and Flexible Tool for Automatic Terminology Extraction Antoni Oliver Merce` Vazquez` Universitat Oberta de Catalunya Universitat Oberta de Catalunya [email protected] [email protected] Abstract assisted translation, thesaurus construction, classi- fication, indexing, information retrieval, and also The manual identification of terminology text mining and text summarisation (Heid and Mc- from specialized corpora is a complex task Naught, 1991; Frantzi and Ananiadou, 1996; Vu et that needs to be addressed by flexible al., 2008). tools, in order to facilitate the construction The automatic terminology extraction tools de- of multilingual terminologies which are veloped in recent years allow easier manual term the main resources for computer-assisted extraction from a specialized corpus, which is a translation tools, machine translation or long, tedious and repetitive task that has the risk ontologies. The automatic terminology of being unsystematic and subjective, very costly extraction tools developed so far either use in economic terms and limited by the current a proprietary code or an open source code, available information. However, existing tools that is limited to certain software func- should be improved in order to get more consistent tionalities. To automatically extract terms terminology and greater productivity (Gornostay, from specialized corpora for different pur- 2010). poses such as constructing dictionaries, In the last few years, several term extraction thesauruses or translation memories, we tools have been developed, but most of them are need open source tools to easily integrate language-dependent: French and English –Fastr new functionalities to improve term selec- (Jacquemin, 1999) and Acabit (Daille, 2003); tion. This paper presents TBXTools, a Portuguese –Extracterm (Costa et al., 2004) and free automatic terminology extraction tool ExATOlp (Lopes et al., 2009); Spanish-Basque that implements linguistic and statistical –Elexbi (Hernaiz et al., 2006); Spanish-German methods for multiword term extraction.
    [Show full text]
  • The Interplay Between Lexical Resources and Natural Language Processing
    Tutorial on: The interplay between lexical resources and Natural Language Processing Google Group: goo.gl/JEazYH 1 Luis Espinosa Anke Jose Camacho-Collados Mohammad Taher Pilehvar Google Group: goo.gl/JEazYH 2 Luis Espinosa Anke (linguist) Jose Camacho-Collados (mathematician) Mohammad Taher Pilehvar (computer scientist) 3 www.kahoot.it PIN: 7024700 NAACL 2018 Tutorial: The Interplay between Lexical Resources and Natural Language Processing Camacho-Collados, Espinosa-Anke, Pilehvar 4 QUESTION 1 PIN: 7024700 www.kahoot.it NAACL 2018 Tutorial: The Interplay between Lexical Resources and Natural Language Processing Camacho-Collados, Espinosa-Anke, Pilehvar 5 Outline 1. Introduction 2. Overview of Lexical Resources 3. NLP for Lexical Resources 4. Lexical Resources for NLP 5. Conclusion and Future Directions NAACL 2018 Tutorial: The Interplay between Lexical Resources and Natural Language Processing Camacho-Collados, Espinosa-Anke, Pilehvar 6 INTRODUCTION NAACL 2018 Tutorial: The Interplay between Lexical Resources and Natural Language Processing Camacho-Collados, Espinosa-Anke, Pilehvar 7 Introduction ● “A lexical resource (LR) is a database consisting of one or several dictionaries.” (en.wikipedia.org/wiki/Lexical_resource) ● “What is lexical resource? In a word it is vocabulary and it matters for IELTS writing because …” (dcielts.com/ielts-writing/lexical-resource) ● “The term Language Resource refers to a set of speech or language data and descriptions in machine readable form, used for … ” (elra.info/en/about/what-language-resource )
    [Show full text]
  • Building Ontologies from Folksonomies and Linked Data: Data Structures and Algorithms Technical Report - 22 May 2012
    Building ontologies from folksonomies and linked data: Data structures and Algorithms Technical Report - 22 May 2012 Andrés García-Silva1, Jael García-Castro2, Alexander García3, Oscar Corcho1, Asunción Gómez-Pérez1 1 Ontology Engineering Group, Facultad de Informática, Universidad Politécnica de Madrid, Spain {hgarcia,ocorcho,asun}@fi.upm.es, 2 E-Business & Web Science Research Group, Universitaet der Bundeswehr, Muenchen, Germany [email protected], 3 Biomedical Informatics, Medical Center, University of Arkansas, USA [email protected], Abstract. We present the data structures and algorithms used in the approach for building domain ontologies from folksonomies and linked data. In this approach we extracts domain terms from folksonomies and enrich them with semantic information from the Linked Open Data cloud. As a result, we obtain a domain ontology that combines the emer- gent knowledge of social tagging systems with formal knowledge from Ontologies. 1 Introduction In this report we present the formalization of the data structures and algorithms used in the approach for building ontologies from folksonomies and linked data. In this approach we use folksonomies to gather a domain terminology. First in a term extraction activity we represent folksonomies as a graph which is traversed by using a spreading activation algorithm (see section 2.1). Next in a semantic elicitation activity we identify classes and relations among terms on the terminology relying on linked data sets (see section 2.2). During this activity terms are associated with semantic resources in DBpedia by means of a semantic grounding algorithm. Once terms are grounded to semantic entities we attempt to identify which of those resources correspond to classes in the ontologies that we are using.
    [Show full text]
  • Bilingual Terminology Extraction in Sketch Engine
    Bilingual Terminology Extraction in Sketch Engine Vít Baisa1,2, Barbora Ulipová, Michal Cukr1,2 1 Natural Language Processing Centre, Faculty of Informatics, Masaryk University Botanická 68a, 602 00 Brno, Czech Republic [email protected] 2 Lexical Computing Brighton, United Kingdom and Brno, Czech Republic {vit.baisa,michal.cukr}@sketchengine.co.uk Abstract. We present a method of bilingual terminology extraction from parallel corpora and a few heuristics and experiments with improving the performance of the basic variant of the method. An evaluation is given using a small gold standard manually prepared for English- Czech language pair from DGT translation memory [1]. The bilingual terminology extraction (ABTE3) is available for several languages in Sketch Engine—the corpus management tool [2]. Keywords: terminology extraction, bilingual terminology extraction, Sketch Engine, logDice, parallel corpus 1 Introduction Parallel corpora are valuable resources for machine and computer-assisted translation. Here we explore a possibility of extracting bilingual terminology from parallel corpora combining a monolingual terminology extraction [3] and a co-occurrence statistics [4]. We describe the method and how it is incorporated in the corpus manager tool Sketch Engine. We experimented with parameter tuning and evaluated a few settings using a small gold standard for English- Czech language pair. The following section is a brief survey of topics, methods and tools in ABTE. In Section 3 we describe the basic algorithm for the extraction and in Section 4 how it is integrated in Sketch Engine. In Sections 5 and 6 we evaluate the algorithm and its variants. 2 Related work The monolingual terminology extraction is a well-studied field, and the topic of ABTE has been explored since 90s [5] but recent summarizing publication [6] 3 ATE stands for “automatic terminology extraction”, so we adopt the abbreviation here and add “B” for “bilingual”.
    [Show full text]