Robust Semantic Analysis for Unseen Data in Framenet

Total Page:16

File Type:pdf, Size:1020Kb

Robust Semantic Analysis for Unseen Data in Framenet Robust Semantic Analysis for Unseen Data in FrameNet Alexis Palmer, Afra Alishahi, Caroline Sporleder Computational Linguistics and Phonetics Saarland University, Germany {apalmer,afra,csporled}@coli.uni-saarland.de Abstract was annotated on a frame-by-frame basis, select- ing individual example sentences for each lexical We present a novel method for FrameNet- unit (LU), or pairing of lemma and frame. This based semantic role labeling (SRL), fo- means that many common lemmas are missing cusing on limitations posed by the limited from FrameNet, and for those that are included coverage of available annotated data. Our the number of example sentences is often rela- SRL model is based on Bayesian cluster- tively small and not in accordance with distribu- ing and has the advantage of being very ro- tions found in naturally-occurring texts. bust in the face of unseen and incomplete FrameNet’s well-known coverage gaps translate data. Frame labeling and role labeling are directly to drops in labeling performance, motivat- modeled in like fashions, allowing cascad- ing the development of systems which are more ing classification scenarios. The model is robust in the face of sparse data. For example, shown to perform especially well on un- the supervised SRL system Shalmaneser (Erk and seen data. In addition, we show that for Pado,´ 2006) obtains a frame labeling accuracy of seen data, predicting semantic types for 93% on FrameNet 1.2 (with a 90-10 training-test roles improves role labeling performance. split), but the same system’s performance drops to 1 Introduction 47% accuracy when trained on FrameNet 1.3 and tested on texts with full frame-semantic annota- The majority of recent work in semantic role la- tions (Palmer and Sporleder, 2010). Similarly, Das beling (SRL) has been carried out on PropBank- et al. (2010) report a 60% frame labeling F-Score style semantic argument annotations (Palmer et on SemEval-07 data, but of 210 unseen lemmas, al., 2005), rather than on FrameNet-style annota- their system predicts just four frames correctly.1 tions (Ruppenhofer et al., 2006). FrameNet dif- fers from PropBank in that FrameNet annotations In general the term unseen could refer to un- are more strongly semantically driven. FrameNet seen frames, unseen lemmas, or unseen LUs. As generalizes over different parts of speech and can further discussed in Section 4, we are interested assign the same sense (frame) to a noun and a verb in unseen LUs: cases in which the system has as in (1), where both competition and play are as- not been exposed to a particular pairing of lemma and frame. We propose a novel method for SRL signed the COMPETITION frame. Also, FrameNet assigns semantic roles not only to syntactic argu- based on Bayesian clustering. The model is well ments of the target but also to constituents which suited to deal with incomplete data, both in terms are not directly syntactically dependent on the tar- of missing feature values and in terms of feature- get but can be semantically understood as filling a label combinations not seen in the training data. role, e.g., Wivenhoe Town in (1a). 2 Related Work (1) a. [Wivenhoe Town]Participant1 have never won the competitionCompetition. While early FrameNet-style SRL systems (Gildea b. [Olympiakos]Participant1 playsCompetition [against Aris Salonica]Participant1 [in and Jurafsky, 2002; Erk and Pado,´ 2006, among Piraeus]Place. others) are unable to make predictions for LUs not seen in the training data, several more recent stud- A major challenge for FrameNet-style SRL is posed by the limited coverage of available anno- 1Under the SemEval-07 partial matching scheme, a ma- tated data. The FrameNet lexicographic corpus jority of the other frame predictions receive partial credit. 628 Proceedings of Recent Advances in Natural Language Processing, pages 628–633, Hissar, Bulgaria, 12-14 September 2011. ies have addressed the coverage issue. For exam- are predicted based on the acquired constructions ple, Das et al. (2010) introduce a latent variable (or clusters), and the extracted features from the ranging over seen targets, allowing them to infer corpus. This strategy provides a number of advan- likely frames for unseen words, and the SRL sys- tages. First, the model can easily deal with incom- tem of Johansson and Nugues (2007) uses Word- plete data; that is, input instances for which any Net to generalise to unseen lemmas. In a simi- number of features are missing can be seamlessly lar vein, Burchardt et al. (2005) propose a system clustered or considered for prediction, based on that generalizes over WordNet synsets to guess the similarity of their features with those in the ex- frames for unknown words. Pennacchiotti et al. isting clusters. Moreover, a single core prediction (2008) compare WordNet-based and distributional mechanism is used for a variety of tasks (e.g. pre- approaches to inferring frames and conclude that dicting a missing frame label, role, or role type), a combination of the two leads to the best results, which can lead to cascading prediction. For exam- while (Cao et al., 2008) discuss how different dis- ple, for a partial (i.e. unannotated) frame instance, tributional models can be utilised. Several ap- the best role type for each argument can be pre- proaches have also addressed other coverage prob- dicted based on the available features, and then ar- lems, e.g., how to automatically expand the num- gument roles can be predicted based on those fea- ber of example sentences for a given lexical unit tures and the predicted role types. (Pado´ et al., 2008; Furstenau¨ and Lapata, 2009). An important characteristic of this model is its Another related approach is that of generalizing generalizability. It uses a full Bayesian prediction over semantic roles. Baldewein et al. (2004) use model, which takes into account the contribution the FrameNet hierarchy to model the similarity of of every cluster to predicting the best value for roles, boosting seldom-seen instances by reusing a missing feature. This way, there is no built-in training data for similar roles, though without sig- difference between predicting a frame label or se- nificant gains in performance. The most exten- mantic role for seen versus unseen instances. Nat- sive study on role generalization to date (Matsub- urally, the outcome of prediction will be more ac- ayashi et al., 2009) compares different ways of curate if the model has seen several instances sim- grouping roles—exploiting hierarchical relations ilar to a test instance (i.e., from the same lexical in FrameNet, generalizing via role names, util- unit or lemma). But even for unseen instances, the ising role types, and using thematic roles from model is still capable of generalizing the proper- VerbNet—with the best results from using all ties of the training instances given that there are groups together. similarities between their available features, such as the syntactic pattern and the semantic properties 3 Model of the predicate and the arguments. We formalize frame and role assignment using 3.1 Clustering Frame Instances an extended version of the construction learning From the FrameNet corpus, we extract for each model of Alishahi and Stevenson (2010). The instance the nine features shown in Table 1. Dif- model uses Bayesian clustering for learning argu- ferent subsets of these features are used for the ex- ment structure constructions: each construction is periments reported in Section 5. a grouping of individual predicate usages which An incremental Bayesian clustering process probabilistically share form-meaning associations. groups each extracted frame instance with the These groupings typically correspond to general most similar existing cluster of instances. If no ex- constructions in the language such as intransitive, isting cluster has sufficiently high probability for transitive, and ditransitive. By detecting similar the new frame instance, a new cluster is created. usages and clustering them into constructions, the Adding a frame instance X to a cluster c is for- model forms probabilistic associations between mulated as finding the c with the maximum proba- syntactic positions of arguments with respect to bility given X, where c ranges over the indices of the predicate, and the lexical semantic properties all clusters, with index 0 representing recognition of the predicate and the arguments. of a new cluster. Using Bayes rule, and dropping We model frame and role assignment in this P (X) which is constant for all c: fashion, where the most probable values for a P (c)P (X|c) P (c|X) = ∼ P (c)P (X|c) (2) missing frame or the semantic roles of arguments P (X) 629 The conditional probabilities P (X|c) and The prior probability P (c) is given by the rela- P (X |c) are determined as in the learning mod- tive frequency of the frame instances it contains, i ule. Ranging over the possible values X of over all observed instances. The posterior prob- i feature i, the value of an unobserved feature can ability of an instance X is expressed in terms of be predicted by maximizing P (X |X): the individual probabilities of its features, which i we assume are independent, thus yielding a sim- ple product of feature probabilities: BestValue(X, i) = argmax P (Xi|X) (7) Xi Y P (X|c) = P (Xi|c) (3) i∈Features(X) Identifying a frame can be simulated This probability is estimated using smoothed max- as finding the frame label Xframe with imum likelihood: the highest P (Xframe |X), or estimating BestValue(X, frame). Similarly, assigning P 0 X0∈c match(Xi,Xi) + λ roles or role types to the arguments of an instance P (Xi|c) = (4) nc + αiλ X is modeled as estimating BestValue(X, role) or BestValue(X, role type), respectively.
Recommended publications
  • Enriching an Explanatory Dictionary with Framenet and Propbank Corpus Examples
    Proceedings of eLex 2019 Enriching an Explanatory Dictionary with FrameNet and PropBank Corpus Examples Pēteris Paikens 1, Normunds Grūzītis 2, Laura Rituma 2, Gunta Nešpore 2, Viktors Lipskis 2, Lauma Pretkalniņa2, Andrejs Spektors 2 1 Latvian Information Agency LETA, Marijas street 2, Riga, Latvia 2 Institute of Mathematics and Computer Science, University of Latvia, Raina blvd. 29, Riga, Latvia E-mail: [email protected], [email protected] Abstract This paper describes ongoing work to extend an online dictionary of Latvian – Tezaurs.lv – with representative semantically annotated corpus examples according to the FrameNet and PropBank methodologies and word sense inventories. Tezaurs.lv is one of the largest open lexical resources for Latvian, combining information from more than 300 legacy dictionaries and other sources. The corpus examples are extracted from Latvian FrameNet and PropBank corpora, which are manually annotated parallel subsets of a balanced text corpus of contemporary Latvian. The proposed approach augments traditional lexicographic information with modern cross-lingually interpretable information and enables analysis of word senses from the perspective of frame semantics, which is substantially different from (complementary to) the traditional approach applied in Latvian lexicography. In cases where FrameNet and PropBank corpus evidence aligns well with the word sense split in legacy dictionaries, the frame-semantically annotated corpus examples supplement the word sense information with clarifying usage examples and commonly used semantic valence patterns. However, the annotated corpus examples often provide evidence of a different sense split, which is often more coarse-grained and, thus, may help dictionary users to cluster and comprehend a fine-grained sense split suggested by the legacy sources.
    [Show full text]
  • Developing a Large Scale Framenet for Italian: the Iframenet Experience
    Developing a large scale FrameNet for Italian: the IFrameNet experience Roberto Basili° Silvia Brambilla§ Danilo Croce° Fabio Tamburini§ ° § Dept. of Enterprise Engineering Dept. of Classic Philology and Italian Studies University of Rome Tor Vergata University of Bologna {basili,croce}@info.uniroma2.it [email protected], [email protected] ian Portuguese, German, Spanish, Japanese, Swe- Abstract dish and Korean. All these projects are based on the idea that English. This paper presents work in pro- most of the Frames are the same among languages gress for the development of IFrameNet, a and that, thanks to this, it is possible to adopt large-scale, computationally oriented, lexi- Berkeley’s Frames and FEs and their relations, cal resource based on Fillmore’s frame se- with few changes, once all the language-specific mantics for Italian. For the development of information has been cut away (Tonelli et al. 2009, IFrameNet linguistic analysis, corpus- Tonelli 2010). processing and machine learning techniques With regard to Italian, over the past ten years are combined in order to support the semi- several research projects have been carried out at automatic development and annotation of different universities and Research Centres. In par- the resource. ticular, the ILC-CNR in Pisa (e.g. Lenci et al. 2008; Johnson and Lenci 2011), FBK in Trento (e.g. Italiano. Questo articolo presenta un work Tonelli et al. 2009, Tonelli 2010) and the Universi- in progress per lo sviluppo di IFrameNet, ty of Rome, Tor Vergata (e.g. Pennacchiotti et al. una risorsa lessicale ad ampia copertura, 2008, Basili et al.
    [Show full text]
  • Integrating Wordnet and Framenet Using a Knowledge-Based Word Sense Disambiguation Algorithm
    Integrating WordNet and FrameNet using a knowledge-based Word Sense Disambiguation algorithm Egoitz Laparra and German Rigau IXA group. University of the Basque Country, Donostia {egoitz.laparra,german.rigau}@ehu.com Abstract coherent groupings of words belonging to the same frame. This paper presents a novel automatic approach to In that way we expect to extend the coverage of FrameNet partially integrate FrameNet and WordNet. In that (by including from WordNet closely related concepts), to way we expect to extend FrameNet coverage, to en- enrich WordNet with frame semantic information (by port- rich WordNet with frame semantic information and ing frame information to WordNet) and possibly to extend possibly to extend FrameNet to languages other than FrameNet to languages other than English (by exploiting English. The method uses a knowledge-based Word local wordnets aligned to the English WordNet). Sense Disambiguation algorithm for linking FrameNet WordNet1 [12] (hereinafter WN) is by far the most lexical units to WordNet synsets. Specifically, we ex- ploit a graph-based Word Sense Disambiguation algo- widely-used knowledge base. In fact, WN is being rithm that uses a large-scale knowledge-base derived used world-wide for anchoring different types of seman- from WordNet. We have developed and tested four tic knowledge including wordnets for languages other than additional versions of this algorithm showing a sub- English [4], domain knowledge [17] or ontologies like stantial improvement over previous results. SUMO [22] or the EuroWordNet Top Concept Ontology [3]. It contains manually coded information about En- glish nouns, verbs, adjectives and adverbs and is organized around the notion of a synset.
    [Show full text]
  • The Hebrew Framenet Project
    The Hebrew FrameNet Project Avi Hayoun, Michael Elhadad Dept. of Computer Science Ben-Gurion University Beer Sheva, Israel {hayounav,elhadad}@cs.bgu.ac.il Abstract We present the Hebrew FrameNet project, describe the development and annotation processes and enumerate the challenges we faced along the way. We have developed semi-automatic tools to help speed the annotation and data collection process. The resource currently covers 167 frames, 3,000 lexical units and about 500 fully annotated sentences. We have started training and testing automatic SRL tools on the seed data. Keywords: FrameNet, Hebrew, frame semantics, semantic resources 1. Introduction frames and their structures in natural language. Recent years have seen growing interest in the task 1.2. FrameNet in Other Languages of Semantic Role Labeling (SRL) of natural language The original FrameNet project has been adapted and text (sometimes called “shallow semantic parsing”). ported to multiple languages. The most active interna- The task is usually described as the act of identify- tional FrameNet teams include the Swedish FrameNet ing the semantic roles, which are the set of semantic (SweFN) covering close to 1,200 frames with 34K LUs properties and relationships defined over constituents (Ahlberg et al., 2014); the Japanese FrameNet (JFN) of a sentence, given a semantic context. with 565 frames, 8,500 LUs and 60K annotated ex- The creation of resources that document the realiza- ample sentences (Ohara, 2013); and FrameNet Brazil tion of semantic roles in natural language texts, such (FN-Br) covering 179 frames, 196 LUs and 12K anno- as FrameNet (Fillmore and Baker, 2010; Ruppenhofer tated sentences (Torrent and Ellsworth, 2013).
    [Show full text]
  • INF5830 Introduction to Semantic Role Labeling
    INF5830 Introduction to Semantic Role Labeling Andrey Kutuzov University of Oslo Language Technology Group With thanks to Lilja Øvrelid, Martha Palmer and Dan Jurafsky INF5830 Introduction to Semantic Role Labeling 1(36) Semantic Role Labeling INF5830 Introduction to Semantic Role Labeling 2(36) Introduction Contents Introduction Semantic roles in general PropBank: Proto-roles FrameNet: Frame Semantics Summary INF5830 Introduction to Semantic Role Labeling 2(36) Introduction Semantics I Study of meaning, expressed in language; I Morphemes, words, phrases, sentences; I Lexical semantics; I Sentence semantics; I (Pragmatics: how the context affects meaning). INF5830 Introduction to Semantic Role Labeling 3(36) Introduction Semantics I Linguistic knowledge: meaning I Meaningful or not: I Word { flick vs blick I Sentence { John swims vs John metaphorically every I Several meanings (WSD): I Words { fish I Sentence { John saw the man with the binoculars I Same meaning (semantic similarity): I Word { sofa vs couch I Sentence { John gave Hannah a gift vs John gave a gift to Hannah I Truth conditions: I All kings are male I Molybdenum conducts electricity I Entailment: I Alfred murdered the librarian I The librarian is dead I Participant roles: John is the `giver', Hannah is the `receiver' INF5830 Introduction to Semantic Role Labeling 4(36) Introduction Representing events I We want to understand the event described by these sentences: 1. IBM bought Spark 2. IBM acquired Spark 3. Spark was acquired by IBM 4. The owners of Spark sold it to IBM I Dependency parsing is insufficient. UDPipe will give us simple relations between verbs and arguments: 1. (buy, nsubj, IBM), (buy, obj, Spark) 2.
    [Show full text]
  • Using Frame Semantics in Natural Language Processing
    Using Frame Semantics in Natural Language Processing Apoorv Agarwal Daniel Bauer Owen Rambow Dept. of Computer Science Dept. of Computer Science CCLS Columbia University Columbia University Columbia University New York, NY New York, NY New York, NY [email protected] [email protected] [email protected] Abstract the notion of a social event (Agarwal et al., 2010), We summarize our experience using a particular kind of event which involves (at least) FrameNet in two rather different projects two people such that at least one of them is aware in natural language processing (NLP). of the other person. If only one person is aware We conclude that NLP can benefit from of the event, we call it Observation (OBS): for FrameNet in different ways, but we sketch example, someone is talking about someone else some problems that need to be overcome. in their absence. If both people are aware of the event, we call it Interaction (INR): for example, 1 Introduction one person is telling the other a story. Our claim We present two projects at Columbia in which we is that links in social networks are in fact made use FrameNet. In these projects, we do not de- up of social events: OBS social events give rise velop basic NLP tools for FrameNet, and we do to one-way links, and INR social events to two- not develop FramNets for new languages: we sim- way links. For more information, see (Agarwal ply use FrameNet or a FrameNet parser in an NLP and Rambow, 2010; Agarwal et al., 2013a; Agar- application.
    [Show full text]
  • Event-Based Knowledge Reconciliation Using Frame Embeddings And
    Knowledge-Based Systems 135 (2017) 192–203 Contents lists available at ScienceDirect Knowle dge-Base d Systems journal homepage: www.elsevier.com/locate/knosys Event-base d knowle dge reconciliation using frame emb e ddings and frame similarity ∗ Mehwish Alam a, Diego Reforgiato Recupero b,d, , Misael Mongiovi c, Aldo Gangemi a,d, Petar Ristoski e a Université Paris 13, 99 avenue JB Clément, Villetaneuse, Paris 93430, France b Università degli Studi di Cagliari, Department of Mathematics and Computer Science, Via Ospedale 72, Cagliari 09124, Italy c CNR, ISTC, Catania, Italy d CNR, ISTC, Via S. Martino della Battaglia 44, Rome, Italy e University of Mannheim, Mannheim, Germany a r t i c l e i n f o a b s t r a c t Article history: This paper proposes an evolution over MERGILO, a tool for reconciling knowledge graphs extracted from Received 6 April 2017 text, using graph alignment and word similarity. The reconciled knowledge graphs are typically used Revised 9 August 2017 for multi-document summarization, or to detect knowledge evolution across document series. The main Accepted 14 August 2017 point of improvement focuses on event reconciliation i.e., reconciling knowledge graphs generated by text Available online 16 August 2017 about two similar events described differently. In order to gather a complete semantic representation of Keywords: events, we use FRED semantic web machine reader, jointly with Framester, a linguistic linked data hub Knowledge reconciliation represented using a novel formal semantics for frames. Framester is used to enhance the extracted event Frame semantics knowledge with semantic frames.
    [Show full text]
  • Out-Of-Domain Framenet Semantic Role Labeling
    Out-of-domain FrameNet Semantic Role Labeling Silvana Hartmann§†, Ilia Kuznetsov†, Teresa Martin§†, Iryna Gurevych§† Research Training Group AIPHES Ubiquitous§ Knowledge Processing (UKP) Lab Department† of Computer Science, Technische Universitat¨ Darmstadt http://www.ukp.tu-darmstadt.de Abstract on a range of benchmark datasets. This is crucial as the demand for semantic textual analysis of large- Domain dependence of NLP systems is one scale web data keeps growing. of the major obstacles to their application in large-scale text analysis, also restrict- Based on FrameNet (Fillmore et al., 2003), ing the applicability of FrameNet semantic FrameNet SRL extracts frame-semantic structures role labeling (SRL) systems. Yet, current on the sentence level that describe a specific FrameNet SRL systems are still only eval- situation centered around a semantic predicate, uated on a single in-domain test set. For often a verb, and its participants, typically the first time, we study the domain depen- syntactic arguments or adjuncts of the predicate. frame dence of FrameNet SRL on a wide range of The predicate is assigned a label, essentially benchmark sets. We create a novel test set a word sense label, that defines the situation and semantic roles for FrameNet SRL based on user-generated determines the of the participants. web text and find that the major bottleneck The following sentence from FrameNet provides Grinding for out-of-domain FrameNet SRL is the an example of the frame and its roles: frame identification step. To address this [The mill]Grinding cause grindsGrinding [the problem, we develop a simple, yet efficient malt]P atient [to grist]Result.
    [Show full text]
  • Verbnet Guidelines
    VerbNet Annotation Guidelines 1. Why Verbs? 2. VerbNet: A Verb Class Lexical Resource 3. VerbNet Contents a. The Hierarchy b. Semantic Role Labels and Selectional Restrictions c. Syntactic Frames d. Semantic Predicates 4. Annotation Guidelines a. Does the Instance Fit the Class? b. Annotating Verbs Represented in Multiple Classes c. Things that look like verbs but aren’t i. Nouns ii. Adjectives d. Auxiliaries e. Light Verbs f. Figurative Uses of Verbs 1 Why Verbs? Computational verb lexicons are key to supporting NLP systems aimed at semantic interpretation. Verbs express the semantics of an event being described as well as the relational information among participants in that event, and project the syntactic structures that encode that information. Verbs are also highly variable, displaying a rich range of semantic and syntactic behavior. Verb classifications help NLP systems to deal with this complexity by organizing verbs into groups that share core semantic and syntactic properties. VerbNet (Kipper et al., 2008) is one such lexicon, which identifies semantic roles and syntactic patterns characteristic of the verbs in each class and makes explicit the connections between the syntactic patterns and the underlying semantic relations that can be inferred for all members of the class. Each syntactic frame in a class has a corresponding semantic representation that details the semantic relations between event participants across the course of the event. In the following sections, each component of VerbNet is identified and explained. VerbNet: A Verb Class Lexical Resource VerbNet is a lexicon of approximately 5800 English verbs, and groups verbs according to shared syntactic behaviors, thereby revealing generalizations of verb behavior.
    [Show full text]
  • Rs and IOS Press
    ECAI 2014 57 T. Schaub et al. (Eds.) © 2014 The Authors and IOS Press. This article is published online with Open Access by IOS Press and distributed under the terms of the Creative Commons Attribution Non-Commercial License. doi:10.3233/978-1-61499-419-0-57 Effective and Robust Natural Language Understanding for Human-R obot Interaction Emanuele Bastianelli(‡), Giuseppe Castellucci(•), Danilo Croce(†), Roberto Basili(†), Daniele Nardi() (†) DII, (‡) DICII, (•) DIE - University of Rome Tor Vergata - Rome, Italy {bastianelli,castellucci}@ing.uniroma2.it, {basili,croce}@info.uniroma2.it () DIAG - Sapienza University of Rome - Rome, Italy [email protected] Abstract. Robots are slowly becoming part of everyday life, as knowledge). Moreover, in HRI, different scenarios need to be con- they are being marketed for commercial applications (viz. telepres- sidered. In some situations, e.g. rescue robotic tasks, the precision is ence, cleaning or entertainment). Thus, the ability to interact with crucial and no command misunderstanding is allowed. non-expert users is becoming a key requirement. Even if user ut- Recently, works in the interpretation of natural language instruc- terances can be efficiently recognized and transcribed by Automatic tions for robots in controlled environments have been focused on Speech Recognition systems, several issues arise in translating them specific subsets of the human language. The interpretation process into suitable robotic actions. In this paper, we will discuss both ap- is mainly carried out through the adoption of specific grammars that proaches providing two existing Natural Language Understanding describe the human language allowed. It gives, for example, a robotic workflows for Human Robot Interaction.
    [Show full text]
  • UMCC DLSI: Textual Similarity Based on Lexical-Semantic Features
    UMCC_DLSI: Textual Similarity based on Lexical-Semantic features Alexander Chávez, Antonio Fernández Orquín, Andrés Montoyo, Rafael Muñoz Héctor Dávila, Yoan Gutiérrez, Armando DLSI, University of Alicante Carretera de Collazo, José I. Abreu San Vicente S/N Alicante, Spain. DI, University of Matanzas {montoyo,rafael}@dlsi.ua.es Autopista a Varadero km 3 ½ Matanzas, Cuba. {alexander.chavez, tony, hector.davila, yoan.gutierrez, armando.collazo, jose.abreu}@umcc.cu necessarily a student). In addition, STS differs Abstract from TE and Paraphrase in that, rather than being a binary yes/no decision, STS is a This paper describes the specifications and results of UMCC_DLSI system, which similarity-graded notion (e.g. a student is more participated in the Semantic Textual similar to a person than a dog to a person). Similarity task (STS) of SemEval-2013. Our This graded bidirectional is useful for NLP supervised system uses different types of tasks such as Machine Translation (MT), lexical and semantic features to train a Information Extraction (IE), Question Bagging classifier used to decide the correct Answering (QA), and Summarization. Several option. Related to the different features we semantic tasks could be added as modules in the can highlight the resource ISR-WN used to STS framework, “such as Word Sense extract semantic relations among words and Disambiguation and Induction, Lexical the use of different algorithms to establish Substitution, Semantic Role Labeling, Multiword semantic and lexical similarities. In order to establish which features are the most Expression detection and handling, Anaphora appropriate to improve STS results we and Co-reference resolution, Time and Date 1 participated with three runs using different resolution and Named Entity, among others” set of features.
    [Show full text]
  • Exploring the Integration of Wordnet and Framenet
    Exploring the Integration of WordNet and FrameNet Egoitz Laparra German Rigau Montse Cuadros IXA group, UPV/EHU IXA group, UPV/EHU TALP Research Center, UPC Donostia, Spain Donostia, Spain Barcelona, Spain [email protected] [email protected] [email protected] Abstract However, building large and rich enough predi- cate models for broad–coverage semantic process- This paper presents a novel automatic approach to ing takes a great deal of expensive manual effort partially integrate FrameNet and WordNet. In that involving large research groups during long peri- way we expect to extend FrameNet coverage, to ods of development. Thus, the coverage of cur- enrich WordNet with frame semantic information rently available predicate-argument resources is and possibly to extend FrameNet to languages other still unsatisfactory. For example, (Burchardt et than English. The method uses a knowledge-based al., 2005) or (Shen and Lapata, 2007) indicate the Word Sense Disambiguation algorithm for match- limited coverage of FrameNet as one of the main ing the FrameNet lexical units to WordNet synsets. problems of this resource. In fact, FrameNet1.3 Specifically, we exploit a graph-based Word Sense covers around 10,000 lexical-units while for in- Disambiguation algorithm that uses a large-scale stance, WordNet3.0 contains more than 150,000 knowledge-base derived from existing resources. words. Furthermore, the same effort should be in- We have developed and tested additional versions vested for each different language (Subirats and of this algorithm showing substantial improvements Petruck, 2003). Following the line of previous over state-of-the-art results. Finally, we show some works (Shi and Mihalcea, 2005), (Burchardt et al., examples and figures of the resulting semantic re- 2005), (Johansson and Nugues, 2007), (Pennac- source.
    [Show full text]