German Prepositions and Their Kin. a Survey with Respect to the Resolution
Total Page:16
File Type:pdf, Size:1020Kb
German prepositions and their kin. A survey with respect to the resolution of PP attachment ambiguities Martin Volk Stockholm University Department of Linguistics SE-10691 Stockholm [email protected] Abstract weekly computer science newspaper. In ad- This paper surveys German prepositions dition to this training corpus, we prepared and their relatives: contracted prepositions, a 3000 sentence corpus with manually an- pronominal adverbs, and reciprocal pro- notated syntax trees. From this treebank nouns. We elaborate on corpus frequencies we extracted over 4000 test cases with am- for these and on their properties with respect biguously positioned PPs for the evaluation to PP attachment. We show that prepo- of the disambiguation method. We will call sitions and contracted prepositions can be these test cases the ‘CZ test set’. handled together. They show an overall at- As a basis for this study we surveyed Ger- tachment tendency towards the noun. But man prepositions and their relatives and we pronominal adverbs and reciprocal pronouns checked for prepositions, contracted prepo- show an overall attachment tendency to- sitions, pronominal adverbs and reciprocal wards the verb and therefore must be treated pronouns whether they can mutually benefit separately.1 from each other with respect to attachment Keywords: Corpus linguistics, ambigu- tendencies. ity resolution, unsupervised learning 2 German prepositions 1 Introduction Prepositions in German are a class of words Any computer system for natural language relating linguistic elements to each other processing has to struggle with the problem with respect to a semantic dimension such of ambiguities. If the system is meant to ex- as local, temporal, causal or modal. They tract precise information from a text, these do not inflect and cannot function by them- ambiguities must be resolved. One of the selves as a sentence unit (cf. [Bußmann, most frequent ambiguities arises from the at- 1990]). But, unlike other function words, a tachment of prepositional phrases (PPs). A German preposition governs the grammati- PP that follows a noun (in English or Ger- cal case of its argument (genitive, dative or man) can be attached to the noun or to the accusative). Frequent German prepositions verb. We did an in-depth study on unsu- are an, f¨ur,in, mit, zwischen. pervised statistical methods to resolve such Prepositions are considered to be a closed ambiguities in German sentences based on word class. Nevertheless it is difficult to de- cooccurrence values derived from a shallow termine the exact number of German prepo- parsed corpus (see [Volk, 2001] and [Volk, sitions. [Schr¨oder, 1990] speaks of “more 2002]). than 200 prepositions”, but his “Lexikon Corpus processing consisted of proper deutscher Pr¨apositionen” lists only 110 of name recognition and classification, Part- them. In this dictionary all entries are of-Speech tagging, lemmatization, phrase marked with their case requirement and chunking, and clause boundary detection. their semantic features. For instance, ohne We used a corpus of more than 5 million requires the accusative and is marked with words from the Computer-Zeitung (CZ), a the semantic functions instrumental, modal, conditional and part-of.2 1This paper is based on my research at the Uni- 2 versity of Zurich in a project supported by the See also [Klaus, 1999] for a detailed comparison Swiss National Science Foundation under grant 12- of the range of German prepositions as listed in a 54106.98. number of recent grammar books. The lexical database CELEX [Baayen et The most frequent homographic func- al., 1995] contains 108 German prepositions tions are separable verb prefix and conjunc- with frequency counts derived from corpora tion. Fortunately, these functions are clearly of the “Institut f¨urdeutsche Sprache”. This marked by their position within the clause. results in the arbitrary inclusion of n¨ordlich, A clause conjunction usually occurs at the nord¨ostlich,s¨udlich while ¨ostlich and west- beginning of a clause, and a separated verb lich are missing. prefix mostly occurs at the end of a clause Searching through 5.5 million tokens of (rechte Satzklammer). A part-of-speech tag- our tagged computer magazine corpus we ger can therefore disambiguate these cases.5 found around 540,000 preposition tokens Typical (i.e. frequent) prepositions are corresponding to 99 preposition types.3 monomorphemic words (e.g. an, auf, f¨ur,in, These counts do not include contracted mit, ¨uber, von, zwischen). Many of the less prepositions. A list of the 66 most frequent frequent prepositions are derived or complex. German prepositions with frequencies from They have turned into prepositions over time our corpus can be found in appendix A. and still show traces of their origin. They are An early frequency count for German by derived from other parts-of-speech such as [Meier, 1964] lists 18 prepositions among the 100 most frequent word forms. 17 out of ² nouns (e.g. angesichts, zwecks), these 18 prepositions are also in our top-20 list. Only gegen is missing which is on rank ² adjectives (e.g. fern, unweit), 23 in our corpus. This means that the usage ² participle forms of verbs (e.g. of the most frequent prepositions is stable entsprechend, w¨ahrend; ungeachtet), or over corpora and time. All frequent prepositions in German have ² lexicalized prepositional phrases (e.g. some homograph serving as anhand, aufgrund, zugunsten). ² separable verb prefix (e.g. ab, auf, mit, German prepositions typically do not al- zu), low compounding. It is generally not possi- 4 ble to form a new preposition by a concate- ² clause conjunction (e.g. bis, um) , nation of prepositions. The two exceptions ² adverb (e.g. auf, f¨ur,¨uber) in often id- are gegen¨uber and mitsamt. Other concate- iomatic expressions (e.g. auf und davon, nated prepositions have led to adverbs like ¨uber und ¨uber), inzwischen, mitunter, zwischendurch. [Helbig and Buscha, 1998] call the ² infinitive marker (zu), monomorphemic prepositions primary ² proper name component (von), or prepositions and the derived preposi- tions secondary prepositions. This ² predicative adjective (e.g. an, auf, aus, distinction is based on the fact that only in, zu as in Die Maschine ist an/aus. primary prepositions form prepositional Die T¨urist auf/zu.). objects, pronominal adverbs (cf. section 2.2) 3These figures are based on automatically as- and prepositional reciprocal pronouns (cf. signed part-of-speech tags. If the tagger systemat- section 2.3). ically mistagged a preposition, the counting proce- In addition, this distinction corresponds dure does not find it. In the course of the project to different case requirements. The primary we realized that this happened to the prepositions prepositions govern accusative (durch, f¨ur, a, via and voller as used in the following example gegen, ohne, um) or dative (aus, bei, mit, sentences (all examples in this paper are from the Computer-Zeitung, Konradin-Verlag, 1993-1997). nach, von, zu) or both (an, auf, hinter, in, (1) Derselbe Service in der Regionalzone (bis neben, ¨uber, unter, vor, zwischen). Most zu 50 Kilometern) kostet 23 Pfennig a 60 of the secondary prepositions govern gen- Sekunden. itive (angesichts, bez¨uglich, dank). Some (2) Master und Host kommunizieren via IPX. 5Note the high degree of ambiguity for zu which (3) Windows steckt voller eigener Fehler. can be a preposition zu ihm, a separated verb prefix sie sieht ihm zu, the infinitive marker ihn zu sehen, a 4[Jaworska, 1999] (p. 306) argues that “clause- predicative adjective das Fenster ist zu, an adjectival introducing preposition-like elements are indeed or adverb marker zu gross, zu sehr, or the ordinal prepositions”. number marker sie kommen zu zweit. prepositions (most notably w¨ahrend) are in the probability estimates in [Ratnaparkhi, the process of changing from genitive to da- 1998] except that Ratnaparkhi includes a tive. Some prepositions do not show overt back-off to the uniform distribution for the case requirements (je, pro, per; cf. [Schaeder, zero denominator case. We added special 1998]) and are used with determiner-less precautions for this case in our disambigua- noun phrases. tion algorithm. The cooccurrence values are Some prepositions show other idiosyncra- also very similar to the probability estimates cies. The preposition bis often takes another in [Hindle and Rooth, 1993]. preposition (in, um, zu as in 4) or combines We started by computing the cooccur- with the particle hin plus a preposition (as rence values over word forms for nouns, in 5). The preposition zwischen is special in prepositions, and verbs based on their part- that it requires a plural argument (as in 6), of-speech tags. In order to compute the pair often realized as a coordination of NPs (as frequencies freq(N1;P ), we search the train- in 7). ing corpus for all token pairs in which a noun is immediately followed by a preposi- (4) Portables mit 486er-Prozessor tion. The treatment of verb + preposition werden bis zu 20 Prozent billiger. cooccurrences is different from the treatment of N+P pairs since verb and preposition are (5) ... und ber¨ucksichtigtauch Daten seldom adjacent to each other in a German und Datentypen bis hin zu Arrays sentence. On the contrary, they can be far oder den Records im VAX-Fortran. apart from each other, the only restriction (6) Die Verbindungstopologie zwischen being that they cooccur within the same den Prozessoren l¨aßtsich als clause. We use the clause boundary infor- dreidimensionaler Torus darstellen. mation in our training corpus to enforce this restriction. For computing the cooccurrence (7) Durch Microsoft Access m¨ussensich values we accept only verbs and nouns with die Anwender nicht mehr l¨anger an occurrence frequency of more than 10. zwischen Bedienerfreundlich- With the N+P and V+P cooccurrence val- keit und Leistung entscheiden. ues for word forms we did a first evaluation over the CZ test set with the following sim- Results for PP attachment ple disambiguation algorithm.