Lambda-Calculus and Formal Language Theory Sylvain Salvati

Total Page:16

File Type:pdf, Size:1020Kb

Lambda-Calculus and Formal Language Theory Sylvain Salvati Lambda-calculus and formal language theory Sylvain Salvati To cite this version: Sylvain Salvati. Lambda-calculus and formal language theory. Computer Science [cs]. Université de Bordeaux, 2015. tel-01253426 HAL Id: tel-01253426 https://hal.archives-ouvertes.fr/tel-01253426 Submitted on 10 Jan 2016 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. UNIVERSITÉ DE BORDEAUX ÉCOLE DOCTORALE DE MATHÉMATIQUE ET INFORMATIQUE DE BORDEAUX Habilitation à diriger les recherches Soutenue publiquement le 10 décembre 2015 Sylvain Salvati Lambda-calculus and formal language theory Jury: Rapporteurs: Thomas Ehrhard - Directeur de recherche CNRS / PPS Giorgio Satta - Professeur Università Padua, Italie Sophie Tison - Professeur Université de Lille / CRIStAL Examinateurs: Bruno Courcelle - Professeur émérite Université de Bordeaux / LaBRI Philippe de Groote - Directeur de recherche INRIA / Loria Jérôme Leroux - Directeur de recherche CNRS / LaBRI Contents Contents iii 1 Introduction 1 1.1 Research context . 1 1.2 Research orientation and main contributions . 2 1.3 Organization of the document . 5 2 Preliminaries and recognizability 7 2.1 Simply typed λ-calculus . 8 2.2 Special constants . 10 2.3 Some syntactic restrictions on simply typed λ-calculus . 12 2.4 Models of λ-calculi . 14 2.5 Recognizability in simply typed λ-calculus . 21 2.6 Conclusion and perspective . 26 3 Abstract Categorial Grammars 29 3.1 Abstract Categorial Grammars . 30 3.2 Expressiveness . 34 3.3 Parsing Algorithms . 39 3.4 OI grammars . 42 3.5 Conclusion and perspectives . 47 4 Mildly Context Sensitive Languages 51 4.1 On mild-context sensitivity and its limitations . 53 4.2 Multiple Context Free Grammars . 59 4.3 The language MIX . 62 4.4 Iteration properties for MCFGs . 70 4.5 Classifying Mildly Context Sensitive Formalisms . 72 4.6 Conclusion and perspectives . 73 5 Logic and Verification 77 5.1 Schematology . 79 5.2 Parity automata . 81 5.3 Wreath product and weak parity automata . 87 5.4 λY -calculus and abstract machines . 90 iii 5.5 A λY -model for parity automata . 96 5.6 Adequacy of the model via parity games . 102 5.7 Conclusion and perspectives . 109 6 Conclusion 113 Bibliography . 116 Personal bibliography . 134 iv Abstract Formal and symbolic approaches have offered computer science many application fields. The rich and fruitful connection between logic, au- tomata and algebra is one such approach. It has been used to model natural languages as well as in program verification. In the mathemat- ics of language it is able to model phenomena ranging from syntax to phonology while in verification it gives model checking algorithms to a wide family of programs. This thesis extends this approach to simply typed lambda-calculus by providing a natural extension of recognizability to programs that are representable by simply typed terms. This notion is then applied to both the mathematics of language and program verification. In the case of the mathematics of language, it is used to generalize parsing algorithms and to propose high-level methods to describe languages. Concerning program verification, it is used to describe methods for verifying the behavioral properties of higher-order programs. In both cases, the link that is drawn between finite state methods and denotational semantics provide the means to mix powerful tools coming from the two worlds. v Acknowledgments First of all, I would like to thank the members of the jury for the attention the have paid to my work. I am grateful to Burno Courcelle for having accepted to be the president of the jury. When I was writing this document, I realized how much his work has influenced mine in many respects. I thank the reviewers for having read this document in details. Moreover, as this document reports on work that I did in two different fields, I must thank them for the patience they had to go through chapters which had little to do with their daily research. I thank Thomas Ehrhard for having done this with computational linguistics and also for the discussions I could have with him during the past years on denotational semantics. Giorgio Satta had the difficult task to accommodate the peculiarities of the French habilitation and I am very happy that he accepted to do this. The third reviewer is Sophie Tison who has a high profile in automata theory. I have remarked that the community working on automata does not like λ-calculus so much, I am thankful to her for having accepted to have overcome this reluctance. I am very pleased that Jérôme Leroux accepted to be part of the jury. First because, I really like his work and also, because, now, as the head of the team Méthodes formelles, he represents the stimulating environment in which my work has grown. I am glad that Philippe de Groote is in this jury. I started research with him and, still, in the rare occasions that we find to discuss research topics or technical problems, I am always impressed by the elegance and clarity of his ideas. I want to thank the PoSET team, David Janin and Myriam de Sainte- Catherine with whom I am trying to find the best tune. When I arrived at LaBRI, I was immediately welcome by the team Méthodes formelles. Not only did it provide me with a strong scientific environment, but also could I have very stimulating discussions with its members. Among these people, I address special thanks to Géraud Sénizergues whose vivid enthusiasm and joyful pleasure in research is strongly contagious; to Igor Walukiewicz who introduced me to the fascinating world of infinite objects; and to Anca Muscholl for her support and encouragement. Research is a matter of ideas and inspiration. It seems impossible to do anything of interest without the insights and the ideas of other researchers. vii This is true for me and I must say that I have had the chance to collaborate with very talented researchers to whom my work owes most. I want to thank Makoto Kanazawa who has provided me with a postdoc when I needed one, for the common work and his patient listening to my so often wrong intuitions. I thank also Greg Kobele for the discussions on linguistics and the formal work. He is the only person I know who is combining at such a high degree an expertise in linguistic and in mathematics. Ryo Yoshinaka did his PhD nearly at the same time as I did and I remember cheerfully the moment when I could work with him. I want to thank my PhD students Pierre and Jérôme and my master students for having trusted me as a superviser. We still have not produced research together, but I hope this will happen before he retires, so I thank Pierre Casteran for teaching me CoQ and sharing with me his smart ideas about coding in the calculus of constructions. Finally I would like to thank my wife for her constant support and for taking care of everything at home when I am away. A final word for my sons, Arthur and Timothée, to whom I want to say again how much I care for them. viii Chapter 1 Introduction 1.1 Research context This document is a synthesis of the research that I carried out in the past ten years and is part of my file to obtain the habilitation à diriger les recherches.I review the work I have done since I obtained my PhD in 2005. I did this work from the end of 2005 until the beginning of 2007 as a postdoc at the National Institute of Informatics in Tokyo under the supervision of Makoto Kanazawa. I then joined INRIA Bordeaux Sud-Ouest as a researcher in the project Signes. My work has taken place in LaBRI and I have been strongly influenced by its scientific environment. While I have been in the team Signes, I have been working on formalisms for natural language, aiming at understanding their algorithmic properties, their limitations and their relations. In 2011, when the team Signes was ended, I was part of the ANR project FREC, on Frontiers of RECognizability. This project allowed me to apply methods I had developed for grammatical formalisms to verification problems and infinitary systems. In this period of time I have had the opportunity to supervise two PhD students: • Pierre Bourreau who defended his thesis in 2012. He worked on general- izing parsing methods for abstract categorial grammars based on datalog programs. • Jérôme Kirman who is expected to defend his thesis by the end of the year. He worked on high-level modeling of natural language based on logics related to finite state automata. In the context of FREC, I have supervised the postdoctoral studies of Lau- rent Braud on higher-order schemes. I also supervised a number of master students on various topics related to formal language theory. 1 1.2 Research orientation and main contributions My research activities find applications in two different fields: mathematics of language and verification. In my work I do not really make a distinction between those two seemingly different fields. Indeed, ideas or tools I use for solving a problem in one field may then find some applications in the other. This is mainly due to the technical apparatus that I use: λ-calculus and formal language theory.
Recommended publications
  • A Type-Theoretical Analysis of Complex Verb Generation
    A Type-theoretical Analysis of Complex Verb Generation Satoshi Tojo Mitsubishi Research Institute, Inc. 2-22 Harumi 3, Chuo-ku Tokyo 104, Japan e-mail: [email protected], [email protected] Abstract hardly find a verb element in the target language, which corresponds with the original word exactly in Tense and aspect, together with mood and modality, meaning. However we also need to admit that the usually form the entangled structure of a complex verb. problem of knowledge representation of tense and as- They are often hard to translate by machines, because pect (namely time), or that of mood and modality is of both syntactic and semantic differences between lan- not only the problem of verb translation, but that of guages. This problem seriously affects upon the gen- the whole natural language understanding. In this pa- eration process because those verb components in in- per, in order to realize a type calculus in syntax, we terlingua are hardly rearranged correctly in the target depart from a rather mundane subset of tense, aspects, language. We propose here a method in which each and modMities, which will be argued in section 2. verb element is defined as a mathematical function ac- cording to its type of type theory. This formalism gives 1.2 The difference in the structure each element its legal position in the complex verb in the target language and certifies so-called partial trans- In the Japanese translation of (1): lation. In addition, the generation algorithm is totally oyoi-de-i-ta-rashii free from the stepwise calculation, and is available on parallel architecture.
    [Show full text]
  • Development of a General-Purpose Categorial Grammar Treebank
    Proceedings of the 12th Conference on Language Resources and Evaluation (LREC 2020), pages 5195–5201 Marseille, 11–16 May 2020 c European Language Resources Association (ELRA), licensed under CC-BY-NC Development of a General-Purpose Categorial Grammar Treebank Yusuke Kubota, Koji Mineshima, Noritsugu Hayashi, Shinya Okano NINJAL, Ochanomizu University, The University of Tokyo, idem. f10-2 Midori-cho, Tachikawa; 2-2-1 Otsuka, Bunkyo; 3-8-1 Komaba, Megurog, Tokyo, Japan [email protected], [email protected], fhayashi, [email protected] Abstract This paper introduces ABC Treebank, a general-purpose categorial grammar (CG) treebank for Japanese. It is ‘general-purpose’ in the sense that it is not tailored to a specific variant of CG, but rather aims to offer a theory-neutral linguistic resource (as much as possible) which can be converted to different versions of CG (specifically, CCG and Type-Logical Grammar) relatively easily. In terms of linguistic analysis, it improves over the existing Japanese CG treebank (Japanese CCGBank) on the treatment of certain linguistic phenomena (passives, causatives, and control/raising predicates) for which the lexical specification of the syntactic information reflecting local dependencies turns out to be crucial. In this paper, we describe the underlying ‘theory’ dubbed ABC Grammar that is taken as a basis for our treebank, outline the general construction of the corpus, and report on some preliminary results applying the treebank in a semantic parsing system for generating logical representations of sentences. Keywords: treebank, categorial grammar, Japanese, annotation 1. Introduction Table 1: Comparison with related work original corpus output This paper reports on the progress of the construction of a H&S Penn Treebank English CCG general-purpose categorial grammar treebank in Japanese Uematsu et al.
    [Show full text]
  • Direct Compositionality and Variable-Free Semantics: the Case of “Principle B”
    Direct Compositionality and Variable-Free Semantics: The Case of “Principle B” Drafty outline/handout of material to be presented at the Workshop on Direct Compositionality Pauline Jacobson Brown University 0. The big picture goals: (A) To argue that direct compositionality is a much simpler hypothesis about the organization of the grammar than the competing views It is, therefore, the view we should hope is correct. Apparent challenges to this view should perhaps lead us to rethink some of the underlying assumptions which give rise to these challenges. (B) To point out: a consequence of at least a reasonably strong version of direct compositionality is that structured representations (e.g., trees) play no actual role in the grammar: they are not something that grammatical rules/principles can “see”. They are just convenient representation for the lnguist (representing the syntactic proof system and the compositional semantics) (C) To point out the consequences of this with respect to principles regarding the distribution of pronouns (reflexives, etc.). Standard assumption: these require the grammar to include principles which are stated on non strictly-local chucks of representation Hence: the hypothesis of direct compositionality should inspire us to rethink such statements (D) To discuss a second way in which binding principles have traditionally been taken to challenge direct compositionality (at least in its strong form): • there are many cases where there are binding type effects (e.g., "binding" of pronouns, "binding" of reflexives to satisfy Principle A, Principle B violations, etc.) but where on the surface, there is no big enough chunk of representation Typical example : connectivity in specificational sentences (1) What John is is proud of himself.
    [Show full text]
  • Chapter 1 Negation in a Cross-Linguistic Perspective
    Chapter 1 Negation in a cross-linguistic perspective 0. Chapter summary This chapter introduces the empirical scope of our study on the expression and interpretation of negation in natural language. We start with some background notions on negation in logic and language, and continue with a discussion of more linguistic issues concerning negation at the syntax-semantics interface. We zoom in on cross- linguistic variation, both in a synchronic perspective (typology) and in a diachronic perspective (language change). Besides expressions of propositional negation, this book analyzes the form and interpretation of indefinites in the scope of negation. This raises the issue of negative polarity and its relation to negative concord. We present the main facts, criteria, and proposals developed in the literature on this topic. The chapter closes with an overview of the book. We use Optimality Theory to account for the syntax and semantics of negation in a cross-linguistic perspective. This theoretical framework is introduced in Chapter 2. 1 Negation in logic and language The main aim of this book is to provide an account of the patterns of negation we find in natural language. The expression and interpretation of negation in natural language has long fascinated philosophers, logicians, and linguists. Horn’s (1989) Natural history of negation opens with the following statement: “All human systems of communication contain a representation of negation. No animal communication system includes negative utterances, and consequently, none possesses a means for assigning truth value, for lying, for irony, or for coping with false or contradictory statements.” A bit further on the first page, Horn states: “Despite the simplicity of the one-place connective of propositional logic ( ¬p is true if and only if p is not true) and of the laws of inference in which it participate (e.g.
    [Show full text]
  • 1 English Subjectless Tagged Sentences Paul Kay Department Of
    1 English subjectless tagged sentences Paul Kay Department of Linguistics University of California Berkeley, CA 94720 [email protected] 2 Abstract A colloquial English sentence like Fooled us, didn't they? contains a finite main verb but no expressed subject. The identity of the missing subject of fooled is recovered from the tag subject they: compare Fooled us, didn't she?, Fooled us, didn't you? This paper argues (1) that such subjectless tagged sentences (STSs) pose a problem for grammatical approaches based on movement and empty categories and (2) that STSs receive a revealing analysis as part of a finely articulated family of tagged sentence constructions when viewed within a non-derivational, constructional, multiple-inheritance-based approach.* *I would like to thank Peter Culicover, Liliane Haegeman, Charles Fillmore Andreas Kathol and Richard Oehrle for comments on previous versions of this paper, as well as an anonymous reviewer for Language. They have doubtless offered more good advice than I have accepted. 3 0. Introduction. It has been argued from several points of view that whatever can be done with empty categories (ecs) can be done without them (Ades and Steedman 1982, Gazdar et al. 1984, Kaplan and Zaenen 1989, Pollard and Sag 1994 chapter 9, Sag and Fodor 1994, Kay and Fillmore 1999, Sag 1999). It has also been argued that, because there is no hard evidence for their existence, linguistic theory would be better off dispensing with these unobservable entities (Pickering and Barry 1991, Sag and Fodor 1994, Sag 1999).1 The present paper purports to take the argument one step further by showing that there are things that can be done without empty categories that cannot be done with them, at least not with any of the ecs currently available.
    [Show full text]
  • Categorial Grammar and Lexical-Functional Grammar∗
    Categorial Grammar and Lexical-Functional Grammar¤ Reinhard Muskens Department of Linguistics Tilburg University The Netherlands Proceedings of the LFG01 Conference University of Hong Kong, Hong Kong Miriam Butt and Tracy Holloway King (Editors) 2001 CSLI Publications http://csli-publications.stanford.edu/ ¤I wish to thank the participants of LFG2001, especially Mary Dalrymple and Ron Kaplan, for valuable feedback. All comments are very welcome. Abstract This paper introduces ¸-grammar, a form of categorial grammar that has much in common with LFG. Like other forms of categorial grammar, ¸-grammars are multi-dimensional and their components are combined in a strictly parallel fashion. Grammatical representa- tions are combined with the help of linear combinators, closed pure ¸-terms in which each abstractor binds exactly one variable. Mathe- matically this is equivalent to employing linear logic, in use in LFG for semantic composition, but the method seems more practicable. While ¸-grammars could be used to formalize many approaches to grammatical theory, they are certainly natural as a basis for the formalization of LFG. This leads to a theory I would like to call ¸- LFG. In this paper it will be shown how the standard components of LFG can be set up in the framework. We will have descriptions of c-structure, descriptions of f-structure, and semantics. The di®erence between de¯ning and constraining information will be explained in terms of entailment, and requirements on long-distance paths in f- structure will be explained in terms of entailment in the presence of a simple set of axioms. 1 Introduction In this paper I want to discuss a version of Lexical-Functional Grammar (LFG) that is also a version of Categorial Grammar (CG).
    [Show full text]
  • The Categorial Fine-Structure of Natural Language
    1 The categorial fine-structure of natural language Johan van Benthem, Amsterdam & Stanford, March 2003 Abstract Categorial grammar analyzes linguistic syntax and semantics in terms of type theory and lambda calculus. A major attraction of this approach is its unifying power, as its basic function/ argument structures occur across the foundations of mathematics, language and computation. This paper considers, in a light example-based manner, where this elegant logical paradigm stands when confronted with the wear and tear of reality. Starting from a brief history of the Lambek tradition since the 1980s, we discuss three main issues: (a) the fit of the lambda calculus engine to characte- ristic semantic structures in natural language, (b) coexistence of the original type-theoretic and more recent modal interpretations of categorial logics, and (c) the place of categorial grammars in the total architecture of natural language, which involves mixtures of interpretation and inference. 1 From Montague Grammar to Categorial Grammar Logic and linguistics have had lively connections from Antiquity right until today (GAMUT 1991). A recurrent theme in this history is the categorial structure of language and ontology, from Aristotle's grammatical categories to Russell's theory of types in the foundations of mathematics. Further bridges were thrown as logic and linguistics developed, with Lambek 1958 as a major advance in sophistication, many years ahead of its time. Large-scale logical analysis of natural language really took off around 1970, thanks to Montague's work (Montague 1975, Partee 1997). This system connects linguistic structure and logical semantics in the following architecture. The pivotal deep structure are syntax trees formed by grammatical construction rules.
    [Show full text]
  • Chapter 3 Language Analysis and Understanding
    Chapter 3 Language Analysis and Understanding 3.1 Overview a b Annie Zaenen & Hans Uszkoreit a Rank Xerox ResearchCentre, Grenoble, France b Deutsches Forschungszentrum fur Kunstlic he Intelligenz and Universitat des Saarlandes, Saarbruc ken, Germany We understand larger textual units bycombining our understanding of smaller ones. The main aim of linguistic theory is to showhow these larger units of meaning arise out of the combination of the smaller ones. This is mo deled by means of a grammar. Computational linguistics then tries to implement this pro cess in an ecientway.Itis traditional to sub divide the task into syntax and semantics, where syntax describ es how the di erent formal elements of a textual unit, most often the sentence, can b e combined and semantics describ es how the interpretation is calculated. In most language technology applications the enco ded linguistic knowledge, i.e., the grammar, is separated from the pro cessing comp onents. The grammar consists of a lexicon, and rules that syntactically and semantically combine words and phrases into larger phrases and sentences. A variety of representation languages have b een develop ed for the enco ding of linguistic knowledge. Some of these languages are more geared towards conformity with formal linguistic theories, others are designed to facilitate certain pro cessing mo dels or sp ecialized applications. Several language technology pro ducts that are on the market to day employ annotated 109 110 Chapter 3: Language Analysis and Understanding phrase-structure grammars, grammars with several hundreds or thousands of rules describing di erent phrase typ es. Each of these rules is annotated by features and sometimes also by expressions in a programming language.
    [Show full text]
  • The Logic of Categorial Grammars: Lecture Notes Christian Retoré
    The Logic of Categorial Grammars: Lecture Notes Christian Retoré To cite this version: Christian Retoré. The Logic of Categorial Grammars: Lecture Notes. RR-5703, INRIA. 2005, pp.105. inria-00070313 HAL Id: inria-00070313 https://hal.inria.fr/inria-00070313 Submitted on 19 May 2006 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE The Logic of Categorial Grammars Lecture Notes Christian Retoré N° 5703 Septembre 2005 Thème SYM apport de recherche ISRN INRIA/RR--5703--FR+ENG ISSN 0249-6399 The Logic of Categorial Grammars Lecture Notes Christian Retoré ∗ Thème SYM — Systèmes symboliques Projet Signes Rapport de recherche n° 5703 — Septembre 2005 —105 pages Abstract: These lecture notes present categorial grammars as deductive systems, and include detailed proofs of their main properties. The first chapter deals with Ajdukiewicz and Bar-Hillel categorial grammars (AB grammars), their relation to context-free grammars and their learning algorithms. The second chapter is devoted to the Lambek calculus as a deductive system; the weak equivalence with context free grammars is proved; we also define the mapping from a syntactic analysis to a higher-order logical formula, which describes the seman- tics of the parsed sentence.
    [Show full text]
  • An Experimental Approach to Linguistic Representation
    BEHAVIORAL AND BRAIN SCIENCES (2017), Page 1 of 61 doi:10.1017/S0140525X16002028, e282 An experimental approach to linguistic representation Holly P. Branigan Department of Psychology, University of Edinburgh, Edinburgh, EH8 9JZ, United Kingdom [email protected] http://www.ed.ac.uk/profile/holly-branigan Martin J. Pickering Department of Psychology, University of Edinburgh, Edinburgh, EH8 9JZ, United Kingdom [email protected] http://www.ed.ac.uk/profile/martin-pickering Abstract: Within the cognitive sciences, most researchers assume that it is the job of linguists to investigate how language is represented, and that they do so largely by building theories based on explicit judgments about patterns of acceptability – whereas it is the task of psychologists to determine how language is processed, and that in doing so, they do not typically question the linguists’ representational assumptions. We challenge this division of labor by arguing that structural priming provides an implicit method of investigating linguistic representations that should end the current reliance on acceptability judgments. Moreover, structural priming has now reached sufficient methodological maturity to provide substantial evidence about such representations. We argue that evidence from speakers’ tendency to repeat their own and others’ structural choices supports a linguistic architecture involving a single shallow level of syntax connected to a semantic level containing information about quantification, thematic relations, and information structure, as well as to a phonological level. Many of the linguistic distinctions often used to support complex (or multilevel) syntactic structure are instead captured by semantics; however, the syntactic level includes some specification of “missing” elements that are not realized at the phonological level.
    [Show full text]
  • Categorial Grammars
    PART 8: CATEGORIAL GRAMMARS Categorial grammar. Adjukiewicz 1935, Bar-Hillel 1953 Bidirectional Categorial grammar: CATB is the smallest set such that: 1. CAT0 is a finite subset of CAT 2. If X, Y CAT then X/Y CAT and X\Y CAT Interpretation: if α X and β X\Y then αβ Y left-concatenation if α X/Y and β Y then αβ X right-concatenation Uni-directional Categorial grammar: CAT is the smallest set such that: 1. CAT0 is a finite subset of CAT 2. If X, Y CAT then X/Y CAT Interpretation: if α X/Y and β Y then αβ X right-concatenation Examples: Bi-directional: Assume basic categories: DP, N, S D = DP/N IV = DP\S TV = IV/DP ADJ = N/N P = (IV/IV)/DP P = (N/N)/DP Examples: IV = DP\S IV forms an S with an NP on its left TV = IV/DP TV forms an IV with an NP on its right Hence: If Ronya DP, and purrs DP\S then Ronya purrs S. Ronya + purrs Ronya purrs DP DP\S S strokes + Ronya strokes Ronya (DP\S)/DP DP (DP\S) Pat + strokes Ronya Pat strokes Ronya DP (DP\S) S 216 Uni-directional: Assume basic categories IV, N, S DP = S/IV D = DP/ N TV = IV/DP ADJ = N/N P = (IV/IV)/DP P = (N/N)/DP Hence: If Ronya S/IV, and purrs IV then Ronya purrs S. Ronya + purrs Ronya purrs S/IV IV S strokes + Ronya strokes Ronya IV/(S/IV) S/IV IV Pat + strokes Ronya Pat strokes Ronya S/IV IV S Fact: (Bar-Hillel et.
    [Show full text]
  • Introduction to Categorial Grammar
    ACS Syntax and Semantics of Natural Language Lecture 1: Introduction to Categorial Grammar Stephen Clark Natural Language and Information Processing (NLIP) Group [email protected] Categorial Grammar (CG) 2 • Main responsibility for defining syntactic form is in the lexicon • Hence CG is a lexicalized theory of grammar – along with other theories of grammar such as HPSG, TAG, LFG, ... • Attractive linguistically because all language-dependent properties re- side in the lexicon – small number of combination rules are language-invariant • Also attractive computationally; e.g. supertagging for Categorial Gram- mar leads to highly efficient parsing (Clark and Curran, 2007) Connection with Semantics 3 • Categorial Grammar has a strong commitment to Frege’s Principle of Compositionality (along with Montague from the 70s): • The meaning of a phrase is a function of the meanings of the parts of the phrase and how those parts are put together – mathematically often described as a homomorphism (structure-preserving mapping) between syntactic and semantic representations (more on this later ...) Contrast with Phrase-Structure Rules 4 • Early Chomskian approach and much work in Generative Grammar uses rewrite rules or productions (as in a Context Free Grammar): S → NP VP VP → TV NP TV → {likes, sees,... } • Categorial Grammar captures the same information by assigning a func- tional type, or category, to grammatical entities • Has roots in early work by Polish mathematician Ajdukiewicz (1935) and even earlier in Russel’s theory of types Lexical Categories 5 • An elementary syntactic structure – a lexical category – is assigned to each word in a sentence, eg: walked: S\NP ‘give me an NP to my left and I return a sentence’ • Think of the lexical category for a verb as a function: NP is the argu- ment, S the result, and the slash indicates the direction of the argument Lexical Categories 6 • Atomic categories: S, N , NP, PP, ..
    [Show full text]