DOCSLIB.ORG

Stochastic Lambda Calculus and Monads of Probability Distributions

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Stochastic Lambda Calculus and Monads of Probability Distributions Reprinted from the Conference Record of the 29th Annual ACM Symposium on Principles of Programming Languages (POPL'02) Stochastic Lambda Calculus and Monads of Probability Distributions Norman Ramsey Avi Pfeffer Division of Engineering and Applied Sciences Harvard University Abstract sidered as programming languages, the techniques used to build probabilistic models are weak. We would like to draw Probability distributions are useful for expressing the mean- on the large body of knowledge about programming lan- ings of probabilistic languages, which support formal mod- guages to design a good language that supports probabilis- eling of and reasoning about uncertainty. Probability dis- tic modeling. Stochastic lambda calculus, in which the deno- tributions form a monad, and the monadic de¯nition leads tations of expressions are probability distributions, not val- to a simple, natural semantics for a stochastic lambda cal- ues, is a suitable basis for such a language. To express the culus, as well as simple, clean implementations of common semantics of a stochastic lambda calculus, we exploit the queries. But the monadic implementation of the expectation monadic structure of probability distributions (Giry 1981; query can be much less e±cient than current best practices Jones and Plotkin 1989). in probabilistic modeling. We therefore present a language The contributions of this paper are: of measure terms, which can not only denote discrete prob- ² We show that the probability monad leads to simple, el- ability distributions but can also support the best known egant implementations of three queries commonly posed modeling techniques. We give a translation of stochastic of probabilistic models: expectation, sampling, and sup- lambda calculus into measure terms. Whether one trans- port. Using the monad as an intermediate form simpli- lates into the probability monad or into measure terms, the ¯es proofs of desirable properties, e.g., that the sampling results of the translations denote the same probability dis- function draws values from any model using appropriate tribution. probabilities. ² We show that the monadic implementation of expecta- 1. Introduction tion is potentially much less e±cient than techniques currently used in probabilistic reasoning. The problem Researchers have long modeled the behavior of agents using arises because a monad does not exploit intensional prop- logic, but logical models are a poor choice for dealing with erties of functions; it only applies functions. To support the uncertainty of the real world. For dealing with inherent an alternative implementation of expectation, we trans- uncertainty and with incomplete knowledge, probabilistic late stochastic lambda calculus into a simple language we models are better. call measure terms. By algebraic manipulation of mea- There are a variety of representations and reasoning tech- sure terms, we can express variable elimination, which is niques for probabilistic models. These techniques, which the standard technique for e±ciently computing expec- include Bayesian networks (Pearl 1988) and other kinds tation. Measure terms denote measures, and our trans- of graphical models (Jordan 1998), are centered around lation into measure terms is consistent with our monadic the structuring and decomposition of probability distribu- de¯nition of stochastic lambda calculus. tions. Recent work focuses on scaling up the techniques to deal with large, complex domains. Domains that re- Our work has implications for both design and imple- quire large-scale modeling techniques include medical di- mentation of probabilistic languages. For design, we show agnosis (Jaakkola and Jordan 1999) and military intelli- that one can support e±cient probabilistic reasoning sim- gence (Mahoney and Laskey 1998). ply by adding a choose operator to an ordinary func- As models grow large, it becomes more important to be tional language; it is not necessary to include language able to build them easily and to reuse the parts|but con- features that expose common implementation techniques such as variable elimination. For implementation, we Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are show that standard techniques of programming-language not made or distributed for pro£t or commercial advantage and that copies implementation|monadic interpreters and algebraic ma- bear this notice and the full citation on the £rst page. To copy otherwise, to nipulation of programs (including common-subexpression republish, to post on servers or to redistribute to lists, requires prior speci£c elimination)|can apply to probabilistic languages. Prob- permission and/or a fee. abilistic reasoners can enjoy the bene¯ts of higher-order, POPL ’02, Jan. 16-18, 2002 Portland, OR USA typed languages, without requiring undue e®ort from im- °c 2002 ACM ISBN 1-58113-450-9/02/01. $5.00 plementors. 154 2. Probabilistic models and queries Language for models & queries The simplest language we have found to describe probabilis- tic models is a lambda calculus in which expressions denote probability distributions. The primary means of creating interesting probability distributions is a new construct that Stochastic lambda calculus makes a probabilistic choice. choose p e1 e2 represents a linear combination of two distributions. Operationally, to take a value from the combined distribution, with proba- bility p we take a value from e1 and with probability 1 ¡ p Probability monad Measure terms we take a value from e2. 2.1. An example model Expectation Sampling Support Expectation To illustrate our ideas, we present a simple model of tra±c lights and drivers, using a Haskell-like notation. Tra±c Ovals are representations; boxes are queries lights are probabilistically red, yellow, or green. htra±c examplei´ Figure 1: Implementation paths light1 = dist [ 0.45 : Red, 0.1 : Yellow, 0.45 : Green ] dist is a version of choose that is extended to combine the expectation of the identity function. The probabil- two or more weighted distributions. Here it means that ity of an outcome satisfying predicate p is the expecta- light1 has value Red with probability 0:45, value Yellow tion of the function \x -> if p x then 1 else 0. Condi- with probability 0:1, and value Green with probability 0:45. tional probability can be computed from probability, since Drivers behave di®erently depending on the colors of the P (p j q) = P (p^q)¥P (q). In the example above, we can an- lights they see. A cautious driver is more likely to brake swer the question about the probability of a crash by build- than an aggressive driver. ing the probability distribution of crash cautious driver htra±c examplei+´ aggressive driver light1 and computing the probability cautious_driver light = of the identity predicate. case light of Sampling means drawing a value from the distribution. Red -> dist [ 0.2 : Braking, 0.8 : Stopped ] By sampling repeatedly, we can not only approximate ex- Yellow -> dist [ 0.9 : Braking, 0.1 : Driving ] pectation but also get an idea of the shape of a distribution, Green -> Driving or of some function over the distribution. Like true exper- aggressive_driver light = imental data, samples can be ¯t to analytic solutions to case light of equations; \Monte Carlo" techniques used in the physical Red -> dist [ 0.3 : Braking, 0.6 : Stopped, sciences rely on sampling. 0.1 : Driving ] Support tells us from what subset of the entire sample Yellow -> dist [ 0.1 : Braking, 0.9 : Driving ] space a sample might be drawn with nonzero probability. Green -> Driving It is seldom interesting by itself, but a good implementa- We estimate that if two drivers go through a single light tion of support can make it easier to compute expectations from di®erent streets, there is a 90% probability of a crash. e±ciently. Support therefore plays a signi¯cant role in our htra±c examplei+´ implementation. crash d1 d2 light = [ 0.90 : d1 light == Driving && 2.3. Implementing probabilistic models d2 (other light) == Driving, 0.10 : False ] This paper presents two representations that are useful for where other Red = Green answering queries about probabilistic models: probability other Green = Red monads and measure terms. Figure 1 shows the translations other Yellow = Yellow involved. 1. A user writes a model and a query using a domain- 2.2. speci¯c, probabilistic language. In this paper, we take Queries the language to be the stochastic lambda calculus that is Having de¯ned a probabilistic model, we might wish to ask de¯ned formally in Section 4. In practice, we would pre- questions about it. For example, if two drivers, one cau- fer a richer language, e.g., one providing types, modules, tious and one aggressive, are approaching light1, what is and either an explicit ¯xed-point operator or recursion the probability of a crash? This question and many others equations. Even in practice, however, stochastic lambda can be answered using three kinds of queries: expectation, calculus is a useful intermediate form. sampling, and support. 2. We translate the model into a more restricted target The expectation of a function h is the mean of h over form: a value in the probability monad, or a measure the distribution. Expectation subsumes some other queries term. Section 4 gives a translation into the probability as special cases. The mean value of a distribution is monad, the semantics of which we explain in Section 3. Section 6 gives a translation into measure terms. 155 3. We use the target form to answer the query. The prob- º(A) = ¹(s¡1(A)), where ¹ is the Lebesgue measure, which ability monad can answer all three kinds of query; mea- describes uniform distributions. We use this formulation sure terms are designed to answer expectation queries for its practical value: if you give us a way of sampling uni- e±ciently. formly on the unit interval, by applying s we'll give you a The probability monad is easy to implement in Haskell way of sampling from the probability distribution º.
Load more

Recommended publications
  • Lecture Notes on the Lambda Calculus 2.4 Introduction to Β-Reduction
    2.2 Free and bound variables, α-equivalence. 8 2.3 Substitution ............................. 10 Lecture Notes on the Lambda Calculus 2.4 Introduction to β-reduction..................... 12 2.5 Formal definitions of β-reduction and β-equivalence . 13 Peter Selinger 3 Programming in the untyped lambda calculus 14 3.1 Booleans .............................. 14 Department of Mathematics and Statistics 3.2 Naturalnumbers........................... 15 Dalhousie University, Halifax, Canada 3.3 Fixedpointsandrecursivefunctions . 17 3.4 Other data types: pairs, tuples, lists, trees, etc. ....... 20 Abstract This is a set of lecture notes that developed out of courses on the lambda 4 The Church-Rosser Theorem 22 calculus that I taught at the University of Ottawa in 2001 and at Dalhousie 4.1 Extensionality, η-equivalence, and η-reduction. 22 University in 2007 and 2013. Topics covered in these notes include the un- typed lambda calculus, the Church-Rosser theorem, combinatory algebras, 4.2 Statement of the Church-Rosser Theorem, and some consequences 23 the simply-typed lambda calculus, the Curry-Howard isomorphism, weak 4.3 Preliminary remarks on the proof of the Church-Rosser Theorem . 25 and strong normalization, polymorphism, type inference, denotational se- mantics, complete partial orders, and the language PCF. 4.4 ProofoftheChurch-RosserTheorem. 27 4.5 Exercises .............................. 32 Contents 5 Combinatory algebras 34 5.1 Applicativestructures. 34 1 Introduction 1 5.2 Combinatorycompleteness . 35 1.1 Extensionalvs. intensionalviewoffunctions . ... 1 5.3 Combinatoryalgebras. 37 1.2 Thelambdacalculus ........................ 2 5.4 The failure of soundnessforcombinatoryalgebras . .... 38 1.3 Untypedvs.typedlambda-calculi . 3 5.5 Lambdaalgebras .......................... 40 1.4 Lambdacalculusandcomputability . 4 5.6 Extensionalcombinatoryalgebras . 44 1.5 Connectionstocomputerscience .
    [Show full text]
  • Category Theory and Lambda Calculus
    Category Theory and Lambda Calculus Mario Román García Trabajo Fin de Grado Doble Grado en Ingeniería Informática y Matemáticas Tutores Pedro A. García-Sánchez Manuel Bullejos Lorenzo Facultad de Ciencias E.T.S. Ingenierías Informática y de Telecomunicación Granada, a 18 de junio de 2018 Contents 1 Lambda calculus 13 1.1 Untyped λ-calculus . 13 1.1.1 Untyped λ-calculus . 14 1.1.2 Free and bound variables, substitution . 14 1.1.3 Alpha equivalence . 16 1.1.4 Beta reduction . 16 1.1.5 Eta reduction . 17 1.1.6 Confluence . 17 1.1.7 The Church-Rosser theorem . 18 1.1.8 Normalization . 20 1.1.9 Standardization and evaluation strategies . 21 1.1.10 SKI combinators . 22 1.1.11 Turing completeness . 24 1.2 Simply typed λ-calculus . 24 1.2.1 Simple types . 25 1.2.2 Typing rules for simply typed λ-calculus . 25 1.2.3 Curry-style types . 26 1.2.4 Unification and type inference . 27 1.2.5 Subject reduction and normalization . 29 1.3 The Curry-Howard correspondence . 31 1.3.1 Extending the simply typed λ-calculus . 31 1.3.2 Natural deduction . 32 1.3.3 Propositions as types . 34 1.4 Other type systems . 35 1.4.1 λ-cube..................................... 35 2 Mikrokosmos 38 2.1 Implementation of λ-expressions . 38 2.1.1 The Haskell programming language . 38 2.1.2 De Bruijn indexes . 40 2.1.3 Substitution . 41 2.1.4 De Bruijn-terms and λ-terms . 42 2.1.5 Evaluation .
    [Show full text]
  • Plurals and Mereology
    Journal of Philosophical Logic (2021) 50:415–445 https://doi.org/10.1007/s10992-020-09570-9 Plurals and Mereology Salvatore Florio1 · David Nicolas2 Received: 2 August 2019 / Accepted: 5 August 2020 / Published online: 26 October 2020 © The Author(s) 2020 Abstract In linguistics, the dominant approach to the semantics of plurals appeals to mere- ology. However, this approach has received strong criticisms from philosophical logicians who subscribe to an alternative framework based on plural logic. In the first part of the article, we offer a precise characterization of the mereological approach and the semantic background in which the debate can be meaningfully reconstructed. In the second part, we deal with the criticisms and assess their logical, linguistic, and philosophical significance. We identify four main objections and show how each can be addressed. Finally, we compare the strengths and shortcomings of the mereologi- cal approach and plural logic. Our conclusion is that the former remains a viable and well-motivated framework for the analysis of plurals. Keywords Mass nouns · Mereology · Model theory · Natural language semantics · Ontological commitment · Plural logic · Plurals · Russell’s paradox · Truth theory 1 Introduction A prominent tradition in linguistic semantics analyzes plurals by appealing to mere- ology (e.g. Link [40, 41], Landman [32, 34], Gillon [20], Moltmann [50], Krifka [30], Bale and Barner [2], Chierchia [12], Sutton and Filip [76], and Champollion [9]).1 1The historical roots of this tradition include Leonard and Goodman [38], Goodman and Quine [22], Massey [46], and Sharvy [74]. Salvatore Florio [email protected] David Nicolas [email protected] 1 Department of Philosophy, University of Birmingham, Birmingham, United Kingdom 2 Institut Jean Nicod, Departement´ d’etudes´ cognitives, ENS, EHESS, CNRS, PSL University, Paris, France 416 S.
    [Show full text]
  • Computational Lambda-Calculus and Monads
    Computational lambda-calculus and monads Eugenio Moggi∗ LFCS Dept. of Comp. Sci. University of Edinburgh EH9 3JZ Edinburgh, UK [email protected] October 1988 Abstract The λ-calculus is considered an useful mathematical tool in the study of programming languages, since programs can be identified with λ-terms. However, if one goes further and uses βη-conversion to prove equivalence of programs, then a gross simplification1 is introduced, that may jeopardise the applicability of theoretical results to real situations. In this paper we introduce a new calculus based on a categorical semantics for computations. This calculus provides a correct basis for proving equivalence of programs, independent from any specific computational model. 1 Introduction This paper is about logics for reasoning about programs, in particular for proving equivalence of programs. Following a consolidated tradition in theoretical computer science we identify programs with the closed λ-terms, possibly containing extra constants, corresponding to some features of the programming language under con- sideration. There are three approaches to proving equivalence of programs: • The operational approach starts from an operational semantics, e.g. a par- tial function mapping every program (i.e. closed term) to its resulting value (if any), which induces a congruence relation on open terms called operational equivalence (see e.g. [Plo75]). Then the problem is to prove that two terms are operationally equivalent. ∗On leave from Universit`a di Pisa. Research partially supported by the Joint Collaboration Contract # ST2J-0374-C(EDB) of the EEC 1programs are identified with total functions from values to values 1 • The denotational approach gives an interpretation of the (programming) lan- guage in a mathematical structure, the intended model.
    [Show full text]
  • Continuation Calculus
    Eindhoven University of Technology MASTER Continuation calculus Geron, B. Award date: 2013 Link to publication Disclaimer This document contains a student thesis (bachelor's or master's), as authored by a student at Eindhoven University of Technology. Student theses are made available in the TU/e repository upon obtaining the required degree. The grade received is not published on the document as presented in the repository. The required complexity or quality of research of student theses may vary by program, and the required minimum study period may vary in duration. General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain Continuation calculus Master’s thesis Bram Geron Supervised by Herman Geuvers Assessment committee: Herman Geuvers, Hans Zantema, Alexander Serebrenik Final version Contents 1 Introduction 3 1.1 Foreword . 3 1.2 The virtues of continuation calculus . 4 1.2.1 Modeling programs . 4 1.2.2 Ease of implementation . 5 1.2.3 Simplicity . 5 1.3 Acknowledgements . 6 2 The calculus 7 2.1 Introduction . 7 2.2 Definition of continuation calculus . 9 2.3 Categorization of terms . 10 2.4 Reasoning with CC terms .
    [Show full text]
  • Semantic Theory Week 4 – Lambda Calculus
    Semantic Theory Week 4 – Lambda Calculus Noortje Venhuizen University of Groningen/Universität des Saarlandes Summer 2015 1 Compositionality The principle of compositionality: “The meaning of a complex expression is a function of the meanings of its parts and of the syntactic rules by which they are combined” (Partee et al.,1993) Compositional semantics construction: • compute meaning representations for sub-expressions • combine them to obtain a meaning representation for a complex expression. Problematic case: “Not smoking⟨e,t⟩ is healthy⟨⟨e,t⟩,t⟩” ! 2 Lambda abstraction λ-abstraction is an operation that takes an expression and “opens” specific argument positions. Syntactic definition: If α is in WEτ, and x is in VARσ then λx(α) is in WE⟨σ, τ⟩ • The scope of the λ-operator is the smallest WE to its right. Wider scope must be indicated by brackets. • We often use the “dot notation” λx.φ indicating that the λ-operator takes widest possible scope (over φ). 3 Interpretation of Lambda-expressions M,g If α ∈ WEτ and v ∈ VARσ, then ⟦λvα⟧ is that function f : Dσ → Dτ M,g[v/a] such that for all a ∈ Dσ, f(a) = ⟦α⟧ If the λ-expression is applied to some argument, we can simplify the interpretation: • ⟦λvα⟧M,g(A) = ⟦α⟧M,g[v/A] Example: “Bill is a non-smoker” ⟦λx(¬S(x))(b’)⟧M,g = 1 iff ⟦λx(¬S(x))⟧M,g(⟦b’⟧M,g) = 1 iff ⟦¬S(x)⟧M,g[x/⟦b’⟧M,g] = 1 iff ⟦S(x)⟧M,g[x/⟦b’⟧M,g] = 0 iff ⟦S⟧M,g[x/⟦b’⟧M,g](⟦x⟧M,g[x/⟦b’⟧M,g]) = 0 iff VM(S)(VM(b’)) = 0 4 β-Reduction ⟦λv(α)(β)⟧M,g = ⟦α⟧M,g[v/⟦β⟧M,g] ⇒ all (free) occurrences of the λ-variable in α get the interpretation of β as value.
    [Show full text]
  • Labelled Λ-Calculi with Explicit Copy and Erase
    Labelled λ-calculi with Explicit Copy and Erase Maribel Fern´andez, Nikolaos Siafakas King’s College London, Dept. Computer Science, Strand, London WC2R 2LS, UK [maribel.fernandez, nikolaos.siafakas]@kcl.ac.uk We present two rewriting systems that define labelled explicit substitution λ-calculi. Our work is motivated by the close correspondence between L´evy’s labelled λ-calculus and paths in proof-nets, which played an important role in the understanding of the Geometry of Interaction. The structure of the labels in L´evy’s labelled λ-calculus relates to the multiplicative information of paths; the novelty of our work is that we design labelled explicit substitution calculi that also keep track of exponential information present in call-by-value and call-by-name translations of the λ-calculus into linear logic proof-nets. 1 Introduction Labelled λ-calculi have been used for a variety of applications, for instance, as a technology to keep track of residuals of redexes [6], and in the context of optimal reduction, using L´evy’s labels [14]. In L´evy’s work, labels give information about the history of redex creation, which allows the identification and classification of copied β-redexes. A different point of view is proposed in [4], where it is shown that a label is actually encoding a path in the syntax tree of a λ-term. This established a tight correspondence between the labelled λ-calculus and the Geometry of Interaction interpretation of cut elimination in linear logic proof-nets [13]. Inspired by L´evy’s labelled λ-calculus, we define labelled λ-calculi where the labels attached to terms capture reduction traces.
    [Show full text]
  • Lambda Λ Calculus
    Lambda λ Calculus Maria Raynor, Katie Kessler, Michael von der Lippe December 5th, 2016 COSC 440 General Intro ❏ 1930s - Alonzo Church ❏ 1935 - Kleene and Rosser say inconsistent ❏ 1936 - published lambda calculus relevant to computation, untyped ❏ 1940 - published typed lambda calculus ❏ Language that expresses function abstraction and application Definition “A formal system in mathematical logic for expressing computation based on abstraction and application using variable binding and substitution” ∈ ● Variables v1, v2, v3, ... , vn Var ● Parenthesis () ● Functions-take 1 argument,return 1 value Syntax Everything is an expression 1. E ID 2. E λ ID. E 3. E E E 4. E (E) Examples and Non-Examples ❏ x ❏ λ x . x ❏ x y ❏ λ λ x . y ❏ λ x . y z What about ambiguous syntax? There is a set of disambiguation rules: ❏ E E E is left associative ❏ x y z becomes (x y) z ❏ w x y z becomes ((w x) y) z ❏ λ ID . E extends as far right as possible ❏ λ x . x y becomes λ x . (x y) ❏ λ x . λ x . x becomes λ x . (λ x . x) ❏ λ a . λ b . λ c . a b c becomes λ a . (λ b . (λ c . ((a b) c))) Simple Examples Church Booleans: if p then x, else y ❏ TRUE = λ x . λ y . x ❏ FALSE = λ x . λ y . y Identity function λ x . x Constant function λ x . k What about λ x . + x 1? How it relates to theoretical computer science Mathematical Composition vs Machine Composition a. Lambda calculus is mathematical by nature. b. Turing Machines are difficult to applied to programming because there is no natural notation for machines Curry-Howard Correspondence This foundation in math allows us to establish functional programming proofs of formal logic.
    [Show full text]
  • Introduction to Type Theory
    Introduction to Type Theory Erik Barendsen version November 2005 selected from: Basic Course Type Theory Dutch Graduate School in Logic, June 1996 lecturers: Erik Barendsen (KUN/UU), Herman Geuvers (TUE) 1. Introduction In typing systems, types are assigned to objects (in some context). This leads to typing statements of the form a : τ, where a is an object and τ a type. Traditionally, there are two views on typing: the computational and the logical one. They differ in the interpretation of typing statements. In the computational setting, a is regarded as a program or algorithm, and τ as a specification of a (in some formalism). This gives a notion of partial correctness, namely well-typedness of programs. From the logical point of view, τ is a formula, and a is considered to be a proof of τ. Various logical systems have a type theoretic interpretation. This branch of type theory is related to proof theory because the constructive or algorithmic content of proofs plays an important role. The result is a realiz- ability interpretation: provability in the logical systems implies the existence of an ‘inhabitant’ in the corresponding type system. Church versus Curry Typing One can distinguish two different styles in typing, usually called after their inventors A. Church and H.B. Curry. The approach `ala Church assembles typed objects from typed components; i.e., the objects are constructed together with their types. We use type anno- tations to indicate the types of basic objects: if 0 denotes the type of natural numbers, then λx:0.x denotes the identity function on N, having type 0→0.
    [Show full text]
  • Monads for Functional Programming
    Monads for functional programming Philip Wadler, University of Glasgow? Department of Computing Science, University of Glasgow, G12 8QQ, Scotland ([email protected]) Abstract. The use of monads to structure functional programs is de- scribed. Monads provide a convenient framework for simulating effects found in other languages, such as global state, exception handling, out- put, or non-determinism. Three case studies are looked at in detail: how monads ease the modification of a simple evaluator; how monads act as the basis of a datatype of arrays subject to in-place update; and how monads can be used to build parsers. 1 Introduction Shall I be pure or impure? The functional programming community divides into two camps. Pure lan- guages, such as Miranda0 and Haskell, are lambda calculus pure and simple. Impure languages, such as Scheme and Standard ML, augment lambda calculus with a number of possible effects, such as assignment, exceptions, or continu- ations. Pure languages are easier to reason about and may benefit from lazy evaluation, while impure languages offer efficiency benefits and sometimes make possible a more compact mode of expression. Recent advances in theoretical computing science, notably in the areas of type theory and category theory, have suggested new approaches that may integrate the benefits of the pure and impure schools. These notes describe one, the use of monads to integrate impure effects into pure functional languages. The concept of a monad, which arises from category theory, has been applied by Moggi to structure the denotational semantics of programming languages [13, 14]. The same technique can be applied to structure functional programs [21, 23].
    [Show full text]
  • Semantics and Pragmatics of NLP Lambda Terms, Quantifiers
    SPNLP: Lambda Terms, Quantifiers, Satisfaction Lascarides & Semantics and Pragmatics of NLP Klein Lambda Terms, Quantifiers, Satisfaction Outline Typed Lambda Calculus First Order Alex Lascarides & Ewan Klein Logic Truth and Satisfaction School of Informatics University of Edinburgh 10 January 2008 SPNLP: Lambda Terms, Quantifiers, Satisfaction Lascarides & Klein 1 Typed Lambda Calculus Outline Typed Lambda Calculus 2 First Order Logic First Order Logic Truth and Satisfaction 3 Truth and Satisfaction Transitive Verbs as Functions SPNLP: Lambda Terms, Quantifiers, Satisfaction We looked at replacing n-ary relations with functions. How Lascarides & does this work with transitive verbs? Klein Outline Version 1: chase of type <IND, IND >→ BOOL Typed Lambda Version 2: chase of type IND → (IND → BOOL) Calculus First Order Logic Advantages of Version 2 (called a curryed function): Truth and Satisfaction Makes the syntax more uniform. Fits better with compositional semantics (discussed later) Transitive Verbs as Functions SPNLP: Lambda Terms, Quantifiers, Satisfaction We looked at replacing n-ary relations with functions. How Lascarides & does this work with transitive verbs? Klein Outline Version 1: chase of type <IND, IND >→ BOOL Typed Lambda Version 2: chase of type IND → (IND → BOOL) Calculus First Order Logic Advantages of Version 2 (called a curryed function): Truth and Satisfaction Makes the syntax more uniform. Fits better with compositional semantics (discussed later) Transitive Verbs as Functions SPNLP: Lambda Terms, Quantifiers, Satisfaction We looked at replacing n-ary relations with functions. How Lascarides & does this work with transitive verbs? Klein Outline Version 1: chase of type <IND, IND >→ BOOL Typed Lambda Version 2: chase of type IND → (IND → BOOL) Calculus First Order Logic Advantages of Version 2 (called a curryed function): Truth and Satisfaction Makes the syntax more uniform.
    [Show full text]
  • Metatheorems About Convertibility in Typed Lambda Calculi
    Metatheorems about Convertibility in Typed Lambda Calculi: Applications to CPS transform and "Free Theorems" by Jakov Kucan B.S.E., University of Pennsylvania (1991) M.A., University of Pennsylvania (1991) Submitted to the Department of Mathematics in partial fulfillment of the requirements for the degree of Doctor of Philosophy at the MASSACHUSETTS INSTITUTE OF TECHNOLOGY February 1997 @ Massachusetts Institute of Technology 1997. All rights reserved. x - I A uthor .... ................ Department of Mathematics /1. October 10, 1996 Certified by ....... , ,.... ..... .... ........................... Albert R. Meyer Hitachi America Professor of Engineering / -Thesis Supervisor (/1 n / Accepted by..... ... ......Accep.. ...yHungApplied.... .... ....ma.. .........Cheng..... Chairman, itics Committee Accepted by ................................... .......... .... ............ Richard Melrose oChairman, Departmental Committee on Graduate Students MAR 0 41997 Metatheorems about Convertibility in Typed Lambda Calculi: Applications to CPS transform and "Free Theorems" by Jakov Kutan Submitted to the Department of Mathematics on October 10, 1996, in partial fulfillment of the requirements for the degree of Doctor of Philosophy Abstract In this thesis we present two applications of using types of a typed lambda calculus to derive equation schemas, instances of which are provable by convertibility. Part 1: Retraction Approach to CPS transform: We study the continuation passing style (CPS) transform and its generalization, the computational transform, in which the notion of computation is generalized from continuation passing to an arbitrary one. To establish a relation between direct style and continuationpassing style interpretation of sequential call- by-value programs, we prove the Retraction Theorem which says that a lambda term can be recovered from its continuationized form via a A-definable retraction. The Retraction Theorem is proved in the logic of computational lambda calculus for the simply typable terms.
    [Show full text]