Monadic State: Axiomatization and Type Safety

Total Page:16

File Type:pdf, Size:1020Kb

Monadic State: Axiomatization and Type Safety Monadic State Axiomatization and Typ e Safety John Launchbury Amr Sabry Oregon Graduate Institute Department of Computer Science PO Box University of Oregon Portland OR Eugene OR jlcseogiedu sabrycsuoregonedu Our formal investigation reveals two subtle p oints that Abstract the previous informal reasoning failed to uncover First Typ e safety of imp erative programs is an area fraught with arbitrary b etareduction is unsound in a compiler which diculty and requiring great care The SML solution to the enco des statetransformers as statepassing functionsany problem originall y involving imp erative typ e variables has compiler that implemented the denotational semantics di b een recently simplied to the syntacticvalue restriction In rectly would have to take great care never to duplicate the Haskell the problem is addressed in a rather dierent way state parameter Second the recursive state op erator fixST using explicit monadic state We present an op erational cannot b e interpreted navely in callbyname but really semantics for state in Haskell and the rst full pro of of typ e needs callbyneed to make sense safety We demonstrate that the semantic notion of value provided by the explicit monadic typ es is able to avoid any Imp erative Typ es problems with generalization We b egin by reviewing the issue of typ e safety The need Intro duction for a sp ecial care arises in SML b ecause of examples like the following When Launchbury and Peyton Jones intro duced encapsu lated monadic state it came equipp ed with a de let val r ref fn x x notational semantics and a mo deltheoretic pro of that dif in fn r r not ferent state threads did not interact with each other The end encapsulation op erator runST had a typ e which statically guaranteed freedom of interaction and the guarantee relied The variable r is given the typ e ref which sub on a parametricity pro of What the pap er failed to provide sequently unies with both the integer and the b o olean uses was any formal reasoning principle at the syntactic level or Intuitively the problem is that the let has generalized over any pro of of typ e safety This pap er makes up for those typ e variables that actually o ccur free in the state shortcomings In particular we The solution adopted for many years is to have a class of imp erative typ e variables and only to generalize axiomatize the monadicstate operations this allows us to view the monad of state transformers as an ab over these if the expression b eing b ound by let is syntac tically a value Due to Wrights observations this has stract typ e and understand formally how it should b e have Previously the choice was b etween an informal since b een simplied to treat all typ e variables as if they were imp erative typ e variables and so collapsing the understanding or a rather heavyweight denotational description two tier structure Why do these problems not o ccur in Haskell when using prove type safety if I have a variable that claims to monadic state The precise answer comes from the pro of contain a list of integers say will it truly do so or later in the pap er of course but we can provide intuition might the typ e system have b ecome confused By us here When working within the state monad or any other ing the axiomatization as a reduction relation we are explicit monad for that matter the facilities provided by able to use standard techniques to show typ e safety of let are given by the use of monadic extension a bind op this system erator in Wadlers terminology thenST in the State in Haskell pap ers or in Haskell notation This prove syntactic noninterference our pro of shows that takes a computationa term of typ e M A where M is the if ever a stateread or write is ab out to b e attempted monadic typ e constructortogether with a function of typ e then the typ e system guarantees that the reference is A MB Intuitively the rst term is executed delivering lo cal a value of typ e A which is then passed as an argument to the function whose subsequent computation is also executed The value is passed according to regular function applica To app ear in ACM SIGPLAN International Confer tion so the typ e A in A M B is a regular typ e not a ence on Functional Programming typ e scheme The intermediate values within a computation are lambdabound therefore rather than b eing letb ound Thats the intuition The fact that it works relies on where we have used the Haskell notation for lamb da expres the correct interplay of a numb er of dierent asp ects of the sions xe instead of the mathematical notation xe system in what comes later for example if the typing judg could b e rewritten as follows ment for runST were relaxed then typ e safety would b e lost let omega omega One way of viewing all this is that the Haskell typ e system in runST do p newVar makes a distinction b etween computations with no eects v readVar p which we call semantic values and computations that may v readVar p have eects which we simply refer to as computations Se writeVar omega mantic values are b ound with the let construct and their returnST vv typ es can b e generalized results of computations are b ound with the construct and their typ es cannot b e general To get an informal feeling for the typ es and semantics of ized Hence like SML Haskells let only p erforms gener the expressions we intuitively explain the evaluation of the alization over values not over the results of computations ab ove fragment First we bind omega to some semantic However unlike SML the Haskell notion of value is seman value and then create a new state thread In this thread we tic and hence richer For example in Haskell the expression allo cate a reference cell p and initializ e it to The cell xx y y is classied as a semantic value whose typ e is then dereferenced twice and the results are added Once can b e generalized but not in SML the values of v and v are determined no more state op erations are p erformed as the nal result is now dened In other words we have a lazy store semantics in which state State in Haskell threads are executed on demand and values may b e re turned b efore the computation has b een completed Hence Our source language is an extension of the callbyname the assignment to the uncalculabl e lo cation omega do es not calculus with several constants and two language constructs aect the nal result which is let and runST later we will add a third Why b other with lazy stores The answer is that lazy stores have a clean interaction with the lazy semantics of the Denition Syntax of Terms Let x range over a set underlying language and provide elegant ways to express Vars of variables fx x x yzg The set of terms 1 2 imp erative functional programs as the following example is inductively dened as fol lows illustrates The example is drawn from streambased simulation in Simple Constants k j j j j j particular simulating a lo cal data cache within a micro pro cessor for our purp oses here we will assume no cache Primitive Store Operations misses The contents of the stream represent the values of 0 s newVar e j readVar e j writeVar e e the input and output wires over time The input streams to the cache will contain addresses data and a b o olean Syntactic Values readwrite ag The output stream will contain the mem 0 v k j xe j e e j returnST e j s ory contents for a read and if a write was p erformed As the cache will contain thousands of randomly acces Terms 0 0 sible lo cations a destructive array is the obvious choice for e x j v j e e j runST e j let fx e g in e i i i mo deling the contents We therefore use the store prim itives readArr and writeArr which are the the obvious We let k range over an unsp ecied set of simple constants generalization s to arrays of the op erations on single lo ca like numb ers and addition The constants newVar readVar tions Heres the co de in Haskell where the rst parameter and writeVar express the usual op erations on reference cells to cache is the size the second parameter contains the three The constants returnST and are the unit and bind op er input streams and the result is the output stream ations of the state monad resp ectively Expressions built up from these statetransformer op erations are treated as syn cache Int IntIntBool Int tactic values These syntactic values will b e used to sp ecify cache size ins the op erational semantics of the language but not to guide runST do arr newArray size generalization of typ e variables The expression runST e loop arr is an eliminator for statetransformer expressions e The op erational intuition b ehind runST is that it executes e in loop arr aasddsTruebs a newly created state thread returning the nal value pro do x readArr arr a duced by e while discarding the nal state The state in xs loop arr asdsbs the thread is neither accessible nor visible from outside the return xxs runST e expression In the examples we sometimes use the Haskell do loop arr aasddsFalsebs notation This construct acts like a nonrecursive let do x writeArr arr a d over computations and is denable in terms of For xs loop arr asdsbs example the following co de return xs let omega omega As the state is lazy the result of each op eration b ecomes in runST newVar p available immediately after it is p erformedthere is no need readVar p v to wait until al l the state op erations are p erformed In readVar p v deed if as we exp ect the list were innite there would b e writeVar omega no end to the state op erations Conceptually as the in returnST
Recommended publications
  • Safety Properties Liveness Properties
    Computer security Goal: prevent bad things from happening PLDI’06 Tutorial T1: Clients not paying for services Enforcing and Expressing Security Critical service unavailable with Programming Languages Confidential information leaked Important information damaged System used to violate laws (e.g., copyright) Andrew Myers Conventional security mechanisms aren’t Cornell University up to the challenge http://www.cs.cornell.edu/andru PLDI Tutorial: Enforcing and Expressing Security with Programming Languages - Andrew Myers 2 Harder & more important Language-based security In the ’70s, computing systems were isolated. Conventional security: program is black box software updates done infrequently by an experienced Encryption administrator. Firewalls you trusted the (few) programs you ran. System calls/privileged mode physical access was required. Process-level privilege and permissions-based access control crashes and outages didn’t cost billions. The Internet has changed all of this. Prevents addressing important security issues: Downloaded and mobile code we depend upon the infrastructure for everyday services you have no idea what programs do. Buffer overruns and other safety problems software is constantly updated – sometimes without your knowledge Extensible systems or consent. Application-level security policies a hacker in the Philippines is as close as your neighbor. System-level security validation everything is executable (e.g., web pages, email). Languages and compilers to the rescue! PLDI Tutorial: Enforcing
    [Show full text]
  • Cyclone: a Type-Safe Dialect of C∗
    Cyclone: A Type-Safe Dialect of C∗ Dan Grossman Michael Hicks Trevor Jim Greg Morrisett If any bug has achieved celebrity status, it is the • In C, an array of structs will be laid out contigu- buffer overflow. It made front-page news as early ously in memory, which is good for cache locality. as 1987, as the enabler of the Morris worm, the first In Java, the decision of how to lay out an array worm to spread through the Internet. In recent years, of objects is made by the compiler, and probably attacks exploiting buffer overflows have become more has indirections. frequent, and more virulent. This year, for exam- ple, the Witty worm was released to the wild less • C has data types that match hardware data than 48 hours after a buffer overflow vulnerability types and operations. Java abstracts from the was publicly announced; in 45 minutes, it infected hardware (“write once, run anywhere”). the entire world-wide population of 12,000 machines running the vulnerable programs. • C has manual memory management, whereas Notably, buffer overflows are a problem only for the Java has garbage collection. Garbage collec- C and C++ languages—Java and other “safe” lan- tion is safe and convenient, but places little con- guages have built-in protection against them. More- trol over performance in the hands of the pro- over, buffer overflows appear in C programs written grammer, and indeed encourages an allocation- by expert programmers who are security concious— intensive style. programs such as OpenSSH, Kerberos, and the com- In short, C programmers can see the costs of their mercial intrusion detection programs that were the programs simply by looking at them, and they can target of Witty.
    [Show full text]
  • Cs164: Introduction to Programming Languages and Compilers
    Lecture 19 Flow Analysis flow analysis in prolog; applications of flow analysis Ras Bodik Hack Your Language! CS164: Introduction to Programming Ali and Mangpo Languages and Compilers, Spring 2013 UC Berkeley 1 Today Static program analysis what it computes and how are its results used Points-to analysis analysis for understanding flow of pointer values Andersen’s algorithm approximation of programs: how and why Andersen’s algorithm in Prolog points-to analysis expressed via just four deduction rules Andersen’s algorithm via CYK parsing (optional) expressed as CYK parsing of a graph representing the pgm Static Analysis of Programs definition and motivation 3 Static program analysis Computes program properties used by a range of clients: compiler optimizers, static debuggers, security audit tools, IDEs, … Static analysis == at compile time – that is, prior to seeing the actual input ==> analysis answer must be correct for all possible inputs Sample program properties: does variable x has a constant value (for all inputs)? does foo() return a table (whenever called, on all inputs)? 4 Client 1: Program Optimization Optimize program by finding constant subexpressions Ex: replace x[i] with x[1] if we know that i is always 1. This optimizations saves the address computation. This analysis is called constant propagation i = 2 … i = i+2 … if (…) { …} … x[i] = x[i-1] 5 Client 2: Find security vulnerabilities One specific analysis: find broken sanitization In a web server program, as whether a value can flow from POST (untrusted source) to the SQL interpreter (trusted sink) without passing through the cgi.escape() sanitizer? This is taint analysis.
    [Show full text]
  • An Operational Semantics and Type Safety Proof for Multiple Inheritance in C++
    An Operational Semantics and Type Safety Proof for Multiple Inheritance in C++ Daniel Wasserrab Tobias Nipkow Gregor Snelting Frank Tip Universitat¨ Passau Technische Universitat¨ Universitat¨ Passau IBM T.J. Watson Research [email protected] Munchen¨ [email protected] Center passau.de [email protected] passau.de [email protected] Abstract pected type, or end with an exception. The semantics and proof are formalized and machine-checked using the Isabelle/HOL theorem We present an operational semantics and type safety proof for 1 multiple inheritance in C++. The semantics models the behaviour prover [15] and are available online . of method calls, field accesses, and two forms of casts in C++ class One of the main sources of complexity in C++ is a complex hierarchies exactly, and the type safety proof was formalized and form of multiple inheritance, in which a combination of shared machine-checked in Isabelle/HOL. Our semantics enables one, for (“virtual”) and repeated (“nonvirtual”) inheritance is permitted. Be- the first time, to understand the behaviour of operations on C++ cause of this complexity, the behaviour of operations on C++ class class hierarchies without referring to implementation-level artifacts hierarchies has traditionally been defined informally [29], and in such as virtual function tables. Moreover, it can—as the semantics terms of implementation-level constructs such as v-tables. We are is executable—act as a reference for compilers, and it can form only aware of a few formal treatments—and of no operational the basis for more advanced correctness proofs of, e.g., automated semantics—for C++-like languages with shared and repeated mul- program transformations.
    [Show full text]
  • Chapter 8 Automation Using Powershell
    Chapter 8 Automation Using PowerShell Virtual Machine Manager is one of the first Microsoft software products to fully adopt Windows PowerShell and offer its users a complete management interface tailored for script- ing. From the first release of VMM 2007, the Virtual Machine Manager Administrator Console was written on top of Windows PowerShell, utilizing the many cmdlets that VMM offers. This approach made VMM very extensible and partner friendly and allows customers to accomplish anything that VMM offers in the Administrator Console via scripts and automation. Windows PowerShell is also the only public application programming interface (API) that VMM offers, giving both developers and administrators a single point of reference for managing VMM. Writing scripts that interface with VMM, Hyper-V, or Virtual Server can be made very easy using Windows PowerShell’s support for WMI, .NET, and COM. In this chapter, you will learn to: ◆ Describe the main benefits that PowerShell offers for VMM ◆ Use the VMM PowerShell cmdlets ◆ Create scheduled PowerShell scripts VMM and Windows PowerShell System Center Virtual Machine Manager (VMM) 2007, the first release of VMM, was one of the first products to develop its entire graphical user interface (the VMM Administrator Con- sole) on top of Windows PowerShell (previously known as Monad). This approach proved very advantageous for customers that wanted all of the VMM functionality to be available through some form of an API. The VMM team made early bets on Windows PowerShell as its public management interface, and they have not been disappointed with the results. With its consis- tent grammar, the great integration with .NET, and the abundance of cmdlets, PowerShell is quickly becoming the management interface of choice for enterprise applications.
    [Show full text]
  • Mastering Powershellpowershell
    CopyrightCopyright © 2009 BBS Technologies ALL RIGHTS RESERVED. No part of this work covered by the copyright herein may be reproduced, transmitted, stored, or used in any form or by any means graphic, electronic, or mechanical, including but not limited to photocopying, recording, scanning, digitizing, taping, Web distribution, information networks, or information storage and retrieval systems except as permitted under Section 107 or 108 of the 1976 United States Copyright Act without the prior written permission of the publisher. For permission to use material from the text please contact Idera at [email protected]. Microsoft® Windows PowerShell® and Microsoft® SQL Server® are registered trademarks of Microsoft Corporation in the United Stated and other countries. All other trademarks are the property of their respective owners. AboutAbout thethe AuthorAuthor Dr. Tobias Weltner is one of the most visible PowerShell MVPs in Europe. He has published more than 80 books on Windows and Scripting Techniques with Microsoft Press and other publishers, is a regular speaker at conferences and road shows and does high level PowerShell and Scripting trainings for companies throughout Europe. He created the powershell.com website and community in an effort to help people adopt and use PowerShell more efficiently. As software architect, he created a number of award-winning scripting tools such as SystemScripter (VBScript), the original PowerShell IDE and PowerShell Plus, a comprehensive integrated PowerShell development system. AcknowledgmentsAcknowledgments First and foremost, I’d like to thank my family who is always a source of inspiration and encouragement. A special thanks to Idera, Rick Pleczko, David Fargo, Richard Giles, Conley Smith and David Twamley for helping to bring this book to the English speaking world.
    [Show full text]
  • Lecture Notes on Language-Based Security
    Lecture Notes on Language-Based Security Erik Poll Radboud University Nijmegen Updated September 2019 These lecture notes discuss language-based security, which is the term loosely used for the collection of features and mechanisms that a programming language can provide to help in building secure applications. These features include: memory safety and typing, as offered by so-called safe pro- gramming languages; language mechanisms to enforce various forms of access con- trol (such as sandboxing), similar to access control traditionally offered by operating systems; mechanisms that go beyond what typical operating systems do, such as information flow control. Contents 1 Introduction 4 2 Operating system based security 7 2.1 Operating system abstractions and access control . .7 2.2 Imperfections in abstractions . 10 2.3 What goes wrong . 10 3 Safe programming languages 12 3.1 Safety & (un)definedness . 13 3.1.1 Safety and security . 14 3.2 Memory safety . 15 3.2.1 Ensuring memory safety . 15 3.2.2 Memory safety and undefinedness . 16 3.2.3 Stronger notions of memory safety . 16 3.3 Type safety . 17 3.3.1 Expressivity . 18 3.3.2 Breaking type safety . 18 3.3.3 Ensuring type safety . 19 3.4 Other notions of safety . 19 3.4.1 Safety concerns in low-level languages . 20 3.4.2 Safe arithmetic . 20 3.4.3 Thread safety . 21 3.5 Other language-level guarantees . 22 3.5.1 Visibility . 22 3.5.2 Constant values and immutable data structures . 23 4 Language-based access control 26 4.1 Language platforms .
    [Show full text]
  • Advanced Programming Techniques Christopher Moretti
    Advanced Programming Techniques C++ Survey Christopher Moretti TIOBE Index April 2016 http://www.tiobe.com/tiobe_index Trending … not so great McJuggerNuggets Halcyon Days of C ❖ Representation is visible Charlie Fleming ❖ Opaque types are an impoverished workaround ❖ Manual creation and copying ❖ Manual initialization ❖ if you remember to do it! ❖ Manual deletion ❖ if you remember to do it! ❖ No type-safety No data abstraction mechanisms C++ as a Reaction to C ❖ A “Better” C ❖ Almost completely upwards compatible with C ❖ Function prototypes as interfaces (later added to ANSI C) ❖ Reasonable data abstraction ❖ methods reveal what is done, but how is hidden ❖ Parameterized types ❖ Object-oriented C++ Origins ❖ Developed at Bell Labs ca. 1980 by Bjarne Stroustrup ❖ “Initial aim for C++ was a language where I could write programs that were as elegant as Simula programs, yet as efficient as C programs.” ❖ Commercial release 1985, standards in 1998, 2014, and 2017(?) ❖ Stroustrup won the 2015 Dahl- Nygaard Prize for contributions to OOP (given by AITO). @humansky With apologies to Yogi Berra I really didn’t say everything I said! “C makes it easy to shoot yourself in the foot; C++ makes it harder, but when you do it blows your whole leg off.” “Within C++, there is a much smaller and cleaner language struggling to get out. […] And no, that smaller and cleaner language is not Java or C#.” “There are more useful systems developed in languages deemed awful than in languages praised for being beautiful--many more” “There are only two kinds of languages: the ones people complain about and the ones nobody uses” www.stroustrup.com quote checker C++: undersold as “C with Classes” ❖ Yes, classes, but also … + = ??? ❖ Data abstraction.
    [Show full text]
  • An Introduction to Subtyping
    An Introduction to Subtyping Type systems are to me the most interesting aspect of modern programming languages. Subtyping is an important notion that is helpful for describing and reasoning about type systems. This document describes much of what you need to know about subtyping. I’ve taken some of the definitions, notation, and presentation ideas in this document from Kim Bruce's text "Fundamental Concepts of Object-Oriented Languages" which is a great book and the one that I use in my graduate programming languages course. I’ve also borrowed ideas from Cardelli and Wegner. 1.1. What is Subtyping When is an assignment, x = y legal? There are at least two possible answers: 1. When x and y are of equal types 2. When y’s type can be “converted” to x’s type The discussion of name and structural equality (which we went into earlier in this course) takes care of the first aspect. What about the second aspect? When can a type be safely converted to another type? Remember that a type is just a set of values. For example, an INTEGER type is the set of values from minint to maxint, inclusive. Once we consider types as set of values, we realize immediately one set may be a subset of another set. [0 TO 10] is a subset of [0 TO 100] [0 TO 100] is a subset of INTEGER [0 TO 10] has a non-empty intersection with [5 TO 20] but is not a subset of [5 TO 20] When the set of values in one type, T, is a subset of the set of values in another type, U, we say that T is a subtype of U.
    [Show full text]
  • Lecture #14: Proving Type-Safety
    Lecture #14: Proving Type-Safety CS 6371: Advanced Programming Languages February 27, 2020 A language's static semantics are designed to eliminate runtime stuck states. Recall that stuck states are non-final configurations whose runtime behavior is undefined according to the language's small-step operational semantics. Definition 1 (Final state). Configuration hc; σi is a final state if c = skip. Definition 2 (Stuck state). Configuration hc; σi is a stuck state if it is non-final and there is 0 0 0 0 no configuration hc ; σ i such that the judgment hc; σi !1 hc ; σ i is derivable. A language is said to be type-safe if its static semantics prevent all stuck states. To define this formally, we need a definition of what it means for a program to be well-typed. Definition 3 (Well-typed commands). A program c is well-typed in context Γ if there exists a typing context Γ0 such that judgment Γ ` c :Γ0 is derivable. We say simply that c is well-typed if it is well-typed in context ?. Definition 4 (Well-typed expressions). Similarly, an expression e is well-typed in context Γ if there exists a type τ such that judgment Γ ` e : τ is derivable; and we say simply that e is well-typed if it is well-typed in context ?. Definition 5 (Type safety). A language is type-safe if for every well-typed program c and 0 0 0 0 number of steps n 2 N, if hc; ?i !n hc ; σ i then configuration hc ; σ i is not a stuck state.
    [Show full text]
  • Ccured: Type-Safe Retrofitting of Legacy Software
    pdfauthor CCured: Type-Safe Retrofitting of Legacy Software GEORGE C. NECULA, JEREMY CONDIT, MATTHEW HARREN, SCOTT McPEAK, and WESTLEY WEIMER University of California, Berkeley This paper describes CCured, a program transformation system that adds type safety guarantees to existing C programs. CCured attempts to verify statically that memory errors cannot occur, and it inserts run-time checks where static verification is insufficient. CCured extends C’s type system by separating pointer types according to their usage, and it uses a surprisingly simple type inference algorithm that is able to infer the appropriate pointer kinds for existing C programs. CCured uses physical subtyping to recognize and verify a large number of type casts at compile time. Additional type casts are verified using run-time type information. CCured uses two instrumentation schemes, one that is optimized for performance and one in which metadata is stored in a separate data structure whose shape mirrors that of the original user data. This latter scheme allows instrumented programs to invoke external functions directly on the program’s data without the use of a wrapper function. We have used CCured on real-world security-critical network daemons to produce instrumented versions without memory-safety vulnerabilities, and we have found several bugs in these programs. The instrumented code is efficient enough to be used in day-to-day operations. Categories and Subject Descriptors: D.2.4 [Software Engineering]: Program Verification; D.2.5 [Software Engineering]: Testing and Debugging; D.2.7 [Software Engineering]: Distribution and Maintenance; D.3.3 [Programming Languages]: Language Constructs and Features General Terms: Languages, Reliability, Security, Verification Additional Key Words and Phrases: memory safety, pointer qualifier, subtyping, libraries 1.
    [Show full text]
  • Modern C++ Tutorial: C++11/14/17/20 on the Fly
    Modern C++ Tutorial: C++11/14/17/20 On the Fly Changkun Ou (hi[at]changkun.de) Last update: August 28, 2021 Notice The content in this PDF file may outdated, please check our website or GitHub repository for the latest book updates. License This work was written by Ou Changkun and licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. http://creativecommons.org/licenses/by-nc-nd/4.0/ 1 2 CONTENTS CONTENTS Contents Preface 8 Introduction ............................................... 8 Targets ................................................. 8 Purpose ................................................. 9 Code ................................................... 9 Exercises ................................................ 9 Chapter 01: Towards Modern C++ 9 1.1 Deprecated Features ........................................ 10 1.2 Compatibilities with C ....................................... 11 Further Readings ............................................ 13 Chapter 02: Language Usability Enhancements 13 2.1 Constants .............................................. 13 nullptr ............................................... 13 constexpr ............................................. 15 2.2 Variables and initialization .................................... 17 if-switch .............................................. 17 Initializer list ........................................... 18 Structured binding ........................................ 20 2.3 Type inference ..........................................
    [Show full text]