Concurrency Roadmap Misc Interoperability with Objective-C

Total Page:16

File Type:pdf, Size:1020Kb

Concurrency Roadmap Misc Interoperability with Objective-C Goal: make concurrent programs simpler to reason about and safer (no data races) Data race = two threads access the same data Data races in memory concurrently (at least one writer) Increasing the priority of a task The mechanism to prevent data can automatically increase the Because the child tasks are races proactively priority of the child tasks known Data isolation Actor-local data, and each actor is single- When a higher-priority task waits on threaded (or serial-queued) internally a lower-priority task, the priority of all child tasks can be escalated An actor performs local computation on its own private state This is the timeout problem Nathaniel Smith wrote about in In the form of calling async Examples of systemic Limiting the total time spent on a his blog posts on structured instance methods task management task (including its child tasks) concurrency "by only allowing asynchronous instance problems this can solve Cancelling a task also cancels Actors send messages methods of actor classes to be invoked from "This eliminates the need for any queuing or its child tasks to other actors outside the actor, we ensure that all synchronization within the synchronous Semantics synchronous methods are already inside the code, making such code more efficient and Structured concurrency = concurrent "Task-local storage" can be actor when they are called" simpler to write" programs are organized into tasks and picked up by child tasks child tasks rather than simply a sea of Messages can't be sync It's possible this restriction could be lifted under formally-unrelated threads and jobs Child tasks can communicate up certain circumstances, e.g. when the caller is in the task hierarchy, e.g. when an async context and waits the sync call they get flooded and need the A cooperative approach to parent to slow down handling pressure Actors act on messages received from other actors The proposal essentially reads like NSOperation, but with Syntax: `actor class BankAccount { … }` compiler support Like classes, but with compiler- = actor isolation Slava Pestov: "I’m considering dying on the enforced protection from data races Allow the programmer to compose for the actor's state multiple async (and non-async) The compiler translates an async “Well Actually async/await is a control flow There are holes in the Properties of mutable reference operations with the language's function into an appropriate set of structure and not a concurrency primitive” hill" protection, though Examples types (classes, pointers) normal control flow structures closures and state machines. Async functions can be suspended, which Every actor has a private serial Async instance methods are Sequentially, but not necessarily queue/exclusive executor executed on this executor in enqueuing order Document will eventually be at Difficult to read Pyramid of doom implies that another task can run on the same docs/ConcurrencyRoadmap.md thread. This sounds like concurrency to me Becomes nested/duplicated Actor classes can't inherit from Exception: inheriting from I don't fully understand this The proposal uses the word non-actor classes NSObject is allowed Goal: make concurrent programming Error handling Actor classes in Swift convenient, efficient, and safe Not compatible with throws "concurrency" more as a synonym for syntax what Jakob Jenkov calls "parallelism" Actor classes are a restricted form of class Manifesto might describe Problems with typical callback- "async/await does not introduce multiple possible directions Conditional execution is hard concurrency per se: ignoring the Example: makeDinner() function in proposal motivation based async code and error-prone section: Should actors (being a new Is inheritance required to bring Not a manifesto suspension points within an asynchronous Support inheritance concept) even support inheritance? UIKit etc. into the actor world? This describes a single plan function, it will execute in essentially the Forget to call callback in one or Where actor classes act like same manner as a synchronous function" func makeDinner() async throws -> Meal { Satisfy AnyObject constraints make asynchronous programming Easy to make mistakes more code paths let veggies = await try chopVegetables() classes convenient and clear at the point of use Too many APIs are not defined let meat = await marinateMeat() But classes are not the only Motivation: async/await alone Are reference types reference types in Swift provide a standard set of asynchronously because To execute an async function's let oven = await try preheatOven(temperature: 350) does not provide concurrency! Why call them "actor classes", language tools and techniques callbacks are awkward They mean that a single async subtasks in parallel, we need The first three subtasks should It's about control flow! function still executes another mechanism to build on let dish = Dish(ingredients: [veggies, meat]) not merely "actors"? Chris Lattner: "I think it is reasonable for run in parallel actors to not have static members and class Intended end state improve the performance of asynchronous Allow async code to be written What's the point of "ignoring the sequentially, even if it can be top of async/await = structured return await try oven.cook(dish, duration: .hours(3)) methods though, as the whole idea is to get rid code through better knowledge at compile time as straight-line code suspension points" suspended in between. concurrency } The subtasks also have dependencies: `cook` can't begin of global state" eliminate data races and deadlocks in the (1) better performance for until the first three are done "The similarities end at being "a same way Swift eliminates memory unsafety asynchronous code reference rather than a value", Advantages of async functions Allow the compiler to directly Even if there's only one CPU, Introduction will span multiple Swift releases (2) better tooling to provide a ktoso: conflating actors and however the semantic E.g. an actor could also be reason about the execution pattern "Concurrency means that an switching between multiple tasks more consistent experience classes may be capabilities the two expose are distributed (living on another of the code, allowing callbacks to application is making progress Will allow uses to organize their while debugging, profiling, and "concurrency is related to how counterproductive very different" machine) run far more efficiently on more than one task at the code around actors; will reduce, exploring code an application handles multiple but not eliminate, data races same time (concurrently)" tasks it works on: one task at at Other code that has a reference (3) a foundation for future time (sequentially) or multiple to the actor can't modify state async/await concurrency features like task tasks at the same time Mutable stored properties Task API and Structured Concurrency priority and cancellation (concurrently)" Actor-isolated Computed properties Ability to protect global variables with "In practice, asynchronous "Parallelism is related to how an members by default Phase 1: async syntax and actor global actors functions are compiled to not Jakob Jenkov: concurrency vs. application handles each Subscripts types the function and all of its depend on the thread during an parallelism "Parallelism means that an application splits individual task: process the task Protect class members by converting asynchronous callers asynchronous call, so that only Synchronous instance methods Safety benefits covered in its tasks up into smaller subtasks which can serially from start to end, or split the class to an actor class It only gives up its thread at a simultaneously abandon the the innermost function needs to phase one be processed in parallel, for instance on the task up into subtasks which = External access is allowed Async function = "think of an asynchronous suspension point (marked by await) thread. do any extra work." multiple CPUs at the exact same time" can be completed in parallel" Frameworks that require access on a function as an ordinary function that has the Types with value semantics that particular queue can define a global actor A synchronous function can't call an special power to give up its thread" By this definition, it's a question of where This is only safe for value types are mutably captured by a Actors and (partial) Actor Isolation and default protocols to it async function because the former you draw the line between "multiple Proposals (better: types with value semantics) closure are also problematic doesn't know how to give up its thread. tasks" and "one task split into subtasks" Global variables will not be A `let` to a (potentially nested, Race conditions not covered in threadsafe by default "This is an interesting question that I'm not sure we Like a thread, a task runs one hidden) mutable reference type is See "Escaping reference types" phase one have a clear answer to. There's an ambiguity between async function at a time Actor-independent Non-actor reference types a function that's "generic" about its executor (e.g. by default Constants (`let`) unsafe in the proposal When a function makes an async call, Actors only allow access to their Concurrency interop with Obj-C because it takes an argument that can only be safely "a task is to asynchronous This is a problem for library evolution the called function is still running as part members directly on `self` called or otherwise used on that executor) and a Every async functions runs in a functions, what a thread is to because turning a `let` into a computed You can use of the same task (and the caller waits Using the @asyncHandler function that's apathetic about its executor (e.g. task synchronous functions" `var` is no longer a resilient change `@actorIndependent var` attribute because it's in an I/O library and is just kicking off work for it to return) and waiting for a response)" Declarations marked with ability to declare a synchronous "So e.g.
Recommended publications
  • Kotlin Coroutines Deep Dive Into Bytecode #Whoami
    Kotlin Coroutines Deep Dive into Bytecode #whoami ● Kotlin compiler engineer @ JetBrains ● Mostly working on JVM back-end ● Responsible for (almost) all bugs in coroutines code Agenda I will talk about ● State machines ● Continuations ● Suspend and resume I won’t talk about ● Structured concurrency and cancellation ● async vs launch vs withContext ● and other library related stuff Agenda I will talk about Beware, there will be code. A lot of code. ● State machines ● Continuations ● Suspend and resume I won’t talk about ● Structured concurrency and cancellation ● async vs launch vs withContext ● and other library related stuff Why coroutines ● No dependency on a particular implementation of Futures or other such rich library; ● Cover equally the "async/await" use case and "generator blocks"; ● Make it possible to utilize Kotlin coroutines as wrappers for different existing asynchronous APIs (such as Java NIO, different implementations of Futures, etc). via coroutines KEEP Getting Lazy With Kotlin Pythagorean Triples fun printPythagoreanTriples() { for (i in 1 until 100) { for (j in 1 until i) { for (k in i until 100) { if (i * i + j * j < k * k) { break } if (i * i + j * j == k * k) { println("$i^2 + $j^2 == $k^2") } } } } } Pythagorean Triples fun printPythagoreanTriples() { for (i in 1 until 100) { for (j in 1 until i) { for (k in i until 100) { if (i * i + j * j < k * k) { break } if (i * i + j * j == k * k) { println("$i^2 + $j^2 == $k^2") } } } } } Pythagorean Triples fun printPythagoreanTriples() { for (i in 1 until 100) { for (j
    [Show full text]
  • Contention in Structured Concurrency: Provably Efficient Dynamic Non-Zero Indicators for Nested Parallelism
    Contention in Structured Concurrency: Provably Efficient Dynamic Non-Zero Indicators for Nested Parallelism Umut A. Acar1;2 Naama Ben-David 1 Mike Rainey 2 January 16, 2017 CMU-CS-16-133 School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 A short version of this work appears in the proceedings of the 22nd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming 2017 (PPoPP '17). 1Carnegie Mellon University, Pittsburgh, PA 2Inria-Paris Keywords: concurrent data structures, non-blocking data structures, contention, nested parallelism, dependency counters Abstract Over the past two decades, many concurrent data structures have been designed and im- plemented. Nearly all such work analyzes concurrent data structures empirically, omit- ting asymptotic bounds on their efficiency, partly because of the complexity of the analysis needed, and partly because of the difficulty of obtaining relevant asymptotic bounds: when the analysis takes into account important practical factors, such as contention, it is difficult or even impossible to prove desirable bounds. In this paper, we show that considering structured concurrency or relaxed concurrency mod- els can enable establishing strong bounds, also for contention. To this end, we first present a dynamic relaxed counter data structure that indicates the non-zero status of the counter. Our data structure extends a recently proposed data structure, called SNZI, allowing our structure to grow dynamically in response to the increasing degree of concurrency in the system. Using the dynamic SNZI data structure, we then present a concurrent data structure for series-parallel directed acyclic graphs (sp-dags), a key data structure widely used in the implementation of modern parallel programming languages.
    [Show full text]
  • Oolong: a Concurrent Object Calculus for Extensibility and Reuse
    OOlong: A Concurrent Object Calculus for Extensibility and Reuse Elias Castegren Tobias Wrigstad KTH Royal Institute of Technology Uppsala University Kista, Sweden Uppsala, Sweden [email protected] [email protected] ABSTRACT This avoids tying the language to a specific model of class We present OOlong, an object calculus with interface in- inheritance (e.g., Java's), while still maintaining an object- heritance, structured concurrency and locks. The goal of oriented style of programming. Concurrency is modeled in a the calculus is extensibility and reuse. The semantics are finish/async style, and synchronisation is handled via locks. therefore available in a version for LATEX typesetting (written The semantics are provided both on paper and in a mecha- in Ott), a mechanised version for doing rigorous proofs in nised version written in Coq. The paper version of OOlong Coq, and a prototype interpreter (written in OCaml) for is defined in Ott [25], and all typing rules in this paper are typechecking an running OOlong programs. generated from this definition. To make it easy for other researchers to build on OOlong, we are making the sources of both versions of the semantics publicly available. We also CCS Concepts provide a prototype interpreter written in OCaml. •Theory of computation ! Operational semantics; Concur- rency; Interactive proof systems; •Software and its engineer- With the goal of extensibility and re-usability, we make the ing ! Object oriented languages; Concurrent programming following contributions: structures; Interpreters; • We define the formal semantics of OOlong, motivate the choice of features, and prove type soundness (Sections Keywords 2{5). Object Calculi; Semantics; Mechanisation; Concurrency • We provide a mechanised version of the full semantics and soundness proof, written in Coq (Section 6).
    [Show full text]
  • Systematic Use of Models of Concurrency in Executable Domain-Specific Modeling Languages Florent Latombe
    Systematic use of Models of Concurrency in eXecutable Domain-Specific Modeling Languages Florent Latombe To cite this version: Florent Latombe. Systematic use of Models of Concurrency in eXecutable Domain-Specific Modeling Languages. Software Engineering [cs.SE]. Université de Toulouse - Institut National Polytechnique de Toulouse (INPT), 2016. English. tel-01369451 HAL Id: tel-01369451 https://hal.inria.fr/tel-01369451 Submitted on 21 Sep 2016 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. THÈSETHÈSE En vue de l’obtention du DOCTORAT DE L’UNIVERSITÉ DE TOULOUSE Délivré par : l’Institut National Polytechnique de Toulouse (INP Toulouse) Présentée et soutenue le 13/07/2016 par : Florent LATOMBE Systematic use of Models of Concurrency in eXecutable Domain-Specific Modeling Languages JURY Richard PAIGE Professor Rapporteur Antonio VALLECILLO Professor Rapporteur Frédéric BOULANGER Professeur des Universités Examinateur Julien DE ANTONI Maître de Conférences Examinateur Benoît COMBEMALE Maître de Conférences Invité Xavier CRÉGUT Maître de Conférences Encadrant Marc PANTEL Maître de Conférences Encadrant École doctorale et spécialité : MITT : Domaine STIC : Sureté de logiciel et calcul de haute performance Unité de Recherche : IRIT : Institut de Recherche en Informatique de Toulouse (UMR 5505) Directeur(s) de Thèse : Marc PANTEL, Xavier CRÉGUT et Yamine AÏT-AMEUR Rapporteurs : Richard PAIGE et Antonio VALLECILLO All that is gold does not glier, Not all those flho flander are lost; e old that is strong does not flither, Deep roots are not reached by the frost.
    [Show full text]
  • The State of Fibers for the JVM Why All Your JVM Coroutines Are Cool, but Broken, and Project Loom Is Gonna Fix That! Lightweigh
    The State of Fibers for the JVM Lightweight Threads Virtual and ... Why all your JVM coroutines are cool, but broken, (Kilim threads, Quasar fibers, Kotlin coroutines, etc.) and Project Loom is gonna fix that! Volkan Yazıcı https://vlkan.com 2019-12-10 @yazicivo 2018-08-25 2018-03-08 Agenda 1) Motivation 2) History 3) Continuations 4) Processes, threads, and fibers 5) Project Loom 6) Structured concurrency 7) Scoped variables Motivation: I/O Quoting from Gor Nishanov's 2016 "LLVM Coroutines: Bringing resumable functions to LLVM" talk. Without I/O, you don’t exist! ● println() ● file access ● network socket access ● database access ● etc. In 1958, ... Quoting from Gor Nishanov's 2016 "LLVM Coroutines: Bringing resumable functions to LLVM" talk. The legend of Melvin Conway Quoting from Gor Nishanov's 2016 "LLVM Coroutines: Bringing resumable functions to LLVM" talk. Subroutine ⊂ Coroutine Coroutine Subroutine A Subroutine B Subroutine A Coroutine C “Coroutines” – Melvin Conway, 1958 … … B start C start call B “Generalization of subroutine” – Donald Knuth, 1968 call C end suspend subroutines coroutines B start resume C allocate frame, allocate frame, suspend call call B pass params pass params free frame, free frame, return resume C return result return result end end suspend No Yes … resume No Yes … Quoting from Gor Nishanov's 2016 "LLVM Coroutines: Bringing resumable functions to LLVM" talk. Where did all the coroutines go? Algol-60 … introduced code blocks and the begin and end pairs for delimiting them. ALGOL 60 was the first language implementing nested function definitions with lexical scope. – Wikipedia “ALGOL 60” Quoting from Gor Nishanov's 2016 "LLVM Coroutines: Bringing resumable functions to LLVM" talk.
    [Show full text]
  • Revisiting Coroutines
    6 Revisiting Coroutines ANA LUCIA´ DE MOURA and ROBERTO IERUSALIMSCHY Catholic University of Rio de Janeiro (PUC–Rio) This article advocates the revival of coroutines as a convenient general control abstraction. After proposing a new classification of coroutines, we introduce the concept of full asymmetric coroutines and provide a precise definition for it through an operational semantics. We then demonstrate that full coroutines have an expressive power equivalent to one-shot continuations and one-shot delimited continuations. We also show that full asymmetric coroutines and one-shot delimited continuations have many similarities, and therefore present comparable benefits. Nevertheless, coroutines are easier implemented and understood, especially in the realm of procedural languages. Categories and Subject Descriptors: D.3.3 [Programming Languages]: Language Constructs and Features—Control structures, coroutines General Terms: Design, Languages Additional Key Words and Phrases: Continuations, generators, multitasking ACM Reference Format: de Moura, A. L. and Ierusalimschy, R. 2009. Revisiting coroutines. ACM Trans. Program. Lang. Syst. 31, 2, Article 6 (February 2009), 31 pages. DOI = 10.1145/1462166.1462167 http:// doi.acm.org/10.1145/1462166.1462167 1. INTRODUCTION The concept of coroutines was introduced in the early 1960’s and constitutes one of the oldest proposals of a general control abstraction. It is attributed to Conway, who described coroutines as “subroutines who act as the master pro- gram,” and implemented this construct to
    [Show full text]
  • Java Concurrency Evolution It Is Becoming Crucial to Understand the Tooling Around How the Available Computing Capacity Can Be Best Utilized
    Java Concurrency Evolution It is becoming crucial to understand the tooling around how the available computing capacity can be best utilized. by Csaba Bejan · Dec. 02, 20 · Java Zone · Opinion Since the early days of Java, Threads were available to support concurrent programming. Interestingly till Java 1.1, green threads (virtual threads) were supported by the JVM, but they were dropped in favor of native OS threads, however with Project Loom on the horizon (targeted for Java 16 or later?), virtual threads are on track to become mainstream again. The goal of this article is to go through the main milestones for the evolution of thread/concurrency handling in Java. As the topic can easily fill a library full of books, the following aspects are out of scope (basically, the goal is to take a look at the happy path of Java concurrency): Error handling – This is very limited, to say the least. Lombok’s SneakyThrows is used to support readability in the code examples. Libraries and Frameworks supporting concurrency – There are endless alternative solutions for the JVM (e.g., Quasar, Akka, Guava, EA Async…) Sophisticated stop conditions – When kicking off a thread with a given task, it is not always clear how and how long to wait for its completion Synchronization between threads – The literature is endless about this. So, what will we covering here, you may ask? A very valid question as it may seem that we excluded all the fun stuff. We will take an example task which we will solve multiple times using newer / different approaches, and we will compare their execution ”behavior.” By nature, this list can’t be complete.
    [Show full text]
  • A Runtime Verification Framework for Kotlin Mobile Applications
    A Runtime Verification Framework For Kotlin Mobile Applications Master’s thesis in Computer science and engineering Denis Furian Department of Computer Science and Engineering CHALMERS UNIVERSITY OF TECHNOLOGY UNIVERSITY OF GOTHENBURG Gothenburg, Sweden 2020 Master’s thesis 2020 A Runtime Verification Framework For Kotlin Mobile Applications Denis Furian Department of Computer Science and Engineering Chalmers University of Technology University of Gothenburg Gothenburg, Sweden 2020 A Runtime Verification Framework For Kotlin Mobile Applications Denis Furian © Denis Furian, 2020. Supervisor: Gerardo Schneider, Department of Computer Science and Engineering Industrial Advisor: Boris Tiutin, Opera Software AB External Advisors: Christian Colombo, University of Malta Yliès Falcone, University Grenoble Alps Examiner: Wolfgang Ahrendt, Department of Computer Science and Engineering Master’s Thesis 2020 Department of Computer Science and Engineering Chalmers University of Technology and University of Gothenburg SE-412 96 Gothenburg Telephone +46 31 772 1000 Typeset in LATEX Gothenburg, Sweden 2020 iv A Runtime Verification Framework For Kotlin Mobile Applications Denis Furian Department of Computer Science and Engineering Chalmers University of Technology and University of Gothenburg Abstract The Kotlin programming language has recently been introduced to Android as the recommended language for development. We investigated whether we could use this language to improve the state of the art for Runtime Verification on mobile devices and focused on creating an API to monitor the execution of coroutines, one of the main Kotlin functionalities that are not featured in Java. This API should be employed by Android programmers to carry out concurrent tasks in a monitored environment and verify at runtime that the Kotlin guidelines and best practices for coroutines are being followed.
    [Show full text]
  • Copyright by David Wilson Kitchin 2013
    Copyright by David Wilson Kitchin 2013 The Dissertation Committee for David Wilson Kitchin certifies that this is the approved version of the following dissertation: Orchestration and Atomicity Committee: Jayadev Misra, Supervisor William Cook, Supervisor Don Batory Keshav Pingali Dan Grossman Orchestration and Atomicity by David Wilson Kitchin, B.S.C.S. Dissertation Presented to the Faculty of the Graduate School of The University of Texas at Austin in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy The University of Texas at Austin August 2013 This dissertation is dedicated to my mother and father, whose boundless love and support have made all of this possible. Acknowledgments First, I must express my gratitude to my best friend, Kristine Butler, without whose unwavering support I could never have completed this journey. I am also deeply grateful to my good friends Chris Lundberg and Mercedes Vaughn, who have given me a place to call home for the past three years, and whose wonderful companionship I have continually enjoyed. I am thankful every day for my loving, quirky, and brilliant family. I am grateful for my excellent advisor and mentor, Jay Misra, so much so that I am not sure how to put it into words. We have worked together for eight years, and our collaborations have always been productive and enjoyable. He has always treated me with respect, even when I have ignored his guidance or strained his patience. Jay is a great scholar, and I look forward to opportunities to work with him again in the future. My gratitude extends to all of the members of the Orc Research Group, past and present, who have each in their own way made the group a lively and interesting hub of great ideas and vigorous discussion.
    [Show full text]
  • Kotlin Coroutines for Android
    GDG Android Athens Meetup 2019/02/27 An introduction to Kotlin Coroutines for Android Antonis Lilis, Mobile Engineer The Problem How to prevent our applications from blocking ● Asynchronous or non-blocking programming is the new reality ○ Fluid client experience ○ Scalable server architecture Approaches ● Threads ○ hard to write and maintain ● Callbacks ○ series of nested callbacks which lead to incomprehensible code ● Futures, Promises,... ○ different programming mental model ● Reactive Extensions ○ everything is a stream, and it's observable ● Coroutines Coroutines ● Based on the concept of suspending functions ● The code is still structured as if we were writing synchronous code ● Are like light-weight threads ● Jetbrains engineers took the best ideas from other languages like Python, Go, C# and JS The term 'Coroutine' was coined by Melvin Conway in 1958 (known for Conway's Law) Kotlin Coroutines ● Kotlin provides Coroutine support at the language level ○ Actually it only adds one language keyword (suspend) ● Functionality is delegated to libraries ○ kotlinx.coroutines is a library developed by JetBrains ● Since Kotlin 1.3 Coroutines are no longer experimental ○ The major feature of this release Suspending Functions - Continuations Synchronous - Sequential Code Asynchronous - Concurrent Code The structure did not change much Coroutines are light-weight Suspending Functions (sequential code example) Suspending Functions ● Used inside coroutines ● They can call other ● Waits tasks like regular functions suspending functions to complete
    [Show full text]
  • Verifying Concurrent Programs by Controlling Alias Interference
    c Copyright 2014 Colin S. Gordon Verifying Concurrent Programs by Controlling Alias Interference Colin S. Gordon A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy University of Washington 2014 Reading Committee: Michael D. Ernst, Chair Dan Grossman, Chair Matthew Parkinson, Microsoft Research, Cambridge, UK Program Authorized to Offer Degree: UW Computer Science and Engineering University of Washington Abstract Verifying Concurrent Programs by Controlling Alias Interference Colin S. Gordon Co-Chairs of the Supervisory Committee: Professor Michael D. Ernst Computer Science and Engineering Associate Professor Dan Grossman Computer Science and Engineering This dissertation proposes a family of techniques for static verification of sequential and concurrent imperative programs by leveraging fine-grained characterizations of mutation. The key idea is that by attaching to each reference in a program (1) a restriction on mu- tations permitted using that reference, and (2) a characterization of possible interference through other aliases, a type system can reason about what properties are preserved by all mutations in a program. This thesis develops four variations on this idea: (1) We adapt reference immutability to support data-race-free concurrent programming. (2) We generalize reference immutability to rely-guarantee references, allowing two-state invariants to express usage restrictions be- tween read-only and arbitrary mutation. (3) We extend rely-guarantee references to prove invariants and functional correctness of lock-free concurrent data structures. (4) We evalu- ate rely-guarantee references' utility for existing Haskell programs. Together these variations show that reasoning about aliasing and reasoning about con- current (imperative) programs are the same fundamental challenge, and that by taking the right foundational approach to reasoning about sequential programs, the gap to reasoning about concurrent programs is significantly reduced.
    [Show full text]
  • Server-Side Kotlin Coroutines
    Server-side Kotlin with Coroutines Roman Elizarov relizarov Speaker: Roman Elizarov • Professional developer since 2000 • Previously developed high-perf trading software @ Devexperts • Teach concurrent & distributed programming @ St. Petersburg ITMO University • Chief judge @ Northern Eurasia Contest / ICPC • Now team lead in Kotlin Libraries @ JetBrains elizarov @ relizarov Kotlin – Programming Language for Kotlin – Programming Language for Server-side This talk Backend evolution Starting with “good old days” Old-school client-server monolith Executor Threads ET 1 ET 2 Clients DB … ET N Incoming request Executor Threads ET 1 ET 2 Clients DB … ET N Blocks tread Executor Threads ET 1! ET 2 Clients DB … ET N Sizing threads – easy Executor Threads ET 1 ET 2 Clients DB … ET N N = number of DB connections Services Old-school client-server monolith Executor Threads ET 1 ET 2 Clients DB … ET N Now with Services Executor Threads ET 1 DB ET 2 Clients … ET N Service Services everywhere Executor Threads ET 1 Service 1 ET 2 Service 2 Clients … … ET N Service K Sizing threads – not easy Executor Threads ET 1 Service 1 ET 2 Service 2 Clients … … ET N Service K N = ????? Complex business logic fun placeOrder(order: Order): Response { … } Complex business logic fun placeOrder(order: Order): Response { val account = accountService.loadAccout(order.accountId) … } Complex business logic fun placeOrder(order: Order): Response { val account = accountService.loadAccout(order.accountId) val margin = if (account.isOptionsAccount) … } Complex business logic fun
    [Show full text]