DOCSLIB.ORG

Sec9on 6: Mutual Exclusion

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Sec9on 6: Mutual Exclusion Sec$on 6: Mutual Exclusion Michelle Ku5el [email protected] Toward sharing resources (memory) Have been studying parallel algorithms using fork- join – Lower span via parallel tasks Algorithms all had a very simple structure to avoid race condi$ons – Each thread had memory “only it accessed” • Example: array sub-range – On fork, “loaned” some of its memory to “forkee” and did not access that memory again un$l aer join on the “forkee” slide adapted from: Sophomoric Parallelism & 2 Concurrency, Lecture 4 Toward sharing resources (memory) Strategy won’t work well when: – Memory accessed by threads is overlapping or unpredictable – Threads are doing independent tasks needing access to same resources (rather than implemen$ng the same algorithm) slide adapted from: Sophomoric Parallelism & 3 Concurrency, Lecture 4 Race Condi$ons A race condi*on is a bug in a program where the output and/or result of the process is unexpectedly and cri$cally dependent on the relave sequence or $ming of other events. The idea is that the events race each other to influence the output first. Examples Mul$ple threads: 1. Processing different bank-account operaons – What if 2 threads change the same account at the same $me? 2. Using a shared cache (e.g., hashtable) of recent files – What if 2 threads insert the same file at the same $me? 3. Creang a pipeline (think assembly line) with a queue for handing work to next thread in sequence? – What if enqueuer and dequeuer adjust a circular array queue at the same $me? Sophomoric Parallelism & 5 Concurrency, Lecture 4 Concurrent Programming Concurrency: Correctly and efficiently managing access to shared resources from mul$ple possibly-simultaneous clients Even correct concurrent applicaons are usually highly non-determinisc: how threads are scheduled affects what operaons from other threads they see when – non-repeatability complicates tes$ng and debugging adapted from: Sophomoric 6 Parallelism & Concurrency, Lecture 4 Sharing, again It is common in concurrent programs that: • Different threads might access the same resources in an unpredictable order or even at about the same $me • Program correctness requires that simultaneous access be prevented using synchronizaon • Simultaneous access is rare – Makes tes$ng difficult – Must be much more disciplined when designing / implemen$ng a concurrent program Sophomoric Parallelism & 7 Concurrency, Lecture 4 Tes$ng concurrent programs • in general extremely difficult: – relies on execu$ng the par$cular sequence of events and ac$ons that cause a problem – number of possible execu$on sequences can be astronomical – problem sequences may never occur in the test environment Why use threads? Unlike parallelism, not about implemen$ng algorithms faster But threads s$ll useful for: • Code structure for responsiveness – Example: Respond to GUI events in one thread while another thread is performing an expensive computaon • Processor u1liza1on (mask I/O latency) – If 1 thread “goes to disk,” have something else to do • Failure isola1on – Convenient structure if want to interleave mul$ple tasks and don’t want an excep$on in one to stop the other Sophomoric Parallelism & 9 Concurrency, Lecture 4 Synchronizaon Synchronizaon constraints are requirements pertaining to the order of events. • Serializaon: Event A must happen before Event B. • Mutual exclusion: Events A and B must not happen at the same $me. Mutual exclusion One of the two most important problems in concurrent programming – several processes compete for a resource, but the nature of the resource requires that only one process at a $me actually accesses the resource – synchronizaon to avoid incorrect simultaneous access – abstrac$on of many synchronizaon problems Synchronizaon • In real life we oPen check and enforce synchronizaon constraints using a clock. How do we know if A happened before B? If we know what $me both events occurred, we can just compare the $mes. • In computer systems, we oPen need to sasfy synchronizaon constraints without the benefit of a clock, either because there is no universal clock, or because we don’t know with fine enough resolu$on when events occur. Mutual exclusion Mutual exclusion: Events A and B must not happen at the same *me. a.k.a. crical secon, which technically has other requirements One process must block: not proceed un$l the “winning” process has completed – join is not what we want – block un$l another thread is “done using what we need” not “completely done execu$ng” Example: Parallel Primality Tesng • Challenge – Print primes from 1 to 1010 • Given – Ten-processor mul$processor – One thread per processor • Goal – Get ten-fold speedup (or close) Slide from: Art of Multiprocessor Programming 14 Load Balancing 1 109 2·109 … 1010 P0 P1 … P9 • Split the work evenly • Each thread tests range of 109 Art of Multiprocessor 15 Programming Procedure for Thread i void primePrint { int i = ThreadID.get(); // IDs in {0..9} for (j = i*109+1, j<(i+1)*109; j++) { if (isPrime(j)) print(j); } } Art of Multiprocessor 16 Programming Issues • Higher ranges have fewer primes • Yet larger numbers harder to test • Thread workloads – Uneven – Hard to predict Art of Multiprocessor 17 Programming Issues • Higher ranges have fewer primes • Yet larger numbers harder to test • Thread workloads – Uneven – Hard to predict • Need dynamic load balancing Art of Multiprocessor 18 Programming Shared Counter 19 18 each thread takes a number 17 Art of Multiprocessor 19 Programming Procedure for Thread i int counter = new Counter(1); void primePrint { long j = 0; while (j < 1010) { j = counter.getAndIncrement(); if (isPrime(j)) print(j); } } Art of Multiprocessor 20 Programming Procedure for Thread i Counter counter = new Counter(1); void primePrint { long j = 0; while (j < 1010) { j = counter.getAndIncrement(); if (isPrime(j)) Shared counter print(j); object } } Art of Multiprocessor 21 Programming Where Things Reside code void primePrint { int i = ThreadID.get(); // IDs Local in {0..9} variables for (j = i*109+1, j<(i+1)*109; j++) { if (isPrime(j)) print(j); } cache cache cache } Bus Bus shared 1 memory shared counter Art of Multiprocessor 22 Programming Procedure for Thread i Counter counter = new Counter(1); void primePrint { long j = 0; while (j < 1010) { Stop when every value j = counter.getAndIncrement();taken if (isPrime(j)) print(j); } } Art of Multiprocessor 23 Programming Procedure for Thread i Counter counter = new Counter(1); void primePrint { long j = 0; while (j < 1010) { j = counter.getAndIncrement(); if (isPrime(j)) print(j); } } Increment & return each new value Art of Multiprocessor 24 Programming Counter Implementaon public class Counter { private long value; public long getAndIncrement() { return value++; } } Art of Multiprocessor 25 Programming Counter Implementaon public class Counter { private long value; public long getAndIncrement() { return value++; } } OK for single thread, not for concurrent threads Art of Multiprocessor 26 Programming What It Means public class Counter { private long value; public long getAndIncrement() { return value++; } } Art of Multiprocessor 27 Programming What It Means public class Counter { private long value; public long getAndIncrement() { return value++; temp = value; } value = value + 1; } return temp; Art of Multiprocessor 28 Programming Not so good… Value… 1 2 3 2 read write read write 1 2 2 3 read write 1 2 me Art of Multiprocessor 29 Programming Is this problem inherent? write read write read If we could only glue reads and writes… Art of Multiprocessor 30 Programming Challenge public class Counter { private long value; public long getAndIncrement() { temp = value; value = temp + 1; return temp; } } Art of Multiprocessor 31 Programming Challenge public class Counter { private long value; public long getAndIncrement() { temp = value; value = temp + 1; return temp; } Make these steps } atomic (indivisible) Art of Multiprocessor How do we do this? 32 Programming Atomic ac$ons Operaons A and B are atomic with respect to each other if, from the perspec$ve of a thread execu$ng A, when another thread executes B, either all of B has executed or none of it has The operaon is indivisible Hardware Solu$on public class Counter { private long value; public long getAndIncrement() { temp = value; value = temp + 1; return temp; } } ReadModifyWrite() instruc$on Art of Multiprocessor 34 Programming Mutual exclusion in Java Programmer must implement cri$cal sec$ons – “The compiler” has no idea what interleavings should or shouldn’t be allowed in your program – Buy you need language primi$ves to do it! Mutual exclusion in Java: Thread safe classes One way we could fix this is by using an exis$ng thread-safe atomic variable class java.util.concurrent.atomic contains atomic variable classes for effec$ng atomic state transi$ons on numbers and object references. e.g. can replace a long counter with AtomicLong to ensure that all ac$ons that access the counter state are atomic Mutual exclusion in Java • Atomic variable only make a class thread-safe if ONE variable defines the class state • to preserve state consistency, you should update related state variables in a single atomic operaon – exercise: give an example showing why this is Another example: atomic won’t work Correct code in a single-threaded world class BankAccount { private int balance = 0; int getBalance() { return balance; } void setBalance(int x) { balance = x; } void withdraw(int amount) { int b = getBalance(); if(amount > b) throw new WithdrawTooLargeException(); setBalance(b – amount); } … // other operations like deposit,
Load more

Recommended publications
  • Multithreading (Concurrency) in Java “Some People, When Confronted
    Multithreading (Concurrency) in Java “Some people, when confronted with a problem, think, "I know, I’ll use threads," and then two they hav erpoblesms.” — Ned Batchelder Multi-tasking In the beginning, computers ran in batch mode: a single program with total access to all resources. Later, a multi-tasking operating system enabled multiple (independent) jobs to run (more or less) simultaneously, even though there was only a single CPU. The jobs take turns running some of their code at one time. This type of interleaving of jobs is called concurrency. Multitasking is performing two or more tasks (or jobs) at roughly the same time. Nearly all operating systems are capable of multitasking by using one of two multitasking techniques: process-based multitasking and thread-based multitasking. Each running job was (and sometimes still is) called a process, which has state (a collection of data and handles to system resources such as files and devices) and a single sequence of instructions. It turns out that many tasks are easier to write, debug, and manage if organized as multiple copies of a process (e.g., a web server). Processes are sometimes called tasks, threads, or jobs. (Although there are some distinctions between these concepts, we will ignore them for now.) Time slice, (context) switching, and scheduling are operating system (“OS”) terms related to multi-tasking. The amount of time a task is allowed to use the CPU exclusively is called a time slice, typically 10ms (a hundredth of a second) but can vary depending on your OS and other factors from 1ms to more than 120ms.
    [Show full text]
  • Shared Objects & Mutual Exclusion
    Chapter 4 Shared Objects & Mutual Exclusion Shared Objects & Concepts: process interference. Mutual Exclusion mutual exclusion and locks. Models: model checking for interference modelling mutual exclusion Practice: thread interference in shared Java objects mutual exclusion in Java (synchronized objects/methods). 1 2 2015 Concurrency: shared objects & mutual exclusion ©Magee/Kramer 2nd Edition 2015 Concurrency: shared objects & mutual exclusion ©Magee/Kramer 2nd Edition A Concert Hall Booking System Concert Hall Booking System const False = 0 A central computer connected to remote terminals via communication links const True = 1 is used to automate seat reservations for a concert hall. range Bool = False..True To book a seat, a client chooses a free seat and the clerk enters the number SEAT = SEAT[False], of the chosen seat at the terminal and issues a ticket, if it is free. SEAT[reserved:Bool] = ( when (!reserved) reserve -> SEAT[True] A system is required which avoids double bookings of the same seat whilst | query[reserved] -> SEAT[reserved] allowing clients free choice of the available seats. | when (reserved) reserve -> ERROR //error of reserved twice Construct an abstract model of the system and demonstrate that your model does ). not permit double bookings. Like STOP, ERROR range Seats = 1..2 is a predefined FSP ||SEATS = (seat[Seats]:SEAT). local process (state), numbered -1 in the 3 equivalent LTS. 4 2015 Concurrency: shared objects & mutual exclusion ©Magee/Kramer 2nd Edition 2015 Concurrency: shared objects & mutual exclusion ©Magee/Kramer 2nd Edition Concert Hall Booking System Concert Hall Booking System – no interference? LOCK = (acquire -> release -> LOCK). TERMINAL = (choose[s:Seats] //lock for the booking system -> seat[s].query[reserved:Bool] -> if (!reserved) then TERMINAL = (choose[s:Seats] -> acquire (seat[s].reserve -> TERMINAL) -> seat[s].query[reserved:Bool] else -> if (!reserved) then TERMINAL (seat[s].reserve -> release-> TERMINAL) ).
    [Show full text]
  • Actor-Based Concurrency by Srinivas Panchapakesan
    Concurrency in Java and Actor- based concurrency using Scala By, Srinivas Panchapakesan Concurrency Concurrent computing is a form of computing in which programs are designed as collections of interacting computational processes that may be executed in parallel. Concurrent programs can be executed sequentially on a single processor by interleaving the execution steps of each computational process, or executed in parallel by assigning each computational process to one of a set of processors that may be close or distributed across a network. The main challenges in designing concurrent programs are ensuring the correct sequencing of the interactions or communications between different computational processes, and coordinating access to resources that are shared among processes. Advantages of Concurrency Almost every computer nowadays has several CPU's or several cores within one CPU. The ability to leverage theses multi-cores can be the key for a successful high-volume application. Increased application throughput - parallel execution of a concurrent program allows the number of tasks completed in certain time period to increase. High responsiveness for input/output-intensive applications mostly wait for input or output operations to complete. Concurrent programming allows the time that would be spent waiting to be used for another task. More appropriate program structure - some problems and problem domains are well-suited to representation as concurrent tasks or processes. Process vs Threads Process: A process runs independently and isolated of other processes. It cannot directly access shared data in other processes. The resources of the process are allocated to it via the operating system, e.g. memory and CPU time. Threads: Threads are so called lightweight processes which have their own call stack but an access shared data.
    [Show full text]
  • Java Concurrency Framework by Sidartha Gracias
    Java Concurrency Framework Sidartha Gracias Executive Summary • This is a beginners introduction to the java concurrency framework • Some familiarity with concurrent programs is assumed – However the presentation does go through a quick background on concurrency – So readers unfamiliar with concurrent programming should still get something out of this • The structure of the presentation is as follows – A brief history into concurrent programming is provided – Issues in concurrent programming are explored – The framework structure with all its major components are covered in some detail – Examples are provided for each major section to reinforce some of the major ideas Concurrency in Java - Overview • Java like most other languages supports concurrency through thread – The JVM creates the Initial thread, which begins execution from main – The main method can then spawn additional threads Thread Basics • All modern OS support the idea of processes – independently running programs that are isolated from each other • Thread can be thought of as light weight processes – Like processes they have independent program counters, call stacks etc – Unlike Processes they share main memory, file pointers and other process state – This means thread are easier for the OS to maintain and switch between – This also means we need to synchronize threads for access to shared resources Threads Continued… • So why use threads ? – Multi CPU systems: Most modern systems host multiple CPU’s, by splitting execution between them we can greatly speed up execution – Handling Asynchronous Events: Servers handle multiple clients. Processing each client is best done through a separate thread, because the Server blocks until a new message is received – UI or event driven Processing: event handlers that respond to user input are best handled through separate threads, this makes code easier to write and understand Synchronization Primitives in Java • How does the java language handle synchronization – Concurrent execution is supported through the Thread class.
    [Show full text]
  • Java Concurrency in Practice
    Java Concurrency in practice Chapters: 1,2, 3 & 4 Bjørn Christian Sebak ([email protected]) Karianne Berg ([email protected]) INF329 – Spring 2007 Chapter 1 - Introduction Brief history of concurrency Before OS, a computer executed a single program from start to finnish But running a single program at a time is an inefficient use of computer hardware Therefore all modern OS run multiple programs (in seperate processes) Brief history of concurrency (2) Factors for running multiple processes: Resource utilization: While one program waits for I/O, why not let another program run and avoid wasting CPU cycles? Fairness: Multiple users/programs might have equal claim of the computers resources. Avoid having single large programs „hog“ the machine. Convenience: Often desirable to create smaller programs that perform a single task (and coordinate them), than to have one large program that do ALL the tasks What is a thread? A „lightweight process“ - each process can have many threads Threads allow multiple streams of program flow to coexits in a single process. While a thread share process-wide resources like memory and files with other threads, they all have their own program counter, stack and local variables Benefits of threads 1) Exploiting multiple processors 2) Simplicity of modeling 3) Simplified handling of asynchronous events 4) More responsive user interfaces Benefits of threads (2) Exploiting multiple processors The processor industry is currently focusing on increasing number of cores on a single CPU rather than increasing clock speed. Well-designed programs with multiple threads can execute simultaneously on multiple processors, increasing resource utilization.
    [Show full text]
  • Java Concurrency in Practice
    Advance praise for Java Concurrency in Practice I was fortunate indeed to have worked with a fantastic team on the design and implementation of the concurrency features added to the Java platform in Java 5.0 and Java 6. Now this same team provides the best explanation yet of these new features, and of concurrency in general. Concurrency is no longer a subject for advanced users only. Every Java developer should read this book. —Martin Buchholz JDK Concurrency Czar, Sun Microsystems For the past 30 years, computer performance has been driven by Moore’s Law; from now on, it will be driven by Amdahl’s Law. Writing code that effectively exploits multiple processors can be very challenging. Java Concurrency in Practice provides you with the concepts and techniques needed to write safe and scalable Java programs for today’s—and tomorrow’s—systems. —Doron Rajwan Research Scientist, Intel Corp This is the book you need if you’re writing—or designing, or debugging, or main- taining, or contemplating—multithreaded Java programs. If you’ve ever had to synchronize a method and you weren’t sure why, you owe it to yourself and your users to read this book, cover to cover. —Ted Neward Author of Effective Enterprise Java Brian addresses the fundamental issues and complexities of concurrency with uncommon clarity. This book is a must-read for anyone who uses threads and cares about performance. —Kirk Pepperdine CTO, JavaPerformanceTuning.com This book covers a very deep and subtle topic in a very clear and concise way, making it the perfect Java Concurrency reference manual.
    [Show full text]
  • Testing Atomicity of Composed Concurrent Operations
    Testing Atomicity of Composed Concurrent Operations Ohad Shacham Nathan Bronson Alex Aiken Tel Aviv University Stanford University Stanford University [email protected] [email protected] [email protected] Mooly Sagiv Martin Vechev Eran Yahav ∗ Tel Aviv University ETH Zurich and IBM Research Technion [email protected] [email protected] [email protected] Abstract 1. Introduction We address the problem of testing atomicity of composed Concurrent data structures are becoming critical components concurrent operations. Concurrent libraries help program- of many systems [27] but are notoriously hard to get right mers exploit parallel hardware by providing scalable concur- (e.g., [11]). To shield programmers from the complexity of rent operations with the illusion that each operation is exe- concurrent data structures, modern languages hide their im- cuted atomically. However, client code often needs to com- plementations in libraries (e.g., [1, 3, 19]). Data structures pose atomic operations in such a way that the resulting com- provided by the library usually guarantee that their opera- posite operation is also atomic while preserving scalability. tions are atomic. That is, every individual operation appears We present a novel technique for testing the atomicity of to take place instantaneously at some point between its invo- client code composing scalable concurrent operations. The cation and its return, and the implementation details of the challenge in testing this kind of client code is that a bug may operation can be ignored by the programmer. occur very rarely and only on a particular interleaving with a specific thread configuration.
    [Show full text]
  • Verifying a Compiler for Java Threads*
    Verifying a Compiler for Java Threads? Andreas Lochbihler Karlsruher Institut f¨urTechnologie (KIT), Karlsruhe, Germany [email protected] Abstract. A verified compiler is an integral part of every security infra- structure. Previous work has come up with formal semantics for sequen- tial and concurrent variants of Java and has proven the correctness of compilers for the sequential part. This paper presents a rigorous formal- isation (in the proof assistant Isabelle/HOL) of concurrent Java source and byte code together with an executable compiler and its correctness proof. It guarantees that the generated byte code shows exactly the same observable behaviour as the semantics for the multithreaded source code. 1 Introduction In a recent \research highlights" article in CACM [14], the CompCert C compiler [13] by Leroy was praised as follows: \I think we are on the verge of a new paradigm for safety-critical systems, where we rely upon formal, machine checked verification, instead of human audits. Leroy's compiler is an impressive step toward this goal." And indeed, Leroy's work can be seen as a door opener, in particular because his verification includes various optimisations and generates assembler code for a real machine. However, concurrent programs call for formal methods even louder, because many bugs show up only in some interleavings of the threads' executions, which makes the bugs nearly impossible to find and reproduce. But so far, nobody has ever never included the compilation of thread primitives and multithreaded (imperative) programs. In this paper, we present a compiler from a substantial subset of multi- threaded Java source code to byte code and show semantic preservation w.r.t.
    [Show full text]
  • Concurrent Programming in Java Examples
    Concurrent Programming In Java Examples Sully usually wisps irremovably or pull-out familiarly when unmasculine Pattie justifying alway and amorally. Anapaestic and fou Jens sizes so presumptively that Edmond expects his perfecter. Telegenic Nicolas collude slantly while Carlton always miniaturise his snib arrives loose, he lightens so adumbratively. Coding standards encourage programmers to cloud a uniform set of guidelines determined purchase the requirements of team project and organization, rather be by the programmerfamiliarity or preference. Interacting with concurrency programming and program and is not. Note round the subclass initialization consists of obtaining an alter of the default logger. What java concurrency is similar to show there are strictly deterministic system and example starts the graph, and is no more responsive graphical user actions. As how to each other thread is organized as its class are instantiated with dennard scaling this lecture, message passing is threadsafe; each lambda expressions. This example programs that concurrency also necessary for reducing lock on the examples cover their actors. The java compiler is pot of the parameter types so you can enclose them burn well. List of tutorials that help perhaps learn multi-threading concurrency programming with Java. Hence, wire a programmer, the ability to write code in parallel environments is a critical skill. In java program has to. Into the ist of erialization yths. Concurrent programming with really simple server Code Review. Once a java examples throughout help either. To chart a class immutable define the class and celebrate its fields as final. Because jdbc connections, such as incrementing a pipeline, prevented from colliding.
    [Show full text]
  • Investigating Different Concurrency Mechanisms in Java Master Thesis
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by NORA - Norwegian Open Research Archives UNIVERSITY OF OSLO Department of Informatics Investigating Different Concurrency Mechanisms in Java Master thesis Petter Andersen Busterud August 2012 Abstract With the continual growth in number of cores on the Central Processing Unit (CPU), developers will need to focus more and more on concurrent programming to get the desired performance boost that in the past have come logically with the increased clock-rate. Today there are numerous of different libraries and mechanisms for synchronization and parallelization in Java, and in this thesis we will attempt to test the efficiency and run time of two different types of sorting algorithms on machines with multi-core processors using the concurrent tools provided by Java. We will also be looking into the overhead that occur by using the various mechanisms, to help establish the correlations between the mechanisms overhead and performance gain. i ii Acknowledgement This thesis concludes my Master’s Degree in Informatics: Programming and Networks with the Department of Informatics at the University of Oslo. It has been a long and different, but positive experience. First I want to thank my supervisor Arne Maus, who offered me this thesis and have been providing valuable feedback along the way. I also like to thank my friends and family who has been patient with me all these years, and the support and encouragement they given me throughout this period. University of Oslo, August 2012 Petter Andersen Busterud iii iv Contents 1 Introduction 1 1.1 Background .
    [Show full text]
  • A Comparison of the Concurrency Features of Ada 95 and Java Benjamin M
    A Comparison of the Concurrency Features of Ada 95 and Java Benjamin M. Brosgol Aonix 200 Wheeler Road Burlington, MA 01803 USA +1.781.221.7317 (Phone) +1.781.270.6882 (FAX) [email protected] 1. ABSTRACT 2. INTRODUCTION Ada [1] and Java [2] [3] are unusual in providing direct Both Ada and Java support concurrent pro- language support for concurrency: the task in Ada and the gramming, but through quite different thread in Java. Although they offer roughly equivalent functionality – the ability to define units of concurrent approaches. Ada has built-in tasking features execution and to control mutual exclusion, synchron- with concurrency semantics, independent of ization, communication, and timing – the two languages have some major differences. This paper compares and the language’s OOP model, whereas Java’s contrasts the concurrency-related facilities in Ada and Java, thread support is based on special execution focusing on their expressive power, support for sound software engineering, and performance. properties of methods in several predefined A brief comparison of concurrency support in Ada and Java classes. Ada achieves mutual exclusion may be found in [4]; this paper extends those results. A through protected objects with encapsulated comprehensive discussion of Ada tasking appears in [5]; components; Java relies on the classical references targeting Java concurrency include [6] and [7]. The term “concurrent” is used here to mean “potentially “monitor” construct with “synchronized” parallel.” Issues related to multiprocessor environments or methods. Ada models condition-based distributed systems are beyond the scope of this paper. synchronization and communication through Section 3 summarizes the Java language and technology.
    [Show full text]
  • Model Checking of Linearizability of Concurrent List Implementations*
    Model Checking of Linearizability of Concurrent List Implementations! Pavol Cern´yˇ 1, Arjun Radhakrishna1, Damien Zufferey1, Swarat Chaudhuri2, and Rajeev Alur3 1 IST Austria 2 Pennsylvania State University 3 University of Pennsylvania Abstract. Concurrent data structures with fine-grained synchroniza- tion are notoriously difficult to implement correctly. The difficulty of reasoning about these implementations does not stem from the number of variables or the program size, but rather from the large number of pos- sible interleavings. These implementations are therefore prime candidates for model checking. We introduce an algorithm for verifying linearizabil- ity of singly-linked heap-based concurrent data structures. We consider a model consisting of an unbounded heap where each vertex stores an element from an unbounded data domain, with a restricted set of oper- ations for testing and updating pointers and data elements. Our main result is that linearizability is decidable for programs that invoke a fixed number of methods, possibly in parallel. This decidable fragment covers many of the common implementation techniques — fine-grained locking, lazy synchronization, and lock-free synchronization. We also show how the technique can be used to verify optimistic implementations with the help of programmer annotations. We developed a verification tool CoLT and evaluated it on a representative sample of Java implementations of the concurrent set data structure. The tool verified linearizability of a number of implementations, found a known error in a lock-free imple- mentation and proved that the corrected version is linearizable. 1 Introduction Concurrency libraries such as the java.util.concurrent package JSR-166 [13] or the Intel Threading Building Blocks support the development of efficient multi- threaded programs by providing concurrent data structures, that is, concurrent implementations of familiar data abstractions such as queues, sets, and stacks.
    [Show full text]