DOCSLIB.ORG

Symbolic Execution

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Symbolic Execution Symbolic Execution CS252r Spring 2011 Contains content from slides by Jeff Foster Static analysis •Static analysis allows us to reason about all possible executions of a program •Gives assurance about any execution, prior to deployment •Lots of interesting static analysis ideas and tools •But difficult for developers to use •Commercial tools spend a lot of effort dealing with developer confusion, false positives, etc. • See A Few Billion Lines of Code Later: Using Static Analysis to Find Bugs in the Real World in CACM 53(2), 2010 ‣http://bit.ly/aedM3k © 2011 Stephen Chong, Harvard University 2 One issue is abstraction •Abstraction lets us scale and model all possible runs •But must be conservative •Try to balance precision and scalability • Flow-sensitive, context-sensitive, path-sensitivity, … •And static analysis abstractions do not cleanly match developer abstractions © 2011 Stephen Chong, Harvard University 3 Testing •Fits well with developer intuitions •In practice, most common form of bug-detection •But each test explores only one possible execution of the system •Hopefully, test cases generalize © 2011 Stephen Chong, Harvard University 4 Symbolic execution •King, CACM 1976. •Key idea: generalize testing by using unknown symbolic variables in evaluation •Symbolic executor executes program, tracking symbolic state. •If execution path depends on unknown, we fork symbolic executor •at least, conceptually © 2011 Stephen Chong, Harvard University 5 SymbolicSymbolicSymbolic Execution Execution execution ExampleExample example WhyWhy Is Is This This Possible? Possible? x=0, y=0, z=0 • There are very powerful SMT/SAT solvers today 1.1.intint a a= =α α, b, b= = β β, ,c c = = γ γ;; x=0, y=0, z=0 • There are very powerful SMT/SAT solvers today 2.2. // // symbolic symbolic α ■ SMT = Satisfiability Modulo Theories = SAT++ tt α f ■ SMT = Satisfiability Modulo Theories = SAT++ 3.3.intint x x= =0, 0, y y= = 0, 0, z z = = 0; 0; x=-2 β<5 ■ Can solve very large instances, very quickly 4. if (a) { x=-2 t β<5 f ■ Can solve very large instances, very quickly 4. if (a) { t f 5. x = -2; - Lets us check assertions, prune infeasible paths 5. x = -2; β<5 ¬α∧γ ! - Lets us check assertions, prune infeasible paths 6. } tβ<5 f ¬α∧γ ! 6. } t f t f ¬α∧(β≥5) ■ We’ve used Z3, STP, and Yices 7. if (b < 5) { z=2 ! t f ¬α∧(β≥5) ■ We’ve used Z3, STP, and Yices 7. if (b < 5) { z=2 ! y=1 z=2 8. if (!a && c) { y = 1; } y=1 z=2 8. if (!a && c) { y = 1; } α∧(β≥5) • Recent success: bug finding 9. z = 2; ! α∧(β≥5) • Recent success: bug finding 9. z = 2; ! z=2 ! 10.} α∧(β<5) z=2 ! ■ Heuristic search through space of possible executions 10.} α (β<5) ■ Heuristic search through space of possible executions 11.assert(x+y+z!=3) ∧ ¬α∧(β<5)∧¬γ " ¬α∧(β<5)∧¬γ ■ 11.assert(x+y+z!=3) " Find really interesting bugs ¬α∧(β<5)∧γ ■ Find really interesting bugs ¬α∧(β<5)∧γ path condition path condition 5 6 5 6 © 2011 Stephen Chong, Harvard University 6 Sym Exec Can Do Much More Rubyx: Symbolic Execution for Rails Sym Exec Can Do Much More Rubyx: Symbolic Execution for Rails • I think symbolic execution can be used in many • I otherthink symbolicinteresting execution ways can be used in many other interesting ways !"#$%&'(%)*+,-.+./%'01/2 !"#$%&'(%)*+,-.+./%'01/2 1.23%4.&5&647&,4.84. !3,.(45('01/$2 !"#$%&'(%)*+,-.+./%'01/2 • Next: Symbolic execution as !"#$%&'() • Next: Symbolic execution as !"#$%&'(%)*+,-.+./%'01/2 1.23%4.&5&647&,4.84. !3,.(45('01/$2 ■ Empirical studies tool !"#$%&'() ■ 1":&%0"04%&.4"-;"7$4< ■Empirical studies tool '//$#-"92* Web application security checker 1":&%0"04%&.4"-;"7$4< ■ ■WebEnhancement application to security abstraction-based checker static analysis '//$#-"92* ■ ■EnhancementProgram synthesis to abstraction-based tool static analysis '*"$+%#%&,-.#/0 !3,.(45('01/$6)4/(-7)&1-.$2 •■AllProgram of these synthesis take advantage tool of sym exec '*"$+%#%&,-.#/0 !3,.(45('01/$6)4/(-7)&1-.$2 • Allstrengths, of these and take try advantage to avoid drawbacksof sym exec strengths, and try to avoid drawbacks 7 8 7 8 SymbolicSymbolicSymbolic Execution Execution execution ExampleExample example WhyWhy Is Is This This Possible? Possible? x=0, y=0, z=0 • There are very powerful SMT/SAT solvers today 1.1.intint a a= =α α, b, b= = β β, ,c c = = γ γ;; x=0, y=0, z=0 • There are very powerful SMT/SAT solvers today 2.2. // // symbolic symbolic α ■ SMT = Satisfiability Modulo Theories = SAT++ tt α f ■ SMT = Satisfiability Modulo Theories = SAT++ 3.3.intint x x= =0, 0, y y= = 0, 0, z z = = 0; 0; x=-2 β<5 ■ Can solve very large instances, very quickly 4. if (a) { x=-2 t β<5 f ■ Can solve very large instances, very quickly 4. if (a) { t f 5. x = -2; - Lets us check assertions, prune infeasible paths 5. x = -2; β<5 ¬α∧γ ! - Lets us check assertions, prune infeasible paths 6. } tβ<5 f ¬α∧γ ! 6. } t f t f ¬α∧(β≥5) ■ We’ve used Z3, STP, and Yices 7. if (b < 5) { z=2 ! t f ¬α∧(β≥5) ■ We’ve used Z3, STP, and Yices 7. if (b < 5) { z=2 ! y=1 z=2 8. if (!a && c) { y = 1; } y=1 z=2 8. if (!a && c) { y = 1; } α∧(β≥5) • Recent success: bug finding 9. z = 2; ! α∧(β≥5) • Recent success: bug finding 9. z = 2; ! z=2 ! 10.} α∧(β<5) z=2 ! ■ Heuristic search through space of possible executions 10.} α (β<5) ■ Heuristic search through space of possible executions 11.assert(x+y+z!=3) ∧ ¬α∧(β<5)∧¬γ " ¬α∧(β<5)∧¬γ ■ 11.assert(x+y+z!=3) " Find really interesting bugs ¬α∧(β<5)∧γ ■ Find really interesting bugs ¬α∧(β<5)∧γ path condition path condition 5 6 5 6 © 2011 Stephen Chong, Harvard University 7 Sym Exec Can Do Much More Rubyx: Symbolic Execution for Rails Sym Exec Can Do Much More Rubyx: Symbolic Execution for Rails • I think symbolic execution can be used in many • I otherthink symbolicinteresting execution ways can be used in many other interesting ways !"#$%&'(%)*+,-.+./%'01/2 !"#$%&'(%)*+,-.+./%'01/2 1.23%4.&5&647&,4.84. !3,.(45('01/$2 !"#$%&'(%)*+,-.+./%'01/2 • Next: Symbolic execution as !"#$%&'() • Next: Symbolic execution as !"#$%&'(%)*+,-.+./%'01/2 1.23%4.&5&647&,4.84. !3,.(45('01/$2 ■ Empirical studies tool !"#$%&'() ■ 1":&%0"04%&.4"-;"7$4< ■Empirical studies tool '//$#-"92* Web application security checker 1":&%0"04%&.4"-;"7$4< ■ ■WebEnhancement application to security abstraction-based checker static analysis '//$#-"92* ■ ■EnhancementProgram synthesis to abstraction-based tool static analysis '*"$+%#%&,-.#/0 !3,.(45('01/$6)4/(-7)&1-.$2 •■AllProgram of these synthesis take advantage tool of sym exec '*"$+%#%&,-.#/0 !3,.(45('01/$6)4/(-7)&1-.$2 • Allstrengths, of these and take try advantage to avoid drawbacksof sym exec strengths, and try to avoid drawbacks 7 8 7 8 SymbolicSymbolicSymbolic Execution Execution execution ExampleExample example WhyWhy Is Is This This Possible? Possible? x=0, y=0, z=0 • There are very powerful SMT/SAT solvers today 1.1.intint a a= =α α, b, b= = β β, ,c c = = γ γ;; x=0, y=0, z=0 • There are very powerful SMT/SAT solvers today 2.2. // // symbolic symbolic α ■ SMT = Satisfiability Modulo Theories = SAT++ tt α f ■ SMT = Satisfiability Modulo Theories = SAT++ 3.3.intint x x= =0, 0, y y= = 0, 0, z z = = 0; 0; x=-2 β<5 ■ Can solve very large instances, very quickly 4. if (a) { x=-2 t β<5 f ■ Can solve very large instances, very quickly 4. if (a) { t f 5. x = -2; - Lets us check assertions, prune infeasible paths 5. x = -2; β<5 ¬α∧γ ! - Lets us check assertions, prune infeasible paths 6. } tβ<5 f ¬α∧γ ! 6. } t f t f ¬α∧(β≥5) ■ We’ve used Z3, STP, and Yices 7. if (b < 5) { z=2 ! t f ¬α∧(β≥5) ■ We’ve used Z3, STP, and Yices 7. if (b < 5) { z=2 ! y=1 z=2 8. if (!a && c) { y = 1; } y=1 z=2 8. if (!a && c) { y = 1; } α∧(β≥5) • Recent success: bug finding 9. z = 2; ! α∧(β≥5) • Recent success: bug finding 9. z = 2; ! z=2 ! 10.} α∧(β<5) z=2 ! ■ Heuristic search through space of possible executions 10.} α (β<5) ■ Heuristic search through space of possible executions 11.assert(x+y+z!=3) ∧ ¬α∧(β<5)∧¬γ " ¬α∧(β<5)∧¬γ ■ 11.assert(x+y+z!=3) " Find really interesting bugs ¬α∧(β<5)∧γ ■ Find really interesting bugs ¬α∧(β<5)∧γ path condition path condition 5 6 5 6 © 2011 Stephen Chong, Harvard University 8 Sym Exec Can Do Much More Rubyx: Symbolic Execution for Rails Sym Exec Can Do Much More Rubyx: Symbolic Execution for Rails • I think symbolic execution can be used in many • I otherthink symbolicinteresting execution ways can be used in many other interesting ways !"#$%&'(%)*+,-.+./%'01/2 !"#$%&'(%)*+,-.+./%'01/2 1.23%4.&5&647&,4.84. !3,.(45('01/$2 !"#$%&'(%)*+,-.+./%'01/2 • Next: Symbolic execution as !"#$%&'() • Next: Symbolic execution as !"#$%&'(%)*+,-.+./%'01/2 1.23%4.&5&647&,4.84. !3,.(45('01/$2 ■ Empirical studies tool !"#$%&'() ■ 1":&%0"04%&.4"-;"7$4< ■Empirical studies tool '//$#-"92* Web application security checker 1":&%0"04%&.4"-;"7$4< ■ ■WebEnhancement application to security abstraction-based checker static analysis '//$#-"92* ■ ■EnhancementProgram synthesis to abstraction-based tool static analysis '*"$+%#%&,-.#/0 !3,.(45('01/$6)4/(-7)&1-.$2 •■AllProgram of these synthesis take advantage tool of sym exec '*"$+%#%&,-.#/0 !3,.(45('01/$6)4/(-7)&1-.$2 • Allstrengths, of these and take try advantage to avoid drawbacksof sym exec strengths, and try to avoid drawbacks 7 8 7 8 What’s going on here? •During symbolic execution, we are trying to determine if certain formulas are satisfiable •E.g., is a particular program point reachable? • Figure out if the path condition is satisfiable •E.g., is array access a[i] out of bounds? • Figure out if conjunction of path condition and i<0 ∨ i > a.length is satisfiable •E.g., generate concrete inputs that execute the same paths •This is enabled by powerful SMT/SAT solvers •SAT = Satisfiability •SMT = Satisfiability modulo theory = SAT++ • E.g.
Load more

Recommended publications
  • Verification of Concurrent Programs in Dafny
    Bachelor’s Degree in Informatics Engineering Computation Bachelor’s End Project Verification of Concurrent Programs in Dafny Author Jon Mediero Iturrioz 2017 Abstract This report documents the Bachelor’s End Project of Jon Mediero Iturrioz for the Bachelor in Informatics Engineering of the UPV/EHU. The project was made under the supervision of Francisca Lucio Carrasco. The project belongs to the domain of formal methods. In the project a methodology to prove the correctness of concurrent programs called Local Rely-Guarantee reasoning is analyzed. Afterwards, the methodology is implemented over Dagny automatic program verification tool, which was introduced to me in the Formal Methods for Software Devel- opments optional course of the fourth year of the bachelor. In addition to Local Rely-Guarantee reasoning, in the report Hoare logic, Separation logic and Variables as Resource logic are explained, in order to have a good foundation to understand the new methodology. Finally, the Dafny implementation is explained, and some examples are presented. i Acknowledgments First of all, I would like to thank to my supervisor, Paqui Lucio Carrasco, for all the help and orientation she has offered me during the project. Lastly, but not least, I would also like to thank my parents, who had supported me through all the stressful months while I was working in the project. iii Contents Abstracti Contentsv 1 Introduction1 1.1 Objectives..................................3 1.2 Work plan..................................3 1.3 Content...................................4 2 Foundations5 2.1 Hoare Logic.................................5 2.1.1 Assertions..............................5 2.1.2 Programming language.......................7 2.1.3 Inference rules...........................9 2.1.4 Recursion.............................
    [Show full text]
  • Transforming Event-B Models to Dafny Contracts
    Electronic Communications of the EASST Volume XXX (2015) Proceedings of the 15th International Workshop on Automated Verification of Critical Systems (AVoCS 2015) Transforming Event-B Models to Dafny Contracts Mohammadsadegh Dalvandi, Michael Butler, Abdolbaghi Rezazadeh 15 pages Guest Editors: Gudmund Grov, Andrew Ireland Managing Editors: Tiziana Margaria, Julia Padberg, Gabriele Taentzer ECEASST Home Page: http://www.easst.org/eceasst/ ISSN 1863-2122 ECEASST Transforming Event-B Models to Dafny Contracts Mohammadsadegh Dalvandi1, Michael Butler2, Abdolbaghi Rezazadeh3 School of Electronic & Computer Science, University of Southampton 1 2 3 md5g11,mjb,[email protected] Abstract: Our work aims to build a bridge between constructive (top-down) and analytical (bottom-up) approaches to software verification. This paper presents a tool-supported method for linking two existing verification methods: Event-B (con- structive) and Dafny (analytical). This method combines Event-B abstraction and refinement with the code-level verification features of Dafny. The link transforms Event-B models to Dafny contracts by providing a framework in which Event-B models can be implemented correctly. The paper presents a method for transforma- tion of Event-B models of abstract data types to Dafny contracts. Also a prototype tool implementing the transformation method is outlined. The paper also defines and proves a formal link between property verification in Event-B and Dafny. Our approach is illustrated with a small case study. Keywords: Formal Methods, Hoare Logic, Program Verification, Event-B, Dafny 1 Introduction Various formal methods communities [CW96, HMLS09, LAB+06] have suggested that no single formal method can cover all aspects of a verification problem therefore engineering bridges be- tween complementary verification tools to enable their effective interoperability may increase the verification capabilities of verification tools.
    [Show full text]
  • Verification and Specification of Concurrent Programs
    Verification and Specification of Concurrent Programs Leslie Lamport 16 November 1993 To appear in the proceedings of a REX Workshop held in The Netherlands in June, 1993. Verification and Specification of Concurrent Programs Leslie Lamport Digital Equipment Corporation Systems Research Center Abstract. I explore the history of, and lessons learned from, eighteen years of assertional methods for specifying and verifying concurrent pro- grams. I then propose a Utopian future in which mathematics prevails. Keywords. Assertional methods, fairness, formal methods, mathemat- ics, Owicki-Gries method, temporal logic, TLA. Table of Contents 1 A Brief and Rather Biased History of State-Based Methods for Verifying Concurrent Systems .................. 2 1.1 From Floyd to Owicki and Gries, and Beyond ........... 2 1.2Temporal Logic ............................ 4 1.3 Unity ................................. 5 2 An Even Briefer and More Biased History of State-Based Specification Methods for Concurrent Systems ......... 6 2.1 Axiomatic Specifications ....................... 6 2.2 Operational Specifications ...................... 7 2.3 Finite-State Methods ........................ 8 3 What We Have Learned ........................ 8 3.1 Not Sequential vs. Concurrent, but Functional vs. Reactive ... 8 3.2Invariance Under Stuttering ..................... 8 3.3 The Definitions of Safety and Liveness ............... 9 3.4 Fairness is Machine Closure ..................... 10 3.5 Hiding is Existential Quantification ................ 10 3.6 Specification Methods that Don’t Work .............. 11 3.7 Specification Methods that Work for the Wrong Reason ..... 12 4 Other Methods ............................. 14 5 A Brief Advertisement for My Approach to State-Based Ver- ification and Specification of Concurrent Systems ....... 16 5.1 The Power of Formal Mathematics ................. 16 5.2Specifying Programs with Mathematical Formulas ........ 17 5.3 TLA .................................
    [Show full text]
  • Specifying Loops with Contracts Reasoning About Loops As Recursive Procedures
    Chair for Software Systems Institute for Informatics LMU Munich Bachelor Thesis in Computer Science: Specifying Loops With Contracts Reasoning about loops as recursive procedures Gregor Cassian Alexandru August 8, 2019 I dedicate this work to the memory of Prof. Martin Hofmann, who was an amazing teacher and inspiration, and left us all too soon. Hiermit versichere ich, dass ich die vorliegende Bachelorarbeit selbstständig verfasst und keine anderen als die angegebenen Quellen und Hilfsmittel verwendet habe. ............................................... (Unterschrift des Kandidaten) München, den 8. August 2019 5 Abstract Recursive procedures can be inductively verified to fulfill some contract, by assuming that contract for recursive calls. Since loops correspond essentially to linear recursion, they ought to be verifiable in an analogous manner. Rules that allow this have been proposed, but are incomplete in some aspect, or do not lend themselves to straight- forward implementation. We propose some implementation-oriented derivatives of the existing verification rules and further illustrate the advantages of contract-based loop specification by means of examples. Contents 1 Introduction 11 2 Motivating Example 12 2.1 Verification using an Invariant . 12 2.2 Using a local Recursive Procedure . 13 2.3 Comparison . 15 3 Preliminaries 16 4 Predicate transformer semantics 17 4.1 Prerequisites . 17 4.2 Loop specification rule for weakest precondition . 20 4.3 Soundness proof . 20 4.4 Context-aware rule . 22 4.5 Rules in strongest postcondition . 22 5 Rules in Hoare Logic 24 5.1 Preliminaries . 24 5.2 Loop specification rule in Hoare logic . 25 6 Implementation 26 7 Example Application to Textbook Algorithms 29 7.1 Euclid’s algorithm .
    [Show full text]
  • KAT and Hoare Logic
    Introduction to Kleene Algebra Lecture 14 CS786 Spring 2004 March 15, 2004 KAT and Hoare Logic In this lecture and the next we show that KAT subsumes propositional Hoare logic (PHL). Thus the specialized syntax and deductive apparatus of Hoare logic are inessential and can be replaced by simple equational reasoning. Moreover, all relationally valid Hoare-style inference rules are derivable in KAT (this is false for PHL). The results of this lecture are from [8, 7]. In a future lecture we will show that deciding the relational validity of such rules is PSPACE-complete. Hoare logic, introduced by C. A. R. Hoare in 1969 [6], was the first formal system for the specification and verification of well-structured programs. This pioneering work initiated the field of program correctness and inspired dozens of technical articles [2, 1, 3]. For this achievement among others, Hoare received the Turing Award in 1980. A comprehensive introduction to Hoare logic can be found in [3]. Hoare logic uses a specialized syntax involving partial correctness assertions (PCAs) of the form {b} p {c} and a deductive apparatus consisting of a system of specialized rules of inference. Under certain conditions, these rules are relatively complete [2]; essentially, the propositional fragment of the logic can be used to reduce partial correctness assertions to static assertions about the underlying domain of computation. The propositional fragment of Hoare logic, called propositional Hoare logic (PHL), is subsumed by KAT. The reduction transforms PCAs to ordinary equations and the specialized rules of inference to equational implications (universal Horn formulas). The transformed rules are all derivable in KAT by pure equational reasoning.
    [Show full text]
  • Cartesian Hoare Logic for Verifying K-Safety Properties ∗
    Cartesian Hoare Logic for Verifying k-Safety Properties ∗ Marcelo Sousa Isil Dillig University of Oxford, UK The University of Texas at Austin, USA [email protected] [email protected] Abstract produce outputs consistent with Ψ. Hence, a valid Hoare Unlike safety properties which require the absence of a “bad" triple states which input-output pairs are feasible in a single, program trace, k-safety properties stipulate the absence of but arbitrary, execution of S. a “bad" interaction between k traces. Examples of k-safety However, some important functional correctness proper- properties include transitivity, associativity, anti-symmetry, ties require reasoning about the relationship between multiple and monotonicity. This paper presents a sound and relatively program executions. As a simple example, consider deter- complete calculus, called Cartesian Hoare Logic (CHL), for minism, which requires 8x; y: x = y ) f(x) = f(y). This verifying k-safety properties. Our program logic is designed property is not a standard safety property because it cannot with automation and scalability in mind, allowing us to be violated by any individual execution trace. Instead, de- formulate a verification algorithm that automates reasoning terminism is a so-called 2-safety hyperproperty [10] since in CHL. We have implemented our verification algorithm in a we need two execution traces to establish its violation. In general, a k-safety (hyper-)property requires reasoning about fully automated tool called DESCARTES, which can be used to analyze any k-safety property of Java programs. We have relationships between k different execution traces. Even though there has been some work on verifying 2- used DESCARTES to analyze user-defined relational operators safety properties in the context of secure information flow [1, and demonstrate that DESCARTES is effective at verifying (or finding violations of) multiple k-safety properties.
    [Show full text]
  • Hoare Logic: Proving Programs Correct
    Hoare Logic: Proving Programs Correct 17-654/17-765 Analysis of Software Artifacts Jonathan Aldrich Reading: C.A.R. Hoare, An Axiomatic Basis for Computer Programming Some presentation ideas from a lecture by K. Rustan M. Leino Testing and Proofs • Testing • Proofs • Observable properties • Any program property • Verify program for one • Verify program for all execution executions • Manual development • Manual development with automated with automated proof regression checkers • Most practical approach • May be practical for now small programs in 10-20 years • So why learn about proofs if they aren’t practical? • Proofs tell us how to think about program correctness • Important for development, inspection • Foundation for static analysis tools • These are just simple, automated theorem provers • Many are practical today! Analysis of Software Artifacts - 3 Spring 2006 1 How would you argue that this program is correct? float sum(float *array, int length) { float sum = 0.0; int i = 0; while (i < length) { sum = sum + array[i]; i = i + 1; } return sum; } Analysis of Software Artifacts - 4 Spring 2006 Function Specifications • Predicate: a boolean function over program state • i.e. an expression that returns a boolean • We often use mathematical symbols as well as program text • Examples • x=3 • y > x • (x ≠ 0) ⇒ (y+z = w) Σ • s = (i ∈1..n) a[i] • ∀i∈1..n . a[i] > a[i-1] • true Analysis of Software Artifacts - 5 Spring 2006 2 Function Specifications • Contract between client and implementation • Precondition: • A predicate describing the condition the function relies on for correct operation • Postcondition: • A predicate describing the condition the function establishes after correctly running • Correctness with respect to the specification • If the client of a function fulfills the function’s precondition, the function will execute to completion and when it terminates, the postcondition will be true • What does the implementation have to fulfill if the client violates the precondition? • A: Nothing.
    [Show full text]
  • Hoare Logic and Model Checking
    Hoare Logic and Model Checking Kasper Svendsen University of Cambridge CST Part II { 2016/17 Acknowledgement: slides heavily based on previous versions by Mike Gordon and Alan Mycroft Course overview This course is about formal techniques for validating software. Formal methods allow us to formally specify the intended behaviour of our programs and use mathematical proof systems to formally prove that our programs satisfy their specification. In this course we will focus on two techniques: • Hoare logic (Lectures 1-6) • Model checking (Lectures 7-12) 1 Course overview There are many different formal reasoning techniques of varying expressivity and level of automation. model program typing checking logics automated manual 2 Formal vs. informal methods Testing can quickly find obvious bugs: • only trivial programs can be tested exhaustively • the cases you do not test can still hide bugs • coverage tools can help Formal methods can improve assurance: • allows us to reason about all possible executions • can reveal hard-to-find bugs 3 Famous software bugs At least 3 people were killed due to massive radiation overdoses delivered by a Therac-25 radiation therapy machine. • the cause was a race-condition in the control software An unmanned Ariane 5 rocket blew up on its maiden flight; the rocket and its cargo were estimated to be worth $500M. • the cause was an unsafe floating point to integer conversion 4 Formal vs. informal methods However, formal methods are not a panacea: • formally verified designs may still not work • can give a false sense of security • formal verification can be very expensive and time-consuming Formal methods should be used in conjunction with testing, not as a replacement.
    [Show full text]
  • Fifty Years of Hoare's Logic
    Fifty Years of Hoare's Logic Krzysztof R. Apt CWI, Amsterdam, The Netherlands MIMUW, University of Warsaw, Warsaw, Poland Ernst-R¨udigerOlderog University of Oldenburg, Oldenburg, Germany Contents 1 Introduction 2 2 Precursors 3 2.1 Turing . .3 2.2 Floyd . .5 3 Hoare's Contributions 6 3.1 Reasoning about while programs . .6 3.2 Reasoning about recursive procedures . .9 3.3 Reasoning about termination . 11 4 Soundness and Completeness Matters 13 4.1 Preliminaries . 13 4.2 Soundness . 14 4.3 Completeness . 15 5 Fine-tuning the Approach 18 5.1 Adaptation rules . 18 5.2 Subscripted and local variables . 20 5.3 Parameter mechanisms and procedure calls . 23 6 Reasoning about Arbitrary Procedures 25 arXiv:1904.03917v2 [cs.LO] 24 Oct 2019 6.1 Completeness results for recursive procedures . 25 6.2 Clarke's incompleteness result . 28 6.3 Clarke's language L4 ......................................... 29 6.4 The characterization problem . 30 1 7 Nondeterministic and Probabilistic Programs 32 7.1 Reasoning about nondeterminism . 32 7.2 Reasoning about fairness . 34 7.3 Probabilistic programs . 36 8 Parallel and Distributed Programs 37 8.1 Reasoning about parallel programs . 37 8.2 Reasoning about distributed programs . 42 9 Object-oriented Programs 46 9.1 Language characteristics . 46 9.2 Reasoning about object-oriented programs . 47 9.3 Advanced topics in the verification of object-oriented programs . 49 10 Alternative Approaches 51 10.1 Weakest precondition semantics and systematic program development . 51 10.2 Specifying in Hoare's logic . 53 10.3 Programming from specifications . 54 10.4 Algorithmic logic and dynamic logic .
    [Show full text]
  • HIDDEN FALLACIES in FORMALLY VERIFIED SYSTEMS a Thesis Presented to the Academic Faculty by Jan Bobek in Partial Fulfillment Of
    HIDDEN FALLACIES IN FORMALLY VERIFIED SYSTEMS A Thesis Presented to The Academic Faculty By Jan Bobek In Partial Fulfillment of the Requirements for the Degree Master of Science in Computer Science Georgia Institute of Technology May 2020 Copyright c Jan Bobek 2020 HIDDEN FALLACIES IN FORMALLY VERIFIED SYSTEMS Approved by: Dr. Taesoo Kim, Advisor Dr. Ada Gavrilovska School of Computer Science School of Computer Science Georgia Institute of Technology Georgia Institute of Technology Dr. Brendan Saltaformaggio School of Electrical and Computer Date Approved: April 23, 2020 Engineering Georgia Institute of Technology Dr. Calton Pu School of Computer Science Georgia Institute of Technology ACKNOWLEDGEMENTS I would like to thank my advisor, Dr. Taesoo Kim, for suggesting the topic of my thesis and guiding me throughout the thesis writing process, and his students, Meng Xu and Seulbae Kim, who have provided assistance and additional information about Hydra. I would also like to express my gratitude to Dr. Ada Gavrilovska, Dr. Brendan Saltafor- maggio and Dr. Calton Pu, from all of whom I have had the unforgettable chance to learn, for agreeing to serve on my thesis reading committee. iii TABLE OF CONTENTS Acknowledgments . iii List of Figures . vii Chapter 1: Introduction . 1 1.1 Model checkers and automated verifiers . 2 1.2 Interactive theorem provers . 3 1.3 About this thesis . 3 Chapter 2: Basic concepts in formal methods . 5 2.1 Logic and proof theory . 5 2.1.1 Deductive systems, proof calculus . 5 2.1.2 Propositional logic . 9 2.1.3 First-order logic . 11 2.1.4 Beyond first-order logic .
    [Show full text]
  • Chapter 17 Key-Hoare
    Chapter 17 KeY-Hoare Richard Bubel and Reiner Hähnle 17.1 Introduction In contrast to the other book chapters that focus on verification of real-world Java program, here we introduce a program logic and a tool based on KeY that has been designed solely for teaching purposes (see the discussion in Section 1.3.3). It is targeted towards B.Sc. students who get in contact with formal program verification for the first time. Hence, we focus on program verification itself, while treating first-order reasoning as a black box. We aimed to keep this chapter self-contained so that it can be given to students as reading material without requiring them to read other chapters in this book. Even though most of the concepts discussed here are identical to or simplified versions of those used by the KeY system for Java, there are subtle differences such as the representation of arrays, which we point out when appropriate. Experience gained from teaching program verification using Hoare logic [Hoare, 1969] (or its sibling the weakest precondition (wp) calculus [Dijkstra, 1976]) as part of introductory courses exposed certain short-comings when relying solely on text books with pen-and-paper exercises: • Using the original Hoare calculus requires to “guess” certain formulas, while using the more algorithmic wp-calculus requires to reason backwards through the target program, which is experienced as nonnatural by the students. • Doing program verification proofs by hand is tedious and error-prone even for experienced teachers. The reason is that trivial and often implicit assumptions like bounds or definedness of values are easily forgotten.
    [Show full text]
  • Rigorous Software Engineering Hoare Logic and Design by Contracts
    Rigorous Software Engineering Hoare Logic and Design by Contracts Sim~ao Melo de Sousa RELEASE (UBI), LIACC (Porto) Computer Science Department University of Beira Interior, Portugal 2010-2011 S. Melo de Sousa (DIUBI) Design by Contracts 2010-2011 1 / 46 Outline 1 Introduction 2 Hoare Logic 3 Weakest Precondition Calculus S. Melo de Sousa (DIUBI) Design by Contracts 2010-2011 2 / 46 Introduction Table of Contents 1 Introduction 2 Hoare Logic 3 Weakest Precondition Calculus S. Melo de Sousa (DIUBI) Design by Contracts 2010-2011 3 / 46 Introduction Floyd-Hoare Logic: Origins Robert W. Floyd. "Assigning meaning to programs"'. In Proc. Symp. in Applied Mathematics, volume 19, 1967. C. A. R. (Tony) Hoare. "An axiomatic basis for computer programming". Communications of the ACM, 12 (10): 576-585. October 1969. Edsger W. Dijkstra, "Guarded command, nondeterminacy and formal derivation of programs". Communication of the ACM, 18 (8):453-457, August 1975. S. Melo de Sousa (DIUBI) Design by Contracts 2010-2011 4 / 46 Introduction Main reference for this lecture Rigorous Software Development, A Practical Introduction to Program Specification and Verification by Jos´eBacelar Almeida, Maria Jo~ao Frade, Jorge Sousa Pinto, Sim~ao Melo de Sousa. Series: Undergraduate Topics in Computer Science, Springer. 1st Edition., 2011, XIII, 307 p. 52 illus. ISBN: 978-0-85729-017-5. S. Melo de Sousa (DIUBI) Design by Contracts 2010-2011 5 / 46 Introduction Logical state vs. programs Goal Provide means to prove the correctness and the safety of imperative programs. Notion of state: logical characterization of the set of values that are manipulated by the program, and their relation.
    [Show full text]