Engineering of Reliable and Secure Software Via Customizable Integrated Compilation Systems

Total Page:16

File Type:pdf, Size:1020Kb

Engineering of Reliable and Secure Software Via Customizable Integrated Compilation Systems Engineering of Reliable and Secure Software via Customizable Integrated Compilation Systems Zur Erlangung des akademischen Grades eines Doktors der Ingenieurwissenschaften von der KIT-Fakultät für Informatik des Karlsruher Institut für Technologie (KIT) genehmigte Dissertation von Dipl.-Inf. Oliver Scherer Tag der mündlichen Prüfung: 06.05.2021 1. Referent: Prof. Dr. Veit Hagenmeyer 2. Referent: Prof. Dr. Ralf Reussner This document is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA 4.0): https://creativecommons.org/licenses/by-sa/4.0/deed.en Abstract Lack of software quality can cause enormous unpredictable costs. Many strategies exist to prevent or detect defects as early in the development process as possible and can generally be separated into proactive and reactive measures. Proactive measures in this context are schemes where defects are avoided by planning a project in a way that reduces the probability of mistakes. They are expensive upfront without providing a directly visible benefit, have low acceptance by developers or don’t scale with the project. On the other hand, purely reactive measures only fix bugs as they are found and thus do not yield any guarantees about the correctness of the project. In this thesis, a new method is introduced, which allows focusing on the project specific issues and decreases the discrepancies between the abstract system model and the final software product. The first component of this method isa system that allows any developer in a project to implement new static analyses and integrate them into the project. The integration is done in a manner that automatically prevents any other project developer from accidentally violating the rule that the new static analysis checks. The second component is a way to directly integrate system models (e.g. from UML) into the project by treating the model as a direct input to the compiler, just like any other source code. These two components together allow developers to handle complex situations that are only relevant to the given project. The entire project gets analyzed for the correct usage of nontrivial APIs or other hazards which either are bugs or are likely to turn into bugs in future refactorings. Thus, the new method permits the incremental introduction of formal analysis without forcing a project’s developers to change to unfamiliar habits or styles. At the same time, it allows preventing classes of defects automatically, yielding immediate gains from the first usage of the new method. Contents 1 Introduction 1 1.1 Motivation ................................. 1 1.2 Overview over the state of the art of reliable and secure software ... 3 1.3 Open aspects of existing solutions .................... 4 1.4 Goals of this thesis ............................ 5 2 State of the art of reliable and secure software 7 2.1 Reliability ................................. 7 2.1.1 Availability ............................ 8 2.1.2 Redundancy ............................ 9 2.1.3 Security .............................. 10 2.1.4 Comprehensibility ........................ 10 2.2 Software engineering of reliable systems ................. 10 2.2.1 Software development process .................. 11 2.2.2 Continuous integration ...................... 11 2.2.3 Model checking .......................... 13 2.2.4 Typestate ............................. 13 2.2.5 Restricting Programming Languages to a safe subset ..... 15 2.2.6 Static Analyses .......................... 20 2.2.7 Project Specific Static Analyses ................. 21 2.2.8 Safety through Programming Languages ............ 22 2.2.9 Compiler extensions ....................... 23 3 New concept of an extendable compilation system with integrated static analysis 36 3.1 Components of compilation systems ................... 36 3.2 Automation in software engineering ................... 38 3.3 Analysis of requirements for extensible compilers ........... 38 3.3.1 Coverage of language constructs ................. 39 3.3.2 Direction of dataflow ....................... 39 3.4 Features enabled by the new concept .................. 41 3.4.1 Employing static analyses .................... 41 3.4.2 Model driven development .................... 47 3.4.3 Checking code against models .................. 48 3.4.4 Code generation from models .................. 49 3.4.5 Code generation vs code checking ................ 49 3.4.6 Abstract interpretation ...................... 50 3.5 Project specific compiler extensions instead of generally applicable tools .................................... 51 3.6 Lint categories .............................. 53 3.7 (Semi-)automatically resolving static analysis results ......... 55 3.8 Incremental steps towards full formal analysis ............. 55 3.9 Summary ................................. 56 4 Comparison of the new concept with related works 58 4.1 Components of compilation systems ................... 59 4.2 Automation in software engineering ................... 60 4.3 Compiler extensions ........................... 61 4.4 Formal analysis .............................. 61 4.5 Model driven development ........................ 62 4.5.1 Code generation ......................... 62 4.5.2 Manual transcription ....................... 62 4.5.3 New concept ........................... 62 4.6 Static analyses .............................. 63 5 Implementation of the components of the new concept 64 5.1 Integrating static analyses into the development process ....... 65 5.1.1 Developing a new static analysis ................ 65 5.1.2 Choosing a responsiveness level ................. 66 5.1.3 Forward compatibility of compiler extensions ......... 67 5.1.4 Diagnostics ............................ 67 5.1.5 Problem resolution instructions ................. 68 5.2 Model driven development ........................ 69 5.2.1 Code generation ......................... 69 5.2.2 Code checking .......................... 74 5.3 Abstract interpretation .......................... 76 5.3.1 Running abstract interpretation on test suites ......... 77 5.3.2 Restraining the virtual machine ................. 78 5.3.3 Employing abstract interpretation for debugging purposes .. 80 5.3.4 Summary ............................. 81 6 Aspects of the practical application of the new concept 82 6.1 Role of false positives on the usability of static analyses ........ 82 6.1.1 Stability across compiler changes ................ 85 6.2 Compiler extension schemes ....................... 89 6.3 Generating static analyses from examples ................ 89 6.3.1 The problem ........................... 89 6.3.2 The new tool and its usage ................... 90 6.4 Community driven database ....................... 93 7 Evaluation 96 7.1 Analysis of the goals of this thesis .................... 96 7.2 Usability study .............................. 97 7.2.1 Collected data .......................... 98 7.2.2 Analysis .............................. 98 7.2.3 Limits of this study ....................... 98 8 Conclusion 99 8.1 Contributions ............................... 101 8.2 Limits ................................... 102 8.3 Outlook .................................. 102 Abbreviations 104 Bibliography 106 A Semantic versioning 118 B Forward compatibility guarantees 119 C The Rust programming language 121 C.1 Basics ................................... 121 C.2 Constructors ............................... 121 C.3 Destructuring ............................... 122 C.4 Refutable destructuring ......................... 123 C.5 Ownership ................................. 124 D Rustc internals 126 D.1 AST Items ................................. 126 D.2 AST Types ................................ 127 D.3 AST Expressions ............................. 127 E Pointer equality operation during abstract interpretation 131 F Code generation from model 132 G Custom driver for project specific static analyses 135 H init function call before foo function call demo 137 I Survey about the ease of tool integration 145 J Full list of related publications 146 J.1 Peer reviewed conferences and journals ................. 146 J.2 Language design and standardization (peer reviewed white papers) . 146 J.3 Peer reviewed open source ........................ 147 Chapter 1 Introduction 1.1 Motivation Adding new ways to access any system, be it physical, informational or digital, comes with the inherent risk of giving access to unauthorized parties. Physical security has been a part of humanity since its dawn and part of the animal kingdom before that. Protecting offspring or property via preparation has clearly been a beneficial trait. Even before the existence of writing knowledge has been kept secret or hidden in code words. Communicating information without fear of interception by either the messenger or third parties was an issue well before the beginning of our calendar [63]. But only with the invention of automated information processing has the protection against malicious information become an end in itself. When it became possible to connect to computers via phone lines, systems did not have any IT-security (from here on just referred to as “security”) concept except for the secrecy of the phone number used to connect to it. Thus, the cat and mouse game of inventing new attacks and defending against them began with automated systems calling every possible phone number to find computers. After these systems were considered reasonably secure, the internet opened a new avenue of attack, because a system was not limited to
Recommended publications
  • Static Analysis the Workhorse of a End-To-End Securitye Testing Strategy
    Static Analysis The Workhorse of a End-to-End Securitye Testing Strategy Achim D. Brucker [email protected] http://www.brucker.uk/ Department of Computer Science, The University of Sheffield, Sheffield, UK Winter School SECENTIS 2016 Security and Trust of Next Generation Enterprise Information Systems February 8–12, 2016, Trento, Italy Static Analysis: The Workhorse of a End-to-End Securitye Testing Strategy Abstract Security testing is an important part of any security development lifecycle (SDL) and, thus, should be a part of any software (development) lifecycle. Still, security testing is often understood as an activity done by security testers in the time between “end of development” and “offering the product to customers.” Learning from traditional testing that the fixing of bugs is the more costly the later it is done in development, security testing should be integrated, as early as possible, into the daily development activities. The fact that static analysis can be deployed as soon as the first line of code is written, makes static analysis the right workhorse to start security testing activities. In this lecture, I will present a risk-based security testing strategy that is used at a large European software vendor. While this security testing strategy combines static and dynamic security testing techniques, I will focus on static analysis. This lecture provides a introduction to the foundations of static analysis as well as insights into the challenges and solutions of rolling out static analysis to more than 20000 developers, distributed across the whole world. A.D. Brucker The University of Sheffield Static Analysis February 8–12., 2016 2 Today: Background and how it works ideally Tomorrow: (Ugly) real world problems and challenges (or why static analysis is “undecideable” in practice) Our Plan A.D.
    [Show full text]
  • Precise and Scalable Static Program Analysis of NASA Flight Software
    Precise and Scalable Static Program Analysis of NASA Flight Software G. Brat and A. Venet Kestrel Technology NASA Ames Research Center, MS 26912 Moffett Field, CA 94035-1000 650-604-1 105 650-604-0775 brat @email.arc.nasa.gov [email protected] Abstract-Recent NASA mission failures (e.g., Mars Polar Unfortunately, traditional verification methods (such as Lander and Mars Orbiter) illustrate the importance of having testing) cannot guarantee the absence of errors in software an efficient verification and validation process for such systems. Therefore, it is important to build verification tools systems. One software error, as simple as it may be, can that exhaustively check for as many classes of errors as cause the loss of an expensive mission, or lead to budget possible. Static program analysis is a verification technique overruns and crunched schedules. Unfortunately, traditional that identifies faults, or certifies the absence of faults, in verification methods cannot guarantee the absence of errors software without having to execute the program. Using the in software systems. Therefore, we have developed the CGS formal semantic of the programming language (C in our static program analysis tool, which can exhaustively analyze case), this technique analyses the source code of a program large C programs. CGS analyzes the source code and looking for faults of a certain type. We have developed a identifies statements in which arrays are accessed out Of static program analysis tool, called C Global Surveyor bounds, or, pointers are used outside the memory region (CGS), which can analyze large C programs for embedded they should address.
    [Show full text]
  • Static Program Analysis Via 3-Valued Logic
    Static Program Analysis via 3-Valued Logic ¡ ¢ £ Thomas Reps , Mooly Sagiv , and Reinhard Wilhelm ¤ Comp. Sci. Dept., University of Wisconsin; [email protected] ¥ School of Comp. Sci., Tel Aviv University; [email protected] ¦ Informatik, Univ. des Saarlandes;[email protected] Abstract. This paper reviews the principles behind the paradigm of “abstract interpretation via § -valued logic,” discusses recent work to extend the approach, and summarizes on- going research aimed at overcoming remaining limitations on the ability to create program- analysis algorithms fully automatically. 1 Introduction Static analysis concerns techniques for obtaining information about the possible states that a program passes through during execution, without actually running the program on specific inputs. Instead, static-analysis techniques explore a program’s behavior for all possible inputs and all possible states that the program can reach. To make this feasible, the program is “run in the aggregate”—i.e., on abstract descriptors that repre- sent collections of many states. In the last few years, researchers have made important advances in applying static analysis in new kinds of program-analysis tools for identi- fying bugs and security vulnerabilities [1–7]. In these tools, static analysis provides a way in which properties of a program’s behavior can be verified (or, alternatively, ways in which bugs and security vulnerabilities can be detected). Static analysis is used to provide a safe answer to the question “Can the program reach a bad state?” Despite these successes, substantial challenges still remain. In particular, pointers and dynamically-allocated storage are features of all modern imperative programming languages, but their use is error-prone: ¨ Dereferencing NULL-valued pointers and accessing previously deallocated stor- age are two common programming mistakes.
    [Show full text]
  • Opportunities and Open Problems for Static and Dynamic Program Analysis Mark Harman∗, Peter O’Hearn∗ ∗Facebook London and University College London, UK
    1 From Start-ups to Scale-ups: Opportunities and Open Problems for Static and Dynamic Program Analysis Mark Harman∗, Peter O’Hearn∗ ∗Facebook London and University College London, UK Abstract—This paper1 describes some of the challenges and research questions that target the most productive intersection opportunities when deploying static and dynamic analysis at we have yet witnessed: that between exciting, intellectually scale, drawing on the authors’ experience with the Infer and challenging science, and real-world deployment impact. Sapienz Technologies at Facebook, each of which started life as a research-led start-up that was subsequently deployed at scale, Many industrialists have perhaps tended to regard it unlikely impacting billions of people worldwide. that much academic work will prove relevant to their most The paper identifies open problems that have yet to receive pressing industrial concerns. On the other hand, it is not significant attention from the scientific community, yet which uncommon for academic and scientific researchers to believe have potential for profound real world impact, formulating these that most of the problems faced by industrialists are either as research questions that, we believe, are ripe for exploration and that would make excellent topics for research projects. boring, tedious or scientifically uninteresting. This sociological phenomenon has led to a great deal of miscommunication between the academic and industrial sectors. I. INTRODUCTION We hope that we can make a small contribution by focusing on the intersection of challenging and interesting scientific How do we transition research on static and dynamic problems with pressing industrial deployment needs. Our aim analysis techniques from the testing and verification research is to move the debate beyond relatively unhelpful observations communities to industrial practice? Many have asked this we have typically encountered in, for example, conference question, and others related to it.
    [Show full text]
  • DEVELOPING SECURE SOFTWARE T in an AGILE PROCESS Dejan
    Software - in an - in Software Developing Secure aBSTRACT Background: Software developers are facing in- a real industry setting. As secondary methods for creased pressure to lower development time, re- data collection a variety of approaches have been Developing Secure Software lease new software versions more frequent to used, such as semi-structured interviews, work- customers and to adapt to a faster market. This shops, study of literature, and use of historical data - in an agile proceSS new environment forces developers and companies from the industry. to move from a plan based waterfall development process to a flexible agile process. By minimizing Results: The security engineering best practices the pre development planning and instead increa- were investigated though a series of case studies. a sing the communication between customers and The base agile and security engineering compati- gile developers, the agile process tries to create a new, bility was assessed in literature, by developers and more flexible way of working. This new way of in practical studies. The security engineering best working allows developers to focus their efforts on practices were group based on their purpose and p the features that customers want. With increased their compatibility with the agile process. One well roce connectability and the faster feature release, the known and popular best practice, automated static Dejan Baca security of the software product is stressed. To de- code analysis, was toughly investigated for its use- velop secure software, many companies use secu- fulness, deployment and risks of using as part of SS rity engineering processes that are plan heavy and the process.
    [Show full text]
  • Using Static Program Analysis to Aid Intrusion Detection
    Using Static Program Analysis to Aid Intrusion Detection Manuel Egele, Martin Szydlowski, Engin Kirda, and Christopher Kruegel Secure Systems Lab Technical University Vienna fpizzaman,msz,ek,[email protected] Abstract. The Internet, and in particular the world-wide web, have be- come part of the everyday life of millions of people. With the growth of the web, the demand for on-line services rapidly increased. Today, whole industry branches rely on the Internet to do business. Unfortunately, the success of the web has recently been overshadowed by frequent reports of security breaches. Attackers have discovered that poorly written web applications are the Achilles heel of many organizations. The reason is that these applications are directly available through firewalls and are of- ten developed by programmers who focus on features and tight schedules instead of security. In previous work, we developed an anomaly-based intrusion detection system that uses learning techniques to identify attacks against web- based applications. That system focuses on the analysis of the request parameters in client queries, but does not take into account any infor- mation about the protected web applications themselves. The result are imprecise models that lead to more false positives and false negatives than necessary. In this paper, we describe a novel static source code analysis approach for PHP that allows us to incorporate information about a web application into the intrusion detection models. The goal is to obtain a more precise characterization of web request parameters by analyzing their usage by the program. This allows us to generate more precise intrusion detection models.
    [Show full text]
  • Introduction to Static Analysis
    Introduction to Static Analysis 17-654: Analysis of Software Artifacts Jonathan Aldrich 2/21/2011 17-654: Analysis of Software Artifacts 1 Static Analysis Source: Engler et al., Checking System Rules Using System-Specific, Programmer-Written Find the Bug! Compiler Extensions , OSDI ’00. disable interrupts ERROR: returning with interrupts disabled re-enable interrupts 2/21/2011 17-654: Analysis of Software Artifacts 2 Static Analysis 1 Metal Interrupt Analysis Source: Engler et al., Checking System Rules Using System-Specific, Programmer-Written Compiler Extensions , OSDI ’00. enable => err(double enable) is_enabled enable disable is_disabled end path => err(end path with/intr disabled) disable => err(double disable) 2/21/2011 17-654: Analysis of Software Artifacts 3 Static Analysis Source: Engler et al., Checking System Rules Using System-Specific, Programmer-Written Applying the Analysis Compiler Extensions , OSDI ’00. initial state is_enabled transition to is_disabled final state is_disabled: ERROR! transition to is_enabled final state is_enabled is OK 2/21/2011 17-654: Analysis of Software Artifacts 4 Static Analysis 2 Outline • Why static analysis? • The limits of testing and inspection • What is static analysis? • How does static analysis work? • AST Analysis • Dataflow Analysis 2/21/2011 17-654: Analysis of Software Artifacts 5 Static Analysis 2/21/2011 17-654: Analysis of Software Artifacts 6 Static Analysis 3 Process, Cost, and Quality Slide: William Scherlis Process intervention, Additional technology testing, and inspection and tools are needed to yield first-order close the gap software quality improvement Perfection (unattainable) Critical Systems Acceptability Software Quality Process CMM: 1 2 3 4 5 Rigor, Cost S&S, Agile, RUP, etc: less rigorous .
    [Show full text]
  • Automated Large-Scale Multi-Language Dynamic Program
    Automated Large-Scale Multi-Language Dynamic Program Analysis in the Wild Alex Villazón Universidad Privada Boliviana, Bolivia [email protected] Haiyang Sun Università della Svizzera italiana, Switzerland [email protected] Andrea Rosà Università della Svizzera italiana, Switzerland [email protected] Eduardo Rosales Università della Svizzera italiana, Switzerland [email protected] Daniele Bonetta Oracle Labs, United States [email protected] Isabella Defilippis Universidad Privada Boliviana, Bolivia isabelladefi[email protected] Sergio Oporto Universidad Privada Boliviana, Bolivia [email protected] Walter Binder Università della Svizzera italiana, Switzerland [email protected] Abstract Today’s availability of open-source software is overwhelming, and the number of free, ready-to-use software components in package repositories such as NPM, Maven, or SBT is growing exponentially. In this paper we address two straightforward yet important research questions: would it be possible to develop a tool to automate dynamic program analysis on public open-source software at a large scale? Moreover, and perhaps more importantly, would such a tool be useful? We answer the first question by introducing NAB, a tool to execute large-scale dynamic program analysis of open-source software in the wild. NAB is fully-automatic, language-agnostic, and can scale dynamic program analyses on open-source software up to thousands of projects hosted in code repositories. Using NAB, we analyzed more than 56K Node.js, Java, and Scala projects. Using the data collected by NAB we were able to (1) study the adoption of new language constructs such as JavaScript Promises, (2) collect statistics about bad coding practices in JavaScript, and (3) identify Java and Scala task-parallel workloads suitable for inclusion in a domain-specific benchmark suite.
    [Show full text]
  • An Efficient and Scalable Platform for Java Source Code Analysis Using Overlaid Graph Representations
    Received March 10, 2020, accepted April 7, 2020, date of publication April 13, 2020, date of current version April 29, 2020. Digital Object Identifier 10.1109/ACCESS.2020.2987631 An Efficient and Scalable Platform for Java Source Code Analysis Using Overlaid Graph Representations OSCAR RODRIGUEZ-PRIETO1, ALAN MYCROFT2, AND FRANCISCO ORTIN 1,3 1Department of Computer Science, University of Oviedo, 33007 Oviedo, Spain 2Department of Computer Science and Technology, University of Cambridge, Cambridge CB2 1TN, U.K. 3Department of Computer Science, Cork Institute of Technology, Cork 021, T12 P928 Ireland Corresponding author: Francisco Ortin ([email protected]) This work was supported in part by the Spanish Department of Science, Innovation and Universities under Project RTI2018-099235-B-I00. The work of Oscar Rodriguez-Prieto and Francisco Ortin was supported by the University of Oviedo through its support to official research groups under Grant GR-2011-0040. ABSTRACT Although source code programs are commonly written as textual information, they enclose syntactic and semantic information that is usually represented as graphs. This information is used for many different purposes, such as static program analysis, advanced code search, coding guideline checking, software metrics computation, and extraction of semantic and syntactic information to create predictive models. Most of the existing systems that provide these kinds of services are designed ad hoc for the particular purpose they are aimed at. For this reason, we created ProgQuery, a platform to allow users to write their own Java program analyses in a declarative fashion, using graph representations. We modify the Java compiler to compute seven syntactic and semantic representations, and store them in a Neo4j graph database.
    [Show full text]
  • Postprocessing of Static Analysis Alarms
    Postprocessing of static analysis alarms Citation for published version (APA): Muske, T. B. (2020). Postprocessing of static analysis alarms. Eindhoven University of Technology. Document status and date: Published: 07/07/2020 Document Version: Publisher’s PDF, also known as Version of Record (includes final page, issue and volume numbers) Please check the document version of this publication: • A submitted manuscript is the version of the article upon submission and before peer-review. There can be important differences between the submitted version and the official published version of record. People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website. • The final author version and the galley proof are versions of the publication after peer review. • The final published version features the final layout of the paper including the volume, issue and page numbers. Link to publication General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal. If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license above, please follow below link for the End User Agreement: www.tue.nl/taverne Take down policy If you believe that this document breaches copyright please contact us at: [email protected] providing details and we will investigate your claim.
    [Show full text]
  • Seminar 6 - Static Code Analysis
    Seminar 6 - Static Code Analysis PV260 Software Quality March 26, 2015 Overview Static program analysis is the analysis of computer software that is performed without actually executing programs. In most cases the analysis is performed on some version of the source code, and in the other cases, some form of the object code. The term is usually applied to the analysis performed by an automated tool. Things to keep in mind: I The tools can usually not find all the problems in the system (False Negatives) I Not all of the detections are real problems (False Positives) I There is no one tool which could be used for everything, more tools are usually used in parallel (Overlaps will occur) I We must know what we are looking for, using everything the tool offers usually results in too much useless data Source Code Analysis - Checkstyle http://checkstyle.sourceforge.net/ Checkstyle can check many aspects of your source code. It can find class design problems, method desig problems. It also have ability to check code layout and formatting issues. PROS: CONS: I Type information is lost I Can be used to check programming style making some checks impossible I Many premade checks available I Files are checked sequentially, content of all New checks are easy to add I files can't be seen at once Available standard checks: http://checkstyle.sourceforge.net/checks.html Bytecode Analysis - Findbugs http://findbugs.sourceforge.net/ FindBugs looks for bugs in Java programs. It is based on the concept of bug patterns. A bug pattern is a code idiom that is often an error.
    [Show full text]
  • Testing Code
    CHAPTER 13 Testing Code By Phil Ames and Franjo Ivančić with Vera Haas and Jen Barnason A reliable system is resilient to failures and meets its documented service level objec‐ tives, which may also include security guarantees. Robust software testing and analy‐ sis are useful aids in mitigating failure risks, and should be a particular focus during the project implementation phase. In this chapter, we discuss several approaches to testing, including unit and integra‐ tion testing. We also cover additional security deep-dive topics like static and dynamic program analysis and fuzz testing, which can help strengthen your soft‐ ware’s resilience against the inputs it encounters. No matter how careful the engineers developing your software are, some mistakes and overlooked edge cases are inevitable. Unexpected input combinations may trig‐ ger data corruption or result in availability issues like the “Query of Death” example in Chapter 22 of the SRE book. Coding errors can cause security problems like buffer overflows and cross-site scripting vulnerabilities. Put simply, there are many ways software is prone to failure in the real world. The techniques discussed in this chapter, used in different stages and contexts of soft‐ ware development, have a variety of cost–benefit profiles.1 For example, fuzzing— sending random requests to a system—can help you harden that system in terms of both security and reliability. This technique can potentially help you catch 1 We recommend checking out Chapter 17 of the SRE book for a reliability-focused perspective. 271 information leaks and reduce serving errors by exposing the service to a multitude of edge cases.
    [Show full text]