DOCSLIB.ORG

Postprocessing of Static Analysis Alarms

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Postprocessing of Static Analysis Alarms Postprocessing of static analysis alarms Citation for published version (APA): Muske, T. B. (2020). Postprocessing of static analysis alarms. Eindhoven University of Technology. Document status and date: Published: 07/07/2020 Document Version: Publisher’s PDF, also known as Version of Record (includes final page, issue and volume numbers) Please check the document version of this publication: • A submitted manuscript is the version of the article upon submission and before peer-review. There can be important differences between the submitted version and the official published version of record. People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website. • The final author version and the galley proof are versions of the publication after peer review. • The final published version features the final layout of the paper including the volume, issue and page numbers. Link to publication General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal. If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license above, please follow below link for the End User Agreement: www.tue.nl/taverne Take down policy If you believe that this document breaches copyright please contact us at: [email protected] providing details and we will investigate your claim. Download date: 30. Sep. 2021 Postprocessing of Static Analysis Alarms PROEFSCHRIFT ter verkrijging van de graad van doctor aan de Technische Universiteit Eindhoven, op gezag van de rector magnificus prof.dr.ir. F.P.T. Baaijens, voor een commissie aangewezen door het College voor Promoties, in het openbaar te verdedigen op dinsdag 7 juli 2020 om 13:30 uur door Tukaram Bhagwat Muske geboren te Hipparsoga, Maharashtra, India Dit proefschrift is goedgekeurd door de promotoren en de amenstelling van de promotiecommissie is als volgt: voorzitter: prof.dr. J.J. Lukkien 1e promotor: dr. A. Serebrenik 2e promotor: prof.dr. M.G.J. van den Brand leden: prof.dr.ir. J.P.M. Voeten prof.dr. S. Schupp (Hamburg University of Technology) prof.dr. Y. Smaragdakis (University of Athens) adviseurs: dr.ir. T.A.C. Willemse MSc. R. Venkatesh (Tata Consultancy Services, India) Het onderzoek of ontwerp dat in dit proefschrift wordt beschreven is uitgevoerd in overeenstemming met de TU/e Gedragscode Wetenschapsbeoefening. Postprocessing of Static Analysis Alarms Tukaram Bhagwat Muske First promotor: Dr. A. Serebrenik (Eindhoven University of Technology) Second promotor: Prof. Dr. M.G.J. van den Brand (Eindhoven University of Technology) Additional members of the reading committee: Prof. Dr. S. Schupp (Hamburg University of Technology) Prof. Dr. Y. Smaragdakis (University of Athens) Prof. Dr. ir. J.P.M. Voeten (Eindhoven University of Technology) Dr. ir. T.A.C. Willemse (Eindhoven University of Technology) MSc. R. Venkatesh (TRDDC, Tata Consultancy Services) The work in this thesis has been fully funded by Tata Consultancy Services Limited, India. A catalogue record is available from the Eindhoven University of Technology Library ISBN: 978-90-386-5037-1 An electronic version of this dissertation is available at https://research.tue.nl/ and https://tmuske.github.io/phdThesis/ Cover design: Anushri Jana & Ankur Jana Printed by: ProefschriftMaken ll www.proefschriftmaken.nl Copyright © 2020 by Tukaram Bhagwat Muske. All rights are reserved. No part of this publica- tion may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronically, mechanically, photocopying, recording or otherwise, without prior permission of the author. Dedicated to... Vitthal Wangwad my grandfather, without whom my education would have not been possible. Acknowledgements And the time has come to express my deep gratitude and sincere thanks to all those who motivated me to undertake this journey for a PhD, who helped me along the journey, and who contributed in an invaluable way to the completion of the thesis. The list is very long! Taking the path for a PhD requires a lot of motivation and clarity. After having settled as an applied researcher in TRDDC, TCS, for about six years, I was still lacking these. Uday Sir (my mentor, and a professor at IIT Bombay), and Ulka and Venky (my supervisors at TCS), you were those who kept motivating me to do a PhD. The process, to motivate me, started sometime in 2011, and went on for almost five years. Without your constant push, I wouldn’t have taken this path. And not just for motivating, I am also grateful to you for being there always for me whenever I required any guidance and support. You have always given me more than what I have asked for, and the same support continues even now! You were instrumental in setting up the stage and ensuring I reach here. Venky and Ulka, I have always enjoyed being supervised by you, and am thankful to you for leading me in a fruitful direction and allowing me the freedom to explore them. Ananth (CTO at TCS) and RD (TRDDC Head), I can’t miss mentioning you! Your opinion and feedback was crucial in making my decision to go for the PhD. Towards the end of 2015, the decision was made. So, the time had arrived, but not the place! The place for my PhD arrived (rather, I arrived at the place) when I visited TU/e for ETAPS 2016. It was there that I met you both Mark and Alexander (from TU/e). The way you ex- plained the process and available options, and offered me the unique opportunity, the decision for the place was immediate! And the journey started. Since then, you both have been wonderful, friendly, and encouraging PhD supervisors (which, I later discovered, was a unanimous feeling among the PhD students at TU/e). You have helped me become a better person, both academ- ically and personally. Alexander, if I express my gratitude to you in words, the expression will not do justice to the support, mentoring, and guidance that I have received from you, because no words can express it. Mark, thank you so much for finding time from your busy schedules and providing valuable feedback from time to time. I have enjoyed discussions with you, and have always benefited from your insightful suggestions and vast experience. Also, I cannot forget the warm welcomes and send-offs you both gave whenever I visited TU/e. I could see the effort that you both put in, to make me feel at home and ensure that I get enough exposure and learning experience through interactions with the people from within and outside the group. Thank you both, again, for making my PhD journey a very smooth and joyful ride. Before I continue to thank everyone who helped me during the journey, I would like to pause and thank, sincerely, all the members of my thesis review committee. Prof. Lukkien, Prof. Voeten, Prof. Schupp, Prof. Smaragdakis, including Tim, Venky, Mark, and Alexander, your detailed and insightful comments have improved the thesis remarkably. Moreover, your comments helped me gain new insights into the work and look at it from different perspectives. I truly appreciate the time and effort you put in to review the thesis. ii Now its time to thank those who were there for me whenever I required anything officially or personally. Hari and Samina (from our HR team at TCS), I appreciate the way you helped me by taking care of so many formalities, including the ones necessary to arrange my visits to TU/e and Alexander’s visits to TRDDC. Shrawan (a senior from our group at TCS, and a close mentor), please accept my deepest thanks for guiding me in the implementation and evaluation of the techniques included in the thesis. Metta (a senior in my group at TCS), I don’t know how to express my gratitude to you, man! You have always been there as a friend, colleague, and personal mentor. Madhukar (my desk-mate at TCS and, more importantly, a friend), I am grateful to you for being there beside me all the time and helping me wherever I required your expertise in several things. Komal and Divyesh (my friends at TCS, and also cadets, like me, in PhD program), thanks to you as well! I loved and enjoyed the PhD related discussions, and appreciate your help whenever I asked for. Advaita, Bharti, Prasad, Priyanka, Anushri, Amey, Supriya, and everyone in the Foundations of Computing group at TRDDC, you all have been such amazing friends and have helped me in many ways. Avriti, thanks a lot for helping me to set up the tool chain required for evaluating the AFPE techniques. Shivayu, Rohith, Vishnu Priya, and Abhinav, thank you for making my PhD life a lot easier. Without you, the work in the thesis would not have been completed. Peeyush, Anushri Laddha, Nathan van Beusekom, and Prajkta, thanks for helping me with the implement- ations and evaluations of the techniques during your internships at TRDDC. Ankur and Anushri, I sincererly appreciate your help in designing the cover page of the book. Paddy (a close friend from Oracle Labs in Brisbane), I can’t miss this opportunity to thank you and appreciate your timely reviews of papers even at my last-hour requests.
Load more

Recommended publications
  • Static Analysis the Workhorse of a End-To-End Securitye Testing Strategy
    Static Analysis The Workhorse of a End-to-End Securitye Testing Strategy Achim D. Brucker [email protected] http://www.brucker.uk/ Department of Computer Science, The University of Sheffield, Sheffield, UK Winter School SECENTIS 2016 Security and Trust of Next Generation Enterprise Information Systems February 8–12, 2016, Trento, Italy Static Analysis: The Workhorse of a End-to-End Securitye Testing Strategy Abstract Security testing is an important part of any security development lifecycle (SDL) and, thus, should be a part of any software (development) lifecycle. Still, security testing is often understood as an activity done by security testers in the time between “end of development” and “offering the product to customers.” Learning from traditional testing that the fixing of bugs is the more costly the later it is done in development, security testing should be integrated, as early as possible, into the daily development activities. The fact that static analysis can be deployed as soon as the first line of code is written, makes static analysis the right workhorse to start security testing activities. In this lecture, I will present a risk-based security testing strategy that is used at a large European software vendor. While this security testing strategy combines static and dynamic security testing techniques, I will focus on static analysis. This lecture provides a introduction to the foundations of static analysis as well as insights into the challenges and solutions of rolling out static analysis to more than 20000 developers, distributed across the whole world. A.D. Brucker The University of Sheffield Static Analysis February 8–12., 2016 2 Today: Background and how it works ideally Tomorrow: (Ugly) real world problems and challenges (or why static analysis is “undecideable” in practice) Our Plan A.D.
    [Show full text]
  • Precise and Scalable Static Program Analysis of NASA Flight Software
    Precise and Scalable Static Program Analysis of NASA Flight Software G. Brat and A. Venet Kestrel Technology NASA Ames Research Center, MS 26912 Moffett Field, CA 94035-1000 650-604-1 105 650-604-0775 brat @email.arc.nasa.gov [email protected] Abstract-Recent NASA mission failures (e.g., Mars Polar Unfortunately, traditional verification methods (such as Lander and Mars Orbiter) illustrate the importance of having testing) cannot guarantee the absence of errors in software an efficient verification and validation process for such systems. Therefore, it is important to build verification tools systems. One software error, as simple as it may be, can that exhaustively check for as many classes of errors as cause the loss of an expensive mission, or lead to budget possible. Static program analysis is a verification technique overruns and crunched schedules. Unfortunately, traditional that identifies faults, or certifies the absence of faults, in verification methods cannot guarantee the absence of errors software without having to execute the program. Using the in software systems. Therefore, we have developed the CGS formal semantic of the programming language (C in our static program analysis tool, which can exhaustively analyze case), this technique analyses the source code of a program large C programs. CGS analyzes the source code and looking for faults of a certain type. We have developed a identifies statements in which arrays are accessed out Of static program analysis tool, called C Global Surveyor bounds, or, pointers are used outside the memory region (CGS), which can analyze large C programs for embedded they should address.
    [Show full text]
  • Static Program Analysis Via 3-Valued Logic
    Static Program Analysis via 3-Valued Logic ¡ ¢ £ Thomas Reps , Mooly Sagiv , and Reinhard Wilhelm ¤ Comp. Sci. Dept., University of Wisconsin; [email protected] ¥ School of Comp. Sci., Tel Aviv University; [email protected] ¦ Informatik, Univ. des Saarlandes;[email protected] Abstract. This paper reviews the principles behind the paradigm of “abstract interpretation via § -valued logic,” discusses recent work to extend the approach, and summarizes on- going research aimed at overcoming remaining limitations on the ability to create program- analysis algorithms fully automatically. 1 Introduction Static analysis concerns techniques for obtaining information about the possible states that a program passes through during execution, without actually running the program on specific inputs. Instead, static-analysis techniques explore a program’s behavior for all possible inputs and all possible states that the program can reach. To make this feasible, the program is “run in the aggregate”—i.e., on abstract descriptors that repre- sent collections of many states. In the last few years, researchers have made important advances in applying static analysis in new kinds of program-analysis tools for identi- fying bugs and security vulnerabilities [1–7]. In these tools, static analysis provides a way in which properties of a program’s behavior can be verified (or, alternatively, ways in which bugs and security vulnerabilities can be detected). Static analysis is used to provide a safe answer to the question “Can the program reach a bad state?” Despite these successes, substantial challenges still remain. In particular, pointers and dynamically-allocated storage are features of all modern imperative programming languages, but their use is error-prone: ¨ Dereferencing NULL-valued pointers and accessing previously deallocated stor- age are two common programming mistakes.
    [Show full text]
  • Opportunities and Open Problems for Static and Dynamic Program Analysis Mark Harman∗, Peter O’Hearn∗ ∗Facebook London and University College London, UK
    1 From Start-ups to Scale-ups: Opportunities and Open Problems for Static and Dynamic Program Analysis Mark Harman∗, Peter O’Hearn∗ ∗Facebook London and University College London, UK Abstract—This paper1 describes some of the challenges and research questions that target the most productive intersection opportunities when deploying static and dynamic analysis at we have yet witnessed: that between exciting, intellectually scale, drawing on the authors’ experience with the Infer and challenging science, and real-world deployment impact. Sapienz Technologies at Facebook, each of which started life as a research-led start-up that was subsequently deployed at scale, Many industrialists have perhaps tended to regard it unlikely impacting billions of people worldwide. that much academic work will prove relevant to their most The paper identifies open problems that have yet to receive pressing industrial concerns. On the other hand, it is not significant attention from the scientific community, yet which uncommon for academic and scientific researchers to believe have potential for profound real world impact, formulating these that most of the problems faced by industrialists are either as research questions that, we believe, are ripe for exploration and that would make excellent topics for research projects. boring, tedious or scientifically uninteresting. This sociological phenomenon has led to a great deal of miscommunication between the academic and industrial sectors. I. INTRODUCTION We hope that we can make a small contribution by focusing on the intersection of challenging and interesting scientific How do we transition research on static and dynamic problems with pressing industrial deployment needs. Our aim analysis techniques from the testing and verification research is to move the debate beyond relatively unhelpful observations communities to industrial practice? Many have asked this we have typically encountered in, for example, conference question, and others related to it.
    [Show full text]
  • DEVELOPING SECURE SOFTWARE T in an AGILE PROCESS Dejan
    Software - in an - in Software Developing Secure aBSTRACT Background: Software developers are facing in- a real industry setting. As secondary methods for creased pressure to lower development time, re- data collection a variety of approaches have been Developing Secure Software lease new software versions more frequent to used, such as semi-structured interviews, work- customers and to adapt to a faster market. This shops, study of literature, and use of historical data - in an agile proceSS new environment forces developers and companies from the industry. to move from a plan based waterfall development process to a flexible agile process. By minimizing Results: The security engineering best practices the pre development planning and instead increa- were investigated though a series of case studies. a sing the communication between customers and The base agile and security engineering compati- gile developers, the agile process tries to create a new, bility was assessed in literature, by developers and more flexible way of working. This new way of in practical studies. The security engineering best working allows developers to focus their efforts on practices were group based on their purpose and p the features that customers want. With increased their compatibility with the agile process. One well roce connectability and the faster feature release, the known and popular best practice, automated static Dejan Baca security of the software product is stressed. To de- code analysis, was toughly investigated for its use- velop secure software, many companies use secu- fulness, deployment and risks of using as part of SS rity engineering processes that are plan heavy and the process.
    [Show full text]
  • Using Static Program Analysis to Aid Intrusion Detection
    Using Static Program Analysis to Aid Intrusion Detection Manuel Egele, Martin Szydlowski, Engin Kirda, and Christopher Kruegel Secure Systems Lab Technical University Vienna fpizzaman,msz,ek,[email protected] Abstract. The Internet, and in particular the world-wide web, have be- come part of the everyday life of millions of people. With the growth of the web, the demand for on-line services rapidly increased. Today, whole industry branches rely on the Internet to do business. Unfortunately, the success of the web has recently been overshadowed by frequent reports of security breaches. Attackers have discovered that poorly written web applications are the Achilles heel of many organizations. The reason is that these applications are directly available through firewalls and are of- ten developed by programmers who focus on features and tight schedules instead of security. In previous work, we developed an anomaly-based intrusion detection system that uses learning techniques to identify attacks against web- based applications. That system focuses on the analysis of the request parameters in client queries, but does not take into account any infor- mation about the protected web applications themselves. The result are imprecise models that lead to more false positives and false negatives than necessary. In this paper, we describe a novel static source code analysis approach for PHP that allows us to incorporate information about a web application into the intrusion detection models. The goal is to obtain a more precise characterization of web request parameters by analyzing their usage by the program. This allows us to generate more precise intrusion detection models.
    [Show full text]
  • Engineering of Reliable and Secure Software Via Customizable Integrated Compilation Systems
    Engineering of Reliable and Secure Software via Customizable Integrated Compilation Systems Zur Erlangung des akademischen Grades eines Doktors der Ingenieurwissenschaften von der KIT-Fakultät für Informatik des Karlsruher Institut für Technologie (KIT) genehmigte Dissertation von Dipl.-Inf. Oliver Scherer Tag der mündlichen Prüfung: 06.05.2021 1. Referent: Prof. Dr. Veit Hagenmeyer 2. Referent: Prof. Dr. Ralf Reussner This document is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA 4.0): https://creativecommons.org/licenses/by-sa/4.0/deed.en Abstract Lack of software quality can cause enormous unpredictable costs. Many strategies exist to prevent or detect defects as early in the development process as possible and can generally be separated into proactive and reactive measures. Proactive measures in this context are schemes where defects are avoided by planning a project in a way that reduces the probability of mistakes. They are expensive upfront without providing a directly visible benefit, have low acceptance by developers or don’t scale with the project. On the other hand, purely reactive measures only fix bugs as they are found and thus do not yield any guarantees about the correctness of the project. In this thesis, a new method is introduced, which allows focusing on the project specific issues and decreases the discrepancies between the abstract system model and the final software product. The first component of this method isa system that allows any developer in a project to implement new static analyses and integrate them into the project. The integration is done in a manner that automatically prevents any other project developer from accidentally violating the rule that the new static analysis checks.
    [Show full text]
  • Introduction to Static Analysis
    Introduction to Static Analysis 17-654: Analysis of Software Artifacts Jonathan Aldrich 2/21/2011 17-654: Analysis of Software Artifacts 1 Static Analysis Source: Engler et al., Checking System Rules Using System-Specific, Programmer-Written Find the Bug! Compiler Extensions , OSDI ’00. disable interrupts ERROR: returning with interrupts disabled re-enable interrupts 2/21/2011 17-654: Analysis of Software Artifacts 2 Static Analysis 1 Metal Interrupt Analysis Source: Engler et al., Checking System Rules Using System-Specific, Programmer-Written Compiler Extensions , OSDI ’00. enable => err(double enable) is_enabled enable disable is_disabled end path => err(end path with/intr disabled) disable => err(double disable) 2/21/2011 17-654: Analysis of Software Artifacts 3 Static Analysis Source: Engler et al., Checking System Rules Using System-Specific, Programmer-Written Applying the Analysis Compiler Extensions , OSDI ’00. initial state is_enabled transition to is_disabled final state is_disabled: ERROR! transition to is_enabled final state is_enabled is OK 2/21/2011 17-654: Analysis of Software Artifacts 4 Static Analysis 2 Outline • Why static analysis? • The limits of testing and inspection • What is static analysis? • How does static analysis work? • AST Analysis • Dataflow Analysis 2/21/2011 17-654: Analysis of Software Artifacts 5 Static Analysis 2/21/2011 17-654: Analysis of Software Artifacts 6 Static Analysis 3 Process, Cost, and Quality Slide: William Scherlis Process intervention, Additional technology testing, and inspection and tools are needed to yield first-order close the gap software quality improvement Perfection (unattainable) Critical Systems Acceptability Software Quality Process CMM: 1 2 3 4 5 Rigor, Cost S&S, Agile, RUP, etc: less rigorous .
    [Show full text]
  • Automated Large-Scale Multi-Language Dynamic Program
    Automated Large-Scale Multi-Language Dynamic Program Analysis in the Wild Alex Villazón Universidad Privada Boliviana, Bolivia [email protected] Haiyang Sun Università della Svizzera italiana, Switzerland [email protected] Andrea Rosà Università della Svizzera italiana, Switzerland [email protected] Eduardo Rosales Università della Svizzera italiana, Switzerland [email protected] Daniele Bonetta Oracle Labs, United States [email protected] Isabella Defilippis Universidad Privada Boliviana, Bolivia isabelladefi[email protected] Sergio Oporto Universidad Privada Boliviana, Bolivia [email protected] Walter Binder Università della Svizzera italiana, Switzerland [email protected] Abstract Today’s availability of open-source software is overwhelming, and the number of free, ready-to-use software components in package repositories such as NPM, Maven, or SBT is growing exponentially. In this paper we address two straightforward yet important research questions: would it be possible to develop a tool to automate dynamic program analysis on public open-source software at a large scale? Moreover, and perhaps more importantly, would such a tool be useful? We answer the first question by introducing NAB, a tool to execute large-scale dynamic program analysis of open-source software in the wild. NAB is fully-automatic, language-agnostic, and can scale dynamic program analyses on open-source software up to thousands of projects hosted in code repositories. Using NAB, we analyzed more than 56K Node.js, Java, and Scala projects. Using the data collected by NAB we were able to (1) study the adoption of new language constructs such as JavaScript Promises, (2) collect statistics about bad coding practices in JavaScript, and (3) identify Java and Scala task-parallel workloads suitable for inclusion in a domain-specific benchmark suite.
    [Show full text]
  • An Efficient and Scalable Platform for Java Source Code Analysis Using Overlaid Graph Representations
    Received March 10, 2020, accepted April 7, 2020, date of publication April 13, 2020, date of current version April 29, 2020. Digital Object Identifier 10.1109/ACCESS.2020.2987631 An Efficient and Scalable Platform for Java Source Code Analysis Using Overlaid Graph Representations OSCAR RODRIGUEZ-PRIETO1, ALAN MYCROFT2, AND FRANCISCO ORTIN 1,3 1Department of Computer Science, University of Oviedo, 33007 Oviedo, Spain 2Department of Computer Science and Technology, University of Cambridge, Cambridge CB2 1TN, U.K. 3Department of Computer Science, Cork Institute of Technology, Cork 021, T12 P928 Ireland Corresponding author: Francisco Ortin ([email protected]) This work was supported in part by the Spanish Department of Science, Innovation and Universities under Project RTI2018-099235-B-I00. The work of Oscar Rodriguez-Prieto and Francisco Ortin was supported by the University of Oviedo through its support to official research groups under Grant GR-2011-0040. ABSTRACT Although source code programs are commonly written as textual information, they enclose syntactic and semantic information that is usually represented as graphs. This information is used for many different purposes, such as static program analysis, advanced code search, coding guideline checking, software metrics computation, and extraction of semantic and syntactic information to create predictive models. Most of the existing systems that provide these kinds of services are designed ad hoc for the particular purpose they are aimed at. For this reason, we created ProgQuery, a platform to allow users to write their own Java program analyses in a declarative fashion, using graph representations. We modify the Java compiler to compute seven syntactic and semantic representations, and store them in a Neo4j graph database.
    [Show full text]
  • Seminar 6 - Static Code Analysis
    Seminar 6 - Static Code Analysis PV260 Software Quality March 26, 2015 Overview Static program analysis is the analysis of computer software that is performed without actually executing programs. In most cases the analysis is performed on some version of the source code, and in the other cases, some form of the object code. The term is usually applied to the analysis performed by an automated tool. Things to keep in mind: I The tools can usually not find all the problems in the system (False Negatives) I Not all of the detections are real problems (False Positives) I There is no one tool which could be used for everything, more tools are usually used in parallel (Overlaps will occur) I We must know what we are looking for, using everything the tool offers usually results in too much useless data Source Code Analysis - Checkstyle http://checkstyle.sourceforge.net/ Checkstyle can check many aspects of your source code. It can find class design problems, method desig problems. It also have ability to check code layout and formatting issues. PROS: CONS: I Type information is lost I Can be used to check programming style making some checks impossible I Many premade checks available I Files are checked sequentially, content of all New checks are easy to add I files can't be seen at once Available standard checks: http://checkstyle.sourceforge.net/checks.html Bytecode Analysis - Findbugs http://findbugs.sourceforge.net/ FindBugs looks for bugs in Java programs. It is based on the concept of bug patterns. A bug pattern is a code idiom that is often an error.
    [Show full text]
  • Testing Code
    CHAPTER 13 Testing Code By Phil Ames and Franjo Ivančić with Vera Haas and Jen Barnason A reliable system is resilient to failures and meets its documented service level objec‐ tives, which may also include security guarantees. Robust software testing and analy‐ sis are useful aids in mitigating failure risks, and should be a particular focus during the project implementation phase. In this chapter, we discuss several approaches to testing, including unit and integra‐ tion testing. We also cover additional security deep-dive topics like static and dynamic program analysis and fuzz testing, which can help strengthen your soft‐ ware’s resilience against the inputs it encounters. No matter how careful the engineers developing your software are, some mistakes and overlooked edge cases are inevitable. Unexpected input combinations may trig‐ ger data corruption or result in availability issues like the “Query of Death” example in Chapter 22 of the SRE book. Coding errors can cause security problems like buffer overflows and cross-site scripting vulnerabilities. Put simply, there are many ways software is prone to failure in the real world. The techniques discussed in this chapter, used in different stages and contexts of soft‐ ware development, have a variety of cost–benefit profiles.1 For example, fuzzing— sending random requests to a system—can help you harden that system in terms of both security and reliability. This technique can potentially help you catch 1 We recommend checking out Chapter 17 of the SRE book for a reliability-focused perspective. 271 information leaks and reduce serving errors by exposing the service to a multitude of edge cases.
    [Show full text]