DOCSLIB.ORG

FORMAL METHODS: BENEFITS, CHALLENGES and FUTURE DIRECTION Mona Batra1, Amit Malik2, Dr

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
FORMAL METHODS: BENEFITS, CHALLENGES and FUTURE DIRECTION Mona Batra1, Amit Malik2, Dr Volume 4, No. 5, May 2013 Journal of Global Research in Computer Science REVIEW ARTICLE Available Online at www.jgrcs.info FORMAL METHODS: BENEFITS, CHALLENGES AND FUTURE DIRECTION Mona Batra1, Amit Malik2, Dr. Meenu Dave3 1 M. Tech. Scholar Department of Computer Science, Jagan Nath University, Jaipur, India [email protected] 2Sr. Analyst, HCL Technologies Ltd. , Noida-201304, India [email protected] 3Assistant Professor Department of Computer Science, Jagan Nath University, Jaipur, India [email protected] Abstract: There is an increasing demand of current information systems to incorporate the use of a higher degree of formalism in the development process. Formal Methods consist of a set of tools and techniques based on mathematical model and formal logic that are used to specify and verify requirements and designs for hardware and software systems. This paper presents a detailed analysis of formal methods along with their goals and benefits followed by limitations. This research work is aimed to help the software engineers to identify the use of formal methods at different stages of software development, with special reference to the requirements phase. Keywords- Formal Methods, Requirements Engineering, Formal Specification, Feasibility Analysis etc. of mathematics in design and construction to ensure product INTRODUCTION quality is common practice in established engineering disciplines, such as bridge or aircraft building, and even In today’s commercial environment, the primary measure of computer (hardware) construction, where one applies success of software projects is the extent to which a mathematically expressed physical and other natural laws to software system fulfills the purpose, which it is intended for. model a problem that deals with the behavior of concrete However, an increasingly competitive market usually systems in the physical world. demands higher quality, shorter turnaround cycles, and cheaper software. Many IT companies face the difficulty of This paper describes various aspects of formal methods in releasing products of quality on time and within the limits of requirements engineering. Formal specification language, approved budget. The number of errors found during different formal specification styles and types of formal development strongly affects the software metrics methods are described in Section 2. In Section 3, goals of mentioned above. If the problem is identified earlier during formal methods are explained whereas in Section 4 benefits program development, then it helps in reducing the project of formal methods are discussed in detail. In Section 5, budget [1]. limitations are presented, and the issues in Section 6. ‘Conclusion and Future Work’ is reported in Section 7. When an error that was introduced in the requirements phase is found during testing, software engineers must fix the TYPES OF FORMAL METHODS incorrect requirements, check all of the ramifications through design and implementation and finally retest the Formal methods are mathematics based languages, product. In order to build a secure software product and techniques and tools that can be applied to any part of the overcome the problem of overrun of budget (which occurs program life-cycle. By providing the feature of abstraction due to errors in requirement specifications), cost-effective and unambiguous description mechanisms, formal methods methods are required that address the major risks and that facilitate the development of the critical systems. The provide tangible evidence of trustworthiness. representation used in formal methods is called a formal specification language. The formal specification languages Formal methods are the solution to the above stated are based on set theory and first order predicate calculus. problems. Formal methods are a particular kind of The language has a formal semantics that can be used to mathematical techniques meant for the specification, express specifications in a clear and unequivocal manner. development and verification of software and hardware Formal methods can be classified using two ways. Firstly, systems. The representation used in formal methods is called according to formal specification styles, and secondly, a formal specification language. [2]. according to software development life-cycle perspective [4]. Formal methods consist of writing formal descriptions, analyzing those descriptions and in some cases producing TYPES OF FORMAL SPECIFICATION STYLES new descriptions. They can be applied in different phases of development process. They are even becoming integral The Formal Specification Styles are specified as follows: components of standards. According to Rushby [3], the use © JGRCS 2010, All Rights Reserved 21 Mona Batra et al, Journal of Global Research in Computer Science, 4 (5), May 2013, 21-25 Model Based Languages: b. Theorem proving is another approach for verification of Model based languages are a way to write a specification. a specification or checking the correctness of a To specify the behavior of the system, model based program. A model of the system is described in a languages construct a mathematical model of the system. mathematical language and desired properties of the The model consists of an underlying state (data) and a model can be proven by a theorem prover. It is collection of operations on that state [5]. The state model is mechanization of a logical proof. The specification to constructed with the help of mathematical entities such as be checked by a theorem prover is written in a relations, sets, sequences and functions. Operations of a mathematical notation. Z (pronounced ‘Zed’) is its well- system are specified by defining how they affect the state of known example. the system model. Operations are also described by the predicates given in terms of pre and post conditions. The GOALS OF FORMAL METHODS most widely used notations for developing model based Formal methods can be applied at different stages of languages are Vienna Development Method (VDM), Zed software development life cycle. On the basis of the details (Z) and B. of the formal methods, some goals may be listed as follows: Algebraic Specification a. Formal methods support in the creation of specifications Algebraic specification is a technique, used to specify the that describe the true requirements of the user, which are system behavior by using methods derived from abstract not usually identical to the stated requirements. This can algebra. Algebraic approach was originally designed for the be achieved using formal methods because of the definition of abstract data types and interface. The most unambiguity of the formal specifications and the widely used notations for developing algebraic specification possibility to prove certain properties about it. languages are LARCH, ASL and OBJ. b. Formal methods ensure that the implementation of a particular software as well as hardware product should Process Oriented: satisfy the requirements specification. Process oriented formal specification language is basically c. Formal methods are basically concerned for development used to describe concurrent system by building a specific and maintenance of security critical reliable systems on implicit model. In these languages processes are denoted by time and within budget. It increases trustworthiness of expressions and are built up with the help of elementary the system in the sense that the system developed is not expressions. Elementary expressions describe simple just correct but known to be correct. Formal methods act processes along with the operations, which combine as evidence which ensures that the system indeed processes to yield more complex processes. The most satisfies the demand of security, reliability and widely used process oriented language is Communicating correctness. Sequential Processes (CSP). BENEFITS OF FORMAL METHODS FORMAL LANGUAGES IN SDLC The early activities in the software development lifecycle In SDLC, formal languages are used in two phases: i.e. requirements analysis and specification, is the most requirements and testing. important. According to one of the Standish Chaos report [9], half of all project failures occur due to poor Specification (Requirements Analysis Phase): requirements specification. The most effective use of formal Specification is the process of describing a system behavior methods is at these early stages. It is effectual to write a and its desired properties. Formal specification languages specification formally rather than writing an informal describe system properties that might include functional specification and then translating it. To detect inconsistency behavior, timing behavior, performance characteristics and and incompleteness, it is efficient to analyze the formal internal structure, etc. [6]. specification as early as possible [10]. Along with the benefits discussed above, there are various other benefits Z, VDM and Larch are used for specifying the behavior of which are discussed as below: sequential systems while other formal methods such as CSP, a. Measure of correctness: The use of formal methods CCS, State charts, Temporal Logic, Lamport and I/O provides a measure of the correctness of a system, as automata, focus on specifying the behavior of concurrent opposed to the current process quality measures. systems [7]. RAISE is used for handling rich state spaces b. Early defect detection: Formal Methods can be applied and LOTOS is one of the languages for handling complexity to the earliest
Load more

Recommended publications
  • Verification and Formal Methods
    Verification and Formal Methods: Practice and Experience J. C. P. Woodcock University of York, UK and P. G. Larsen Engineering College of Aarhus, Denmark and J. C. Bicarregui STFC Rutherford Appleton Laboratory, UK and J. S. Fitzgerald Newcastle University, UK We describe the state of the art in the industrial use of formal verification technology. We report on a new survey of the use of formal methods in industry, and compare it with the most significant surveys carried out over the last 20 years. We review the literature on formal methods, and present a series of industrial projects undetaken over the last two decades. We draw some observations from these surveys and records of experience. Based on this, we discuss the issues surrounding the industrial adoption of formal methods. Finally, we look to the future and describe the development of a Verified Software Repository, part of the worldwide Verified Software Initiative. We introduce the initial projects being used to populate the repository, and describe the challenges they address. Categories and Subject Descriptors: D.2.4 [Software/Program Verification]: Assertion check- ers, Class invariants, Correctness proofs, Formal methods, Model checking, Programming by contract; F.3.1 [Specifying and Verifying and Reasoning about Programs]: Assertions, Invariants, Logics of programs, Mechanical verification, Pre- and post-conditions, Specification techniques; F.4.1 [Mathematical Logic]: Mechanical theorem proving; I.2.2 [Automatic Pro- gramming]: Program verification. Additional Key Words and Phrases: Experimental software engineering, formal methods surveys, Grand Challenges, Verified Software Initiative, Verified Software Repository. 1. INTRODUCTION Formal verification, for both hardware and software, has been a topic of great sig- nificance for at least forty years.
    [Show full text]
  • Formal Methods
    SE 5302: Formal Methods Course Instructor: Parasara Sridhar Duggirala, Ph.D. Catalog Description. 3 credits. This course is designed to provide students with an introduction to formal methods as a framework for the specification, design, and verification of software-intensive embedded systems. Topics include automata theory, model checking, theorem proving, and system specification. Examples are driven by cyber-physical systems. The course is addressed to students in engineering who have had at least a year of software or embedded systems design experience. Pre- Requisites: SE 5100 or SE 5101 or SE 5102 and at least one year of software or embedded systems design experience. Course Delivery Method. The course will be offered online, asynchronously, in small recorded modules according to the course schedule and syllabus. Direct and live communication with the instructor will be available each week, according to the class schedule, for discussion, questions, examples, and quizzes. Attendance at live sessions is required, and you must notify the instructor in advance if you cannot attend. A social networking tool called Slack will be used to communicate with students and the instructor between live sessions. Course Objective. This course is designed to provide students with an introduction to formal methods as a framework for the specification, design, and verification of software- intensive embedded systems. Topics include automata theory, model checking, theorem proving, and system specification. Examples are driven by control systems and software systems. Anticipated Student Outcomes. By the end of the course, a student will be able to (1) Gain familiarity with current system design flows in industry used for embedded system design, implementation and verification.
    [Show full text]
  • Formal Methods for Biological Systems: Languages, Algorithms, and Applications Qinsi Wang CMU-CS-16-129 September 2016
    Formal Methods for Biological Systems: Languages, Algorithms, and Applications Qinsi Wang CMU-CS-16-129 September 2016 School of Computer Science Computer Science Department Carnegie Mellon University Pittsburgh, PA Thesis Committee Edmund M. Clarke, Chair Stephen Brookes Marta Zofia Kwiatkowska, University of Oxford Frank Pfenning Natasa Miskov-Zivanov, University of Pittsburgh Submitted in partial fulfillment of the requirements for the Degree of Doctor of Philosophy Copyright c 2016 Qinsi Wang This research was sponsored by the National Science Foundation under grant numbers CNS-0926181 and CNS- 1035813, the Army Research Laboratory under grant numbers FA95501210146 and FA955015C0030, the Defense Advanced Research Projects Agency under grant number FA875012C0204, the Office of Naval Research under grant number N000141310090, the Semiconductor Research Corporation under grant number 2008-TJ-1860, and the Mi- croelectronics Advanced Research Corporation (DARPA) under grant number 2009-DT-2049. The views and conclusions contained in this document are those of the author and should not be interpreted as rep- resenting the official policies, either expressed or implied, of any sponsoring institution, the U.S. government or any other entity. Keywords: Model checking, Formal specification, Formal Analysis, Boolean networks, Qual- itative networks, Rule-based modeling, Multiscale hybrid rule-based modeling, Hybrid systems, Stochastic hybrid systems, Symbolic model checking, Bounded model checking, Statistical model checking, Bounded reachability, Probabilistic bounded reachability, Parameter estimation, Sensi- tivity analysis, Statistical tests, Pancreatic cancer, Phage-based bacteria killing, Prostate cancer treatment, C. elegans For My Beloved Mom & Dad iv Abstract As biomedical research advances into more complicated systems, there is an in- creasing need to model and analyze these systems to better understand them.
    [Show full text]
  • A Systematic Literature Review of the Use of Formal Methods in Medical Software Systems∗
    JOURNAL OF SOFTWARE: EVOLUTION AND PROCESS J. Softw. Evol. and Proc. 2017; 00:1–23 Published online in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/smr A Systematic Literature Review of the use of Formal Methods in Medical Software Systems∗ Silvia Bonfanti∗, Angelo Gargantini1, Atif Mashkoor2 ∗University of Bergamo, [email protected] 1University of Bergamo, [email protected] 2Software Competence Center Hagenberg GmbH, [email protected] SUMMARY The use of formal methods is often recommended to guarantee the provision of necessary services and to assess the correctness of critical properties, such as functional safety, cybersecurity and reliability, in medical and health-care devices. In the past, several formal and rigorous methods have been proposed and consequently applied for trustworthy development of medical software and systems. In this paper, we perform a systematic literature review on the available state of the art in this domain. We collect the relevant literature on the use of formal methods for modeling, design, development, verification and validation of software-intensive medical systems. We apply standard systematic literature review techniques and run several queries in well-known repositories in order to obtain information that can be useful for people who are either already working in this field or planning to start. Our study covers both quantitative and qualitative aspects of the subject. Copyright c 2017 John Wiley & Sons, Ltd. Received . KEY WORDS: Formal Methods, Systematic Literature Review, Medical Device Software 1. INTRODUCTION In modern medical devices, human safety depends upon the correct operation of software controlling the device: software malfunctioning can cause injuries to, or even the death of, patients.
    [Show full text]
  • Do Formal Methods Improve Code Quality?
    Do Formal Methods Improve Code Quality? Shari Lawrence Pfleeger Les Hatton Centre for Software Reliability Programming Research Ltd. Northampton Square Glenbrook House, 1/11 Molesey Road London EC1V 0HB Hersham, Surrey KT12 4RH England England phone: +44 171 477-8426 +44 932 888080 fax: +44 171 477-8585 +44 932 888081 email: [email protected] [email protected] Abstract Formal methods are advocated on many projects, in the hope that their use will improve the quality of the resulting software. However, to date there has been little quantitative evidence of their effectiveness, especially for safety-critical applications. We examined the code and development records for a large air traffic control support system to see if the use of formal methods made a measurable difference. In this paper, we show that formal specification, in concert with thorough unit testing and careful reviews, can lead to high-quality code. But we also show that improved measurement and record-keeping could have made analysis easier and the results more clear-cut. As practitioners and researchers, we continue to look for methods and tools that help us to improve our software development processes and products. Articles in IEEE Software and elsewhere focus on candidate technologies that promise increased productivity, better quality, lower cost or enhanced customer satisfaction. But we are reminded that these methods and tools should be tested empirically and rigorously to determine if they make a quantifiable difference to software we produce.1,2 Often, such evaluation is not considered until after the technology has been used, making careful, quantitative analysis difficult if not impossible.
    [Show full text]
  • A Debate on Teaching Computing Science
    Teaching Computing Science t the ACM Computer Science Conference last Strategic Defense Initiative. William Scherlis is February, Edsger Dijkstra gave an invited talk known for his articulate advocacy of formal methods called “On the Cruelty of Really Teaching in computer science. M. H. van Emden is known for Computing Science.” He challenged some of his contributions in programming languages and the basic assumptions on which our curricula philosophical insights into science. Jacques Cohen Aare based and provoked a lot of discussion. The edi- is known for his work with programming languages tors of Comwunications received several recommenda- and logic programming and is a member of the Edi- tions to publish his talk in these pages. His comments torial Panel of this magazine. Richard Hamming brought into the foreground some of the background received the Turing Award in 1968 and is well known of controversy that surrounds the issue of what be- for his work in communications and coding theory. longs in the core of a computer science curriculum. Richard M. Karp received the Turing Award in 1985 To give full airing to the controversy, we invited and is known for his contributions in the design of Dijkstra to engage in a debate with selected col- algorithms. Terry Winograd is well known for his leagues, each of whom would contribute a short early work in artificial intelligence and recent work critique of his position, with Dijkstra himself making in the principles of design. a closing statement. He graciously accepted this offer. I am grateful to these people for participating in We invited people from a variety of specialties, this debate and to Professor Dijkstra for creating the backgrounds, and interpretations to provide their opening.
    [Show full text]
  • Top Ten Ways to Make Formal Methods for HPC Practical
    Top Ten Ways to Make Formal Methods for HPC Practical Ganesh Gopalakrishnan and Robert M. Kirby School of Computing, University of Utah, Salt Lake City, UT 84112 http://www.cs.utah.edu/fv { fganesh,[email protected] ABSTRACT such as deadlocks and resource leaks. Barring a few ex- Almost all fundamental advances in science and engineer- ceptions [2], debugging challenges associated with MPI pro- ing crucially depend on the availability of extremely capable gramming have not been very much discussed in the formal high performance computing (HPC) systems. Future HPC verification literature. The primary debugging approach for systems will increasingly be based on heterogeneous multi- MPI is still one of running an MPI application on a specific core CPUs, and their programming will involve multiple con- platform, feeding it a collection of test inputs, and seeing currency models. These developments can make concurrent if anything goes wrong. This approach may seem to work programming and optimization of HPC platforms and ap- | largely due to the uniformity of the platform hardware, plications very error-prone. Therefore, significant advances libraries, and programming styles employed in this area. By must occur in verification methods for HPC. We present ten avoiding aggressive styles of MPI programming and staying important formal methods research thrusts that can accel- within safe practices, today's HPC application developers erate these advances. can often compensate for the lack of rigorous testing and reasoning approaches. At present, HPC application developers and the Com- 1. FORMAL METHODS AND HPC puter Science research community are relatively unaware of High performance computing (HPC) is one of the pillars what is going on each others' research areas.
    [Show full text]
  • Formal Methods in Macro- Biology First International Conference, FMMB 2014, Noumea, New Caledonia, September 22-14, 2014, Proceedings
    springer.com Computer Science : Computational Biology / Bioinformatics Fages, François, Piazza, Carla (Eds.) Formal Methods in Macro- Biology First International Conference, FMMB 2014, Noumea, New Caledonia, September 22-14, 2014, Proceedings This book constitutes the refereed proceedings of the First International Conference on Formal Methods in Macro-Biology, FMMB 2014, held in Nouméa, New Caledonia, in September 2014. The 7 revised full and 3 short papers presented together with 7 invited presentations were carefully reviewed and selected from 17 submissions. The scientific program consists of papers on a wide variety of topics, including ecological systems, medical applications, logical frameworks, and discrete continuous and hybrid models for the analysis of biological systems at macroscopic levels. Springer Order online at springer.com/booksellers 2014, XXVI, 183 p. 46 illus. Springer Nature Customer Service Center LLC 1st 233 Spring Street edition New York, NY 10013 USA T: +1-800-SPRINGER NATURE Printed book (777-4643) or 212-460-1500 Softcover [email protected] Printed book Softcover ISBN 978-3-319-10397-6 $ 59,99 Available Discount group Professional Books (2) Product category Proceedings Series Lecture Notes in Bioinformatics Other renditions Softcover ISBN 978-3-319-10399-0 Prices and other details are subject to change without notice. All errors and omissions excepted. Americas: Tax will be added where applicable. Canadian residents please add PST, QST or GST. Please add $5.00 for shipping one book and $ 1.00 for each additional book. Outside the US and Canada add $ 10.00 for first book, $5.00 for each additional book. If an order cannot be fulfilled within 90 days, payment will be refunded upon request.
    [Show full text]
  • The State-Of-The-Art in Formal Methods
    The State-of-the-Art in Formal Methods by Milica Barjaktarovic Wilkes University Wilkes Barre PA 18766 and WetStone Technologies, Inc. 273 Ringwood Rd. Freeville, NY 13068 January 1998 For Michael Nassiff Rome Research Site AFRL/IFGB 525 Brooks Rd. Rome, NY 13441-4505 Report: State of the Art in Formal Methods M. Barjaktarovic / WetStone Technologies Abstract This report is predominantly based on observations and informal interviews during participation in the following events: · Workshop on Integrating Formal Techniques (WIFT 98). Bocca Raton, FL, October 1998. · Visit to SRI International. Palo Alto, CA, October 1998. · Formal Methods Standardization Working Group Meeting. Palo Alto, CA, October 1998. · Formal Methods PI Meeting with Hellen Gill. Palo Alto, CA, October 1998. · Formal Methods in CAD (FMCAD 98). Palo Alto, CA, November 1998. The overall impression from the trip is that industry needs assistance in dealing with the present realities of complex products and short time-to-market deadlines, and needs to consider formal methods as a systematic approach to dealing with the overwhelming amount of information. CAD industry seems the most willing and already uses many lightweight formal tools, such as model checkers and equivalence checkers. Telecommunications industry comes next. We have not encountered presentations in computer security and electronic commerce, but we could assume that their situation is very similar. The major task of the formal methods community will be to provide the assistance sought. Expressed needs include: more user-friendly tools; more powerful and robust tools; more real-life applications; more infrastructure such as verified libraries; more publicity of success stories and available technologies; and more user training.
    [Show full text]
  • Methods and Tools for Formal Software Engineering
    Methods and Tools for Formal Software Engineering Zhiming Liu1, and R. Venkatesh2 1 International Institute for Software Technology United Nations University, Macao SAR, China [email protected] 2 Tata Research and Design Development Centre, Pune, India [email protected] Abstract. We propose a collaboration project to integrate the research effort and results obtained at UNU-IIST on formal techniques in component and object sys- tems with research at TRDDC in modelling and development of tools that support object-oriented and component-based design. The main theme is an integration of verification techniques with engineering methods of modelling and design, and an integration of verification tools and transformation tools. This will result in a method in which a correct program can be developed through transformations that are either proven to be correct or by showing that the transformed model can be proven correct by a verification tool. 1 Formal Software Engineering and the Grand Challenge The goal of the Verifying Compiler Grand Challenge [7,6] is to build a verifying com- piler that “uses mathematical and logical reasoning to check the programs that it compiles.” This implies that “a program should be allowed to run only if it is both syntactically and semantically correct” [20]. To achieve this goal, the whole computing community have to deal with a wide range of issues, among which are [2] 1. arriving at automated procedures of abstraction that enables a compiler to work in combination with different program verification tools including testing tools, 2. studying what, where, when and how the correctness properties, i.e.
    [Show full text]
  • Assembling a Prehistory for Formal Methods: a Personal View Thomas Haigh [email protected]
    Assembling A Prehistory for Formal Methods: A Personal View Thomas Haigh [email protected] University of Wisconsin—Milwaukee & Siegen University www.tomandmaria.com This is a preprint copy. Please quote and cite the final version, which will appear in a special issue of Formal Aspects of Computing devoted to historical work. Thanks to Cliff Jones and the anonymous reviewers for their encouragement and feedback on earlier drafts of this paper. Preprint Draft Haigh – Assembling a History for Formal Methods 2 Although I was pleased to be asked to contribute something to this volume I have a confession to make: I have never studied the history of formal methods. So this is not going to be a history of formal methods as much as a reflection on how such a story might be written. My plan is to triangulate from my personal experiences as a computer science student a quarter century ago, my Ph.D. training as a historian of science and technology, and my subsequent career researching and writing about various aspects of the history of computing. The fact that, despite a general familiarity with the literature on the history of computing, I don’t have a better grasp of the history of formal methods tells us a lot about the need for this special issue. Most of the history is so far locked up in the heads of participants, which is not a convenient place for the rest of us to find it. Stories written by participants or people with a personal connection to the events described are not usually the last word on historical events, but they are a vital starting point.
    [Show full text]
  • Formal Methods for Software Testing Marie-Claude Gaudel
    Formal Methods for Software Testing Marie-Claude Gaudel To cite this version: Marie-Claude Gaudel. Formal Methods for Software Testing. 11th International Symposium on Theoretical Aspects of Software Engineering (TASE 2017), , IEEE, Sep 2017, Sophia-Antipolis, France. hal-01683611 HAL Id: hal-01683611 https://hal.archives-ouvertes.fr/hal-01683611 Submitted on 14 Jan 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Formal Methods for Software Testing (Invited Paper) Marie-Claude Gaudel LRI, Univ. Paris-Sud, CNRS, CentraleSupelec´ Universite´ Paris-Saclay Orsay, France 91405 Email: [email protected] Abstract—This extended abstract takes advantage of a theory II. BACKGROUND:SPECIFICATION-BASED TESTING, of software testing based on formal specifications to point out FORMAL METHODS. the benefits and limits of the use of formal methods to this end. A notion of exhaustive test set is defined according to the A. Some Basic Facts on Specification-Based Testing semantics of the formal notation, the considered conformance Specification-based testing, or model-based testing, are relation, and some testability hypotheses on the system under test. black-box testing methods, where the internal organisation This gives a framework for the formalisation of test selection, test execution, and oracles, and, moreover, leads to the explicitation of the system under test (SUT) is ignored: the test strategy of those hypotheses underlying test selection strategies, such as is based on some description of the intended properties and uniformity hypotheses or regularity hypotheses.
    [Show full text]