Carmine Vassallo

Total Page:16

File Type:pdf, Size:1020Kb

Carmine Vassallo Automated Testing Carmine Vassallo [email protected] @ccvassallo Recommended Book Gerard Meszaros, xUnit Test Patterns: Refactoring Test Code (Martin Fowler Signature Book) Addison-Wesley, 2007 2 Software Bugs “A software bug is an error, flaw, failure or fault in a computer program or system that causes it to produce an incorrect or unexpected result, or to behave in unintended ways.” https://en.wikipedia.org/wiki/Software_bug 3 How to detect bugs? Testing • Testing is the activity of finding out whether a piece of code (a method, class, or program) produces the intended behaviour. • We test software because we are sure it has bugs in it! • The feedback provided by testing is very valuable, but if it comes so late in the development cycle, its value is greatly diminished. • We need to continuously check for defects in our code. 4 The LEAN process http://thecommunitymanager.com/2012/08/01/the-lean-community/ 5 Automated SW Testing • Automated Software Testing consists of using special software (separate from the software being tested) to control the execution of tests and the comparison of actual outcomes with predicted outcomes. • Test automation can automate some repetitive but necessary tasks in a formalized testing process already in place, or perform additional testing that would be difficult to do manually. • Test automation is critical for continuous delivery and continuous testing. 6 Goals of Automated Testing (1/2) • Tests should help us improve quality. • If we are doing test-driven development or test-first development, the tests give us a way to capture what the SUT should be doing before we start building it. • The very act of thinking through various scenarios in enough detail to turn them into tests helps us identify those areas where the requirements are ambiguous or self-contradictory, improving the quality of the specification, and consequently the quality of the software so specified. • Tests should help us understand the software under test (SUT). • If we want to know how the system does something, we can turn on the debugger, run the test, and single- step through the code to see how it works. In this sense, the automated tests act as a form of documentation for the SUT. • Tests should reduce (and not introduce) risk. 7 Goals of Automated Testing (2/2) • Tests should be easy to run. • They must be Fully Automated Tests so they can be run without any effort. • They must be Self-Checking Tests so they can detect and report any errors without manual inspection. • They must be Repeatable Tests so they can be run multiple times with the same result. • Ideally, each test should be an Independent Test that can be run by itself. • Tests should be easy to write and maintain. • Tests should require minimal maintenance as the system evolves around them. 8 Economics of Automated Testing 9 Types of Tests 10 Automated Unit Testing 11 Automated Unit Testing • Unit tests verify the behavior of a single class or method that is a consequence of a design decision. • This behavior is typically not directly related to the requirements except when a key chunk of business logic is encapsulated within the class or method in question. • These tests are written by developers for their own use; they help developers describe what “done looks like” by summarizing the behavior of the unit in the form of tests. 12 xUnit • xUnit is the collective name for several unit testing frameworks that derive their structure and functionality from Smalltalk's SUnit. • Following its introduction in Smalltalk the framework was ported to Java by Kent Beck and Erich Gamma and gained wide popularity, eventually gaining ground in the majority of programming languages in current use. • The names of many of these frameworks are a variation on "SUnit", usually replacing the "S" with the first letter (or letters) in the name of their intended language ("JUnit" for Java, "RUnit" for R etc.). These frameworks and their common architecture are collectively known as "xUnit". 13 xUnit: Key Concepts (1/2) • Test Runner • An executable program that runs tests implemented using an xUnit framework and reports the test results. • Test Case • Is the most elemental class. All unit tests are inherited from here. • Text fixtures • A test fixture (also known as a test context) is the set of preconditions or state needed to run a test. The developer should set up a known good state before the tests, and return to the original state after the tests. 14 xUnit: Key Concepts (2/2) • Test suites • A test suite is a set of tests that all share the same fixture. The order of the tests shouldn't matter. • Test result formatter • A test runner produces results in one or more output formats. In addition to a plain, human-readable format, there is often a test result formatter that produces XML output. • Assertion • An assertion is a function or macro that verifies the behavior (or the state) of the unit under test. Usually an assertion expresses a logical condition that is true for results expected in a correctly running system under test (SUT). Failure of an assertion typically throws an exception, aborting the execution of the current test. 15 xUnit: The steps 1. Setup: Set up the test fixture (the “before” picture) that is required for the SUT to exhibit the expected behavior as well as anything you need to put in place to be Setup able to observe the actual outcome. Exercise SUT Fixture 2. Exercise: We interact with the SUT. Verify Teardown 3. Verify: We do whatever is necessary to determine whether the expected outcome has been obtained. 4. Teardown: We tear down the test fixture to put the world back into the state in which we found it. 16 xUnit: Test Execution setup(); /* First, we should prepare our 'world' to make an isolated environment for testing */ ... /* Body of test - Here we make all the tests */ ... teardown(); /* At the end, whether we succeed or fail, we should clean up our 'world' to not disturb other tests or code */ 17 xUnit: Interaction Points • A test interacts with the SUT through one or more interfaces or interaction points. From the test’s point of view, these interfaces can act as either control points or observation points. Front Door Back Door 18 xUnit: DOC • For the most part we assumed that the SUT was designed such that it could be tested easily in isolation of other pieces of software. • When a class does not depend on any other classes, testing it is relatively straightforward. • When a class does depend on other classes, called depended-on components (DOCs), we have two choices: • We can test it together with all the DOCs; • we can try to isolate it from the DOCs so that we can test it by itself. 19 Why don’t use directly DOCs? • The depended-on component (DOC) may return values or throw exceptions that affect the behavior of the SUT, but it may prove difficult or impossible to cause certain cases to occur. • The indirect inputs received from the DOC may be unpredictable (such as the system clock or calendar). • the DOC may not be available in the test environment or may not even exist. • In other cases, we need to verify that certain side effects of executing the SUT have, indeed, occurred. • How can we test dependent classes in these circumstances? 20 Indirect Inputs 21 Indirect Outputs 22 Testing with Doubles • A Test Double is any object or component that we install in place of the real component for the express purpose of running a test. • There are 4 types: • A Dummy Object is a placeholder object that is passed to the SUT as an argument (or an attribute of an argument) but is never actually used. • A Test Stub is an object that replaces a real component on which the SUT depends so that the test can control the indirect inputs of the SUT. A Test Spy, which is a more capable version of a Test Stub, can be used to verify the indirect outputs of the SUT by giving the test a way to inspect them after exercising the SUT. • A Mock Object is an object that replaces a real component on which the SUT depends so that the test can verify its indirect outputs. • A Fake Object (or just “Fake” for short) is an object that replaces the functionality of the real DOC with an alternative imple- mentation of the same functionality. 23 Test Stub 24 Test Stub • A Test Stub is an object that acts as a control point to deliver indirect inputs to the SUT when the Test Stub’s methods are called. • Its use allows us to exercise Untested Code paths in the SUT that might otherwise be impossible to traverse during testing. • A Responder is a basic Test Stub that is used to inject valid and invalid indirect inputs into the SUT via normal returns from method calls. • A Saboteur is a special Test Stub that raises exceptions or errors to inject abnormal indirect inputs into the SUT. 25 Test Spy 26 Test Spy • A Test Spy is an object that can act as an observation point for the indirect outputs of the SUT. • To the capabilities of a Test Stub, it adds the ability to quietly record all calls made to its methods by the SUT. 27 Mock Object 28 Mock Object • A Mock Object is also an object that can act as an observation point for the indirect outputs of the SUT. • It differs from a Test Spy, however, in that the Mock Object compares actual calls received with the previously defined expectations using assertions and fails the test on behalf of the Test Method.
Recommended publications
  • CITS5501 Software Testing and Quality Assurance Test Automation
    Test automation Test cases CITS5501 Software Testing and Quality Assurance Test Automation Unit coordinator: Arran Stewart 1 / 111 Test automation Test cases Re-cap We looked at testing concepts – failures, faults/defects, and erroneous states We looked at specifications and APIs – these help us answer the question, “How do we know what to test against?” i.e., What is the correct behaviour for some piece of software? We have discussed what unit tests are, and what they look like 2 / 111 Test automation Test cases Questions What’s the structure of a test? How do different types of test relate? How do we come up with tests? How do we know when we have enough tests? What are typical patterns and techniques when writing tests? How do we deal with difficult-to-test software? (e.g. software components with many dependencies) What sorts of things can be tested? 3 / 111 Test automation Test cases Questions What’s the structure of a test? Any test can be seen, roughly, as asking: “When set up appropriately – if the system (or some part of it) is asked to do X, does its actual behaviour match the expected behaviour?” 4 / 111 Test automation Test cases Test structure That is, we can see any test as consisting of two things: Test values: anything required to set up the system (or some part of it), and “ask it do” something, and observe the result. Expected values: what the system is expected to do. “Values” is being used in a very broad sense. Suppose we are designing system tests for a phone – then the “test values” might include, in some cases, physical actions to be done by a tester to put the phone in a particular state (e.g.
    [Show full text]
  • ABAP to the Future 864 Pages, 2019, $79.95 ISBN 978-1-4932-1761-8
    First-hand knowledge. Browse the Book This chapter covers eliminating dependencies in your existing programs, implementing test doubles, and using ABAP Unit to write and implement test classes. It also includes advice on how to improve test-driven development via automated frameworks. ABAP Unit and Test-Driven Development Table of Contents Index The Author Paul Hardy ABAP to the Future 864 Pages, 2019, $79.95 ISBN 978-1-4932-1761-8 www.sap-press.com/4751 Chapter 5 ABAP Unit and Test-Driven Development 5 “Code without tests is bad code. It doesn’t matter how well-written it is; it doesn’t matter how pretty or object-oriented or well-encapsulated it is. With tests, we can change the behavior of our code quickly and verifiably. Without them, we really don’t know if our code is getting better or worse.” —Michael Feathers, Working Effectively with Legacy Code Programs have traditionally been fragile; that is, any sort of change was likely to break something, potentially causing massive damage. You want to reverse this situ- ation so that you can make as many changes as the business requires as fast as you can with zero risk. The way to do this is via test-driven development (TDD), supported by the ABAP Unit tool. This chapter explains what TDD is and how to enable it via the ABAP Unit framework. In the traditional development process, you write a new program or change an exist- ing one, and after you’re finished you perform some basic tests, and then you pass the program on to QA to do some proper testing.
    [Show full text]
  • Assessing Mock Classes: an Empirical Study
    Assessing Mock Classes: An Empirical Study Gustavo Pereira, Andre Hora ASERG Group, Department of Computer Science (DCC) Federal University of Minas Gerais (UFMG) Belo Horizonte, Brazil fghapereira, [email protected] Abstract—During testing activities, developers frequently SinonJS1 and Jest,2 which is supported by Facebook; Java rely on dependencies (e.g., web services, etc) that make the developers can rely on Mockito3 while Python provides test harder to be implemented. In this scenario, they can use unittest.mock4 in its core library. The other solution to create mock objects to emulate the dependencies’ behavior, which contributes to make the test fast and isolated. In practice, mock classes is by hand, that is, manually creating emulated the emulated dependency can be dynamically created with the dependencies so they can be used in test cases. In this case, support of mocking frameworks or manually hand-coded in developers do not need to rely on any particular mocking mock classes. While the former is well-explored by the research framework since they can directly consume the mock class. literature, the latter has not yet been studied. Assessing mock For example, to facilitate web testing, the Spring web classes would provide the basis to better understand how those mocks are created and consumed by developers and to detect framework includes a number of classes dedicated to mock- 5 novel practices and challenges. In this paper, we provide the ing. Similarly, the Apache Camel integration framework first empirical study to assess mock classes. We analyze 12 provides mocking classes to support distributed and asyn- popular software projects, detect 604 mock classes, and assess chronous testing.6 That is, in those cases, instead of using their content, design, and usage.
    [Show full text]
  • Mockator Pro
    UNIVERSITY OF APPLIED SCIENCES RAPPERSWIL Mockator Pro Seams and Mock Objects for Eclipse CDT MASTER THESIS: Fall and Spring Term 2011/12 Author Supervisor Michael Rüegg Prof. Peter Sommerlad “To arrive at the simple is difficult.” — Rashid Elisha i Abstract Breaking dependencies is an important task in refactoring legacy code and putting this code under tests. Feathers’ seams help us here because they enable us to inject dependencies from outside. Although seams are a valuable technique, it is hard and cumbersome to apply them without automated refactorings and tool chain config- uration support. We provide sophisticated support for seams with Mockator Pro, a plug-in for the Eclipse C/C++ development tooling project. Mockator Pro creates the boilerplate code and the necessary infrastructure for the four seam types object, compile, preprocessor and link seam. Although there are already various existing mock object libraries for C++, we believe that creating mock objects is still too complicated and time-consuming for developers. Mockator provides a mock object library and an Eclipse plug-in to create mock objects in a simple yet powerful way. Mockator leverages the new language facilities C++11 offers while still being compatible with C++98/03. ii Management Summary In this report we discuss the development of an Eclipse plug-in to refactor towards seams in C++ and the engineered mock object solution. This master’s thesis is a con- tinuation of a preceding term project at the University of Applied Sciences Rapperswil by the same author. Motivation High coupling, hard-wired and cyclic dependencies lead to systems that are hard to change, test and deploy in isolation.
    [Show full text]
  • ABAP Object Unit, 747 ABAP Unit, 747 Abstract Setup Decorator Defined, 449 Example, 453 Acceptance Tests. See Also Customer Test
    Index A Hard-Coded Test Data solution, 196 ABAP Object Unit, 747 preface, xxi ABAP Unit, 747 anonymous inner class Abstract Setup Decorator defi ned, 786 defi ned, 449 Test Stub examples, 535–536 example, 453 Ant, 753 acceptance tests. See also AntHill, 753 customer tests anti-pattern (AP) defi ned, 785 defi ned, 786 why test?, 19 test smells, xxxv accessor methods, 785 AOP (aspect-oriented programming) ACID, 785 defi ned, 786 acknowledgements, xxvii–xxviii Dependency Injection, 681 action components, 280 retrofi tting testability, 148 agile method API (application programming inter- defi ned, 785–786 face) property tests, 52 Creation Methods, 416 AllTests Suite database as SUT, 336 example, 594–595 defi ned, 786 introduction, 13 Test Utility Method, 600 when to use, 593 architecture, design for testability. annotation See design-for-testability defi ned, 786 arguments Test Methods, 351 messages describing, 371–372 Anonymous Creation Method as parameters (Dummy defi ned, 417 Arguments), 729 example, 420 role-describing, 725 835 836 Index Arguments, Dummy, 729 improperly coded in Neverfail Ariane 5 rocket, 218 Tests, 274 aspect-oriented programming (AOP) introduction, 77 defi ned, 786 Missing Assertion Messages, Dependency Injection, 681 226–227 retrofi tting testability, 148 reducing Test Code Duplication, Assertion Message 114–119 of Assertion Method, 364 refactoring, xlvi–xlix pattern description, 370–372 Self-Checking Tests, 107–108 Assertion Method unit testing, 6 Assertion Messages, 364 Verify One Condition per Test, calling built-in, 363–364
    [Show full text]
  • Development Testing
    Software and Systems Verification (VIMIMA01) Development testing Zoltan Micskei Budapest University of Technology and Economics Fault Tolerant Systems Research Group Budapest University of Technology and Economics Department of Measurement and Information Systems 1 Main topics of the course . Overview (1) o V&V techniques, Critical systems . Static techniques (2) o Verifying specifications o Verifying source code . Dynamic techniques: Testing (7) o Developer testing, Test design techniques o Testing process and levels, Test generation, Automation . System-level verification (3) o Verifying architecture, Dependability analysis o Runtime verification 2 Example: what/how/where to test? 3 Example: what/how/where to test? Tests through GUI (~ system test) 4 Example: what/how/where to test? Tests through API (~ integration test) 5 Example: what/how/where to test? Module/unit tests 6 UNIT TESTING 7 Learning outcomes . Explain characteristics of good unit tests (K2) . Write unit tests using a unit testing framework (K3) 8 Module / unit testing . Module / unit: o Logically separable part o Well-defined interface o Can be: method / class / package / component… . Call hierarchy (ideal case): A A A3 A31 A311 A312 A1 A2 A3 A31 A32 A33 … A311 A312 A313 9 Why do we need unit testing? . Goal: Detect and fix defects during development (lowest level) o Can integrated later tested modules o Developer of the unit can fix the defect fastest . Units can be tested separately o Manage complexity o Locate defects more easily, fix is cheaper o Gives confidence for performing changes . Characteristics if unit tests o Checks a well-defined functionality o Defines a “contract” for the unit o Can be used an example o (Not neceserraly automatic) 10 Unit test frameworks .
    [Show full text]
  • Testen Mit Mockito.Pdf
    Testen mit Mockito http://www.vogella.com/tutorials/Mockito/article.html Warum testen? Würde dies funktionieren, ohne es vorab zu testen? Definition von Tests • Ein Softwaretest prüft und bewertet Software auf Erfüllung der für ihren Einsatz definierten Anforderungen und misst ihre Qualität. Die gewonnenen Erkenntnisse werden zur Erkennung und Behebung von Softwarefehlern genutzt. Tests während der Softwareentwicklung dienen dazu, die Software möglichst fehlerfrei in Betrieb zu nehmen. Arten von Tests • Unit-Test: Test der einzelnen Methoden einer Klasse • Integrationstest: Tests mehrere Klassen / Module • Systemtest: Test des Gesamtsystems (meist GUI-Test) • Akzeptanztest / Abnahmetest: Test durch den Kunden, ob Produkt verwendbar • Regressionstest: Nachweis, dass eine Änderung des zu testenden Systems früher durchgeführte Tests erneut besteht • Feldtest: Test während des Einsatzes • Lasttest • Stresstest • Smoke-Tests: (Zufallstest) nicht systematisch; nur Funktion wird getestet Definitionen • SUT … system under test • CUT … class under test TDD - Test Driven Development Test-Driven Development with Mockito, packt 2013 JUnit.org Hamcrest • Hamcrest is a library of matchers, which can be combined in to create flexible expressions of intent in tests. They've also been used for other purposes • http://hamcrest.org/ • https://github.com/hamcrest/JavaHamcrest • http://www.leveluplunch.com/java/examples/hamcrest- collection-matchers-junit-testing/ • http://grepcode.com/file/repo1.maven.org/maven2/ org.hamcrest/hamcrest-library/1.3/org/hamcrest/Matchers.java Test Doubles Warum Test-Doubles? • A unit test should test a class in isolation. Side effects from other classes or the system should be eliminated if possible. The achievement of this desired goal is typical complicated by the fact that Java classes usually depend on other classes.
    [Show full text]
  • Unit Testing: Principles, Practices, and Patterns
    Principles, Practices, and Patterns Vladimir Khorikov MANNING Chapter Map Licensed toJorge Cavaco <[email protected]> Complexity (ch. 7) Fast feedback (ch. 4) Maximize Have high Domain model and Maintainability Maximize Unit tests Cover algorithms (ch. 4) (ch. 7) Protection against Test accuracy False negatives Defined by Tackled by regressions Maximize Integration tests (ch. 4) (ch. 4) (ch. 4) Cover Defined by Maximize Resistance to False positives Controllers Tackled by refactoring Used in (ch. 4) (ch. 7) (ch. 4) Damage if used incorrectly Have large number of Mocks (ch. 5) In-process dependencies Are Collaborators (ch. 2) (ch. 2) Managed dependencies Should not be used for (ch. 8) Are Out-of-process dependencies Are (ch. 2) Should be used for Unmanaged Are dependencies (ch. 8) Unit Testing: Principles, Practices, and Patterns VLADIMIR KHORIKOV MANNING SHELTER ISLAND Licensed to Jorge Cavaco <[email protected]> For online information and ordering of this and other Manning books, please visit www.manning.com. The publisher offers discounts on this book when ordered in quantity. For more information, please contact Special Sales Department Manning Publications Co. 20 Baldwin Road PO Box 761 Shelter Island, NY 11964 Email: [email protected] ©2020 by Manning Publications Co. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by means electronic, mechanical, photocopying, or otherwise, without prior written permission of the publisher. Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in the book, and Manning Publications was aware of a trademark claim, the designations have been printed in initial caps or all caps.
    [Show full text]
  • BONUS CHAPTER Contents
    BONUS CHAPTER contents preface xvii acknowledgments xix about this book xxi about the cover illustration xxvii PART 1 A TDD PRIMER ..............................................1 The big picture 3 1 1.1 The challenge: solving the right problem right 5 Creating poorly written code 5 ■ Failing to meet actual needs 6 1.2 Solution: being test-driven 7 High quality with TDD 8 ■ Meeting needs with acceptance TDD 10 ■ What’s in it for me? 11 1.3 Build it right: TDD 14 Test-code-refactor: the heartbeat 15 ■ Developing in small increments 19 ■ Keeping code healthy with refactoring 24 ■ Making sure the software still works 28 i ii CONTENTS 1.4 Build the right thing: acceptance TDD 31 What’s in a name? 31 ■ Close collaboration 32 ■ Tests as a shared language 33 1.5 Tools for test-driven development 36 Unit-testing with xUnit 36 ■ Test frameworks for acceptance TDD 37 ■ Continuous integration and builds 37 ■ Code coverage 39 1.6 Summary 41 Beginning TDD 43 2 2.1 From requirements to tests 45 Decomposing requirements 45 ■ What are good tests made of? 47 ■ Working from a test list 47 ■ Programming by intention 48 2.2 Choosing the first test 48 Creating a list of tests 49 ■ Writing the first failing test 50 ■ Making the first test pass 54 ■ Writing another test 56 2.3 Breadth-first, depth-first 58 Faking details a little longer 59 ■ Squeezing out the fake stuff 60 2.4 Let’s not forget to refactor 63 Potential refactorings in test code 64 ■ Removing a redundant test 65 2.5 Adding a bit of error handling 66 Expecting an exception 66 ■ Refactoring toward
    [Show full text]
  • ABAP to the Future 801 Pages, 2016, $79.95 ISBN 978-1-4932-1410-5
    First-hand knowledge. Reading Sample This sample chapter describes how to use ABAP Unit for test-driven development (TDD) when creating and changing custom programs to make your changes with minimal risk to the business. This chap- ter explains what TDD is and how to enable it via the ABAP Unit framework. “ABAP Unit and Test-Driven Development” Contents Index The Author Paul Hardy ABAP to the Future 801 Pages, 2016, $79.95 ISBN 978-1-4932-1410-5 www.sap-press.com/4161 Chapter 3 Code without tests is bad code. It doesn’t matter how well-written it is; it doesn’t matter how pretty or object-oriented or well-encapsulated it is. With tests, we can change the behavior of our code quickly and verifiably. Without them, we really don't know if our code is getting better or worse. —Michael Feathers, Working Effectively with Legacy Code 3 ABAP Unit and Test-Driven Development Nothing is more important, during the process of creating and changing custom programs, than figuring out how to make such changes with minimal risk to the business. The way to do this is via test-driven development (TDD), and the tool to use is ABAP Unit. This chapter explains what TDD is and how to enable it via the ABAP Unit framework. In the traditional development process, you write a new program or change an existing one, and after you’re finished you perform some basic tests, and then you pass the program on to QA to do some proper testing. Often, there isn’t enough time, and this aspect of the software development lifecycle is brushed over—with disastrous results.
    [Show full text]
  • Unit Testing
    Software Construction Mock Testing Jürg Luthiger University of Applied Sciences Northwestern Switzerland Institute for Mobile and Distributed Systems Learning Target You can describe the concepts behind Mock testing can use Mock Objects as an efficient way to do Unit Testing Institute for Mobile and Distributed Systems J. Luthiger 2 Agenda Introduction into Mock Testing Introduction into EasyMock2 Institute for Mobile and Distributed Systems J. Luthiger 3 Unit Testing (Reminder!) Unit Testing is done on each module in isolation to verify its behavior Unit test will establish some kind of artificial environment invoke routines in the module under test check the results against known values Institute for Mobile and Distributed Systems J. Luthiger 4 Limits of Unit Testing Some things can't be tested in isolation Configuration JDBC code z Testing for connection acquisition and release is not very interesting O/R mappings ... and, of course, how classes work together Institute for Mobile and Distributed Systems J. Luthiger 5 Test Double in Unit Testing Dummy objects are passed around but never actually used. Usually they are just used to fill parameter lists. Fake objects actually have working implementations, but usually take some shortcut which makes them not suitable for production (an in-memory database is a good example). Stubs provide canned answers to calls made during the test, usually not responding at all to anything outside what's programmed in for the test. Stubs may also record information about calls, such as an email gateway stub that remembers the messages it 'sent', or maybe only how many messages it 'sent'. Mocks objects pre-programmed with expectations which form a specification of the calls they are expected to receive.
    [Show full text]
  • Automated Testing for Provisioning Systems of Complex Cloud Products
    David Jorge Garcia Mendes Bachelor in Computer Science Automated Testing for Provisioning Systems of Complex Cloud Products Dissertation submitted in partial fulfillment of the requirements for the degree of Master of Science in Computer Science and Informatics Engineering Advisers: Miguel João, Cloud Systems Architect, OutSystems João Lourenço, Assistant Professor, NOVA University of Lisbon Examination Committee Chairperson: Prof. Nuno Preguiça, FCT-NOVA Members: Prof. João Lourenço, FCT-NOVA Prof. João Pascoal Faria, FEUP September, 2019 Automated Testing for Provisioning Systems of Complex Cloud Products Copyright © David Jorge Garcia Mendes, Faculty of Sciences and Technology, NOVA Uni- versity Lisbon. The Faculty of Sciences and Technology and the NOVA University Lisbon have the right, perpetual and without geographical boundaries, to file and publish this dissertation through printed copies reproduced on paper or on digital form, or by any other means known or that may be invented, and to disseminate through scientific repositories and admit its copying and distribution for non-commercial, educational or research purposes, as long as credit is given to the author and editor. This document was created using the (pdf)LATEX processor, based in the “novathesis” template[1], developed at the Dep. Informática of FCT-NOVA [2]. [1] https://github.com/joaomlourenco/novathesis [2] http://www.di.fct.unl.pt In loving memory of my grandmother, Deonilde Mendes. Acknowledgements First of all, I would like to thank the Faculty of Sciences and Technology from the New University of Lisbon and, in specific, the Informatics Department for providing me with the building blocks from which I can start building my professional career.
    [Show full text]