Ref. Ares(2018)3343807 - 25/06/2018 Title: Test Strategy and Environment Abstract Multi-cloud Execution-ware This document presents a strategy for testing, acceptance criteria, for Large-scale Optimized test related products and responsibilities related to quality Data -Intensive Computing assurance tasks in Melodic. The document should be use as a H2020-ICT-2016-2017 guideline for performing all activities within the testing process. Leadership in Enabling and Also, it should be used in conjunction with the 'D5.10 Quality Industrial Technologies; Information and Assurance Guide' deliverable, which contains detailed Communication Technologies descriptions on how to accomplish test related tasks and should be Grant Agreement No.: use as a manual for those tasks. The deliverable's intended 731664 audiences is as follows: It could be used by all participants in the Duration: project. Especially it should be use by development teams (the 1 December 2016 - unit/integration tests and the bugs definition), test teams (the 30 November 2019 whole document), architects (bugs and test cases processes), use www.melodic.cloud case application users (test reporting and bugs handling) and Deliverable reference: managers (management of the releases and the testing process). D5.6 In detail, this document defines the test strategy, and describes Date: various levels of testing (e.g. unit testing, integration testing, 31 May 2018 functional testing, and non-functional testing). The next main Responsible partner: topic covered is the environments configurations, including their 7bulls purposes, followed by test process descriptions. For the test Editor(s): process descriptions, the document explains the process of testing, Katarzyna Materka how to use it in the project, the purpose of the process, and where Author(s): to find more information. Furthermore, this document describes Katarzyna Materka, Michał Semczuk test related products delivered within the Melodic project, including a Test Plan, Test Cases with scenarios, and a Test Report. Approved by: Ernst Gunnar Gran Finally, the document covers communication and responsibilities ISBN Number: related to quality assurance in the project. Altogether, this N/A deliverable should represent a complete and comprehensive guide Document URL: for the most important quality assurance tasks with regards to http://www.melodic.cloud/ testing in the project. deliverables/D5.6 Test Strategy and Environment.pdf This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731664 www.melodic.cloud Deliverable reference: Editor(s): D5.6 Katarzyna Materka Document Period Covered M6-12 Deliverable No. D5.06 Deliverable Title Test Strategy and Environment Editor(s) Katarzyna Materka Author(s) Katarzyna Materka, Michał Semczuk Reviewer(s) Kyriakos Kritikos, Ioannis Patiniotakis Work Package No. 5 Work Package Title Integration and security Lead Beneficiary 7bulls Distribution PU Version Final Draft/Final Final Total No. of Pages 35 This project has received funding from the European Union’s Horizon 2020 www.melodic.cloud 2 research and innovation programme under grant agreement No 731664 Deliverable reference: Editor(s): D5.6 Katarzyna Materka Table of Contents 1 Introduction ................................................................................................................................................. 6 1.1 The purpose and Objective ................................................................................................................ 6 1.1.1 Purpose ................................................................................................................................................. 6 1.1.2 Objective ............................................................................................................................................... 7 1.2 Assumptions ........................................................................................................................................... 7 1.3 Intended Audience ............................................................................................................................... 8 1.4 Document Structure ............................................................................................................................. 8 2 Test Strategy ............................................................................................................................................. 10 2.1 Definition of Project Testing .......................................................................................................... 10 2.2 Planning of Test Activities .............................................................................................................. 12 2.2.1 Development .................................................................................................................................... 12 2.2.2 Acceptance Test .............................................................................................................................. 12 2.2.3 Scope of Testing .............................................................................................................................. 12 3 Levels of Testing ...................................................................................................................................... 13 3.1 Unit Testing ........................................................................................................................................... 13 3.1.1 Definition ........................................................................................................................................... 13 3.1.2 Objectives .......................................................................................................................................... 14 3.1.3 Tools ..................................................................................................................................................... 14 3.2 Smoke Testing ..................................................................................................................................... 15 3.2.1 Definition ........................................................................................................................................... 15 3.2.2 Objectives .......................................................................................................................................... 15 3.2.3 Tools ..................................................................................................................................................... 15 3.3 Functional Testing ............................................................................................................................. 16 3.3.1 Definition ........................................................................................................................................... 16 3.3.2 Objectives .......................................................................................................................................... 17 3.3.3 Tools ..................................................................................................................................................... 18 3.4 Regression Testing ............................................................................................................................. 18 This project has received funding from the European Union’s Horizon 2020 www.melodic.cloud 3 research and innovation programme under grant agreement No 731664 Deliverable reference: Editor(s): D5.6 Katarzyna Materka 3.4.1 Definition ........................................................................................................................................... 18 3.4.2 Objectives .......................................................................................................................................... 19 3.4.3 Tools ..................................................................................................................................................... 19 3.5 Non-Functional Testing ................................................................................................................... 19 3.5.1 Definition ........................................................................................................................................... 19 3.5.2 Objectives .......................................................................................................................................... 20 4 Test Environments ................................................................................................................................. 21 4.1 Development environment (Unit Testing Environment) ................................................... 21 4.2 Integration environment (Smoke Testing Environment) .................................................. 21 4.3 Acceptance environment (Functional Test Environment) ................................................ 22 4.4 Non-Functional Test Environment – optional ....................................................................... 22 5 Test Process ............................................................................................................................................... 23 5.1 Test cases and test scenario relations ....................................................................................... 24 5.2