Contributions to Model-Based Testing of Dynamic and Distributed Real-Time Systems Moez Krichen To cite this version: Moez Krichen. Contributions to Model-Based Testing of Dynamic and Distributed Real-Time Systems. Performance [cs.PF]. École Nationale d’Ingénieurs de Sfax (Tunisie), 2018. tel-02495153 HAL Id: tel-02495153 https://hal.archives-ouvertes.fr/tel-02495153 Submitted on 1 Mar 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Doctoral School The Minister of Higher Education Sciences and Technologies and Scientific Research HDR Thesis University of Sfax Computer System Engineering National Engineering School of Sfax Order N°: THESIS Presented at National Engineering School of Sfax to obtain the title of HDR IN COMPUTER SCIENCES Computer System Engineering by Moez KRICHEN Contributions to Model-Based Testing of Dynamic and Distributed Real-Time Systems Defended on 15 August 2018 in front of the jury composed of: Prof. Mohamed Jmaiel (University of Sfax, Tunisia) Chair Prof. Kamel Barkaoui (CEDRIC-CNAM, France) Reviewer Prof. Adel Mahfoudhi (University of Sfax, Tunisia) Reviewer Prof. Wassim Jaziri (University of Sfax, Tunisia) Examiner A.Pr. Mahdi Khemakhem (University of Sfax, Tunisia) Examiner Abstract In this dissertation we report on our main research contributions dealing with Model-Based Testing of Dynamic and Distributed Real-Time Systems, performed during the last ten years. Our first contribution deals with testing techniques for distributed and dynamically adapt- able systems. In this context, we propose a standard-based test execution platform which affords a platform-independent test system for isolating and executing runtime tests. This platform uses the TTCN3 standard and considers both structural and behavioral adaptations. Moreover, our platform is equipped with a test isolation layer that reduces the risk of interference between testing processes and business processes. Besides, we compute a minimal subset of test cases to run and efficiently distribute them among the execution nodes while respecting resource and connectivity constraints. In addition, we validate the proposed techniques on two case studies, one in the healthcare domain and the other one in the fleet management domain. Our second contribution consists in proposing a model-based framework to combine Load and Functional Tests. This framework is based on the model of extended timed automata with inputs/ouputs and shared integer variables. We present different modelling techniques aspects and we illustrate them by means of a case study. Moreover, we study BPEL compositions be- haviors under various load conditions using the proposed framework. We introduce a taxonomy of the detected problems and we illustrate how test verdicts are assigned. Besides, we validate our approach using a Travel Agency case study. Furthermore, we consider several mutants of the corresponding BPEL process and we test them using our tool. Our third contribution consists in introducing a set of formal techniques for the determiniza- tion and off-line test selection for timed automata with inputs and outputs. With this respect, we propose a game-based approach between two players for the determinization of a given timed automaton and some fixed resources. Moreover, we present a complete formalization for the au- tomatic off-line generation of test cases from non-deterministic timed automata with inputs and outputs. We also define a selection technique of test cases with expressive test purposes. Test cases are generated using a symbolic co-reachability analysis of the observable behaviors of the specification guided by the test purpose which is in turn defined as a special timed automaton. Finally we report on two ongoing works. The first one deals with a model-based approach for security testing of Internet of Things applications. The second one deals with providing a scalable test execution platform providing testing facilities as a cloud service. i Contents 1 General Introduction 1 1.1 Research Context and Motivation . .1 1.2 Contributions . .3 1.3 Document Outline . .5 I Testing Distributed and Dynamically Adaptable Systems 6 2 Background Materials and State of the Art 7 2.1 Introduction . .7 2.2 Dynamically adaptable systems . .7 2.3 Software testing fundamentals . .9 2.4 Testing dynamically adaptable systems . 12 2.5 Related work on regression testing . 14 2.6 Related work on runtime testing . 16 2.7 Summary . 19 3 Runtime Testing for Structural Adaptations 20 3.1 Introduction . 20 3.2 The Approach in a nutshell . 21 3.3 Online dependency analysis . 22 3.4 Online test case selection . 23 3.5 Constrained test component placement . 24 3.6 Test isolation and execution support . 26 3.7 Summary . 30 4 Runtime Testing of Behavioral Adaptations 31 4.1 Introduction . 31 4.2 The approach in a nutshell . 31 4.3 Prerequisites: UPPAAL Timed Automata . 32 4.4 Differencing between behavioral models . 34 4.5 Old test suite classification . 35 4.6 Test generation and recomputation . 35 4.7 Test case concretization . 37 4.8 Summary . 39 5 Prototype Implementation 40 5.1 Introduction . 40 5.2 RTF4ADS overview . 40 5.3 Test selection and distribution GUI . 41 5.4 Test isolation and execution GUI . 43 5.5 Selective Test Generation GUI . 44 5.6 Application of RTF4ADS for Structural Adaptations . 45 5.7 Application of RTF4ADS for Behavioral Adaptations . 50 5.8 Summary . 55 II Combining Load and Functional Tests 56 6 A Comparative Evaluation of State-of-the-Art of Load Testing Approaches 57 6.1 Introduction . 57 6.2 Motivation . 58 6.3 Load & Stress Testing . 58 6.4 Classification of Load & Stress Testing Solutions . 61 6.5 Discussion . 65 6.6 Summary . 68 7 A Model Based Approach to Combine Load and Functional Tests 69 7.1 Introduction . 69 7.2 Extended Timed Automata . 70 7.3 Modelling Issues . 71 iii 7.4 Illustration through the TRMCS case study . 76 7.5 Summary . 80 8 Limitations of WS-BPEL Compositions under Load Conditions 81 8.1 Introduction . 81 8.2 Study of WS-BPEL Compositions under Load . 81 8.3 Automated Advanced Load Test Analysis Approach . 85 8.4 Travel Agency Case Study . 88 8.5 Summary . 92 III Determinization and Off-Line Test Selection for Timed Automata 94 9 A Game Approach to Determinize Timed Automata 95 9.1 Introduction . 95 9.2 Motivation . 95 9.3 Preliminaries . 97 9.4 A game approach . 100 9.5 Extension to "-transitions and invariants . 105 9.6 Comparison with existing methods . 105 9.7 Summary . 108 10 Off-line Test Selection for Non-Deterministic Timed Automata 109 10.1 Introduction . 109 10.2 Motivation . 110 10.3 A model of open timed automata with inputs/outputs . 111 10.4 Conformance testing theory . 112 10.5 Approximate determinization preserving tioco . 114 10.6 Off-line test case generation . 117 10.7 Summary . 121 IV Ongoing Works 122 11 Towards a Model-Based Testing Framework for the Security of Internet of Things for Smart City Applications 123 11.1 Introduction . 123 11.2 Motivation . 123 iv 11.3 Preliminaries . 124 11.4 Threats and challenges . 125 11.5 Proposed Approach . 126 11.6 Related Work . 127 11.7 Summary . 128 12 Towards a Scalable Test Execution Platform On the Cloud 129 12.1 Introduction . 129 12.2 Motivation . 129 12.3 Background and Related Work . 130 12.4 Proposed Approach . 132 12.5 eHealth case study . 133 12.6 Summary . 135 13 General Conclusion.