DOCSLIB.ORG

Automated Design Space Exploration for Component-Based Real-Time Distributed Systems

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Automated Design Space Exploration for Component-Based Real-Time Distributed Systems Automated design space exploration for component-based real-time distributed systems Citation for published version (APA): Triantafyllidis, K. (2017). Automated design space exploration for component-based real-time distributed systems. Technische Universiteit Eindhoven. Document status and date: Published: 18/04/2017 Document Version: Publisher’s PDF, also known as Version of Record (includes final page, issue and volume numbers) Please check the document version of this publication: • A submitted manuscript is the version of the article upon submission and before peer-review. There can be important differences between the submitted version and the official published version of record. People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website. • The final author version and the galley proof are versions of the publication after peer review. • The final published version features the final layout of the paper including the volume, issue and page numbers. Link to publication General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal. If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license above, please follow below link for the End User Agreement: www.tue.nl/taverne Take down policy If you believe that this document breaches copyright please contact us at: [email protected] providing details and we will investigate your claim. Download date: 11. Oct. 2021 Automated Design Space Exploration for Component-Based Real-Time Distributed Systems PROEFSCHRIFT ter verkrijging van de graad van doctor aan de Technische Universiteit Eindhoven, op gezag van de rector magnificus prof.dr.ir. F.P.T. Baaijens, voor een commissie aangewezen door het College voor Promoties, in het openbaar te verdedigen op dinsdag 18 april 2017 om 16.00 uur door Konstantinos Triantafyllidis geboren te Karditsa, Griekenland Dit proefschrift is goedgekeurd door de promotoren en de samenstelling van de promotiecommissie is als volgt: voorzitter: prof.dr.ir. J.H. Blom 1e promotor: prof.dr.ir. P.H.N. de With copromotor(en): dr. Y. Bondarau leden: dr. L. Almeida (University of Porto, Portugal) dr. J.L. Medina (University of Cantabria, Spain) prof.dr. K.G.W. Goossens dr.ir. R.J. Bril Het onderzoek of ontwerp dat in dit proefschrift wordt beschreven is uitgevoerd in overeenstemming met de TU/e Gedragscode Wetenschapsbeoefening. To my parents Gianni and Vagelitsa. CIP-DATA LIBRARY TECHNISCHE UNIVERSITEIT EINDHOVEN Triantafyllidis, Konstantinos. Design Space Exploration for Comonent-Based Real-Time Distributed Systems by Konstantinos Triantafyllidis - Eindhoven : Technische Universiteit Eindhoven, 2017. Proefschrift. - ISBN 978-94-629-5596-7 NUR 959 Trefw.: prestatievoorspelling / real-time systemen / architectuurontwerp / componentgebasseerde architecturen. Subject headings: performance prediction / real-time systems / design space exploration / component-based architecture. c Copyright 2017 Konstantinos Triantafyllidis All rights are reserved. No part of this book may be reproduced, stored in a re- trieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording, or otherwise, without the prior written permission from the copyright owner. Summary Automated Design Space Exploration for Component-Based Real-Time Distributed Systems In recent years, component-based development has become a common prac- tice, enabling rapid system prototyping and system composition from existing SW and HW blocks. At the early component-composition phases, an architect needs accurate assessment methods to evaluate the performance of the system. There- fore, the component models should be reasonably detailed, while maintaining a high abstraction level, so that they can be easily incorporated and combined for the composition of a virtual prototype. Moreover, the performance analysis of such pro- totype systems may result in pessimistic worst-case response time predictions, or even worse, cannot guarantee reachability of actual worst-case response times. On top of this, the incorporation of multi-node architectures requires analysis methods that consider high-accuracy predictions of the involved networked communication. The complexity of such multi-node systems makes accurate performance prediction a challenging task. Additionally, due the large number of different architecture al- ternatives (numerous factors of freedom in system architecture), the design space exploration (DSE) of such systems should enable both fast generation and rapid evaluation, in preferably automated way, of those architecture alternatives. In this thesis, we propose the ProMARTES DSE framework, which enables rapid and highly accurate DSE of component-based real-time distributed systems (CB- RTDS). ProMARTES incorporates four individual phases: (a) profiling and resource modeling, (b) architecture composition, (c) performance analysis, and (d) system evaluation and architecture optimization. After presenting this framework, the Pro- MARTES DSE is evaluated by various experiments. For profiling, the framework enables cycle-accurate measurements and auto- mated generation of component resource models by using the ProMo tool devel- oped for this purpose. The generated resource models are then placed into a repos- itory alongside with the behavior models of the SW. Also, the HW component modules are added. For architecture composition, constitution of the system is per- formed in a semi-automated manner, where an architect specifies in an intuitive way the functional and non-functional system requirements. The automated part con- sists of realizing the composition of the HW platform and the SW/HW mapping, using state-of-the-art optimization heuristics. With respect to performance analy- i sis, the composed system model is applied to a hybrid performance analysis method, which provides identification of worst-case response times in a deterministic pro- cedure, while average-case response times and detailed behavior time-line data are obtained via simulation. The hybrid method supports both computation and com- munication resources. Regarding the final system evaluation with ProMARTES DSE, the architecture composition of a system and its performance analysis are exe- cuted in a fast, automated and iterative manner, until the optimal or a set of optimal system architecture(s) is identified. This automated iterative process is guided by newly modified state-of-the-art optimization heuristics. The ProMARTES framework is validated on three challenging real-world case studies, which involve autonomously navigating robot systems with multiple pro- cessing nodes, various HW and SW components, real-time scheduling policies and communication protocols. The first case study contributes in the evaluation of the processing performance analysis framework, by comparing predicted and actual performance of an autonomous navigating robot-system. The second case study covers three autonomously navigating robots with high processing resource de- mands. The communication between the robots and the processing resources is performed wirelessly, thereby explicitly evaluating robustness and multi-node net- working aspects in the ProMARTES performance analysis framework. The third and last case study concentrates on the automated optimization, comparing and se- lecting the best performing system architecture for the second case study. The first novel element is the guided optimization process to the optimal architecture by as- signing weights to fundamental architecture dimensions. The second innovation is the generation of architecture alternatives by imposing rules derived from patterns in real-time distributed system design. This innovation is significantly improving the convergence speed for finding the best architecture in a short time. The ProMARTES DSE framework offers a number of contributions and further considerations. The cycle-accurate resource models generated at profiling, act as a valid and accurate source in the succeeding performance analysis phase, while being widely applicable to many CPU-based architectures. Moreover, the direct usage of MARTE-compatible resource models in the system composition and per- formance analysis phases is ensured without any manual intervention. However, their generation requires the physical presence of a HW platform for preliminary profiling in isolated execution. The semi-automated embedding of functional and non-functional requirements via execution scenarios facilitates automated SW/HW mapping and rapid system prototyping, while also reducing the manual composi- tion effort by the architect. The case studies and the associated experiments have shown that the Pro- MARTES performance prediction method yields typically only a 6% deviation from the physically implemented system prototype. The schedulability analysis has shown larger deviation, because it is
Load more

Recommended publications
  • Handling Decisions and Traffic Dependencies in Layered
    Handling Decisions and Traffic Dependencies in Layered Queueing Networks by Lianhua Li, B.A.Eng., M.Sc. A thesis submitted to the Faculty of Graduate Studies and Postdoctoral Affairs in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Electrical and Computer Engineering Carleton University Ottawa, Ontario, Canada c 2016 Lianhua Li ii Abstract A Layered Queueing Network (LQN) is a recognized performance modelling technique for performance prediction and evaluation of distributed systems. However, at present LQNs do not handle models with state-based behaviour such as timeouts and aborts, called ‘decisions’ here. This research extends LQNs by incorporating decisions into the model. The XML input language used to describe LQNs has been extended to handle these decisions. Both the LQN simulator, lqsim, and analytic solver, lqns, were then modified to solve models with decisions. The analytic solver uses decomposition and mean value analysis to solve models. Unfortunately, mean value analysis cannot be used to solve models with state-based behaviour. To overcome this limitation, a new approach called Dynamic Parameter Substitution (DPS) is used where intermediate results found while solving the model are used to alter the input parameters for subsequent iterations of the solution. To accomplish this goal, Layered Queueing eXperiment (LQX) language functions were derived to handle timeout and retry decisions and to handle fair-share queueing. The results from solving models using DPS were compared to results found from hybrid modelling, simulation, and where feasible, Petri nets. This research also improves the accuracy of the LQN analytic solver when solv- ing models with traffic dependencies, namely interlocking and sub-chain dependent behaviour.
    [Show full text]
  • On the Solution of Cooperating Stochastic Models
    Scuola Dottorale di Ateneo Graduate School Dottorato di ricerca in Informatica Ciclo XXVI Anno di discussione 2013 On the Solution of Cooperating Stochastic Models SETTORE SCIENTIFICO DISCIPLINARE DI AFFERENZA: INF/01 Tesi di Dottorato di Gian-Luca Dei Rossi, matricola 955834 Coordinatore del Dottorato Tutore del Dottorando Prof. Riccardo Focardi Prof.ssa Simonetta Balsamo To the future readers of this thesis, for their patience. Abstract Stochastic models are widely used in the performance evaluation community. In particular, Markov processes, and more precisely, Continuous Time Markov Chains (CTMCs), often serve as underlying stochastic processes for models written in higher-level formalisms, such as Queueing Networks, Stochastic Petri Nets and Stochastic Process Algebras. While compositionality, i.e., the ability to express a complex model as a combination of simpler components, is a key feature of most of those formalisms, CTMCs, by themselves, don't allow for mechanisms to ex- press the interaction with other CTMCs. In order to mitigate this problem various lower-level formalisms have been proposed in literature, e.g., Stochastic Automata Networks (SANs) [146], Communicating Markov Processes [46], Interactive Markov chains [100] and the labelled transition systems derived from PEPA models [101]. However, while the compositionality of those formalism is a useful property which makes the modelling phase easier, exploiting it to get solutions more efficiently is a non-trivial task. Ideally one should be able to either detect a product-form solution and analyse the components in isolation or, if a product form cannot be detected, use other techniques to reduce the complexity of the solution, e.g., reducing the state space of either the single components or the joint process.
    [Show full text]
  • VU Research Portal
    VU Research Portal Queueing Networks with Shared Resources van der Weij, W. 2009 document version Publisher's PDF, also known as Version of record Link to publication in VU Research Portal citation for published version (APA) van der Weij, W. (2009). Queueing Networks with Shared Resources. General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal ? Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. E-mail address: [email protected] Download date: 02. Oct. 2021 Queueing Networks with Shared Resources Wemke van der Weij, 1982 Queueing Networks with Shared Resources ISBN 978-90-8659-298-2 THOMAS STIELTJES INSTITUTE FOR MATHEMATICS The research in this thesis has been carried out in the context of E-Quality Center of Excellence, and has been partly supported by the Basic Research in Informatics for Creating the Knowledge Society (BRICKS) project on Quality of Service in Communication Networks. c W. van der Weij, Amsterdam 2009.
    [Show full text]
  • Extending Layered Queueing Network with Hybrid Sub Models Representing Exceptions and D Ecision Making
    Extending Layered Queueing Network with Hybrid Sub­ models Representing Exceptions and Decision Making by Pengfei Wu B. Eng., M.A. Sc. A thesis submitted to the Faculty of Graduate and Postdoctoral Affairs in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Electrical and Computer Engineering Ottawa-Carleton Institute for Electrical and Computer Engineering (OCIECE) Department of Systems and Computer Engineering Carle ton University Ottawa, Ontario, Canada, K1S 5B6 May 2013 © Copyright 2013, Pengfei Wu Library and Archives Bibliotheque et Canada Archives Canada Published Heritage Direction du 1+1 Branch Patrimoine de I'edition 395 Wellington Street 395, rue Wellington Ottawa ON K1A0N4 Ottawa ON K1A 0N4 Canada Canada Your file Votre reference ISBN: 978-0-494-94539-1 Our file Notre reference ISBN: 978-0-494-94539-1 NOTICE: AVIS: The author has granted a non­ L'auteur a accorde une licence non exclusive exclusive license allowing Library and permettant a la Bibliotheque et Archives Archives Canada to reproduce, Canada de reproduire, publier, archiver, publish, archive, preserve, conserve, sauvegarder, conserver, transmettre au public communicate to the public by par telecommunication ou par I'lnternet, preter, telecommunication or on the Internet, distribuer et vendre des theses partout dans le loan, distrbute and sell theses monde, a des fins commerciales ou autres, sur worldwide, for commercial or non­ support microforme, papier, electronique et/ou commercial purposes, in microform, autres formats. paper, electronic and/or any other formats. The author retains copyright L'auteur conserve la propriete du droit d'auteur ownership and moral rights in this et des droits moraux qui protege cette these.
    [Show full text]
  • Sudan University of Science and Technology College of Graduate Studies
    Sudan University of Science and Technology College of Graduate Studies Model-Based Prediction of Resource Utilization and Performance Risks التنبؤ المبني على نموذج ﻹستغﻻل الموارد و مخاطر اﻻداء A Dissertation Submitted to the College of Graduation Studies, Faculty of Computer Science and Information Technology, Sudan University of Science and Technology In Partial Fulfillment of the Requirements for the Degree of DOCTOR OF PHILOSOPHY Major Subject: Software Performance Prediction By Haitham Abdel Moniem Mohamed Supervisor Hany Ammar, Professor May, 2018 اﻵيــــــــــــــــــــــة ii Dedication I would like to dedicate my work to My family, My teachers, and My friends …. iii ACKNOLEGEMENT Firstly, Alhamdulillah Secondly, I would like to express my deepest thanks, respect, and appreciation to Prof. Hany Ammar, my supervisor for his ideas, inspiration, encouragement, support, and patient. Many thanks for Sudan University of Science and Technology for hospitality, generosity, and attention. I also place my sincere thanks to Future University for helping, supporting, and funding my PhD. Haitham A.Moniem iv ABSTRACT The growing complexity of modern software systems makes the prediction of performance a challenging activity. Many drawbacks incurred by using the traditional performance prediction techniques such as simulation, guessing, and depending on previous experience. Moreover, performance assessment and prediction is time consuming activity and may produce inaccurate results especially in complex and large scale software applications. To contribute to solving these problems, we adopt a model-based approach for resource utilization and performance risk prediction. The steps of the approach can be stated as follows: Firstly, we model the software system into annotated UML diagrams. Secondly, performance model is derived from the annotated UML diagrams in order to be evaluated.
    [Show full text]
  • Improving Trade-Offs Between Multiple Metrics in Parallel Queueing Systems
    Imperial College London Department of Computing Improving Trade-Offs between Multiple Metrics in Parallel Queueing Systems Tommi Topi Kalevi Pesu Submitted in part fulfilment of the requirements for the degree of Doctor of Philosophy in Computing of Imperial College London and the Diploma of Imperial College London, 1 July 2019 Abstract Parallel Queueing Networks can be used to model and optimise systems in many different en- vironments, such as distributed storage facilities, multi-core processors, RAID systems, supply chains and public services such as hospitals. The various stakeholders involved with the systems will often measure the performance of such systems using a wide range of metrics that often conflict with each other. Metrics of interest include task response time, subtask dispersion and energy consumption. Subtask dispersion is a recent metric, which is the difference in time of the first and last subtask to complete. The trade-offs between metrics can be controlled in various ways. Within this context, this thesis makes four primary contributions, the first of which of is to compare various delay- padding techniques in split{merge and fork{join parallel queueing models, with respect to task response time and subtask dispersion. We compare seven techniques from the literature, including some of our own, against each other across multiple case studies, in order to determine their strengths and weaknesses. Our results indicate that dynamic delay padding in a fork{join setting is currently the most promising technique for improving the trade-off between subtask dispersion and task response time. Our second contribution is to extend existing delay-padding techniques to work in a class of multi-layered parallel queueing environments, specifically Hidden Stochastic PERT Networks.
    [Show full text]
  • Layered Queueing Networks – Performance Modelling, Analysis and Optimisation
    Layered queueing networks : performance modelling, analysis and optimisation Citation for published version (APA): Dorsman, J. L. (2015). Layered queueing networks : performance modelling, analysis and optimisation. Technische Universiteit Eindhoven. https://doi.org/10.6100/IR784295 DOI: 10.6100/IR784295 Document status and date: Published: 01/01/2015 Document Version: Publisher’s PDF, also known as Version of Record (includes final page, issue and volume numbers) Please check the document version of this publication: • A submitted manuscript is the version of the article upon submission and before peer-review. There can be important differences between the submitted version and the official published version of record. People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website. • The final author version and the galley proof are versions of the publication after peer review. • The final published version features the final layout of the paper including the volume, issue and page numbers. Link to publication General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal.
    [Show full text]
  • Proceedings of the 2020 Winter Simulation Conference K.-H. Bae, B
    Proceedings of the 2020 Winter Simulation Conference K.-H. Bae, B. Feng, S. Kim, S. Lazarova-Molnar, Z. Zheng, T. Roeder, and R. Thiesing, eds. INTEGRATED PERFORMANCE EVALUATION OF EXTENDED QUEUEING NETWORK MODELS WITH LINE Giuliano Casale Department of Computing Imperial College London SW7 2AZ, London, UK ABSTRACT Despite the large literature on queueing theory and its applications, tool support to analyze these models is mostly focused on discrete-event simulation and mean-value analysis (MVA). This circumstance diminishes the applicability of other types of advanced queueing analysis methods to practical engineering problems, for example analytical methods to extract probability measures useful in learning and inference. In this tool paper, we present LINE 2.0, an integrated software package to specify and analyze extended queueing network models. This new version of the tool is underpinned by an object-oriented language to declare a fairly broad class of extended queueing networks. These abstractions have been used to integrate in a coherent setting over 40 different simulation-based and analytical solution methods, facilitating their use in applications. 1 INTRODUCTION Queueing network models have been extensively used in performance analysis and optimization of software applications, computer networks, call centers, logistics, and business processes, among others. Despite a rich literature, limited work has however been carried out towards offering modelling and simulation tools that integrate different analysis paradigms in a coherent way. LINE (http://line-solver.sf.net/) is a MATLAB package to specify and analyze extended queueing network models. With its version 2.0, the tool now offers an object-oriented language to declare and analyze a fairly general class of queueing network models featuring class-switching, layering, state-dependent routing, non-exponential service, caching, and random environments.
    [Show full text]
  • Simplifying Layered Queueing Network Models
    Simplifying Layered Queueing Network Models by Farhana Islam Thesis Submitted to the Faculty of Graduate and Postdoctoral Affairs in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Electrical and Computer Engineering Carleton University Ottawa, Ontario © 2018, Farhana Islam Abstract The amount of detail to include in a performance model is usually regarded as a judgment to be made by an expert modeler and the question “how much detail is necessary?” is seldom asked and is difficult to answer. However, if a simpler model gives essentially the same performance predictions, it may be more useful than a detailed model. It may solve more quickly, for instance, and may be easier to understand. Or a model for a complex sub- system such as a database server may be usefully simplified so it can be included in larger system models. This research proposes an aggregation process for layered queuing models that reduces the number of queues (called tasks and hosts/processors, in layered models) while preserving the total execution demand and the bottleneck characteristics (the highest saturated resource(s)) of the detailed model. This thesis demonstrates how the simplification process can greatly reduce the number of tasks and processors with a very small relative error. The application of proposed simplification process is applied on a number of case studies. A Java application called “LQN model simplifier” was built that takes an LQN model as input and generates a series of simplified models after applying simplification operations to the original model. ii Acknowledgements Behind this journey, there are a lot of dedication, effort, patience and hard work.
    [Show full text]
  • Layered Queueing Network Solver and Simulator User Manual
    Layered Queueing Network Solver and Simulator User Manual Greg Franks Peter Maly Murray Woodside Dorina C. Petriu Alex Hubbard Martin Mroz Department of Systems and Computer Engineering Carleton University Ottawa ON K1S 5B6 {cmw,greg}@sce.carleton.ca January 30, 2013 Revision: 11145 Contents 1 The Layered Queueing Network Model 1 1.1 ModelElements................................... ........... 3 1.1.1 Processors .................................... ........ 3 1.1.2 Groups ........................................ ...... 4 1.1.3 Tasks ......................................... ...... 4 1.1.4 Entries ....................................... ....... 5 1.1.5 Activities .................................... ......... 5 1.1.6 Precedence .................................... ........ 8 1.1.7 Requests ...................................... ....... 9 1.2 MultiplicityandReplication . ................. 9 1.3 ABriefHistory ................................... ........... 10 2 Results 11 2.1 Header.......................................... ......... 11 2.1.1 AnalyticSolver(lqns) . ............ 13 2.1.2 Simulator(lqsim)... .... .... ... .... .... .... .... ........... 13 2.2 Type1ThroughputBounds. ............. 13 2.3 MeanDelayforaRendezvous . ............. 15 2.4 VarianceofDelayforaRendezvous . ................ 15 2.5 MeanDelayforaSend-No-ReplyRequest . ................. 15 2.6 VarianceofDelayforaSend-No-ReplyRequest . .................... 15 2.7 ArrivalLossProbabilities. ................. 15 2.8 MeanDelayforaJoin............................... ...........
    [Show full text]