Ref. Ares(2018)3067143 - 11/06/2018 Title: Provider agnostic interface definition & mapping cycle Executive summary: Multi-cloud Execution-ware for Large-scale Optimised Data- Intensive Computing This deliverable presents the Executionware component of H2020-ICT-2016-2017 the Melodic project. The tasks of the Executionware are: (a) Leadership in Enabling and the allocation of resources from a heterogeneous multi-cloud Industrial Technologies; environment, (b) the usage of those resources to deploy and Information and Communication Technologies run (data processing) tasks and (c) monitoring the runtime context of the running tasks. Grant Agreement No.: 731664 This document focuses on the provider agnostic interface Duration: used to abstract syntactic and semantic differences in the 1 December 2016 - cloud providers’ APIs and the required mapping to translate 30 November 2019 the agnostic interface to concrete implementations on the www.melodic.cloud providers’ side. In addition, it presents a first draft of the Deliverable reference: resource management layer, focusing on resource D4.1 advertisement to Melodic’s Upperware. Finally, the Date: deliverable gives an outlook for a refined resource 09 April 2019 management layer and the data processing layer that will Responsible partner: span on top of it. UULM Editor(s): Daniel Baur Author(s): Daniel Baur, Daniel Seybold Approved by: Ernst Gunnar Gran ISBN number: N/A Document URL: http://www.melodic.cloud/deli verables/D4.1 Provider agnostic interface definition & mapping cycle This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731664 www.melodic.cloud Deliverable reference: Editor(s): 4.1 Daniel Baur Document Period Covered M1-16 Deliverable No. D4.1 Deliverable Title Provider agnostic interface definition & mapping cycle Editor(s) Daniel Baur Author(s) Daniel Baur, Daniel Seybold Reviewer(s) Gregoris Mentzas, Marcin Prusiński Work Package No. 4 Work Package Title Executionware Lead Beneficiary Ulm University Distribution PU Version 1.0 Draft/Final Final Total No. of Pages 36 This project has received funding from the European Union’s Horizon 2020 research and www.melodic.cloud innovation programme under grant agreement No 731664 2 Deliverable reference: Editor(s): 4.1 Daniel Baur Table of Contents 1 Introduction ......................................................................................................................................................... 5 1.1 Scope of the document ............................................................................................................................... 5 1.2 Structure of the document ........................................................................................................................ 6 2 Related Work ....................................................................................................................................................... 6 2.1 IaaS Mapping ................................................................................................................................................. 6 2.2 PaaS Mapping ................................................................................................................................................ 8 2.3 Cross-Level Mapping .................................................................................................................................. 9 2.4 Resource Management ............................................................................................................................. 10 3 Features .............................................................................................................................................................. 10 3.1 Provider agnostic interface & mapping ............................................................................................... 11 IaaS ................................................................................................................................................................... 11 PaaS ................................................................................................................................................................ 15 3.2 Job Description ........................................................................................................................................... 18 3.3 Resource Management ............................................................................................................................. 19 Resource Advertisement ........................................................................................................................ 20 Matchmaking / Scheduling ................................................................................................................... 22 Resource Allocation ..................................................................................................................................23 3.4 Deployment ..................................................................................................................................................23 3.5 Monitoring ................................................................................................................................................... 24 3.6 Adaptation ................................................................................................................................................... 26 4 Architecture ..................................................................................................................................................... 26 5 Implementation............................................................................................................................................... 28 6 Integration and Documentation ................................................................................................................ 28 6.1 Integration ................................................................................................................................................... 29 6.2 Documentation ........................................................................................................................................... 30 7 Future Work ....................................................................................................................................................... 31 7.1 Resource Management ............................................................................................................................. 31 7.2 Deployment .................................................................................................................................................. 31 7.3 Adaptation ....................................................................................................................................................32 This project has received funding from the European Union’s Horizon 2020 research and www.melodic.cloud innovation programme under grant agreement No 731664 3 Deliverable reference: Editor(s): 4.1 Daniel Baur 7.4 Data Processing Layer ..............................................................................................................................32 8 Conclusion .........................................................................................................................................................32 Bibliography .............................................................................................................................................................. 33 List of Figures Figure 1: Melodic Architecture [1] ......................................................................................................................... 5 Figure 2: ComputeService and DiscoveryService Interface ....................................................................... 13 Figure 3: Discovery Class Model ........................................................................................................................ 15 Figure 4: PlatformService Interface and Plaform Entities ......................................................................... 16 Figure 5: Job Description Framework .............................................................................................................. 19 Figure 6: Requirement .......................................................................................................................................... 22 Figure 7: Monitoring Framework ........................................................................................................................ 25 Figure 8: Monitoring Class Diagram .................................................................................................................. 25 Figure 9: Cloudiator Architecture ...................................................................................................................... 27 Figure 10: Cloudiator Integration Tools & Workflow ................................................................................... 30 List of Tables Table 1: IaaS Compute Entities ............................................................................................................................ 13 Table 2: Supported Cloud Providers ................................................................................................................... 14 Table 3: PaaS Entities ............................................................................................................................................