This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 777533. PROviding Computing solutions for ExaScale ChallengeS Initial state of the art and requirement analysis, D4.1 initial PROCESS architecture Start / 01 November 2017 Project : PROCESS H2020 – 777533 Duration: 36 Months Dissemination1: PU Nature2: R Due Date: Month 6 Work Package: WP 4 D4.1_Initial_ state_of_the_art_and_requirement_analysis_ Filename3 initial_PROCESS_architecture_v1.docx ABSTRACT The PROCESS project brings together heterogeneous use cases with unique challenges that the current solutions are unable to meet. This deliverable provides requirement and innovation potential analysis of the use cases together with their detailed description. On the basis of the analysis, the common conceptual model and initial PROCESS architecture have been developed. According to the technological state of the art, we have identified technologies that will help solve the use case challenges, which will be revised during the lifetime of PROCESS, taking into account the involved technologies for both computing resource management and data management deployed and used across existing European Research Infrastructures (RI). This version is a draft of D4.1 and is under review. 1 PU = Public; CO = Confidential, only for members of the Consortium (including the EC services). 2 R = Report; R+O = Report plus Other. Note: all “O” deliverables must be accompanied by a deliverable report. 3 eg DX.Y_name to the deliverable_v0xx. v1 corresponds to the final release submitted to the EC. Deliverable Name Organization Role / Title Contributors: Deliverable Deliverable Hluchý, L. UISAV Leader4 coordinator Bobák, M., Dlugolinský, Š., Habala, O., Nguyen, G., UISAV Writers Šeleng, M., Tran, V. Pancake-Steeg, J., Spahr, LSY Writers S. gentschen Felde, N., Heikkurinen, M., Höb, M., LMU Writers Contributing Schmidt, J. Authors5 Graziani, M., Müller, H. HES-SO Writers Maassen, J., Spreeuw, H. NLESC Writers Belloum, A., Cushing, R., UvA Writers Rahmanian, A. Bubak, M., Meizner, J., AGH / AGH- Nowakowski, P., Rycerz, K., Writers UST Wilk, B. Cushing, Reginald UvA Reviewer Graziani, Mara HES-SO Reviewer Habala, Ondrej UISAV Reviewer Höb, Maximilian LMU Reviewer 6 Reviewer(s) Maassen, Jason NLESC Reviewer AGH / AGH- Meizner, Jan Reviewer UST AGH / AGH- Nowakowski, Piotr Reviewer UST Spahr, Stefan LSY Reviewer Final review and Project gentschen Felde, Nils LMU approval coordinator Document History Release Date Reasons for Change Status7 Distribution 0.1 2018-01-18 Initial version Draft 2018-01-18 Final version of the 0.2 2018-02-09 Draft 2018-02-09 document structure 1st improvement of the 0.3 2018-03-09 Draft 2018-03-09 draft version 2nd improvement of the 0.4 2018-04-10 Draft 2018-04-10 draft version 4 Person from the lead beneficiary that is responsible for the deliverable. 5 Person(s) from contributing partners for the deliverable. 6 Typically person(s) with appropriate expertise to assess the deliverable quality. 7 Status = “Draft”; “In Review”; “Released”. This version is a draft of D4.1 and is under review. 2 Preparation of the 0.5 2018-04-17 In Review 2018-04-17 prefinal version 0.6 2018-04-23 Reviewing In Review 2018-04-23 0.7 2018-04-25 1st language correction In Review 2018-04-25 0.8 2018-04-28 2nd language correction In Review 2018-04-28 1.0 2018-04-30 Final version Released 2018-04-30 This version is a draft of D4.1 and is under review. 3 Table of Contents Executive Summary ................................................................................................................... 8 List of Figures ............................................................................................................................. 9 List of Tables ............................................................................................................................ 11 Introduction ............................................................................................................................... 12 1 Use case analysis ............................................................................................................. 12 1.1 UC#1: Exascale learning on medical image data ..................................................... 12 1.1.1 Use Case Domain .............................................................................................. 12 1.1.2 Use Case Motivation .......................................................................................... 12 1.1.3 Use Case Goal ................................................................................................... 12 1.1.4 Use Case Description......................................................................................... 13 1.1.5 ‘Data Upload’ workflow ....................................................................................... 14 1.1.6 ‘Model Training’ workflow ................................................................................... 15 1.1.7 ‘Model Testing’ workflow .................................................................................... 18 1.1.8 Software layers ................................................................................................... 18 1.1.9 Methods and tools .............................................................................................. 19 1.1.10 Datasets’ description .......................................................................................... 19 1.1.11 Requirement analysis ......................................................................................... 20 1.1.12 Innovation potential ............................................................................................ 21 1.2 UC#2: Square Kilometre Array/LOFAR..................................................................... 23 1.2.1 Use Case Domain .............................................................................................. 23 1.2.2 Use case Motivation ........................................................................................... 23 1.2.3 Use Case Goal ................................................................................................... 23 1.2.4 Use Case Description......................................................................................... 23 1.2.5 Use Case Scenario ............................................................................................ 25 1.2.6 Methods and tools .............................................................................................. 27 1.2.7 Dataset description............................................................................................. 28 1.2.8 Requirement analysis ......................................................................................... 28 1.2.9 Innovation potential ............................................................................................ 29 1.3 UC#3: Supporting innovation based on global disaster risk data ............................. 30 1.3.1 Use Case Domain .............................................................................................. 30 1.3.2 Use Case Motivation .......................................................................................... 30 1.3.3 Use Case Goal ................................................................................................... 30 1.3.4 Use Case Description......................................................................................... 30 1.3.5 Software layers ................................................................................................... 31 1.3.6 Workflow ............................................................................................................. 32 1.3.7 Methods and tools .............................................................................................. 33 This version is a draft of D4.1 and is under review. 4 1.3.8 Datasets’ description .......................................................................................... 33 1.3.9 Requirement analysis ......................................................................................... 34 1.3.10 Innovation potential ............................................................................................ 34 1.4 UC#4: Ancillary pricing for airline revenue management ......................................... 35 1.4.1 Use Case Domain .............................................................................................. 35 1.4.2 Use Case Motivation .......................................................................................... 35 1.4.3 Use Case Goal ................................................................................................... 35 1.4.4 Use Case Description......................................................................................... 36 1.4.5 Software layers ................................................................................................... 37 1.4.6 Scenario ............................................................................................................. 37 1.4.7 Methods and tools .............................................................................................. 38 1.4.8 Datasets’ description .......................................................................................... 38 1.4.9 Requirement analysis ......................................................................................... 39 1.4.10 Innovation potential