Ref. Ares(2020)1227945 - 27/02/2020 H2020-FETHPC-3-2017 - Exascale HPC ecosystem development EXDCI-2 European eXtreme Data and Computing Initiative - 2 Grant Agreement Number: 800957 D5.3 Presence of Europe in HPC-HPDA standardisation and recommendations to promote European technologies Final Version: 1.0 Authors: JF Lavignon, TS-JFL; Marcin Ostasz, ETP4HPC; Thierry Bidot, Neovia Innovation Date: 21/02/2020 D5.3 Presence of Europe in HPC-HPDA standardisation Project and Deliverable Information Sheet EXDCI Project Project Ref. №: FETHPC-800957 Project Title: European eXtreme Data and Computing Initiative - 2 Project Web Site: http://www.exdci.eu Deliverable ID: D5.3 Deliverable Nature: Report Dissemination Level: Contractual Date of Delivery: PU * 29 / 02 / 2020 Actual Date of Delivery: 21/02/2020 EC Project Officer: Evangelia Markidou * - The dissemination level are indicated as follows: PU – Public, CO – Confidential, only for members of the consortium (including the Commission Services) CL – Classified, as referred to in Commission Decision 2991/844/EC. Document Control Sheet Title: Presence of Europe in HPC-HPDA standardisation and Document recommendations to promote European technologies ID: D5.3 Version: <1.0> Status: Final Available at: http://www.exdci.eu Software Tool: Microsoft Word 2013 File(s): EXDCI-2-D5.3-V1.0.docx Written by: JF Lavignon, TS-JFL Authorship Marcin Ostasz, ETP4HPC Thierry Bidot, Neovia Innovation Contributors: Reviewed by: Elise Quentel, GENCI John Clifford, PRACE Approved by: MB/TB EXDCI-2 - FETHPC-800957 i 21.02.2020 D5.3 Presence of Europe in HPC-HPDA standardisation Document Status Sheet Version Date Status Comments 0.1 03/02/2020 Draft To collect internal feedback 0.2 07/02/2020 Draft For internal reviewers 1.0 21/02/2020 Final version Integration of reviewers’ comments Document Keywords Keywords: PRACE, , Research Infrastructure, HPC, HPDA, Standards Copyright notices 2020 EXDCI-2 Consortium Partners. All rights reserved. This document is a project document of the EXDCI project. All contents are reserved by default and may not be disclosed to third parties without the written consent of the EXDCI-2 partners, except as mandated by the European Commission contract GA no.800957 for reviewing and dissemination purposes. All trademarks and other rights on third party products mentioned in this document are acknowledged as own by the respective holders. EXDCI-2 - FETHPC-800957 ii 21.02.2020 D5.3 Presence of Europe in HPC-HPDA standardisation Table of Contents Project and Deliverable Information Sheet ......................................................................................... i Document Control Sheet ........................................................................................................................ i Document Status Sheet ......................................................................................................................... ii Document Keywords ............................................................................................................................. ii Table of Contents ................................................................................................................................. iii List of Tables ......................................................................................................................................... iv References and Applicable Documents .............................................................................................. iv List of Acronyms and Abbreviations ................................................................................................... v Executive Summary .............................................................................................................................. 7 1 Introduction ................................................................................................................................... 9 2 Presentation of standard organisations relevant in HPC ........................................................ 10 2.1 Trends in standards for HPC/HPDA ................................................................................................10 2.2 Hardware ............................................................................................................................................11 2.3 Middleware .........................................................................................................................................16 2.4 Language .............................................................................................................................................22 2.5 Software packages ..............................................................................................................................26 3 Standard organisation analysis .................................................................................................. 31 3.1 Weight of European organisations and presence of European experts .........................................31 3.2 Synthesis ..............................................................................................................................................34 4 Interviews ..................................................................................................................................... 36 4.1 Objectives ............................................................................................................................................36 4.2 Execution .............................................................................................................................................36 4.3 Findings ...............................................................................................................................................37 4.4 Other discussions with stakeholders .................................................................................................38 5 Recommendations ....................................................................................................................... 40 5.1 Achieving a more efficient organisation ...........................................................................................40 5.2 Achieving a more active European ecosystem: making Europe a standard leader ......................41 5.3 Conclusion ...........................................................................................................................................43 6 Acknowledgments ........................................................................................................................ 44 7 Annex ............................................................................................................................................ 45 7.1 Annex 1 : Template for standard organisation description ............................................................46 7.2 Annex 2: Examples of standard organisation descriptions .............................................................47 7.3 Annex 3: Interview template .............................................................................................................56 7.4 Annex 4: Examples of interviews ......................................................................................................58 EXDCI-2 - FETHPC-800957 iii 21.02.2020 D5.3 Presence of Europe in HPC-HPDA standardisation List of Tables Table 1: Position of Europe in hardware oriented standard organisations ............................................ 32 Table 2: Position of Europe in HPC software stack oriented standard organisations ........................... 33 Table 3: Position of Europe in HPC language oriented standard organisations .................................... 33 Table 4 Position of Europe in software package oriented standard organisations ................................ 34 Table 5: Coverage of standards by the interviewees ............................................................................. 37 References and Applicable Documents [1] http://www.exdci.eu [2] http://www.prace-project.eu [3] http://www.etp4hpc.eu EXDCI-2 - FETHPC-800957 iv 21.02.2020 D5.3 Presence of Europe in HPC-HPDA standardisation List of Acronyms and Abbreviations Below is a list of acronyms used within the EXDCI-2 project. The acronym specific to this report are explained inside the text where they are used. AISBL Association Internationale Sans But Lucratif (International Non-for-Profit Association) BDEC Big Data and Extreme-scale Computing BDV Big Data Value CoE Centres of Excellence for Computing Applications cPPP contractual Public-Private Partnership CSA Coordination and Support Action D Deliverable DG Directorate General DoW Description of Work EC European Commission ECMWF European Centre for Medium-range Weather Forecasts EESI European Exascale Software Initiative ENES European Network for Earth System modelling EPOS European Plate Observing System EsD Extreme scale Demonstrators EU European Union FET Future and Emerging Technologies FP7 Framework Programme 7 GDP Gross Domestic Product H2020 Horizon 2020 – The EC Research and Innovation Programme in Europe HPC High Performance Computing IDC International Data Corporation IESP International Exascale Software Project INVG Istituto Nazionale di Geofisica e Vulcanologia (National Institute of Geophysics and Volcanology) ISV Independent Software Vendor IT Information Technology KPI Key-Performance Indicator M Month OS Operating System PM Person Month