Prace-3Ip D8.3.4
Total Page:16
File Type:pdf, Size:1020Kb
SEVENTH FRAMEWORK PROGRAMME Research Infrastructures INFRA-2012-2.3.1 – Third Implementation Phase of the European High Performance Computing (HPC) service PRACE PRACE-3IP PRACE Third Implementation Phase Project Grant Agreement Number: RI-312763 D8.3.4 Technical lessons learnt from the implementation of the joint PCP for PRACE-3IP Final Version: 1.5 Author(s): Stephen Booth, EPCC Date: 10.01.2018 D8.3.4 Technical lessons learnt from the implementation of the joint PCP for PRACE-3IP Project and Deliverable Information Sheet PRACE Project Project Ref. №: RI-312763 Project Title: PRACE Third Implementation Phase Project Project Web Site: http://www.prace-project.eu Deliverable ID: D8.3.4 Deliverable Nature: <Report> Deliverable Level: Contractual Date of Delivery: PU 31 / 12 / 2017 Actual Date of Delivery: 15 / 01 / 2018 EC Project Officer: Leonardo Flores Añover * - The dissemination level are indicated as follows: PU – Public, PP – Restricted to other participants (including the Commission Services), RE – Restricted to a group specified by the consortium (including the Commission Services). CO – Confidential, only for members of the consortium (including the Commission Services). Document Control Sheet Title: Technical lessons learnt from the implementation of the joint Document PCP for PRACE-3IP ID: D8.3.4 Version: 1.5 Status: Final Available at: http://www.prace-project.eu Software Tool: Microsoft Word 2010 File(s): D8.3.4.docx Written by: Stephen Booth, EPCC Authorship Contributors: Fabio Affinito, CINECA Eric Boyer, GENCI Carlo Cavazzoni, CINECA Pekka Manninen, CSC Dirk Pleiter, JUELICH Philippe Segers, GENCI Reviewed by: Stéphane Requena, GENCI Florian Berberich, JUELICH Approved by: MB/TB Document Status Sheet Version Date Status Comments 0.1 19/10/2017 Draft Initial outline 0.2 20/10/2017 Draft 0.3 27/10/2017 Draft PCP section 0.4 10/11/2017 Draft General lessons 0.5 28/11/2017 Draft Technical background 0.6 11/12/2017 Draft E4 sections PRACE-3IP - RI-312763 i 10.01.2018 D8.3.4 Technical lessons learnt from the implementation of the joint PCP for PRACE-3IP 0.7 11/12/2017 Draft ATOS-BULL sections 0.8 12/12/2017 Draft User experiences 0.9 14/12/2017 Draft Formatting 1.0 14/12/2017 Draft User experience section 1.1 16/12/2017 Draft Commits & corrections 1.2 22/12/2017 Draft Editorial updates 1.3 09/01/2017 Pre-Final Updates based on internal review reports 1.4 10/01/2017 Pre-Final Error in Table 19 fixed 1.5 10/01/2018 Last corrections Document Keywords Keywords: PRACE, HPC, Research Infrastructure, Joint Pre Commercial Procurement, Energy Efficiency Disclaimer This deliverable has been prepared by the responsible Work Package of the Project in accordance with the Consortium Agreement and the Grant Agreement n° RI-312763. It solely reflects the opinion of the parties to such agreements on a collective basis in the context of the Project and to the extent foreseen in such agreements. Please note that even though all participants to the Project are members of PRACE AISBL, this deliverable has not been approved by the Council of PRACE AISBL and therefore does not emanate from it nor should it be considered to reflect PRACE AISBL’s individual opinion. Copyright notices 2018 PRACE Consortium Partners. All rights reserved. This document is a project document of the PRACE project. All contents are reserved by default and may not be disclosed to third parties without the written consent of the PRACE partners, except as mandated by the European Commission contract RI-312763 for reviewing and dissemination purposes. All trademarks and other rights on third party products mentioned in this document are acknowledged as own by the respective holders. PRACE-3IP - RI-312763 ii 10.01.2018 D8.3.4 Technical lessons learnt from the implementation of the joint PCP for PRACE-3IP Table of Contents Project and Deliverable Information Sheet ......................................................................................... i Document Control Sheet ........................................................................................................................ i Document Status Sheet .......................................................................................................................... i Document Keywords ............................................................................................................................. ii Table of Contents ................................................................................................................................. iii List of Figures ........................................................................................................................................ v List of Tables .......................................................................................................................................... v References and Applicable Documents .............................................................................................. vi List of Acronyms and Abbreviations ................................................................................................. vii Executive Summary ............................................................................................................................ 12 1 Introduction ........................................................................................................................................13 2 Overview of the PRACE PCP ............................................................................................................13 3 Technical Background .......................................................................................................................14 4 Lessons learned from the Atos-Bull KNL pilot system ............................................................ 17 4.1 Description of the system ...................................................................................................................17 4.1.1 System description ..............................................................................................................................17 4.1.2 Software environment ........................................................................................................................18 4.1.3 Energy efficiency aspects of the design .............................................................................................19 Technology related ....................................................................................................... 19 Infrastructure for Energy monitoring and optimization ............................................... 22 4.2 Suitability for general purpose HPC.................................................................................................28 4.2.1 Ease of code development and porting .............................................................................................28 4.2.2 Energy monitoring/prediction ...........................................................................................................29 4.2.3 System usability .......................................................................................................................... 29 4.3 Impact on energy efficiency ...............................................................................................................29 4.3.1 Final results for HPL..........................................................................................................................30 4.3.2 Final results for NEMO .....................................................................................................................31 4.3.3 Final results for SPECFEM3D ..........................................................................................................32 Small test case .............................................................................................................. 32 Large test case .............................................................................................................. 34 4.3.4 Final results for BQCD ......................................................................................................................34 4.3.5 Final results for Quantum Espresso .................................................................................................35 4.4 Schedule and timing ...........................................................................................................................39 4.5 Impact on Atos-Bull roadmap ...........................................................................................................40 4.6 Summary of lessons learned from the Atos-Bull KNL pilot system ...............................................40 5 Lessons learned from the Maxeler data-flow pilot system ...................................................... 41 5.1 Description of the Maxeler data-flow pilot system ..........................................................................41 5.1.1 System description ..............................................................................................................................41 5.1.2 Software environment ........................................................................................................................43 5.1.3 Energy efficiency aspects of the design .............................................................................................43 5.2 Suitability for general purpose HPC.................................................................................................44