SEVENTH FRAMEWORK PROGRAMME Research Infrastructures INFRA-2011-2.3.5 – Second Implementation Phase of the European High Performance Computing (HPC) service PRACE PRACE-2IP PRACE Second Implementation Project Grant Agreement Number: RI-283493 D8.1.2 Performance Model of Community Codes Final Version: 1.0 Author(s): Claudio Gheller, Will Sawyer, Thomas Schulthess, CSCS; Fabio Affinito, CINECA; Ivan Girotto, Alastair McKinstry, Filippo Spiga, ICHEC; Laurent Crouzet, CEA; Andy Sunderland, STFC; Giannis Koutsou, Abdou Abdel-Rehim, CASTORC; Fernando Nogueira, Miguel Avillez , UC-LCA; Georg Huhs, José María Cela, and Mohammad Jowkar, BSC. Date: 24.11.2011 D8.1.2 Performance Model of Community Codes Project and Deliverable Information Sheet PRACE Project Project Ref. №: RI-283493 Project Title: PRACE Second Implementation Project Project Web Site: http://www.prace-project.eu Deliverable ID: D8.1.2 Deliverable Nature: Report Deliverable Level: Contractual Date of Delivery: PU 30 / 11 / 2011 Actual Date of Delivery: 30 / 11 / 2011 EC Project Officer: Bernhard Fabianek * - The dissemination level are indicated as follows: PU – Public, PP – Restricted to other participants (including the Commission Services), RE – Restricted to a group specified by the consortium (including the Commission Services). CO – Confidential, only for members of the consortium (including the Commission Services). Document Control Sheet Title: Performance Model of Community Codes Document ID: D8.1.2 Version: 1.0 Status: Final Available at: http://www.prace-project.eu Software Tool: Microsoft Word 2007 File(s): D8.1.2.docx Written by: Claudio Gheller, Will Sawyer Authorship Contributors: Thomas Schulthess, CSCS; Fabio Affinito, CINECA; Ivan Girotto, Alastair McKinstry, Filippo Spiga, ICHEC; Laurent Crouzet, CEA; Andy Sunderland, STFC; Giannis Koutsou, Abdou Abdel-Rehim, CASTORC; Fernando Nogueira, Miguel Avillez , UC-LCA; Georg Huhs), José María Cela, and Mohammad Jowkar, BSC Reviewed by: Aad van der Steen; Dietmar Erwin Approved by: MB/TB PRACE-2IP - RI-283493 i 24.11.2011 D8.1.2 Performance Model of Community Codes Document Status Sheet Version Date Status Comments 0.1 04/10/2011 Draft Document skeleton 0.2 19/10/2011 Draft Draft distributed to task leaders 0.3 24/10/2011 Draft First version of the performance modelling methodology 0.4 25/10/2011 Draft First benchmarks collected 0.6 28/10/2011 Draft Introduction and Section1 improved 0.8 5/11/2011 Draft Most benchmarks collected 0.9 9/11/2011 Draft Extensive proofreading 1.0 30/11/2011 Final version Document Keywords Keywords: PRACE, HPC, Research Infrastructure, scientific applications, libraries, performance modelling. Disclaimer This deliverable has been prepared by Work Package 8 of the Project in accordance with the Consortium Agreement and the Grant Agreement n° RI-283493. It solely reflects the opinion of the parties to such agreements on a collective basis in the context of the Project and to the extent foreseen in such agreements. Please note that even though all participants to the Project are members of PRACE AISBL, this deliverable has not been approved by the Council of PRACE AISBL and therefore does not emanate from it nor should it be considered to reflect PRACE AISBL’s individual opinion. Copyright notices 2011 PRACE Consortium Partners. All rights reserved. This document is a project document of the PRACE project. All contents are reserved by default and may not be disclosed to third parties without the written consent of the PRACE partners, except as mandated by the European Commission contract RI-283493 for reviewing and dissemination purposes. All trademarks and other rights on third party products mentioned in this document are acknowledged as own by the respective holders. PRACE-2IP - RI-283493 ii 24.11.2011 D8.1.2 Performance Model of Community Codes Table of Contents Project and Deliverable Information Sheet ....................................................................................... i Document Control Sheet .................................................................................................................. i Document Status Sheet ................................................................................................................... ii Document Keywords ....................................................................................................................... ii Table of Contents ........................................................................................................................... iii List of Figures ................................................................................................................................. iv List of Tables ................................................................................................................................ viii References and Applicable Documents ........................................................................................... ix List of Acronyms and Abbreviations ............................................................................................... xi Executive Summary ......................................................................................................................... 1 1. Introduction ................................................................................................................................ 2 2. The Performance Analysis Methodology ...................................................................................... 4 2.1 Performance Modelling Example .................................................................................................. 5 3. Performance Analysis of Community Codes: Astrophysics ........................................................... 7 3.1 RAMSES ......................................................................................................................................... 7 3.1.1 Description of the code.................................................................................................................... 7 3.1.2 Performance Analysis ...................................................................................................................... 8 3.2 PKDGRAV ..................................................................................................................................... 13 3.2.1 Description of the code.................................................................................................................. 13 3.2.2 Performance Analysis .................................................................................................................... 13 3.3 PFARM ......................................................................................................................................... 18 3.3.1 Description of the code.................................................................................................................. 18 3.3.2 Performance Analysis .................................................................................................................... 18 4. Performance Analysis of Community Codes: Climate ................................................................. 21 4.1 OASIS ........................................................................................................................................... 21 4.1.1 Description of Code ....................................................................................................................... 21 4.1.2 Performance Analysis .................................................................................................................... 21 4.2 Input/Output ............................................................................................................................... 23 4.2.1 Description of Code: CDI ................................................................................................................ 24 4.2.2 Performance Analysis: CDI ............................................................................................................. 25 4.2.3 Description of Code: XIOS .............................................................................................................. 26 4.2.2 Description of Code: PIO ................................................................................................................ 27 4.2.3 Performance Analysis: PIO ............................................................................................................. 27 4.3.1 Description of Codes ...................................................................................................................... 29 4.3.2 Performance Analysis: EULAG, ICON ............................................................................................. 30 4.4 Ocean Models ............................................................................................................................. 34 4.4.1 Description of Code: NEMO ........................................................................................................... 34 4.4.2 Performance Analysis: NEMO ........................................................................................................ 35 4.4.3 Description of Code: ICOM ............................................................................................................ 39 4.4.4 Performance Analysis: ICOM ......................................................................................................... 39 5.