DOCSLIB.ORG

Piz Daint”, One of the Most Powerful Supercomputers

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Piz Daint”, One of the Most Powerful Supercomputers The Swiss High-Performance Computing and Networking Thomas C. Schulthess | T. Schulthess !1 What is considered success in HPC? | T. Schulthess !2 High-Performance Computing Initiative (HPCN) in Switzerland High-risk & high-impact projects (www.hp2c.ch) Application driven co-design Phase III of pre-exascale supercomputing ecosystem Three pronged approach of the HPCN Initiative 2017 1. New, flexible, and efficient building 2. Efficient supercomputers 2016 Monte Rosa 3. Efficient applications Pascal based hybrid Cray XT5 2015 14’762 cores Upgrade to Phase II Cray XE6 K20X based hybrid 2014 Upgrade 47,200 cores Hex-core upgrade Phase I 22’128 cores 2013 Development & Aries network & multi-core procurement of 2012 petaflop/s scale supercomputer(s) 2011 2010 New 2009 building Begin construction complete of new building | T. Schulthess !3 FACT SHEET “Piz Daint”, one of the most powerful supercomputers A hardware upgrade in the final quarter of 2016 Thanks to the new hardware, researchers can run their simula- saw “Piz Daint”, Europe’s most powerful super- tions more realistically and more efficiently. In the future, big computer, more than triple its computing perfor- science experiments such as the Large Hadron Collider at CERN mance. ETH Zurich invested around CHF 40 million will also see their data analysis support provided by “Piz Daint”. in the upgrade, so that simulations, data analysis and visualisation can be performed more effi- ETH Zurich has invested CHF 40 million in the upgrade of “Piz ciently than ever before. Daint” – from a Cray XC30 to a Cray XC40/XC50. The upgrade in- volved replacing two types of compute nodes as well as the in- With a peak performance of seven petaflops, “Piz Daint” has tegration of a novel technology from Cray known as DataWarp. been Europe’s fastest supercomputer since its debut in Novem- DataWarp’s “burst buffer mode” quadruples the effective ber 2013. And it is set to remain number one for now thanks to bandwidth to and from storage devices, markedly accelerating a hardware upgrade in late 2016, which boosted its peak per- data input and output rates and so facilitating the analysis of formance to more than 25 petaflops. This increase in perfor- millions of small, unstructured files. Thus, “Piz Daint” is able to mance is vital for enabling the higher-resolution, compute- and analyse the results of its computations even while they are still data-intensive simulations used in modern materials science, in progress. The revamped “Piz Daint” remains an extremely physics, geophysics, life sciences and climate science. Data energy-efficient and balanced system where simulations and science too, an area where ETH Zurich is establishing strategic data analyses are scalable from a few to thousands of compute research strength, calls for high-power computing facilities. nodes. These fields involve the processing of vast amounts of data. The new system is now well equipped to provide an infrastruc- ture that will accommodate the increasing demands in high performance computing (HPC) up until the end of the decade. “Piz Daint” 2017 fact sheet ~5’000 NVIDIA P100 GPU accelerated nodes Piz~1’400 Daint Dual specifications multi-core socket nodes Model Cray XC40/Cray XC50 Number of Hybrid Compute Nodes 5 320 Number of Multicore Compute Nodes 1 431 Theoretical Peak Floataing-point Performance per Hybrid Node 4.761 Teraflops Intel Xeon E5-2690 v3/Nvidia Tesla P100 Theoretical Peak Floating-point Performance per Multicore Node 1.210 Teraflops Intel Xeon E5-2695 v4 Theoretical Hybrid Peak Performance 25.326 Petaflops Theoretical Muliticore Peak Performance 1.731 Petaflops Hybrid Memory Capacity per Node 64 GB; 16 GB CoWoS HBM2 Multicore Memory Capacity per Node 64 GB, 128 GB Total System Memory 437.9 TB; 83.1 TB System Interconnect Cray Aries routing and communications ASIC, and Dragonfly network topology Sonexion 3000 Storage Capacity 6.2 PB Sonexion 3000 Parallel File System Theoretical Peak Performance 112 GB/s Sonexion 1600 Storage Capacity 2.5 PB Sonexion 1600 Parallel File System Theoretcal Peak Performance 138 GB/s http://www.cscs.ch/publications/fact_sheets/index.html | T. Schulthess !4 Via Trevano 131 T +41 91 610 82 11 © CSCS 2017 6900 Lugano F +41 91 610 82 82 Switzerland www.cscs.ch First production level GPU deployment in 2013 • 2009: Call for application development projects • 2010: Start 11 high-risk, high-impact development projects (incl. COSMO) • Nov. 2011: decision to engage in study with Cray (X86 vs. XeonPhi vs. GPU) Model• GPU Cray areXC40/C NOTray XC50 plan of record for Cray XC systems Number of Hybrid Compute Nodes 5 320 • Jan.Number 2012: of Multicore study Compute of 9 applicationsNodes show GPU are1 431 a viable option Theoretical• GPU bladePeak Floataing-point design begins Performance but per XeonPhi Hybrid Node (KNC) 4.761 has Te rhigheraflops Intel priority Xeon E5-2690 v3/Nvidia Tesla P100 Theoretical Peak Floating-point Performance per Multicore Node 1.210 Teraflops Intel Xeon E5-2695 v4 • Jul.Theoretical 2012: Hybrid difficulties Peak Performance in getting applications to25.326 perform Petaflops on KNC • Sep.-Oct.Theoretical Muliticore 2012: Peakdemonstrate Performance KNC can’t work (deficient1.731 Petaflops memory subsystem) Hybrid Memory Capacity per Node 64 GB; 16 GB CoWoS HBM2 • Nov.Multicore 2012: Memo Crayry Capacity switches per Node priorities, putting GPU64 GB, ahead 128 GB of XeonPhi • Nov.Total System 2012: Memo firstry deployment of Piz Daint (CPU)437.9 TB; 83.1 TB System Interconnect Cray Aries routing and communications ASIC, and Dragonfly • Nov. 2013: full scale out of Pix Daint with Keplernetwork (K20X) topology GPU Sonexion 3000 Storage Capacity 6.2 PB • Feb. 2014 – Apr. 2015: analysis, design, negotiations of upgrade Sonexion 3000 Parallel File System Theoretical Peak Performance 112 GB/s • Nov.Sonexion 2016: 1600 Stoupgraderage Capacity to Pascal GPU 2.5 PB Sonexion 1600 Parallel File System Theoretcal Peak Performance 138 GB/s • Apr. 2017: fully integrated platform for compute (GPU & CPU) and data service http://www.cscs.ch/publications/fact_sheets/index.html | T. Schulthess !5 FACT SHEET “Piz Daint”, one of the most powerful supercomputers A hardware upgrade in the final quarter of 2016 Thanks to the new hardware, researchers can run their simula- saw “Piz Daint”, Europe’s most powerful super- tions more realistically and more efficiently. In the future, big computer, more than triple its computing perfor- science experiments such as the Large Hadron Collider at CERN mance. ETH Zurich invested around CHF 40 million will also see their data analysis support provided by “Piz Daint”. in the upgrade, so that simulations, data analysis and visualisation can be performed more effi- ETH Zurich has invested CHF 40 million in the upgrade of “Piz ciently than ever before. Daint” – from a Cray XC30 to a Cray XC40/XC50. The upgrade in- volved replacing two types of compute nodes as well as the in- With a peak performance of seven petaflops, “Piz Daint” has tegration of a novel technology from Cray known as DataWarp. been Europe’s fastest supercomputer since its debut in Novem- DataWarp’s “burst buffer mode” quadruples the effective ber 2013. And it is set to remain number one for now thanks to bandwidth to and from storage devices, markedly accelerating a hardware upgrade in late 2016, which boosted its peak per- data input and output rates and so facilitating the analysis of formance to more than 25 petaflops. This increase in perfor- millions of small, unstructured files. Thus, “Piz Daint” is able to mance is vital for enabling the higher-resolution, compute- and analyse the results of its computations even while they are still data-intensive simulations used in modern materials science, in progress. The revamped “Piz Daint” remains an extremely physics, geophysics, life sciences and climate science. Data energy-efficient and balanced system where simulations and science too, an area where ETH Zurich is establishing strategic data analyses are scalable from a few to thousands of compute research strength, calls for high-power computing facilities. nodes. These fields involve the processing of vast amounts of data. The new system is now well equipped to provide an infrastruc- ture that will accommodate the increasing demands in high performance computing (HPC) up until the end of the decade. “Piz Daint” 2017 fact sheet Piz Daint specifications Model Cray XC40/Cray XC50 Number of Hybrid Compute Nodes 5 320 Number of Multicore Compute Nodes 1 431 Theoretical Peak Floataing-point Performance per Hybrid Node 4.761 Teraflops Intel Xeon E5-2690 v3/Nvidia Tesla P100 Theoretical Peak Floating-point Performance perInstitutions Multicore Node using 1.210 Piz DaintTeraflops Intel Xeon E5-2695 v4 Theoretical Hybrid Peak Performance 25.326 Petaflops • User Lab (including PRACE Tier-0 allocations) Theoretical Muliticore Peak Performance 1.731 Petaflops Hybrid Memory Capacity per Node• University of Zurich, USI, PSI,64 GB; EMPA 16 GB CoWoS HBM2 Multicore Memory Capacity per Node 64 GB, 128 GB • Total System Memory MaterialsCloud and HBP Collaboratory437.9 TB; 83.1 TB (EPFL) System Interconnect • CHIPP (sine Aug. 2017) Cray Aries routing and communications ASIC, and Dragonfly network topology Sonexion 3000 Storage Capacity• Others, e.g. Swiss Data Science6.2 PB Center Sonexion 3000 Parallel File System(exploratory) Theoretical Peak Performance 112 GB/s Sonexion 1600 Storage Capacity 2.5 PB Sonexion 1600 Parallel File System Theoretcal Peak Performance 138 GB/s http://www.cscs.ch/publications/fact_sheets/index.html | T. Schulthess !6 Via Trevano 131 T +41 91 610 82 11 © CSCS 2017 6900 Lugano F +41 91 610 82 82 Switzerland www.cscs.ch | T. Schulthess !7 Higher resolution is necessary for quantitative agreement wth experiment (18 days for July 9-27, 2006) Altdorf (Reuss valley) Lodrino (Leventina) COSMO-2 COSMO-1 source: Oliver Fuhrer, MeteoSwiss | T.
Load more

Recommended publications
  • An Operational Perspective on a Hybrid and Heterogeneous Cray XC50 System
    An Operational Perspective on a Hybrid and Heterogeneous Cray XC50 System Sadaf Alam, Nicola Bianchi, Nicholas Cardo, Matteo Chesi, Miguel Gila, Stefano Gorini, Mark Klein, Colin McMurtrie, Marco Passerini, Carmelo Ponti, Fabio Verzelloni CSCS – Swiss National Supercomputing Centre Lugano, Switzerland Email: {sadaf.alam, nicola.bianchi, nicholas.cardo, matteo.chesi, miguel.gila, stefano.gorini, mark.klein, colin.mcmurtrie, marco.passerini, carmelo.ponti, fabio.verzelloni}@cscs.ch Abstract—The Swiss National Supercomputing Centre added depth provides the necessary space for full-sized PCI- (CSCS) upgraded its flagship system called Piz Daint in Q4 e daughter cards to be used in the compute nodes. The use 2016 in order to support a wider range of services. The of a standard PCI-e interface was done to provide additional upgraded system is a heterogeneous Cray XC50 and XC40 system with Nvidia GPU accelerated (Pascal) devices as well as choice and allow the systems to evolve over time[1]. multi-core nodes with diverse memory configurations. Despite Figure 1 clearly shows the visible increase in length of the state-of-the-art hardware and the design complexity, the 37cm between an XC40 compute module (front) and an system was built in a matter of weeks and was returned to XC50 compute module (rear). fully operational service for CSCS user communities in less than two months, while at the same time providing significant improvements in energy efficiency. This paper focuses on the innovative features of the Piz Daint system that not only resulted in an adaptive, scalable and stable platform but also offers a very high level of operational robustness for a complex ecosystem.
    [Show full text]
  • A Scheduling Policy to Improve 10% of Communication Time in Parallel FFT
    A scheduling policy to improve 10% of communication time in parallel FFT Samar A. Aseeri Anando Gopal Chatterjee Mahendra K. Verma David E. Keyes ECRC, KAUST CC, IIT Kanpur Dept. of Physics, IIT Kanpur ECRC, KAUST Thuwal, Saudi Arabia Kanpur, India Kanpur, India Thuwal, Saudi Arabia [email protected] [email protected] [email protected] [email protected] Abstract—The fast Fourier transform (FFT) has applications A. FFT Algorithm in almost every frequency related studies, e.g. in image and signal Forward Fourier transform is given by the following equa- processing, and radio astronomy. It is also used to solve partial differential equations used in fluid flows, density functional tion. 3 theory, many-body theory, and others. Three-dimensional N X (−ikxx) (−iky y) (−ikz z) 3 f^(k) = f(x; y; z)e e e (1) FFT has large time complexity O(N log2 N). Hence, parallel algorithms are made to compute such FFTs. Popular libraries kx;ky ;kz 3 perform slab division or pencil decomposition of N data. None The beauty of this sum is that k ; k ; and k can be summed of the existing libraries have achieved perfect inverse scaling x y z of time with (T −1 ≈ n) cores because FFT requires all-to-all independent of each other. These sums are done at different communication and clusters hitherto do not have physical all- to-all connections. With advances in switches and topologies, we now have Dragonfly topology, which physically connects various units in an all-to-all fashion.
    [Show full text]
  • View Annual Report
    Fellow Shareholders, Headlined by strong growth in revenue and profitability, we had one of our best years ever in 2015, executing across each of our major focus areas and positioning our company for continued growth into the future. We achieved another year of record revenue, growing by nearly 30 percent compared to 2014. In fact, our revenue in 2015 was more than three times higher than just four years prior — driven by growth in both our addressable market and market share. Over the last five years, we have transformed from a company solely focused on the high-end of the supercomputing market — where we are now the clear market leader — to a company with multiple product lines serving multiple markets. We provide our customers with powerful computing, storage and analytics solutions that give them the tools to advance their businesses in ways never before possible. During 2015, we installed supercomputing and storage solutions at a number of customers around the world. In the U.S., we completed the first phase of the massive new “Trinity” system at Los Alamos National Laboratory. This Cray XC40 supercomputer with Sonexion storage serves as the National Nuclear Security Administration’s flagship supercomputer, supporting all three of the NNSA’s national laboratories. We installed the first petaflop supercomputer in India at the Indian Institute of Science. In Europe, we installed numerous XC and storage solutions, including a significant expansion of the existing XC40 supercomputer at the University of Stuttgart in Germany. This new system nearly doubles their computing capacity and is currently the fastest supercomputer in Germany.
    [Show full text]
  • This Is Your Presentation Title
    Introduction to GPU/Parallel Computing Ioannis E. Venetis University of Patras 1 Introduction to GPU/Parallel Computing www.prace-ri.eu Introduction to High Performance Systems 2 Introduction to GPU/Parallel Computing www.prace-ri.eu Wait, what? Aren’t we here to talk about GPUs? And how to program them with CUDA? Yes, but we need to understand their place and their purpose in modern High Performance Systems This will make it clear when it is beneficial to use them 3 Introduction to GPU/Parallel Computing www.prace-ri.eu Top 500 (June 2017) CPU Accel. Rmax Rpeak Power Rank Site System Cores Cores (TFlop/s) (TFlop/s) (kW) National Sunway TaihuLight - Sunway MPP, Supercomputing Center Sunway SW26010 260C 1.45GHz, 1 10.649.600 - 93.014,6 125.435,9 15.371 in Wuxi Sunway China NRCPC National Super Tianhe-2 (MilkyWay-2) - TH-IVB-FEP Computer Center in Cluster, Intel Xeon E5-2692 12C 2 Guangzhou 2.200GHz, TH Express-2, Intel Xeon 3.120.000 2.736.000 33.862,7 54.902,4 17.808 China Phi 31S1P NUDT Swiss National Piz Daint - Cray XC50, Xeon E5- Supercomputing Centre 2690v3 12C 2.6GHz, Aries interconnect 3 361.760 297.920 19.590,0 25.326,3 2.272 (CSCS) , NVIDIA Tesla P100 Cray Inc. DOE/SC/Oak Ridge Titan - Cray XK7 , Opteron 6274 16C National Laboratory 2.200GHz, Cray Gemini interconnect, 4 560.640 261.632 17.590,0 27.112,5 8.209 United States NVIDIA K20x Cray Inc. DOE/NNSA/LLNL Sequoia - BlueGene/Q, Power BQC 5 United States 16C 1.60 GHz, Custom 1.572.864 - 17.173,2 20.132,7 7.890 4 Introduction to GPU/ParallelIBM Computing www.prace-ri.eu How do
    [Show full text]
  • TECHNICAL GUIDELINES for APPLICANTS to PRACE 17Th CALL
    TECHNICAL GUIDELINES FOR APPLICANTS TO PRACE 17th CALL (T ier-0) The contributing sites and the corresponding computer systems for this call are: System Architecture Site (Country) Core Hours Minimum (node hours) request Joliot Curie - Bull Sequana X1000 GENCI@CEA 134 million 15 million core SKL (FR) (2.8 million) hours Joliot Curie - BULL Sequana GENCI@CEA 72 million 15 million core KNL X1000 (FR) (1,1 million) hours Hazel Hen Cray XC40 System GCS@HLRS 70 million 35 million core (DE) (2.9 million) hours JUWELS Multicore cluster GCS@JSC (DE) 70 million 35 million core (1.5 million) hours Marconi- Lenovo System CINECA (IT) 36 million 15 million core Broadwell (1 million) hours Marconi-KNL Lenovo System CINECA (IT) 612 million 30 million core (9 million) hours MareNostrum Lenovo System BSC (ES) 240 million 15 million core (5 million) hours Piz Daint Cray XC50 System CSCS (CH) 510 million 68 million core (7.5 million) hours Use of GPUs SuperMUC Lenovo NextScale/ GCS@LRZ (DE) 105 million 35 million core SuperMUC-NG Lenovo ThinkSystem (3.8 million) hours The site selection is done together with the specification of the requested computing time by the two sections at the beginning of the online form. The applicant can choose one or several machines as execution system, as long as proper benchmarks and resource request justification are provided on each of the requested systems. The parameters are listed in tables. The first column describes the field in the web online form to be filled in by the applicant. The remaining columns specify the range limits for each system.
    [Show full text]
  • Cray XC40 Power Monitoring and Control for Knights Landing
    Cray XC40 Power Monitoring and Control for Knights Landing Steven J. Martin, David Rush Matthew Kappel, Michael Sandstedt, Joshua Williams Cray Inc. Cray Inc. Chippewa Falls, WI USA St. Paul, MN USA {stevem,rushd}@cray.com {mkappel,msandste,jw}@cray.com Abstract—This paper details the Cray XC40 power monitor- This paper is organized as follows: In section II, we ing and control capabilities for Intel Knights Landing (KNL) detail blade-level Hardware Supervisory System (HSS) ar- based systems. The Cray XC40 hardware blade design for Intel chitecture changes introduced to enable improved telemetry KNL processors is the first in the XC family to incorporate enhancements directly related to power monitoring feedback gathering capabilities on Cray XC40 blades with Intel KNL driven by customers and the HPC community. This paper fo- processors. Section III provides information on updates to cuses on power monitoring and control directly related to Cray interfaces available for power monitoring and control that blades with Intel KNL processors and the interfaces available are new for Cray XC40 systems and the software released to users, system administrators, and workload managers to to support blades with Intel KNL processors. Section IV access power management features. shows monitoring and control examples. Keywords-Power monitoring; power capping; RAPL; energy efficiency; power measurement; Cray XC40; Intel Knights II. ENHANCED HSS BLADE-LEVEL MONITORING Landing The XC40 KNL blade incorporates a number of en- hancements over previous XC blade types that enable the I. INTRODUCTION collection of power telemetry in greater detail and with Cray has provided advanced power monitoring and control improved accuracy.
    [Show full text]
  • Hpc in Europe
    HPC IN EUROPE Organisation of public HPC resources Context • Focus on publicly-funded HPC resources provided primarily to enable scientific research and development at European universities and other publicly-funded research institutes • These resources are also intended to benefit industrial / commercial users by: • facilitating access to HPC • providing HPC training • sponsoring academic-industrial collaborative projects to exchange expertise and accelerate efficient commercial exploitation of HPC • Do not consider private sector HPC resources owned and managed internally by companies, e.g. in aerospace design & manufacturing, oil & gas exploration, fintech (financial technology), etc. European HPC Infrastructure • Structured provision of European HPC facilities: • Tier-0: European Centres (> petaflop machines) • Tier-1: National Centres • Tier-2: Regional/University Centres • Tiers planned as part of an EU Research Infrastructure Roadmap • This is coordinated through “PRACE” – http://prace-ri.eu PRACE Partnership foR Advanced Computing in Europe • International non-profit association (HQ office in Brussels) • Established in 2010 following ESFRI* roadmap to create a persistent pan-European Research Infrastructure (RI) of world-class supercomputers • Mission: enable high-impact scientific discovery and engineering research and development across all disciplines to enhance European competitiveness for the benefit of society. *European Strategy Forum on Reseach Infrastructures PRACE Partnership foR Advanced Computing in Europe Aims: • Provide access to leading-edge computing and data management resources and services for large-scale scientific and engineering applications at the highest performance level • Provide pan-European HPC education and training • Strengthen the European users of HPC in industry A Brief History of PRACE PRACE Phases & Objectives • Preparation and implementation of the PRACE RI was supported by a series of projects funded by the EU’s FP7 and Horizon 2020 funding programmes • 530 M€ of funding for the period 2010-2015.
    [Show full text]
  • A Performance Analysis of the First Generation of HPC-Optimized Arm Processors
    McIntosh-Smith, S., Price, J., Deakin, T., & Poenaru, A. (2019). A performance analysis of the first generation of HPC-optimized Arm processors. Concurrency and Computation: Practice and Experience, 31(16), [e5110]. https://doi.org/10.1002/cpe.5110 Publisher's PDF, also known as Version of record License (if available): CC BY Link to published version (if available): 10.1002/cpe.5110 Link to publication record in Explore Bristol Research PDF-document This is the final published version of the article (version of record). It first appeared online via Wiley at https://doi.org/10.1002/cpe.5110 . Please refer to any applicable terms of use of the publisher. University of Bristol - Explore Bristol Research General rights This document is made available in accordance with publisher policies. Please cite only the published version using the reference above. Full terms of use are available: http://www.bristol.ac.uk/red/research-policy/pure/user-guides/ebr-terms/ Received: 18 June 2018 Revised: 27 November 2018 Accepted: 27 November 2018 DOI: 10.1002/cpe.5110 SPECIAL ISSUE PAPER A performance analysis of the first generation of HPC-optimized Arm processors Simon McIntosh-Smith James Price Tom Deakin Andrei Poenaru High Performance Computing Research Group, Department of Computer Science, Summary University of Bristol, Bristol, UK In this paper, we present performance results from Isambard, the first production supercomputer Correspondence to be based on Arm CPUs that have been optimized specifically for HPC. Isambard is the first Simon McIntosh-Smith, High Performance Cray XC50 ‘‘Scout’’ system, combining Cavium ThunderX2 Arm-based CPUs with Cray's Aries Computing Research Group, Department of interconnect.
    [Show full text]
  • Industry Insights | HPC and the Future of Seismic
    INDUSTRY INSIGHTS August 20 By Andrew Long ([email protected]) 1 of 4 HPC and the Future of Seismic I briefly profile the world’s largest commercial computer installations, and consider their relevance for the future of high-end seismic imaging and AI pursuits by the oil and gas industry. Introduction When I began my career in seismic geophysics over 20 years ago we were regularly told that seismic processing and imaging was one of the largest users of computing, and indeed, it took developments in computing capability to mature much further before applications such as Full Waveform Inversion (FWI) and Least-Squares Migration (LSM) became commercially commonplace in the last 5-10 years. Although the oil and gas industry still has several representatives in the top-100 ranked supercomputers (discussed below), applications now more commonly include modeling and simulations essential for nuclear security, weather and climate forecasting, computational fluid dynamics, financial forecasting and risk management, drug discovery and biochemical modeling, clean energy development, exploring the fundamental laws of the universe, and so on. The dramatic growth in High Performance Computing (HPC) services in the cloud (HPCaaS: HPC-as-a-Service) in recent years has in principle made HPC accessible ‘on demand’ to anyone with an appropriate budget, and key selling points are generally the scalable and flexible capabilities, combined with a variety of vendor-specific Software-as-a-Service (SaaS), Platform-as-a-Service (PaaS), and Infrastucture-as-a-Service (IaaS) offerings. This new vocabulary can be confronting, and due to the complexity of cloud-based solutions, I only focus here on the standalone supercomputer infrastructures.
    [Show full text]
  • Cray Xc-50 at Cscs Swiss National Supercomputing Centre
    ▸ Motivation and challenges ▸ Architecture ▸ Production performance ▸ Assessment and outlook PRODUCTION EXPERIENCE AND PERFORMANCE FOR ATLAS DATA PROCESSING ON A CRAY XC-50 AT CSCS SWISS NATIONAL SUPERCOMPUTING CENTRE Gianfranco Sciacca AEC - Laboratory for High Energy Physics, University of Bern, Switzerland CHEP Conference 2018 - 9-13 July 2018, Sofia, Bulgaria MOTIVATION AND CHALLENGES ATLAS DATA PROCESSING ON PIZ DAINT AT CSCS !2 WLCG computing on HPC systems ▸ The HENP computing community will face several challenges with respect to the computing requirements for the next decade and beyond ▸ For the LHC community, requirements for the High-Luminosity LHC runs (2025-2034) are expected to be a factor of ~50 higher than today ▸ Available budgets are expected to be flat at best ▸ Novel computing models making a more dynamic use of heterogeneous resources (supercomputers and clouds) need to be evaluated in order to address such challenges ▸ HPC machines are increasingly powerful, could play a crucial role in delivering more computing for the same price ▸ One of the biggest challenges is the transparent integration with the complex experiment data processing frameworks Gianfranco Sciacca - AEC / LHEP Universität Bern • CHEP 2018, 9-13 July 2018, Sofia, Bulgaria MOTIVATION AND CHALLENGES ATLAS DATA PROCESSING ON PIZ DAINT AT CSCS !3 WLCG computing on HPC systems ▸ HPC is awesome ▸ Piz Daint Cray XC50 / XC40 @ CSCS - ‘cpu/gpu hybrid’ (5320 nodes) and ‘multicore’ (1431 nodes), 361,760 cores - NVIDIA Tesla P100, Xeon E5-2690v3 2.6 GHz, 521 TB
    [Show full text]
  • Introduction to Parallel Programming for Multicore/Manycore Clusters
    Introduction to Parallel Programming for Multicore/Manycore Clusters Introduction Kengo Nakajima Information Technology Center The University of Tokyo http://nkl.cc.u-tokyo.ac.jp/18s/ 2 Descriptions of the Class • Technical & Scientific Computing I (4820-1027) – 科学技術計算Ⅰ – Department of Mathematical Informatics • Special Lecture on Computational Science I(4810-1215) – 計算科学アライアンス特別講義Ⅰ – Department of Computer Science • Multithreaded Parallel Computing (3747-110) (from 2016) – スレッド並列コンピューティング – Department of Electrical Engineering & Information Systems • This class is certificated as the category “F" lecture of "the Computational Alliance, the University of Tokyo" • 2009-2014 3 – Introduction to FEM Programming • FEM: Finite-Element Method ：有限要素法 – Summer (I) : FEM Programming for Solid Mechanics – Winter (II): Parallel FEM using MPI • The 1 st part (summer) is essential for the 2 nd part (winter) • Problems – Many new (international) students in Winter, who did not take the 1st part in Summer – They are generally more diligent than Japanese students • 2015 – Summer (I) : Multicore programming by OpenMP – Winter (II): FEM + Parallel FEM by MPI/OpenMP for Heat Transfer • Part I & II are independent (maybe...) • 2017 – Lectures are given in English – Reedbush-U Supercomputer System Intro 4 Motivation for Parallel Computing (and this class) • Large-scale parallel computer enables fast computing in large-scale scientific simulations with detailed models. Computational science develops new frontiers of science and engineering. • Why parallel computing ? – faster & larger – “larger” is more important from the view point of “new frontiers of science & engineering”, but “faster” is also important. – + more complicated – Ideal: Scalable • Solving N x scale problem using N x computational resources during same computation time (weak scaling) • Solving a fix-sized problem using N x computational resources in 1/N computation time (strong scaling) Intro 5 Scientific Computing = SMASH Science • You have to learn many things.
    [Show full text]
  • Accelerating Science with the NERSC Burst Buffer Early User Program
    Accelerating Science with the NERSC Burst Buffer Early User Program Wahid Bhimji∗, Debbie Bard∗, Melissa Romanus∗y, David Paul∗, Andrey Ovsyannikov∗, Brian Friesen∗, Matt Bryson∗, Joaquin Correa∗, Glenn K. Lockwood∗, Vakho Tsulaia∗, Suren Byna∗, Steve Farrell∗, Doga Gursoyz, Chris Daley∗, Vince Beckner∗, Brian Van Straalen∗, David Trebotich∗, Craig Tull∗, Gunther Weber∗, Nicholas J. Wright∗, Katie Antypas∗, Prabhat∗ ∗ Lawrence Berkeley National Laboratory, Berkeley, CA 94720 USA, Email: [email protected] y Rutgers Discovery Informatics Institute, Rutgers University, Piscataway, NJ, USA zAdvanced Photon Source, Argonne National Laboratory, 9700 South Cass Avenue, Lemont, IL 60439, USA Abstract—NVRAM-based Burst Buffers are an important part their workflow, initial results and performance measurements. of the emerging HPC storage landscape. The National Energy We conclude with several important lessons learned from this Research Scientific Computing Center (NERSC) at Lawrence first application of Burst Buffers at scale for HPC. Berkeley National Laboratory recently installed one of the first Burst Buffer systems as part of its new Cori supercomputer, collaborating with Cray on the development of the DataWarp A. The I/O Hierarchy software. NERSC has a diverse user base comprised of over 6500 users in 700 different projects spanning a wide variety Recent hardware advancements in HPC systems have en- of scientific computing applications. The use-cases of the Burst abled scientific simulations and experimental workflows to Buffer at NERSC are therefore also considerable and diverse. We tackle larger problems than ever before. The increase in scale describe here performance measurements and lessons learned and complexity of the applications and scientific instruments from the Burst Buffer Early User Program at NERSC, which selected a number of research projects to gain early access to the has led to corresponding increase in data exchange, interaction, Burst Buffer and exercise its capability to enable new scientific and communication.
    [Show full text]