DOCSLIB.ORG

Performance Evaluation of a Vector Supercomputer SX-Aurora TSUBASA

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Performance Evaluation of a Vector Supercomputer SX-Aurora TSUBASA Performance Evaluation of a Vector Supercomputer SX-Aurora TSUBASA Kazuhiko Komatsu, S. Momose, Y. Isobe, O. Watanabe, A. Musa, M. Yokokawa, T. Aoyama, M. Sato, H. Kobayashi Tohoku University 14 November, 2018 SC18 Outline • Background • Overview of SX-Aurora TSUBASA • Performance evaluation • Benchmark performance • Application performance • Conclusions 14 November, 2018 SC18 2 Background • Supercomputers become important infrastructures • Widely used for scien8fic researches as well as various industries • Top1 Summit system reaches 143.5 Pflop/s • Big gap between theore8cal performance and sustained performance ◎ Compute-intensive applica8ons stand to benefit from high peak performance ✖Memory-intensive applica8ons are limited by lower memory performance Memory performance has gained more and more attentions 14 November, 2018 SC18 3 A new vector supercomputer SX-Aurora TSUBASA • Two important concepts of its design • High usability • High sustained performance • New memory integration technology • Realize the world’s highest memory bandwidth • New architecture • Vector host (VH) is attached to vector engines (VEs) • VE is responsible for executing an entire application • VH is used for processing system calls invoked by the applications VH VEVE 14 November, 2018 SC18 5 X86 Linux Vector processor New execution model • Conven1onal model • New execution model Host GPU VH VE Start Exe module load Start processing processing Transparent System call Kernel offload (I/O, etc) execution OS function Kernel Finish execution processing Fisnish processing SC18 6 Highlights of the execution model • Two advantages over conventional execution model • Avoid frequent data transfers between VE and VH • Applications are entirely executed on VE • Only necessary data for system calls need to be transferred →High sustained performance VH VE • No special programming • Explicit specifications of computation Exe module load Start kernels are not necessary processing • System calls are transparently offloaded Offload System call (I/O, etc) to the VH OS function • Programmers do not need to care system calls →High usability Finish processing 14 November, 2018 SC18 7 Specification of SX-Aurora TSUBASA • Memory bandwidth • 1.22 TB/s world’s highest memory bandwidth • Six HBM2 memory modules integraEon • 3.0 TB/s LLC bandwidth • LLC is connected to cores via 2D mesh network • ComputaEonal capability • 2.15 Tflop/[email protected] GHz • 8 powerful vector cores • 16 nm FINFET process technology • 4.8 billion transistors • 14.96 mm x 33.00 mm 14 November, 2018 SC18 Block diagram of a vector processor Outline • Background • Overview of SX-Aurora TSUBASA • Performance evaluation • Benchmark performance • Application performance • Conclusions 14 November, 2018 SC18 9 Experimental environments • SX-Aurora TSUBASA A300-2 VH VE • 2x VEs Type 10B VE • 1x VH X86 Linux Vector Engines VH Intel Xeon Gold 6126 VE Type 10B Frequency 2.60 GHz / 3.70 GHz (Turbo) Frequency 1.4 GHz Peak FP / core 83.2 Gflop/s Peak FP / core 268.8 Gflop/s # cores 12 # cores 8 Peak DP Flops 998.4 Gflop/s Peak DP Flops / socket 2.15 Tflop/s Mem BW 128 GB/s Memory BW 1.2 TB/s Mem Capacity 96 GB Memory capacity 48 GB Mem config DDR4-2666 DIMM 16GB x 6 Memory config HBM2 14 November, 2018 SC18 10 Experimental environments cont. SX-Aurora Xeon Gold Xeon Phi Processor SX-ACE Tesla V100 Type 10B 6126 KNL 7290 Frequency 1.4 GHz 2.6 GHz 1.0 GHz 1.245 GHz 1.5 GHz # oF cores 8 12 4 5120 72 DP Flop/s 2.15 T 998.4 GF 7 TF 3.456 TF 256 GF (SP flop/s) (4.30 T) (1996.8 GF) (14 TF) (6.912 TF) Memory MCDRAM HBM2 x6 DDR4 x6ch DDR3 x16ch HBM2 x4 subsystem DDR4 450+ GB/s Memory BW 1.22 TB/s 128 GB/s 256 GB/s 900 GB/s 115.2 GB/s Memory 16 GB 48 GB 96 GB 64 GB 16 GB capacity 96 GB LLC BW 2.66 TB/s N/A 1.0 TB/s N/A N/A 16 MB 19.25 MB 1 MB shared LLC capacity 1 MB private 6 MB shared 14 November,shared 2018 shared SC18 by 211 cores Applications used for evaluation • SGEMM/DGEMM • Matrix-matrix mul;plica;ons to evaluate the Peak flop/s • Stream benchmark • Simple kernels (copy, scale, add, triad) to measure sustained memory performance • Himeno benchmark • Jacobi kernels with a 19-point stencil as a memory-intensive kernels • Applica;on kernels • Kernels of prac;cal applica;ons of Tohoku univ in Earthquake, CFD, Electromagne;c • Microbenchmark to evaluate the execu;on model • Mixture with vector-friendly Jacobi kernels and I/O kernels 14 November, 2018 SC18 12 Overview of application kernels Memory Mesh Code Actual Kernels Fields Methods access size B/F B/F Electro Land mine FDTD Sequential 100x750x750 6.22 5.15 magnetic Seismolo Friction Earthquake Sequential 2047x2047x256 4.00 4.00 gy Law Navier- Turbulent Flow CFD Sequential 512x16384x512 1.91 0.35 Stokes Electro Antenna FDTD Sequential 252755x9x97336 1.73 0.98 magnetic Lax- Plasma Physics Indirect 20,048,000 1.12 0.075 Wendroff Turbine CFD LU-SGS Indirect 480x80x80x10 0.96 0.0084 14 November, 2018 SC18 13 Outline • Background • Overview of SX-Aurora TSUBASA • Performance evaluation • Benchmark performance • Application performance • Conclusions 14 November, 2018 SC18 14 SGEMM/DGEMM Performance DGEMM Gflop/s SGEMM Gflop/s DGEMM efficiency SGEMM Efficiency 4500 100 4000 90 3500 80 3000 70 60 2500 50 2000 40 1500 30 Efficiency (%) Efficiency 1000 20 500 10 0 0 GEMM performance (Gflop/s) 1 2 3 4 5 6 7 8 Number of threads • High scalability up to 8 threads • High vectorization ratio 99.36%, good vector length 253.8 • High efficiency • Efficiency 97.8~99.2% 14 November, 2018 SC18 15 Memory performance(Stream Triad) 1200 1400 x 4.72 x 11.7 x 1.37 x 2.23 SX-Aurora… SX-ACE Skylake 1000 1200 800 1000 600 800 600 400 400 200 Stream bandwidth Stream (GB/s) Stream bandwidth Stream (GB/s) 200 0 SX-Aurora SX-ACE Skylake Tesla V100 KNL 0 TSUBASA 0 2 4 6 8 10 12 Number of threads • High sustained memory bandwidth of SX-Aurora TSUBASA • Efficiency: Aurora 79%, ACE 83%, Skylake 66%, V100 81% • Scalability • Saturated even when the number of threads is less than half 14 November, 2018 SC18 16 Himeno (Jacobi) performance 350 320 x 0.93 SX-Aurora TSUBASA SX-ACE Skylake 300 x 3.4 x 7.96 x 2.1 280 250 240 x 6.9 200 200 160 150 120 100 80 50 40 Himeno performance (Gflop/s) Himeno performance (Gflop/s) 0 0 SX-Aurora SX-ACE Skylake Tesla V100 KNL 0 2 4 6 8 10 12 TSUBASA Number of threads • Higher performance… except GPU • Vector reduction becomes bottleneck due to copy among vector pipes • Nice thread scalability • 6.9x speedup in 8 threads => 86% parallel efficiency 14 November, 2018 SC18 17 Application kernel performance 80 SX-Aurora TSUBASA SX-ACE Skylake 4096 SX-Aurora TSUBASA SX-ACE 70 Antenna 60 1024 Earthquake x 9.9 Turbulent flow 50 256 Turbine 40 Plasma 64 Antenna 30 Plasma 16 Land mine Execution time (sec) 20 x 3.4 x 4.3 10 x 2.9 x 2.6 x 3.4 4 0 Attainable performance (Gflop/s) 1 Land mine Earthquake Turbulent Antenna Plasma Turbine flow 0.1250.25 0.5 1 2 4 8 16 32 64 128 Arithmetic intensity (Flops/Byte) • SX-Aurora TSUBASA could achieve high performance • Plasma, Turbine => Indirect access, memory latency-bound • Antenna => computation-bound to memory BW-bound • Land mine, Earthqauke, Turbulent flow =>memory or LLC BW- bound 14 November, 2018 SC18 18 Memory bound? or LLC bound? • Further analysis using 4 types of Bytes/Flop ratio • Memory B/F = (memory BW) / (peak performance) • LLC B/F = (LLC BW) / (peak performance) • Code B/F = (necessary data in Byte) / (# FP operations) • Actual B/F = (# block memory access) * (block size) / (# FP operations) B/F ratio Actual < Memory Memory > Actual Code < LLC Computation-bound Memory BW-bound Code > LLC LLC BW-bound Memory or LLC bound * • Code B/F > Actual B/F * LLC BW / Memory BW => LLC bound • Code B/F < Actual B/F * LLC BW / Memory BW => memory bound 14 November, 2018 SC18 19 Application kernel performance 80 SX-Aurora TSUBASA SX-ACE Skylake B/F ratio Actual < Memory Actual > Memory 70 60 x 9.9 Code < LLC Computation-bound Memory BW-bound 50 Code > LLC LLC BW-bound Memory or LLC bound 40 30 • Memory B/F = 1.22 TB/s / 2.15 TF Execution time (sec) 20 x 3.4 = 0.57 x 4.3 10 x 2.9 x 2.6 x 3.4 • LLC B/F = 2.66 TB/s / 2.15 TF 0 Land mine Earthquake Turbulent Antenna Plasma Turbine = 1.24 flow • Land mine (Code 6.22, Actual 5.79) => LLC bound • Earthqauke (Code 6.00, Actual 2.00) => LLC bound • Turbulent flow (Code 1.91, Actual 0.35) => memory BW bound • Antenna (Code 1.73, Actual 0.98) => memory BW bound 14 November, 2018 SC18 20 Evaluation of the execution model • (Transparent/Explicit) • Offload from VH to VE Offload from VE to VH VH VE VH VE VH V S VE S V offload AP AP offload 40 Data transfer Jacobi 1 I/O Jacobi 2 35 30 V 25 AP V V AP 20 S S 15 S AP Execution time (sec) 10 V V 5 AP V AP S 0 AP 21 TransparentVE execution VE to VH explicitVH offload VE to VH VHVE to offload VE Multi-VE performance on A300-8 9000 2400 Aurora Ideal Aurora Ideal /s) 2200 8000 2000 7000 Gflop 1800 6000 1600 5000 1400 1200 4000 1000 3000 800 performance ( 2000 600 400 1000 Stream bandwidth (GB/s) Stream 200 0 Himeno 0 1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 8 Number of VEs Number of VEs • Stream VE-level scalability • Almost ideal scalability up to 8 VEs • Himeno VE-level scalability • Good scalability up to 4VEs • Lack of vector lengths when more than 5VEs • Problem size is too small 14 November, 2018 SC18 22 Outline • Background • Overview of SX-Aurora TSUBASA • Performance evaluation • Benchmark performance • Application performance • Conclusions 14 November, 2018 SC18 23 Application evaluation • Applications • Tsunami simulation code • Mainly consists on ground fluctuation and Tsunami inundation prediction • Used for a real-time tsunami inundation system • A costal region of Japan(1244x826km) with an 810m resolution • Direct numerical simulation code of turbulent flows • Incompressible Navier-Stokes equations and a continuum equation are solved by 3D FFT • MPI parallelization to 4VEs (1~32 processes) • 1283, 2563, 5123 grid points 14 November, 2018 SC18 24 Performance of the Tsunami code • Core performance is x 11.4, x 4.1, x2.4, to KNL, Skylake, ACE.
Load more

Recommended publications
  • Petaflops for the People
    PETAFLOPS SPOTLIGHT: NERSC housands of researchers have used facilities of the Advanced T Scientific Computing Research (ASCR) program and its EXTREME-WEATHER Department of Energy (DOE) computing predecessors over the past four decades. Their studies of hurricanes, earthquakes, NUMBER-CRUNCHING green-energy technologies and many other basic and applied Certain problems lend themselves to solution by science problems have, in turn, benefited millions of people. computers. Take hurricanes, for instance: They’re They owe it mainly to the capacity provided by the National too big, too dangerous and perhaps too expensive Energy Research Scientific Computing Center (NERSC), the Oak to understand fully without a supercomputer. Ridge Leadership Computing Facility (OLCF) and the Argonne Leadership Computing Facility (ALCF). Using decades of global climate data in a grid comprised of 25-kilometer squares, researchers in These ASCR installations have helped train the advanced Berkeley Lab’s Computational Research Division scientific workforce of the future. Postdoctoral scientists, captured the formation of hurricanes and typhoons graduate students and early-career researchers have worked and the extreme waves that they generate. Those there, learning to configure the world’s most sophisticated same models, when run at resolutions of about supercomputers for their own various and wide-ranging projects. 100 kilometers, missed the tropical cyclones and Cutting-edge supercomputing, once the purview of a small resulting waves, up to 30 meters high. group of experts, has trickled down to the benefit of thousands of investigators in the broader scientific community. Their findings, published inGeophysical Research Letters, demonstrated the importance of running Today, NERSC, at Lawrence Berkeley National Laboratory; climate models at higher resolution.
    [Show full text]
  • Ushering in a New Era: Argonne National Laboratory & Aurora
    Ushering in a New Era Argonne National Laboratory’s Aurora System April 2015 ANL Selects Intel for World’s Biggest Supercomputer 2-system CORAL award extends IA leadership in extreme scale HPC Aurora Argonne National Laboratory >180PF Trinity NNSA† April ‘15 Cori >40PF NERSC‡ >30PF July ’14 + Theta Argonne National Laboratory April ’14 >8.5PF >$200M ‡ Cray* XC* Series at National Energy Research Scientific Computing Center (NERSC). † Cray XC Series at National Nuclear Security Administration (NNSA). 2 The Most Advanced Supercomputer Ever Built An Intel-led collaboration with ANL and Cray to accelerate discovery & innovation >180 PFLOPS (option to increase up to 450 PF) 18X higher performance† >50,000 nodes Prime Contractor 13MW >6X more energy efficient† 2018 delivery Subcontractor Source: Argonne National Laboratory and Intel. †Comparison of theoretical peak double precision FLOPS and power consumption to ANL’s largest current system, MIRA (10PFs and 4.8MW) 3 Aurora | Science From Day One! Extreme performance for a broad range of compute and data-centric workloads Transportation Biological Science Renewable Energy Training Argonne Training Program on Extreme- Scale Computing Aerodynamics Biofuels / Disease Control Wind Turbine Design / Placement Materials Science Computer Science Public Access Focus Areas Focus US Industry and International Co-array Fortran Batteries / Solar Panels New Programming Models 4 Aurora | Built on a Powerful Foundation Breakthrough technologies that deliver massive benefits Compute Interconnect File System 3rd Generation 2nd Generation Intel® Xeon Phi™ Intel® Omni-Path Intel® Lustre* Architecture Software >17X performance† >20X faster† >3X faster† FLOPS per node >500 TB/s bi-section bandwidth >1 TB/s file system throughput >12X memory bandwidth† >2.5 PB/s aggregate node link >5X capacity† bandwidth >30PB/s aggregate >150TB file system capacity in-package memory bandwidth Integrated Intel® Omni-Path Architecture Processor code name: Knights Hill Source: Argonne National Laboratory and Intel.
    [Show full text]
  • Architectural Trade-Offs in a Latency Tolerant Gallium Arsenide Microprocessor
    Architectural Trade-offs in a Latency Tolerant Gallium Arsenide Microprocessor by Michael D. Upton A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy (Electrical Engineering) in The University of Michigan 1996 Doctoral Committee: Associate Professor Richard B. Brown, CoChairperson Professor Trevor N. Mudge, CoChairperson Associate Professor Myron Campbell Professor Edward S. Davidson Professor Yale N. Patt © Michael D. Upton 1996 All Rights Reserved DEDICATION To Kelly, Without whose support this work may not have been started, would not have been enjoyed, and could not have been completed. Thank you for your continual support and encouragement. ii ACKNOWLEDGEMENTS Many people, both at Michigan and elsewhere, were instrumental in the completion of this work. I would like to thank my co-chairs, Richard Brown and Trevor Mudge, first for attracting me to Michigan, and then for allowing our group the freedom to explore many different ideas in architecture and circuit design. Their guidance and motivation combined to make this a truly memorable experience. I am also grateful to each of my other dissertation committee members: Ed Davidson, Yale Patt, and Myron Campbell. The support and encouragement of the other faculty on the project, Karem Sakallah and Ron Lomax, is also gratefully acknowledged. My friends and former colleagues Mark Rossman, Steve Sugiyama, Ray Farbarik, Tom Rossman and Kendall Russell were always willing to lend their assistance. Richard Oettel continually reminded me of the valuable support of friends and family, and the importance of having fun in your work. Our corporate sponsors: Cascade Design Automation, Chronologic, Cadence, and Metasoft, provided software and support that made this work possible.
    [Show full text]
  • TOP500 Supercomputer Sites
    7/24/2018 News | TOP500 Supercomputer Sites HOME | SEARCH | REGISTER RSS | MY ACCOUNT | EMBED RSS | SUPER RSS | Contact Us | News | TOP500 Supercomputer Sites http://top500.org/blog/category/feature-article/feeds/rss Are you the publisher? Claim or contact Browsing the Latest Browse All Articles (217 Live us about this channel Snapshot Articles) Browser Embed this Channel Description: content in your HTML TOP500 News Search Report adult content: 04/27/18--03:14: UK Commits a 0 0 Billion Pounds to AI Development click to rate The British government and the private sector are investing close to £1 billion Account: (login) pounds to boost the country’s artificial intelligence sector. The investment, which was announced on Thursday, is part of a wide-ranging strategy to make the UK a global leader in AI and big data. More Channels Under the investment, known as the “AI Sector Deal,” government, industry, and academia will contribute £603 million in new funding, adding to the £342 million already allocated in existing budgets. That brings the grand total to Showcase £945 million, or about $1.3 billion at the current exchange rate. The UK RSS Channel Showcase 1586818 government is also looking to increase R&D spending across all disciplines by 2.4 percent, while also raising the R&D tax credit from 11 to 12 percent. This is RSS Channel Showcase 2022206 part of a broader commitment to raise government spending in this area from RSS Channel Showcase 8083573 around £9.5 billion in 2016 to £12.5 billion in 2021. RSS Channel Showcase 1992889 The UK government policy paper that describes the sector deal meanders quite a bit, describing a lot of programs and initiatives that intersect with the AI investments, but are otherwise free-standing.
    [Show full text]
  • MPI on Aurora
    AN OVERVIEW OF AURORA, ARGONNE’S UPCOMING EXASCALE SYSTEM ALCF DEVELOPERS SESSION COLLEEN BERTONI, SUDHEER CHUNDURI www.anl.gov AURORA: An Intel-Cray System Intel/Cray machine arriving at Argonne in 2021 Sustained Performance greater than 1 Exaflops 2 AURORA: A High-level View § Hardware Architecture: § Intel Xeon processors and Intel Xe GPUs § Greater than 10 PB of total memory § Cray Slingshot network and Shasta platform § IO • Uses Lustre and Distributed Asynchronous Object Store IO (DAOS) • Greater than 230 PB of storage capacity and 25 TB/s of bandwidth § Software (Intel One API umbrella): § Intel compilers (C,C++,Fortran) § Programming models: DPC++, OpenMP, OpenCL § Libraries: oneMKL, oneDNN, oneDAL § Tools: VTune, Advisor § Python 3 Node-level Hardware The Evolution of Intel GPUs Source: Intel 5 Intel GPUs § Intel Integrated GPUs are used for over a decade in § Laptops (e.g. MacBook pro) § Desktops § Servers § Recent and upcoming integrated generations : § Gen 9 – used in Skylake based nodes § Gen 11 – used in Ice Lake based nodes § Gen 9: Double precision peak performance: 100-300 GF § Low by design due to power and space limits Layout of Architecture components for an Intel Core i7 processor 6700K for desktop systems (91 W TDP, 122 mm) § Future Intel Xe (Gen 12) GPU series will provide both integrated and discrete GPUs 6 Intel GPU Building Blocks EU: Execution Unit Subslice L2 Slice: 24 EUs SIMD FPU Dispatch&I$ L1 Shared Local Memory (64 KB/subslice) SIMD FPU Subslice: 8 EUs Send 8x EU Sampler L2 $ L3 Data Cache Branch Dataport
    [Show full text]
  • Analysis of the Characteristics and Development Trends of the Next-Generation of Supercomputers in Foreign Countries
    This study was carried out for RIKEN by Special Study Analysis of the Characteristics and Development Trends of the Next-Generation of Supercomputers in Foreign Countries Earl C. Joseph, Ph.D. Robert Sorensen Steve Conway Kevin Monroe IDC OPINION Leadership-class supercomputers have contributed enormously to advances in fundamental and applied science, national security, and the quality of life. Advances made possible by this class of supercomputers have been instrumental for better predicting severe weather and earthquakes that can devastate lives and property, for designing new materials used in products, for making new energy sources pragmatic, for developing and testing methodologies to handle "big data," and for many more beneficial uses. The broad range of leadership-class supercomputers examined during this study make it clear that there are a number of national programs planned and already in place to not only build pre-exascale systems to meet many of today’s most aggressive research agendas but to also develop the hardware and software necessary to produce sustained exascale systems in the 2020 timeframe and beyond. Although our studies indicate that there is no single technology strategy that will emerge as the ideal, it is satisfying to note that the wide range of innovative and forward leaning efforts going on around the world almost certainly ensures that the push toward more capable leadership-class supercomputers will be successful. IDC analysts recognize, however, that for almost every HPC development project examined here, the current effort within each organization is only their latest step in a long history of HPC progress and use.
    [Show full text]
  • Leadership Computing Partnering with the ALCF Enabling
    ARGONNE LEADERSHIP ALCF COMPUTING FACILITY Accelerating Discovery The ALCF provides supercomputing resources to the scientific and engineering community to advance fundamental discovery and understanding in a broad range of disciplines. As a key player in our nation’s efforts to deliver future exascale computing capabilities, the ALCF is helping to advance scientific computing through a convergence of simulation, data science, and machine learning methods. CONNECT WITH US We encourage you to contact us if you have any questions about alcf.anl.gov getting started at the ALCF. [email protected] Leadership Computing Aurora Slated to be one of the world’s first exascale systems, Aurora will be capable of performing more than a quintillion calculations per second. Designed in collaboration with industry leaders, Intel and Cray, the ALCF’s next-generation supercomputer will help ensure continued U.S. leadership in high-end computing for scientific research. Theta Theta, the ALCF’s Intel-Cray supercomputer, is the engine that drives scientific discoveries for the ALCF user community. The system provides powerful capabilities for research involving modeling and simulation, data science, and machine learning techniques. Partnering with the ALCF ALCF resources are available to researchers in academia, industry, and government laboratories through competitive, peer-reviewed allocation programs supported by DOE and Argonne National Laboratory, including INCITE, ALCC, and the ALCF Data Science Program. A special allocation program is available for ECP projects. ALCF computational scientists, performance engineers, visualization experts, and support staff help users to maximize scientific productivity on the facility’s supercomputers. The ALCF also provides training opportunities to prepare researchers to use its leadership-class systems for future science campaigns.
    [Show full text]
  • Intel® Xeon Phi™ Processors
    IDC HPC User Forum Intel’s vision: the Scalable system framework Bret Costelow September 2015 Legal Disclaimers Intel technologies features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. No computer system can be absolutely secure. Check with your system manufacturer or retailer or learn more at [intel.com]. Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. All information provided here is subject to change without notice. Contact your Intel representative to obtain the latest Intel product specifications and roadmaps. Results have been estimated or simulated using internal Intel analysis or architecture simulation or modeling, and provided to you for informational purposes. Any differences in your system hardware, software or configuration may affect your actual performance. Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. No computer system can be absolutely secure. Check with your system manufacturer or retailer or learn more at https://www-ssl.intel.com/content/www/us/en/high- performance-computing/path-to-aurora.html. Intel, the Intel logo, Xeon, and Intel Xeon Phi are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States or other countries.
    [Show full text]
  • Exascale” Supercomputer Fugaku & Beyond
    The first “exascale” supercomputer Fugaku & beyond l Satoshi Matsuoka l Director, RIKEN Center for Computational Science l 20190815 Modsim Presentation 1 Arm64fx & Fugaku 富岳 /Post-K are: l Fujitsu-Riken design A64fx ARM v8.2 (SVE), 48/52 core CPU l HPC Optimized: Extremely high package high memory BW (1TByte/s), on-die Tofu-D network BW (~400Gbps), high SVE FLOPS (~3Teraflops), various AI support (FP16, INT8, etc.) l Gen purpose CPU – Linux, Windows (Word), otherSCs/Clouds l Extremely power efficient – > 10x power/perf efficiency for CFD benchmark over current mainstream x86 CPU l Largest and fastest supercomputer to be ever built circa 2020 l > 150,000 nodes, superseding LLNL Sequoia l > 150 PetaByte/s memory BW l Tofu-D 6D Torus NW, 60 Petabps injection BW (10x global IDC traffic) l 25~30PB NVMe L1 storage l many endpoint 100Gbps I/O network into Lustre l The first ‘exascale’ machine (not exa64bitflops but in apps perf.) 3 Brief History of R-CCS towards Fugaku April 2018 April 2012 AICS renamed to RIKEN R-CCS. July 2010 Post-K Feasibility Study start Satoshi Matsuoka becomes new RIKEN AICS established 3 Arch Teams and 1 Apps Team Director August 2010 June 2012 Aug 2018 HPCI Project start K computer construction complete Arm A64fx announce at Hotchips September 2010 September 2012 Oct 2018 K computer installation starts K computer production start NEDO 100x processor project start First meeting of SDHPC (Post-K) November 2012 Nov 2018 ACM Gordon bell Award Post-K Manufacturing approval by Prime Minister’s CSTI Committee 2 006 2011 2013
    [Show full text]
  • Scienzfic Simulazons on Thousands of Gpus with Performance Portability
    Scien&fic Simulaons on Thousands of GPUs with Performance Portability Alan Gray and Kevin Stratford EPCC, The University of Edinburgh CORAL procurement • Three “pre-exascale” machines have been announced in the US, each in the region of 100-300 petaflops • Summit at ORNL and Sierra at LLNL will use NVIDIA GPUs (with IBM CPUs) . • Aurora at Argonne will use Intel Xeon Phi many-core CPUs (Cray system) • Performance Portability is the key issue for the programmer 2 Outline Applications: Ludwig and MILC Performance Portability with targetDP Performance results on GPU, CPU and Xeon Phi § Using same source code for each Scaling to many nodes with MPI+targetDP 3 Ludwig Applicaon • So3 ma4er substances or complex fluids are all around us • Ludwig: uses lace Boltzmann and finite difference methods to simulate a wide range of systems • Improving the understanding of, and ability to manipulate, liquid crystals is a very ac&ve research area • But required simulaons can be extremely computaonally demanding, due to range of scales involved • targetDP developed in co-design with Ludwig Gray, A., Hart, A., Henrich, O. & Stratford, K., Scaling soft Stratford, K., A. Gray, and J. S. Lintuvuori. "Large Colloids matter physics to thousands of graphics processing units in in Cholesteric Liquid Crystals." Journal of Statistical parallel, IJHPCA (2015) Physics 161.6 (2015): 1496-1507. 4 MILC applicaon • Lace QCD simulaons provide numerical studies to help understand how quarks and gluons interact to form protons, neutrons and other elementary par&cles. • The
    [Show full text]
  • A CORAL System and Implications for Future HPC Hardware and Data Centers
    A CORAL System and Implications for Future HPC Hardware and Data Centers Michael K Patterson Senior Principal Engineer; Power, Packaging & Cooling Intel, Technical Computing Systems Architecture and Pathfinding Acknowledgement Contributors, borrowed content, and data sources Mark Seager, Intel Ram Nagappan, Intel Susan Coghlan, Argonne National Lab Helmut Satzger, LRZ, Munich Jim Rogers, ORNL Cray; Aurora system partners Appreciation NCAR Team for continuing to invite us. Intel Core™ i7 with over 1 billion transistors and over 6 miles (10 km) of wires in the chip to connect them It would only take eight Core™ i7s to make a wire long enough to connect Glasgow to Edinburgh! Intel Investments Paving the Way Holistic Approach to Cluster Solutions CPU Software & Tools Fabric Storage Intel® Xeon® Processors Intel® Parallel Studio Intel® Omni-Path Intel® Solid-State Intel® Xeon Phi™ Product Intel® Enterprise Edition Architecture Drives (NVMe) Family for Lustre* software *Other names and brands may be claimed as the property of others. 4 Intel’s Scalable System Framework A Configurable Design Path Customizable for a Wide Range of HPC & Big Data Workloads Small Clusters Through Supercomputers Compute Memory/Storage Compute and Data-Centric Computing Fabric Software Standards-Based Programmability On-Premise and Cloud-Based Intel Silicon Photonics Intel® Xeon® Processors Intel® True Scale Fabric Intel® SSDs Intel® Software Tools Intel® Xeon Phi™ Intel® Omni-Path Intel® Lustre-based Solutions HPC Scalable Software Stack Coprocessors Architecture Intel® Silicon Photonics Intel® Cluster Ready Program Intel® Xeon Phi™ Processors Intel® Ethernet Technology 6 CORAL COLLABORATION OF OAK RIDGE, ARGONNE, AND LIVERMORE . Acquire DOE 2018 – 2022 Leadership Computing Capability .
    [Show full text]
  • Aurora Fact Sheet
    Aurora Fact Sheet System Feature The Aurora Details Comparison to Mira Peak System Performance (FLOP/s) 180 - 450 PetaFLOP/s 10 PetaFLOP/s Processor Future Generation Intel® Xeon Phi™ Processor PowerPC A2 1600 MHz processor (Code name: Knights Hill) Number of Nodes >50,000 49,152 Compute Platform Intel system based on Cray Shasta next generation IBM Blue Gene/Q supercomputing platform Aggregate High Bandwidth On-Package >7,000 Terabytes 768 Terabytes Memory, local Memory and Persistent Memory Aggregate High Bandwidth On-Package >30 Petabytes/s 2.5 Petabytes/s Memory Bandwidth System Interconnect 2nd Generation Intel® Omni-Path Architecture with IBM 5D torus interconnect silicon photonics with VCSEL photonics Interconnect Aggregate Node >2.5 Petabytes/s 2 Petabytes/s Link Bandwidth Interconnect Bisection Bandwidth >500 Terabytes/s 24 Terabytes/s Interconnect Interface Integrated Integrated Burst Buffer Storage Intel® SSDs, using both 1st and 2nd Generation Intel® None Omni-Path Architecture File System Intel® Lustre File System IBM GPFS File System File System Capacity >150 Petabytes 26 Petabytes File System Throughput >1 Terabyte/s 300 Gigabyte/s Intel Architecture (Intel® 64) Compatibility Yes No Peak Power Consumption 13 Megawatts 4.8 Megawatts FLOP/s Per Watt >13 GigaFLOP/s per watt >2 GigaFLOP/s per watt Delivery Timeline 2018 2012 Facility Area for Compute Clusters ~3,000 sq. ft. ~1,536 sq. ft. For further information on Aurora, visit: intel.com/Aurora Results have been estimated or simulated using internal Intel analysis or architecture simulation or modeling, and provided to you for informational purposes. Any differences in your system hardware, software or configuration may affect your actual performance.
    [Show full text]