Overview of Hardware Accelerators

Total Page:16

File Type:pdf, Size:1020Kb

Overview of Hardware Accelerators High Performance Computing with Application Accelerators Volodymyr Kindratenko Innovative Systems Laboratory @ NCSA Institute for Advanced Computing Applications and Technologies (IACAT) National Center for Supercomputing Applications University of Illinois at Urbana-Champaign A Bit of History • Application accelerator is not a new concept • e.g., Intel C8087 Math Coprocessor • But it received a renewed interest around 2002 due to the single thread performance stall • Frequency scaling became unsustainable with smaller IC feature sizes • Instruction-level parallelism (IPL) can go only so far Accelerators from early 2000s • Sony Emotion Engine • Designed for Sony PS2 game console • PS2 compute clusters, such as one at NCSA • Field-Programmable Gate Arrays (FPGAs) • In early 2000s reached size of millions of gates • The field of reconfigurable computing emerged • FPGA performance growth trends pointed towards outperforming CPUs • Graphics Processing Units (GPUs) used for General-Purpose computing (GPGPUs) • Programmable shaders Mainstream Accelerators from mid-2000s • FPGAs • Finally large enough for running useful floating point calculations • Many vendors offer a variety of products for reconfigurable computing • Sony/Toshiba/IBM Cell Broadband Engine • Designed for Sony PS3 game console • Delivers over 200 GFLOPS in single-precision (SP) • ClearSpeed • First floating-point accelerator specifically made for high-performance computing • 25 GFLOPS peak @ 10 Watt power Application Accelerators Today • GPUs • Dominated by NVIDIA • Offer unsurpassed performance for floating-point applications • IBM PowerXCell 8i • Cell/B.E. variant with improved double-precision floating-point support • Used in RoadRunner supercomputer • FPGAs • CPU socket plug-ins and PCI-based accelerator boards offered by a number of vendors Why Application Accelerators 1600 GPU Performance Trends 1400 GTX 480 NVIDIA GPU 1200 Intel CPU GTX 285 1000 GTX 280 800 ~9x GFLOPS 8800 Ultra 600 8800 GTX 400 7900 GTX 2.26 GHz Xeon Eight-core 3.33 GHz Xeon Quad (Nehalem-EX) 200 (Nehalem-EP) 0 9/22/2002 2/4/2004 6/18/2005 10/31/2006 3/14/2008 7/27/2009 12/9/2010 Major HPC systems with accelerators • Nebulae • NVIDIA Tesla C2050 GPU • #2 on June 2010 TOP-500 list • ~2.8 PFLOPS peak, ~1.2 PFLOPS Linpack • National Supercomputing Centre in Shenzhen, China • RoadRunner • PowerXCell 8i • #3 on June 2010 TOP-500 list • ~1.3 PFLOPS peak, ~1 PFLOPS Linpack • Los Alamos National Lab, USA • Tianhe-1 • ATI Radeon HD 4870 GPU • #7 on June 2010 TOP-500 list • ~1.2 PFLOPS peak, ~0.5 PFLOPS Linpack • Chinese National University of Defense Technology, China NVIDIA Tesla S1070 GPU Computing Server 4 GB GDDR3 • 4 T10 GPUs 4 GB GDDR3 SDRAM SDRAM Tesla Tesla GPU Power supply GPU NVIDIA PCI x16 SWITCH Thermal NVIDIA PCI x16 management SWITCH Tesla GPU Tesla System System monitoring GPU 4 GB GDDR3 SDRAM 4 GB GDDR3 SDRAM NVIDIA Tesla GPU Architecture PCIe interface Input assembler Thread execution manager • 240 streaming processors arranged TPC 1 TPC 10 Geometry controller Geometry controller as 30 streaming SMC SMC multiprocessors SM SM SM SM SM SM I cache I cache I cache I cache I cache I cache MT issue MT issue MT issue MT issue MT issue MT issue • At 1.3 GHz this C cache C cache C cache C cache C cache C cache SP SP SP SP SP SP SP SP SP SP SP SP provides SP SP SP SP SP SP SP SP SP SP SP SP SP SP SP SP SP SP SP SP SP SP SP SP • 1 TFLOPS SP SP SP SP SP SP SP SP SP SP SP SP SP • 86.4 TFLOPS DP SFU SFU SFU SFU SFU SFU SFU SFU SFU SFU SFU SFU Shared Shared Shared Shared Shared Shared memory memory memory memory memory memory • 512-bit interface to Texture units Texture units Texture L1 Texture L1 off-chip GDDR3 memory 512-bit memory interconnect • 102 GB/s bandwidth L2 ROP ROP L2 DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM NCSA AC Cluster AC01-32 nodes • HP xw9400 workstation • 2216 AMD Opteron 2.4 GHz IB dual socket dual core QDR IB • 8GB DDR2 in ac04-ac32 HP xw9400 workstation Nallatech • 16GB DDR2 in ac01-03 PCI-X H101 FPGA • PCIe gen 1.0 card • Infiniband QDR PCIe x16 PCIe x16 • Tesla S1070 1U GPU Computing Server PCIe interface PCIe interface • 1.3 GHz Tesla T10 processors T10 T10 T10 T10 • 4x4 GB GDDR3 SDRAM • 1 per host DRAM DRAM DRAM DRAM Tesla S1070 AC33 node • CPU cores (Intel core i7): 8 • Accelerator Units (S1070): 2 • Total GPUs: 8 • Host Memory: 24 GB DDR3 • GPU Memory: 32 GB • CPU cores/GPU ratio: 1 • PCIe gen 2.0 • Dual IOH (72 lanes PCIe) Core i7 host PCIe x16 PCIe x16 PCIe x16 PCIe x16 PCIe interface PCIe interface PCIe interface PCIe interface T10 T10 T10 T10 T10 T10 T10 T10 DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM Tesla S1070 Tesla S1070 AC34-AC41 nodes (New) • Supermicro A+ Server • Dual six-core AMD Istanbul • 32 GB DDR2 • PCIe gen 2.0 • QDR IB (32 Gbit/sec) • 3 Internal ATI Radeon 5870 GPUs AC Cluster Software Stack Conventional cluster GPU cluster enhancements • Shared system software • Shared system software • Torque / Moab • Torque extensions • ssh • CUDA/OpenCL wrapper • Programming tools • Programming tools • Matlab • CUDA C SDK • Intel compiler • OpenCL SDK • Other tools • PGI+GPU compiler • mvapich2 MPI (IB) • Other tools • CUDA memory test • Power monitoring CUDA/OpenCL Wrapper • Basic operation principle • Use /etc/ld.so.preload to overload (intercept) a subset of CUDA/OpenCL functions, e.g. {cu|cuda}{Get|Set}Device, clGetDeviceIDs, etc. • Transparent operation • Purpose • Enables controlled GPU device visibility and access, extending resource allocation to the workload manager • Provides a platform for rapid implementation and testing of HPC relevant features not available in NVIDIA APIs • Features • NUMA Affinity mapping • Sets thread affinity to CPU core(s) nearest the GPU device • Shared host, multi-GPU device fencing • Only GPUs allocated by scheduler are visible or accessible to user • GPU device numbers are virtualized, with a fixed mapping to a physical device per user environment • User always sees allocated GPU devices indexed from 0 Host to device Bandwidth Comparison 3500 ) AC (no affinity mapping) 3000 AC (with affinity mapping) 2500 (Mbytes/sec 2000 1500 1000 bandwidth 500 0 0.000001 0.0001 0.01 1 100 packet size (Mbytes) CUDA/OpenCL Wrapper • Additional utilities • showgputime utility • Shows percent time CUDA linked processes utilized GPU • Displays last 15 records (showallgputime shows all) • wrapper_query utility • Within any job environment, get details on what the wrapper library is doing • Memory Scrubber • Independent utility from wrapper, but packaged with it • Linux kernel does no management of GPU device memory • Must run between user jobs to ensure security between users • Availability • NCSA/UofI Open Source License • https://sourceforge.net/projects/cudawrapper/ CUDA Memtest • 4GB of Tesla GPU memory is not ECC protected • Potential for producing erroneous results due to “soft” errors • Features • Full re-implementation of every test included in memtest86 • Random and fixed test patterns, error reports, error addresses, test specification • Email notification • Includes additional stress test for software and hardware errors • Usage scenarios • Hardware test for defective GPU memory chips • CUDA API/driver software bugs detection • Hardware test for detecting soft errors due to non-ECC memory • Stress test for thermal loading • Availability • NCSA/UofI Open Source License • https://sourceforge.net/projects/cudagpumemtest/ Power Profiling • Goals • Accurately record power consumption of GPU and workstation (CPU) for performance per watt efficiency comparison • Make this data clearly and conveniently presented to application scientist • Accomplish this with cost effective hardware • Solution • Modify inexpensive power meter to add logging capability • Integrate monitoring with job management infrastructure • submit job with prescribed resource (powermon) • Use web interface to present data in multiple forms to user Power Profiling Example improvement in performance-per-watt e = p/pa*s Application t (sec) ta (sec) s p (watt) pa (watt) e NAMD 6.6 1.1 6 316 681 2.78 VMD 1,465.2 57.5 25.5 299 742 10.48 QMCPACK 61.5 314 853 22.6 MILC 77,324 3,881 19.9 225 555 8.1 Future of Application Accelerators in HPC • Application accelerators will continue to play a role in HPC • Cost, power, and size are the driving forces and application accelerators have an advantage • HPC clusters with application accelerators will continue to be the dominant architecture • GPUs will continue to dominate the accelerator market • NVIDIA has a GPU product line specifically designed for HPC • New major deployments are coming • NSF Track 2D system, Keeneland • New accelerator architectures are coming • Intel Many Integrated Core (MIC) architecture, AMD Fusion • We are starting to see more and more HPC applications ported to accelerators .
Recommended publications
  • IBM US Nuke-Lab Beast 'Sequoia' Is Top of the Flops (Petaflops, That Is) | Insidehpc.Com
    Advertisement insideHPC Skip to content Latest News HPC Hardware Software Tools Events inside-BigData Search Rock Stars of HPC Videos inside-Startups HPC Jobs IBM US Nuke-lab Beast ‘Sequoia’ is Top of the Flops (Petaflops, that is) 06.18.2012 Mi piace By Timothy Prickett Morgan • Get more from this author For the second time in the past two years, a new supercomputer has taken the top ranking in the Top 500 list of supercomputers – and it does not use a hybrid CPU-GPU architecture. But the question everyone will be asking at the International Super Computing conference in Hamburg, Germany today is whether this is the last hurrah for such monolithic parallel machines and whether the move toward hybrid machines where GPUs or other kinds of coprocessors do most of the work is inevitable. No one can predict the future, of course, even if they happen to be Lawrence Livermore National Laboratory (LLNL) and even if they happen to have just fired up IBM’s “Sequoia” BlueGene/Q beast, which has been put through the Linpack benchmark paces, delivering 16.32 petaflops of sustained performance running across the 1.57 million PowerPC cores inside the box. Sequoia has a peak theoretical performance of 20.1 petaflops, so 81.1 per cent of the possible clocks in the box that could do work running Linpack did so when the benchmark test was done. LLNL was where the original BlueGene/L super was commercialized, so that particular Department of Energy nuke lab knows how to tune the massively parallel Power machine better than anyone on the planet, meaning the efficiency is not a surprise.
    [Show full text]
  • June 2012 | TOP500 Supercomputing Sites
    PROJECT LISTS STATISTICS RESOURCES NEWS CONTACT SUBMISSIONS LINKS HOME Home Lists June 2012 MANNHEIM, Germany; BERKELEY, Calif.; and KNOXVILLE, Tenn.—For the first time since November 2009, a United Contents States supercomputer sits atop the TOP500 list of the world’s top supercomputers. Named Sequoia, the IBM BlueGene/Q system installed at the Department of Energy’s Lawrence Livermore National Laboratory achieved an impressive 16.32 Release petaflop/s on the Linpack benchmark using 1,572,864 cores. Top500 List Sequoia is also one of the most energy efficient systems on Press Release (PDF) the list, which will be released Monday, June 18, at the 2012 Press Release International Supercomputing Conference in Hamburg, Germany. This will mark the 39th edition of the list, which is List highlights compiled twice each year. Performance Development On the latest list, Fujitsu’s “K Computer” installed at the RIKEN Related Files Advanced Institute for Computational Science (AICS) in Kobe, Japan, is now the No. 2 system with 10.51 Pflop/s on the TOP500 List (XML) Linpack benchmark using 705,024 SPARC64 processing TOP500 List (Excel) A 1.044 persone piace cores. The K Computer held the No. 1 spot on the previous TOP500 Poster Mi piace two lists. questo elemento. Di' che Poster in PDF piace anche a te, prima di The new Mira supercomputer, an IBM BlueGene/Q system at tutti i tuoi amici. Argonne National Laboratory in Illinois, debuted at No. 3, with Drilldown 8.15 petaflop/s on the Linpack benchmark using 786,432 Performance Development cores. The other U.S.
    [Show full text]
  • Supercomputers – Prestige Objects Or Crucial Tools for Science and Industry?
    Supercomputers – Prestige Objects or Crucial Tools for Science and Industry? Hans W. Meuer a 1, Horst Gietl b 2 a University of Mannheim & Prometeus GmbH, 68131 Mannheim, Germany; b Prometeus GmbH, 81245 Munich, Germany; This paper is the revised and extended version of the Lorraine King Memorial Lecture Hans Werner Meuer was invited by Lord Laird of Artigarvan to give at the House of Lords, London, on April 18, 2012. Keywords: TOP500, High Performance Computing, HPC, Supercomputing, HPC Technology, Supercomputer Market, Supercomputer Architecture, Supercomputer Applications, Supercomputer Technology, Supercomputer Performance, Supercomputer Future. 1 e-mail: [email protected] 2 e-mail: [email protected] 1 Content 1 Introduction ..................................................................................................................................... 3 2 The TOP500 Supercomputer Project ............................................................................................... 3 2.1 The LINPACK Benchmark ......................................................................................................... 4 2.2 TOP500 Authors ...................................................................................................................... 4 2.3 The 39th TOP500 List since 1993 .............................................................................................. 5 2.4 The 39th TOP10 List since 1993 ...............................................................................................
    [Show full text]
  • An Analysis of System Balance and Architectural Trends Based on Top500 Supercomputers
    ORNL/TM-2020/1561 An Analysis of System Balance and Architectural Trends Based on Top500 Supercomputers Hyogi Sim Awais Khan Sudharshan S. Vazhkudai Approved for public release. Distribution is unlimited. August 11, 2020 DOCUMENT AVAILABILITY Reports produced after January 1, 1996, are generally available free via US Department of Energy (DOE) SciTech Connect. Website: www.osti.gov/ Reports produced before January 1, 1996, may be purchased by members of the public from the following source: National Technical Information Service 5285 Port Royal Road Springfield, VA 22161 Telephone: 703-605-6000 (1-800-553-6847) TDD: 703-487-4639 Fax: 703-605-6900 E-mail: [email protected] Website: http://classic.ntis.gov/ Reports are available to DOE employees, DOE contractors, Energy Technology Data Ex- change representatives, and International Nuclear Information System representatives from the following source: Office of Scientific and Technical Information PO Box 62 Oak Ridge, TN 37831 Telephone: 865-576-8401 Fax: 865-576-5728 E-mail: [email protected] Website: http://www.osti.gov/contact.html This report was prepared as an account of work sponsored by an agency of the United States Government. Neither the United States Government nor any agency thereof, nor any of their employees, makes any warranty, express or implied, or assumes any legal lia- bility or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or rep- resents that its use would not infringe privately owned rights. Refer- ence herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise, does not nec- essarily constitute or imply its endorsement, recommendation, or fa- voring by the United States Government or any agency thereof.
    [Show full text]
  • The Race to Exascale Getting Artificial Intelligence and Big Data up to Speed
    Issue 06 July 2019 SUPERCOMPUTING aSIa 1,000,000,000,000,000,000 THE RACE TO EXASCALE GETTING ARTIFICIAL INTELLIGENCE AND BIG DATA UP TO SPEED IT'S A MATERIAL WORLD A QUANTUM LEAP INTO THE FUTURE MOVE IT! MCI (P) 037/04/2019 Issue 06 CONTENTS July 2019 FEATURES p. 24 A Quantum Leap into the Future Building an ‘unhackable’ internet p. 28 Move it! Helping big data go round the globe p. 32 Scaling New Heights at SCA19 Highlights from SupercomputingAsia 2019 p. 6 Digital Dispatch Supercomputing news from around the world p. 10 It’s a Material World How high-performance computing is transforming the material world COVER STORY p. 36 Business Bytes p. 18 The latest industry moves p. 38 THE RACE TO Super Snapshot EXASCALE India’s need for speed Getting artificial intelligence and big data up to speed Data Mover Challenge 2020 Topology SUPERCOMPUTING SINET 100G aSIa DTN @ KREONET2 Denmark 100G DTN @ TransPAC- EDITOR’S NOTE EDITORIAL ADVISORY COMMITTEE London, Paris PacificWave Prof. Tan Tin Wee DTN @ 100G Seattle Surfnet DTN @ Prof. Satoshi Matsuoka DTN @ Chicago New York South Korea SINET 100G Prof. John Gustafson n this issue, we celebrate yet another successful Yves Poppe DTN @ Japan SingAREN-NICT LA edition of the annual SupercomputingAsia 100G conference, which saw more than 700 research CEO & PUBLISHER NII-SingAREN Dr. Juliana Chan 100G SingAREN- and industry delegates from around the world flock CAE-1 Internet2 100G 100G to Singapore on March 12-14, 2019 (Scaling New Singapore EDITOR-IN-CHIEF DTN @ AARNET-SXTransPORT Heights At SCA19, p.
    [Show full text]
  • Supercomputer Centers and High Performance Computing
    Journal of Electrical and Electronic Engineering 2019; 7(4): 87-94 http://www.sciencepublishinggroup.com/j/jeee doi: 10.11648/j.jeee.20190704.11 ISSN: 2329-1613 (Print); ISSN: 2329-1605 (Online) Age of Great Chinese Dragon: Supercomputer Centers and High Performance Computing Andrey Molyakov Institute of Information Technologies and Cybersecurity, Russian State University for the Humanities, Moscow, Russia Email address: To cite this article: Andrey Molyakov. Age of Great Chinese Dragon: Supercomputer Centers and High Performance Computing. Journal of Electrical and Electronic Engineering. Special Issue: Science Innovation . Vol. 7, No. 4, 2019, pp. 87-94. doi: 10.11648/j.jeee.20190704.11 Received : August 18, 2019; Accepted : September 21, 2019; Published : October 9, 2019 Abstract: Author describes Chinese supercomputer centers and networks. There are currently five National Supercomputing Centers in China, which are established in Tianjin, Shenzhen, Shanghai, Jinan, and Chang-Sha. These cities were selected as pilot ones for conducting an experiment on the development of the cloud computing services market. The directions of evolutionary and innovative development of exaflops supercomputers are highlighted in Pacific region. The evolutionary approach is the simplest and allows you to quickly get the result, but the created supercomputer of this type will be effective only when solving a narrow class of problems and have low energy efficiency. An innovative approach involves basic research and the development of innovative technologies, which is much more complicated and requires more time. Innovative technologies for the development of exaflops supercomputers, due to the stringent requirements of energy efficiency and productivity efficiency, have much in common with technologies for creating highly efficient on-board and embedded systems.
    [Show full text]
  • At the Frontiers of Extreme Computing
    NOVEMBER 2011 SUPER- COMPUTERS AT THE FRONTIERS OF EXTREME COMPUTING PUBLISHED IN PARTNERSHIP WITH Research and Innovation with HPC Joint SMEs Laboratory HPC At the interface of computer science and mathematics, Inria researchers have spent 40 years establishing the scientific bases of a new field of knowledge: computational science. In inte- raction with other scientific disciplines, computational science offers new concepts, languages, methods and subjects for study that open new perspectives in the understanding of complex phenomena. High Performance Computing is a The work of this laboratory focuses Eventually, in order to boost techno- strategic topic for Inria, about thirty on development of algorithms and logy transfer from public research to Inria research teams are involved. software for computers at the peta- industry, which is part of Inria’s core flop scale and beyond. The laborato- mission, the institute has launched Inria has thus established large ry’s researchers carry out their work an «SME go HPC» Program, together scale strategic partnerships with- as part of the Blue Waters project. with GENCI, OSEO and four French Bull for the design of future HPC industry clusters (Aerospace Valley, architectures and with EDF R&D fo- It is also noteworthy that several Axelera, Minalogic, Systematic). cused on high performance simulation former Inria spin-off companies have The objective of the Program is to for energy applications. developed their business on this mar- bring high level expertise to SMEs wil- ket, such as Kerlabs, Caps Enterprise, ling to move to Simulation and HPC as At the international level, Inria and the Activeon or Sysfera.
    [Show full text]
  • Chinese Supercomputer Emerges at Head of Latest Top500 List
    From SIAM News, Volume 43, Number 10, December 2010 Chinese Supercomputer Emerges at Head of Latest Top500 List From time to time, announcement of the top 500 supercomputers in the world, a highlight of the annual Supercomputing conference, contains an element of drama. Release of the latest list at SC 2010 (New Orleans, November 13–19) is such an instance. Of the top five computers on the list, two are from China, two are from the U.S., and one is from Japan. Number 1, as predicted with near certainty two weeks in advance of the official announcement in an article in The New York Times, is the Tianhe-1A, located at the National Supercomputing Center in Tianjin, China. With sustained performance of 2.57 petaflop/s (46% faster than the Jaguar at Oak Ridge National Laboratory, the previous number 1 system), the Tianhe-1A has captured the attention of those who use, analyze, create, and fund supercomputers. Making the prediction was Jack Dongarra, director of the Innovative Computing Laboratory at the University of Tennessee. The Tianhe “blows away the existing No. 1 machine,” he told the Times reporter. “It is unlikely that we will see a system that is faster soon.” At the beginning of November, with the official release of the list still two weeks away, Dongarra, who also has an appointment at Oak Ridge National Lab and the University of Manchester and has been the driving force behind the twice yearly Top500 list since its 1993 founding, spoke to SIAM News by phone about the Chinese supercomputer and its implications.
    [Show full text]
  • Issues in Developing the New Generation High Performance Computers
    Issues in developing the new generation high performance computers Depei Qian Beihang University ICPP 2015,Beijing Sep. 4, 2015 Outline • A brief review • Issues in developing next generation supercomputers • Prospects A brief review The 863 program • The most important high-tech R&D program of China since 1987 • Proposed by 4 senior scientists and approved by former leader Deng Xiaoping in March 1986 • A regular R&D program, named after the 5-year plan, current the 12th 5-year 863 program • 8 areas, Information Technology is one of them • Strategic, looking-ahead, frontier research on major technologies supporting China’s development • Emphasize technology transfer and adoption of research outcomes by industry • Encourage enterprise participation Evolution of 863’s emphasis • 1987: Intelligent computers – Influenced by the 5th generation computer program in Japan • 1990: from intelligent computer to high performance computers – Emphasize practical HPC capability for research and industry • 1998: from high performance computer system to HPC environment – Emphasize resource sharing and ease of access – Broaden usage of the HPC systems Evolution of 863’s emphasis • 2006: from high performance to high productivity – Emphasize other metrics such as programmability, program portability, and reliability besides peak performance • Current: from HPC environment to HPC application service environment – Emphasize integrated efforts on HPC systems, HPC environment, and HPC applications – Explore new mechanisms and business models for HPC services
    [Show full text]
  • The Path to Petascale Computing in China
    The Path to Petascale ComputingTitle in China XueXue--binbin Chi Unit Name SuperComputing Center, CNIC, CAS DateDecember 9-9-10,10, 2010, Tokyo, Japan Supercomputing Center of Chinese Academy of Sciences Outline Overview the HPC History of China Brief Introduction of SCCAS Grid environment overview Applications in science and engineering Future Plan on high performance environment Supercomputing Center of Chinese Academy of Sciences Overview the HPC History of China 1.Started in the late of 1980’s 2.Deve lop ing i n th e 1990’ s Supercomputing Center of Chinese Academy of Sciences Parallel computers (1988‐1994) BJ‐01 (1988‐1992) – 4 processors, with global and local memmory, made by ICT, CAS Transputers (1991‐1994) – Several parallel systems, our group had a 17 transputer system KJ 8950 (1993‐1995) – 16 processors, with global and local memmory, made by ICT, CAS 1995 1st parallel computer Dawning 1000 occurred – Peak performance 2.5GFLOPS in single precision, HPL 50% – Similar to Paragon machine, NX parallel implementation environment – Intel i860 Supercomputing Center of Chinese Academy of Sciences National High Performance computing Centers (1996‐2000) National High Performance computing Center (Beijing) – In Institute of computing technology, CAS National High Performance computing Center (Wuhan) – Huazhong University of Science and Technology National High Performance computing Center (Chengdu) – Southwest Jiaotong University National High Performance computing Center ()(Hefei) – University of Science and Technology of China
    [Show full text]
  • Acceleration of CFD and Data Analysis Using Graphics Processors Ali Khajeh Saeed University of Massachusetts Amherst, [email protected]
    University of Massachusetts Amherst ScholarWorks@UMass Amherst Open Access Dissertations 2-2012 Acceleration of CFD and Data Analysis Using Graphics Processors Ali Khajeh Saeed University of Massachusetts Amherst, [email protected] Follow this and additional works at: https://scholarworks.umass.edu/open_access_dissertations Part of the Industrial Engineering Commons, and the Mechanical Engineering Commons Recommended Citation Khajeh Saeed, Ali, "Acceleration of CFD and Data Analysis Using Graphics Processors" (2012). Open Access Dissertations. 524. https://doi.org/10.7275/hhk9-mx74 https://scholarworks.umass.edu/open_access_dissertations/524 This Open Access Dissertation is brought to you for free and open access by ScholarWorks@UMass Amherst. It has been accepted for inclusion in Open Access Dissertations by an authorized administrator of ScholarWorks@UMass Amherst. For more information, please contact [email protected]. ACCELERATION OF CFD AND DATA ANALYSIS USING GRAPHICS PROCESSORS A Dissertation Outline Presented by ALI KHAJEH-SAEED Submitted to the Graduate School of the University of Massachusetts Amherst in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY February 2012 Mechanical and Industrial Engineering © Copyright by Ali Khajeh-Saeed 2012 All Rights Reserved ACCELERATION OF CFD AND DATA ANALYSIS USING GRAPHICS PROCESSORS A Dissertation Outline Presented by ALI KHAJEH-SAEED Approved as to style and content by: J. Blair Perot, Chair Stephen de Bruyn Kops, Member Rui Wang, Member Hans Johnston, Member Donald L. Fisher, Department Head Mechanical and Industrial Engineering ACKNOWLEDGMENTS This thesis would not have been possible without the aid and support of countless people over the past four years. I must first express my gratitude towards my advisor, Professor J.
    [Show full text]
  • Trends in High-Performance Computing
    N o v E l A r C h I t E C t u r E S Editors: Volodymyr Kindratenko, [email protected] Pedro Trancoso, [email protected] Trends in HigH-Performance comPuTing By Volodymyr Kindratenko and Pedro Trancoso HPC system architectures are shifting from the traditional clusters of homogeneous nodes to clusters of heterogeneous nodes and accelerators. e can infer the future of from traditional clusters of homo- at number six and deployed at the high-performance com- geneous nodes to clusters of hetero- French Atomic and Alternative Ener- W puting (HPC) from the geneous nodes (CPU+GPU). As the gies Commission. technologies developed today to show- sidebar, “Architecture of Current Peta- The Tianhe-1A is composed of case the leadership-class compute flops Systems” describes, three out 7,168 nodes—each containing two systems—that is, the supercomputers. of seven systems that achieved over Intel Xeon X5670 hex-core (West- These machines are usually designed one quadrillion flops (petaflops) on mere) processors and one Nvidia to achieve the highest possible perfor- the standard benchmark tool Linpack Tesla M2050 GPU. The Jaguar is a mance in terms of the number of 64-bit (www.top500.org/project/linpack) are more traditional Cray XT system floating-point operations per second Nvidia GPU-based, and two out of consisting of 18,688 compute nodes (flops). Their architecture has evolved the three largest systems are deployed containing dual hex-core AMD Op- from early custom design systems to in China. teron 2435 (Istanbul) processors. The the current clusters of commodity The number one system on the highest-performing GPU-based US- multisocket, multicore systems.
    [Show full text]