DOCSLIB.ORG

Performance Computing to US Competitiveness

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Performance Computing to US Competitiveness The Vital Importance of High- Performance Computing to U.S. Competitiveness BY STEPHEN J. EZELL AND ROBERT D. ATKINSON | APRIL 2016 High-performance computing (HPC) refers to systems that, through a Leadership in high- combination of processing capability and storage capacity, can rapidly performance computing remains indispensable solve difficult computational problems across a diverse range of scientific, to a country’s industrial engineering, and business fields. HPC represents a strategic, game- competitiveness, changing technology with tremendous economic competitiveness, science national security, and leadership, and national security implications. Because HPC stands at the potential for scientific discovery, yet forefront of scientific discovery and commercial innovation, it is heightened global positioned at the frontier of competition—for nations and their competition places enterprises alike—making U.S. strength in producing and adopting HPC America’s HPC central to its competitiveness. But as competitor nations rapidly scale up leadership under increasing threat. their investments in and applications of high-performance computing, America will need concerted public and private collaboration and investment to maintain its leading position in both HPC production and application. INFORMATION TECHNOLOGY & INNOVATION FOUNDATION | APRIL 2016 PAGE 1 TABLE OF CONTENTS Introduction ............................................................................................................................... 3 What is HPC, and Why Does Its Production and Use Matter? ............................................................. 4 What is HPC? ...................................................................................................................................... 4 Why HPC Adoption and Use Matters ..................................................................................................... 7 Why HPC Production Matters .............................................................................................................. 11 Commercial Applications and Benefits of HPC USE ....................................................................... 13 Manufacturing and Industrial Applications of HPC ............................................................................... 14 Aerospace ..................................................................................................................................... 15 Automotive ................................................................................................................................... 16 Steel and Welding ......................................................................................................................... 19 Consumer Packaged Goods Manufacturing ...................................................................................... 19 Energy Consumption and Production .............................................................................................. 20 Bringing HPC to America’s SME Manufacturers ............................................................................... 20 What’s Next for HPC in Manufacturing? .......................................................................................... 22 Health-Care-Related Applications of HPC ............................................................................................ 24 Other Commercial Sectors Leveraging HPC .......................................................................................... 28 Finance ........................................................................................................................................ 28 Sports and Entertainment .............................................................................................................. 28 Scientific Research Applications of HPCs ............................................................................................ 28 Weather Forecasting ...................................................................................................................... 28 Space Research ............................................................................................................................ 29 The Global HPC Market .............................................................................................................. 30 International Competition for HPC Leadership ............................................................................... 34 China ................................................................................................................................................ 34 The European Union .......................................................................................................................... 37 Japan ............................................................................................................................................... 38 India................................................................................................................................................. 39 South Korea ...................................................................................................................................... 39 Russia .............................................................................................................................................. 40 Country Summary .............................................................................................................................. 40 Why A U.S. HPC Policy Is Needed ............................................................................................... 41 The National Strategic Computing Initiative ......................................................................................... 42 Policy Recommendations ............................................................................................................ 44 Conclusion ............................................................................................................................... 48 Endnotes .................................................................................................................................. 49 Acknowledgments ...................................................................................................................... 50 About The Authors ..................................................................................................................... 50 About ITIF ................................................................................................................................ 50 INFORMATION TECHNOLOGY & INNOVATION FOUNDATION | APRIL 2016 PAGE 2 INTRODUCTION High-performance computing has become indispensable to the ability of enterprises, scientific researchers, and government agencies to generate new discoveries and to innovate breakthrough products and services. Indeed, high-performance computers are contributing significantly to scientific progress, industrial competitiveness, national security, and quality of life. Accordingly, many leading nations are engaged in an intensifying contest to develop the most sophisticated high-performance computing systems—and to broadly deploy them throughout their academic, industry, and government institutions—in order to advance their industrial competitiveness and scientific leadership, ensure their national security, and help address social challenges such as health, public safety, weather forecasting, climate change, and environmental protection. These nations recognize that more sophisticated and faster computers can give their countries a comparative advantage. This report explains what high-performance computing is and why both HPC production and use matters; articulates how industry, academia, and governments leverage HPC to solve frontier challenges; details the contours of the intensifying competition for global HPC leadership; and assesses U.S. policy toward high-performance computing. The report finds that robust levels of public investment—and effective public-private partnerships to diffuse the availability and accessibility of HPC systems—has been foundational to America’s leadership in high-performance computing. The report makes the following policy recommendations to ensure America’s continuing HPC leadership into the future. Congress should: Hold hearings on the National Strategic Computing Initiative (NSCI) and the intensifying race for global HPC leadership. Authorize and appropriate funding levels for the National Strategic Computing Initiative as requested in the Obama administration’s FY 2017 budget for FY 2017 and for future years. Reform export control regulations to match the reality of current high- performance computing systems. The administration, or its agencies and departments therein, should: Continue to make technology transfer and commercialization activities a priority focus of America’s network of national laboratories. Emphasize HPC in federal worker training and retraining programs. Emphasize HPC in relevant Manufacturing Extension Partnership (MEP) engagements, helping facilitate small- to medium-sized enterprises’ (SME) access to high-performance computing. INFORMATION TECHNOLOGY & INNOVATION FOUNDATION | APRIL 2016 PAGE 3 WHAT IS HPC, AND WHY DOES ITS PRODUCTION AND USE MATTER? This section defines and describes high-performance computing and then assesses specific reasons why leadership in both HPC adoption and production matters to nations.
Load more

Recommended publications
  • AI Chips: What They Are and Why They Matter
    APRIL 2020 AI Chips: What They Are and Why They Matter An AI Chips Reference AUTHORS Saif M. Khan Alexander Mann Table of Contents Introduction and Summary 3 The Laws of Chip Innovation 7 Transistor Shrinkage: Moore’s Law 7 Efficiency and Speed Improvements 8 Increasing Transistor Density Unlocks Improved Designs for Efficiency and Speed 9 Transistor Design is Reaching Fundamental Size Limits 10 The Slowing of Moore’s Law and the Decline of General-Purpose Chips 10 The Economies of Scale of General-Purpose Chips 10 Costs are Increasing Faster than the Semiconductor Market 11 The Semiconductor Industry’s Growth Rate is Unlikely to Increase 14 Chip Improvements as Moore’s Law Slows 15 Transistor Improvements Continue, but are Slowing 16 Improved Transistor Density Enables Specialization 18 The AI Chip Zoo 19 AI Chip Types 20 AI Chip Benchmarks 22 The Value of State-of-the-Art AI Chips 23 The Efficiency of State-of-the-Art AI Chips Translates into Cost-Effectiveness 23 Compute-Intensive AI Algorithms are Bottlenecked by Chip Costs and Speed 26 U.S. and Chinese AI Chips and Implications for National Competitiveness 27 Appendix A: Basics of Semiconductors and Chips 31 Appendix B: How AI Chips Work 33 Parallel Computing 33 Low-Precision Computing 34 Memory Optimization 35 Domain-Specific Languages 36 Appendix C: AI Chip Benchmarking Studies 37 Appendix D: Chip Economics Model 39 Chip Transistor Density, Design Costs, and Energy Costs 40 Foundry, Assembly, Test and Packaging Costs 41 Acknowledgments 44 Center for Security and Emerging Technology | 2 Introduction and Summary Artificial intelligence will play an important role in national and international security in the years to come.
    [Show full text]
  • The Evolution of Cloud Computing Over the Past Few Years Is Potentially One of the Major Advances in the History of Computing
    INSTITUTIONAL ARRANGEMENT, TECHNOLOGICAL INNOVATION AND APPLICATION EVOLUTION: THE RISE OF CHINA’S EMERGING COMPUTING INFRASTRUCTURE Jiang Yu, Institute of Policy and Management, Chinese Academy of Sciences No. 15, Zhonguancun Beiyitiao, Beijing, 100190, P.R. China Email: [email protected], Telephone: 0086 10 59358509 Yue Zhang, Institute of Policy and Management, Chinese Academy of Sciences No. 15, Zhonguancun Beiyitiao, Beijing, 100190, P.R. China Email: [email protected] ABSTRACT This paper tries to explore the interaction of institutional arrangement, technological innovation and application evolution underlying the impressive growth of China’s computing infrastructure. Drawing upon the actor-network theory, we construct a framework to explain how the elements identified forge the evolution of the sector. Our study hopes to provide the analytical lens and explanatory power to probe this growth process under the emerging contexts. We conduct an in-depth case study on the growth of China’s emerging computing infrastructure to justify the framework. Chinese government has been deeply involved in the development of the computing infrastructures including the systems of supercomputing and cloud computing to build a nationwide computing backbone network. In the resent emerging of cloud computing, the networks which involved in much more diversified actors with heterogeneous interests are shaping under a more open setting. However, the facility-oriented strategies by the dominant state-owned players still exert great challenge to the cloud computing development which needs sustainable benefits generated from the infrastructure. Our paper tries to provide a systematic understanding on the growth of China’s emerging computing infrastructure and offer some important insights to the emerging industries in other large emerging countries.
    [Show full text]
  • IBM US Nuke-Lab Beast 'Sequoia' Is Top of the Flops (Petaflops, That Is) | Insidehpc.Com
    Advertisement insideHPC Skip to content Latest News HPC Hardware Software Tools Events inside-BigData Search Rock Stars of HPC Videos inside-Startups HPC Jobs IBM US Nuke-lab Beast ‘Sequoia’ is Top of the Flops (Petaflops, that is) 06.18.2012 Mi piace By Timothy Prickett Morgan • Get more from this author For the second time in the past two years, a new supercomputer has taken the top ranking in the Top 500 list of supercomputers – and it does not use a hybrid CPU-GPU architecture. But the question everyone will be asking at the International Super Computing conference in Hamburg, Germany today is whether this is the last hurrah for such monolithic parallel machines and whether the move toward hybrid machines where GPUs or other kinds of coprocessors do most of the work is inevitable. No one can predict the future, of course, even if they happen to be Lawrence Livermore National Laboratory (LLNL) and even if they happen to have just fired up IBM’s “Sequoia” BlueGene/Q beast, which has been put through the Linpack benchmark paces, delivering 16.32 petaflops of sustained performance running across the 1.57 million PowerPC cores inside the box. Sequoia has a peak theoretical performance of 20.1 petaflops, so 81.1 per cent of the possible clocks in the box that could do work running Linpack did so when the benchmark test was done. LLNL was where the original BlueGene/L super was commercialized, so that particular Department of Energy nuke lab knows how to tune the massively parallel Power machine better than anyone on the planet, meaning the efficiency is not a surprise.
    [Show full text]
  • June 2012 | TOP500 Supercomputing Sites
    PROJECT LISTS STATISTICS RESOURCES NEWS CONTACT SUBMISSIONS LINKS HOME Home Lists June 2012 MANNHEIM, Germany; BERKELEY, Calif.; and KNOXVILLE, Tenn.—For the first time since November 2009, a United Contents States supercomputer sits atop the TOP500 list of the world’s top supercomputers. Named Sequoia, the IBM BlueGene/Q system installed at the Department of Energy’s Lawrence Livermore National Laboratory achieved an impressive 16.32 Release petaflop/s on the Linpack benchmark using 1,572,864 cores. Top500 List Sequoia is also one of the most energy efficient systems on Press Release (PDF) the list, which will be released Monday, June 18, at the 2012 Press Release International Supercomputing Conference in Hamburg, Germany. This will mark the 39th edition of the list, which is List highlights compiled twice each year. Performance Development On the latest list, Fujitsu’s “K Computer” installed at the RIKEN Related Files Advanced Institute for Computational Science (AICS) in Kobe, Japan, is now the No. 2 system with 10.51 Pflop/s on the TOP500 List (XML) Linpack benchmark using 705,024 SPARC64 processing TOP500 List (Excel) A 1.044 persone piace cores. The K Computer held the No. 1 spot on the previous TOP500 Poster Mi piace two lists. questo elemento. Di' che Poster in PDF piace anche a te, prima di The new Mira supercomputer, an IBM BlueGene/Q system at tutti i tuoi amici. Argonne National Laboratory in Illinois, debuted at No. 3, with Drilldown 8.15 petaflop/s on the Linpack benchmark using 786,432 Performance Development cores. The other U.S.
    [Show full text]
  • Supercomputers – Prestige Objects Or Crucial Tools for Science and Industry?
    Supercomputers – Prestige Objects or Crucial Tools for Science and Industry? Hans W. Meuer a 1, Horst Gietl b 2 a University of Mannheim & Prometeus GmbH, 68131 Mannheim, Germany; b Prometeus GmbH, 81245 Munich, Germany; This paper is the revised and extended version of the Lorraine King Memorial Lecture Hans Werner Meuer was invited by Lord Laird of Artigarvan to give at the House of Lords, London, on April 18, 2012. Keywords: TOP500, High Performance Computing, HPC, Supercomputing, HPC Technology, Supercomputer Market, Supercomputer Architecture, Supercomputer Applications, Supercomputer Technology, Supercomputer Performance, Supercomputer Future. 1 e-mail: [email protected] 2 e-mail: [email protected] 1 Content 1 Introduction ..................................................................................................................................... 3 2 The TOP500 Supercomputer Project ............................................................................................... 3 2.1 The LINPACK Benchmark ......................................................................................................... 4 2.2 TOP500 Authors ...................................................................................................................... 4 2.3 The 39th TOP500 List since 1993 .............................................................................................. 5 2.4 The 39th TOP10 List since 1993 ...............................................................................................
    [Show full text]
  • An Analysis of System Balance and Architectural Trends Based on Top500 Supercomputers
    ORNL/TM-2020/1561 An Analysis of System Balance and Architectural Trends Based on Top500 Supercomputers Hyogi Sim Awais Khan Sudharshan S. Vazhkudai Approved for public release. Distribution is unlimited. August 11, 2020 DOCUMENT AVAILABILITY Reports produced after January 1, 1996, are generally available free via US Department of Energy (DOE) SciTech Connect. Website: www.osti.gov/ Reports produced before January 1, 1996, may be purchased by members of the public from the following source: National Technical Information Service 5285 Port Royal Road Springfield, VA 22161 Telephone: 703-605-6000 (1-800-553-6847) TDD: 703-487-4639 Fax: 703-605-6900 E-mail: [email protected] Website: http://classic.ntis.gov/ Reports are available to DOE employees, DOE contractors, Energy Technology Data Ex- change representatives, and International Nuclear Information System representatives from the following source: Office of Scientific and Technical Information PO Box 62 Oak Ridge, TN 37831 Telephone: 865-576-8401 Fax: 865-576-5728 E-mail: [email protected] Website: http://www.osti.gov/contact.html This report was prepared as an account of work sponsored by an agency of the United States Government. Neither the United States Government nor any agency thereof, nor any of their employees, makes any warranty, express or implied, or assumes any legal lia- bility or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or rep- resents that its use would not infringe privately owned rights. Refer- ence herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise, does not nec- essarily constitute or imply its endorsement, recommendation, or fa- voring by the United States Government or any agency thereof.
    [Show full text]
  • The Race to Exascale Getting Artificial Intelligence and Big Data up to Speed
    Issue 06 July 2019 SUPERCOMPUTING aSIa 1,000,000,000,000,000,000 THE RACE TO EXASCALE GETTING ARTIFICIAL INTELLIGENCE AND BIG DATA UP TO SPEED IT'S A MATERIAL WORLD A QUANTUM LEAP INTO THE FUTURE MOVE IT! MCI (P) 037/04/2019 Issue 06 CONTENTS July 2019 FEATURES p. 24 A Quantum Leap into the Future Building an ‘unhackable’ internet p. 28 Move it! Helping big data go round the globe p. 32 Scaling New Heights at SCA19 Highlights from SupercomputingAsia 2019 p. 6 Digital Dispatch Supercomputing news from around the world p. 10 It’s a Material World How high-performance computing is transforming the material world COVER STORY p. 36 Business Bytes p. 18 The latest industry moves p. 38 THE RACE TO Super Snapshot EXASCALE India’s need for speed Getting artificial intelligence and big data up to speed Data Mover Challenge 2020 Topology SUPERCOMPUTING SINET 100G aSIa DTN @ KREONET2 Denmark 100G DTN @ TransPAC- EDITOR’S NOTE EDITORIAL ADVISORY COMMITTEE London, Paris PacificWave Prof. Tan Tin Wee DTN @ 100G Seattle Surfnet DTN @ Prof. Satoshi Matsuoka DTN @ Chicago New York South Korea SINET 100G Prof. John Gustafson n this issue, we celebrate yet another successful Yves Poppe DTN @ Japan SingAREN-NICT LA edition of the annual SupercomputingAsia 100G conference, which saw more than 700 research CEO & PUBLISHER NII-SingAREN Dr. Juliana Chan 100G SingAREN- and industry delegates from around the world flock CAE-1 Internet2 100G 100G to Singapore on March 12-14, 2019 (Scaling New Singapore EDITOR-IN-CHIEF DTN @ AARNET-SXTransPORT Heights At SCA19, p.
    [Show full text]
  • Supercomputer Centers and High Performance Computing
    Journal of Electrical and Electronic Engineering 2019; 7(4): 87-94 http://www.sciencepublishinggroup.com/j/jeee doi: 10.11648/j.jeee.20190704.11 ISSN: 2329-1613 (Print); ISSN: 2329-1605 (Online) Age of Great Chinese Dragon: Supercomputer Centers and High Performance Computing Andrey Molyakov Institute of Information Technologies and Cybersecurity, Russian State University for the Humanities, Moscow, Russia Email address: To cite this article: Andrey Molyakov. Age of Great Chinese Dragon: Supercomputer Centers and High Performance Computing. Journal of Electrical and Electronic Engineering. Special Issue: Science Innovation . Vol. 7, No. 4, 2019, pp. 87-94. doi: 10.11648/j.jeee.20190704.11 Received : August 18, 2019; Accepted : September 21, 2019; Published : October 9, 2019 Abstract: Author describes Chinese supercomputer centers and networks. There are currently five National Supercomputing Centers in China, which are established in Tianjin, Shenzhen, Shanghai, Jinan, and Chang-Sha. These cities were selected as pilot ones for conducting an experiment on the development of the cloud computing services market. The directions of evolutionary and innovative development of exaflops supercomputers are highlighted in Pacific region. The evolutionary approach is the simplest and allows you to quickly get the result, but the created supercomputer of this type will be effective only when solving a narrow class of problems and have low energy efficiency. An innovative approach involves basic research and the development of innovative technologies, which is much more complicated and requires more time. Innovative technologies for the development of exaflops supercomputers, due to the stringent requirements of energy efficiency and productivity efficiency, have much in common with technologies for creating highly efficient on-board and embedded systems.
    [Show full text]
  • At the Frontiers of Extreme Computing
    NOVEMBER 2011 SUPER- COMPUTERS AT THE FRONTIERS OF EXTREME COMPUTING PUBLISHED IN PARTNERSHIP WITH Research and Innovation with HPC Joint SMEs Laboratory HPC At the interface of computer science and mathematics, Inria researchers have spent 40 years establishing the scientific bases of a new field of knowledge: computational science. In inte- raction with other scientific disciplines, computational science offers new concepts, languages, methods and subjects for study that open new perspectives in the understanding of complex phenomena. High Performance Computing is a The work of this laboratory focuses Eventually, in order to boost techno- strategic topic for Inria, about thirty on development of algorithms and logy transfer from public research to Inria research teams are involved. software for computers at the peta- industry, which is part of Inria’s core flop scale and beyond. The laborato- mission, the institute has launched Inria has thus established large ry’s researchers carry out their work an «SME go HPC» Program, together scale strategic partnerships with- as part of the Blue Waters project. with GENCI, OSEO and four French Bull for the design of future HPC industry clusters (Aerospace Valley, architectures and with EDF R&D fo- It is also noteworthy that several Axelera, Minalogic, Systematic). cused on high performance simulation former Inria spin-off companies have The objective of the Program is to for energy applications. developed their business on this mar- bring high level expertise to SMEs wil- ket, such as Kerlabs, Caps Enterprise, ling to move to Simulation and HPC as At the international level, Inria and the Activeon or Sysfera.
    [Show full text]
  • Chinese Supercomputer Emerges at Head of Latest Top500 List
    From SIAM News, Volume 43, Number 10, December 2010 Chinese Supercomputer Emerges at Head of Latest Top500 List From time to time, announcement of the top 500 supercomputers in the world, a highlight of the annual Supercomputing conference, contains an element of drama. Release of the latest list at SC 2010 (New Orleans, November 13–19) is such an instance. Of the top five computers on the list, two are from China, two are from the U.S., and one is from Japan. Number 1, as predicted with near certainty two weeks in advance of the official announcement in an article in The New York Times, is the Tianhe-1A, located at the National Supercomputing Center in Tianjin, China. With sustained performance of 2.57 petaflop/s (46% faster than the Jaguar at Oak Ridge National Laboratory, the previous number 1 system), the Tianhe-1A has captured the attention of those who use, analyze, create, and fund supercomputers. Making the prediction was Jack Dongarra, director of the Innovative Computing Laboratory at the University of Tennessee. The Tianhe “blows away the existing No. 1 machine,” he told the Times reporter. “It is unlikely that we will see a system that is faster soon.” At the beginning of November, with the official release of the list still two weeks away, Dongarra, who also has an appointment at Oak Ridge National Lab and the University of Manchester and has been the driving force behind the twice yearly Top500 list since its 1993 founding, spoke to SIAM News by phone about the Chinese supercomputer and its implications.
    [Show full text]
  • Issues in Developing the New Generation High Performance Computers
    Issues in developing the new generation high performance computers Depei Qian Beihang University ICPP 2015，Beijing Sep. 4, 2015 Outline • A brief review • Issues in developing next generation supercomputers • Prospects A brief review The 863 program • The most important high-tech R&D program of China since 1987 • Proposed by 4 senior scientists and approved by former leader Deng Xiaoping in March 1986 • A regular R&D program, named after the 5-year plan, current the 12th 5-year 863 program • 8 areas, Information Technology is one of them • Strategic, looking-ahead, frontier research on major technologies supporting China’s development • Emphasize technology transfer and adoption of research outcomes by industry • Encourage enterprise participation Evolution of 863’s emphasis • 1987: Intelligent computers – Influenced by the 5th generation computer program in Japan • 1990: from intelligent computer to high performance computers – Emphasize practical HPC capability for research and industry • 1998: from high performance computer system to HPC environment – Emphasize resource sharing and ease of access – Broaden usage of the HPC systems Evolution of 863’s emphasis • 2006: from high performance to high productivity – Emphasize other metrics such as programmability, program portability, and reliability besides peak performance • Current: from HPC environment to HPC application service environment – Emphasize integrated efforts on HPC systems, HPC environment, and HPC applications – Explore new mechanisms and business models for HPC services
    [Show full text]
  • The Path to Petascale Computing in China
    The Path to Petascale ComputingTitle in China XueXue--binbin Chi Unit Name SuperComputing Center, CNIC, CAS DateDecember 9-9-10,10, 2010, Tokyo, Japan Supercomputing Center of Chinese Academy of Sciences Outline Overview the HPC History of China Brief Introduction of SCCAS Grid environment overview Applications in science and engineering Future Plan on high performance environment Supercomputing Center of Chinese Academy of Sciences Overview the HPC History of China 1.Started in the late of 1980’s 2.Deve lop ing i n th e 1990’ s Supercomputing Center of Chinese Academy of Sciences Parallel computers (1988‐1994) BJ‐01 (1988‐1992) – 4 processors, with global and local memmory, made by ICT, CAS Transputers (1991‐1994) – Several parallel systems, our group had a 17 transputer system KJ 8950 (1993‐1995) – 16 processors, with global and local memmory, made by ICT, CAS 1995 1st parallel computer Dawning 1000 occurred – Peak performance 2.5GFLOPS in single precision, HPL 50% – Similar to Paragon machine, NX parallel implementation environment – Intel i860 Supercomputing Center of Chinese Academy of Sciences National High Performance computing Centers (1996‐2000) National High Performance computing Center (Beijing) – In Institute of computing technology, CAS National High Performance computing Center (Wuhan) – Huazhong University of Science and Technology National High Performance computing Center (Chengdu) – Southwest Jiaotong University National High Performance computing Center ()(Hefei) – University of Science and Technology of China
    [Show full text]