SUSE and Lenovo Deliver Some of the World's Most Powerful

Total Page:16

File Type:pdf, Size:1020Kb

SUSE and Lenovo Deliver Some of the World's Most Powerful White Paper SUSE Linux Enterprise Server for High Performance Computing SUSE Enterprise Storage SUSE and Lenovo Deliver Some of the World’s Most Powerful Supercomputers Table of Contents page Put the Power of High-Performance Computing to Work for Your Business...........................................................................................................2 The Changing Face of HPC ..............................................................................................................2 Why SUSE and Lenovo? ..........................................................................................................................3 Get the Best of HPC without the Hassle .............................................................3 Components of the SUSE-Lenovo Solution ................................................3 Make the Most of HPC with SUSE and Lenovo .....................................5 White Paper SUSE and Lenovo Deliver Some of the World’s Most Powerful Supercomputers Put the Power of High- Performance Computing to Work for Your Business The demand for high-performance computing (HPC) has grown beyond its traditional home of research institutions and government labs. Today, enterprises of all sizes are realizing the value of HPC for a variety of tasks, such as financial forecasting, physical simulations, fraud detection, business intelligence, engineering, marketing and personalized medicine—and the most common use, data analytics. With an HPC infrastructure, enterprises more cost-effective for enterprises, and for Analyze or develop large data sets. can leverage massive volumes of data to the first time, they can benefit from those Develop the AI applications of the quickly solve large and complex problems powerful capabilities while staying within future. like modeling or simulations. SUSE and budget. Monitor and profile consumer trends. Lenovo have partnered to offer a com- Create computer visualizations. prehensive HPC infrastructure that can get HPC is being used in many industries, Carry out simulations or modeling of you started quickly and easily. mostly where organizations have a lot of complex processes. data or complex projects to complete, in- The Changing Face of HPC cluding energy, oil and gas; healthcare and As more enterprises move to HPC, it’s HPC is now almost entirely Linux based. In life sciences; higher education and research; becoming clear that not all HPC systems fact, 100 percent of Supercomputing’s Top finance; and manufacturing, and in the de- are created equal. That’s why SUSE and 500 supercomputers run Linux.* Where velopment of artificial intelligence (AI). Lenovo developed their joint solution. Our HPC systems were once large, specialized aim is to empower you to spend more systems used in labs, they are now mostly Enterprises employ HPC for a variety of time on the work that matters, and we do composed of very large Linux clusters of tasks, including to: that by delivering the most HPC compute small, standard systems. This makes HPC power and capacity possible at the low- __________ Develop and redesign products. est cost and energy usage—plus provid- Optimize production and delivery ing ease of use and expert support from * www.top500.org/statistics/details/osfam/1 processes. industry leaders. 2 Why SUSE and Lenovo? than 3.2 trillion calculations per second, Get popular OpenHPC packages SUSE and Lenovo are uniquely positioned pro viding a total cluster capacity of 11.1 pet- with technical support and added in the HPC space. Both companies were aflops. It’s more impressive when you con- functionality from leading technology OpenHPC founding members and con- sider that the cluster was delivered, wired, providers. tinue to be major contributors in the open and up and running before Intel announced Get robust, high-capacity HPC source HPC community. the processor to the general public. infrastructure in a small footprint. Reduce the cost and risk of HPC investments by expanding the SUSE® software runs on 50 percent of the Lenovo built the first warm-water-cooled world’s top 50 largest supercomputers, supercomputer together with the Leibniz capabilities of existing infrastructure and SUSE Linux Enterprise Server is the Supercomputing Centre, or LRZ. The new components. only Linux distribution that includes sup- SuperMUC-NG installation will provide Simplify administration with a single ported HPC packages within the distribu- LRZ with a staggering 26.7 petaflop com- platform that lets you efficiently tion. The SUSE High Performance Module pute capacity powered by almost 6,500 manage HPC and AI workloads. refresh cycle helps you keep up with rap- nodes of Lenovo’s next-generation Think- Build storage that scales affordably idly evolving HPC technologies and avoid System SD650 servers—all in a smaller to support your HPC system. Take advantage of expert extensive retesting of your platform. data center footprint with drastically re- configuration and implementation duced energy usage. Lenovo is one of the fastest-growing HPC services to ensure that all components work together seamlessly. providers in the Top 500 HPC, coming sec- The joint SUSE-Lenovo HPC solution uses ond worldwide and first in China. It’s also the OpenHPC components for flexibility and leading Top 500 supercomputer provider lower total cost of ownership (TCO). It Components of the in Italy, Spain, China, Norway, Germany and also provides supported versions of the SUSE-Lenovo Solution Denmark. Lenovo took home five HPCwire most popular OpenHPC packages, such SUSE Linux Enterprise Server for “Best of HPC” awards at SuperComputing as SLURM for workload management and High Performance Computing 2017, including best HPC server for the job scheduling. In addition to supporting The SUSE Linux Enterprise Server for High ThinkSystem SD530 and best HPC storage popular software components, the solu- Performance Computing is the same dis- product for Lenovo Distributed Storage tion is enabled with best-of-breed fabrics, tribution as SUSE Linux Enterprise Server, Solution for IBM Spectrum Scale (DSS-G). including Ethernet, InfiniBand and Intel but it is sold with different terms, condi- Omni-Path Architecture fabrics, to deliver tions and prices that are tailored for the Together, Lenovo and SUSE worked with the best performance for your demand- unique requirements of HPC environments. the Barcelona Supercomputing Center ing workloads. to develop MareNostrum 4, the highest- It includes the SUSE HPC Module with performing supercomputer in the world And finally, SUSE and Lenovo are continu- high-demand packages for HPC work- based on next-generation Intel Xeon Scal- ally working together to refine their HPC loads. These are packages that are a part able processors. Each of the 3,456 Lenovo offerings. The Lenovo HPC team identifies of the OpenHPC stack, but unlike the ThinkSystem SD530 nodes performs more a rising need for particular features and ca- software available through OpenHPC, all pabilities, and SUSE integrates those into packages in the SUSE module come with its HPC module. enterprise support from SUSE. Together, SUSE and Lenovo deliver the most HPC compute power and Get the Best of HPC Packages in the HPC module include (but are not limited to): capacity possible at the lowest without the Hassle With SUSE and Lenovo, you can realize cost and energy usage—plus Console access: conman 0.2.7 the powerful potential of HPC without CPU identification: cpuid 20151017 providing ease of use and expert the difficult implementation and manage- (x86-64) support from industry leaders. ment. The solution allows you to: Portable hardware locality: hwloc 1.11.5 www.suse.com 3 White Paper SUSE and Lenovo Deliver Some of the World’s Most Powerful Supercomputers User environment management: Lenovo Hardware percent better performance and up to 50 lua-lmod 6.5.11 SUSE Linux Enterprise Server for High percent energy savings compared to air- File system library: lua-luafilesystem Performance Computing runs on Lenovo’s cooled systems. 1.6.3 award-winning servers, which are spe- Bindings for POSIX APIs: lua-luaposix cifically designed for high-performance 33.2.1 workloads. Whether you’re looking for en- Terminal management: lua-luaterm 0.7 ergy efficiency, highly dense computing, Memory allocation: memkind 1.7.0 reduced TCO or GPU-enabled hybrid so- (x86-64) lutions, the Lenovo ThinkSystem portfolio Remote shell programs: mrsh 2.12 has a wide array of options: Authentication service: munge 0.5.12 ThinkSystem SR650 Parallel remote commands: pdsh 2.31 —With its unique Power management for clusters: AnyBay design—which allows for mul- powerman 2.3.24 tiple storage types in the same drive Parallel task executor: prun 1.0 bay, including front-accessible Peripheral Monitor kernel RAS: rasdaemon 0.5.7 Component Interconnect Express (PCIe) Workload manager: slurm 16.5.5.1 solid-state drives—this server lets you flex- ibly configure your storage the way you want it. SUSE has a flexible release schedule for ThinkSystem SD530—This ultradense two- the HPC module. Releases are indepen- unit, four-node platform delivers more dent of the base SUSE operating system compute power in less space and sup- service pack schedule, allowing SUSE to ports the use of GPUs for diverse workload update the module more frequently so you requirements. get the latest HPC technology as quickly as possible. ThinkSystem SR630—Ideal for manage- SUSE Package Hub ment nodes, the two-unit SR650 has ex- The SUSE Package Hub offers access to tensive memory and storage
Recommended publications
  • Barcelona Supercomputing Center Puts Beauty of HPC on Display
    CASE STUDY High Performance Computing (HPC) Beauty and High Performance Computing Under Glass at Barcelona Supercomputing Center Intel® Omni-Path Architecture and Intel® Xeon® Scalable Processor Family enable breakthrough European science using 13.7 petaFLOPS MareNostrum 4 Challenge MareNostrum 4 In publicly and privately funded computational science research, dollars (or • Spain’s 13.7 petaFLOPS Euros in this case) follow FLOPS. And when you’re one of the leading computing supercomputer contributes centers in Europe with a reputation around the world of highly reliable, leading- to the Partnership for edge technology resources, you look for the best in supercomputing in order to Advanced Computing in continue supporting breakthrough research. Thus, Barcelona Supercomputing Europe (PRACE) and supports Center (BSC), or Centro Nacional de Supercomputación, is driven to build leading the Spanish Supercomputing supercomputing clusters for its research clients in the public and private sectors. Network (RES) “We have the privilege of users coming back to us each year to run their projects,” said Sergi Girona, BSC’s Operations Department Director. “They return because we • 3,456 nodes of Intel® Xeon® reliably provide the technology and services they need year after year, and because Scalable Processors, plus our systems are of the highest level.” 0.5 petaFLOPS cluster of Intel® Xeon Phi™ Processors Supported by the Spanish and Catalan governments and funded by the Ministry (codenamed Knights Landing of Economy and Competitiveness with €34 million in 2015, BSC sought to take its MareNostrum 3 system to the next-generation of computing capabilities. It and Knights Hill) specified multiple clusters for both general computational needs of ongoing • Intel® Omni-Path Architecture research, and for development of next-generation codes for many integrated core interconnects multiple (MIC) supercomputing and tools for the Exascale computing era.
    [Show full text]
  • TOP500 Supercomputer Sites
    7/24/2018 News | TOP500 Supercomputer Sites HOME | SEARCH | REGISTER RSS | MY ACCOUNT | EMBED RSS | SUPER RSS | Contact Us | News | TOP500 Supercomputer Sites http://top500.org/blog/category/feature-article/feeds/rss Are you the publisher? Claim or contact Browsing the Latest Browse All Articles (217 Live us about this channel Snapshot Articles) Browser Embed this Channel Description: content in your HTML TOP500 News Search Report adult content: 04/27/18--03:14: UK Commits a 0 0 Billion Pounds to AI Development click to rate The British government and the private sector are investing close to £1 billion Account: (login) pounds to boost the country’s artificial intelligence sector. The investment, which was announced on Thursday, is part of a wide-ranging strategy to make the UK a global leader in AI and big data. More Channels Under the investment, known as the “AI Sector Deal,” government, industry, and academia will contribute £603 million in new funding, adding to the £342 million already allocated in existing budgets. That brings the grand total to Showcase £945 million, or about $1.3 billion at the current exchange rate. The UK RSS Channel Showcase 1586818 government is also looking to increase R&D spending across all disciplines by 2.4 percent, while also raising the R&D tax credit from 11 to 12 percent. This is RSS Channel Showcase 2022206 part of a broader commitment to raise government spending in this area from RSS Channel Showcase 8083573 around £9.5 billion in 2016 to £12.5 billion in 2021. RSS Channel Showcase 1992889 The UK government policy paper that describes the sector deal meanders quite a bit, describing a lot of programs and initiatives that intersect with the AI investments, but are otherwise free-standing.
    [Show full text]
  • Interconnect Your Future Enabling the Best Datacenter Return on Investment
    Interconnect Your Future Enabling the Best Datacenter Return on Investment TOP500 Supercomputers, November 2015 InfiniBand FDR and EDR Continue Growth and Leadership The Most Used Interconnect On The TOP500 Supercomputing List EDR InfiniBand Now Used in 4 Systems on the List, with More EDR Systems Being Deployed by End of 2015 Will Result in More Than 2X the Number of EDR Systems Worldwide Compared to June 2015 . Mellanox Delivers Up To 99.8% System Efficiency with InfiniBand, 4X higher versus Ethernet • Delivering highest datacenter return on investment . For the first time many Chinese-based Ethernet Cloud/Web2.0 systems submitted and ranked on the list • Altering the trends perspective of high-performance computing systems on the TOP500 for Ethernet/InfiniBand connectivity © 2015 Mellanox Technologies 2 TOP500 Performance Trends 76% CAGR . Explosive high-performance computing market growth . Clusters continue to dominate with 85% of the TOP500 list Mellanox InfiniBand Solutions Provide the Highest Systems Utilization on the TOP500 © 2015 Mellanox Technologies 3 TOP500 Major Highlights . InfiniBand is the most used interconnect on the TOP500 list, with 237 systems, or 47.4% of the list . FDR InfiniBand is the most used technology on the TOP500 list, connecting 163 systems • 16% increase from Nov’14 to Nov’15 . EDR InfiniBand now used in 4 systems on the List, with more EDR systems being deployed by end of 2015 • More than 2X the number of EDR systems expected compared to July 2015 . InfiniBand enables the most efficient system on the list with 99.8% efficiency – record! • Delivering highest datacenter Return on Investment, 4X higher than 10GbE, 33% higher than Cray interconnect • InfiniBand enables the top 9 most efficient systems on the list, and 28 of the TOP30 .
    [Show full text]
  • Towards On-Demand I/O Forwarding in HPC Platforms Jean Luca Bez, Francieli Zanon Boito, Alberto Miranda, Ramon Nou, Toni Cortes, Philippe Navaux
    Towards On-Demand I/O Forwarding in HPC Platforms Jean Luca Bez, Francieli Zanon Boito, Alberto Miranda, Ramon Nou, Toni Cortes, Philippe Navaux To cite this version: Jean Luca Bez, Francieli Zanon Boito, Alberto Miranda, Ramon Nou, Toni Cortes, et al.. Towards On-Demand I/O Forwarding in HPC Platforms. PDSW 2020 : 5th IEEE/ACM International Parallel Data Systems Workshop, Nov 2020, Atlanta, Georgia / Virtual, United States. hal-03150024 HAL Id: hal-03150024 https://hal.inria.fr/hal-03150024 Submitted on 23 Feb 2021 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Towards On-Demand I/O Forwarding in HPC Platforms Jean Luca Bez1, Francieli Z. Boito2, Alberto Miranda3, Ramon Nou3, Toni Cortes3,4, Philippe O. A. Navaux1 1Institute of Informatics, Federal University of Rio Grande do Sul (UFRGS) — Porto Alegre, Brazil 2LaBRI, University of Bordeaux, Inria, CNRS, Bordeaux-INP – Bordeaux, France 3Barcelona Supercomputing Center (BSC) — Barcelona, Spain 4Polytechnic University of Catalonia — Barcelona, Spain fjean.bez, [email protected], [email protected], falberto.miranda,[email protected], [email protected] Abstract—I/O forwarding is an established and widely-adopted accommodate larger applications and more concurrent jobs, technique in HPC to reduce contention and improve I/O the PFS is not able to keep providing performance due to performance in the access to shared storage infrastructure.
    [Show full text]
  • BSC Roadmap for HPC in Europe
    BSC roadmap for HPC in Europe Prof. Mateo Valero Director, Barcelona Supercomputing Center Some societal challenges • Ageing population • Climate change • Cybersecurity • Increasing energy needs • Intensifying global competition Images courtesy of The PRACE Scientific Steering Committee, “The Scientific Case for Computing in Europe 2018-2026” Top10, Nov 2018 Rmax Rpeak GFlops Rank Name Site Manufacturer Country Cores Accelerators [TFlop/s] [TFlop/s] /Watts DOE/SC/Oak Ridge 1 Summit IBM US 2,397,824 2,196,480 143,500 200,795 14.67 National Laboratory DOE/NNSA/Lawrence 2 Sierra IBM/NVIDIA US 1,572,480 1,382,400 94,640 125,712 12.72 Livermore National Lab. Sunway National Supercomputing 3 NRCPC China 10,649,600 93,015 125,436 6.05 TaihuLight Center in Wuxi National Super Computer 4 Tianhe-2ª NUDT China 4,981,760 4,554,752 61,445 100,679 3.33 Center in Guangzhou Swiss National 5 Piz Daint Cray Inc. Switz 387,872 319,424 21,230 27.154.3 8.90 Supercomputing Centre 6 Trinity DOE/NNSA/LANL/SNL Cray Inc. US 979,072 20,158,7 41,461 2.66 AI Bridging National Inst. of Adv 7 Fujitsu Japan 391,680 348,160 19,880 32,577 12.05 Cloud Inf. Industrial Science & Tech. German 8 SuperMUC-NG Leibniz Rechenzentrum Lenovo 305,856 19,477 28,872,86 y DOE/SC/Oak Ridge 9 Titan Cray Inc. US 560,640 261,632 17,590 27,113 2.14 National Laboratory DOE/NNSA/Lawrence 10 Sequoia IBM US 1,572,864 17,173 20,133 2.18 Livermore National Lab.
    [Show full text]
  • European Processor Initiative & RISC-V
    European Processor Initiative & RISC-V Prof. Mateo Valero BSC Director 9/May/2018 RISC-V Workshop, Barcelona Barcelona Supercomputing Center Centro Nacional de Supercomputación BSC-CNS objectives Supercomputing services R&D in Computer, PhD programme, to Spanish and Life, Earth and technology transfer, EU researchers Engineering Sciences public engagement Spanish Government 60% BSC-CNS is a consortium Catalan Government 30% that includes Univ. Politècnica de Catalunya (UPC) 10% People and Resources Data as of 31st of December 2017 Context: The international Exascale challenge • Sustained real life application performances, not just Linpack… • Exascale will not just allow present solutions to run faster, but will enable new solutions not affordable with today HPC technology • From simulation to high predictability for precise medicine, energy, climate change, autonomous driven vehicles… • The International context (US, China, Japan and EU…) • The European HPC programme • The European Processor initiative • BSC role Top5 November 2017 list (compact view) Rank Site Computer Procs Rmax Rpeak Mflops/Watt 1 Wuxi, China Sunway SW26010 260C 10.649.600 93.015 125.436 6.051 3.120.000 2 Guangzhou, China Xeon E5-2692+Phi 33.863 54.902 1.902 2736000 361.760 3 CSCS, Switzerland Cray XC50, Xeon E2690 12C+P100 19.590 25.326 8.622 297920 19860000 4 JAMEST, Japan ZettaScaler Xeon D-1571, PEZY-SC2 19.135 28.192 14.173 19840000 560.640 5 DOE/SC/Oak Ridge, US Cray XK7, Opteron 16C+K20 17.590 27.113 2.143 261632 6 DOE/NNSA/LLNL, US BlueGene/Q, BQC 16C 1.572.864
    [Show full text]
  • Artificial Intelligence Understanding Its Applications, Value and Where to Begin
    Intelligent Transformation in the Data Centre Sumir Bhatia | 16 September 2018 President, Asia Pacific – Lenovo Data Canter Group @Sumir_Bhatia 2018 Lenovo Internal. All rights reserved. The Reality We All Face Cloud Transformation Private, hybrid, and public models offer on-demand delivery of resources and applications. Cybersecurity Business impact of security incidents and regulatory compliance. Performance data & analytics Speed-of-insight, actionable business intelligence. Customer Experience Deliver real customer benefit through reliability and trusted partnerships. Artificial Intelligence Understanding its applications, value and where to begin. 2018 Lenovo Internal. All rights reserved. 2018 Lenovo. All rights reserved. Data Centre Group Be the most trusted data centre partner – empowering customers’ Intelligent Transformation and solving humanity’s greatest challenges. INNOVATION FOCUS N O L E G A C Y DEEP PARTNERSHIPS #1 #1 #1 #1 88 #26 Customer TOP500 World Record X86 Server SAP Hana Gartner global Satisfaction Supercomputing & benchmarks reliability performance supply chain TBR - Lenovo's 5 yrs. running fastest growing HPC overall satisfaction company again surpassed scores for Dell 2,000 EMC and HPE 100 20M+ 25 Developers across 7 Years in the Servers per hour Servers shipped global labs data center 5 10,000 #1 6 Nationalities on Service TOP500 Owned/controlled 2018 Lenovo Internal. All rights reserved. DCG SLT professionals Supercomputing manufacturing sites AI & HPC The future is here today 2018 Lenovo Internal. All rights reserved. 4 $1.2 Trillion The expected amount of business that more agile AI-enabled companies will take from less informed peers. 2018 Lenovo Internal. All rights reserved. 5 Beyond The Buzzwords – What is AI? Artificial Intelligence Machines performing tasks in ways that are intelligent.
    [Show full text]
  • Infiniband Strengthens Leadership As the Interconnect of Choice by Providing Best Return on Investment
    InfiniBand Strengthens Leadership as the Interconnect Of Choice By Providing Best Return on Investment TOP500 Supercomputers, July 2015 TOP500 Performance Trends 76% CAGR . Explosive high-performance computing market growth . Clusters continue to dominate with 87% of the TOP500 list Mellanox InfiniBand solutions provide the highest systems utilization in the TOP500 for both high-performance computing and clouds © 2015 Mellanox Technologies 2 TOP500 Major Highlights . InfiniBand is the de-facto Interconnect solution for High-Performance Computing • Positioned to continue and expand in Cloud and Web 2.0 . InfiniBand connects the majority of the systems on the TOP500 list, with 257 systems • Increasing 15.8% year-over-year, from 222 system in June’14 to 257 in June’15 . FDR InfiniBand is the most used technology on the TOP500 list, connecting 156 systems . EDR InfiniBand has entered the list with 3 systems . InfiniBand enables the most efficient system on the list with 99.8% efficiency – record! . InfiniBand enables the top 17 most efficient systems on the list . InfiniBand is the most used interconnect for Petascale systems with 33 systems © 2015 Mellanox Technologies 3 InfiniBand in the TOP500 . InfiniBand is the most used interconnect technology for high-performance computing • InfiniBand accelerates 257 systems, 51.4% of the list . FDR InfiniBand connects the fastest InfiniBand systems • TACC (#8), NASA (#11), Government (#13, #14), Tulip Trading (#15), EDRC (#16), Eni (#17), AFRL (#19), LRZ (#20) . InfiniBand connects the most powerful
    [Show full text]