HPC Advisory Council March 21, 2016 Calista Redmond President, OpenPOWER Foundation Director, IBM OpenPOWER Global Alliances [email protected] @Calista_Redmond © 2016 OpenPOWER Foundation Data is the new basis of competitive value Oil & Gas Healthcare Retail Banking 2 © 2016 OpenPOWER Foundation Data is growing exponentially and demands new system approaches (technology and strategy) 44 zettabytes unstructured data You are here structured data 2010 2020 3 © 2016 OpenPOWER Foundation Data on the Rise and is the New Basis of Competitive Value . The world is awash in data – sensor, modeling, social . Pools of dark data – collected but un-analyzed Oil and Gas Genomics Financial Analysis Personalized medicine •15 PBs of survey data • Next Gen Sequence data doubling •10+ months to process new survey • 4 TB/day every 5 months data once acquired • 10k to 100k databases • Some leading institutions @ •100x compute needed for deep water • Multi PB volume >100PB in 1-2 years imaging • 400M tasks per day • Projects increasingly National •Network and high bandwidth storage • <100ms response required scale (UK, China, UAE, US) intensive • Tight coupling of near real time • Large cluster and Large SMP •Long term storage needs analytics and trading systems to needs •Multi-TB data sets for visualization underlying data sets. • High performance file system and •1 TB per oilfield per day scalable storage •2 TB per rig per day •80% Dark Data* • Multi-stage workflow process for personalized treatment Firms of all sizes are experiencing data challenges as they focus on insight 4 © 2016 OpenPOWER Foundation From High Performance Computing to High Performance Insights Massive data requirements drive a composable architecture for big data, complex analytics, modeling and simulation. The DCS architecture will appeal to segments experiencing an explosion of data and the associated computational demands Business Business Intelligence Analytics Technical Computing Oil and Gas Financial Social Analytics Analytics Climate & Environment Science Life Sciences Cloud Meets Data Centric Cognitive Systems Big Data • Cloud • Analytics • Watson 5 © 2016 OpenPOWER Foundation OpenPOWER, a catalyst for Open Innovation Market Shifts Moore’s law no longer Growing workload Numerous IT Mature Open satisfies performance gain demands consumption models software ecosystem OpenPOWER Strategy Vibrant ecosystem through open Accelerated innovation through Amplified capabilities driving development collaboration of partners industry performance leadership Industry adoption, Open choice Cloud Computing High Performance Domestic Hyperscale & Large scale Computing & Analytics Datacenters IT Agendas OpenPOWER is an open development community, using the POWER Architecture to serve the evolving needs of customers. 6 © 2016 OpenPOWER Foundation OpenPOWER collaboration with HPC Advisory Council OpenPOWER is pleased to announce our membership in HPCAC • Furthering cross-community collaboration opportunities in HPC Contribution of OpenPOWER systems to HPCAC lab for benchmarking and demonstration • 4 systems 2x 10c with 256GB memory with dual NVIDIA K80 GPU acceleration 7 © 2016 OpenPOWER Foundation 8 © 2016 OpenPOWER Foundation OpenPOWER Development Community 9 © 2016 OpenPOWER Foundation Fueling the OpenPOWER Community 10 © 2016 OpenPOWER Foundation OpenPOWER Foundation reach 190+ members 20+ technologies revealed 24 countries 6 continents 100+ innovations under way 11 © 2016 OpenPOWER Foundation So what? What difference does it make? 12 © 2016 OpenPOWER Foundation POWER8: Processor Performance Leadership & Accelerator Interfaces Faster Cores Larger Caches 3x Higher Memory 8 Threads Per Core Direct Accelerator Bandwidth, 1 TB Interconnect Memory per Socket POWER8 12 Cores, 96 Threads DRAM Memory 4 Level Large Caches Chips Buffer Up to 1 TB per socket Up to 230 GB/s sustained 13 © 2016 OpenPOWER Foundation Accelerates Technology roadmap Mellanox Interconnect Connect-IB ConnectX-4 ConnectX-5 FDR Infiniband EDR Infiniband Next-Gen Infiniband PCIe Gen3 CAPI over PCIe Gen3 Enhanced CAPI over PCIe Gen4 NVIDIA GPUs Kepler Pascal Volta PCIe Gen3 NVLink Enhanced NVLink POWER8 POWER8 with NVLink POWER9 IBM CPUs OpenPower Enhanced CAPI Interface CAPI & NVLink 2015 2016 2017 IBM Systems 14 © 2016 OpenPOWER Foundation Application Benchmarks 15 © 2016 OpenPOWER Foundation Portfolio of HPC Solutions • High Performance Processors & Systems Processors & • Accelerator, networking, storage integration via CAPI & NVLink Systems • Innovative solutions like CAPI Flash • Platform LSF & Symphony workflow and resource management HPC • Compilers: gcc, IBM XLC, PGI Fortran/C/C++, Java, OpenACC, Software OpenMP • Debuggers, Profilers, Math libraries, MPI & HPC apps High Performance • Highest Performance HPC Storage: Elastic Storage Server File System & • High Performance Spectrum Scale (GPFS) Parallel File System Storage • Flash Storage 16 © 2016 OpenPOWER Foundation IBM Research Paving the Path to Next-Generation HPC Data Centric System Scalable High Programming Enhancing Open Node, & Processor Performance Storage Models for Exascale Interconnects Innovations & File Systems POWER 17 © 2016 OpenPOWER Foundation Cross community collaboration is essential 18 © 2016 OpenPOWER Foundation OpenPOWER and Open Compute Project are teaming to deliver price performance advantage on Power • Contributing OpenPOWER Open Compute reference design via collaboration between IBM and Rackspace. • Contributing OpenPOWER firmware from IBM to ensure fully open opportunity for OpenPOWER Open Compute system • Engaging cross community opportunities via Open Compute role on advisory group to OpenPOWER Foundation along with joint activities 19 © 2016 OpenPOWER Foundation • Over 2,200 Linux ISVs developing on Power Accelerates • 50 IBM Innovation Centers software • Compelling PoCs innovation • Support for little endian applications Big Data & Machine HPC Cloud Mobile Enterprise Learning CHARMM miniDFT GROMACS CTH NAMD BLAST AMBER Bowtie RTM BWA GAMESS FASTA WRF HMMER HYCOM GATK HOMME SOAP3 LES STAC-A2 MiniGhost SHOC AMG2013 Graph500 OpenFOAM Ilog Major Linux Distros 20 © 2016 OpenPOWER Foundation Superior Cloud economics, powering Hyperscale datacenters SoftLayer Bare Metal POWER cloud Rackspace joins OpenPOWER, declares Open Compute OpenPOWER system Docker, OpenStack HEAT, and Chef Server for Power Open Source Docker Bluemix Cloud Integration and SQLDB Services with Power Systems for SOE/SOR integration Power Cloud environments in Europe IBM Watson Developer’s Cloud for cognitive computing www.ibm.com/smarterplanet/us/en/ibmwatson/developers.html Power Dev Cloud free POWER access to ISVs for Porting hwww.ibm.com/partnerworld/wps/servlet/ContentHandler/stg_com_sys_power-development-platform 21 © 2016 OpenPOWER Foundation Accelerates Infrastructure Standards 11 Work Groups 2014 2015 2016 Personalized Medicine Charter Pers Med Integrated Solutions Integrated Solutions Charter CAPI Linux SDK System SW Charter 64b ABI Platform Ref 25g IO Compatibility Charter 25g IO Spec OpenPOWER I/O Charter Sys I/O Enablement Guide CAPI AFU Intf Spec V1 CAPI AFU Intf Spec V2 Accelerator Charter OpenCL SDK Memory Charter OPMB Intf. Spec V1 FSI Specification Charter FSI Spec P8 SP010 P8 2U2S P8+ 1U1S P8+ 2U2S Charter Developer Platform Data Reference Reference Reference OpenPOWER ISA Profile V1 OpenPOWER ISA Profile V2 Charter IO Device Architecture V2 IO Device Architecture V3 HW Architecture Coherent Accel Intf Arch Coherent Accel Intf Arch Compliance Specification Comp Compliance Charter Draft Review WG Spec STD SP010 – Tyan OpenPOWER Customer Reference System AFU – Accelerator Function Unit OPMB – OpenPOWER Memory Bus SDK – Software Developer Kit CAPI – Coherent Accelerator Processor Interface FSI – Field Replaceable Unit (FRU) Service Interface ABI – Application Binary Interface 22 © 2016 OpenPOWER Foundation Engage in the OpenPOWER community Technology and Software Innovators, Integrators, Innovators and Partners End Users INTEREST Strategic imperatives and Discuss areas of collaboration Deep understanding of workload workload demands for and synergy in OpenPOWER. demands and consumption performance and cost preferences of end users. optimization. Sign up for membership and ACTION join a work group. Team with innovators and end Require open software and users to drive requirements, systems with choice and Build technical and business engage in specific projects. flexibility. relationships. Engage directly on system design options. Develop Deliver Deploy collaborative innovations with collaborative innovations with collaborative innovations with OUTCOME compelling value compelling value compelling value 23 © 2016 OpenPOWER Foundation Thank you. Calista Redmond President, OpenPOWER Foundation Director, IBM OpenPOWER Global Alliances [email protected] @Calista_Redmond 24 © 2016 OpenPOWER Foundation People Can't Stop Talking About OpenPOWER According to results shared at the STAC Summit on June 4, an IBM Both the current results and future potential are so promising that we are Power8-based system server delivered more than twice the preparing to build an OpenPOWER-based, Open Compute platform. “performance of the best-in-class x86 counterpart when running a set “And it will run OpenStack services. - Aaron Sullivan, Senior Director & of standard financial industry benchmarks. - HPC Wire Distinguished Engineer, Rackspace We estimate that a physical Power Systems server can support “People ask me if we would switch to Power, and the answer is twice as many