3Rd Gen Intel® Xeon® Scalable Platform Technology Preview
Total Page:16
File Type:pdf, Size:1020Kb
Performance made flexible. 3rd Gen Intel® Xeon® Scalable Platform Technology Preview Lisa Spelman Corporate Vice President, Xeon and Memory Group Data Platforms Group Intel Corporation Unmatched Portfolio of Hardware, Software and Solutions Move Faster Store More Process Everything Optimized Software and System-Level Solutions 3 Announcing Today – Intel’s Latest Data Center Portfolio Targeting 3rd Gen Intel® Xeon® Scalable processors Move Faster Store More Process Everything Intel® Optane™ SSD P5800X Fastest SSD on the planet 3rd Gen Intel® Xeon® Scalable Intel® Optane™ Persistent processor Memory 200 series Intel® Ethernet E810- Intel’s highest performing server CPU 2CQDA2 Up to 6TB memory per socket with built-in AI and security solutions + Native data persistence Up to 200GbE per PCIe 4.0 slot for Intel® Agilex™ FPGA bandwidth-intensive workloads Intel® SSD D5-P5316 First PCIe 4.0 144-Layer QLC Industry leading FPGA logic performance and 3D NAND performance/watt Enables up to 1PB storage in 1U Optimized Solutions >500 Partner Solutions 4 World’s Most Broadly Deployed Data Center Processor From the cloud to the intelligent edge >1B Xeon Processor Cores Deployed in the >50M Cloud Since 20131 Intel® Xeon® >800 cloud providers Scalable Processors with Intel® Xeon® processor-based servers Shipped deployed1 Intel® Xeon® Scalable Processors are the Foundation for Multi-Cloud Environments 1. Source: Intel internal estimate using IDC Public Cloud Services Tracker and Intel’s Internal Cloud Tracker, as of March 1, 2021. 5 Why Customers Choose Intel Delivering workload-optimized performance Platform Features Comprehensive Portfolio AI Capabilities >2X more TLS requests Realized 2:1 server consolidation 1.8X performance improvement processed with new Intel Crypto while quickly accessing and re- for Monte Carlo simulation with no acceleration for fast, predictable formatting images and video accuracy loss using Intel DL response and lower TCO using Intel Xeon processors, Intel Boost and oneAPI-optimized Optane and Intel FPGAs software Higher Performance Through Partnership and Co-Engineering Solutions Optimized Software 3.78X faster inference with lower Faster TTM and 20X faster boot Quickly scaled from 8-node POC power and higher utilization after time using Intel’s early access to 68-node full production switching from GPU text programs and engineering COVID-19 research cluster using recognition to Intel® Xeon® support to create SMB continuity Intel Select Solution for processors with optimized and recovery solution Genomics Analytics PyTorch Platform to deliver true flexibility Performance varies by use, configuration and other factors. Configurations see appendix [45] 6 INTRODUCING 3rd Gen Intel® Xeon® Scalable processors Built specifically for our customers’ needs Optimized for Cloud, Enterprise, HPC, 5G and Edge Built-in security with Intel Software Guard Extensions, Platform Firmware Resilience and Total Memory Encryption Only data center processor with built-in AI (Intel DL Boost) Built-in crypto acceleration reduces the performance impact of pervasive encryption 7 INTRODUCING 3rd Gen Intel® Xeon® Scalable processors Performance made flexible Up to 40 cores per processor 20% IPC improvement 28 core, ISO Freq, ISO compiler 1.46x average performance increase Geomean of Integer, Floating Point, Stream Triad, LINPACK 8380 vs. 8280 1.74x AI inference increase 8380 vs. 8280 BERT Intel 10nm Process 2.65x average performance increase vs. 5-year-old system 8380 vs. E5-2699v4 Performance varies by use, configuration and other factors. Configurations see appendix [1,3,5,55] 8 INTRODUCING 3rd Gen Intel® Xeon® Scalable processors Performance made flexible Only x86 data center processor with built-in Artificial Intelligence Advanced security solutions Scalable, flexible, customizable Intel Software Intel Intel Platform Intel Total Memory Intel Deep Intel Speed Intel Optimized Guard Extensions Crypto Firmware Encryption Learning Boost Select AVX-512 Software Acceleration Resilience Technology Targeted for 1S-2S systems Next-gen Xeon Scalable Platform Breakthrough Data Performance Faster, Flexible,9 Data Scale Up to Up to Up to Up to 6TB 8CH 2.6X 64 System Memory DDR4-3200 Memory Capacity Lanes Intel® Intel® Intel® SSD Intel® Ethernet Intel® Capacity 2 DPC Increase vs. PCI Express Optane™ Optane™ D series 800 series Agilex™ (Per Socket) (Per Socket) 2nd Gen Xeon 4 persistent SSD P5800X network FPGA DRAM + PMem Scalable (per Socket) memory 200 series adapters solutions series 9 Flexible Performance for Most Demanding Workloads Outstanding gen-on-gen performance from intelligent edge to cloud Cloud 5G IoT HPC Artificial Intelligence UP TO UP TO UP TO UP TO UP TO 1.5x 1.62x 1.56x 1.57x 1.74x Improvement in Improvement Image Classification Faster Modeling Language Latency Sensitive in Network and Inference for Critical Vaccine Processing Workloads Communications Improvement Research Inference Workloads Improvements Performance varies by use, configuration and other factors. Configurations see appendix [5,7, 17, 19, 52] 10 3rd Gen Intel® Xeon® Scalable Processors Broad industry adoption Cloud Service Providers OEM/ODMs ▪ All top CSPs planning to deploy services ▪ >250 designs with more than 50 unique OxM partners ▪ Over 200 ISVs and partners have deployed Intel SGX ▪ Broad software and ecosystem readiness to speed faster time to value Network Providers HPC Labs and HPCaaS ▪ >15 major TEMs, OEMs and CoSPs readying POCs or ▪ Over 20 publicly-declared HPC adopters to date initial deployments ▪ HPC solutions coming from all major OEMs ▪ Growing HPCaaS footprint including: >200k units shipped in Q1 2021 11 Only x86 Data Center CPU with Built-in AI Acceleration Artificial intelligence made flexible Vs. Competition Intel Software Optimizations ▪ Up to 25x performance on image recognition ▪ Up to 10x performance improvement with vs. AMD EPYC 7763 TensorFlow for deep learning on ResNet50 ▪ Xeon leads on average across a broad mix of vs. default distro 20 popular AI & ML workloads: ▪ Up to 100x improvement with Scikit-Learn for ▪ Up to 1.5x vs. AMD EPYC 7763 machine learning on SVC/kNN predict vs. the ▪ Up to 1.3x vs. Nvidia A100 GPU default distro Productivity Performance Drive-thru recommendation engine Simplicity Medical imaging solution exceeds using Analytics Zoo to unify end-to-end Automating underground pipe performance requirements using Intel Spark data pipeline on a Xeon-based inspection using a solution developed DL Boost powered by OneAPI cluster with Intel AI Builders partner Wipro 150+ Containers and 200+ Turnkey Solutions Accelerate Development and Deployment Performance varies by use, configuration and other factors. Configurations see appendix [ 26, 28, 29, 36, 54] 12 Intel’s Most Secure, Compliant and Performant Data Center Platform Security made flexible Built-in Intel Software Guard Extensions Introducing New Security Features ▪ Hundreds of customers currently using ▪ Intel Total Memory Encryption for basic bulk Intel SGX to enhance security and enable encryption of the entire memory space to protect business transformation through data privacy against physical attacks ▪ Smallest attack surface of any data center ▪ Intel Platform Firmware Resilience for defending confidential computing technology and recovering the underlying firmware layer to ▪ 4000x* increase in protected enclave size to protect against permanent denial of service 1TB ▪ Among the largest health insurance providers in Germany ▪ Globally $2T is laundered each year and can be used to fund crime or terrorism ▪ Intel SGX selected as Trusted Execution Environment for federated digital health record management serving over 26 ▪ Intel SGX allows banks to share records without revealing million people private customer information and reduce false positives 83% *3rd Gen Intel® Xeon® Scalable processors provides up to 1TB enclave size in a 2S configuration (SKU dependent) vs Xeon E 2100 256MBAOK and Consilient systems initially deployed on Intel® Xeon® E processors 13 Built-in Crypto Acceleration for Encryption-Intensive Workloads Encryption made flexible Intel Crypto Acceleration ▪ New instructions and architectural features parallelize execution of encryption functions ▪ Reduces penalty of implementing pervasive data encryption ▪ Higher throughput with fast and strong encryption for AVX-512 ISA ▪ Increases performance of encryption-intensive workloads such as SSL web server, 5G infrastructure and VPN/firewalls 4.2x 1.94x Encrypted Web Server Vector Packet Processing More TLS encrypted web server connections per More encrypted packets processed per second; second; more content delivered per server higher network and VPN capacity per node Performance varies by use, configuration and other factors. Configurations see appendix [17, 51] 14 The Power of the Intel Portfolio Delivering workload innovation and customer results 5G vRAN Virtual Desktop (VDI) Azure Stack HCI 2x 1.87x 2x mMIMO throughput in a similar More VMs per node power envelope for a best-in- Throughput with lower read class 3x100MHz 64T64R and write latency configuration 300 Compute-intensive VMs per server Performance varies by use, configuration and other factors. Configurations see appendix [39] 15 Intel® Optane™ Persistent Memory 200 Series Persistent memory made flexible eADR (Enhanced Asynchronous DRAM Refresh) Average of improves performance of apps that use persistent higher memory by eliminating “cache flushes” 32% memory bandwidth compared to 100 series Persistent memory ecosystem continues to grow