Front cover IBM Power System S824L Technical Overview and Introduction Linux server built on OpenPOWER technologies Ready for scientific, Java, and Big Data & Analytics workloads Dual NVIDIA GPU accelerators supported Alexandre Bicas Caldeira YoungHoon Cho James Cruickshank Bartłomiej Grabowski Volker Haug Andrew Laidlaw Seulgi Yoppy Sung ibm.com/redbooks Redpaper International Technical Support Organization IBM Power System S824L Technical Overview and Introduction December 2014 REDP-5139-00 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. First Edition (December 2014) This edition applies to IBM Power System S824L (8247-42L) servers. © Copyright International Business Machines Corporation 2014. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . vii Trademarks . viii Preface . ix Authors. ix Now you can become a published author, too! . .x Comments welcome. xi Stay connected to IBM Redbooks . xi Chapter 1. General description . 1 1.1 Power S824L server . 2 1.2 NVIDIA Tesla GPU Accelerators. 3 1.2.1 NVIDIA CUDA. 5 1.3 Operating environment . 5 1.4 Physical package . 6 1.5 Server features . 7 1.5.1 Server features for a Power S824L with a NVIDIA GPU. 7 1.5.2 Server features for a Power S824L without a GPU. 8 1.5.3 Minimum features . 8 1.5.4 Power supply features . 8 1.5.5 Processor module features . 9 1.5.6 Memory features . 9 1.6 PCIe slots . 10 1.7 Disk and media features . 11 1.8 I/O drawers for Power S824L server. 13 1.8.1 PCIe Gen3 I/O expansion drawer . 14 1.8.2 I/O drawers and usable PCI slot . 15 1.8.3 EXP24S SFF Gen2-bay drawer . 16 1.9 Server and virtualization management . 17 1.10 System racks. 18 1.10.1 IBM 7014 Model T00 rack. 18 1.10.2 IBM 7014 Model T42 rack. 19 1.10.3 IBM 42U Slim Rack 7965-94Y . 21 1.10.4 Feature code 0551 rack . 21 1.10.5 Feature code 0553 rack . 21 1.10.6 Feature code ER05 rack . 21 1.10.7 AC power distribution unit and rack content . 22 1.10.8 Rack-mounting rules . 24 1.10.9 Useful rack additions. 24 1.10.10 OEM rack . 24 Chapter 2. Architecture and technical overview . 27 2.1 The IBM POWER8 processor . 28 2.1.1 POWER8 processor overview. 28 2.1.2 POWER8 processor core . 31 2.1.3 Simultaneous multithreading. 32 2.1.4 Memory access. 32 2.1.5 On-chip L3 cache innovation and Intelligent Cache . 33 2.1.6 L4 cache and memory buffer . 34 © Copyright IBM Corp. 2014. All rights reserved. iii 2.1.7 Hardware transactional memory . 35 2.1.8 Coherent Accelerator Processor Interface . 36 2.1.9 Power management and system performance . 37 2.1.10 Comparison of the POWER8, POWER7+, and POWER7 processors . 38 2.2 Memory subsystem . 38 2.2.1 Custom DIMM . 39 2.2.2 Memory placement rules. 40 2.2.3 Memory bandwidth . 41 2.3 System bus . 44 2.4 Internal I/O subsystem . 45 2.4.1 Slot configuration . 45 2.4.2 System ports . 46 2.5 PCI adapters . 47 2.5.1 PCI Express . 47 2.5.2 LAN adapters . 48 2.5.3 SAS adapters . 48 2.5.4 Graphics accelerator adapters . 49 2.5.5 Fibre Channel adapters . 49 2.5.6 Fibre Channel over Ethernet. 50 2.5.7 Asynchronous and USB adapters. 51 2.5.8 Cryptographic coprocessor . 51 2.5.9 Field-programmable gate array adapters . 51 2.5.10 Compute Intensive Accelerator. 52 2.5.11 Flash storage adapters . ..