SPARC S7 Servers

Oracle’s SPARC S7 Servers

Technical Overview

Rainer Schott Oracle Systems Sales Consulting September 2016

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 3 • App Data Integrity SPARC @ Oracle Including • DB Query Acceleration Software in Silicon } • Inline Decompression 7 Processors in 6 Years • More….

2010 2011 2013 2013 2013 2015 2016

SPARC T3 SPARC T4 SPARC T5 SPARC M5 SPARC M6 SPARC M7 SPARC S7

16 x 2nd Gen cores 8 x 3rd Gen Cores 16 x 3rd Gen Cores 16x 3 rd Gen Cores 12 x 3rd Gen Cores 32 x 4th Gen Cores 8 x 4th Gen Cores 4MB L3 Cache 4MB L3 Cache 8MB L3 Cache 48MB L3 Cache 48MB L3 Cache 64MB L3 Cache 16MB L3 cache 1.65 GHz 3.0 GHz 3.6 GHz 3.6 GHz 3.6 GHz 4.1 GHz 4.5 GHz

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential Advancing the State-of-the-Art M7 Microprocessor – World’s First Implementation of Software Features in Silicon

• SQL in Silicon – High-Speed Memory Decompression… – Accelerates In-Memory Database • Always-On Security in Silicon – Memory intrusion detection • High-Speed Encryption – Near zero performance impact

DDR4 M7 DDR4 Interfaces Interfaces

S7 (“Sonoma”)

Scale-Up

PCIe Gen3 Interfaces Scale-Out

1 Overview

2 SPARC S7 Processor Overview

3 Server Details

SPARC S7-2 Server SPARC S7-2L Server Processors 1 or 2 2 Max Cores/Threads (8) 16 / (64) 128 16 / 128 Max Memory 1 1 TB 1 TB Form Factor 1U 2U Max Disk Drives 8 26 PCIe Slots Available 3 6

Integrated Ethernet 4x 10GBase-T 4x 10GBase-T

(1) Maximum memory capacity is based on 64 GB DIMMs.

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 8 SPARC S7 Processor–Based Servers Key Characteristics • Oracle’s SPARC S7 processor: – Software in Silicon features: Same as in Oracle’s SPARC M7 processor – System-on-a-chip design: DDR4 interfaces and PCIe controller • DDR4-2400 memory for high performance • Internal SAS-3 Host Bus Adapter • Onboard support for NVMe flash drives • x8-capable PCIe 3.0 slots • Oracle Integrated Lights Out Manager (Oracle ILOM) management • Oracle Solaris 11.3 or later required – Oracle Solaris 10 1/13 supported in guest domains

SPARC S7-2, 1U 8x 2.5-inch drives 1U; 1 or 2 processors; 16 DIMMs; 1,024 GB DDR4; 3 PCIe 3.0 slots; 17 TB storage (8x 2.5-inch SAS-3 drives, 4x NVMe-enabled bays)

SPARC S7-2L, 2U 8x 2.5-inch drives 2U; 2 processors; 16 DIMMs; 1,024 GB DDR4; 6 PCIe 3.0 slots; 17 TB storage (8x 2.5-inch SAS-3 drives, 4x NVMe-enabled bays)

SPARC S7-2L, 2U 26x 2.5-inch drives 2U; 2 processors; 16 DIMMs; 1,024 GB DDR4; 6 PCIe 3.0 slots; 39 TB storage (24x plus 2x 2.5-inch SAS-3 drives, 4x NVMe-enabled bays)

SPARC S7-2L, 2U 12x 2.5-inch NVMe flash drives 2U; 2 processors; 16 DIMMs; 1,024 GB DDR4; 4 PCIe 3.0 slots; 38 TB NVMe flash storage (12x 2.5-inch NVMe drives)

SPARC S7-2L, 2U 12x 3.5-inch and 2x 2.5-inch drives 2U; 2 processors; 16 DIMMs; 1,024 GB DDR4; 6 PCIe 3.0 slots; ~100 TB storage (12x 3.5-inch drives plus 2x 2.5-inch SAS-3 drives)

• Two SPARC S7 core clusters – Eight processor cores, 64 threads, and 16 MB L3 cache • 4 Data Analytics Accelerator (DAX) units – 4 pipelines per DAX unit, 16 DAX engines • Integrated PCIe 3.0 x16 controller – Supports single x16, dual x8, or quad x4 links • Coherence unit to support 2-socket configuration • Two Memory Control Units (MCU) – Four direct-attached DDR4 channels – 77 GB/sec low-latency bandwidth • Frequency: 4.27 GHz

Glueless 2-way System Interconnect Integrated Memory Integrated DDR4 DIMMs PCIe 3.0 • Fewer components • Fewer links • Lower power Coherence SPARC Links SPARC • Less space S7 S7 • Lower cost Storage Storage PCIe Ethernet Ethernet

SPARC T5 SPARC M7 SPARC S7 Processor Processor Processor Processor Cores 16 32 8 Cache per Core 0.5 MB 2 MB 2 MB Memory Bandwidth per Core 5.0 GB/sec 5.3 GB/sec 6.0 GB/sec Memory Access 163 ns 131 ns 97 ns I/O Bandwidth 32 GB/sec 145 GB/sec 32 GB/sec Processor Frequency 3.60 GHz 4.13 GHz 4.27 GHz

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 15 Required Software Releases for SPARC S7 • Solaris 11.3 FCS (internally, this is S11.3 build 30) – Also contains improvements in virtual memory management (“OSM”) and supports very large page sizes • Oracle 12.1.0.2 plus (MOS doc 2174762.1) – Patch 23273686 - DATABASE PROACTIVE BUNDLE PATCH 12.1.0.2.160719 (JUL2016) – Patch 24353230 - MERGE REQUEST ON TOP OF DATABASE BP 12.1.0.2.160719 FOR BUGS 22091036 23235386 – Patch 23265829 - CPU EFFECTIVE MULTIPLIER CHANGE TO 0.5 DEFAULT – Patch 21249747 - FOLLOWUP FOR BUG 18867241 FOR NON PQ ENABLED QUERIES – Patch 21888938 - CPUSPEEDNW IS UNDER REPORTED ON SPARC • The Oracle In-Memory Database feature must be enabled and the workload must trigger In-Memory processing

Memory Memory • BOTH row and column formats Memory for same table

SALES • Simultaneously active and Compressed Column transactionally consistent SALES SALESFormat Row Column • Analytics & reporting use new Format Format in-memory Column format • OLTP uses proven row format • “Two stage” compression • Column header • Column contents ( “memcompress for ...” )

Decompress Software Multiple Write Read Read

More than Doubles data size scan Write steps t

One SQL: SELECT count(*) DAX

Read step Write 10X …WHERE lo_orderdate = d_datekey …AND lo_partkey = 1059538 faster AND d_year_monthnum BETWEEN 201311 AND 201312 ;

Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 18 In-Memory Comparison (PoC from Poland) Analytical Query on star schema (12 cores) – load generated from 10 users up to 100 users – Intel E5-2699 v3

Without In-memory With In-memory Analytics Accelerator Analytics Accelerator

38 seconds 6X Image Faster 6 seconds

Big Data & DevOps Description Written in Big Data & DevOps Description Written in Oracle Fusion Enterprise Apps Java Akka (REST) REST for Big Data JVM Apache Spark In-memory Analtyics JVM Apache Accumulo key/value store Java Apache Cassandera NoSQL database Java Apache Flink Batch &Stream Processing Java(JVM) Apache Hadoop Disk to disk Map Reduce Java Apache Kafka Streaming Message Broker JVM Apache HDFS filesystem Java Apache log4j Log event manager Java Apache Lucene Doc text Indexing Java Apache Samza Stream processing JVM Apache Solr text/doc/web search Java Apache Storm Stream processing Java & Clojure Jersey/Grizzly (REST) REST Interface Java Apache Yarn Cluster job manager Java Apache Hive SQL on HDFS Java Apache Zookeeper Config & group services Java Neo4j Graph Java H20.ai ML Apps libraries Java, Python,R Scala Language JVM Hbase non-relational database Java

Max jOPS / Core

S7-2 1.7x Faster Java 4,112 4.27 GHz S7 Core

x86 2,402 2.2 GHz E5 v4 Core HPE DL360 G9

SPARC S7-2 (16-core) 65,790 SPECjbb2015-MultiJVM max-jOPS, 35,812 SPECjbb2015-MultiJVM critical-jOPS; HP ProLiant DL360 Gen9 (44-core) 105,690 SPECjbb2015-MultiJVM max-jOPS, 52,952 SPECjbb2015-MultiJVM critical-jOPS

Java SPARC S7’s core enables SPARC S7-2 1.7x dramatic cost reduction E5v4 throughout the cloud OLTP Database SPARC S7-2 1.6x E5v4 Analytics Database Few x86 per core SPARC S7-2 7x performance E5v3 improvements over 4 Memory Bandwidth generations (Sandy Bridge SPARC S7-2 2.0x to Broadwell) E5v4

SPARC S7-2 Oracle Solaris HPE DL360 G9 • 28 Servers RHEL / VMWare • 448 Cores • 8 GB memory per Core • 32 Servers • 768 Cores Plus • 8 GB memory per core • Silicon Secured Memory • Near-Zero Encryption Performance Impact

42% Fewer Cores $1,145 K $614 K Configurations include 3 yr. support, 24x7

SPARC S7-2 Oracle Solaris HPE DL360 G9 • 19 Servers RHEL / VMWare • 304 Cores • 4 GB memory per VM • 32 Servers • 768 Cores Plus • 4 GB memory per VM • Silicon Secured Memory • Near-Zero Encryption Performance Impact

60% Fewer Cores $1,643 per VM $817 per VM Configurations include 3 yr. support, 24x7

• Protects data in memory Pointer “B” • Hidden “color” bits added to GO pointers (key), and content (lock) • Pointer color (key) must match content color or program is aborted Pointer “R” GO • Set on memory allocation , changed on memory free’

• Protects against access off end of Pointer “Y” structure , stale pointer access and malicious attacks

ApplicationsM7 Processor Memory

1) Oracle’s Software enhanced with ADI, e. g. Oracle DB uses ADI on SGA 2) Solaris malloc() enhanced with ADI ( libadimalloc, libumem based) • LD_PRELOAD-able with no application changes • Few assumptions on pointer usage 3) Discover LD_PRELOAD-able ADI library (with options) % LD_PRELOAD=\lib/compilers/sparcv9/libdiscoverADI.so \ ADP_PRECISE_MODE=1 \ # ADI Precise Mode ADP_REPORT_STACK_TRACES=1 \ # Add infos about where the mem. was allocated and freed a.out 4) Studio Discover tool with ADI Find and fix bugs during development • Available today on the SWiSDev cloud, http://swisdev.oracle.com 5) Solaris ADI API • Add ADI to applications • Available on 11.3 Build 6+ and 11.2 SRU 6

8 Cores, 8 Crypto Accelerators per Processor Clear Data In

SPARC S7 Encrypted Data Out

x86 E5 v4 0.9 GB/s Core AES 256-CFB: Popular for Cloud, DB

SPARC S7 3.0 GB/s 7.5x Faster Core x86 E5 v4 0.4 GB/s Core SHA 512: Important for Financial Operations

14,121.46 SECURE EjOps Only 2% Impact with 14,400.78 SPARC S7 UNSECURE EjOps

5,000 10,000 15,000

SPECjEnterprise2010 (see disclosure slide)

VM VM VM VM VM VM VM

VM VM VM VM VM VM VM VM VM

Live VMs in Transit are Fully Encrypted - No Service Loss - No Performance Loss

Silicon Encryption Access Control, Compliance Secured Accelerators Read-Only Reporting, Memory VMs Remote Audits

Protection from attacks against data 8 Cores and in memory, on media or 8 Cryptographic transmitted over the Accelerators per Chip network with virtually no performance impact

• 1U chassis, fits into 900 mm–deep rack • One or two SPARC S7 processors (up to 16 cores/128 threads) • Up to 1,024 GB of DDR4-2400 memory – 4, 8, or 16 DIMMs per system – 16 GB, 32 GB, or 64 GB per DIMM • Eight 2.5-inch hot-pluggable disk drive bays – Up to 8 SAS HDDs/SSDs – Up to 4 NVMe SSDs – Mixing SAS and NVMe drives is supported • One internal 12 Gb/sec SAS-3 HBA • Onboard support for NVMe SSDs • Four 10GBASE-T ports (one onboard quad-port NIC) • 3+1 1 low-profile PCIe 3.0 x8 slots (2 with physical x16 support) • Serial and Ethernet management ports, 2 USB ports • Four hot-swappable N+1 redundant fan modules (top loading) • Two 800 W/1,200 W 2 (output) hot-pluggable power supplies (N+1)

1) One PCIe slot (#4) is internal and reserved for the SAS HBA 2) Power supply output: 800 W when operating at 100–120 VAC, 1,200 W at 200–240 VAC

Locator Front System Indicators LED/Button 4x NVMe–Capable 2x USB 2.0 Drive Bays

SAS1 SAS3/NVMe1 SAS5/NVMe3

SAS0 SAS2/NVMe0 SAS4/NVMe2 SAS6 SAS7

Power RFID/Serial Button Number

3x PCIe 3.0 Slots

PCIe 1 PCIe 2 PCIe 3

RJ45 Serial 2x N+1 Redundant Power Supplies Rear System 4x 10GBase-T Management Port IEC 60320 C13/C14 AC Inlet Indicators 1000Base-T Network Management Port

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 39 SPARC S7-2 Server: Configuration Policy • Single- or dual-processor base packages • Memory DIMM slots on motherboard – Choice of half-populated or fully populated memory (4x or 8x DIMMs per processor) – All DIMMs required to be the same: either 16 GB, 32 GB, or 64 GB • Disk drives – Minimum of one disk drive is required per system, no HBA or controller options required – Mixing of SAS HDDs/SSDs and NVMe SSDs is supported • Fans – Base package includes four N+1 redundant hot-swappable quad-fan modules – System continues to operate with fan failure(s) unless an over-temperature scenario occurs – System will not power-on with a failed fan or a missing fan module • Power supply units (PSUs) – Base package includes two N+1 redundant hot-swappable power supplies – System continues to operate and will power-on with one failed or missing power supply – Requires 100–120 VAC or 200–240 VAC, 50/60 Hz; system warns if an AC cord is not attached

SPARC S7 Processor 0 SPARC S7 Processor 1 PCIe Controller PCIe Controller Port 0 Port 1 Port 0 Port 1

PCIe Switch 1 PCIe Switch 0 Legend: Root Root Root Complex Complex 0 Complex 1 Device Device @2 Device Device @4 Device @5 Device @6 Device @7 Device @1 Device Device @11 Device @12 Device Device @13 Device @14 PCIe SLOT 3 x8 SLOT PCIe PCIe SLOT 1* 1* x8 SLOT PCIe 2* x8 SLOT PCIe NVMe Drive 0x4 Drive NVMe 1x4 Drive NVMe 2x4 Drive NVMe 3x4 Drive NVMe Integrated Devices Integrated Quad 10GBase-T Quadx8 Available PCIe Slots PCIe Available Internal SAS HBA HBA x8 SAS Internal USB/eUSB/rKVMS x1 USB/eUSB/rKVMS

* PCIe slots 1 and 2 are wired for x8 operation with a x16 physical connector

SPARC S7 Processor 0 PCIe Controller Port 0 Port 1

PCIe Switch 1 PCIe Switch 0 Legend: Root Root Root Device Device @4 Complex Complex 0 Complex 0 Device Device @2 Device Device @5 Device @6 Device @7 Device @1 Device Device @11 Device @12 Device Device @13 Device @14 PCIe SLOT1 x8 SLOT1 PCIe x8 SLOT2 PCIe PCIe SLOT3 x8 SLOT3 PCIe NVMe Drive 0x4 Drive NVMe 1x4 Drive NVMe 2x4 Drive NVMe 3x4 Drive NVMe Integrated Devices Integrated Quad 10GBase-T Quadx8 Available PCIe Slots PCIe Available Internal SAS HBA HBA x8 SAS Internal USB/eUSB/rKVMS x1 USB/eUSB/rKVMS

* PCIe slots 1 and 2 are wired for x8 operation with a x16 physical connector

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 46 SPARC S7-2L Server: Overview • 2U chassis, fits into 900 mm–deep rack • Two SPARC S7 processors (16 cores/128 threads) • Up to 1,024 GB of DDR4-2400 memory – 8 or 16 DIMMs per system – 16 GB, 32 GB, or 64 GB per DIMM • Four types of disk drive cage options – Eight 2.5-inch drive bays 1 – 24 front and 2 rear 2.5-inch drive bays 1,2 – Twelve 2.5-inch NVMe drive bays (no SAS drives) – Twelve 3.5-inch and two 2.5-inch drive bays 2 (no NVMe drives) • One internal 12 Gb/sec SAS-3 HBA 3 • Four 10GBASE-T ports (one onboard quad-port NIC) • 6+1 4 low-profile PCIe 3.0 x8 slots (2 with physical x16 support) • Serial and Ethernet management ports, 2 USB ports • Four hot-swappable N+1 redundant fan modules (top loading) • Two 1,200 W (output) hot-pluggable power supplies (N+1) 1) Four drive bays are NVMe-enabled, mixing SAS and NVMe drives is supported 2) All drive bays are supported by the single internal 12 Gb/sec SAS-3 HBA 3) Not included in the 12x NVMe drive configuration 4) One PCIe slot (#7) is internal and reserved for the SAS HBA or an NVMe PCIe switch

SPARC S7-2L with Eight 2.5-Inch Disk Drive Cage Locator 4x NVMe-Capable LED/Button Drive Bays 2x USB 2.0 Front System Indicators Power Button RFID/Serial Number

SPARC S7-2L with Twenty-Four 2.5-Inch Disk Drive Cage 2x NVMe-Capable 2x NVMe-Capable Drive Bays Drive Bays

SPARC S7-2L with Twelve NVMe Disk Drive Cage Locator LED/Button 2x USB 2.0 Front System Indicators Power Button RFID/Serial Number

SPARC S7-2L with Twelve 3.5-Inch Disk Drive Cage

6x PCIe 3.0 Slots Two rear 2.5-inch SAS disk bays included with 24x 2.5-inch and 12x 3.5-inch disk cages only

SAS Drive SAS Drive PCIe 6 PCIe PCIe 3 PCIe PCIe 4 PCIe 5 PCIe PCIe 1 PCIe PCIe 2 PCIe

Rear System 4x 10GBase-T RJ45 Serial 2x N+1 Redundant Power Supplies, Indicators Management Port IEC 60320 C13/C14 AC Inlet 1000Base-T Network Management Port

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 50 SPARC S7-2L Server: Configuration Policy • Server base package includes dual processors • Memory DIMM slots on motherboard – Choice of half-populated or fully populated memory (8x or 16x DIMMs per system) – All DIMMs required to be the same: either 16 GB, 32 GB, or 64 GB • Disk drives – Minimum of one disk drive is required per system, HBA or PCIe switch factory options required – Mixing of SAS HDDs/SSDs and NVMe SSDs is supported in select models • Fans – Base package includes four N+1 redundant hot-swappable dual-fan modules – System continues to operate with fan failure(s) unless an over-temperature scenario occurs – System will not power-on with a failed fan or a missing fan module • Power supply units (PSUs) – Base package includes two N+1 redundant hot-swappable power supplies – System continues to operate and will power-on with one failed or missing power supply – Requires 200–240 VAC, 50/60 Hz; system warns if AC cord not attached (100–120 VAC not supported)

Fault Management Architecture (FMA) Hot-pluggable drives

Memory error protection, message retry in hardware, Internal NVMe drives supported by cyclic redundancy check (CRC) two separate PCIe buses for isolation

Oracle Solaris ZFS for file Front and rear system system resilience (RAID) indicator LEDs

Dual PCIe root complexes and Power-On cross-connected PCIe switches Self-Test Redundant I/O controller (cards) Redundant, hot-swappable with MPxIO for storage devices power supplies and cooling fans and IPMP for network devices

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 55 Select Oracle White Papers • “Oracle’s SPARC S7 Server Architecture” https://community.oracle.com/docs/DOC-1000784 • “The Fully Encrypted Data Center” http://www.oracle.com/technetwork/server-storage/hardware-solutions/fully-encrypted-datacenter-2715841.pdf • “Oracle VM Server for SPARC Best Practices” http://www.oracle.com/technetwork/server-storage/vm/ovmsparc-best-practices-2334546.pdf • “Consolidation Using Oracle' s SPARC Virtualizaon Technologies” http://www.oracle.com/technetwork/server-storage/sun-sparc-enterprise/technologies/consolidate-sparc-virtualization-2301718.pdf • “Implementing Root Domains with Oracle VM Server for SPARC” http://www.oracle.com/technetwork/server-storage/vm/ovm-sparc-rootdomains-wp-1914481.pdf

Copyright © 2016, Oracle and/or its affiliates. All rights reserved. | 56 Most Advanced Platform for Secure Computing Security in Silicon, Data Analytics Acceleration, Fastest for Database & Enterprise Apps

New!

SPARC M7 SPARC T7 SPARC S7