1 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

2 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Eine phatastische Reise ins Innere der Hardware Franz Haberhauer Stefan Hinker Oracle Hardware in 3D

5 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. T5 and M5 PCIe Carrier Card

. Supports standard low-profile PCIe cards

Air Flow

PCIe Retimer

x16 Connector (x8 electrical)

6 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. PCIe Data Paths: Full System

. Two root complexes per T5 . Each PCIe port on a T5 processor controls a single PCIe slot

7 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. T5-2 Block Diagram

DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM DIMM

BoB BoB BoB BoB BoB BoB BoB BoB BoB BoB BoB BoB BoB BoB BoB BoB

T5-0 T5-1

CPU CPU TPM Host & CPU PCIe Debug CPU PCIe Debug Data Flash DC/DCs 0 1 Port DC/DCs 0 1 Port

x8 x8 FPGA x8 x4 x8 x1 HDD0 DBG SAS/SATA x1 HDD0 IO Controller x4 x4 PCIe PCIe SP Module HDD0 get rid of all inside x8 x8 SAS/SATA smallSwitch boxes 0 Switch 1 FRUID HDD0 IO Controller Sideband Mgmt DRAM HDD0 USB 1.1 Keyboard Mouse Service SPI x8 USB 3.0 x8 USB 2.0 Storage Flash HDD0 Host Processor SATA DVD NAND USB 2.0 Hub USB USB 3.0 USB Internal USB Hub VGA VGA

REAR IO Board

USB2 USB3 VGA USB0 USB1 VGA Serial Enet

Quad 10Gig Enet DB15 Mgmt Mgmt

Slot 2 (8) 2 Slot (8) 3 Slot (8) 4 Slot (8) 5 Slot (8) 6 Slot (8) 7 Slot (8) 8 Slot Slot 1 (8) 1 Slot 10/100 FAN BOARD REAR IO

8 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Agenda

. Preparing a LDom Guest with it’s own Root Complex . Removing a PCIe card . Re-inserting a PCIe card

9 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Creating a Root Domain An Example on M6-32 – Listing IO Devices

root@primary # ldm ls-io NAME TYPE BUS DOMAIN STATUS ------pci_32 BUS pci_32 primary IOV pci_33 BUS pci_33 primary IOV pci_34 BUS pci_34 primary IOV pci_35 BUS pci_35 primary IOV pci_36 BUS pci_36 primary IOV […] /SYS/IOU2/PCIE3 PCIE pci_32 primary EMP /SYS/IOU2/EMS1/CARD/NET0 PCIE pci_32 primary OCC /SYS/IOU2/EMS1/CARD/SCSI PCIE pci_32 primary OCC /SYS/IOU2/PCIE2 PCIE pci_33 primary OCC /SYS/IOU2/PCIE5 PCIE pci_34 primary EMP /SYS/IOU2/PCIE8 PCIE pci_35 primary EMP /SYS/IOU2/PCIE11 PCIE pci_36 primary EMP /SYS/IOU2/EMS3/CARD/NET0 PCIE pci_36 primary EMP /SYS/IOU2/EMS3/CARD/SCSI PCIE pci_36 primary EMP

10 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Creating a Root Domain An Example on M6-32 – Giving away some devices

root@primary # ldm start-reconf primary ldm rm-io pci_33 ldm rm-io pci_34 Reboot

[…] ldm add-io pci_33 mars ldm add-io pci_34 mars

11 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Creating a Root Domain Checking IO Devices again

root@primary # ldm ls-io NAME TYPE BUS DOMAIN STATUS ------pci_32 BUS pci_32 primary IOV pci_33 BUS pci_33 mars OCC pci_34 BUS pci_34 mars EMP pci_35 BUS pci_35 primary IOV pci_36 BUS pci_36 primary IOV […] /SYS/IOU2/PCIE3 PCIE pci_32 primary EMP /SYS/IOU2/EMS1/CARD/NET0 PCIE pci_32 primary OCC /SYS/IOU2/EMS1/CARD/SCSI PCIE pci_32 primary OCC /SYS/IOU2/PCIE2 PCIE pci_33 mars OCC /SYS/IOU2/PCIE5 PCIE pci_34 mars EMP /SYS/IOU2/PCIE8 PCIE pci_35 primary EMP /SYS/IOU2/PCIE11 PCIE pci_36 primary EMP /SYS/IOU2/EMS3/CARD/NET0 PCIE pci_36 primary EMP /SYS/IOU2/EMS3/CARD/SCSI PCIE pci_36 primary EMP

12 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Preparing for Hotplug Check in “mars” using the hotplug command

root@mars # hotplug list -c Connection State Description ______IOU2-PCIE2 ENABLED PCIe-Native IOU2-PCIE5 EMPTY PCIe-Native

13 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Preparing for Hotplug A Detailed view on PCIE2 root@host-9-78 # hotplug list -clv IOU2-PCIE2 Connection State Description Path ______IOU2-PCIE2 ENABLED PCIe-Native /pci@b40/pci@1/pci@0/pci@2 Device Usage ______SUNW,qlc@0 - fp - disk - fp@0,0 - SUNW,qlc@0,1 - fp - disk - fp@0,0 -

14 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Removing the HBA

root@mars # hotplug poweroff IOU2-PCIE2 root@mars # hotplug list -c Connection State Description ______IOU2-PCIE2 PRESENT PCIe-Native IOU2-PCIE5 EMPTY PCIe-Native

15 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Re-Inserting the HBA

root@mars # hotplug poweron IOU2-PCIE2 root@mars # hotplug list -c Connection State Description ______IOU2-PCIE2 POWERED PCIe-Native IOU2-PCIE5 EMPTY PCIe-Native

root@mars # hotplug enable IOU2-PCIE2 root@mars # hotplug list -c IOU2-PCIE2 Connection State Description ______IOU2-PCIE2 ENABLED PCIe-Native IOU2-PCIE5 EMPTY PCIe-Native

16 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

17 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

SPARC M6: Processor Overview PCIe . SerDes MCU SerDes

12 SPARC S3 cores, 96 threads MIO . 48MB shared L3 cache L3 SPARC L3

Core

Coherence Coherence Scalability & . 4 DDR3 schedulers, maximum of 1TB of memory per socket SPARC SPARC L3 SPARC L3 SPARC SPARC Core Core Ctl Core Ctl Core Core . 2 PCIe 3.0 x8 lanes SerDes Crossbar

. Up to 8 sockets glue-less scaling SPARC SPARC L3 SPARC L3 SPARC SPARC

. Up to 32 sockets glued scaling Core Core Ctl Core Ctl Core Core

. 4.1 Tbps total link bandwidth SPARC SerDes L3 Core L3

. 4.27 billion transistors

SerDes MCU SerDes PCIe

18 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Sun 4/260 „Sunrise“ July 1987

. MB86900 chip set implementing SPARC V7 ISA – First implementation of SPARC – Two 20.000-gate 1.2µm CMOS Gate Arrays . Manufactured by Limited . MB86900 . MB86910 Floating-Point Unit – 16.67 MHz, 10 MIPS

19 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 25+ Years of SPARC Processors

1987 1988 1992 1995 1996 2000 2002 2005 2007 2010 2011 2013

Sunrise: 1st SPARC Processor UltraSPARC IV+ UltraSPARC II SPARC T5 SuperSPARC I UltraSPARC IIIi UltraSPARC T2 SPARC T4

SUNRAY

SUNRAY UltraSPARC I UltraSPARC III UltraSPARC T1 UltraSPARC T3 SPARC M5

20 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

SPARC M6: Processor Overview PCIe . SerDes MCU SerDes

12 SPARC S3 cores, 96 threads MIO . 48MB shared L3 cache L3 SPARC L3

Core

Coherence Coherence Scalability & . 4 DDR3 schedulers, maximum of 1TB of memory per socket SPARC SPARC L3 SPARC L3 SPARC SPARC Core Core Ctl Core Ctl Core Core . 2 PCIe 3.0 x8 lanes SerDes Crossbar

. Up to 8 sockets glue-less scaling SPARC SPARC L3 SPARC L3 SPARC SPARC

. Up to 32 sockets glued scaling Core Core Ctl Core Ctl Core Core

. 4.1 Tbps total link bandwidth SPARC SerDes L3 Core L3

. 4.27 billion transistors

SerDes MCU SerDes PCIe

21 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

SPARC M6 CPU Block Diagram

DDR3 – 1066 MHz DDR3 – 1066 MHz DDR3 – 1066 MHz DDR3 – 1066 MHz

Scalability Links

12 Gbps per lane BoB BoB BoB BoB BoB BoB BoB BoB 16 GBps eachdirectionGBps 16 – 4 lanes per link GBps PCIex 8 @ 3.0 82 (144 Gbps) Coherency Links SLC Memory Memory IO 12.8 Gbps per lane Control Control Subsystem - 12 lanes per link SLC (1075 Gbps) Coherence Unit Coherence Unit SLC Link 0 Link 1

SPARC SLC S3 Core SLC Link 2 128 KB L2$ Link 3 L3$ B0 L3$ B2 L3$ B1 L3$ B3 SLC L3$ B0 16 KB L1I$ 12MB1MB,16,16--wayway 12MB,16-way 12MB,16-way 12MB,16-way Link 4 16 KB L1D$ 12 x 5 Crossbar (~620GBps bandwidth) Link 5

FGU

C6 C7 C8 C9 C10 C11 Switch 2x4 Coherency C0 C1 C2 C3 C4 C5 Link 6 Crypto 8 threads per Core

22 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. T5 System Interconnects

1-Way 2-Way 4-Way Single Socket Dual Socket

6-Way 8-Way

23 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 8 Socket Local Coherency & Data Interconnect

All-to-All Interconnect Where the Node-to-Node Fabric is 12 diff pairs per link in each direction. DIMMS DIMMS M5/T5 M5/T5 T5 interconnect bandwidth= 157.5 GB/sec T5-8 interconnect bandwidth= 1260 GB/sec

DIMMS M5/T5 M5/T5 DIMMS PCIe Gen3 Bandwidth 8 diff pairs per ports At 8Gb/sec ~8GB/sec/direction POINT-TO-POINT LOCAL ~8Gb/sec/lane X 8 lanes = 64 Gb/s INTERCONNECT X 2 directions X 2 Ports/chip DIMMS = 256Gb/s/chip M5/T5 M5/T5 DIMMS = 32 GB/s per chip

DDR3-1066 Memory Bandwidth DIMMS T5 is 133 GB/sec DIMMS M5/T5 M5/T5 T5-8 is 1064 GB/s

24 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. M6-32 Block Diagram

Central Coherency Directory And Data Switches

DCU 1 DCU 2 DCU 3 DCU 4

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

IO Switch IO Switch IO Switch IO Switch IO Switch IO Switch IO Switch IO Switch Board 0 Board 1 Board 0 Board 1 Board 0 Board 1 Board 0 Board 1

Disks Disks Disks Disks Disks Disks Disks Disks 0-3 4-7 0-3 4-7 0-3 4-7 0-3 4-7

0 1 2 3

25 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Scale-Up for Maximum In-Memory Performance

. Scale-Up on large SMPs

. SMP scaling removes overhead of distributing queries across servers or coordinating transactions

. Inter-processor bandwidth far exceeds any network

26 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Breakthrough: Dual Format In-Memory Database

. BOTH row and column Memory Memory in-memory formats for same data/table

OLTP Sales Sales Analytics . Simultaneously active and Row Column transactionally consistent Format Format

. 100X Faster Analytics & reporting: column format

. 2X Faster OLTP: row format

27 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. SPARC System Design: 2x Faster Bandwidth Delivered performance dramatically faster than Power7+ & x86

SPARC 600 #chi Processor Stream p 500 SPARC T5-8 3.6GHz SPARC T5 8 643 GB/s SPARC T5-4 3.6GHz SPARC T5 4 312 GB/s 400 SPARC T5-2 3.6GHz SPARC T5 2 155 GB/s 3.3GHz Power7 IBM p750 Exp 4 123 GB/s 300 P7=P7+ GB/s IBM HP DL980 G7 2.4GHz E7-4870 8 107 GB/s 200 X4-2L Ivy Bridge 2.9GHz E5-2697 v2 2 86 GB/s X86 2ch Xeon 2.9GHz E5-2690 2 79 GB/s

Memory Memory bandwidth GB/s x86 100 SPARC faster storage performance Ivy – Bridge 3.1M IOPs delivered IOPS 0 – +40 GB/s delivered IO bandwidth 2 4 #Chips 6 8

28 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. http://www.cs.virginia.edu/stream/by_date/Bandwidth.html See benchmark disclosure slide SPARC Establishes Dramatic Performance Leadership Enterprise performance SPARC T5 SPARC: over 2x performance each generation

x86: only ~20 to 50% each generation Ivy Bridge Xeon E5 v2 Power7+: only ~10% in 3 years

Sandy Bridge Xeon E5 IBM Power7+ IBM Power7 SPARC T4 SPARC T3

Westmere Xeon E7 SPARC T-Series Nehalem IBM Power HP/Cisco x86

SPARC redefines economics! Per chip based on internal testing 2010 2011 2012 2013 2014

29 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Oracle: Re-engineering Systems Economics Oracle’s near-linear pricing removes artificial high-end premium IBM Power 795 POWER7 $6,491,183

IBM Worse Worse Power 780 POWER7+ $2,101,370

IBM IBM Power 750 Power 740 POWER7+

POWER7+ $204,982 $ /performance $

$101,571

Better

Better T5-2 T5-4 T5-8 M6-32 $67,042 $147,992 $268,314 $1,209,943

2 socket 4 socket 8 socket 32 socket

30 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. SPARC M6 RAS: End-to-End Protection

. Internal Logic: parity and ECC – Architectural Registers

– Cache structures

– Internal networks . Links: CRC retry

CRC ECC with line retire Data-ECC, Address-parity Other (Parity, Retry etc) DFT, Debug etc.

31 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

SPARC M6 RAS: General Error Handling Flow

Hardware Hypervisor Service Processor

Detection and Clean-up Assist with clean-up Analyze Hypervisor Report

Gather Signature Collect Hardware Data Update Error History

De-configure Resources Generate Report for SP Initiate Service Call

Manage De-configuration Initiate De-configuration

Retire Threads Retire Cores Retire Solaris Retire Pages Offline Cache Lines SerDes Lanes Activate DIMM De-configure Spare Column User-Visible Resource

32 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Oracle Server Availability Cloud can’t go down. User experience and business depend on it. T5-2 T5-8 T4-4 T5-4

T4-2 T4-1 M5 RAS

Redundant Clock / Redundant & Hot-Plug SP VM Secure Live Migration Hot Plug PCIe Redundant / Hot-swap Fans, Power, Disks Lane Sparing (L3$/Memory/Interconnect) ECC, Predictive Self Healing Redundant Interconnect w/Lane Sparing

33 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. New Storage Architecture Enabled with Flash Server

High Multi-Core, Performance Multi Socket CPUs DRAM Performance Flash Affinity High Performance Flash Devices (Cache/Tier 0 Storage) Capacity Storage Expansion

High Capacity HDDs

37 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Optimized Solution for Backup and Recovery Oracle Systems Backup Options

ZFS Storage Appliance Backup (Most Flexible)

. RTO: Next to Immediate . RPO: Last transaction . Customer requires industry leading fast backup and recovery support

Tape Backup (Most Economical)

. RTO: Hours . RPO: Last Transaction Backup . Customer requires and economical and green backup and recovery solution with long retention periods

Disk to Disk to Tape

. RTO: Next to immediate . RPO: Last Transaction Backup . Customer requires an economical and green backup and recovery solution with long retention periods

38 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Oracle StorageTek Tape Portfolio • Best scalability • Best reliability and availability • Best TCO and investment protection

SL8500

Entry SL3000 Software Device Management SL150 Data Management Tiered Storage Virtualization LTO T9840 T10000 VLE VSM Encryption

39 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Oracle Enterprise Tape Technology Roadmap

5 Year Trajectory Tape Capacity 12 – 20x In the Lab Archive Capacity 14 – 24x SL8500 Enterprise Tape Library 1.4 – 2.4 Exabyte Delivered Capacity Gen5 Enterprise SL8500 Enterprise T10000D Tape Drive Tape Library Enterprise 12 - 20 TB Capacity SL8500 Enterprise 500 PB Capacity Tape Drive Tape Library 8.5 TB Capacity 100 PB Capacity T10000C Enterprise native 252 MB/s Tape Drive compressed 800MB/s T10000B Enterprise 5 TB Capacity announced Tape Drive Sep. 10, 2013 1 TB Capacity 2010 2011 2012 2013 2014 2015

40 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Storage Technologies: Future Projections Areal Density Trends Drive Lower Cost/TB…

Disk Roadmap Disk improvements: ~20%/yr

Tape improvements: ~40%/yr

Source: INSIC roadmap Tape gets its capacity by having 1000X the recording surface area comparing a 1/2 inch cartridge to a 3 1/2 inch disk.

41 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. What About the Future? Tape’s advantage is increasing!

Tape 100000 Disk Optical Blu-ray MLC NAND Flash up to 4 bits/cell 10000 SLC NAND Flash

1000

Disk improvements: ~20%/yr $/TB 100 Tape improvements: ~40%/yr

10

1 2004 2006 2008 2010 2012 2014 2016 2018

Source: INSIC roadmap areal density projections translated into $/TB Year

42 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. [email protected] [email protected] https://blogs.oracle.com/cmt https://blogs.oracle.com/solarium

43 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 44 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Required Benchmark Disclosure Statement Must be in SPARC T5 & M6 Presos with Benchmark Results (1 of 2) .Copyright 2013, Oracle &/or its affiliates. All rights reserved. Oracle & are registered trademarks of Oracle &/or its affiliates.Other names may be trademarks of their respective owners.. .TPC Benchmark C, tpmC, and TPC-C are trademarks of the Transaction Processing Performance Council (TPC). SPARC T5-8 (8/128/1024) with 11g Release 2 Enterprise Edition with Partitioning, 8,552,523 tpmC, $0.55 USD/tpmC, available 9/25/2013, New Order 90th% Response Time 0.410sec. IBM Power 780 Cluster (24/192/768) with DB2 ESE 9.7, 10,366,254 tpmC, $1.38 USD/tpmC, available 10/13/2010, New Order 90th% Response Time 2.10 sec. IBM x3850 X5 (4/40/80) with DB2 ESE 9.7, 3,014,684 tpmC, $0.59 USD/tpmC, available 7/11/2011. IBM x3850 X5 (4/32/64) with DB2 ESE 9.7, 2,308,099 tpmC, $0.60 USD/tpmC, available 5/20/2011. IBM Flex x240 (2/16/32) with DB2 ESE 9.7, 1,503,544 tpmC, $0.53 USD/tpmC, available 8/16/2012. IBM Power 780 (2/8/32) with IBM DB2 9.5, 1,200,011 tpmC, $0.69 USD/tpmC, available 10/13/2010. Source: http://www.tpc.org/tpcc, results as of 3/26/2013. . SPEC and the benchmark name SPECjEnterprise are registered trademarks of the Standard Performance Evaluation Corporation. Results from www.spec.org as of 3/26/2013. SPARC T5-8, 57,422.17 SPECjEnterprise2010 EjOPS; SPARC T4-4, 40,104.86 SPECjEnterprise2010 EjOPS; Sun Server X2-8, 27,150.05 SPECjEnterprise2010 EjOPS; Cisco UCS B440 M2, 26,118.67 SPECjEnterprise2010 EjOPS; IBM Power 780, 16,646.34 SPECjEnterprise2010 EjOPS. IBM PowerLinux 7R2, 13,161.07 SPECjEnterprise2010 EjOPS. Sun Server X4-2, 11,259.88 SPECjEnterprise2010 EjOPS. SPARC T5-8 (SPARC T5-8 Server base package, 8xSPARC T5 16-core processors, 128x16GB-1066 DIMMS, 2x600GB 10K RPM 2.5. SAS-2 HDD, 4x Power Cables) List Price $268,742. IBM Power 780 (IBM Power 780:9179 Model MHB, 8x3.86GHz 16-core, 64x one processor activation, 4xCEC Enclosure with IBM Bezel, I/O Backplane and System Midplane,16x 0/32GB DDR3 Memory (4x8GB) DIMMS-1066MHz Power7 CoD Memory, 12x Activation of 1 GB DDR3 Power7 Memory, 5x Activation of 100GB DDR3 Power7 Memory, 1x Disk/Media Backplane. 2x 146.8GB SAS 15K RPM 2.5. HDD (AIX/ only), 4x AC Power Supply 1725W) List Price $992,023. Source: Oracle.com and IBM.com, collected 03/18/2013. SPEC and the benchmark name SPECjEnterprise are registered trademarks of the Standard Performance Evaluation Corporation. Results from www.spec.org as of 5/1/2013. SPARC T5-8, 27,843.57 SPECjEnterprise2010 EjOPS; IBM Power 780, 10,902.30 SPECjEnterprise2010 EjOPS. Oracle server(4 app: 4db) only hardware list price is $298,494, and total hardware plus software list price is $1,565,092. Oracle server(5 app: 3db) only hardware list price is $304,914, and total hardware plus software list price is $1,487,792. http://www.oracle.com as of 9/20/2013. IBM server only HW list price is $803,613 and HW+SW cost of $1,943,162.00 and IBM PowerLinux 7R2 server total hardware plus software cost of $819,451.00 based on public pricing from http://www.ibm.com as of 9/20/2013. .SPEC and the benchmark name SPECjbb are registered trademarks of Standard Performance Evaluation Corporation (SPEC). Results from www.spec.org as of 9/22/2013 unless cited below. SPARC T5-2 81,084 SPECjbb2013-MultiJVM max-jOPS, 39,129 SPECjbb2013-MultiJVM critical-jOPS; Sun Server X2-4 65,211 SPECjbb2013-MultiJVM max-jOPS, 22,057 SPECjbb2013-MultiJVM critical-jOPS; Cisco UCS B200 M3 62,393 SPECjbb2013-MultiJVM max-jOPS, 23,505 SPECjbb2013-MultiJVM critical-jOPS, result from www.cisco.com/en/US/prod/collateral/ps10265/le_41704_pb_specjbb2013b200.pdf; Sun Server X4-2 52,664 SPECjbb2013-MultiJVM max-jOPS, 20,553 SPECjbb2013- MultiJVM critical-jOPS, result from www.oracle.com/benchmarks; Sun Server X3-2 41,954 SPECjbb2013-MultiJVM max-jOPS, 13,305 SPECjbb2013-MultiJVM critical-jOPS; HP ProLiant DL560p Gen8 66,007 SPECjbb2013-MultiJVM max-jOPS, 16,577 SPECjbb2013-MultiJVM critical-jOPS; HP ProLiant ML350p Gen8 40,047 SPECjbb2013-MultiJVM max-jOPS, 12,308 SPECjbb2013-MultiJVM critical-jOPS.

45 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Required Benchmark Disclosure Statement Must be in SPARC T5 & M6 Presos with Benchmark Results (2 of 2) .Copyright 2013, Oracle &/or its affiliates. All rights reserved. Oracle & Java are registered trademarks of Oracle &/or its affiliates.Other names may be trademarks of their respective owners.. .Two-tier SAP Sales and Distribution (SD) Standard Application benchmarks SAP Enhancement package 5 for SAP ERP 6.0 as of 3/26/13:SPARC M5-32 (32 processors, 192 cores, 1536 threads) 85,050 SAP SD users, 32 x 3.6 GHz SPARC M5, 4 TB memory, Oracle Database 11g, 11, Cert# 2013009. SPARC T5-8 (8 processors, 128 cores, 1024 threads) 40,000 SAP SD users, 8 x 3.6 GHz SPARC T5, 2 TB memory, Oracle Database 11g, Oracle Solaris 11, Cert# 2013008. IBM Power 760 (8 processors, 48 cores, 192 threads) 25,488 SAP SD users, 8 x 3.41 GHz IBM POWER7+, 1024 GB memory, DB2 10, AIX 7.1, Cert#2013004. Two-tier SAP Sales and Distribution (SD) Standard Application benchmarks SAP Enhancement package 4 for SAP ERP 6.0 as of 4/30/12:IBM Power 795 (32 processors, 256 cores, 1024 threads) 126,063 SAP SD users, 32 x 4 GHz IBM POWER7, 4 TB memory, DB2 9.7, AIX7.1, Cert#2010046. SPARC Enterprise Server M9000 (64 processors, 256 cores, 512 threads) 32,000 SAP SD users, 64 x 2.88 GHz SPARC64 VII, 1152 GB memory, Oracle Database 10g, Oracle Solaris 10, Cert# 2009046. SAP, R/3, reg TM of SAP AG in Germany and other countries. More info www.sap.com/benchmark . SPEC & benchmark names SPECfp, SPECint are registered trademarks of the Standard Performance Evaluation Corporation. Results as of March 26, 2013 from www.spec.org and this report. SPARC T5-8: 3750 SPECint_rate2006, 3490 SPECint_rate_base2006, 3020 SPECfp_rate2006, 2770 SPECfp_rate_base2006; SPARC T5-1B: 489 SPECint_rate2006, 441 SPECint_rate_base2006, 369 SPECfp_rate2006, 350 SPECfp_rate_base2006. IBM Power 780 8-chip 3.92GHz: 2640 SPECint_rate2006. IBM Power 710 Express 1-chip 3.556GHz: 289 SPECint_rate2006. .TPC Benchmark, TPC-H, QphH, QthH, QppH are trademarks of the Transaction Processing Performance Council (TPC). Results as of 6/7/13, prices are in USD. SPARC T5-4 www.tpc.org/3288; SPARC T4-4 www.tpc.org/3278; SPARC Enterprise M9000 www.tpc.org/3262 historical result; SPARC Enterprise M9000 www.tpc.org/3258; IBM Power 780 www.tpc.org/3277; HP ProLiant DL980 www.tpc.org/3285. .SPC Results as of September 10, 2013, for more information go to http://www.storageperformance.org/results SPC-2. Results for Oracle ZFS Storage ZS3-4 are 17,244.22 SPC- 2 MBPS™, $22.53 SPC-2 Price-Performance. Full results at http://www.storageperformance.org/results/benchmark_results_spc2#b00067. Results for IBM DS8870 are 15,423.66 SPC-2 MBPS, $131.21 SPC-2 Price-Performance. Full results at http://www.storageperformance.org/results/benchmark_results_spc2#b00062. Results for HP P9500 XP Disk Array are 13,147.87 SPC-2 MBPS, $88.34 SPC-2 Price-Performance. Full results at http://www.storageperformance.org/results/benchmark_results_spc2#b00056. .SPEC SFS SPEC & benchmark names SPECfp, SPECint are registered trademarks of the Standard Performance Evaluation Corporation. Results as of September 10, 2013, for more information see www.spec.org. For details on performance and price comparisons see http://www.oracle.com/us/solutions/performance-scalability/sun-storage-gateway- 160373.html

46 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 47 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.