™

SCSI Trade Association

SAS vs. NVMe Smackdown

August 11, 2020 Today’s Presenters ™ SCSI Trade Association

Cameron Brett STA President; Director, Enterprise and Cloud Storage Marketing, America

Jonmichael Hands NVM Express™ Marketing Workgroup Co-chair; Sr. Strategic Planner and Product Manager,

Don Jeanette Vice President, TRENDFOCUS

August 11, 2020 2 TRENDFOCUS Introduction

• Established in 1993 Cloud, Hyperscale, & Enterprise Storage Service • Over 80 clients globally Detailed SSD and HDD Device Adoption Trends by • Located in Silicon Valley Traditional and Emerging Applications • Industry analysis for various technologies & segments: • HDD, SSD, NAND Storage Interlinks SSD and HDD Demand from Client Computing, Enterprise • PC, Gaming, Surveillance, Cloud, Hyperscale & Enterprise segments and Consumer Electronics • Quarterly short-term forecasts • Annual long-term forecasts • Periodic Installments - Major new product and SDAS: HDD NAND/SSD Information earnings coverage Information Service Service • Executive Briefs - Analyst commentary on market conditions • FOCUS ON white papers • Daily news links Key Components: Rigid Disk • Special projects available to clients Media/Substrate, Recording Head Information Service

August 11, 2020 May 2020 3 All Enterprise Storage Exabytes (2019-2024)

SAS Connected Storage Continues Strong Growth 2500

2000

1500

1000

500

0 2019 2020 2021 2022 2023 2024 SATA SSD SAS SSD PCIe SSD SAS/SATA HDD

August 11, 2020 May 2020 4 Enterprise SSD Storage Exabytes (2019-2024)

180 160 140 120 100 80

Exabytes 60 40 20 0 2019 2020 2021 2022 2023 2024 Long-Term Forecast SATA SSD SAS SSD PCIe SSD

August 11, 2020 May 2020 5 How Did We Get Here? ™ SCSI Trade Association

◆ SCSI was developed to connect peripheral devices - commonly disk, tape, and optical drives - to a host ◆ SAS was designed to address large topologies via an inexpensive interconnect system ◆ SCSI/SAS evolved to become the industry standard for desktop, server, and storage connectivity for decades

◆ NVM Express was specifically developed for NVM storage, optimized for performance and latency ◆ NVM Express addresses storage overhead and scalability (queues)

August 11, 2020 6 Serial Attached SCSI Overview ™ SCSI Trade Association

◆ SCSI-1 specification published in 1986; latest published is SAS-4 ◆ Organization: ● INCITS T10 (technical) and SCSI Trade Association (marketing) ◆ Command set and physical transport created for enterprise hard drives ● Evolved to support SAS and SATA HDDs and SSDs ◆ 11 generations of SCSI/SAS technology ● Transitioned from parallel to serial as cable lengths became impractical ◆ Specification includes SAS infrastructure (i.e. cables / connectors, expanders, controllers, end devices, etc.) ◆ Led by committee chairs/officers and board of directors (marketing) ◆ 50+ member companies over the years

August 11, 2020 7 Specifications/Enhancements Timeline ™ SCSI Trade Association

SAS-2 SAS-3 SAS-4 SAS-5 • 6Gb/s link rate • 12Gb/s link rate • 22.5 GBaud • 45 Gbaud • Zoning • Decision Feedback • 20-bit Forward Error Correction Physical SAS-2.1 Equalization (DFE) • 128b/130b encoding Layer • Managed cables • Transmitter training • Insertion loss specifications • Power management • Crosstalk • Slimline connectors • Cable management SPL-2 SPL-3 SPL-4 SPL-5 SAS • Transmitter training • Persistent • SAS packets • Re-timers Protocol • Optical cables connections • Fairness • Wide ports Layer • Power primitives • Active PHY • Interleaving Transmitter • Obsolete muxing Adjustment (APTA) ZBC ZBC-2 • Support SMR • Multi Actuators SCSI • Zoned blocks • Dynamic zones Command • Zoned format • Sanitize rules Layer SBC / SPC • SCSI evolutions for ZBC, etc. • Rebuild assist for SSDs

August 11, 2020 8 NVM Express Overview NVMe™ specification published in 2011 Innovative § Latest published: NVMe 1.4, NVMe-oF™ 1.1, NVMe-MI™ 1.1 Organizations: • Open collection of standards industry driven § NVM Express, Inc. technical work groups and marketing work • Full solution stack innovation group • Interface – NVMe • Management – NVMe-MI § PCI-SIG for physical transport over PCI Express® • Fabric – NVMe-OF Command set created for non-volatile memory • Value-add features delivered annually technologies • Robust ecosystem of open source software for management and Led by 13 industry promoters and board of performance (e.g. NVMe-CLI, spdk) directors

Hundreds of member companies 9 NVM Express Technology Specification Roadmap

2015 2016 2017 2018 2019 2020 2021

Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4

NVMe 2.0* NVMe 1.3 May’17 NVMe 1.4 June’19 NVMe NVMe 1.2.1 May’16 • Sanitize • IO Determinism (NVM Sets) NVMe Base Spec Spec • Streams • Persistent Event Log, Rebuild Assist • Virtualization • Persistent Memory Region (PMR) • Merged w/Fabrics • Asymmetric Namespace Access (ANA) • Namespace Types • Alternate Cmd Sets NVMe-oF 1.0 May’16 NVM-oF 1.1 Oct’19 NVMe Transport NVMe-oF • Transport and protocol Spec(s) • Enhanced Discovery Spec • RDMA binding • TCP Transport Binding NVMe Command Set Spec(s)

NVMe-MI 1.0 Nov’15 NVMe-MI 1.1 May’19 • Out-of-band management NVMe-MI • Enclosure Management • Device discovery • In-band Mechanism Spec • Health & temp monitoring • Storage Device Extension • Firmware Update

Released NVMe specification Planned release 10

Performance at the Device Interface ™ SCSI Trade Association

Max Bandwidth (MB/s) 8000 Wide-port or MultiLink™ 7000 24G SAS offers Typical SSD bandwidth up to requires 4x host higher per-lane ~4.8GB/s 6000 resources performance at x1 PCIe up to ~2.4GB/s ~2GB/s 5000

4000

3000

2000

1000

0 12Gb/s SAS 12Gb/s SAS 24G SAS 24G SAS PCIe 3.0 PCIe 3.0 PCIe 4.0 PCIe 4.0 (x1) (x2) (x1) (X2) (x1) (x4) (x1) (x4) August 11, 2020 12 Performance Scalability

Max SSD Speed Seq (MB/s) 16000

Scalable 14000

12000 • Inside-the-box scalability • High-perf & low latency 10000 • High IOPS/TB scales usable capacity 8000 • Taking advantage of gen over gen improvements for PCIe bandwidth 6000 • Outside-the-box scalability with 4000 NVMe-oF

• Processor scalability 2000 • Queuing mechanism scales with cores, virtualization & containers 0 • Streamlined protocol improves clock SATA SAS 12GbpsSAS 24Gbps PCIe 3.1 x4 PCIe 4.0 x1 PCIe 4.0 x4 PCIe 5.0 x4 cycle to I/O efficiency 6Gbps

13 Scalability with SAS ™ SCSI Trade Association

Cascaded JBODs (with SAS expanders) of ◆ Up to 64K end devices SAS/SATA HDDs and/or SSDs ● Dependent on memory for route tables ● Deployments with up to 2K devices in practice ◆ Multiple hosts for high availability ◆ Dynamic scaling with zero downtime ◆ Active / passive and copper / optical cabling allow for both rack-level and data center- level reach

August 11, 2020 14

Flexibility - Form Factors for PCIe E1.L

AIC/CEM

Flexible E1.S

E1.S with enclosure • Broad set of form factors to support range of solution design objectives M.2 • Supports multiple media E3 types to optimize data tiering on a common interface (TLC/QLC & SCM) U.2 • Improve storage consolidation with higher capacity drives vs competing interfaces, e.g. E1.L

16 Flexibility with SAS ™ SCSI Trade Association

Hot Tier Warm Tier Cold Tier Performance Scalability Large-scale, low power, (IOPS) low cost, high capacity ($/GB)

SAS SSDs SAS HDDs SATA SSDs Cascaded JBODs (with SAS expanders) of Cascaded JBODs Nearline SAS HDDs (with SAS expanders) of SATA SMR HDDs

August 11, 2020 17

Manageability and Serviceability ™ SCSI Trade Association

SAS / SCSI Enclosure Services NVMe-MI

Host Processor Management Controller (BMC) Host BMC Operating System

Application Application BMC Operating System NVMe Driver NVMe-MI Driver

PCIe Root PCIe Root PCIe Port SMBus/I2C Port Port

PCIe PCIe VDM SMBus/I2C PCIe Bus PCIe Port SMBus/I2C

NVMe NVM Subsystem

August 11, 2020 19 And the WINNER is ...

20 CQ1 ‘20 End Market Splits Hyperscale, Enterprise, Channel SATA SSD: 5.623 Exabytes SAS SSD: 3.352 Exabytes

Tier-1 Hyperscale 0.7% Enterprise Channel 33.9% Enterprise Channel 53.0% 90.8% 8.5%

Tier-1 Hyperscale 13.2%

PCIe SSD: 11.045 Exabytes SAS/SATA HDD: 171.02 Exabytes

Channel 8.4% Channel Tier-1 18.6% Hyperscale Tier-1 75.9% Enterprise Hyperscale Enterprise 15.6% 64.3% 17.2%

August 2020 21 Summary ™ SCSI Trade Association

◆ SAS is the tried and true ◆ NVMe technology was designed enterprise storage technology for NVM storage, focused on for HDDs and SSDs performance and low latency ◆ Mature and proven for over ◆ Available since 2011, the three decades interface supports client, ◆ SAS-connected storage will be hyperscale and enterprise use around for years to come cases ◆ Will be the storage interface for the future of computing

August 11, 2020 22 Summary - NVMe/PCIe The optimal interface for data center storage.

Scalable Flexible Innovative

• Inside-the-box scalability • Broad set of form factors to • Open collection of standards driven support range of solution design • High-perf & low latency by 100+ members objectives • High IOPS/TB scales usable • Full solution stack innovation capacity • Supports multiple media types to optimize data tiering on a common • Interface – NVMe • Taking advantage of gen over gen interface (TLC/QLC & SCM) improvements for PCIe bandwidth • Management – NVMe-MI • Outside-the-box scalability with • Improve storage consolidation • Fabric – NVMe-OF with higher capacity drives vs NVMe-oF • Value-add features delivered competing interfaces, e.g. E1.L • Processor scalability annually • Queuing mechanism scales with • Robust ecosystem of open source cores, virtualization & containers software for management and • Streamlined protocol improves clock performance (e.g. NVMe-CLI, spdk) cycle to I/O efficiency

23 ™

SCSI Trade Association Thank You!

For more information, go to: www.scsita.org/content nvmexpress.org/ trendfocus.com/

August 11, 2020 24