VMware vSAN and Hyper-Converged Infrastructure What’s New / Technical Walkthrough VMware Confidential
Tom Twyman Systems Engineering Storage & Availability How Are Customers Getting Started?
Expose Services (API, Catalog, Inf. As Code, etc…)
Move Management up the stack – decouple from hardware
Automate Daily Tasks – atomic units
Buy vs. Build – Whenever Possible
Simplify – wherever possible Hyper-Converged Infrastructure Simplifies Private Clouds
HYPER-CONVERGED INDUSTRY-STANDARD SOFTWARE HARDWARE
Compute, storage Convergence of and networking physical storage on x86 hardware Tightly integrated software stack Building-block approach
3 VMware Hyper-Converged Strategy
VMware Hyper-Converged Software vCenter Server Unified management
vSphere Market-leading hypervisor
vSAN Simple, enterprise-class storage
Most flexible deployment options Industry-Standard Servers
4 Building Block for the Software-Defined Data Center
SDDC software NSX: Leading network virtualization platform for the SDDC
vRealize Operations: Advanced storage vCenter Server management and planning
vSphere vRealize Log Insight: Real-time log management of vSAN vSAN VMwareHCS Horizon: Single platform for virtual and hosted desktops
Industry-Standard Servers
5 Broadest Deployment Options…
Software + Hardware Appliance Component Based vSAN Ready Node Hyper-Converged Infrastructure
A Hyper-Converged Infrastructure Any Server on Appliance (HCIA) for the SDDC vSphere Hardware Compatibility List
SSD or PCIe
SAS/NL-SAS/ SATA HDDs Each HCIA is pre-built on a qualified and optimized HBA/RAID Controller 2U/4 Node server platform.
…using the VMware vSAN Compatibility Guide (VCG) (1)
Maximum Flexibility Maximum Ease of Use
6 Enterprises Adopting vSAN in Production for Tier 1 Apps
US One of the One of the Largest Leader in Large Retailer Largest Airlines Pizza Outlet in the US Social Media
Largest vSAN ROBO deployment Plans to move their entire Tier 1 vSAN is the primary production 1.5PB of streaming video data on (1200 sites) and the largest All Flash apps to HCI (vSAN) and retire all storage deployed on SQL vSAN stored across 100 sites deployment across 32 SAN storage vSAN delivers high storage vSAN All Flash delivered highest vSAN is able to sustain and performance to handle transactional performance on NVMe at the lowest scale both workload performance data on SQL database price (20% cheaper than SAN) and capacity More Customers Enable HCI with VMware HCS than Competition
VMware is, as far as we’re 7,000 + concerned pretty much the most solid approach to Customers choose VMware hyperconvergence. HCS
It really did work as advertised…the fact that I have been able to set it and forget it is huge! VMware vSAN
9 VMware vSAN Radically Simple Hypervisor-Converged Storage for VMs
VM VM VM VM VM VM Overview
• Software-defined storage optimized for VMs vSphere + vSAN • Hypervisor-converged architecture … • Runs on any standard x86 server • Pools HDD/SSD into a shared datastore • Delivers enterprise-level scalability and performance • Managed through per-VM storage policies • Deeply integrated with the VMware stack
vSAN Datastore
10 Efficiency of a Single, Hyper-Converged Software Stack
One in every server
Storage VM
vSphere vSphere + vSAN
✖ Overhead of virtual appliance Kernel-embedded for optimized I/O data path ✖ Long data paths Major advantage in resource utilization ✖ Bolted-on integration • 2x CPU efficiency and 3x memory efficiency All features work natively • Native vMotion and DRS vSAN with Next-Generation Hardware
SSD NVMe NVMe NVDIMM
Caching Tier
Persistence Tier NVMe
vSAN vSAN vSAN leverages next-gen hardware Re-Platform to deliver the lowest $/Gig and $/IOPS iSCSI Support vSAN 6.5 New ROBO Options Accelerating Innovation Q4 2016 Expanded H/W Support PowerCLI / API vSAN Encryption (BETA)
Deduplication Compression Erasure Coding (RAID 5/6) vSAN 6.2 Quality of Service Stretched Cluster March 2016 Performance & Capacity Monitoring vSAN 6.1 Replication - 5 Min RPO Expanded vSAN Ready Nodes September 2015 Root Cause Analysis Health Monitoring All Flash 64 Node Cluster X2 Hybrid Performance vSAN 6.0 vSAN Snapshots March 2015 vSAN Clones Rack Awareness
vSAN 5.5 March 2014 13 Tiered All-Flash and Hybrid Options All-Flash Hybrid
Caching SSD PCIe NVMe SSD PCIe NVMe
Writes cached first, Read and Write Cache Reads from capacity tier
Data vSAN Persistence Capacity Tier Flash Devices Capacity Tier Reads primarily from capacity tier SAS / NL-SAS / SATA
90K IOPS per Host + 40K IOPS per Host sub-millisecond latency
14 Understanding Default vSAN Availability
• With “FTT=1” availability – 2+1 (3 host minimum, 4 required for rebuild capabilities) – 2x overhead • 20GB disk takes 40GB
FTT=1
witness data data
data witness data
data data witness
witness data data
ESXi Host ESXi Host ESXi Host ESXi Host
15 All Flash Only
RAID-5 Erasure Coding
• With “FTT=1” availability RAID-5 – 3+1 (4 host minimum) – 1.33x instead of 2x overhead • 20GB disk normally takes 40GB, now just ~27GB
RAID-5
parity data data data
data parity data data
data data parity data
data data data parity
ESXi Host ESXi Host ESXi Host ESXi Host
16 All Flash Only
RAID-6 Erasure Coding
• With “FTT=2” availability RAID-6 – 4+2 (6 host minimum) – 1.5x instead of 3x overhead • 20GB disk normally takes 60GB, now just ~30GB
RAID-6
parity parity data data data data
data data parity parity data data
data data data data parity parity
ESXi Host ESXi Host ESXi Host ESXi Host ESXi Host ESXi Host
17 All Flash Only Beta
Deduplication and Compression for Space Efficiency
• Nearline deduplication and compression per disk group level. – Will be called “Space Efficiency” • Space Efficiency enabled on a cluster level • Deduplicated when de-staging from cache tier to capacity tier – Fixed block length deduplication (4KB Blocks) • Compressed after deduplication esxi-01 esxi-02 esxi-03 • Encryption – post-compression – coming in 6.5 vSphere & vSAN
vmdk vmdk vmdk 18 vSAN - Core : Software Checksum
Overview • End-to-end checksum of the data to detect and resolve silent disk errors • Checksum is enabled by default as a cluster wide setting vSAN Datastore • Fetch the data from another copy in case of checksum verification failures • Disk scrubbing will run in the background Benefits • Provide additional level of data integrity • Automatic detection and resolution of silent disk errors
19 Quality of Service 1 Click to configure limit Complete visibility into IOPS consumed per VM/Virtual Disk Eliminate noisy neighbor issues Manage performance SLAs: independent of VM provisioning order Granular Performance SLA Management
20 vSAN - Core : Support For Pure IPv6
Overview • Operate vSAN in IPv6-only mode. All network communications are through IPv6 network vSAN Datastore • Configuration through UI • vSAN supports L2 or L3 multicast • Monitor/Management through HealthUI
SSD SSD SSD • Support mixed IPv4 & IPv6 for upgrade process Hard disks Hard disks Hard disks Benefits • Address the needs of the customers who are moving to IPv6 (e.g. Federal, Service Providers) vSAN network vSAN network vSAN network • Align with vSphere support of IPv6 Support for pure IPv4 or IPv6 networks Enhanced vSAN Management with Health Service
Performance Monitoring Capacity Monitoring
Built-in performance monitoring Health and performance APIs and SDK Storage capacity reporting And many more health checks… 22 vSAN - Usability & Manageability : Health Check Plugin Fully integrated operational management, which are natively part of the vSphere Web Client
Overview • SNMP support, custom scripts, emails via VC alarms • Performance Monitoring – Web client integrated • Cluster wide summary of VM availability • Event based alarm triggers • Detailed Space Reporting (account for dedup etc) • Proactive rebalance from UI (Health and actions) • Alarms on performance threshold breach • Integrate performance data in support bundle Benefits • Fully integrated operational management Additional Efficiencies…
Client Cache • Write through read memory cache • “Local” to the virtual Machine • Low overhead, big impact Sparse Swap • Reclaim Space used by memory swap • Host advanced option enables setting policy for swap to no space reservation.
24 What’s New with vSAN 6.5? vSAN 6.5: Faster Response Times and Greater TCO Savings
Accelerate 20-50% Additional Scale to Responsiveness TCO Savings Tomorrow
• Automate and customize with • Extend workload support to physical • Deploy next gen, cloud-native full featured PowerCLI for servers and clustered applications applications enterprise-class automation with iSCSI support • Maximize storage with large • Eliminate switches with 2-node capacity drives through 512e direct connect for ROBO sites • Expand all-flash hardware to • Extend space efficiency features to any edition of vSAN ROBO with new vSAN ADV for ROBO 26 Reduce TCO with iSCSI Support
Physical SQL with Application Failover Clusters
iSCSI Initiator iSCSI Initiator
Network
iSCSI Target Managed through one tool, vCenter
vSAN Datastore Lower ROBO Costs and Complexity with 2-Node Direct Connect
Savings: Witness 2 Node ROBO avg cost: $11-12K USD Traffic Central Data Center 2 10G switch cost: $2-$3K USD
vSAN Total cost savings with cross connect cable approximately 15-20%
vSAN Datastore Respond Faster with Cloud Automation New Full-Featured PowerCLI cmdlets
vSphere and vSAN
PowerCLI cmdlets
vSAN Datastore Scale to tomorrow with latest hardware innovations
vSphere vSAN 512e
vSAN Datastore vSAN Beta: Advanced HCI Security and Protection
SECURE PROTECT MANAGE Software Encryption Nested Fault Domains Enhanced Storage and for Data at Rest For Stretched Clusters Network Monitoring
http://www.vmware.com/go/Virtual-SAN-Beta
This presentation may contain product features that are currently under development. Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind. Technical feasibility and market demand will affect final delivery. Pricing and packaging for any new technologies or features discussed or presented have not been determined. Photon Platform with vSAN Storage Services Extend vSAN to Containers and CNA • vCenter Server Photon Controller •
Cluster Managers
• • VM VIC •
• Primary Cluster Primary Cluster
vSphere vSAN 6.5 Photon vSAN for Photon • • Thank you Three Ways to Get Started with vSAN Today
Online Download vSAN Learn more… 1 Hands-on Lab 2 Evaluation 3 Assessment vmware.com/go/virtual-san
• vSAN Product Overview Video
• vSAN Datasheet vmware.com/go/try-vsan-en vmware.com/go/try-vsan-en • Reach out to your VMware Partner, SEs or Rep for a • vSAN Customer • Test-drive vSAN right from • 60-day Free vSAN FREE vSAN Assessment References your browser—with an Evaluation • Results in just 1 week! instant Hands-on Lab • VMUG members get a 6- • The vSAN Assessment tool • vSAN Assessment • Register and your free, month EVAL or 1-year collects and analyzes data self-paced lab is up and EVALExperience for $200 from your vSphere storage running in minutes environment and provides • VMware Storage Blog technical and business recommendations. • @vmwarevsan
35