ScaleIO Overview
(selected slides) Problem: Traditional Storage Arrays The old way
Deployment Management Refresh • Takes up to months to procure, • Siloes of unused storage • Need forklift upgrades every deploy and provision storage 3-5 years • Multiple arrays to manage • Overprovisioning • Large data migrations • Performance hotspots • High CAPEX
Traditional
SDS
Time
2 © Copyright 2017 Dell Inc. Solution: ScaleIO Software-Defined Storage Combining storage virtualization with web-scale efficiencies
Deployment Management Refresh • Deploy in minutes! • “Abstract, Pool, Automate” - for • Rolling server upgrades Storage! • Start small, no • No large data migrations. overprovisioning • Data center scale, no silos Ever!
• Standard x86 servers and • HCI or traditional SAN • Superior TCO Ethernet
3 © Copyright 2017 Dell Inc. Life without ScaleIO application(s) Host file-system (bare metal) semantics file-system block semantics vol. manager
block dev. drivers
mostly unutilized, DAS contain OS files HBA NIC/IB
External Storage Subsystem switch switch Fabric HBA
switch
EMC CONFIDENTIAL—INTERNAL USE ONLY 4 ScaleIO Data Client (SDC) application(s) Host file-system semantics Exposes ScaleIO file-system shared block volumes block semantics to the application vol. manager Access to OS partition may still be done “regularly” block dev. drivers SDC ScaleIO data client (SDC) is a block device driver
ScaleIO DAS protocol
HBA NIC/IB ScaleIO protocol: proprietary External block storage andStorage metadata protocol overSubsystem TCP/IP. switch switch Fabric It HBAis NOT iSCSI due to ScaleIO’s switch distributed nature.
EMC CONFIDENTIAL—INTERNAL USE ONLY 5 ScaleIO Data Server (SDS) application(s) Host Owns local storage file-system SDS that contributes to the block semantics ScaleIO storage pool vol. manager ScaleIO data server (SDS) is a daemon / service block dev. drivers
Space ScaleIO allocated to DAS protocol ScaleIO HBA NIC/IB
External Storage Subsystem switch switch Fabric HBA
switch
EMC CONFIDENTIAL—INTERNAL USE ONLY 6 ScaleIO Data Server (SDS) application(s) Host Owns local storage file-system SDS that contributes to the block semantics ScaleIO storage pool vol. manager ScaleIO data server (SDS) is a daemon / service block dev. drivers
Space ScaleIO allocated to DAS protocol ScaleIO Local storage couldHBA NIC/IB be dedicated disks, partitions within a disk, or External even files Storage Subsystem switch switch Fabric HBA
switch
EMC CONFIDENTIAL—INTERNAL USE ONLY 7 SDC & SDS in the same host application(s) Host file-system An SDC and an SDS can live semantics file-system SDS together. block semantics vol. manager SDC serves the I/O requests of the resident host applications.
block dev. drivers SDC SDS serves the I/O requests of various SDCs. Space ScaleIO allocated to DAS protocol ScaleIO HBA NIC/IB
External Storage Subsystem switch switch Fabric HBA
switch
EMC CONFIDENTIAL—INTERNAL USE ONLY 8 ScaleIO Building Blocks x86
ScaleIO Data Client (SDC) Operating Systems • Manages connection to SDC • Microsoft Windows ScaleIO’s pool of storage • Linux ScaleIO Data Server (SDS) Deployed on… Hypervisors • Consumes local storage and SDS presents it to SDCs • VMware ESX • HyperV • Xen MDM Metadata Manager (MDM) • Coordinates and monitors storage Platforms • OpenStack • Mesos • Docker
And more…
9 © Copyright 2017 Dell Inc. ScaleIO Building Blocks (2)
Deployment and management components
• ScaleIO Gateway • Performs installation and configuration checks; acts as an endpoint for API calls and passes them to MDM
• ScaleIO Lightweight Installation Agent • Receives packages from gateway, installs them on its local host
• ScaleIO Graphical User Interface (GUI)
• ScaleIO Command Line Interface (CLI)
• All of these components do coexist along with SDS, SDC, MDM
Orchestration and deployment
• ScaleIO Advanced Management Services (AMS) • Extended interface for ScaleIO GUI • Manages and installs ScaleIO; must exist outside of ScaleIO system
10 © Copyright 2017 Dell Inc. Three ways to consume
0 0 1 0 1 1 1 0 1 0 ScaleIO 1 1 ScaleIO Ready VCE 1 0 0 0 1 1 1 0 1 1 0 1 1 0 1 1 1 Software 1 VxRack 0 0 0 0 1 Node 1 0 0 1 1 1 1 System 1 0 with FLEX
Software-defined maximum flexibility Lowest risk, highest value, lowest TCO Ultra Scale-Out SDS Scale-Out Block Storage Turnkey Software-Defined IaaS • Software only • Dell PowerEdge servers tuned, • Fully productized platform • Complete flexibility optimized and validated for • VCE factory integrated and ScaleIO • End user supplies server logically configured • Hyper-converged or Storage • End user supplies switch • VCE support and lifecycle only assurance • End user supplies rack • All-flash configurations
Build Buy Maintain Consume
11 © Copyright 2017 Dell Inc. ScaleIO Deployment Configurations ScaleIO Configurations: 2-Layer Server SAN
Ethernet access PCIe/SCSI bus access • SDS nodes dedicated to app SDS SDC serving storage • Operationally app separated SDS SDC • Drop-in replacement for app block storage SDS SDC ETHERNET • Any x86 OS, any combination of app SDS SDC operating systems and hypervisors is app possible SDS SDC
13 © Copyright 2017 Dell Inc. ScaleIO Configurations: Converged
Ethernet access PCIe/SCSI bus access
vSphere Cluster HyperV Cluster • Both SDS and app SDC SDC app SDC on the SDS SDS same node • CPU and SDC SDC app app memory efficient; SDS SDS more resources for compute SDC SDC app app • Can serve SDS ETHERNET SDS different hypervisor SDC SDC app app clusters with one SDS SDS storage cluster
SDC SDC app app SDS SDS
14 © Copyright 2017 Dell Inc. ScaleIO Configurations: Hybrid
Ethernet access PCIe/SCSI bus access • One ScaleIO app SDC SDC app cluster SDS SDS • SDS-only, SDC- only, and SDS SDC SDC app app +SDC nodes all SDS SDS possible • Scale storage SDC app app and compute SDS ETHERNET SDC independently
app SDS SDC
app SDS SDC
15 © Copyright 2017 Dell Inc.