Software Defined Storage @

PRESENTATION TITLE GOES HERE Siddhartha Roy Cloud + Enterprise Division Microsoft Corporation Lessons Learned – operating large cloud properties Industry trends

Cloud scale services influencing design Data explosion • Standard, volume hardware to build • Device proliferation high-scale systems at low cost • Modern apps • Cloud design points in software • Unstructured data analytics

What is Software Defined Storage (SDS) ? Cloud scale storage and cost economics on standard, volume hardware

Virtualization Scale Out with minimal operational • Mobility and flexibility within and complexity across sites/clouds • More density

3 Customer choice

Private Cloud Private Cloud Hybrid Public with partner with Cloud Microsoft SDS Storage Storage

SAN and NAS Windows SMB3 StorSimple + storage Scale Out File Server Microsoft Azure storage (SoFS) + Storage Storage Spaces Microsoft Software Defined Storage (SDS) Breadth offering and unique opportunity Private Enterprise and Hosted Clouds with SAN and NAS storage

Private Cloud Private Cloud Hybrid Public with partner with Cloud Cloud storage Microsoft SDS Storage Storage

SAN and NAS Windows SMB3 StorSimple + Microsoft Azure storage SoFS + Storage Microsoft Azure storage Spaces Optimizing Windows for SAN/NAS storage

• INCITS: T10,T11,T13 (SCSI,FC,AT) • Technical work: SMI-S, NVM • IETF: Co chairs for NFS 4.1, STORM Programming, XAM (iSCSI) • SMB 2/3 Plugfest Private Enterprise and Hosted Clouds with Microsoft Storage Defined Storage

Private Cloud Private Cloud Hybrid Public with partner with Cloud Cloud storage Microsoft SDS Storage Storage

SAN and NAS Windows SMB3 StorSimple + Microsoft Azure storage SoFS + Storage Microsoft Azure storage Spaces Public Cloud lessons applied Software Defined Storage in Windows Server 2012 R2

Primary application data storage on cost affective, continuously available, high performance

Hyper-V Clusters SMB3 file Shares backed by Storage Spaces SMB3 Storage Network Fabric 1 1. Performance, Scale: SMB3 File Storage network 2 2 Scale-Out File Server Clusters 2. Continuous Availability and Seamless Scale Out with File Server Nodes Storage Spaces 3 3. Elastic, Reliable, Optimized Storage Spaces Shared JBOD 4 Storage 4. Standard volume hardware for low cost

SoFS + Storage Spaces – under the hood

SMB3 File Storage network Hyper-V cluster  High speed, low latency with SMB Direct nodes  SMB Multichannel for storage path failure resiliency SMB3 Storage Network Scale Out File Server Nodes  Easy share management Scale Out File Server  Active/Active Scale Out pay as you grow cluster nodes  Continuously Available

Tiered Storage spaces Virtualized storage  Optimized Placement

Physical SSD storage HDD SoFS - Low latency, high scale with SMBDirect

• SMBDirect – Microsoft implementation of RDMA on Ethernet, InfiniBand over SMB3 Hyper-V Scale Out File server (SoFS) protocol Cluster Cluster • High throughput with low latency App Buffer • Optimized to expose full potential of 10/40Gbps Ethernet and 56Gbps SMB SMB Buffer Buffer InfiniBand • Usage beyond storage for Server  Server Fast Live migration

32KB random reads from a mirrored Adapter Adapter Buffer Buffer space (disk) ~500,000 IOPS ~16.5 GBytes/sec Windows System Center Server Software Defined Storage stack overview

Guest Scale with 8,000 VMs Hyper-V Dynamic SMB3 in Clusters on DPM 64-node per Hyper- Replica Access flight data clusters V Cluster SMB control encryption

Cluster-Aware VM VM Storage Updating Windows Prioritization Migration with no Azure downtime Backup

Storage File storage Block storage Utilization provisioning provisioning Trending

SMB3 SoFS for Hyper-V, SQL Server Thin NFS 3, 4.1 SAS Array PowerShell iSCSI Target SMB3 for Provision for *nix SMB3 SMB3 Direct CSV Scale SMB3 Support Support block Windows Transparent for low Multichannel Alert Monitor clients, Out storage clients Failover latency for FT, Perf VMware Hyper-V SAN based Thin LUN ReFS local Storage Rapid Fast NTFS provisioning file system Dedup chkdsk Management Provisioning for resiliency

SMI-S Storage Pool SM API Storage Tiered Storage Spaces Classification Integration Service Private Cloud Choice - SAN or Microsoft SDS

Traditional FC/iSCSI Hyper-V Hyper-V Microsoft SDS Storage SAN storage arrays compute compute (in Windows Server) nodes nodes  Block protocol fabric  File protocol fabric  Low latency network  Low latency with SMB3Direct  Management of LUNs  Management of Shares  Storage tiering  Storage tiering (new with R2)  Data deduplication  Data deduplication

 RAID resiliency groups Scale Out File Server +  Flexible resiliency options SAN/NAS  Pooling of disks Storage Spaces  Pooling of disks.  High availability FC/SAS disk shelf Shared SAS JBOD  Continuous availability FC/SAS disk shelf Shared SAS JBOD  Persistent write-back cache.  Persistent write-back cache.  Copy offload (new with R2)  Snapshots  SMB copy offload  Snapshots Customer Quote: NTTX

Hosting provider uses industry-standard storage (Microsoft SoFS + Storage Spaces) to slash storage costs by 30 %

“By using Storage Spaces, Hyper-V NTTX designed a Benefits: over SMB, and other new features, I new datacenter Achieved greater eliminate big, lumpy capital around Windows flexibility for meeting Server 2012 in order customer needs. expenditures.… I can buy to get new services Got new offerings to inexpensive storage…and scale.” to market faster and market faster. - Philip Moss, Chief Technology Officer, NTTX Select at a lower cost. Increased annual revenue opportunities to U.S.$18.6 million. Saved $5.8 million a year. http://www.quantaqct.com/ http://www.dell.com/ http://www.supermicro.com/

http://www.raidinc.com/ http://www.fujitsu.com/fts/ http://www.dataonstorage.com/ Ecosystem of SMB server/client implementations

SMB PlugFest  Occurs every year side-by-side with the Storage Developer Conference (SNIA SDC) in September  Interaction across operating systems and SMB implementations

Participants in the 2013 edition of the SNIA SMB2 / SMB3 Plugfest Santa Clara, CA – September 2013

Hybrid Cloud Storage StorSimple + Azure

Private Cloud Private Cloud Hybrid Public with partner with Cloud Cloud storage Microsoft SDS Storage Storage

SAN and NAS Windows SMB3 StorSimple + Microsoft Azure storage SoFS + Storage Microsoft Azure storage Spaces StorSimple Applications & Workloads

Target Use Cases File Share CapEx, OpEx of traditional File servers SMB storage NAS NFS SharePoint Collaboration Data grows exponentially Cloud Content & records Business intelligence (50–60% Annually) Storage management

Capacity Archives Media EMR/PACS Most I/O happens to Engineering Legal working set data Logs, records Construction VMs Local VM sprawl Regional office Storage VM archives storage Time

MICROSOFT – NDA ONLY Application Servers StorSimple connects Windows, Hyper-V and VMware servers to Azure Storage in minutes with no application modification

StorSimple Appliance

Most Active Data on SSD

Warm data on SAS Local Tier Consolidates primary, archive, backup, Speed of SSD/SAS • + Elasticity of Cloud DR thru seamless integration with Azure

Azure Storage • Cloud Snapshots = revolutionary speed, Inactive Primary Data + simplicity and reliability for backup and recovery Backup + Archive + • Reduces enterprise storage TCO by 60–80% DR Public Cloud Storage – Azure

Private Cloud Private Cloud Hybrid Public with partner with Cloud Cloud storage Microsoft SDS Storage Storage

SAN and NAS Windows SMB3 StorSimple + Microsoft Azure storage SoFS + Storage Microsoft Azure storage Spaces Store, backup, recover your data

• Highly scalable: 20 trillion objects stored • Highly durable: Multiple copies of your data • Multiple object support: blobs, tables, drives • Easy access: Supports REST APIs • Available anywhere: multiple regions

Get your data wherever and whenever you need it

• Microsoft Azure Storage • Defend against regional disasters.

Geo replication

Continue the journey …… Microsoft Cloud Server – Contribution to Open Compute

 Contributions to Open Compute Project – CAD models, Specs, Gerber files, Source code  Benefits to traditional servers - 40% cost savings, 15% power efficiency gains Where can I find more information ?

Microsoft Storage  http://Microsoft.com/storage

Solution guide – Cost effective storage for Hyper-V  http://technet.microsoft.com/en-us/library/dn554251.aspx

Drop by our expo booth