Dell EMC All-Flash Strategy Operate Your Business in Real Time
Total Page:16
File Type:pdf, Size:1020Kb
Dell EMC All-Flash Strategy Operate your business in real time Aleksandr Shvadtshenko Sr System Engineer, Nordics Evolution of all-flash storage architectures Dell EMC Midrange • This research shows that flash will become the lowest cost media for almost all storage from 2016 and beyond, and that a shared data philosophy is required to maximize the potential from both storage cost and application functionality perspectives. 2 Dell - Internal Use - Confidential http://wikibon.org/wiki/v/Evolution_of_All-Flash_Array_Architectures Modernize your data center DELL EMC STORAGE PORTFOLIO 3 Dell - Internal Use - Confidential Storage Architecture matters TYPE TYPE TYPE TYPE Tightly Coupled Loosely CoupledWhy ScaleDistributed-Out? Scale Up 1 Scale-Out 2 Scale Out 3 Share Nothing 4 • Controllers are the Bottleneck • Dual Controller • Multi-Controller Grid • Independent Controllers • Independent Controllers • Shared Meta-Data • Shared Meta-Data • Distributed• No Meta front-Data-end relief• inDistributed Scale Up Meta-Data • Large• ContentLimited Repositories CPU for Data• Non Services-Transactional Commits • Mid-Tier Architecture • Enterprise Architecture • Linear Scaling – Iops & Latency • 7+ Year Asset Lifecycle • No performance tech refreshes • Xpect More Program SC / VMAX Isilon Isilon XtremIO • SuperiorvSAN Resiliency & Performance UNITY • N-Way Active/Active Architecture 4 Dell - Internal Use - Confidential ® 5 Dell - Internal Use - Confidential Powered by Intel Xeon® Processors Unprecedented growth story $2,000 $1,800 $1,600 $1,400 $1,200 Fastest growth $1,000 $800 5x nearest array $600 Groundbreaking $400 $200 1st Year 2nd Year 3th Year 4th Year 5th Year Time Since Introduction 6 Dell - Internal Use - Confidential Performance Consistent predictable performance 7 Dell - Internal Use - Confidential Speed is a competitive advantage BEFORE XTREMIO – ALL HDD 7ms Sudden “Reporting job finished at 1:30 AM impact! insteadLATENCY of 6:30 AM …now I can have my life back!” 0.5ms 8 Dell - Internal Use - Confidential Performance matters XtremIO consistently outperforms traditional AFAs • Consistent low latency at all Workload: OLTP with 8KB Block Size (Actual customer data ) times with no system level Latency Spikes garbage collection 2-5ms • Predictable, scalable IOPs Latency whether the array is new or has 10TB ‘X-Brick’ 35TB Traditional Flash Array been fully overwritten. Worse than Garbage collection kicks-in • Predictable performance with Latency Disk Latency Always-on, Inline Data 20-40ms Services 9 Dell - Internal Use - Confidential XTREMIO – NO SYSTEM LEVEL TAX XtremIO Controller No Garbage Collection ASIC ASIC ASIC ASIC ASIC ASIC ASIC ASIC ASIC Performed by Each SSD Controller ASIC • SSD controllers have ideal knowledge of the NAND • Zero back-end I/O initiated by the array controllers • No tax on array controllers 10 Dell - Internal Use - Confidential XTREMIO REBALANCING FULL FULL BALANCED BALANCED BALANCED BALANCED EMPTY EMPTY IOPS & Capacity (2x)IOPS & Capacity (4x) • Zero Downtime, on-demand scaling and non-disruptive upgrades • Predictable, Linear Growth for performance and capacity • Auto-Balancing reduces operational complexity/costs • Simplified, single-cluster management for workload consolidation 11 Dell - Internal Use - Confidential XtremIO X-Brick • Cluster building block 32 Active Active CPU Controller 1 Controller 2 CORES 256GB 256GB 512 Infiniband RDMA GB RAM RAM RAM 2 x FC 4 2 x FC 2 x iSCSI 2 x iSCSI HOST PORTS SAS 2.0 SAS 2.0 25 eMLC SSDs 12 Dell - Internal Use - Confidential XtremIO Family Portrait 150K mixed IOPS 1.2M mixed IOPS 250K read IOPS 2M read IOPS <1ms Latency <1ms Latency From 2 – 16 N-way Active Controllers Starter 5TB 5TB – Over 1PB Usable Capacity SCALE-OUT <1ms LATENCY RICH DATA SERVICES NO TUNING 13 Dell - Internal Use - Confidential © Copyright 2015 EMC Corporation. All rights reserved. Efficiency Transformational efficiency XtremIOIN-LINE inALL-line, THE all- theTIME-time, DATA data SERVICES services Thin Inline D@RE Provisioning Compression XVC Virtual Inline XtremIO Copies Deduplication Data Protection 15 Dell - Internal Use - Confidential XtremIO simplicity & automation Management Impact: • Zero Planning & Tuning 40 • No storage skills • No GUI certifications SECONDS • Provision in seconds! CREATEMAP Integration: INITIATORCREATE VOLUMES GROUPS213 • VMware vCenter • EMC ViPR, ESA, ESI, SRM • Microsoft Hyper-V • App Consoles: Oracle, SAP, System Center, etc • REST API & CLI 16 Dell - Internal Use - Confidential Complexity is no longer Needed SIMPLIFY ARCHITECTURE AND OPERATIONAL MANAGEMENT HISTORIC COMPLEXITIES Disk Type Selection RAID Protection Selection RAID Group or Storage Pool XTREMIO Striped or Concatenated Meta Devices Auto Tiering DONE! Array Caching Thick or Thin LUNs 17 Dell - Internal Use - Confidential XtremIO Data Protection • Designed for SSD • No legacy RAID baggage • Highly efficient- only 8% overhead Good Capacity • Lowest write amplification Utilization RAID 5 • SSDs may fail in place • No configuration XDP • No hot spares High Superior Performance Protection • Adapts to failures RAID 1 RAID 6 18 Dell - Internal Use - Confidential Business Agility ICDM: What If You Could Simultaneously… Consolidate Meet all everything: performance & production, dev, test, availability SLAs analytics Transform Simplify Business operations and process workflow self-service agility 20 Dell - Internal Use - Confidential The Copy Data Management Problem IDC: >60% data from copies Development Operations Test/Dev Sandbox Continuous- Integration Patch management QA Optimizations & tuning Training Pre-prod simulation Data Analytics Data Protection Production Reporting Backup BI DR copies Analytics Logical corruption protection 21 Dell - Internal Use - Confidential Traditional data copies process challenges Challenge: Slow copies Making copies is slow - Restore from backup takes hours - Virtual data center copy operations take a long time Using copies is slow - Snapshots are sloooow (metadata on disk) - Test environments usually have tier2 performance 22 Dell - Internal Use - Confidential XTREMIO VIRTUAL COPIES 100% IN-MEMORY 100% SPACE Any topology EFFICIENT Instant creation No space reservations Instant deletion No metadata bloat 100% PERFORMANCE 100% OPTIMIZED Identical read IOPS Identical data services Identical write IOPS Always on, always inline Identical latency INCREDIBLE SCALE UNMATCHED Use XtremIO where all- Instant application clones flash arrays were never to petabyte scale before viable 23 Dell - Internal Use - Confidential ALET’S SNAPSHOT SEE HOW IS CREATEDIT WORKS INSTANTLY IT ONLY INVOLVES ALLOCATION TO A SMALL CONTAINER IN-MEMORY METADATA ProductionShared MD MD Snapshot MD SSD DATA 24 Dell - Internal Use - Confidential METADATA MANAGEMENT IS EFFICIENT ENABLING THOUSANDS OF SPACE EFFICIENT COPIES IN-MEMORY METADATA Production MD Shared MD Snapshot MD SSD DATA 25 Dell - Internal Use - Confidential METADATA MANAGEMENT IS EFFICIENT THE METADATA IS SHARED AND IN-MEMORY SPACE EFFICIENT Modify Data B @ Block 1 IN-MEMORY METADATA Production MD Shared MD Snapshot MD SSD DATA 26 Dell - Internal Use - Confidential SNAPSHOT PERFORMANCE IS EQUAL IT’S EXACTLY LIKE WRITING DATA TO THE PRODUCTION VOLUME Modify Data D @ Block 4 IN-MEMORY METADATA Production MD Shared MD Snapshot MD SSD DATA 27 Dell - Internal Use - Confidential Virtual data copies at no cost Flash innovation will make fast & free copies • An XtremIO writable snaphots 1. Have same performance as a regular volume • - Metadata allways kept in memory • - No hops between metadata tables = IT’S FAST 2. Do not (at creation) consume any • - SSD capacity • - Metadata space = IT’S FREE 28 Dell - Internal Use - Confidential XVCXVC vs.vs. TRADITIONALtraditional snapshots SNAPSHOTS XtremIO Vs. Vendor “A” DB Volumes, Steady State, IOPS Over Time 70K IOPS XtremIO • No impact on copy creation IOPs • Consistent performance on prod and copy XtremIO Vs. Vendor “A” DB Volumes, Steady State, Latency Over Time Vendor A • IOPs drop by 50% to 35K • Spikes to 20ms 1ms latency latency Latency 29 Dell - Internal Use - Confidential Traditional infrastructure architecture Complex, costly, silo’d & slow Test & Dev ‘Starved’ Production ‘Underperforming’ Over-Provisioned Reports QA Instance Finance Copies Analytics Stress Test Marketing Copies Trends Training Sales Copies 3 copies for 30 engineers, 10TB for 2TB DB, 150K+ IOPS 10+ DB copies, 150K+ IOPS 30TB, ~50k+ IOPS 13+ DB copies to manage, 130TB+ of storage, 2TB of production application data SAP Applications deployed on multiple, dedicated & inefficient storage silos 30 Dell - Internal Use - Confidential Consolidate with ONE platform Efficient, faster & simpler Test & Dev Production Mktg, Fin, Sales Every engineer gets a full Every team gets a full DB copy, All data, full IOPs 10TB for 2TB DB, 150K+ IOPS DB, All data, Flash speeds • One single all-flash array • Faster than silos of storage • Simpler to manage 31 Dell - Internal Use - Confidential Advantages of Flash Storage in the Data Center Result: You’ll build better quality software faster • Faster Development Copies - > Faster development • More Testing Copies-> More testing • More & Faster Develoment Resources- > Better code, less bugs, FASTER TTM Happier Users Happier Developers 32 Dell - Internal Use - Confidential Storage Architecture matters TYPE TYPE TYPE TYPE Tightly Coupled Loosely Coupled Distributed Scale Up 1 Scale-Out 2 Scale Out Why3 ScaleShare-Out? Nothing 4 • Dual Controller • Multi-Controller Grid •• IndependentControllers Controllers are