Arkadiusz Ścisło Storage Practice Sun Microsystems 1 IT Storage Challenges Wzrost ilo ści danych zwi ększa wyzwania co do infrastruktury IT Niewystarczająca wydajność pamięci Utrzymanie masowej ZuŜycie prądu wymaganych dla wymagających SLAs aplikacji 2 The Business Eco-System 3 Co to jest Open ...? • Open Architecture Industry standard hardware & open source software implementing functions that scale higher at lower TCO than proprietary alternatives It is the next step in the evolution toward an open end-to-end • Open Software system. Open sourced code and APIs to maximize the developer Open Servers OpenStorage Open Network A storage approach Unified data center opportunity Leveraging innovative network that utilizes product design and that leverages common components, packaging, common open source software, components, open source open software, and seamless integration software, and wide with existing interoperability to deliver an open architecture with environments breakthrough economics common components, and to deliver for Sun customers breakthrough ecomonics • Open Interoperability open interoperability to for Sun customers Simple, predictable integration in create innovative storage heterogeneous environments products that deliver (open data formats, open breakthrough economics protocols) for Sun customers Sun Proprietary/Confidential: Need to Know 4 “Otwarta” Strategia Sun'a Open Servers Open Storage Open Archive Open Source reduced costs • Follows same server trend and vendor lock-in Archive products built from • General purpose systems will open architectures Scale out architectures brought drive storage costs down Using general purpose new economics systems • Robust Open Source soft-ware that drive down costs Commoditization brought will further reduce costs increased competition Seamless integration • Simple data administration with existing environments Differentiation from innovative • Revolutionary analytics Leading Sun Archive product design and packaging software • Open architectures will free now open sourced users from vendor lock-in Sun Confidential: Internal Only 5 Sun Open Storage 7000 • Nowe podejście do tworzenia produktów storage • Wykorzystanie atutów Sun Microsytems • Jest o czym opowiadać Sun Confidential: Internal Only 6 Od pocz ątku ... Co to znaczy Open Storage? • Stworzone z otwartych elementów software'owych dostępnych dla kaŜdego • Dający moŜliwość pełnej kontroli przez Administratora • Rozwijane poprzez społeczność http://www.sun.com/storage/openstorage/community.jsp • Standardowy hardware • NiezaleŜny od producenta sprzętu Sun Confidential: Internal Only 7 Sun Open Storage 7000 NajwaŜniejsze elementy: • OpenSolaris, w tym ZFS (Zetabyte File System) • DTrace – element Solaris 10 umoŜliwiający monitoring pracy elementów systemu • Mechanizmy self-healing – Solaris 10 i zFS • Dyski SSD Sun Confidential: Internal Only 8 Najwolniejszy element – “w ąskie gardła” Sun Confidential: Internal Only 9 Problem z wydajno ści ą ? Oczekiwanie na dane ... • Today’s Multi-Core, Multi-Socket application server design are increasingly held back by slow storage • When requesting data, the server spends most of it’s time waiting for storage • Application performance remain sluggish regardless of the Server CPU horsepower • The traditional remedy of adding more expensive DRAM may no longer suffice as data sets double ever 2 years Sun Confidential: Internal Only 10 Enterprise SSD vs HDD – Wydajno ść • Enterprise HDD •Enterprise SSD > 180 write IOPs 7,000 write IOPs > 320 read IOPs 35,000+ read IOPs Sun Confidential: Internal Only 11 Wi ększa wydajno ść z dyskami SSD •Today’s Multi-Core, Multi-Socket application server design are now served by High Performance SSDs •The server no longer waists time waiting for data •Application performance is as high as the Server CPUs horsepower •No longer need to remedy sluggish storage performance by adding expensive DRAM •Bottom Line: Improved end user experience, faster results and Better ROI Sun Confidential: Internal Only 12 Hybrid Storage Pool Model Scale Performance and Capacity Independently Read Write Storage Performance Performance Capacity Transparently Managed As A Single Storage Pool Sun Confidential: Internal Only 13 Latency Comparison Bridging the DRAM to HDD Gap Sun Confidential: Internal Only 14 ZFS Hybrid Storage Pool Architecture Performance Tuning Without the Guess Work Old Model Storage Pool New Model Storage Pool Hybrid Storage Pool (ZFS) • ARC – Adaptive Replacement Cache , the main ZFS memory cache in DRAM • L2ARC – Level Two Adaptive Replacement Cache , extends the ARC into Read Optimized Solid State Disk Devices to provide a large read cache to accelerate reads • ZIL – ZFS Intent Log is transactional, using Write Optimized Solid State Disk Devices provides a large cache to accelerate writes • Disk Storage Pool – 7200 RPM SATA Drives, high speed drives no longer relevant Sun Confidential: Internal Only 15 ZFS Hybrid Storage Pool Architecture Sun Confidential: Internal Only 16 Building the Hybrid Storage Pool Combining Performance and Capacity Sun Confidential: Internal Only 17 W czym mo Ŝe pomóc ZFS ? “Hybrid Storage Pool Data Management” ZFS automatically: • Writes new data to a very fast SSD pool ZFS Intent Log (ZIL) • Determines data access patterns and stores frequently accessed data in the L2ARC • Bundles IO into sequential lazy writes for more efficient use of low cost mechanical disks • Now shipping in OpenSolaris and coming soon in Solaris 10 Sun Confidential: Internal Only 18 Sun Storage 7000 Unified Storage Systems Scale your Storage, not your Budget Sun Confidential: Internal Only 19 Sun Storage 7110 Unified Storage System Unified Storage Systems for Departmental/Workgroups • Hybrid Storage Pool 8GB Adaptive Replacement Cache 1 x AMD Quad-Core Processor Sun Fire x4240 BRAND 6 PCI-E slots NEW 14 x 146GB or 300GB SAS Drives • Network Connectivity Standard 4 x 1Gb Ethernet Ports Optional Dual Copper or Optical Port 10Gb Ethernet Optional Quad Port 1 Gb Ethernet • Tape Backup Connectivity Optional Dual Fiber Channel HBA Optional Dual Port SCSI HBA Sun Confidential: Internal Only 20 Sun Storage 7210 Unified Storage System High-density Open Unified Storage Systems Hybrid Storage Pool 32GB or 64GB ARC 2 x AMD Quad-Core Processors Sun Fire x4540 3 PCI-E slots SSD Write Optimized Up to 2 x 36GB 46 x 250GB,500GB or 1TB Drives BRAND Expandable to 142 Drives (2@J4500) NEW Network Connectivity Standard 4 x 1Gb Ethernet Ports Optional Dual Copper or Optical Port 10Gb Ethernet Optional Quad Port 1 Gb Ethernet Tape Backup Connectivity Optional Dual Fiber Channel HBA Optional Dual Port SCSI HBA Sun Confidential: Internal Only 21 Sun Storage 7310 Unified Storage System High Availability, cost effective Unified Open Storage Server BRAND Hybrid Storage Pool NEW 16GB or 64GB ARC Sun Fire x4140 Up to 4 x quad-core CPU 3 PCI-E slots per node SSD Read Optimized Up to 12 x 100GB SSD Write Optimized Up to 16 x 36GB SATA up to 96 1TB Drives Arrays up to 4 @ 24 HDDs (4 x J4400) Network Connectivity Standard 4 x 1Gb Ethernet Ports Optional Dual Copper or Optical Port 10Gb Ethernet Optional Quad Port 1 Gb Ethernet Tape Backup Connectivity Optional Dual Port Fiber Channel HBA Optional Dual Port SCSI HBA Clustering for High Availability Sun Confidential: Internal Only Preliminary Data Valid from May 29 - Subject to Change without Notice 22 Sun Storage 7410 Unified Storage System High Availability, massive scale Unified Open Storage Server • Hybrid Storage Pool 16GB, 64GB or 128GB ARC Sun Fire x4440 Up to 8 x 6-core CPU 6 PCI-E slots per node SSD Read Optimized Up to 12 x 100GB SSD Write Optimized Up to 16 x 36GB SATA up to 576 1TB Drives Arrays up to 24 @ 24 HDDs (24 x J4400) • Network Connectivity Standard 4 x 1Gb Ethernet Ports Optional Dual Copper or Optical Port 10Gb Ethernet Optional Quad Port 1 Gb Ethernet • Tape Backup Connectivity Optional Dual Port Fiber Channel HBA Optional Dual Port SCSI HBA • Clustering for High Availability Sun Confidential: Internal Only 23 Additional Management Clustering - Active / Active Take Over Functionality Network Network Pool 0 Pool 1 Pool 0 Pool 1 • Normal Operation • In the event of a take over The take over node will temporarily own both Each node owns a storage pool and network resources storage pools. Duplicate network adapters are now active to Duplicate network adapters are kept service the failed node's clients available for the other node in the event of a take over Sun Confidential: Internal Only 24 Additional Management Clustering - Active / Passive Take Over Functionality Network Network Pool 0 Pool 0 • Normal Operation • In the event of a take over The take over node will temporarily own all One node owns all resources, Network and Storage Pool resources, Network and Storage Pool The other node is effectively in a standby mode Sun Confidential: Internal Only 25 Additional Management Browser User Interface • The primary administrative interface Open Storage Manger is an AJAX-based browser interface Uses HTTPS - https://amberroadappliance:215 Supported Browsers are Firefox, Safari,IE6,IE7 and Opera. Sun Confidential: Internal Only 26 Additional Management CLI and RPC Interface • CLI Interface CLI tools can execute locally on the appliance to change the configuration: all features are accessible as in the browser UI except the graphical DTrace Analytics and dashboard elements CLI is accessed over SSH for security Different CLI syntax than 5320 Easy to learn Syntax CLI Scripting