Arkadiusz Ścisło Storage Practice Sun Microsystems
1 IT Storage Challenges Wzrost ilo ści danych zwi ększa wyzwania co do infrastruktury IT
Niewystarczająca wydajność pamięci Utrzymanie masowej ZuŜycie prądu wymaganych dla wymagających SLAs aplikacji
2 The Business Eco-System
3 Co to jest Open ...? • Open Architecture Industry standard hardware & open source software implementing functions that scale higher at lower TCO than proprietary alternatives It is the next step in the evolution toward an open end-to-end • Open Software system. Open sourced code and APIs to maximize the developer Open Servers OpenStorage Open Network A storage approach Unified data center opportunity Leveraging innovative network that utilizes product design and that leverages common components, packaging, common open source software, components, open source open software, and seamless integration software, and wide with existing interoperability to deliver an open architecture with environments breakthrough economics common components, and to deliver for Sun customers breakthrough ecomonics • Open Interoperability open interoperability to for Sun customers Simple, predictable integration in create innovative storage heterogeneous environments products that deliver (open data formats, open breakthrough economics protocols) for Sun customers
Sun Proprietary/Confidential: Need to Know 4 “Otwarta” Strategia Sun'a
Open Servers Open Storage Open Archive Open Source reduced costs • Follows same server trend and vendor lock-in Archive products built from • General purpose systems will open architectures Scale out architectures brought drive storage costs down Using general purpose new economics systems • Robust Open Source soft-ware that drive down costs Commoditization brought will further reduce costs increased competition Seamless integration • Simple data administration with existing environments Differentiation from innovative • Revolutionary analytics Leading Sun Archive product design and packaging software • Open architectures will free now open sourced users from vendor lock-in
Sun Confidential: Internal Only 5 Sun Open Storage 7000
• Nowe podejście do tworzenia produktów storage • Wykorzystanie atutów Sun Microsytems • Jest o czym opowiadać
Sun Confidential: Internal Only 6 Od pocz ątku ... Co to znaczy Open Storage?
• Stworzone z otwartych elementów software'owych dostępnych dla kaŜdego • Dający moŜliwość pełnej kontroli przez Administratora • Rozwijane poprzez społeczność http://www.sun.com/storage/openstorage/community.jsp • Standardowy hardware • NiezaleŜny od producenta sprzętu
Sun Confidential: Internal Only 7 Sun Open Storage 7000 NajwaŜniejsze elementy: • OpenSolaris, w tym ZFS (Zetabyte File System) • DTrace – element Solaris 10 umoŜliwiający monitoring pracy elementów systemu • Mechanizmy self healing – Solaris 10 i zFS • Dyski SSD
Sun Confidential: Internal Only 8 Najwolniejszy element – “w ąskie gardła”
Sun Confidential: Internal Only 9 Problem z wydajno ści ą ? Oczekiwanie na dane ... • Today’s Multi-Core, Multi-Socket application server design are increasingly held back by slow storage • When requesting data, the server spends most of it’s time waiting for storage • Application performance remain sluggish regardless of the Server CPU horsepower • The traditional remedy of adding more expensive DRAM may no longer suffice as data sets double ever 2 years
Sun Confidential: Internal Only 10 Enterprise SSD vs HDD – Wydajno ść
• Enterprise HDD •Enterprise SSD
> 180 write IOPs 7,000 write IOPs
> 320 read IOPs 35,000+ read IOPs
Sun Confidential: Internal Only 11 Wi ększa wydajno ść z dyskami SSD
•Today’s Multi Core, Multi Socket application server design are now served by High Performance SSDs •The server no longer waists time waiting for data •Application performance is as high as the Server CPUs horsepower •No longer need to remedy sluggish storage performance by adding expensive DRAM •Bottom Line: Improved end user experience, faster results and Better ROI
Sun Confidential: Internal Only 12 Hybrid Storage Pool Model Scale Performance and Capacity Independently
Read Write Storage Performance Performance Capacity
Transparently Managed As A Single Storage Pool
Sun Confidential: Internal Only 13 Latency Comparison Bridging the DRAM to HDD Gap
Sun Confidential: Internal Only 14 ZFS Hybrid Storage Pool Architecture Performance Tuning Without the Guess Work
Old Model Storage Pool New Model Storage Pool Hybrid Storage Pool (ZFS)
• ARC – Adaptive Replacement Cache , the main ZFS memory cache in DRAM • L2ARC – Level Two Adaptive Replacement Cache , extends the ARC into Read Optimized Solid State Disk Devices to provide a large read cache to accelerate reads • ZIL – ZFS Intent Log is transactional, using Write Optimized Solid State Disk Devices provides a large cache to accelerate writes • Disk Storage Pool – 7200 RPM SATA Drives, high speed drives no longer relevant Sun Confidential: Internal Only 15 ZFS Hybrid Storage Pool Architecture
Sun Confidential: Internal Only 16 Building the Hybrid Storage Pool Combining Performance and Capacity
Sun Confidential: Internal Only 17 W czym mo Ŝe pomóc ZFS ? “Hybrid Storage Pool Data Management”
ZFS automatically: • Writes new data to a very fast SSD pool ZFS Intent Log (ZIL) • Determines data access patterns and stores frequently accessed data in the L2ARC • Bundles IO into sequential lazy writes for more efficient use of low cost mechanical disks • Now shipping in OpenSolaris and coming soon in Solaris 10
Sun Confidential: Internal Only 18 Sun Storage 7000 Unified Storage Systems Scale your Storage, not your Budget
Sun Confidential: Internal Only 19 Sun Storage 7110 Unified Storage System Unified Storage Systems for Departmental/Workgroups
• Hybrid Storage Pool
8GB Adaptive Replacement Cache
1 x AMD Quad Core Processor
Sun Fire x4240 BRAND 6 PCI E slots NEW 14 x 146GB or 300GB SAS Drives • Network Connectivity
Standard 4 x 1Gb Ethernet Ports
Optional Dual Copper or Optical Port 10Gb Ethernet
Optional Quad Port 1 Gb Ethernet • Tape Backup Connectivity
Optional Dual Fiber Channel HBA
Optional Dual Port SCSI HBA
Sun Confidential: Internal Only 20 Sun Storage 7210 Unified Storage System High-density Open Unified Storage Systems Hybrid Storage Pool 32GB or 64GB ARC 2 x AMD Quad Core Processors Sun Fire x4540 3 PCI E slots SSD Write Optimized Up to 2 x 36GB 46 x 250GB,500GB or 1TB Drives BRAND Expandable to 142 Drives (2@J4500) NEW Network Connectivity Standard 4 x 1Gb Ethernet Ports Optional Dual Copper or Optical Port 10Gb Ethernet Optional Quad Port 1 Gb Ethernet Tape Backup Connectivity Optional Dual Fiber Channel HBA Optional Dual Port SCSI HBA
Sun Confidential: Internal Only 21 Sun Storage 7310 Unified Storage System High Availability, cost effective Unified Open Storage Server BRAND Hybrid Storage Pool NEW 16GB or 64GB ARC Sun Fire x4140 Up to 4 x quad core CPU 3 PCI E slots per node SSD Read Optimized Up to 12 x 100GB SSD Write Optimized Up to 16 x 36GB SATA up to 96 1TB Drives Arrays up to 4 @ 24 HDDs (4 x J4400) Network Connectivity Standard 4 x 1Gb Ethernet Ports Optional Dual Copper or Optical Port 10Gb Ethernet Optional Quad Port 1 Gb Ethernet Tape Backup Connectivity Optional Dual Port Fiber Channel HBA Optional Dual Port SCSI HBA Clustering for High Availability
Sun Confidential: Internal Only Preliminary Data Valid from May 29 Subject to Change without Notice 22 Sun Storage 7410 Unified Storage System High Availability, massive scale Unified Open Storage Server • Hybrid Storage Pool
16GB, 64GB or 128GB ARC
Sun Fire x4440
Up to 8 x 6 core CPU
6 PCI E slots per node
SSD Read Optimized Up to 12 x 100GB
SSD Write Optimized Up to 16 x 36GB
SATA up to 576 1TB Drives
Arrays up to 24 @ 24 HDDs (24 x J4400) • Network Connectivity
Standard 4 x 1Gb Ethernet Ports
Optional Dual Copper or Optical Port 10Gb Ethernet
Optional Quad Port 1 Gb Ethernet • Tape Backup Connectivity
Optional Dual Port Fiber Channel HBA
Optional Dual Port SCSI HBA • Clustering for High Availability
Sun Confidential: Internal Only 23 Additional Management Clustering - Active / Active Take Over Functionality
Network Network
Pool 0 Pool 1 Pool 0 Pool 1
• Normal Operation • In the event of a take over The take over node will temporarily own both Each node owns a storage pool and network resources storage pools. Duplicate network adapters are now active to Duplicate network adapters are kept service the failed node's clients available for the other node in the event of a take over Sun Confidential: Internal Only 24 Additional Management Clustering - Active / Passive Take Over Functionality
Network Network
Pool 0 Pool 0
• Normal Operation • In the event of a take over The take over node will temporarily own all One node owns all resources, Network and Storage Pool resources, Network and Storage Pool
The other node is effectively in a standby mode
Sun Confidential: Internal Only 25 Additional Management Browser User Interface • The primary administrative interface Open Storage Manger is an AJAX based browser interface Uses HTTPS https://amberroadappliance:215 Supported Browsers are Firefox, Safari,IE6,IE7 and Opera.
Sun Confidential: Internal Only 26 Additional Management CLI and RPC Interface • CLI Interface
CLI tools can execute locally on the appliance to change the configuration: all features are accessible as in the browser UI except the graphical DTrace Analytics and dashboard elements
CLI is accessed over SSH for security
Different CLI syntax than 5320
Easy to learn Syntax
CLI Scripting
CLI also permits scripts to be written and sent over SSH, and underlying XML RPC calls will be exposed to developers
CLI scripting can be used to integrate with end user scripts (e.g. create a home directory for each user in LDAP directory)
Sun Confidential: Internal Only 27 FISHWorks Appliance Instantiation of Open Storage • Accessible via WEB browser • Easy to Configure & Diagnose
• Extremely granular Analytics via D Trace and Fully Integrated Software and Hardware (FISH)
Sun Confidential: Internal Only 28 Unprecedented DTrace Analytics Analyse Performance Bottlenecks Down to the User Level
• Real time monitoring of the complete storage system • Built on DTrace instrumentation for key subsystems > NFSv3, NFSv4, CIFS, iSCSI > ZFS and the Solaris i/o path > CPU and Memory Utilization > Networking (TCP, UDP, IP) • Real time graphical business analytics > “What files are hot right now?” > “What is the distribution of reads and writes?” > “Which CIFS clients are hot right now?” > “How much networking bandwidth do I use?” • Group into worksheets, can be made persistent • Data can be exported for further number crunching
Sun Confidential: Internal Only 29 Additional Management DTrace Analytics - Continued • Drill Down statistics to amazing detail levels
Sun Confidential: Internal Only 30 Additional Management DTrace Analytics - continued • Statistic categories and Drill Down subcategories CPU Mode, CPU ID, Application, Process RawID, User ID, Category Statistic Drill Down Subcategories CPU Mode, CPU ID, Application, Process RawID, User ID, CIFS Operations Op, Client, Filename, Share, Project, Latency,, Offset, Size Raw Op, Client, Raw CPU Utilization Percent Type, Disk, Size, Latency, Offset, Raw CPU Kernel Spins Disk, Raw Disk iSCSI Operations Op, Pool, Raw Disk I/O Operations Op, Pool, Raw Disk Utilization Percent Raw Disk ZFS I/O Bytes Hit/Miss, Raw Disk ZFS I/O Operations File system DNLC Entries File system DNLC Accesses Kmem Cache, Raw HTTP/WebDAV Requests KmemOp, Result, Cache, Client, Raw Filename, User, Usere, Agent, Latency, Siz Raw Memory Dynamic Memory Usage Kmem Cache, Application,Raw Raw Memory Kernel Memory Memory Kernel Memory In Use Memory Kernel Memory Lost To Fragmentation
Sun Confidential: Internal Only 31 Additional Management DTrace Analytics - continued
Op, Raw • Statistic categories and DrillOp, Raw Down subcategories – Op, Raw Categorycont' Statistic Op,Drill RawDown Subcategories NDMPDevice Disk Bytes Bytes Transferred Direction, Device, Raw NDMPInterface Filesystem Bytes Operations NDMP Jobs NDMP Tape Bytes Transferred Hostname, Protocol, Direction, Raw Network Network Direction, Interface, Raw Network IP Bytes Network IP Packets Network TCP Bytes Network TCP Packets Hostname, Protocol, Direction, Raw ZFS ARC Adaptive Parameter Raw ZFS ARC Accesses Hostname, Protocol, Hit/Miss, Direction, Raw Raw ZFS ARC Size RawHostname, Protocol, Direction, Raw ZFS ARC Target Size Raw
Sun Confidential: Internal Only 32 Data Services ZFS • ZFS NAS offerings Effectively unlimited capacity Thin provisioning using dynamic reservations and quotas for projects and shares Check summing of all data and meta data Data protection schemes for capacity, availability and performance
Sun Confidential: Internal Only 33 Data Services ZFS - Continued • ZFS Useable Space Market Leading Usable Space
Double Double Mirrored Single Parity Striped Parity Parity RAID RAID RAID Wide Stripes
72% 83% 42% 60% 90%
Sun Confidential: Internal Only 34 Data Services ZFS - Continued • ZFS Resilver Feature Rebuild Times Traditional volume Sunfor Unified Spare fromStorage failed 7210mirror manager filesystem 55 delivered architecture must 600050 Concurrent Streams = 45 750 MB/sec! resilver by copying 44,000 hours40 of content = 20TB Usable, 46 TB every block of a disk. 35 Mirrored 55,00030 FLV files random access 7000 series need only 25
resilver allocated Minutes 20 blocks. 15 10 Faster rebuilds means 5 0 faster recovery to full 7110-146G 7110-146G ST6540- protection and full SAS 10% SAS Full 146G FC performance. Spare Drive Type/System
Sun Confidential: Internal Only 35 Data Protocols NDMP backup and recovery using directly connected tape drives
Sun Storage 7000 • Directly Connected Tape Drives Network FC SAN Backup application server controls the tape library and mounts tapes for the
Backup Server appliance. NDMP commands and reporting go to and from the backup application server over the network. Backups and restores go over FC connections to the tape drives in the tape library.
Sun Confidential: Internal Only 36 Additional Management Name Services • Name services supported are DNS and NIS
Sun Confidential: Internal Only 37 Absolute Zero Cost Software License Free and No Charge Support
DataData Protocols DataData Services DataAdditional Management Protocols Services Management
• NFS v2, v3 and v4 • Write Flash Acceleration • DTrace Analytics • CIFS • Read Flash Acceleration • Self healing system and data • iSCSI • RAID 2Z (RAID 6 P+Q) • Simple out of the box setup • HTTP and HTTPS • Mirroring • Secure Browser UI and CLI • WebDAV • Striping • Advanced Networking • FTP, FTPS and SFTP • Active active Clustering • NIS, LDAP, and AD • NDMP v4 • Remote Replication • Users, Rolls • FC Target (Roadmap) • Antivirus Support • Dashboard • InfiniBand • Unlimited Snapshots • Alerts • SNMP • Compression • Phone Home • De Duplication (Roadmap) • Scripting BRAND • Microsoft VSS Shadow Copy • Online Upgrade NEW • CIFS share level ACL • Workflow Automation
Sun Confidential: Internal Only 38 Sun Storage 7000 Certyfikacje ISV
Sun Confidential: Internal Only 39 Co tak naprawd ę jest „Open” w „Open Storage” serii 7000? Otwarte elementy to: A. Open Server (Architektura) B. OpenSolaris ( zFS ) C. Open Networks (Protocols) Storage D. Open Software (DTrace)
Integrated Platform Compute Network
Sun Confidential: Internal Only 40 .... a co w takim razie jest „Closed”?
Element zaknięty to: Management Interface based on Fishworks (GUI + Command Interface)
Sun Confidential: Internal Only 41 ZFS Hybrid Pool Example Based on Actual Benchmark Results 4.9x 3.2x 4%
2x 11%
Read IOPs Write IOPs Cost Storage Power Raw Capacity (Watts) (TB)
Hybrid Storage Pool (DRAM + Read SSD + Write SSD + 5x 4200 RPM SATA) Traditional Storage Pool (DRAM + 7x 10K RPM 2.5”)
Sun Confidential: Internal Only 42 Sun 7410 vs NetApp FAS6080 50 TB VS 50 TB Production Environment
$1 000 000 $900 000 $800 000 $700 000 Initial Investment $600 000 Year 2 Year 3 $500 000 Year 4 $400 000 Year 5 Total $300 000 $200 000 $100 000 $0 NetApp FAS6080 Sun 7410 Savings
Cash Flow Analysis Eco Metrics NetApp FAS6080 Sun 7410 Pct. Reduction Power kWh/month 3,547 1,73 51% Cooling kWh/month 2,838 1,384 51% CO2 MT/month 1,33 0,65 51% Floor space sq. m 3 1 73%
Sun Confidential: Internal Only 43 Sun Confidential: Internal Only 44 http://blogs.sun.com/brendan/date/20081215
Sun Confidential: Internal Only 45 UK IT Pro have recently published their review of our Storage 7410 Unified Storage System and our solution was given 5/6 stars and an Editors Choice Award.
The comprehensive review is summed up with the verdict: The 7410 offers more of everything for network storage and looks very good value – especially as the standard features include unlimited snapshots and replication. FC SAN supports would make it truly complete but its hybrid pools allow you to choose combinations of storage devices to suit requirements, performance across a range of protocols is good and it comes with sophisticated management and monitoring tools. http://www.itpro.co.uk/610529/sun storage 7410 unified storage system review Sun Confidential: Internal Only 46 SE7000 – Try and Buy
http://www.sun.com/tryandbuy/applyonline.jsp Sun Confidential: Internal Only 47 Open VTL Strategy Open Storage Emulates Tape
Tape Automation
VTL Servers
Sun Confidential: Internal Only 48 Dzi ękuj ę ...
Arkadiusz Ścisło [email protected]
49