Arkadiusz Ścisło Storage Practice

1 IT Storage Challenges Wzrost ilo ści danych zwi ększa wyzwania co do infrastruktury IT

Niewystarczająca wydajność pamięci Utrzymanie masowej ZuŜycie prądu wymaganych dla wymagających SLAs aplikacji

2 The Business Eco-System

3 Co to jest Open ...? • Open Architecture Industry standard hardware & open source software implementing functions that scale higher at lower TCO than proprietary alternatives It is the next step in the evolution toward an open end-to-end • Open Software system. Open sourced code and APIs to maximize the developer Open Servers OpenStorage Open Network A storage approach Unified data center opportunity Leveraging innovative network that utilizes product design and that leverages common components, packaging, common open source software, components, open source open software, and seamless integration software, and wide with existing interoperability to deliver an open architecture with environments breakthrough economics common components, and to deliver for Sun customers breakthrough ecomonics • Open Interoperability open interoperability to for Sun customers Simple, predictable integration in create innovative storage heterogeneous environments products that deliver (open data formats, open breakthrough economics protocols) for Sun customers

Sun Proprietary/Confidential: Need to Know 4 “Otwarta” Strategia Sun'a

Open Servers Open Storage Open Archive  Open Source reduced costs • Follows same server trend and vendor lock-in  Archive products built from • General purpose systems will open architectures  Scale out architectures brought drive storage costs down  Using general purpose new economics systems • Robust Open Source soft-ware that drive down costs  Commoditization brought will further reduce costs increased competition  Seamless integration • Simple data administration with existing environments  Differentiation from innovative • Revolutionary analytics  Leading Sun Archive product design and packaging software • Open architectures will free now open sourced users from vendor lock-in

Sun Confidential: Internal Only 5 Sun Open Storage 7000

• Nowe podejście do tworzenia produktów storage • Wykorzystanie atutów Sun Microsytems • Jest o czym opowiadać

Sun Confidential: Internal Only 6 Od pocz ątku ... Co to znaczy Open Storage?

• Stworzone z otwartych elementów software'owych dostępnych dla kaŜdego • Dający moŜliwość pełnej kontroli przez Administratora • Rozwijane poprzez społeczność http://www.sun.com/storage/openstorage/community.jsp • Standardowy hardware • NiezaleŜny od producenta sprzętu

Sun Confidential: Internal Only 7 Sun Open Storage 7000 NajwaŜniejsze elementy: • OpenSolaris, w tym ZFS (Zetabyte File System) • DTrace – element Solaris 10 umoŜliwiający monitoring pracy elementów systemu • Mechanizmy selfhealing – Solaris 10 i zFS • Dyski SSD

Sun Confidential: Internal Only 8 Najwolniejszy element – “w ąskie gardła”

Sun Confidential: Internal Only 9 Problem z wydajno ści ą ? Oczekiwanie na dane ... • Today’s Multi-Core, Multi-Socket application server design are increasingly held back by slow storage • When requesting data, the server spends most of it’s time waiting for storage • Application performance remain sluggish regardless of the Server CPU horsepower • The traditional remedy of adding more expensive DRAM may no longer suffice as data sets double ever 2 years

Sun Confidential: Internal Only 10 Enterprise SSD vs HDD – Wydajno ść

• Enterprise HDD •Enterprise SSD

> 180 write IOPs  7,000 write IOPs

> 320 read IOPs  35,000+ read IOPs

Sun Confidential: Internal Only 11 Wi ększa wydajno ść z dyskami SSD

•Today’s MultiCore, MultiSocket application server design are now served by High Performance SSDs •The server no longer waists time waiting for data •Application performance is as high as the Server CPUs horsepower •No longer need to remedy sluggish storage performance by adding expensive DRAM •Bottom Line: Improved end user experience, faster results and Better ROI

Sun Confidential: Internal Only 12 Hybrid Storage Pool Model Scale Performance and Capacity Independently

Read Write Storage Performance Performance Capacity

Transparently Managed As A Single Storage Pool

Sun Confidential: Internal Only 13 Latency Comparison Bridging the DRAM to HDD Gap

Sun Confidential: Internal Only 14 ZFS Hybrid Storage Pool Architecture Performance Tuning Without the Guess Work

Old Model Storage Pool New Model Storage Pool Hybrid Storage Pool (ZFS)

• ARC – Adaptive Replacement Cache , the main ZFS memory cache in DRAM • L2ARC – Level Two Adaptive Replacement Cache , extends the ARC into Read Optimized Solid State Disk Devices to provide a large read cache to accelerate reads • ZIL – ZFS Intent Log is transactional, using Write Optimized Solid State Disk Devices provides a large cache to accelerate writes • Disk Storage Pool – 7200 RPM SATA Drives, high speed drives no longer relevant Sun Confidential: Internal Only 15 ZFS Hybrid Storage Pool Architecture

Sun Confidential: Internal Only 16 Building the Hybrid Storage Pool Combining Performance and Capacity

Sun Confidential: Internal Only 17 W czym mo Ŝe pomóc ZFS ? “Hybrid Storage Pool Data Management”

ZFS automatically: • Writes new data to a very fast SSD pool ZFS Intent Log (ZIL) • Determines data access patterns and stores frequently accessed data in the L2ARC • Bundles IO into sequential lazy writes for more efficient use of low cost mechanical disks • Now shipping in OpenSolaris and coming soon in Solaris 10

Sun Confidential: Internal Only 18 Sun Storage 7000 Unified Storage Systems Scale your Storage, not your Budget

Sun Confidential: Internal Only 19 Sun Storage 7110 Unified Storage System Unified Storage Systems for Departmental/Workgroups

• Hybrid Storage Pool

 8GB Adaptive Replacement Cache

 1 x AMD QuadCore Processor

 x4240 BRAND  6 PCIE slots NEW  14 x 146GB or 300GB SAS Drives • Network Connectivity

 Standard 4 x 1Gb Ethernet Ports

 Optional Dual Copper or Optical Port 10Gb Ethernet

 Optional Quad Port 1 Gb Ethernet • Tape Backup Connectivity

 Optional Dual Fiber Channel HBA

 Optional Dual Port SCSI HBA

Sun Confidential: Internal Only 20 Sun Storage 7210 Unified Storage System High-density Open Unified Storage Systems Hybrid Storage Pool 32GB or 64GB ARC 2 x AMD QuadCore Processors Sun Fire x4540 3 PCIE slots SSD Write Optimized Up to 2 x 36GB 46 x 250GB,500GB or 1TB Drives BRAND Expandable to 142 Drives (2@J4500) NEW Network Connectivity Standard 4 x 1Gb Ethernet Ports Optional Dual Copper or Optical Port 10Gb Ethernet Optional Quad Port 1 Gb Ethernet Tape Backup Connectivity Optional Dual Fiber Channel HBA Optional Dual Port SCSI HBA

Sun Confidential: Internal Only 21 Sun Storage 7310 Unified Storage System High Availability, cost effective Unified Open Storage Server BRAND Hybrid Storage Pool NEW 16GB or 64GB ARC Sun Fire x4140 Up to 4 x quadcore CPU 3 PCIE slots per node SSD Read Optimized Up to 12 x 100GB SSD Write Optimized Up to 16 x 36GB SATA up to 96 1TB Drives Arrays up to 4 @ 24 HDDs (4 x J4400) Network Connectivity Standard 4 x 1Gb Ethernet Ports Optional Dual Copper or Optical Port 10Gb Ethernet Optional Quad Port 1 Gb Ethernet Tape Backup Connectivity Optional Dual Port Fiber Channel HBA Optional Dual Port SCSI HBA Clustering for High Availability

Sun Confidential: Internal Only Preliminary Data Valid from May 29 Subject to Change without Notice 22 Sun Storage 7410 Unified Storage System High Availability, massive scale Unified Open Storage Server • Hybrid Storage Pool

 16GB, 64GB or 128GB ARC

 Sun Fire x4440

 Up to 8 x 6core CPU

 6 PCIE slots per node

 SSD Read Optimized Up to 12 x 100GB

 SSD Write Optimized Up to 16 x 36GB

 SATA up to 576 1TB Drives

 Arrays up to 24 @ 24 HDDs (24 x J4400) • Network Connectivity

 Standard 4 x 1Gb Ethernet Ports

 Optional Dual Copper or Optical Port 10Gb Ethernet

 Optional Quad Port 1 Gb Ethernet • Tape Backup Connectivity

 Optional Dual Port Fiber Channel HBA

 Optional Dual Port SCSI HBA • Clustering for High Availability

Sun Confidential: Internal Only 23 Additional Management Clustering - Active / Active Take Over Functionality

Network Network

Pool 0 Pool 1 Pool 0 Pool 1

• Normal Operation • In the event of a take over  The take over node will temporarily own both  Each node owns a storage pool and network resources storage pools.  Duplicate network adapters are now active to  Duplicate network adapters are kept service the failed node's clients available for the other node in the event of a take over Sun Confidential: Internal Only 24 Additional Management Clustering - Active / Passive Take Over Functionality

Network Network

Pool 0 Pool 0

• Normal Operation • In the event of a take over  The take over node will temporarily own all  One node owns all resources, Network and Storage Pool resources, Network and Storage Pool

 The other node is effectively in a standby mode

Sun Confidential: Internal Only 25 Additional Management Browser User Interface • The primary administrative interface Open Storage Manger is an AJAXbased browser interface  Uses HTTPS https://amberroadappliance:215  Supported Browsers are Firefox, Safari,IE6,IE7 and Opera.

Sun Confidential: Internal Only 26 Additional Management CLI and RPC Interface • CLI Interface

 CLI tools can execute locally on the appliance to change the configuration: all features are accessible as in the browser UI except the graphical DTrace Analytics and dashboard elements

 CLI is accessed over SSH for security

 Different CLI syntax than 5320

 Easy to learn Syntax

 CLI Scripting

 CLI also permits scripts to be written and sent over SSH, and underlying XML RPC calls will be exposed to developers

 CLI scripting can be used to integrate with enduser scripts (e.g. create a home directory for each user in LDAP directory)

Sun Confidential: Internal Only 27 FISHWorks Appliance Instantiation of Open Storage • Accessible via WEBbrowser • Easy to Configure & Diagnose

• Extremely granular Analytics via DTrace and Fully Integrated Software and Hardware (FISH)

Sun Confidential: Internal Only 28 Unprecedented DTrace Analytics Analyse Performance Bottlenecks Down to the User Level

• Realtime monitoring of the complete storage system • Built on DTrace instrumentation for key subsystems > NFSv3, NFSv4, CIFS, iSCSI > ZFS and the Solaris i/o path > CPU and Memory Utilization > Networking (TCP, UDP, IP) • Realtime graphical business analytics > “What files are hot right now?” > “What is the distribution of reads and writes?” > “Which CIFS clients are hot right now?” > “How much networking bandwidth do I use?” • Group into worksheets, can be made persistent • Data can be exported for further number crunching

Sun Confidential: Internal Only 29 Additional Management DTrace Analytics - Continued • Drill Down statistics to amazing detail levels

Sun Confidential: Internal Only 30 Additional Management DTrace Analytics - continued • Statistic categories and Drill Down subcategories CPU Mode, CPU ID, Application, Process RawID, User ID, Category Statistic Drill Down Subcategories CPU Mode, CPU ID, Application, Process RawID, User ID, CIFS Operations Op, Client, Filename, Share, Project, Latency,, Offset, Size Raw Op, Client, Raw CPU Utilization Percent Type, Disk, Size, Latency, Offset, Raw CPU Kernel Spins Disk, Raw Disk iSCSI Operations Op, Pool, Raw Disk I/O Operations Op, Pool, Raw Disk Utilization Percent Raw Disk ZFS I/O Bytes Hit/Miss, Raw Disk ZFS I/O Operations File system DNLC Entries File system DNLC Accesses Kmem Cache, Raw HTTP/WebDAV Requests KmemOp, Result, Cache, Client, Raw Filename, User, Usere, Agent, Latency, Siz Raw Memory Dynamic Memory Usage Kmem Cache, Application,Raw Raw Memory Kernel Memory Memory Kernel Memory In Use Memory Kernel Memory Lost To Fragmentation

Sun Confidential: Internal Only 31 Additional Management DTrace Analytics - continued

Op, Raw • Statistic categories and DrillOp, Raw Down subcategories – Op, Raw Categorycont' Statistic Op,Drill RawDown Subcategories NDMPDevice Disk Bytes Bytes Transferred Direction, Device, Raw NDMPInterface Filesystem Bytes Operations NDMP Jobs NDMP Tape Bytes Transferred Hostname, Protocol, Direction, Raw Network Network Direction, Interface, Raw Network IP Bytes Network IP Packets Network TCP Bytes Network TCP Packets Hostname, Protocol, Direction, Raw ZFS ARC Adaptive Parameter Raw ZFS ARC Accesses Hostname, Protocol, Hit/Miss, Direction, Raw Raw ZFS ARC Size RawHostname, Protocol, Direction, Raw ZFS ARC Target Size Raw

Sun Confidential: Internal Only 32 Data Services ZFS • ZFS NAS offerings  Effectively unlimited capacity  Thin provisioning using dynamic reservations and quotas for projects and shares  Checksumming of all data and metadata  Data protection schemes for capacity, availability and performance

Sun Confidential: Internal Only 33 Data Services ZFS - Continued • ZFS Useable Space  Market Leading Usable Space

Double Double Mirrored Single Parity Striped Parity Parity RAID RAID RAID Wide Stripes

72% 83% 42% 60% 90%

Sun Confidential: Internal Only 34 Data Services ZFS - Continued • ZFS Resilver Feature Rebuild Times  Traditional volume Sunfor Unified Spare fromStorage failed 7210mirror manager filesystem 55 delivered architecture must 600050 Concurrent Streams = 45 750 MB/sec! resilver by copying 44,000 hours40 of content = 20TB Usable, 46 TB every block of a disk. 35 Mirrored 55,00030 FLV files random access  7000 series need only 25

resilver allocated Minutes 20 blocks. 15 10  Faster rebuilds means 5 0 faster recovery to full 7110-146G 7110-146G ST6540- protection and full SAS 10% SAS Full 146G FC performance. Spare Drive Type/System

Sun Confidential: Internal Only 35 Data Protocols NDMP backup and recovery using directly connected tape drives

Sun Storage 7000 • Directly Connected Tape Drives Network FC SAN  Backup application server controls the tape library and mounts tapes for the

Backup Server appliance.  NDMP commands and reporting go to and from the backup application server over the network.  Backups and restores go over FC connections to the tape drives in the tape library.

Sun Confidential: Internal Only 36 Additional Management Name Services • Name services supported are DNS and NIS

Sun Confidential: Internal Only 37 Absolute Zero Cost Software License Free and No Charge Support

DataData Protocols DataData Services DataAdditional Management Protocols Services Management

• NFS v2, v3 and v4 • Write Flash Acceleration • DTrace Analytics • CIFS • Read Flash Acceleration • Selfhealing system and data • iSCSI • RAID2Z (RAID6 P+Q) • Simple outofthebox setup • HTTP and HTTPS • Mirroring • Secure Browser UI and CLI • WebDAV • Striping • Advanced Networking • FTP, FTPS and SFTP • Activeactive Clustering • NIS, LDAP, and AD • NDMP v4 • Remote Replication • Users, Rolls • FC Target (Roadmap) • Antivirus Support • Dashboard • InfiniBand • Unlimited Snapshots • Alerts • SNMP • Compression • Phone Home • DeDuplication (Roadmap) • Scripting BRAND • Microsoft VSS Shadow Copy • Online Upgrade NEW • CIFS share level ACL • Workflow Automation

Sun Confidential: Internal Only 38 Sun Storage 7000 Certyfikacje ISV

Sun Confidential: Internal Only 39 Co tak naprawd ę jest „Open” w „Open Storage” serii 7000? Otwarte elementy to: A. Open Server (Architektura) B. OpenSolaris ( zFS ) C. Open Networks (Protocols) Storage D. Open Software (DTrace)

Integrated Platform Compute Network

Sun Confidential: Internal Only 40 .... a co w takim razie jest „Closed”?

Element zaknięty to: Management Interface based on Fishworks (GUI + Command Interface)

Sun Confidential: Internal Only 41 ZFS Hybrid Pool Example Based on Actual Benchmark Results 4.9x 3.2x 4%

2x 11%

Read IOPs Write IOPs Cost Storage Power Raw Capacity (Watts) (TB)

Hybrid Storage Pool (DRAM + Read SSD + Write SSD + 5x 4200 RPM SATA) Traditional Storage Pool (DRAM + 7x 10K RPM 2.5”)

Sun Confidential: Internal Only 42 Sun 7410 vs NetApp FAS6080 50 TB VS 50 TB Production Environment

$1 000 000 $900 000 $800 000 $700 000 Initial Investment $600 000 Year 2 Year 3 $500 000 Year 4 $400 000 Year 5 Total $300 000 $200 000 $100 000 $0 NetApp FAS6080 Sun 7410 Savings

Cash Flow Analysis Eco Metrics NetApp FAS6080 Sun 7410 Pct. Reduction Power kWh/month 3,547 1,73 51% Cooling kWh/month 2,838 1,384 51% CO2 MT/month 1,33 0,65 51% Floor space sq. m 3 1 73%

Sun Confidential: Internal Only 43 Sun Confidential: Internal Only 44 http://blogs.sun.com/brendan/date/20081215

Sun Confidential: Internal Only 45 UK IT Pro have recently published their review of our Storage 7410 Unified Storage System and our solution was given 5/6 stars and an Editors Choice Award.

The comprehensive review is summed up with the verdict: The 7410 offers more of everything for network storage and looks very good value – especially as the standard features include unlimited snapshots and replication. FC SAN supports would make it truly complete but its hybrid pools allow you to choose combinations of storage devices to suit requirements, performance across a range of protocols is good and it comes with sophisticated management and monitoring tools. http://www.itpro.co.uk/610529/sunstorage7410unifiedstoragesystemreview Sun Confidential: Internal Only 46 SE7000 – Try and Buy

http://www.sun.com/tryandbuy/applyonline.jsp Sun Confidential: Internal Only 47 Open VTL Strategy Open Storage Emulates Tape

Tape Automation

VTL Servers

Sun Confidential: Internal Only 48 Dzi ękuj ę ...

Arkadiusz Ścisło [email protected]

49