Building a smarter planet using a Dynamic Infrastructure IEEE Mass Storage Conference Vendor Reception Lake Tahoe, NV Joe Rotiroti Client Systems Manager IBM, Federal 484 433 9756 cell 845 491 5227 fax [email protected] May 04, 2010 11 © 2009 IBM Corporation Building a smarter planet using a Dynamic Infrastructure How is GPFS different? Massive namespace support GPFS Centrally deployed, managed, backed up and SAN grown. Seamless capacity and performance scaling All features included - All of the software features: snapshots, replication and multi-site connectivity are included in the GPFS license. There are no license keys besides client and server to add-on, you get all of the features up front. 2 © 2009 IBM Corporation Building a smarter planet using a Dynamic Infrastructure Enhance enterprise-wide collaboration through multi-cluster LAN LAN NSD Protocol Create an enterprise-wide GPFS GPFS Global namespace SAN SAN SAN SAN Why? . Tie together multiple sets of data into a single namespace . Allow multiple application groups to share portions or all data . Secure, available and high performance data sharing 3 © 2009 IBM Corporation Building a smarter planet using a Dynamic Infrastructure File System configuration and performance data GPFS is already running at data sizes most companies will start supporting five years from now. Number of files: Disk IO: . 2 Billion per file system . AIX 134 GB/sec . 256 file systems . Linux 66 GB/sec . Max File System Size: 2^99 bytes . Max File Size = File system size Number of nodes: . 1 to 8192 4 © 2009 IBM Corporation Building a smarter planet using a Dynamic Infrastructure IBM Scale Out HTTP NFS CIFS FTP SCP Clients Clients Clients Clients Clients NAS Architecture IP Network Parallel Grid architecture provides: • Massive scalability • Extreme performance Global Namespace • Automatic Tiered Storage • Global virtual file server Management Interface Interface Interface IBM Scale out NAS is an appliance: Node Node ... Node .... Node • Simple: Only 3 basic orderable parts: IP Mgmt. Network Infiniband Data Network Tape Management Nodes Interface Nodes Storage Pods Storage Node Storage Node Storage Node Storage Node . All nodes are clustered . SONAS Software runs on every node Storage Storage ... Storage Storage . Uses enterprise commercial off- controller controller controller controller the-shelf (COTS) components and disk and disk and disk and disk . To leverage technology cost and performance advances quickly Storage Pod Storage Pod 6 © 2009 IBM Corporation Building a smarter planet using a Dynamic Infrastructure IBM Scale Out NAS Fully Integrated Appliance Appliance Superscalar Network Attached Storage (NAS) system with a Primary Rack industry-leading software stack 42 GbE Switch #2 41 GbE Switch #1 40 Management Node #2 NFS, CIFS, FTP, HTTP and SCP network file protocols 39 38 Management Node #1 • Near linear performance on a ‘per-node’ basis to existing 37 market, but with aggregate performance that will be extreme 36 36-port IB 35 36-port IB #1 and market leading. 34 Interface Node #6 33 • Global file system namespace 32 Interface Node #5 • Synch and Asynch replication of file data 31 30 Interface Node #4 • File system snapshots, quotas, 29 iPDU iPDU 28 Interface Node #3 • Scalable, Integrated Information Lifecycle Management (ILM) 27 26 Interface Node #2 • Automatic tiered storage 25 • HSM support to external Tivoli Storage Manager (TSM) 24 Interface Node #1 23 server 22 1U Blank Filler Panel 21 Keyboard, Video, Mouse • Real-time performance monitoring 20 Storage node #2 19 • Integrated System HealthCenter for HW monitoring 18 Storage node #1 • LDAP Support, Windows Active Directory support 17 16 Disk Storage • 1GbE and 10GbE host interfaces 15 Expansion Unit #2.2 14 • High speed extremely low latency (20 Gbit/sec) private 13 12 Infiniband cluster data network 11 Storage Controller #2.1 iPDU 10 iPDU • High density RAID controller and disk expansion drawer (4U x 9 60 HDD’s) 8 Disk Storage 7 Expansion Unit #1.2 • Support for high-performance SAS and high-capacity SATA 6 5 HDD’s 4 3 Storage Controller #1.1 2 1 5/4/2010 7 © 2009 IBM Corporation Building a smarter planet using a Dynamic Infrastructure IBM Scale Out Network Attached Storage Expansion Options Node Expansion Switches Switches Interface Node Storage Node Interface Node Storage Node Interface Node • Up to 30 interface nodes 60 Disks Interface Node • High speed extremely low latency (20 Gbps) private Interface Node 60 Disks Interface Node Infiniband cluster data network Interface Node 60 Disks Interface Node Interface Node 60 Disks Interface Node Storage Expansion Interface Node Storage Node Interface Node Storage Node Interface Node 60 Disks Interface Node • Up to 30 storage pods, each with up to 240 HDD’s Interface Node 60 Disks • Scalable to 14.4 PB of raw storage in single system Interface Node Interface Node 60 Disks using 2 TB drives Interface Node Interface Node • Max of 7,200 hard drives 60 Disks Interface Node I/O Dense Storage Dense Configuration Configuration 8 © 2009 IBM Corporation Building a smarter planet using a Dynamic Infrastructure IBM Scale Out NAS: The life of a file from creation to deletion • Using Automatic Tiered storage • Storage pool – group of LUNs Protocols CIFS • Fileset - define subtrees of a file system NFS HTTP • Policies – for rule based management of FTP files inside the storage pools SCP • Delivering: Management • Scalability - billions of files Central • One global file system name space Administration Monitoring across independent logical storage File Mgmt pools • Files in the same directory can be in different pools • Files placed in storage pools at create Availability Data Migration time using policies Replication • Files moved between pools via Backup automated policy-driven tiered storage • Hierarchical storage based on files • Hierarchical to both disk and tape • Allows classification of data according to SLAs 9 © 2009 IBM Corporation Building a smarter planet using a Dynamic Infrastructure SAN Volume Controller 2 nodes . IBM’s Storage Virtualization product and Single point of control for Storage resources. Designed to combine Storage capacity from multiple disk systems into a reservoir of capacity . Thin provisioning . Supports the consolidation of Heterogeneous Storage systems from many vendors ftp://ftp.software.ibm.com/common/ssi/pm/sp/n/tsd00254usen/TSD00254USEN.PDF . Mirrored virtual disks, which can be mirrored across disk subsystems 1010 © 2009 IBM Corporation Building a smarter planet using a Dynamic Infrastructure SAN Volume Controller . Tiered Storage support . Easy data migration from one Storage to another without Apps down time. Easy to use Graphical management interface . Supports IBM Tivoli Storage FlashCopy manager application-aware snapshots. For more information, http://www-03.ibm.com/systems/storage/software/virtualization/svc/ . Storage Performance council Reports SPC1 - http://www.storageperformance.org/benchmark_results_files/a00072_IBM_SVC4.3_SPC1_full-disclosure.pdf SPC2 - http://www.storageperformance.org/results/b00024_IBM-SVC4.2_SPC2_full-disclosure.pdf 1111 © 2009 IBM Corporation Building a smarter planet using a Dynamic Infrastructure IBM System Storage Disk product family SAN products NAS products DS8000® series XIV® N7000 series FC/FICON, ESCON FC and iSCSI N6000 series Enterprise storage Enterprise SAN Volume Controller DS5000™ (SVC) N5000 DS4700 DS5020 DS4800 Flexible Disk series Virtualization range storage range DS6000™ - N3000 series Departmental FC FC and series mid iSCSI FC and FICON N3700 DS3400 (FC) DS3300 (iSCSI) DS3200 (SAS) storage Entry workgroup workgroup Entry http://www-03.ibm.com/systems/resources/systems_storage_resource_pguide_prodguidedisk.pdf 1212 © 2009 IBM Corporation I B M Building a smarter planet using a Dynamic Infrastructure C o n DS8700 Highlights Disk Road Map f i d e n . New Hardware Platform t – P6 model 570 servers a l • 4.7 Ghz processors - 2 core and 4 core • Enhanced RAS features – PCI Express I/O drawer • High throughput PCIe 4x Gen2 cable connection. – New Model (Model 941/94E) • Significant performance increase – Enhanced device adapter processor • IOPS boost . Functional Improvements – High Performance Ficon for System z (multitrack) – Encryption enhancements • Deadlock Recovery Key Management • Dual Platform Key server support – Code Load Improvements • Service window reductions . Inherited Advanced Function from DS8000 13 © 2009 IBM Corporation Building a smarter planet using a Dynamic Infrastructure Smart Tools for Optimizing Tiered Storage Smart data analysis tools – IBM FLASHDA tool for identifying opportunities for SSD exploitation – New DS8000 performance analytics for identifying sub-volume data to exploit tiered storage for both open and zOS – System Monitoring Facility (SMF) for analyzing z/OS trends and peak usage – System p AIX filemon for performance analysis – System i workload analysis tools – Tivoli Storage Productivity Center for Disk for detailed, real-time performance monitoring and historical performance analysis – Omegamon XE for analyzing dataset and volume performance – Softek Data Mobility Console for z/OS offers real time data analysis and user controlled movement of data with concurrent application access 14 © 2009 IBM Corporation All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represents goals and objectives only. Building a smarter planet using a Dynamic Infrastructure DS8000 POWER6 Estimated Performance Sequential