IBM DS8880: Hybrid Cloud Integration with Transparent Cloud Tiering
Total Page:16
File Type:pdf, Size:1020Kb
Accelerate with IBM Storage: IBM DS8880: Hybrid cloud integration with Transparent Cloud Tiering Craig Gordon Consulting I/T Specialist IBM Washington Systems Center [email protected] © Copyright IBM Corporation 2018. Washington Systems Center - Storage Accelerate with IBM Storage Webinars The Free IBM Storage Technical Webinar Series Continues in 2018... Washington Systems Center – Storage experts cover a variety of technical topics. Audience: Clients who have or are considering acquiring IBM Storage solutions. Business Partners and IBMers are also welcome. To automatically receive announcements of upcoming Accelerate with IBM Storage webinars, Clients, Business Partners and IBMers are welcome to send an email request to [email protected]. Located in the Accelerate with IBM Storage Blog: https://www.ibm.com/developerworks/mydeveloperworks/blogs/accelerate/?lang=en Also, check out the WSC YouTube Channel here: https://www.youtube.com/playlist?list=PLSdmGMn4Aud-gKUBCR8K0kscCiF6E6ZYD&disable_polymer=true 2018 Webinars: January 9 – DS8880 Easy Tier January 17 – Start 2018 Fast! What's New for Spectrum Scale V5 and ESS February 8 - VersaStack - Solutions For Fast Deployments February 16 - TS7700 R4.1 Phase 2 GUI with Live Demo February 22 - DS8880 Transparent Cloud Tiering Live Demo March 1 - Spectrum Scale/ESS Application Case Study Register Here: https://ibm2.webex.com/ibm2/onstage/g.php?MTID=e25146b6c1207cb081f4392087fb6f73a March 7 - Spectrum Storage Management, Control, Insights, Foundation; what’s the difference? Register Here: https://ibm2.webex.com/ibm2/onstage/g.php?MTID=e3165dfc6c698c8fcb83132c95ae6dfe7 March 15 - IBM FlashSystem A9000/R and SVC Configuration Best Practices Register Here: https://ibm2.webex.com/ibm2/onstage/g.php?MTID=e87d423c5cccbdefbbb61850d54f70f4b © Copyright IBM Corporation 2018. Accelerate with IBM Storage Washington Systems Center - Storage Webinar Agenda • What is the Problem? • Why is Cloud Storage the Answer? • Tell me more about the Benefits • Give me more Details • How do I Get Started? • Demonstrate Transparent Cloud Tiering in Action © Copyright IBM Corporation 2018. Accelerate with IBM Storage 3 Washington Systems Center - Storage ILM Still Utilizes a 1970’s Architecture CPU Cycles Online Immediate Access DFSMS Reorgs, Offline Audits, Delayed Access DSS/HSM Half Backups Data Movers Continual Recycle 16K Blocksize Serial Access to Tape © Copyright IBM Corporation 2018. Accelerate with IBM Storage 4 Washington Systems Center - Storage Transparent Cloud Tiering – Client Value TCT for DS8000 and DFSMShsm saves z/OS CPU utilization by eliminating constraints that are tied to original tape methodologies Direct data movement from DS8000 to cloud object storage without data going through the host Transparency via full integration with DFSMShsm for migrate/recall of z/OS datasets Migrate with Tape ✓ Reduce CPU Utilization Migrate with TCT & 16K Blocksizes Cloud Storage Dual data movement Recycle Serial Access to Tape ✓ Co-location ✓ HSM inventory (Eliminates OCDS) IBM Cloud Object Storage IBM TS7700 © Copyright IBM Corporation 2018. Accelerate with IBM Storage Washington Systems Center - Storage Cloud Simplicity and Differentiation IF TAPE • Each object represents a dataset instead of a tape volume • Select a tape (partial, full, scratch?) • Allocate a drive • Allows for parallelism for migrate and recall (eliminates • Invoke DSS serial access to tape) • DSS Reads data and passes to HSM • HSM reblocks the data into 16K blocks • Storage tiers are not new • 16K blocks are written over the Channel • Cloud is a new storage tier (MIGRATC) • SYNCH data on tape • Not meant to replace ML2 but additive • Tape flushes buffers and stops streaming • Handle EOV, Spanning, FBID • Data does not have to go through ML1 or ML2 to go to MIGRATC RECYCLE processing • Continuously rewrites older data to new tapes Accelerate with IBM Storage 12 Washington Systems Center - Storage Transparent Cloud Tiering for DS8000 • Server-less direct data transfer from DS8870/DS8880 to cloud storage • No additional appliances in data path • Optimized for DFSMShsm - Saving System z CPU utilization DFSMS • Software Using Existing DS8000 Infrastructure • Microcode Upgrade Only • Available for DS8870 (7.5SP5 via RPQ), DS8880 R8.2.3 (June GA) • No Additional Hardware Required • Uses existing Ethernet ports in DS8870 and DS8880 CECs (Power8 Servers) • Supports Openstack Swift / Amazon S3 Object Store connectivity • Auditing / Security • Ethernet Ports are Outbound Ports Only – No method to access DS8k CECs • Support of System z Audit Logging Transparent • Architected with System z security (RACF, Top Secret) Cloud IBM Cloud Tiering Object Storage IBM TS7700 © Copyright IBM Corporation 2018. Accelerate with IBM Storage 7 Washington Systems Center - Storage DS8880 Object Offload to TS7700 • Take advantage of TCT for DS8880 and DFSMShsm with TS7700 as an object store • Data stored on TS7700 as objects, not tape volumes IBM DS8880 IBM TS7700 • Embeds GRID data movement engine within DS8000 to move data Transparent Cloud • Supports 2x2 GRID for redundant data Tiering GRID Data GRID Data Movement Movement • Note: Current TCT/object configuration cannot be with Engine Ethernet Engine existing GRID configurations GRID Links © Copyright IBM Corporation 2018. Accelerate with IBM Storage Washington Systems Center - Storage How much in CPU savings? MIPS / Data Set Size Transparent Cloud Tiering •Tape •Catalog •HSM / DSS Synch 20 •Eligibility Handshake •Scratch Pre •Serialize Move •Blocking Post •Catalog 15 •CDS I/O •I/O •CDS I/O 10 MIPS / Data Set Size 5 DFSMS I/O 0 0.06 Small Medium Large Extra Large 20 * PreProcessing Data Movement Post Processing 15 10 5 0 Small Medium Large Extra Large PreProcessing Data Movement Post Processing * Values in graphs are not from actual tests, but rather just represent a relative comparison © Copyright IBM Corporation 2018. Accelerate with IBM Storage 9 Washington Systems Center - Storage CPU Efficiency Estimator IBM has created a tool to estimate CPU savings • HSM writes various statistics to SMF record specified by SETSYS SMF(smfid) • Recommended smfid is 240 • FSR records are written to smfid+1 (241) • FSRCPU records CPU time • Fields include dataset size and amount of data written With a few days worth of SMF data, the estimator can determine: 1. Size of datasets to target for greatest cost savings 2. Estimated amount of CPU cycles saved by using Transparent Cloud Tiering © Copyright IBM Corporation 2018. Accelerate with IBM Storage 10 Washington Systems Center - Storage TCT CPU Saving Estimator – Example Savings Output • Estimated Savings based on amount of CPU used versus estimated usage with TCT • View number of tracks migrated in relation to savings • View client’s dataset size based on real SMF data 1 © Copyright IBM Corporation 2018. Accelerate with IBM Storage 1 Washington Systems Center - Storage Delivery Plan The Cloud Storage Solution will be delivered iteratively • Intent is to ship enhancements every six to nine months • Some support will be z/OS only, some DS8K only, and some will be a combination • Most z/OS support will be shipped via SPEs • Some support will be delivered on Release boundaries © Copyright IBM Corporation 2018. Accelerate with IBM Storage 12 Washington Systems Center - Storage Updates delivered to date 4Q2016 • Initial RPQ only solution for DS8870 • APAR OA51622 (zOS 2.1) 2Q2017 • Support on DS8880 family with R8.2.3 • APARs OA51622 (zOS 2.1) and OA50677 (zOS 2.2) • SWIFT API connection to the cloud • Simplex volumes only 3Q2017 • DS8880 family with R8.3 • APAR OA52384 (zOS 2.1/2.2) OA53538 (zOS 2.3) • Metro Mirror and Hyperswap volumes now eligible • Add IBM Cloud Object Storage as a new cloud type • Add Amazon S3 API © Copyright IBM Corporation 2018. Accelerate with IBM Storage 13 Washington Systems Center - Storage Example Setup © Copyright IBM Corporation 2018. Accelerate with IBM Storage 14 Washington Systems Center - Storage Setup on DS8880 • Plug in Ethernet cables into both CEC’s free Ethernet ports • Two empty ports per card today • Use DSCLI to import and/or export your certificates if you plan to use TLS • Use DSCLI or GUI to create a userid to authenticate to the DS8880 HMC from zOS • Use DSCLI to configure TCPIP on Ethernet cards • setnetworkport [-ipaddr IP_address] [-subnet IP_mask] [-gateway IP_address] Port_ID • This will automatically set up the firewall – outgoing ports only • Use DSCLI to configure DS8k to the Cloud Storage / TS7700 • mkcloudserver -type cloud_type [–ssl tls_version] -account account_name -user user_name -pw user_password -endpoint location_address –port port_num cloud_name © Copyright IBM Corporation 2018. Accelerate with IBM Storage Washington Systems Center - Storage Add DS8880 Self-signed certificate to RACF SITE ring • RACDCERT SITE ADD(S13FCM01.CERTIF.PEM) WITHLABEL('DS8000 FCM01 SELF SIGNED SITE') TRUST • PERMIT IRR.DIGTCERT.LISTRING CLASS(FACILITY) ID(DFHSM) ACCESS(READ) © Copyright IBM Corporation 2018. Accelerate with IBM Storage 16 Washington Systems Center - Storage Configure Cloud in SMS • Same cloud_name specified in ISMF panels, defining the DS8000 HMC as the endpoint DS8000 userid for authenticating to GUI or DSCLI © Copyright IBM Corporation 2018. Accelerate with IBM Storage Washington Systems Center - Storage Configure Cloud in SMS (continued) Uniform Resource Identifier – authentication endpoint HTTPs – authentication port information Specifies the name of the key store to be used. The value can be one