IBM DS8880: Hybrid Cloud Integration with Transparent Cloud Tiering

Accelerate with IBM Storage:

IBM DS8880: Hybrid cloud integration with Transparent Cloud Tiering

Craig Gordon Consulting I/T Specialist IBM Washington Systems Center ckgordon@us.ibm.com

Accelerate with IBM Storage Webinars

The Free IBM Storage Technical Webinar Series Continues in 2018...

Washington Systems Center – Storage experts cover a variety of technical topics.

Audience: Clients who have or are considering acquiring IBM Storage solutions. Business Partners and IBMers are also welcome.

To automatically receive announcements of upcoming Accelerate with IBM Storage webinars, Clients, Business Partners and IBMers are welcome to send an email request to [email protected].

Located in the Accelerate with IBM Storage Blog: https://www.ibm.com/developerworks/mydeveloperworks/blogs/accelerate/?lang=en

Also, check out the WSC YouTube Channel here: https://www.youtube.com/playlist?list=PLSdmGMn4Aud-gKUBCR8K0kscCiF6E6ZYD&disable_polymer=true

2018 Webinars:

January 9 – DS8880 Easy Tier January 17 – Start 2018 Fast! What's New for Spectrum Scale V5 and ESS February 8 - VersaStack - Solutions For Fast Deployments February 16 - TS7700 R4.1 Phase 2 GUI with Live Demo February 22 - DS8880 Transparent Cloud Tiering Live Demo March 1 - Spectrum Scale/ESS Application Case Study Register Here: https://ibm2.webex.com/ibm2/onstage/g.php?MTID=e25146b6c1207cb081f4392087fb6f73a March 7 - Spectrum Storage Management, Control, Insights, Foundation; what’s the difference? Register Here: https://ibm2.webex.com/ibm2/onstage/g.php?MTID=e3165dfc6c698c8fcb83132c95ae6dfe7 March 15 - IBM FlashSystem A9000/R and SVC Configuration Best Practices Register Here: https://ibm2.webex.com/ibm2/onstage/g.php?MTID=e87d423c5cccbdefbbb61850d54f70f4b

Webinar Agenda

• What is the Problem?

• Why is Cloud Storage the Answer?

• Tell me more about the Benefits

• Give me more Details

• How do I Get Started?

• Demonstrate Transparent Cloud Tiering in Action

ILM Still Utilizes a 1970’s Architecture

CPU Cycles Online Immediate Access

DFSMS Reorgs, Offline Audits, Delayed Access DSS/HSM Half Backups Data Movers Continual Recycle 16K Blocksize

Serial Access to Tape

TCT for DS8000 and DFSMShsm saves z/OS CPU utilization by eliminating constraints that are tied to original tape methodologies

Direct data movement from DS8000 to cloud object storage without data going through the host

Transparency via full integration with DFSMShsm for migrate/recall of z/OS datasets

Migrate with Tape ✓ Reduce CPU Utilization Migrate with TCT & 16K Blocksizes Cloud Storage Dual data movement Recycle Serial Access to Tape ✓ Co-location ✓ HSM inventory (Eliminates OCDS) IBM Cloud Object Storage IBM TS7700

IF TAPE • Each object represents a dataset instead of a tape volume • Select a tape (partial, full, scratch?) • Allocate a drive • Allows for parallelism for migrate and recall (eliminates • Invoke DSS serial access to tape) • DSS Reads data and passes to HSM • HSM reblocks the data into 16K blocks • Storage tiers are not new • 16K blocks are written over the Channel • Cloud is a new storage tier (MIGRATC) • SYNCH data on tape • Not meant to replace ML2 but additive • Tape flushes buffers and stops streaming • Handle EOV, Spanning, FBID • Data does not have to go through ML1 or ML2 to go to MIGRATC RECYCLE processing • Continuously rewrites older data to new tapes

Accelerate with IBM Storage 12 Washington Systems Center - Storage Transparent Cloud Tiering for DS8000

• Server-less direct data transfer from DS8870/DS8880 to cloud storage • No additional appliances in data path • Optimized for DFSMShsm - Saving System z CPU utilization DFSMS • Software Using Existing DS8000 Infrastructure • Microcode Upgrade Only • Available for DS8870 (7.5SP5 via RPQ), DS8880 R8.2.3 (June GA) • No Additional Hardware Required • Uses existing Ethernet ports in DS8870 and DS8880 CECs (Power8 Servers) • Supports Openstack Swift / Amazon S3 Object Store connectivity • Auditing / Security • Ethernet Ports are Outbound Ports Only – No method to access DS8k CECs • Support of System z Audit Logging Transparent • Architected with System z security (RACF, Top Secret) Cloud IBM Cloud Tiering Object Storage

IBM TS7700 © Copyright IBM Corporation 2018. Accelerate with IBM Storage 7 Washington Systems Center - Storage DS8880 Object Offload to TS7700

• Take advantage of TCT for DS8880 and DFSMShsm with TS7700 as an object store

• Data stored on TS7700 as objects, not tape volumes IBM DS8880 IBM TS7700 • Embeds GRID data movement engine within DS8000 to move data Transparent Cloud • Supports 2x2 GRID for redundant data Tiering

GRID Data GRID Data Movement Movement • Note: Current TCT/object configuration cannot be with Engine Ethernet Engine existing GRID configurations GRID Links

How much in CPU savings?

MIPS / Data Set Size Transparent Cloud Tiering

•Tape •Catalog •HSM / DSS Synch 20 •Eligibility Handshake •Scratch Pre •Serialize Move •Blocking Post •Catalog 15 •CDS I/O •I/O •CDS I/O 10 MIPS / Data Set Size 5 DFSMS I/O 0 0.06 Small Medium Large Extra Large 20 * PreProcessing Data Movement Post Processing 15

0 Small Medium Large Extra Large

PreProcessing Data Movement Post Processing

* Values in graphs are not from actual tests, but rather just represent a relative comparison

IBM has created a tool to estimate CPU savings

• HSM writes various statistics to SMF record specified by SETSYS SMF(smfid) • Recommended smfid is 240

• FSR records are written to smfid+1 (241) • FSRCPU records CPU time • Fields include dataset size and amount of data written

With a few days worth of SMF data, the estimator can determine: 1. Size of datasets to target for greatest cost savings 2. Estimated amount of CPU cycles saved by using Transparent Cloud Tiering

• Estimated Savings based on amount of CPU used versus estimated usage with TCT • View number of tracks migrated in relation to savings

• View client’s dataset size based on real SMF data

1 © Copyright IBM Corporation 2018. Accelerate with IBM Storage 1 Washington Systems Center - Storage

Delivery Plan

The Cloud Storage Solution will be delivered iteratively

• Intent is to ship enhancements every six to nine months • Some support will be z/OS only, some DS8K only, and some will be a combination

• Most z/OS support will be shipped via SPEs • Some support will be delivered on Release boundaries

Updates delivered to date

4Q2016 • Initial RPQ only solution for DS8870 • APAR OA51622 (zOS 2.1) 2Q2017 • Support on DS8880 family with R8.2.3 • APARs OA51622 (zOS 2.1) and OA50677 (zOS 2.2) • SWIFT API connection to the cloud • Simplex volumes only 3Q2017 • DS8880 family with R8.3 • APAR OA52384 (zOS 2.1/2.2) OA53538 (zOS 2.3) • Metro Mirror and Hyperswap volumes now eligible • Add IBM Cloud Object Storage as a new cloud type • Add Amazon S3 API

Example Setup

Setup on DS8880

• Plug in Ethernet cables into both CEC’s free Ethernet ports • Two empty ports per card today

• Use DSCLI to import and/or export your certificates if you plan to use TLS

• Use DSCLI or GUI to create a userid to authenticate to the DS8880 HMC from zOS

• Use DSCLI to configure TCPIP on Ethernet cards • setnetworkport [-ipaddr IP_address] [-subnet IP_mask] [-gateway IP_address] Port_ID • This will automatically set up the firewall – outgoing ports only

• Use DSCLI to configure DS8k to the Cloud Storage / TS7700 • mkcloudserver -type cloud_type [–ssl tls_version] -account account_name -user user_name -pw user_password -endpoint location_address –port port_num cloud_name

Add DS8880 Self-signed certificate to RACF SITE ring

• RACDCERT SITE ADD(S13FCM01.CERTIF.PEM) WITHLABEL('DS8000 FCM01 SELF SIGNED SITE') TRUST

• PERMIT IRR.DIGTCERT.LISTRING CLASS(FACILITY) ID(DFHSM) ACCESS(READ)

Configure Cloud in SMS

• Same cloud_name specified in ISMF panels, defining the DS8000 HMC as the endpoint

DS8000 userid for authenticating to GUI or DSCLI

Configure Cloud in SMS (continued)

Uniform Resource Identifier – authentication endpoint

HTTPs – authentication port information

Specifies the name of the key store to be used. The value can be one of the following: - A SAF keyring name, in the form of userid/keyring - A PKCS #11 token, in the form of Accelerate with IBM Storage *TOKEN*/token_name Washington Systems Center - Storage

Configure Cloud in SMS

Uniform Resource Identifier – authentication endpoint

Accelerate with IBM Storage Washington Systems Center - Storage

DFSMShsm

MIGRATE DATASET(dsname) CLOUD(cloud) • HSM invokes DSS to migrate data sets to the Cloud HSM inventory manages the Cloud, Container and Object prefix Transparent to applications and end users No Recycle Recall works just as it does today Audit support VOLUME and STORAGEGROUP keywords also supported

• As today, volser will be changed to ‘MIGRAT’ ISPF will display ‘MIGRATC’, as opposed to ‘MIGRAT1’ or ‘MIGRAT2’

DFSMShsm Migration

As today, DFSMShsm will automatically Recall a data set to Primary Storage when it is referenced • RECALL, HRECALL, ARCHRCAL all support recalling from the Cloud. There are no parameter changes, as all information is stored within the HSM control data sets • Common Recall Queue is supported

Fast Subsequent Migration • Remigrated data sets are just reconnected to existing migration objects if the source data set was not updated No additional data movement

DFSMShsm: DB2 Image Copy Offload

▪ Step 1: Create PiT DB2 Images Copies using FlashCopy ▪ Step 2: Wait for background FlashCopy to complete

DB2 Source Objects DB2 Image Copies

FlashCopy Cloud TierCloud

DFSMS

IBM TS7700

▪ Step 3: MIGRATE STORAGEGROUP(DB2IMGC) CLOUD(MYCLOUD) DB2 Offline PiT Image Copies with the Data never going through the host

DFSMShsm: DB2 Transparent Archiving

Storage Tiers ▪ DB2 V11 Transparent Archiving of DB2 Active Table High End Temporal Data

• DB2 automatically moves deleted rows to an archive table

• Increases efficiency and reduces DB2 Archive Table size of base table Migrate / Recall IBM Cloud • Archive Table migrated to cloud Object Storage storage

Live Demonstration

• Server-less direct data transfer from DS8870/DS8880 to cloud storage • Optimized for DFSMShsm - Saving System z CPU utilization

DFSMS

• Software Using Existing DS8000 Infrastructure • Current ethernet connections limited to 1Gbps – Enhancements planned • Solutions implemented today should be limited to applications that can sustain delays in recall time • Ideal time to install and configure storage management policies to prepare for production rollout

• Auditing / Security • Ethernet Ports are Outbound Ports Only – No method to access DS8k CECs • Support of System z Audit Logging Transparent • Architected with System z security (RACF, Top Secret) Cloud IBM Cloud Tiering Object Storage

Thank You.

Accelerate with IBM Storage Washington Systems Center - Storage

Please Note: • IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice and at IBM’s sole discretion. • Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. • The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. • The development, release, and timing of any future features or functionality described for our products remains at our sole discretion. • Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.