IBM System Storage DS8000 Performance Monitoring and Tuning

Total Page:16

File Type:pdf, Size:1020Kb

IBM System Storage DS8000 Performance Monitoring and Tuning Front cover IBM System Storage DS8000 Performance Monitoring and Tuning Axel Westphal Bert Dufrasne Wilhelm Gardt Jana Jamsek Peter Kimmel Flavio Morais Paulus Usong Alexander Warmuth Kenta Yuge Redbooks International Technical Support Organization IBM System Storage DS8000 Performance Monitoring and Tuning April 2016 SG24-8318-00 Note: Before using this information and the product it supports, read the information in “Notices” on page xiii. First Edition (April 2016) This edition applies to Version 8.0 of the IBM DS8884 and DS8886 models (product numbers 2831–2834) and Version 7.5 of the IBM DS8870 (product numbers 2421–2424). © Copyright International Business Machines Corporation 2016. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . xiii Trademarks . xiv IBM Redbooks promotions . .xv Preface . xvii Authors. xvii Now you can become a published author, too! . xix Comments welcome. xix Stay connected to IBM Redbooks . .xx Part 1. IBM System Storage DS8000 performance considerations . 1 Chapter 1. IBM System Storage DS8880 family characteristics . 3 1.1 The storage server challenge . 4 1.1.1 Performance numbers . 4 1.1.2 Recommendations and rules . 5 1.1.3 Modeling your workload . 5 1.1.4 Allocating hardware components to workloads. 5 1.2 Meeting the challenge: The DS8000 product family . 6 1.2.1 DS8880 family models and characteristics . 6 1.3 DS8000 performance characteristics overview. 8 1.3.1 Advanced caching techniques . 8 1.3.2 IBM Subsystem Device Driver . 9 1.3.3 Performance characteristics for z Systems. 10 1.3.4 Easy Tier. 11 1.3.5 I/O Priority Manager . 17 Chapter 2. Hardware configuration . 25 2.1 Storage system . 26 2.2 Processor memory and cache . 27 2.2.1 Cache and I/O operations . 28 2.2.2 Determining the correct amount of cache storage . 33 2.3 I/O enclosures and the PCIe infrastructure . 34 2.4 Disk subsystem . 35 2.4.1 Device adapters . 35 2.4.2 DS8000 Fibre Channel switched interconnection at the back end . 36 2.4.3 Disk enclosures. 37 2.4.4 DDMs . 38 2.4.5 Enterprise drives compared to Nearline drives and flash . 39 2.4.6 Installation order . 39 2.5 Host adapters . 41 2.5.1 Fibre Channel and FICON host adapters . 41 2.5.2 Multiple paths to Open Systems servers. 42 2.5.3 Multiple paths to z Systems servers . 43 2.5.4 Spreading host attachments . 43 2.6 Tools to aid in hardware planning . 44 2.6.1 White papers. 44 2.6.2 Disk Magic . 45 © Copyright IBM Corp. 2016. All rights reserved. iii 2.6.3 Capacity Magic . 45 Chapter 3. Logical configuration concepts and terminology . 47 3.1 RAID levels and spares. 48 3.1.1 RAID 5 overview . 48 3.1.2 RAID 6 overview . 49 3.1.3 RAID 10 overview . 50 3.1.4 Array across loops . 51 3.1.5 Spare creation. 52 3.2 The abstraction layers for logical configuration. 53 3.2.1 Array sites . 54 3.2.2 Arrays . 54 3.2.3 Ranks . 55 3.2.4 Extent pools . 57 3.2.5 Logical volumes . 60 3.2.6 Space-efficient volumes . 61 3.2.7 Extent allocation methods. 62 3.2.8 Allocating, deleting, and modifying LUNs and CKD volumes . 65 3.2.9 Logical subsystem . 66 3.2.10 Address groups. 67 3.2.11 Volume access . 68 3.2.12 Summary of the DS8000 logical configuration hierarchy . 69 3.3 Data placement on ranks and extent pools. 70 3.3.1 Rank and array considerations . 71 3.3.2 Extent pool considerations . 72 3.3.3 Easy Tier considerations. 78 Chapter 4. Logical configuration performance considerations . 83 4.1 Reviewing the tiered storage concepts and Easy Tier . 84 4.1.1 Tiered storage concept . 84 4.1.2 IBM System Storage Easy Tier. ..
Recommended publications
  • IBM Spectrum Scale CSI Driver for Container Persistent Storage
    Front cover IBM Spectrum Scale CSI Driver for Container Persistent Storage Abhishek Jain Andrew Beattie Daniel de Souza Casali Deepak Ghuge Harald Seipp Kedar Karmarkar Muthu Muthiah Pravin P. Kudav Sandeep R. Patil Smita Raut Yadavendra Yadav Redpaper IBM Redbooks IBM Spectrum Scale CSI Driver for Container Persistent Storage April 2020 REDP-5589-00 Note: Before using this information and the product it supports, read the information in “Notices” on page ix. First Edition (April 2020) This edition applies to Version 5, Release 0, Modification 4 of IBM Spectrum Scale. © Copyright International Business Machines Corporation 2020. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. iii iv IBM Spectrum Scale CSI Driver for Container Persistent Storage Contents Notices . vii Trademarks . viii Preface . ix Authors. ix Now you can become a published author, too . xi Comments welcome. xii Stay connected to IBM Redbooks . xii Chapter 1. IBM Spectrum Scale and Containers Introduction . 1 1.1 Abstract . 2 1.2 Assumptions . 2 1.3 Key concepts and terminology . 3 1.3.1 IBM Spectrum Scale . 3 1.3.2 Container runtime . 3 1.3.3 Container Orchestration System. 4 1.4 Introduction to persistent storage for containers Flex volumes. 4 1.4.1 Static provisioning. 4 1.4.2 Dynamic provisioning . 4 1.4.3 Container Storage Interface (CSI). 5 1.4.4 Advantages of using IBM Spectrum Scale storage for containers . 5 Chapter 2. Architecture of IBM Spectrum Scale CSI Driver . 7 2.1 CSI Component Overview. 8 2.2 IBM Spectrum Scale CSI driver architecture.
    [Show full text]
  • IBM Storage Insights | Data Sheet
    Systems Hardware Data Sheet IBM Storage Insights | Data Sheet Optimize storage environments with Highlights predictive analytics delivered from IBM Cloud • Consolidate management for on-premises and cloud The value of data is growing, yet visibility into today’s storage storage from IBM Cloud environments can be foggy and unclear—the result of • Use predictive analytics to expanding IT complexity, escalating user demands and gain insights that can exponential data growth. Many IT organizations lack a true reduce storage cost understanding of their storage infrastructure, negatively • Experience proactive impacting their ability to make informed decisions and support, open support causing storage utilization rates to hover around 50 percent.1 tickets and speed Manual storage management processes and the rapid resolution deployments of mobile, social, analytics and cloud IT models • Avoid the upfront cost and compound the challenges. With the cost of managing storage complexity of on-premises infrastructures significantly higher than the cost of solutions purchasing storage capacity, organizations need new • Provide flexibility with no approaches to managing their environments. long-term commitment To meet this need, IBM® Storage Insights combines analytics • Deploy IBM Storage leadership and a rich history of storage management Insights at no cost expertise with a cloud-based delivery model, enabling you to: Accurately identify and categorize storage assets Monitor capacity and performance from the storage consumers’ perspective—including
    [Show full text]
  • Content Marketing Members-Only Conference
    Content Marketing Members-Only Conference Wednesday, March 12, 2014 | Charles Schwab & Co. Inc. | San Francisco, CA at We’ll be live tweeting throughout the conference (@ANAMarketers), as well as posting photos and other information at facebook.com/ANA. www.ana.net Table of Contents ANA Content Marketing Members-Only Conference at Charles Schwab & Co. Agenda ............................................................................ pg 2 Speaker Bios .................................................................... pg 4 Attendees ........................................................................ pg 7 ANA Member Benefits .....................................................pg 15 www.ana.net 1 Agenda ANA Content Marketing Members-Only Conference at Charles Schwab & Co. WEDNESDAY, MARCH 12, 2014 to expand the opportunity to engage balance different content strategies for consumers and to build brand affinity different types of brands, or measure Breakfast (8:15 a.m.) in a new way that complements tradi- real results? The next five years will see tional advertising. a strategic inflection for marketing and advertising, and content will be at the Helen Loh General Session (9:00 a.m.) core. This session will talk through the Vice President, Content and Digital Marketing business case, the process, the tactics Charles Schwab & Co. Inc. BENJAMIN MOORE USES CONTENT TO and real-life examples of how real CONNECT WITH DIFFERENT AUDIENCE Tami Dorsey brands are using content to drive real SEGMENTS Editorial Director marketing results. Charles Schwab & Co. Inc. Staying true to their namesake’s 130+ Robert Rose Chief Strategist year-old vision, Benjamin Moore & Co. INTEL DEVELOPS A BRANDED Content Marketing Institute is committed to producing the highest CONTENT FORMULA TO ENSURE quality paints and finishes in the indus- try. But marketing to their disparate REPEATED SUCCESS Lunch (12:50 p.m.) target markets (contractors to home- When Intel & Toshiba launched “The owners, as well as designers and archi- Inside Experience” in 2011 it was General Session Cont.
    [Show full text]
  • Ibm® Storwize® V3700
    IBM® STORWIZE® V3700 Advanced Capabilities for SMB An application provides monitoring capabilities to securely check the health and performance of the system remotely from a mobile device. The built-in performance dashboard provides at-a-glance access to key high-level real-time system performance information. OPTIMIZE EFFICIENCY Using thin provisioning, applications consume only the space they are actually using, versus the total space that they have ENTERPRISE-CLASS SOLUTION been allocated. Designed to keep business overhead low, thin provisioning optimizes efficiency by allocating disk storage space Data has become the new currency of business, their most criti- in a flexible manner among multiple users, based on the mini- cal asset. But organizations often spend too much money and mum space required by each user at any given time. This can time managing where their data is stored. The average firm pur- help organizations save power, lower heat generation and reduce chases 24 percent more storage every year1, but uses less than hardware space requirements. half of its capacity2 The right infrastructure allows clients to shift spending and invest IMPROVE PERFORMANCE in projects that improve business results. The infrastructure must ensure the most value from data at the least cost with the least Automated storage tiering with IBM Easy Tier, an optional func- effort and the greatest flexibility. tion for Storwize V3700, is designed to help improve perfor- mance at lower cost through more efficient use of flash storage Building an effective infrastructure starts with software-defined or multiple types of disk drives. Easy Tier automatically and storage, which frees data from the physical storage and provides dynamically moves the appropriate data across storage tiers to better access to applications.
    [Show full text]
  • Thermal-Aware Scheduling in Openmp
    Thermal-aware Scheduling in OpenMP ARTUR PODOBAS KTH Information and Communication Technology Master of Science Thesis Stockholm, Sweden 2010 TRITA-ICT-EX-2010:114 I would like to thank my supervisor Mats Brorsson for the freedom I had in this work and his time, help, advices and directions when I was stuck as well as his mentorship. I also would like to oer thanks to the SICS multicore groups for useful feedback in the dierent stages of this work. Simics and Gems forum users have my thanks for all the question solved by reading through them. Finally my thanks to the guys at Barcelona Supercomputing Center for their support in the Nanos++ and Mercurium compiler. 2 Contents I Abbreviations 11 II Introduction 12 III Background Study 13 1 Introduction 14 2 Eects 15 2.1 Introduction . 15 2.2 Electromigration . 15 2.3 Stressmigration . 16 2.4 Time-Dependent Dielectric Breakdown . 16 2.5 Resistor-Capacitor-Delays / Propagation Delays . 17 2.6 Ohmic drop . 18 2.7 Package and Lifetime Cost . 18 3 The transistor and the inverter 20 3.1 Introduction . 20 3.2 The MOSFET Transistor . 20 3.3 The Inverter . 20 4 Power calculation 21 4.1 Introduction . 21 4.2 Static Power . 21 4.3 Dynamic Power . 21 5 Power management 24 5.1 Introduction . 24 5.2 Voltage and frequency scaling . 24 5.3 Clock Gating . 25 5.4 Power-ecient logic . 26 5.5 Thread, Task and Process migration . 26 5.6 Shutting down modules . 27 5.7 Cool-loops . 27 6 Scheduling and Thermal modeling 27 6.1 Introduction .
    [Show full text]
  • IBM Software-Defined Storage Guide
    Front cover IBM Software-Defined Storage Guide Larry Coyne Joe Dain Eric Forestier Patrizia Guaitani Robert Haas Christopher D. Maestas Antoine Maille Tony Pearson Brian Sherman Christopher Vollmar Redpaper International Technical Support Organization IBM Software-Defined Storage Guide July 2018 REDP-5121-02 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. Third Edition (July 2018) © Copyright International Business Machines Corporation 2016, 2018. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . vii Trademarks . viii Preface . ix Authors. ix Now you can become a published author, too . xi Comments welcome. xii Stay connected to IBM Redbooks . xii Chapter 1. Why software-defined storage . 1 1.1 Introduction to software-defined architecture . 2 1.2 Introduction to software-defined storage. 3 1.3 Introduction to Cognitive Storage Management . 7 Chapter 2. Software-defined storage. 9 2.1 Introduction to SDS . 10 2.2 SDS overview . 11 2.2.1 SDS supports emerging as well as traditional IT consumption models . 12 2.2.2 Required SDS capabilities . 14 2.2.3 SDS Functions . 15 2.3 SDS Data-access protocols . 16 2.3.1 Block I/O . 16 2.3.2 File I/O . 17 2.3.3 Object Storage . 17 2.4 SDS reference architecture. 17 2.5 Ransomware Considerations . 18 Chapter 3. IBM SDS product offerings . 19 3.1 SDS architecture . 20 3.1.1 SDS control plane . 23 3.1.2 SDS data plane.
    [Show full text]
  • IBM Flashsystem 7200 | Data Sheet
    IBM Systems Data Sheet IBM FlashSystem 7200 | Data sheet Cost-efficient storage made simple for Highlights hybrid cloud • Deploy enterprise-grade To take advantage of artificial intelligence (AI)-enhanced functionality applications, real-time Big Data analytics, and cloud • Leverage NVMe architectures that require higher levels of system performance in one cost- performance and storage capacity, enterprises around the efficient system globe are rapidly moving to modernize legacy IT infrastructures. But for many organizations, staff resources • Build easy-to-manage, and expertise are not abundant, and cost-efficiency is a top high-performance hybrid cloud environments priority. These organizations have important investments in existing infrastructure that they want to maximize. They need • Extend data services across enterprise-grade solutions that optimize cost-efficiency and more than 500 security while simplifying the pathway to modernization. The heterogeneous systems IBM FlashSystem 7200 is designed specifically for these • Transform data economics requirements and use cases. using sophisticated data reduction Built with IBM Spectrum Virtualize software – part of the IBM • Leverage AI to optimize Spectrum Storage family – IBM FlashSystem 7200 provides storage management and feature-rich, enterprise-grade storage solutions that help streamline issue resolution enterprises effectively support the workloads and • Deploy leading-edge applications that are crucial to their business success. IBM storage solutions with FlashSystem storage arrays can handle massive volumes of confidence using IBM data, enable rapid and flexible cloud services deployments, FlashWatch and deliver the performance needed to gain insights from the • Increase cost-efficiency latest AI and analytics technologies with all-flash or hybrid- with IBM Storage Utility flash solutions.
    [Show full text]
  • IBM System Storage Solutions Handbook
    Front cover IBM System Storage Solutions Handbook Ezgi Coskun Mikael Lindström Maciej Olejniczak Oliver Stark Megan Gilge Redbooks International Technical Support Organization IBM System Storage Solutions Handbook July 2016 SG24-5250-11 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. Eleventh Edition (July 2016) This edition applies to the IBM System Storage products as of April 2016. © Copyright International Business Machines Corporation 1999, 2016. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . vii Trademarks . viii IBM Redbooks promotions . ix Preface . xi Authors. xi Now you can become a published author, too! . xiii Comments welcome. xiii Stay connected to IBM Redbooks . xiii Chapter 1. Introduction. 1 1.1 IBM Spectrum family and software defined systems. 2 1.1.1 Introduction to software-defined architecture . 2 1.1.2 Introduction to software-defined storage. 4 1.1.3 SDS reference architecture. 5 1.2 IBM storage systems. 6 1.2.1 IBM SAN Volume Controller and IBM Storwize family . 7 1.2.2 IBM FlashSystem family . 8 1.2.3 IBM DS8880 Storage System . 9 1.2.4 IBM XIV Storage System . 9 1.2.5 IBM Elastic Storage Server. 9 1.2.6 IBM tape storage. 9 1.2.7 IBM storage area network products . 11 1.3 IBM storage services. 12 Chapter 2. IBM Spectrum Storage family . 13 2.1 SDS architecture . 14 2.2 SDS control plane . 15 2.2.1 IBM Spectrum Control.
    [Show full text]
  • Storage and Network Convergence Using Fcoe and Iscsi
    Front cover Storage and Network Convergence Using FCoE and iSCSI Learn how to improve IT service performance and availability Simplify your storage and network infrastructure See how to reduce data center network costs Sangam Racherla Silvio Erdenberger Harish Rajagopal Kai Ruth ibm.com/redbooks International Technical Support Organization Storage and Network Convergence Using FCoE and iSCSI January 2014 SG24-7986-01 Note: Before using this information and the product it supports, read the information in “Notices” on page xi. Second Edition (January 2014) This edition applies to the latest supported Converged Network Adapters and Switches in the IBM System Networking Portfolio of products. © Copyright International Business Machines Corporation 2012, 2014. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . xi Trademarks . xii Preface . xiii Authors. xiii Now you can become a published author, too! . .xv Comments welcome. .xv Stay connected to IBM Redbooks . xvi Part 1. Overview of storage and network convergence . 1 Chapter 1. Introduction to convergence . 3 1.1 What convergence is. 4 1.1.1 Calling it what it is . 4 1.2 Vision of convergence in data centers . 4 1.3 The interest in convergence now . 5 1.4 Fibre Channel SANs today . 5 1.5 Ethernet-based storage today. 6 1.6 Benefits of convergence in storage and network . 7 1.7 Challenge of convergence . 8 1.8 Conclusion . 10 Chapter 2. Fibre Channel over Ethernet . 11 2.1 Background: Data Center Bridging . 12 2.1.1 Priority-based Flow Control: IEEE 802.1Qbb .
    [Show full text]
  • IBM Storage Networking SAN256B-7: SAN256B-7 Installation, Service, and User Guide Safety and Environmental Notices
    IBM Storage Networking SAN256B-7 MTM Service information: 8961-F74 Installation, Service, and User Guide IBM SC28-3149-00 Read Before Using This product contains software that is licensed under written license agreements. Your use of such software is subject to the license agreements under which they are provided. Before you use the information in this publication, be sure to read the general information under “Notices” on page 215. Copyright Portions Copyright © 2020 Broadcom, Inc. All Rights Reserved. © Copyright International Business Machines Corporation 2020. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Figures................................................................................................................. ix Tables................................................................................................................ xiii Read this first...................................................................................................... xv Getting help................................................................................................................................................ xv Accessibility features................................................................................................................................. xv Feedback....................................................................................................................................................xvi Safety and
    [Show full text]
  • IBM Flashsystem 5100
    IBM Systems Data Sheet IBM FlashSystem 5100 NVMe-accelerated performance and proven, wide-ranging functionality in Highlights affordable storage solutions Enterprises today are rapidly adopting leading-edge • Provides storage virtualization with the technologies such as real-time analytics, artificial intelligence speed of NVMe-optimized (AI) and blockchain, among others. These powerful new flash technologies require IT infrastructure that provides great flexibility and scalability, wide-ranging data services, • Leverages the power of IBM seamless movement within multicloud architectures, and Spectrum Virtualize for rich data services perhaps most importantly — Speed. • Offers data reduction pools The Non-Volatile Memory Express (NVMe) protocol is one of with deduplication and the most powerful new innovations designed to dramatically compression accelerate data processing. IBM Storage has been rapidly • Brings hybrid cloud storage moving forward with implementing NVMe-based solutions capabilities to increase across its entire storage portfolio. The IBM FlashSystem business agility family of data systems has already incorporated NVMe • Simplifies storage capabilities into its High-End Enterprise and Midrange management with an Enterprise FlashSystem. With the introduction of the IBM innovative user interface FlashSystem 5100, IBM integrates the speed and efficiency • Extends wide-ranging data of NVMe technologies into the Entry Enterprise line designed services across hundreds of to provide affordable, highly functional, high-performance
    [Show full text]
  • The GPU Computing Revolution
    The GPU Computing Revolution From Multi-Core CPUs to Many-Core Graphics Processors A Knowledge Transfer Report from the London Mathematical Society and Knowledge Transfer Network for Industrial Mathematics By Simon McIntosh-Smith Copyright © 2011 by Simon McIntosh-Smith Front cover image credits: Top left: Umberto Shtanzman / Shutterstock.com Top right: godrick / Shutterstock.com Bottom left: Double Negative Visual Effects Bottom right: University of Bristol Background: Serg64 / Shutterstock.com THE GPU COMPUTING REVOLUTION From Multi-Core CPUs To Many-Core Graphics Processors By Simon McIntosh-Smith Contents Page Executive Summary 3 From Multi-Core to Many-Core: Background and Development 4 Success Stories 7 GPUs in Depth 11 Current Challenges 18 Next Steps 19 Appendix 1: Active Researchers and Practitioner Groups 21 Appendix 2: Software Applications Available on GPUs 23 References 24 September 2011 A Knowledge Transfer Report from the London Mathematical Society and the Knowledge Transfer Network for Industrial Mathematics Edited by Robert Leese and Tom Melham London Mathematical Society, De Morgan House, 57–58 Russell Square, London WC1B 4HS KTN for Industrial Mathematics, Surrey Technology Centre, Surrey Research Park, Guildford GU2 7YG 2 THE GPU COMPUTING REVOLUTION From Multi-Core CPUs To Many-Core Graphics Processors AUTHOR Simon McIntosh-Smith is head of the Microelectronics Research Group at the Univer- sity of Bristol and chair of the Many-Core and Reconfigurable Supercomputing Conference (MRSC), Europe’s largest conference dedicated to the use of massively parallel computer architectures. Prior to joining the university he spent fifteen years in industry where he designed massively parallel hardware and software at companies such as Inmos, STMicro- electronics and Pixelfusion, before co-founding ClearSpeed as Vice-President of Architec- ture and Applications.
    [Show full text]