DOCSLIB.ORG

IBM Redbook IBM Spectrum Scale (Formerly GPFS)

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
IBM Redbook IBM Spectrum Scale (Formerly GPFS) Front cover IBM Spectrum Scale (formerly GPFS) Dino Quintero Luis Bolinches Puneet Chaudhary Willard Davis Steve Duersch Carlos Henrique Fachim Andrei Socoliuc Olaf Weiser Redbooks International Technical Support Organization IBM Spectrum Scale (formerly GPFS) May 2015 SG24-8254-00 Note: Before using this information and the product it supports, read the information in “Notices” on page ix. First Edition (May 2015) This edition applies to IBM Spectrum Scale (formerly GPFS) v4.1.0.4 (TL1), SLES 11 SP2, SLES11 SP3, RHEL ppc64 6.5, AIX 7.1 TL3, Tivoli Storage Manager 7.1 Server, Client and Storage Agent (LAN-free), Tivoli Storage Manager for Space Management 7.1.1, and TSM for Space Management (HSM) 7.1.1. © Copyright International Business Machines Corporation 2015. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . ix Trademarks . .x IBM Redbooks promotions . xi Preface . xiii Authors. xiii Now you can become a published author, too! . .xv Comments welcome. .xv Stay connected to IBM Redbooks . .xv Chapter 1. Introduction. 1 1.1 Overview . 2 1.2 IBM Spectrum Scale major components and terminology . 3 1.2.1 IBM Spectrum Scale cluster topologies . 5 1.3 IBM Spectrum Scale new features and enhancements . 5 1.3.1 Enhanced security . 6 1.3.2 Performance improvements . 6 1.3.3 New usability features. 7 1.3.4 Reliability, availability, and serviceability. 10 1.4 IBM Spectrum Scale competitive strategy . 10 1.5 IBM Spectrum Scale licensing . 12 1.6 IBM Spectrum Scale on cross-platform environments . 15 1.6.1 IBM Spectrum Scale for AIX . 15 1.6.2 IBM Spectrum Scale for Windows operating systems . 16 1.6.3 IBM Spectrum Scale for Linux. 16 1.6.4 IBM Spectrum Scale for Linux on System z . 17 1.6.5 IBM Spectrum Scale Server solution . 17 1.7 IBM Spectrum Scale and virtualization . 18 1.7.1 Virtualization on IBM Power Systems . 19 1.7.2 Virtualization on x86 Linux operating systems . 26 1.7.3 Virtualization on Windows operating systems. 27 1.8 Contact information . 28 Chapter 2. Infrastructure planning and considerations . 29 2.1 IBM Spectrum Scale cluster topologies . 30 2.1.1 Network-based Spectrum Scale client . 30 2.1.2 Direct attached storage. 30 2.1.3 Mixed NSD access: server and clients . 31 2.1.4 IBM Spectrum Scale File Placement Optimizer . 32 2.2 Network design . 33 2.2.1 Ethernet adapters options. 33 2.2.2 NIC teaming configurations. 34 2.2.3 InfiniBand networks. 36 2.2.4 RDMA over Converged Enhanced Ethernet . 39 2.2.5 IBM data center networking products . 45 2.3 Storage design . 45 2.3.1 Host bus adapter. 46 2.3.2 Multipath driver . 47 © Copyright IBM Corp. 2015. All rights reserved. iii 2.3.3 Storage subsystem considerations . 50 2.3.4 Tape library . 54 2.4 IBM Spectrum Scale supported platforms. 56 2.4.1 IBM Spectrum Scale on AIX . 57 2.4.2 IBM Spectrum Scale for Linux (x86 and POWER) . 57 2.4.3 IBM Spectrum Scale for Linux on System z . 59 2.4.4 IBM Spectrum Scale on Windows operating systems. 61 2.4.5 Summary of IBM Spectrum Scale support functions on operating systems . 64 2.4.6 GPT partition table . 66 2.4.7 SCSI-3 Persistent Reservation . 66 2.5 Security considerations for IBM Spectrum Scale clusters. 69 2.5.1 Remote shell with ssh . 70 2.5.2 Remote cluster: Subnets, firewall rules, and TCP port numbers . 70 2.5.3 SELinux configuration with IBM Spectrum Scale . 71 2.6 IBM Spectrum Scale configuration planning . 72 2.6.1 High availability . 72 2.6.2 Network Shared Disk creation considerations . 78 2.6.3 Planning the IBM Spectrum Scale file system . 85 2.6.4 Planning for IBM Spectrum Scale FPO. 93 Chapter 3. Scenarios . 97 3.1 IBM Spectrum Scale advantages over Network File System . 98 3.2 IBM Spectrum Scale in active-passive and mutual takeover clusters. 98 3.3 IBM Spectrum Scale in active-active clusters . 99 3.4 Two-node Linux IBM Spectrum Scale cluster . 99 3.4.1 Installing IBM Spectrum Scale . 99 3.4.2 Configure auxiliary tools . 100 3.4.3 Building the IBM Spectrum Scale portability layer on Linux nodes. 102 3.4.4 Create IBM Spectrum Scale cluster . 104 3.4.5 Create NSD disks . 105 3.4.6 Starting the IBM Spectrum Scale cluster . 107 3.4.7 Quorum configuration . 108 3.4.8 Start IBM Spectrum Scale at boot. 109 3.4.9 Create the IBM Spectrum Scale file system . 110 3.5 Cluster NFS. ..
Load more

Recommended publications
  • Elastic Storage for Linux on System Z IBM Research & Development Germany
    Peter Münch T/L Test and Development – Elastic Storage for Linux on System z IBM Research & Development Germany Elastic Storage for Linux on IBM System z © Copyright IBM Corporation 2014 9.0 Elastic Storage for Linux on System z Session objectives • This presentation introduces the Elastic Storage, based on General Parallel File System technology that will be available for Linux on IBM System z. Understand the concepts of Elastic Storage and which functions will be available for Linux on System z. Learn how you can integrate and benefit from the Elastic Storage in a Linux on System z environment. Finally, get your first impression in a live demo of Elastic Storage. 2 © Copyright IBM Corporation 2014 Elastic Storage for Linux on System z Trademarks The following are trademarks of the International Business Machines Corporation in the United States and/or other countries. AIX* FlashSystem Storwize* Tivoli* DB2* IBM* System p* WebSphere* DS8000* IBM (logo)* System x* XIV* ECKD MQSeries* System z* z/VM* * Registered trademarks of IBM Corporation The following are trademarks or registered trademarks of other companies. Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
    [Show full text]
  • Building a SAN-Less Private Cloud with IBM Powervm and IBM Powervc
    Front cover Building a SAN-less Private Cloud with IBM PowerVM and IBM PowerVC Javier Bazan Lazcano Stephen Lutz Redpaper International Technical Support Organization Building a SAN-less Private Cloud with IBM PowerVM and IBM PowerVC July 2018 REDP-5455-02 Note: Before using this information and the product it supports, read the information in “Notices” on page v. Third Edition (July 2018) This edition applies to Version 1, Release 4, Modification 1 of IBM Cloud PowerVC Manager for Software-Defined Infrastructure V1.1 (product number 5765-VCD). © Copyright International Business Machines Corporation 2017, 2018. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . .v Trademarks . vi Preface . vii Authors. vii Now you can become a published author, too! . viii Comments welcome. viii Stay connected to IBM Redbooks . viii Chapter 1. Architecture of a software-defined infrastructure solution with IBM Power Systems servers and IBM PowerVC . 1 1.1 Software-defined infrastructure . 2 1.2 The motivation behind software-defined infrastructure . 2 1.3 Use cases . 4 1.3.1 Use case 1: Building a storage area network-less cloud . 4 1.3.2 Use case 2: Building an iSCSI-backed cloud . 5 1.3.3 More use cases. 5 1.4 Rack topologies and components . 6 1.4.1 Starter cloud . 7 1.4.2 Mini cloud . 8 1.4.3 Rack scale . 9 1.4.4 Storage/management switches. 10 1.4.5 Data switches . 10 1.4.6 Network nodes .
    [Show full text]
  • IBM Spectrum Scale CSI Driver for Container Persistent Storage
    Front cover IBM Spectrum Scale CSI Driver for Container Persistent Storage Abhishek Jain Andrew Beattie Daniel de Souza Casali Deepak Ghuge Harald Seipp Kedar Karmarkar Muthu Muthiah Pravin P. Kudav Sandeep R. Patil Smita Raut Yadavendra Yadav Redpaper IBM Redbooks IBM Spectrum Scale CSI Driver for Container Persistent Storage April 2020 REDP-5589-00 Note: Before using this information and the product it supports, read the information in “Notices” on page ix. First Edition (April 2020) This edition applies to Version 5, Release 0, Modification 4 of IBM Spectrum Scale. © Copyright International Business Machines Corporation 2020. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. iii iv IBM Spectrum Scale CSI Driver for Container Persistent Storage Contents Notices . vii Trademarks . viii Preface . ix Authors. ix Now you can become a published author, too . xi Comments welcome. xii Stay connected to IBM Redbooks . xii Chapter 1. IBM Spectrum Scale and Containers Introduction . 1 1.1 Abstract . 2 1.2 Assumptions . 2 1.3 Key concepts and terminology . 3 1.3.1 IBM Spectrum Scale . 3 1.3.2 Container runtime . 3 1.3.3 Container Orchestration System. 4 1.4 Introduction to persistent storage for containers Flex volumes. 4 1.4.1 Static provisioning. 4 1.4.2 Dynamic provisioning . 4 1.4.3 Container Storage Interface (CSI). 5 1.4.4 Advantages of using IBM Spectrum Scale storage for containers . 5 Chapter 2. Architecture of IBM Spectrum Scale CSI Driver . 7 2.1 CSI Component Overview. 8 2.2 IBM Spectrum Scale CSI driver architecture.
    [Show full text]
  • IBM Storage Insights | Data Sheet
    Systems Hardware Data Sheet IBM Storage Insights | Data Sheet Optimize storage environments with Highlights predictive analytics delivered from IBM Cloud • Consolidate management for on-premises and cloud The value of data is growing, yet visibility into today’s storage storage from IBM Cloud environments can be foggy and unclear—the result of • Use predictive analytics to expanding IT complexity, escalating user demands and gain insights that can exponential data growth. Many IT organizations lack a true reduce storage cost understanding of their storage infrastructure, negatively • Experience proactive impacting their ability to make informed decisions and support, open support causing storage utilization rates to hover around 50 percent.1 tickets and speed Manual storage management processes and the rapid resolution deployments of mobile, social, analytics and cloud IT models • Avoid the upfront cost and compound the challenges. With the cost of managing storage complexity of on-premises infrastructures significantly higher than the cost of solutions purchasing storage capacity, organizations need new • Provide flexibility with no approaches to managing their environments. long-term commitment To meet this need, IBM® Storage Insights combines analytics • Deploy IBM Storage leadership and a rich history of storage management Insights at no cost expertise with a cloud-based delivery model, enabling you to: Accurately identify and categorize storage assets Monitor capacity and performance from the storage consumers’ perspective—including
    [Show full text]
  • File Systems and Storage
    FILE SYSTEMS AND STORAGE On Making GPFS Truly General DEAN HILDEBRAND AND FRANK SCHMUCK Dean Hildebrand manages the PFS (also called IBM Spectrum Scale) began as a research project Cloud Storage Software team that quickly found its groove supporting high performance comput- at the IBM Almaden Research ing (HPC) applications [1, 2]. Over the last 15 years, GPFS branched Center and is a recognized G expert in the field of distributed out to embrace general file-serving workloads while maintaining its original and parallel file systems. He pioneered pNFS, distributed design. This article gives a brief overview of the origins of numer- demonstrating the feasibility of providing ous features that we and many others at IBM have implemented to make standard and scalable access to any file GPFS a truly general file system. system. He received a BSc degree in computer science from the University of British Columbia Early Days in 1998 and a PhD in computer science from Following its origins as a project focused on high-performance lossless streaming of multi- the University of Michigan in 2007. media video files, GPFS was soon enhanced to support high performance computing (HPC) [email protected] applications, to become the “General Parallel File System.” One of its first large deployments was on ASCI White in 2002—at the time, the fastest supercomputer in the world. This HPC- Frank Schmuck joined IBM focused architecture is described in more detail in a 2002 FAST paper [3], but from the outset Research in 1988 after receiving an important design goal was to support general workloads through a standard POSIX inter- a PhD in computer science face—and live up to the “General” term in the name.
    [Show full text]
  • IBM Software Defined Storage Guide
    Front cover IBM Software-Defined Storage Guide Larry Coyne Mathias Defiebre Phil Gilmer Shivaramakrishnan Gopalakrishna Mikael Lindström Brandon Mann Gianluca Perilli Mladen Portak Redpaper International Technical Support Organization IBM Software-Defined Storage Guide January 2016 REDP-5121-00 Note: Before using this information and the product it supports, read the information in “Notices” on page v. First Edition (January 2016) This document was created or updated on January 20, 2016. © Copyright International Business Machines Corporation 201. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . .v Trademarks . vi IBM Redbooks promotions . vii Preface . ix Authors. ix Now you can become a published author, too! . xi Comments welcome. xi Stay connected to IBM Redbooks . xi Chapter 1. Why software-defined storage? . 1 1.1 Introduction to the software-defined architecture . 2 1.2 Software-defined infrastructure (SDI) . 2 Chapter 2. Software-defined storage. 7 2.1 Introduction to SDS . 8 2.2 SDS overview . 8 2.2.1 SDS supports emerging as well as traditional IT consumption models . 9 2.2.2 Required SDS Capabilities . 11 2.2.3 SDS Functions . 12 2.3 SDS Data-access protocols . 13 2.4 SDS Reference Architecture . 14 Chapter 3. IBM SDS product offerings . 17 3.1 SDS architecture . 18 3.2 SDS Control Plane . 19 3.2.1 IBM Spectrum Control. 20 3.2.2 IBM Spectrum Protect. 26 3.3 SDS data plane . 32 3.3.1 IBM Spectrum Virtualize . 32 3.3.2 IBM Spectrum Accelerate .
    [Show full text]
  • Filesystems HOWTO Filesystems HOWTO Table of Contents Filesystems HOWTO
    Filesystems HOWTO Filesystems HOWTO Table of Contents Filesystems HOWTO..........................................................................................................................................1 Martin Hinner < [email protected]>, http://martin.hinner.info............................................................1 1. Introduction..........................................................................................................................................1 2. Volumes...............................................................................................................................................1 3. DOS FAT 12/16/32, VFAT.................................................................................................................2 4. High Performance FileSystem (HPFS)................................................................................................2 5. New Technology FileSystem (NTFS).................................................................................................2 6. Extended filesystems (Ext, Ext2, Ext3)...............................................................................................2 7. Macintosh Hierarchical Filesystem − HFS..........................................................................................3 8. ISO 9660 − CD−ROM filesystem.......................................................................................................3 9. Other filesystems.................................................................................................................................3
    [Show full text]
  • IBM Worklight V5.0.6 Technology Overview
    IBM Software Technical White Paper WebSphere IBM Worklight V5.0.6 Technology overview IBM Worklight—Overview Contents IBM® Worklight® software helps enable organizational leaders to extend their business to mobile devices. This software provides an open, 1 IBM Worklight—Overview comprehensive and advanced mobile application platform for smart- phones and tablets, helping organizations of all sizes to efficiently 2 IBM Worklight—Components develop, connect, run and manage mobile and omni-channel applications. 3 Development tools Leveraging standards-based technologies and tools, the IBM team has created Worklight software that provides a single integrated platform. 8 Runtime server environment This platform includes a comprehensive development environment, 9 The IBM Worklight Console mobile-optimized runtime middleware, a private enterprise application store and an integrated management and analytics console—all supported 9 IBM Worklight Device by a variety of security mechanisms. Runtime components 10 Security and authentication Develop. The IBM Worklight Studio and the IBM Worklight software mechanisms development kit (SDK) simplify the development of mobile and omni- channel applications (apps) throughout multiple mobile platforms, includ- ing iOS, Android, BlackBerry, Windows 8, Windows Phone and Java ME. The IBM Worklight optimization framework fosters code reuse while delivering rich user experiences that match the styling requirements of each target environment. With such code reuse, IBM Worklight reduces costs of development, reduces time-to-market and provides strong support for your ongoing management efforts. Connect. The IBM Worklight Server architecture and adapter technol- ogy simplifies the integration of mobile apps with back-end enterprise systems and cloud-based services. The IBM Worklight Server is designed IBM Software Technical White Paper WebSphere to fit quickly into your organization’s IT infrastructure and is Console.
    [Show full text]
  • AIX Dec 2004.P65
    110 December 2004 In this issue 3 Finding the biggest file in directories on the same filesystem 4 Creating a physical partition map of an hdisk by logical volume 9 AIX console mirroring 11 Using ClamAV 14 Happy 18th birthday AIX 16 Deploying multiple compiler versions on AIX 27 Mirroring tips and techniques in AIX 36 Generating a logo 41 Default user password settings in AIX 47 AIX news © Xephon Inc 2004 AIX Update Published by Disclaimer Xephon Inc Readers are cautioned that, although the PO Box 550547 information in this journal is presented in good Dallas, Texas 75355 faith, neither Xephon nor the organizations or USA individuals that supplied information in this Phone: 214-340-5690 journal give any warranty or make any Fax: 214-341-7081 representations as to the accuracy of the material it contains. Neither Xephon nor the contributing Editor organizations or individuals accept any liability of Trevor Eddolls any kind howsoever arising out of the use of such E-mail: [email protected] material. Readers should satisfy themselves as to the correctness and relevance to their Publisher circumstances of all advice, information, code, Bob Thomas JCL, scripts, and other contents of this journal E-mail: [email protected] before making any use of it. Subscriptions and back-issues Contributions A year’s subscription to AIX Update, When Xephon is given copyright, articles comprising twelve monthly issues, costs published in AIX Update are paid for at the rate $275.00 in the USA and Canada; £180.00 in of $160 (£100 outside North America) per the UK; £186.00 in Europe; £192.00 in 1000 words and $80 (£50) per 100 lines of code Australasia and Japan; and £190.50 elsewhere.
    [Show full text]
  • Ibm® Storwize® V3700
    IBM® STORWIZE® V3700 Advanced Capabilities for SMB An application provides monitoring capabilities to securely check the health and performance of the system remotely from a mobile device. The built-in performance dashboard provides at-a-glance access to key high-level real-time system performance information. OPTIMIZE EFFICIENCY Using thin provisioning, applications consume only the space they are actually using, versus the total space that they have ENTERPRISE-CLASS SOLUTION been allocated. Designed to keep business overhead low, thin provisioning optimizes efficiency by allocating disk storage space Data has become the new currency of business, their most criti- in a flexible manner among multiple users, based on the mini- cal asset. But organizations often spend too much money and mum space required by each user at any given time. This can time managing where their data is stored. The average firm pur- help organizations save power, lower heat generation and reduce chases 24 percent more storage every year1, but uses less than hardware space requirements. half of its capacity2 The right infrastructure allows clients to shift spending and invest IMPROVE PERFORMANCE in projects that improve business results. The infrastructure must ensure the most value from data at the least cost with the least Automated storage tiering with IBM Easy Tier, an optional func- effort and the greatest flexibility. tion for Storwize V3700, is designed to help improve perfor- mance at lower cost through more efficient use of flash storage Building an effective infrastructure starts with software-defined or multiple types of disk drives. Easy Tier automatically and storage, which frees data from the physical storage and provides dynamically moves the appropriate data across storage tiers to better access to applications.
    [Show full text]
  • IBM DS8870 Architecture and Implementation (Release 7.5)
    Front cover IBM DS8870 Architecture and Implementation (Release 7.5) Bertrand Dufrasne Werner Bauer Artur Borowicz Adrian Orben Robert Tondini Bob Xiao Redbooks International Technical Support Organization IBM DS8870 Architecture and Implementation (Release 7.5) July 2015 SG24-8085-05 Note: Before using this information and the product it supports, read the information in “Notices” on page xi. Sixth Edition (July 2015) This edition applies to Release 7.5 (DS8000 License Machine Code 7.7.50.xx.xx , bundle version 87.51.52.xx, or later) of the IBM DS8870 (MachineType 2421, 2422, 2423, and 2424). © Copyright International Business Machines Corporation 2013, 2015. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . xi Trademarks . xii IBM Redbooks promotions . xiii Preface . .xv Authors. xvi Now you can become a published author, too! . xvii Comments welcome. xviii Stay connected to IBM Redbooks . xviii Part 1. Concepts and architecture. 1 Chapter 1. Introduction to the IBM DS8870 . 3 1.1 Introduction to the IBM DS8870 . 4 1.1.1 Features of the DS8870 . 5 1.2 DS8870 controller options and frames . 9 1.3 DS8870 architecture and functions overview . 11 1.3.1 Overall architecture and components . 11 1.3.2 Storage capacity . 14 1.3.3 Supported environments. 15 1.3.4 Configuration flexibility . 15 1.3.5 Copy Services functions . 17 1.3.6 Service and setup . 18 1.3.7 IBM Certified Secure Data Overwrite . 18 1.4 Performance features . 19 1.4.1 16 Gbps host adapters .
    [Show full text]
  • IBM Storage BP Guidebook V17.0E#.Pdf
    December 2013 CLICK HERE to check for updates How to Optimize Building an A Seller’sYour Current Roadmap IBM to IBMInfrastructure Storage for IBMOn Demand Solutions StorageComputing Today and Tomorrow Business Partner Guidebook Environment eBook Edited by Jim Hoskins Jim Hoskins IBM Storage Business Partner Guidebook Titles of Interest More IBM Titles of Interest • IBM PureSystems Business Partner Guidebook • IBM System x & BladeCenter Business Partner Guidebook • IBM Power Systems Business Partner Guidebook For more information, visit us at maxpress.com or email us at [email protected]. IBM Storage Business Partner Guidebook Seventeenth Edition A Seller’s Roadmap to IBM Storage Solutions Edited by Jim Hoskins (version 17.0e) 605 Silverthorn Road Gulf Breeze, FL 32561 maxpress.com Notices Production Manager: Jacquie Wallace Cover Designer: Lauren Smith Proofreader: Jacquie Wallace This publication is designed to provide accurate and authoritative information in regard to the subject matter covered. It is sold with the understanding that the publisher is not engaged in rendering professional services. If legal, accounting, medical, psychological, or any other expert assistance is required, the services of a competent professional person should be sought. ADAPTED FROM A DECLARATION OF PRIN- CIPLES OF A JOINT COMMITTEE OF THE AMERICAN BAR ASSOCIATION AND PUBLISHERS. Copyright 2013 by Maximum Press. All rights reserved. Published simultaneously in Canada. Reproduction or translation of any part of this work beyond that permitted by Section 107 or 108 of the 1976 United States Copyright Act without the permission of the copyright owner is unlawful. Requests for permission or further information should be addressed to the Permissions Department, Maximum Press.
    [Show full text]