IBM Spectrum Scale 5.0.3: Concepts, Planning, and Installation Guide Configuration of an IBM Spectrum Scale Stretch Chapter 8
Total Page:16
File Type:pdf, Size:1020Kb
IBM Spectrum Scale Version 5.0.3 Concepts, Planning, and Installation Guide IBM SC27-9567-03 IBM Spectrum Scale Version 5.0.3 Concepts, Planning, and Installation Guide IBM SC27-9567-03 Note Before using this information and the product it supports, read the information in “Notices” on page 477. This edition applies to version 5 release 0 modification 3 of the following products, and to all subsequent releases and modifications until otherwise indicated in new editions: v IBM Spectrum Scale Data Management Edition ordered through Passport Advantage® (product number 5737-F34) v IBM Spectrum Scale Data Access Edition ordered through Passport Advantage (product number 5737-I39) v IBM Spectrum Scale Erasure Code Edition ordered through Passport Advantage (product number 5737-J34) v IBM Spectrum Scale Data Management Edition ordered through AAS (product numbers 5641-DM1, DM3, DM5) v IBM Spectrum Scale Data Access Edition ordered through AAS (product numbers 5641-DA1, DA3, DA5) v IBM Spectrum Scale Data Management Edition for IBM ESS (product number 5765-DME) v IBM Spectrum Scale Data Access Edition for IBM ESS (product number 5765-DAE) Significant changes or additions to the text and illustrations are indicated by a vertical line (|) to the left of the change. IBM welcomes your comments; see the topic “How to send your comments” on page xxv. When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you. © Copyright IBM Corporation 2015, 2019. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Figures .............. vii Data restore options in IBM Spectrum Scale .. 97 Data mirroring in IBM Spectrum Scale .... 98 Tables ............... ix Protecting file data using snapshots ..... 98 Introduction to Scale Out Backup and Restore (SOBAR) .............. 98 About this information ........ xi Introduction to protocols cluster disaster recovery Prerequisite and related information ..... xxiv (DR) ................ 98 Conventions used in this information ..... xxiv Commands for data protection and recovery in How to send your comments ........ xxv IBM Spectrum Scale .......... 99 Introduction to IBM Spectrum Scale GUI .... 100 Summary of changes ....... xxvii IBM Spectrum Scale management API ..... 103 Functional overview .......... 104 Chapter 1. Introducing IBM Spectrum API requests............. 105 Scale ................ 1 API responses ............ 109 List of IBM Spectrum Scale management API Overview of IBM Spectrum Scale ....... 1 commands ............. 111 The strengths of IBM Spectrum Scale ..... 1 Introduction to Cloud services........ 116 The basic IBM Spectrum Scale structure .... 5 How Transparent cloud tiering works .... 118 IBM Spectrum Scale cluster configurations ... 7 How Cloud data sharing works ...... 119 GPFS architecture............. 9 How Write Once Read Many (WORM) storage Special management functions ....... 9 works ............... 122 Use of disk storage and file structure within a Supported cloud providers ........ 123 GPFS file system ........... 12 Interoperability of Transparent cloud tiering GPFS and memory ........... 15 with other IBM Spectrum Scale features ... 123 GPFS and network communication ..... 17 Interoperability of Cloud data sharing with Application and user interaction with GPFS .. 19 other IBM Spectrum Scale features ..... 125 NSD disk discovery .......... 25 Introduction to file audit logging ....... 127 Failure recovery processing ........ 25 Producers in file audit logging ...... 127 Cluster configuration data files ....... 26 The message queue in file audit logging ... 127 GPFS backup data ........... 27 Consumers in file audit logging ...... 128 Clustered configuration repository...... 27 The file audit logging fileset ....... 128 Protocols support overview: Integration of protocol File audit logging records ........ 129 access methods with GPFS ......... 28 File audit logging events' descriptions .... 130 NFS support overview.......... 30 JSON attributes in file audit logging..... 130 SMB support overview ......... 32 Remotely mounted file systems in file audit Object storage support overview ...... 33 logging .............. 132 Cluster Export Services overview ...... 38 Introduction to watch folder ........ 133 CES iSCSI support ........... 40 | Introduction to clustered watch ....... 133 Active File Management .......... 41 | Producers in clustered watch ....... 134 Introduction to Active File Management (AFM) 41 | The message queue in clustered watch .... 134 Overview and concepts ......... 42 | Conduits in clustered watch ....... 135 Active File Management (AFM) features.... 53 | The message queue services monitor and AFM Limitations ........... 77 | clustered watch............ 136 AFM-based Asynchronous Disaster Recovery (AFM | Interaction between clustered watch and the DR) ................. 78 | external Kafka sink .......... 136 Introduction ............. 79 | JSON attributes in clustered watch ..... 137 Recovery time objective (RTO) ....... 81 IBM Spectrum Scale in an OpenStack cloud Modes and concepts .......... 81 deployment .............. 139 AFM-based Asynchronous Disaster Recovery IBM Spectrum Scale product editions ..... 142 features............... 81 IBM Spectrum Scale license designation .... 143 AFM DR Limitations .......... 87 Capacity-based licensing ......... 146 AFM DR deployment considerations and best IBM Spectrum Storage Suite ........ 147 practices .............. 89 Data protection and disaster recovery in IBM Spectrum Scale ............. 97 Data backup options in IBM Spectrum Scale .. 97 © Copyright IBM Corp. 2015, 2019 iii Chapter 2. Planning for IBM Spectrum Chapter 3. Steps for establishing and Scale ............... 149 starting your IBM Spectrum Scale Planning for GPFS............ 149 cluster .............. 243 Hardware requirements ......... 149 Software requirements ......... 150 Chapter 4. Installing IBM Spectrum Recoverability considerations ....... 151 Scale on Linux nodes and deploying GPFS cluster creation considerations..... 158 Disk considerations .......... 162 protocols ............. 245 File system creation considerations ..... 167 Deciding whether to install IBM Spectrum Scale Fileset considerations for creating protocol data and deploy protocols manually or with the exports .............. 183 installation toolkit ............ 246 Backup considerations for using IBM Spectrum Installation prerequisites.......... 246 Protect .............. 185 Preparing the environment on Linux nodes ... 251 Planning for Quality of Service for I/O IBM Spectrum Scale packaging overview .... 252 operations (QoS) ........... 194 Preparing to install the GPFS software on Linux Planning for extended attributes ...... 195 nodes ................ 252 Planning for the Highly Available Write Cache Accepting the electronic license agreement on feature (HAWC) ........... 198 Linux nodes ............. 253 Planning for systemd.......... 201 Extracting the IBM Spectrum Scale software on Planning for protocols .......... 202 Linux nodes ............. 253 Authentication considerations ....... 202 Extracting IBM Spectrum Scale patches (update Planning for NFS ........... 214 SLES or Red Hat Enterprise Linux RPMs or Planning for SMB ........... 216 Ubuntu Linux packages) ........ 255 Planning for object storage deployment.... 221 Installing the IBM Spectrum Scale man pages on Planning for Cloud services ........ 227 Linux nodes ............. 255 Hardware requirements for Cloud services .. 227 For Linux on Z: Changing the kernel settings 255 Software requirements for Cloud services ... 228 Manually installing the IBM Spectrum Scale Network considerations for Cloud services .. 229 software packages on Linux nodes ...... 256 Cluster node considerations for Cloud services 229 Building the GPFS portability layer on Linux IBM Cloud Object Storage considerations ... 230 nodes ............... 261 Firewall recommendations for Cloud services 232 Manually installing IBM Spectrum Scale and Performance considerations........ 233 deploying protocols on Linux nodes..... 263 Security considerations ......... 237 Verifying the IBM Spectrum Scale installation on Planning for maintenance activities ..... 237 Ubuntu Linux nodes .......... 270 Backup considerations for Transparent cloud Verifying the IBM Spectrum Scale installation on tiering ............... 238 SLES and Red Hat Enterprise Linux nodes .. 270 Quota support for tiering ........ 239 Manually installing IBM Spectrum Scale for | Client-assisted recalls.......... 240 object storage on Red Hat Enterprise Linux 7.x Planning for AFM ............ 240 nodes ............... 271 Requirements for UID and GID on the cache Manually installing IBM Spectrum Scale for and home clusters ........... 240 object storage on Ubuntu 16.04 LTS and 18.04 Recommended workerthreads on cache cluster 240 LTS nodes ............. 272 Inode limits to set at cache and home .... 240 Manually installing the performance monitoring Planning for AFM DR .......... 241 tool................ 273 Requirements for UID/GID on primary and Manually installing IBM Spectrum Scale secondary clusters ........... 241 management GUI ........... 276 Recommended worker1threads on primary Installing IBM Spectrum Scale on Linux nodes with cluster............... 241 the installation toolkit .......... 283 NFS setup on the secondary cluster ..... 241 Overview of the installation toolkit ....