CXFSTM Administration Guide for SGI® Infinitestorage
Total Page:16
File Type:pdf, Size:1020Kb
CXFSTM Administration Guide for SGI® InfiniteStorage 007–4016–020 CONTRIBUTORS Written by Lori Johnson Illustrated by Chrystie Danzer Production by Karen Jacobson Engineering contributions to the book by Rich Altmaier, Neil Bannister, François Barbou des Places, Ken Beck, Felix Blyakher, Laurie Costello, Mark Cruciani, Dave Ellis, Brian Gaffey, Philippe Gregoire, Dean Jansa, Erik Jacobson, Dennis Kender, Chris Kirby, Ted Kline, Dan Knappe, Kent Koeninger, Linda Lait, Bob LaPreze, Steve Lord, Aaron Mantel, Troy McCorkell, LaNet Merrill, Terry Merth, Nate Pearlstein, Bryce Petty, Alain Renaud, John Relph, Elaine Robinson, Dean Roehrich, Eric Sandeen, Wesley Smith, Kerm Steffenhagen, Paddy Sreenivasan, Andy Tran, Rebecca Underwood, Connie Waring, Geoffrey Wehrman COPYRIGHT © 1999–2004 Silicon Graphics, Inc. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of Silicon Graphics, Inc. LIMITED RIGHTS LEGEND The electronic (software) version of this document was developed at private expense; if acquired under an agreement with the USA government or any contractor thereto, it is acquired as "commercial computer software" subject to the provisions of its applicable license agreement, as specified in (a) 48 CFR 12.212 of the FAR; or, if acquired for Department of Defense units, (b) 48 CFR 227-7202 of the DoD FAR Supplement; or sections succeeding thereto. Contractor/manufacturer is Silicon Graphics, Inc., 1500 Crittenden Lane, Mountain View, CA 94043-1351. TRADEMARKS AND ATTRIBUTIONS Silicon Graphics, SGI, the SGI logo, Altix, IRIS, IRIX, O2, Octane, Onyx, Onyx2, Origin, and XFS are registered trademarks and CXFS, FailSafe, IRISconsole, IRIS FailSafe, FDDIXPress, NUMAlink, Octane2, Performance Co-Pilot, Silicon Graphics Fuel, SGI FailSafe, Tezro, and Trusted IRIX are trademarks of Silicon Graphics, Inc., in the United States and/or other countries worldwide. AIX is a registered trademark of IBM Corporation. Brocade is a trademark of Brocade Communication Systems, Inc. Inc. Digi is a trademark of Digi International, Inc. FLEXlm is a trademark of Macrovision Corporation. Java and Sun are registered trademarks and Solaris is a trademark of Sun Microsystems, Inc. HP-UX is a registered trademark of Hewlett-Packard Company. Linux is a registered trademark of Linus Torvalds, used with permission by Silicon Graphics, Inc. Legato NetWorker is a registered trademark of Legato Systems, Inc. Mac OS is a registered trademark of Apple Computer, Inc. Netscape is a trademark of Netscape Communications Corporation. Red Hat is a registered trademark and RPM is a trademark of Red Hat, Inc. UNIX is a registered trademark of The Open Group in the United States and other countries. VERITAS is a trademark of VERITAS Software Corporation. Windows and Windows NT are registered trademarks of Microsoft Corporation. X/Open is a registered trademark of X/Open Company Ltd. New Features in This Guide This update contains the following: • Support for client-only nodes running the Mac OS X operating system in the configuration tools. See "Define a Node with the GUI" on page 154 and "Define a Node with cmgr" on page 202. For more information, see CXFS MultiOS Client-Only Guide for SGI InfiniteStorage. • Information about console redirection. See "Redirecting the Console for Origin 300, Origin 3200C, Onyx 300, and Onyx 3200C" on page 293. • Information about the SGI TP9300, SGI TP9300S, and SGI TP9500S. See Chapter 2, "SGI RAID Firmware" on page 47. • "Hardware Changes and I/O Fencing" on page 294. • Updated example in Chapter 17, "Migration from an IRIX Cluster to a Linux 64–bit Cluster" on page 331. • Removal of the unimplemented GUI feature to define CXFS kernel messaging networks. See "Define a Node with the GUI" on page 154, "Examples of Defining a Node with the GUI" on page 160, and "Modify a Node Definition with the GUI" on page 163. 007–4016–020 iii Record of Revision Version Description 001 September 1999 Supports the CXFS 1.1 product in the IRIX 6.5.6f release. 002 October 1999 Supports the CXFS 1.1 product in the IRIX 6.5.6f release. 003 December 1999 Supports the CXFS product in the IRIX 6.5.7f release. 004 March 2000 Supports the CXFS product in the IRIX 6.5.8f release. 005 June 2000 Supports the CXFS product in the IRIX 6.5.9f release. 006 September 2000 Supports the CXFS product in the IRIX 6.5.10f release. 007 January 2001 Supports the CXFS product in the IRIX 6.5.11f release. 008 March 2001 Supports the CXFS product in the IRIX 6.5.12f release. 009 June 2001 Supports the CXFS product in the IRIX 6.5.13f release. 011 September 2001 Supports the CXFS product in the IRIX 6.5.14f release. (Note, there was no 010 version due to an internal numbering mechanism.) 012 December 2001 Supports the CXFS Version 2 product in IRIX 6.5.15f. 013 March 2002 Supports the CXFS Version 2 product in IRIX 6.5.16f. 007–4016–020 v Record of Revision 014 June 2002 Supports the CXFS Version 2 product in IRIX 6.5.17f. 015 September 2002 Supports the CXFS Version 2 product in IRIX 6.5.18f. 016 December 2002 Supports the CXFS Version 2 product in IRIX 6.5.19f. 017 March 2003 Supports the CXFS Version 2 product in IRIX 6.5.20f. 018 September 2003 Supports the CXFS 3.0 product in IRIX 6.5.22 and CXFS 3.0 for SGI Altix 3000 running SGI ProPack 2.3 for Linux. 019 December 2003 Supports the CXFS 3.1 product in IRIX 6.5.23 and CXFS 3.1 for SGI Altix 3000 running SGI ProPack 2.4 for Linux. 020 March 2004 Supports the CXFS 3.2 product in IRIX 6.5.24 and CXFS 3.2 for SGI Altix 3000 running SGI ProPack 3.0 for Linux. vi 007–4016–020 Contents About This Guide .....................xxxi Related Publications . ...................xxxi Obtaining Publications . ...................xxxiii Conventions . ........................xxxiii Reader Comments .......................xxxiv 1. Introduction to CXFS . ................. 1 What is CXFS? ........................ 1 Comparison of XFS and CXFS ................... 2 Supported XFS Features . ................... 3 When to Use CXFS . ................... 4 Performance Considerations ................... 5 Comparison of Network and CXFS Filesystems .............. 6 Network Filesystems . ................... 6 CXFS Filesystems . ................... 6 Features ........................ 7 Restrictions ....................... 8 Cluster Environment . ................... 8 Terminology ........................ 9 Cluster . ........................ 9 Node . ........................ 9 Pool . ........................ 9 Cluster Database . ................... 10 Node Functions . ................... 11 Membership ....................... 18 007–4016–020 vii Contents Private Network . ................... 18 Relocation ........................ 19 Recovery ........................ 20 CXFS Tiebreaker . ................... 22 Isolating Failed Nodes . ................... 23 I/O Fencing ....................... 24 Reset . ........................ 28 The Cluster Database and CXFS Clients . .............. 31 Metadata Server Functions . ................... 31 System View ........................ 33 Hardware and Software Support ................... 33 Requirements ........................ 33 Requirements Specific to IRIX .................. 36 Requirements Specific to Linux 64-bit . .............. 36 Compatibility ........................ 37 Recommendations . ................... 37 Overview of FailSafe Coexecution .................. 38 Cluster Manager Tools Overview .................. 40 Overview of the Installation and Configuration Steps . ......... 41 CXFS Packages Installed . ................... 41 Client-Only Packages Installed .................. 42 Administration Packages Installed . .............. 42 CXFS Commands Installed ................... 42 Client-Only Commands Installed . .............. 43 Administration Commands Installed . .............. 43 IRIX Overview ....................... 43 Linux 64-bit on SGI Altix Overview . .............. 45 viii 007–4016–020 CXFSTM Administration Guide for SGI® InfiniteStorage 2. SGI RAID Firmware . ................. 47 Supported SGI RAID Hardware ................... 47 Required SGI RAID Firmware ................... 48 Required SGI TP9500S RAID Firmware . .............. 48 Required SGI TP9500 RAID Firmware . .............. 48 Required SGI TP9400 RAID Firmware . .............. 48 Required SGI TP9300S RAID Firmware . .............. 49 Required SGI TP9300 RAID Firmware . .............. 49 Required SGI TP9100 RAID Firmware . .............. 49 RAID Firmware Verification . ................... 49 3. Brocade Fibre Channel Switch Verification . .......... 51 Required Brocade Fibre Channel Switch Firmware and License ......... 51 Verifying the Brocade License ................... 52 Verifying the Brocade Switch Firmware Version .............. 52 Configuring the Brocade Silkworm 3900 . .............. 53 Configuring the Brocade Silkworm 12000 . .............. 54 Changing the Brocade FC Cable Connections . .............. 54 4. Obtaining CXFS and XVM FLEXlm Licenses .......... 57 Obtaining the Host Information Required for the License . ......... 57 IRIX Host Information . ................... 57 Linux 64-bit Host Information .................. 58 Obtaining and Installing the Licenses . .............. 59 License Verification ....................... 59 For More Information . ................... 59 5. Preinstallation Steps . ................