CXFSTM Administration Guide for SGI® Infinitestorage
Total Page:16
File Type:pdf, Size:1020Kb
CXFSTM Administration Guide for SGI® InfiniteStorage 007–4016–025 CONTRIBUTORS Written by Lori Johnson Illustrated by Chrystie Danzer Engineering contributions to the book by Vladmir Apostolov, Rich Altmaier, Neil Bannister, François Barbou des Places, Ken Beck, Felix Blyakher, Laurie Costello, Mark Cruciani, Rupak Das, Alex Elder, Dave Ellis, Brian Gaffey, Philippe Gregoire, Gary Hagensen, Ryan Hankins, George Hyman, Dean Jansa, Erik Jacobson, John Keller, Dennis Kender, Bob Kierski, Chris Kirby, Ted Kline, Dan Knappe, Kent Koeninger, Linda Lait, Bob LaPreze, Jinglei Li, Yingping Lu, Steve Lord, Aaron Mantel, Troy McCorkell, LaNet Merrill, Terry Merth, Jim Nead, Nate Pearlstein, Bryce Petty, Dave Pulido, Alain Renaud, John Relph, Elaine Robinson, Dean Roehrich, Eric Sandeen, Yui Sakazume, Wesley Smith, Kerm Steffenhagen, Paddy Sreenivasan, Roger Strassburg, Andy Tran, Rebecca Underwood, Connie Woodward, Michelle Webster, Geoffrey Wehrman, Sammy Wilborn COPYRIGHT © 1999–2007 SGI. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of SGI. LIMITED RIGHTS LEGEND The software described in this document is "commercial computer software" provided with restricted rights (except as to included open/free source) as specified in the FAR 52.227-19 and/or the DFAR 227.7202, or successive sections. Use beyond license provisions is a violation of worldwide intellectual property laws, treaties and conventions. This document is provided with limited rights as defined in 52.227-14. TRADEMARKS AND ATTRIBUTIONS SGI, Altix, the SGI cube and the SGI logo are registered trademarks IRIS, IRIX, O2, Octane, Onyx, Onyx2, Origin, Silicon Graphics Prism, Silicon Graphics Tezro, and XFS are registered trademarks and CXFS, FailSafe, IRIS FailSafe, FDDIXPress, NUMAlink, Octane2, Performance Co-Pilot, Silicon Graphics Fuel, SGI FailSafe, SGI ProPack, and Trusted IRIX are trademarks of SGI in the United States and/or other countries worldwide. AIX is a registered trademark of IBM Corporation. Brocade is a trademark of Brocade Communication Systems, Inc. Inc. Digi is a trademark of Digi International, Inc. FLEXlm is a trademark of Macrovision Corporation. Java and Sun are registered trademarks and Solaris is a trademark of Sun Microsystems, Inc. HP-UX is a registered trademark of Hewlett-Packard Company. Linux is a registered trademark of Linus Torvalds in several countries. Legato NetWorker is a registered trademark of Legato Systems, Inc. Mac OS is a registered trademark of Apple Computer, Inc. Netscape is a trademark of Netscape Communications Corporation. QLogic is a registered trademark of QLogic Corporation. Red Hat is a registered trademark and RPM is a trademark of Red Hat, Inc. UNIX is a registered trademark of The Open Group in the United States and other countries. VERITAS is a trademark of VERITAS Software Corporation. Windows and Windows NT are registered trademarks of Microsoft Corporation. X/Open is a registered trademark of X/Open Company Ltd. All other trademarks mentioned herein are the property of their respective owners. New Features in This Guide Note: Be sure to read the release notes for your platforms to learn about any late-breaking changes to the installation and configuration procedures. This version include the following: • Support for SGI IRIX 6.5.30. • Support for SGI ProPack 5 running SUSE Linux Enterprise Server 10 (SLES 10). • Support for SGI License Key (LK) software on SGI ProPack server-capable nodes. Server-side licensing is required on the following client-only nodes (to determine the Linux architecture type, use the uname -i command): – SGI ProPack 5 – Red Hat Enterprise Linux (RHEL) 4 on x86_64 – SLES 9 on x86_64 – SLES 10 on x86_64 or ia64 Note: For specific release levels, see the release notes. Other client-only nodes can use either server-side or client-side licensing. However, if one node within a cluster requires server-side licensing, all nodes must use server-side licensing. If no nodes in the cluster require server-side licensing, the nodes can continue to use existing client-side licensing. See the general release notes and Chapter 4, "CXFS License Keys" on page 69. Note: Server-side licensing is preferred, and no new client-side licenses will be issued. Customers with support contracts can exchange their existing client-side licenses for new server-side licenses. A future release will not support client-side licensing. For more information, contact SGI customer support. 007–4016–025 iii New Features in This Guide • Support for the following RAID hardware: SGI InfiniteStorage 10000 SGI InfiniteStorage 6700 SGI InfiniteStorage 4500 SGI InfiniteStorage 4000 See "RAID Hardware" on page 59. • DMAPI is disabled by default on SGI ProPack 5 systems. When you install DMF on a server-capable node, it automatically enables DMAPI. However, if you want to mount filesystems on an SGI ProPack 5 client-only node with the dmi mount option, you must enable DMAPI. See "SGI ProPack Limitations and Considerations" on page 110. • "Use the Appropriate Version of lcrash for SGI ProPack" on page 153. • "Upgrading From 3.4.1 Or Earlier" on page 381 discusses the procedure required for clusters with three or more server capable nodes. • "Removing a Metadata Server from the Cluster" on page 440 includes information about avoiding a reset. • New mtcp_rpc_thread system tunable parameter (for SGI ProPack and Linux third-party nodes) that specifies whether metadata messages are sent from a separate thread in order to save stack space. See "Site-Changeable Static Parameters" on page 414. • "Rotating Log Files on SGI ProPack" on page 406. •"SYSLOG credid Warnings" on page 551. • The table of mount options is now located in the CXFS MultiOS Client-Only Guide for SGI InfiniteStorage. iv 007–4016–025 Record of Revision Version Description 001 September 1999 Supports the CXFS 1.1 product in the IRIX 6.5.6f release. 002 October 1999 Supports the CXFS 1.1 product in the IRIX 6.5.6f release. 003 December 1999 Supports the CXFS product in the IRIX 6.5.7f release. 004 March 2000 Supports the CXFS product in the IRIX 6.5.8f release. 005 June 2000 Supports the CXFS product in the IRIX 6.5.9f release. 006 September 2000 Supports the CXFS product in the IRIX 6.5.10f release. 007 January 2001 Supports the CXFS product in the IRIX 6.5.11f release. 008 March 2001 Supports the CXFS product in the IRIX 6.5.12f release. 009 June 2001 Supports the CXFS product in the IRIX 6.5.13f release. 011 September 2001 Supports the CXFS product in the IRIX 6.5.14f release. (Note, there was no 010 version due to an internal numbering mechanism.) 012 December 2001 Supports the CXFS Version 2 product in IRIX 6.5.15f. 013 March 2002 Supports the CXFS Version 2 product in IRIX 6.5.16f. 007–4016–025 v Record of Revision 014 June 2002 Supports the CXFS Version 2 product in IRIX 6.5.17f. 015 September 2002 Supports the CXFS Version 2 product in IRIX 6.5.18f. 016 December 2002 Supports the CXFS Version 2 product in IRIX 6.5.19f. 017 March 2003 Supports the CXFS Version 2 product in IRIX 6.5.20f. 018 September 2003 Supports the CXFS 3.0 product in IRIX 6.5.22 and CXFS 3.0 for SGI Altix 3000 running SGI ProPack 2.3 for Linux. 019 December 2003 Supports the CXFS 3.1 product in IRIX 6.5.23 and CXFS 3.1 for SGI Altix 3000 running SGI ProPack 2.4 for Linux. 020 March 2004 Supports the CXFS 3.2 product in IRIX 6.5.24 and CXFS 3.2 for SGI Altix 3000 running SGI ProPack 3 for Linux. 021 November 2004 Supports the CXFS 3.2 product in IRIX 6.5.24 and CXFS 3.2 for SGI Altix 3000 running SGI ProPack 3 for Linux. 022 April 2005 Supports the CXFS 3.3 product 023 July 2005 Supports the CXFS 3.4 product 024 May 2006 Supports the CXFS 4.0 product 025 January 2007 Supports the CXFS 4.1 product vi 007–4016–025 Contents About This Guide .....................xxxix Related Publications . ...................xxxix Obtaining Publications . ...................xliii Conventions . ........................xliii Reader Comments .......................xliv 1. Introduction to CXFS . ................. 1 What is CXFS? ........................ 2 Comparison of XFS and CXFS ................... 3 Supported XFS Features . ................... 4 When to Use CXFS . ................... 5 Performance Considerations ................... 6 Comparison of Network and CXFS Filesystems .............. 7 Network Filesystems . ................... 7 CXFS Filesystems . ................... 8 Features ........................ 8 Restrictions ....................... 9 Cluster Environment . ................... 9 Terminology ........................ 10 Cluster . ........................ 10 Node . ........................ 10 Pool . ........................ 11 Cluster Database . ................... 12 Node Functions . ................... 12 Membership ....................... 19 007–4016–025 vii Contents Private Network . ................... 19 Relocation ........................ 20 Recovery ........................ 22 CXFS Tiebreaker . ................... 23 Cluster Administration Daemons . .............. 24 CXFS Services ....................... 25 CXFS Control Daemon . ................... 26 CXFS Client Daemon . ................... 26 Forced CXFS Shutdown . ................... 27 Heartbeat Monitoring . ................... 27 Isolating Failed Nodes: Failure Policies . .............. 28 Fence . .......................