Administrator Manual Revision: 58F161e
Total Page:16
File Type:pdf, Size:1020Kb
Bright Cluster Manager 8.1 Administrator Manual Revision: 58f161e Date: Wed Sep 29 2021 ©2020 Bright Computing, Inc. All Rights Reserved. This manual or parts thereof may not be reproduced in any form unless permitted by contract or by written permission of Bright Computing, Inc. Trademarks Linux is a registered trademark of Linus Torvalds. PathScale is a registered trademark of Cray, Inc. Red Hat and all Red Hat-based trademarks are trademarks or registered trademarks of Red Hat, Inc. SUSE is a registered trademark of Novell, Inc. PGI is a registered trademark of NVIDIA Corporation. FLEXlm is a registered trademark of Flexera Software, Inc. PBS Professional, PBS Pro, and Green Provisioning are trademarks of Altair Engineering, Inc. All other trademarks are the property of their respective owners. Rights and Restrictions All statements, specifications, recommendations, and technical information contained herein are current or planned as of the date of publication of this document. They are reliable as of the time of this writing and are presented without warranty of any kind, expressed or implied. Bright Computing, Inc. shall not be liable for technical or editorial errors or omissions which may occur in this document. Bright Computing, Inc. shall not be liable for any damages resulting from the use of this document. Limitation of Liability and Damages Pertaining to Bright Computing, Inc. The Bright Cluster Manager product principally consists of free software that is licensed by the Linux authors free of charge. Bright Computing, Inc. shall have no liability nor will Bright Computing, Inc. provide any warranty for the Bright Cluster Manager to the extent that is permitted by law. Unless confirmed in writing, the Linux authors and/or third parties provide the program as is without any warranty, either expressed or implied, including, but not limited to, marketability or suitability for a specific purpose. The user of the Bright Cluster Manager product shall accept the full risk for the qual- ity or performance of the product. Should the product malfunction, the costs for repair, service, or correction will be borne by the user of the Bright Cluster Manager product. No copyright owner or third party who has modified or distributed the program as permitted in this license shall be held liable for damages, including general or specific damages, damages caused by side effects or consequential damages, resulting from the use of the program or the un-usability of the program (including, but not limited to, loss of data, incorrect processing of data, losses that must be borne by you or others, or the inability of the program to work together with any other program), even if a copyright owner or third party had been advised about the possibility of such damages unless such copyright owner or third party has signed a writing to the contrary. Table of Contents Table of Contents . .i 0.1 Quickstart . xv 0.2 About This Manual . xv 0.3 About The Manuals In General . xv 0.4 Getting Administrator-Level Support . xvi 0.5 Getting Professional Services . xvi 1 Introduction 1 1.1 Bright Cluster Manager Functions And Aims . .1 1.2 The Scope Of The Administrator Manual (This Manual) . .1 1.2.1 Installation . .1 1.2.2 Configuration, Management, And Monitoring Via Bright Cluster Manager Tools And Applications . .2 1.3 Outside The Direct Scope Of The Administrator Manual . .2 2 Cluster Management With Bright Cluster Manager 5 2.1 Concepts . .5 2.1.1 Devices . .5 2.1.2 Software Images . .6 2.1.3 Node Categories . .7 2.1.4 Node Groups . .7 2.1.5 Roles . .8 2.2 Modules Environment . .8 2.2.1 Adding And Removing Modules . .8 2.2.2 Using Local And Shared Modules . .9 2.2.3 Setting Up A Default Environment For All Users . .9 2.2.4 Creating A Modules Environment Module . 10 2.2.5 Lua Modules Environment (LMod) . 10 2.3 Authentication . 11 2.3.1 Changing Administrative Passwords On The Cluster . 11 2.3.2 Logins Using ssh ...................................... 12 2.3.3 Certificates . 13 2.3.4 Profiles . 13 2.4 Bright View GUI . 14 2.4.1 Installing The Cluster Management GUI Service . 14 2.4.2 Navigating The Cluster With Bright View . 15 2.5 Cluster Management Shell . 18 2.5.1 Invoking cmsh ....................................... 18 2.5.2 Levels, Modes, Help, And Commands Syntax In cmsh ................ 20 2.5.3 Working With Objects . 24 2.5.4 Accessing Cluster Settings . 32 ii Table of Contents 2.5.5 Advanced cmsh Features . 33 2.6 Cluster Management Daemon . 40 2.6.1 Controlling The Cluster Management Daemon . 40 2.6.2 Configuring The Cluster Management Daemon . 42 2.6.3 Configuring The Cluster Management Daemon Logging Facilities . 42 2.6.4 Configuration File Modification, And The FrozenFile Directive . 43 2.6.5 Configuration File Conflicts Between The Standard Distribution And Bright Clus- ter Manager For Generated And Non-Generated Files . 43 2.6.6 CMDaemon Lite . 44 3 Configuring The Cluster 45 3.1 Main Cluster Configuration Settings . 46 3.1.1 Cluster Configuration: Various Name-Related Settings . 46 3.1.2 Cluster Configuration: Some Network-Related Settings . 47 3.1.3 Miscellaneous Settings . 48 3.1.4 Limiting The Maximum Number Of Open Files . 50 3.2 Network Settings . 51 3.2.1 Configuring Networks . 52 3.2.2 Adding Networks . 55 3.2.3 Changing Network Parameters . 55 3.3 Configuring Bridge Interfaces . 66 3.4 Configuring VLAN interfaces . 68 3.4.1 Configuring A VLAN Interface Using cmsh ...................... 68 3.4.2 Configuring A VLAN Interface Using Bright View . 68 3.5 Configuring Bonded Interfaces . 69 3.5.1 Adding A Bonded Interface . 69 3.5.2 Single Bonded Interface On A Regular Node . 70 3.5.3 Multiple Bonded Interface On A Regular Node . 70 3.5.4 Bonded Interfaces On Head Nodes And HA Head Nodes . 70 3.5.5 Tagged VLAN On Top Of a Bonded Interface . 71 3.5.6 Further Notes On Bonding . 71 3.6 Configuring InfiniBand And Omni-Path Interfaces . 71 3.6.1 Installing Software Packages . 72 3.6.2 Subnet Managers . 72 3.6.3 InfiniBand Network Settings . 73 3.6.4 Verifying Connectivity . 74 3.7 Configuring BMC (IPMI/iLO/DRAC) Interfaces . 75 3.7.1 BMC Network Settings . 75 3.7.2 BMC Authentication . 77 3.7.3 Interfaces Settings . 77 3.7.4 Identification With A BMC . 78 3.8 Configuring Switches And PDUs . 79 3.8.1 Configuring With The Manufacturer’s Configuration Interface . 79 3.8.2 Configuring SNMP . 79 3.8.3 Uplink Ports . 79 3.8.4 The showport MAC Address to Port Matching Tool . 80 3.8.5 Disabling Port Detection . 81 Table of Contents iii 3.8.6 The switchoverview Command . 81 3.9 Disk Layouts: Disked, Semi-Diskless, And Diskless Node Configuration . 82 3.9.1 Disk Layouts . 82 3.9.2 Disk Layout Assertions . 82 3.9.3 Changing Disk Layouts . 83 3.9.4 Changing A Disk Layout From Disked To Diskless . 83 3.10 Configuring NFS Volume Exports And Mounts . 84 3.10.1 Exporting A Filesystem Using Bright View And cmsh ................. 85 3.10.2 Mounting A Filesystem Using Bright View And cmsh ................. 87 3.10.3 Mounting A Filesystem Subtree For A Diskless Node Over NFS . 90 3.10.4 Mounting The Root Filesystem For A Diskless Node Over NFS . ..