XC™ Series Software Installation and Configuration Guide (CLE 6.0.UP04) S-2559 Rev B Contents Contents 1 About XC™ Series Software Installation and Configuration Guide S-2559............................................................7 1.1 Related Publications................................................................................................................................11 1.2 Distribution Media....................................................................................................................................12 2 Introduction to Installation and Configuration of Cray XC™ Software..................................................................14 2.1 About Cray Scalable Services.................................................................................................................15 2.2 About Config Sets....................................................................................................................................16 2.3 About Variable Names in the Configurator and Configuration Worksheets.............................................18 2.4 About Snapshots and Config Set Backups..............................................................................................18 2.5 About Config Set Caching.......................................................................................................................20 2.6 About Node Groups.................................................................................................................................20 2.7 About Simple Sync..................................................................................................................................23 2.8 About Secure Shell Configuration...........................................................................................................27 2.9 About Boot Automation Files...................................................................................................................30 2.10 About the Admin Image.........................................................................................................................31 3 Install and Configure SMW/CLE Software............................................................................................................32 3.1 Prepare for an SMW/CLE Fresh Install...................................................................................................32 3.1.1 Information to Collect Before Installation....................................................................................33 3.1.2 Network Connections.................................................................................................................35 3.1.3 SMW Internal Disk Requirements..............................................................................................35 3.1.4 Configuration Values..................................................................................................................36 3.1.5 Passwords..................................................................................................................................37 3.2 Install the Base Operating System on the SMW.....................................................................................37 3.2.1 Prepare to Install the Base Linux Distribution............................................................................38 3.2.2 Install the SLES 12 SP2 Base Linux Distribution on the SMW..................................................61 3.2.3 Configure Boot RAID Devices....................................................................................................66 3.2.4 Make a Snapshot Manually........................................................................................................86 3.3 Install the SMW and CLE Software.........................................................................................................87 3.3.1 Start a Typescript File.................................................................................................................87 3.3.2 Prepare to Bootstrap the SMW Installation................................................................................88 3.3.3 Determine the Persistent Device Name for a LUN.....................................................................90 3.3.4 RAID Disk Space Requirements................................................................................................93 3.3.5 Bootstrap the SMW Installation..................................................................................................95 3.3.6 Provision SMW Storage...........................................................................................................102 3.3.7 Run the Installer for an Initial Installation.................................................................................103 3.3.8 Set Default Snapshot and Boot the SMW................................................................................104 S2559 2 Contents 3.4 Configure SMW for CLE System Hardware during a Fresh Install........................................................105 3.4.1 Set or Change the HSS Data Store (MariaDB) Root Password...............................................106 3.4.2 Start a Typescript File...............................................................................................................107 3.4.3 Make a Post-install Snapshot using snaputil............................................................................108 3.4.4 Update install.cle.conf for Software Updates...........................................................................108 3.4.5 Prepare and Update the Global Config Set..............................................................................109 3.4.6 Prepare the CLE Configuration Worksheets............................................................................116 3.4.7 Bootstrap Hardware Discovery.................................................................................................117 3.4.8 Discover Hardware and HSN Routing, Prepare STONITH .....................................................120 3.4.9 Update Firmware......................................................................................................................121 3.4.10 (Optional) Configure Partitions...............................................................................................123 3.4.11 Repurpose Compute Nodes...................................................................................................124 3.4.12 Finish Configuring the SMW for the CLE System Hardware..................................................124 3.5 Configure CLE.......................................................................................................................................125 3.5.1 Update CLE Configuration Worksheets....................................................................................126 3.5.2 Create New CLE Config Set from Worksheets.........................................................................191 3.5.3 Update CLE Config Set after a Fresh Install............................................................................192 3.5.4 Check CLE Hostnames in /etc/hosts File.................................................................................194 3.5.5 Update /etc/motd for Nodes.....................................................................................................195 3.5.6 Copy Files for External Lustre Fine-grained Routing...............................................................195 3.5.7 Configure Files for Cray Simple Sync Service.........................................................................196 3.5.8 Display and Capture all Config Set Information.......................................................................197 3.5.9 Validate Config Sets.................................................................................................................197 3.5.10 Make a Post-config Snapshot using snaputil.........................................................................198 3.5.11 Make a Post-config Backup of Current Global and CLE Config Sets.....................................199 3.6 Prepare Boot Images and Boot the CLE System during a Fresh Install................................................199 3.6.1 Where to Place the Root File System—tmpfs versus netroot..................................................200 3.6.2 Create a NIMS Map..................................................................................................................201 3.6.3 About Image Groups and How to Customize Them.................................................................202 3.6.4 Build Boot Images for a Fresh Install.......................................................................................204 3.6.5 Set the Turbo Boost Limit.........................................................................................................208 3.6.6 Check NIMS Information during a Fresh Install........................................................................208 3.6.7 Boot the System using a Boot Automation File........................................................................209 3.6.8 Run Tests after Boot is Complete.............................................................................................211 3.6.9 Prepare Site and Software Revision Information Reporting using xtgetrev and xtshowrev.....213 3.6.10 Test xtdumpsys and cdump....................................................................................................214