Sonexion™ 2000 Administration Guide (2.0.0) S-2537 Rev C Contents Contents 1 About the Sonexion™ 2000 Administration Guide.................................................................................................. 5 2 Hardware Architecture............................................................................................................................................ 7 3 Software Architecture........................................................................................................................................... 10 4 What Is and Is Not Supported in Sonexion 2.0.0..................................................................................................12 5 Log In to CSM.......................................................................................................................................................14 6 SSA.......................................................................................................................................................................16 6.1 SSA Introduction......................................................................................................................................16 6.2 Configure SSA for Sonexion....................................................................................................................16 6.2.1 SSA Prerequisites...................................................................................................................... 17 6.2.2 Install the Sonexion SSA RPM Packages.................................................................................. 17 6.3 Sonexion InfiniBand Fabric Plugins.........................................................................................................23 7 Configure LNet Fine-Grained Routing for XC Systems........................................................................................ 25 7.1 Routing and Bandwidth Matching for Sonexion Systems........................................................................28 7.2 External Server Node: Sonexion 3000 or ClusterStor L300 System Recommended Parameters.......... 30 7.3 Use CLCVT to Configure Fine-Grained Routing Files.............................................................................32 7.3.1 CLCVT Prerequisite Files...........................................................................................................32 7.3.2 Create the CLCVT info.file-system-identifier File....................................................................... 33 7.3.3 Create the CLCVT client-system.hosts File............................................................................... 36 7.3.4 Create the CLCVT client-system.ib File..................................................................................... 36 7.3.5 Create the CLCVT cluster-name.ib File..................................................................................... 37 7.3.6 Create the CLCVT client-system.rtrIm File.................................................................................38 7.3.7 Generate ip2nets and Routes Information................................................................................. 39 7.4 Place the LNet Configuration on a CLE6 System....................................................................................42 7.4.1 Copy Files for External Lustre Fine-grained Routing................................................................. 42 7.4.2 Configure LNet Routers for Fine-Grained Routing..................................................................... 43 7.5 Create Custom LNet Configuration for Sonexion.................................................................................... 45 8 Change Network Settings..................................................................................................................................... 48 8.1 Create Custom LNet Configuration for Sonexion.................................................................................... 48 8.2 Change DNS Resolver Configuration......................................................................................................50 8.3 Change Externally Facing IP Addresses................................................................................................. 50 8.4 Configure LDAP over TLS in Daily Mode................................................................................................ 51 8.5 Change LDAP Settings in Daily Mode.....................................................................................................53 8.6 Configure NIS Support in Daily Mode......................................................................................................55 8.7 Change NIS Settings in Daily Mode........................................................................................................ 56 9 Change the NTP Configuration.............................................................................................................................58 2 Contents 10 Check File Systems Using e2fsck Command.................................................................................................. 59 11 Disk Watching Daemon...................................................................................................................................... 61 12 Distributed Namespace (DNE) Feature.............................................................................................................. 64 13 Support Bundles................................................................................................................................................. 67 13.1 Collect Support Files Manually.............................................................................................................. 68 13.2 Create Support Bundles Using CLI....................................................................................................... 69 13.3 Import a Support File............................................................................................................................. 70 13.4 Download a Support File....................................................................................................................... 71 13.5 Delete a Support File.............................................................................................................................71 13.6 View Support Files.................................................................................................................................72 13.7 Interpret Support Bundles......................................................................................................................73 14 Troubleshooting Overview.................................................................................................................................. 75 14.1 Management Node Shutdown Corrupts Database................................................................................75 14.2 Invalid Puppet Certificate on Diskless Node Boot-up............................................................................ 77 14.3 Upgrade Error "Metadata File does not Match Checksum"...................................................................79 14.4 Capture Dumps for Mellanox Host Adaptors and Switches...................................................................79 14.5 Reseat a Problematic High-Speed Network Cable ...............................................................................80 14.6 RAIDs Assembled Incorrectly on Nodes............................................................................................... 82 14.6.1 Prepare to Recover a Failed RAID Array................................................................................. 83 14.6.2 Recover a Failed RAID Array................................................................................................... 85 14.7 Non-Responsive Server........................................................................................................................ 89 14.8 conman to GEM Causes "Port In Use" Message.................................................................................. 89 14.9 HA Failover on xyvinc Malfunction........................................................................................................ 90 14.10 Performance Tab Appears Blank.........................................................................................................92 14.11 Isolate a Slow Disk.............................................................................................................................. 93 14.12 Warning After cscli unmount: "Database assertion: created a new connection but..."........................ 94 15 CSCLI Introduction............................................................................................................................................. 96 15.1 CSCLI Command Summary.................................................................................................................. 98 15.2 Administrative Commands...................................................................................................................101 15.3 Administrative Settings Commands.....................................................................................................104 15.4 alerts Display Command................................................................................................................. 107 15.5 alerts_config Command..............................................................................................................110