HP XC System Software XC User Guide Version 4.0 HP Part Number: A-XCUSR-40a Published: February 2009 © Copyright 2003, 2005, 2006, 2007, 2008, 2009 Hewlett-Packard Development Company, L.P. Confidential computer software. Valid license from HP required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor's standard commercial license. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. AMD and AMD Opteron are trademarks or registered trademarks of Advanced Micro Devices, Inc. Intel , the Intel logo, Itanium , and Xeon are trademarks or registered trademarks of Intel Corporation in the United States and other countries. Linux is a U.S. registered trademark of Linus Torvalds. LSF, Platform Computing, and the LSF and Platform Computing logos are trademarks or registered trademarks of Platform Computing, Inc. Lustre is a trademark of Cluster File Systems, Inc. Myrinet and Myricom are registered trademarks of Myricom, Inc. Quadrics and QSNet II are registered trademarks of Quadrics, Ltd. The Portland Group and PGI are trademarks or registered trademarks of The Portland Group Compiler Technology, STMicroelectronics, Inc. Red Hat is a registered trademark of Red Hat Inc. syslog-ng is a copyright of BalaBit IT Security. SystemImager is a registered trademark of Brian Finley. TotalView is a registered trademark of Etnus, Inc. UNIX is a registered trademark of The Open Group. Table of Contents About This Document.......................................................................................................11 Intended Audience................................................................................................................................11 New and Changed Information in This Edition...................................................................................11 Typographic Conventions.....................................................................................................................11 HP XC and Related HP Products Information.....................................................................................12 Related Information..............................................................................................................................13 Manpages..............................................................................................................................................16 HP Encourages Your Comments..........................................................................................................17 1 Overview of the User Environment.............................................................................19 1.1 System Architecture........................................................................................................................19 1.1.1 HP XC System Software..........................................................................................................19 1.1.2 Operating System....................................................................................................................19 1.1.3 Node Platforms.......................................................................................................................19 1.1.4 Node Specialization.................................................................................................................20 1.1.5 Storage and I/O........................................................................................................................21 1.1.6 File System...............................................................................................................................21 1.1.7 System Interconnect Network.................................................................................................22 1.1.8 Network Address Translation (NAT)......................................................................................23 1.2 Determining System Configuration Information............................................................................23 1.3 User Environment...........................................................................................................................23 1.3.1 LVS...........................................................................................................................................23 1.3.2 Modules...................................................................................................................................23 1.3.3 Commands..............................................................................................................................24 1.4 Application Development Environment.........................................................................................24 1.4.1 Parallel Applications...............................................................................................................24 1.4.2 Serial Applications..................................................................................................................25 1.5 Run-Time Environment...................................................................................................................25 1.5.1 SLURM....................................................................................................................................25 1.5.2 Load Sharing Facility (LSF).....................................................................................................25 1.5.3 Standard LSF...........................................................................................................................25 1.5.4 How LSF and SLURM Interact................................................................................................26 1.5.5 HP-MPI....................................................................................................................................26 1.6 Components, Tools, Compilers, Libraries, and Debuggers............................................................27 2 Using the System..........................................................................................................29 2.1 Logging In to the System.................................................................................................................29 2.1.1 LVS Login Routing..................................................................................................................29 2.1.2 Using the Secure Shell to Log In.............................................................................................29 2.2 Overview of Launching and Managing Jobs..................................................................................29 2.2.1 Introduction.............................................................................................................................30 2.2.2 Getting Information About Queues........................................................................................30 2.2.3 Getting Information About Resources....................................................................................30 2.2.4 Getting Information About System Partitions........................................................................31 2.2.5 Launching Jobs........................................................................................................................31 2.2.6 Getting Information About Your Jobs.....................................................................................31 2.2.7 Stopping and Suspending Jobs...............................................................................................31 2.2.8 Resuming Suspended Jobs......................................................................................................31 2.3 Performing Other Common User Tasks..........................................................................................31 Table of Contents 3 2.3.1 Determining the LSF Cluster Name and the LSF Execution Host..........................................32 2.4 Getting System Help and Information............................................................................................32 3 Configuring Your Environment with Modulefiles.......................................................33 3.1 Overview of Modules......................................................................................................................33 3.2 Supplied Modulefiles......................................................................................................................34 3.3 Modulefiles Automatically Loaded on the System.........................................................................36 3.4 Viewing Available Modulefiles.......................................................................................................36 3.5 Viewing Loaded Modulefiles..........................................................................................................36 3.6 Loading a Modulefile......................................................................................................................36 3.6.1 Loading a Modulefile for the Current Session........................................................................36