VSC HPC Tutorial for University of Antwerp Mac Users
Total Page：16
File Type：pdf, Size：1020Kb
VLAAMS SUPERCOMPUTER Innovative Computing CENTRUM for A Smarter Flanders HPC Tutorial Last updated: September 29 2021 For Mac Users Authors: Franky Backeljauw5, Stefan Becuwe5, Geert Jan Bex3, Geert Borstlap5, Jasper Devreker2, Stijn De Weirdt2, Andy Georges2, Balázs Hajgató1,2, Kenneth Hoste2, Kurt Lust5, Samuel Moors1, Ward Poelmans1, Mag Selwa4, Álvaro Simón García2, Bert Tijskens5, Jens Timmerman2, Kenneth Waegeman2, Toon Willems2 Acknowledgement: VSCentrum.be 1Free University of Brussels 2Ghent University 3Hasselt University 4KU Leuven 5University of Antwerp 1 Audience: This HPC Tutorial is designed for researchers at the University of Antwerp and affiliated institutes who are in need of computational power (computer resources) and wish to explore and use the High Performance Computing (HPC) core facilities of the Flemish Supercomputing Centre (VSC) to execute their computationally intensive tasks. The audience may be completely unaware of the UAntwerpen-HPC concepts but must have some basic understanding of computers and computer programming. Contents: This Beginners Part of this tutorial gives answers to the typical questions that a new UAntwerpen- HPC user has. The aim is to learn how to make use of the HPC. Beginners Part Questions chapter title What is a UAntwerpen-HPC exactly? 1 Introduction to HPC Can it solve my computational needs? How to get an account? 2 Getting an HPC Account How do I connect to the UAntwerpen- 3 Connecting to the HPC infrastructure HPC and transfer my files and pro- grams? How to start background jobs? 4 Running batch jobs How to start jobs with user interaction? 5 Running interactive jobs Where do the input and output go? 6 Running jobs with input/output data Where to collect my results? Can I speed up my program by explor- 7 Multi core jobs/Parallel Computing ing parallel programming techniques? Troubleshooting 8 Troubleshooting What are the rules and priorities of 9 HPC Policies jobs? FAQ 10 Frequently Asked Questions The Advanced Part focuses on in-depth issues. The aim is to assist the end-users in running their own software on the UAntwerpen-HPC. Advanced Part Questions chapter title What are the optimal Job Specifica- 11 Fine-tuning Job Specifications tions? Can I start many jobs at once? 12 Multi-job submission Can I compile my software on the 13 Compiling and testing your software on UAntwerpen-HPC? the HPC Do you have more program examples for 14 Program examples me? Do you have more job script examples 15 Job script examples for me? Any more advice? 16 Best Practices The Annexes contains some useful reference guides. 2 Annex Title chapter HPC Quick Reference Guide A TORQUE options B Useful Linux Commands C Notification: In this tutorial specific commands are separated from the accompanying text: $ commands These should be entered by the reader at a command line in a terminal on the UAntwerpen-HPC. They appear in all exercises preceded by a $ and printed in bold. You’ll find those actions ina grey frame. Button are menus, buttons or drop down boxes to be pressed or selected. “Directory” is the notation for directories (called “folders” in Windows terminology) or specific files. (e.g., “/user/antwerpen/201/vsc20167”) “Text” Is the notation for text to be entered. Tip: A “Tip” paragraph is used for remarks or tips. More support: Before starting the course, the example programs and configuration files used in this Tutorial must be copied to your home directory, so that you can work with your personal copy. If you have received a new VSC-account, all examples are present in an “/apps/antwerpen/tutorials/Intro- HPC/examples” directory. $ cp -r /apps/antwerpen/tutorials/Intro-HPC/examples ∼/ $ cd $ ls They can also be downloaded from the VSC website at https://www.vscentrum.be. Apart from this UAntwerpen-HPC Tutorial, the documentation on the VSC website will serve as a reference for all the operations. Tip: The users are advised to get self-organised. There are only limited resources available at the UAntwerpen-HPC staff, which are best effort based. The UAntwerpen-HPC staff cannot give support for code fixing. The user applications and own developed software remain solely the responsibility of the end-user. More documentation can be found at: 1. VSC documentation: https://www.vscentrum.be/user-portal 2. CalcUA Core Facility web pages: https://www.uantwerpen.be/hpc 3. External documentation (TORQUE, Moab): http://docs.adaptivecomputing.com This tutorial is intended for users who want to connect and work on the HPC of the University of Antwerp. 3 This tutorial is available in a Windows, Mac or Linux version. This tutorial is available for UAntwerpen, UGent, KU Leuven, UHasselt and VUB users. Request your appropriate version at [email protected]. Contact Information: We welcome your feedback, comments and suggestions for improving the UAntwerpen-HPC Tutorial (contact: [email protected]). For all technical questions, please contact the UAntwerpen-HPC staff: 1. By e-mail: [email protected] 2. By phone: 03/2653860 (Stefan), 03/2653855 (Franky), 03/2653879 (Bert), 03/2653852 (Kurt), 03/2658980 (Carl) 3. In real: Campus Middelheim, Building G, Rooms G.309, G.310 and G.311 Mailing-lists: 1. Announcements: [email protected] (for official announcements and communications) New users are automatically added to the mailing list. You can check the archives on https: //sympa.ua.ac.be/sympa/, but you will need to generate a password first on that site using your main e-mail address (on which you receive the mailing list). 4 Glossary nfs Network File System, a protocol for sharing file systems across a network, often used on Unix(-like) operating systems. nic Network Interface Controller, a (virtualized) hardware component that connects a computer to a network. rest REpresentational State Transfer is a software architectural style that defines a set of constraints to be used for creating web services. yaml A human-readable text-based data serialization format. cluster A group of compute nodes. compute node The computational units on which batch or interactive jobs are processed. A compute node is pretty much comparable to a single personal computer. It contains one or more sockets, each holding a single CPU. Some nodes also contain one or more GPGPUs. The compute node is equipped with memory (RAM) that is accessible by all its CPUs. core An individual compute unit inside a CPU. A CPU typically contains one or more cores. CPU A central processing unit. A CPU is a consumable resource. A compute node typically contains one or more CPUs. distributed memory system Computing system consisting of many compute nodes connected by a network, each with their own memory. Accessing memory on a neighbouring node is possible but requires explicit communication. FLOPS FLOPS is short for “Floating-point Operations Per second”, i.e., the number of (floating- point) computations that a processor can perform per second. FTP File Transfer Protocol, used to copy files between distinct machines (over a network.) FTP is unencrypted, and as such blocked on certain systems. SFTP or SCP are secure alternatives to FTP. GPGPU A general purpose graphical processing unit. A GPGPU is a consumable resource. A GPGPU is a GPU that is used for highly parallel general purpose calculations. A compute node may contain zero, one or more GPGPUs. grid A group of clusters. 5 Heat Heat is the OpenStack orchestration service, which can manage multiple composite cloud applications using templates, through both an OpenStack-native rest API and a CloudFormation- compatible Query API. Heat Orchestration Template A Heat Orchestration Template (hot) is a text file which describes the infrastructure for a cloud application. Because hot files are text files ina yaml-based format, they are readable and writable by humans, and can be managed using a version control system. hot is one of the template formats supported by Heat, along with the older CloudFormation-compatible cfn format. Horizon Horizon is the name of the OpenStack Dashboard. HPC High Performance Computing, high performance computing and multiple-task computing on a supercomputer. The UAntwerpen-HPC is the HPC infrastructure at the University of Antwerp. InfiniBand A high speed switched fabric computer network communications link used in UAntwerpen- HPC. job constraints A set of conditions that must be fulfilled for the job to start. L1d Level 1 data cache, often called primary cache, is a static memory integrated with the CPU core that is used to store data recently accessed by a CPU and also data which may be required by the next operations. L2d Level 2 data cache, also called secondary cache, is a memory that is used to store recently accessed data and also data, which may be required for the next operations. The goal of having the level 2 cache is to reduce data access time in cases when the same data was already accessed before.. L3d Level 3 data cache. Extra cache level built into motherboards between the microprocessor and the main memory. LAN Local Area Network. Linux An operating system, similar to UNIX. LLC The Last Level Cache is the last level in the memory hierarchy before main memory. Any memory requests missing here must be serviced by local or remote DRAM, with significant increase in latency when compared with data serviced by the cache memory. login node On UAntwerpen-HPC clusters, login nodes serve multiple functions. From a login node you can submit and monitor batch jobs, analyse computational results, run editors, plots, debuggers, compilers, do housekeeping chores as adjust shell settings, copy files and in general manage your account. You connect to these servers when want to start working on the UAntwerpen-HPC. memory A quantity of physical memory (RAM). Memory is provided by compute nodes. It is required as a constraint or consumed as a consumable resource by jobs.