DOCSLIB.ORG

ACCRE Cheat Sheet Cat File Print Entire Content of Filename ​ ​ Guide to Linux, Lmod and SLURM Commands More File Incrementally Display Content of Filename ​ ​

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
ACCRE Cheat Sheet Cat File Print Entire Content of Filename ​ ​ Guide to Linux, Lmod and SLURM Commands More File Incrementally Display Content of Filename ​ ​ Viewing and editing text files ACCRE Cheat Sheet cat file Print entire content of filename ​ ​ Guide to Linux, Lmod and SLURM commands more file Incrementally display content of filename ​ ​ less file Similar to more, but with additional features ​ head file Display file header Accessing ACCRE ​ tail file Display file footer ​ Logging in from a terminal emacs Extensible and customizable text editor ssh [email protected] vim Minimalist yet powerful text editor ​ ​ nano Simple text editor Transferring files between ACCRE and your system scp source [email protected]:destination ​ ​ ​ ​ ​ scp [email protected]:source destination More advanced file management ​ ​ ​ ​ ​ chmod Changes read/write/execute permissions Windows/Mac clients: which cmd Lists the full file path of a command PuTTY SSH client for Windows ​ whereis cmd Lists possible file paths of a command WinSCP SCP client for Windows du dir Lists size of directory dir and its FileZilla FTP client for Linux, Windows, Mac ​ ​ ​ ​ subdirectories Xming/XQuartz X11 server for Windows/Mac find Finds files in a directory Basic Linux file management Aliases and system variables man command Displays the manual page for command ​ ​ alias Automatically replace one command with pwd Prints out the present working directory another ls Lists the files in the current directory env Lists all system variables ls -lh Show long listing of files export var=val Create environment variable $var and set ​ ​ ​ ​ ​ ls -a Show hidden files as well value to val ​ ls dir Lists files inside directory dir echo Print text to the screen ​ ​ rm file Deletes file echo $var Print the value of variable var ​ ​ ​ ​ mkdir dir Creates empty directory called dir .bashrc Define default aliases and system variables ​ ​ rmdir dir Removes empty directory dir ​ ​ Input and output redirection rm -r dir Removes directory dir and all of its content ​ ​ ​ ​ ​ ​ $(command) Runs the command inside $() first, then inserts cd dir Changes directory to dir ​ ​ ​ ​ the output to the rest of the command. Same as cd .. Changes working directory to parent putting grave marks (`) between the command cd Changes working directory to home < Standard input redirection cp file1 file2 Copy file1 into file2 > Standard output redirection ​ ​ ​ ​ ​ ​ cp file dir Makes a copy of file file inside directory dir 2> Standard error redirection ​ ​ ​ ​ ​ ​ mv file1 file2 Renames file file1 as file2 2>&1 Standard error and output redirection ​ ​ ​ ​ ​ ​ mv file dir Moves file file inside directory dir cmd1 | cmd2 Pipe command; redirects output of command ​ ​ ​ ​ ​ ​ ​ ​ cmd1 to input of cmd2 cp -i, mv -i Display a warning before copying or moving to ​ ​ an existing file path Filters rm -i Display a warning before removal wc Word count ~ (tilde) Home directory grep Gets a regular expression and prints it . (period) Current directory sort Sort input .. (double dot) Parent directory uniq Filter duplicate lines wget URL Downloads a file from URL in Internet ​ ​ ​ cut Cuts specific fields or columns unzip file.zip Extract a ZIP file ​ ​ sed Stream editor for search and replace tar xzf Extract a gz compressed tarball file.tar.gz awk Extensive tool for complex filtering tasks ​ vanderbilt.edu/accre ● Hill Center Suite 201 ● 1231 18th Ave. South, Nashville, TN 37212-2807 Revised 11/2018 ​ Cluster directories #SBATCH directives (continued) /home GPFS, backed up nightly --time=min Time limit; either min or ​ dd-hh:mm:ss /data GPFS, backed up nightly --mem=count RAM per node; e.g. 5G /dors GPFS, backed up nightly ​ --output=file Standard output; defaults to /scratch GPFS, higher quotas, not backed up ​ slurm-jobid.out if omitted ​ ​ /tmp Temporary local storage for I/O intensive tasks --error=file Write standard error to file ​ Lmod --array=arrayspec Define job array ​ ​ --gres=gpu:cores GPUs per process module avail Shows all available modules ​ --mail-user=email Email for job alerts module load module Loads module in the environment ​ ​ ​ ​ ​ --mail-type=type Email alert types: BEGIN, END, FAIL, module spider string Searches for module names ​ ​ REQUEUE, ALL matching string ​ --account=account Account to charge module keyword string Searches for modules containing ​ ​ string in name or description --depend=state:jobid Job dependency. state = after, ​ ​ ​ ​ ​ ​ afterok, afterany, afternotok module list List currently loaded modules --job-name=name Job name module unload module Removes module from environment ​ ​ ​ ​ --constrain=attribute Request CPU type: westmere, module purge Removes all modules from ​ sandy_bridge, haswell, eight, twelve, environment sixteen module save collection Saves currently loaded modules to ​ --partition=name Submit to partition: production , collection ​ debug, maxwell, pascal module savelist Returns all saved modules collections SLURM Environment Variables module describe Get modules in a saved collection ​ SLURM_JOBID Job ID module restore Restore modules from collection ​ SLURM_SUBMIT_DIR Job submission directory collection SLURM_SUBMIT_HOST Name of host from which job was SLURM submitted ​ SLURM_JOB_NODELIST Names of nodes allocated to job sbatch filename Submits a job script filename ​ ​ SLURM_ARRAY_TASK_ID Task id within job array squeue -u vunetid Show job queue for user vunetid ​ ​ SLURM_JOB_CPUS_PER_NODE CPU cores per node allocated to job scancel jobid Deletes the job with jobid ​ ​ SLURM_NNODES Number of nodes allocated to job scontrol hold jobid Hold job jobid ​ ​ scontrol release jobid Release job jobid ​ ​ ACCRE-specific utilities sinfo Cluster status ​ accre_storage Check storage quota usage salloc Starts an interactive job rtracejob jobid Check resources utilization for job ​ xalloc Starts an interactive job with X jobid window support q3 Get recent jobs by user, group and srun Launch parallel job step account sacct Display job accounting information qSummary -g group Queue summary for group and its ​ ​ ​ users #SBATCH directives showLimits -g group Get resource limits for specific ​ --nodes=count Number of nodes group ​ --tasks-per-node=count Processes per node SlurmActive Show cluster’s CPU/node utilization ​ --ntasks=count Total processes gpustate Show GPU cluster utilization ​ --cpus-per-task=count CPU cores per process sinfofeatures Get node availability based on ​ features --nodelist=nodes Preferred nodes ​ --exclude=nodes Nodes to avoid ​ vanderbilt.edu/accre ● Hill Center Suite 201 ● 1231 18th Ave. South, Nashville, TN 37212-2807 Revised 11/2018 ​ .
Load more

Recommended publications
  • Windows Command Prompt Cheatsheet
    Windows Command Prompt Cheatsheet - Command line interface (as opposed to a GUI - graphical user interface) - Used to execute programs - Commands are small programs that do something useful - There are many commands already included with Windows, but we will use a few. - A filepath is where you are in the filesystem • C: is the C drive • C:\user\Documents is the Documents folder • C:\user\Documents\hello.c is a file in the Documents folder Command What it Does Usage dir Displays a list of a folder’s files dir (shows current folder) and subfolders dir myfolder cd Displays the name of the current cd filepath chdir directory or changes the current chdir filepath folder. cd .. (goes one directory up) md Creates a folder (directory) md folder-name mkdir mkdir folder-name rm Deletes a folder (directory) rm folder-name rmdir rmdir folder-name rm /s folder-name rmdir /s folder-name Note: if the folder isn’t empty, you must add the /s. copy Copies a file from one location to copy filepath-from filepath-to another move Moves file from one folder to move folder1\file.txt folder2\ another ren Changes the name of a file ren file1 file2 rename del Deletes one or more files del filename exit Exits batch script or current exit command control echo Used to display a message or to echo message turn off/on messages in batch scripts type Displays contents of a text file type myfile.txt fc Compares two files and displays fc file1 file2 the difference between them cls Clears the screen cls help Provides more details about help (lists all commands) DOS/Command Prompt help command commands Source: https://technet.microsoft.com/en-us/library/cc754340.aspx.
    [Show full text]
  • TRSDOS 6.2 to LS-DOS 6.3.0 Manual Update
    LS-DOSÔ 6.3 UPDATE FOR TRSDOSâ 6.2.X The LS-DOS 6.3 release is an upgrade for the TRSDOS 6.2 operating system. Several important changes have been made to extend and enhance the operating system and its utilities. The date ranging has been expanded to accept dates through the year 1999. Files will now carry a modification time as well as a date. The DATECONV/CMD program is provided to translate version 6.2 or earlier disks to the 6.3 style dating. The user password has been eliminated from the system. The owner password still remains. The library command ID was added to display a customer service number. Several enhancements have been made to BASIC. The new DISKCOPY/CMD program will duplicate 5" double density floppy disks. Because the LS-DOS 6.3 update is a series of enhancements to TRSDOS 6.2, the primary documentation remains the 6.2 manual and Technical Reference manual. If you have a version of TRSDOS earlier than 6.2, you can obtain the manuals from Radio Shack under the catalog numbers 26-0316 (TRSDOS Version 6 [6.2 DOS manual and disk]), 26-2110 (Model 4/4D [6.2] Technical Reference Manual), or 26-1117 (6.2 DOS manual only). This documentation should be treated as an addendum to the TRSDOS 6.2 information. LS-DOS 6.3 installation instructions Before performing the upgrade, it is recommended that you make several backup copies of the 6.3 master disk. The simplest way to do this is to boot your system using the 6.3 diskette, insert a blank diskette to receive the copy in drive 1, and type the command: DISKCOPY :0 :1 When the copy finishes, you can insert another destination diskette and make another copy.
    [Show full text]
  • Unix Command Line; Editors
    Unix command line; editors Karl Broman Biostatistics & Medical Informatics, UW–Madison kbroman.org github.com/kbroman @kwbroman Course web: kbroman.org/AdvData My goal in this lecture is to convince you that (a) command-line-based tools are the things to focus on, (b) you need to choose a powerful, universal text editor (you’ll use it a lot), (c) you want to be comfortable and skilled with each. For your work to be reproducible, it needs to be code-based; don’t touch that mouse! Windows vs. Mac OSX vs. Linux Remote vs. Not 2 The Windows operating system is not very programmer-friendly. Mac OSX isn’t either, but under the hood, it’s just unix. Don’t touch the mouse! Open a terminal window and start typing. I do most of my work directly on my desktop or laptop. You might prefer to work remotely on a server, instead. But I can’t stand having any lag in looking at graphics. If you use Windows... Consider Git Bash (or Cygwin) or turn on the Windows subsystem for linux 3 Cygwin is an effort to get Unix command-line tools in Windows. Git Bash combines git (for version control) and bash (the unix shell); it’s simpler to deal with than Cygwin. Linux is now accessible in Windows 10, but you have to enable it. If you use a Mac... Consider Homebrew and iTerm2 Also the XCode command line tools 4 Homebrew is a packaging system; iTerm2 is a Terminal replacement. The XCode command line tools are a must for most unixy things on a Mac.
    [Show full text]
  • Unix/Linux Command Reference
    Unix/Linux Command Reference .com File Commands System Info ls – directory listing date – show the current date and time ls -al – formatted listing with hidden files cal – show this month's calendar cd dir - change directory to dir uptime – show current uptime cd – change to home w – display who is online pwd – show current directory whoami – who you are logged in as mkdir dir – create a directory dir finger user – display information about user rm file – delete file uname -a – show kernel information rm -r dir – delete directory dir cat /proc/cpuinfo – cpu information rm -f file – force remove file cat /proc/meminfo – memory information rm -rf dir – force remove directory dir * man command – show the manual for command cp file1 file2 – copy file1 to file2 df – show disk usage cp -r dir1 dir2 – copy dir1 to dir2; create dir2 if it du – show directory space usage doesn't exist free – show memory and swap usage mv file1 file2 – rename or move file1 to file2 whereis app – show possible locations of app if file2 is an existing directory, moves file1 into which app – show which app will be run by default directory file2 ln -s file link – create symbolic link link to file Compression touch file – create or update file tar cf file.tar files – create a tar named cat > file – places standard input into file file.tar containing files more file – output the contents of file tar xf file.tar – extract the files from file.tar head file – output the first 10 lines of file tar czf file.tar.gz files – create a tar with tail file – output the last 10 lines
    [Show full text]
  • Command Window – Basic Commands
    Command Window – Simple Commands help lists all commands p: switch to your P-drive c: switch to the computer’s C-drive dir list all files in a directory (aka “folder”); e.g. dir (list all files in current directory) dir myfolder (list all files in subdirectory myfolder) cd change directory; e.g. cd myfolder (move to subdirectory myfolder) cd .. (move up one directory level) md make (create) a directory; e.g. md myfolder (make a subdirectory called myfolder) copy copy files; e.g. copy oldfile newfile copy source.f90 myfolder\source.f90 ren rename files; e.g. ren oldfile newfile erase erase (delete) a file; e.g. (or del) erase unwanted.txt fc file compare; e.g. fc file1 file2 type list the contents of a file type somefile.txt type somefile.txt ¦ more (list contents, one page at a time) Wildcards (* and ?) Can be used to match length-unspecified strings (*) or individual letters (?); e.g. copy *.f90 *.bak dir solve.f?? Command Syntax and Options Most commands have various options; e.g. dir /p – list files, one page at a time To find the syntax and options available for any particular command use the /? option; e.g. dir /? History Use the and arrows on keyboard to recover previous commands. Use F7 to get a list of previous commands and arrow up and down to choose one to reissue. Editors An editor called notepad comes with the operating system: notepad myfile.f90 Running Programs You can run any program simply by typing its name; e.g. to run windows explorer: explorer Batch Files To avoid having to type a long sequence of commands it is convenient to put them all in a batch file – identified by the .bat extension.
    [Show full text]
  • Session 1171-2017
    Paper 1171-2017 Let SAS® Do Your DIRty Work Richann Watson, Experis ABSTRACT Making sure that you have saved all the necessary information to replicate a deliverable can be a cumbersome task. You want to make sure that all the raw data sets and all the derived data sets, whether they are Study Data Tabulation Model (SDTM) data sets or Analysis Data Model (ADaM) data sets, are saved. You prefer that the date/time stamps are preserved. Not only do you need the data sets, you also need to keep a copy of all programs that were used to produce the deliverable, as well as the corresponding logs from when the programs were executed. Any other information that was needed to produce the necessary outputs also needs to be saved. You must do all of this for each deliverable, and it can be easy to overlook a step or some key information. Most people do this process manually. It can be a time-consuming process, so why not let SAS® do the work for you? INTRODUCTION Making a copy of all information needed to produce a deliverable is time-consuming and is normally done using • Windows® Explorer: copy and paste to a new folder for archiving • Command interpreter (CMD shell)*: copy or move commands Both of these methods require you to create an archive directory and either copy or move the files manually. Most people go the route of using Windows Explorer due to familiarity. This can tie up your computer while the files are being archived. CMD is faster and commands can be set to run in the background if you know how to access CMD and know the necessary commands.
    [Show full text]
  • Pingdirectory Administration Guide Version
    Release 7.3.0.3 Server Administration Guide PingDirectory | Contents | ii Contents PingDirectory™ Product Documentation................................................ 20 Overview of the Server............................................................................. 20 Server Features.................................................................................................................................20 Administration Framework.................................................................................................................21 Server Tools Location....................................................................................................................... 22 Preparing Your Environment....................................................................22 Before You Begin.............................................................................................................................. 22 System requirements..............................................................................................................22 Installing Java......................................................................................................................... 23 Preparing the Operating System (Linux).......................................................................................... 24 Configuring the File Descriptor Limits.................................................................................... 24 File System Tuning.................................................................................................................25
    [Show full text]
  • UNIX and the Shells
    UNIX and the Shells Ole Peter Smith, IME, UFG, [email protected] 24/04/2010 Life sure is a Mystery to be Lived Not a Problem to be Solved... Ole Peter Smith, IME, UFG, [email protected] () UNIX and the Shells 24/04/2010 1 / 13 Beautiful Scientific Documents Classical Free Software Markup Language Thesis, automatic: · Bibliography · Contents · List of Tables, Figures · Index, References Slideshows: Beamer SL! MikTex, LyX, TexMaker, Kyle ^ Ole Peter Smith, IME, UFG, [email protected] () UNIX and the Shells 24/04/2010 2 / 13 Introdu¸c~ao UNIX vs. Linux Shell: Concha Bash: Bourne-Again Shell Csh: C Shell Ssh: Secure Shell · Remote Administration · File Transfer O mais importante n~ao´esaber de tudo O mais importante ´esaber onde pesquisar! Ole Peter Smith, IME, UFG, [email protected] () UNIX and the Shells 24/04/2010 3 / 13 File Commands List: ls - ls -l - ls -a - ls -tlF Usage: man command Criate: touch Move or rename: mv Copy: cp - cp -p - cp -r Remove: rm - rm -f (take care!!!!) - rm -r Content: cat Edit: vi or vim Symbolic Link: ln -s Ole Peter Smith, IME, UFG, [email protected] () UNIX and the Shells 24/04/2010 4 / 13 Notable Files & Directories System Configuration dir: /etc User Configuration dir, Home: '~/' (or '/home/$user') Users: /etc/passwd -: user - uid - gid - shell - home - Gecho Groups: /etc/group -: gname - gid - members Known hosts /etc/hosts -: ip - hostname - hostname... File systems /etc/fstab -: dev mount-point - fs-type - options Network services /etc/services -: service-name - port/protocol /usr, /var, /home,..
    [Show full text]
  • A Brief Introduction to Unix-2019-AMS
    A Brief Introduction to Linux/Unix – AMS 2019 Pete Pokrandt UW-Madison AOS Systems Administrator [email protected] Twitter @PTH1 Brief Intro to Linux/Unix o Brief History of Unix o Basics of a Unix session o The Unix File System o Working with Files and Directories o Your Environment o Common Commands Brief Intro to Unix (contd) o Compilers, Email, Text processing o Image Processing o The vi editor History of Unix o Created in 1969 by Kenneth Thompson and Dennis Ritchie at AT&T o Revised in-house until first public release 1977 o 1977 – UC-Berkeley – Berkeley Software Distribution (BSD) o 1983 – Sun Workstations produced a Unix Workstation o AT&T unix -> System V History of Unix o Today – two main variants, but blended o System V (Sun Solaris, SGI, Dec OSF1, AIX, linux) o BSD (Old SunOS, linux, Mac OSX/MacOS) History of Unix o It’s been around for a long time o It was written by computer programmers for computer programmers o Case sensitive, mostly lowercase abbreviations Basics of a Unix Login Session o The Shell – the command line interface, where you enter commands, etc n Some common shells Bourne Shell (sh) C Shell (csh) TC Shell (tcsh) Korn Shell (ksh) Bourne Again Shell (bash) [OSX terminal] Basics of a Unix Login Session o Features provided by the shell n Create an environment that meets your needs n Write shell scripts (batch files) n Define command aliases n Manipulate command history n Automatically complete the command line (tab) n Edit the command line (arrow keys in tcsh) Basics of a Unix Login Session o Logging in to a unix
    [Show full text]
  • College Holiday : May 24
    Sp21 CIS -18A-41Z: Introduction to Linux/Unix Midterm ONE: Apr 28, Midterm TWO: May 26 , Finals: Jun 21 CENSUS DATE: Apr 19 College Holiday : May 24 Assignment Due dates : Apr 12,19,26, May 3,10,17,25,31, Jun 7,14 No Makeups for any of the above. If you miss, you lose points. Plan accordingly. (Zoom, synchronous M/W, 6PM - 7 PM - Window ) (See http://www.deanza.edu/calendar/finalexams.html) Instructor communicates with student ONLY. • Zoom lectures attendance is not mandatory. Sessions will be recorded and shared in Canvas. • Students need to take midterms and finals -in-the-alloted-time-date. If student does not show up for midterm/finals then 0 points. • FINALS will be on Jun 21, via CANVAS. All times PDT. • If you have questions on assignment grade, email me and we will discuss and resolve it. Any feedback about your work is going to be via email M/W 6 thru 750PM • Do not use Shell programming/Sed/Awk/Perl/Python/Posix expressions for this class in your assignments. Stick to Syllabus. Refer to CANVAS for assignments ! College academic Calendar:Spring 2021 http://deanza.fhda.edu/calendar/springdates.html Instructor Information • Name: Lalitha Krishnamurthy • Email: krishnamurthylalitha at fhda dot edu • Email only in canvas please. • Online Lab Hours: Wednesdays 845pm - 10pm (via Canvas) • Office Hours: Available via synchronous zoom: Mondays 830-930pm PDT. • Lecture timings for CIS18A : M/W 6 PM - 750 PM - Online/Zoom via CANVAS Students, please read the following and plan accordingly • All communication with instructor is via Canvas for assignments and quizzes.
    [Show full text]
  • Introduction to Unix Part I: the Essentials
    Introduction to Unix Part I: The Essentials Frederick J Tan Bioinformatics Research Faculty Carnegie Institution of Washington, Department of Embryology 9 April 2013 Unix, Linux, Ubuntu, Oh My! 2 A Three Hour Tour Part I: The Essentials client-server model, command-line interface, navigation, viewing files, searching, finding help Part II: Special Topics account settings, multi-tasking, programming, installing programs, file systems, system administration 3 The Awesome Power of the Client-Server Model 4 A Tale of Two Interfaces Command Line Graphical Terminal.app, Unix shell Finder.app, Galaxy breadth, cutting-edge discovery, visualization 5 Running Programs Using the Command-Line Interface command-line graphical type in the name of the to run a program program and hit <ENTER> double click on an icon (e.g. bowtie2) type in options after the program, to modify how a click on check boxes, before hitting <ENTER> program operates select from pull-down menus (e.g. bowtie2 --very-sensitive) 6 The Anatomy of a Shell Prompt workshop@ubuntu:~$ The text in between the colon (:) The $ symbol indicates The symbol and the dollar sign ($) indicates that the server is ready to indicates where what what directory you are in. perform a command. you type in will appear. /home/workshop$ $ ssh [email protected] 7 Task 1: Connect to your server and start top with -i option Start VirtualBox Start Ubuntu Secure SHell $ ssh [email protected] <ENTER> <SPACE> Shell Prompt /home/workshop$ <TAB> Start top -i $ top -i <CTRL> <UP> <DOWN> 8 Task 2: Figure
    [Show full text]
  • Great Lakes Cheat Sheet Less File Prints Content of File Page by Page Guide to General L Inux (Bash) a Nd S Lurm C Ommands Head File Print First 10 Lines of File
    Viewing and editing text files cat file Print entire content of file Great Lakes Cheat Sheet less file Prints content of file page by page Guide to general L inux (Bash) and S lurm c ommands head file Print first 10 lines of file tail file Print last 10 lines of file Accessing Great Lakes nano Simple, easy to use text editor Logging in from a terminal (Duo required) vim Minimalist yet powerful text editor ssh uniqname @greatlakes.arc-ts.umich.edu emacs Extensible and customizable text editor Transferring files between Great Lakes and your system scp input uniqname@ greatlakes-xfer.arc-ts.umich.edu: output Advanced file management scp -r i nput uniqname@ greatlakes-xfer.arc-ts.umich.edu:o utput scp uniqname@ greatlakes-xfer.arc-ts.umich.edu:i nput output chmod Change read/write/execute permissions which cmd List the full file path of a command GUI Clients PuTTY SSH client for Windows whereis cmd List all related file paths (binary, source, manual, etc.) of a command WinSCP SCP client for Windows du dir List size of directory and its subdirectories FileZilla FTP client for Windows, Mac, and Linux find Find file in a directory Basic Linux file management Aliases and system variables man command Display the manual page for command alias Create shortcut to command pwd Print out the present working directory env Lists all environment variables ls List the files in the current directory export var = val Create environment variable $ var with value ls -lh Show long, human-readable listing val ls dir List files inside directory dir echo $var Print the value of variable $var rm file Delete file .bashrc File that defines user aliases and variables mkdir dir Create empty directory called dir Input and output redirection rmdir dir Remove empty directory dir $( command) Runs command first, then inserts output to the rm -r dir Remove directory dir and all contents rest of the overall command cd dir Change working directory to dir < Standard input redirection cd .
    [Show full text]