CERN UNIX User Guide

Total Page:16

File Type:pdf, Size:1020Kb

CERN UNIX User Guide IT/PS/164 Version 3.0 September, 2002 CERN UNIX User Guide Editor: Alan Silverman ACKNOWLEDGEMENTS Much of the information in this Guide is not original; we are indebted to the authors of the "UNIX at Fermilab Guide" and the authors of the "GSI UNIX Primer" for permitting us to include information lifted from those two excellent publications. We also thank other CERN colleagues for helping us with particular sections and with the numerous edits which were necessary to correct our initial drafts. Information in this Guide is not copyright but any use in other documents should include not only acknowledgement to this source but also to the FNAL and GSI guides as well. This Guide is by no means guaranteed free from error, especially considering the range of UNIX architectures and environments it is intended to cover. Readers are encouraged to send comments and error reports to Alan Silver- man at the e-mail address [email protected]. Copies of this Guide can be found as follows: AFS File /afs/cern.ch/asis/share/usr.local/doc/unixguide.ps Anonymous ftp file asisftp.cern.ch:pub/doc/unixguide.ps WWW - postscript The full postscript file can be found under the Documents Section of the UNIX Workstation Support Page, URL - http://wsspinfo.cern.ch/file/doc- uments WWW - html The HTML version is also available at the URL http://wsspinfo.cern.ch/ file/documents and has options for selecting by contents pages or Index entries. You will also find symbols defined to show footnotes and forward and backward ref- erences. CHANGE RECORD Version 1.00 1 July 1994 First general release: prepared by Harry Renshall, Judy Richards and Alan Silverman; edited by Tracey Appleby Version 1.01 11 July 1994 HTML address of Guide added Version 1.02 14 July 1994 UCO Book List and purchase scheme updated. AFS address of Guide modified Version 1.10 14 November 1994 Various minor mods including more options on the ftp, lpq and lprmcommands and information on symbolic links Version 1.11 27 March 1995 Some corrections made for documentation sources for elm, pine and gnu Additions to index Additions to the list of special chars in Appendix A Several minor errors and typing errors corrected Clearer explanation of Internet addressing Newer book recommendation for gnu emacs Version 2.0 1 February1996 Translated to FrameMaker by Luc Goidadin Version 2.1 8 March 1996 Reference to local disc copy of guide removed Version 2.2 1 August 1996 Mostly small error corrections and minor additions (thanks to Dietrich Wiegandt for pointing them out) Removal of sections on elm and connecting to CERNVM Note about CN recommendations for mail agent (pine) and newsreaders (trn and xrn) Version 3.0 28 September 2002 Made conformant to IT-recommended architecture Examples taken from zsh and tcsh (mainly) Table of contents 1. Introduction ........................................................................... 7 1.1 The Standard CERN Unix Environment .........................................................7 1.1.1 Certified UNIX Architecture ..........................................................................................7 1.1.2 SUE - The Standard UNIX Environment ...........................................................................8 1.1.3 The HEPiX User Environment ...........................................................................................8 1.2 Getting a UNIX Account ...............................................................................8 1.3 Login, Logout, Setting Passwords ...................................................................8 1.3.1 Login ..................................................................................................................................8 1.3.2 Logout ................................................................................................................................9 1.3.3 Setting Passwords ...............................................................................................................9 2. UNIX Shells ............................................................................. 10 2.1 Entering Commands ........................................................................................10 2.2 Path ..................................................................................................................12 2.3 Processes .........................................................................................................12 2.4 Standard Input, Output and Redirection ..........................................................13 2.5 Pipes ................................................................................................................14 2.6 Shell Scripts .....................................................................................................14 2.7 Filters ...............................................................................................................15 2.8 Regular Expressions ........................................................................................15 3. Working Environment ........................................................... 17 3.1 Environment Variables ....................................................................................17 3.1.1 Shell Variables and Environment Variables ......................................................................17 3.1.2 Setting Environment Variables ..........................................................................................17 3.1.3 Getting Values of Environment Variables .........................................................................18 3.1.4 A Summary of Some Useful Environment Variables ........................................................18 3.1.5 Changing Your Command Prompt .....................................................................................19 3.2 The Profile Files ..............................................................................................19 3.3 Terminal Characteristics ..................................................................................21 3.3.1 Keyboards ..........................................................................................................................21 3.4 Alias .................................................................................................................22 3.5 Recalling Commands: history .........................................................................23 3.5.1 tcsh Shell ............................................................................................................................23 3.5.2 zsh Shell Command Line Editing ......................................................................................24 3.5.3 Command Line Editing in Other Shells .............................................................................24 4. File System ............................................................................. 25 4.1 File Structure ...................................................................................................25 4.1.1 Naming Directories and Files .............................................................................................25 4.1.2 Rules for Naming and Accessing Files ..............................................................................25 4.2 List of Simple File System Commands ...........................................................26 4.2.1 Displaying the contents of a directory: ls ...........................................................................26 4.2.2 Changing the Working Directory: cd .................................................................................26 4.2.3 Determining Your Working Directory: pwd ......................................................................26 4.2.4 Creating a New Directory: mkdir .......................................................................................26 Table of contents 3 4.2.5 Removing an Existing Directory: rmdir .............................................................................27 4.2.6 Renaming a Directory: mv .................................................................................................27 4.2.7 Displaying the Contents of a File: cat,more, etc ................................................................27 4.2.8 Renaming a File: mv ..........................................................................................................28 4.2.9 Copying a File: cp ..............................................................................................................28 4.2.10 Creating Links ln ................................................................................................................28 4.2.11 Deleting a File: rm ..............................................................................................................28 4.2.12 File and Directory Permissions ..........................................................................................29 4.2.13 Determining Permission: ls -l .............................................................................................29 4.2.14 Changing Permission: chmod .............................................................................................30 4.3 File Backup ..................................................................................................... 30 4.4 AFS Overview ................................................................................................ 31 5. Communications ..................................................................32
Recommended publications
  • Unix Introduction
    Unix introduction Mikhail Dozmorov Summer 2018 Mikhail Dozmorov Unix introduction Summer 2018 1 / 37 What is Unix Unix is a family of operating systems and environments that exploits the power of linguistic abstractions to perform tasks Unix is not an acronym; it is a pun on “Multics”. Multics was a large multi-user operating system that was being developed at Bell Labs shortly before Unix was created in the early ’70s. Brian Kernighan is credited with the name. All computational genomics is done in Unix http://www.read.seas.harvard.edu/~kohler/class/aosref/ritchie84evolution.pdfMikhail Dozmorov Unix introduction Summer 2018 2 / 37 History of Unix Initial file system, command interpreter (shell), and process management started by Ken Thompson File system and further development from Dennis Ritchie, as well as Doug McIlroy and Joe Ossanna Vast array of simple, dependable tools that each do one simple task Ken Thompson (sitting) and Dennis Ritchie working together at a PDP-11 Mikhail Dozmorov Unix introduction Summer 2018 3 / 37 Philosophy of Unix Vast array of simple, dependable tools Each do one simple task, and do it really well By combining these tools, one can conduct rather sophisticated analyses The Linux help philosophy: “RTFM” (Read the Fine Manual) Mikhail Dozmorov Unix introduction Summer 2018 4 / 37 Know your Unix Unix users spend a lot of time at the command line In Unix, a word is worth a thousand mouse clicks Mikhail Dozmorov Unix introduction Summer 2018 5 / 37 Unix systems Three common types of laptop/desktop operating systems: Windows, Mac, Linux. Mac and Linux are both Unix-like! What that means for us: Unix-like operating systems are equipped with “shells”" that provide a command line user interface.
    [Show full text]
  • Introduction to Unix
    Introduction to Unix Rob Funk <[email protected]> University Technology Services Workstation Support http://wks.uts.ohio-state.edu/ University Technology Services Course Objectives • basic background in Unix structure • knowledge of getting started • directory navigation and control • file maintenance and display commands • shells • Unix features • text processing University Technology Services Course Objectives Useful commands • working with files • system resources • printing • vi editor University Technology Services In the Introduction to UNIX document 3 • shell programming • Unix command summary tables • short Unix bibliography (also see web site) We will not, however, be covering these topics in the lecture. Numbers on slides indicate page number in book. University Technology Services History of Unix 7–8 1960s multics project (MIT, GE, AT&T) 1970s AT&T Bell Labs 1970s/80s UC Berkeley 1980s DOS imitated many Unix ideas Commercial Unix fragmentation GNU Project 1990s Linux now Unix is widespread and available from many sources, both free and commercial University Technology Services Unix Systems 7–8 SunOS/Solaris Sun Microsystems Digital Unix (Tru64) Digital/Compaq HP-UX Hewlett Packard Irix SGI UNICOS Cray NetBSD, FreeBSD UC Berkeley / the Net Linux Linus Torvalds / the Net University Technology Services Unix Philosophy • Multiuser / Multitasking • Toolbox approach • Flexibility / Freedom • Conciseness • Everything is a file • File system has places, processes have life • Designed by programmers for programmers University Technology Services
    [Show full text]
  • “Linux at the Command Line” Don Johnson of BU IS&T  We’Ll Start with a Sign in Sheet
    “Linux at the Command Line” Don Johnson of BU IS&T We’ll start with a sign in sheet. We’ll end with a class evaluation. We’ll cover as much as we can in the time allowed; if we don’t cover everything, you’ll pick it up as you continue working with Linux. This is a hands-on, lab class; ask questions at any time. Commands for you to type are in BOLD The Most Common O/S Used By BU Researchers When Working on a Server or Computer Cluster Linux is a Unix clone begun in 1991 and written from scratch by Linus Torvalds with assistance from a loosely-knit team of hackers across the Net. 64% of the world’s servers run some variant of Unix or Linux. The Android phone and the Kindle run Linux. a set of small Linux is an O/S core programs written by written by Linus Richard Stallman and Torvalds and others others. They are the AND GNU utilities. http://www.gnu.org/ Network: ssh, scp Shells: BASH, TCSH, clear, history, chsh, echo, set, setenv, xargs System Information: w, whoami, man, info, which, free, echo, date, cal, df, free Command Information: man, info Symbols: |, >, >>, <, ;, ~, ., .. Filters: grep, egrep, more, less, head, tail Hotkeys: <ctrl><c>, <ctrl><d> File System: ls, mkdir, cd, pwd, mv, touch, file, find, diff, cmp, du, chmod, find File Editors: gedit, nedit You need a “xterm” emulation – software that emulates an “X” terminal and that connects using the “SSH” Secure Shell protocol. ◦ Windows Use StarNet “X-Win32:” http://www.bu.edu/tech/support/desktop/ distribution/xwindows/xwin32/ ◦ Mac OS X “Terminal” is already installed Why? Darwin, the system on which Apple's Mac OS X is built, is a derivative of 4.4BSD-Lite2 and FreeBSD.
    [Show full text]
  • Shell Variables
    Shell Using the command line Orna Agmon ladypine at vipe.technion.ac.il Haifux Shell – p. 1/55 TOC Various shells Customizing the shell getting help and information Combining simple and useful commands output redirection lists of commands job control environment variables Remote shell textual editors textual clients references Shell – p. 2/55 What is the shell? The shell is the wrapper around the system: a communication means between the user and the system The shell is the manner in which the user can interact with the system through the terminal. The shell is also a script interpreter. The simplest script is a bunch of shell commands. Shell scripts are used in order to boot the system. The user can also write and execute shell scripts. Shell – p. 3/55 Shell - which shell? There are several kinds of shells. For example, bash (Bourne Again Shell), csh, tcsh, zsh, ksh (Korn Shell). The most important shell is bash, since it is available on almost every free Unix system. The Linux system scripts use bash. The default shell for the user is set in the /etc/passwd file. Here is a line out of this file for example: dana:x:500:500:Dana,,,:/home/dana:/bin/bash This line means that user dana uses bash (located on the system at /bin/bash) as her default shell. Shell – p. 4/55 Starting to work in another shell If Dana wishes to temporarily use another shell, she can simply call this shell from the command line: [dana@granada ˜]$ bash dana@granada:˜$ #In bash now dana@granada:˜$ exit [dana@granada ˜]$ bash dana@granada:˜$ #In bash now, going to hit ctrl D dana@granada:˜$ exit [dana@granada ˜]$ #In original shell now Shell – p.
    [Show full text]
  • LPI 101 – Work on the Command Line [5] (Linux Professional Institute Certification) A
    – LPI 101 – Work on the Command Line [5] (Linux Professional Institute Certification) a .˜. /V\ by: geoffrey robertson // \\ [email protected] @._.@ $Id: gl1.103.1.slides.tex,v 1.3 2003/05/30 05:09:04 waratah Exp $ a c Copyright 2002 Geoffrey Robertson, Andrew Eager. Permission is granted to make and distribute verbatim copies or modified versions of this document provided that this copyright notice and this permission notice are preserved on all copies under the terms of the GNU General Public License as published by the Free Software Foundation—either version 2 of the License or (at your option) any later version. 1 Work on the command line [5] Objective Candidate should be able to interact with shells and commands using the command line. This includes typing valid commands and command sequences, defining, referencing and exporting environment variables, using command history and editing facilities, invoking commands in the path and outside the path, using command substitution, applying commands recursively through a directory tree and using man to find about commands. 2 Work on the command line [5] Key files, terms, and utilities ¡ . ¡ man ¡ bash ¡ pwd ¡ echo ¡ set ¡ env ¡ unset ¡ ¡ exec ˜/.bash history ¡ ¡ export ˜/.profile 3 Work on the command line [5] Resources of interest LPI Certification in a Nutshell pp15—19 LPIC 1 Cert. Bible Chapter 2 Linux Shells by Example by Ellie Quigley 4 Shells Command Line Interface ¡ A shell is the program that provides a Command Line Interface to the operating system. 5 Shells may be accessed in various ways: – Virtual Console – Terminal attached to a serial line – Remote access over tcp/ip with telnet, rsh or ssh – An X terminal run on an X session, either on the local console or remotely See /etc/inittab Shells Command Line Interface ¡ A shell is the program that provides a Command Line Interface to the operating system.
    [Show full text]
  • Operating System User's Mannal ~Zilog 03-0072-01 Revision a September 1978
    t_ .' Operating System User's Mannal ~Zilog 03-0072-01 Revision A September 1978 Copyright © 1978 by Zilog, Inc. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording, or otherwise, without the prior written permission of Zilog. Zilog assumes no responsibility for the use of any circuitry other than circuitry embodied in a Zilog product. No other circuit patent licenses are implied. zaO-RIO Operating System User's Manual September 1978 TABLE OF CONTENTS CHAPTER 1 - INTRODUCTION AND OVERVIEW • 1 1.1 INTRODUCTION •• 1 1.2 SYSTEM OVERVIEW 3 1.2.1 Hardware Configuration • • • • • • 3 1.2.2 File Systems • • • • • • • . • • 3 1.2.3 System Initialization •••.••• 6 1.2.4 Commands • • .• .•..••• 7 1.2.5 I/O • • • . • • • • • . • • • • • . 7 CHAPTER 2 - RIO EXECUTIVE 9 2.1 SYSTEM INITIALIZATION 9 2.2 FILE NAME CONVENTIONS · 10 2.3 MEMORY MANAGEMENT . • • . 12 2.3.1 MEMMGR • . 13 2.4 COMMAND STRING INTERPRETATION · 13 2.5 ERROR HANDLING • • . 15 2.6 PROGRAM EXECUTION OF COMMANDS · 15 CHAPTER 3 - 1/0 STRUCTURE • · 16 3.1 OVERVIEW . • · 16 3.2 I/O REQUESTS - SYSTEM CALLS · 17 3.3 THE 'ASSIGN' I/O REQUEST ••• • 19 - i - 3.4 STANDARD RIO I/O DEVICES • • • 21 3.4.1 ZDOS . • • • . 21 3.4.2 DFS . 21 3.4.3 NULL . • • • . 21 3.4.4 CON . • • • . • • • • • 22 3.4.5 PCON • 27 3.4.6 FLOPPY • • • • • • • • • • 27 3.4.7 DISK • • • • • • 27 CHAPTER 4 - PROGRAM INTERFACE • • 28 4.1 PROGRAM LOCATION • • • • • 28 4.2 PARAMETER STRING ADDRESS · 29 4.3 PROGRAM STACK SPACE • • • 29 4.4 PROGRAM TERMINATION - ERROR HANDLING ••.
    [Show full text]
  • Ardpower Documentation Release V1.2.0
    ardPower Documentation Release v1.2.0 Anirban Roy Das Sep 27, 2017 Contents 1 Introduction 1 2 Screenshot 3 3 Documentaion 5 3.1 Overview.................................................5 3.2 Installation................................................7 3.3 Usage................................................... 12 4 Indices and tables 13 i ii CHAPTER 1 Introduction Its a custom Oh-My-Zsh Theme inspired by many custom themes suited for a perfect ZSH Environment under Byobu with Tmux Backend. 1 ardPower Documentation, Release v1.2.0 2 Chapter 1. Introduction 3 ardPower Documentation, Release v1.2.0 CHAPTER 2 Screenshot 4 Chapter 2. Screenshot CHAPTER 3 Documentaion You can also find PDF version of the documentation here. Overview We will start with understanding the individual components of an entire CLI. Generally we don’t put much attention to what we do. We just fire up a terminal or some say sheel and start typing our commands and get the result. That’s all. But there are a lot of things that goes behind all this. Terminal The very first component is the Terminal. So what is a Terminal? A terminal emulator, terminal application, term, or tty for short, is a program that emulates a video ter- minal within some other display architecture. Though typically synonymous with a shell or text terminal, the term terminal covers all remote terminals, including graphical interfaces. A terminal emulator inside a graphical user interface is often called a terminal window.A terminal window allows the user access to a text terminal and all its applications such as command-line interfaces (CLI) and text user interface (TUI) applications.
    [Show full text]
  • IODF Explorer
    The Input/Output Definition File (IODF) is a critical Control Point in the management of the IBM z/Series Platform. IODF Explorer Release 4.0 USER GUIDE Contact us for additional information: NewEra Software Technical Support 800-421-5035 [email protected] www.newera.com Rev: 2009-04-24 IODF Explorer 4.0 ¾ Copyright, Trademark and Legal Notices Copyrights This Getting Started Guide and the related Software Product(s) are protected under a Copyright dated 2009 by NewEra Software, Inc. All rights are reserved. License Agreement This Getting Started Guide describes the installation and operation of Image FOCUS, its environment and applications. It is made available only under the terms of a license agreement between the licensee and NewEra Software Inc. No part of this Guide or the related Software Product(s) may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording, for any purpose, without the express written permission of NewEra Software, Inc. Trademarks and Copyrights of Others The following products and/or registered trademarks of International Business Machines Corporation are referenced in this document: MVS, VM, RACF, z/OS, SYSPLEX, JES, VTAM, TSO, ISPF, ICKDSF, DFSMSdss, DF/DSS, and others. 2 NewEra Software, Inc. ‐ Image Control Environment (ICE) Applications IODF Explorer 4.0 ¾ Technical Support Information NewEra Software is dedicated to providing the highest level of technical Around-the-clock- support support to meet our customers’ growing needs. In order to meet these needs, NewEra provides around‐the‐clock technical support, 7 days a week, 24 hours a day.
    [Show full text]
  • Hardware Configuration Definition User's Guide
    z/OS Version 2 Release 3 Hardware Configuration Definition User's Guide IBM SC34-2669-30 Note Before using this information and the product it supports, read the information in “Notices” on page 443. This edition applies to Version 2 Release 3 of z/OS (5650-ZOS) and to all subsequent releases and modifications until otherwise indicated in new editions. Last updated: 2019-02-16 © Copyright International Business Machines Corporation 1994, 2018. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents List of Figures..................................................................................................... xiii List of Tables.....................................................................................................xxiii About this document.......................................................................................... xxv Who this document is for..........................................................................................................................xxv Related information.................................................................................................................................. xxv How to use this document.......................................................................................................................xxvi How this document is organized............................................................................................................. xxvi How to read syntax diagrams................................................................................................................
    [Show full text]
  • Unix Systems: Shell Scripting (III)
    Unix Systems: Shell Scripting (III) Bruce Beckles University of Cambridge Computing Service 1 Introduction • Who: ! Bruce Beckles, e-Science Specialist, UCS • What: ! Unix Systems: Shell Scripting (III) course ! Follows on from “Unix Systems: Shell Scripting (II)” ! Part of the Scientific Computing series of courses • Contact (questions, etc): ! [email protected] • Health & Safety, etc: ! Fire exits • Please switch off mobile phones! [email protected] Unix Systems: Shell Scripting (III) 2 As this course is part of the Scientific Computing series of courses run by the Computing Service, all the examples that we use will be more relevant to scientific computing than to system administration, etc. This does not mean that people who wish to learn shell scripting for system administration and other such tasks will get nothing from this course, as the techniques and underlying knowledge taught are applicable to shell scripts written for almost any purpose. However, such individuals should be aware that this course was not designed with them in mind. For details of the “Unix Systems: Shell Scripting (II)” course, see: http://www.cam.ac.uk/cs/courses/coursedesc/linux.html#script2 2 What we don’t cover • Different types of shell: ! We are using the Bourne-Again SHell (bash). • Differences between versions of bash • Very advanced shell scripting – try this course instead: ! “Programming: Python for Absolute Beginners” [email protected] Unix Systems: Shell Scripting (III) 3 bash is probably the most common shell on modern Unix/Linux systems – in fact, on most modern Linux distributions it will be the default shell (the shell users get if they don’t specify a different one).
    [Show full text]
  • Korn Shell Variables
    V4.1 cover Front cover Korn and Bash Shell Programming (Course code AL32) Student Notebook ERC 1.0 IBM Certified Course Material Student Notebook Trademarks IBM® is a registered trademark of International Business Machines Corporation. The following are trademarks of International Business Machines Corporation in the United States, or other countries, or both: AIX® AIX 5L™ Language Environment® OS/2® POWER™ RISC System/6000® RS/6000® Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Windows is a trademark of Microsoft Corporation in the United States, other countries, or both. UNIX® is a registered trademark of The Open Group in the United States and other countries. Linux® is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others. October 2007 edition The information contained in this document has not been submitted to any formal IBM test and is distributed on an “as is” basis without any warranty either express or implied. The use of this information or the implementation of any of these techniques is a customer responsibility and depends on the customer’s ability to evaluate and integrate them into the customer’s operational environment. While each item may have been reviewed by IBM for accuracy in a specific situation, there is no guarantee that the same or similar results will result elsewhere. Customers attempting to adapt these techniques to their own environments do so at their own risk. © Copyright International Business Machines Corporation 2007.
    [Show full text]
  • Bash Tutorial
    Bash Shell Lecturer: Prof. Andrzej (AJ) Bieszczad Email: [email protected] Phone: 818-677-4954 Bash Shell The shell of Linux • Linux has a variety of different shells: – Bourne shell (sh), C shell (csh), Korn shell (ksh), TC shell (tcsh), Bour ne Again shell (bash). • Certainly the most popular shell is “bash”. Bash is an sh- compatible shell that incorporates useful features from the Korn shell (ksh) and C shell (csh). • It is intended to conform to the IEEE POSIX P1003.2/ISO 9945.2 Shell and Tools standard. • It offers functional improvements over sh for both programming and interactive use. Bash Shell Programming or Scripting ? • bash is not only an excellent command line shell, but a scripting language in itself. Shell scripting allows us to use the shell's abilities and to automate a lot of tasks that would otherwise require a lot of commands. • Difference between programming and scripting languages: – Programming languages are generally a lot more powerful and a lot faster than scriptin g languages. Programming languages generally start from source code and are compil ed into an executable. This executable is not easily ported into different operating syste ms. – A scripting language also starts from source code, but is not compiled into an executabl e. Rather, an interpreter reads the instructions in the source file and executes each inst ruction. Interpreted programs are generally slower than compiled programs. The main a dvantage is that you can easily port the source file to any operating system. bash is a s cripting language. Other examples of scripting languages are Perl, Lisp, and Tcl.
    [Show full text]