Reference Guide

Total Page:16

File Type:pdf, Size:1020Kb

Reference Guide Reference Guide Scyld ClusterWare Release 5.10.1-5101g0000 December 18, 2013 Reference Guide: Scyld ClusterWare Release 5.10.1-5101g0000; December 18, 2013 Revised Edition Published December 18, 2013 Copyright © 1999 - 2013 Penguin Computing, Inc. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording or otherwise) without the prior written permission of Penguin Computing, Inc.. The software described in this document is "commercial computer software" provided with restricted rights (except as to included open/free source). Use beyond license provisions is a violation of worldwide intellectual property laws, treaties, and conventions. Scyld ClusterWare, the Highly Scyld logo, and the Penguin Computing logo are trademarks of Penguin Computing, Inc.. Intel is a registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Infiniband is a trademark of the InfiniBand Trade Association. Linux is a registered trademark of Linus Torvalds. Red Hat and all Red Hat-based trademarks are trademarks or registered trademarks of Red Hat, Inc. in the United States and other countries. All other trademarks and copyrights referred to are the property of their respective owners. Table of Contents Preface .....................................................................................................................................................................................v Feedback.........................................................................................................................................................................v Scyld ClusterWare Commands .............................................................................................................................................7 bdate................................................................................................................................................................................9 beoboot .........................................................................................................................................................................11 beoconfig.......................................................................................................................................................................15 beomap..........................................................................................................................................................................19 beonetconf.....................................................................................................................................................................23 beonpc...........................................................................................................................................................................25 beorun ...........................................................................................................................................................................27 beosetup ........................................................................................................................................................................31 beosi..............................................................................................................................................................................35 beostatus .......................................................................................................................................................................39 beostat...........................................................................................................................................................................43 bpcp...............................................................................................................................................................................45 bpsh...............................................................................................................................................................................47 bpstat.............................................................................................................................................................................51 linpack...........................................................................................................................................................................55 mpprun..........................................................................................................................................................................59 Scyld ClusterWare Maintenance Commands....................................................................................................................63 beofdisk.........................................................................................................................................................................65 beorsync........................................................................................................................................................................69 beomodprobe ................................................................................................................................................................71 beoserv..........................................................................................................................................................................73 bpctl ..............................................................................................................................................................................75 bplib ..............................................................................................................................................................................79 bpmaster........................................................................................................................................................................81 bpslave ..........................................................................................................................................................................83 node_down....................................................................................................................................................................85 recvstats ........................................................................................................................................................................87 sendstats........................................................................................................................................................................89 Scyld ClusterWare Special Files .........................................................................................................................................91 beowulf-config..............................................................................................................................................................93 beowulf-fstab ..............................................................................................................................................................103 Scyld ClusterWare Beostat Libraries...............................................................................................................................105 beostat_count_idle_cpus.............................................................................................................................................107 beostat_count_idle_cpus_on_node.............................................................................................................................109 beostat_get_avail_nodes_by_id ..................................................................................................................................111 beostat_get_cpu_count ...............................................................................................................................................113 beostat_get_cpu_percent.............................................................................................................................................115 beostat_get_cpuinfo_x86............................................................................................................................................117 beostat_get_disk_usage ..............................................................................................................................................119 beostat_get_last_multicast..........................................................................................................................................121 beostat_get_loadavg ...................................................................................................................................................123 beostat_get_meminfo..................................................................................................................................................125 beostat_get_MHz........................................................................................................................................................127 iii beostat_get_name .......................................................................................................................................................129
Recommended publications
  • Embedding Redhat Linux in a Diskonchip - HOWTO
    Embedding Redhat Linux in a DiskOnChip - HOWTO Don Davies, Prosig Ltd ( [email protected]) October 2002 Describes the configuration and setup of a development environment for a Single Board Computer running Redhat Linux from a DiskOnChip device. Contents 1.0 Introduction ..........................................................................................................3 1.1 Hardware Details..................................................................................................3 1.2 System Configuration ...........................................................................................4 2.0 DOS Development Environment...........................................................................5 2.1 DiskOnChip Tools ................................................................................................5 2.2 Boot Loader..........................................................................................................6 2.3 MS-DOS System Startup......................................................................................6 3.0 Linux Development Environment ......................................................................7 3.1 Custom Kernel Configuration ............................................................................8 3.2 Building Custom Kernel ..................................................................................10 3.3 Booting Custom Kernel ...................................................................................10 3.4 Formatting DiskOnChip for Linux
    [Show full text]
  • OS Awareness Manual Linux
    OS Awareness Manual Linux TRACE32 Online Help TRACE32 Directory TRACE32 Index TRACE32 Documents ...................................................................................................................... OS Awareness Manuals ................................................................................................................ OS Awareness and Run Mode Debugging for Linux .............................................................. OS Awareness Manual Linux ................................................................................................. 1 Overview ............................................................................................................................... 4 Terminology 4 Brief Overview of Documents for New Users 5 Supported Versions 5 Configuration ........................................................................................................................ 6 Quick Configuration Guide 6 Hooks & Internals in Linux 6 Features ................................................................................................................................ 8 Display of Kernel Resources 8 Task-Related Breakpoints 8 Task Context Display 9 MMU Support 11 Space IDs 11 MMU Declaration 11 Debugger Table Walk 17 Symbol Autoloader 18 SMP Support 19 Dynamic Task Performance Measurement 20 Task Runtime Statistics 20 Process / thread switch support for ARM using context ID register: 21 Task State Analysis 21 Function Runtime Statistics 22 Linux Specific Menu 24 Debugging Linux Kernel
    [Show full text]
  • Absolute BSD—The Ultimate Guide to Freebsd Table of Contents Absolute BSD—The Ultimate Guide to Freebsd
    Absolute BSD—The Ultimate Guide to FreeBSD Table of Contents Absolute BSD—The Ultimate Guide to FreeBSD............................................................................1 Dedication..........................................................................................................................................3 Foreword............................................................................................................................................4 Introduction........................................................................................................................................5 What Is FreeBSD?...................................................................................................................5 How Did FreeBSD Get Here?..................................................................................................5 The BSD License: BSD Goes Public.......................................................................................6 The Birth of Modern FreeBSD.................................................................................................6 FreeBSD Development............................................................................................................7 Committers.........................................................................................................................7 Contributors........................................................................................................................8 Users..................................................................................................................................8
    [Show full text]
  • Discovering and Emulating an Intel Gigabit Ethernet Device
    Discovering and emulating an Intel Gigabit Ethernet device. Student: Bao Chi Tran Nguyen , Supervisor: Knut Omang Master’s Thesis Spring 2017 Preface Thanks to Aril Schultzen, Marie Ekeberg, Thomas Plagemann, Morten Rosseland, Linda Sørensen, Esra Boncuk, Torstein Winterseth and David Huynh for their help. 3 4 Contents 1 Introduction 3 1.1 Motivation . .4 1.2 Problem . .5 1.3 Methodology . .6 1.4 Outline . .6 2 Background 7 2.1 Virtualization . .7 2.2 QEMU . 10 2.3 PC . 12 2.4 Operating system . 12 2.5 PCI . 17 2.6 PCI-Express . 20 2.7 SR/IOV . 23 2.8 E1000 . 24 2.9 Igb . 28 3 Framework 33 4 Goals 37 5 Methodology and tools 39 6 Environment 41 7 Discovery 45 8 Results 47 8.1 MMIO . 49 8.2 Device structure . 54 8.3 New advanced descriptors . 55 8.4 Initialize and cleanup. 57 8.5 EEPROM . 57 8.6 PHY (MDIC) . 58 8.7 Statistics . 59 8.8 Descriptor queues . 59 5 8.9 Legacy interrupt . 59 8.10 VMState . 60 9 Conclusion 61 9.1 Summary . 61 9.2 Open problems . 61 9.2.1 MMIO . 62 9.2.2 Descriptor queues . 62 9.2.3 SR/IOV . 63 6 List of Figures 2.1 The Von Neumann architecture that most computer system derive its architectural design from.[33] . .8 2.2 Layers of communication . .9 2.3 The official QEMU-logo[6] . 10 2.4 QEMU as seen from the host operating system.[27] . 11 2.5 A 80’s IBM PC[11] and todays HP Compaq PC[10].
    [Show full text]
  • Operating System Structures
    COP 4610: Introduction to Operating Systems (Fall 2016) Operating System Structures Zhi Wang Florida State University Content • Operating system services • User interface • System calls • Operating system structures • Virtual machines Operating System Services • Operating systems provides an environment for program execution and services to programs and users • a set of services is helpful to (visible to) users: • user interface • program execution • I/O operation • file-system manipulation • communication • error detection • another set of services exists for ensuring efficient operation of the system: • resource allocation • accounting • protection and security A View of Operating System Services Operating System Services (User-Visible) • User interface • most operating systems have a user interface (UI). • e.g., command-Line (CLI), graphics user interface (GUI), or batch • Program execution • load and execute an program in the memory • end execution, either normally or abnormally • I/O operations • a running program may require I/O such as file or I/O device • File-system manipulation • read, write, create and delete files and directories • search or list files and directories • permission management Operating System Services (User-Visible) • Communications • processes exchange information, on the same system or over a network • via shared memory or through message passing • Error detection • OS needs to be constantly aware of possible errors • errors in CPU, memory, I/O devices, programs • it should take appropriate actions to ensure correctness
    [Show full text]
  • System Log Files Kernel Ring Buffer Viewing Log Files the Log Files
    System Log Files Most log files are found in /var/log Checking logs are critical to see if things are working correctly Checking logs is critical to see if things are working correctly. Take a look at all the log files on scratch ls /var/log Kernel Ring Buffer The kernel ring buffer is something like a log file for the kernel; however, unlike other log files, it’s stored in memory rather than in a disk file. You can use the dmesg command to view it. Many times it is logged to /var/log/dmesg as well. It requires sudo privileges to read the /var/log/dmesg file, but not to run the dmesg command. Viewing log files There are a number of commands to view log files. cat less head tail Anytime a new entry is added to a log file, it is appended to the end of the file. This is one of those times where tail is particularly useful. Usually when we want to look at log files we want to look at the most recent entries. When organizing our viewing command - order matters. Most of the following commands produce different results. And all are useful depending on what type of results you want. Go through the thought process and figure out what each command does. Can you figure out which three produce identical results? cat /var/log/syslog cat /var/log/syslog | grep daemon cat /var/log/syslog | grep daemon | tail -n 10 cat /var/log/syslog | tail -n 10 cat /var/log/syslog | tail -n 10 | grep daemon less /var/log/syslog less /var/log/syslog | tail -n 10 | grep daemon head -n 10 /var/log/syslog head -n 10 /var/log/syslog | grep daemon tail -n 10 /var/log/syslog tail -n 10 /var/log/syslog | grep daemon If you add the -f option to the tail command it provides a live watch of the log file.
    [Show full text]
  • Filedes = Open(Name, Mode) Opens an Existing File with the Given Name
    Computer Science 425 Distributed Systems CS 425 / ECE 428 Fall 2013 Indranil Gupta (Indy) December 3, 2013 Lecture 27 Distributed File Systems Chapter 12 (relevant parts) 2013, I. Gupta, K. Nahrtstedt, S. Mitra, N. Vaidya, M. T. Harandi, J. Hou Lecture 27-1 File Attributes & System Modules File Attribute Block Block Block Record length creation timestamp File read timestamp Directory Module Access write timestamp Module attribute timestamp File Module Block reference count Module file type Access control ownership Device Module Module access control list File System Modules Lecture 27-2 UNIX File System Operations filedes = open(name, mode) Opens an existing file with the given name . filedes = creat(name, mode) Creates a new file with the given name . Both operations deliver a file descriptor referencing the open file. The mode is read, write or both. status = close(filedes) Closes the open file filedes. count = read(filedes, buffer, n) Transfers n bytes from the file referenced by filedes to buffer . count = write(filedes, buffer, n) Transfers n bytes to the file referenced by filedes from buffer. Both operations deliver the number of bytes actually transferred and advance the read-write pointer. pos = lseek(filedes, offset, Moves the read-write pointer to offset (relative or absolute, whence) depending on whence). status = unlink(name) Removes the file name from the directory structure. If the file has no other links to it, it is deleted from disk. status = link(name1, name2) Creates a new link (name2) for a file (name1 ). status = stat(name, buffer) Gets the file attributes for file name into buffer. Lecture 27-3 Distributed File System (DFS) Requirements Transparency : server-side changes should be invisible to the client-side.
    [Show full text]
  • Introduction to the Linux Kernel: Challenges and Case Studies
    Introduction to the Linux kernel: challenges and case studies Juan Carlos Sáez Alcaide Department of Computer Architecture and Automation ArTeCS Group Complutense University of Madrid IV Semana de la Informática 2018 Feb 8, 2018 About Me Juan Carlos Sáez Alcaide ([email protected]) Interim Associate Professor, UCM Department of Computer Architecture and Automation Teaching: Operating Systems, Linux and Android Internals,… Member of the ArTeCS Research Group High Performance Computing Computer Architecture Interaction between system software and architecture … UCM Campus Representative of the USENIX Int’l Association Login (USENIX Magazine) IV Semana de la Informática 2018 - 2 Outline 1 Introduction 2 Main Features 3 Kernel Control Paths and Concurrency 4 Common Kernel abstractions 5 A case study: PMCTrack tool IV Semana de la Informática 2018 - 3 Outline 1 Introduction 2 Main Features 3 Kernel Control Paths and Concurrency 4 Common Kernel abstractions 5 A case study: PMCTrack tool IV Semana de la Informática 2018 - 4 Unix (I) Unics – Unix (1969) Created by Ken Thompson and rewrit- ten in “C” by Dennis Ritchie (1973) V6 (1975): Public source code (AT&T license) BSD distributions (Billy Joy) John Lion’s book on UNIX V6 Keys to success 1 Inexpensive license 2 Source code available 3 Code was simple and easy to modify 4 Ran on modest HW IV Semana de la Informática 2018 - 5 Unix (II) Unix (Cont.) V7 (1979): code can be no longer used for academic purposes Xenix (1980) Microsoft SCO Unix System III (1982) Unix System V (1983) HP-UX, IBM’s AIX, Sun’s Solaris IV Semana de la Informática 2018 - 6 Unix (III) Proyecto GNU (1983) - Richard Stallman SO GNU: Emacs, GNU compiler collection (GCC), GNU Hurd (kernel) Minix v1 (1987) - Andrew Tanenbaum Richard Stallman Minimal Unix-like OS (Unix clone) Teaching purposes.
    [Show full text]
  • Apple File System Reference
    Apple File System Reference Developer Contents About Apple File System 7 General-Purpose Types 9 paddr_t .................................................. 9 prange_t ................................................. 9 uuid_t ................................................... 9 Objects 10 obj_phys_t ................................................ 10 Supporting Data Types ........................................... 11 Object Identifier Constants ......................................... 12 Object Type Masks ............................................. 13 Object Types ................................................ 14 Object Type Flags .............................................. 20 EFI Jumpstart 22 Booting from an Apple File System Partition ................................. 22 nx_efi_jumpstart_t ........................................... 24 Partition UUIDs ............................................... 25 Container 26 Mounting an Apple File System Partition ................................... 26 nx_superblock_t ............................................. 27 Container Flags ............................................... 36 Optional Container Feature Flags ...................................... 37 Read-Only Compatible Container Feature Flags ............................... 38 Incompatible Container Feature Flags .................................... 38 Block and Container Sizes .......................................... 39 nx_counter_id_t ............................................. 39 checkpoint_mapping_t ........................................
    [Show full text]
  • Unix Commands (09/04/2014)
    Unix Commands (09/04/2014) • Access control – login <login_name> – exit – passwd <login_name> – yppassswd <loginname> – su – • Login as Super user – su <login> • Login as user <login> • Root Prompt – [root@localhost ~] # • User Prompt – [bms@raxama ~] $ On Line Documentation – man <command/topic> – info <command/topic> • Working with directories – mkdir –p <subdir> ... {-p create all directories in path if not present} mkdir –p /2015/Jan/21/14 will create /2015, Jan, 21 & 14 in case any of these is absent – cd <dir> – rm -r <subdir> ... Man Pages • 1 Executable programs or shell commands • 2 System calls (functions provided by the kernel) • 3 Library calls (functions within program libraries) • 4 Special files (usually found in /dev) • 5 File formats and conventions eg /etc/passwd • 6 Games • 7 Miscellaneous (including macro packages and conventions), e.g. man(7), groff(7) • 8 System administration commands (usually only for root) • 9 Kernel routines [Non standard] – man grep, {awk,sed,find,cut,sort} – man –k mysql, man –k dhcp – man crontab ,man 5 crontab – man printf, man 3 printf – man read, man 2 read – man info Runlevels used by Fedora/RHS Refer /etc/inittab • 0 - halt (Do NOT set initdefault to this) • 1 - Single user mode • 2 - Multiuser, – without NFS (The same as 3, if you do not have networking) • 3 - Full multi user mode w/o X • 4 - unused • 5 - X11 • 6 - reboot (Do NOT set init default to this) – init 6 {Reboot System} – init 0 {Halt the System} – reboot {Requires Super User} – <ctrl> <alt> <del> • in tty[2-7] mode – tty switching • <ctrl> <alt> <F1-7> • In Fedora 10 tty1 is X.
    [Show full text]
  • Device Drivers
    Device Drivers Prof. Stephen A. Edwards Columbia University Spring 2016 Linux Operating System Structure Applications Function Calls # Callbacks " Libraries System Calls # Signals " The Kernel Processes Scheduling Networking Memory Management File Systems Device Drivers iowrite32(), etc. # Interrupts " Hardware Busses Memory Peripherals User Space vs. Kernel Space Process abstraction central to most OSes Independent PC, registers, and memory Virtual memory hardware isolates processes, OS Processes run in limited-resourse “user mode” Bug in a process takes down the process only Kernel runs in “supervisor mode” with no access limitations Bugs in kernel code take down the whole system Unix Device Driver Model “Everything is a file” By convention, special “device” files stored in /dev Created by the mknod command or dynamically $ ls -Ggl --time-style=+ \ /dev/sd{a,a1,a2,b} /dev/tty{,1,2} \ First SCSI drive Block /dev/ttyUSB0 Device First partition of brw-rw----b 1 8, 0 /dev/sda first SCSI drive brw-rw---- 1 8, 1 /dev/sda1 brw-rw---- 1 8, 2 /dev/sda2 Second SCSI drive Character Device brw-rw---- 1 8, 16 /dev/sdb crw-rw-rw-c 1 5, 0 /dev/tty Current terminal crw-rw---- 1 4, 1 /dev/tty1 Second terminal crw-rw---- 1 4, 2 /dev/tty2 crw-rw---- 1 188,188 0 /dev/ttyUSB0 Major Minor First USB terminal Owner Group World Device Device permissions Number Number https://www.cs.columbia.edu/~smb/classes/s06-4118/l23.pdf /proc/devices Virtual file with a list of device drivers by major number $ cat /proc/devices Character devices: 4 /dev/vc/0 4 tty 4 ttyS 5
    [Show full text]
  • (Fall 2009) Lecture 19 Distributed File Systems Reading
    Computer Science 425/ECE 428/CSE 424 Distributed Systems (Fall 2009) Lecture 19 Distributed File Systems Reading: Chapter 8 Acknowledgement • The slides during this semester are based on ideas and material from the following sources: – Slides prepared by Professors M. Harandi, J. Hou, I. Gupta, N. Vaidya, Y-Ch. Hu, S. Mitra. – Slides from Professor S. Gosh’s course at University o Iowa. Administrative • MP2 posted October 5, 2009, on the course website, – Deadline November 6 (Friday) – Demonstration, 4-6pm, 11/6/2009 – Tutorial for MP2 planned for October 28 evening if students send questions to TA by October 25. Send requests what you would like to hear in the tutorial. Administrative • MP3 proposal instructions – Deadline for MP3 proposal: October 25, 2009, email proposal to TA – At least one representative of each group meets with instructor or TA during October 26-28 during their office hours ) watch for extended office hours during these days. – Wednesday, October 28, 8:30-10am – instructor’s office hours 3104 SC – No office hours, Thursday, 29, 9-10am Administrative • Homework 3 posted on Thursday, October 15 – Deadline: Thursday, October 29, 2009 at the beginning of class • Midterm Re-grading Period by Instructor – additional office hours: – October 27, 3:15-4pm – in 3104 SC – October 29, 3:15-4pm – in 3104 SC Plan for Today • File Systems – Review • Distributed File Systems – Requirements • File System Architecture • Network File System (NFS) • Andrew File System (AFS) File Systems A file is a collection of data with a user view (file structure) and a physical view (blocks). A directory is a file that provides a mapping from text names to internal file identifiers.
    [Show full text]