DOCSLIB.ORG

Fedora 17 System Administrator's Guide

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Fedora 17 System Administrator's Guide Fedora 17 System Administrator's Guide Deployment, Configuration, and Administration of Fedora 17 Jaromír Hradílek Douglas Silas Martin Prpič Stephen Wadeley Eliška Slobodová Tomáš Čapek Petr Kovář John Ha System Administrator's Guide David O'Brien Michael Hideo Don Domingo Fedora 17 System Administrator's Guide Deployment, Configuration, and Administration of Fedora 17 Edition 1 Author Jaromír Hradílek [email protected] Author Douglas Silas [email protected] Author Martin Prpič [email protected] Author Stephen Wadeley [email protected] Author Eliška Slobodová [email protected] Author Tomáš Čapek [email protected] Author Petr Kovář [email protected] Author John Ha Author David O'Brien Author Michael Hideo Author Don Domingo Copyright © 2012 Red Hat, Inc. and others. The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/. The original authors of this document, and Red Hat, designate the Fedora Project as the "Attribution Party" for purposes of CC-BY-SA. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version. Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law. Red Hat, Red Hat Enterprise Linux, the Shadowman logo, JBoss, MetaMatrix, Fedora, the Infinity Logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries. For guidelines on the permitted uses of the Fedora trademarks, refer to https://fedoraproject.org/wiki/ Legal:Trademark_guidelines. Linux® is the registered trademark of Linus Torvalds in the United States and other countries. Java® is a registered trademark of Oracle and/or its affiliates. XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries. MySQL® is a registered trademark of MySQL AB in the United States, the European Union and other countries. All other trademarks are the property of their respective owners. The System Administrator's Guide documents relevant information regarding the deployment, configuration, and administration of Fedora 17. It is oriented towards system administrators with a basic understanding of the system. Preface xvii 1. Target Audience .......................................................................................................... xvii 2. How to Read this Book ................................................................................................ xvii 3. Document Conventions .................................................................................................. xx 3.1. Typographic Conventions .................................................................................... xx 3.2. Pull-quote Conventions ....................................................................................... xxi 3.3. Notes and Warnings .......................................................................................... xxii 4. We Need Feedback! .................................................................................................... xxii 5. Acknowledgments ....................................................................................................... xxiii I. Basic System Configuration 1 1. Configuring the Language and Keyboard 3 1.1. Changing the Language ....................................................................................... 3 1.2. Changing the Date, Time, and Numeric Format ...................................................... 4 1.3. Changing the Keyboard Layout ............................................................................. 6 1.4. Viewing the Current Configuration ......................................................................... 8 2. Configuring the Date and Time 9 2.1. Using the Date and Time Configuration Tool .......................................................... 9 2.2. Using the Command Line Tools .......................................................................... 10 2.2.1. Changing the Date ................................................................................... 10 2.2.2. Changing the Time .................................................................................. 10 2.2.3. Configuring the Network Time Protocol ..................................................... 10 2.3. Additional Resources .......................................................................................... 12 2.3.1. Installed Documentation ........................................................................... 12 3. Managing Users and Groups 13 3.1. Introduction to Users and Groups ........................................................................ 13 3.1.1. User Private Groups ................................................................................ 13 3.1.2. Shadow Passwords ................................................................................. 13 3.2. Using the User Accounts Tool ............................................................................. 14 3.2.1. Configuring an Account ............................................................................ 15 3.2.2. Adding a New User ................................................................................. 16 3.2.3. Removing a User ..................................................................................... 16 3.3. Using the User Manager Tool ............................................................................. 17 3.3.1. Viewing Users and Groups ....................................................................... 17 3.3.2. Adding a New User ................................................................................. 18 3.3.3. Adding a New Group ............................................................................... 19 3.3.4. Modifying User Properties ........................................................................ 19 3.3.5. Modifying Group Properties ...................................................................... 20 3.4. Using Command Line Tools ................................................................................ 21 3.4.1. Adding a New User ................................................................................. 21 3.4.2. Adding a New Group ............................................................................... 24 3.4.3. Enabling Password Aging ......................................................................... 25 3.4.4. Enabling Automatic Logouts ..................................................................... 26 3.4.5. Creating Group Directories ....................................................................... 27 3.5. Additional Resources .......................................................................................... 28 3.5.1. Installed Documentation ........................................................................... 28 II. Package Management 29 4. Yum 31 4.1. Checking For and Updating Packages ................................................................. 31 4.1.1. Checking For Updates ............................................................................. 31 v System Administrator's Guide 4.1.2. Updating Packages .................................................................................. 32 4.1.3. Preserving Configuration File Changes ..................................................... 34 4.2. Packages and Package Groups .......................................................................... 34 4.2.1. Searching Packages ................................................................................ 34 4.2.2. Listing Packages ..................................................................................... 34 4.2.3. Displaying Package Information ................................................................ 37 4.2.4. Installing Packages .................................................................................. 38 4.2.5. Removing Packages ................................................................................ 40 4.2.6. Working with Transaction History .............................................................. 41 4.3. Configuring Yum and Yum Repositories ............................................................... 46 4.3.1. Setting [main] Options .............................................................................. 46 4.3.2. Setting [repository] Options ...................................................................... 49 4.3.3. Using Yum Variables ............................................................................... 50 4.3.4. Viewing the Current Configuration ............................................................. 51 4.3.5. Adding, Enabling, and Disabling a Yum Repository .................................... 52 4.3.6. Creating a Yum Repository ...................................................................... 53 4.4. Yum Plug-ins ..................................................................................................... 53 4.4.1. Enabling, Configuring, and Disabling Yum Plug-ins .................................... 54 4.4.2. Installing Additional Yum Plug-ins ............................................................. 55 4.4.3. Plug-in Descriptions ................................................................................
Load more

Recommended publications
  • Performance Counters in Htop 3.0
    Slide: [ ] Talk: Perf counters in htop 3.0 Presenter: https://hisham.hm PID USER PRI NI VIRT RES SHR S CPU% MEM% TIME+ Command Performance counters in htop 3.0 Hisham Muhammad @[email protected] https://hisham.hm Slide: [ 2 ] Date: 2018-08-25 Talk: Perf counters in htop 3.0 Presenter: https://hisham.hm PID USER PRI NI VIRT RES SHR S CPU% MEM% TIME+ Command About me original author of htop, a project started in 2004 http://hisham.hm/htop/ lead dev of LuaRocks, package manager for Lua http://luarocks.org/ co-founder of the GoboLinux distribution http://gobolinux.org/ developer at Kong – FLOSS API gateway http://getkong.org/ (we’re hiring!) Slide: [ 3 ] Date: 2018-08-25 Talk: Perf counters in htop 3.0 Presenter: https://hisham.hm PID USER PRI NI VIRT RES SHR S CPU% MEM% TIME+ Command What is htop an interactive process manager intended to be “a better top” by this all I originally meant was: scrolling! (versions of top improved a lot since!) Slide: [ 4 ] Date: 2018-08-25 Talk: Perf counters in htop 3.0 Presenter: https://hisham.hm PID USER PRI NI VIRT RES SHR S CPU% MEM% TIME+ Command Hello, htop! Slide: [ 5 ] Date: 2018-08-25 Talk: Perf counters in htop 3.0 Presenter: https://hisham.hm PID USER PRI NI VIRT RES SHR S CPU% MEM% TIME+ Command htop beyond Linux Linux MacOS FreeBSD OpenBSD DragonFlyBSD Solaris (illumos) Slide: [ 6 ] Date: 2018-08-25 Talk: Perf counters in htop 3.0 Presenter: https://hisham.hm PID USER PRI NI VIRT RES SHR S CPU% MEM% TIME+ Command Then Apple released a broken kernel..
    [Show full text]
  • Kirjoituspohja VTT Science
    IENCE C • •S T S E C Small world for dynamic wireless cyber-physical N O H I N systems S O I V Dissertation L • O S 142 G T Y H • R Industries and consumer markets are today increasingly using G I E L VTT SCIEN CE S H E G services exposed from wireless sensor and actuator networks, A I R H C cyber-physical machine-to-machine systems. The motivation for H the research arises from problems detected in the remote 1 4 2 interaction with embedded devices over dynamic wireless networks in such systems. The selected approach is based on the application of the small- world paradigm to cyber-physical systems. It is here assumed that the concept of small world, "six degrees of separation", can be expanded to also cover communication with wireless embedded devices in cyber-physical systems context. The main contributions are the technical enablers referred to as dynamic communication spaces, dynamic M2M service spaces, configuration and remote use of services, communication overlay, access systems selection, integrated mobility, secure ad hoc networking, situated opportunistic communication, hierarchical networking for small-world networks, and short-cuts for network optimization. The enablers have been evaluated as separate technical methods and means by means of experiments and/or simulations. According to the evaluations, the enablers seem to work well as separate building blocks and that they can be combined to expand the concept of small world to also cover communication with embedded devices. Wireless short-cuts can improve the scalability and efficiency of dynamic wireless networking and weak links are essential in the neighbour discovery process.
    [Show full text]
  • Freiesmagazin 12/2012
    freiesMagazin Dezember 2012 Topthemen dieser Ausgabe Slackware 14.0 Seite 3 Die wohl älteste noch aktive Linux-Distribution hat nach überdurchschnittlich langer Entwick- lungszeit die neue Version 14.0 veröffentlicht. Der Artikel gibt eine Übersicht über Altes und Neues, was sich seit Version 9.0 so alles geändert hat – und was nicht. (weiterlesen) Video Disk Recoder auf Basis von easyVDR 1.0 Seite 10 Der Artikel erklärt den Aufbau eines MediaCenters auf Basis der Distribution easyVDR und stellt die Neuerungen der Version 1.0 sowie deren Installation und Konfiguration vor. Der Schwerpunkt des Artikels liegt dabei in der Hardwareauswahl und den neuen Features der jetzt auf der Linux-Distribution Ubuntu basierten Version 1.0 sowie der „easy“ Inbetriebnahme dieser. (weiterlesen) Softmaker Office 2012 Seite 25 Der Markt für Büroprogramme ist unübersichtlich: In der Windows-Welt gilt Microsoft Office trotz der saftigen Preise immer noch als Referenz. Unter Linux dürfte dagegen LibreOffice mitt- lerweile den Stand eines Standards erreicht haben. Hinzu kommen noch zahlreiche freie An- wendungen und diverse kommerzielle Alternativen. Eines der Programme mit professionellem Anspruch ist SoftMaker Office, das nicht nur Nischenmärkte unter verschiedenen Systemen besetzen, sondern eine Alternative zu den Platzhirschen sein will. (weiterlesen) © freiesMagazin CC-BY-SA 3.0 Ausgabe 12/2012 ISSN 1867-7991 MAGAZIN Editorial Sechster Programmierwettbewerb werden dann ebenfalls einige Meta-Daten zu der Inhalt Linux allgemein Im März 2012 gab es mit dem fünften Wett- jeweiligen Ausgabe angezeigt. Slackware 14.0 S. 3 bewerb ein kleines Zwischenspiel außer der Aber auch so haben wir weiter an der CSS-Datei Video Disk Recoder auf Basis von S.
    [Show full text]
  • 20 Linux System Monitoring Tools Every Sysadmin Should Know by Nixcraft on June 27, 2009 · 315 Comments · Last Updated November 6, 2012
    About Forum Howtos & FAQs Low graphics Shell Scripts RSS/Feed nixcraft - insight into linux admin work 20 Linux System Monitoring Tools Every SysAdmin Should Know by nixCraft on June 27, 2009 · 315 comments · Last updated November 6, 2012 Need to monitor Linux server performance? Try these built-in commands and a few add-on tools. Most Linux distributions are equipped with tons of monitoring. These tools provide metrics which can be used to get information about system activities. You can use these tools to find the possible causes of a performance problem. The commands discussed below are some of the most basic commands when it comes to system analysis and debugging server issues such as: 1. Finding out bottlenecks. 2. Disk (storage) bottlenecks. 3. CPU and memory bottlenecks. 4. Network bottlenecks. #1: top - Process Activity Command The top program provides a dynamic real-time view of a running system i.e. actual process activity. By default, it displays the most CPU-intensive tasks running on the server and updates the list every five seconds. Fig.01: Linux top command Commonly Used Hot Keys The top command provides several useful hot keys: Hot Usage Key t Displays summary information off and on. m Displays memory information off and on. Sorts the display by top consumers of various system resources. Useful for quick identification of performance- A hungry tasks on a system. f Enters an interactive configuration screen for top. Helpful for setting up top for a specific task. o Enables you to interactively select the ordering within top. r Issues renice command.
    [Show full text]
  • Ubuntu Kung Fu
    Prepared exclusively for Alison Tyler Download at Boykma.Com What readers are saying about Ubuntu Kung Fu Ubuntu Kung Fu is excellent. The tips are fun and the hope of discov- ering hidden gems makes it a worthwhile task. John Southern Former editor of Linux Magazine I enjoyed Ubuntu Kung Fu and learned some new things. I would rec- ommend this book—nice tips and a lot of fun to be had. Carthik Sharma Creator of the Ubuntu Blog (http://ubuntu.wordpress.com) Wow! There are some great tips here! I have used Ubuntu since April 2005, starting with version 5.04. I found much in this book to inspire me and to teach me, and it answered lingering questions I didn’t know I had. The book is a good resource that I will gladly recommend to both newcomers and veteran users. Matthew Helmke Administrator, Ubuntu Forums Ubuntu Kung Fu is a fantastic compendium of useful, uncommon Ubuntu knowledge. Eric Hewitt Consultant, LiveLogic, LLC Prepared exclusively for Alison Tyler Download at Boykma.Com Ubuntu Kung Fu Tips, Tricks, Hints, and Hacks Keir Thomas The Pragmatic Bookshelf Raleigh, North Carolina Dallas, Texas Prepared exclusively for Alison Tyler Download at Boykma.Com Many of the designations used by manufacturers and sellers to distinguish their prod- ucts are claimed as trademarks. Where those designations appear in this book, and The Pragmatic Programmers, LLC was aware of a trademark claim, the designations have been printed in initial capital letters or in all capitals. The Pragmatic Starter Kit, The Pragmatic Programmer, Pragmatic Programming, Pragmatic Bookshelf and the linking g device are trademarks of The Pragmatic Programmers, LLC.
    [Show full text]
  • The Kdesvn Handbook
    The kdesvn Handbook Rajko Albrecht The kdesvn Handbook 2 Contents 1 Introduction 7 1.1 Terms . .7 2 Using kdesvn 8 2.1 kdesvn features . .8 2.2 Beginning with subversion and kdesvn . .8 2.2.1 Creating a working copy . .9 2.2.2 Committing local changes . .9 2.2.3 Update working copy . .9 2.2.4 Adding and Deleting from working copy . .9 2.2.4.1 Add items . 10 2.2.4.2 Deleting items from working copy and unversion . 10 2.2.5 Displaying logs . 10 2.2.5.1 The log display dialog . 10 2.3 Working on repositories . 11 2.3.1 Restoring deleted items . 11 2.3.2 Importing folders . 11 2.3.2.1 With drag and drop . 11 2.3.2.2 Select folder to import with directory-browser . 11 2.4 Other Operations . 11 2.4.1 Merge . 11 2.4.1.1 Internal merge . 12 2.4.1.2 Using external program for merge . 12 2.4.2 Resolving conflicts . 12 2.5 Properties used by kdesvn for configuration . 13 2.5.1 Bugtracker integration . 13 2.6 The revision tree . 13 2.6.1 Requirements . 14 2.7 Internal log cache . 14 2.7.1 Offline mode . 14 2.7.2 Log cache and revision tree . 14 The kdesvn Handbook 2.8 Meaning of icon overlays . 14 2.9 kdesvn and passwords . 16 2.9.1 Not saving passwords . 16 2.9.2 Saving passwords in KWallet . 16 2.9.3 Saving to subversion’s own password storage .
    [Show full text]
  • Fira Code: Monospaced Font with Programming Ligatures
    Personal Open source Business Explore Pricing Blog Support This repository Sign in Sign up tonsky / FiraCode Watch 282 Star 9,014 Fork 255 Code Issues 74 Pull requests 1 Projects 0 Wiki Pulse Graphs Monospaced font with programming ligatures 145 commits 1 branch 15 releases 32 contributors OFL-1.1 master New pull request Find file Clone or download lf- committed with tonsky Add mintty to the ligatures-unsupported list (#284) Latest commit d7dbc2d 16 days ago distr Version 1.203 (added `__`, closes #120) a month ago showcases Version 1.203 (added `__`, closes #120) a month ago .gitignore - Removed `!!!` `???` `;;;` `&&&` `|||` `=~` (closes #167) `~~~` `%%%` 3 months ago FiraCode.glyphs Version 1.203 (added `__`, closes #120) a month ago LICENSE version 0.6 a year ago README.md Add mintty to the ligatures-unsupported list (#284) 16 days ago gen_calt.clj Removed `/**` `**/` and disabled ligatures for `/*/` `*/*` sequences … 2 months ago release.sh removed Retina weight from webfonts 3 months ago README.md Fira Code: monospaced font with programming ligatures Problem Programmers use a lot of symbols, often encoded with several characters. For the human brain, sequences like -> , <= or := are single logical tokens, even if they take two or three characters on the screen. Your eye spends a non-zero amount of energy to scan, parse and join multiple characters into a single logical one. Ideally, all programming languages should be designed with full-fledged Unicode symbols for operators, but that’s not the case yet. Solution Download v1.203 · How to install · News & updates Fira Code is an extension of the Fira Mono font containing a set of ligatures for common programming multi-character combinations.
    [Show full text]
  • An User & Developer Perspective on Immutable Oses
    An User & Developer Perspective on Dario Faggioli Virtualization SW. Eng. @ SUSE Immutable OSes [email protected] dariof @DarioFaggioli https://dariofaggioli.wordpress.com/ https://about.me/dario.faggioli About Me What I do ● Virtualization Specialist Sw. Eng. @ SUSE since 2018, working on Xen, KVM, QEMU, mostly about performance related stuff ● Daily activities ⇒ how and what for I use my workstation ○ Read and send emails (Evolution, git-send-email, stg mail, ...) ○ Write, build & test code (Xen, KVM, Libvirt, QEMU) ○ Work with the Open Build Service (OBS) ○ Browse Web ○ Test OSes in VMs ○ Meetings / Video calls / Online conferences ○ Chat, work and personal ○ Some 3D Printing ○ Occasionally play games ○ Occasional video-editing ○ Maybe scan / print some document 2 ● Can all of the above be done with an immutable OS ? Immutable OS: What ? Either: ● An OS that you cannot modify Or, at least: ● An OS that you will have an hard time modifying What do you mean “modify” ? ● E.g., installing packages ● ⇒ An OS on which you cannot install packages ● ⇒ An OS on which you will have an hard time installing packages 3 Immutable OS: What ? Seriously? 4 Immutable OS: Why ? Because it will stay clean and hard to break ● Does this sound familiar? ○ Let’s install foo, and it’s dependency, libfoobar_1 ○ Let’s install bar (depends from libfoobar_1, we have it already) ○ Actually, let’s add an external repo. It has libfoobar_2 that makes foo work better! ○ Oh no... libfoobar_2 would break bar!! ● Yeah. It happens. Even in the best families distros
    [Show full text]
  • Lab 09: Operating System Basics
    ESE 150 – Lab 09: Operating System Basics LAB 09 Today’s Lab has the following objectives: 1. Learn how to remotely log into Eniac Linux server 2. Learn some of the basics of process management on the Linux Operating System This lab will take place in Ketterer (Moore 200). Background: OPERATING SYSTEMS We learned in lecture that a CPU can really only execute one task or instruction (like ADD or SUBTRACT, etc) at a time. The Operating System is a program that runs on a CPU with the job of managing the CPU’s time. It schedules programs that user’s would like run for time on the CPU, essentially its main job is to keep the CPU busy. Another aspect of the OS is to protect access to the hardware that surrounds the CPU (like input and output devices – keyboards, mice, etc.) so that programs don’t have direct access to the hardware, but instead ask the OS for permission to access it. This also lends itself to “virtualizing” the CPU and its hardware so that each program that runs on the CPU believes it is the only program running on the CPU at any given time. Before the personal computer existed, before Mac OS and Windows came into being, an operating system named UNIX was written to manage large computers at AT&T Bell Laboratories in the 1970s that became a model for modern operating systems (like Windows, and Mac OSX). In the 1990’s an operating system named Linux was invented modeled very heavily on the UNIX operating system.
    [Show full text]
  • Linux Performance Tools
    Linux Performance Tools Brendan Gregg Senior Performance Architect Performance Engineering Team [email protected] @brendangregg This Tutorial • A tour of many Linux performance tools – To show you what can be done – With guidance for how to do it • This includes objectives, discussion, live demos – See the video of this tutorial Observability Benchmarking Tuning Stac Tuning • Massive AWS EC2 Linux cloud – 10s of thousands of cloud instances • FreeBSD for content delivery – ~33% of US Internet traffic at night • Over 50M subscribers – Recently launched in ANZ • Use Linux server tools as needed – After cloud monitoring (Atlas, etc.) and instance monitoring (Vector) tools Agenda • Methodologies • Tools • Tool Types: – Observability – Benchmarking – Tuning – Static • Profiling • Tracing Methodologies Methodologies • Objectives: – Recognize the Streetlight Anti-Method – Perform the Workload Characterization Method – Perform the USE Method – Learn how to start with the questions, before using tools – Be aware of other methodologies My system is slow… DEMO & DISCUSSION Methodologies • There are dozens of performance tools for Linux – Packages: sysstat, procps, coreutils, … – Commercial products • Methodologies can provide guidance for choosing and using tools effectively • A starting point, a process, and an ending point An#-Methodologies • The lack of a deliberate methodology… Street Light An<-Method 1. Pick observability tools that are: – Familiar – Found on the Internet – Found at random 2. Run tools 3. Look for obvious issues Drunk Man An<-Method • Tune things at random until the problem goes away Blame Someone Else An<-Method 1. Find a system or environment component you are not responsible for 2. Hypothesize that the issue is with that component 3. Redirect the issue to the responsible team 4.
    [Show full text]
  • Free As in Freedom
    Daily Diet Free as in freedom ... • The freedom to run the program, for any purpose (freedom 0). Application Seen elsewhere Free Software Choices • The freedom to study how the program works, and adapt it to Text editor Wordpad Kate / Gedit/Vi/ Emacs your needs (freedom 1). Access to the source code is a precondition for this. Office Suite Microsoft Office KOffice / Open Office • The freedom to redistribute copies so you can help your Word Processor Microsoft Word Kword / Writer Presentation PowerPoint KPresenter / Impress neighbor (freedom 2). Spreadsheet Excel Kexl / Calc • The freedom to improve the program, and release your Mail & Info Manager Outlook Thunderbird / Evolution improvements to the public, so that the whole community benefits (freedom 3). Access to the source code is a Browser Safari, IE Konqueror / Firefox precondition for this. Chat client MSN, Yahoo, Gtalk, Kopete / Gaim IRC mIRC Xchat Non-Kernel parts = GNU (GNU is Not Unix) [gnu.org] Netmeeting Ekiga Kernel = Linux [kernel.org] PDF reader Acrobat Reader Kpdf / Xpdf/ Evince GNU Operating Syetem = GNU/Linux or GNU+Linux CD - burning Nero K3b / Gnome Toaster Distro – A flavor [distribution] of GNU/Linux os Music, video Winamp, Media XMMS, mplayer, xine, player rythmbox, totem Binaries ± Executable Terminal>shell>command line – interface to type in command Partition tool Partition Magic Gparted root – the superuser, administrator Graphics and Design Photoshop, GIMP, Image Magick & Corel Draw Karbon14,Skencil,MultiGIF The File system Animation Flash Splash Flash, f4l, Blender Complete list- linuxrsp.ru/win-lin-soft/table-eng.html, linuxeq.com/ Set up Broadband Ubuntu – set up- in terminal sudo pppoeconf.
    [Show full text]
  • Python Workflows on HPC Systems
    Python Workflows on HPC Systems Dominik Strassel1; , Philipp Reusch1; and Janis Keuper2;1; 1CC-HPC, Fraunhofer ITWM, Kaiserslautern, Germany 2Institute for Machine Learning and Analytics, Offenburg University,Germany Abstract—The recent successes and wide spread application of phenomenon that regularly causes following GPU-jobs compute intensive machine learning and data analytics methods to crash when these processes are still occupying GPU have been boosting the usage of the Python programming lan- memory. guage on HPC systems. While Python provides many advantages for the users, it has not been designed with a focus on multi- • Python jobs appear to be “escaping” the resource con- user environments or parallel programming - making it quite trol mechanisms of batch systems on a regular basis, challenging to maintain stable and secure Python workflows on a allocating more memory and CPU cores than scheduled HPC system. In this paper, we analyze the key problems induced - hence, affecting other users on the system. by the usage of Python on HPC clusters and sketch appropriate • The maintenance and management of the diverse and workarounds for efficiently maintaining multi-user Python soft- ware environments, securing and restricting resources of Python fast evolving Python software environment is quite jobs and containing Python processes, while focusing on Deep challenging, especially when the needs of a diverse user Learning applications running on GPU clusters. group are contradicting. Index Terms—high performance computing, python, deep This paper presents the intermediate results of our ongoing learning, machine learning, data analytics investigation of causes and possible solutions to these prob- lems in the context of machine learning applications on GPU- I.
    [Show full text]