COMP421 Unix Environment for Programmers Lecture 03: Installing Unix Jeff Wiegley, Ph.D
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
A Dynamic Bitmap for Huge File System in Sans
A Dynamic Bitmap for Huge File System in SANs G.B.Kim*, D.J.Kang*, C.S.Park*, Y.J.Lee*, B.J.Shin** *Computer System Department, Computer and Software Technology Labs. ETRI(Electronics and Telecommunications Research Institute) 161 Gajong-Dong, Yusong-Gu, Daejon, 305-350, South Korea ** Dept. of Computer Engineering, Miryang National University 1025-1 Naei-dong Miryang Gyeongnam, South Korea Abstract: - A storage area network (SAN) is a high-speed special-purpose network (or subnetwork) that interconnects different kinds of data storage devices with associated data servers on behalf of a larger network of users. In SAN, computers service local file requests directly from shared storage devices. Direct device access eliminates the server machines as bottlenecks to performance and availability. Communication is unnecessary between computers, since each machine views the storage as being locally attached. SAN provides us to very large physical storage up to 64-bit address space, but traditional file systems can’t adapt to the file system for SAN because they have the limitation of scalability. In this paper we propose a new mechanism for file system using dynamic bitmap assignment. While traditional file systems rely on a fixed bitmap structures for metadata such as super block, inode, and directory entries, the proposed file system allocates bitmap and allocation area depend on file system features. Our approaches give a solution of the problem that the utilization of the file system depends on the file size in the traditional file systems. We show that the dynamic bitmap mechanism this improves the efficiency of disk usage in file system when compared to the conventional file systems. -
Linux on the Road
Linux on the Road Linux with Laptops, Notebooks, PDAs, Mobile Phones and Other Portable Devices Werner Heuser <wehe[AT]tuxmobil.org> Linux Mobile Edition Edition Version 3.22 TuxMobil Berlin Copyright © 2000-2011 Werner Heuser 2011-12-12 Revision History Revision 3.22 2011-12-12 Revised by: wh The address of the opensuse-mobile mailing list has been added, a section power management for graphics cards has been added, a short description of Intel's LinuxPowerTop project has been added, all references to Suspend2 have been changed to TuxOnIce, links to OpenSync and Funambol syncronization packages have been added, some notes about SSDs have been added, many URLs have been checked and some minor improvements have been made. Revision 3.21 2005-11-14 Revised by: wh Some more typos have been fixed. Revision 3.20 2005-11-14 Revised by: wh Some typos have been fixed. Revision 3.19 2005-11-14 Revised by: wh A link to keytouch has been added, minor changes have been made. Revision 3.18 2005-10-10 Revised by: wh Some URLs have been updated, spelling has been corrected, minor changes have been made. Revision 3.17.1 2005-09-28 Revised by: sh A technical and a language review have been performed by Sebastian Henschel. Numerous bugs have been fixed and many URLs have been updated. Revision 3.17 2005-08-28 Revised by: wh Some more tools added to external monitor/projector section, link to Zaurus Development with Damn Small Linux added to cross-compile section, some additions about acoustic management for hard disks added, references to X.org added to X11 sections, link to laptop-mode-tools added, some URLs updated, spelling cleaned, minor changes. -
System Administration Storage Systems Agenda
System Administration Storage Systems Agenda Storage Devices Partitioning LVM File Systems STORAGE DEVICES Single Disk RAID? RAID Redundant Array of Independent Disks Software vs. Hardware RAID 0, 1, 3, 5, 6 Software RAID Parity done by CPU FakeRAID Linux md LVM ZFS, btrfs ◦ Later Hardware RAID RAID controller card Dedicated hardware box Direct Attached Storage SAS interface Storage Area Network Fiber Channel iSCSI ATA-over-Ethernet Fiber Channel Network Attached Storage NFS CIFS (think Windows File Sharing) SAN vs. NAS PARTITIONING 1 File System / Disk? 2 TB maybe… 2TB x 12? 2TB x 128 then? Partitioning in Linux fdisk ◦ No support for GPT Parted ◦ GParted Fdisk Add Partition Delete Partition Save & Exit Parted Add Partition Change Units Delete Partition No need to save Any action you do is permanent Parted will try to update system partition table Script support parted can also take commands from command line: ◦ parted /dev/sda mkpart pri ext2 1Mib 10Gib Resize (Expand) 1. Edit partition table ◦ Delete and create with same start position 2. Reload partition table ◦ Reboot if needed 3. Expand filesystem Resize (Shrink) 1. Shrink filesystem ◦ Slightly smaller than final 2. Edit partition table ◦ Delete and create with same start position 3. Reload partition table ◦ Reboot if needed 4. Expand filesystem to fit partition No Partition Moving LOGICAL VOLUME MANAGER What is LVM? A system to manage storage devices Volume == Disk Why use LVM? Storage pooling Online resizing Resize any way Snapshots Concepts Physical Volume ◦ A disk or partition Volume Group ◦ A group of PVs Logical Volume ◦ A virtual disk/partition Physical Extent ◦ Data blocks of a PV Using a partition for LVM Best to have a partition table 1. -
Multiboot Guide Booting Fedora and Other Operating Systems
Fedora 23 Multiboot Guide Booting Fedora and other operating systems. Fedora Documentation Project Copyright © 2013 Fedora Project Contributors. The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/. The original authors of this document, and Red Hat, designate the Fedora Project as the "Attribution Party" for purposes of CC-BY-SA. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version. Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law. Red Hat, Red Hat Enterprise Linux, the Shadowman logo, JBoss, MetaMatrix, Fedora, the Infinity Logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries. For guidelines on the permitted uses of the Fedora trademarks, refer to https:// fedoraproject.org/wiki/Legal:Trademark_guidelines. Linux® is the registered trademark of Linus Torvalds in the United States and other countries. Java® is a registered trademark of Oracle and/or its affiliates. XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries. MySQL® is a registered trademark of MySQL AB in the United States, the European Union and other countries. All other trademarks are the property of their respective owners. -
12. File-System Implementation
12.12. FiFilele--SystemSystem ImpImpllemeemenntattatiionon SungyoungLee College of Engineering KyungHeeUniversity ContentsContents n File System Structure n File System Implementation n Directory Implementation n Allocation Methods n Free-Space Management n Efficiency and Performance n Recovery n Log-Structured File Systems n NFS Operating System 1 OverviewOverview n User’s view on file systems: ü How files are named? ü What operations are allowed on them? ü What the directory tree looks like? n Implementor’sview on file systems: ü How files and directories are stored? ü How disk space is managed? ü How to make everything work efficiently and reliably? Operating System 2 FileFile--SySysstemtem StrStruucturecture n File structure ü Logical storage unit ü Collection of related information n File system resides on secondary storage (disks) n File system organized into layers n File control block ü storage structure consisting of information about a file Operating System 3 LayeLayerreded FFililee SystemSystem Operating System 4 AA TypicalTypical FFileile ControlControl BlockBlock Operating System 5 FileFile--SySysstemtem ImImpplementationlementation n On-disk structure ü Boot control block § Boot block(UFS) or Boot sector(NTFS) ü Partition control block § Super block(UFS) or Master file table(NTFS) ü Directory structure ü File control block (FCB) § I-node(UFS) or In master file table(NTFS) n In-memory structure ü In-memory partition table ü In-memory directory structure ü System-wide open file table ü Per-process open file table Operating -
CS 378 (Spring 2003)
Department of Computer Sciences THE UNIVERSITY OF TEXAS AT AUSTIN CS 378 (Spring 2003) Linux Kernel Programming Yongguang Zhang ([email protected]) Copyright 2003, Yongguang Zhang This Lecture • Linux File System – Overview – Four basic data structures (superblock, inode, dentry, file) • Questions? Spring 2003 © 2003 Yongguang Zhang 2 Using File Systems in UML (1) · You need a block device ± In UML: a block device can be emulated by a file ± Create a file (say, 4M in size) dd if=/dev/zero of=new_fs bs=1M count=4 · Run UML with the new block device ± With command line argument ubd1= ./linux ubd0=... ubd1=new_fs ... ± Look at /dev/ubd/: usermode:~# ls -l /dev/ubd total 0 brw-rw---- 1 root root 98, 0 Dec 31 1969 0 brw-rw---- 1 root root 98, 1 Dec 31 1969 1 Spring 2003 © 2003 Yongguang Zhang 3 Using File Systems in UML (2) · Create a new file system on the new block device ± Make a MSDOS file system: /projects/cs378.ygz/bin/mkdosfs -S 1024 -v /dev/ubd/1 ± Make a MINIX file system mkfs.minix /dev/ubd/1 ± Make a EXT2 file system mkfs.ext2 /dev/ubd/1 ± Disaster aware: never mistype as /dev/ubd/0 Spring 2003 © 2003 Yongguang Zhang 4 Using File Systems in UML (3) · You need a mount point ± Usually under /mnt mkdir /mnt/test · Mount the new block device (with filesystem) ± Give the block device file, and the mount point mount /dev/ubd/1 /mnt/test · Sysadmin tools for file systems ± mount ± umount /mnt/test Spring 2003 © 2003 Yongguang Zhang 5 Linux File Systems • The kernel subsystem that manage file system directories in kernel and external memory -
Formation Debian GNU/Linux
Formation Debian GNU/Linux Alexis de Lattre [email protected] Formation Debian GNU/Linux par Alexis de Lattre Copyright © 2002, 2003 par Alexis de Lattre Ce document est disponible aux formats : • HTML en ligne (http://people.via.ecp.fr/~alexis/formation-linux/) ou HTML zippé (http://people.via.ecp.fr/~alexis/formation-linux/formation-linux-html.zip) (3,6 Mo), • PDF zippé (http://people.via.ecp.fr/~alexis/formation-linux/formation-linux-pdf.zip) (4 Mo), • RTF zippé (http://people.via.ecp.fr/~alexis/formation-linux/formation-linux-rtf.zip) (3,5 Mo), • Texte zippé (http://people.via.ecp.fr/~alexis/formation-linux/formation-linux-txt.zip) (215 Ko). La version la plus récente de ce document se trouve à l’adresse http://people.via.ecp.fr/~alexis/formation-linux/. Vous avez le droit de copier, distribuer et/ou modifier ce document selon les termes de la GNU Free Documentation License, version 1.2 ou n’importe quelle version ultérieure, telle que publiée par la Free Software Foundation. Le texte de la licence se trouve dans l’annexe GNU Free Documentation License. Table des matières A propos de ce document ....................................................................................................................................................... i I. Installation de Debian GNU/Linux.................................................................................................................................... i 1. Linux, GNU, logiciels libres,... c’est quoi ?................................................................................................................1 -
Process Need Outline File Systems
1/26/2016 Motivation – Process Need • Processes store, retrieve information • When process terminates, memory lost Distributed Computing Systems • How to make it persist? • What if multiple processes want to share? File Systems • Requirements: – large Solution? Files – persistent are large, – concurrent access persistent! Motivation – Disk Functionality (1 of 2) Motivation – Disk Functionality (2 of 2) • Questions that quickly arise – How do you find information? – How to map blocks to files? bs – boot sector sb – super block – How do you keep one user from reading another’s data? – How do you know which blocks are free? Solution? File Systems • Sequence of fixed-size blocks • Support reading and writing of blocks Outline File Systems • Abstraction to disk (convenience) • Files (next) – “The only thing friendly about a disk is that it has • Directories persistent storage.” – Devices may be different: tape, USB, SSD, IDE/SCSI, • Disk space management NFS • Misc • Users • Example file systems – don’t care about implementation details – care about interface • OS – cares about implementation (efficiency and robustness) 1 1/26/2016 File System Concepts Files: The User’s Point of View • Files - store the data • Naming: how does user refer to it? • Directories - organize files • Does case matter? Example: blah , BLAH , Blah – Users often don’t distinguish, and in much of Internet no • Partitions - separate collections of directories (also difference (e.g., domain name), but sometimes (e.g., URL called “volumes”) path) – all directory information -
Copyrighted Material
Index alias command, 57–58 SYMBOLs alsamixer, 109–110 #! syntax, shells and, 64 AMD-V virtualization support ... (ellipses), omitted information in (svm), 298–299 code, 10 apropos command, 12–13 [ ] (brackets), testing shell scripts APT (Advanced Package Tool). See and, 65 also software, managing with APT ~. (tilde and period), exiting ssh vs. aptitude, 25 sessions and, 262 basics of, 21 > (greater-than sign) commands for security, 295 appending files and, 55 apt-get command to direct output to files, 55 update command, 35, 37 . (dots), in PATH environment clean option, 29–30 variables, 65 installing packages and, 28–29 ! (exclamation points), negating KVMs and, 301 search criterion with, 85 remove option, 29 / (forward slash), IRC commands and, aptitude. See also software, managing 253 with aptitude ; (semicolons), vi and, 315 vs. APT, 25 basics of, 21 A Aptitude Survival Guide, 35 -a option, (debsums), 42 Aptitude User’s Manual, 35 adding apt-key command, 70 content to scripts, 65–68 archives. See also backups to files to archives, 160 compressed archives groups, 286 backing up with SSH, 161–162 passwords, 281 ARP (Address Resolution Protocol), software, virtualization hosts and, 301 checking, 229–230 software collections, 24–25 ASCII art, viewing movies and, 123 text, 91, 93 ASCII text, reading, 99 user accounts,COPYRIGHTED 280–281 at command, MATERIAL 186 Address Resolution Protocol (ARP), Atheros, 225 checking, 229–230 audio, 107–117 administration of remote systems. See adjusting levels, 109–110 remote systems administration encoding, 111–114 Advanced Linux Sound Architecture files, converting, 116–117 (ALSA), 109 playing music, 107–109 Advanced Package Tool. -
A Novel Term Weighing Scheme Towards Efficient Crawl Of
International Journal of Computer Engineering and Applications, Volume X, Special Issue, ICRTCST -2016 www.ijcea.com, ISSN 2321-3469 FEATURES AND DIFFERENCES OF LINUX EXT, EXT2, EXT3 AND EXT4 FILE SYSTEMS Sanku Sinha 1, Sadique Nayeem 2 1, 2 Department of Computer Science and Engineering, R.V.S. College of Engineering and Technology, Jamshedpur ABSTRACT: File System is a way used by operating systems to store and organize files so that the files can be accessed efficiently. File system is a component of operating system and it interacts with the abstraction of the underlying hardware known as Block Layer. An open source environment like Linux has over 50 different file systems since its existence. Though, in recent years, the speed of CPUs have been increased and the Hard drive technology have tremendous growth, the file systems have also been evolved so that operating system can provide better performance to the user. To measure the performance of the file systems there are different benchmarks used by different developers. In this work, a study of Linux file system evolution has been carried out. As there are several file systems for different Linux Distributions and different Linux kernel versions, some popular versions of extended file systems like ext, ext2, ext3 and ext4 has been considered. The features and differences on the inode structures of these file systems have been discussed. Keywords: Ext, ext2, ext3, ext4, inode, Linux [1] INTRODUCTION Operating System of a particular system is chosen by a user on the basis of applications to be used or better system performance. For better system performance, the performance of the file system is a key part. -
Security by Virtualization
Security by virtualization A novel antivirus for personal computers Balduzzi Marco, 2 nd of March 2007 Master Thesis in Computer Engineering, University of Bergamo 1 This page has been left intentionally blank. 2 Content 1. Introduction .............................................................................................................. 5 1.1. Motivations....................................................................................................... 6 2. Security by virtualization........................................................................................ 10 2.1. Introduction to computer virtualization.......................................................... 10 2.2. Virtualization approach to security ................................................................ 16 3. Virus protection ...................................................................................................... 20 4. Image scan .............................................................................................................. 25 4.1. File repair........................................................................................................ 32 5. On-access scan........................................................................................................ 39 5.1. File organization............................................................................................. 48 5.2. Cache design................................................................................................... 54 5.3. Antivirus -
Linux Filesystem Comparisons
Linux Filesystem Comparisons Jerry Feldman Boston Linux and Unix Presentation prepared in LibreOffice Impress Boston Linux and Unix 12/17/2014 Background My Background. I've worked as a computer programmer/software engineer almost continually since 1972. I have used the Unix Operating System since about 1980, and Linux since about 1993. While I am not an expert in filesystems, I do have some knowledge and experience. I have been a member and director of the BLU since its founding in 1994. Linux File Systems Comparison Dec 17, 2014 2 Overview My talk is intended to focus primarily on the end user. Servers and NAS systems have different requirements, so what might be good for you may not be appropriate for a high-traffic NAS system. I will try to explain some of the file system issues that you should be aware of when you decide to install Linux. While I will mention distributions, all Linux distributions allow you to use just about any file system you want. Please feel free to ask questions at any time. Linux File Systems Comparison Dec 17, 2014 3 Terminology RAID: redundant array of independent disks RAID is used to incorporate stripe sets, and to add redundancy. In general RAID 0 is stripe, and RAID 1 is mirroring. There are other RAID levels that I won't discuss here STRIPE – Data is spanned among multiple volumes or devices. Mirroring – Data is written to 2 or more volumes Linux File Systems Comparison Dec 17, 2014 4 Terminology LVM – Logical Volume Manager. This has been around for a while.