Naming and Directories

Total Page:16

File Type:pdf, Size:1020Kb

Naming and Directories Naming and Directories Sarah Diesburg Operating Systems CS 3430 Recall from the last time… A file header associates the file with its data blocks File Header Storage Under UNIX, a file header is stored in a data structure called i-node For early UNIX systems I-nodes are stored in a special array Fixed number of array entries . Maximum number of files fixed Not stored near data blocks on disk . Reading a small file involves . One disk seek to get the i-node . Other disk seek(s) to get file blocks Reasons for Separate Allocations Reliability Data corruptions are unlikely to affect i-nodes Reduced fragmentation File headers are smaller than a whole block By packing them in an array, multiple headers can be fetched from disk File headers are accessed more often e.g., ls Grouping file headers improves disk efficiency More recently Portions of file header array stored on each cylinder For small directories All file headers and data stored in the same cylinder Reduce seek time Naming Remember that odd moment when your computer asks you to name the first file? Naming: allows users to issue file names instead of i-node numbers - Users tend to come up with poor names e.g., test - Many file are difficult to name… How do you name these photos? Directories A table of file names and their i-node numbers Under many file systems Directories are implemented as normal files Containing file names and i_node numbers Only the OS is permitted to modify directories Name Space Flat name space Hierarchical naming Relational name space Contextual naming Content-based naming Flat Name Space All files are stored in a single directory + Easy to implement - Not scalable for large directories Name collisions: multiple files with the same names Hierarchical Naming Uses multiple levels of directories Most popular name space organization + Conceptual model maps well into the human model of organizing things A file cabinet contains many files + Scalable The probability of name collisions decreases + Spatial locality Store all files under a directory within a cylinder to avoid disk seeks More on Hierarchical Naming Absolute path name: consisting the path from the root directory ‘/’ to the file e.g., /pets/cat.jpg root directory sub directory file name Drawbacks of Hierarchical Naming - Not all files can fit into the hierarchical model pets pests ? ? - Accessing a file may involve many levels of directory lookups, or a path resolution before getting to the file content An Example of Path Resolution To access the data content of /pets/cat.jpg The system needs to perform the following disk I/Os An Example of Path Resolution To access the data content of /pets/cat.jpg The system needs to perform the following disk I/Os 1. Read in the file header for the root directory ‘/’ Stored at a fixed location on disk / An Example of Path Resolution To access the data content of /pets/cat.jpg The system needs to perform the following disk I/Os 2. Read the first data block for the root directory Lookup the directory entry for pets / pets An Example of Path Resolution To access the data content of /pets/cat.jpg The system needs to perform the following disk I/Os 3. Read the file header for pets / pets pets An Example of Path Resolution To access the data content of /pets/cat.jpg The system needs to perform the following disk I/Os 4. Read the first data block for the pet directory Lookup the directory entry for cat.jpg / pets pets cat An Example of Path Resolution To access the data content of /pets/cat.jpg The system needs to perform the following disk I/Os 5. Read the file header for cat.jpg / pets cat pets cat An Example of Path Resolution To access the data content of /pets/cat.jpg The system needs to perform the following disk I/Os 6. Read the data block for cat.jpg / pets cat pets cat Some Performance Optimizations… Top-level directories are usually cached A user inside a directory (e.g., /pets) Can issue relative path names (e.g., cat.jpg) to refer files within the current directory Relational Name Space Hierarchical naming model is largely a tree One step beyond is the relational naming model, which allows the construction of general graphs A file can belong to multiple folders According to its attributes Files can be accessed in a manner similar to relational databases e.g., keywords: cats and binder Pros and Cons of Relational Name Space + More flexible than hierarchical naming - May require a long list of attributes to name a single piece of data e.g., this lecture Keywords: operating systems, file systems, naming, too many cat pics, etc . - Who will create those attributes? Contextual Naming Takes advantage of the observation that certain attributes can be added automatically e.g., when you try to open a file by Word, a system will search only the file types supported by Word (.doc, .txt, .html) + Avoids a long list of attributes - A user may not remember the file name Content-Based Naming Searches a file by its content instead of names File contents are extracted automatically e.g., I want a photo of a cat taken five years ago The system returns all files satisfying the criteria Content-Based Naming - Requires advanced information processing techniques e.g., image recognition Many existing systems use manual indexing Automated content-based naming is still an active area of research Example: The “Internet File System” Can be viewed as a worldwide file system What is the naming scheme for the Internet file system? The “Internet File System” Contains shades of various naming schemes Flat name space: Each URL provides a unique name Hierarchical name space: Within individual websites Relational name space Can search the Internet via search engines Contextual name space: Page ranked according to relevance Content-based name space: You can find your information without knowing the exact file names Example: Plan 9 Modern UNIX has a deep-rooted influence from the Plan 9 OS Developed by Bell lab Major design philosophy: everything is a file A single hierarchical name space for Processes (e.g., /proc) Files IPC (e.g., pipe) Devices (e.g., /dev/fd0) Use open/close/read/write for everything e.g., /dev/mem .
Recommended publications
  • Openvms: an Introduction
    The Operating System Handbook or, Fake Your Way Through Minis and Mainframes by Bob DuCharme VMS Table of Contents Chapter 7 OpenVMS: An Introduction.............................................................................. 7.1 History..........................................................................................................................2 7.1.1 Today........................................................................................................................3 7.1.1.1 Popular VMS Software..........................................................................................4 7.1.2 VMS, DCL................................................................................................................4 Chapter 8 Getting Started with OpenVMS........................................................................ 8.1 Starting Up...................................................................................................................7 8.1.1 Finishing Your VMS Session...................................................................................7 8.1.1.1 Reconnecting..........................................................................................................7 8.1.2 Entering Commands..................................................................................................8 8.1.2.1 Retrieving Previous Commands............................................................................9 8.1.2.2 Aborting Screen Output.........................................................................................9
    [Show full text]
  • MS-DOS Basics.Pdf
    MS-DOS Basics The Command Prompt When you first turn on your computer, you will see some cryptic information flash by. MS-DOS displays this information to let you know how it is configuring your computer. You can ignore it for now. When the information stops scrolling past, you'll see the following: C:\> This is called the command prompt or DOS prompt. The flashing underscore next to the command prompt is called the cursor. The cursor shows where the command you type will appear. Type the following command at the command prompt: ver The following message appears on your screen: MS-DOS version 6.22 Viewing the Contents of a Directory To view the contents of a directory 1. Type the following at the command prompt: dir A list similar to the following appears: Changing Directories To change from the root directory to the WINDOWS directory To change directories, you will use the cd command. The cd command stands for "change directory." 1. Type the following at the command prompt: cd windows The command prompt changes. It should now look like the following: C:\WINDOWS> Next, you will use the dir command to view a list of the files in the DOS directory. Viewing the Contents of WINDOWS Directory To view a list of the files in the WINDOWS directory 1. Type the following at the command prompt: dir Changing Back to the Root Directory To change to the root directory 1. Type the following at the command prompt: cd \ Note that the slash you type in this command is a backslash (\), not a forward slash (/).
    [Show full text]
  • MS-DOS Lecture
    MS-DOS 2017 University of Babylon College of Engineering Electrical Department Learning Basics of MS-DOS Assis. Lec. Abeer Abd Alhameed | 1 MS-DOS 2017 Outcomes: By the end of this lecture, students are able to: Define the MS-DOS system Log in MS-DOS commands system Display MS-DOS information on your computer Type basic commands of MS-DOS system (view directory contents, change directory, make directory) Assis. Lec. Abeer Abd Alhameed | 2 MS-DOS 2017 Learning of MS-DOS Basics: Definition - What does Microsoft Disk Operating System (MS- DOS) mean? The Microsoft Disk Operating System (MS-DOS) is an operating system developed for PCs (personal computers) with x86 microprocessors. It was the first widely-installed operating system in personal computers. It is a command-line-based system, where all commands are entered in text form and there is no graphical user interface. The Command Prompt: When you first turn on your computer, you will see some information flash by. MS-DOS displays this information to let you know how it is configuring your computer. You can ignore it for now. When the information stops scrolling past, you'll see the following: C:\> This is called the command prompt or DOS prompt. The flashing underscore next to the command prompt is called the cursor. The cursor shows where the command you type will appear. Typing a Command: This section explains how to type a command at the command prompt and demonstrates the "Bad command or file name" message. • To type a command at the command prompt 1. Type the following at the command prompt (you can type the command in either uppercase or lowercase letters): nul If you make a typing mistake, press the BACKSPACE key to erase the mistake, and then try again.
    [Show full text]
  • CS 103 Lab 1 - Linux and Virtual Machines
    CS 103 Lab 1 - Linux and Virtual Machines 1 Introduction In this lab you will login to your Linux VM and write your first C/C++ program, compile it, and then execute it. 2 What you will learn In this lab you will learn the basic commands and navigation of Linux/Unix, its file system, the GNU C/C++ compiler and a few basic applications such as Gedit. Important: The Linux operating system and environment shares a vast majority of commands and methods with Unix. 3 Background Information and Notes 3.1 Software to Install on your PC Start by following the course virtual machine installation instructions found at the link below. http://cs103.usc.edu/tools-and-links/installing-course-vm/ Below is a list of recommended software you should install that will be helpful over multiple courses in CS and EE. These tools allow you to access remote servers, run GUI apps on those servers, and transfer files between your PC and those servers. For Windows: FileZilla FTP – Available from : https://software.usc.edu/index.aspx XWin-32 – Available from : https://software.usc.edu/index.aspx PuTTY – Available from : https://software.usc.edu/index.aspx For Mac: X Server: http://developer.apple.com/opensource/tools/runningx11.html Fetch FTP – Available from : https://software.usc.edu/index.aspx Reference: http://www.usc.edu/its/unix/ Last Revised: 8/29/2014 1 CS 103 Lab 1 - Linux and Virtual Machines 3.2 Getting Started with Unix1 and Accessing your Account Solaris vs. Unix vs. Linux UNIX was developed by AT&T Bell Labs in 1969.
    [Show full text]
  • How to Load Vista Or Windows 7 Onto a Bootable Thumb Drive
    STAR Watch Statewide Technology Assistance Resources Project A publication of the Western New York Law Center,Inc. Volume 15 Issue 5 Sept-Oct 2011 How to Load Vista or Windows 7 onto a Bootable Thumb Drive Ever since the capacity of USB thumb more robust. What happens when a drives rose into the multi-gigabyte range, DVD gets scratched? computer geeks have been trying to use them to create bootable devices that • Some of the latest computers don’t could be used in an emergency to boot have DVD drives, but they do have a up a failed computer. It was a wonderful USB port. idea, except for one detail: The driver • It takes less time to re-install needed to read the Windows install files Windows from a thumb drive could not be accessed. With the release of Vista and Windows 7 operating Find yourself a suitable thumb drive. It systems, the drivers needed to read the might be possible to shoehorn the files have been made more accessible. It Windows software onto a 4GB thumb is now possible to create a bootable drive, but that would leave no room for thumb drive that can be used to boot up anything else (It might be nice to have a computer and install Windows. copies of the install programs for things like printer drivers or other software that So, what is the big deal? Isn’t a DVD good enough? For many people, a DVD is quite adequate. Just store it in a safe In this issue… place and pull it out when it is needed.
    [Show full text]
  • Linux File System and Linux Commands
    Hands-on Keyboard: Cyber Experiments for Strategists and Policy Makers Review of the Linux File System and Linux Commands 1. Introduction Becoming adept at using the Linux OS requires gaining familiarity with the Linux file system, file permissions, and a base set of Linux commands. In this activity, you will study how the Linux file system is organized and practice utilizing common Linux commands. Objectives • Describe the purpose of the /bin, /sbin, /etc, /var/log, /home, /proc, /root, /dev, /tmp, and /lib directories. • Describe the purpose of the /etc/shadow and /etc/passwd files. • Utilize a common set of Linux commands including ls, cat, and find. • Understand and manipulate file permissions, including rwx, binary and octal formats. • Change the group and owner of a file. Materials • Windows computer with access to an account with administrative rights The Air Force Cyber College thanks the Advanced Cyber Engineering program at the Air Force Research Laboratory in Rome, NY, for providing the information to assist in educating the general Air Force on the technical aspects of cyberspace. • VirtualBox • Ubuntu OS .iso File Assumptions • The provided instructions were tested on an Ubuntu 15.10 image running on a Windows 8 physical machine. Instructions may vary for other OS. • The student has administrative access to their system and possesses the right to install programs. • The student’s computer has Internet access. 2. Directories / The / directory or root directory is the mother of all Linux directories, containing all of the other directories and files. From a terminal users can type cd/ to move to the root directory.
    [Show full text]
  • Jailbreak Ios 12.1.1 As a Case Study
    OPEN ACCESS Ind. Journal on Computing ISSN 2460-9056 Vol. 4, Issue. 2, Sept 2019. pp. 205-218 socj.telkomuniversity.ac.id/indojc doi:10.21108/indojc.2019.4.2.349 Digital Forensic Analysis on iDevice: Jailbreak iOS 12.1.1 as a Case Study Amin Aenurahman Ali 1, Niken Dwi Wahyu Cahyani 2, Erwid Musthofa Jadied 3 1,2,3 Informatics, School of Computing, Telkom University Jl. Telekomunikasi No. 1 Terusan Buah Batu, Bandung, Indonesia 1 [email protected] 2 [email protected] 3 [email protected] Abstract Jailbreak has an issue in data alteration, as it modifies file(s) in the device to allow user to extract more data than without jailbreaking. This issue raises controversy of the use of jailbreaking in digital forensic investigation, as data integrity is a prominent requirement in a court proceeding. This study aims to analyze the process of jailbreak, what is actually done by the jailbreak code in a device, and what data is actually modified by the jailbreak code. By using the latest version of iOS system, this study uses the voucher_swap exploit as a representation of semi-tethered jailbreaking method to investigate the effects of jailbreak on data integrity on a idevice. The investigation is conducted based on to what extent data can be extracted from the jailbreak device, hash value comparison of the data, and source code analysis to scrutinize the effect of jailbreak to the system and user data inside the device. Results of this study suggest that jailbreak is acceptable to prepare idevice in digital forensic investigations to acquire more data, as it maintains the integrity of user data.
    [Show full text]
  • Apple File System Reference
    Apple File System Reference Developer Contents About Apple File System 7 General-Purpose Types 9 paddr_t .................................................. 9 prange_t ................................................. 9 uuid_t ................................................... 9 Objects 10 obj_phys_t ................................................ 10 Supporting Data Types ........................................... 11 Object Identifier Constants ......................................... 12 Object Type Masks ............................................. 13 Object Types ................................................ 14 Object Type Flags .............................................. 20 EFI Jumpstart 22 Booting from an Apple File System Partition ................................. 22 nx_efi_jumpstart_t ........................................... 24 Partition UUIDs ............................................... 25 Container 26 Mounting an Apple File System Partition ................................... 26 nx_superblock_t ............................................. 27 Container Flags ............................................... 36 Optional Container Feature Flags ...................................... 37 Read-Only Compatible Container Feature Flags ............................... 38 Incompatible Container Feature Flags .................................... 38 Block and Container Sizes .......................................... 39 nx_counter_id_t ............................................. 39 checkpoint_mapping_t ........................................
    [Show full text]
  • File Systems
    File Systems CS 4410 Operating Systems [R. Agarwal, L. Alvisi, A. Bracy, M. George, E. Sirer, R. Van Renesse] The abstraction stack I/O systems are accessed Application through a series of layered Library abstractions File System File System API Block Cache& Performance Block Device Interface Device DriverDevice Access Memory-mapped I/O, DMA, Interrupts Physical Device The Block Cache Application Library • a cache for the disk File System File System API • caches recently read blocks Block Cache& Performance • buffers recently written blocks • serves as synchronization point Block Device Interface (ensures a block is only fetched Device DriverDevice Access once) Memory-mapped I/O, DMA, Interrupts Physical Device More Layers (not a 4410 focus) • allows data to be read or Application written in fixed-sized blocks Library • uniform interface to disparate devices File System File System API • translate between OS Block Cache& Performance abstractions and hw-specific Block Device Interface details of I/O devices Device DriverDevice Access • Control registers, bulk data Memory-mapped I/O, transfer, OS notifications DMA, Interrupts Physical Device Where shall we store our data? Process Memory? (why is this a bad idea?) 5 File Systems 101 Long-term Information Storage Needs • large amounts of information • information must survive processes • need concurrent access by multiple processes Solution: the File System Abstraction • Presents applications w/ persistent, named data • Two main components: • Files • Directories 6 The File Abstraction • File: a named collection of data • has two parts • data – what a user or application puts in it - array of untyped bytes • metadata – information added and managed by the OS - size, owner, security info, modification time 7 First things first: Name the File! 1.
    [Show full text]
  • Unix-Like Access Permissions in Fully Decentralized File Systems Johanna Amann, Thomas Fuhrmann Technische Universität München, Germany
    Unix-like Access Permissions in Fully Decentralized File Systems Johanna Amann, Thomas Fuhrmann Technische Universität München, Germany 1 Each user and each group owns a dedicated Features: / (root) home amann Documents poster.pdf directory tree. It contains all data belonging to - Unix-like permissions on untrusted storage the user/group. A hash-tree secures the - enforced only by cryptography directory tree. The top-level directory is signed. - fork consistency i.e. resistent against Thus the whole tree can be verified. rollback attacks Providing Confidentiality, Authenticity, and 28876FF... Integrity hash of directory - fast, only requires symmetric cryptography superuser and subdirectories Access Permissions on Fully Decentralized Version: 10 Untrusted Storage - ACLs can be layered on top of this approach, Directory version albeit with considerable overhead - works on block/chunk oriented storage Hash and version are signed by user/group 2 5 The visible root of the file system is All users have access to the keys contained within the dedicated directory, which stores the data directory structure of the file-system needed to verify user signatures. The superuser. superuser hash tree protects the 2 837561A... 1B05524... signatures. 3 / home Redirects glue the different user- 6 and group directory structures 28876FF... 1 Groups are split into a public and B55A142... 7B3220A... superuser together. home amann a private part. The pointers to the Version: 10 private subdirectory are encrypted Files and directories are referenced FAD2452... with the current group key. 7A35209... 5 B70462F... A22A182... 3 multiple times in the hierarchy. amann .users amann Documents Version: 5 Group keys are distributed to users using the subset difference algorithm.
    [Show full text]
  • Working with the File System, Configuration Files, and Software Images
    Working with the File System, Configuration Files, and Software Images This appendix describes how to manipulate the router flash file system, how to copy configuration files, and how to download software images to a router. Working with the File System Working with Configuration Files Working with Software Images Working with the File System Commands in this document use URLs as part of the command syntax. URLs used in the Cisco 910 Industrial Router file system contain the following two parts: File system or network prefix File identification suffix The following tables list URL keywords that can be used in the source-url and destination-url arguments for all commands in this document. The prefixes listed below can also be used in the filesystem arguments in this document. Table 5 lists common URL network prefixes used to indicate a device on the network. Table 5 Network Prefixes, Descriptions, and Formats Prefix Description Format ftp Specifies a File Transfer Protocol [[//[username[:password]@]location]/directory]/filename (FTP) network server. For example: ftp://network-config (prefix://filename) ftp://jeanluc:[email protected]/ship-config tftp Specifies a TFTP server. tftp:[[//location]/directory]/filename Table 6 common URL prefixes used to indicate memory locations on the system. Cisco Systems, Inc. www.cisco.com 1 Working with the File System, Configuration Files, and Software Images Table 6 URL Prefixes and Descriptions Prefix Description flash0 On board NAND flash memory, corresponding to /dev/mtd6 which is mounted as /mnt/apps. flash1 On board NAND flash memory, corresponding to /dev/mtd7 which is mounted as /mnt/data.
    [Show full text]
  • File Allocation Table - Wikipedia, the Free Encyclopedia Page 1 of 22
    File Allocation Table - Wikipedia, the free encyclopedia Page 1 of 22 File Allocation Table From Wikipedia, the free encyclopedia File Allocation Table (FAT) is a file system developed by Microsoft for MS-DOS and is the primary file system for consumer versions of Microsoft Windows up to and including Windows Me. FAT as it applies to flexible/floppy and optical disc cartridges (FAT12 and FAT16 without long filename support) has been standardized as ECMA-107 and ISO/IEC 9293. The file system is partially patented. The FAT file system is relatively uncomplicated, and is supported by virtually all existing operating systems for personal computers. This ubiquity makes it an ideal format for floppy disks and solid-state memory cards, and a convenient way of sharing data between disparate operating systems installed on the same computer (a dual boot environment). The most common implementations have a serious drawback in that when files are deleted and new files written to the media, directory fragments tend to become scattered over the entire disk, making reading and writing a slow process. Defragmentation is one solution to this, but is often a lengthy process in itself and has to be performed regularly to keep the FAT file system clean. Defragmentation should not be performed on solid-state memory cards since they wear down eventually. Contents 1 History 1.1 FAT12 1.2 Directories 1.3 Initial FAT16 1.4 Extended partition and logical drives 1.5 Final FAT16 1.6 Long File Names (VFAT, LFNs) 1.7 FAT32 1.8 Fragmentation 1.9 Third party
    [Show full text]