File Organization & Management

Total Page:16

File Type:pdf, Size:1020Kb

File Organization & Management 1 UNESCO -NIGERIA TECHNICAL & VOCATIONAL EDUCATION REVITALISATION PROJECT -PHASE II NATIONAL DIPLOMA IN COMPUTER TECHNOLOGY File Organization and Management YEAR II- SE MESTER I THEORY Version 1: December 2008 1 2 Table of Contents WEEK 1 File Concepts .................................................................................................................................6 Bit: . .................................................................................................................................................7 Binary digit .....................................................................................................................................8 Representation ...............................................................................................................................9 Transmission ..................................................................................................................................9 Storage ............................................................................................................................................9 Storage Unit .....................................................................................................................................9 Abbreviation and symbol ............................................................................................................ 10 More than one bit ......................................................................................................................... 11 Bit, trit, dontcare, what? .............................................................................................................. 12 RfC on trivial bits ......................................................................................................................... 12 Alternative words ......................................................................................................................... 15 WEEK 2 Identifying and organizing files .................................................................................................. 16 WEEK 3 File system .................................................................................................................................... 32 Aspects of file systems ............................................................................................................... 32 File names ..................................................................................................................................... 33 Metadata ........................................................................................................................................ 33 Hierarchical file systems............................................................................................................. 34 Facilities ........................................................................................................................................ 34 Secure access .............................................................................................................................. 34 WEEK 6 Types of file systems .................................................................................................................. 35 Disk file systems .......................................................................................................................... 35 Flash file systems ........................................................................................................................ 35 Database file systems ................................................................................................................. 36 Transactional file systems .......................................................................................................... 36 Network file systems ................................................................................................................... 37 Special purpose file systems ..................................................................................................... 37 2 3 File systems and operating systems ......................................................................................... 38 Flat file systems ........................................................................................................................... 38 File systems under Unix-like operating systems ..................................................................... 39 File systems under Plan 9 from Bell Labs ................................................................................ 42 File systems under Microsoft Windows .................................................................................... 44 WEEK 7 Storing files .................................................................................................................................. 47 Backing up files ........................................................................................................................... 47 Purpose of storage ...................................................................................................................... 76 Primary storage ............................................................................................................................ 77 Secondary storage....................................................................................................................... 80 Tertiary storage ............................................................................................................................ 81 Off-line storage ............................................................................................................................ 82 Characteristics of storage .......................................................................................................... 83 Volatility ........................................................................................................................................ 84 Differentiation ............................................................................................................................... 84 Mutability ...................................................................................................................................... 84 Accessibility ................................................................................................................................. 85 Addressability .............................................................................................................................. 85 Capacity ........................................................................................................................................ 86 Performance ................................................................................................................................. 87 Fundamental storage technologies ........................................................................................... 87 Semiconductor ............................................................................................................................. 87 Magnetic ........................................................................................................................................ 88 Optical ........................................................................................................................................... 88 Paper ............................................................................................................................................. 89 Uncommon ................................................................................................................................... 89 Related technologies ................................................................................................................... 91 Network connectivity ................................................................................................................... 91 Robotic storage ............................................................................................................................ 91 File Processing ............................................................................................................................. 107 File Processing Activities ......................................................................................................... 108 3 4 Technology ............................................................................................................................................ 130 Program execution .............................................................................................................................. 130 Interrupts ................................................................................................................................................ 130 Protected mode and supervisor mode ........................................................................................... 131 Memory management ......................................................................................................................... 133 Virtual memory ..................................................................................................................................... 134 Multitasking ........................................................................................................................................... 135 Disk access
Recommended publications
  • Java Implementation of the Graphical User Interface of the Octopus Distributed Operating System
    Java implementation of the graphical user interface of the Octopus distributed operating system Submitted by Aram Sadogidis Advisor Prof. Spyros Lalis University of Thessaly Volos, Greece October 2012 Acknowledgements I am sincerely grateful for all the people that supported me during my Uni- versity studies. Special thanks to professor Spyros Lalis, my mentor, who had decisive influence in shaping my character as an engineer. Also many thanks to my family and friends, whose support all these years, encouraged me to keep moving forward. 1 Contents 1 Introduction 4 2 System software technologies 6 2.1 Inferno OS . 6 2.2 JavaSE and Android framework . 8 2.3 Synthetic file systems . 10 2.3.1 Styx . 10 2.3.2 Op . 12 3 Octopus OS 14 3.1 UpperWare architecture . 14 3.2 Omero, a filesystem based window system . 16 3.3 Olive, the Omero viewer . 19 3.4 Ox, the Octopus shell . 21 4 Java Octopus Terminal 23 4.1 JOlive . 24 4.2 Desktop version . 25 4.2.1 Omero package . 26 4.2.2 ui package . 27 4.3 Android version . 28 4.3.1 com.jolive.Omero . 28 4.3.2 com.jolive.ui . 29 4.3.3 Pull application's UI . 30 5 Future perspective 33 5.1 GPS resources . 33 5.2 JOp . 34 5.3 Authentication device . 34 5.4 Remote Voice commander . 34 5.5 Conclusion . 35 6 Thesis preview in Greek 38 2 List of Figures 2.1 An application operates on a synthetic file as if it is a disk file, effectively communicating with a synthetic file system server.
    [Show full text]
  • MOAT004 1 Eprint Cs.DC/0306067 Computing in High Energy and Nuclear Physics, 24-28 March 2003, La Jolla, California Resources
    Computing in High Energy and Nuclear Physics, 24-28 March 2003, La Jolla, California The AliEn system, status and perspectives P. Buncic Institut für Kernphysik, August-Euler-Str. 6, D-60486 Frankfurt, Germany and CERN, 1211, Geneva 23, Switzerland A. J. Peters, P.Saiz CERN, 1211, Geneva 23, Switzerland In preparation of the experiment at CERN's Large Hadron Collider (LHC), the ALICE collaboration has developed AliEn, a production environment that implements several components of the Grid paradigm needed to simulate, reconstruct and analyse data in a distributed way. Thanks to AliEn, the computing resources of a Virtual Organization can be seen and used as a single entity – any available node can execute jobs and access distributed datasets in a fully transparent way, wherever in the world a file or node might be. The system is built aroun d Open Source components, uses the Web Services model and standard network protocols to implement the computing platform that is currently being used to produce and analyse Monte Carlo data at over 30 sites on four continents. Several other HEP experiments as well as medical projects (EU MammoGRID, INFN GP -CALMA) have expressed their interest in AliEn or some components of it. As progress is made in the definition of Grid standards and interoperability, our aim is to interface AliEn to emerging products from both Europe and the US. In particular, it is our intention to make AliEn services compatible with the Open Grid Services Architecture (OGSA). The aim of this paper is to present the current AliEn architecture and outline its future developments in the light of emerging standards.
    [Show full text]
  • Persistent 9P Sessions for Plan 9
    Persistent 9P Sessions for Plan 9 Gorka Guardiola, [email protected] Russ Cox, [email protected] Eric Van Hensbergen, [email protected] ABSTRACT Traditionally, Plan 9 [5] runs mainly on local networks, where lost connections are rare. As a result, most programs, including the kernel, do not bother to plan for their file server connections to fail. These programs must be restarted when a connection does fail. If the kernel’s connection to the root file server fails, the machine must be rebooted. This approach suffices only because lost connections are rare. Across long distance networks, where connection failures are more common, it becomes woefully inadequate. To address this problem, we wrote a program called recover, which proxies a 9P session on behalf of a client and takes care of redialing the remote server and reestablishing con- nection state as necessary, hiding network failures from the client. This paper presents the design and implementation of recover, along with performance benchmarks on Plan 9 and on Linux. 1. Introduction Plan 9 is a distributed system developed at Bell Labs [5]. Resources in Plan 9 are presented as synthetic file systems served to clients via 9P, a simple file protocol. Unlike file protocols such as NFS, 9P is stateful: per-connection state such as which files are opened by which clients is maintained by servers. Maintaining per-connection state allows 9P to be used for resources with sophisticated access control poli- cies, such as exclusive-use lock files and chat session multiplexers. It also makes servers easier to imple- ment, since they can forget about file ids once a connection is lost.
    [Show full text]
  • Onetouch 4 Lite USB Mac User Guide
    Contents Getting Started . .1 Using the Formatting Tool . .1 Preparing the Software Manually . .4 Installing the Software . .9 Managing Your Drives . .15 Customizing the OneTouch Button . .15 Running Diagnostics . .18 Updating Your Software . .19 Backing Up & Restoring Folders . .22 Creating Backup Plans . .22 Using Simple Backup . .22 Creating a Custom Backup Plan . .26 Managing Backup Plans . .33 Editing Backup Settings . .33 Deleting Backup Plans . .36 Backing Up Manually . .37 Restoring Files . .39 OneTouch II and III Users . .42 Managing Security . .42 Using DrivePass . .42 Enabling DrivePass . 42 Unlocking Your OneTouch Drive . 45 Removing DrivePass . 50 Changing Your DrivePass Password . 52 If You Forget Your Password... .55 Synchronizing Folders . .60 Using Pre-configured Sync . .61 Using Custom Sync . .61 Completing the Sync . .64 Maxtor OneTouch IV i Removing Folders from Sync . .65 Checking Sync Status . .65 Synchronizing Manually . .66 Using the Maxtor Synchronization Window . .66 Using Automatic Overwrite . 68 Using RAID . .68 Frequently Asked Questions . .76 Index . i 072407 Maxtor OneTouch IV ii Getting Started The Maxtor OneTouch 4 drive offers these features: • Backup & Restore to protect your data • A customized OneTouch button to quickly open a frequently-used program If you are a OneTouch II or III user, you also have access to features available on that drive: • Sync to synchronize one or more folders between two or more computers • Security settings to password-protect your drive The Maxtor OneTouch software is loaded on your OneTouch drive. Because the software is configured for a Windows operating system, the software must be prepared for installation on your Macintosh. Using the Formatting Tool The Mac OneTouch 4 Formatting tool automatically prepares the Maxtor Manager software for installation on your Macintosh, To use the Mac OneTouch 4 Formatting Tool, Step 1: Connect your OneTouch 4 drive to your computer.
    [Show full text]
  • Partitioner Och Filsystem 2
    Partitioner och filsystem 2 File systems FAT Unix-like NTFS Vad är ett filsystem? • Datorer behöver en metod för att lagra och hämta data… • Referensmodell för filsystem (Carrier) – Filsystem kategori • Layout och storleksinformation – Innehålls kategori • Kluster och block – data enheter – Metadata kategori • Tidsinformation, storlek, access kontroll • Adresser till allokerade data enheter – Filnamn kategori • Oftast ihop-kopplad med metadata – Applikations kategori • Quota • Journaler • De modernaste påminner mycket om relations databaser Windows • NTFS (New Technology File System) – 6 versioner finns, de nyaste är v3.0 (Windows 2000) och v3.1 (XP, 2003, Vista, 2008, 7), kallas även 5.0, 5.1, 5.2, 6.0 och 6.1 (efter OS version) – Stöd för unicode, säkerhet, mm. - är mycket mer komplext än FAT! – http://en.wikipedia.org/wiki/Ntfs • FAT 12/16/32, VFAT (långa filnamn i Win95) – Används fortfarande men är inte effektivt för större lagringskapaciteter (klusterstorleken) – Långsammare access än NTFS • Windows Future Storage (WinFS) inställt projekt, enligt rykten var det en SQL-databas som ligger ovanpå ett NTFS filsystem – Läs mer på: http://www.ntfs.com/ – Och: http://en.wikipedia.org/wiki/WinFS FAT12, 16 och 32 • FAT12, finns på floppy diskar – Begränsad lagringskapacitet – Designat för MS-DOS 1.0 • FAT16, var designat för större diskar – Äldre OS använde detta • MS-DOS 3.0, Win95 OSR1, NT 3.5 och NT 4.0 – Max diskstorlek 2 GB • FAT32 kom när diskar större än 2GB kom – Vissa äldre och alla nya OS kan använda FAT32 • Windows 98/Me/2000/XP/2003/Vista/7 och 2008 • Begränsningar med FAT32 – Största formaterabara volymen är 32GB (större volymer kan dock användas, < 16 TiB) – Begränsade features vad gäller komprimering, kryptering, säkerhet och hastighet jämfört mot NTFS • http://en.wikipedia.org/wiki/FAT_file_system exFAT • exFAT (Extended File Allocation Table, a.k.a.
    [Show full text]
  • ® Apple® A/UXTM Release Notes Version 1.0 Ii APPLE COMPUTER, INC
    .® Apple® A/UXTM Release Notes Version 1.0 Ii APPLE COMPUTER, INC. UNIBUS, VAX, VMS, and VT100 are trademarks of Digital © Apple Computer, Inc., 1986 Equipment Corporation. 20525 Mariani Ave. Cupertino, California 95014 Simultaneously published in the (408) 996-1010 United States and Canada. Apple, the Apple logo, APPLE'S SYSTEM V AppleTalk, ImageWriter, IMPLEMENTATION A/UX LaserWriter, Macintosh, RELEASE 1.0 RUNNING ON A MacTerminal, and ProDOS are MACINTOSH II COMPUTER registered trademarks of Apple HAS BEEN TESTED BY THE Computer, Inc. AT&T-IS' SYSTEM V VERIFICATION SUITE AND Apple Desktop Bus, A!UX, CONFORMS TO ISSUE 2 OF EtherTalk, and Finder are AT&T-IS' SYSTEM V trademarks of Apple Computer, INTERFACE DEFINITION Inc. BASE PLUS KERNEL Ethernet is a registered EXTENSIONS. trademark of Xerox Corporation. IBM is a registered trademark, and PC-DOS is a trademark, of International Business Machines, Inc. - ITC Avant Garde Gothic, ITC Garamond, and ITC Zapf Dingbats are registered trademarks of International Typeface Corporation. Microsoft and MS-DOS are registered trademarks of Microsoft Corporation. NFS is a registered trademark, and Sun Microsystems is a trademark, of Sun Microsystems, Inc. NuBus is a trademark of Texas Instruments. POSTSCRIPT is a registered trademark, and TRANSCRIPT is a trademark, of Adobe Systems Incorporated. UNIX is a registered trademark of AT&T Information Systems. Introduction to A/UX Release Notes, Version 1.0 These release notes contain late-breaking information about release 1.0 of the A!UXI'M software for the Apple® Macintosh® II computer. This package contains two kinds of materials: o Specific information that was not available in time to be incorporated into the printed manuals.
    [Show full text]
  • DATARMOR and New Tools.Pdf
    JOURNÉE DE RENCONTRE DES UTILISATEURS DU PÔLE DE CALCUL INTENSIF POUR LA MER PIERRE COTTY Le programme de la journée • 9 h 40 - 12 h 10 DATARMOR: nouveau périmètre, nouvelles perspectives • Pause déjeuner : buffet • 14 h 00 - 16 h 30 DATARMOR: nouveaux champs d'applications scientifiques • Poster et Discussions autour d’un pot 17/05/2018 2 DATARMOR AND N E W T O O L S Tina ODAKA DATARMOR 17/05/2018 4 ACCES CLIENTS (10 Gigabit Ethernet connected to IFREMER and INFUSER network (SHOM / IUEM / ENSTA Bretagne Cluster HPC 426 Tflops 11 088 cores 396 Nodes Login nodes PBS Pro; sharing computing Batch system: resources PBS Pro InfiniBand FDR 17/05/2018 5 DATARMOR: not only HPC Cluster SMP Cluster Cluster HPC VIS High speed Cluster SCRATCH Network WEB Infini Band DATA DATAREF HOME DATA 17/05/2018 WORK 6 DISK • DATAREF (LUSTRE, 1.5PB = 1395TiB) • Reference data (next presentation) • DATAWORK (GPFS, 5PB = 4500TiB) • Work data • User space and project space • SCRATCH (LUSTRE 0.5PB) PB ? TiB?? • Scratch file for HPCcomparisons computation. with International System of Units (SI) prefixes • 15 days max one kibibit 1 Kibit = 210 bit = 1024 bit one kilobit 1 kbit = 103 bit = 1000 bit • DATAHOME (NFS, 0.04PB)one mebibyte 1 MiB = (210)2 B = 1 048 576 B • Source codes and softwaresone megabyte 1 MB = (103)2 B = 1 000 000 B • with backup ( tape, inone a gibibytedifferent1 GiBbuilding= (210)3 B) = 1 073 741 824 B one gigabyte 1 GB = (103)3 B = 1 000 000 000 B byte = octet( French) TiB (tebibyte) = Tio (French tébioctet) 17/05/2018 7 Clustre WEB, SMP, VIS • Cluster SMP • 1 node with 240 cores, 5 TB RAM • PBS Pro • Jobs only for huge memory, or many CPU cores.
    [Show full text]
  • Release 0.5.0 Will Mcgugan
    PyFilesystem Documentation Release 0.5.0 Will McGugan Aug 09, 2017 Contents 1 Guide 3 1.1 Introduction...............................................3 1.2 Getting Started..............................................4 1.3 Concepts.................................................5 1.4 Opening Filesystems...........................................7 1.5 Filesystem Interface...........................................7 1.6 Filesystems................................................9 1.7 3rd-Party Filesystems.......................................... 10 1.8 Exposing FS objects........................................... 10 1.9 Utility Modules.............................................. 11 1.10 Command Line Applications....................................... 11 1.11 A Guide For Filesystem Implementers.................................. 14 1.12 Release Notes.............................................. 16 2 Code Documentation 17 2.1 fs.appdirfs................................................ 17 2.2 fs.base.................................................. 18 2.3 fs.browsewin............................................... 30 2.4 fs.contrib................................................. 30 2.5 fs.errors.................................................. 32 2.6 fs.expose................................................. 34 2.7 fs.filelike................................................. 40 2.8 fs.ftpfs.................................................. 42 2.9 fs.httpfs.................................................. 43 2.10 fs.memoryfs..............................................
    [Show full text]
  • United States Patent (19) 11 Patent Number: 5,761,485 Munyan (45) Date of Patent: Jun
    USOO5761485A United States Patent (19) 11 Patent Number: 5,761,485 Munyan (45) Date of Patent: Jun. 2, 1998 54 PERSONAL ELECTRONIC BOOKSYSTEM Miyazawa et al. ("An Electronic Book: APTBook". Human-Computer Interaction-Interact '90. Proceedings of 76) Inventor: Daniel E. Munyan, 805 Mt. Gretna the IFIPTC 13 Third International Conference, 1 Jan. 1990, Rd., Elizabethtown, Pa. 17022 pp. 513-519). 21 Appl. No.: 565,915 (List continued on next page.) 22 Filed: Dec. 1, 1995 (51) Int. Cl. ............................ G06F 15/02; G06F 17/40: Primary Examiner Emanuel Todd Voeltz G09G 1/02 Assistant Examiner-Phalaka Kik 52 U.S. Cl. .............................. 395/500; 345/901; 326/8: Attorney, Agent, or Firm-Earl F. Clifford; Clifford & 395/187.01; 455/411 Clifford Law Firm 58) Field of Search .................................... 395/2.69, 500, 395/145. 2.82, 186, 187.01, 188.01, 200.09. 57 ABSTRACT 650; 455/89; 379/98. 368, 58: 348/134: The Personal Electronic Book System invention replaces a 382/14, 56; 345/192, 127, 130,901: 434/317: standard handheld book with an electronic equivalent. The 326/8; 364/286.4, 286.5, 949.81 260: 365/185.04; invention is sized and configured to be book size and to open 462/903: 463/29: 902/4 like a book for use. When opened, the user sees two facing page-like touch-sensitive, display screens with black print 56) References Cited on white background. Icons represent the electronically U.S. PATENT DOCUMENTS stored material. "artwork, audio clips, books, E-mail, faxes, 3,718,906 2/1973 Lighter.
    [Show full text]
  • Etir Code Lists
    eTIR Code Lists Code lists CL01 Equipment size and type description code (UN/EDIFACT 8155) Code specifying the size and type of equipment. 1 Dime coated tank A tank coated with dime. 2 Epoxy coated tank A tank coated with epoxy. 6 Pressurized tank A tank capable of holding pressurized goods. 7 Refrigerated tank A tank capable of keeping goods refrigerated. 9 Stainless steel tank A tank made of stainless steel. 10 Nonworking reefer container 40 ft A 40 foot refrigerated container that is not actively controlling temperature of the product. 12 Europallet 80 x 120 cm. 13 Scandinavian pallet 100 x 120 cm. 14 Trailer Non self-propelled vehicle designed for the carriage of cargo so that it can be towed by a motor vehicle. 15 Nonworking reefer container 20 ft A 20 foot refrigerated container that is not actively controlling temperature of the product. 16 Exchangeable pallet Standard pallet exchangeable following international convention. 17 Semi-trailer Non self propelled vehicle without front wheels designed for the carriage of cargo and provided with a kingpin. 18 Tank container 20 feet A tank container with a length of 20 feet. 19 Tank container 30 feet A tank container with a length of 30 feet. 20 Tank container 40 feet A tank container with a length of 40 feet. 21 Container IC 20 feet A container owned by InterContainer, a European railway subsidiary, with a length of 20 feet. 22 Container IC 30 feet A container owned by InterContainer, a European railway subsidiary, with a length of 30 feet. 23 Container IC 40 feet A container owned by InterContainer, a European railway subsidiary, with a length of 40 feet.
    [Show full text]
  • Human Services Examiner
    Cayuga County Department of Human Resources and Civil Service Commission JOB SPECIFICATION Civil Service Title: HUMAN SERVICES EXAMINER Jurisdictional Class: Competitive Civil Division: County Adoption: CSM 12/17/03 Revised: CSM 02/09/05 (Change in Title); 10/18/06; 6/14/17; 3/16/21 DISTINGUISHING FEATURES OF THE CLASS: This position exists in the Department of Social Services and involves responsibility to participate in the delivery of financial service programs including: Public Assistance, Medical Assistance, Supplemental Nutrition Assistance Program (SNAP), and Child Support Enforcement Services. The work is performed in accordance with State and Federal regulations and department policy and involves responsibility in determining financial eligibility, investigations, in-depth interviewing, establishing amounts of assistance, making appropriate referrals; and the processing and maintenance of a variety of forms and records. In addition, the incumbents may represent the department in court as custodian of record to ascertain the completeness of records. Depending upon unit and/or assignment, work is performed under the direct or general supervision of a higher-level employee with leeway allowed in the performance of work assignments. Supervision is not normally a function of the class. Does related work as required. TYPICAL WORK ACTIVITIES: (Illustrative Only) Conducts investigations, including in-depth interviews to elicit sufficient information to approve, deny or determine the feasibility of a financial service/program, make an
    [Show full text]
  • Z/OS, Language Environment, and UNIX How They Work Together
    The Trainer’s Friend, Inc. 256-B S. Monaco Parkway Telephone: (800) 993-8716 Denver, Colorado 80224 (303) 393-8716 U.S.A. Fax: (303) 393-8718 E-mail: [email protected] Internet: www.trainersfriend.com z/OS, Language Environment, and UNIX How They Work Together The following terms that may appear in these materials are trademarks or registered trademarks: Trademarks of the International Business Machines Corporation: AD/Cycle, AIX, AIX/ESA, Application System/400, AS/400, BookManager, CICS, CICS/ESA, COBOL/370, COBOL for MVS and VM, COBOL for OS/390 & VM, Common User Access, CORBA, CUA, DATABASE 2, DB2, DB2 Universal Database, DFSMS, DFSMSds, DFSORT, DOS/VSE, Enterprise System/3090, ES/3090, 3090, ESA/370, ESA/390, Hiperbatch, Hiperspace, IBM, IBMLink, IMS, IMS/ESA, Language Environment, MQSeries, MVS, MVS/ESA, MVS/XA, MVS/DFP, NetView, NetView/PC, Object Management Group, Operating System/400, OS/400, PR/SM, OpenEdition MVS, Operating System/2, OS/2, OS/390, OS/390 UNIX, OS/400, QMF, RACF, RS/6000, SOMobjects, SOMobjects Application Class Library, System/370, System/390, Systems Application Architecture, SAA, System Object Model, TSO, VisualAge, VisualLift, VTAM, VM/XA, VM/XA SP, WebSphere, z/OS, z/VM, z/Architecture, zSeries Trademarks of Microsoft Corp.: Microsoft, Windows, Windows NT, Windows ’95, Windows ’98, Windows 2000, Windows SE, Windows XP Trademark of Chicago-Soft, Ltd: MVS/QuickRef Trademark of Phoenix Software International: (E)JES Registered Trademarks of Institute of Electrical and Electronic Engineers: IEEE, POSIX Registered Trademark of The Open Group: UNIX Trademark of Sun Microsystems, Inc.: Java Registered Trademark of Linus Torvalds: LINUX Registered Trademark of Unicode, Inc.: Unicode Preface This document came about as a result of writing my first course for UNIX on the IBM mainframe.
    [Show full text]