Minor Modifications for UNIX System V Compatibility. File Access Rates Up

Total Page:16

File Type:pdf, Size:1020Kb

Minor Modifications for UNIX System V Compatibility. File Access Rates Up minor modifications for UNIX System V compatibility. File Powerfail Recovery. The HP-UX operating system on the access rates up to ten times faster than a traditional UNIX Model 840 also supports powerfail recovery. On a tempo file system have been achieved in the fast file system. rary power failure, the CPU state and data stored in the The fast file system partitions the disc into one or more cache are flushed out to memory backed up by battery. If cylinder groups, each of which consists of one or more power is restored within a short time (15 minutes for a consecutive cylinders on a disc. Inodes. which store infor 24M-byte system), all I/O devices are reset, I/O transactions mation such as file types and locations, are allocated in ongoing at the time of the power failure are restarted, CPU each cylinder to reduce disc head movement, rather than and cache states are restored, and a signal is sent to each at the beginning of a file system as in a traditional UNIX process informing it of the power failure. A process can operating system. Large data blocks with small fragments then take appropriate recovery actions. are supported to maximize disc transfer rates and minimize file system fragmentation. New data blocks are allocated Asynchronous I/O on the same cylinder as the previous block, whenever pos In a traditional UNIX operating system, a process cannot sible, with rotational latency taken into consideration. Files continue its execution until the completion of the requested belonging to the same directory are placed in the same I/O operation. The delayed write feature in a UNIX operat cylinder group whenever possible. The fast file system user ing system is an attempt to gain more parallelism in the interface is fully compatible with that of a traditional file system. However, many applications in the computer inte system. grated manufacturing market want to start multiple I/O File Locking. File locking has been added to HP-UX and operations, continue their execution, and then wait for implemented on the Model 840. Both advisory and enforce completion of all of the I/O transactions. Other applications ment mode locks are supported. An advisory lock allows may want to perform multiple asynchronous I/O operations a process to lock a region of a file to achieve exclusive use and be signaled on the completion of any of the I/O trans of the region among cooperating processes. A process can actions. The Berkeley 4.2BSD system supports asynchro still have access to an advisorily locked region if it chooses. nous I/O activities of this type. This capability has been Enforcement lock enforces exclusive access by the locking added to HP-UX and implemented on the Model 840. In process. Other processes that attempt to access the locked particular, a process can request that it be signaled when resource either return an error or sleep until the resource a certain driver state occurs. Alternatively, it can poll a becomes unlocked. The same interface has been accepted driver to determine if the driver is ready for reading or into the SVID and /usr/group standard. writing, or if it has an exceptional condition pending. It Scatter Read and Gather Write. Scatter read allows a user to read from a file and scatter the data into multiple buffers in one system call. Gather write allows a user to gather HP-UX Process Components data from multiple buffers and write it to a file in one system call. It is extremely useful for data acquisition ap plications to minimize the system call overhead. The inter face was first defined in Berkeley 4.2BSD, added to HP-UX, and implemented on the Model 840. User Control of Buffering. In traditional UNIX operating systems, the file systems store the most recently used data in their buffer cache to reduce the file system access time Accessible and improve the file system bandwidth. The buffer cache by a is periodically flushed out to disc to ensure data integrity 32-Bit Address Space in a system crash. UNIX System V supports the capability of flushing out all of its buffer cache. The operation incurs significant overhead to the system and, therefore, is done infrequently. The Berkeley system added the capability of flushing out only the buffer cache of a specified file to Shared Memory 1 allow users better control of the buffering. This interface has been adopted into HP-UX and implemented on the Model 840. In addition to flushing out the buffer cache of Shared Memory 2 the specified file, HP-UX on the Model 840 also flushes out the inode and indirect blocks of the file so that data integrity of the file is guaranteed. Shared Memory N Preallocation of Disc Space. In a traditional UNIX operat ing system, the disc space of a file is allocated as needed on write operations. This implies that performance on write Fig. 8. AT&T's UNIX System V Interface Definition implies is slower since time may be spent allocating space during that processes have the following components: text, data, the write operation. This may be unacceptable to some unitialized data, a user stack, a heap, and zero or more shared critical real-time applications. The capability of preallocat- memory segments. The user stack may grow automatically to suit the procedure call nesting of the process. The heap ing file space has been added to HP-UX and implemented will grow (or shrink) when the process requests more (or less) on the Model 840. memory using the brk or sbrk system calls. DECEMBER 1986 HEWLETT-PACKARD JOURNAL 1 1 © Copr. 1949-1998 Hewlett-Packard Co..
Recommended publications
  • Package 'Filelock'
    Package ‘filelock’ October 5, 2018 Title Portable File Locking Version 1.0.2 Author Gábor Csárdi Maintainer Gábor Csárdi <[email protected]> Description Place an exclusive or shared lock on a file. It uses 'LockFile' on Windows and 'fcntl' locks on Unix-like systems. License MIT + file LICENSE LazyData true URL https://github.com/r-lib/filelock#readme BugReports https://github.com/r-lib/filelock/issues RoxygenNote 6.0.1.9000 Suggests callr (>= 2.0.0), covr, testthat Encoding UTF-8 NeedsCompilation yes Repository CRAN Date/Publication 2018-10-05 10:30:12 UTC R topics documented: lock .............................................2 Index 5 1 2 lock lock Advisory File Locking and Unlocking Description There are two kinds of locks, exclusive and shared, see the exclusive argument and other details below. Usage lock(path, exclusive = TRUE, timeout = Inf) unlock(lock) Arguments path Path to the file to lock. If the file does not exist, it will be created, but the directory of the file must exist. Do not place the lock on a file that you want to read from or write to! *Always use a special lock file. See details below. exclusive Whether to acquire an exclusive lock. An exclusive lock gives the process ex- clusive access to the file, no other processes can place any kind of lock on it. A non-exclusive lock is a shared lock. Multiple processes can hold a shared lock on the same file. A process that writes to a file typically requests an exclusive lock, and a process that reads from it typically requests a shared lock.
    [Show full text]
  • Mac OS X for UNIX Users the Power of UNIX with the Simplicity of Macintosh
    Mac OS X for UNIX Users The power of UNIX with the simplicity of Macintosh. Features Mac OS X version 10.3 “Panther” combines a robust and open UNIX-based foundation with the richness and usability of the Macintosh interface, bringing UNIX technology Open source, standards-based UNIX to the mass market. Apple has made open source and standards a key part of its foundation strategy and delivers an operating system built on a powerful UNIX-based foundation •Based on FreeBSD 5 and Mach 3.0 • Support for POSIX, Linux, and System V APIs that is innovative and easy to use. • High-performance math libraries, including There are over 8.5 million Mac OS X users, including scientists, animators, developers, vector/DSP and PowerPC G5 support and system administrators, making Mac OS X the most widely used UNIX-based desktop • Optimized X11 window server for UNIX GUIs operating system. In addition, Mac OS X is the only UNIX-based environment that •Open source code available via the natively runs Microsoft Office, Adobe Photoshop, and thousands of other consumer Darwin project applications—all side by side with traditional command-line, X11, and Java applications. Standards-based networking For notebook computer users, Mac OS X delivers full power management and mobility •Open source TCP/IP-based networking support for Apple’s award-winning PowerBook G4. architecture, including IPv4, IPv6, and L2TP/IPSec •Interoperability with NFS, AFP, and Windows (SMB/CIFS) file servers •Powerful web server (Apache) •Open Directory 2, an LDAP-based directory services
    [Show full text]
  • Managing Network File Systems in Oracle® Solaris 11.4
    Managing Network File Systems in ® Oracle Solaris 11.4 Part No: E61004 August 2021 Managing Network File Systems in Oracle Solaris 11.4 Part No: E61004 Copyright © 2002, 2021, Oracle and/or its affiliates. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs) and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government end users are "commercial computer software" or "commercial computer software documentation" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, reproduction, duplication, release, display, disclosure, modification, preparation of derivative works, and/or adaptation of i) Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs), ii) Oracle computer documentation and/or iii) other Oracle data, is subject to the rights and limitations specified in the license contained in the applicable contract.
    [Show full text]
  • Portalocker Documentation Release 2.3.2
    Portalocker Documentation Release 2.3.2 Rick van Hattem Aug 27, 2021 CONTENTS 1 portalocker - Cross-platform locking library1 1.1 Overview.................................................1 1.2 Redis Locks...............................................1 1.3 Python 2.................................................2 1.4 Tips....................................................2 1.5 Links...................................................2 1.6 Examples.................................................3 1.7 Versioning................................................4 1.8 Changelog................................................4 1.9 License..................................................4 1.9.1 portalocker package.......................................4 1.9.1.1 Submodules......................................4 1.9.1.2 Module contents....................................9 1.9.2 tests package.......................................... 13 1.9.2.1 Module contents.................................... 13 1.9.3 License............................................. 13 2 Indices and tables 15 Python Module Index 17 Index 19 i ii CHAPTER ONE PORTALOCKER - CROSS-PLATFORM LOCKING LIBRARY 1.1 Overview Portalocker is a library to provide an easy API to file locking. An important detail to note is that on Linux and Unix systems the locks are advisory by default. By specifying the -o mand option to the mount command it is possible to enable mandatory file locking on Linux. This is generally not recommended however. For more information about the subject: • https://en.wikipedia.org/wiki/File_locking
    [Show full text]
  • Real-Time Audio Servers on BSD Unix Derivatives
    Juha Erkkilä Real-Time Audio Servers on BSD Unix Derivatives Master's Thesis in Information Technology June 17, 2005 University of Jyväskylä Department of Mathematical Information Technology Jyväskylä Author: Juha Erkkilä Contact information: [email protected].fi Title: Real-Time Audio Servers on BSD Unix Derivatives Työn nimi: Reaaliaikaiset äänipalvelinsovellukset BSD Unix -johdannaisjärjestelmissä Project: Master's Thesis in Information Technology Page count: 146 Abstract: This paper covers real-time and interprocess communication features of 4.4BSD Unix derived operating systems, and especially their applicability for real- time audio servers. The research ground of bringing real-time properties to tradi- tional Unix operating systems (such as 4.4BSD) is covered. Included are some design ideas used in BSD-variants, such as using multithreaded kernels, and schedulers that can provide real-time guarantees to processes. Factors affecting the design of real- time audio servers are considered, especially the suitability of various interprocess communication facilities as mechanisms to pass audio data between applications. To test these mechanisms on a real operating system, an audio server and a client utilizing these techniques is written and tested on an OpenBSD operating system. The performance of the audio server and OpenBSD is analyzed, with attempts to identify some bottlenecks of real-time operation in the OpenBSD system. Suomenkielinen tiivistelmä: Tämä tutkielma kattaa reaaliaikaisuus- ja prosessien väliset kommunikaatio-ominaisuudet, keskittyen 4.4BSD Unix -johdannaisiin käyt- töjärjestelmiin, ja erityisesti siihen kuinka hyvin nämä soveltuvat reaaliaikaisille äänipalvelinsovelluksille. Tutkimusalueeseen sisältyy reaaliaikaisuusominaisuuk- sien tuominen perinteisiin Unix-käyttöjärjestelmiin (kuten 4.4BSD:hen). Mukana on suunnitteluideoita, joita on käytetty joissakin BSD-varianteissa, kuten säikeis- tetyt kernelit, ja skedulerit, jotka voivat tarjota reaaliaikaisuustakeita prosesseille.
    [Show full text]
  • Design and Implementation of XNU Port of Lustre Client File System
    Design and Implementation of XNU port of Lustre Client File System Danilov Nikita 2005.02.01 Abstract Describes structure of Lustre client file system module for XNU (Darwin kernel). In particular, changes that were necessary in core XNU kernel to enable unique Lustre requirements (e.g., intents) are discussed in much detail. Changes to the platform-independent core of Lustre in order to make it more portable are discussed in the companion paper Lustre Universal Portability Specification. Contents 1 Introduction 2 2 Distribution 3 3 Backgroundon XNU 3 3.1 XNUVFS.......................................... ......... 3 3.1.1 namei()....................................... ......... 4 3.1.2 vnodelifecycle ................................ ........... 6 3.2 XNUpagecache.................................... ........... 6 3.3 XNUSynchronization .............................. ............. 7 3.4 Miscellania..................................... ............. 9 4 High Level Design 9 4.1 XLLIntentHandling ............................... ............. 9 4.1.1 Requirements .................................. .......... 9 4.1.2 FunctionalSpecification . .............. 10 4.1.3 UseCases ...................................... ........ 10 4.1.4 LogicalSpecification . ............. 11 4.1.5 StateSpecification ......................... .... ............ 12 4.2 Sessions........................................ ............ 12 4.2.1 Requirements .................................. .......... 12 4.2.2 FunctionalSpecification . .............. 12 4.2.3 UseCases .....................................
    [Show full text]
  • Lock Or No-Lock?
    Lock Or No-Lock? Abstract guaranteeing atomicity are necessary when these oper- ations must be atomic. Many scientific applications require high perfor- With the advent of parallel I/O libraries data can be mance concurrent IO accesses to a file by multiple pro- accessed in various complex patterns. Locking mecha- cesses. Those applications rely indirectly on atomic IO nisms are used to ensure that shared data is not being capabilities inorder to perform updates to structured violated. Adapted from the POSIX semantics, parallel datasets, such as those stored in HDF5 format files. file system like GPFS [9] and Lustre [10] provide byte Current support for atomic mode operations such as range locking mechanism. Byte range locks provide these in MPI-IO is performed by locking around the an option for guaranteeing atomicity of non-contiguous operations, imposing lock overhead in all situations, operations. By locking the entire region, changes can even though in many cases these operations are non- be made using a read-modify-write sequence. How- overlapping in the file. We propose to isolate non- ever, this approach does not consider the actual non- overlapping accesses from overlapping ones in collec- contiguous access pattern that may occur in a byte tive I/O cases, allowing the non-overlapping ones to range and introduces false sharing. This approach also proceed without imposing lock overhead. To enable this limits the benefits of parallel I/O that can be gained, we have implemented an efficient conflict detection al- by unnecessarily serializing the accesses. To address gorithm in MPI-IO using MPI file views and datatypes.
    [Show full text]
  • With the Spiagent File Locking Add-On Evaluator's Guide
    with the SPIAgent File Locking Add-On Evaluator’s Guide ©2010 Software Pursuits, Inc. Table of Contents Introduction ....................................................................................................................... 2 System Requirements ....................................................................................................... 2 Contact Information ........................................................................................................... 3 Required Add-Ons for SPIAgent File Locking ................................................................... 3 SPIAgent Add-On .......................................................................................................... 3 SPIAgent File Locking Add-On ..................................................................................... 4 Other SureSync Add-Ons ................................................................................................. 4 ArchiveSync Add-On ..................................................................................................... 4 What is SPIAgent File Locking? ........................................................................................ 4 Supported Applications ..................................................................................................... 6 Expected Application Behavior when Encountering Locks ............................................... 7 Our Scenario ..................................................................................................................
    [Show full text]
  • Mac OS X Server File Services Administration for Version 10.4 Or Later
    Mac OS X Server File Services Administration For Version 10.4 or Later K Apple Computer, Inc. © 2005 Apple Computer, Inc. All rights reserved. The owner or authorized user of a valid copy of Mac OS X Server software may reproduce this publication for the purpose of learning to use such software. No part of this publication may be reproduced or transmitted for commercial purposes, such as selling copies of this publication or for providing paid-for support services. Every effort has been made to ensure that the information in this manual is accurate. Apple Computer, Inc., is not responsible for printing or clerical errors. Apple 1 Infinite Loop Cupertino CA 95014-2084 www.apple.com The Apple logo is a trademark of Apple Computer, Inc., registered in the U.S. and other countries. Use of the “keyboard” Apple logo (Option-Shift-K) for commercial purposes without the prior written consent of Apple may constitute trademark infringement and unfair competition in violation of federal and state laws. Apple, the Apple logo, AppleShare, AppleTalk, Mac, Macintosh, QuickTime, Xgrid, and Xserve are trademarks of Apple Computer, Inc., registered in the U.S. and other countries. Finder is a trademark of Apple Computer, Inc. Adobe and PostScript are trademarks of Adobe Systems Incorporated. UNIX is a registered trademark in the United States and other countries, licensed exclusively through X/Open Company, Ltd. Other company and product names mentioned herein are trademarks of their respective companies. Mention of third-party products is for informational purposes only and constitutes neither an endorsement nor a recommendation.
    [Show full text]
  • Securing Mac OS X - Presentation Slides
    Securing Mac OS X - Presentation Slides Securing Mac OS X Paul Day, pd(at)csse.uwa.edu.au “Keep others out - With Mac OS X, you may never need to worry about security again.” Top 10 reasons to upgrade Apple web-site 1 Securing Mac OS X - Presentation Slides Introduction Background • Mac OS X made a major transition from Classic to X. – Introduced Unix in the form of FreeBSD, NeXT and the Mach/Darwin Kernel • One of the more secure Unix installations by default, but still plenty of drawbacks. 2 Securing Mac OS X - Presentation Slides Overview Aims of this talk: • Discuss methods of hardening OS X from a: – Local user perspective – Network perspective • Point out vulnerabilities in recommendations and existing technologies. Similar work - why bother? • Tried not to let paranoia result in recommendations with little/no benefit but large inconvenience. • Included recommendations, and discussed vulnerabilities others have over-looked. • Simplified and reduced background and semi-relevant information. 3 Securing Mac OS X - Presentation Slides Local Security Local security? Methods to harden security within Mac OS X from a local user perspective: – With local physical access to the machine via its console, OR – With interactive local access to the machine via methods such as Secure Shell (SSH) or Apple Remote Desktop (ARD). 4 Securing Mac OS X - Presentation Slides Login Window • Enable it • Disable auto-login • Insert login window message • Change your password Login Window Enable it and disable auto-login •Uncheck “Automatically log in as:”
    [Show full text]
  • Controlled Environment to Run Untrusted Applications
    CONTROLLED ENVIRONMENT TO RUN UNTRUSTED APPLICATIONS A thesis submitted To Kent State University in partial Fulfillment of the requirements for the Degree of Master of Science by TAHANI ALBALAWI August, 2013 Thesis written by TAHANI ALBALAWI B.S., Taiba University, KSA 2007 M.S., Kent State University, USA, 2013 Approved by Michael Rothstein, Advisor Javed Khan , Chair, Department of Computer Science Raymond Craig, Dean, College of Arts and Sciences ii Abstract Untrusted applications pose a security threat to systems they run on. At the same time sometimes a user wants to run such applications without risking unauthorized access to certain parts of the system. For this reason we propose a controlled environment to run host untrusted applications based on AppArmor tool. We intend to augment the usefulness of AppArmor by further restricting the permissions of the files accessible to the process using other system mechanisms, such as NFS and Chroot. Based on the principle of least authority, programs can run in a restricted secure environment limiting access to a subset of the files. This way untrusted applications are allowed to run with limits to protect the system. iii Table of Contents LIST OF FIGURES ..................................................................................................... vii LIST OF TABLES ...................................................................................................... vii DEDICATION.............................................................................................................
    [Show full text]
  • Daemons and Systems Aspects
    Error Handling 1 / 37 Error Handling ■ I/O devices and physical media aren’t perfect ■ Device drivers have to cope with error conditions ■ Recovery can be complex and device-dependent ■ Often, errors are detected by adding check bytes or ECC bytes to physical blocks 1 / 37 Example: Tape Errors ■ Suppose a tape drive indicated a bad read ■ First, retry up to 10 times ■ Backspace the tape a few inches and “shoe shine” it — move it back and forth so the bad spot is scraped against the edge of the read head ■ The idea is to dislodge any pieces of dirt 2 / 37 1 Disk I/O Errors ■ If a disk write fails, retry a few times ■ If the write still fails, mark the block as “bad” — how this is done is device-dependent — and allocate a spare block ■ Somehow, indicate that this remapping has taken place 3 / 37 Testing for Errors ■ How do you test your error recovery code? ■ Where do you get media that are just bad enough? ■ Remember that failure modes can be arbitarily weird ■ Loose cables can generate very strange signals 4 / 37 2 From the NetBSD Printer Driver 1. You should be able to write to and read back the same value to the data port. Do an alternating zeros, alternating ones, walking zero, and walking one test to check for stuck bits. 2. You should be able to write to and read back the same value to the control port lower 5 bits, the upper 3 bits are reserved per the IBM PC technical reference manauls and different boards do different things with them.
    [Show full text]