DOCSLIB.ORG

CXFSTM Administration Guide for SGI® Infinitestorage

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
CXFSTM Administration Guide for SGI® Infinitestorage CXFSTM Administration Guide for SGI® InfiniteStorage 007–4016–027 COPYRIGHT © 1999–2008 SGI. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of SGI. The following copyright notice applies to the LZF algorithm: Copyright (c) 2000-2005 Marc Alexander Lehmann <[email protected]> Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met: 1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer. 2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution. 3. The name of the author may not be used to endorse or promote products derived from this software without specific prior written permission. THIS SOFTWARE IS PROVIDED BY THE AUTHOR ‘‘AS IS’’ AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY,WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. LIMITED RIGHTS LEGEND The software described in this document is "commercial computer software" provided with restricted rights (except as to included open/free source) as specified in the FAR 52.227-19 and/or the DFAR 227.7202, or successive sections. Use beyond license provisions is a violation of worldwide intellectual property laws, treaties and conventions. This document is provided with limited rights as defined in 52.227-14. TRADEMARKS AND ATTRIBUTIONS SGI, Altix, the SGI cube, the SGI logo, IRIX, O2, Octane, Onyx, Onyx2, Origin, Silicon Graphics Prism, Silicon Graphics Tezro, and XFS are registered trademarks and CXFS, FDDIXPress, NUMAlink, Octane2, Performance Co-Pilot, Silicon Graphics Fuel, and SGI ProPack are trademarks of SGI in the United States and/or other countries worldwide. AIX and IBM are registered trademarks of IBM Corporation. Brocade is a trademark of Brocade Communication Systems, Inc. Inc. Digi is a trademark of Digi International, Inc. Java and Sun are registered trademarks and Solaris is a trademark of Sun Microsystems, Inc. Linux is a registered trademark of Linus Torvalds in several countries. Legato NetWorker is a registered trademark of Legato Systems, Inc. Mac OS is a registered trademark of Apple Computer, Inc. Netscape is a trademark of Netscape Communications Corporation. QLogic is a registered trademark of QLogic Corporation. Red Hat is a registered trademark and RPM is a trademark of Red Hat, Inc. UNIX is a registered trademark of The Open Group in the United States and other countries. VERITAS is a trademark of VERITAS Software Corporation. Windows and Windows NT are registered trademarks of Microsoft Corporation. X/Open is a registered trademark of X/Open Company Ltd. All other trademarks mentioned herein are the property of their respective owners. New Features in This Guide Note: Be sure to read the release notes for your platforms and the late-breaking caveats page on Supportfolio to learn about any changes to the installation and configuration procedures. This version contains the following: • Support for clusters with server-capable administration nodes running only SGI ProPack for Linux. IRIX is now exclusively supported as a client-only platform and is generally documented in CXFS MultiOS Client-Only Guide for SGI InfiniteStorage. Because IRIX is no longer supported as a server-capable administration node, CXFS 5.0 also no longer supports coexecution with FailSafe. Because the client administration node type (client_admin) was supported only for coexecution with FailSafe, this node type is no longer supported. For information about moving from a cluster with IRIX metadata servers to a cluster with SGI ProPack metadata servers, see Appendix I, "Migration from a Cluster with IRIX Server-Capable Administration Nodes" on page 597. Note: CXFS does not support SGIRDAC mode. See "Changing SGIRDAC Mode to SGIAVT Mode for SGI RAID" on page 598. • New initial installation and update procedures: "Installation from the ISSP Distribution" on page 112. • The ability to revoke and restore the CXFS kernel membership for the local node, which must be a server-capable administration node, by using the stop_cxfs and start_cxfs commands in cxfs_admin. See "Revoke and Restore CXFS Kernel Membership for the Local Node" on page 248. • The ability to generate streaming workload for SD/HD/2K/4K formats of video streams by using the frametest(1) command. See "Generation of Streaming Workload for Video Streams" on page 323. • Support for the framesort utility, which provides easy file-layout analysis and advanced file-sequence reorganization. See "Frame Files Defragmentation and Analysis" on page 324. 007–4016–027 iii New Features in This Guide • The new site-changeable static system-tunable parameter "mtcp_hb_local_options" on page 481 • Reorganization to improve clarity. • Information about the cmgr command is located primarily in Appendix G, "Reference to cmgr Tasks" on page 493 (which has not been updated to reflect CXFS 5.0 support). With the exception of a few administrative cmgrcommands, the preferred CXFS configuration tools are cxfs_admin and the CXFS graphical user interface (GUI). The following cmgr commands are still useful: admin fence admin nmi admin ping admin powerCycle admin reset start/stop cx_services test connectivity test serial In addition, the build_cmgr_script command is still useful. In a future release, all of cmgr functionality will be provided by the cxfs_admin command and the cmgr command will not be supported. • The following commands are now deprecated: clconf_status and cluster_status. The functionality of these commands is now provided by the cxfs_admin command and/or the CXFS GUI. See Appendix J, "Deprecated Commands" on page 613. iv 007–4016–027 Record of Revision Version Description 001 September 1999 Supports the CXFS 1.1 product in the IRIX 6.5.6f release. 002 October 1999 Supports the CXFS 1.1 product in the IRIX 6.5.6f release. 003 December 1999 Supports the CXFS product in the IRIX 6.5.7f release. 004 March 2000 Supports the CXFS product in the IRIX 6.5.8f release. 005 June 2000 Supports the CXFS product in the IRIX 6.5.9f release. 006 September 2000 Supports the CXFS product in the IRIX 6.5.10f release. 007 January 2001 Supports the CXFS product in the IRIX 6.5.11f release. 008 March 2001 Supports the CXFS product in the IRIX 6.5.12f release. 009 June 2001 Supports the CXFS product in the IRIX 6.5.13f release. 011 September 2001 Supports the CXFS product in the IRIX 6.5.14f release. (Note, there was no 010 version due to an internal numbering mechanism.) 012 December 2001 Supports the CXFS Version 2 product in IRIX 6.5.15f. 013 March 2002 Supports the CXFS Version 2 product in IRIX 6.5.16f. 007–4016–027 v Record of Revision 014 June 2002 Supports the CXFS Version 2 product in IRIX 6.5.17f. 015 September 2002 Supports the CXFS Version 2 product in IRIX 6.5.18f. 016 December 2002 Supports the CXFS Version 2 product in IRIX 6.5.19f. 017 March 2003 Supports the CXFS Version 2 product in IRIX 6.5.20f. 018 September 2003 Supports the CXFS 3.0 product in IRIX 6.5.22 and CXFS 3.0 for SGI Altix 3000 running SGI ProPack 2.3 for Linux. 019 December 2003 Supports the CXFS 3.1 product in IRIX 6.5.23 and CXFS 3.1 for SGI Altix 3000 running SGI ProPack 2.4 for Linux. 020 March 2004 Supports the CXFS 3.2 product in IRIX 6.5.24 and CXFS 3.2 for SGI Altix 3000 running SGI ProPack 3 for Linux. 021 November 2004 Supports the CXFS 3.2 product in IRIX 6.5.24 and CXFS 3.2 for SGI Altix 3000 running SGI ProPack 3 for Linux. 022 April 2005 Supports the CXFS 3.3 product 023 July 2005 Supports the CXFS 3.4 product 024 May 2006 Supports the CXFS 4.0 product 025 January 2007 Supports the CXFS 4.1 product vi 007–4016–027 CXFSTM Administration Guide for SGI® InfiniteStorage 026 September 2007 Supports the CXFS 4.2 product 027 March 2008 Supports the CXFS 5.0 product 007–4016–027 vii Contents About This Guide ..................... xli Related Publications . ................... xli Obtaining Publications . ...................xliii Conventions . ........................xliv Reader Comments ....................... xlv 1. Introduction to CXFS . ................. 1 What is CXFS? ........................ 1 Comparison of XFS and CXFS ................... 3 Differences in Filesystem Mounting and Management . ......... 3 Supported XFS Features . ................... 4 When to Use CXFS . ................... 5 Performance Considerations ................... 5 Comparison of Network and CXFS Filesystems .............. 6 Network Filesystems . ................... 7 CXFS Filesystems . ................... 7 CXFS Features ....................... 7 CXFS Restrictions . ................... 8 Cluster Environment
Load more

Recommended publications
  • Early Experiences with Storage Area Networks and CXFS John Lynch
    Early Experiences with Storage Area Networks and CXFS John Lynch Aerojet 6304 Spine Road Boulder CO 80516 Abstract This paper looks at the design, integration and application issues involved in deploying an early access, very large, and highly available storage area network. Covered are topics from filesystem failover, issues regarding numbers of nodes in a cluster, and using leading edge solutions to solve complex issues in a real-time data processing network. 1 Introduction SAN technology can be categorized in two distinct approaches. Both Aerojet designed and installed a highly approaches use the storage area network available, large scale Storage Area to provide access to multiple storage Network over spring of 2000. This devices at the same time by one or system due to it size and diversity is multiple hosts. The difference is how known to be one of a kind and is the storage devices are accessed. currently not offered by SGI, but would serve as a prototype system. The most common approach allows the hosts to access the storage devices across The project’s goal was to evaluate Fibre the storage area network but filesystems Channel and SAN technology for its are not shared. This allows either a benefits and applicability in a second- single host to stripe data across a greater generation, real-time data processing number of storage controllers, or to network. SAN technology seemed to be share storage controllers among several the technology of the future to replace systems. This essentially breaks up a the traditional SCSI solution. large storage system into smaller distinct pieces, but allows for the cost-sharing of The approach was to conduct and the most expensive component, the evaluation of SAN technology as a storage controller.
    [Show full text]
  • CXFSTM Client-Only Guide for SGI® Infinitestorage
    CXFSTM Client-Only Guide for SGI® InfiniteStorage 007–4507–016 COPYRIGHT © 2002–2008 SGI. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of SGI. LIMITED RIGHTS LEGEND The software described in this document is "commercial computer software" provided with restricted rights (except as to included open/free source) as specified in the FAR 52.227-19 and/or the DFAR 227.7202, or successive sections. Use beyond license provisions is a violation of worldwide intellectual property laws, treaties and conventions. This document is provided with limited rights as defined in 52.227-14. TRADEMARKS AND ATTRIBUTIONS SGI, Altix, the SGI cube and the SGI logo are registered trademarks and CXFS, FailSafe, IRIS FailSafe, SGI ProPack, and Trusted IRIX are trademarks of SGI in the United States and/or other countries worldwide. Active Directory, Microsoft, Windows, and Windows NT are registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries. AIX and IBM are registered trademarks of IBM Corporation. Brocade and Silkworm are trademarks of Brocade Communication Systems, Inc. AMD, AMD Athlon, AMD Duron, and AMD Opteron are trademarks of Advanced Micro Devices, Inc. Apple, Mac, Mac OS, Power Mac, and Xserve are registered trademarks of Apple Computer, Inc. Disk Manager is a registered trademark of ONTRACK Data International, Inc. Engenio, LSI Logic, and SANshare are trademarks or registered trademarks of LSI Corporation.
    [Show full text]
  • Ebook - Informations About Operating Systems Version: August 15, 2006 | Download
    eBook - Informations about Operating Systems Version: August 15, 2006 | Download: www.operating-system.org AIX Internet: AIX AmigaOS Internet: AmigaOS AtheOS Internet: AtheOS BeIA Internet: BeIA BeOS Internet: BeOS BSDi Internet: BSDi CP/M Internet: CP/M Darwin Internet: Darwin EPOC Internet: EPOC FreeBSD Internet: FreeBSD HP-UX Internet: HP-UX Hurd Internet: Hurd Inferno Internet: Inferno IRIX Internet: IRIX JavaOS Internet: JavaOS LFS Internet: LFS Linspire Internet: Linspire Linux Internet: Linux MacOS Internet: MacOS Minix Internet: Minix MorphOS Internet: MorphOS MS-DOS Internet: MS-DOS MVS Internet: MVS NetBSD Internet: NetBSD NetWare Internet: NetWare Newdeal Internet: Newdeal NEXTSTEP Internet: NEXTSTEP OpenBSD Internet: OpenBSD OS/2 Internet: OS/2 Further operating systems Internet: Further operating systems PalmOS Internet: PalmOS Plan9 Internet: Plan9 QNX Internet: QNX RiscOS Internet: RiscOS Solaris Internet: Solaris SuSE Linux Internet: SuSE Linux Unicos Internet: Unicos Unix Internet: Unix Unixware Internet: Unixware Windows 2000 Internet: Windows 2000 Windows 3.11 Internet: Windows 3.11 Windows 95 Internet: Windows 95 Windows 98 Internet: Windows 98 Windows CE Internet: Windows CE Windows Family Internet: Windows Family Windows ME Internet: Windows ME Seite 1 von 138 eBook - Informations about Operating Systems Version: August 15, 2006 | Download: www.operating-system.org Windows NT 3.1 Internet: Windows NT 3.1 Windows NT 4.0 Internet: Windows NT 4.0 Windows Server 2003 Internet: Windows Server 2003 Windows Vista Internet: Windows Vista Windows XP Internet: Windows XP Apple - Company Internet: Apple - Company AT&T - Company Internet: AT&T - Company Be Inc. - Company Internet: Be Inc. - Company BSD Family Internet: BSD Family Cray Inc.
    [Show full text]
  • Preparing for an Installation of a 33 to 256 Processor System HR-04122-0B Origin ™ Systems Last Modified: August 1999
    Preparing for an Installation of a 33 to 256 Processor System HR-04122-0B Origin ™ Systems Last Modified: August 1999 Record of Revision . 4 Overview . 5 System Components and Configurations . 6 Equipment Separation Limits . 8 Site Requirements . 10 Planning Your Access Route . 10 Environmental Requirements . 14 Facility Power Requirements . 15 Remote Support . 20 Network Connections . 20 Raised-floor Installations . 21 Securing the Cabinets . 25 Physical Specifications . 28 Origin 2000 Systems . 34 Onyx2 InfiniteReality2 Systems . 38 Onyx2 InfiniteReality2 Rack System . 38 Onyx2 InfiniteReality Multirack Systems . 38 Onyx2 InfiniteReality2 Multirack System Layout Options . 41 SCSI RAID Rack . 42 Origin Fibre Channel Rack . 43 O2 Workstation . 44 Site Planning Checklist . 46 Summary . 48 HR-04122-0B SGI Proprietary 1 Preparing for an Installation Figures Figure 1. Origin 2000 128- and 256-Processor Multirack Systems: Standard and Optional Floor Layouts Placed on 24 in. x 24 in. Floor Panels . 7 Figure 2. Distance between Racks (Standard Layout) . 8 Figure 3. Separation Limits . 9 Figure 4. Origin 2000 Rack, Onyx2 InfiniteReality2 Rack, and MetaRouter Shipping Configuration . 11 Figure 5. SCSI RAID Rack Shipping Configuration . 12 Figure 6. Origin Fibre Channel Rack Shipping Configuration . 13 Figure 7. Origin 2000 Rack and Onyx2 InfiniteReality2 Rack Floor Cutout 22 Figure 8. MetaRouter Floor Cutout . 23 Figure 9. SCSI RAID Rack Floor Cutout . 24 Figure 10. Origin Fibre Channel Rack Floor Cutout . 24 Figure 11. Securing the Origin 2000 Rack and Onyx2 Rack . 25 Figure 12. Securing the MetaRouter . 26 Figure 13. Securing the Origin Fibre Channel Rack . 27 Figure 14. Origin 2000 Rack . 35 Figure 15. MetaRouter . 36 Figure 16.
    [Show full text]
  • SGI Altix Applications Development and Optimization
    SGI Altix Applications Development and Optimization Part No.: AAPPL-0.9-L2.4-S-SD-W-DRAFT Release Date: May 15, 2003 2 RESTRICTION ON USE This document is protected by copyright and contains information proprietary to Silicon Graphics, Inc. Any copying, adaptation, distribution, public performance, or public display of this document without the express written consent of Silicon Graphics, Inc., is strictly prohibited. The receipt or possession of this document does not convey the rights to reproduce or distribute its contents, or to manufacture, use, or sell anything that it may describe, in whole or in part, without the specific written consent of Silicon Graphics, Inc. Copyright 1997-2000 Silicon Graphics, Inc. All rights reserved. U.S. GOVERNMENT RESTRICTED RIGHTS LEGEND Use, duplication, or disclosure of the data and information contained in this document by the Government is subject to restrictions as set forth in FAR 52.227-19(c)(2) or subparagraph (c)(1)(ii) of the Rights in Technical Data and Computer Software clause at DFARS 252.227-7013 and/or in similar or successor clauses in the FAR, or the DOD or NASA FAR Supplement. Unpublished rights reserved under the Copyright Laws of the United States. Contrac- tor/manufacturer is Silicon Graphics, Inc., 1600 Amphitheatre Pkwy., Mountain View, CA 94039-1351. The contents of this publication are subject to change without notice. PART NUMBER AAPPL-0.9-L2.4-S-SD-W-DRAFT, May 2003 RECORD OF REVISION Revision 0.9, Version 2.4, April 2003. SGI TRADEMARKS InfiniteReality, IRIX, Silicon Graphics, and the Silicon Graphics logo are registered trademarks, and Altix, Altix 3000, Origin, Origin 2000, Origin 300, Origin 3000, Power Challenge, Power ChallengeArray, NUMAflex and ProDev are trademarks of Silicon Graphics, Inc.
    [Show full text]
  • Silicon Graphics, Inc. Scalable Filesystems XFS & CXFS
    Silicon Graphics, Inc. Scalable Filesystems XFS & CXFS Presented by: Yingping Lu January 31, 2007 Outline • XFS Overview •XFS Architecture • XFS Fundamental Data Structure – Extent list –B+Tree – Inode • XFS Filesystem On-Disk Layout • XFS Directory Structure • CXFS: shared file system ||January 31, 2007 Page 2 XFS: A World-Class File System –Scalable • Full 64 bit support • Dynamic allocation of metadata space • Scalable structures and algorithms –Fast • Fast metadata speeds • High bandwidths • High transaction rates –Reliable • Field proven • Log/Journal ||January 31, 2007 Page 3 Scalable –Full 64 bit support • Large Filesystem – 18,446,744,073,709,551,615 = 264-1 = 18 million TB (exabytes) • Large Files – 9,223,372,036,854,775,807 = 263-1 = 9 million TB (exabytes) – Dynamic allocation of metadata space • Inode size configurable, inode space allocated dynamically • Unlimited number of files (constrained by storage space) – Scalable structures and algorithms (B-Trees) • Performance is not an issue with large numbers of files and directories ||January 31, 2007 Page 4 Fast –Fast metadata speeds • B-Trees everywhere (Nearly all lists of metadata information) – Directory contents – Metadata free lists – Extent lists within file – High bandwidths (Storage: RM6700) • 7.32 GB/s on one filesystem (32p Origin2000, 897 FC disks) • >4 GB/s in one file (same Origin, 704 FC disks) • Large extents (4 KB to 4 GB) • Request parallelism (multiple AGs) • Delayed allocation, Read ahead/Write behind – High transaction rates: 92,423 IOPS (Storage: TP9700)
    [Show full text]
  • 10º Encontro Português De Computação Gráfica
    Actas do 10º Encontro Português de Computação Gráfica 1 – 3 de Outubro 2001 Lisboa – Portugal Patrocinadores de Honra Patrocinadores Organização 10º Encontro Português de Computação Gráfica 1-3 de Outubro 2001 PREFÁCIO A investigação, o desenvolvimento e o ensino na área da Computação Gráfica constituem, em Portugal, uma realidade positiva e de largas tradições. O Encontro Português de Computação Gráfica (EPCG), realizado no âmbito das actividades do Grupo Português de Computação Gráfica (GPCG), tem permitido reunir regularmente, desde o 1º EPCG realizado também em Lisboa, mas no já longínquo mês de Julho de 1988, todos os que trabalham nesta área abrangente e com inúmeras aplicações. Pela primeira vez no historial destes Encontros, o 10º EPCG foi organizado em ligação estreita com as comunidades do Processamento de Imagem e da Visão por Computador, através da Associação Portuguesa de Reconhecimento de Padrões (APRP), salientando-se, assim, a acrescida colaboração, e a convergência, entre essas duas áreas e a Computação Gráfica. Tal como nos Encontros anteriores, o programa está estruturado ao longo de três dias, sendo desta vez o primeiro dia dedicado a seminários por conferencistas convidados e os dois últimos à apresentação de comunicações e de "posters", decorrendo em simultâneo o Concurso para Jovens Investigadores, uma Exibição Comercial e, pela primeira vez, um Atelier Digital. Como novidade essencialmente dedicada aos jovens, realiza-se ainda em paralelo com o Encontro um torneio de jogos de computador. Em resposta ao apelo às comunicações para este 10º EPCG foram submetidos 38 trabalhos, na sua maioria de grande qualidade, tendo sido seleccionadas pela Comissão de Programa, após um cuidadoso processo de avaliação, apenas 19 comunicações; aos autores de 14 dos restantes trabalhos, considerados suficientemente promissores, foi sugerida a sua reformulação e uma nova submissão como "posters".
    [Show full text]
  • SGI® L1 and L2 Controller Software User's Guide
    SGI® L1 and L2 Controller Software User’s Guide 007-3938-004 CONTRIBUTORS Written by Linda Rae Sande Revised by Francisco Razo and Terry Schultz Illustrated by Dan Young Production by Terry Schultz Engineering contributions by Don Adams, Michael T. Brown, Dick Brownell, Jason Chang, Steve Hein, Jill Heitpas, Nancy Heller, Matt Hoy, Hao Pham, Craig Schultz, and Lisa Steinmetz. COPYRIGHT © 2002, 2003, 2004, 2005, Silicon Graphics, Inc. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of Silicon Graphics, Inc. LIMITED RIGHTS LEGEND The software described in this document is “commercial computer software” provided with restricted rights (except as to included open/free source) as specified in the FAR 52.227-19 and/or the DFAR 227.7202, or successive sections. Use beyond license provisions is a violation of worldwide intellectual property laws, treaties and conventions. This document is provided with limited rights as defined in 52.227-14. TRADEMARKS AND ATTRIBUTIONS Silicon Graphics, SGI, the SGI logo, Altix, Onyx, and Origin are registered trademarks and Fuei, NUMAflex, NUMAlink, Prism, and SGIconsole are trademarks of Silicon Graphics, Inc., in the U.S. and/or other countries worldwide. All other trademarks mentioned herein are the property of their respective owners. New Features in This Guide This manual has been updated with information to support the SGI Altix 3700 Bx2 system. Major Documentation Changes The following sections were revised for this release: • Added information about the Silicon Graphics Prism Visualization System in the Introduction, Chapter 1, and Chapter 2.
    [Show full text]
  • W4118: File Systems
    W4118: file systems Instructor: Junfeng Yang References: Modern Operating Systems (3rd edition), Operating Systems Concepts (8th edition), previous W4118, and OS at MIT, Stanford, and UWisc Outline File system concepts . What is a file? . What operations can be performed on files? . What is a directory and how is it organized? File implementation . How to allocate disk space to files? 1 What is a file User view . Named byte array • Types defined by user . Persistent across reboots and power failures OS view . Map bytes as collection of blocks on physical storage . Stored on nonvolatile storage device • Magnetic Disks 2 Role of file system Naming . How to “name” files . Translate “name” + offset logical block # Reliability . Must not lose file data Protection . Must mediate file access from different users Disk management . Fair, efficient use of disk space . Fast access to files 3 File metadata Name – only information kept in human-readable form Identifier – unique tag (number) identifies file within file system (inode number in UNIX) Location – pointer to file location on device Size – current file size Protection – controls who can do reading, writing, executing Time, date, and user identification – data for protection, security, and usage monitoring How is metadata stored? (inode in UNIX) 4 File operations int creat(const char* pathname, mode_t mode) int unlink(const char* pathname) int rename(const char* oldpath, const char* newpath) int open(const char* pathname, int flags, mode_t mode) int read(int fd, void* buf, size_t count); int write(int fd, const void* buf, size_t count) int lseek(int fd, offset_t offset, int whence) int truncate(const char* pathname, offset_t len) ..
    [Show full text]
  • Lecture 17: Files and Directories
    11/1/16 CS 422/522 Design & Implementation of Operating Systems Lecture 17: Files and Directories Zhong Shao Dept. of Computer Science Yale University Acknowledgement: some slides are taken from previous versions of the CS422/522 lectures taught by Prof. Bryan Ford and Dr. David Wolinsky, and also from the official set of slides accompanying the OSPP textbook by Anderson and Dahlin. The big picture ◆ Lectures before the fall break: – Management of CPU & concurrency – Management of main memory & virtual memory ◆ Current topics --- “Management of I/O devices” – Last week: I/O devices & device drivers – Last week: storage devices – This week: file systems * File system structure * Naming and directories * Efficiency and performance * Reliability and protection 1 11/1/16 This lecture ◆ Implementing file system abstraction Physical Reality File System Abstraction block oriented byte oriented physical sector #’s named files no protection users protected from each other data might be corrupted robust to machine failures if machine crashes File system components ◆ Disk management User – Arrange collection of disk blocks into files File File ◆ Naming Naming access – User gives file name, not track or sector number, to locate data Disk management ◆ Security / protection – Keep information secure Disk drivers ◆ Reliability/durability – When system crashes, lose stuff in memory, but want files to be durable 2 11/1/16 User vs. system view of a file ◆ User’s view – Durable data structures ◆ System’s view (system call interface) – Collection of bytes (Unix) ◆ System’s view (inside OS): – Collection of blocks – A block is a logical transfer unit, while a sector is the physical transfer unit.
    [Show full text]
  • CXFSTM Administration Guide for SGI® Infinitestorage
    CXFSTM Administration Guide for SGI® InfiniteStorage 007–4016–025 CONTRIBUTORS Written by Lori Johnson Illustrated by Chrystie Danzer Engineering contributions to the book by Vladmir Apostolov, Rich Altmaier, Neil Bannister, François Barbou des Places, Ken Beck, Felix Blyakher, Laurie Costello, Mark Cruciani, Rupak Das, Alex Elder, Dave Ellis, Brian Gaffey, Philippe Gregoire, Gary Hagensen, Ryan Hankins, George Hyman, Dean Jansa, Erik Jacobson, John Keller, Dennis Kender, Bob Kierski, Chris Kirby, Ted Kline, Dan Knappe, Kent Koeninger, Linda Lait, Bob LaPreze, Jinglei Li, Yingping Lu, Steve Lord, Aaron Mantel, Troy McCorkell, LaNet Merrill, Terry Merth, Jim Nead, Nate Pearlstein, Bryce Petty, Dave Pulido, Alain Renaud, John Relph, Elaine Robinson, Dean Roehrich, Eric Sandeen, Yui Sakazume, Wesley Smith, Kerm Steffenhagen, Paddy Sreenivasan, Roger Strassburg, Andy Tran, Rebecca Underwood, Connie Woodward, Michelle Webster, Geoffrey Wehrman, Sammy Wilborn COPYRIGHT © 1999–2007 SGI. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of SGI. LIMITED RIGHTS LEGEND The software described in this document is "commercial computer software" provided with restricted rights (except as to included open/free source) as specified in the FAR 52.227-19 and/or the DFAR 227.7202, or successive sections. Use beyond
    [Show full text]
  • Application of General Purpose HPC Systems in HPEC David Alexander
    Application of General Purpose HPC Systems in HPEC David Alexander Silicon Graphics, Inc. Phone: (650) 933-1073 Fax: (650) 932-0663 Email: [email protected] Areas that this paper/presentation will address: * Reconfigurable Computing for Embedded Systems * High-Speed Interconnect Technologies Abstract: High performance embedded computing (HPEC) has traditionally been performed by systems designed specifically for the task. Recent years have seen the increasing application of general-purpose high performance computing (HPC) systems in embedded applications. General purpose HPC systems typically have a large user base which results in broad application SW and device driver availability, robust development and debugging tools, and revenue streams which support significant R&D funding of technologies to enhance HPC system performance and reliability. Various factors have prevented wider adoption of general purpose HPC systems in the embedded space...factors such as lack of dense, ruggedized packaging suitable for embedded applications, lack of real-time capabilities in general purpose operating systems [1], and performance/watt and performance/unit volume advantages that specialized systems have traditionally had over general purpose HPC systems. This presentation details plans for addressing these shortcomings through the deployment of a heterogeneous computing architecture which incorporates FPGA-based reconfigurable computing and I/O elements, system interconnect advancements leveraged from HPC system development, microprocessor and system advancements developed under DARPA's HPCS program, and the mapping of the system into packaging suitable for HPEC applications. Introduction and System Architectural Review SGI's ccNUMA (cache coherent non-uniform memory architecture) global shared memory system architecture is the basis of our general-purpose Origin [2] and Altix [3] HPC systems.
    [Show full text]