O'reilly & Associates, Inc

Total Page:16

File Type:pdf, Size:1020Kb

O'reilly & Associates, Inc Table of Contents Preface .......................................................... 1 Who this book is for ................................................ 2 Versions ........................................................ 2 Organization ...................................... ............... 3 Conventions used in this book ......................................... 4 Differences between the first edition and second edition ...................... 5 Comments and questions ............................................ 5 Hal's acknowledgments from the first edition .............................. 6 Acknowledgments for the second edition ................................. 6 1. Networking Fundamentals ......................................... 9 1.1 Networking overview ............................................ 9 1.2 Physical and data link layers ...................................... 11 1.3 Network layer ................................................ 12 1.4 Transport layer ................................................ 18 1.5 The session and presentation layers ................................. 19 2. Introduction to Directory Services ................................... 24 2.1 Purpose of directory services ...................................... 24 2.2 Brief survey of common directory services ............................ 25 2.3 Name service switch ............................................ 29 2.4 Which directory service to use ..................................... 29 3. Network Information Service Operation .............................. 31 3.1 Masters, slaves, and clients ....................................... 31 3.2 Basics of NIS management ....................................... 34 3.3 Files managed under NIS ........................................ 41 3.4 Trace of a key match ............................................ 52 4. System Management Using NIS ..................................... 56 4.1 NIS network design ............................................ 56 4.2 Managing map files ............................................ 58 4.3 Advanced NIS server administration ................................ 65 4.4 Managing multiple domains ...................................... 67 5. Living with Multiple Directory Servers ............................... 70 5.1 Domain name servers ........................................... 70 5.2 Implementation ............................................... 72 5.3 Fully qualified and unqualified hostnames ............................ 74 5.4 Centralized versus distributed management ........................... 76 5.5 Migrating from NIS to DNS for host naming .......................... 77 5.6 What next? ................................................... 77 6. System Administration Using the Network File System ................... 78 6.1 Setting up NFS ................................................ 79 6.2 Exporting filesystems ........................................... 80 6.3 Mounting filesystems ........................................... 85 6.4 Symbolic links ................................................ 96 6.5 Replication .................................................. 99 6.6 Naming schemes ............................................. 103 7. Network File System Design and Operation .......................... 108 7.1 Virtual filesystems and virtual nodes ............................... 108 7.2 NFS protocol and implementation ................................. 109 7.3 NFS components ............................................. 117 7.4 Caching .................................................... 122 7.5 File locking ................................................. 127 7.6 NFS futures ................................................. 129 8. Diskless Clients ................................................ 132 8.1 NFS support for diskless clients ................................... 132 8.2 Setting up a diskless client ...................................... 133 8.3 Diskless client boot process ...................................... 136 8.4 Managing client swap space ..................................... 140 8.5 Changing a client's name ........................................ 142 8.6 Troubleshooting .............................................. 143 8.7 Configuration options .......................................... 147 8.8 Brief introduction to JumpStart administration ........................ 150 8.9 Client/server ratios ............................................ 151 9. The Automounter .............................................. 153 9.1 Automounter maps ............................................ 154 9.2 Invocation and the master map ................................... 162 9.3 Integration with NIS ........................................... 167 9.4 Key and variable substitutions .................................... 169 9.5 Advanced map tricks .......................................... 173 9.6 Side effects ................................................. 182 10. PC/NFS Clients ............................................... 184 10.1 PC/NFS today .............................................. 184 10.2 Limitations of PC/NFS ........................................ 185 10.3 Configuring PC/NFS .......................................... 188 10.4 Common PC/NFS usage issues .................................. 189 10.5 Printer services .............................................. 191 11. File Locking ................................................. 192 11.1 What is file locking? .......................................... 192 11.2 NFS and file locking .......................................... 194 11.3 Troubleshooting locking problems ................................ 196 12. Network Security .............................................. 200 12.1 User-oriented network security .................................. 200 12.2 How secure are NIS and NFS? ................................... 206 12.3 Password and NIS security ..................................... 207 12.4 NFS security ............................................... 210 12.5 Stronger security for NFS ...................................... 223 12.6 Viruses ................................................... 245 13. Network Diagnostic and Administrative Tools ........................ 247 13.1 Broadcast addresses .......................................... 248 13.2 MAC and IP layer tools ........................................ 250 13.3 Remote procedure call tools ..................................... 268 13.4 NIS tools .................................................. 276 13.5 Network analyzers ........................................... 283 14. NFS Diagnostic Tools .......................................... 295 14.1 NFS administration tools ....................................... 295 14.2 NFS statistics ............................................... 298 14.3 snoop ..................................................... 307 14.4 Publicly available diagnostics ................................... 311 14.5 Version 2 and Version 3 differences ............................... 317 14.6 NFS server logging ........................................... 318 14.7 Time synchronization ......................................... 331 15. Debugging Network Problems .................................... 335 15.1 Duplicate ARP replies ......................................... 335 15.2 Renegade NIS server ......................................... 337 15.3 Boot parameter confusion ...................................... 338 15.4 Incorrect directory content caching ............................... 339 15.5 Incorrect mount point permissions ................................ 343 15.6 Asynchronous NFS error messages ............................... 345 16. Server-Side Performance Tuning ................................. 349 16.1 Characterization of NFS behavior ................................ 349 16.2 Measuring performance ........................................ 351 16.3 Benchmarking .............................................. 352 16.4 Identifying NFS performance bottlenecks ........................... 353 16.5 Server tuning ............................................... 357 17. Network Performance Analysis ................................... 367 17.1 Network congestion and network interfaces ......................... 367 17.2 Network partitioning hardware .................................. 369 17.3 Network infrastructure ........................................ 371 17.4 Impact of partitioning ......................................... 372 17.5 Protocol filtering ............................................ 374 18. Client-Side Performance Tuning .................................. 376 18.1 Slow server compensation ...................................... 376 18.2 Soft mount issues ............................................ 381 18.3 Adjusting for network reliability problems .......................... 382 18.4 NFS over wide-area networks ................................... 384 18.5 NFS async thread tuning ....................................... 385 18.6 Attribute caching ............................................ 387 18.7 Mount point constructions ...................................... 388 18.8 Stale filehandles ............................................. 390 A. IP Packet Routing ............................................. 392 A.1 Routers and their routing tables ................................... 392 A.2 Static routing ................................................ 396 B. NFS Problem Diagnosis ......................................... 397
Recommended publications
  • Reference Guide
    Reference Guide Scyld ClusterWare Release 5.10.1-5101g0000 December 18, 2013 Reference Guide: Scyld ClusterWare Release 5.10.1-5101g0000; December 18, 2013 Revised Edition Published December 18, 2013 Copyright © 1999 - 2013 Penguin Computing, Inc. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording or otherwise) without the prior written permission of Penguin Computing, Inc.. The software described in this document is "commercial computer software" provided with restricted rights (except as to included open/free source). Use beyond license provisions is a violation of worldwide intellectual property laws, treaties, and conventions. Scyld ClusterWare, the Highly Scyld logo, and the Penguin Computing logo are trademarks of Penguin Computing, Inc.. Intel is a registered trademark of Intel Corporation or its subsidiaries in the United States and other countries. Infiniband is a trademark of the InfiniBand Trade Association. Linux is a registered trademark of Linus Torvalds. Red Hat and all Red Hat-based trademarks are trademarks or registered trademarks of Red Hat, Inc. in the United States and other countries. All other trademarks and copyrights referred to are the property of their respective owners. Table of Contents Preface .....................................................................................................................................................................................v
    [Show full text]
  • Oracle® Linux 7 Managing File Systems
    Oracle® Linux 7 Managing File Systems F32760-07 August 2021 Oracle Legal Notices Copyright © 2020, 2021, Oracle and/or its affiliates. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs) and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government end users are "commercial computer software" or "commercial computer software documentation" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, reproduction, duplication, release, display, disclosure, modification, preparation of derivative works, and/or adaptation of i) Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs), ii) Oracle computer documentation and/or iii) other Oracle data, is subject to the rights and limitations specified in the license contained in the applicable contract.
    [Show full text]
  • Managing File Systems in Oracle® Solaris 11.4
    ® Managing File Systems in Oracle Solaris 11.4 Part No: E61016 November 2020 Managing File Systems in Oracle Solaris 11.4 Part No: E61016 Copyright © 2004, 2020, Oracle and/or its affiliates. License Restrictions Warranty/Consequential Damages Disclaimer This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. Warranty Disclaimer The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. Restricted Rights Notice If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs) and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government end users are "commercial computer software" or "commercial
    [Show full text]
  • NFS-HOWTO.Pdf
    Linux NFS−HOWTO Tavis Barr tavis dot barr at liu dot edu Nicolai Langfeldt janl at linpro dot no Seth Vidal skvidal at phy dot duke dot edu Tom McNeal trmcneal at attbi dot com 2002−08−25 Revision History Revision v3.1 2002−08−25 Revised by: tavis Typo in firewalling section in 3.0 Revision v3.0 2002−07−16 Revised by: tavis Updates plus additions to performance, security Linux NFS−HOWTO Table of Contents 1. Preamble..........................................................................................................................................................1 1.1. Legal stuff.........................................................................................................................................1 1.2. Disclaimer.........................................................................................................................................1 1.3. Feedback...........................................................................................................................................1 1.4. Translation........................................................................................................................................1 1.5. Dedication.........................................................................................................................................1 2. Introduction.....................................................................................................................................................2 2.1. What is NFS?....................................................................................................................................2
    [Show full text]
  • Managing Network File Systems in Oracle® Solaris 11.4
    Managing Network File Systems in ® Oracle Solaris 11.4 Part No: E61004 August 2021 Managing Network File Systems in Oracle Solaris 11.4 Part No: E61004 Copyright © 2002, 2021, Oracle and/or its affiliates. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited. The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing. If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable: U.S. GOVERNMENT END USERS: Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs) and Oracle computer documentation or other Oracle data delivered to or accessed by U.S. Government end users are "commercial computer software" or "commercial computer software documentation" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, the use, reproduction, duplication, release, display, disclosure, modification, preparation of derivative works, and/or adaptation of i) Oracle programs (including any operating system, integrated software, any programs embedded, installed or activated on delivered hardware, and modifications of such programs), ii) Oracle computer documentation and/or iii) other Oracle data, is subject to the rights and limitations specified in the license contained in the applicable contract.
    [Show full text]
  • Proceedings of the Linux Symposium Volume
    Proceedings of the Linux Symposium Volume Two July 19th–22nd, 2006 Ottawa, Ontario Canada Contents Evolution in Kernel Debugging using Hardware Virtualization With Xen 1 Nitin A. Kamble Improving Linux Startup Time Using Software Resume (and other techniques) 17 Hiroki Kaminaga Automated Regression Hunting 27 A. Bowen, P. Fox, J. Kenefick, A. Romney, J. Ruesch, J. Wilde, & J. Wilson Hacking the Linux Automounter—Current Limitations and Future Directions 37 Ian Maxwell Kent & Jeff Moyer Why NFS Sucks 51 Olaf Kirch Efficient Use of the Page Cache with 64 KB Pages 65 Dave Kleikamp and Badari Pulavarty Startup Time in the 21st Century: Filesystem Hacks and Assorted Tweaks 71 Benjamin C.R. LaHaise Using Hugetlbfs for Mapping Application Text Regions 75 H.J. Lu, K. Doshi, R. Seth, & J. Tran Towards a Better SCM: Revlog and Mercurial 83 Matt Mackall Roadmap to a GL-based composited desktop for Linux 91 K.E. Martin and K. Packard Probing the Guts of Kprobes 101 A. Mavinakayanahalli, P. Panchamukhi, J. Keniston, A. Keshavamurthy, & M. Hiramatsu Shared Page Tables Redux 117 Dave McCracken Extending RCU for Realtime and Embedded Workloads 123 Paul E. McKenney OSTRA: Experiments With on-the-fly Source Patching 139 Arnaldo Carvalho de Melo Design and Implementation to Support Multiple Key Exchange Protocols for IPsec 143 K. Miyazawa, S. Sakane, K. Kamada, M. Kanda, & A. Fukumoto The State of Linux Power Management 2006 151 Patrick Mochel I/O Workload Fingerprinting in the Genetic-Library 165 Jake Moilanen X86-64 XenLinux: Architecture, Implementation, and Optimizations 173 Jun Nakajima, Asit Mallick GCC—An Architectural Overview, Current Status, and Future Directions 185 Diego Novillo Shared-Subtree Concept, Implementation, and Applications in Linux 201 Al Viro & Ram Pai The Ondemand Governor 215 Venkatesh Pallipadi & Alexey Starikovskiy Linux Bootup Time Reduction for Digital Still Camera 231 Chan-Ju Park A Lockless Pagecache in Linux—Introduction, Progress, Performance 241 Nick Piggin The Ongoing Evolution of Xen 255 I.
    [Show full text]
  • Filedes = Open(Name, Mode) Opens an Existing File with the Given Name
    Computer Science 425 Distributed Systems CS 425 / ECE 428 Fall 2013 Indranil Gupta (Indy) December 3, 2013 Lecture 27 Distributed File Systems Chapter 12 (relevant parts) 2013, I. Gupta, K. Nahrtstedt, S. Mitra, N. Vaidya, M. T. Harandi, J. Hou Lecture 27-1 File Attributes & System Modules File Attribute Block Block Block Record length creation timestamp File read timestamp Directory Module Access write timestamp Module attribute timestamp File Module Block reference count Module file type Access control ownership Device Module Module access control list File System Modules Lecture 27-2 UNIX File System Operations filedes = open(name, mode) Opens an existing file with the given name . filedes = creat(name, mode) Creates a new file with the given name . Both operations deliver a file descriptor referencing the open file. The mode is read, write or both. status = close(filedes) Closes the open file filedes. count = read(filedes, buffer, n) Transfers n bytes from the file referenced by filedes to buffer . count = write(filedes, buffer, n) Transfers n bytes to the file referenced by filedes from buffer. Both operations deliver the number of bytes actually transferred and advance the read-write pointer. pos = lseek(filedes, offset, Moves the read-write pointer to offset (relative or absolute, whence) depending on whence). status = unlink(name) Removes the file name from the directory structure. If the file has no other links to it, it is deleted from disk. status = link(name1, name2) Creates a new link (name2) for a file (name1 ). status = stat(name, buffer) Gets the file attributes for file name into buffer. Lecture 27-3 Distributed File System (DFS) Requirements Transparency : server-side changes should be invisible to the client-side.
    [Show full text]
  • The Pkgsrc Guide
    The pkgsrc guide Documentation on the NetBSD packages system (2006/02/18) Alistair Crooks [email protected] Hubert Feyrer [email protected] The pkgsrc Developers The pkgsrc guide: Documentation on the NetBSD packages system by Alistair Crooks, Hubert Feyrer, The pkgsrc Developers Published 2006/02/18 01:46:43 Copyright © 1994-2005 The NetBSD Foundation, Inc Information about using the NetBSD package system (pkgsrc) from both a user view for installing packages as well as from a pkgsrc developers’ view for creating new packages. Table of Contents 1. What is pkgsrc?......................................................................................................................................1 1.1. Introduction.................................................................................................................................1 1.2. Overview.....................................................................................................................................1 1.3. Terminology................................................................................................................................2 1.4. Typography .................................................................................................................................3 I. The pkgsrc user’s guide .........................................................................................................................1 2. Where to get pkgsrc and how to keep it up-to-date........................................................................2
    [Show full text]
  • Apple File System Reference
    Apple File System Reference Developer Contents About Apple File System 7 General-Purpose Types 9 paddr_t .................................................. 9 prange_t ................................................. 9 uuid_t ................................................... 9 Objects 10 obj_phys_t ................................................ 10 Supporting Data Types ........................................... 11 Object Identifier Constants ......................................... 12 Object Type Masks ............................................. 13 Object Types ................................................ 14 Object Type Flags .............................................. 20 EFI Jumpstart 22 Booting from an Apple File System Partition ................................. 22 nx_efi_jumpstart_t ........................................... 24 Partition UUIDs ............................................... 25 Container 26 Mounting an Apple File System Partition ................................... 26 nx_superblock_t ............................................. 27 Container Flags ............................................... 36 Optional Container Feature Flags ...................................... 37 Read-Only Compatible Container Feature Flags ............................... 38 Incompatible Container Feature Flags .................................... 38 Block and Container Sizes .......................................... 39 nx_counter_id_t ............................................. 39 checkpoint_mapping_t ........................................
    [Show full text]
  • NFS Administration Guide
    NFS Administration Guide 2550 Garcia Avenue Mountain View, CA 94043 U.S.A. A Sun Microsystems, Inc. Business 1995 Sun Microsystems, Inc. 2550 Garcia Avenue, Mountain View, California 94043-1100 U.S.A. All rights reserved. This product or document is protected by copyright and distributed under licenses restricting its use, copying, distribution and decompilation. No part of this product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors, if any. Portions of this product may be derived from the UNIX® system, licensed from UNIX Systems Laboratories, Inc., a wholly owned subsidiary of Novell, Inc., and from the Berkeley 4.3 BSD system, licensed from the University of California. Third-party software, including font technology in this product, is protected by copyright and licensed from Sun’s Suppliers. RESTRICTED RIGHTS LEGEND: Use, duplication, or disclosure by the government is subject to restrictions as set forth in subparagraph (c)(1)(ii) of the Rights in Technical Data and Computer Software clause at DFARS 252.227-7013 and FAR 52.227-19. The product described in this manual may be protected by one or more U.S. patents, foreign patents, or pending applications. TRADEMARKS Sun, Sun Microsystems, the Sun logo, SunSoft, the SunSoft logo, Solaris, SunOS, OpenWindows, DeskSet, ONC, ONC+, and NFS are trademarks or registered trademarks of Sun Microsystems, Inc. in the United States and other countries. UNIX is a registered trademark in the United States and other countries, exclusively licensed through X/Open Company, Ltd. OPEN LOOK is a registered trademark of Novell, Inc.
    [Show full text]
  • (Fall 2009) Lecture 19 Distributed File Systems Reading
    Computer Science 425/ECE 428/CSE 424 Distributed Systems (Fall 2009) Lecture 19 Distributed File Systems Reading: Chapter 8 Acknowledgement • The slides during this semester are based on ideas and material from the following sources: – Slides prepared by Professors M. Harandi, J. Hou, I. Gupta, N. Vaidya, Y-Ch. Hu, S. Mitra. – Slides from Professor S. Gosh’s course at University o Iowa. Administrative • MP2 posted October 5, 2009, on the course website, – Deadline November 6 (Friday) – Demonstration, 4-6pm, 11/6/2009 – Tutorial for MP2 planned for October 28 evening if students send questions to TA by October 25. Send requests what you would like to hear in the tutorial. Administrative • MP3 proposal instructions – Deadline for MP3 proposal: October 25, 2009, email proposal to TA – At least one representative of each group meets with instructor or TA during October 26-28 during their office hours ) watch for extended office hours during these days. – Wednesday, October 28, 8:30-10am – instructor’s office hours 3104 SC – No office hours, Thursday, 29, 9-10am Administrative • Homework 3 posted on Thursday, October 15 – Deadline: Thursday, October 29, 2009 at the beginning of class • Midterm Re-grading Period by Instructor – additional office hours: – October 27, 3:15-4pm – in 3104 SC – October 29, 3:15-4pm – in 3104 SC Plan for Today • File Systems – Review • Distributed File Systems – Requirements • File System Architecture • Network File System (NFS) • Andrew File System (AFS) File Systems A file is a collection of data with a user view (file structure) and a physical view (blocks). A directory is a file that provides a mapping from text names to internal file identifiers.
    [Show full text]
  • Database-Installation-Guide-Linux.Pdf
    Oracle® Database Database Installation Guide 19c for Linux E96432-19 July 2021 Oracle Database Database Installation Guide, 19c for Linux E96432-19 Copyright © 2015, 2021, Oracle and/or its affiliates. Primary Authors: Prakash Jashnani, Subhash Chandra Contributing Authors: Douglas Williams Contributors: Jean-Francois Verrier, Richard Roddy, Neha Avasthy, Sampath Ravindhran, Prasad Bagal, Subhranshu Banerjee, Gerald Venzl, Tammy Bednar, Avi Miller, Gavin Bowe, Gia-Khanh Nguyen, Darcy Christensen, Kiran Chamala, Jonathan Creighton, Benoit Dageville, Logeshwaran Rajan, Rajesh Dasari, Angad Gokakkar , Anu Natarajan, Girdhari Ghantiyala, Bernard Clouse, Chandrasekharan Iyer, Anil Nair, Sivaram Soma, Lisa Vaz, Ranjit Noronha, Vasu Venkatasubramanian, Sumanta Chatterjee, Margaret Susairaj, Malai Stalin, Markus Michalewicz, Subrahmanyam Kodavaluru, Sudip Datta, Madhu Hunasigi, Jim Erickson, Marcus Fallen, Joseph Francis, Allan Graves, Barbara Glover, Asad Hasan, Thirumaleshwara Hasandka, Putta Ramesh, Sergio Leunissen, Aneesh Khandelwal, Joel Kallman, Eugene Karichkin, Jai Krishnani, Prasad K Kulkarni, Ranjith Kundapur, Balaji Pagadala, Christopher Jones, Tak Wang, Bryn Llewellyn, Saar Maoz, Chao Liang, Gopal Mulagund, Pushkar Punit, Sivaselvam Narayanasamy, Ankur Kemkar, Sue Lee, Rich Long, Ricardo Alonso Gonzalez Acuna, Barb Lundhild, Sangeeth Jose, Rudregowda Mallegowda, Prasad Kuruvadi Nagaraj, Mughees Minhas, Krishna Mohan, Matthew McKerley, John McHugh, Gurudas Pai, Satish Panchumarthy , Rajesh Prasad, Rajendra Pingte, Ramesh Chakravarthula,
    [Show full text]