Analysis of Body Movement and Its Effects on Cyberware 3D Whole

Total Page:16

File Type:pdf, Size:1020Kb

Analysis of Body Movement and Its Effects on Cyberware 3D Whole ANALYSIS OF BODY MOVEMENT AND ITS EFFECTS ON CYBERWARE 3D WHOLE BODY SCANNER A Thesis Presented to The Faculty of the Fritz J. and Dolores H. Russ College of Engineering and Technology Ohio University In Partial Fulfillment of the Requirement for the Degree Master of Science By Anmin Hu August, 1999 OHIO UNIVERSITY LIBRARY ACKNOWLEDGEMENTS I, Anmin Hu, would like to take this opportunity to thank several people who make thesis become possible. First, I would like to express my deep appreciation and thanks to my advisor, Dr. Joseph H. Nurre, for his directions. He has been so kind and patient to help me when I had problems. "Thanks a lot! Dr. Nurre". I would like to thank my friend, Collier Jeff and Lewark Eric, who are the graduate students of Dr. Nurre. They always gave me hints and help when I had the troubles. This helps me a lot. I would like to thank Mr. Brian Comer, who is research scientist in US Army Natick RD&E Center, to provide the 3D scan data. Without his assistance, this thesis can not be formed. I also would like to thank Dr. Jeffrey Giesey, Dr. Mehmet Celenk to be the members of the thesis committee and Dr. Bhavin Mehta to be the college representative of the thesis committee. Thanks for your time to revise my thesis. Contents Chapter One Introduction 1 Chapter Two Literature Review 5 Chapter Three Body Sway Analysis in Cyberware WB4 Scanning 10 3.0 Introduction 10 3.1 Analysis Method 10 3.1.0 The Cyberware Whole Body Scanner 10 3.1.1 Scan the Subject with the Cylinder Attached 12 3.1.2 Post-Processing of 3D Cylinder Surface Data 14 3.2 Software Implementation 18 3.2.0 Data Sort by Z Cordinate 18 3.2.1 Implementing Furthest Point Analysis Algorithm 18 3.3 Verification of the Analysis Method and its Implementation 19 Chapter Four Simulation and Analysis of Body Sway Using Jack Package 27 4.0 Introduction 27 4.1 Develop the Human Body Model Using Jack 27 4.1.0 Peabody Object Representation 27 4.1.1 Develop a Model Based on Peabody Language 28 4.2 Software Simulation of Body Movement Using the Model 28 4.2.0 Introduction 28 4.2.1 Lisp Interface and JCL 28 4.2.2 C&C++ API 29 11 4.2.3 Network Jack 30 4.2.4 Software Simulation Methods 31 4.3 Software Implementation of 'jackmove' 33 4.3.0 Introduction 33 4.3.1 Establish RPC connection between Jack Program and 'jackmove' Program 33 4.3.2 Specify the Movement of the Center of Gravity 34 4.3.3 Adjust Joint 35 4.3.4 Initialize Node Position and Apparel Length 36 4.3.5 Analyze the Body Movement 38 4.3.6 Analyze the Apparel Measurement Error 39 4.3.7 User Interface 39 Chapter Five Results 43 Chapter Six Conclusion and Future Research 52 Bibliography 54 Appendix l.x C Programs for Chapter Three 56 Appendix 1.0 measure.h 56 Appendix 1.1 measure.c 57 Appendix 1.2 plyLoad.c 58 Appendix 1.3 dataSortByZ.c 61 Appendix 1.4 dataStatistic.c 63 Appendix 1.5 cutoff.c 65 Appendix 1.6 dataAnalysis.c 66 iii Appendix 1.7 calculate.c 67 Appendix 2.x C Programs for Chapter Four 70 Appendix 2.0 capi.h 70 Appendix 2.1 main.c 71 Appendix 2.2 move_center_gravity.c 72 Appendix 2.3 adjustJoint.c 73 Appendix 2.4 datalnit.c 78 Appendix 2.5 initial_Iength.c 79 Appendix 2.6 picknewpoint.c 80 Appendix 2.7 showmovement.c 81 Appendix 2.8 showlengtherror.c 82 Appendix 2.9 shownode.c 84 Appendix 2.10 mainmenu.c 85 Appendix 2.11 jointmenu.c 86 Appendix 2.12 nodemenu.c 87 iv Figures Figure 3.1 The Cyberware Whole Body Scanner 11 Figure 3.2 The Researcher uses Cyberware WB4 scanner to collect the Human body anthropometric data in a simple pose 12 Figure 3.3 Subject with Cylinder Attached to His Front Torso Showing Scanning Position 13 Figure 3.4 Cylinder extracted from whole body scan 13 Figure 3.5 An Actual Z-slice of the Cylinder in 2D 14 Figure 3.6 A Diagram to Show How to Implement 'Furthest Point Algorithm' 16 Figure 3.7 A Linked-list to Store the Furthest Point for all Z-slices 19 Figure 3.8 A Static Cylinder is Scanned 20 Figure 3.9 A Moving Cylinder is Scanned 20 Figure 3.10 The Graph for Static Cylinder Scan 22 Figure 3.11 The Graph for Moving Cylinder Scan 23 Figure 3.12 The Graph for Moving Cylinder Scan 24 Figure 3.13 The Graph Showing the Subject's Intentional Sway 25 Figure 3.14 The Graph Showing the Subject's Intentional Sway 26 Figure 4.1 Jack Model 29 Figure 4.2 Network Jack and its Implementation 31 Figure 4.3 User Interface I 40 Figure 4.4 User Interface II 41 Figure 4.5 User Interface III 42 Figure 5.1 First Scan of the Subject Fitted with Cylinder 44 v Figure 5.2 Second Scan of the Subject Fitted with Cylinder 45 Figure 5.3 Third Scan of the Subject Fitted with Cylinder 46 Figure 5.4 Fourth Scan of the Subject Fitted with Cylinder 47 Figure 5.5 Fifth Scan of the Subject Fitted with Cylinder 48 vi Tables Table 1. Body Sway From the Five Scans 50 Table 2. Anthropometric Measurement Errors From the Five Scans 50 CHAPTER ONE INTRODUCTION Variations in human body size are tremendous. Both military and civilian industry frequently use anthropometric data to access the range of body size within their target populations. These comparative measurements guide the design and sizing of uniforms and other apparel. Engineers also use these data to optimize the layout of vehicles and workstations with respect to key parameters, such as reach, clearance, egress, and ingress. So, where does the anthropometric data come from? Traditional methods are based on measurements, such as segment lengths, breadths, and circumferences. These measurements were obtained with standard tools including anthropometers, calipers, and tape measures. However, within the past ten years, the state-of-the-art in anthropometric data collection has moved away from these tools toward non-contact 3D scanning. This trend began with scanning systems in the mid-1980s for the head, face, and other body segments and has recently evolved into whole-body scanning. Two primary technologies of the whole-body scanning system have emerged in the United States as valuable candidates for surface digitizing and measurement of the human body. Both are optically based and non-contact. The laser-based scanning system was developed and marketed by Cyberware Inc. in Monterey, California. A moire-based light-projection system was developed for commercialization by Textile and Clothing Technology Corporation in Cary, North Carolina. 2 The whole body scanning system, built by Cyberware, employs a laser-scanning triangulation method to acquire 3D images. In this design, a stripe of light is emitted from four laser diodes onto the scanning surface, then viewed simultaneously from two locations using an arrangement of mirrors. Viewed from an angle, the laser stripe appears deformed by the object's shape. These deformations are recorded by a CCD sensor and digitized. The cameras positioned with each of four scanning heads record this surface information as the scan heads traverse the length of the scanning volume from top to bottom. The separate data files from each scanning head are then combined in software to yield a complete integrated image of the scanned object. The Cyberware whole-body scanning system can image a person's surface and provide data for further post-processing. The scanned volume is approximately equal to a 2-meter high by 1.2-meter diameter cylinder. These dimensions accommodate the vast majority of human subjects. The spatial resolution of image ranges 5 millimeters in the x­ axis, 2 millimeters in the y-axis, and 2 millimeters along the z-axis. Scanning speed for the maximum scanned volume is around 17 seconds, which yields about 400,000 3D coordinates on the surface of an adult human body. The first two commercial whole-body scanning systems built by Cyberware have been delivered to both the U.S. Army Natick RD&E Center and the U.S. Air Force's Computerized Anthropometric Research and Design Laboratory. Researchers in the Computerized Anthropometric Research and Design Laboratory used the Cyberware scanner principally for aircrew-helmet and oxygen mask design, as well as for medical applications for bum victims and amputees. The Human Engineering Division of Armstrong Laboratory at Wright-Patterson introduced the Cyberware whole-body scanner 3 to improve the fit of commercial and military clothing, while bettering the design of aircraft cockpits and crew stations. Of course, civilian applications for the Cyberware whole body scanner could be as valuable as those for military applications. For example, the apparel industry is intensely interested in scanning people for potentially more affordable, custom-tailored clothes. Although the laser-based 3D whole body scanning system has been put into commercial applications, some hurdles still confront the mainstream use of this promising technology. Some problems are fundamental - data accuracy and reliability, for example - and will affect all potential applications. This thesis will focus on the basic research conducted on 3D data digitizing accuracy and reliability. The Cyberware whole body scanner images the human body for about 17 seconds as the cameras travel from head to toe. This process yields thousands of digitized profiles from each of the scanning heads.
Recommended publications
  • Beej's Guide to Unix IPC
    Beej's Guide to Unix IPC Brian “Beej Jorgensen” Hall [email protected] Version 1.1.3 December 1, 2015 Copyright © 2015 Brian “Beej Jorgensen” Hall This guide is written in XML using the vim editor on a Slackware Linux box loaded with GNU tools. The cover “art” and diagrams are produced with Inkscape. The XML is converted into HTML and XSL-FO by custom Python scripts. The XSL-FO output is then munged by Apache FOP to produce PDF documents, using Liberation fonts. The toolchain is composed of 100% Free and Open Source Software. Unless otherwise mutually agreed by the parties in writing, the author offers the work as-is and makes no representations or warranties of any kind concerning the work, express, implied, statutory or otherwise, including, without limitation, warranties of title, merchantibility, fitness for a particular purpose, noninfringement, or the absence of latent or other defects, accuracy, or the presence of absence of errors, whether or not discoverable. Except to the extent required by applicable law, in no event will the author be liable to you on any legal theory for any special, incidental, consequential, punitive or exemplary damages arising out of the use of the work, even if the author has been advised of the possibility of such damages. This document is freely distributable under the terms of the Creative Commons Attribution-Noncommercial-No Derivative Works 3.0 License. See the Copyright and Distribution section for details. Copyright © 2015 Brian “Beej Jorgensen” Hall Contents 1. Intro................................................................................................................................................................1 1.1. Audience 1 1.2. Platform and Compiler 1 1.3.
    [Show full text]
  • Mmap and Dma
    CHAPTER THIRTEEN MMAP AND DMA This chapter delves into the area of Linux memory management, with an emphasis on techniques that are useful to the device driver writer. The material in this chap- ter is somewhat advanced, and not everybody will need a grasp of it. Nonetheless, many tasks can only be done through digging more deeply into the memory man- agement subsystem; it also provides an interesting look into how an important part of the kernel works. The material in this chapter is divided into three sections. The first covers the implementation of the mmap system call, which allows the mapping of device memory directly into a user process’s address space. We then cover the kernel kiobuf mechanism, which provides direct access to user memory from kernel space. The kiobuf system may be used to implement ‘‘raw I/O’’ for certain kinds of devices. The final section covers direct memory access (DMA) I/O operations, which essentially provide peripherals with direct access to system memory. Of course, all of these techniques requir e an understanding of how Linux memory management works, so we start with an overview of that subsystem. Memor y Management in Linux Rather than describing the theory of memory management in operating systems, this section tries to pinpoint the main features of the Linux implementation of the theory. Although you do not need to be a Linux virtual memory guru to imple- ment mmap, a basic overview of how things work is useful. What follows is a fairly lengthy description of the data structures used by the kernel to manage memory.
    [Show full text]
  • An Introduction to Linux IPC
    An introduction to Linux IPC Michael Kerrisk © 2013 linux.conf.au 2013 http://man7.org/ Canberra, Australia [email protected] 2013-01-30 http://lwn.net/ [email protected] man7 .org 1 Goal ● Limited time! ● Get a flavor of main IPC methods man7 .org 2 Me ● Programming on UNIX & Linux since 1987 ● Linux man-pages maintainer ● http://www.kernel.org/doc/man-pages/ ● Kernel + glibc API ● Author of: Further info: http://man7.org/tlpi/ man7 .org 3 You ● Can read a bit of C ● Have a passing familiarity with common syscalls ● fork(), open(), read(), write() man7 .org 4 There’s a lot of IPC ● Pipes ● Shared memory mappings ● FIFOs ● File vs Anonymous ● Cross-memory attach ● Pseudoterminals ● proc_vm_readv() / proc_vm_writev() ● Sockets ● Signals ● Stream vs Datagram (vs Seq. packet) ● Standard, Realtime ● UNIX vs Internet domain ● Eventfd ● POSIX message queues ● Futexes ● POSIX shared memory ● Record locks ● ● POSIX semaphores File locks ● ● Named, Unnamed Mutexes ● System V message queues ● Condition variables ● System V shared memory ● Barriers ● ● System V semaphores Read-write locks man7 .org 5 It helps to classify ● Pipes ● Shared memory mappings ● FIFOs ● File vs Anonymous ● Cross-memory attach ● Pseudoterminals ● proc_vm_readv() / proc_vm_writev() ● Sockets ● Signals ● Stream vs Datagram (vs Seq. packet) ● Standard, Realtime ● UNIX vs Internet domain ● Eventfd ● POSIX message queues ● Futexes ● POSIX shared memory ● Record locks ● ● POSIX semaphores File locks ● ● Named, Unnamed Mutexes ● System V message queues ● Condition variables ● System V shared memory ● Barriers ● ● System V semaphores Read-write locks man7 .org 6 It helps to classify ● Pipes ● Shared memory mappings ● FIFOs ● File vs Anonymous ● Cross-memoryn attach ● Pseudoterminals tio a ● proc_vm_readv() / proc_vm_writev() ● Sockets ic n ● Signals ● Stream vs Datagram (vs uSeq.
    [Show full text]
  • Table of Contents
    TABLE OF CONTENTS Chapter 1 Introduction ............................................................................................. 3 Chapter 2 Examples for FPGA ................................................................................. 4 2.1 Factory Default Code ................................................................................................................................. 4 2.2 Nios II Control for Programmable PLL/ Temperature/ Power/ 9-axis ....................................................... 6 2.3 Nios DDR4 SDRAM Test ........................................................................................................................ 12 2.4 RTL DDR4 SDRAM Test ......................................................................................................................... 14 2.5 USB Type-C DisplayPort Alternate Mode ............................................................................................... 15 2.6 USB Type-C FX3 Loopback .................................................................................................................... 17 2.7 HDMI TX and RX in 4K Resolution ........................................................................................................ 21 2.8 HDMI TX in 4K Resolution ..................................................................................................................... 26 2.9 Low Latency Ethernet 10G MAC Demo .................................................................................................. 29 2.10 Socket
    [Show full text]
  • IPC: Mmap and Pipes
    Interprocess Communication: Memory mapped files and pipes CS 241 April 4, 2014 University of Illinois 1 Shared Memory Private Private address OS address address space space space Shared Process A segment Process B Processes request the segment OS maintains the segment Processes can attach/detach the segment 2 Shared Memory Private Private Private address address space OS address address space space space Shared Process A segment Process B Can mark segment for deletion on last detach 3 Shared Memory example /* make the key: */ if ((key = ftok(”shmdemo.c", 'R')) == -1) { perror("ftok"); exit(1); } /* connect to (and possibly create) the segment: */ if ((shmid = shmget(key, SHM_SIZE, 0644 | IPC_CREAT)) == -1) { perror("shmget"); exit(1); } /* attach to the segment to get a pointer to it: */ data = shmat(shmid, (void *)0, 0); if (data == (char *)(-1)) { perror("shmat"); exit(1); } 4 Shared Memory example /* read or modify the segment, based on the command line: */ if (argc == 2) { printf("writing to segment: \"%s\"\n", argv[1]); strncpy(data, argv[1], SHM_SIZE); } else printf("segment contains: \"%s\"\n", data); /* detach from the segment: */ if (shmdt(data) == -1) { perror("shmdt"); exit(1); } return 0; } Run demo 5 Memory Mapped Files Memory-mapped file I/O • Map a disk block to a page in memory • Allows file I/O to be treated as routine memory access Use • File is initially read using demand paging ! i.e., loaded from disk to memory only at the moment it’s needed • When needed, a page-sized portion of the file is read from the file system
    [Show full text]
  • A Machine-Independent DMA Framework for Netbsd
    AMachine-Independent DMA Framework for NetBSD Jason R. Thorpe1 Numerical Aerospace Simulation Facility NASA Ames Research Center Abstract 1.1. Host platform details One of the challenges in implementing a portable In the example platforms listed above,there are at kernel is finding good abstractions for semantically- least three different mechanisms used to perform DMA. similar operations which often have very machine- The first is used by the i386 platform. This mechanism dependent implementations. This is especially impor- can be described as "what you see is what you get": the tant on modern machines which share common archi- address that the device uses to perform the DMA trans- tectural features, e.g. the PCI bus. fer is the same address that the host CPU uses to access This paper describes whyamachine-independent the memory location in question. DMA mapping abstraction is needed, the design consid- DMA address Host address erations for such an abstraction, and the implementation of this abstraction in the NetBSD/alpha and NetBSD/i386 kernels. 1. Introduction NetBSD is a portable, modern UNIX-likeoperat- ing system which currently runs on eighteen platforms covering nine processor architectures. Some of these platforms, including the Alpha and i3862,share the PCI busasacommon architectural feature. In order to share device drivers for PCI devices between different platforms, abstractions that hide the details of bus access must be invented. The details that must be hid- den can be broken down into twoclasses: CPU access Figure 1 - WYSIWYG DMA to devices on the bus (bus_space)and device access to host memory (bus_dma). Here we will discuss the lat- The second mechanism, employed by the Alpha, ter; bus_space is a complicated topic in and of itself, is very similar to the first; the address the host CPU and is beyond the scope of this paper.
    [Show full text]
  • Interprocess Communication
    06 0430 CH05 5/22/01 10:22 AM Page 95 5 Interprocess Communication CHAPTER 3,“PROCESSES,” DISCUSSED THE CREATION OF PROCESSES and showed how one process can obtain the exit status of a child process.That’s the simplest form of communication between two processes, but it’s by no means the most powerful.The mechanisms of Chapter 3 don’t provide any way for the parent to communicate with the child except via command-line arguments and environment variables, nor any way for the child to communicate with the parent except via the child’s exit status. None of these mechanisms provides any means for communicating with the child process while it is actually running, nor do these mechanisms allow communication with a process outside the parent-child relationship. This chapter describes means for interprocess communication that circumvent these limitations.We will present various ways for communicating between parents and chil- dren, between “unrelated” processes, and even between processes on different machines. Interprocess communication (IPC) is the transfer of data among processes. For example, a Web browser may request a Web page from a Web server, which then sends HTML data.This transfer of data usually uses sockets in a telephone-like connection. In another example, you may want to print the filenames in a directory using a command such as ls | lpr.The shell creates an ls process and a separate lpr process, connecting 06 0430 CH05 5/22/01 10:22 AM Page 96 96 Chapter 5 Interprocess Communication the two with a pipe, represented by the “|” symbol.A pipe permits one-way commu- nication between two related processes.The ls process writes data into the pipe, and the lpr process reads data from the pipe.
    [Show full text]
  • Real-Time Streaming Video and Image Processing on Inexpensive Hardware with Low Latency
    University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln Theses, Dissertations, and Student Research Electrical & Computer Engineering, Department from Electrical & Computer Engineering of Spring 5-2018 Real-Time Streaming Video and Image Processing on Inexpensive Hardware with Low Latency Richard L. Gregg University of Nebraska - Lincoln, [email protected] Follow this and additional works at: https://digitalcommons.unl.edu/elecengtheses Part of the Computer Engineering Commons, and the Other Electrical and Computer Engineering Commons Gregg, Richard L., "Real-Time Streaming Video and Image Processing on Inexpensive Hardware with Low Latency" (2018). Theses, Dissertations, and Student Research from Electrical & Computer Engineering. 93. https://digitalcommons.unl.edu/elecengtheses/93 This Article is brought to you for free and open access by the Electrical & Computer Engineering, Department of at DigitalCommons@University of Nebraska - Lincoln. It has been accepted for inclusion in Theses, Dissertations, and Student Research from Electrical & Computer Engineering by an authorized administrator of DigitalCommons@University of Nebraska - Lincoln. Real-Time Streaming Video And Image Processing On Inexpensive Hardware With Low Latency by Richard L. Gregg A THESIS Presented to the Faculty of The Graduate College at the University of Nebraska In Partial Fulfillment of Requirements For the Degree of Master of Science Major: Telecommunications Engineering Under the Supervision of Professor Dongming Peng Lincoln, Nebraska May 2018 REAL-TIME STREAMING VIDEO AND IMAGE PROCESSING ON INEXPENSIVE HARDWARE WITH LOW LATENCY Richard L. Gregg, M.S. University of Nebraska, 2018 Advisor: Dongming Peng The use of resource constrained inexpensive hardware places restrictions on the design of streaming video and image processing system performance.
    [Show full text]
  • Lecture 14: Paging
    Lecture 14: Paging Fall 2018 Jason Tang Slides based upon Operating System Concept slides, http://codex.cs.yale.edu/avi/os-book/OS9/slide-dir/index.html Copyright Silberschatz, Galvin, and Gagne, 2013 "1 Topics • Memory Mappings! • Page Table! • Translation Lookaside Bu$ers! • Page Protection "2 Memory Mapped • Logical address translated not to memory but some other location! • Memory-mapped I/O (MMIO): hardware redirects read/write of certain addresses to physical device! • For example, on x86, address 0x3F8 usually mapped to first serial port! • Memory-mapped file (mmap): OS redirects read/write of mapped memory region to file on disk! • Every call to read() / write() involves a system call! • Writing to a pointer faster, and OS can translate in the background (also see upcoming lecture) "3 Memory-Mapped File • In Linux, typical pattern is to:! • Open file, using open() function! • Optional: preallocate file size, using ftruncate()! • Create memory mapping, using mmap() function! • Do work, and then release mapping using munmap() function! • Kernel might not write data to disk until munmap() "4 mmap() function void *mmap(void *addr, size_t length, int prot, int flags, int fd, off_t offset) • addr is target address of mapping, or NULL to let kernel decide! • length is number of bytes to map! • prot defines what mapping protection (read-only or read/write)! • flags sets other options! • fd is file descriptor that was returned by open()! • offset is o$set into file specified by fd "5 mmap() example part 1 • See man page for each of these functions
    [Show full text]
  • Process Address Spaces and Binary Formats
    2/5/20 COMP 790: OS Implementation COMP 790: OS Implementation Logical Diagram Binary Memory Process Address Spaces Threads Formats AllocatorsToday’s and Binary Formats Lecture User System Calls Kernel Don Porter RCU File System Networking Sync Memory Device CPU Management Drivers Scheduler Hardware Interrupts Disk Net Consistency 1 2 1 2 COMP 790: OS Implementation COMP 790: OS Implementation Review Definitions (can vary) • We’ve seen how paging and segmentation work on • Process is a virtual address space x86 – 1+ threads of execution work within this address space – Maps logical addresses to physical pages • A process is composed of: – These are the low-level hardware tools – Memory-mapped files • This lecture: build up to higher-level abstractions • Includes program binary • Namely, the process address space – Anonymous pages: no file backing • When the process exits, their contents go away 3 4 3 4 COMP 790: OS Implementation COMP 790: OS Implementation Address Space Layout Simple Example • Determined (mostly) by the application • Determined at compile time Virtual Address Space – Link directives can influence this hello heap stk libc.so • See kern/kernel.ld in JOS; specifies kernel starting address • OS usually reserves part of the address space to map 0 0xffffffff itself • “Hello world” binary specified load address – Upper GB on x86 Linux • Also specifies where it wants libc • Application can dynamically request new mappings from the OS, or delete mappings • Dynamically asks kernel for “anonymous” pages for its heap and stack 5 6 5 6 1 2/5/20 COMP 790: OS Implementation COMP 790: OS Implementation In practice Problem 1: How to represent in the kernel? • You can see (part of) the requested memory layout • What is the best way to represent the components of of a program using ldd: a process? $ ldd /usr/bin/git – Common question: is mapped at address x? linux-vdso.so.1 => (0x00007fff197be000) • Page faults, new memory mappings, etc.
    [Show full text]
  • CS162 Operating Systems and Systems Programming Lecture 19
    CS162 Operating Systems and Systems Programming Lecture 19 File Systems (Con’t), MMAP October 1st, 2017 Prof. Ion Stoica http://cs162.eecs.Berkeley.edu So What About a “Real” File System? • Meet the inode: Inode Array Triple Double Indirect Indirect Indirect Data Inode Blocks Blocks Blocks Blocks File file_number Metadata ... ... ... Direct ... Pointers ... ... ... ... ... Indirect Pointer Dbl. Indirect Ptr. Tripl. Indrect Ptr. ... ... ... ... ... ... ... 11/1/17 CS162 © UCB Fall 2017 Lec 19.2 An “Almost Real” File System • Pintos: src/filesys/file.c, inode.c Inode Array Triple Double Indirect Indirect Indirect Data Inode Blocks Blocks Blocks Blocks File file_number Metadata ... ... ... Direct ... Pointers ... ... ... ... ... Indirect Pointer Dbl. Indirect Ptr. Tripl. Indrect Ptr. ... ... ... ... ... ... ... 11/1/17 CS162 © UCB Fall 2017 Lec 19.3 Unix File System (1/2) • Original inode format appeared in BSD 4.1 – Berkeley Standard Distribution Unix – Part of your heritage! – Similar structure for Linux Ext2/3 • File Number is index into inode arrays • Multi-level index structure – Great for little and large files – Asymmetric tree with fixed sized blocks 11/1/17 CS162 © UCB Fall 2017 Lec 19.4 Unix File System (2/2) • Metadata associated with the file – Rather than in the directory that points to it • UNIX Fast File System (FFS) BSD 4.2 Locality Heuristics: – Block group placement – Reserve space • Scalable directory structure 11/1/17 CS162 © UCB Fall 2017 Lec 19.5 File Attributes • inode metadata Inode Array Triple Double Indirect Indirect Indirect Data Inode Blocks Blocks Blocks Blocks File Metadata ... User ... ... Group Direct ... Pointers 9 basic access control bits ... - UGO x RWX ... ... ... Setuid bit ... Indirect Pointer - execute at owner permissionsDbl.
    [Show full text]
  • Shared Memory Introduction
    12 Shared Memory Introduction 12.1 Introduction Shared memory is the fastest form of IPC available. Once the memory is mapped into the address space of the processes that are sharing the memory region, no kernel involvement occurs in passing data between the processes. What is normally required, however, is some form of synchronization between the processes that are storing and fetching information to and from the shared memory region. In Part 3, we discussed various forms of synchronization: mutexes, condition variables, read–write locks, record locks, and semaphores. What we mean by ‘‘no kernel involvement’’ is that the processes do not execute any sys- tem calls into the kernel to pass the data. Obviously, the kernel must establish the mem- ory mappings that allow the processes to share the memory, and then manage this memory over time (handle page faults, and the like). Consider the normal steps involved in the client–server file copying program that we used as an example for the various types of message passing (Figure 4.1). • The server reads from the input file. The file data is read by the kernel into its memory and then copied from the kernel to the process. • The server writes this data in a message, using a pipe, FIFO, or message queue. These forms of IPC normally require the data to be copied from the process to the kernel. We use the qualifier normally because Posix message queues can be implemented using memory-mapped I/O (the mmap function that we describe in this chapter), as we showed in Section 5.8 and as we show in the solution to Exercise 12.2.
    [Show full text]