DOCSLIB.ORG

A Component-Based Environment for Android Apps

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
A Component-Based Environment for Android Apps A Component-based Environment for Android Apps Alexander Senier FOSDEM, Brussels, 2020-02-02 Smartphone Trust Challenges Privilege Escalation 2020-02-02 2 Media Frameworks are not getting simpler. How do we avoid such fatal errors? 2020-02-02 3 Trustworthy Systems Component-based Architectures ■ Can’t reimplement everything ■ Solution: software reuse ▪ Untrusted software (gray) Protocol validator (e.g. Firewall) ▪ Policy object (green) ▪ Client software (orange) ■ Policy object Network Web ▪ Establishes assumptions of client Stack browser ▪ Sanitizes ▪ Enforces additional policies 2020-02-02 4 Information Flow Correctness 2020-02-02 5 Trustworthy Systems Information Flow: Genode OS Framework ■ Recursive system structure ■ Hierarchical System ▪ Root: Microkernel Architecture ▪ Parent: Responsibility + control ▪ Isolation is default ▪ Strict communication policy ■ Everything is a user-process ▪ Application ▪ File systems ▪ Drivers, Network stacks ■ Stay here for the next 2 talks for details (13:00) 2020-02-02 https://genode.org 6 Trustworthy Systems Correctness: SPARK ■ Programming Language ■ Applications ▪ Based on Ada ▪ Avionics ▪ Compilable with GCC and LLVM ▪ Defense ▪ Customizable runtimes ▪ Air Traffic Control ▪ Contracts (preconditions, postconditions, invariants) ▪ Space ■ Verification Toolset ▪ Automotive ▪ Absence of runtime errors ▪ Medical Devices ▪ Functional correctness ▪ Security 2020-02-02 https://www.adacore.com/about-spark 7 Applying this Approach to Android Apps 2020-02-02 8 GART Project Objectives ■ Unmodified Android Apps ■ On top of Genode OS Framework ■ Formally-verified policy objects 2020-02-02 9 GART Project Elements ■ Build system ■ Android Runtime ■ Trusted Proxies ■ IPC 2020-02-02 10 Build System Integration 2020-02-02 11 Build System Integration Android Build Files ■ Soong replaced old make-based build system in Oreo (8.0) ■ JSON-like blueprint files cc_binary { ■ Purely declarative – no name: "gzip", conditionals, no control flow srcs: ["src/test/minigzip.c"], ■ Complex cases handled in Go shared_libs: ["libz"], application stl: "none", } ■ Manifests for the Ninja build system are generated 2020-02-02 12 Build System Integration Translating Android Build Files $ gnoos -b android -i libnativehelper/Android.bp -o libnativehelper.mk -p LIBNATIVEHELPER_ \ '/cc_library[@name=libnativehelper]' $ cat libnativehelper.mk LIBNATIVEHELPER_CFLAGS = -Werror -fvisibility=protected LIBNATIVEHELPER_EXPORT_HEADER_LIB_HEADERS = jni_headers jni_platform_headers libnativehelper_header_only LIBNATIVEHELPER_EXPORT_INCLUDE_DIRS = include LIBNATIVEHELPER_HEADER_LIBS = jni_headers jni_platform_headers libnativehelper_header_only LIBNATIVEHELPER_HOST_SUPPORTED = True LIBNATIVEHELPER_NAME = libnativehelper LIBNATIVEHELPER_SHARED_LIBS = liblog LIBNATIVEHELPER_SRCS = JNIHelp.cpp JniConstants.cpp JniInvocation.cpp toStringArray.cpp 2020-02-02 13 Build System Integration Integrating Android Build Files (1) ■ Gnoos has been integrated into Genode build system ■ Consistent with regular Genode applications ▪ Library build files are in lib/mk ▪ Library import files are in lib/import ▪ Applications have a target.mk 2020-02-02 14 Build System Integration Integrating Android Build Files (2) ■ Porting native Android applications is easy ■ With run script, they can be run as every other Genode application ■ makes porting Android tests a one-liner gart_gtest_main $ make -C build/arm_v8a run/test/libutils AAB [init A> libutils_test] Note: Google Test filter = -VectorTest.SetCapacity_Overflow:VectorTest._grow_OverflowSize [init A> libutils_test] :VectorTest._grow_OverflowCapacrstr16EmptyTarget_bug:SystemClock.SystemClock [init A> libutils_test] [==========] Running 61 tests from 9 test cases. [init A> libutils_test] [----------] Global test environment set-up. [init A> libutils_test] [----------] 3 tests from VectorTest [init A> libutils_test] [ RUN ] VectorTest.CopyOnWrite_CopyAndAddElements [init A> libutils_test] [ OK ] VectorTest.CopyOnWrite_CopyAndAddElements (2 ms) AAB [init A> libutils_test] [ PASSED ] 61 tests. [init] child "libutils_test" exited with exit value 0 Run script execution successful. make: Leaving directory 'build/arm_v8a' 2020-02-02 15 Android Runtime 2020-02-02 16 Android Runtime Dependencies libvixld-arm libsigchain libvixld-arm64 art_libdexfile_tests libartd-disassembler art_runtime_tests libart-gtest libart-compiler-gtest art_runtime_compiler_tests liblz4 libgtest_prod libicui18n libnativehelper libicuuc libart-runtime-gtest libmetricslogger libartd-compiler libicuuc_stubdata libartd libnativeloader libnativebridge liblog libgtest libbase libartbased liblzma libcutils libbacktrace libdemangle libasync_safe libtombstoned_client libvndksupport libdexfiled libziparchive libz libutils libdl ld-android 2020-02-02 17 Android Runtime Components ■ dalvikvm ▪ Only ~200 LOC ▪ Linked with only few libraries – , , libsigchain libnativehelper libc ■ Item1▪ : interception layer for signals libsigchain ■ Titem2▪ : helpers for Java/native interface libnativehelper ■ ▪libartSubitem ▪ Actual Java Virtual Machine ▪ Loaded dynamically by dalvikvm ▪ > 50 dependencies that needed to be ported 2020-02-02 18 Android Runtime Current State ■ dalvikvm and libart ported to Genode ▪ The ~1000 tests cases of dependencies succeed ▪ Most of the ~500 ART test cases succeed ■ ▪Item1Runtime fully initializes and starts Java program on Genode/arm_v8a ■ Titem2(and then crashes, see below ;) ■ ▪OpenSubitem issues ▪ Concurrency bugs due to missing futex implementation ▪ Probably some more due to differences between Genodes libc and Linux ▪ Runtime-compiler basically ported, but still has issues 2020-02-02 https://github.com/Componolit/gart 19 Trusted Proxies 2020-02-02 20 Trusted Proxies Component Environment ■ Gneiss component library ■ Downsized SPARK/Ada runtime ▪ Fully asynchronous, event-driven ▪ Optimized for critical low- and platform-independent complexity components ▪ Support for Genode, Muen and ▪ No allocators, no exception Linux handlers, no implicit dynamic ▪ Only constructs that are formally code, no tasking... verifiable with SPARK proof tools ▪ Support for Genode, Muen and ▪ Generic interfaces: Log, timer, Linux block device, message, shared ▪ Easy to customize and port to memory new (embedded) environments ■ See recordings of previous talk by Johannes Kliemann for details 2020-02-02 https://github.com/Componolit/ada-runtime | https://github.com/Componolit/gneiss 21 Trusted Proxies Verified Binary Parsers ■ RecordFlux package TLV is ▪ DSL and toolset for formal type Tag is (Msg_Data A> 1, specification of binary messages Msg_Error A> 3) with Size A> 2; type Length is mod 2ARFSQ ▪ Model verification (absence of contradictions, reachability, ...) type Message is message ▪ Generation of verifiable binary Tag : Tag then Length parsers if Tag = Msg_Data, then null ▪ Generation of message if Tag = Msg_Error; generators Length : Length then Value ■ See recording of Tobias Reihers with Length A> Length * 8; Value : Payload; talk for details (Saturday, 11:30, end messageQ security devroom) end TLV; 2020-02-02 https://github.com/Componolit/RecordFlux | https://arxiv.org/abs/1910.02146 22 Future Work / Next Up: Android IPC 2020-02-02 23 2020-02-02 24 Android IPC Binder device Binder devices "/dev/binder" open : int "/dev/hwbinder" Pathname: String ! " "/dev/vndbinder" Flags: Int ioctl : int FD : Int Open flags Binder requests Request : Unsigned_Long O_RDWR #I$D%R_WRI&%_R%'D Perform read/write operation Data : Pointer ■ Linux device node /dev/[vnd|hw|]binder #I$D%R_S%&_(')_&*R%'DS Set maximum number of binder threads #I$D%R_S%&_+O$&%)&_(,R Become context manager #I$D%R_&*R%'D_%)I& Exit a binder thread #I$D%R_-%RSIO$ Retrieve binder version Binder data binder_write_read Re./est ! #I$D%R_WRI&%_R%'D ▪ Interaction through interface Write_Size : Signed_Long B tes to write ioctl() Write_Consumed : Signed_Long B tes consumed b !erne" driver si5e Write_Buffer : Pointer Pointer to write bu#er Read_Size : Signed_Long B tes to read Read_Consumed : Signed_Long B tes consumed b !erne" driver Read_Buffer : Pointer Pointer to read bu#er binder_set_max_threads Re./est ! #I$D%R_S%&_(')_&*R%'DS Unsigned_01 $aximum number of threads ▪ Blocking or non-blocking binder_version Re./est ! #I$D%R_-%RSIO$ Protocol_Version : Signed_01 %river protoco" version void Re./est ! #I$D%R_&*R%'D_%)I& void Re./est ! #I$D%R_S%&_+O$&%)&_(,R ▪ Send and/or receive phase Binder_%river_,ommand_Protoco" #+_&R'$S'+&IO$ #+_R%PL4 #+_9R%%_#U99%R #+_I$+R%9S #+_'+;UIR% #+_R%L%'S% #+_D%+R%9S ■ Data is passed via linked data structure #+_I$+R%9S_DO$% #+_'+;UIR%_DO$% #+_R%,IS&%R_LOOP%R #+_%$&%R_LOOP%R #+_%)I&_LOOP%R #+_R%;U%S&_D%'&*_$O&I9I+'&IO$ #+_+L%'R_D%'&*_$O&I9I+'&IO$ Binder transaction #+_D%'D_#I$D%R_DO$% ▪ Local/remote objects with reference counting Command : Unsigned_01 #+_&R'$S'+&IO$_S, binder_transaction_data #+_R%PL4_S, +o223nd ! #+_&R'$S'+&IO$ ∨ +o223nd ! #+_R%PL4 Handle: U01 %escriptor for remote ob&ects Ptr: Pointer Pointer to "oca" ob&ects Cookie : Pointer 'arget ob&ect coo!ie 'ransaction flags Code : U01 Remote method (% &9_O$%_W'4 One>w3A c3ll@ 3sAnchrono/s@ no ret/rn Flags : U01 )"ags &9_ROO&_O#J%+& +ontents 3re the co2ponents root obKect Sender_PID : Pid Sender process (% &9_S&'&US_+OD% +ontents 3re 3 01>bit st3t/s code Sender_ !ID : Uid E#ective user (% of sender &9_'++%P&_9DS 'llow replies with Ble descriptors ▪ Special objects Data_Size : Si5e *umber of b tes of data si5e "ffsets_Size: Si5e *umber of b tes of o#sets Buffer: Pointer 'ransaction data Bu#: U6 768 (n"ine data
Load more

Recommended publications
  • Unix Protection
    View access control as a matrix Protection Ali Mashtizadeh Stanford University Subjects (processes/users) access objects (e.g., files) • Each cell of matrix has allowed permissions • 1 / 39 2 / 39 Specifying policy Two ways to slice the matrix Manually filling out matrix would be tedious • Use tools such as groups or role-based access control: • Along columns: • - Kernel stores list of who can access object along with object - Most systems you’ve used probably do this dir 1 - Examples: Unix file permissions, Access Control Lists (ACLs) Along rows: • dir 2 - Capability systems do this - More on these later. dir 3 3 / 39 4 / 39 Outline Example: Unix protection Each process has a User ID & one or more group IDs • System stores with each file: • 1 Unix protection - User who owns the file and group file is in - Permissions for user, any one in file group, and other Shown by output of ls -l command: 2 Unix security holes • user group other owner group - rw- rw- r-- dm cs140 ... index.html 3 Capability-based protection - Eachz}|{ groupz}|{ z}|{ of threez}|{ lettersz }| { specifies a subset of read, write, and execute permissions - User permissions apply to processes with same user ID - Else, group permissions apply to processes in same group - Else, other permissions apply 5 / 39 6 / 39 Unix continued Non-file permissions in Unix Directories have permission bits, too • Many devices show up in file system • - Need write permission on a directory to create or delete a file - E.g., /dev/tty1 permissions just like for files Special user root (UID 0) has all
    [Show full text]
  • A Practical UNIX Capability System
    A Practical UNIX Capability System Adam Langley <[email protected]> 22nd June 2005 ii Abstract This report seeks to document the development of a capability security system based on a Linux kernel and to follow through the implications of such a system. After defining terms, several other capability systems are discussed and found to be excellent, but to have too high a barrier to entry. This motivates the development of the above system. The capability system decomposes traditionally monolithic applications into a number of communicating actors, each of which is a separate process. Actors may only communicate using the capabilities given to them and so the impact of a vulnerability in a given actor can be reasoned about. This design pattern is demonstrated to be advantageous in terms of security, comprehensibility and mod- ularity and with an acceptable performance penality. From this, following through a few of the further avenues which present themselves is the two hours traffic of our stage. Acknowledgments I would like to thank my supervisor, Dr Kelly, for all the time he has put into cajoling and persuading me that the rest of the world might have a trick or two worth learning. Also, I’d like to thank Bryce Wilcox-O’Hearn for introducing me to capabilities many years ago. Contents 1 Introduction 1 2 Terms 3 2.1 POSIX ‘Capabilities’ . 3 2.2 Password Capabilities . 4 3 Motivations 7 3.1 Ambient Authority . 7 3.2 Confused Deputy . 8 3.3 Pervasive Testing . 8 3.4 Clear Auditing of Vulnerabilities . 9 3.5 Easy Configurability .
    [Show full text]
  • System Calls System Calls
    System calls We will investigate several issues related to system calls. Read chapter 12 of the book Linux system call categories file management process management error handling note that these categories are loosely defined and much is behind included, e.g. communication. Why? 1 System calls File management system call hierarchy you may not see some topics as part of “file management”, e.g., sockets 2 System calls Process management system call hierarchy 3 System calls Error handling hierarchy 4 Error Handling Anything can fail! System calls are no exception Try to read a file that does not exist! Error number: errno every process contains a global variable errno errno is set to 0 when process is created when error occurs errno is set to a specific code associated with the error cause trying to open file that does not exist sets errno to 2 5 Error Handling error constants are defined in errno.h here are the first few of errno.h on OS X 10.6.4 #define EPERM 1 /* Operation not permitted */ #define ENOENT 2 /* No such file or directory */ #define ESRCH 3 /* No such process */ #define EINTR 4 /* Interrupted system call */ #define EIO 5 /* Input/output error */ #define ENXIO 6 /* Device not configured */ #define E2BIG 7 /* Argument list too long */ #define ENOEXEC 8 /* Exec format error */ #define EBADF 9 /* Bad file descriptor */ #define ECHILD 10 /* No child processes */ #define EDEADLK 11 /* Resource deadlock avoided */ 6 Error Handling common mistake for displaying errno from Linux errno man page: 7 Error Handling Description of the perror () system call.
    [Show full text]
  • Advanced Components on Top of a Microkernel
    Faculty of Computer Science Institute for System Architecture, Operating Systems Group Advanced Components on Top of A Microkernel Björn Döbel What we talked about so far • Microkernels are cool! • Fiasco.OC provides fundamental mechanisms: – Tasks (address spaces) • Container of resources – Threads • Units of execution – Inter-Process Communication • Exchange Data • Timeouts • Mapping of resources TU Dresden, 2012-07-24 L4Re: Advanced Components Slide 2 / 54 Lecture Outline • Building a real system on top of Fiasco.OC • Reusing legacy libraries – POSIX C library • Device Drivers in user space – Accessing hardware resources – Reusing Linux device drivers • OS virtualization on top of L4Re TU Dresden, 2012-07-24 L4Re: Advanced Components Slide 3 / 54 Reusing Existing Software • Often used term: legacy software • Why? – Convenience: • Users get their “favorite” application on the new OS – Effort: • Rewriting everything from scratch takes a lot of time • But: maintaining ported software and adaptions also does not come for free TU Dresden, 2012-07-24 L4Re: Advanced Components Slide 4 / 54 Reusing Existing Software • How? – Porting: • Adapt existing software to use L4Re/Fiasco.OC features instead of Linux • Efficient execution, large maintenance effort – Library-level interception • Port convenience libraries to L4Re and link legacy applications without modification – POSIX C libraries, libstdc++ – OS-level interception • Wine: implement Windows OS interface on top of new OS – Hardware-level: • Virtual Machines TU Dresden, 2012-07-24 L4Re:
    [Show full text]
  • Lecture Notes in Assembly Language
    Lecture Notes in Assembly Language Short introduction to low-level programming Piotr Fulmański Łódź, 12 czerwca 2015 Spis treści Spis treści iii 1 Before we begin1 1.1 Simple assembler.................................... 1 1.1.1 Excercise 1 ................................... 2 1.1.2 Excercise 2 ................................... 3 1.1.3 Excercise 3 ................................... 3 1.1.4 Excercise 4 ................................... 5 1.1.5 Excercise 5 ................................... 6 1.2 Improvements, part I: addressing........................... 8 1.2.1 Excercise 6 ................................... 11 1.3 Improvements, part II: indirect addressing...................... 11 1.4 Improvements, part III: labels............................. 18 1.4.1 Excercise 7: find substring in a string .................... 19 1.4.2 Excercise 8: improved polynomial....................... 21 1.5 Improvements, part IV: flag register ......................... 23 1.6 Improvements, part V: the stack ........................... 24 1.6.1 Excercise 12................................... 26 1.7 Improvements, part VI – function stack frame.................... 29 1.8 Finall excercises..................................... 34 1.8.1 Excercise 13................................... 34 1.8.2 Excercise 14................................... 34 1.8.3 Excercise 15................................... 34 1.8.4 Excercise 16................................... 34 iii iv SPIS TREŚCI 1.8.5 Excercise 17................................... 34 2 First program 37 2.1 Compiling,
    [Show full text]
  • Operating System Support for Parallel Processes
    Operating System Support for Parallel Processes Barret Rhoden Electrical Engineering and Computer Sciences University of California at Berkeley Technical Report No. UCB/EECS-2014-223 http://www.eecs.berkeley.edu/Pubs/TechRpts/2014/EECS-2014-223.html December 18, 2014 Copyright © 2014, by the author(s). All rights reserved. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission. Operating System Support for Parallel Processes by Barret Joseph Rhoden A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Computer Science in the Graduate Division of the University of California, Berkeley Committee in charge: Professor Eric Brewer, Chair Professor Krste Asanovi´c Professor David Culler Professor John Chuang Fall 2014 Operating System Support for Parallel Processes Copyright 2014 by Barret Joseph Rhoden 1 Abstract Operating System Support for Parallel Processes by Barret Joseph Rhoden Doctor of Philosophy in Computer Science University of California, Berkeley Professor Eric Brewer, Chair High-performance, parallel programs want uninterrupted access to physical resources. This characterization is true not only for traditional scientific computing, but also for high- priority data center applications that run on parallel processors. These applications require high, predictable performance and low latency, and they are important enough to warrant engineering effort at all levels of the software stack.
    [Show full text]
  • Android Porting Guide Step by Step
    Android Porting Guide Step By Step ChristoferBarometric remains Derron left-handstill connects: after postulationalSpenser snoops and kinkilywispier or Rustin preacquaint microwaves any caterwaul. quite menacingly Hewie graze but intubated connectedly. her visionaries hereditarily. The ramdisk of the logs should be placed in API calls with the thumb of the code would cause problems. ROMs are desperate more difficult to figure naked but the basic skills you seek be taught here not be applied in principle to those ROMs. Find what catch the prescribed procedures to retrieve taken. Notification data of a surface was one from android porting guide step by step by specific not verify your new things at runtime. Common interface to control camera device on various shipsets and used by camera source plugin. If tap have executed any state the commands below and see want i run the toolchain build again, like will need maybe open a fancy shell. In cases like writing, the input API calls are they fairly easy to replace, carpet the accelerometer input may be replaced by keystrokes, say. Sometimes replacing works and some times editing. These cookies do not except any personally identifiable information. When you decide up your email account assess your device, Android automatically uses SSL encrypted connection. No custom ROM developed for team yet. And Codeaurora with the dtsi based panel configuration, does charity have a generic drm based driver under general hood also well? Means describe a lolipop kernel anyone can port Marshmallow ROMs? Fi and these a rain boot. After flashing protocol. You least have no your fingertips the skills to build a full operating system from code and install navigate to manage running device, whenever you want.
    [Show full text]
  • Capability Myths Demolished
    Capability Myths Demolished Mark S. Miller Ka-Ping Yee Jonathan Shapiro Combex, Inc. University of California, Berkeley Johns Hopkins University [email protected] [email protected] [email protected] ABSTRACT The second and third myths state false limitations on We address three common misconceptions about what capability systems can do, and have been capability-based systems: the Equivalence Myth (access propagated by a series of research publications over the control list systems and capability systems are formally past 20 years (including [2, 3, 7, 24]). They have been equivalent), the Confinement Myth (capability systems cited as reasons to avoid adopting capability models cannot enforce confinement), and the Irrevocability and have even motivated some researchers to augment Myth (capability-based access cannot be revoked). The capability systems with extra access checks [7, 13] in Equivalence Myth obscures the benefits of capabilities attempts to fix problems that do not exist. The myths as compared to access control lists, while the Confine- about what capability systems cannot do continue to ment Myth and the Irrevocability Myth lead people to spread, despite formal results [22] and practical see problems with capabilities that do not actually exist. systems [1, 9, 18, 21] demonstrating that they can do these supposedly impossible things. The prevalence of these myths is due to differing inter- pretations of the capability security model. To clear up We believe these severe misunderstandings are rooted the confusion, we examine three different models that in the fact that the term capability has come to be have been used to describe capabilities, and define a set portrayed in terms of several very different security of seven security properties that capture the distinctions models.
    [Show full text]
  • CS140 – Operating Systems
    CS140 – Operating Systems Instructors: Adam Belay, Ali Mashtizadeh, David Mazieres` CAs: Michael Chang, Peter Johnston, Yutian Liu, Rush Moody, Rasmus Rygaard, Jayesh Yerrapragada Stanford University 1 / 33 Administrivia • Class web page: http://cs140.scs.stanford.edu/ - All assignments, handouts, lecture notes on-line • Textbook: Operating System Concepts, 8th Edition, by Silberschatz, Galvin, and Gagne - 9th edition is way more expensive, I haven’t looked at it - Trying to ween class from textbook anyway—consider it optional • Goal is to make lecture slides the primary reference - Almost everything I talk about will be on slides - PDF slides contain links to further reading about topics - Please download slides from class web page 2 / 33 Administrivia 2 • Staff mailing list: [email protected] - Please mail staff list rather than individuals for help • Google group 15wi-cs140 is main discussion forum • Key dates: - Lectures: MW 4:15–5:30pm, Gates B01 - Section: Some Fridays, time/location TBD - Midterm: Monday, Feb 9, 4:15–5:30pm (in class) - Final: Thursday, March 19, 12:15pm–3:15pm • Exams open note, but not open book - Bring notes, slides, any printed materials except textbook - No electronic devices permitted 3 / 33 Lecture videos • Lectures will be televised for SCPD students - Can also watch if you miss a lecture, or to review - But resist temptation to miss a bunch of lectures and watch them all at once • SCPD students welcome to attend lecture in person - 4:15pm lecture time conveniently at end of work day - Many parking
    [Show full text]
  • Linux Internals
    LINUX INTERNALS Peter Chubb and Etienne Le Sueur [email protected] A LITTLE BIT OF HISTORY • Ken Thompson and Dennis Ritchie in 1967–70 • USG and BSD • John Lions 1976–95 • Andrew Tanenbaum 1987 • Linux Torvalds 1991 NICTA Copyright c 2011 From Imagination to Impact 2 The history of UNIX-like operating systems is a history of people being dissatisfied with what they have and wanting to do some- thing better. It started when Ken Thompson got bored with MUL- TICS and wanted to write a computer game (Space Travel). He found a disused PDP-7, and wrote an interactive operating sys- tem to run his game. The main contribution at this point was the simple file-system abstraction. (Ritchie 1984) Other people found it interesting enough to want to port it to other systems, which led to the first major rewrite — from assembly to C. In some ways UNIX was the first successfully portable OS. After Ritchie & Thompson (1974) was published, AT&T became aware of a growing market for UNIX. They wanted to discourage it: it was common for AT&T salesmen to say, ‘Here’s what you get: A whole lot of tapes, and an invoice for $10 000’. Fortunately educational licences were (almost) free, and universities around the world took up UNIX as the basis for teaching and research. The University of California at Berkeley was one of those univer- NICTA Copyright c 2011 From Imagination to Impact 2-1 sities. In 1977, Bill Joy (a postgrad) put together and released the first Berkeley Software Distribution — in this instance, the main additions were a pascal compiler and Bill Joy’s ex editor.
    [Show full text]
  • File Descriptors
    ���������������� �����������������everything is a file � main.c � a.out � /dev/sda1����������������� � /dev/tty2������������� � /proc/cpuinfo������������������������������� � ��������������������������������� ���������������������������������� ��file descriptor������������������������������������������� ������������������int ��� ������������� #include <sys/types.h> #include <sys/stat.h> #include <fcntl.h> int open(const char *path, int flags); ������������������flags��������������O_RDONLY� O_WRONLY�����O_RDWR �������O_CREAT�������������������������� #include <unistd.h> int close(int fd); ����������������������� � ������������������� #include <unistd.h> ssize_t read(int fd, void *buf, size_t n); ���������� fd����������������n������������buf #include <unistd.h> ssize_t write(int fd, const void *buf, size_t n); ���������fd��������������n������������buf ����������������������������������������������������� ���-1������������� � ����������������������� #include "csapp.h" ������ int main(int argc, char **argv) { ELF int fd = Open(argv[0], O_RDONLY, 0); char buf[5]; Read(fd, buf, 4); buf[4] = 0; printf("%s\n", buf+1); return 0; } ���� ����� ��������������� #include <unistd.h> int pipe(int fds[2]); ����������������������� ������������������������������ � fds[0]���������������� � fds[1]����������������� �� ���������������������������� #include "csapp.h" ������ int main(int argc, char **argv) { Hello int fds[2]; char buf[6]; Pipe(fds); Write(fds[1], "Hello", 5); Read(fds[0], buf, 5); buf[5] = 0; printf("%s\n", buf); return 0; } ���� ����� ���������������������������������
    [Show full text]
  • Of File Systems and Storage Models
    Chapter 4 Of File Systems and Storage Models Disks are always full. It is futile to try to get more disk space. Data expands to fill any void. –Parkinson’sLawasappliedto disks 4.1 Introduction This chapter deals primarily with how we store data. Virtually all computer systems require some way to store data permanently; even so-called “diskless” systems do require access to certain files in order to boot, run and be useful. Albeit stored remotely (or in memory), these bits reside on some sort of storage system. Most frequently, data is stored on local hard disks, but over the last few years more and more of our files have moved “into the cloud”, where di↵erent providers o↵er easy access to large amounts of storage over the network. We have more and more computers depending on access to remote systems, shifting our traditional view of what constitutes a storage device. 74 CHAPTER 4. OF FILE SYSTEMS AND STORAGE MODELS 75 As system administrators, we are responsible for all kinds of devices: we build systems running entirely without local storage just as we maintain the massive enterprise storage arrays that enable decentralized data replication and archival. We manage large numbers of computers with their own hard drives, using a variety of technologies to maximize throughput before the data even gets onto a network. In order to be able to optimize our systems on this level, it is important for us to understand the principal concepts of how data is stored, the di↵erent storage models and disk interfaces.Itisimportanttobeawareofcertain physical properties of our storage media, and the impact they, as well as certain historic limitations, have on how we utilize disks.
    [Show full text]