DOCSLIB.ORG

Securing the Virtual Infrastructure in the Laas Cloud Computing Model

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Securing the Virtual Infrastructure in the Laas Cloud Computing Model Securing the Virtual Infrastructure in the IaaS Cloud Computing Model by Amani S. Ibrahim This thesis is submitted in fulfilment of the requirements for the degree of Doctor of Philosophy. Faculty of Science, Engineering and Technology Swinburne University of Technology October 2014 Abstract With the advent of virtualization, the Infrastructure-as-a-Service (IaaS) cloud computing model has been widely deployed by organizations. One of the main issues with this model is the un- trusted client virtual machines security problem. Unlike traditional physical servers that are directly managed and protected by their owners, the security of hosted virtual machines in the IaaS platform relies on the cloud customer, who might be a malicious hacker. Moreover, these hosted virtual machines are owned and controlled by a cloud consumer, and at the same time they are hosted by a cloud provider. Thus, both consumers and providers claim the right to provide the security for the hosted virtual machines from their own perspectives, causing a loss-of-control security problem. In this research project, we address the loss-of-control security problem of the IaaS plat- form by introducing the concept of virtualization-aware security solutions. Virtualiza- tion-aware security solutions enable both cloud providers and consumers to fully utilize the virtualization advantages of the IaaS platform from both perspectives. Particularly, we introduce CloudSec++, a security appliance that has the ability to provide active, transparent and real-time monitoring and protection for the running operating systems in the hosted virtual machines, from outside the virtual machines themselves. CloudSec++ enables provision of security from a cloud provider’s perspective with no need to have any control over the hosted virtual machines, while passively incorporating consumers in maintaining the security of their hosted virtual machines. CloudSec++ has the ability to systematically protect multiple concurrent guest op- erating systems against zero-day threats that could target operating system’s kernel. In particular, CloudSec++ has the ability to defend against different types of pointer-manipulation attacks (whether known or unknown) that target kernel dynamic data and memory. Implementing such a virtualization-aware security solution is a multi-disciplinary research project, where a number of new mechanisms and techniques were introduced to address dif- ferent challenging problems. These mechanisms and techniques include: (i) a virtual machine introspection framework that enables active and transparent monitoring of the hosted virtual II machines at a hypervisor level. (ii) A new points-to analysis algorithm and a kernel dynamic objects discovery tool to support the automation of overcoming the semantic gap problem of hosted virtual machines, without a prior knowledge of the operating system’s kernel runtime data layout. (iii) A set of operating system runtime security tools that has the ability to defend against kernel dynamic data zero-day threats in a real-time fashion. (iv) A security appliance to host and deploy our developed virtualization-aware security solution in the IaaS platforms. III Acknowledgements I would like to express my heartfelt gratitude and thanks to my supervisors, Prof. John Grundy and Dr. James Hamlyn-Harris, for their support, guidance, and mentorship over the past four years. I thank both of them for their steadfast encouragement and invaluable advice. They greatly supported me to hurdle all the obstacles in the completion of this research work. Hon- estly, I have always counted myself very lucky and blessed to have both of them as my super- visors. I also thank all the friends, colleagues, and staff at SUCCESS, especially Gillian Foster, for all their help and support during my PhD journey. My highest and warmest gratitude, appreciation, and thanks to my parents, brother, sister and friends for their endless love, encouragement, and support to me to go through the ups and downs of my life including my PhD journey. A special feeling of gratitude to my mother who has been a source of encouragement and inspiration throughout my life. I also cannot forget to thank my kids Malak and Adam for being helpful and supportive in delaying me towards fin- ishing this work but honestly I enjoyed the journey with them. I have done my best to be a good and friendly mum for them during my PhD despite my responsibilities. Last but not least, the love of my life, my husband, Mohamed. No words can express my love and sincere gratitude towards him. I could not achieve anything in my life and this thesis is not an exception without him. He has been a great supporter at work and at home, with endless love and encouragement. Very special thanks for your practical and emotional support. Financial support for this research was provi ded by Swinburne Uni versity of Technology and VMsafe libraries research licence was provided by VMware. This PhD thesis is dedicated to the memory of my dear father. Declaration Hereby I certify that, this thesis contains no material which has been accepted for the award of any other degree or diploma, except where due reference is made in the text of the thesis. To the best of my knowledge, this thesis contains no material previously published or written by an- other person except where due reference is made in the text of the thesis. ______________________ Amani S. Ibrahim ______________________ Date V List of Publications A big portion of this research project was published in a number or papers. Below is a list of my publications during my PhD journey relevant to this thesis topic: 1. Amani S. Ibrahim, John C. Grundy, James Hamlyn-Harris, Mohamed Almorsy, "DIGGER: Identifying Operating System Dynamic Kernel Objects for Run-time Security Analysis", International Journal on Internet and Distributed Computing Systems (IJIDCS), 2013. 2. Amani S. Ibrahim, John C. Grundy, James Hamlyn-Harris, Mohamed Almorsy, "Identi- fying OS Kernel Runtime Objects for Run-time Security Analysis", 6th International Conference on Network and System Security (NSS 2012), Nov 21-23 2012, Wu Yi Shan, Fujian, China, Springer. 3. Amani S. Ibrahim, John C. Grundy, James Hamlyn-Harris, Mohamed Almorsy, "Operating System Kernel Data Disambiguation to Support Security Analysis", 6th International Conference on Network and System Security (NSS 2012), Nov 21-23 2012, Wu Yi Shan, Fujian, China, Springer. 4. Amani S. Ibrahim, John C. Grundy, James Hamlyn-Harris, Mohamed Almorsy, "Sup- porting Operating System Kernel Data Disambiguation using Points-to Analysis", 27th IEEE/ACM International Conference on Automated Software Engineering (ASE 2012), Sept 3-7 2012, Essen, Germany, ACM Press. 5. Amani S. Ibrahim, James Hamlyn-Harris, John Grundy and Mohamed Almorsy, "Sup- porting Virtualizaion-Aware Security Solutions using a Systematic Approach to Overcome the Semantic Gap", 5th IEEE Conference on Cloud Computing (CLOUD 2012), IEEE CS Press, Waikiki, Hawai, USA, June 24-29 2012. 6. Amani S. Ibrahim, James Hamlyn-Harris, John Grundy and Mohamed Almorsy, "CloudSec: A Security Monitoring Appliance for Virtual Machines in the IaaS Cloud Model", 5th International Conference on Network and System Security (NSS 2011), Milan, Italy on 6 – 8 September, 2011. 7. Amani S. Ibrahim, James Hamlyn-Harris and John Grundy, "Emerging Security Chal- lenges of Cloud Virtual Infrastructure", In Proceedings of the 2010 Asia Pacific Cloud Workshop 2010 (co located with APSEC2010), Sydney, Nov 30 2010. 8. Mohamed Almorsy, John Grundy, and Amani S. Ibrahim, "Adaptive Security Management in SaaS Applications", Security, Privacy and Trust in Cloud Systems, Book Springer (in press). 9. Mohamed Almorsy, John Grundy, and Amani S. Ibrahim, "Adaptable, Model-driven Se- curity Engineering for SaaS Cloud-based Applications", Automated Software Engineering Journal, to appear. VI Other papers co-authored during my PhD: 1. Mohamed Almorsy, John C. Grundy, Amani S. Ibrahim, "MDSE@R: Model-Driven Se- curity Engineering at Runtime”, The 4th International Symposium on Cyberspace Safety and Security (CSS 2012), Dec 12-13 2012, Melbourne, Australia. 2. Mohamed Almorsy, John Grundy, and Amani S. Ibrahim, "Automated Software Archi- tecture Security Risk Analysis Using Formalized Signatures", 2013 IEEE/ACM Interna- tional Conference on Software Engineering (ICSE 2013), San Franciso, May 2013, IEEE CS Press. 3. Mohamed Almorsy, John C. Grundy, Amani S. Ibrahim, "VAM-aaS: Online Cloud Ser- vices Security Vulnerability Analysis and Mitigation-as-a-Service”, The 13th International Conference on Web Information System Engineering (WISE 2012), Nov 28-30 2012, Paphos, Cyprus, Springer. 4. Mohamed Almorsy, John C. Grundy, Amani S. Ibrahim, "Supporting Automated Vulnera- bility Analysis using Formalized Vulnerability Signatures", 27th IEEE/ACM International Conference on Automated Software Engineering (ASE 2012), Sept 3-7 2012, Essen, Germany, ACM Press. 5. Mohamed Almorsy, John C. Grundy, Amani S. Ibrahim, "Supporting Automated Software Re-Engineering Using "Re-Aspects”, 27th IEEE/ACM International Conference on Au- tomated Software Engineering (ASE 2012), Sept 3-7 2012, Essen, Germany, ACM Press. 6. Mohamed Almorsy, John Grundy and Amani S. Ibrahim, "TOSSMA: A Tenant-Oriented SaaS Security Management Architecture", 5th IEEE Conference on Cloud Computing (CLOUD 2012), IEEE CS Press, Waikiki, Hawai, USA, June 24-29 2012. 7. Mohamed Almorsy, John Grundy and Amani S. Ibrahim, "SMURF: Supporting Mul- ti-tenancy Using Re-Aspects
Load more

Recommended publications
  • PC-BSD 9 Turns a New Page
    CONTENTS Dear Readers, Here is the November issue. We are happy that we didn’t make you wait for it as long as for October one. Thanks to contributors and supporters we are back and ready to give you some usefull piece of knowledge. We hope you will Editor in Chief: Patrycja Przybyłowicz enjoy it as much as we did by creating the magazine. [email protected] The opening text will tell you What’s New in BSD world. It’s a review of PC-BSD 9 by Mark VonFange. Good reading, Contributing: especially for PC-BSD users. Next in section Get Started you Mark VonFange, Toby Richards, Kris Moore, Lars R. Noldan, will �nd a great piece for novice – A Beginner’s Guide To PF Rob Somerville, Erwin Kooi, Paul McMath, Bill Harris, Jeroen van Nieuwenhuizen by Toby Richards. In Developers Corner Kris Moore will teach you how to set up and maintain your own repository on a Proofreaders: FreeBSD system. It’s a must read for eager learners. Tristan Karstens, Barry Grumbine, Zander Hill, The How To section in this issue is for those who enjoy Christopher J. Umina experimenting. Speed Daemons by Lars R Noldan is a very good and practical text. By reading it you can learn Special Thanks: how to build a highly available web application server Denise Ebery with advanced networking mechanisms in FreeBSD. The Art Director: following article is the �nal one of our GIS series. The author Ireneusz Pogroszewski will explain how to successfully manage and commission a DTP: complex GIS project.
    [Show full text]
  • Virtual Memory
    M08_STAL6329_06_SE_C08.QXD 2/21/08 9:31 PM Page 345 CHAPTER VIRTUAL MEMORY 8.1 Hardware and Control Structures Locality and Virtual Memory Paging Segmentation Combined Paging and Segmentation Protection and Sharing 8.2 Operating System Software Fetch Policy Placement Policy Replacement Policy Resident Set Management Cleaning Policy Load Control 8.3 UNIX and Solaris Memory Management Paging System Kernel Memory Allocator 8.4 Linux Memory Management Linux Virtual Memory Kernel Memory Allocation 8.5 Windows Memory Management Windows Virtual Address Map Windows Paging 8.6 Summary 8.7 Recommended Reading and Web Sites 8.8 Key Terms, Review Questions, and Problems APPENDIX 8A Hash Tables 345 M08_STAL6329_06_SE_C08.QXD 2/21/08 9:31 PM Page 346 346 CHAPTER 8 / VIRTUAL MEMORY Table 8.1 Virtual Memory Terminology Virtual memory A storage allocation scheme in which secondary memory can be addressed as though it were part of main memory.The addresses a program may use to reference mem- ory are distinguished from the addresses the memory system uses to identify physi- cal storage sites, and program-generated addresses are translated automatically to the corresponding machine addresses. The size of virtual storage is limited by the ad- dressing scheme of the computer system and by the amount of secondary memory available and not by the actual number of main storage locations. Virtual address The address assigned to a location in virtual memory to allow that location to be ac- cessed as though it were part of main memory. Virtual address space The virtual storage assigned to a process. Address space The range of memory addresses available to a process.
    [Show full text]
  • SLAKE: Facilitating Slab Manipulation for Exploiting
    SLAKE: Facilitating Slab Manipulation for Exploiting Vulnerabilities in the Linux Kernel Yueqi Chen Xinyu Xing [email protected] [email protected] The Pennsylvania State University The Pennsylvania State University ABSTRACT 1 INTRODUCTION To determine the exploitability for a kernel vulnerability, a secu- Despite extensive code review, a Linux kernel, like all other soft- rity analyst usually has to manipulate slab and thus demonstrate ware, still inevitably contains a large number of bugs and vulnerabil- the capability of obtaining the control over a program counter or ities [42]. Compared with vulnerabilities in user-level applications, performing privilege escalation. However, this is a lengthy process a vulnerability in kernel code is generally more disconcerting be- because (1) an analyst typically has no clue about what objects cause kernel code runs with a higher privilege and the successful and system calls are useful for kernel exploitation and (2) he lacks exploitation of a kernel vulnerability could provide an attacker with the knowledge of manipulating a slab and obtaining the desired full root access. layout. In the past, researchers have proposed various techniques One straightforward solution to minimize the damage of Linux to facilitate exploit development. Unfortunately, none of them can kernel defects is to have software developers and security analysts be easily applied to address these challenges. On the one hand, this patch all the bugs and vulnerabilities immediately. However, even is because of the complexity of the Linux kernel. On the other hand, though allowing anyone to contribute to code development and this is due to the dynamics and non-deterministic of slab variations.
    [Show full text]
  • A Guide to Kernel Exploitation Attacking the Core (2011
    A Guide to Kernel Exploitation This page intentionally left blank A Guide to Kernel Exploitation Attacking the Core Enrico Perla Massimiliano Oldani Technical Editor Graham Speake AMSTERDAM • BOSTON • HEIDELBERG • LONDON • • • NEW YORK OXFORD PARIS SAN DIEGO SYNGRESS SAN FRANCISCO • SINGAPORE • SYDNEY • TOKYO ® Syngress is an imprint of Elsevier Acquiring Editor: Rachel Roumeliotis Development Editor: Matthew Cater Project Manager: Julie Ochs Designer: Alisa Andreola Syngress is an imprint of Elsevier 30 Corporate Drive, Suite 400, Burlington, MA 01803, USA © 2011 Elsevier Inc. All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or any information storage and retrieval system, without permission in writing from the publisher. Details on how to seek permission, further information about the Publisher’s permissions policies and our arrangements with organizations such as the Copyright Clearance Center and the Copyright Licensing Agency, can be found at our website: www.elsevier.com/permissions. This book and the individual contributions contained in it are protected under copyright by the Publisher (other than as may be noted herein). Notices Knowledge and best practice in this field are constantly changing. As new research and experience broaden our understanding, changes in research methods or professional practices, may become necessary. Practitioners and researchers must always rely on their own experience and knowledge in evaluating and using any information or methods described herein. In using such information or methods they should be mindful of their own safety and the safety of others, including parties for whom they have a professional responsibility.
    [Show full text]
  • A Principled Approach to Kernel Memory Management
    A Principled Approach To Kernel Memory Management A thesis submitted to the School of Computer Science and Engineering at the University of New South Wales in fulfilment of the requirements for the degree of Doctor of Philosophy. Dhammika Elkaduwe 2010 !! " #$ % & '!( )' ( ! * + "()%',(-. /0012 /!! ! ! "# $$%' -. /0032 4!! 2 ! !& '( ) ) "* " , /0032 5!! 2 ' #&#67585 &9'-./0082 :!! "! & ) '( ( "* () ) )/0082 ;!! 2 1 $! ) '( *+ < . ( )/00;2 Abstract Small kernels are a promising approach to secure and reliable system construction. These systems reduce the size of the kernel to a point where it is feasible to formally verify the implementation correctness of the kernel with respect to an abstract formal model of the kernel’s behaviour. The system is composed of user-level components, isolated from one another using the kernel-provided mechanisms. The abstract formal model facilitates the enforcement, and reasoning about the enforcement of different policies between these user-level components. However, existing formal models only capture the application-level interface of a small kernel with no clear relationship between the externally visible access control model and the kernel’s low-level management of physical memory. In this work, a model for managing the in-kernel memory of a formally verified, small kernel is designed and evaluated for its formal and empirical characteristics. The design eliminates all implicit memory allocations within the kernel by promoting all dynamically allocated kernel memory into first-class, explicitly allocated kernel objects. This reduces the problem of physical memory management within the kernel to that of controlling the authority to perform these explicit allocations and controlling the dissemination of author- ity over already allocated objects.
    [Show full text]
  • Dynamic and Elastic Memory Management in Virtualized Clouds
    DYNAMIC AND ELASTIC MEMORY MANAGEMENT IN VIRTUALIZED CLOUDS A Dissertation Presented to The Academic Faculty By Wenqi Cao In Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the School of Computer Science Georgia Institute of Technology May 2019 Copyright c Wenqi Cao 2019 DYNAMIC AND ELASTIC MEMORY MANAGEMENT IN VIRTUALIZED CLOUDS Approved by: Dr. Ling Liu, Advisor Dr. David Devecsery School of Computer Science School of Computer Science Georgia Institute of Technology Georgia Institute of Technology Dr. Calton Pu, Co-Advisor Dr. Joy Arulraj School of Computer Science School of Computer Science Georgia Institute of Technology Georgia Institute of Technology Dr. Jay Lofstead Date Approved: March 26, 2019 Scalable System Software Group Sandia National Laboratories To my parents and my wife ACKNOWLEDGEMENTS I would like to express my deepest gratitude to my advisor, Dr. Ling Liu, for her guid- ance in this research and the support throughout my graduate study. She always inspires me to be a better researcher in many ways. I was especially fortunate to work with her and ben- efit from her advises. In addition to academic research, she always shares her life lessons with me and always been available whenever I need help. Her principles and dedication will have a great influence on me. I would also like to give special thanks to Dr. Calton Pu, Dr. David Devecsery, Dr. Joy Arulraj, and Dr. Jay Lofstead for their time to serve on my thesis committee and their valu- able feedback on my thesis proposal and final dissertation. Their welcome suggestions and insightful comments have greatly contributed to my thesis.
    [Show full text]
  • Operating Systems in Depth This Page Intentionally Left Blank OPERATING SYSTEMS in DEPTH
    This page intentionally left blank Operating Systems in Depth This page intentionally left blank OPERATING SYSTEMS IN DEPTH Thomas W. Doeppner Brown University JOHN WILEY & SONS, INC. vice-president & executive publisher Donald Fowley executive editor Beth Lang Golub executive marketing manager Christopher Ruel production editor Barbara Russiello editorial program assistant Mike Berlin senior marketing assistant Diana Smith executive media editor Thomas Kulesa cover design Wendy Lai cover photo Thomas W. Doeppner Cover photo is of Banggai Cardinalfi sh (Pterapogon kauderni), taken in the Lembeh Strait, North Sulawesi, Indonesia. This book was set in 10/12 Times Roman. The book was composed by MPS Limited, A Macmillan Company and printed and bound by Hamilton Printing Company. This book is printed on acid free paper. ϱ Founded in 1807, John Wiley & Sons, Inc. has been a valued source of knowledge and understanding for more than 200 years, helping people around the world meet their needs and fulfi ll their aspirations. Our company is built on a foundation of principles that include responsibility to the communities we serve and where we live and work. In 2008, we launched a Corporate Citizenship Initiative, a global effort to address the environmental, social, economic, and ethical challenges we face in our business. Among the issues we are addressing are carbon impact, paper specifi cations and procurement, ethical conduct within our business and among our vendors, and community and charitable support. For more information, please visit our
    [Show full text]
  • Memory Management in Freebsd 12.0
    Memory Management in FreeBSD 12.0 Mark Johnston BSDTW 2017 Introduction I Mark Johnston, [email protected] I OS Team at Dell EMC Isilon I FreeBSD user since 2010, committer since December 2012 I sys/vm neophyte since 2015 Responsibilities I Implementing the virtual memory abstraction I Syscalls: mmap, madvise, mprotect, minherit, mincore, msync, mlock, mlockall, munmap, munlock, munlockall I More syscalls: fork, vfork, execve, read, write, sendfile, ptrace, ... I Page fault handling Enforcing memory protection Copy-on-write Tracking page dirty state Page-in from swap, or a filesystem, or device memory Responsibilities, cont'd I Handling memory pressure Reclaiming pages, approximating LRU Page queue maintenance Laundering dirty pages I Kernel memory allocation malloc(9), free(9) Slab allocation (uma(9)) KVA allocation (vmem(9)) Physically contiguous allocations Physical address constraints (e.g., ISA DMA) I Miscellaneous tightly coupled subsystems FS buffer cache pmap(9) tmpfs(5), md(4) vmm(4), Linux drm drivers SYSV and POSIX shared memory Scalability w.r.t. CPU count and RAM size Good single-threaded performance VM Factoids I The VM is not a virtual machine I Originated from Mach, since 4.4BSD I Heavily reworked in the 1990s, dg@, dyson@, dillon@, alc@ Kernel Path Comments Code OpenBSD sys/uvm/ 7,716 13,853 FreeBSD sys/vm/ 9,246 21,468 illumos uts/common/vm/ 14,352 34,100 XNU osfmk/vm/ 17,007 52,400 Linux mm/ 28,476 78,260 Implications I The VM is complicated I Old foundations I Consistency and conceptual integrity are important I Some
    [Show full text]
  • Download The
    Visit : https://hemanthrajhemu.github.io Join Telegram to get Instant Updates: https://bit.ly/VTU_TELEGRAM Contact: MAIL: [email protected] INSTAGRAM: www.instagram.com/hemanthraj_hemu/ INSTAGRAM: www.instagram.com/futurevisionbie/ WHATSAPP SHARE: https://bit.ly/FVBIESHARE Contents Chapter 9 Virtual Memory . 9.1 Background 315 9.8 Allocating Kernel Memory 353 9.2 Demand Paging 319 9.9 Other Considerations 357 9.3 Copy-on-Write 325 9.10 Operating-System Examples 363 9.4 Page Replacement 327 9.11 Summary 365 9.5 Allocation of Frames 340 Exercises 366 9.6 Thrashing 343 Bibliographical Notes 370 9.7 Memory-Mapped Files 348 PART FOUR • STORAGE MANAGEMENT Chapter 10 File-System Interface 10.1 File Concept 373 10.6 Protection 402 10.2 Access Methods 382 10.7 Summary 407 10.3 Directory Structure 385 Exercises 408 10.4 File-System Mounting 395 Bibliographical Notes 409 10.5 File Sharing 397 Chapter 11 File-System Implementation 11.1 File-System Structure 411 11.8 Log-Structured File Systems 437 11.2 File-System Implementation 413 11.9 NFS 438 11.3 Directory Implementation 419 11.10 Example: The WAFL File System 444 11.4 Allocation Methods 421 11.11 Summary 446 11.5 Free-Space Management 429 Exercises 447 11.6 Efficiency and Performance 431 Bibliographical Notes 449 11.7 Recovery 435 Chapter 12 Mass-Storage Structure 12.1 Overview of Mass-Storage 12.7 RAID Structure 468 Structure 451 12.8 Stable-Storage Implementation 477 12.2 Disk Structure 454 12.9 Tertiary-Storage Structure 478 12.3 Disk Attachment 455 12.10 Summary 488 12.4 Disk Scheduling 456 Exercises 489 12.5 Disk Management 462 Bibliographical Notes 493 12.6 Swap-Space Management 466 Chapter 13 I/O Systems 13.1 Overview 495 13.6 STREAMS 520 13.2 I/O Hardware 496 13.7 Performance 522 13.3 Application I/O Interface 505 13.8 Summary 525 13.4 Kernel I/O Subsystem 511 Exercises 526 13.5 Transforming I/O Requests to Bibliographical Notes 527 Hardware Operations 518 https://hemanthrajhemu.github.io V" vCHAPTER In Chapter 8, we discussed various memory-management strategies used in computer systems.
    [Show full text]
  • Utilizing the IOMMU Scalably
    Utilizing the IOMMU Scalably Omer Peleg Technion - Computer Science Department - M.Sc. Thesis MSC-2015-18 - 2015 Technion - Computer Science Department - M.Sc. Thesis MSC-2015-18 - 2015 Utilizing the IOMMU Scalably Research Thesis Submitted in partial fulfillment of the requirements for the degree of Master of Science in Computer Science Omer Peleg Submitted to the Senate of the Technion | Israel Institute of Technology Av 5775 Haifa August 2015 Technion - Computer Science Department - M.Sc. Thesis MSC-2015-18 - 2015 Technion - Computer Science Department - M.Sc. Thesis MSC-2015-18 - 2015 This research was carried out under the supervision of Prof. Dan Tsafrir, in the Faculty of Computer Science. Some results in this thesis have been published as a paper by the author and research collaborators in a conference during the course of the author's research period: Omer Peleg, Adam Morrison, Benjamin Serebrin, and Dan Tsafrir. Utilizing the IOMMU scalably. In USENIX Annual Technical Conference (ATC), 2015. Acknowledgements I would like to thank my parents, Nitzan and Ofer, as well as my brother Amit for being there for me all along. I would like to thank the amazing people I met in the Technion, for helping out when I needed it the most and for making the time I spent in this amazing place ever more enjoyable. I also want to thank Ben Serebrin, for giving me this challenge. Last but not least, I would like to thank Adam Morrison. Without your help, I doubt any of this would have seen the light of day. The generous financial help of the Israeli Ministry of Science & Technology is gratefully acknowledged.
    [Show full text]
  • Magazines and Vmem: Extending the Slab Allocator to Many Cpus and Arbitrary Resources
    Magazines and Vmem: Extending the Slab Allocator to Many CPUs and Arbitrary Resources Jeff Bonwick, Sun Microsystems Jonathan Adams, California Institute of Technology Abstract The slab allocator [Bonwick94] provides efficient object caching but has two significant limitations: its global locking doesn’t scale to many CPUs, and the allocator can’t manage resources other than kernel memory. To provide scalability we introduce a per−processor caching scheme called the magazine layer that provides linear scaling to any number of CPUs. To support more general resource allocation we introduce a new virtual memory allocator, vmem, which acts as a universal backing store for the slab allocator. Vmem is a complete general−purpose resource allocator in its own right, providing several important new services; it also appears to be the first resource allocator that can satisfy arbitrary−size allocations in constant time. Magazines and vmem have yielded performance gains exceeding 50% on system−level benchmarks like LADDIS and SPECweb99. We ported these technologies from kernel to user context and found that the resulting libumem outperforms the current best−of−breed user−level memory allocators. libumem also provides a richer programming model and can be used to manage other user−level resources. 1. Introduction §4. Vmem: Fast, General Resource Allocation. The slab allocator caches relatively small objects and relies The slab allocator [Bonwick94] has taken on a life of on a more general−purpose backing store to provide its own since its introduction in these pages seven slabs and satisfy large allocations. We describe a new years ago. Initially deployed in Solaris 2.4, it has resource allocator, vmem, that can manage arbitrary since been adopted in whole or in part by several other sets of integers − anything from virtual memory operating systems including Linux, FreeBSD, addresses to minor device numbers to process IDs.
    [Show full text]
  • Index COPYRIGHTED MATERIAL
    Index 4-byte pages, 363, 364 mandatory, 684-685 32-byte memory, 363, 364 role-based, 683-684 50-percent rule, 359 access-control lists (ACLs), 552, 555, 826 64-bit computing, 383 accessed bits, 437 access mask, 849 A access matrix, 675-685 defined, 675 ABI (application binary interface), 78-79 implementation of, 679-682 aborting processes, 342 and mandatory access control, 684-685 absolute code, 352 and revocation of access rights, 682- 683 absolute path names, 546 and role-based access control, 683-684 abstract data type (ADT), 277-278 access rights, 534, 673, 680, 682-683 access, 539-541 accounting, 110, 659, 788 anonymous, 605 ACG (Arbitrary Code Guard), 827 controlling, 552-554 acknowledgment packet, 748 direct (relative), 539-541 ACLs, see access-control lists effective access time, 397-398 ACPI (advanced configuration and power kernel object, 884-885 interface), 516 lightweight directory-access protocol, activation record, 107 607, 884 active directory, 607, 884 memory, 15, 18, 19, 418-419, 498-500 acyclic graphs, 547 process migration for, 753 acyclic-graph directories, 547-549 and protection, 551 additional-reference-bits algorithm, random-access devices, 502 409-410 random-accessCOPYRIGHTED time, 450 MATERIALadditional sense code, 512 read, 292 additional sense-code qualifier, 512 relative, 539-540 address(es): Remote Access Tool, 625 defined, 496 remote file, 764-767 linear, 380, 382 security access tokens, 662 logical, 353, 379 sequential, 539, 541 MAC, 745 wireless access points, 736 physical, 354, 379 write, 292 trusted, 638 access control: virtual, 354 discretionary, 684 address binding, 352-353 in Linux, 816-818 address mapping, 456-457 MAC address, 745 address resolution protocol (ARP), 745 901 902 Index address space: process hierarchy, 122-123 logical vs.
    [Show full text]