DOCSLIB.ORG

Pin: Building Customized Program Analysis Tools with Dynamic Instrumentation

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Pin: Building Customized Program Analysis Tools with Dynamic Instrumentation Pin: Building Customized Program Analysis Tools with Dynamic Instrumentation Chi-Keung Luk Robert Cohn Robert Muth Harish Patil Artur Klauser Geoff Lowney Steven Wallace Vijay Janapa Reddi Kim Hazelwood Intel Corporation ¡ University of Colorado ¢¤£¦¥¨§ © £ ¦£ "! #%$&'( £)&(¦*+©-,.+/01$©-!2 ©-,2¦3 45£) 67©2, £¦!2 "0 Abstract 1. Introduction Robust and powerful software instrumentation tools are essential As software complexity increases, instrumentation—a technique for program analysis tasks such as profiling, performance evalu- for inserting extra code into an application to observe its behavior— ation, and bug detection. To meet this need, we have developed is becoming more important. Instrumentation can be performed at a new instrumentation system called Pin. Our goals are to pro- various stages: in the source code, at compile time, post link time, vide easy-to-use, portable, transparent, and efficient instrumenta- or at run time. Pin is a software system that performs run-time tion. Instrumentation tools (called Pintools) are written in C/C++ binary instrumentation of Linux applications. using Pin’s rich API. Pin follows the model of ATOM, allowing the The goal of Pin is to provide an instrumentation platform for tool writer to analyze an application at the instruction level with- building a wide variety of program analysis tools for multiple archi- out the need for detailed knowledge of the underlying instruction tectures. As a result, the design emphasizes ease-of-use, portabil- set. The API is designed to be architecture independent whenever ity, transparency, efficiency, and robustness. This paper describes possible, making Pintools source compatible across different archi- the design of Pin and shows how it provides these features. tectures. However, a Pintool can access architecture-specific details Pin’s instrumentation is easy to use. Its user model is similar when necessary. Instrumentation with Pin is mostly transparent as to the popular ATOM [30] API, which allows a tool to insert calls the application and Pintool observe the application’s original, unin- to instrumentation at arbitrary locations in the executable. Users strumented behavior. Pin uses dynamic compilation to instrument do not need to manually inline instructions or save and restore executables while they are running. For efficiency, Pin uses sev- state. Pin provides a rich API that abstracts away the underlying eral techniques, including inlining, register re-allocation, liveness instruction set idiosyncrasies, making it possible to write portable analysis, and instruction scheduling to optimize instrumentation. instrumentation tools. The Pin distribution includes many sample This fully automated approach delivers significantly better instru- architecture-independent Pintools including profilers, cache simu- mentation performance than similar tools. For example, Pin is 3.3x lators, trace analyzers, and memory bug checkers. The API also faster than Valgrind and 2x faster than DynamoRIO for basic-block allows access to architecture-specific information. counting. To illustrate Pin’s versatility, we describe two Pintools Pin provides efficient instrumentation by using a just-in-time in daily use to analyze production software. Pin is publicly avail- (JIT) compiler to insert and optimize code. In addition to some able for Linux platforms on four architectures: IA32 (32-bit x86), standard techniques for dynamic instrumentation systems includ- 8 EM64T (64-bit x86), Itanium R , and ARM. In the ten months since ing code caching and trace linking, Pin implements register re- Pin 2 was released in July 2004, there have been over 3000 down- allocation, inlining, liveness analysis, and instruction scheduling to loads from its website. optimize jitted code. This fully automated approach distinguishes Pin from most other instrumentation tools which require the user’s Categories and Subject Descriptors D.2.5 [Software Engineer- assistance to boost performance. For example, Valgrind [22] re- ing]: Testing and Debugging-code inspections and walk-throughs, lies on the tool writer to insert special operations in their in- debugging aids, tracing; D.3.4 [Programming Languages]: Processors- termediate representation in order to perform inlining; similarly compilers, incremental compilers DynamoRIO [6] requires the tool writer to manually inline and save/restore application registers. General Terms Languages, Performance, Experimentation Another feature that makes Pin efficient is process attaching Keywords Instrumentation, program analysis tools, dynamic com- and detaching. Like a debugger, Pin can attach to a process, in- pilation strument it, collect profiles, and eventually detach. The application only incurs instrumentation overhead during the period that Pin is attached. The ability to attach and detach is a necessity for the in- strumentation of large, long-running applications. Pin’s JIT-based instrumentation defers code discovery until run time, allowing Pin to be more robust than systems that use static Permission to make digital or hard copies of all or part of this work for personal or instrumentation or code patching. Pin can seamlessly handle mixed classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation code and data, variable-length instructions, statically unknown in- on the first page. To copy otherwise, to republish, to post on servers or to redistribute direct jump targets, dynamically loaded libraries, and dynamically to lists, requires prior specific permission and/or a fee. generated code. PLDI'05 June 12–15,2005,Chicago,Illinois,USA. Pin preserves the original application behavior by providing in- 9 Copyright c 2005 ACM 1-59593-080-9/05/0006 :;:;: $5.00. strumentation transparency. The application observes the same ad- dresses (both instruction and data) and same values (both register )*,+-/.102¥3 465¢7 and memory) as it would in an uninstrumented execution. Trans- 88:9 parency makes the information collected by instrumentation more 2 ;=<¥0>3@? 5,?A62BDC¥2 ;,0¥5>2¥5 4EA62F relevant and is also necessary for correctness. For example, some GH*=I>J 5 4EA62FEK 5,?L¥2 ;,0¥5MNGH*=IO.P;=QSRTGH*=I/.D3EFF2URWV*,XY¥Z[/\ ;,]¥5^1_ applications unintentionally access data beyond the top of stack, so `EQ¥2 ;=<¥0`¨Ma02¥3 465¢R=b=cEQedfL>cEQ>cF gh<bRi;=QSRj3EFF2URk\ ;,]¥5^7 Pin and the instrumentation do not modify the application stack. l 8 R Pin’s first generation, Pin 0, supports Itanium . The recently- 88Dm 1 3¥nnE5EF>` A62>5Eo¥5E2Bp;=<\h02Eq4h0 ;hAh< released second generation, Pin 2, extends the support to four GH*=Ir*=<\h02Eq4h0 ;hAh<sMt*,X¥uO;=<\¨RWGH*=Iv.6o ^w_ 88 architectures: IA32 (32-bit x86) [14], EM64T (64-bit x86) [15], ;=<\h02Eqh? 56<¥0\1C¥2 ;,0¥5 \1q\ ;=<¥xP3yQ¥2¥5EF ;6463E0¥5EFr463¥nnsR 8 8 R R 88 Itanium [13], and ARM [16]. Pin 2 for Itanium is still under ;z{5UzW0E| 5P463¥nn:| 36QQ 56<\/;,``D0E| 5P\h0 A62¥5};6\ 88 development. 3 4h0Eq 3¥nn6BP5E~¥5 4tq¥0¥5EF Pin has been gaining popularity both inside and outside of Intel, ;,`OMt*,X¥u¥*6\tK 5,?A62BEL¥2 ;,0¥5Mt;=<\ ^^ 9 m 2¥5EF ;6463E0¥5EF 3¥n¥nM with more than 3000 downloads since Pin 2 was first released *,X¥u¥*=<\65E20 9 9 H*,XY 6-E)HhJ¥-URkE)V¥X YEJsMNJ 5 4EA62FEK 5,?L¥2 ;,0¥5^R in July 2004. This paper presents an in-depth description of Pin, ;=<\¨Ri* 9 YEJSRy*,EJ¥ hK¥-EKHhJLJ*,Y- 6-UR and is organized as follows. We first give an overview of Pin’s *,EJ¥ *,X¥uEY *,EJ¥ hK¥-EKHhJLJ*,Y- Eu*tE-URD*,EJ¥ 6-XEI^7 instrumentation capability in Section 2. We follow by discussing l design and implementation issues in Section 3. We then evaluate in Section 4 the performance of Pin’s instrumentation and compare it ;=<¥0y? 3;=<sMt;=<¥0P3E2x4¨Rk4t| 3E2v.E3E2xoS ^y_ 9 against other tools. In Section 5, we discuss two sample Pintools *,X *=<;,0¨M3E2x4¨Rk3E2xo ^7 used in practice. Finally, we relate Pin to other work in Section 6 02¥3 465D:` AhQ 56<sMhb,3E02¥3 465UzAhq¥0bRDbCbE^7 and conclude in Section 7. *,X¥u¥6FF *=<\h02Eqh? 56<¥0E)q<4h0 ;hA6<sMt*,<\h02q4h0;hAh<SRy^7 9 9 88 *,X EuE0¥3E20 2 A6x2¥3,?SMt^7 X¥5Eo¥5E2>2¥5E0Eq¥2E<\ 2¥5E0Eq¥2E</¢7 2. Instrumentation with Pin l The Pin API makes it possible to observe all the architectural state of a process, such as the contents of registers, memory, and Figure 1. A Pintool for tracing memory writes. control flow. It uses a model similar to ATOM [30], where the user adds procedures (as known as analysis routines in ATOM’s notion) ¤¨§ © £ © # £ © ¦ ¡ ¡ $ $ to the application process, and writes instrumentation routines to ¦¥" ensures that is © determine where to place calls to analysis routines. The arguments invoked only if the memory instruction is predicated . to analysis routines can be architectural state or constants. Pin Note that the same source code works on all architectures. The also provides a limited ability to alter the program behavior by user does not need to know about the bundling of instructions on allowing an analysis routine to overwrite application registers and Itanium, the various addressing modes on each architecture, the application memory. different forms of predication supported by Itanium and ARM, x86 Instrumentation is performed by a just-in-time (JIT) compiler. string instructions that can write a variable-size memory area, or ¨§ The input to this compiler is not bytecode, however, but a native ex- x86 instructions like that can implicitly write memory. ecutable. Pin intercepts the execution of the first instruction of the Pin provides a comprehensive API for inspection and instru- executable and generates (“compiles”) new code for the straight- mentation. In this particular example, instrumentation is done one line code sequence starting at this instruction. It then transfers con- instruction at a time. It is also possible to inspect whole traces, trol to the generated sequence.
Load more

Recommended publications
  • Dynamic Optimization of IA-32 Applications Under Dynamorio by Timothy Garnett
    Dynamic Optimization of IA-32 Applications Under DynamoRIO by Timothy Garnett Submitted to the Department of Electrical Engineering and Computer Science in Partial Fulfillment of the Requirements for the Degree of Master of Engineering in Computer Science Abstract The ability of compilers to optimize programs statically is diminishing. The advent and increased use of shared libraries, dynamic class loading, and runtime binding means that the compiler has, even with difficult to accurately obtain profiling data, less and less knowledge of the runtime state of the program. Dynamic optimization systems attempt to fill this gap by providing the ability to optimize the application at runtime when more of the system's state is known and very accurate profiling data can be obtained. This thesis presents two uses of the DynamoRIO runtime introspection and modification system to optimize applications at runtime. The first is a series of optimizations for interpreters running under DynamoRIO's logical program counter extension. The optimizations include extensions to DynamoRIO to allow the interpreter writer add a few annotations to the source code of his interpreter that enable large amounts of optimization. For interpreters instrumented as such, improvements in performance of 20 to 60 percent were obtained. The second use is a proof of concept for accelerating the performance of IA-32 applications running on the Itanium processor by dynamically translating hot trace paths into Itanium IA-64 assembly through DynamoRIO while allowing the less frequently executed potions of the application to run in Itanium's native IA-32 hardware emulation. This transformation yields speedups of almost 50 percent on small loop intensive benchmarks.
    [Show full text]
  • Dynamic Binary Translation & Instrumentation
    Dynamic Binary Translation & Instrumentation Pin Building Customized Program Analysis Tools with Dynamic Instrumentation CK Luk, Robert Cohn, Robert Muth, Harish Patil, Artur Klauser, Geoff Lowney, Steven Wallace, Kim Hazelwood Intel Vijay Janapa Reddi University of Colorado http://rogue.colorado.edu/Pin PLDI’05 2 Instrumentation • Insert extra code into programs to collect information about execution • Program analysis: • Code coverage, call-graph generation, memory-leak detection • Architectural study: • Processor simulation, fault injection • Existing binary-level instrumentation systems: • Static: • ATOM, EEL, Etch, Morph • Dynamic: • Dyninst, Vulcan, DTrace, Valgrind, Strata, DynamoRIO C Pin is a new dynamic binary instrumentation system PLDI’05 3 A Pintool for Tracing Memory Writes #include <iostream> #include "pin.H" executed immediately before a FILE* trace; write is executed • Same source code works on the 4 architectures VOID RecordMemWrite(VOID* ip, VOID* addr, UINT32 size) { fprintf(trace,=> “%p: Pin Wtakes %p %dcare\n”, of ip, different addr, size); addressing modes } • No need to manually save/restore application state VOID Instruction(INS ins, VOID *v) { if (INS_IsMemoryWrite(ins))=> Pin does it for you automatically and efficiently INS_InsertCall(ins, IPOINT_BEFORE, AFUNPTR(RecordMemWrite), IARG_INST_PTR, IARG_MEMORYWRITE_EA, IARG_MEMORYWRITE_SIZE, IARG_END); } int main(int argc, char * argv[]) { executed when an instruction is PIN_Init(argc, argv); dynamically compiled trace = fopen(“atrace.out”, “w”); INS_AddInstrumentFunction(Instruction,
    [Show full text]
  • An Infrastructure for Adaptive Dynamic Optimization
    An Infrastructure for Adaptive Dynamic Optimization Derek Bruening, Timothy Garnett, and Saman Amarasinghe Laboratory for Computer Science Massachusetts Institute of Technology Cambridge, MA 02139 fiye,timothyg,[email protected] Abstract ing profile information improves the predictions but still falls short for programs whose behavior changes dynami- Dynamic optimization is emerging as a promising ap- cally. Additionally, many software vendors are hesitant to proach to overcome many of the obstacles of traditional ship binaries that are compiled with high levels of static op- static compilation. But while there are a number of com- timization because they are hard to debug. piler infrastructures for developing static optimizations, Shifting optimizations to runtime solves these problems. there are very few for developing dynamic optimizations. Dynamic optimization allows the user to improve the per- We present a framework for implementing dynamic analy- formance of binaries without relying on how they were ses and optimizations. We provide an interface for build- compiled. Furthermore, several types of optimizations are ing external modules, or clients, for the DynamoRIO dy- best suited to a dynamic optimization framework. These in- namic code modification system. This interface abstracts clude adaptive, architecture-specific, and inter-module opti- away many low-level details of the DynamoRIO runtime mizations. system while exposing a simple and powerful, yet efficient Adaptive optimizations require instant responses to and lightweight, API. This is achieved by restricting opti- changes in program behavior. When performed statically, a mization units to linear streams of code and using adaptive single profiling run is taken to be representative of the pro- levels of detail for representing instructions.
    [Show full text]
  • Using Dynamic Binary Instrumentation for Security(And How You May Get
    King’s Research Portal Document Version Peer reviewed version Link to publication record in King's Research Portal Citation for published version (APA): Cono D'Elia, D., Coppa, E., Palmaro, F., & Cavallaro, L. (Accepted/In press). SoK: Using Dynamic Binary Instrumentation for Security (And How You May Get Caught Red Handed). In ACM Asia Conference on Information, Computer and Communications Security (ASIACCS 2019) Citing this paper Please note that where the full-text provided on King's Research Portal is the Author Accepted Manuscript or Post-Print version this may differ from the final Published version. If citing, it is advised that you check and use the publisher's definitive version for pagination, volume/issue, and date of publication details. And where the final published version is provided on the Research Portal, if citing you are again advised to check the publisher's website for any subsequent corrections. General rights Copyright and moral rights for the publications made accessible in the Research Portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognize and abide by the legal requirements associated with these rights. •Users may download and print one copy of any publication from the Research Portal for the purpose of private study or research. •You may not further distribute the material or use it for any profit-making activity or commercial gain •You may freely distribute the URL identifying the publication in the Research Portal Take down policy If you believe that this document breaches copyright please contact [email protected] providing details, and we will remove access to the work immediately and investigate your claim.
    [Show full text]
  • Coverage-Guided Fuzzing of Grpc Interface
    Niko Lappalainen COVERAGE-GUIDED FUZZING OF GRPC INTERFACE Master of Science Thesis Faculty of Information Technology and Communication Sciences Examiners: Marko Helenius Billy Brumley January 2021 i ABSTRACT Niko Lappalainen: Coverage-guided fuzzing of gRPC interface Master of Science Thesis Tampere University Master’s Degree Programme in Information Technology January 2021 Fuzz testing has emerged as a cost-effective method of finding security issues in many real- world targets. The software company M-Files Inc. wanted to incorporate fuzz testing to harden the security of their product M-Files Server. The newly implemented gRPC API was set as the target interface to be fuzzed. This thesis was requested to find a suitable fuzzing tool, and to verify that the tool could find and report issues. Another objective of this thesis was to determine a criterion for stopping fuzzing when adequate testing coverage has been achieved without having to run the fuzzer perpetually. To select a suitable fuzzing tool, some requirements had to be defined. Requirements and selection criteria were set based on the properties of the M-Files system as well as the target interface. Next, various fuzzing tool options were gathered from different sources. These options were validated based on the set requirements to select a short list of tools that could be analysed more closely. The suitable tool was selected from these based on their ease of integration and suspected performance. The coverage-guided WinAFL was evaluated as the most suitable from the considered options. The selected fuzzing tool was used to test M-Files Server in order to record its results.
    [Show full text]
  • Valgrind a Framework for Heavyweight Dynamic Binary
    VValgrindalgrind AA FramFrameweworkork forfor HHeavyweavyweighteight DDynamynamicic BBinaryinary InstrumInstrumentationentation Nicholas Nethercote — National ICT Australia Julian Seward — OpenWorks LLP 1 FAFAQQ #1#1 • How do you pronounce “Valgrind”? • “Val-grinned”, not “Val-grined” • Don’t feel bad: almost everyone gets it wrong at first 2 DDBBAA toolstools • Program analysis tools are useful – Bug detectors – Profilers – Visualizers • Dynamic binary analysis (DBA) tools – Analyse a program’s machine code at run-time – Augment original code with analysis code 3 BBuildinguilding DDBBAA toolstools • Dynamic binary instrumentation (DBI) – Add analysis code to the original machine code at run-time – No preparation, 100% coverage • DBI frameworks – Pin, DynamoRIO, Valgrind, etc. Tool Framework + = Tool plug-in 4 PriorPrior wworkork Well-studied Not well-studied Framework performance Instrumentation capabilities Simple tools Complex tools • Potential of DBI has not been fully exploited – Tools get less attention than frameworks – Complex tools are more interesting than simple tools 5 ShadowShadow valuevalue toolstools 6 ShadowShadow valuevalue toolstools (I)(I) • Shadow every value with another value that describes it – Tool stores and propagates shadow values in parallel Tool(s) Shadow values help find... Memcheck Uses of undefined values bugs Annelid Array bounds violations Hobbes Run-time type errors TaintCheck, LIFT, TaintTrace Uses of untrusted values security “Secret tracker” Leaked secrets DynCompB Invariants properties Redux Dynamic
    [Show full text]
  • Using Dynamic Binary Instrumentation for Security (And How You May Get Caught Red Handed)
    SoK: Using Dynamic Binary Instrumentation for Security (And How You May Get Caught Red Handed) Daniele Cono D’Elia Emilio Coppa Simone Nicchi Sapienza University of Rome Sapienza University of Rome Sapienza University of Rome [email protected] [email protected] [email protected] Federico Palmaro Lorenzo Cavallaro Prisma King’s College London [email protected] [email protected] ABSTRACT 1 INTRODUCTION Dynamic binary instrumentation (DBI) techniques allow for moni- Even before the size and complexity of computer software reached toring and possibly altering the execution of a running program up the levels that recent years have witnessed, developing reliable and to the instruction level granularity. The ease of use and flexibility of efficient ways to monitor the behavior of code under execution DBI primitives has made them popular in a large body of research in has been a major concern for the scientific community. Execution different domains, including software security. Lately, the suitabil- monitoring can serve a great deal of purposes: to name but a few, ity of DBI for security has been questioned in light of transparency consider performance analysis and optimization, vulnerability iden- concerns from artifacts that popular frameworks introduce in the tification, as well as the detection of suspicious actions, execution execution: while they do not perturb benign programs, a dedicated patterns, or data flows in a program. adversary may detect their presence and defeat the analysis. To accomplish this task users can typically resort to instrumen- The contributions we provide are two-fold. We first present the tation techniques, which in their simplest form consist in adding abstraction and inner workings of DBI frameworks, how DBI as- instructions to the code sections of the program under observation.
    [Show full text]
  • Dynamic Data Flow Analysis Via Virtual Code Integration (Aka the Spiderpig Case)
    Dynamic Data Flow Analysis via Virtual Code Integration (aka The SpiderPig case) Piotr Bania [email protected] November 2008 "I'm all alone I smoke my friends down to the lter But I feel much cleaner After it rains" - Tom Waits, Little Drop Of Poison Abstract This paper addresses the process of dynamic data ow analysis using vir- tual code integration (VCI), often refered to as dynamic binary rewriting. This article will try to demonstrate all of the techniques that were applied in the SpiderPig project [15]. It will also discuss the main dierences between the methods that were employed and those used in other available software, arXiv:0906.0724v1 [cs.CR] 3 Jun 2009 as well as introducing other related work. SpiderPig's approach was found to be very fast and was transparent enough for reliable and usable data ow analysis. It was created with the purpose of providing a tool which would aid vulnerability and security researchers with tracing and analyzing any necessary data and its further propagation through a program. At the time of writing this article, it is the authors opinion that SpiderPig oers one of the most advanced solutions for data 1 ow monitoring. At the current state it works on IA-32 platforms with Mi- crosoft Windows systems and it supports FPU, SSE1, MMX and all of the IA-32 general instructions. Furthermore it can be extended to cover other operating systems and architectures as well. SpiderPig also demonstrates the usage of a virtual code integration (VCI) framework which allows for modify- ing the target application code at the instruction level.
    [Show full text]
  • Introspective Intrusion Detection
    UNIVERSITY OF CALIFORNIA, IRVINE Introspective Intrusion Detection DISSERTATION submitted in partial satisfaction of the requirements for the degree of DOCTOR OF PHILOSOPHY in Computer Engineering by Byron Hawkins Dissertation Committee: Associate Professor Brian Demsky, Chair Professor Michael Franz Associate Professor Athina Markopoulou 2017 Portions of Chapters 1, 2, 5 c 2017 IEEE Portions of Chapters 1, 2, 3 c 2016 ACM Portions of Chapters 1, 4 c 2015 IEEE All other materials c 2017 Byron Hawkins DEDICATION To the International Justice Mission for their enduring effort to protect powerless individuals from the malicious intrusions of the real world. ii TABLE OF CONTENTS Page LIST OF FIGURES vii LIST OF TABLES ix LIST OF ALGORITHMS x ACKNOWLEDGMENTS xi CURRICULUM VITAE xii ABSTRACT OF THE DISSERTATION xiv 1 Introduction 1 1.1 Timeline of Important RCE Defenses . 8 1.1.1 Bug Fixing . 9 1.1.2 Traditional Intrusion Detection . 10 1.1.3 Control Flow Integrity . 12 1.1.4 Diversification . 14 1.2 Theoretical Advantages and Challenges of IID . 16 1.3 Goals of Introspective Intrusion Detection . 24 1.4 Usage Model . 29 1.4.1 Forensics . 30 1.4.2 Advanced Persistent Threats . 32 1.4.3 Field Debugging . 35 1.4.4 Profiling . 37 1.5 Prototype IID Implementations . 38 1.5.1 BlackBox for x86 COTS Binaries . 40 1.5.2 ZenIDS for PHP Applications . 42 1.6 Contributions . 44 1.7 Organization . 45 2 Paradise: a Hypothetically Pure IID 46 2.1 Platform Snares . 47 2.2 Generic Threat Model . 51 2.3 Deployment . 52 2.3.1 Generating the Trusted Profile .
    [Show full text]
  • A Platform for Secure Static Binary Instrumentation ∗
    A Platform for Secure Static Binary Instrumentation ∗ Mingwei Zhang Rui Qiao Niranjan Hasabnis R. Sekar Stony Brook University Abstract instrumentations can be more easily and extensively opti- Program instrumentation techniques form the basis of many mized by exploiting higher level information such as types. recent software security defenses, including defenses against However, binary instrumentations are more widely applica- common exploits and security policy enforcement. As com- ble since users have ready access to binaries. Moreover, se- pared to source-code instrumentation, binary instrumenta- curity instrumentations should be applied to all code, includ- tion is easier to use and more broadly applicable due to the ing all libraries, inline assembly code, and any code inserted ready availability of binary code. Two key features needed by the compiler/linker. Here again, binary based techniques for security instrumentations are (a) it should be applied are advantageous. to all application code, including code contained in various Binary instrumentation can either be static or dynamic. system and application libraries, and (b) it should be non- Static binary instrumentation (SBI) is performed offline on bypassable. So far, dynamic binary instrumentation (DBI) binary files, whereas dynamic binary instrumentation (DBI) techniques have provided these features, whereas static bi- operates on code already loaded into main memory. DBI nary instrumentation (SBI) techniques have lacked them. techniques disassemble and instrument each basic block just These features, combined with ease of use, have made DBI before its first execution. DBI has been the technique of the de facto choice for security instrumentations. However, choice for security instrumentation of COTS binaries. Pre- DBI techniques can incur high overheads in several common vious works have used DBI for sandboxing [15, 17], taint- usage scenarios, such as application startups, system-calls, tracking [23, 28], defense from return-oriented program- and many real-world applications.
    [Show full text]
  • Transparent Dynamic Instrumentation
    Transparent Dynamic Instrumentation Derek Bruening Qin Zhao Saman Amarasinghe Google, Inc. Google, Inc Massachusetts Institute of Technology [email protected] [email protected] [email protected] Abstract can be executed, monitored, and controlled. A software code cache Process virtualization provides a virtual execution environment is used to implement the virtual environment. The provided layer within which an unmodified application can be monitored and con- of control can be used for various purposes including security en- trolled while it executes. The provided layer of control can be used forcement [14, 22], software debugging [8, 43], dynamic analy- for purposes ranging from sandboxing to compatibility to profil- sis [42, 45], and many others [40, 41, 44]. The additional operations ing. The additional operations required for this layer are performed are performed clandestinely alongside regular program execution. clandestinely alongside regular program execution. Software dy- First presented in 2001 [9], DynamoRIO evolved from a re- namic instrumentation is one method for implementing process search project [6, 10] for dynamic optimization to the flagship virtualization which dynamically instruments an application such product of a security company [22] and finally an open source that the application’s code and the inserted code are interleaved to- project [1]. Presently it is being used to build tools like Dr. Mem- gether. ory [8] that run large applications including proprietary software on DynamoRIO is a process virtualization system implemented us- both Linux and Windows. There are many challenges to building ing software code cache techniques that allows users to build cus- such a system that supports executing arbitrary unmodified appli- tomized dynamic instrumentation tools.
    [Show full text]
  • Efficient Cross-Architecture Hardware Virtualisation
    This thesis has been submitted in fulfilment of the requirements for a postgraduate degree (e.g. PhD, MPhil, DClinPsychol) at the University of Edinburgh. Please note the following terms and conditions of use: This work is protected by copyright and other intellectual property rights, which are retained by the thesis author, unless otherwise stated. A copy can be downloaded for personal non-commercial research or study, without prior permission or charge. This thesis cannot be reproduced or quoted extensively from without first obtaining permission in writing from the author. The content must not be changed in any way or sold commercially in any format or medium without the formal permission of the author. When referring to this work, full bibliographic details including the author, title, awarding institution and date of the thesis must be given. Efficient Cross-architecture Hardware Virtualisation Tom Spink I V N E R U S E I T H Y T O H F G E R D I N B U Doctor of Philosophy Institute for Computing Systems Architecture School of Informatics University of Edinburgh 2016 Abstract Hardware virtualisation is the provision of an isolated virtual environment that represents real physical hardware. It enables operating systems, or other system- level software (the guest), to run unmodified in a “container” (the virtual ma- chine) that is isolated from the real machine (the host). There are many use-cases for hardware virtualisation that span a wide-range of end-users. For example, home-users wanting to run multiple operating sys- tems side-by-side (such as running a Windows® operating system inside an OS X environment) will use virtualisation to accomplish this.
    [Show full text]