VMM Emulation of Intel Hardware Transactional Memory

Total Page:16

File Type:pdf, Size:1020Kb

VMM Emulation of Intel Hardware Transactional Memory VMM Emulation of Intel Hardware Transactional Memory Maciej Swiech Kyle C. Hale Peter Dinda Department of Electrical Engineering and Computer Science Northwestern University {m-swiech,k-hale,pdinda}@northwestern.edu ABSTRACT HTM promises better correctness in concurrent code by We describe the design, implementation, and evaluation of replacing locking with transactions over instructions. Unlike emulated hardware transactional memory, specifically the locks, such transactions are composable, meaning that it is Intel Haswell Restricted Transactional Memory (RTM) ar- less likely to introduce deadlock and livelock bugs as a code- chitectural extensions for x86/64, within a virtual machine base expands. Furthermore, transactions have the potential monitor (VMM). Our system allows users to investigate RTM for running faster than locks because the hardware is able on hardware that does not provide it, debug their RTM- to detect violations of transaction independence alongside of based transactional software, and stress test it on diverse maintaining coherence. emulated hardware configurations, including potential fu- Intel has made HTM a component of its Haswell plat- ture configurations that might support arbitrary length trans- form, and chips with the first implementation of this feature actions. Initial performance results suggest that we are able are now widely available. This paper focuses on the re- to accomplish this approximately 60 times faster than under stricted transactional memory (RTM) component of Intel's a full emulator. A noteworthy aspect of our system is a novel specification. RTM is a bit of a misnomer|it might bet- page-flipping technique that allows us to completely avoid ter be called explicit transactional memory. With RTM, the instruction emulation, and to limit instruction decoding to programmer starts, aborts, and completes transactions us- only that necessary to determine instruction length. This ing new instructions added to the ISA. Our work does not makes it possible to implement RTM emulation, and poten- address the other component of Intel's specification, hard- tially other techniques, far more compactly than would oth- ware lock elision (HLE), which is a mechanism for promot- erwise be possible. We have implemented our system in the ing some forms of existing lock-based code to transactions context of the Palacios VMM.Our techniques are not specific automatically|i.e., it is implicit transactional memory. to Palacios, and could be implemented in other VMMs. Our paper focuses on how to extend a virtual machine monitor (VMM) so that it can provide the guest with Intel Haswell RTM capability even if the underlying hardware 1. INTRODUCTION does not support it. Furthermore, the limitations of this Hardware transactional memory (HTM) [4] is an endur- emulated capability can differ from that of the underlying ing concept that holds considerable promise for improving hardware. the correctness and performance of concurrent programs on There are three primary use cases. The first is in testing hardware multiprocessors. Today's typical server platforms RTM code against different hardware models, to attempt are already small scale NUMA machines. A mid-range server to make the code resilient to different and changing hard- may have as many as 64 hardware threads spread over 4 ware. As we describe in more detail in Section 2, transaction sockets. Further, it is widely accepted that the growth of aborts are caused not only by the detection of failures of single node performance depends on increased concurrency transaction independence, but also by other events that are within the node. For example, the U.S. national exascale strongly dependent on specific hardware configurations and efforts are crystallizing around a model of billion-way par- implementations. Hence, a transaction that may succeed on allelism [1], of which a factor of 1000 or more is anticipated one processor model might abort on another model. to be within a single node [12]. Given these trends, correct The second use case is to consider potential future RTM and efficient concurrency within a single node or server is of implementations, including those that might allow arbitrary overarching importance, not just to systems software, but length transactions. Current RTM hardware implementa- also to libraries and applications. tions limit transaction length due to cache size and write buffer size limitations. Our system is free of such limita- tions unless they are explicitly configured. Conceivably, this Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed functionality could also be used to bridge RTM and software for profit or commercial advantage and that copies bear this notice and the full cita- transactional memory. tion on the first page. Copyrights for components of this work owned by others than The third use case is in debugging RTM code via a con- ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or re- trolled environment. Through emulation, it is possible to publish, to post on servers or to redistribute to lists, requires prior specific permission introduce abort-generating events at specific points and ob- and/or a fee. Request permissions from [email protected]. serve the effects. It is also possible to collect detailed trace ROSS ’14, June 10, 2014, Munich, Germany Copyright 2014 ACM 978-1-4503-2950-7/14/06 ...$15.00. data from running code. http://dx.doi.org/10.1145/2612262.2612265 We have designed, implemented, and evaluated a system has the goals of providing support for new code that ex- for Intel RTM emulation within the Palacios VMM. Our plicitly uses transactions, backward compatibility of some techniques are not specific to Palacios, and could be imple- such new code to older processors, and allowing for hardware mented in other VMMs as well. Our implementation will be differences and innovation under the ISA-visible model [5]. available as part of the open-source Palacios codebase when There are two models supported by TSX, hardware lock this paper is published. Our contributions are as follows: elision (HLE) and restricted transactional memory (RTM). • We have designed a page-flipping technique that allows Our focus in this paper is on RTM. In the RTM model, four additional instructions have been instruction execution while capturing instruction added to the ISA: XBEGIN, XEND, XABORT, and XTEST. fetches, and data reads and writes. This technique If they are executed on hardware which does not support avoids the need for any instruction emulation or them, a #UD (undefined opcode) exception is generated. complex instruction decoding other than determining Code can use the XTEST instruction to determine if it is instruction length. This greatly simplifies RTM executing within a transaction. An RTM transaction is typ- emulation and could be applied to other services. ically written in a form like this: • We have designed an emulation technique for RTM start_label: based around the page-flipping technique, XBEGIN abort_label redo-logging, undefined opcode exceptions, and <body of transaction, may use XABORT> hypercalls. The technique is extensible, allowing for XEND the inclusion of different hardware models, for success_label: example different cache sizes and structures. <handle transaction commited> abort_label: • We have implemented the RTM emulation technique in <handle transaction aborted> Palacios. The entire technique comprises about 1300 lines of C code. The XBEGIN instruction signifies the start of a transaction, • We have evaluated our VMM-based RTM emulation and provides the hardware with the address to jump to if technique and compared it with Intel's the transaction is aborted. The body of the transaction emulator-based implementation of Haswell RTM in then executes. If no abort conditions arise, the transaction the Software Development Emulator [6]. Our is committed by the XEND. implementation is approximately 60 times faster Conceptually, the core on which the body of the trans- when a transaction is executing, and has full action, from XBEGIN to XEND, executes does reads and performance when none are. writes that are independent of those from other cores, and Related work: Herlihy and Moss introduced HTM [4]. Re- its own writes are not seen by other cores until after the cent work by Rajwar, Herlihy, and Lai showed how HTM XEND completes successfully. If another core executes a could be extended such that hardware resource limitations conflicting write or read, breaking the promise of indepen- would not be programmer visible [11]. Unbounded transac- dence, the hardware will abort the transaction, discard all tional memory [2] shows that hardware designs that allow of the completed writes, and jump to the abort label. The arbitrarily long transactions are feasible, and this work also code in the body of the transaction may also explicitly abort demonstrated that using such transactions would allow for the transaction using the XABORT instruction. The spe- significant speedups in Java and Linux kernel code. Ham- cific reason is written into RAX so the abort handling code mond et al. [3] have argued for using such powerful trans- can decide what to do. actions as the basic unit of parallelism, coherence, and con- Beyond conflicting memory reads and writes on other cores, sistency. In contrast to such work, our goal is simply to and the execution of the XABORT instruction, there are nu- efficiently emulate a specific commercially available HTM merous reasons why a transaction may abort. These form system that will have model-specific hardware resource lim- three categories: instructions, exceptions, and resource lim- itations. By using our system, programmers will be able its. Within each category, there are both implementation- to test how different hardware limits might affect their pro- independent and implementation-dependent items. One of grams. However, because the conditions under which our the benefits of our emulated RTM system is to allow the system aborts a transaction are software defined, and the testing of RTM code under different implementations.
Recommended publications
  • The Case for Hardware Transactional Memory
    Lecture 20: Transactional Memory CMU 15-418: Parallel Computer Architecture and Programming (Spring 2012) Giving credit ▪ Many of the slides in today’s talk are the work of Professor Christos Kozyrakis (Stanford University) (CMU 15-418, Spring 2012) Raising level of abstraction for synchronization ▪ Machine-level synchronization prims: - fetch-and-op, test-and-set, compare-and-swap ▪ We used these primitives to construct higher level, but still quite basic, synchronization prims: - lock, unlock, barrier ▪ Today: - transactional memory: higher level synchronization (CMU 15-418, Spring 2012) What you should know ▪ What a transaction is ▪ The difference between the atomic construct and locks ▪ Design space of transactional memory implementations - data versioning policy - con"ict detection policy - granularity of detection ▪ Understand HW implementation of transaction memory (consider how it relates to coherence protocol implementations we’ve discussed in the past) (CMU 15-418, Spring 2012) Example void deposit(account, amount) { lock(account); int t = bank.get(account); t = t + amount; bank.put(account, t); unlock(account); } ▪ Deposit is a read-modify-write operation: want “deposit” to be atomic with respect to other bank operations on this account. ▪ Lock/unlock pair is one mechanism to ensure atomicity (ensures mutual exclusion on the account) (CMU 15-418, Spring 2012) Programming with transactional memory void deposit(account, amount){ void deposit(account, amount){ lock(account); atomic { int t = bank.get(account); int t = bank.get(account); t = t + amount; t = t + amount; bank.put(account, t); bank.put(account, t); unlock(account); } } } nDeclarative synchronization nProgrammers says what but not how nNo explicit declaration or management of locks nSystem implements synchronization nTypically with optimistic concurrency nSlow down only on true con"icts (R-W or W-W) (CMU 15-418, Spring 2012) Declarative vs.
    [Show full text]
  • Robust Architectural Support for Transactional Memory in the Power Architecture
    Robust Architectural Support for Transactional Memory in the Power Architecture Harold W. Cain∗ Brad Frey Derek Williams IBM Research IBM STG IBM STG Yorktown Heights, NY, USA Austin, TX, USA Austin, TX, USA [email protected] [email protected] [email protected] Maged M. Michael Cathy May Hung Le IBM Research IBM Research (retired) IBM STG Yorktown Heights, NY, USA Yorktown Heights, NY, USA Austin, TX, USA [email protected] [email protected] [email protected] ABSTRACT in current p795 systems, with 8 TB of DRAM), as well as On the twentieth anniversary of the original publication [10], strengths in RAS that differentiate it in the market, adding following ten years of intense activity in the research lit- TM must not compromise any of these virtues. A robust erature, hardware support for transactional memory (TM) system is one that is sturdy in construction, a trait that has finally become a commercial reality, with HTM-enabled does not usually come to mind in respect to HTM systems. chips currently or soon-to-be available from many hardware We structured TM to work in harmony with features that vendors. In this paper we describe architectural support for support the architecture's scalability. Our goal has been to TM provide a comprehensive programming environment includ- TM added to a future version of the Power ISA . Two im- ing support for simple system calls and debug aids, while peratives drove the development: the desire to complement providing a robust (in the sense of "no surprises") execu- our weakly-consistent memory model with a more friendly tion environment with reasonably consistent performance interface to simplify the development and porting of multi- and without unexpected transaction failures.2 TM must be threaded applications, and the need for robustness beyond usable throughout the system stack: in hypervisors, oper- that of some early implementations.
    [Show full text]
  • Leveraging Modern Multi-Core Processor Features to Efficiently
    LEVERAGING MODERN MULTI-CORE PROCESSORS FEATURES TO EFFICIENTLY DEAL WITH SILENT ERRORS, AUGUST 2017 1 Leveraging Modern Multi-core Processor Features to Efficiently Deal with Silent Errors Diego Perez´ ∗, Thomas Roparsz, Esteban Meneses∗y ∗School of Computing, Costa Rica Institute of Technology yAdvanced Computing Laboratory, Costa Rica National High Technology Center zUniv. Grenoble Alpes, CNRS, Grenoble INP ' , LIG, F-38000 Grenoble France Abstract—Since current multi-core processors are more com- about 200% of resource overhead [3]. Recent contributions [1] plex systems on a chip than previous generations, some transient [4] tend to show that checkpointing techniques provide the errors may happen, go undetected by the hardware and can best compromise between transparency for the developer and potentially corrupt the result of an expensive calculation. Because of that, techniques such as Instruction Level Redundancy or efficient resource usage. In theses cases only one extra copy checkpointing are utilized to detect and correct these soft errors; is executed, which is enough to detect the error. But, still the however these mechanisms are highly expensive, adding a lot technique remains expensive with about 100% of overhead. of resource overhead. Hardware Transactional Memory (HTM) To reduce this overhead, some features provided by recent exposes a very convenient and efficient way to revert the state of processors, such as hardware-managed transactions, Hyper- a core’s cache, which can be utilized as a recovery technique. An experimental prototype has been created that uses such feature Threading and memory protection extensions, could be great to recover the previous state of the calculation when a soft error opportunities to implement efficient error detection and recov- has been found.
    [Show full text]
  • Lecture 21: Transactional Memory
    Lecture 21: Transactional Memory • Topics: Hardware TM basics, different implementations 1 Transactions • New paradigm to simplify programming . instead of lock-unlock, use transaction begin-end . locks are blocking, transactions execute speculatively in the hope that there will be no conflicts • Can yield better performance; Eliminates deadlocks • Programmer can freely encapsulate code sections within transactions and not worry about the impact on performance and correctness (for the most part) • Programmer specifies the code sections they’d like to see execute atomically – the hardware takes care of the rest (provides illusion of atomicity) 2 Transactions • Transactional semantics: . when a transaction executes, it is as if the rest of the system is suspended and the transaction is in isolation . the reads and writes of a transaction happen as if they are all a single atomic operation . if the above conditions are not met, the transaction fails to commit (abort) and tries again transaction begin read shared variables arithmetic write shared variables transaction end 3 Example Producer-consumer relationships – producers place tasks at the tail of a work-queue and consumers pull tasks out of the head Enqueue Dequeue transaction begin transaction begin if (tail == NULL) if (head->next == NULL) update head and tail update head and tail else else update tail update head transaction end transaction end With locks, neither thread can proceed in parallel since head/tail may be updated – with transactions, enqueue and dequeue can proceed in parallel
    [Show full text]
  • Practical Enclave Malware with Intel SGX
    Practical Enclave Malware with Intel SGX Michael Schwarz, Samuel Weiser, Daniel Gruss Graz University of Technology Abstract. Modern CPU architectures offer strong isolation guarantees towards user applications in the form of enclaves. However, Intel's threat model for SGX assumes fully trusted enclaves and there doubt about how realistic this is. In particular, it is unclear to what extent enclave malware could harm a system. In this work, we practically demonstrate the first enclave malware which fully and stealthily impersonates its host application. Together with poorly-deployed application isolation on per- sonal computers, such malware can not only steal or encrypt documents for extortion but also act on the user's behalf, e.g., send phishing emails or mount denial-of-service attacks. Our SGX-ROP attack uses new TSX- based memory-disclosure primitive and a write-anything-anywhere prim- itive to construct a code-reuse attack from within an enclave which is then inadvertently executed by the host application. With SGX-ROP, we bypass ASLR, stack canaries, and address sanitizer. We demonstrate that instead of protecting users from harm, SGX currently poses a se- curity threat, facilitating so-called super-malware with ready-to-hit ex- ploits. With our results, we demystify the enclave malware threat and lay ground for future research on defenses against enclave malware. Keywords: Intel SGX, Trusted Execution Environments, Malware 1 Introduction Software isolation is a long-standing challenge in system security, especially if parts of the system are considered vulnerable, compromised, or malicious [24]. Recent isolated-execution technology such as Intel SGX [23] can shield software modules via hardware protected enclaves even from privileged kernel malware.
    [Show full text]
  • Taming Transactions: Towards Hardware-Assisted Control Flow Integrity Using Transactional Memory
    Taming Transactions: Towards Hardware-Assisted Control Flow Integrity Using Transactional Memory B Marius Muench1( ), Fabio Pagani1, Yan Shoshitaishvili2, Christopher Kruegel2, Giovanni Vigna2, and Davide Balzarotti1 1 Eurecom, Sophia Antipolis, France {marius.muench,fabio.pagani,davide.balzarotti}@eurecom.fr 2 University of California, Santa Barbara, USA {yans,chris,vigna}@cs.ucsb.edu Abstract. Control Flow Integrity (CFI) is a promising defense tech- nique against code-reuse attacks. While proposals to use hardware fea- tures to support CFI already exist, there is still a growing demand for an architectural CFI support on commodity hardware. To tackle this problem, in this paper we demonstrate that the Transactional Synchro- nization Extensions (TSX) recently introduced by Intel in the x86-64 instruction set can be used to support CFI. The main idea of our approach is to map control flow transitions into transactions. This way, violations of the intended control flow graphs would then trigger transactional aborts, which constitutes the core of our TSX-based CFI solution. To prove the feasibility of our technique, we designed and implemented two coarse-grained CFI proof-of-concept implementations using the new TSX features. In particular, we show how hardware-supported transactions can be used to enforce both loose CFI (which does not need to extract the control flow graph in advance) and strict CFI (which requires pre-computed labels to achieve a better pre- cision). All solutions are based on a compile-time instrumentation. We evaluate the effectiveness and overhead of our implementations to demonstrate that a TSX-based implementation contains useful concepts for architectural control flow integrity support.
    [Show full text]
  • A Survey of Published Attacks on Intel
    1 A Survey of Published Attacks on Intel SGX Alexander Nilsson∗y, Pegah Nikbakht Bideh∗, Joakim Brorsson∗zx falexander.nilsson,pegah.nikbakht_bideh,[email protected] ∗Lund University, Department of Electrical and Information Technology, Sweden yAdvenica AB, Sweden zCombitech AB, Sweden xHyker Security AB, Sweden Abstract—Intel Software Guard Extensions (SGX) provides a Unfortunately, a relatively large number of flaws and attacks trusted execution environment (TEE) to run code and operate against SGX have been published by researchers over the last sensitive data. SGX provides runtime hardware protection where few years. both code and data are protected even if other code components are malicious. However, recently many attacks targeting SGX have been identified and introduced that can thwart the hardware A. Contribution defence provided by SGX. In this paper we present a survey of all attacks specifically targeting Intel SGX that are known In this paper, we present the first comprehensive review to the authors, to date. We categorized the attacks based on that includes all known attacks specific to SGX, including their implementation details into 7 different categories. We also controlled channel attacks, cache-attacks, speculative execu- look into the available defence mechanisms against identified tion attacks, branch prediction attacks, rogue data cache loads, attacks and categorize the available types of mitigations for each presented attack. microarchitectural data sampling and software-based fault in- jection attacks. For most of the presented attacks, there are countermeasures and mitigations that have been deployed as microcode patches by Intel or that can be employed by the I. INTRODUCTION application developer herself to make the attack more difficult (or impossible) to exploit.
    [Show full text]
  • Experiments Using IBM's STM Compiler
    Barna L. Bihari1, James Cownie2, Hansang Bae2, Ulrike M. Yang1 and Bronis R. de Supinski1 1Lawrence Livermore National Laboratory, Livermore, California 2Intel Corporation, Santa Clara, California OpenMPCon Developers Conference Nara, Japan, October 3-4, 2016 Technical: Trent D’Hooge (LLNL) Tzanio Kolev (LLNL) Supervisory: Lori Diachin (LLNL) Borrowed example and mesh figures: A.H. Baker, R.D. Falgout, Tz.V. Kolev, and U.M. Yang, Multigrid Smoothers for Ultraparallel Computing, SIAM J. Sci. Comput., 33 (2011), pp. 2864-2887. LLNL-JRNL-473191. Financial support: Dept. of Energy (DOE), Office of Science, ASCR DOE, under contract DE-AC52-07NA27344 INFORMATION IN THIS DOCUMENT IS PROVIDED “AS IS”. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO THIS INFORMATION INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. Intel, Xeon, and the Intel logo are trademarks of Intel Corporation in the U.S. and other countries. Optimization Notice Intel’s compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors.
    [Show full text]
  • Anatomy of Cross-Compilation Toolchains
    Embedded Linux Conference Europe 2016 Anatomy of cross-compilation toolchains Thomas Petazzoni free electrons [email protected] Artwork and Photography by Jason Freeny free electrons - Embedded Linux, kernel, drivers - Development, consulting, training and support. http://free-electrons.com 1/1 Thomas Petazzoni I CTO and Embedded Linux engineer at Free Electrons I Embedded Linux specialists. I Development, consulting and training. I http://free-electrons.com I Contributions I Kernel support for the Marvell Armada ARM SoCs from Marvell I Major contributor to Buildroot, an open-source, simple and fast embedded Linux build system I Living in Toulouse, south west of France Drawing from Frank Tizzoni, at Kernel Recipes 2016 free electrons - Embedded Linux, kernel, drivers - Development, consulting, training and support. http://free-electrons.com 2/1 Disclaimer I I am not a toolchain developer. Not pretending to know everything about toolchains. I Experience gained from building simple toolchains in the context of Buildroot I Purpose of the talk is to give an introduction, not in-depth information. I Focused on simple gcc-based toolchains, and for a number of examples, on ARM specific details. I Will not cover advanced use cases, such as LTO, GRAPHITE optimizations, etc. I Will not cover LLVM free electrons - Embedded Linux, kernel, drivers - Development, consulting, training and support. http://free-electrons.com 3/1 What is a cross-compiling toolchain? I A set of tools that allows to build source code into binary code for
    [Show full text]
  • Logtm: Log-Based Transactional Memory
    Appears in the proceedings of the 12th Annual International Symposium on High Performance Computer Architecture (HPCA-12) Austin, TX February 11-15, 2006 LogTM: Log-based Transactional Memory Kevin E. Moore, Jayaram Bobba, Michelle J. Moravan, Mark D. Hill & David A. Wood Department of Computer Sciences, University of Wisconsin–Madison {kmoore, bobba, moravan, markhill, david}@cs.wisc.edu http://www.cs.wisc.edu/multifacet Abstract (e.g., in speculative hardware). On a store, a TM system can use eager version management and put the new value in Transactional memory (TM) simplifies parallel program- place, or use lazy version management to (temporarily) ming by guaranteeing that transactions appear to execute leave the old value in place. atomically and in isolation. Implementing these properties Conflict detection signals an overlap between the write includes providing data version management for the simul- set (data written) of one transaction and the write set or read taneous storage of both new (visible if the transaction com- set (data read) of other concurrent transactions. Conflict mits) and old (retained if the transaction aborts) values. detection is called eager if it detects offending loads or Most (hardware) TM systems leave old values “in place” stores immediately and lazy if it defers detection until later (the target memory address) and buffer new values else- (e.g., when transactions commit). where until commit. This makes aborts fast, but penalizes The taxonomy in Table 1 illustrates which TM proposals (the much more frequent) commits. use lazy versus eager version management and conflict In this paper, we present a new implementation of trans- detection.
    [Show full text]
  • Varys: Protecting SGX Enclaves from Practical Side-Channel Attacks
    Varys: Protecting SGX enclaves from practical side-channel attacks Oleksii Oleksenko, Bohdan Trach, Robert Krahn, and André Martin, TU Dresden; Mark Silberstein, Technion; Christof Fetzer, TU Dresden https://www.usenix.org/conference/atc18/presentation/oleksenko This paper is included in the Proceedings of the 2018 USENIX Annual Technical Conference (USENIX ATC ’18). July 11–13, 2018 • Boston, MA, USA ISBN 978-1-939133-02-1 Open access to the Proceedings of the 2018 USENIX Annual Technical Conference is sponsored by USENIX. Varys Protecting SGX Enclaves From Practical Side-Channel Attacks Oleksii Oleksenko†, Bohdan Trach†, Robert Krahn†, Andre Martin†, Christof Fetzer†, Mark Silberstein‡ †TU Dresden, ‡Technion Abstract cludes side channels from the SGX threat model, SCAs Numerous recent works have experimentally shown that effectively circumvent the SGX confidentiality guarantees Intel Software Guard Extensions (SGX) are vulnerable to and impede SGX adoption in many real-world scenarios. cache timing and page table side-channel attacks which More crucially, a privileged adversary against SGX can could be used to circumvent the data confidentiality guar- mount much more powerful SCAs compared to the un- antees provided by SGX. Existing mechanisms that pro- privileged one in canonical variants of the attacks. For ex- tect against these attacks either incur high execution costs, ample, a malicious OS can dramatically reduce the noise are ineffective against certain attack variants, or require levels in cache timing attacks via single-stepping [24] or significant code modifications. by slowing down the victim. We present Varys, a system that protects unmodified In this paper, we investigate practical ways of protect- programs running in SGX enclaves from cache timing ing SGX programs from page table and cache timing and page table side-channel attacks.
    [Show full text]
  • Eradicating Controlled-Channel Attacks Against Enclave Programs
    T-SGX: Eradicating Controlled-Channel Attacks Against Enclave Programs Ming-Wei Shihy;?, Sangho Leey, and Taesoo Kim Marcus Peinado Georgia Institute of Technology Microsoft Research {mingwei.shih, sangho, taesoo}@gatech.edu [email protected] Abstract—Intel Software Guard Extensions (SGX) is a I. INTRODUCTION hardware-based trusted execution environment (TEE) that en- ables secure execution of a program in an isolated environ- Hardware-based trusted execution environments (TEEs) ment, an enclave. SGX hardware protects the running enclave have become one of the most promising solutions against against malicious software, including an operating system (OS), various security threats, including malware, remote exploits, a hypervisor, and even low-level firmwares. This strong security kernel exploits, hardware Trojans, and even malicious cloud op- property allows the trustworthy execution of programs in a hostile erators [27]. ARM’s TrustZone [1] and Samsung’s KNOX [50] environment, such as a public cloud, without trusting anyone (e.g., a cloud provider) between the enclave and the SGX hardware. are now widely deployed on mobile phones and tablets. To However, recent studies have demonstrated that enclave programs secure traditional computing devices, such as laptops, desktops, are vulnerable to an accurate controlled-channel attack: Since and servers, the trusted platform module (TPM) [60], Intel’s enclaves rely on the underlying OS, a curious or potentially Trusted Execution Technology (TXT) [16], and Software Guard malicious OS can observe a sequence of accessed addresses by Extensions (SGX) [24] have been developed and are being intentionally triggering page faults. adopted into mainstream products. Among these hardware- based TEEs, Intel SGX is getting considerable attention because In this paper, we propose T-SGX, a complete mitigation it can be the basis for practical solutions in an important solution to the controlled-channel attack in terms of compatibility, performance, and ease of use.
    [Show full text]