Applying Hardware Transactional Memory for Concurrency-Bug

Total Page:16

File Type:pdf, Size:1020Kb

Applying Hardware Transactional Memory for Concurrency-Bug Applying Hardware Transactional Memory for Concurrency-Bug Failure Recovery in Production Runs Yuxi Chen, Shu Wang, and Shan Lu, University of Chicago; Karthikeyan Sankaralingam, University of Wisconsin – Madison https://www.usenix.org/conference/atc18/presentation/chen-yuxi This paper is included in the Proceedings of the 2018 USENIX Annual Technical Conference (USENIX ATC ’18). July 11–13, 2018 • Boston, MA, USA ISBN 978-1-939133-02-1 Open access to the Proceedings of the 2018 USENIX Annual Technical Conference is sponsored by USENIX. Applying Hardware Transactional Memory for Concurrency-Bug Failure Recovery in Production Runs Yuxi Chen Shu Wang Shan Lu Karthikeyan Sankaralingam University of Chicago University of Wisconsin – Madison Thread 1 Abstract Thread 2 … Re-Execu2on Concurrency bugs widely exist and severely threaten Point Re-execu'on gets around failure system availability. Techniques that help recover from Thread F failure concurrency-bug failures during production runs are Rollback Point highly desired. This paper proposes BugTM, an ap- Figure 1: Single-threaded recovery for concurrency bugs proach that leverages Hardware Transactional Mem- ory (HTM) on commodity machines for production- ten come together with naive failure restarts; even if not run concurrency-bug recovery. Requiring no knowl- successful, the recovery attempts only delays the failure edge about where are concurrency bugs, BugTM uses by a negligible amount of time. static analysis and code transformation to insert HTM in- This approach also faces challenges in performance, structions into multi-threaded programs. These BugTM- recovery capability, and correctness (i.e., not introducing transformed programs will then be able to recover from a new bugs), as we elaborate below. concurrency-bug failure by rolling back and re-executing Traditional rollback recovery conducts full-blown the recent history of a failure thread. BugTM greatly multi-threaded re-execution and whole-memory check- improves the recovery capability of state-of-the-art tech- pointing. It can help recover almost all concurrency-bug niques with low run-time overhead and no changes to OS failures, but incurs too large overhead to be deployed in or hardware, while guarantees not to introduce new bugs. production runs [35, 39]. Even with support from operat- 1 Introduction ing systems changes, periodic full-blown checkpointing 1.1 Motivation still often incurs more than 10% overhead [35]. A recently proposed recovery technique, ConAir, Concurrency bugs are caused by untimely accesses to conducts single-threaded re-execution and register-only shared variables. They are difficult to expose dur- checkpointing [55]. As shown in Figure 1, when a fail- ing in-house testing. They widely exist in production- ure happens at a thread, ConAir rolls back the register run software [26] and have caused disastrous failures content of this thread through an automatically inserted [23, 32, 40]. Production run failures severely hurt sys- longjmp and re-executes from the return of an automat- tem availability: the restart after a failure could take long ically inserted setjmp, which took register checkpoints. time and even lead to new problems if the failure leaves This design offers great performance (<1% overhead), inconsistent system states. Furthermore, comparing with but also imposes severe limitations to failure-recovery many other types of bugs, failures caused by concurrency capability. Particularly, with no memory checkpoints bugs are particularly difficult to diagnose and fix cor- and re-executing only one thread, ConAir does not al- rectly [50]. Techniques that handle production-run fail- low its re-execution regions to contain writes to shared ures caused by concurrency bugs are highly desired. variables (referred to as Ws) for correctness concerns, Rollback-and-reexecution is a promising approach to severely hurting its chance to recover many failures. recover failures caused by concurrency bugs. When a This limitation can be demonstrated by the real-world failure happens during a production run, the program example in Figure 2. In this example, the NULL assign- rolls back and re-executes from an earlier checkpoint. ment from Thread-2 could execute between the write Due to the unique non-determinism nature of concur- (A1) and the read (A2) on s!table from Thread-1, and rency bugs, the re-execution could get around the failure. cause failures. At the first glance, the failure could be This approach is appealing for several reasons. It is recovered if we could rollback Thread-1 and re-execute generic, requiring no prior knowledge about bugs; it im- both A1 and A2. However, such rollback and re-execution proves availability, masking the manifestation of concur- cannot be allowed by ConAir, as correctness can no rency bugs from end users; it avoids causing system in- longer be guaranteed if a write to a shared variable is consistency or wasting computation resources, which of- re-executed (Ws in Figure 2): another thread t could have USENIX Association 2018 USENIX Annual Technical Conference 837 read the old value of s!table, saved it to a local pointer, ReExecution RollBack Checkpoint ReExecution the re-execution then gave s!table a new value, caus- Point Point Memory ? contains Ws? ing inconsistency between t and Thread-1 and deviation ConAir setjmp longjmp 7 7 from the original program semantics. BugTMH StartTx AbortTx XX setjmp longjmp BugTMHS – or StartTx or AbortTx X X 1 //Thread-1 1 //Thread-2 2 s->table = newTable(...); //A1, Ws 2 Table 1: Design comparisons (Ws: shared-variable writes) 3 3 s->table = NULL; 4 if(!s->table) //A2 Deterministic aborts, such as those caused by trapping 5 //fatal-error message; software fails instructions, could cause software to hang if not well handled. We need to guarantee these cases do not happen Figure 2: A real-world concurrency bug from Mozilla and ensure software semantics remains unmodified. Failure recovery challenges: In order for HTM to help recovery, we need to improve the chances that soft- Rx BugTMHS ware executes in a transaction when a failure happens BugTMH and we need to carefully design HTM-abort handlers to correctly process the corresponding transaction aborts. ConAir BugTM addresses these challenges by its carefully de- Recovery Capability signed and carefully inserted, based on static program analysis, HTM start, commit, and abort routines. Specif- 0.5 1.5 3 10 Overhead (%) ically, we have explored two BugTM designs: BugTMH Figure 3: Design space of concurrency-bug failure re- and BugTMHS, as highlighted in Table 1. They are both covery (Heart: non-existing optimal design; Rx [35] changes OS) implemented as LLVM compiler passes that automati- cally instrument software in the following ways. 1.2 Contributions Hardware BugTM, short for BugTMH , uses HTM techniques2 exclusively to help failure recovery. When a Existing recovery techniques only touch two corners of failure is going to happen, a hardware transaction abort the design space — good performance but limited re- causes the failing thread to roll back. The re-execution covery capability or good recovery capability but lim- naturally starts from the beginning of the enclosing trans- ited performance — as shown in Figure 3. It is desir- action, carefully inserted by BugTM . able to have new recovery techniques that combine the H BugTM provides better recovery capability than performance and recovery capability strengths of the ex- H ConAir — benefiting from HTM, its re-execution region isting two corners of design, while maintaining correct- can contain shared variable writes. However, HTM costs ness guarantees. BugTM provides such a new technique more than setjmp/longjmp. Therefore, the performance leveraging hardware transactional memory (HTM) sup- of BugTM is worse than ConAir, but much better than port that already exists in commodity machines. H full-blown checkpointing, as shown in Figure 3. At the first glance, the opportunity seems obvious, as Hybrid BugTM, short for BugTM , uses HTM HTM provides a powerful mechanism for concurrency HS techniques and setjmp/longjmp together to help failure re- control and rollback-reexecution. Previous work [46] covery. BugTM inserts both setjmp/longjmp and HTM also showed that TM can be used to manually fix con- HS APIs into software, with the latter inserted only when currency bugs after they are detected. beneficial (i.e., when able to extend re-execution re- However, automatically inserting HTMs to help gions). When a failure is going to happen, the rollback tackle unknown concurrency bugs during production is carried out through transaction abort if under an active runs faces many challenges not encountered by manu- transaction or longjmp otherwise. ally fixing already detected concurrency bugs off-line: Performance challenges: High frequency of transac- BugTMHS provides performance almost as good tion uses would cause large overhead unacceptable for as ConAir and recovery capability even better than production runs. Unsuitable content of transactions, like BugTMH by carefully combining BugTMH and ConAir. trapping instructions1, high levels of transaction nesting, We thoroughly evaluated BugTMH and BugTMHS us- and long loops, would also cause performance degrada- ing 29 real-world concurrency bugs, including all the tion due to repeated and unnecessary transaction aborts. bugs used by a set of recent papers on concurrency bug Correctness challenges: Unpaired transaction-start detection and avoidance [17, 19, 41, 55, 56, 57]. Our and transaction-commit
Recommended publications
  • The Case for Hardware Transactional Memory
    Lecture 20: Transactional Memory CMU 15-418: Parallel Computer Architecture and Programming (Spring 2012) Giving credit ▪ Many of the slides in today’s talk are the work of Professor Christos Kozyrakis (Stanford University) (CMU 15-418, Spring 2012) Raising level of abstraction for synchronization ▪ Machine-level synchronization prims: - fetch-and-op, test-and-set, compare-and-swap ▪ We used these primitives to construct higher level, but still quite basic, synchronization prims: - lock, unlock, barrier ▪ Today: - transactional memory: higher level synchronization (CMU 15-418, Spring 2012) What you should know ▪ What a transaction is ▪ The difference between the atomic construct and locks ▪ Design space of transactional memory implementations - data versioning policy - con"ict detection policy - granularity of detection ▪ Understand HW implementation of transaction memory (consider how it relates to coherence protocol implementations we’ve discussed in the past) (CMU 15-418, Spring 2012) Example void deposit(account, amount) { lock(account); int t = bank.get(account); t = t + amount; bank.put(account, t); unlock(account); } ▪ Deposit is a read-modify-write operation: want “deposit” to be atomic with respect to other bank operations on this account. ▪ Lock/unlock pair is one mechanism to ensure atomicity (ensures mutual exclusion on the account) (CMU 15-418, Spring 2012) Programming with transactional memory void deposit(account, amount){ void deposit(account, amount){ lock(account); atomic { int t = bank.get(account); int t = bank.get(account); t = t + amount; t = t + amount; bank.put(account, t); bank.put(account, t); unlock(account); } } } nDeclarative synchronization nProgrammers says what but not how nNo explicit declaration or management of locks nSystem implements synchronization nTypically with optimistic concurrency nSlow down only on true con"icts (R-W or W-W) (CMU 15-418, Spring 2012) Declarative vs.
    [Show full text]
  • Robust Architectural Support for Transactional Memory in the Power Architecture
    Robust Architectural Support for Transactional Memory in the Power Architecture Harold W. Cain∗ Brad Frey Derek Williams IBM Research IBM STG IBM STG Yorktown Heights, NY, USA Austin, TX, USA Austin, TX, USA [email protected] [email protected] [email protected] Maged M. Michael Cathy May Hung Le IBM Research IBM Research (retired) IBM STG Yorktown Heights, NY, USA Yorktown Heights, NY, USA Austin, TX, USA [email protected] [email protected] [email protected] ABSTRACT in current p795 systems, with 8 TB of DRAM), as well as On the twentieth anniversary of the original publication [10], strengths in RAS that differentiate it in the market, adding following ten years of intense activity in the research lit- TM must not compromise any of these virtues. A robust erature, hardware support for transactional memory (TM) system is one that is sturdy in construction, a trait that has finally become a commercial reality, with HTM-enabled does not usually come to mind in respect to HTM systems. chips currently or soon-to-be available from many hardware We structured TM to work in harmony with features that vendors. In this paper we describe architectural support for support the architecture's scalability. Our goal has been to TM provide a comprehensive programming environment includ- TM added to a future version of the Power ISA . Two im- ing support for simple system calls and debug aids, while peratives drove the development: the desire to complement providing a robust (in the sense of "no surprises") execu- our weakly-consistent memory model with a more friendly tion environment with reasonably consistent performance interface to simplify the development and porting of multi- and without unexpected transaction failures.2 TM must be threaded applications, and the need for robustness beyond usable throughout the system stack: in hypervisors, oper- that of some early implementations.
    [Show full text]
  • Leveraging Modern Multi-Core Processor Features to Efficiently
    LEVERAGING MODERN MULTI-CORE PROCESSORS FEATURES TO EFFICIENTLY DEAL WITH SILENT ERRORS, AUGUST 2017 1 Leveraging Modern Multi-core Processor Features to Efficiently Deal with Silent Errors Diego Perez´ ∗, Thomas Roparsz, Esteban Meneses∗y ∗School of Computing, Costa Rica Institute of Technology yAdvanced Computing Laboratory, Costa Rica National High Technology Center zUniv. Grenoble Alpes, CNRS, Grenoble INP ' , LIG, F-38000 Grenoble France Abstract—Since current multi-core processors are more com- about 200% of resource overhead [3]. Recent contributions [1] plex systems on a chip than previous generations, some transient [4] tend to show that checkpointing techniques provide the errors may happen, go undetected by the hardware and can best compromise between transparency for the developer and potentially corrupt the result of an expensive calculation. Because of that, techniques such as Instruction Level Redundancy or efficient resource usage. In theses cases only one extra copy checkpointing are utilized to detect and correct these soft errors; is executed, which is enough to detect the error. But, still the however these mechanisms are highly expensive, adding a lot technique remains expensive with about 100% of overhead. of resource overhead. Hardware Transactional Memory (HTM) To reduce this overhead, some features provided by recent exposes a very convenient and efficient way to revert the state of processors, such as hardware-managed transactions, Hyper- a core’s cache, which can be utilized as a recovery technique. An experimental prototype has been created that uses such feature Threading and memory protection extensions, could be great to recover the previous state of the calculation when a soft error opportunities to implement efficient error detection and recov- has been found.
    [Show full text]
  • Lecture 21: Transactional Memory
    Lecture 21: Transactional Memory • Topics: Hardware TM basics, different implementations 1 Transactions • New paradigm to simplify programming . instead of lock-unlock, use transaction begin-end . locks are blocking, transactions execute speculatively in the hope that there will be no conflicts • Can yield better performance; Eliminates deadlocks • Programmer can freely encapsulate code sections within transactions and not worry about the impact on performance and correctness (for the most part) • Programmer specifies the code sections they’d like to see execute atomically – the hardware takes care of the rest (provides illusion of atomicity) 2 Transactions • Transactional semantics: . when a transaction executes, it is as if the rest of the system is suspended and the transaction is in isolation . the reads and writes of a transaction happen as if they are all a single atomic operation . if the above conditions are not met, the transaction fails to commit (abort) and tries again transaction begin read shared variables arithmetic write shared variables transaction end 3 Example Producer-consumer relationships – producers place tasks at the tail of a work-queue and consumers pull tasks out of the head Enqueue Dequeue transaction begin transaction begin if (tail == NULL) if (head->next == NULL) update head and tail update head and tail else else update tail update head transaction end transaction end With locks, neither thread can proceed in parallel since head/tail may be updated – with transactions, enqueue and dequeue can proceed in parallel
    [Show full text]
  • Practical Enclave Malware with Intel SGX
    Practical Enclave Malware with Intel SGX Michael Schwarz, Samuel Weiser, Daniel Gruss Graz University of Technology Abstract. Modern CPU architectures offer strong isolation guarantees towards user applications in the form of enclaves. However, Intel's threat model for SGX assumes fully trusted enclaves and there doubt about how realistic this is. In particular, it is unclear to what extent enclave malware could harm a system. In this work, we practically demonstrate the first enclave malware which fully and stealthily impersonates its host application. Together with poorly-deployed application isolation on per- sonal computers, such malware can not only steal or encrypt documents for extortion but also act on the user's behalf, e.g., send phishing emails or mount denial-of-service attacks. Our SGX-ROP attack uses new TSX- based memory-disclosure primitive and a write-anything-anywhere prim- itive to construct a code-reuse attack from within an enclave which is then inadvertently executed by the host application. With SGX-ROP, we bypass ASLR, stack canaries, and address sanitizer. We demonstrate that instead of protecting users from harm, SGX currently poses a se- curity threat, facilitating so-called super-malware with ready-to-hit ex- ploits. With our results, we demystify the enclave malware threat and lay ground for future research on defenses against enclave malware. Keywords: Intel SGX, Trusted Execution Environments, Malware 1 Introduction Software isolation is a long-standing challenge in system security, especially if parts of the system are considered vulnerable, compromised, or malicious [24]. Recent isolated-execution technology such as Intel SGX [23] can shield software modules via hardware protected enclaves even from privileged kernel malware.
    [Show full text]
  • Taming Transactions: Towards Hardware-Assisted Control Flow Integrity Using Transactional Memory
    Taming Transactions: Towards Hardware-Assisted Control Flow Integrity Using Transactional Memory B Marius Muench1( ), Fabio Pagani1, Yan Shoshitaishvili2, Christopher Kruegel2, Giovanni Vigna2, and Davide Balzarotti1 1 Eurecom, Sophia Antipolis, France {marius.muench,fabio.pagani,davide.balzarotti}@eurecom.fr 2 University of California, Santa Barbara, USA {yans,chris,vigna}@cs.ucsb.edu Abstract. Control Flow Integrity (CFI) is a promising defense tech- nique against code-reuse attacks. While proposals to use hardware fea- tures to support CFI already exist, there is still a growing demand for an architectural CFI support on commodity hardware. To tackle this problem, in this paper we demonstrate that the Transactional Synchro- nization Extensions (TSX) recently introduced by Intel in the x86-64 instruction set can be used to support CFI. The main idea of our approach is to map control flow transitions into transactions. This way, violations of the intended control flow graphs would then trigger transactional aborts, which constitutes the core of our TSX-based CFI solution. To prove the feasibility of our technique, we designed and implemented two coarse-grained CFI proof-of-concept implementations using the new TSX features. In particular, we show how hardware-supported transactions can be used to enforce both loose CFI (which does not need to extract the control flow graph in advance) and strict CFI (which requires pre-computed labels to achieve a better pre- cision). All solutions are based on a compile-time instrumentation. We evaluate the effectiveness and overhead of our implementations to demonstrate that a TSX-based implementation contains useful concepts for architectural control flow integrity support.
    [Show full text]
  • A Survey of Published Attacks on Intel
    1 A Survey of Published Attacks on Intel SGX Alexander Nilsson∗y, Pegah Nikbakht Bideh∗, Joakim Brorsson∗zx falexander.nilsson,pegah.nikbakht_bideh,[email protected] ∗Lund University, Department of Electrical and Information Technology, Sweden yAdvenica AB, Sweden zCombitech AB, Sweden xHyker Security AB, Sweden Abstract—Intel Software Guard Extensions (SGX) provides a Unfortunately, a relatively large number of flaws and attacks trusted execution environment (TEE) to run code and operate against SGX have been published by researchers over the last sensitive data. SGX provides runtime hardware protection where few years. both code and data are protected even if other code components are malicious. However, recently many attacks targeting SGX have been identified and introduced that can thwart the hardware A. Contribution defence provided by SGX. In this paper we present a survey of all attacks specifically targeting Intel SGX that are known In this paper, we present the first comprehensive review to the authors, to date. We categorized the attacks based on that includes all known attacks specific to SGX, including their implementation details into 7 different categories. We also controlled channel attacks, cache-attacks, speculative execu- look into the available defence mechanisms against identified tion attacks, branch prediction attacks, rogue data cache loads, attacks and categorize the available types of mitigations for each presented attack. microarchitectural data sampling and software-based fault in- jection attacks. For most of the presented attacks, there are countermeasures and mitigations that have been deployed as microcode patches by Intel or that can be employed by the I. INTRODUCTION application developer herself to make the attack more difficult (or impossible) to exploit.
    [Show full text]
  • Experiments Using IBM's STM Compiler
    Barna L. Bihari1, James Cownie2, Hansang Bae2, Ulrike M. Yang1 and Bronis R. de Supinski1 1Lawrence Livermore National Laboratory, Livermore, California 2Intel Corporation, Santa Clara, California OpenMPCon Developers Conference Nara, Japan, October 3-4, 2016 Technical: Trent D’Hooge (LLNL) Tzanio Kolev (LLNL) Supervisory: Lori Diachin (LLNL) Borrowed example and mesh figures: A.H. Baker, R.D. Falgout, Tz.V. Kolev, and U.M. Yang, Multigrid Smoothers for Ultraparallel Computing, SIAM J. Sci. Comput., 33 (2011), pp. 2864-2887. LLNL-JRNL-473191. Financial support: Dept. of Energy (DOE), Office of Science, ASCR DOE, under contract DE-AC52-07NA27344 INFORMATION IN THIS DOCUMENT IS PROVIDED “AS IS”. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO THIS INFORMATION INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. Intel, Xeon, and the Intel logo are trademarks of Intel Corporation in the U.S. and other countries. Optimization Notice Intel’s compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors.
    [Show full text]
  • Anatomy of Cross-Compilation Toolchains
    Embedded Linux Conference Europe 2016 Anatomy of cross-compilation toolchains Thomas Petazzoni free electrons [email protected] Artwork and Photography by Jason Freeny free electrons - Embedded Linux, kernel, drivers - Development, consulting, training and support. http://free-electrons.com 1/1 Thomas Petazzoni I CTO and Embedded Linux engineer at Free Electrons I Embedded Linux specialists. I Development, consulting and training. I http://free-electrons.com I Contributions I Kernel support for the Marvell Armada ARM SoCs from Marvell I Major contributor to Buildroot, an open-source, simple and fast embedded Linux build system I Living in Toulouse, south west of France Drawing from Frank Tizzoni, at Kernel Recipes 2016 free electrons - Embedded Linux, kernel, drivers - Development, consulting, training and support. http://free-electrons.com 2/1 Disclaimer I I am not a toolchain developer. Not pretending to know everything about toolchains. I Experience gained from building simple toolchains in the context of Buildroot I Purpose of the talk is to give an introduction, not in-depth information. I Focused on simple gcc-based toolchains, and for a number of examples, on ARM specific details. I Will not cover advanced use cases, such as LTO, GRAPHITE optimizations, etc. I Will not cover LLVM free electrons - Embedded Linux, kernel, drivers - Development, consulting, training and support. http://free-electrons.com 3/1 What is a cross-compiling toolchain? I A set of tools that allows to build source code into binary code for
    [Show full text]
  • Logtm: Log-Based Transactional Memory
    Appears in the proceedings of the 12th Annual International Symposium on High Performance Computer Architecture (HPCA-12) Austin, TX February 11-15, 2006 LogTM: Log-based Transactional Memory Kevin E. Moore, Jayaram Bobba, Michelle J. Moravan, Mark D. Hill & David A. Wood Department of Computer Sciences, University of Wisconsin–Madison {kmoore, bobba, moravan, markhill, david}@cs.wisc.edu http://www.cs.wisc.edu/multifacet Abstract (e.g., in speculative hardware). On a store, a TM system can use eager version management and put the new value in Transactional memory (TM) simplifies parallel program- place, or use lazy version management to (temporarily) ming by guaranteeing that transactions appear to execute leave the old value in place. atomically and in isolation. Implementing these properties Conflict detection signals an overlap between the write includes providing data version management for the simul- set (data written) of one transaction and the write set or read taneous storage of both new (visible if the transaction com- set (data read) of other concurrent transactions. Conflict mits) and old (retained if the transaction aborts) values. detection is called eager if it detects offending loads or Most (hardware) TM systems leave old values “in place” stores immediately and lazy if it defers detection until later (the target memory address) and buffer new values else- (e.g., when transactions commit). where until commit. This makes aborts fast, but penalizes The taxonomy in Table 1 illustrates which TM proposals (the much more frequent) commits. use lazy versus eager version management and conflict In this paper, we present a new implementation of trans- detection.
    [Show full text]
  • Varys: Protecting SGX Enclaves from Practical Side-Channel Attacks
    Varys: Protecting SGX enclaves from practical side-channel attacks Oleksii Oleksenko, Bohdan Trach, Robert Krahn, and André Martin, TU Dresden; Mark Silberstein, Technion; Christof Fetzer, TU Dresden https://www.usenix.org/conference/atc18/presentation/oleksenko This paper is included in the Proceedings of the 2018 USENIX Annual Technical Conference (USENIX ATC ’18). July 11–13, 2018 • Boston, MA, USA ISBN 978-1-939133-02-1 Open access to the Proceedings of the 2018 USENIX Annual Technical Conference is sponsored by USENIX. Varys Protecting SGX Enclaves From Practical Side-Channel Attacks Oleksii Oleksenko†, Bohdan Trach†, Robert Krahn†, Andre Martin†, Christof Fetzer†, Mark Silberstein‡ †TU Dresden, ‡Technion Abstract cludes side channels from the SGX threat model, SCAs Numerous recent works have experimentally shown that effectively circumvent the SGX confidentiality guarantees Intel Software Guard Extensions (SGX) are vulnerable to and impede SGX adoption in many real-world scenarios. cache timing and page table side-channel attacks which More crucially, a privileged adversary against SGX can could be used to circumvent the data confidentiality guar- mount much more powerful SCAs compared to the un- antees provided by SGX. Existing mechanisms that pro- privileged one in canonical variants of the attacks. For ex- tect against these attacks either incur high execution costs, ample, a malicious OS can dramatically reduce the noise are ineffective against certain attack variants, or require levels in cache timing attacks via single-stepping [24] or significant code modifications. by slowing down the victim. We present Varys, a system that protects unmodified In this paper, we investigate practical ways of protect- programs running in SGX enclaves from cache timing ing SGX programs from page table and cache timing and page table side-channel attacks.
    [Show full text]
  • Eradicating Controlled-Channel Attacks Against Enclave Programs
    T-SGX: Eradicating Controlled-Channel Attacks Against Enclave Programs Ming-Wei Shihy;?, Sangho Leey, and Taesoo Kim Marcus Peinado Georgia Institute of Technology Microsoft Research {mingwei.shih, sangho, taesoo}@gatech.edu [email protected] Abstract—Intel Software Guard Extensions (SGX) is a I. INTRODUCTION hardware-based trusted execution environment (TEE) that en- ables secure execution of a program in an isolated environ- Hardware-based trusted execution environments (TEEs) ment, an enclave. SGX hardware protects the running enclave have become one of the most promising solutions against against malicious software, including an operating system (OS), various security threats, including malware, remote exploits, a hypervisor, and even low-level firmwares. This strong security kernel exploits, hardware Trojans, and even malicious cloud op- property allows the trustworthy execution of programs in a hostile erators [27]. ARM’s TrustZone [1] and Samsung’s KNOX [50] environment, such as a public cloud, without trusting anyone (e.g., a cloud provider) between the enclave and the SGX hardware. are now widely deployed on mobile phones and tablets. To However, recent studies have demonstrated that enclave programs secure traditional computing devices, such as laptops, desktops, are vulnerable to an accurate controlled-channel attack: Since and servers, the trusted platform module (TPM) [60], Intel’s enclaves rely on the underlying OS, a curious or potentially Trusted Execution Technology (TXT) [16], and Software Guard malicious OS can observe a sequence of accessed addresses by Extensions (SGX) [24] have been developed and are being intentionally triggering page faults. adopted into mainstream products. Among these hardware- based TEEs, Intel SGX is getting considerable attention because In this paper, we propose T-SGX, a complete mitigation it can be the basis for practical solutions in an important solution to the controlled-channel attack in terms of compatibility, performance, and ease of use.
    [Show full text]