Secure Computation Systems for Confidential Data Analysis

Total Page:16

File Type:pdf, Size:1020Kb

Secure Computation Systems for Confidential Data Analysis Secure Computation Systems for Confidential Data Analysis Rishabh Poddar Electrical Engineering and Computer Sciences University of California at Berkeley Technical Report No. UCB/EECS-2020-211 http://www2.eecs.berkeley.edu/Pubs/TechRpts/2020/EECS-2020-211.html December 17, 2020 Copyright © 2020, by the author(s). All rights reserved. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission. Secure Computation Systems for Confidential Data Analysis by Rishabh Poddar A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Computer Science in the Graduate Division of the University of California, Berkeley Committee in charge: Professor Raluca Ada Popa, Chair Professor Ion Stoica Professor Sylvia Ratnasamy Professor Deirdre Mulligan Fall 2020 Secure Computation Systems for Confidential Data Analysis Copyright 2020 by Rishabh Poddar 1 Abstract Secure Computation Systems for Confidential Data Analysis by Rishabh Poddar Doctor of Philosophy in Computer Science University of California, Berkeley Professor Raluca Ada Popa, Chair A large number of services today are built around processing data that is collected from or shared by customers. While such services are typically able to protect the data when it is in transit or in storage using standard encryption protocols, they are unable to extend this protection to the data when it is being processed, making it vulnerable to breaches. This not only threatens data confidentiality in existing services, it also prevents customers from availing such services altogether for sensitive workloads, in that they are unwilling / unable to share their data out of privacy concerns, regulatory hurdles, or business competition. Existing solutions to this problem are unable to meet the requirements of advanced data analysis applications. Systems that are efficient do not provide strong enough security guarantees, and approaches with stronger security are often not efficient. To address this problem, the work in this dissertation develops new systems and protocols for securely computing on encrypted data, that attempt to bridge the gap between security and efficiency. We distill design principles based on the properties of the two primary approaches for secure computation—advanced cryptographic protocols and trusted execution environments. Informed by these principles, we design novel cryptographic protocols and algorithms with strong and provable security guarantees, using which we show how to build systems that are both secure and efficient. i To my family. ii Contents Contents ii List of Figuresv List of Tables viii 1 Introduction1 1.1 Motivation....................................... 1 1.2 Approaches for Secure Computation......................... 2 1.3 Building Systems using Secure Computation..................... 3 1.4 Impact and Adoption ................................. 5 1.5 Dissertation Roadmap................................. 5 2 Building Secure and Practical Data Systems6 2.1 Trusted Execution Environments........................... 6 2.2 Cryptographic Approaches.............................. 7 2.3 Challenges and Design Strategy ........................... 8 3 Database Queries on Encrypted Data 11 3.1 Introduction...................................... 11 3.2 Overview ....................................... 14 3.3 Encryption Building Blocks.............................. 18 3.4 ArxRange & Order-based Queries.......................... 18 3.5 ArxEq & Equality Queries.............................. 23 3.6 ArxAgg & Aggregation Queries........................... 25 3.7 ArxJoin & Join Queries ............................... 26 3.8 Arx’s Planner ..................................... 28 3.9 Security Analysis................................... 30 3.10 Evaluation....................................... 32 3.11 Limitations and Future Work............................. 40 3.12 Related Work ..................................... 40 3.13 Summary ....................................... 42 iii 4 Collaborative SQL Analytics on Encrypted Data 43 4.1 Introduction...................................... 43 4.2 Senate’s API...................................... 47 4.3 Threat Model and Security Guarantees........................ 48 4.4 Senate’s MPC Decomposition Protocol........................ 49 4.5 Senate’s Circuit Primitives .............................. 57 4.6 Decomposable Circuits for SQL Operators...................... 60 4.7 Query Execution ................................... 62 4.8 Evaluation....................................... 67 4.9 Limitations and Discussion.............................. 74 4.10 Related work ..................................... 75 4.11 Summary ....................................... 76 5 Analyzing Encrypted Network Traffic 77 5.1 Introduction...................................... 77 5.2 Model and Threat Model ............................... 80 5.3 SafeBricks: End-to-end Architecture......................... 81 5.4 Background...................................... 83 5.5 SafeBricks: Framework Design............................ 84 5.6 SafeBricks: NF Isolation, Least Privilege....................... 88 5.7 SafeBricks: System Bootstrap Protocol........................ 91 5.8 Security Guarantees.................................. 94 5.9 Evaluation....................................... 95 5.10 Limitations and Future Work.............................100 5.11 Related Work .....................................101 5.12 Summary .......................................102 6 Encrypted Video Analytics and Machine Learning 103 6.1 Introduction......................................103 6.2 Background and Motivation..............................106 6.3 Threat Model and Security Guarantees........................108 6.4 A Privacy-Preserving MLaaS Framework ......................110 6.5 Designing Oblivious Vision Modules.........................114 6.6 Oblivious Video Decoding ..............................116 6.7 Oblivious Image Processing..............................120 6.8 Evaluation.......................................125 6.9 Discussion.......................................133 6.10 Related Work .....................................133 6.11 Summary .......................................134 7 Collaborative Machine Learning on Encrypted Data 136 7.1 Introduction......................................136 iv 7.2 Overview .......................................137 7.3 Threat Model and Security Guarantees........................138 7.4 System Design.....................................139 7.5 Data-oblivious training and inference.........................141 7.6 Implementation....................................144 7.7 Evaluation.......................................144 7.8 Conclusion ......................................145 8 Conclusion 147 8.1 Future Directions ...................................148 Bibliography 149 A Joins over Multisets in Senate 175 B Invertibility of SQL Operators in Senate 176 C Security Proofs and Pseudocode for Visor 178 C.1 Oblivious video decoding...............................178 C.2 Oblivious image processing..............................181 D Impact of Video Encoder Padding on Visor 190 D.1 Inter-prediction for interframes............................190 v List of Figures 1.1 Classification of the systems we built, by computation scenario and the secure computa- tion approach used by the system. ............................ 3 3.1 Arx’s architecture: Shaded boxes depict components introduced by Arx. Locks indicate that sensitive data at the component is encrypted. .................... 14 3.2 ArxRange example. Enc is encryption with BASE..................... 19 3.3 Search token tree...................................... 24 3.4 ArxEq read throughput with increasing no. of duplicates. ................ 35 3.5 ArxEq write throughput with increasing no. of duplicates................. 35 3.6 YCSB throughput for different workloads......................... 36 3.7 ArxRange latency of reads and writes. .......................... 37 3.8 ArxRange throughput, with and without caching...................... 37 3.9 ShareLaTeX performance with Arx’s client proxy on varying cores .......... 38 3.10 ShareLaTeX performance with increasing no. of client threads ............. 38 4.1 Overview of Senate’s workflow. ............................. 44 4.2 Query execution in the baseline (monolithic MPC) vs. Senate (decomposed MPC). s represent a filtering operation, and on is a join. Green boxes with locks denote MPC operations; white boxes denote plaintext computation. X represents additional verification operations added by Senate. ......................... 45 4.3 Query execution in Senate. Colored keys and locks indicate which parties are involved in which MPC circuits................................... 63 4.4 Performance of m-SI in LAN................................ 67 4.5 Performance of m-Sort in LAN. ............................. 68 4.6 Performance of m-SU in LAN............................... 68 4.7 Resource consumption of building blocks (16 parties)................... 69 4.8 Building blocks in WAN.................................. 69 4.9 Query 1 with 16 parties................................... 69 4.10 Query 2 with
Recommended publications
  • A DATA-ORIENTED NETWORK ARCHITECTURE Doctoral Dissertation
    TKK Dissertations 140 Espoo 2008 A DATA-ORIENTED NETWORK ARCHITECTURE Doctoral Dissertation Teemu Koponen Helsinki University of Technology Faculty of Information and Natural Sciences Department of Computer Science and Engineering TKK Dissertations 140 Espoo 2008 A DATA-ORIENTED NETWORK ARCHITECTURE Doctoral Dissertation Teemu Koponen Dissertation for the degree of Doctor of Science in Technology to be presented with due permission of the Faculty of Information and Natural Sciences for public examination and debate in Auditorium T1 at Helsinki University of Technology (Espoo, Finland) on the 2nd of October, 2008, at 12 noon. Helsinki University of Technology Faculty of Information and Natural Sciences Department of Computer Science and Engineering Teknillinen korkeakoulu Informaatio- ja luonnontieteiden tiedekunta Tietotekniikan laitos Distribution: Helsinki University of Technology Faculty of Information and Natural Sciences Department of Computer Science and Engineering P.O. Box 5400 FI - 02015 TKK FINLAND URL: http://cse.tkk.fi/ Tel. +358-9-4511 © 2008 Teemu Koponen ISBN 978-951-22-9559-3 ISBN 978-951-22-9560-9 (PDF) ISSN 1795-2239 ISSN 1795-4584 (PDF) URL: http://lib.tkk.fi/Diss/2008/isbn9789512295609/ TKK-DISS-2510 Picaset Oy Helsinki 2008 AB ABSTRACT OF DOCTORAL DISSERTATION HELSINKI UNIVERSITY OF TECHNOLOGY P. O. BOX 1000, FI-02015 TKK http://www.tkk.fi Author Teemu Koponen Name of the dissertation A Data-Oriented Network Architecture Manuscript submitted 09.06.2008 Manuscript revised 12.09.2008 Date of the defence 02.10.2008 Monograph X Article dissertation (summary + original articles) Faculty Information and Natural Sciences Department Computer Science and Engineering Field of research Networking Opponent(s) Professor Jon Crowcroft Supervisor Professor Antti Ylä-Jääski Instructor(s) Dr.
    [Show full text]
  • NSDI '11: 8Th USENIX Symposium on Networked Systems Design And
    NSDI ’11: 8th USENIX Symposium on Networked Systems Design and Implementation Boston, MA March 30–April 1, 2011 Opening Remarks and Awards Presentation Summarized by Rik Farrow ([email protected]) David Andersen (CMU), co-chair with Sylvia Ratnasamy (Intel Labs, Berkeley), presided over the opening of NSDI. David told us that there were 251 attendees by the time of the opening, three short of a record for NSDI; 157 papers were submitted and 27 accepted. David joked that they used a Bayesian ranking process based on keywords, and that using the word “A” in your title seemed to increase your chances of having your paper accepted. In reality, format checking and Geoff Voelker’s Banal paper checker were used in a first pass, and all surviving papers received three initial reviews. By the time of the day-long program committee meeting, there were 56 papers left. In the end, there were no invited talks at NSDI ’11, just paper presentation sessions. David announced the winners of the Best Paper awards: “ServerSwitch: A Programmable and High Performance Platform for Datacenter Networks,” Guohan Lu et al. (Microsoft Research Asia), and “Design, Implementation and Evaluation of Congestion Control for Multipath TCP,” Damon Wischik et al. (University College London). Patrick Wendell (Princeton University) was awarded a CRA Undergraduate Research Award for outstanding research potential in CS for his work on DONAR, a system for selecting the best online replica, a service he deployed and tested. Patrick also worked at Cloudera in the summer of 2010 and become a committer for the Apache Avro system, the RPC networking layer to be used in Hadoop.
    [Show full text]
  • Abstract Sensor Event Processing to Achieve Dynamic Composition of Cyber-Physical Systems
    Abstract Sensor Event Processing to Achieve Dynamic Composition of Cyber-Physical Systems D I S S E R T A T I O N zur Erlangung des akademischen Grades Doktoringenieur (Dr.-Ing.) angenommen durch die Fakultät für Informatik der Otto-von-Guericke-Universität Magdeburg von Dipl.-Inform. Christoph Steup geb. am 29.01.1985 in Halle (Saale) Gutachterinnen/Gutachter Prof. Dr. rer. nat. Jörg Kaiser Prof. Dr. s.c. ETH Kay Uwe Römer Prof. Dr.-Ing. Christian Diedrich Magdeburg, den 19.02.2018 Zusammenfassung Diese Thesis widmet sich dem übergeordneten Ziel Cyber-Physische Systeme (CPS) dy- namisch aus Komponenten zusammenzusetzen. CPS sind eine Schlüsseltechnologie für die Industrie 4.0, moderne Robotik und autonom fahrende Fahrzeuge. Jedoch werden die realen Systeme immer komplexer und setzen sich aus immer mehr einzelnen Komponenten zusam- men, welche über ein Kommunikationsnetz verbunden sind. Die Herausforderung bei der En- twicklung dieser Systeme ist die Spezifikation und der Austausch der im System vorhandenen Informationen um die vorhandenen Komponenten bestmöglich zu nutzen. Die notwendigen Informationen sind dabei sehr Szenario spezifisch. Diese Arbeit versucht die Konstruktion und Komposition dieser Systeme zu vereinfachen indem eine neue Form der Information- sabstraktion für CPS eingeführt wird: Abstract Sensor Events (ASE). Diese stellen die Kapselung von Sensorinformation in maschinenlesbare Form dar. Die Kapselung vereint die inhärenten Sensordaten mit den notwendigen Kontextdaten. Der Kontext der Information besteht hierbei mindestens aus Zeitpunkt, Position, Ersteller und semantischer Beschrei- bung. Um die unvermeidbare Unschärfe der Sensorinformationen abzubilden, enthalten ASE eine intervallbasierte Unschärfebeschreibung, der Daten und des Kontextes. Die semantische Beschreibung basiert auf einem Wörterbuch von Attributen, die in den Ereignissen enthal- ten sein können.
    [Show full text]
  • A New Approach to Network Function Virtualization
    A New Approach to Network Function Virtualization By Aurojit Panda A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Computer Science in the Graduate Division of the University of California, Berkeley Committee in charge: Professor Scott J. Shenker, Chair Professor Sylvia Ratnasamy Professor Ion Stoica Professor Deirdre Mulligan Summer 2017 A New Approach to Network Function Virtualization Copyright 2017 by Aurojit Panda 1 Abstract A New Approach to Network Function Virtualization by Aurojit Panda Doctor of Philosophy in Computer Science University of California, Berkeley Professor Scott J. Shenker, Chair Networks provide functionality beyond just packet routing and delivery. Network functions such as firewalls, caches, WAN optimizers, etc. are crucial for scaling networks and in supporting new applications. While traditionally network functions were implemented using dedicated hardware middleboxes, recent efforts have resulted in them being implemented as software and deployed in virtualized environment . This move towards virtualized network function is commonly referred to as network function virtualization (NFV). While the NFV proposal has been enthusiastically accepted by carriers and enterprises, actual efforts to deploy NFV have not been as successful. In this thesis we argue that this is because the current deployment strategy which relies on operators to ensure that network functions are configured to correctly implement policies, and then deploys these network functions as virtual machines (or containers), connected by virtual switches are ill- suited to NFV workload. In this dissertation we propose an alternative NFV framework based on the use of static tech- niques such as type checking and formal verification.
    [Show full text]
  • Two Decades of Ddos Attacks and Defenses
    Two Decades of DDoS Attacks and Defenses LUMIN SHI, University of Oregon Two decades after the first distributed denial-of-service (DDoS) attack, the Internet continues to faceDDoS attacks. To understand why DDoS defense is a difficult problem, we must study how the attacks are carried out and whether the existing defense solutions are sufficient. In this work, we review the latest DDoS attacks and DDoS defense solutions. In particular, we focus on the key advancements and missing pieces in DDoS research. CCS Concepts: • Networks → Network security; Denial-of-service attacks. Additional Key Words and Phrases: DDoS attack, DDoS defense, CDN, SDN 1 INTRODUCTION Distributed denial-of-service (DDoS) attacks are easy to launch but difficult to defend against. Despite two decades of DDoS research, DDoS attacks continue to impose threats to today’s networks. Recent attacks such as [1, 2, 3] have shown that resourceful attackers can launch DDoS attacks to flood network links and leaves them paralyzed for hours or days. In the meantime, the proliferation of Internet-of-Things (IoT) devices amplifies the threat of DDoS. Many of these devices come with little to no updates for security vulnerabilities, and as such, they are exploitable by the attackers. Compromised IoT devices remain vulnerable even after major incidents such as the Mirai attack [1]. The sheer amount of vulnerable, increasing IoT devices challenges the capacity/scalability of existing defense solutions. On the other hand, the frequent DDoS attacks led the network community to seek better defense solutions. From remotely triggered black hole (RTBH) [4] to BGP FlowSpec [5], we see the progress made by the network community to move away from high-collateral-damage solutions [4].
    [Show full text]
  • Zero-Knowledge Middleboxes
    Zero-Knowledge Middleboxes Paul Grubbs Arasu Arun Ye Zhang Joseph Bonneau Michael Walfish NYU Department of Computer Science, Courant Institute Abstract. This paper initiates research on zero-knowledge an attempted compromise, Mozilla introduced a special ca- middleboxes (ZKMBs). A ZKMB is a network middlebox that nary domain that instructs clients to fall back to legacy DNS. enforces network usage policies on encrypted traffic. Clients But this is no compromise: it is simply handing the local send the middlebox zero-knowledge proofs that their traffic network a (silent) veto over encrypted DNS. is policy-compliant; these proofs reveal nothing about the Encrypted DNS represents a fraught tussle [30, 70] that we client’s communication except that it complies with the pol- specifically want to confront and resolve. Thus, this paper’s icy. We show how to make ZKMBs work with unmodified overarching question: can we create mechanisms that achieve encrypted-communication protocols (specifically TLS 1.3), meaningful compromise? Note that we do not take a philo- making ZKMBs invisible to servers. As a contribution of in- sophical position for or against middleboxes.1 That debate is dependent interest, we design zero-knowledge proofs for TLS almost as old as the Internet architecture itself. Instead, we ac- 1.3 session keys. We apply the ZKMB paradigm to several cept that policy-enforcing middleboxes are a fact of life today case studies, including filtering for encrypted DNS protocols. and likely to remain so. For example, adult content blocking Experimental results suggest that performance, while not yet is legally mandated for U.S. K–12 school networks [27,61] practical, is promising.
    [Show full text]
  • Practical and Efficient Internet Routing with Competing Interests
    Practical and Efficient Internet Routing with Competing Interests Ratul Mahajan A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy University of Washington 2005 Program Authorized to Offer Degree: Computer Science and Engineering University of Washington Graduate School This is to certify that I have examined this copy of a doctoral dissertation by Ratul Mahajan and have found that it is complete and satisfactory in all respects, and that any and all revisions required by the final examining committee have been made. Co-Chairs of the Supervisory Committee: David J. Wetherall Thomas E. Anderson Reading Committee: David J. Wetherall Thomas E. Anderson John Zahorjan Date: In presenting this dissertation in partial fulfillment of the requirements for the doctoral degree at the University of Washington, I agree that the Library shall make its copies freely available for inspection. I further agree that extensive copying of this dissertation is allowable only for scholarly purposes, consistent with “fair use” as prescribed in the U.S. Copyright Law. Requests for copying or reproduction of this dissertation may be referred to Proquest Information and Learning, 300 North Zeeb Road, Ann Arbor, MI 48106-1346, 1-800-521-0600, to whom the author has granted “the right to reproduce and sell (a) copies of the manuscript in microform and/or (b) printed copies of the manuscript made from microform.” Signature Date University of Washington Abstract Practical and Ef®cient Internet Routing with Competing Interests Ratul Mahajan Co-Chairs of the Supervisory Committee: Associate Professor David J. Wetherall Computer Science and Engineering Professor Thomas E.
    [Show full text]
  • Contents U U U
    Contents u u u ACM Awards Reception and Banquet, June 2018 .................................................. 2 Introduction ......................................................................................................................... 3 A.M. Turing Award .............................................................................................................. 4 ACM Prize in Computing ................................................................................................. 5 ACM Charles P. “Chuck” Thacker Breakthrough in Computing Award ............. 6 ACM – AAAI Allen Newell Award .................................................................................. 7 Software System Award ................................................................................................... 8 Grace Murray Hopper Award ......................................................................................... 9 Paris Kanellakis Theory and Practice Award ...........................................................10 Karl V. Karlstrom Outstanding Educator Award .....................................................11 Eugene L. Lawler Award for Humanitarian Contributions within Computer Science and Informatics ..........................................................12 Distinguished Service Award .......................................................................................13 ACM Athena Lecturer Award ........................................................................................14 Outstanding Contribution
    [Show full text]
  • PURDUE UNIVERSITY GRADUATE SCHOOL Thesis/Dissertation Acceptance
    Graduate School Form 30 Updated PURDUE UNIVERSITY GRADUATE SCHOOL Thesis/Dissertation Acceptance This is to certify that the thesis/dissertation prepared By Harold Owens II Entitled PROVISIONING END-TO-END QUALITY OF SERVICE FOR REAL-TIME INTERACTIVE VIDEO OVER SOFTWARE-DEFINED NETWORKING For the degree of Doctor of Philosophy Is approved by the final examining committee: Arjan Durresi Chair Mohammad Al Hasan Xia N. Ning Raje R. Rajeev To the best of my knowledge and as understood by the student in the Thesis/Dissertation Agreement, Publication Delay, and Certification Disclaimer (Graduate School Form 32), this thesis/dissertation adheres to the provisions of Purdue University’s “Policy of Integrity in Research” and the use of copyright material. Approved by Major Professor(s): Arjan Durresi Approved by: Shiaofen Fang 11/22/2016 Head of the Departmental Graduate Program Date PROVISIONING END-TO-END QUALITY OF SERVICE FOR REAL-TIME INTERACTIVE VIDEO OVER SOFTWARE-DEFINED NETWORKING A Dissertation Submitted to the Faculty of Purdue University by Harold Owens II In Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy December 2016 Purdue University Indianapolis, Indiana ii To my mother (1947-2006). To my wife, daughter, and son. Thank you. iii ACKNOWLEDGMENTS I want to acknowledge my mentor and advisor, Dr. Arjan Durresi for his encour- agement and guidance during my studies. I want to acknowledge thesis committee members Dr. Rajeev Raje, Dr. Xia Ning, and Dr. Mohammad Al Hasan for reviewing and providing feedback
    [Show full text]
  • Timothy Roscoe (Mothy)
    Timothy Roscoe (Mothy) Education University of Cambridge, United Kingdom Ph.D., Computer Science (Operating Systems and Networking), November 1995 Diploma in Computer Science (passed with Distinction), August 1990 B.A. Pure Mathematics (2nd class honours), July 1989 Research Large-scale distributed systems, operating systems, network architecture. Interests Research ETH (Swiss Federal Institute of Technology) Zurich¨ , Switzerland. From January Experience 2007 (Professor of Computer Science). Barrelfish: Operating system support for heterogeneous, manycore processors and high-level concurrent programming languages. Rhizoma: Declarative distributed resource management using Constraint Logic Pro- gramming. r-OSGI: Extending module management techniques to distributed computing deploy- ments. National ICT Australia, Sydney, Australia. 2006 (Visiting Researcher): High- assurance kernels for embedded real-time systems. Intel Research, Berkeley, California, USA. 2002–2006 (Principal Research Scientist): P2: A declarative toolkit for expressing, building, executing, debugging, monitoring distributed systems (with U.C. Berkeley). PlanetLab. An open platform for developing, deploying, and accessing planetary-scale services. The de facto standard testbed for wide-area distributed systems research. See http://www.planet-lab.org/ for more details. PIER: A distributed relational query processor (with U.C. Berkeley and ICSI). Scalable continuous relational queries over large numbers of widely-distributed data sources. Bamboo: A highly robust distributed hash table (DHT) implementation (with U.C. Berkeley). Internet Capabilities: Preventing denial of service using hard-to-forge identifiers stored as soft-state in routers along the packet forwarding path (with U. Washington). Palimpsest: A wide-area ephemeral storage system (with U. Cambridge). Palimpsest stores erasure-coded blocks in a distributed hash table which functions as a FIFO queue, allowing the application of congestion-pricing models to storage.
    [Show full text]
  • UC Berkeley UC Berkeley Electronic Theses and Dissertations
    UC Berkeley UC Berkeley Electronic Theses and Dissertations Title An Architecture for Network Function Virtualization Permalink https://escholarship.org/uc/item/3nc1g6q7 Author Lan, Chang Publication Date 2018 Peer reviewed|Thesis/dissertation eScholarship.org Powered by the California Digital Library University of California An Architecture for Network Function Virtualization by Chang Lan A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Computer Science in the Graduate Division of the University of California, Berkeley Committee in charge: Professor Sylvia Ratnasamy, Chair Professor Scott Shenker Professor Rhonda Righter Summer 2018 An Architecture for Network Function Virtualization Copyright 2018 by Chang Lan 1 Abstract An Architecture for Network Function Virtualization by Chang Lan Doctor of Philosophy in Computer Science University of California, Berkeley Professor Sylvia Ratnasamy, Chair Today’s networks provide more than connectivity. Network functions such as firewalls, caches, WAN optimizers play a crucial role in improving security and performance capabili- ties. Although network functions traditionally have been implemented as dedicated hardware middleboxes, a recent effort commonly referred to as Network Function Virtualization (NFV) promises to bring the advantages of cloud computing to network packet processing by moving network appliance functionality from proprietary hardware to software. However, while NFV has quickly gained remarkable momentum in the industry, accepted NFV approaches are merely replacing monolithic hardware with monolithic software. In this dissertation, we argue that current approaches to NFV are ill-suited to the original vision of NFV. Instead, NFV needs a framework that serves as a common runtime for network functions. We present E2 – an NFV framework that provides placement and elastic scaling with high-level network function composition interface.
    [Show full text]
  • Complete Paper
    Washington University in St. Louis School of Engineering and Applied Science Department of Computer Science and Engineering Dissertation Examination Committee: Raj Jain, Chair Viktor Gruev Chenyang Lu Paul Min Mohammed Samaka Software Defined Application Delivery Networking by Subharthi Paul A dissertation presented to the Graduate School of Arts and Sciences of Washington University in partial fulfillment of the requirements for the degree of Doctor of Philosophy June 2014 Saint Louis, Missouri copyright by Subharthi Paul 2014 Contents List of Tables ::::::::::::::::::::::::::::::::::::::: iii List of Figures :::::::::::::::::::::::::::::::::::::: iv Acknowledgments :::::::::::::::::::::::::::::::::::: vii Abstract :::::::::::::::::::::::::::::::::::::::::: x 1 Introduction :::::::::::::::::::::::::::::::::::::: 1 1.1 Objectives . 4 1.2 Approach . 5 1.3 Contribution . 10 1.4 Potential Impact . 11 1.5 Organization . 15 2 Background :::::::::::::::::::::::::::::::::::::: 17 2.1 What does Software-Defined mean? . 17 2.2 Software-Defined Networking (SDN) . 22 2.3 Application-Delivery Networking (ADN) . 25 2.3.1 Virtual compute, network and storage infrastructures . 27 2.3.2 Middleboxes and Middleware . 38 2.4 Next-generation Internet . 59 2.4.1 ID-locator split architectures . 60 2.4.2 Internet 3.0 . 65 2.4.3 Future Internet Architectures (FIA) projects . 72 2.5 Other Related Work . 79 3 AppFabric High-level Architecture ::::::::::::::::::::::: 82 3.1 High-level Ideas . 82 3.1.1 Horizontal integration Platform . 82 3.1.2 Separation of control and data planes . 86 3.1.3 ID/Locator Split . 93 3.2 High-level Goal . 95 4 OpenADN: The AppFabric Data Plane ::::::::::::::::::::: 97 i 4.1 OpenADN: Architectural Requirements . 98 4.2 OpenADN: Architecture . 109 5 Lighthouse: The AppFabric Control and Management Plane System :: 122 5.1 The Management Subsystem .
    [Show full text]