Rentable CDN Using Blockchain and Proof of Provenance

Total Page:16

File Type:pdf, Size:1020Kb

Rentable CDN Using Blockchain and Proof of Provenance applied sciences Article Rentable CDN Using Blockchain and Proof of Provenance Suah Kim 1,* , Vasily Sachnev 2 and Hyoung Joong Kim 1 1 Department of Information Security, Institute of Cyber Security & Privacy, School of Cybersecurity, Korea University, Seoul 02841, Korea; [email protected] 2 Department of Information, Communications and Electronic Engineering, Catholic University of Korea, Bucheon 14662, Korea; [email protected] * Correspondence: [email protected] or [email protected] Received: 15 July 2020; Accepted: 18 September 2020; Published: 20 September 2020 Featured Application: Rentable content delivery network with proof of provenance provides s p2p based content distribution network infrastructure that supports content control, is less vulnerable to variety of collusion attacks, and provides faster content transfer speed. Abstract: Building a rentable content delivery network (CDN), a p2p based CDN that supports content control and is composed of hardware rented from consumers, requires significant trust between the renters and consumers. The proposed method solves this using a Blockchain to provide transparency in running the network, and proof of provenance, a verifiable proof origin of the content that is used to determine who can get paid for their services to discourage malicious activities. Keywords: blockchain; content delivery network; proof of provenance; rentable CDN; p2p based CDN 1. Introduction Internet is an ever-growing network infrastructure that connects users from all around the world. With the growing adoption of personal computers and various mobile devices that connect to it, the number of accessible contents has increased as well. This meant that the sudden spike in request for a particular content has become a common occurrence and services can stop suddenly due to high load [1]. To make the contents accessible even during the sudden peak period, content delivery network (CDN) is developed. CDN solves this issue by replicating contents and redirecting content requests to ensure that the service can function uninterrupted. CDN’s performance boils down to its replication and redirecting capability [2]. For effective content replication, following three questions need to be answered: which contents should be replicated, how much replications are required, and where to place the CDN servers that will be replicating and delivering the contents. Determining which content to replicate can be further broken down to whether to replicate the content fully or partially. This is because a content is usually composed of several files. For example, a website (content) may contain HTML files, image files, and functional codes such as JavaScript. Replicating parts that are unique to the content such as HTML files will have smaller benefit, whereas images or functional codes that are common to other contents will have bigger benefit. The identification of such files can be achieved by clustering individual files based on a metric such as the of time delay reduction measurement to delivery contents [3,4]. Then, replication priority per cluster can be determined using the same or similar metric. On the other hand, finding the optimal level of replications (how much to replicate) is known to be an NP-hard problem [5]. Instead of trying to find the optimal level of replications, heuristic Appl. Sci. 2020, 10, 6570; doi:10.3390/app10186570 www.mdpi.com/journal/applsci Appl. Sci. 2020, 10, 6570 2 of 14 methods such as global greedy algorithm are used to find the sub optimal solution. Refs. [6,7] focused on finding a set of replication levels per object that guarantees a certain delivery performance. More advanced work incorporates other CDN specific data such as location of CDN servers, and distance between CDN servers to determine the level of replications [8,9]. Finally, there is a question of where to place the CDN servers. This question can be reformulated to solving the optimization problems like minimum k-median problem [10], k-HST problem [11], and set-cover problem [12]: the placement of CDN is optimized with respect to the cost function, where the cost function uses inputs such as set of possible locations for CDN, workload, latency, and other information derived from CDN. Using the aforementioned work, one can build a fast, reliable and scalable CDN. However, building and managing a globally connected CDN infrastructure is costly and difficult. To remove the need for individual businesses to build and maintain a global CDN, cloud-based CDN such as Google Cloud and Amazon CloudFront have emerged to provide a fast and scalable infrastructure that can be configured and bought over online [13]. In addition to the ease of usage, cloud based CDN hardware is regularly upgraded and maintained by the CDN service provider. Despite the advantages, CDN services are costly and the inherent high barrier to enter the CDN market promotes centralization, censorship, and market oligopoly. To reduce the cost of building and maintaining the CDN, there has been work that utilize user’s existing hardware to build a globally connected CDN. Unlike the traditional CDN that uses server client model, where dedicated CDN servers deliver contents to users, this type of CDN uses peer to peer (p2p) communication to deliver contents from a set of users to a user. This is referred as p2p based CDN. The key feature of p2p based CDN is that users can deliver contents using the resources they already own. The communication within the network is passed from a peer to a peer, thus it is designed to allow anyone with the hardware to participate, making the network easily scalable. It also means that searching requires more efforts than server client model-based networks because there is no centralized server that keeps the locations of the contents. The most obvious method to search a content in p2p network is called flooding. This is where the search request is sent out to all the connected peers and the requests are relayed to their peers until the content is found [14]. More advanced version of flooding improves upon how the contents and peers are indexed. Improvements in content indexing reduces the search space while the improvements in peer indexing allows for more efficient way to keep track of which peers have which contents. The most famous one is called Kademlia DHT system. In this system, pieces of contents and the peer associated with having that piece is stored as a keyword and a string which resembles the hash of the keyword, respectively [15]. Thus, searching for content becomes faster and the network overhead is reduced greatly. Although it has many benefits, p2p based CDN lacks many global features, such as caching, content moderation, load balancing, financial incentive, and reliability. Although lack of reliability is a serious issue, since users can shutdown their hardware at any time and bring down the CDN, more important issue is that there is no payment system that can financially reward users for their content delivery efforts. Without the financial incentive, users may not have good reasons to participate in p2p based CDN for prolong period. With the rise in the development of technologies related to Blockchain, a new type of p2p based CDN became available: we refer to it as “rentable CDN”. In rentable CDN, the content is delivered using p2p communications and the content delivers are paid using decentralized payment system based on Blockchain. It provides affordable localized content delivery network for small and medium-sized content distributing companies without the expensive initial investment and risks from continued operation. It also provides income for consumers with what they already have, making the market fair, and promote fair pricing. The detailed explanation of existing work on rentable CDN is expanded in the next section. Appl. Sci. 2020, 10, 6570 3 of 14 The rest of the paper is described using existing Blockchain terminology and p2p protocols to aid with understanding, but the proposed method is not bound by a specific Blockchain or p2p software. 2. Limitations of Rentable CDNs The main problem for rentable CDN is finding a secure and trustable payment scheme based on p2p network usage. In traditional CDN, like cloud based CDNs, the user pays the CDN based on the network usage that CDN provides. On the other hand, payment is a bit trickier in p2p based CDNs like rentable CDN, because there is no third party that can verify the network usage. Figure1 graphically shows the payment process of the traditional CDN and rentable CDN. Payment in rentable CDN is determined using the claim and the acknowledgment made by the downloader and uploader, respectively. However, “claiming” you sent a content or conversely not acknowledging that you received a content is trivial. Usage Report CDN Downloader Content CDN Client Server Payment (a) Delivery Claim Payment Downloader Content Uploader Server Payment Delivery Acknowledgement (b) Figure 1. CDN usage based payment comparison. (a) charging based on CDN server network usage: content delivery cost is determined using measured usage reported by the server; (b) charging based on p2p network usage: content delivery cost is determined using delivery claim (Uploader) and delivery acknowledgement (Downloader). Existing work solve this by putting constraints on the content delivery process and penalizing malicious party. For example, SLIVER.TV (see the whitepaper published in https://www.thetatoken. org/, downloadable at https://s3.us-east-2.amazonaws.com/assets.thetatoken.org/Theta-white- paper-latest.pdf?v=1597976373.104) is the most recent state of the art p2p based CDN using Theta Network (Blockchain) with multi-level BFT as the consensus mechanism. Figure2 graphically describes how the payment is transferred. First, the downloader makes a deposit to Blockchain in the case of double spending, then they send a partially signed payment receipt to all the uploaders. When the uploader sends a part of the content to the downloader, the downloader sends another partially signed payment receipt.
Recommended publications
  • Uila Supported Apps
    Uila Supported Applications and Protocols updated Oct 2020 Application/Protocol Name Full Description 01net.com 01net website, a French high-tech news site. 050 plus is a Japanese embedded smartphone application dedicated to 050 plus audio-conferencing. 0zz0.com 0zz0 is an online solution to store, send and share files 10050.net China Railcom group web portal. This protocol plug-in classifies the http traffic to the host 10086.cn. It also 10086.cn classifies the ssl traffic to the Common Name 10086.cn. 104.com Web site dedicated to job research. 1111.com.tw Website dedicated to job research in Taiwan. 114la.com Chinese web portal operated by YLMF Computer Technology Co. Chinese cloud storing system of the 115 website. It is operated by YLMF 115.com Computer Technology Co. 118114.cn Chinese booking and reservation portal. 11st.co.kr Korean shopping website 11st. It is operated by SK Planet Co. 1337x.org Bittorrent tracker search engine 139mail 139mail is a chinese webmail powered by China Mobile. 15min.lt Lithuanian news portal Chinese web portal 163. It is operated by NetEase, a company which 163.com pioneered the development of Internet in China. 17173.com Website distributing Chinese games. 17u.com Chinese online travel booking website. 20 minutes is a free, daily newspaper available in France, Spain and 20minutes Switzerland. This plugin classifies websites. 24h.com.vn Vietnamese news portal 24ora.com Aruban news portal 24sata.hr Croatian news portal 24SevenOffice 24SevenOffice is a web-based Enterprise resource planning (ERP) systems. 24ur.com Slovenian news portal 2ch.net Japanese adult videos web site 2Shared 2shared is an online space for sharing and storage.
    [Show full text]
  • Informed Content Delivery Across Adaptive Overlay Networks
    Informed Content Delivery Across Adaptive Overlay Networks John Byers Jeffrey Considine Michael Mitzenmacher Stanislav Rost [email protected] [email protected] [email protected] [email protected] Dept. of Computer Science EECS MIT Laboratory for Boston University Harvard University Computer Science Boston, Massachusetts Cambridge, Massachusetts Cambridge, Massachusetts Abstract Categories and Subject Descriptors C.2 [Computer Systems Organization]: Computer- Overlay networks have emerged as a powerful and highly flexible Communication Networks method for delivering content. We study how to optimize through- put of large transfers across richly connected, adaptive overlay net- General Terms works, focusing on the potential of collaborative transfers between Algorithms, Measurement, Performance peers to supplement ongoing downloads. First, we make the case for an erasure-resilient encoding of the content. Using the digital Keywords fountain encoding approach, end-hosts can efficiently reconstruct Overlay, peer-to-peer, content delivery, digital fountain, erasure ¡ the original content of size ¡ from a subset of any symbols drawn correcting code, min-wise summary, Bloom filter, reconciliation, from a large universe of encoded symbols. Such an approach af- collaboration. fords reliability and a substantial degree of application-level flex- ibility, as it seamlessly accommodates connection migration and 1 Introduction parallel transfers while providing resilience to packet loss. How- ever, since the sets of encoded symbols acquired by peers during Consider the problem of distributing a large new file across a downloads may overlap substantially, care must be taken to enable content delivery network of several thousand geographically dis- them to collaborate effectively. Our main contribution is a collec- tributed machines.
    [Show full text]
  • Instart Logic TWITTER LINKEDIN
    Instart Logic TWITTER LINKEDIN MOBILE VIDEO AND APPS WEBSITE Who we are Our advantage Instart Logic is a platform designed to make the delivery of It is a fully responsive platform, offering both flexibility and websites and applications fast, secure and easy. It’s the world’s control. It provides: first endpoint-aware application delivery solution. Performance – Helps improve site-wide performance, especially on mobile through image, code and network Instart’s intelligent architecture provides a new way to optimisation techniques. accelerate web and mobile application performance, based on the user’s specific device, browser, and network conditions. Ad Security – Ability to recover lost advertising revenue from ad-blockers. This new breed of technology goes beyond a traditional Security – Helps protect from harmful bots that flood the site, content delivery network (CDN) to enable businesses to deliver skew data and warp search algorithms and shield from rapid customer-centric website and mobile application Distributed Denial of Service (DDoS), brute-force entry, and experiences. other cyber attacks Agility – Use a DevOps first infrastructure allowed for self-sufficient management and deployment of new content and applications throughout network. Our partnership How does our solution work? Telstra will be using Instart Logic to optimise, monetise and AppSpeed: Instart Logic’s endpoint-aware application delivery deliver managed websites and web applications. Those that are solution provides a new way to accelerate web and mobile application performance. It’s intelligent architecture optimises currently on trial include: images, HTML, JavaScript and other page elements based on • Australian Football League (AFL) each user’s specific device, browser, and network conditions.
    [Show full text]
  • A Peer-To-Peer Internet Measurement Platform and Its Applications in Content Delivery Networks
    A PEER-TO-PEER INTERNET MEASUREMENT PLATFORM AND ITS APPLICATIONS IN CONTENT DELIVERY NETWORKS BY SIPAT TRIUKOSE Submitted in partial fulfillment of the requirements for the degree of Doctor Of Philosophy DISSERTATION ADVISOR: DR. MICHAEL RABINOVICH DEPARTMENT OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCE CASE WESTERN RESERVE UNIVERSITY JANUARY 2014 CASE WESTERN RESERVE UNIVERSITY SCHOOL OF GRADUATE STUDIES We hereby approve the dissertation of SIPAT TRIUKOSE candidate for the Doctor of Philosophy degree *. MICHAEL RABINOVICH TEKIN OZSOYOGLU SHUDONG JIN VIRA CHANKONG MARK ALLMAN (date) December 1st, 2010 *We also certify that written approval has been obtained for any proprietary material contained therein. Contents List of Tables . vi List of Figures . ix List of Abbreviations . x Abstract . xi 1 Introduction 1 1.1 Internet Measurements . 1 1.2 Content Delivery Network (CDN) . 4 1.2.1 Akamai and Limelight . 6 1.2.2 Coral . 7 1.3 Outline . 7 1.4 Acknowledgement . 9 2 Related Work 10 2.1 On-demand Network Measurements . 10 2.2 Content Delivery Network (CDN) Research . 12 2.2.1 Performance Assessment . 12 2.2.2 Security . 13 2.2.3 Performance Improvement . 14 3 DipZoom: Peer-to-Peer Internet Measurement Platform 17 3.1 System Overview . 17 i 3.2 The DipZoom Measuring Point (MP) . 21 3.2.1 MP-Loader, MP-Class, and MP Configurations . 25 3.2.2 Authentication . 30 3.2.3 Keep Alive . 37 3.2.4 Measurement . 39 3.3 The DipZoom Client and API . 43 3.4 Security . 44 3.5 Performance . 47 3.5.1 Scalability: Measuring Point Fan-Out .
    [Show full text]
  • Content Distribution in P2P Systems Manal El Dick, Esther Pacitti
    Content Distribution in P2P Systems Manal El Dick, Esther Pacitti To cite this version: Manal El Dick, Esther Pacitti. Content Distribution in P2P Systems. [Research Report] RR-7138, INRIA. 2009. inria-00439171 HAL Id: inria-00439171 https://hal.inria.fr/inria-00439171 Submitted on 6 Dec 2009 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE Content Distribution in P2P Systems Manal El Dick — Esther Pacitti N° 7138 Décembre 2009 Thème COM apport de recherche ISSN 0249-6399 ISRN INRIA/RR--7138--FR+ENG Content Distribution in P2P Systems∗ Manal El Dick y, Esther Pacittiz Th`emeCOM | Syst`emescommunicants Equipe-Projet´ Atlas Rapport de recherche n° 7138 | D´ecembre 2009 | 63 pages Abstract: The report provides a literature review of the state-of-the-art for content distribution. The report's contributions are of threefold. First, it gives more insight into traditional Content Distribution Networks (CDN), their re- quirements and open issues. Second, it discusses Peer-to-Peer (P2P) systems as a cheap and scalable alternative for CDN and extracts their design challenges. Finally, it evaluates the existing P2P systems dedicated for content distribution according to the identified requirements and challenges.
    [Show full text]
  • Toolkit on Environmental Sustainability for the ICT Sector Toolkit September 2012
    !"#"$%&&'()$*+%(,-."/0%1,-*(2- -------!"#"&*+$,-3*4%1*/%15- .*+%(*#-7(/"1A6()B"1,)/5-C%(,%1+'&- D%1-!"#"$%&&'()$*+%(,-- 6.789:;7!<-=9>37-;!6=7-=7- >9.?8@- Toolkit on environmental sustainability for the ICT !"#"$%&&'()$*+%(,-."/0%1,-*(2- -------!"#"&*+$,-3*4%1*/%15- !"#"$%&&'()$*+%(,-."/0%1,-*(2- sector -------!"#"&*+$,-3*4%1*/%15- .*+%(*#-7(/"1A6()B"1,)/5.*+%(*#-7(/"1A-C%(,%1+'&- 6()B"1,)/5-C%(,%1+'&- D%1-!"#"$%&&'()$*+%(,D%1---!"#"$%&&'()$*+%(,-- 6.789:;7!<-=9>37-;!6=7-=7-6.789:;7!<-=9>37-;!6=7-=7- >9.?8@- >9.?8@- Toolkit on environmental sustainability for the ICT sector Toolkit September 2012 About ITU-T and Climate Change: itu.int/ITU-T/climatechange/ Printed in Switzerland Geneva, 2012 E-mail: [email protected] Photo credits: Shutterstock® itu.int/ITU-T/climatechange/ess Acknowledgements This toolkit was developed by ITU-T with over 50 organizations and ICT companies to establish environmental sustainability requirements for the ICT sector. This toolkit provides ICT organizations with a checklist of sustainability requirements; guiding them in efforts to improve their eco-efficiency, and ensuring fair and transparent sustainability reporting. The toolkit deals with the following aspects of environmental sustainability in ICT organizations: sustainable buildings, sustainable ICT, sustainable products and services, end of life management for ICT equipment, general specifications and an assessment framework for environmental impacts of the ICT sector. The authors would like to thank Jyoti Banerjee (Fronesys) and Cristina Bueti (ITU) who gave up their time to coordinate all comments received and edit the toolkit. Special thanks are due to the contributory organizations of the Toolkit on Environmental Sustainability for the ICT Sector for their helpful review of a prior draft.
    [Show full text]
  • (CDN) Federations How Sps Can Win the Battle for Content-Hungry Consumers
    Point of View Content Delivery Network (CDN) Federations How SPs Can Win the Battle for Content-Hungry Consumers By Scott Puopolo, Marc Latouche, François Le Faucheur, and Jaak Defour As consumers demand ever-greater amounts of high-quality content over the Internet, service providers (SPs) are finding it difficult to increase revenues while containing costs. This is due mainly to two trends: (1) over-the-top (OTT) content providers have outsourced the delivery of content to pure-play content delivery network (CDN) companies, and (2) traffic growth (with no resulting revenue benefit) is increasing network build-out and maintenance costs for SPs. In response to these challenges, many SPs began to utilize CDNs within their own networks. The initial focus was to reduce content-transport costs and improve the quality of content delivery to their own customers. Over time, individual SPs started offering CDN services to OTT content providers as a way to earn extra income from the content flowing over their networks. While this approach has helped, results have been limited. As demand for content continues to increase worldwide, OTTs would rather work with fewer individual companies for the delivery of their content. Given this situation, SPs are now exploring the potential of CDN federations, which the Cisco® Internet Business Solutions Group (IBSG) defines as multi-footprint, open CDN capabilities built from resources owned and operated by autonomous members. CDN federations benefit SPs, content providers, and consumers: ● SPs can lower costs by pooling their resources ● Content providers can reduce business complexity by dealing with fewer companies ● Consumers receive better quality of service (QoS) Given the clear benefits of this approach, Cisco is involved in a number of CDN-related initiatives to accelerate the move to CDN federations.
    [Show full text]
  • Reliable Streaming Media Delivery
    WHITE PAPER Reliable Streaming Media Delivery www.ixiacom.com 915-1777-01 Rev B January 2014 2 Table of Contents Overview ................................................................................................................ 4 Business Trends ..................................................................................................... 6 Technology Trends ................................................................................................. 7 Building in Reliability .............................................................................................. 8 Ixia’s Test Solutions ............................................................................................... 9 Streaming Media Test Scenarios ........................................................................... 11 Conclusion .............................................................................................................13 3 Overview Streaming media is an evolving set of technologies that deliver multimedia content over the Internet and private networks. A number of service businesses are dedicated to streaming media delivery, including YouTube, Brightcove, Vimeo, Metacafe, BBC iPlayer, and Hulu. Streaming video delivery is growing dramatically: according to the comScore Video Metrix1, Americans viewed a significantly higher number of videos in 2009 than in 2008 (up 19%) due to both increased content consumption and the growing number of video ads delivered. In January of 2010, more than 170 million viewers watched videos
    [Show full text]
  • AT&T Content Delivery Network
    Product Brief AT&T Content Delivery Network Accelerate, optimize, and help protect your apps and content Today, we are seeing massive growth in the To improve performance, AT&T CDN offers: Potential Benefits number of users, devices, apps, and sources • Mobile optimization of content that rely on the Web for delivery of • Lower capital investments and data, images, apps, and video. • Dynamic site acceleration on-going costs To meet this demand, today and tomorrow, • Dynamic Site Acceleration for • Front-end optimization speeding dynamic, personalized we need to accelerate the delivery of content to end users digital assets – from web page content and Improve media delivery services • Rapid delivery of digital assets for applications to movies, live events, and large Streaming video, live or on-demand, is an software and media files. We also need to higher customer satisfaction and increasingly important component of many engagement optimize and personalize those assets for businesses. With AT&T Content Delivery • Reduced site abandonment growing volumes of mobile users who want Network, you have a service and a partner to view and interact with rich content from to help coordinate, support, and manage a • Powerful management and reporting tools to control anywhere, using any device. library of pre-existing video or live events that resources, enforce policies and In short, we need to deliver a flexible, demand optimized streaming to ensure the increase value best possible viewing experience. responsive, and engaging web experience to • Support for IPv6 without attract and keep customer attention, loyalty, To improve media delivery, AT&T CDN offers: upgrading your website and business.
    [Show full text]
  • Installation and Operation Guide
    HELO H.264 Streaming and Recording Encoder Installation and Operation Guide Version 4.0 Published May 24, 2019 Notices Trademarks AJA® and Because it matters.® are registered trademarks of AJA Video Systems, Inc. for use with most AJA products. AJA™ is a trademark of AJA Video Systems, Inc. for use with recorder, router, software and camera products. Because it matters.™ is a trademark of AJA Video Systems, Inc. for use with camera products. CION®, Corvid Ultra®, lo®, Ki Pro®, KONA®, KUMO®, ROI® and T-Tap® are registered trademarks of AJA Video Systems, Inc. AJA Control Room™, KiStor™, Science of the Beautiful™, TruScale™, TruZoom™, V2Analog™ and V2Digital™ are trademarks of AJA Video Systems, Inc. All other trademarks are the property of their respective owners. Copyright Copyright © 2019 AJA Video Systems, Inc. All rights reserved. All information in this manual is subject to change without notice. No part of the document may be reproduced or transmitted in any form, or by any means, electronic or mechanical, including photocopying or recording, without the express written permission of AJA Video Systems, Inc. Contacting AJA Support When calling for support, have all information at hand prior to calling. To contact AJA for sales or support, use any of the following methods: Telephone +1.530.271.3190 FAX +1.530.271.3140 Web https://www.aja.com Support Email [email protected] Sales Email [email protected] HELO H.264 Streaming and Recording Encoder v4.0 2 www.aja.com Contents Notices . .2 Trademarks . 2 Copyright . 2 Contacting AJA Support . 2 Chapter 1 – Introduction . .5 Overview.
    [Show full text]
  • Design and Analysis of Adaptive Caching Techniques for Internet Content Delivery
    Dissertation Design and Analysis of Adaptive Caching Techniques for Internet Content Delivery Thesis approved by the Department of Computer Science of the University of Kaiserslautern (TU Kaiserslautern) for the award of the Doctoral Degree Doctor of Engineering (Dr.-Ing.) to Daniel S. Berger Date of the viva : June 8, 2018 Dean : Prof. Dr. Stefan Deßloch PhD committee Chair : Prof. Dr. Pascal Schweitzer Reviewers : Prof. Dr. Jens B. Schmitt Prof. Dr. Florin Ciucu (University of Warwick) Prof. Dr. Mor Harchol-Balter (Carnegie Mellon University) D 386 Abstract Fast Internet content delivery relies on two layers of caches on the request path. Firstly, content delivery networks (CDNs) seek to answer user requests before they traverse slow Internet paths. Secondly, aggregation caches in data centers seek to answer user requests before they traverse slow backend systems. The key challenge in managing these caches is the high variability of object sizes, request patterns, and retrieval latencies. Unfortunately, most existing literature focuses on caching with low (or no) variability in object sizes and ignores the intricacies of data center subsystems. This thesis seeks to fill this gap with three contributions. First, we design a new caching system, called AdaptSize, that is robust under high object size variability. Sec- ond, we derive a method (called Flow-Offline Optimum or FOO) to predict the optimal cache hit ratio under variable object sizes. Third, we design a new caching system, called RobinHood, that exploits variances in retrieval latencies to deliver faster responses to user requests in data centers. The techniques proposed in this thesis significantly improve the performance of CDN and data center caches.
    [Show full text]
  • Resource Allocation and Task Scheduling Optimization in Cloud- Based Content Delivery Networks with Edge Computing
    Southern Methodist University SMU Scholar Engineering Management, Information, and Engineering Management, Information, and Systems Research Theses and Dissertations Systems Fall 12-2019 Resource Allocation and Task Scheduling Optimization in Cloud- Based Content Delivery Networks with Edge Computing Yang Peng Southern Methodist University, [email protected] Follow this and additional works at: https://scholar.smu.edu/engineering_managment_etds Part of the Digital Communications and Networking Commons, Operational Research Commons, Systems and Communications Commons, and the Systems Engineering Commons Recommended Citation Peng, Yang, "Resource Allocation and Task Scheduling Optimization in Cloud-Based Content Delivery Networks with Edge Computing" (2019). Engineering Management, Information, and Systems Research Theses and Dissertations. 6. https://scholar.smu.edu/engineering_managment_etds/6 This Dissertation is brought to you for free and open access by the Engineering Management, Information, and Systems at SMU Scholar. It has been accepted for inclusion in Engineering Management, Information, and Systems Research Theses and Dissertations by an authorized administrator of SMU Scholar. For more information, please visit http://digitalrepository.smu.edu. RESOURCE ALLOCATION AND TASK SCHEDULING OPTIMIZATION IN CLOUD-BASED CONTENT DELIVERY NETWORKS WITH EDGE COMPUTING Approved by: Dr. Richard Barr Dr. Eli Olinick Dr. Jeff Tian Dr. Harsha Gangammanavar Dr. John Medellin RESOURCE ALLOCATION AND TASK SCHEDULING OPTIMIZATION IN CLOUD-BASED CONTENT
    [Show full text]