Monetizing the Edge with Content Delivery Networks CONTENTS INTRODUCTION

Total Page:16

File Type:pdf, Size:1020Kb

Monetizing the Edge with Content Delivery Networks CONTENTS INTRODUCTION MONETIZING THE EDGE WITH CONTENT DELIVERY NETWORKS CONTENTS INTRODUCTION Introduction ..................................................................... 2 Edge computing is increasingly prevalent and will become even more so as the use of 5G and Internet of Things (IoT) devices enter Why are Content Delivery Networks important? ..... 3 the mainstream. By locating key data processing functions closer to What are the key CDN challenges? ............................. 4 the edge, there’s no need to transmit data to the cloud and back for What are Intel's solutions for CDN? ............................ 5 analysis, so latency is less of an issue. Also, since edge data centers are increasingly self-sufficient, it is still possible to keep services up and Memory, bandwidth and storage .................................... 5 running even when other parts of the infrastructure are down. Accelerators ............................................................................ 6 Sixty nine percent of service providers already have plans to deploy Ecosystem acceleration ..................................................... 6 multi-access edge computing (MEC)i. Yet the majority are still trying Open Visual Cloud ............................................................... 6 to figure out the golden use case that will monetize their investment. There’s a lot of talk about cloud gaming, 360-degree virtual reality (VR), Intel® Select Solutions ....................................................... 7 and immersive media, but the real use case driving return on investment Conclusion ........................................................................ 8 (ROI) today is content delivery networks (CDNs). In this eguide you’ll discover why CDNs are becoming increasingly lucrative, the key challenges associated with CDN delivery, and how an integrated, end-to-end computing infrastructure optimized for media workloads can address these. WHY ARE CONTENT DELIVERY NETWORKS IMPORTANT? Media is transforming. Thanks to our insatiable appetite for live and on-demand video, the global video streaming market will be worth USD 102B by 2023ii. Consumers expect this web and video content anytime, anywhere and on any device. And as the content gets richer, more localized, personalized, interactive and immersive, the pressure is on for service providers to deliver more than just ‘media’ content to their customers; they must deliver Visual Cloud experiences. These range from media processing and delivery, through to new services such as media analytics and dynamic ad insertion. CDNs enable service providers to deploy these services at the edge of the network, which means they can deliver richer content to widely distributed, and often mobile, consumers. WHAT ARE THE KEY CDN CHALLENGES? 1. Web content: With rapid rise in encrypted web traffic, more businesses are using encryption as the primary method of securing web content. CDN providers are required to match the growing levels of data from CDN USE CASE CHALLENGES secure sockets layer (SSL)/ transport layer service (TLS) encrypted websites. This requires cryptography to be done by the server’s CPU located in CDN infrastructure. Increasing the throughput requires CDN SSD • Need more cores for security encryption/ providers to upgrade those servers to the latest processor technology. crypto acceleration 2. Long-tail content: With growth in over-the-top (OTT) services and Transparent caching video traffic, large Internet traffic spikes are everyday occurrences. To overcome this challenge, many CDN providers are transitioning to higher connectivity of 100G per cache node to scale their node level • Maximizing available throughput performance. For long-tail video content such as video-on-demand SSD • Overprovisioning of capacity to meet (VOD) and cloud digital video recorder (DVR) usages, this requires CDN HDD throughput demand providers to transition to high throughput storage such as non-volatile • Failure rates with HDD memory express (NVMe)-based storage devices to be able to fully Long-tail content utilize the available network throughput. 3. Live streaming: One of the other challenges faced by CDN providers Memory • Exponential rise in live streaming traffic is with live linear content streaming. The live streaming video market • Lower glass-to-glass latency is growing at an alarming rate and since the content is immediately • Need for more memory, low latency caching distributed to the end users, large memory capacity is needed to Live streaming and hot VOD caching buffer each of the many independent streams a CDN server needs to handle. Unfortunately, large capacity dual in-line memory modules (DIMMs) are expensive. Figure 1: Key CDN challenges. These key use case specific challenges are shown in figure 1. WHAT ARE INTEL’s solUTIONS FOR CDN? ACCELERATORS Intel offers comprehensive, interoperable end-to-end • High-density accelerators like those from Celestica – see encoding, low latency, competitive 3D performance, and media solutions to help service providers better meet the figure 2 – can help to maximize performance on edge nodes multiple Windows games per card, VCAC-R can handle four aforementioned CDN challenges so that they can better Windows game streams at 1080p 30FPS, and at 720p 30FPS • First, the Intel® Visual Cloud Accelerator Card – Analytics serve their existing customers, as well as extend their CDN to can handle 20 Android game streams (VCAC-A) is optimized for the highest density offload support emerging edge cloud use cases. acceleration for use in network edge servers. The new • As an alternative to upgrading to the latest processor acceleration solution combines both on-card decode and technology to manage encryption throughput for secure MEMORY, BANDWIDTH AND STORAGE video inference acceleration, along with high efficiency, FP16 web content, Intel® QuickAssist Technology (Intel® QAT) • Intel® QLC 3D NAND SSDs are ideally suited for high- precision that can manage 24 streams at 1080p 30FPS, up cards help to offload cryptography from the CPU to expand capacity, high-volume use cases such as VOD and cloud DVR to 144 streams per server with six cards its SSL/TLS throughput, while being cost efficient. For inline SSL/TLS processing, CDN providers can further utilize the • Intel® Optane™ SSDs provide extremely high reliability and • Second, the Intel® Visual Cloud Accelerator Card – Render Intel® FPGA Programmable Acceleration Card (Intel® FPGA performance compared to hard disk drives (HDDs) and (VCAC-R) is optimized for cloud gaming, graphics, VR, and PAC) N300 standard SSDs. These drives are best suited for hot content virtual desktops. With high-performance rendering and use cases • Intel® Optane™ DC persistent memory provides a bigger memory footprint at a low total cost of ownership (TCO) and faster access to storage by bringing data closer to the Density-Optimized Workload Optimized Performance/TCO CPU. This technology helps service providers meet growing RENDERING ANALYTICS Low Power demand for latency-sensitive use cases such as live and linear streaming • High 3D performance at competitive TCO • Optimized for high-density edge analytics • 2nd generation Intel® Xeon® Scalable processors support • Low latency rendering and encoding • Up to 24 real-time streams on board demanding CDN workloads, with two 48-core sockets, 12 • Multiple windows games per card • Intel® Movidius™ Myriad™ X VPU memory channels per socket, high-speed interconnect and cache optimizations, and balanced I/O to meet the demands of high-performance storage solutions • Extending intelligence to the edge, Intel® Xeon® D processors support high-density, single-socket network, storage and cloud edge computing solutions with a range of integrated security, network and acceleration capabilities Figure 2: Visual Cloud Accelerator cards from Celestica. EcOSYSTEM ACCELERATION • Intel is working to accelerate the CDN ecosystem through collaboration with communication and cloud service providers; workload characterization and performance turning; and hardware and software optimizations with original equipment manufacturers (OEMs), systems integrators (SIs) and independent software vendors (ISVs) – see figure 3 CUSTOMER COLLABORATION WORKLOAD CHARACTERIZATION AND PERFORMANCE TUNING OPEN VISUAL CLOUD Replication of customer CDN environment in Performance and security optimizations • To help strengthen the ecosystem and Intel Labs (3 labs located in AZ, MA, PRC) provide ready access to the building blocks Guidance on best practices for CDN deployments and pipelines for cost-effective Visual Cloud Engagements with telco CDN providers, (targeted white papers, sizing guides, case studies innovations, Intel has set up the Open Visual OTT providers, next wave CSPs and detailed documentation) Cloud project. It provides availability of high performance, high quality, open source, validated building blocks across encode, decode, inference, and rendering – see figure 4, as well as reference pipelines that HW AND SW OPTIMIZATIONS support visual cloud workloads. The goal is to minimize barriers to innovation for quickly Join testing and optimization with OEMs, SIs and ISVs and easily creating and monetizing Visual Cloud services. Support for familiar industry standard frameworks use the larger open Validated solution with CDN stack improvements (Linux, NGINX, ATS) source community and include media (FFMPEG and GStreamer), AI (TensorFlow, Caffe, MXNet, ONNX, Kaldi), and graphics (OpenGL, DirectX) Figure 3: Characterization and
Recommended publications
  • Uila Supported Apps
    Uila Supported Applications and Protocols updated Oct 2020 Application/Protocol Name Full Description 01net.com 01net website, a French high-tech news site. 050 plus is a Japanese embedded smartphone application dedicated to 050 plus audio-conferencing. 0zz0.com 0zz0 is an online solution to store, send and share files 10050.net China Railcom group web portal. This protocol plug-in classifies the http traffic to the host 10086.cn. It also 10086.cn classifies the ssl traffic to the Common Name 10086.cn. 104.com Web site dedicated to job research. 1111.com.tw Website dedicated to job research in Taiwan. 114la.com Chinese web portal operated by YLMF Computer Technology Co. Chinese cloud storing system of the 115 website. It is operated by YLMF 115.com Computer Technology Co. 118114.cn Chinese booking and reservation portal. 11st.co.kr Korean shopping website 11st. It is operated by SK Planet Co. 1337x.org Bittorrent tracker search engine 139mail 139mail is a chinese webmail powered by China Mobile. 15min.lt Lithuanian news portal Chinese web portal 163. It is operated by NetEase, a company which 163.com pioneered the development of Internet in China. 17173.com Website distributing Chinese games. 17u.com Chinese online travel booking website. 20 minutes is a free, daily newspaper available in France, Spain and 20minutes Switzerland. This plugin classifies websites. 24h.com.vn Vietnamese news portal 24ora.com Aruban news portal 24sata.hr Croatian news portal 24SevenOffice 24SevenOffice is a web-based Enterprise resource planning (ERP) systems. 24ur.com Slovenian news portal 2ch.net Japanese adult videos web site 2Shared 2shared is an online space for sharing and storage.
    [Show full text]
  • Informed Content Delivery Across Adaptive Overlay Networks
    Informed Content Delivery Across Adaptive Overlay Networks John Byers Jeffrey Considine Michael Mitzenmacher Stanislav Rost [email protected] [email protected] [email protected] [email protected] Dept. of Computer Science EECS MIT Laboratory for Boston University Harvard University Computer Science Boston, Massachusetts Cambridge, Massachusetts Cambridge, Massachusetts Abstract Categories and Subject Descriptors C.2 [Computer Systems Organization]: Computer- Overlay networks have emerged as a powerful and highly flexible Communication Networks method for delivering content. We study how to optimize through- put of large transfers across richly connected, adaptive overlay net- General Terms works, focusing on the potential of collaborative transfers between Algorithms, Measurement, Performance peers to supplement ongoing downloads. First, we make the case for an erasure-resilient encoding of the content. Using the digital Keywords fountain encoding approach, end-hosts can efficiently reconstruct Overlay, peer-to-peer, content delivery, digital fountain, erasure ¡ the original content of size ¡ from a subset of any symbols drawn correcting code, min-wise summary, Bloom filter, reconciliation, from a large universe of encoded symbols. Such an approach af- collaboration. fords reliability and a substantial degree of application-level flex- ibility, as it seamlessly accommodates connection migration and 1 Introduction parallel transfers while providing resilience to packet loss. How- ever, since the sets of encoded symbols acquired by peers during Consider the problem of distributing a large new file across a downloads may overlap substantially, care must be taken to enable content delivery network of several thousand geographically dis- them to collaborate effectively. Our main contribution is a collec- tributed machines.
    [Show full text]
  • Instart Logic TWITTER LINKEDIN
    Instart Logic TWITTER LINKEDIN MOBILE VIDEO AND APPS WEBSITE Who we are Our advantage Instart Logic is a platform designed to make the delivery of It is a fully responsive platform, offering both flexibility and websites and applications fast, secure and easy. It’s the world’s control. It provides: first endpoint-aware application delivery solution. Performance – Helps improve site-wide performance, especially on mobile through image, code and network Instart’s intelligent architecture provides a new way to optimisation techniques. accelerate web and mobile application performance, based on the user’s specific device, browser, and network conditions. Ad Security – Ability to recover lost advertising revenue from ad-blockers. This new breed of technology goes beyond a traditional Security – Helps protect from harmful bots that flood the site, content delivery network (CDN) to enable businesses to deliver skew data and warp search algorithms and shield from rapid customer-centric website and mobile application Distributed Denial of Service (DDoS), brute-force entry, and experiences. other cyber attacks Agility – Use a DevOps first infrastructure allowed for self-sufficient management and deployment of new content and applications throughout network. Our partnership How does our solution work? Telstra will be using Instart Logic to optimise, monetise and AppSpeed: Instart Logic’s endpoint-aware application delivery deliver managed websites and web applications. Those that are solution provides a new way to accelerate web and mobile application performance. It’s intelligent architecture optimises currently on trial include: images, HTML, JavaScript and other page elements based on • Australian Football League (AFL) each user’s specific device, browser, and network conditions.
    [Show full text]
  • A Peer-To-Peer Internet Measurement Platform and Its Applications in Content Delivery Networks
    A PEER-TO-PEER INTERNET MEASUREMENT PLATFORM AND ITS APPLICATIONS IN CONTENT DELIVERY NETWORKS BY SIPAT TRIUKOSE Submitted in partial fulfillment of the requirements for the degree of Doctor Of Philosophy DISSERTATION ADVISOR: DR. MICHAEL RABINOVICH DEPARTMENT OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCE CASE WESTERN RESERVE UNIVERSITY JANUARY 2014 CASE WESTERN RESERVE UNIVERSITY SCHOOL OF GRADUATE STUDIES We hereby approve the dissertation of SIPAT TRIUKOSE candidate for the Doctor of Philosophy degree *. MICHAEL RABINOVICH TEKIN OZSOYOGLU SHUDONG JIN VIRA CHANKONG MARK ALLMAN (date) December 1st, 2010 *We also certify that written approval has been obtained for any proprietary material contained therein. Contents List of Tables . vi List of Figures . ix List of Abbreviations . x Abstract . xi 1 Introduction 1 1.1 Internet Measurements . 1 1.2 Content Delivery Network (CDN) . 4 1.2.1 Akamai and Limelight . 6 1.2.2 Coral . 7 1.3 Outline . 7 1.4 Acknowledgement . 9 2 Related Work 10 2.1 On-demand Network Measurements . 10 2.2 Content Delivery Network (CDN) Research . 12 2.2.1 Performance Assessment . 12 2.2.2 Security . 13 2.2.3 Performance Improvement . 14 3 DipZoom: Peer-to-Peer Internet Measurement Platform 17 3.1 System Overview . 17 i 3.2 The DipZoom Measuring Point (MP) . 21 3.2.1 MP-Loader, MP-Class, and MP Configurations . 25 3.2.2 Authentication . 30 3.2.3 Keep Alive . 37 3.2.4 Measurement . 39 3.3 The DipZoom Client and API . 43 3.4 Security . 44 3.5 Performance . 47 3.5.1 Scalability: Measuring Point Fan-Out .
    [Show full text]
  • Content Distribution in P2P Systems Manal El Dick, Esther Pacitti
    Content Distribution in P2P Systems Manal El Dick, Esther Pacitti To cite this version: Manal El Dick, Esther Pacitti. Content Distribution in P2P Systems. [Research Report] RR-7138, INRIA. 2009. inria-00439171 HAL Id: inria-00439171 https://hal.inria.fr/inria-00439171 Submitted on 6 Dec 2009 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE Content Distribution in P2P Systems Manal El Dick — Esther Pacitti N° 7138 Décembre 2009 Thème COM apport de recherche ISSN 0249-6399 ISRN INRIA/RR--7138--FR+ENG Content Distribution in P2P Systems∗ Manal El Dick y, Esther Pacittiz Th`emeCOM | Syst`emescommunicants Equipe-Projet´ Atlas Rapport de recherche n° 7138 | D´ecembre 2009 | 63 pages Abstract: The report provides a literature review of the state-of-the-art for content distribution. The report's contributions are of threefold. First, it gives more insight into traditional Content Distribution Networks (CDN), their re- quirements and open issues. Second, it discusses Peer-to-Peer (P2P) systems as a cheap and scalable alternative for CDN and extracts their design challenges. Finally, it evaluates the existing P2P systems dedicated for content distribution according to the identified requirements and challenges.
    [Show full text]
  • Toolkit on Environmental Sustainability for the ICT Sector Toolkit September 2012
    !"#"$%&&'()$*+%(,-."/0%1,-*(2- -------!"#"&*+$,-3*4%1*/%15- .*+%(*#-7(/"1A6()B"1,)/5-C%(,%1+'&- D%1-!"#"$%&&'()$*+%(,-- 6.789:;7!<-=9>37-;!6=7-=7- >9.?8@- Toolkit on environmental sustainability for the ICT !"#"$%&&'()$*+%(,-."/0%1,-*(2- -------!"#"&*+$,-3*4%1*/%15- !"#"$%&&'()$*+%(,-."/0%1,-*(2- sector -------!"#"&*+$,-3*4%1*/%15- .*+%(*#-7(/"1A6()B"1,)/5.*+%(*#-7(/"1A-C%(,%1+'&- 6()B"1,)/5-C%(,%1+'&- D%1-!"#"$%&&'()$*+%(,D%1---!"#"$%&&'()$*+%(,-- 6.789:;7!<-=9>37-;!6=7-=7-6.789:;7!<-=9>37-;!6=7-=7- >9.?8@- >9.?8@- Toolkit on environmental sustainability for the ICT sector Toolkit September 2012 About ITU-T and Climate Change: itu.int/ITU-T/climatechange/ Printed in Switzerland Geneva, 2012 E-mail: [email protected] Photo credits: Shutterstock® itu.int/ITU-T/climatechange/ess Acknowledgements This toolkit was developed by ITU-T with over 50 organizations and ICT companies to establish environmental sustainability requirements for the ICT sector. This toolkit provides ICT organizations with a checklist of sustainability requirements; guiding them in efforts to improve their eco-efficiency, and ensuring fair and transparent sustainability reporting. The toolkit deals with the following aspects of environmental sustainability in ICT organizations: sustainable buildings, sustainable ICT, sustainable products and services, end of life management for ICT equipment, general specifications and an assessment framework for environmental impacts of the ICT sector. The authors would like to thank Jyoti Banerjee (Fronesys) and Cristina Bueti (ITU) who gave up their time to coordinate all comments received and edit the toolkit. Special thanks are due to the contributory organizations of the Toolkit on Environmental Sustainability for the ICT Sector for their helpful review of a prior draft.
    [Show full text]
  • (CDN) Federations How Sps Can Win the Battle for Content-Hungry Consumers
    Point of View Content Delivery Network (CDN) Federations How SPs Can Win the Battle for Content-Hungry Consumers By Scott Puopolo, Marc Latouche, François Le Faucheur, and Jaak Defour As consumers demand ever-greater amounts of high-quality content over the Internet, service providers (SPs) are finding it difficult to increase revenues while containing costs. This is due mainly to two trends: (1) over-the-top (OTT) content providers have outsourced the delivery of content to pure-play content delivery network (CDN) companies, and (2) traffic growth (with no resulting revenue benefit) is increasing network build-out and maintenance costs for SPs. In response to these challenges, many SPs began to utilize CDNs within their own networks. The initial focus was to reduce content-transport costs and improve the quality of content delivery to their own customers. Over time, individual SPs started offering CDN services to OTT content providers as a way to earn extra income from the content flowing over their networks. While this approach has helped, results have been limited. As demand for content continues to increase worldwide, OTTs would rather work with fewer individual companies for the delivery of their content. Given this situation, SPs are now exploring the potential of CDN federations, which the Cisco® Internet Business Solutions Group (IBSG) defines as multi-footprint, open CDN capabilities built from resources owned and operated by autonomous members. CDN federations benefit SPs, content providers, and consumers: ● SPs can lower costs by pooling their resources ● Content providers can reduce business complexity by dealing with fewer companies ● Consumers receive better quality of service (QoS) Given the clear benefits of this approach, Cisco is involved in a number of CDN-related initiatives to accelerate the move to CDN federations.
    [Show full text]
  • Reliable Streaming Media Delivery
    WHITE PAPER Reliable Streaming Media Delivery www.ixiacom.com 915-1777-01 Rev B January 2014 2 Table of Contents Overview ................................................................................................................ 4 Business Trends ..................................................................................................... 6 Technology Trends ................................................................................................. 7 Building in Reliability .............................................................................................. 8 Ixia’s Test Solutions ............................................................................................... 9 Streaming Media Test Scenarios ........................................................................... 11 Conclusion .............................................................................................................13 3 Overview Streaming media is an evolving set of technologies that deliver multimedia content over the Internet and private networks. A number of service businesses are dedicated to streaming media delivery, including YouTube, Brightcove, Vimeo, Metacafe, BBC iPlayer, and Hulu. Streaming video delivery is growing dramatically: according to the comScore Video Metrix1, Americans viewed a significantly higher number of videos in 2009 than in 2008 (up 19%) due to both increased content consumption and the growing number of video ads delivered. In January of 2010, more than 170 million viewers watched videos
    [Show full text]
  • AT&T Content Delivery Network
    Product Brief AT&T Content Delivery Network Accelerate, optimize, and help protect your apps and content Today, we are seeing massive growth in the To improve performance, AT&T CDN offers: Potential Benefits number of users, devices, apps, and sources • Mobile optimization of content that rely on the Web for delivery of • Lower capital investments and data, images, apps, and video. • Dynamic site acceleration on-going costs To meet this demand, today and tomorrow, • Dynamic Site Acceleration for • Front-end optimization speeding dynamic, personalized we need to accelerate the delivery of content to end users digital assets – from web page content and Improve media delivery services • Rapid delivery of digital assets for applications to movies, live events, and large Streaming video, live or on-demand, is an software and media files. We also need to higher customer satisfaction and increasingly important component of many engagement optimize and personalize those assets for businesses. With AT&T Content Delivery • Reduced site abandonment growing volumes of mobile users who want Network, you have a service and a partner to view and interact with rich content from to help coordinate, support, and manage a • Powerful management and reporting tools to control anywhere, using any device. library of pre-existing video or live events that resources, enforce policies and In short, we need to deliver a flexible, demand optimized streaming to ensure the increase value best possible viewing experience. responsive, and engaging web experience to • Support for IPv6 without attract and keep customer attention, loyalty, To improve media delivery, AT&T CDN offers: upgrading your website and business.
    [Show full text]
  • Installation and Operation Guide
    HELO H.264 Streaming and Recording Encoder Installation and Operation Guide Version 4.0 Published May 24, 2019 Notices Trademarks AJA® and Because it matters.® are registered trademarks of AJA Video Systems, Inc. for use with most AJA products. AJA™ is a trademark of AJA Video Systems, Inc. for use with recorder, router, software and camera products. Because it matters.™ is a trademark of AJA Video Systems, Inc. for use with camera products. CION®, Corvid Ultra®, lo®, Ki Pro®, KONA®, KUMO®, ROI® and T-Tap® are registered trademarks of AJA Video Systems, Inc. AJA Control Room™, KiStor™, Science of the Beautiful™, TruScale™, TruZoom™, V2Analog™ and V2Digital™ are trademarks of AJA Video Systems, Inc. All other trademarks are the property of their respective owners. Copyright Copyright © 2019 AJA Video Systems, Inc. All rights reserved. All information in this manual is subject to change without notice. No part of the document may be reproduced or transmitted in any form, or by any means, electronic or mechanical, including photocopying or recording, without the express written permission of AJA Video Systems, Inc. Contacting AJA Support When calling for support, have all information at hand prior to calling. To contact AJA for sales or support, use any of the following methods: Telephone +1.530.271.3190 FAX +1.530.271.3140 Web https://www.aja.com Support Email [email protected] Sales Email [email protected] HELO H.264 Streaming and Recording Encoder v4.0 2 www.aja.com Contents Notices . .2 Trademarks . 2 Copyright . 2 Contacting AJA Support . 2 Chapter 1 – Introduction . .5 Overview.
    [Show full text]
  • Design and Analysis of Adaptive Caching Techniques for Internet Content Delivery
    Dissertation Design and Analysis of Adaptive Caching Techniques for Internet Content Delivery Thesis approved by the Department of Computer Science of the University of Kaiserslautern (TU Kaiserslautern) for the award of the Doctoral Degree Doctor of Engineering (Dr.-Ing.) to Daniel S. Berger Date of the viva : June 8, 2018 Dean : Prof. Dr. Stefan Deßloch PhD committee Chair : Prof. Dr. Pascal Schweitzer Reviewers : Prof. Dr. Jens B. Schmitt Prof. Dr. Florin Ciucu (University of Warwick) Prof. Dr. Mor Harchol-Balter (Carnegie Mellon University) D 386 Abstract Fast Internet content delivery relies on two layers of caches on the request path. Firstly, content delivery networks (CDNs) seek to answer user requests before they traverse slow Internet paths. Secondly, aggregation caches in data centers seek to answer user requests before they traverse slow backend systems. The key challenge in managing these caches is the high variability of object sizes, request patterns, and retrieval latencies. Unfortunately, most existing literature focuses on caching with low (or no) variability in object sizes and ignores the intricacies of data center subsystems. This thesis seeks to fill this gap with three contributions. First, we design a new caching system, called AdaptSize, that is robust under high object size variability. Sec- ond, we derive a method (called Flow-Offline Optimum or FOO) to predict the optimal cache hit ratio under variable object sizes. Third, we design a new caching system, called RobinHood, that exploits variances in retrieval latencies to deliver faster responses to user requests in data centers. The techniques proposed in this thesis significantly improve the performance of CDN and data center caches.
    [Show full text]
  • Resource Allocation and Task Scheduling Optimization in Cloud- Based Content Delivery Networks with Edge Computing
    Southern Methodist University SMU Scholar Engineering Management, Information, and Engineering Management, Information, and Systems Research Theses and Dissertations Systems Fall 12-2019 Resource Allocation and Task Scheduling Optimization in Cloud- Based Content Delivery Networks with Edge Computing Yang Peng Southern Methodist University, [email protected] Follow this and additional works at: https://scholar.smu.edu/engineering_managment_etds Part of the Digital Communications and Networking Commons, Operational Research Commons, Systems and Communications Commons, and the Systems Engineering Commons Recommended Citation Peng, Yang, "Resource Allocation and Task Scheduling Optimization in Cloud-Based Content Delivery Networks with Edge Computing" (2019). Engineering Management, Information, and Systems Research Theses and Dissertations. 6. https://scholar.smu.edu/engineering_managment_etds/6 This Dissertation is brought to you for free and open access by the Engineering Management, Information, and Systems at SMU Scholar. It has been accepted for inclusion in Engineering Management, Information, and Systems Research Theses and Dissertations by an authorized administrator of SMU Scholar. For more information, please visit http://digitalrepository.smu.edu. RESOURCE ALLOCATION AND TASK SCHEDULING OPTIMIZATION IN CLOUD-BASED CONTENT DELIVERY NETWORKS WITH EDGE COMPUTING Approved by: Dr. Richard Barr Dr. Eli Olinick Dr. Jeff Tian Dr. Harsha Gangammanavar Dr. John Medellin RESOURCE ALLOCATION AND TASK SCHEDULING OPTIMIZATION IN CLOUD-BASED CONTENT
    [Show full text]