Speeding up Web Page Loads with Shandian

Total Page:16

File Type:pdf, Size:1020Kb

Speeding up Web Page Loads with Shandian Speeding up Web Page Loads with Shandian Xiao Sophia Wang and Arvind Krishnamurthy, University of Washington; David Wetherall, University of Washington and Google https://www.usenix.org/conference/nsdi16/technical-sessions/presentation/wang This paper is included in the Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI ’16). March 16–18, 2016 • Santa Clara, CA, USA ISBN 978-1-931971-29-4 Open access to the Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI ’16) is sponsored by USENIX. Speeding up Web Page Loads with Shandian Xiao Sophia Wang∗, Arvind Krishnamurthy∗, and David Wetherall∗† Abstract pages use JavaScript libraries such as jQuery [21] or in- Web page loads are slow due to intrinsic inefficiencies clude large customized JavaScript code in order to sup- in the page load process. Our study shows that the in- port a high degree of user interactivity. The result is that a efficiencies are attributable not only to the contents and large portion of the code conveyed to a browser is never structure of the Web pages (e.g., three-fourths of the CSS used on a page or is only used when a user triggers an resources are not used during the initial page load) but action. The second inefficiency stems from how the dif- also the way that pages are loaded (e.g., 15% of page load ferent stages of the page load process are scheduled to times are spent waiting for parsing-blocking resources to ensure semantic correctness in the presence of concur- be loaded). rent access to shared resources. This results in limited To address these inefficiencies, this paper presents overlap between computation and network transfer, thus Shandian (which means lightening in Chinese) that re- increasing PLT. The third and related inefficiency is that structures the page load process to speed up page loads. many resources included in a Web page are often loaded Shandian exercises control over what portions of the sequentially due to the complex dependencies in the page page gets communicated and in what order so that the ini- load process, and this results in sub-optimal use of the tial page load is optimized. Unlike previous techniques, network and increased PLTs. Shandian works on demand without requiring a train- Reducing PLT is hard given these inefficiencies. Hu- ing period, is compatible with existing latency-reducing man inspection is not ideal since there is no guaran- techniques (e.g., caching and CDNs), supports security tee that Web developers adhere to the ever-changing features that enforce same-origin policies, and does not best practices prescribed by experts [35]. Thus, it is impose additional privacy risks. Our evaluations show widely believed that the inefficiencies should be trans- that Shandian reduces page load times by more than parently mitigated by automated tools and techniques. half for both mobile phones and desktops while incur- Many previously proposed techniques focus on improv- ring modest overheads to data usage. ing the network transfer times. For example, techniques such as DNS pre-resolution [22], TCP pre-connect [19], 1 Introduction and TCP fast open [28] reduce latencies, and the SPDY Web pages have become the de-facto standard for bil- protocol improves network efficiency at the application lions of users to get access to the Internet. The end- layer [32]. Other techniques lower computation costs by to-end Web page load time (PLT) has consequently be- either exploiting parallelism [25, 12] or adding software come a key metric as it affects user experience and thus architecture support [41, 13]. While these techniques are is associated with business revenues [6, 4]. Reports sug- moderately effective at speeding up the individual activ- gest that Shopzilla increased its revenue 12% by reduc- ities corresponding to a page load, they have had limited ing PLT from 6 seconds to 1.2 seconds and that Amazon impact in reducing overall PLT, because they still com- found every 100ms of increase in PLT cost them 1% in municate redundant code, stall in the presence of con- sales [27]. flicting operations, and are constrained by the limited Despite its importance and various attempts to im- parallelism in the page load process. prove PLT, the end-to-end PLT for most pages is still The key and yet unresolved issue with page loads is a few seconds on desktops and more than ten seconds that the page load process is suboptimally prioritized as on mobile devices [9, 39]. This is because modern Web to what portions of a page get loaded and when. In pages are often complex. Previous studies show that this paper, we advocate an approach that precisely pri- Web pages contain more than fifty Web objects on av- oritizes resources that are needed during the initial page erage [9], and exhibit complex inter-dependencies that load (load-time state) and those that are needed only af- result in inefficient utilization of network and compute ter a page is loaded (post-load state). Unlike SPDY (or resources [39]. In our own experiments, we have iden- HTTP/2) server push and Klotski [10], which only pri- tified three types of inefficiencies associated with Web oritize network transfers at the granularity of Web ob- pages and the page load process. The first inefficiency jects, our approach prioritizes both network transfers and comes from the content size of Web pages. Many Web computation at a fine granularity (e.g., HTML elements ∗University of Washington and CSS rules), directly tackling the three inefficiencies †Google Inc. listed above. 1 USENIX Association 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI ’16) 109 A key challenge addressed by our approach is to en- CDNs and security features such as the enforcement sure that we do not break static Web objects (e.g., exter- of same-origin policies. The resulting system is thus nal JavaScript and CSS), because caching and CDNs are both efficient and practical. commonly used to improve PLT. We make design deci- We evaluate Shandian on the top 100 Alexa • sions to send unmodified static contents in the post-load Web pages which have been heavily optimized by state thereby incurring the cost of sending a small por- other technologies. Our evaluations still show that tion of redundant content that is already included in the Shandian reduces PLT by more than half with a rea- load-time state. sonably powerful proxy server on a variety of mobile To deploy this approach transparently to Web pages, settings with varied RTT, bandwidth, CPU power, and we choose a split-browser architecture and fulfill part of memory. For example, Shandian reduces PLT by the page load on a proxy server, which can be either 50% to 60% on a mobile phone with 1GHz CPU and part of the web service itself (e.g., reverse proxies) or 1GB memory by exploiting the compute power of a third-party proxy servers (e.g., Amazon EC2). A proxy proxy server with a multicore 2.4GHz server. Unlike server is set up to preload a Web page up to a time, e.g., many techniques that only improve network or com- when the load event is fired; the preload is expected to be putation, Shandian shows consistent benefits on a fast since it exploits greater compute power at the proxy variety of settings. We also find that the amount of server and since all the resources that would normally re- load-time state is decreased while the total amount of sult in blocking transfers are locally available. When mi- traffic is increased moderately by 1%. grating state (logics that determine a Web page and the In the rest of this paper, we first review the background stage of the page load process) to the client, the proxy of Web pages and the page load process by identify- server prioritizes state needed for the initial page load ing the inefficiencies associated with page loads ( 2). § over state that will be used later, so as to convey critical Next, we present the design of Shandian ( 3) and § information as fast as possible. After all the state is fully its implementations and deployment ( 4). We evaluate § migrated, the user can interact with the page normally as Shandian in 5, discuss in 6, review related work in § § if the page were loaded directly without using a proxy 7, and conclude in 8. § § server. 2 An analysis of page load inefficiencies Note that Opera mini [26] and Amazon Silk [3] also embrace a split-browser architecture but differ in terms This section reviews the background on the Web page load process ( 2.1), identifies three inefficiencies in the of how the rendering process is split between the client § and the proxy server. Their client-side browsers only load process, and quantifies them using a measurement study ( 2.2). handle display, and thus JavaScript evaluation is han- § dled by the proxy server. This process depends on the 2.1 Background: Web page loads network, which is both slow and unreliable in mobile settings [30], and encourages the proxy server to be Web page compositions. A Web page consists of sev- placed near users. We have a fully functioning client-side eral Web objects that can be HTML, JavaScript, CSS, im- browser and encourages the proxy server to be placed ages, and other media such as videos and Flash. HTML near front-end Web servers (e.g., edge POPs) for the is the language (also the root object) that describes a Web most performance gains. page; it uses a markup to define a set of tree-structured el- Our contributions are as follows: ements such as headings, paragraphs, tables, and inputs.
Recommended publications
  • Need for Mobile Speed: a Historical Analysis of Mobile Web Performance
    Need for Mobile Speed: A Historical Analysis of Mobile Web Performance Javad Nejati Meng Luo Nick Nikiforakis Aruna Balasubramanian Stony Brook University Stony Brook University Stony Brook University Stony Brook University [email protected] [email protected] [email protected] [email protected] Abstract—As more and more users rely on their mobile devices The problem, however, is that it is not clear which fac- for the majority of their computing needs, browser vendors are tors contribute to this improvement in performance. Mobile competing for the user’s attention on the mobile platform. As browsers are complex, and several factors affect page perfor- a result, mobile Web page performance has improved over the years. However, it is not clear if these improvements are a result mance. These factors include browser improvements, network of better browsers, optimized Web pages, new platforms, or im- conditions, the device capacity, and the page itself. It is critical proved network conditions. In this work, we conduct a historical to identify the factors that lead to the most improvement in study over 4 years with 8 popular mobile browsers, loading page performance, so that researchers and practitioners can over 250K Web pages, to isolate the effect of different factors determine not only where to focus their attention, but whether on page load improvements. Using a combination of record- and-replay proxies, historical data from the Internet archive, these performance benefits are available to all users who load and specifications about current and past network speeds, we pages on devices and networks with diverse capacities.
    [Show full text]
  • Performance Gains from Web Performance Optimization Case Including the Optimization of Webpage Resources in a Comprehensive Way
    Performance Gains from Web Performance Optimization Case Including the Optimization of Webpage Resources in a Comprehensive Way Juha Vihervaara1, Pekka Loula1 and Tommi Tuominen2 1Pori Campus, Tampere University of Technology, Pohjoisranta 11, 28100 Pori, Finland 2Foredata Oy, Kässäläntie 30, 38200 Sastamala, Finland Keywords: Website, Performance, Optimization. Abstract: Web performance optimization tries to minimize the time in which web pages are downloaded and displayed on the web browser. It also means that the sizes of website resources are usually minimized. By optimizing their websites, organizations can verify the quality of response times on their websites. This increases visitor loyalty and user satisfaction. A fast website is also important for search engine optimization. Minimized resources also cut the energy consumption of the Internet. In spite of the importance of optimization, there has not been so much research work to find out how much the comprehensive optimization of a website can reduce load times and the sizes of web resources. This study presents the results related to an optimization work where all the resources of the website were optimized. The results obtained were very significant. The download size of the front page was reduced by a total of about 80 percent and the downloading time about 60 percent. The server can now handle more than three times as much concurrent users as earlier. 1 INTRODUCTION In spite of the importance of WPO, there has not been so much research work to find out how much Web performance optimization (WPO), or website the comprehensive optimization of a website can optimization, tries to minimize the time in which reduce load times and the sizes of web resources.
    [Show full text]
  • Amazon Silk Developer Guide Amazon Silk Developer Guide
    Amazon Silk Developer Guide Amazon Silk Developer Guide Amazon Silk: Developer Guide Copyright © 2015 Amazon Web Services, Inc. and/or its affiliates. All rights reserved. The following are trademarks of Amazon Web Services, Inc.: Amazon, Amazon Web Services Design, AWS, Amazon CloudFront, AWS CloudTrail, AWS CodeDeploy, Amazon Cognito, Amazon DevPay, DynamoDB, ElastiCache, Amazon EC2, Amazon Elastic Compute Cloud, Amazon Glacier, Amazon Kinesis, Kindle, Kindle Fire, AWS Marketplace Design, Mechanical Turk, Amazon Redshift, Amazon Route 53, Amazon S3, Amazon VPC, and Amazon WorkDocs. In addition, Amazon.com graphics, logos, page headers, button icons, scripts, and service names are trademarks, or trade dress of Amazon in the U.S. and/or other countries. Amazon©s trademarks and trade dress may not be used in connection with any product or service that is not Amazon©s, in any manner that is likely to cause confusion among customers, or in any manner that disparages or discredits Amazon. All other trademarks not owned by Amazon are the property of their respective owners, who may or may not be affiliated with, connected to, or sponsored by Amazon. AWS documentation posted on the Alpha server is for internal testing and review purposes only. It is not intended for external customers. Amazon Silk Developer Guide Table of Contents What Is Amazon Silk? .................................................................................................................... 1 Split Browser Architecture ......................................................................................................
    [Show full text]
  • Exploiting Split Browsers for Efficiently Protecting User Data
    Exploiting Split Browsers for Efficiently Protecting User Data Angeliki Zavou, Elias Athanasopoulos, Georgios Portokalidis, and Angelos D. Keromytis Columbia University, New York, NY, USA {azavou,elathan,porto,angelos}@cs.columbia.edu ABSTRACT as the services offered to them. Web browsers have become Offloading complex tasks to a resource-abundant environ- the preferred “portal” to access these services, since they ment like the cloud, can extend the capabilities of resource allow developers to create a uniform interface that is acces- constrained mobile devices, extend battery life, and improve sible from different platforms (PCs, smartphones, tablets, user experience. Split browsing is a new paradigm that etc.), and requires minimal (if any) changes to support new adopts this strategy to improve web browsing on devices like platforms. For the same reason, many mobile applications smartphones and tablets. Split browsers offload computa- (e.g., the NY Times and Facebook apps) simply encapsulate tion to the cloud by design; they are composed by two parts, browsers, acting in essence, as site-specific browsers [24]. Their key role and popularity, their size, and in the case one running on the thin client and one in the cloud. Render- 1 ing takes place primarily in the latter, while a bitmap or a of mobile devices, a growing monoculture, are probably the simplified web page is communicated to the client. Despite main reasons browsers are frequently targeted by attack- its difference with traditional web browsing, split browsing ers [5, 11, 17]. In the past, they have suffered severe attacks still suffers from the same types of threats, such as cross-site that exploit vulnerabilities like buffer overflows [17], which scripting.
    [Show full text]
  • Mobile Browsers Free Download Top 7 Best Browsers for Windows Phone
    mobile browsers free download Top 7 Best Browsers for Windows Phone. Windows Phone ships with Internet Explorer or IE as the default web browser on it, and over a period of time, Microsoft has done a pretty good job with the features on IE, continuously improving it. But, there is still room for improvement as many features are missing on the widely used browser of all time. This is where the third party web browsers come into the picture. There are lots of free and paid web browsers available in the Windows Phone store, and today we will be taking a look at the 7 such best browsers for Windows Phone that you can use as an alternative to Internet Explorer. 1. UC Browser 2. Maxthon Browser 3. Opera Mini Beta 4. Nokia Xpress 5. SurfCube 3D Browser 6. Surfy 7. Aerize Explorer. 1. UC Browser. UC Browser is one of the most best browser for Windows Phone, and one very good thing about the team behind it is that they release quite a lot of regular updates for the browser. It comes with a lot of useful features such as speed dial, Wi-Fi downloading, option to save to SD card, Bluetooth file sharing and more; all this packaged in a good interface makes it even more attractive. You are also allowed to change the browser skin using the options available in the UC Theme Center, and these can also be used as lock screen wallpapers. App size & price : 2.34 MB - 10.18 MB and Free. 2. Maxthon Browser.
    [Show full text]
  • Cdns Extend to Web Performance Optimization and End-To-End Cloud Services 2
    For: Application CDNs Extend To Web Performance Development & Delivery Optimization And End-To-End Cloud Professionals Services by Mark Grannan and Philipp Karcher, July 31, 2014 KEY TAKEAWAYS CDN Services Are Evolving To Tackle Mobile And Dynamic Complexity CDN providers are no longer focused on bit pushing services as those services have become largely commoditized. Vendors in the CDN and digital acceleration market are increasingly focused on web performance optimization techniques to meet dynamic content and mobile needs. Parallel Technology Buying Decisions Blur CDN Boundaries Buying CDN services is no longer simple. Web security, cloud storing and hosting adoption, enterprise app complexity, and web analytics needs all factor into CDN purchasing decisions due to the overlaps. Customers need to understand where the overlaps exist to make smart investments. Match Your Performance Needs Against The CDN Landscape’s Four Segments The four market segments include: traditional CDNs that sell bit pushing as a service and aggregate broader capabilities; telco CDNs that add Internet connectivity to the traditional CDN package; cloud platforms that offer basic CDN features to complement storage and compute; and startups that offer caching (primarily) as a feature and focus on newer web performance techniques. Forrester Research, Inc., 60 Acorn Park Drive, Cambridge, MA 02140 USA Tel: +1 617.613.6000 | Fax: +1 617.613.5000 | www.forrester.com FOR APPLICATION DEVELOPMENT & DELIVERY PROFESSIONALS JULY 31, 2014 CDNs Extend To Web Performance Optimization And End-To- End Cloud Services Market Overview: CDN And Digital Acceleration Services By Mark Grannan and Philipp Karcher with John R. Rymer, Mike Gualtieri, Andre Kindness, Michael Facemire, Stephen Powers, Rick Holland, and Steven Kesler WHY READ THIS REPOrt Content delivery networks (CDNs) have been around for over 20 years, yet intensifying digital performance requirements are forcing CDN providers to evolve.
    [Show full text]
  • Kindle Devices
    Instructions for using Libby on Kindle devices Libby is a collection of ebooks, How to setup Libby: audiobooks and magazines. You can 1) Open the Silk web browser on your have 10 items checked out and 10 Kindle and go to www.libbyapp.com items on hold at one time. 2) When you open the Libby website for the first time, it will ask you if you have a library card. Select “Yes”. Loan periods (you can choose the 3) If you have already installed Libby on length of the loan at checkout): another device, select “Copy from my Ebook – 7, 14 or 21 days other device” and then follow the Audiobook—7, 14 or 21 days instructions. Otherwise, select “I’ll Search for a Library” and then type in Magazines—7, 14 or 21 days Plainfield. From the search results, select eIndiana Digital Consortium Plainfield-Guilford Township Public The Libby app can be installed on: Library. Android mobile devices 4) When it asks you where you use your Apple mobile devices library card, select Plainfield-Guilford Township Public Library. It will then ask Windows 10 computers you to enter your library card number. Type in the number that’s on the back of If you can’t install the Libby app on your Plainfield library card, then select your device, you can access Libby “Sign In”. through your device’s web browser (go 5) After you are signed in, you will see the to www.libbyapp.com). Compatible details for your Linked Card. You will web browsers include: have the option to rename this card.
    [Show full text]
  • Download Kindle Browser for Windows 10 the Best Web Browser for Amazon Fire TV Stick: Firefox Vs
    download kindle browser for windows 10 The Best Web Browser for Amazon Fire TV Stick: Firefox vs. Silk. You probably already know that you can browse the web with Amazon Fire TV and Amazon Fire TV Stick. But what's the best browser to use? The Amazon Fire TV and Fire TV Stick is about more just watching Netflix and streaming Spotify. The devices are also an excellent way to browse the web on your TV. Two browsers are available in the Amazon Appstore: Firefox and Silk. Both are optimized for the operating system, and both give you the full internet experience. Silk is Amazon's in-house browser. As Fire TV owners will already know, you also need to use a browser if you want to access YouTube. Google no longer makes its video service available on the Fire TV platform. But what is the best browser for the Amazon Fire TV and Amazon Fire TV Stick? And are there any sideloaded apps that can rival Firefox and Silk for the crown? Keep reading to see our comparison and conclusion. For Watching YouTube. In late 2017, Google and Amazon had a spat. The details aren't important, but in the fallout, Google axed its YouTube app for Fire TV. Rather than pandering to its competitor, Amazon rolled out a near-instantaneous update for its devices that introduced web browser capabilities. At the same time, Firefox and Silk became available in the Appstore. Today, if you click on the YouTube app on your Fire Stick, you'll be taken to the YouTube homepage in one of the two browsers.
    [Show full text]
  • Web Performance Load Tester 3.6 Manual
    Quick Start Guide Quick Start This guide will help you learn basic navigation of the Web Performance Load Tester interface as well as the steps to record, replay and analyze the performance of a your website. 1. Installation 2. Getting Help 3. Updating the Software 4. Navigating the User Interface 5. Record a testcase 6. Inspecting a testcase 7. Replay a testcase 8. Analyze the performance changes 9. Run a Load Test Installation Supported Platforms Web Performance Load Tester is supported and tested on Windows 2000, Windows XP and Vista. It should also work on most other modern Windows versions. note: Installation of the Load Engine is supported on Windows, Linux and Solaris. Installation of the Server Agent is supported on Win- dows and Linux. Installation Notes l For Linux stand-alone installations, do not install the application at the top level directory (at "/"). There is a known issue with the install application when this directory is used. l For any installation, ensure that the directory the application is being installed in is not a read-only directory to the users of the application. The application will not start properly when this occurs. l For stand-alone installations, do not install Web Performance Load Tester and Web Performance Load Engine in the same directory. Installation steps 1. Download the software from http://webperformanceinc.com/download 2. On Windows, run the installer and follow the wizard 3. On Linux/Unix with a GUI, run the installer and follow the wizard 4. On Linux/Unix from a console, run the installer with the "-i console" option.
    [Show full text]
  • Front-End Website Performance Optimisation Optimising the Front-End Performance of Swedbank’S Website
    IT 13 062 Examensarbete 15 hp September 2013 Front-end website performance optimisation Optimising the front-end performance of Swedbank’s website Tobias Ericsson Institutionen för informationsteknologi Department of Information Technology Abstract Front-end website performance optimisation Tobias Ericsson Teknisk- naturvetenskaplig fakultet UTH-enheten The purpose of this study is to establish what techniques Swedbank can employ to improve the performance of their external website. Several optimisation techniques Besöksadress: for improving front-end performance are presented from user experience and server Ångströmlaboratoriet Lägerhyddsvägen 1 load perspectives. The website is then evaluated based on the principles identified to Hus 4, Plan 0 determine if and how it can be improved, whereupon testing is employed to determine the benefits of implementing these techniques. The evaluation shows that Postadress: the Swedbank website can be improved in several ways; the most important being to Box 536 751 21 Uppsala employ text file compression, caching headers and to combine images together. The report concludes that Swedbank should implement at least these three techniques as Telefon: they are the most cost-effective from both a user experience and server load 018 – 471 30 03 perspective. Telefax: 018 – 471 30 00 Hemsida: http://www.teknat.uu.se/student Handledare: Henrik Wall Ämnesgranskare: Arnold Pears Examinator: Olle Eriksson IT 13 062 Tryckt av: Reprocentralen ITC 2 Abstract in Swedish Syftet med denna rapport är att fastställa vilka tekniker Swedbank kan använda sig av för att förbättra prestandan på sin externa webbsida. Flera optimeringsåtgärder för förbättring av front- end-prestanda ur användarupplevelse- samt serverbelastningsperspektiv presenteras. Webbsidan utvärderas sedan utefter de presenterade principerna.
    [Show full text]
  • Optimization of Graphical Performance in a Motion- Based Web Game – Improving Design and Implementation of a Game Mea- Sured by Frame Rate
    Linköping University | Department of Computer Science Master thesis, 30 ECTS | Datateknik 2017 | LIU-IDA/LITH-EX-A--17/036--SE Optimization of graphical performance in a motion- based web game – Improving design and implementation of a game mea- sured by frame rate Oskar Therén Supervisor : Aseel Berglund Examiner : Henrik Eriksson Linköpings universitet SE–581 83 Linköping +46 13 28 10 00 , www.liu.se Upphovsrätt Detta dokument hålls tillgängligt på Internet – eller dess framtida ersättare – under 25 år från publiceringsdatum under förutsättning att inga extraordinära omständigheter uppstår. Tillgång till dokumentet innebär tillstånd för var och en att läsa, ladda ner, skriva ut enstaka kopior för enskilt bruk och att använda det oförändrat för ickekommersiell forskning och för undervisning. Överföring av upphovsrätten vid en senare tidpunkt kan inte upphäva detta tillstånd. All annan användning av dokumentet kräver upphovsmannens medgivande. För att garantera äktheten, säkerheten och tillgängligheten finns lösningar av teknisk och admin- istrativ art. Upphovsmannens ideella rätt innefattar rätt att bli nämnd som upphovsman i den omfattning som god sed kräver vid användning av dokumentet på ovan beskrivna sätt samt skydd mot att dokumentet ändras eller presenteras i sådan form eller i sådant sam- manhang som är kränkande för upphovsmannenslitterära eller konstnärliga anseende eller egenart. För ytterligare information om Linköping University Electronic Press se förlagets hemsida http://www.ep.liu.se/. Copyright The publishers will keep this document online on the Internet – or its possible replacement – for a period of 25 years starting from the date of publication barring exceptional circum- stances. The online availability of the document implies permanent permission for anyone to read, to download, or to print out single copies for his/hers own use and to use it unchanged for non-commercial research and educational purpose.
    [Show full text]
  • An Analysis of Internet Content Delivery Systems
    An Analysis of Internet Content Delivery Systems Stefan Saroiu, Krishna P. Gummadi, Richard J. Dunn, Steven D. Gribble, and Henry M. Levy Department of Computer Science & Engineering University of Washington {tzoompy,gummadi,rdunn,gribble,levy}@cs.washington.edu Abstract versity of Washington, a large university with over 60,000 students, faculty, and staff. For this paper, we analyze a In the span of only a few years, the Internet has expe- nine day trace that saw over 500 million transactions and rienced an astronomical increase in the use of specialized over 20 terabytes of HTTP data. From this data, we pro- content delivery systems, such as content delivery networks vide a detailed characterization and comparison of content and peer-to-peer file sharing systems. Therefore, an under- delivery systems, and in particular, the latest peer-to-peer standing of content delivery on the Internet now requires workloads. Our results quantify: (1) the extent to which a detailed understanding of how these systems are used in peer-to-peer traffic has overwhelmed web traffic as a lead- practice. ing consumer of Internet bandwidth, (2) the dramatic differ- This paper examines content delivery from the point of ences in the characteristics of objects being transferred as a view of four content delivery systems: HTTP web traffic, the result, (3) the impact of the two-way nature of peer-to-peer Akamai content delivery network, and Kazaa and Gnutella communication, and (4) the ways in which peer-to-peer sys- peer-to-peer file sharing traffic. We collected a trace of all tems are not scaling, despite their explicitly scalable design.
    [Show full text]