Massive Ongoing Changes in Content Distribution
Content Delivery Summit, Spring 2013
Dr. Craig Labovitz [email protected] Internet Observatory 2009
• Largest study of Internet backbone to date • Data from backbone routers in 161 providers around the world • Major findings on consolidation of content and evolution of backbone architecture
2 Preliminary 2013 Data
• Started work on 2013 Internet Report • DeepField sells software to cloud, exchange points, CDN and ISPs to manage, analyze and design services • Software collects large volumes of real-time data from backbone routers, DNS, routing protocols, AAA, OSS, etc. • Data represents many tens of millions of end devices across large population of diverse providers
3 Preliminary 2013 Data
• Roughly 1/3 our customers elected to participate in anonymized study • Representing 1/5 of all North America consumer Internet traffic • One of largest study of backbone traffic and architecture trends to date • This talk is preliminary data
4 Overall CDN Growth
60" CDN"as"a"Percentage"of"US"Consumer"Backbone"Traffic" 5050"
40"
30"
20" Percent of Traffic 10" 2009 2011 2013
0"
• A major CDN milestone this Spring • CDN grows > 50% of consumer traffic in the US • CDN is the network
5 CDN Traffic Share 2013
50"
45"
40" CDNs"as"a"Percentage"of"Peak"
35" CDN"Traffic"Across"North"
30" American"Subscriber"Backbones"
25"
20"
15"
10"
5"
0" Akamai" OpenConnect" Level3" Limelight" Google"Global" Edgecast" Cloud"Front" HighWinds" China"Cache" Cloud"Flare" Cache"
• Large std deviation across sample • Mainly due to “tier1” business policies with respect CDN • Also increasingly blurry definition of “CDN”
6 Internet Traffic 2009
• Traffic dominated by small number of sites and services • In 2007, 50% of traffic came from several thousand sites • In 2009, 50% of traffic came from 150 sites
7 Internet Traffic 2013
60"
50"
40"
30"
20" Traffic)in)North)America)
10" Percentage)of)all)Consumer)Internet)
0" 1" 11" 21" 31" 41" 51" 61" 71" 81" 91" Number)of)unique)web)sites)and)services)
• 50% of traffic comes from 35 sites / services • And smaller number of CDN / infrastructure sources • Most traffic is no longer web
8 Hyper Giants 2013
9 Netflix OpenConnect
ASN NAME 5050 Pittsburgh,Supercomputing,Center 803 Sasktel.net 2711 Spirit,Communications • Rapidly expanding 18712 SureWest,Kansas,Operations 21565 Horry,Telephone,Cooperative OpenConnect coverage 6079 RCN 6128 Cablevision 19108 Suddenlink,Communications • Now in many networks 8047 GENERAL,COMMUNICATION 5056 Iowa,Network,Services 3737 PenTeleData,Inc. • Especially interconnect limited 3292 TDC,Data,Networks 5650 Frontier,Communications,of,America NA regions (e.g. outside NFL 13490 Buckeye,Cablevision 5645 TekSavvy,Solutions,Inc. 26827 EPB,Telecom cities and Canada) 2152 California,State,University,Network 32233 PERSONA,COMMUNICATIONS • Almost all higher education 6181 Cincinnati,Bell 11260 EastLink 16713 Northwest,Open,Access,Network networks of size 11758 IRIS,Networks 23205 JAB,Wireless • Not in any “tier-1” providers 855 Bell,Aliant 23114 Critical,Hub,Networks 11232 Midcontinent,Communications Sample of Networks with OpenConnect Today
10 Cyber Supply Chain
• Growing overlay and multi-CDN strategies • Many symbiotic commercial and technical relationships
11 Trends
• New financial incentives (high-speed ad markets and super hi-def video) • Massive growth in traffic. Estimate CDN at 60% of traffic by 2014 • Growing focus on latency • All driving CDN to secondary cities
12 Trends
• Growing variety of edge boxes • Growing number of consumer providers with content as customers • Almost all providers in CDN build, buy or partner discussions • Roughly 1/4 providers pursuing build in our survey
13 DeepField
Big Data Analytics Software for Big Networks
14 www.deepfield.net
15