CLOUD PERFORMANCE FROM THE END USER A CloudOps ANALYSIS OF CLIENT-SIDE LATENCY AND AVAILABILITY ON CLOUD PLATFORMS EXECUTIVE SUMMARY We analyzed several days’ data collected worldwide from visitors to specially instrumented sites. The data totaled nearly three hundred million individual tests, conducted by 1.2 million individual browser visits, measuring performance and availability of nine cloud providers. Some quick lessons learned include: ƒƒ Regional effects matter tremendously, and the difference between countries can be significant. ƒƒ Directing a regional client to the correct regionalized zone for a cloud provider does improve performance. ƒƒ The average time to complete an HTTP request and receive a response, worldwide, was 426.4 milliseconds. The average availability worldwide was 97.69%. ƒƒ While most cloud providers had roughly similar average availability, a closer analysis of percentiles shows that the worst-served visitors fared very differently. This underscores the importance of doing proper analysis on performance data. ƒƒ End user information is an important complement to synthetic testing. While the results aren’t as consistent, they provide insight into the conditions of far-flung end users across a broad spectrum of networks and countries. ƒƒ Given variance in cloud performance and availability by region and by day, it makes sense for serious cloud users to hedge their bets, and find ways to arbitrate cost and service quality across providers.

PAGE 2 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com INTRODUCTION The risk and uncertainty of cloud computing platforms are often cited as major obstacles to adoption by a broader audience, particularly those of mainstream businesses. In this report, we analyze data provided by Cedexis to estimate the performance of several leading cloud providers from the end users’ point of view. Because the information comes from actual browsers, we not only learn about the performance of the clouds, but also of the countries and service providers.

How the data was collected Cedexis captures performance information from visitors’ browsers when those browsers are idle. Customers insert a small Javascript into their pages:

Once the page is finished loading, the browser executes the script. The browser receives a weighted list of providers, with URLs for small and large objects for each provider. The client randomly picks some number of these providers to measure each time. For each provider, the browser then requests two objects: a 50-byte object called cdx10b.js and a 100-Kbyte object called cds10b-100KB.js. The smaller object is requested twice, each time with a different random URI parameter, in order to prevent any intermediate caches from skewing results. That means requests look like this:

http://wac.0de9.edgecastcdn.net/800DE9/www.cedexis. com/cdx10b.js?rnd=7009653189

Cedexis uses a dynamic application to generate the response, rather than a static object. For some providers, static objects are served by a different infrastructure from dynamic ones; dynamically generating the response eliminates this external shell of infrastructure and instead tests the cloud itself.

PAGE 3 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Cedexis captures a relatively small amount of data on each cloud each time a page loads. This includes: ƒƒ Availability—whether the page loads or not. ƒƒ HTTP Connect Time—how long it takes for the browser to establish a connection with the server, including DNS time and the establishment of the initial TCP and HTTP sessions to the provider. ƒƒ HTTP Response Time—how long it takes for the server to respond to a subsequent request, once all of the noise of establishing a connection is completed. This is a relatively close approximation of TCP round-trip time (RTT) from the browser to the provider. ƒƒ Throughput—this is the data rate of the connection, in kilobits per second, as measured from the retrieval of the 100 Kbyte object. The system doesn’t collect other information such as OS or browser that could be used to further segment the results, or other sources of delay such as DNS lookup time and SSL negotiation time (though these can be inferred from the difference between the first and second request of the small object.)

What client-side data looks like An actual message from a client contains the following information:

Field Example Count 1 total_ms 100 time 2011-02-24 21:00:00 market_num 3 country_num 1 autosys_num 6752 provider_owner_zone_id 0 provider_owner_customer_id 0 provider_id 13 probe_type_num 3

Cedexis did several things to the data before they provided it to CloudOps Research. ƒƒ First, they limited it to cloud provider test data. Through its customers, Cedexis collects data on a wide range of providers1. We focused only on nine clouds.

1 Measurements are collected for Cloud providers (EC2 APAC, EC2 EU, EC2 US-East, EC2

PAGE 4 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com ƒƒ Second, they replaced certain fields’ numbers with their text equivalents—the service provider, the cloud provider, and the country, for example. ƒƒ Third, they removed some of the data that doesn’t aggregate well, leaving us with the HTTP response time and availability tests. We did not analyze HTTP Connect Time or Throughput metrics. ƒƒ Fourth, they aggregated it by day to make it feasible to process, which meant we had one row per cloud provider, per service provider, per day. This means that, for every ISP in the world, we had a minimum of 63 rows (7 days times 9 cloud providers) assuming at least one visitor from that ISP on a given day. As we’ll see below, this loses a significant amount of information, but is still valuable for overall analysis. The resulting data, which we received from them in raw format, looked like this:

Metric What it means EC2 APAC The provider that handled the request—in this case Amazon’s EC2 zone in Asia Pacific. Egypt The country from which the request came, in this case, Egypt. Bibliotheca Alexandrina The service provider from which the request came, in this case the Library of Alexandrina. 33782 The Autonomous System (AS) number of the network from which the request came. 2010-12-15 00:00:00 The timestamp of the request. Cedexis truncated this data to individual days. HTTP Connect Time The measurement, in this case the time to connect to a server via HTTP. 2 The number of measurements made, in this case two. 883 The average HTTP Connect Time across these two measurements.

Data aggregation It’s well understood among statisticians, performance experts, and site operators that averages mask problems. Average across too many data points, and it’s hard to identify incidents that are otherwise hidden by the

US-West, GoGrid, Google App Engine, Joyent, Rackspace CloudServer, Windows Azure); cloud storage and delivery networks (CacheFly, CloudFlare, Cloudfront, MaxCDN, Nirvanix, Rackspace CloudFiles, S3-EU, S3-US, Voxel) traditional CDN/ADN providers (Akamai, Akamai HD, BitGravity, CDNet- works, Cotendo, Edgecast, Highwinds, Internap, Level3, Limelight, CDNVideo, ChinaCache, Internode, Ngenix, Prime Networks, Yacast) and major web destinations (Amazon.com, AOL.com, Bing.com, Blogger.com, Facebook.com, MSN.com, Twitter.com, WordPress.com, Yahoo.com, YouTube.com). Ce- dexis clients may also test their own providers or data centers.

PAGE 5 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com smoothing effect of averages; and a few outliers can skew an otherwise good experience. In its day-to-day use, Cedexis needs more than one-day granularity. Once a minute, all of the measurements collected from the same provider network (i.e. “Bibliotheca Alexandrina in Egypt”) for the same test metric (i.e. “HTTP response time of cdx10b.js”) are stored as a row in the company’s database. That means that Cedexis has views like the following one into the performance of much of the Internet’s backbone, as seen by browser users around the world.

For this report, we’re dealing with the daily aggregate of data. That means that—in an extreme case—one day of activity on France Telecom’s network yielded 810,065 data points about Amazon’s European availability zone, because there were 810,065 unique tests of Amazon Europe done by browsers on that network. This results in a very reliable understanding of network availability, but it also hides the variance across those individual browsers. This limitation comes down to a simple lack of time, tools, and computing horsepower on our part; one-minute summaries are likely to be relevant for Cedexis’ core business of making good service provider selections as the Internet’s backbones change. We used percentiles to provide better insight into end user experience. This is important because we often care about how theworst-served 5% experienced an application. To do this, we had to build histograms by provider, day, country, and service provider, which consumes more computing resources but ultimately gives us a clearer means of comparing providers. There’s another important source of bias in the results. As a result of its early beta and rollout, Cedexis’ largest customers are popular French media

PAGE 6 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com sites. This means it’s unwise to make sweeping generalizations from this data; as Cedexis’ customers become more global, the data will be easier to apply to providers worldwide.

The two data sets Cedexis provided us with two sets of data. The first, described above, was analyzed using Google’s Fusiontables product. It consisted of 1.2 million rows of information, spanning five days, representing 296,265,830 individual tests conducted by visiting browsers. This means that on average, each browser conducted roughly 247 tests once it had loaded a page. The second data set was designed for deeper analysis within a more traditional spreadsheet, allowing us to calculate percentiles (though client aggregation still occurred) and process the information with Pivot Tables and grouping in Excel. In this second set, the data appeared as follows:

PAGE 7 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com date country network provider measurement count aggregate 11-01-17 New Starhub EC2 APAC HTTP 2 17 Zealand Internet Response Exchange Time 11-01-19 Vietnam Vietel GoGrid HTTP 224 84992 Corporation Response Time 11-01-17 Peru Telmex Peru Windows Availability 170 16800 Azure

The “count” measurement was the number of tests conducted by a client, and the “aggregate” the total amount—so a “score” had to be calculated from the two. In the case above, users of Peru’s Telmex ISP had 16,800/170=98.824% availability in their tests of Windows Azure on January 17th.

CloudOps policy on reports and data sources CloudOps publishes reports and research that are useful to the technology community as a whole, and distributes them under a creative commons share-alike license. We don’t do partisan research or propose particular technologies or vendors. Some of our research is sponsored; in this case, Cedexis provided us with the raw data and paid us for the creation of this document. They did not have editorial input into its content, and are making this information available to the cloud computing and performance communities freely.

PAGE 8 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com OVERALL PERFORMANCE AND AVAILABILITY The core data set we examined spanned a week in January 2011. During that time, the 95th percentile HTTP Response Time and the average availability varied significantly.

If we break the performance down into percentiles, we see that while the average latency worldwide is fairly consistent, the worst-served 5% and 1% of clients are seeing significant variation in performance.

PAGE 9 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com The same is true for availability: even though 90% of clients are seeing that roughly 90% of their HTTP requests complete properly, the worst-served 1% of visitors measured are seeing only half of their requests complete.

When we break this data down by specific cloud provider, the variance becomes even clearer. Every provider has days of good performance, and days where their cloud is slow.2

2 It’s important to remember, however, that the relative performance of some providers is skewed because the majority of tests come from regions like France. As a result, European sites (in particular, Amazon’s European availability zone) seem comparatively fast.

PAGE 10 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com If we examine availability over the week, we see similar results—with a significantly lower availability for Google’s App Engine.

Before we proceed, that Google App Engine number deserves some discussion. When we first analyzed the data, we were surprised to see App Engine scoring so poorly. We contacted members of the App Engine team at the start of March, and Cedexis provided them with the source code, logfiles, and details of how the tests worked on March 3, 2011. Cedexis’ strategy of cache-busting by generating a random URI parameter eliminates any performance gains from Google’s global network of caches. “The fact that you bust the cache by adding url parameters disadvantages us because our data centers for App Engine are in the US, your browsers mainly in France, and edge caching does not work if you bust the cache,” said Patrick Chanezon, Google’s Developer Relations Manager for App Engine, “but this should be reflected in latency differentials with local cloud services, not availability.” On March 4, 2011, Patrick Chanezon let us know the results of his investigation. His first guess was that billing wasn’t activated, so that when the test application exceeded the day’s free quota it stopped responding. Google’s App Engine gives users a certain amount of compute, storage, and networking for free3, after which users are billed. Google checked, and while billing had been activated, on October 17, 2010, Google was unable to charge the credit card provided by Cedexis, which was costing roughly $6 a day at this point. As a result, the application was over quota for CPU every day since October 17, 2010 (once a three-day grace period had expired), including the days that the data analyzed in this study was collected. When we learned this, we removed the App Engine data from the study and retracted the report until we had time to look into the issue in more detail.

3 http://code.google.com/appengine/docs/quotas.html

PAGE 11 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Google’s investigation also revealed that there was nothing in the logfiles about dropped requests due to a lack of quota, and Cedexis received no alerts to the problem, which suggests there is a bug in App Engine’s handling of rejected charges for payment. Cedexis sent us another two-day data set for App Engine. All days seem to have this pattern of drops around 7AM, but not the drop we’d expect. If, as Google suspects, the Cedexis application was consuming all quota, we’d expect to see a sudden drop in availability from a good number to 0%. That’s not what’s happening.

We then broke down performance by several of the dimensions available to us in the Cedexis data for a single day—March 3, 2011, before Google had looked into the situation. First, we looked at specific regions.

PAGE 12 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com From this data, we see that two regions—Africa and Asia—experience a significantly lower level of availability than other regions. China at Afghanistan score extremely low (10.3% and 15.5% respectively.) However, even the United States experiences a low performance number, as shown in this heatmap of availability from a sampling of countries on March 3, 2011:

Google concluded that it looked into “the billing issue, and it should not have affected the results: even if the billing fails, this should not impact serving.” The company says these availability measurements don’t correlate with its own internal measurements, and sat down with Cedexis to understand the cause of the low numbers.4

4 Google’s team spent a lot of time helping us dig into this issue, and we want to thank them for their responsiveness and generally awesome attitude throughout the process.

PAGE 13 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com After some comparison of log data, Google determined that App Engine’s logs had 126,000 more hits from clients than Cedexis’ browser collectors had recorded. The App Engine logs show that 99.8% of HTTP requests were handled with a 200 OK (correct) response; for the same period, Cedexis data shows a 95% availability. That means there’s roughly a 5% drop in availability from network and client-side issues. Cedexis will be broadening its instrumentation to better understand the makeup of these error conditions.

PAGE 14 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com CLOUD PROVIDERS Here’s a numerical breakdown of cloud performance across the entire week.

Averages worldwide Average performance and availability didn’t vary dramatically from provider to provider. End-user experience in each of these cases is lower than what a synthetic testing system would report—the idealized conditions of a test script running in a data center don’t accurately capture the last-mile, regional, and service-provider problems that end users see.

Average HTTP Average Provider response time Availability EC2 APAC 513.12 ms 95.61% EC2 EU 353.52 ms 96.32% EC2 US-East 381.51 ms 96.42% EC2 US-West 410.93 ms 95.80% GoGrid 432.96 ms 96.33% Google App Engine 445.20 ms 93.05% Joyent 474.90 ms 94.87% Rackspace CloudServer 412.62 ms 96.33% Windows Azure 416.40 ms 95.39%

Performance percentiles Breaking the performance into percentiles, it’s clear that a subset of users are suffering through very slow connections. Joyent, in particular, had particularly high latency for the 95th and 99th percentile.

Provider Median 90th 95th 99th EC2 APAC 454.12 801.42 965.36 1,490.09 EC2 EU 281.53 656.40 820.72 1,329.71 EC2 US-East 299.54 667.49 829.03 1,467.77 EC2 US-West 335.20 677.53 855.58 1,393.71 GoGrid 350.20 713.85 881.16 1,648.97 Google App Engine 358.04 732.60 947.24 1,637.00 Joyent 379.68 803.19 1,021.46 1,637.25 Rackspace CloudServer 320.84 697.28 874.26 1,668.20 Windows Azure 332.51 718.63 914.38 1,524.43

PAGE 15 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Availability percentiles When it comes to percentile availability, the story is similar. Here, we’re looking at all reported availability for a cloud, and seeing what the worst 10%, worst 5%, and worst 1% of visitors experienced. Google’s App Engine is particularly bad.

Provider Median 90th 95th 99th EC2 APAC 97.75% 90.61% 83.33% 60.21% EC2 EU 98.43% 91.67% 86.25% 66.67% EC2 US-East 98.40% 92.70% 86.86% 65.44% EC2 US-West 98.06% 90.68% 83.72% 63.55% GoGrid 98.32% 92.12% 86.11% 68.02% Google App Engine 97.30% 85.73% 74.11% 7.96% Joyent 97.72% 88.55% 79.01% 50.00% Rackspace CloudServer 98.27% 91.60% 85.42% 70.63% Windows Azure 98.14% 90.65% 82.54% 46.60% EC2 APAC 98.04% 90.48% 83.04% 55.45%

Performance histogram One way to visualize all of this information is a performance histogram, as shown below.

PAGE 16 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com This visualization breaks the time taken for an HTTP response into “buckets”—0 to 100 milliseconds; 100 to 200; and so on. Then it counts the number of tests in each bucket for each cloud. Here’s the data table for the histogram.

Provider 100 200 300 400 500 600 700 800 900 1000 1100 1200 1300 1400 1500 1600 EC2 APAC 21 103 195 768 995 507 238 150 124 61 45 22 18 14 18 6 EC2 EU 226 982 22 1053 405 296 179 103 64 38 31 12 4 6 5 8 EC2 US-East 31 554 934 803 403 259 159 100 65 40 26 14 9 4 6 8 EC2 US-West 12 195 1085 827 467 253 182 106 63 43 27 17 12 4 3 3 GoGrid 18 202 691 1229 505 284 160 136 70 46 32 19 15 8 5 3 Google App Engine 7 217 720 1056 510 334 203 120 66 61 32 33 18 10 5 9 Joyent 16 147 350 1347 519 323 213 164 84 77 53 30 26 21 11 9 Rackspace CloudServer 19 319 817 1067 454 256 178 93 93 49 26 16 11 9 4 2 Windows Azure 20 311 1125 719 472 261 162 125 68 46 36 25 15 17 5 6 The following map, generated by Cedexis for January 2011, shows which cloud providers were fastest worldwide in January.

PAGE 17 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com BY COUNTRY We then broke down the data by country. Since there’s a lot of data, we list the 10 worst and 10 best for each.

Performance The 10 worst-performing countries had average latency of from 893.79 milliseconds to 1.8 seconds. By comparison, the average performance worldwide was 426.4 milliseconds.

10 worst performance Count 3 Average Stdev Median 90th 95th 99th Bolivia 7 1810.85 2082.18 562 4565.6 5001.8 5350.7 Kenya 55 2146.33 1082.79 1951 3535 4083.3 4927.81 Nigeria 252 1334.87 442.16 1199.55 2060.68 2262.71 2502.65 Luxembourg 252 642.14 647.25 286.45 1766.88 1824.78 1898.83 Uganda 63 930.48 383.21 823.42 1502.81 1746.80 1954.80 Iraq 86 951.14 616.79 789.91 1491.5 1930 3265.10 Cameroon 184 1035.61 442.81 938.49 1474.58 1946.22 2619.59 United Arab Emirates 189 764.22 467.31 499.15 1471.05 1635.27 1896.33 Indonesia 189 944.18 285.10 936.08 1330.45 1507.4 1647.16 Sudan 185 893.79 279.12 867.44 1225.21 1358.66 1652.84 On the other hand, top-performing countries like Belgium and Monaco enjoyed excellent performance.

10 best performance Count4 Average Stdev Median 90th 95th 99th Belgium 532 250.74 83.68 247.50 358.05 399.46 516.57 Monaco 63 269.18 65.73 273.85 361.8 390.36 402.12 Lithuania 63 280.28 67.65 273.53 374.09 388.29 428.88 Macedonia 63 286.69 72.24 283.98 375.60 406.76 484.92 Germany 687 275.12 83.23 274.77 376.97 417.97 501.82 Estonia 63 285.57 73.02 275.01 377.24 393.80 451.94 Bulgaria 126 286.04 79.97 286.48 377.8 420.64 499.57 Moldavia 126 284.89 92.24 276.54 385.75 430.32 515.97 Mexico 126 272.55 82.49 266.55 396.13 450.92 469.33 Andorra 63 306.69 69.66 307.73 396.74 411.58 483.86

5 These represent only 0.00134% of all samples collected. 6 These represent only 0.00176% of all samples collected.

PAGE 18 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Availability The 10 worst-availability countries didn’t have reliable access to any clouds; by comparison, the average availability worldwide was 97.69%. Note, however, that we’re only seeing tests from clients that were successfully able to load a page with the embedded Javascript, and whose browser had time to run the tests in the background. This information is definitely skewed, as only some users in the countries listed below were even able to load the page. We define “worst availability” as the lowest 90th percentile from all samples.

10 worst availability5 Count Average Stdev Median 90th 95th 99th Bolivia 9 57.78% 43.81% 50.00% 0.00% 0.00% 0.00% Sudan 189 81.87% 28.68% 91.53% 3.32% 1.41% 0.43% Kenya 60 51.73% 29.93% 50.00% 16.25% 0.00% 0.00% Syria 63 81.39% 26.14% 90.72% 24.92% 9.23% 4.88% Cameroon 186 67.36% 18.85% 72.03% 37.17% 28.57% 16.31% Iran 126 86.58% 18.57% 92.23% 40.00% 34.42% 30.80% Iraq 89 82.71% 20.47% 89.50% 50.00% 50.00% 0.00% Rwanda 63 77.53% 13.09% 77.78% 61.29% 54.67% 47.66% China 315 90.04% 12.80% 95.17% 67.67% 54.92% 49.12% Mauritania 63 78.09% 6.21% 78.13% 69.67% 68.08% 65.34%

The best-served 10 countries enjoyed a relatively reliable access to clouds.

10 best availability6 Count Average Stdev Median 90th 95th 99th Mexico 126 98.65% 0.51% 98.63% 98.14% 97.94% 97.04% Lithuania 63 98.61% 0.94% 98.82% 97.84% 97.15% 95.22% Monaco 63 98.53% 0.73% 98.64% 97.83% 97.60% 96.12% Colombia 315 98.62% 0.70% 98.66% 97.72% 97.36% 96.64% Belgium 534 98.24% 4.92% 98.75% 97.56% 96.94% 93.28% Puerto Rico 189 98.68% 1.19% 98.84% 97.48% 96.75% 94.23% Estonia 63 98.90% 1.04% 99.26% 97.36% 97.00% 96.02% Romania 258 97.99% 7.43% 98.83% 97.14% 95.91% 84.28% Denmark 403 98.62% 2.94% 99.07% 97.09% 96.04% 90.03% Moldavia 126 98.94% 1.34% 99.24% 97.09% 96.29% 94.77%

7 These represent only 0.00064% of all samples collected. 8 These represent only 0.00118% of all samples collected.

PAGE 19 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com BY SERVICE PROVIDER We then analyzed performance by the individual service providers. Many countries have several providers from which to choose, each with different performance characteristics.

Performance The worst 10 providers (judged by their 90th percentile HTTP response time) took two to three times as long to get a response from a cloud. By comparison, the average performance worldwide was 426.4 milliseconds.

Worst providers Count Average Stdev Median 90th 95th 99th Saix 117 1,455.01 989.57 982.05 3,227.93 3,519.33 4,479.70 Direct On Pc 63 1,986.73 340.04 1,963.50 2,341.97 2,469.94 2,884.27 Ses Astra 85 1,853.02 574.96 1,757.36 2,241.30 2,543.80 3,812.56 Cyprus Telecommunications Authority 126 866.36 548.74 696.68 1,585.44 1,701.75 1,904.11 Pt Telekomunikasi Selular 63 1,123.78 321.43 1,120.89 1,551.52 1,616.35 1,792.84 Multi Links Telecommunications Limited 63 1,221.53 166.74 1,212.97 1,459.37 1,488.61 1,569.15 Mtn Network Solutions 247 904.08 436.35 813.20 1,409.95 1,780.40 2,482.73 Orange Cameroun 63 1,158.29 206.05 1,143.57 1,402.76 1,487.94 1,693.21 Idm 145 1,000.61 633.19 894.89 1,395.20 1,966.80 3,875.71 Mobitel 61 1,044.69 326.69 1,010.14 1,359.56 1,495.47 2,102.68 The best providers—which included a disproportionate number from Canada and France—enjoyed a fast Internet connection to clouds. The appearance of high rankings from French-speaking countries is likely related to the sampling bias of French sites mentioned above.

Best providers Count Average Stdev Median 90th 95th 99th Clearblue Technologies 63 125.45 63.75 115.55 217.42 229.24 236.87 Bell Canada 76 182.96 77.16 183.53 221.02 374.41 384.3 Shaw Communications 63 184.74 54.86 169.07 272.88 294.17 309.27 Charter Communications 63 189.32 59.31 170.65 299.86 318.90 339.39 The Janet Ip Service 152 217.94 75.00 223.54 299.99 344.37 365.79 Road Runner Holdco 63 194.25 57.74 181.36 304.09 327.15 345.85

PAGE 20 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Reseau National De Telecommunications Pour La Technologie 126 231.44 62.00 227.59 309.33 324.85 365 Cox Communicatons 63 188.46 66.78 162.98 310.22 324.08 334.99 Videotron Telecom Ltee 63 169.23 69.80 156.32 311.12 343.59 359.33 Gps Technik 84 219.7 75.19 227.54 312 348.29 358.62

Availability The worst providers from an average availability perspective have significant problems reaching any clouds reliably.

Worst providers Count Average Stdev Median 90th 95th 99th Ses Astra 94 66.03% 27.50% 74.32% 13.04% 0.00% 0.00% Orange Cameroun 63 70.34% 8.96% 71.77% 60.01% 50.15% 44.78% Saix 122 73.82% 29.98% 91.73% 25.00% 16.67% 0.00% Cameroon Telecommunications Network 63 74.82% 5.99% 76.15% 65.40% 63.67% 61.23% Direct On Pc 63 76.26% 6.75% 76.41% 66.96% 64.39% 62.79% Mtn Network Solutions 249 76.43% 20.49% 81.25% 45.56% 30.96% 17.14% Gabon Telecom Internet Network 63 77.91% 5.42% 77.91% 69.98% 68.57% 65.77% Mauritanian Telecommunication Company 63 78.09% 6.21% 78.13% 69.67% 68.08% 65.34% Mobitel 63 79.02% 27.98% 89.53% 17.75% 1.44% 0.31% Ikatel 63 79.72% 6.32% 80.22% 71.33% 69.45% 67.44% The list of most-available ISPs is significantly different from the list of high- performing ones.

Best providers Count Average Stdev Median 90th 95th 99th Television Francaise 1 63 99.78% 0.30% 99.84% 99.34% 99.32% 98.88% Clearblue Technologies 63 99.58% 0.34% 99.69% 99.09% 98.68% 98.48% Opera Software Asa 63 99.56% 0.29% 99.63% 99.16% 98.99% 98.72% Megalan 63 99.36% 1.02% 100.00% 98.15% 97.93% 95.73% Northrop Grumman 63 99.27% 0.91% 99.52% 97.85% 97.49% 96.47% Kocnet 63 99.25% 0.71% 99.53% 98.11% 98.02% 97.53%

PAGE 21 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Trans European Versatel Ip Transport Backbone 109 99.18% 2.26% 99.55% 98.50% 97.85% 93.61% Telmex Servicios Empresariales 63 99.16% 0.46% 99.19% 98.56% 98.33% 97.84% Telianet Denmark 63 99.15% 0.92% 99.34% 98.32% 97.80% 96.21% Corbina Telecom 63 99.14% 0.40% 99.23% 98.65% 98.38% 97.99%

PAGE 22 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com MATCHING CLOUDS TO REGIONS One of the real questions around regional performance is what the impact of a local provider has on performance. Amazon is a perfect test case, since the company has four zones around the world. The Cedexis script analyzes the performance of each of these, and by comparing regional tests, we see significant benefit to regional data center use.

Source country EC2 APAC EC2 EU EC2 US-East EC2 US-West China 290.693 595.659 497.638 403.059 European Union 512.982 197.822 276.002 351.655 United States 437.148 304.034 275.140 296.241

We did a similar analysis for availability across the four zones.

Source country EC2 APAC EC2 EU EC2 US-East EC2 US-West China 96.38% 93.15% 96.08% 93.03% European Union 97.11% 97.09% 97.61% 96.27% United States 97.34% 97.43% 98.15% 96.50% We also broke down performance from five countries across the nine cloud destinations monitored by Cedexis. As the following chart illustrates, different regions experience clouds very differently—for example, Japanese clients did not have good performance from App Engine and Azure.

PAGE 23 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com CONCLUSIONS It’s clear that cloud performance varies widely, and that end user experience is different from synthetic testing measurements. The variance in cloud performance by region, even on a day-to-day basis, suggests that there are significant benefits to a portable computing workload that can be run from several locations, because this means a customer can choose from the cheapest, best-performing, or most-available cloud for a given set of end users on a given day. Capturing and analyzing these volumes of performance information in real time is a difficult proposition; in order to process this much data, details that would be extremely valuable, such as individual measurements, browser information, and more have been discarded. With the availability of affordable, increasingly simple systems for big data processing, however, it’s likely that customers will start analyzing the performance of their providers more and more closely. Finally, service providers’ claimed levels of uptime don’t match what clients are seeing, particularly in remote locations or countries that lack information infrastructure. The digital divide between nations that have reliable, performant Internet access and those who don’t is significant.

PAGE 24 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com ABOUT CLOUDOPS RESEARCH Since 2006, CloudOps Research (formerly BitCurrent) has been focused on delivering core on emerging technologies to startups, enterprises, and governments. Our goal is to separate hype from reality, and help IT organizations put new technology to work. CloudOps Research clients include Cedexis, Citrix, Coradiant, Strangeloop Networks, Taser and Webmetrics.

Our Services: ƒƒ Technology due diligence. We help investors and startups to understand the strengths and weaknesses of emerging technologies. ƒƒ Market and product analysis. We help enterprises and governments understand the technology landscape, create vendor shortlists and define product roadmaps. ƒƒ Report research and publication. We develop primary research and white papers that explain and clarify emerging sectors of IT. ƒƒ We’ve done this for companies like Strangeloop Networks, Taser, Citrix, Coradiant, Webmetrics, Cedexis, and others. ƒƒ Thought leadership. We present at conferences and within organizations, helping to bring For more information on CloudOps Research and our capabilities, contact us at www.cloudops.com

Distribution license This report is distributed under a Creative Commons Attribution/No Derivative license. You are free to to copy, distribute and transmit the work provided that you provide attribution to CloudOps, and that you do not create derivative works from it without the express written permission of the author.

BC_CPEU_0311

PAGE 25 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com APPENDIX A: HOW DID YOUR PROVIDER DO? Here’s a complete list of availability results by country and provider.

Albania 95.82% Telecom Albania 95.82% Algeria 89.07% Fawri 89.07% Andorra 98.45% Andorra Telecom 98.45% Argentina 98.37% Cablevision 98.87% Prima 98.85% Techtel Lmds Comunicaciones Interactivas 96.84% Telecentro 99.07% Telecom Argentina 98.47% Telefonica De Argentina 98.14% Australia 97.57% Iinet Limited 97.09% Internode Systems Pty 97.53% Microplex Pty 97.27% Telstra Pty 97.88% Tpg Internet Pty 98.11% Austria 97.92% Hutchison 3g Austria 97.40% Kujtesa 100.00% Telekom Austria 98.77% Upc Broadband 98.77% Verizon Business 75.00% Bahrain 95.18% Batelco Bh 95.61% Mena Broadband 92.28% Mtc Vodafone Bahrain 97.65% Belarus 98.03% Belpak 98.03% Belgium 98.24% Belgacom Regional 98.78% BeMobistar 98.58%

PAGE 26 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Brutele Sc 98.72% Gts Novera 94.44% Kpn Belgium Nv 98.25% Numericable 98.47% Scarlet Belgium 98.91% Telenet Operaties NV 98.60% Verizon Business 97.39% Benin 80.99% Office Des Postes Et Telecommunications Du Benin 80.99% Bolivia 57.78% Telesc Telecomunicacoes De Santa Catarina 57.78% Bosnia-Herzegovina 97.86% Telekom Srpske 97.86% Brazil 96.57% Embratel 95.13% Global Village Telecom 98.93% Net Servicos De Comunicao 98.42% Telecomunicacoes Da Bahia 96.65% Telecomunicacoes De Sao Paulo S/a Telesp 98.34% Telesc Telecomunicacoes De Santa Catarina 97.95% Telesp Celular 93.51% Telet 93.65% Bulgaria 98.52% Bulgarian Telecommunication Company 97.68% Megalan 99.36% Cameroon 67.36% Cameroon Telecommunications Network 74.82% Mtn Network Solutions 56.38% Orange Cameroun 70.34% Canada 94.60% Bell Canada 96.49% Cogeco Cable Canada 98.63% Cogent Communications 98.18% Hydro Quebec 97.60% Level 3 Communications 64.13% Qwest Communications Corporation 100.00% Rogers Cable Communications 98.73% Shaw Communications 98.96% Telus Advanced Communications 98.39%

PAGE 27 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Videotron Telecom Ltee 98.90% Chile 95.71% Entel Chile 98.31% Entel Pcs Telecomunicaciones 95.14% Gtd Internet 98.52% Telmex Chile Internet 85.48% Telmex Peru 90.32% Telmex Servicios Empresariales 99.16% Terra Networks Chile 98.80% Vtr Banda Ancha 99.13% China 90.04% Beijing Province Network 89.52% China Education And Research Network Center 94.34% China Telecom Group 86.37% Chinanet 90.25% Cncgroup China 169 89.72% Colombia 98.62% Colombia Telecomunicaciones 98.00% Emcatel 99.08% Epm Telecomunicaciones 98.45% Etb Colombia 98.52% Tv Cable 99.04% Costa Rica 96.84% Instituto Costarricense De Electricidad Y Telecom 96.51% Radigrafica Costarricense 97.17% Cote dIvoire 88.53% Ci Telecom 88.53% Croatia 98.09% Iskon 97.51% Optima Telekom 98.15% T Com Croatia Internet Network 98.61% Cyprus 97.66% Cyprus Telecommunications Authority 97.66% Czech Republic 98.13% Gts Novera 97.88% Sloane Park Property Trust 98.27% Telefonica O2 98.64% Upc Broadband 97.23%

PAGE 28 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Verizon Business 100.00% Denmark 98.62% Colt Telecommunications 100.00% CybercityDk 98.44% Lyse Tele 100.00% Netgroup Datacenter 98.35% Tdc Data Networks 98.22% Tele Og Teknik Aps 98.72% Telianet Denmark 99.15% Verizon Business 98.14% Dominican Republic 97.08% Compa A Dominicana De Tel Fonos C Por A Codetel 97.08% Ecuador 96.70% Corporacion Nacional De Telecomunicaciones Cnt 97.25% Satnet 96.15% Egypt 95.94% Linkdotnet 96.58% Nile Online 94.92% Raya Telecom Egypt 96.32% Tedata 95.92% El Salvador 97.66% Cte Sa De Cv 97.66% Estonia 98.90% Elion Enterprises 98.90% European Union 96.23% Aol Transit Data Network 98.19% Aramco Services Company 97.02% Arcor Ip Network 98.62% Arnes 99.75% Att Global Network Services Emea 97.48% Belgacom Regional 99.02% Bezeqint 97.16% Bnp Paribas 93.33% Btnet Uk Regional Network 96.30% Cogent Communications 96.54% Colt Telecommunications 97.95% Deutsche Telekom 98.12% Dfn Ip Service G Win 98.43% Dna Oy 100.00%

PAGE 29 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Eircom 95.65% Entel Chile 92.96% Esat Net Backbone 97.90% Eunet Finland 100.00% Fastweb 98.97% Gps Technik 97.73% Hansenet Telekommunikation 87.50% Hungarian Telecom ; Magyar Telekom 98.05% Ibernet Internet Access Network Of Tde 100.00% Idm 82.89% Infostrada Spa 96.83% Korea Telecom 90.76% Lanlink Elisa Oyj 98.57% Lattelekom Apollo 98.15% Neuf Cegetel 88.17% Novis Telecom 99.11% Ntl Group Limited 98.59% Palnet Communications 90.64% Partner Communications 95.58% Qualitynet 98.67% Reseau National De Telecommunications Pour La Technologie 98.53% Samsung Networks 72.50% Swisscom 95.77% Tdc Data Networks 98.54% Tele2 95.08% Telecom Italia 98.75% Telefonica Deutschland 75.00% Telekom Austria 97.40% Telekom Srbija 100.00% Telenet Operaties NV 98.58% Telenor Business Solutions 98.08% Telianet Europe 98.89% Telianet Sweden 98.93% Teliasonera 97.39% The Janet Ip Service 98.15% Trans European Versatel Ip Transport Backbone 99.37% Verizon Business 94.77% Versatel West 97.34% Finland 97.50% Dna Oy 97.18% Eircom 100.00% Elisa Oyj 98.26% Eunet Finland 97.21%

PAGE 30 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Lanlink Elisa Oyj 97.86% Sanoma Television 97.06% Tdc Data Networks 97.57% Teliasonera 95.98% Verizon Business 99.50% France 94.87% Bouygues Telecom Isp 98.61% Cogent Communications 91.79% Fawri 100.00% France Telecom 98.36% Monaco Telecom 90.14% Neuf Cegetel 98.16% Numericable 98.64% Office Des Postes Et Telecommunications New Caledonia 96.38% Proxad/free Isp 98.63% Reseau National De Telecommunications Pour La Technologie 97.84% Ses Astra 52.00% Sodetel Sal 87.50% Verizon Business 96.81% Gabon 77.91% Gabon Telecom Internet Network 77.91% Germany 97.68% Arcor Ip Network 98.94% Att Global Network Services Emea 100.00% Colt Telecommunications 96.67% Deutsche Telekom 98.54% Dfn Ip Service G Win 97.91% Hansenet Telekommunikation 98.86% Kabel Baden Wuerttemberg 98.37% Kabel Deutschland Breitband Service 99.08% Telefonica Deutschland 97.97% Telianet Europe 98.33% Unitymedia Group 99.02% Verizon Business 89.19% Versatel West 98.54% Ghana 91.83% Ghana Telecom 91.83% Great Britain 96.74% Avatar Broadband Limited 98.54% Bskyb Broadband 98.81%

PAGE 31 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Btnet Uk Regional Network 98.88% Colt Telecommunications 97.21% Deutsche Telekom 98.01% Hutchison 3g Uk And Ireland 97.75% Ibernet Internet Access Network Of Tde 100.00% Level 3 Communications 95.99% Nomurainternational 94.94% Ntl Group Limited 98.88% Opal Telecom 99.02% Orange Pcs Limited 98.82% Telianet Europe 97.67% The Janet Ip Service 98.09% Tiscali Uk Formerly Telincoworldonline 98.88% Verizon Business 96.61% Wns Global Services 79.35% Xs4all Internet 100.00% Greece 98.26% Evergy 98.41% Forthnet 98.66% Hellas Online 98.32% On 98.16% Otenet 97.58% Verizon Business 100.00% Guatemala 96.50% Telgua 96.50% Hong Kong 94.89% City Telecom Hk 98.49% Hutchison Telecom Hk 89.19% Pccw Imsbiz 94.16% Pccw Limited 97.71% Hungary 97.07% Digi 98.74% Hungarian Telecom ; Magyar Telekom 97.89% Invitel 97.89% Upc Broadband 98.40% Verizon Business 0.00% Iceland 98.21% Og Vodafone 98.21%

PAGE 32 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com India 89.30% Bharti Airtel 91.93% Mahanagar Telephone Nigam 94.80% National Internet Backbone 94.32% Reliance Infocom Ltd Internet Data Centre 87.22% Tata Communications 87.45% Wns Global Services 80.11% Indonesia 85.71% Pt Telekomunikasi Indonesia 89.75% Pt Telekomunikasi Selular 80.34% Wirelessnet 87.03% Iran 86.58% Aria Rasana Tadbir 88.85% AS12880 DCI Autonomous System 84.31% Iraq 82.71% Idm 66.33% Newroz Telecom 89.48% Ireland 97.56% Cogent Communications 100.00% Eircom 98.19% Esat Net Backbone 97.79% Hutchison 3g Uk And Ireland 96.87% Ntl Group Limited 100.00% O2 Ireland 98.12% Smart Telecom 99.06% Upc Broadband 98.50% Verizon Business 94.00% Vodafone Ireland 97.66% Israel 96.16% 012 Smile Communications 98.21% Bezeqint 91.55% Netvision 96.60% Partner Communications 98.13% Italy 96.95% Colt Telecommunications 96.59% Fastweb 97.96% H3g Italy 94.22% Infostrada Spa 96.80% Telecom Italia 98.21%

PAGE 33 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Tim Telecom Italia Mobile 94.74% Tiscali Italia Spa 97.97% Verizon Business 98.48% Vodafone NV 97.64% Japan 97.49% Ntt Communications Corporation 99.00% Trend Micro 95.97% Jordan 97.08% Batelco Jordan 97.12% Go Jor 95.38% Lasilkee S 97.93% Linkdotnet Jordan 97.31% National Information Technology Center 96.93% Xol Jo 97.51% Kazakhstan 96.94% Kazakh Telecom 96.94% Kenya 51.73% Saix 51.76% Ses Astra 50.00% Kuwait 96.67% Fast Telecommunications Company WLL 95.55% Gulfnet Kuwait 97.23% Kuwait Data Center Co 96.69% Kuwait Telecommunication Company 97.08% Qualitynet 96.56% Wataniya Telecom 96.92% Latvia 98.15% Lattelekom Apollo 98.15% Lebanon 87.14% Cyberia 87.81% Idm 85.83% Sodetel Sal 91.50% Terranet Sal 83.44% Libya 91.93% Gptc 91.93% Lithuania 98.61% Teo Lt 98.61%

PAGE 34 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Luxembourg 91.64% Entreprise Des P Et T Luxembourg 97.03% Luxembourg Online 98.37% Ses Astra 72.96% Tango Mobile SA Lux 98.21% Macedonia 98.33% Makedonski Telekom 98.33% Madagascar 81.38% Gulfsat 81.38% Malaysia 95.97% Binariang Berhad 95.71% Celcom Internet Service Provider 94.58% Packet One Networks 96.04% Tm Net Internet Service Provider 97.56% Mali 79.72% Ikatel 79.72% Malta 98.36% Datastream International High Speed 98.33% Melita Cable 98.39% Mauritania 78.09% Mauritanian Telecommunication Company 78.09% Mauritius 91.70% Mauritius Telecom 91.70% Mexico 98.65% Megacable Sa De Cv 98.95% Uninet Sa De Cv 98.35% Moldavia 98.94% Moldtelecom 98.79% Starnet 99.08% Monaco 98.53% Monaco Telecom 98.53% Morocco 87.90% Itissalat Al Maghrib 92.51% Wana Corporate 83.29%

PAGE 35 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Nepal 95.51% Nepal Telecommunications Corporation Internet Services 95.51% Netherlands 98.36% Arcor Ip Network 100.00% Att Global Network Services Emea 98.35% Att Worldnet Services 99.20% Deutsche Telekom 98.84% Gps Technik 98.69% Kpn Internet Solutions 98.34% Orange Nederland 98.80% Telfort 98.93% Trans European Versatel Ip Transport Backbone 99.05% Upc Broadband 98.77% Verizon Business 94.10% Xs4all Internet 98.63% New Caledonia 97.27% Canl 97.19% Office Des Postes Et Telecommunications New Caledonia 97.34% New Zealand 97.75% Callplus Services Limited 98.05% Ecce Terram Internet Services 97.12% Netgate 98.81% Orcon Internet 97.68% Starhub Internet Exchange 99.64% Telecom Xtra Auckland 98.26% Vodafone Nz 95.64% Nigeria 83.13% Direct On Pc 76.26% Ipnx Nigeria Limited 88.41% Multi Links Telecommunications Limited 82.97% Starcomms Nigeria Limited 84.89% Norway 97.24% AS2116 Ventelo 93.37% Get Norway 97.42% Lyse Tele 96.94% Nextgentel 97.34% Opera Software Asa 99.56% Tdc Data Networks 97.38% Tele2 100.00% Telenor Business Solutions 98.54%

PAGE 36 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Verizon Business 96.05% Occupied Palestinian Territory 95.49% Jawwal 96.43% Palnet Communications 95.04% Paltel 95.01% Oman 94.49% Omantel Nap 94.49% Pakistan 95.91% Burraq Telecom 97.15% Linkdotnet Telecom Limited 95.79% National Wimax/ims Environment 96.18% Pakistan Telecommunication Company Limited 96.42% Transworld 94.85% Worldcall Telecom 95.05% Panama 98.03% Cable Onda 98.56% Cable Wireless Panama 97.51% Paraguay 95.34% Telecel 95.34% Peru 96.11% Telefonica Del Peru SAA 96.38% Telmex Peru 95.84% Philippines 94.70% Ayalaport Makati Inc / Data Center Operator 95.60% Bayan Telecommunications 89.01% Digital Telecommunications Philippines 96.08% Globe Telecom 95.47% Philippine Long Distance Telephone Company 96.52% Skycable Corporation 94.80% Smart Broadband 95.39% Poland 97.89% Multimedia Polska Spz Oo 98.35% Netia 98.29% Polish Telecom S Commercial Ip Network 97.64% Ptk Centertel 95.68% Upc Broadband 98.99% Vectra Technologie 98.57%

PAGE 37 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Polynesia 97.28% Mana 97.28% Portugal 98.23% Cabovisaosa 98.93% Novis Telecom 98.82% Optimus Portugal 97.39% Ptcom Comunicacoes Interactivas 98.93% Tmn 96.18% Tvcabo 99.09% Verizon Business 100.00% Vodafone Portugal 98.14% Puerto Rico 98.68% Centennial De Puerto Rico 98.51% Datacom Caribe 98.80% San Juan Cable 98.74% Qatar 97.42% Qatar Telecom Qtel 97.42% Reunion 96.71% Intercable Reunion 96.71% Romania 97.99% Astral Telecom 98.04% Hungarian Telecom ; Magyar Telekom 80.00% Moldtelecom 100.00% Rcs Rds 98.40% Rtd Romtelecom 98.53% Upc Broadband 97.98% Russian Federation 97.60% Belpak 96.22% Comstar Direct 98.46% Corbina Telecom 99.14% Ojsc North West Telecom 98.65% Southen Telecommunication 96.78% Telianet Europe 88.89% Rwanda 77.53% Mtn Network Solutions 77.53% Saudi Arabia 96.67% Awalnet 96.68%

PAGE 38 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Bayanat Al Oula 95.78% Etihad Atheeb Telecom Company 97.06% Saudinet 97.14% Senegal 93.93% Sonatel 93.93% Serbia 97.45% Invitel 100.00% Ipko Net 97.66% Kujtesa 96.29% Serbia Broadband 98.07% Telekom Srbija 97.70% Singapore 94.92% Globe Telecom 79.41% Magix Broadband Network 96.27% Mobileone 95.74% Pacific Internet Pte 95.78% Pccw Imsbiz 97.10% Scv Broadband Access Provider 96.42% Singnet 93.50% Starhub Internet Exchange 94.84% Slovak Republic 98.17% Invitel 99.23% Orange Slovensko 95.87% Slovak Telecom 98.72% Upc Broadband 99.21% Slovenia 97.91% Amis 97.78% Arnes 98.09% T 2 DOO 98.51% Telekom Slovenije Dd 97.25% South Africa 92.08% Is 93.66% Mtn Network Solutions 81.32% Netactive 94.43% Saix 94.47% Vodacom 93.36% Yebo 95.23% South Korea 94.82% Hanaro Telecom 97.74%

PAGE 39 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Korea Telecom 97.06% Lg Dacom Corporation 95.16% Samsung Networks 89.31% Spain 97.97% AS12479 Uni2 Autonomous System 97.63% Cableuropa Ono 98.34% Cogent Communications 96.30% Colt Telecommunications 100.00% Fawri 100.00% Ibernet Internet Access Network Of Tde 97.54% Jazz Telecom 98.61% Verizon Business 99.17% Vodafone 97.60% Sri Lanka 96.42% Sri Lanka Telecom Internet 96.42% Sudan 81.87% Kanar Telecommunication 82.27% Mobitel 79.02% Sudatel Internet Exchange 84.31% Sweden 98.10% Comhem Sweden 98.96% Dna Oy 100.00% Tdc Data Networks 97.39% Tele2 97.81% Telenor Business Solutions 98.89% Television Francaise 1 99.78% Telianet Europe 98.10% Telianet Sweden 97.60% Verizon Business 95.49% Switzerland 97.40% Cablecom 98.72% Colt Telecommunications 88.01% Pccw Imsbiz 87.50% Servicing Cable Network Customer In Ch 98.90% Sunrise Tdc Switzerland 98.36% Swisscom 97.94% Swisscom Fixnet 98.71% Verizon Business 97.71% Vodafone 75.00% Vtx Services 97.94%

PAGE 40 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Syria 81.39% Ste 81.39% Taiwan 97.27% Data Communication Business Group 96.55% Digital United 97.14% Taiwan Fixed Network Telco And Network Service Provider 98.13% Thailand 93.88% Asia Infonet Co Ltd/ True Internet Co 96.43% Maxnet Internet Service Provider Bangkok 94.51% Tot Public Company Limited 90.26% Uninet Th 94.33% Tunisia 93.18% Tunisia Backbone 93.18% Turkey 98.08% Dogan Iletisim Elektronik Servis Hizmetleri 97.83% Kocnet 99.25% Tellcom Iletisim Hizmetleri 98.83% Ttnet 97.74% Turkcell 96.73% Uganda 89.53% Mtn Network Solutions 89.53% Ukraine 98.01% Comstar Direct 97.78% Jsc Ukrtelecom 97.90% Volia 98.36% United Arab Emirates 92.38% Cyprus Telecommunications Authority 83.28% Emirates Integrated Telecommunications Company Pjsc Eitcdu 97.13% Emirates Internet 96.72% United States 96.83% 302 Direct Media 97.73% Administracion Nacional De Telecomunicaciones 100.00% Aol Transit Data Network 95.76% Aramco Services Company 100.00% Arcor Ip Network 100.00% Att Global Network Services Emea 97.90% Att Internet Services 98.42%

PAGE 41 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Att Worldnet Services 97.09% Beijing Province Network 84.17% Bell Canada 92.86% Bellsouthnet 98.47% Btnet Uk Regional Network 95.59% Cablevision Systems Corp 98.87% Cellco Partnership 97.51% Centennial De Puerto Rico 91.67% Centergate Research 97.63% Charter Communications 98.90% Clearblue Technologies 99.58% Cogent Communications 92.84% Colt Telecommunications 99.53% Comcast Cable Communications 98.89% Comcast Cable Communications Holdings 98.92% Cox Communicatons 98.95% Emirates Internet 98.46% Etb Colombia 99.10% Go Jor 97.82% Google 95.99% Hurricane Electric 93.65% Instituto Costarricense De Electricidad Y Telecom 94.23% Level 3 Communications 93.31% Netvision 96.34% Northrop Grumman 99.27% Opendns 95.61% Pccw Imsbiz 91.67% Qwest Communications Corporation 97.04% Radigrafica Costarricense 100.00% Road Runner Holdco 98.63% Samsung Networks 96.05% Singnet 100.00% Starhub Internet Exchange 94.57% Swisscom 100.00% Tata Communications 95.27% Tdc Data Networks 96.30% Tele2 100.00% Telenet Operaties NV 90.00% Telianet Sweden 96.73% Teliasonera 96.54% Telmex Chile Internet 97.70% Telus Advanced Communications 97.52% The Janet Ip Service 96.30%

PAGE 42 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com Trend Micro 99.77% Verizon Business 97.23% Verizon Internet Services 98.46% Yt Yemen Net 90.64% Uruguay 96.26% Administracion Nacional De Telecomunicaciones 96.26% Venezuela 96.19% Cantv Servicios Venezuela 97.24% Internet Cable Plus C A 98.06% Telcel Ca 93.27% Vietnam 98.02% The Corporation For Financing Promoting Technology 98.17% Vietel Corporation 97.05% Vietnam Posts And Telecommunications Vnpt 98.85% Yemen 93.06% Yt Yemen Net 93.06%

PAGE 43 > CLOUD PERFORMANCE FROM THE END USER www.cloudops.com