Webscale Computing Mike Culver

Amazon Web Services

Ideas Meet Pagers Scale as Fast as You Can How Do You Survive This? Don’t Do the Muck Web Services Are...

Building block services that allow developers to innovate and make money Infrastructure As a Service People As a Service Amazon Simple Storage Service Amazon Elastic Compute Cloud Amazon Simple Queue Service Amazon SimpleDB Alexa Web Services Alexa Web Information Service Commerce As a Service Alexa Top Sites Amazon Flexible Payments Alexa Site Thumbnail Service Alexa Web Search Platform Fulfillment Web Service Amazon Simple Storage Service ()

Highly scalable data storage in-the-cloud Programmatic access via web services API Simple to get going, simple to use Highly available and durable Pay-as-you-go: Storage: $0.15 / GB / month Data Transfer: starts at $0.18 / GB Requests: nominal charges Billions of Objects Stored

14 Billion

10 Billion 5 Billion 800 Million August 06 April 07 October 07 January 08 Amazon S3 Namespace

Amazon S3

bucket bucket

object object object object

bucket

object object Amazon S3 Namespace

Amazon S3

mculver-images media.mydomain.com

Beach.jpg 2005/party/hat.jpg img1.jpg img2.jpg

public.blueorigin.com

index.html img/pic1.jpg Internet Backup on a Stick Or Stick Backed Up on the Net? Open Source Backup Store Gazillions of Terabytes Amazon Elastic Compute Cloud (Amazon EC2)

Resizable compute capacity in the cloud Obtain and boot new server instances in minutes Quickly scale capacity, up or down, as your computing requirements change Full root access to a blank machine Simple Web service management interface Changes the economics of computing Predictions Cost Money

Infrastructure Cost $

You just Large lost Capital customers Expenditure

Predicted Demand

Opportunity Traditional Cost Hardware

Actual Demand

Automated Virtualization

time Three Flavors of Amazon Machine Images

Public AMIs: Use pre-configured, template AMIs to get up and running immediately. Choose from Fedora, Movable Type, Ubuntu configurations, and more

Private AMIs: Create an Amazon Machine Image (AMI) containing your applications, libraries, data and associated configuration settings

Paid AMIs: Set a price for your AMI and let others purchase and use it (Single payment and/or per hour) Three Amazon EC2 Choices

Small Large Extra Large Bits 32 64 64 RAM 1.7 GB 7.5 GB 15 GB Disk 160 GB 850 GB 1690 GB EC2 1 4 8 Compute Units I/O Medium High High Performance Firewall Yes Yes Yes $5 or $30,000 For a Prototype?

$30,000 worth of in-house servers

DISA paid a total of $5 Build Your Own Virtual ISP Operating Systems as a Service Hadoop and Amazon EC2 Scale From an Idea to 30 Million Users Users

100000

90000

80000

70000

60000

50000 Users 40000

30000

20000

10000

0 Amazon Simple Queue Service (Amazon SQS)

A distributed queue in the cloud Used for storing messages traveling between computers Reliable Runs within Amazon's high-availability data centers Messages are stored redundantly across multiple servers and locations Scalable to millions of messages a day Simple: Only 6 methods Platform agnostic Provides access control and message locking You Can’t Count On the Other End Being Up and Running

Amazon SimpleDB Limited Beta Databases Should Just Work But They’d Better Scale…

Easy: no administration Web Service API Flexible (no schemas) Scalable: create new domains as Your data grows Request throughput increases Durable Multiple nodes Replicated data centers …On a Low-Scale Budget

$0.14 per Machine Hour consumed (normalized to a circa 2007 1.7 GHz Xeon processor) Data transfer $0.10 per GB - all data transfer in Data Transfer Out (per GB) $0.18 <= 10 TB / month $0.16 - next 40 TB / month $0.13 > 50 TB TB / month Storage - $1.50 per GB-month Amazon SimpleDB

item description color material 123 Sweater Blue, Red 456 Dress shirt White, Blue 789 Shoes Black Leather

PUT (item, 123), (description, Sweater), (color, Blue), (color, Red) PUT (item, 456), (description, Dress shirt), (color, White), (color, Blue) PUT (item, 789), (description, Shoes), (color, Black), (material, Leather)

Query Domain = MyStore [‘description’ = ‘Sweater’] Learn More About AWS

Explore http://aws.amazon.com Read our blog at http://aws.typepad.com Email me at [email protected]