Open Cloud Computing A Case for HPC CRO NGI Day Zagreb, Oct, 26th
Philippe Trautmann HPC Business Development Manager Global Education @ Research Sun Microsystems, Inc. 1 • The Cloud • HPC and Cloud: any needs? • Cloud Computing from Sun • Getting Started
Agenda
2 ● The illusion of infinite computing resources ● The elimination of an up-front commitment The Cloud ● Pay for use of computing resources
3 What Does Cloud Mean?
“ A fundamental shift in the computing paradigm” - Steve Ballmer, CEO Microsoft “The return of the mainframe, and the mainframe is a set of computers. You never visit them, you never see them. But they're out there.” - Eric Schmidt, CEO Google “It's nothing more than a faddish term for the established concept of computers linked by networks. A cloud is water vapour” - Larry Ellison, CEO Oracle “You build your app, and you inherit our architecture” - Marc Benioff, CEO SalesForce.com
“The Truth Is Rarely Pure And Never Simple” -Oscar Wilde
4 Business Models
Public Private Hybrid
You don’t know You own the server, You own some who else is on the network and disk, parts and are same server, and decide who sharing some network or disk gets to run on it with parts, though in a that you are you controlled way
5 Application Domains
HPC Medical Intelligence
Finance Analytics Web Domains Drive Differences in Hardware and Software Architecture
6 Cloud Computing Layers Software as a Service Applications offered on-demand over the networkFaster (salesforce.com) time-to-market PlatformReduction as a Service of custom Developer platformsoftware with built-in services (GooglePay App only Engine) for what you Infrastructureuse as a Service Basic storage and Growcompute infrastructure capabilities offered as a service (Amazonwith business web services)
7 HPC market requirements
8
8 HPC Market Overview IDC HPC Application/Industry Forecast Servers Storage IDC Server Revenue by Vendor 2008 CAGR Application Segment 2009 ($K) 2013 ($K) (07-13) 2009 ($K) % of Mkt HP IBM SUN University Academic $1,800,235 $2,337,419 6.75% $571,344 16.27% Dell Govt. Lab $1,425,431 $1,863,896 6.93% $433,087 12.33% Other Sun Other Bio Sciences $1,217,297 $1,781,031 9.98% $652,271 18.57% HP CAE $952,761 $1,562,311 13.16% $455,087 12.96% Defense $871,585 $1,186,212 8.01% $414,288 11.80% DELL EDA $613,729 $948,920 11.51% $173,687 4.94% DCC & Distribution $576,228 $835,046 9.72% $269,913 7.68% Geosciences & Geo Engineering $529,772 $807,039 11.10% $222,042 6.32% IBM Weather $371,260 $545,329 10.09% $119,956 3.42% Economics /Financial $261,750 $421,115 12.62% $64,663 1.84% Chemical Engineering $223,468 $260,900 3.95% $88,262 2.51% Other $182,756 $140,644 -6.34% $20,227 0.58% IDC Estimates that for every $ spent on Servers ● Mechanical Design & Drafting $106,400 $98,205 -1.98% $27,568 0.78% An additional $.39 is spent on storage Total Revenue $9,132,672 $12,788,067 4.10% $3,512,395 100.00% ● An additional $.25 is spent on services
Server Revenue by IDC Competitive Segments 2009 CAGR DOWN SIDE Segment Price Range TAM $B (07 – 13) CAGR Supercomputer $500K and up $2.58 3.20% 1.50% Division $250K - $500K $1.30 1.60% -0.70% Department $100k - $250K $3.62 7.10% -0.04% Workgroup <100K $1.73 1.90% -0.06%
9 The Importance of HPC Organizations are Under Pressure • Reduce costs and increase efficiency • Improve quality and be first to market • Make better and faster decisions • Applications becoming increasingly computationally intensive • Required to run more and more of these applications • Need to analyze more and more data
HPC can solve these problems and is now a required technology to stay competitive 10 Limiting factors
• The “P” in HPC • Technical limitations – system, storage, interconnect, complexity • Exploding Data Requirements • Increasing fidelity of modeling and simulation • Instruments that spit out PetaBytes of Data • Requirement for collaborative research • Complexity of Use • Need reliable solutions that are easy to architect, deploy and use • Space, power and cooling issues
11 Barriers to HPC: Data Access
Exponential 2009 Data Growth 2011 Time to Compute
Time to Time Store to Time to Data Compute Store Data Time to Time to Load Data Load Data
You can only compute as fast as you can move the data
12 Barriers to HPC: I/O Bottlenecks – Application Enemy #1 • Prevents applications from scaling • Leads to poor overall application performance • Complex – CPU? Memory? Storage? Interconnect? Application? • Removing I/O Bottlenecks requires an end-to- end approach
• Is there a catch for Cloud computing here?
13 IDC: Cloud costs vs.DataCenter In H2 2009, IDC analyzed the costs of running 100% of a typical large businesses IT infrastructure in a DC versus the cloud: £30,000,000.00 Even with 3 year Final Score £25,000,000.00 refresh cycles of 30%, DC: £15M DC remains much Cloud: £26M cheaper £20,000,000.00
Data Centre £15,000,000.00 Cloud
£10,000,000.00
After year 3, £5,000,000.00 cloud costs exceeded the £0.00 DC Start Year Year Year Year Year Year Year Year Year Year up 1 2 3 4 5 6 7 8 9 10 cost 14 14 The Real Problems On The Horizon That Will Make Or Break Cloud Services Standards . Common standards on development, deployment, and migration/transition . Ability for businesses to move a system from one cloud to another – No Lock In
Differentiation . Different providers with different value propositions – Big vendors, Telcos, Hosting Providers…. . Specialization and the emergence of best of breed providers in specific areas
Competition . Price competition and eco system competition . No one dominant winner
15 Cloud Architecture Cloud Computing From Sun
16
16 Sun’s Strategy Develop the core technologies for Sun's Open Cloud Platform
Offer Services through Sun's public cloud service – the Sun Cloud
Work with service providers and enterprises to build their own clouds
Develop open standards
Build partnerships and communities
17 Cloud Architecture – Future User Apps and Services Internet Accessible APIs and UIs Customer Web Site
Database Queuing Identity JavaEE Service Service Service Service etc. Compute Storage Virtual Datacenter Application Catalog, Service Service Management Console Forums, Docs
Accounting, Billing and Metering
Virtualized Datacenter Management Layer
Servers Storage Network
Partner and Build
18 Building Robust Sun Cloud Ecosystem
Sun Cloud
19 Initial Public Cloud Roadmap Update 1 Storage, Compute Adds Identity, Queuing, Database services
Early Access H2 2009 Storage Compute
Internal Alpha Q2 2009 Storage Compute Sun Open Cloud Platform Q1 2009 Work with Customers on Product Version of Software in Public Cloud
20 Getting Started
21
21 Adopt Models & Standards
=
22 Prepare your IT Service Management e r e H
s u c o F
Faster, Better, Cheaper, Reduced Scope, or Someone Else's Problem?
23 Consider Adoption Strategies
Test and Development
Functional Offload (Batch Processes – TimesMachine)
Functional Offload (Storage – SmugMug)
Augmentation (Temporary Load – Animoto)
Web Service
24 Profile Applications & Workloads
Suitable for cloud Not suitable for cloud • Time based • Vertically scaled applications • Very parallel (i.e. batch) • Consistent load levels • Spiky traffic • Latency sensitive applications • Capital intensive (especially startup) • Insecure applications • Proof of Concept • Hardware device dependent (e.g. fax server, SNA • Low utilization gateway) • Less deployment costs • ISV unsupported • High bandwidth costs / • Per CPU licensed high real estate applications 25 Getting Started Today
• Participate in the Development of our Open Cloud APIs • Sign up for Early Access to Sun Cloud Services • Become a Sun Cloud Partner • Let Sun experts help you take advantage of Cloud Computing
http://sun.com/cloud
26 THANK YOU! [email protected] sun.com/hpc
27