IBM Platform Computing Cloud Service Ready to Use Platform LSF & Symphony Clusters in the Softlayer Cloud
Total Page:16
File Type:pdf, Size:1020Kb
Platform Computing IBM Platform Computing Cloud Service Ready to use Platform LSF & Symphony clusters in the SoftLayer cloud February 25, 2014 1 © 2014 IBM Corporation Platform Computing Agenda v Mapping clients needs to cloud technologies v Addressing your pain points v Introducing IBM Platform Computing Cloud Service v Product features and benefits v Use cases v Performance benchmarks 2 © 2014 IBM Corporation Platform Computing HPC cloud characteristics and economics are different than general-purpose computing • High-end hardware and special purpose devices (e.g. GPUs) are typically used to supply the needed processing, memory, network, and storage capabilities • The performance requirements of technical computing and service-oriented workloads means that performance may be impacted in a virtualized cloud environment, especially when latency or I/O is a constraint • HPC cluster/grid utilization is usually in the 70-90% range, removing a major potential advantage of a public cloud service provider for stable workload volumes HPC Workloads Recommended for Private Cloud HPC Workloads with Best Potential for Virtualized Public & Hybrid Cloud Primary HPC Workloads 3 © 2014 IBM Corporation Platform Computing IBM’s HPC cloud strategy provides a flexible approach to address a variety of client needs Private Hybrid Public Clouds Clouds Clouds Evolve existing infrastructure to Enable integrated HPC Cloud to enhance approach to improve Access additional responsiveness, HPC cost and HPC capacity with flexibility, and capability variable cost model cost effectiveness. 60% Based on HPC Cloud’s potential impact, organizations are evolving their infrastructures to enable private cloud deployments, exploring hybrid clouds, and considering public clouds. 4 © 2014 IBM Corporation Platform Computing Are you experiencing any of these pain points? • Unable to meet business objectives (delay to market, etc.) • Existing resources insufficient to meet peek compute demand – Long run times on existing cluster or grid – No access to local technical computing resources (workstation users) • Technical resources expensive and time consuming to acquire • The skills/staff to architect and manage a technical computing infrastructure can be difficult to acquire Planned Daily Cycle (24 x 365) Planned Project 50,000 1600 1400 40,000 1200 30,000 1000 800 20,000 600 400 10,000 200 - 0 1 4 7 10 13 16 19 22 April May June Financial Services Life Sciences 5 © 2014 IBM Corporation Platform Computing IBM Platform Computing Cloud Service Making the cloud work for you Build Manage Support Protect • Complete, ready to run • Seamless workload • 24X7 cloud operation • Data encryption, clusters in the cloud management, on- support dedicated physical • Add additional capacity premise and in the • Access to technical machines and network in hours instead of cloud computing expertise • Security through months • Transparent user when you need it physical isolation experience Complete, end to end dynamic cloud solution 6 © 2014 IBM Corporation Platform Computing Ready to use Platform LSF & Platform Symphony clusters in the cloud Client and ISV Applications IBM Platform Computing Cloud Service (SaaS) IBM Platform IBM Platform LSF Symphony SoftLayer, an IBM Company Infrastructure 24X7 CloudOps Support 7 © 2014 IBM Corporation Platform Computing Dedicated physical and virtual machine infrastructure as a service • 13+ data centers • 17 network PoPs 190,000+ 21,000+ 22,000,000+ SERVERS CUSTOMERS DOMAINS • Global private network • Bare metal and virtual machines 8 © 2014 IBM Corporation Platform Computing Ready to use Platform LSF & Platform Symphony clusters in the cloud DIFFERENTIATOR RATING IBM ADVANTAGES • SoftLayer’s architecture outperforms by >50% equivalent Workload I/O intensity Low High intensity AWS instances for high I/O intensity workloads workloads workloads • SoftLayer offers hundreds of Control (APIs, hardware configurations vs. 14 hardware / network Low degree of High degree of for AWS configurability) control and control and • ~2,000 APIs for SoftLayer vs. ~60 customization customization for AWS and none for RAX • Unified integration & control panel for multiple cloud Integrated platform of architectures multiple architectures Single platform Seamless integration • RAX requires paid bridge, different control interfaces AWS RAX IBM 9 © 2014 IBM Corporation Platform Computing Non-shared physical machines for added security and performance • Dedicated and isolated compute environment • All machine instances are dedicated to the client • Each cluster is isolated on a VLAN • Only the VPN gateway has an addressable interface • All customer data at rest is encrypted on shared file systems • When machines instances are decommissioned the disks are scrubbed using DoD approved methods 10 © 2014 IBM Corporation Platform Computing Optimal performance for technical computing apps EDA Benchmark (IBM-MESA) Industrial Manufacturing Benchmark – Structural Mechanics Note: Benchmark results were obtained by IBM and have not yet been externally 11 audited or validated. © 2014 IBM Corporation Platform Computing Run and supported by dedicated, 24X7 HPC Cloud Operations Team CloudOps functions • Pre-provisioning: Provide guidance to client on how to enable VPN, multi-cluster settings & security settings on the client on-premise environment • One time setup testing: Extensive testing of the cluster prior to release to the client • Extensive testing of the cluster on every event of flex-up prior to release to the client • Email alerts prior to flex-down & cluster shutdown operations • Email alerts in case of any overage (compute hours, download bandwidth) • Provide billing details of monthly usage including overage details • Provide support under IBM SLA by experts highly experienced in Platform Computing products Value: quality, peace of mind & minimum disruption to business • Extensive quality checks ensures minimum loss of usage hours & disruptions • Proactive alerts ensures that in-progress critical jobs are not killed in case of Flex-down & Cluster Shutdowns and Overages • Highly trained & experienced Support ensures smooth on-boarding and minimize disruptions 12 © 2014 IBM Corporation Platform Computing Industry-leading workload management • 20 years managing distributed scale-out systems with 2000+ 23 of 30 customers in many industries largest commercial • High performance workload management combined with enterprises intelligent resource scheduling engine 60% of top • Unmatched scalability (small clusters to global grids) and financial production-proven reliability services companies • Heterogeneous – manages System x and Power plus 3rd party systems, virtual and bare metal, accelerators / GPU, cloud, etc. Over 5M • Shared services for both compute and data intensive workloads CPUs under management • Integrated solutions with vertical reference architectures 13 © 2014 IBM Corporation Platform Computing IBM Platform LSF Overview Powerful workload management for demanding, distributed and mission-critical high performance computing environments. Key Capabilities • Powerful - Policy and resource-aware scheduling - Resource consolidation for optimal performance - Advanced self-management • Flexible - Heterogeneous platform support - Policy-driven automation - CLI, web services, APIs • Scalable - Thousands of concurrent users and jobs - Virtualized pool of shared resources - Flexible control, multiple policies Client Benefits • Optimal utilization: reduced infrastructure cost • Robust capabilities: improved productivity • High throughput: faster time to results 14 14 © 2014 IBM Corporation Platform Computing IBM Platform Symphony Overview Low-latency grid management platform for distributed computing and analytics with sophisticated resource sharing Key Capabilities • Accelerates service-oriented applications • Extreme app scalability and throughput with very low latency • Compute and data-intensive applications on a single platform • Sophisticated, hierarchical resource sharing • Open and flexible: choice of OS, frameworks and Low Latency / High throughput Sub-millisecond, 17,000 tasks per second languages Large Scale Client Benefits 10k cores per application, 40k cores per grid Efficient shared services • Increase performance and analytic result quality Heterogeneous & Open • Reduces IT costs - increase utilization, simplify Linux, Windows, AIX, C/C++, C#, Java, Excel, application onboarding, reduce administration costs Python, R 15 15 © 2014 IBM Corporation Platform Computing Use case 1 – hybrid cluster The problem • Existing resources cannot meet peak demand • Resources are expensive and time consuming to acquire • Skills to architect and manage clusters are difficult to find • Fixed or reduced budgets • On-premise constraints in space, cooling and power The solution • Fully functioning IBM Platform LSF or Symphony clusters are provisioned on the SoftLayer cloud and connected to the on- premise cluster, expanding capacity as needed • Leverage MultiCluster capability for managed forwarding of jobs from on premise cluster to off premise cluster The Value • Access to additional compute capacity on a temporary basis as needed • Near-zero wait times • Reduce costs by paying for only what is used • Pay for additional capacity as an operating expense • Fully supported, end-to-end solution, from the on-premise to the on-cloud clusters • Expected and reliable performance from running technical computing workloads on physical machines • Transparent access to cloud resources, the end user