DB2 10.5 and Puredata Update and Strategy

#IDUG

DB2 10.5 and PureData Update and Strategy

Les King Director, Big Data, Analytics and Database Solutions

Session Code: D10 Thu, September 11, 2014 (16:00 – 17:00)| Platform: DB2 for Linux, UNIX, and Windows #IDUG

Agenda

• PureApplication System • Positioning

• PureData System for Transaction • Current State

• PureData System for Analytics • Latest Releases

• PureData System for Operational Analytics • Roadmap

• PureData System for Hadoop

#IDUG

The PureSystems Family

Infrastructure Application Platform Data Platform

Delivering Infrastructure Services Delivering Platform Services Delivering Data Services #IDUG

Simplified, integrated system management – Full Appliance

Single pane of glass • Consistent IBM PureSystem console to manage all resources and workloads • Role-based security and tasks • Easy integration with data center monitoring tools and processes • System firmware and OS updates applied with no planned downtime • Single point of contact for support • Single order part number

4 #IDUG

The PureSystems Family

Infrastructure Application Platform Data Platform

Delivering Infrastructure Services Delivering Platform Services Delivering Data Services #IDUG

6 IBM PureApplication System A Simple, Efficient, Flexible, Virtualized Application Platform

Complete, Ready-to-Go Systems

• Pre-integrated, up and running in <4 hours Manual, brittle Best practice, pattern-based • Pre-optimized for enterprise application workloads Deploy Simplify Ongoing Tasks OS, runtime, Policy based elasticity, • Single point of platform and application resources single view management • Repeatable self service application Manage provisioning Manual optimizations on-site Pre-optimized by experts Built for Cloud • “Platform as a Service” • Elastic application Optimize • On-premise #IDUG

IBM PureApplication System provides savings across the IT lifecycle Labor Hours Spent* How does PureApplication 10000 9612 hrs System do this?

Deployment .Deployment Incident/capacity Mgmt . Fully assembled and configured . Pre-installed management software Asset Management . Fast pattern-based deployment Security Management Change Management .Incident/capacity management . Centrally monitor and resolve issues . Automatic scaling 5000 .Asset management 76% . Track license usage of products Savings 2302 hrs .Security management . Centralized access control

.Change management . Visibility into relationships of virtual 0 images in a workload Do It Yourself PureApplication System . Automatically apply changes to desired virtual servers *Note: Do It yourself used 9 blades (144 cores). IBM PureApplication System used 3 nodes (96 cores). Each system has the capacity to run 72 workloads where each workload can sustain a peak throughput of 1720 page elements per second. This is an IBM internal estimated labor study based on modeling customer data on IBM hardware and software solutions and on competitor converged solutions designed to replicate typical IBM customer usage in the marketplace. It is not a benchmark. As such, customer applications, differences in stack deployed and other systems variations may produce different results and may vary based on actual configuration, applications, specific queries and other variables in a production environment based on published standard labor rates for IT staff. #IDUG

New DB2 10.5 News in the PureApplication System

Workloads (Virtual Applications) • Application awareness DB2 10.5 Images Topologies • Fully integrated software (Virtual Systems) stacks Images • IBM defined product images • IBM defined topologies (Virtual Machines) and patterns for common • Simplified interaction model topologies • Highly standardized and • Basic execution services for • Ability to create custom automated standalone VM images patterns • Integrated middleware with • Complete control over image • Traditional configuration and cloud capabilities contents administration model • Integrated lifecycle • Basic image • Aligned around existing management management/library functions products • IBM provided product images • Automated provisioning of • Ability to create custom images into patterns images Integrated middleware with cloud • Leverages IBM image capabilities management tools

Automated provisioning of middleware DB2 10.5 OLTP Pattern Image Management DB2 10.5 Analytics Pattern with BLU Acceleration 8 BI Patterns which include DB2 10.5 with BLU Acceleration #IDUG

PureApplication System Patterns Available

• IBM BI Pattern with BLU Acceleration V1.0 (includes both DB2 and Cognos) • https://www-304.ibm.com/software/brandcatalog/ puresystems/centre/details?uid=PPA_D124VLLM

• IBM Business Intelligence Pattern V2.0 (includes Cognos only) • https://www-304.ibm.com/software/brandcatalog/ puresystems/centre/details?uid=PPA_D0NWGLL

• IBM Data Mart Pattern V1.1 (includes DB2, with 5 user Cognos licenses) • https://www-304.ibm.com/software/brandcatalog/ puresystems/centre/details?uid=PPA_D0LJGLL

• Other DB2 patterns available • IBM Transactional Database Pattern • IBM DB2 Enterprise Server Edition #IDUG

The PureSystems Family

Infrastructure Application Platform Data Platform

Delivering Infrastructure Services Delivering Platform Services Delivering Data Services #IDUG

IBM PureData Systems – Family Members

Meeting Big Data Challenges – Fast and Easy!

For apps like Customer Analysis… System for Analytics Data warehouse services optimized for high-speed, peta-scale analytics and simplicity Powered by Netezza technology For apps like Real-time Fraud Detection… System for Operational Analytics Operational data warehouse services optimized to balance high performance analytics and real-time operational Powered by DB2 technology throughput

For apps like E-commerce… System for Transactions Database cluster services optimized for transactional throughput and scalability Powered by DB2 technology

For Exploratory Analysis & Queryable Archive System for Hadoop Hadoop data services optimized for big data analytics and online archive with appliance simplicity Powered by Big Insights technology #IDUG

IBM PureData Systems – Family Members

Meeting Big Data Challenges – Fast and Easy!

For apps like E-commerce… System for Transactions Database cluster services optimized for transactional throughput and scalability Powered by DB2 technology

13 IBM Netezza’s Market-Leading Evolution PureData System for Analytics

PureData System for Analytics Striper World’s fastest and “greenest” analytical platform

World’s First TwinFin™ with i- Analytic Data Class™ Warehouse Advanced Analytics Appliance TwinFin™ World’s First Petabyte Data Warehouse Appliance

World’s First 100 TB Data NPS® Warehouse 10000 Series Appliance

World’s First Data Warehouse NPS® Appliance 8000 Series 2003 2006 2009 2010 2011 2013 #IDUG

What Makes PureData System for Analytics Different?

Up to 2000X faster than before “Netezza has allowed us to reduce the complexity Speed of regulatory reporting and processing of Growing by 30% every month exchange data from days down to minutes.”

Up and running 6 months before having any training “Allowing the business users access to the Simplicity Netezza box was what sold it.” 200X faster than Oracle system - Steve Taff, Executive Dir. of IT Services ROI in less than 3 months

“NYSE … has replaced an Oracle IO 1 PB on Netezza relational database with a data 7 years of historical data warehousing appliance from Netezza, Scalability 100-200% annual data growth allowing it to conduct rapid searches of 650 terabytes of data.” - ComputerWeekly.com

“Once we had the data on Netezza we were SUNY Buffalo researchers reduced able to do the same analysis and much more the time to perform quintillions of complex analysis in minutes. The research Smart draws on medical records, lab results, MRI computations from 27 hours to 12 scans, and patient surveys.” minutes - Dr. Murali Ramanathan, SUNY Buffalo #IDUG

15 IBM PureData System for Analytics Optimized exclusively for analytic data workloads Speed . 10-100x faster than traditional custom systems* System for Analytics . Patented, hardware accelerated MPP (Massively Parallel Processing) Delivering data services Simplicity . Data load ready in hours for analytics . No database indexes . No tuning . No storage administration Scalability . Peta-scale data capacity* Smart . Designed to runs complex analytics in minutes, not hours . Richest set of in-database analytics

• Based on IBM customers' reported results. "Traditional custom systems" refers to systems that are not professionally pre-built, pre-tested and optimized. Individual results may vary. • Peta Scale capacity offered in the N1001 model #IDUG

16 Benefits of the IBM PureData System for Analytics The fastest performance of Netezza technology to date!

Accelerate . Accelerate Big Data Analytics with 3X faster Performance performance1 . Tackle Big Data faster than ever before with 128 of Analytic Queries GB/sec effective scan rate per rack2

. Optimize data center efficiency with 50% greater Increase Efficiency data capacity per rack3 of your Data Center - More capacity and less power per rack than both Oracle and Teradata

Simplicity and . Spend less time managing and more time delivering Ease of innovation improved system resilience and Administration workload management tooling

1 Based on a comparison of the IBM PureData System for Analytics N2001 to the IBM PureData System for Analytics N1001. The performance speed refers to the query times on both macro-analytic and mixed workload tests as conducted in IBM engineering lab benchmarks. The N2001 query times were an average of 3x faster than those of the N1001. Individual results may vary. 2 128 GB/sec scan rate assuming an average of 4x compression across the system. Individual results may vary. 3 Capacity of IBM PureData System for Analytics N2001 compared to previous generation IBM PureData System for Analytics N1001. #IDUG

PureData System for Analytics N200x Latest generation Netezza appliance

PureData for Analytics provides:

• Fastest Time to Value on the market today • Optimized Big Data analytics performance • Simple administration for fast and agile deployment • Accelerate analytic performance using large library of analytic functions #IDUG

18 Benefits of the IBM PureData System for Analytics N200X The Fastest Performance of Netezza Technology to Date!

Accelerate . 128 GB/sec effective scan rate per rack1 Performance (3x faster than N1001)2 to tackle Big Data faster of Analytic Queries

Increase Efficiency . 50% greater data capacity per rack3 helps optimize data center efficiency of your Data . More capacity and less power per rack than both Oracle and Teradata Center

. Improved system management and resilience Simplicity and to spend less time managing and more time delivering value Ease of . 70% FEWER service calls Administration with more spare drives and faster disk regeneration4

1 128 GB/sec scan rate assuming an average of 4x compression across the system. Individual results may vary. 2 Based on a comparison of the IBM PureData System for Analytics N200x to the IBM PureData System for Analytics N1001. The performance speed refers to the query times on both macro-analytic and mixed workload tests as conducted in IBM engineering lab benchmarks. The N200x query times were an average of 3x faster than those of the N1001. Individual results may vary. 3 Capacity of IBM PureData System for Analytics N200x compared to previous generation IBM PureData System for Analytics N1001. 4-Each N200x rack contains 34 hot spare drives and 240 active drives for a ratio of 1 spare per 7 drives. Each N1001 rack contains 4 hot spare drives and 92 active drives for a ratio of 1 spare per 23 drives. The N200x has 3.3x more spares per active drive. Frequency of disk related service calls expected to decrease by 70% assuming the same drive failure rates. #IDUG

19 PureData System for Analytics Hardware Overview: N200x

12 Disk Enclosures . 288 600 GB SAS2 Drives • 240 for User Data • 14 for S-Blades • 34 Spare . RAID 1 Mirroring

2 Hosts (Active-Passive)

. 2 Intel 2.7 GHz Sandy Bridge CPUs

Scales from . 7x300 GB SAS Drives . Red Hat Linux 6 64-bit ½ Rack to 4 Racks 1

7 PureData for Analytics S-Blades™

. 2 Intel 8 Core 2+ GHz CPUs

. 2 8-Engine Xilinx Virtex-6 FPGAs . 128 GB RAM + 8 GB slice buffer . Linux 64-bit Kernel

. User Data Capacity: 192 TB2 . Power Requirements: 7.5 kW . Data Scan Speed: 478 TB/hr* . Cooling Requirements: 27,000 BTU/hr . Load Speed (per system): 5+ TB/hr

1Clients interested in a smaller entry point should refer to the N2002-002 model 2Assuming 4X compression #IDUG

Simplicity and Spend Less Time Managing and More Time Innovating Ease of Administration

 Easy Administration Portal  No software installation  No indexes and tuning  No storage administration

. No dbspace/tablespace sizing and configuration . No redo/physical/Logical log sizing and configuration . No page/block sizing and configuration for tables . No extent sizing and configuration for tables . No Temp space allocation and monitoring . No RAID level decisions for dbspaces . No logical volume creations of files . No integration of OS kernel recommendations . No maintenance of OS recommended patch levels Data Experts, not . No JAD sessions to configure host/network/storage Database Experts #IDUG

Simplicity and IBM Netezza Performance Portal 2.0 Ease of Consolidating WebAdmin and Portal for Simple Admin Administration

• Simple web user interface • Part of the PureData System for Analytics • Monitor System Resources

• New functional and usability enhancements • Perform System Administration • Administrative Functions • Understand & Predict Capacity • Hardware view & alerts • Database objects administration • User & Group management • View active sessions • Workload Management • View Events • Table skew/storage search • Capacity Planning

• Monitor enhancements • Usability improvements – allow to resize monitors and mark not-monitored periods

• Customer requested improvements • Show locks #IDUG

IBM zEnterprise and DB2 Analytics Accelerator Driving revolutionary change

The hybrid computing platform on zEnterprise Transactional

Processing  Supports transaction processing and analytics workloads concurrently, efficiently and cost- Analytics effectively Workload  Delivers industry leading performance for mixed workloads

DB2 Analytics Accelerator and DB2 for z/OS

A self-managing, hybrid workload-optimized database management system that runs each query workload in the most efficient way, so that each query is executed in its optimal environment for greatest performance and cost efficiency #IDUG

IBM DB2 Analytics Accelerator Delivering critical insight at the speed of business

The high performance appliance that integrates Netezza technology with zEnterprise technology to deliver dramatically faster business analytics

What does it do? What’s new in Version 4.1? • Accelerates complex queries up to 2000x . Accelerate a broader spectrum of queries faster including Static SQL and multi-row FETCH • Improves access to historical data and lowers . Improved Enterprise Robustness & the cost of storing, managing and processing Scalability with enhanced workload historical data balancing, improved incremental update • Minimizes latency performance and enhanced monitoring • Reduces zEnterprise capacity requirements . High Performance Storage Saver - improved • Improves security and reduces risk ease of use with built-in restore, better access • Complements existing investments control for archived partitions and protection of moved partitions . And more . . . #IDUG

IBM DB2 Analytics Accelerator Do things you could never do before

Run the entire spectrum of workload on a single platform • Hybrid computing environment that supports high-volume business transactions, batch reporting and complex analytic queries all running concurrently • Transparent to the application and reporting tools - the DB2 for z/OS optimizer automatically routes complex queries to the Accelerator • Inherits DB2 for z/OS attributes, extending DB2 qualities of service to analytic workload • No changes required to applications or tools • No need to create or maintain indices • Eliminate complex analytic query tuning • Fast deployment and time-to-value • Install the appliance, populate the Accelerator with DB2 data and begin reaping the benefits of high-performance decision making! #IDUG

zEnterprise Analytics with DB2 Analytics Accelerator Impacts the Bottom Line

Grew profitability by adding customers and keeping IT costs constant

Helped meet corporate growth objectives by identifying business areas with untapped demand

Increased retail sales revenue through point-of -sale suggest-sell insight #IDUG

IBM PureData Systems – Family Members

Meeting Big Data Challenges – Fast and Easy!

For apps like E-commerce… System for Transactions Database cluster services optimized for transactional throughput and scalability Powered by DB2 technology

27 IBM DB2’s Market-Leading Evolution PureData System for Operational Analytics

Mixed Workloads PureData for PureSystems Operational branding; single Extreme Compression Analytics ( PDOA ) admin; single PID Extreme Performance

Oracle Application Compatibility Integrated purchase NOSQL process; bundled IBM Smart Analytic support & services SAP System ( ISAS )

Broader Software InfoSphere capabilities and Balanced tighter h/w Warehouse ( IBW ) integration Balanced Prescriptive Best Configuration Unit Practices for WH ( BCU ) environments Multi-temperature Data Partitioning MDC, Autonomics, Range Partitioning, storage; Real-time BLU Acceleration Software Feature ( DPF ), Simplified Admin, Active Warehousing, Warehousing, leveraging columnar Innovations in Optimization for pureXML, Cubing Compression, WLM, Temporal and “in-memory”, Warehousing mixed workloads Services, Mining Cognos, ETL Analytics NOSQL, Big Data 2003 2006 2009 2010 2011 2013 #IDUG

Distinctive Value of DB2

“The reduction in database size means we won’t have to invest in new storage hardware for some time. More importantly, performance has improved significantly: query response times have been reduced by 25 percent, batch and reporting processes by 44 percent, and backups by 71 percent. We’re no longer struggling to complete our overnight processes, and users are seeing a noticeable improvement in real-time performance,” -- Franz Moser, chief information officer, Maschinenfabrik Reinhausen

"We were really impressed with the improvement in the performance of our SAP production systems that was possible with the IBM DB2 software compared with the former Oracle database environments," -- Joachim Wolf, business application manager, Treofan Germany GmbH & Co. KG

“By using DB2 Deep Compression during the migration from Adabas, Oracle and other data sources, Newell Rubbermaid has achieved average database compression ratios of 58 percent, and average savings per SAP NetWeaver Business Warehouse instance of some 1.2TB. In production systems, Newell Rubbermaid has realized close to 80 percent reduction in size for the largest tables.” -- Creighton Kelly, Director of IT for the SAP Infrastructure, Newell Rubbermaid

“We tested the new Adaptive Compression feature of DB2 10 with one of our SAP Enterprise Resource Planning applications. The compression ratio is almost 77%, which will hugely reduce storage consumption. The Adaptive Compression feature can be implemented without offline reorg, which means we’ll have less down time and that the feature will be easy to use." -- Eric Xu, DB2 DBA, Mindray Medical International Limited

"IBM DB2 offers massively improved functionalities when compared to Oracle, and helps to reduce database administrative workload by around 30 percent." -- Iwan Nussbaumer, Head of ICT, IWB #IDUG

29 IBM PureData System for Operational Analytics Optimized exclusively for operational analytic data workloads

Speed . Designed for 1000+ concurrent operational queries System for Operational Analytics . Continuous ingest of operational data . MPP analytics (Massively Parallel Processing) Delivering data services for Simplicity operational analytics . Fast time-to-value . Automatic workload management . Integrated backup on the system . Integrated management and support Scalability . Multiple sizes with data capacity up to a Petabyte Smart . In-database analytics for leading applications . Supports DB2 applications unchanged and Oracle Database apps with minimal change . Clients have experienced cases of 10x storage space savings via Adaptive Compression #IDUG

30 PureData System for Operational Analytics Hardware

. IBM POWER7 P740 & P730 16 Core servers @ 3.55GHz

. IBM Storwize® V7000 with Scales to

900GB drives PB+ .Ultra SSD I/O Drawers, each with capacity* six 387GB SSD

. Blade Network Technologies 10G and 1G Ethernet switches .Brocade SAN switches (SAN48B-5) #IDUG

31 PureData System for Operational Analytics – Models and Sizes

PureData System for Operational Analytics: Standard Sizes Extra Small Small Medium Large Data Nodes 0.5 1.5 2.5 3.5 Active Data 13TB 33.8TB 54.6TB 75.4TB Usable Space (TB) Backup / Cold 25.7TB 66.9TB 108.1 TB 149.3 TB Usable space (TB) Total Usable 38.7TB 100.7TB 162.7TB 224.7TB Space*

* Total Uncompressed Usable Space after RAID6 data protection and formatting DB2 Provides up to 10x Data Compression #IDUG

32 DB2 10.5.0.4 – BLU Shadow Tables – GA: Aug, 2014 DB2 Cancun Release - Full support of any workloads

Traditional row-based tables, with indexes for, for tables dedicated to + OLTP or Operational Analytics

Simple BLU tables ( columnar ) for tables dedicated to analytics and reporting workloads

Traditional row-based tables, with indexes and BLU Shadow Tables + + for tables with mixed workloads

Single Server • Power of BLU All 3 scenarios in a single database • Faster analytics and reporting • Faster OLTP – up to 2X • Simpler environment #IDUG

33 DB2 10.5.0.4 - BLU Other Enhancements DB2 Cancun Release – Significant enhancements with BLU Acceleration Oracle Application Compatibility Layer SAP BW Certification Phase 2

450 100 85.3 86.5 400 81.5 90 Number Reports 77.9 76.4 350 80 %-Obj Compat 300 70 60 • DSO Support 250 %-Stmt Compat 50 • 200 Linear (%-Obj Compat) Transactional InfoCube 40 150 30 • Flat InfoCube 100 20 • ETL Performance Improvements 50 96.6 94.7 96.6 95.6 97.2 10 0 0 • Additional compression 9.7.2 9.7.3 9.7.4 9.7.5 10.1

HADR Support Power 8 Exploitation

• Processor exploitation • Memory exploitation • Multiple Stand-bys • SIMD • All sync modes • Policy based Workload Management • Time delay • Automatic Storage exploitation • Automatic client reroute • Cognitive Compilation • Faster range predicates • Financial Calculations Performance • Integrity and Reliability • Increased Concurrency #IDUG

Analytics Platforms and Analytic Accelerators

Appliances Accelerators

PureData for Analytics powered by Netezza -

PureData for Operational Analytics Leveraging DB2 DB2 for z/OS

Software >90% of OLTP systems have reporting running on them DB2 with BLU Acceleration >50% of OLTP systems have analytics running on them Customized Software Address the demands of these “mixed workload” environments Multi-tenancy Virtual Environments

Informix C Warehouse loud Accelerator Informix BLU Acceleration for Cloud

Informix #IDUG

PureData for Analytics vs DB2 with BLU

DB2 with BLU

• Available on Unix PDA Many workloads can be handled by • SAP • Commodity HW both • Mixed Workloads • Scalability to PBs Decide based on • Software only •Appliance preference, skills, etc • Cloud •Deep analytics Simplicity • Handles NOSQL •Built-in function Analytics & • Oracle compatibility •Cost Considerations Reporting •Investing in new HW •Cost Consierations •Maintenance •Leverage existing HW •DBA Costs •Existing DB2 licenses

#IDUG

IBM PureData Systems – Family Members

Meeting Big Data Challenges – Fast and Easy!

For apps like Customer Analysis… System for Analytics Data warehouse services optimized for •Mergehigh- speed,into a singlepeta-scale PureData analytics for andAnalytics simplicity Powered by Netezza technology •Includes BLU Acceleration •BestFor of appsboth worlds like Real( DB2- time+ Netezza Fraud ) Detection… •Investment protection System for Operational Analytics Operational data warehouse services optimized to balance high performance analytics and real-time operational Powered by DB2 technology throughput

For apps like E-commerce… System for Transactions Database cluster services optimized for transactional throughput and scalability Powered by DB2 technology

IBM PureData Systems – Family Members

Meeting Big Data Challenges – Fast and Easy!

For apps like E-commerce… System for Transactions Database cluster services optimized for transactional throughput and scalability Powered by DB2 technology

Optimized exclusively for transactional data workloads System for Transactions

• Handles 100+ databases on 1 system • Up to 30x database scalability • Up to 10x storage space savings

• Database node recovery in seconds • Supports DB2 applications unchanged • Supports Oracle Database applications with minimal change

#IDUG

39 Simplified deployment of high availability

Uninterrupted access to data with consistent performance

Traditional systems PureData System - build it yourself with built-in expertise 6-node database Over several days/weeks: In minutes, 1. Define High Availability topology cluster 1. Just specify database, 2. Configure HW/SW/Network description and 3. Set up storage pools topology pattern 4. Install multiple operating systems 5. Install database instances 6. Set up primary and secondary management systems 7. Set up database members 8. Set up backup processes 9. Test, tune, reconfigure #IDUG

40 Simplified deployment of multi-tenant databases

Deploy topology and databases in minutes using patterns

Topology patterns pureScaleTM Instances Automatically creates, configures and deploys a database system topology with built-in redundancy and high performance

Database patterns

Automatically creates, configures and deploys IBM or client-specified databases optimized for transactional workloads #IDUG

41 Pay As You Grow pricing model, no new Development

Existing parts and BOM New part only: min entitled nodes New part only: adding an extra pair of notes New part only: adding extra disk space, M->L M->min L Usable no extra nodes

disk, TB

73.6

extra pair extra pair extra pair extra

S->M S->min M

extra pair extra pair extra pair extra

36.8

extra pair extra pair extra pair extra

18.4

Small Medium min Medium Large min Large nodes

extra pair extra pair extra min Smallmin 6 or 2 4 6 12 or 6 8 10 12 24 or 12 14 ... 24 #IDUG

IBM PureData System for Transactions Disaster Recovery FP3 Enhancement (GA: July 2013) • Simple to setup, configure, and manage • Online Enablement -- No outage required on existing system • Support includes • ASYNC and SUPERASYNC modes • Time delayed apply • Log spooling • Both Planned (non-forced - role switch) and Unplanned (forced) takeovers • Zero data-loss (Recovery Point Objective = 0) provided for Planned takeovers • Near-Zero data-loss provided for Unplanned takeovers

CF CF

Primary Instance CF CF

Standby DR Instance #IDUG

43 pureScale with TCP/IP Interconnect (pureScale "Lite") DB2 10.5 FP4 enhancement ( 10.5.0.4 ) – GA: August, 2014 ( SW Only today )

• TCP/IP (sockets) interconnect for faster cluster setup and lower cost deployments using commodity network hardware

• Provides exactly the same level of high availability as RDMA-based pureScale environments

• Appropriate for small clusters with moderate workloads where availability is the primary motivator for pureScale

• New DBM configuration parameter CF_TRANSPORT_METHOD gets set to either TCP or RDMA at instance creation time • Can be manually changed after the fact if the interconnect changes

• Prerequisites • 10 Gigabit Ethernet strongly recommended for production installations • Typical performance impact of 10GE TCP/IP is 30% relative to RDMA-based interconnect • Set DB2_SD_ALLOW_SLOW_NETWORK=YES for VMware or 1GE implementations • Hosts must be on the same subnet • Hosts must be able to ping each other #IDUG

44 Virtualized Deployments of DB2 pureScale DB2 10.5 FP4 enhancement ( 10.5.0.4 ) – GA: August, 2014 ( SW only today )

• Previously, virtualized deployments of pureScale were limited to: • AIX LPARs, with dedicated RDMA network adapters per partition • KVM with RHEL, with dedicated 10 GE RoCE network adapters per partition

• Additional virtualized deployments now available in FP4 with TCP/IP (sockets) interconnect, including: • AIX LPARs • VMware (ESXi, vSphere) with RHEL or SLES • KVM with RHEL

• Virtualized environments are perfect for: • Development • QA and testing • Production environments with moderate workloads • Getting hands-on experience with pureScale #IDUG

IBM PureData Systems – Family Members

Meeting Big Data Challenges – Fast and Easy!

•MoreFor flexible apps buildinglike E- commerce…blocks System for Transactions •MoreDatabase workloads cluster services optimized for •Compatibilitytransactional with throughput PureApplication and scalability System Powered by DB2 technology

IBM PureData Systems – Family Members

Meeting Big Data Challenges – Fast and Easy!

For apps like E-commerce… System for Transactions Database cluster services optimized for transactional throughput and scalability Powered by DB2 technology

47 Let’s simplify From custom Big Data …To organized simplicity

Visualization

HDFS MapReduce HCatalog Designed to…

Pig . Simplify the building, deploying and management of a Hadoop cluster DEPLOY . Speed the time-to-value for 8x Hadoop and unstructured data FASTER!1 Development Hive Tools . Maximize the overall analytic ecosystem . Provide enterprise security and platform management

1Based on IBM internal testing and customer feedback. "Custom built clusters" refer to clusters that are not professionally pre-built, pre-tested and optimized. Individual results may vary. #IDUG

IBM PureData Systems – Family Members

Meeting Big Data Challenges – Fast and Easy!

For apps like E-commerce… System for Transactions Database cluster services optimized for transactional throughput and scalability Powered by DB2 technology

•NoFor longer Exploratory available Analysis & Queryable Archive System for Hadoop •MarketHadoop requirements data services optimizedneed more for flexible big data implementations analytics and online •Bestarchive practices with appliance and prescriptive simplicity configs Powered by Big Insights technology #IDUG

IBM PureData Systems – Family Members - Roadmap

Meeting Big Data Challenges – Fast and Easy!

•NoFor longer Exploratory available Analysis & Queryable Archive System for Hadoop •MarketHadoop requirements data services need optimized more forflexible big data implementations analytics and online •Bestarchive practices with applianceand prescriptive simplicity configs Powered by Big Insights technology #IDUG

Les King IBM Canada Ltd. [email protected]

Session: D10 Title: DB2 10.5 and PureData Update and Strategy