The Business Value of DB2 for Z/OS

Total Page:16

File Type:pdf, Size:1020Kb

The Business Value of DB2 for Z/OS John Campbell Namik Hrle Ruiping Li Surekha Parekh Terry Purcell MC Press Online, LLC Boise, ID 83703 The Business Value of DB2 for z/OS: IBM DB2 Analytics Accelerator and Optimizer John Campbell, Namik Hrle, Ruiping Li, Surekha Parekh, and Terry Purcell First Edition First Printing—March 2013 © 2013 IBM. All rights reserved. Every attempt has been made to provide correct information. However, IBM, the publisher, and the authors do not guarantee the accuracy of the book and do not assume responsibility for information included in or omitted from it. The performance data and client examples cited are presented for illustrative purposes only. Actual performance results may vary depending on specific configurations and operating conditions. It is the user’s responsibility to evaluate and verify the operation of any other products or programs with IBM products and programs. The following terms are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both: IBM, CICS, Cognos, DB2, DB2 Connect, Distributed Relational Database Architecture, DRDA, IMS, InfoSphere, MVS, OMEGAMON, OS/390, PureData, Smarter Banking, Smarter Commerce, Smarter Planet, System z, System z9, Tivoli, WebSphere, z10, zEnterprise, and z/OS. Netezza is a registered trademark of IBM International Group B.V., an IBM Company. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Other company, product, or service names may be trademarks or service marks of others. Printed in Canada. All rights reserved. This publication is protected by copyright, and permission must be obtained from the publisher prior to any prohibited reproduction, storage in a retrieval system, or transmission in any form or by any means, electronic, mechanical, photocopying, recording, or likewise. MC Press offers excellent discounts on this book when ordered in quantity for bulk purchases or special sales. MC Press Online, LLC, 3695 W. Quail Heights Court, Boise, ID 83703-3861 USA Customer Service: (208) 629-7275 ext. 500; [email protected] Permissions and Special Orders: [email protected] On the Web: www.mc-store.com ISBN: 978-1-58347-381-8 About the Authors • iii About the Authors John Campbell ([email protected]) is an IBM® Distinguished Engineer reporting to the Director for z/OS® Development at the IBM Silicon Valley Lab. He has extensive experience of DB2® in terms of systems, database, and applications design. John specializes in design for high performance and data sharing. He is one of IBM’s foremost authorities for implementing high-end database/transaction- processing applications. Namik Hrle works in the IBM Boeblingen Development Labora- tory and is the lab’s chief Information Management technologist, responsible for strategy and technology directions. As an IBM Distinguished Engineer and a member of the IBM Academy of Technology, he belongs to a small circle of the top technical leaders whose work and expertise affect the direction of IBM. He is a member of the Information Management Architecture Board, Software Group Architecture Board Steering Committee, Technical Experts Council, and many other IBM expert teams that work on strategic technology topics as well as address customers’ information technol- ogy needs and requirements. He is the holder of numerous patents, outstanding technical achievements, and author recognition and corporate awards. Ruiping Li is a Senior Engineer in DB2 for z/OS development at IBM Silicon Valley Lab. She is the technical lead responsible for the DB2 query acceleration support for the IBM DB2 Analytics Accelerator. She has been the development lead for DB2 9 for z/ OS new feature optimistic locking support and DB2 10 for z/OS new feature timestamp with time zone data type support and has also been the key developer for some other important function- ality. This functionality includes pureXML index exploitation, complex queries, MQTs, and multiple CCSID features in DB2 for z/OS. iv • The Business Value of DB2 for z/OS Surekha Parekh ([email protected]) is IBM’s World- Wide Marketing Program Director for DB2 for z/OS and also leads the Social Media Strategy for Information Management on System z. She is responsible for market strategy and planning of DB2 on System z® and building social media communities for Information Management System z. Based in Warwick, United Kingdom, Surekha is a passionate marketer with proven results. She has over 25 years of business experience, and she is also passionate about Information Management. Surekha represents IBM on the IDUG committee. IDUG is an independent DB2 user group with more than 16,000 members in more than 100 countries. Terry Purcell ([email protected]) is a Senior Technical Staff Member with the IBM Silicon Valley Lab, where he is lead designer for the DB2 for z/OS Optimizer. Terry has two decades of experience with DB2 in database administration and application development as a customer, consultant, and DB2 developer. Table of Contents • v Contents About the Authors ........................................................................................................ iii Foreword by Don Haderle............................................................................................ vii Introduction by Surekha Parekh ................................................................................. ix 30 Years of Innovation ................................................................................................. xi The Vision of DB2 ........................................................................................................ xix Revolution in IBM DB2 Performance: IBM DB2 Analytics Accelerator by Namik Hrle, Ruiping Li, and Wolfgang Hengstler .......................................... 1 Abstract ................................................................................................................ 1 Objectives ............................................................................................................ 1 Introduction .......................................................................................................... 2 What Is Business Analytics? ................................................................................ 2 How Business Analytics Can Help Your Organization ........................................ 3 Key Design and Operational Features ................................................................. 6 Query Execution Process Flow ............................................................................ 8 DB2 Analytics Accelerator Content Maintenance ............................................... 9 DB2 Analytics Accelerator Table Definition and Deployment ............................ 10 High-Performance Storage Saver ........................................................................ 10 Connectivity Options ........................................................................................... 10 Disaster Recovery Considerations ....................................................................... 10 Query Acceleration Criteria ................................................................................. 12 Query Acceleration Control Knobs ...................................................................... 12 EXPLAIN Function ............................................................................................. 13 System-Scope Instrumentation ............................................................................ 16 Thread-Scope Instrumentation ............................................................................. 17 DB2 Analytics Accelerator Administrative Stored Procedures ........................... 17 DISPLAY ACCELerator Command .................................................................... 18 Performance Considerations ................................................................................ 19 The PureData System for Analytics S-Blade, Based on Netezza Technology ..... 21 Applying Data Stream Processing to DB2 Queries ............................................. 22 Comparing PureData System for Analytics Appliance Models ........................... 23 Minimizing Disk Failures .................................................................................... 23 vi • The Business Value of DB2 for z/OS Minimizing S-Blade Failures ............................................................................... 23 Summary .............................................................................................................. 23 DB2 10 for z/OS Query Optimization Update by Terry Purcell .................................................................................................... 27 Access Path Management .................................................................................... 28 DB2 10 Takes Plan Management to the Next Level ............................................ 32 Predicate Processing and Runtime Optimizations ............................................... 38 Sort Performance Enhancements ......................................................................... 51 New Choices for the Query
Recommended publications
  • IBM Service Management Suite for Z/OS with Service Management Unite
    Front cover IBM Service Management Suite for z/OS with Service Management Unite Lorin Ullmann Carol Davis Michael Gouveia Arthur McDonald Wolfgang Schaeberle Solution Guide Changes are happening in record time, forcing IT managers to develop strategies to anticipate and address these looming IT challenges. These service-driven demands are confronting IT management and making them choose how to best prepare for the future. They must be proactive and agile, which requires getting the most out of their team’s skills and experience to manage this increasingly complex environment. IBM® Service Management Suite for z/OS® (Figure 1) offers a single point of control for systems management functions, such as visibility, control, and automation. It spans hardware and software enterprise resources in an IBM z/OS systems environment and beyond. Stakeholder • IT Operations Dashboards • Development/SME • Line of Business W IT Analytics O Assets Business Results R • Workload Optimization K • Business Agility L • Innovation O A D Performance Automation Systems of S Management Scheduling Engagement Systems of Record Figure 1 Service Management Suite for z/OS overview and strategy for IBM z Systems® Did you know? Service Management Suite for z/OS provides operators a transparent view of the IBM z Systems compute landscape, including central electronic complex (CECs), LPARs, and Sysplexes with key performance indicators for improved problem isolation, analysis, and diagnosis. This IBM Redbooks® Solution Guide describes Service Management Suite for z/OS and its new user interface IBM Service Management Unite and includes high-level architectures (for each solution) with their key components. The guide also explains the integration of Service Management Unite with Service Management Suite for z/OS components and integration with other IBM products and third-party solutions to create a comprehensive solution.
    [Show full text]
  • IBM Monitoring OMEGAMON Best Practices & Performance Guidelines V1
    IBM Monitoring OMEGAMON Best Practices & Performance Guidelines V1 January 2020 Rocky McMahan – Rocket Matt Hunter – IBM IBM Monitoring – OMEGAMON Best Practices & IBM z Systems Performance Guidelines V4 Table of Contents 1. Objectives ........................................................................................................................................................................................... 5 1.1 Document Updates and Revisions ............................................................................................................................................... 5 2. Requirements ..................................................................................................................................................................................... 5 3. IBM OMEGAMON shared documentation ................................................................................................................................... 5 4. Maintenance Documentation ........................................................................................................................................................... 5 5. PARMGEN Configuration for OMEGAMON/TMS Products on z/OS ...................................................................................... 6 5.1 How to run OMEGAMON’s V550/V540 and still use OMEGAVIEW and OMII CUA’s at V530 levels. .................................. 6 6. Components and architecture .........................................................................................................................................................
    [Show full text]
  • IBM OMEGAMON and Tivoli Management Services on Z/OS Shared Documentation: Messages Table 1
    IBM OMEGAMON and Tivoli Management Services on z/OS Shared Documentation 6.3.0 Fix Pack 2 and above Messages IBM Note Before using this information and the product it supports, read the information in “Notices” on page 581. This edition applies to IBM OMEGAMON products that use OMNIMON Base version 7.5.0 and above and to all subsequent releases and modifications until otherwise indicated in new editions. Last updated: 2021-04-30 © Copyright International Business Machines Corporation 2007, 2021. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Introduction to messages...................................................................................... 1 Messages for z/OS components..............................................................................5 CI messages.................................................................................................................................................8 CND messages........................................................................................................................................... 25 CS and CT messages..................................................................................................................................33 ETE messages............................................................................................................................................ 40 IA messages...............................................................................................................................................56
    [Show full text]
  • IBM Tivoli OMEGAMON XE on Z/VM and Linux: Planning and Configuration Guide Part 4
    Tivoli® OMEGAMON XE on z/VM and Linux Version 4.2.0 Planning and Configuration Guide SC27-2837-00 Tivoli® OMEGAMON XE on z/VM and Linux Version 4.2.0 Planning and Configuration Guide SC27-2837-00 Note Before using this information and the product it supports, read the information in “Notices” on page 111. This edition applies to Version 4, Release 2, Modification 0 of OMEGAMON XE on z/VM and Linux (product number 5698-A36) and to all subsequent releases and modifications until otherwise indicated in new editions. © Copyright IBM Corporation 2006, 2010. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Figures ....................................vii Tables.....................................ix Preface ....................................xi Intended audience ................................xi What this guide contains ..............................xi Part 1. Planning your configuration ......................1 Chapter 1. Overview of the OMEGAMON XE on z/VM and Linux monitoring agent .......3 Tivoli Enterprise Portal ...............................4 What's new in Version 4.2.0 .............................5 Replacement of the z/VM Systems: default workspace with the z/VM Systems: System Health workspace..................................5 Overall system view ...............................5 New product-provided situations ..........................6 Tivoli Management Services components ........................6 IBM Tivoli Monitoring features ............................7
    [Show full text]
  • OMEGAMON for Storage on Z/OS Troubleshooting Guide
    OMEGAMON for Storage on z/OS Troubleshooting Guide IBM GC27-4381-04 OMEGAMON for Storage on z/OS Troubleshooting Guide IBM GC27-4381-04 ii OMEGAMON for Storage on z/OS Troubleshooting Guide Contents About this guide ........... v Dump Creation ............ 43 Traces ............... 44 Chapter 1. General troubleshooting for Dumping SMF Records ......... 45 the OMEGAMON XE Monitoring Agent Creating a BVIR data set ......... 45 Running LISTDATA .......... 46 on z/OS ............... 1 CINFO Output ............ 46 Troubleshooting flow for an OMEGAMON XE TEPS database export .......... 47 Monitoring Agent on z/OS ......... 1 RKS3DATA Dump ........... 47 Determining whether the problem was caused by an Tips regarding the collection of diagnostic data 47 OMEGAMON XE Monitoring Agent on z/OS ... 2 About log files for product components .... 49 Reproducible problems reported as Tivoli Enterprise Portal client problems ...... 2 Chapter 3. Troubleshooting installation Unreproducible problems reported as Tivoli and configuration .......... 53 Enterprise Portal client problems ...... 7 Problems reported as Tivoli Enterprise Portal Take Action commands show return code 0, but Server problems ............ 7 might be unsuccesful ........... 53 Problems affecting an OMEGAMON XE Historical workspaces contain no data ..... 53 Monitoring Agent on z/OS ........ 7 Tivoli Enterprise Monitoring Server on z/OS starts Setting up a trace for an OMEGAMON XE normally in a system without the Integrated Monitoring Agent on z/OS ......... 9 Cryptographic Service Facility but does not connect Using the KDC_DEBUG environment variable.. 10 to the Tivoli Enterprise Portal Server ...... 53 Setting up RAS1 tracing ......... 10 Understanding and using RAS1 logs ...... 17 Chapter 4. Troubleshooting data Determining which product or component collection ............. 55 generated a message .........
    [Show full text]
  • IBM Tivoli OMEGAMON XE on Z/OS: User™S Guide
    IBM Tivoli OMEGAMON XE on z/OS Version 5 Release 1 User’s Guide SC27-4028-00 IBM Tivoli OMEGAMON XE on z/OS Version 5 Release 1 User’s Guide SC27-4028-00 Note Before using this information and the product it supports, read the information in “Notices” on page 395. March 2012 This edition applies to version 5, release 1, modification 0 of IBM Tivoli OMEGAMON XE on z/OS (product number 5698-T01) and to all subsequent releases and modifications until otherwise indicated in new editions. © Copyright IBM Corporation 2004, 2012. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Figures ...............ix z/OS Status DASD Issues report ....27 z/OS Status WLM Service Class Period Tables ...............xi report .............29 z/OS Utilization Common Storage report 32 z/OS Utilization LPAR Summary report . 35 Part 1. Getting started........1 z/OS Utilization LPAR Usage Summary report .............37 Chapter 1. Introducing IBM Tivoli z/OS Utilization Real Storage report . 39 OMEGAMON XE on z/OS .......3 Finding more information about historical data collection ..............41 How OMEGAMON XE on z/OS works .....3 Using Take Action commands ........42 Resources provided by OMEGAMON XE on z/OS . 5 Issuing OMEGAMON XE on z/OS commands 42 What you can do with OMEGAMON XE on z/OS . 6 Issuing UNIX commands .........43 Interoperability and integration with other products 9 Environment for issuing UNIX commands . 43 New in V5.1.0 ..............9 Redirecting UNIX commands output ....44 Support for IBM Tivoli Monitoring V6.2.3 and Running commands in the background .
    [Show full text]
  • Getting Started with IBM Z Resiliency
    Front cover Getting Started with IBM Z Resiliency Bill White Marc Coq Pabitra Mukhopadhyay Carlos Alberto Pistillo David Raften Mai Zeng Redbooks IBM Redbooks Getting Started with IBM Z Resiliency March 2020 SG24-8446-00 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. First Edition (March 2020) © Copyright International Business Machines Corporation 2020. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . vii Trademarks . viii Preface . ix Authors. ix Now you can become a published author, too! . .x Comments welcome. .x Stay connected to IBM Redbooks . xi Chapter 1. Resiliency is key to the survival of a digital business . 1 1.1 What’s the cost of downtime . 2 1.1.1 Fixed costs . 2 1.1.2 Lost revenue . 3 1.1.3 Intangible costs . 3 1.1.4 Balancing IT risk and costs of mitigation. 4 1.2 Measuring availability . 4 1.2.1 Availability objectives . 5 1.2.2 Recovery objectives: RPO and RTO. 6 1.2.3 Aspects of availability . 7 1.3 A path to higher availability . 9 1.3.1 Model 1: Starting with a resilient and reliable base. 10 1.3.2 Model 2: Reducing the duration of outages with failover capability . 11 1.3.3 Model 3: Reducing the impact of outages with a fault tolerant architecture and GDPS. 12 1.3.4 Model 4: Adding GDPS Continuous Availability for maximal resilience . 13 Chapter 2.
    [Show full text]
  • DB2 10 for Z/OS Performance Topics
    IBM® Information Management Software Front cover DB2 10 for z/OS Performance Topics Discover the functions that provide reduced CPU time in CM and NFM Understand improved scalability and availability Evaluate the impact of new functions Paolo Bruni Felipe Bortoletto Ravikumar Kalyanasundaram Glenn McGeoch Roger Miller Cristian Molaro Yasuhiro Ohmori Michael Parbs ibm.com/redbooks International Technical Support Organization DB2 10 for z/OS Performance Topics June 2011 SG24-7942-00 Note: Before using this information and the product it supports, read the information in “Notices” on page xxi. First Edition (June 2011) This edition applies to IBM DB2 Version 10.1 for z/OS (program number 5605-DB2). © Copyright International Business Machines Corporation 2011. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Figures . ix Tables . .xv Examples . xvii Notices . xxi Trademarks . xxii Preface . xxiii The team who wrote this book . xxiii Now you can become a published author, too! . xxvi Comments welcome. xxvi Stay connected to IBM Redbooks . xxvii Summary of changes. xxix June 2011, First Edition . xxix December 2011, First Update. xxix January 2013, Second Update . xxix August 2013, Third Update . xxix Chapter 1. Introduction. 1 1.1 Executive summary. 2 1.1.1 Performance benefit summary . 2 1.1.2 Conclusion . 2 1.2 General introduction to DB2 10. 2 1.2.1 Performance improvements . 2 1.2.2 Unsurpassed resiliency for business-critical information . 3 1.2.3 Rapid application and warehouse deployment for business growth . 4 1.2.4 Enhanced business analytics and mathematical functions with QMF.
    [Show full text]
  • IBM System Z Strengths and Values
    Front cover IBM System z Strengths and Values Technical presentation of System z hardware and z/OS Enterprise-wide roles for the System z platform Cost of computing considerations Philippe Comte Andrea Corona James Guilianelli Douglas Lin Werner Meiner Michel Plouin Marita Prassolo Kristine Seigworth Eran Yona Linfeng Yu ibm.com/redbooks International Technical Support Organization IBM System z Strengths and Values May 2008 SG24-7333-01 Note: Before using this information and the product it supports, read the information in “Notices” on page ix. First Edition (May 2008) This edition applies to the IBM System z platform and IBM z/OS V1.8. © Copyright International Business Machines Corporation 2008. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . ix Trademarks . x Preface . xiii The team that wrote this redbook. xiii Become a published author . xv Comments welcome. xv Summary of changes . xvii May 2008, First Edition. xvii Chapter 1. A business view . 1 1.1 Business drivers . 2 1.2 Impact on IT . 3 1.3 The System z platform . 7 1.3.1 Using System Z technology to reduce complexity . 7 1.3.2 Business integration and resiliency. 8 1.3.3 Managing the System z platform to meet business goals. 11 1.3.4 Security . 12 1.4 Summary . 13 Chapter 2. System z architecture and hardware platform . 15 2.1 History . 16 2.2 System z architecture . 17 2.2.1 Multiprogramming and multiprocessing . 18 2.2.2 The virtualization concept .
    [Show full text]
  • Planning, Customization, and Migration Guide
    5.4 IBM OMEGAMON for Db2 Performance Expert on z/OS Planning, Customization, and Migration Guide IBM GH12-7072 Note: Before using this information and the product it supports, read the "Notices" topic at the end of this information. 2021-03-23 edition This edition applies to Version 5 Release 4 of IBM® OMEGAMON for DB2® Performance Expert on z/OS (product number 5655-W37) and to all subsequent releases and modifications until otherwise indicated in new editions. © Copyright IBM Corp. 2005, 2021 iii iv Planning, Customization, and Migration Guide Contents ............................................................................................................................ iii Figures................................................................................................................. ix Tables.................................................................................................................. xi About this information......................................................................................... xv Chapter 1. Overview.............................................................................................. 1 Where to find information............................................................................................................................1 Service updates and support information...................................................................................................2 Accessibility features...................................................................................................................................2
    [Show full text]
  • Conference Directory
    Conference Directory IBM System z™ Expo September 17-21, 2007 San Antonio, Texas San Antonio Conference Directory Welcome to Business Service Management from BMC Software. Business Service Management (BSM) means the goals of IT are the same as the goals of the business. And with proven software and gZhZgkZY## g^\]ih The CFO expects increased stock value. processes from BMC Software, 6aa BSM can be implemented in stages, >cX# IV`Z ndjg cZildg` [gdb ^begdk^hZY id dg\Vc^oZY# demonstrating the value of IT as HnhiZbh! 8^hXd Dc i]Z ^ciZ\gViZY cZildg`! Veea^XVi^dch! hidgV\Z The COO expects improved supply chain efficiency. you go. All business success stories '%%, have to start somewhere. With BSM, VcY hZgkZgh VgZ higZVba^cZY# 6cY Xdhih! hnhiZbh The CMO expects accelerated market growth. they begin in IT. VcY eZdeaZ VgZ ZVh^Zg id bVcV\Z# 6aa! l^i] 8^hXd 9ViV 8ZciZg Hdaji^dch! YZh^\cZY heZX^[^XVaan [dg The CEO expects a better bottom line. www.bmc.com/business Wjh^cZhhZh a^`Z ndjgh# Id hZZ ]dl lZ XVc h^bea^[n ndjg cZildg`! k^h^i X^hXd#Xdb$\d$YViVXZciZg# The CIO has the same expectations and now has the tools to drive business. © 2007 BMC Software, Inc. All Rights Reserved. BMC_Digital_Ball_ad.indd 1 3/6/07 10:53:44 AM September 17, 2007 Welcome to San Antonio and the IBM System z Expo! This conference is devoted to IBM System z, the flagship of IBM Systems and the hub of the IT infrastructure, and to you, the skilled professionals who support the mainframe environment.
    [Show full text]