John Campbell Namik Hrle Ruiping Li Surekha Parekh Terry Purcell MC Press Online, LLC Boise, ID 83703 The Business Value of DB2 for z/OS: IBM DB2 Analytics Accelerator and Optimizer John Campbell, Namik Hrle, Ruiping Li, Surekha Parekh, and Terry Purcell First Edition First Printing—March 2013 © 2013 IBM. All rights reserved. Every attempt has been made to provide correct information. However, IBM, the publisher, and the authors do not guarantee the accuracy of the book and do not assume responsibility for information included in or omitted from it. The performance data and client examples cited are presented for illustrative purposes only. Actual performance results may vary depending on specific configurations and operating conditions. It is the user’s responsibility to evaluate and verify the operation of any other products or programs with IBM products and programs. The following terms are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both: IBM, CICS, Cognos, DB2, DB2 Connect, Distributed Relational Database Architecture, DRDA, IMS, InfoSphere, MVS, OMEGAMON, OS/390, PureData, Smarter Banking, Smarter Commerce, Smarter Planet, System z, System z9, Tivoli, WebSphere, z10, zEnterprise, and z/OS. Netezza is a registered trademark of IBM International Group B.V., an IBM Company. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Other company, product, or service names may be trademarks or service marks of others. Printed in Canada. All rights reserved. This publication is protected by copyright, and permission must be obtained from the publisher prior to any prohibited reproduction, storage in a retrieval system, or transmission in any form or by any means, electronic, mechanical, photocopying, recording, or likewise. MC Press offers excellent discounts on this book when ordered in quantity for bulk purchases or special sales. MC Press Online, LLC, 3695 W. Quail Heights Court, Boise, ID 83703-3861 USA Customer Service: (208) 629-7275 ext. 500; [email protected] Permissions and Special Orders: [email protected] On the Web: www.mc-store.com ISBN: 978-1-58347-381-8 About the Authors • iii About the Authors John Campbell ([email protected]) is an IBM® Distinguished Engineer reporting to the Director for z/OS® Development at the IBM Silicon Valley Lab. He has extensive experience of DB2® in terms of systems, database, and applications design. John specializes in design for high performance and data sharing. He is one of IBM’s foremost authorities for implementing high-end database/transaction- processing applications. Namik Hrle works in the IBM Boeblingen Development Labora- tory and is the lab’s chief Information Management technologist, responsible for strategy and technology directions. As an IBM Distinguished Engineer and a member of the IBM Academy of Technology, he belongs to a small circle of the top technical leaders whose work and expertise affect the direction of IBM. He is a member of the Information Management Architecture Board, Software Group Architecture Board Steering Committee, Technical Experts Council, and many other IBM expert teams that work on strategic technology topics as well as address customers’ information technol- ogy needs and requirements. He is the holder of numerous patents, outstanding technical achievements, and author recognition and corporate awards. Ruiping Li is a Senior Engineer in DB2 for z/OS development at IBM Silicon Valley Lab. She is the technical lead responsible for the DB2 query acceleration support for the IBM DB2 Analytics Accelerator. She has been the development lead for DB2 9 for z/ OS new feature optimistic locking support and DB2 10 for z/OS new feature timestamp with time zone data type support and has also been the key developer for some other important function- ality. This functionality includes pureXML index exploitation, complex queries, MQTs, and multiple CCSID features in DB2 for z/OS. iv • The Business Value of DB2 for z/OS Surekha Parekh ([email protected]) is IBM’s World- Wide Marketing Program Director for DB2 for z/OS and also leads the Social Media Strategy for Information Management on System z. She is responsible for market strategy and planning of DB2 on System z® and building social media communities for Information Management System z. Based in Warwick, United Kingdom, Surekha is a passionate marketer with proven results. She has over 25 years of business experience, and she is also passionate about Information Management. Surekha represents IBM on the IDUG committee. IDUG is an independent DB2 user group with more than 16,000 members in more than 100 countries. Terry Purcell ([email protected]) is a Senior Technical Staff Member with the IBM Silicon Valley Lab, where he is lead designer for the DB2 for z/OS Optimizer. Terry has two decades of experience with DB2 in database administration and application development as a customer, consultant, and DB2 developer. Table of Contents • v Contents About the Authors ........................................................................................................ iii Foreword by Don Haderle............................................................................................ vii Introduction by Surekha Parekh ................................................................................. ix 30 Years of Innovation ................................................................................................. xi The Vision of DB2 ........................................................................................................ xix Revolution in IBM DB2 Performance: IBM DB2 Analytics Accelerator by Namik Hrle, Ruiping Li, and Wolfgang Hengstler .......................................... 1 Abstract ................................................................................................................ 1 Objectives ............................................................................................................ 1 Introduction .......................................................................................................... 2 What Is Business Analytics? ................................................................................ 2 How Business Analytics Can Help Your Organization ........................................ 3 Key Design and Operational Features ................................................................. 6 Query Execution Process Flow ............................................................................ 8 DB2 Analytics Accelerator Content Maintenance ............................................... 9 DB2 Analytics Accelerator Table Definition and Deployment ............................ 10 High-Performance Storage Saver ........................................................................ 10 Connectivity Options ........................................................................................... 10 Disaster Recovery Considerations ....................................................................... 10 Query Acceleration Criteria ................................................................................. 12 Query Acceleration Control Knobs ...................................................................... 12 EXPLAIN Function ............................................................................................. 13 System-Scope Instrumentation ............................................................................ 16 Thread-Scope Instrumentation ............................................................................. 17 DB2 Analytics Accelerator Administrative Stored Procedures ........................... 17 DISPLAY ACCELerator Command .................................................................... 18 Performance Considerations ................................................................................ 19 The PureData System for Analytics S-Blade, Based on Netezza Technology ..... 21 Applying Data Stream Processing to DB2 Queries ............................................. 22 Comparing PureData System for Analytics Appliance Models ........................... 23 Minimizing Disk Failures .................................................................................... 23 vi • The Business Value of DB2 for z/OS Minimizing S-Blade Failures ............................................................................... 23 Summary .............................................................................................................. 23 DB2 10 for z/OS Query Optimization Update by Terry Purcell .................................................................................................... 27 Access Path Management .................................................................................... 28 DB2 10 Takes Plan Management to the Next Level ............................................ 32 Predicate Processing and Runtime Optimizations ............................................... 38 Sort Performance Enhancements ......................................................................... 51 New Choices for the Query