Front cover Accelerating Data Transformation with IBM DB2 Analytics Accelerator for z/OS Ute Baumbach Patric Becker Uwe Denneler Eberhard Hechler Wolfgang Hengstler Steffen Knoll Frank Neumann Guenter Georg Schoellmann Khadija Souissi Timm Zimmermann In partnership with IBM Academy of Technology Redbooks International Technical Support Organization Accelerating Data Transformation with IBM DB2 Analytics Accelerator for z/OS December 2015 SG24-8314-00 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. First Edition (December 2015) This edition applies to DB2 for z/OS Version 10, IBM DB2 Analytics Accelerator for z/OS Version 4.1 PTF 5.1, IBM DB2 Analytics Accelerator for z/OS Version 5.1, QMF for z/OS Version 11.2. © Copyright International Business Machines Corporation 2015. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . vii Trademarks . viii IBM Redbooks promotions . ix Preface . xi Authors. xii Acknowledgement. xiii Now you can become a published author, too . xiv Comments welcome. xiv Stay connected to IBM Redbooks . xiv Chapter 1. Analytics on an IBM z Systems environment. 1 1.1 Traditional data warehouse and analytics concepts . 3 1.1.1 Persistency layers. 3 1.1.2 Information supply chain . 3 1.1.3 Analytics on z Systems aspects . 4 1.2 IBM Transaction and Analytics Processing. 4 1.2.1 Logical data warehouse . 5 1.2.2 Technical approaches. 5 1.2.3 Real-time analytics on z Systems . 6 1.2.4 Analytics on operational data . 6 1.3 Transformation patterns . 6 1.3.1 Traditional ETL . 6 1.3.2 Accelerating data transformation . 7 1.3.3 New transformation patterns. 7 1.4 New use cases . 8 1.4.1 Use case description. 8 1.5 Strategic outlook . 10 Chapter 2. Accelerator-only tables . 11 2.1 Concepts and architecture . 12 2.1.1 Non-accelerator DB2 table . 13 2.1.2 Accelerator-shadow table . 14 2.1.3 Accelerator-archived table and partition . 15 2.1.4 Accelerator-only table (AOT). 15 2.2 Software level prerequisites . 17 2.3 Syntax and capabilities . 18 2.3.1 Creating accelerator-only tables . 18 2.3.2 Inserting data into accelerator-only tables . 19 2.3.3 Removing accelerator-only tables. 21 2.3.4 Using accelerator-only tables in queries or DML statements . 22 2.4 Transactional considerations . 22 2.5 Lifecycle management . 24 2.6 Limitations and restrictions . 25 2.7 Performance considerations . 26 2.7.1 INSERT SELECT performance considerations. 29 © Copyright IBM Corp. 2015. All rights reserved. iii Chapter 3. Use cases that are enabled by accelerator-only tables and in-database analytics . 31 3.1 The four use cases of the DB2 Analytics Accelerator . 32 3.2 How accelerator-only tables and in-database analytics extend use cases . 33 3.3 Acceleration of existing business critical queries . 34 3.4 Derive business insight from z/OS transaction systems . 37 3.5 Reduce IT sprawl for analytics initiatives . 40 3.6 Improve access to historical data and lower storage costs. 43 3.7 Summary. 46 Chapter 4. Multistep reporting . 47 4.1 Concepts of multistep reporting . 48 Chapter 5. Using IBM DB2 QMF to store query results and import tables . 53 5.1 QMF and IBM z Systems . 54 5.2 QMF for z/OS and DB2 Analytics Accelerator . 55 5.2.1 Accelerator-only table support in QMF for z/OS V11.2. 56 5.3 Running queries and saving results using a QMF procedure . 58 5.3.1 Queries used in the sample scenario . 58 5.3.2 Running the procedure in DB2 for z/OS . 61 5.3.3 Running the procedure in DB2 for z/OS and DB2 Analytics Accelerator . 62 5.3.4 Running the procedure in DB2 Analytics Accelerator using accelerator-only tables created by the SAVE DATA AS command . 63 5.3.5 Running the procedure in DB2 Analytics Accelerator using accelerator-only tables created by the RUN QUERY command . 65 5.4 Importing tables as accelerator-only tables. 69 5.5 Preferred practices . 70 Chapter 6. Accelerating IBM Campaign processing . 73 6.1 What is IBM Campaign . 74 6.2 Components and architecture . 75 6.2.1 IBM Campaign and DB2 for z/OS . 76 6.2.2 IBM Campaign performance considerations and usage of temp tables . 76 6.2.3 Defining temporary tables . 78 6.3 Our IBM Campaign environment. 79 6.4 Campaign example scenario used in this chapter . 82 6.4.1 Flowchart for car insurance campaign . 82 6.4.2 Using temp tables for car insurance campaign. 83 6.4.3 Using and enabling accelerator-only tables for car insurance campaign . 84 Chapter 7. In-database transformations . ..