IBM® Information Management Software Front cover Optimizing DB2 Queries with IBM DB2 Analytics Accelerator for z/OS
Leverage your investment in IBM System z for data warehousing
Transparently accelerate DB2 complex queries
Implement highly available analytics
Paolo Bruni Patric Becker Willie Favero Ravikumar Kalyanasundaram Andrew Keenan Steffen Knoll Nin Lei Cristian Molaro PS Prem
ibm.com/redbooks
International Technical Support Organization
Optimizing DB2 Queries with IBM DB2 Analytics Accelerator for z/OS
August 2012
SG24-8005-00 Note: Before using this information and the product it supports, read the information in “Notices” on page xix.
First Edition (August 2012)
This edition applies to Version 2.1 of IBM DB2 Analytics Accelerator for z/OS (program number 5697-SAO) for use with IBM DB2 Version 9.1 for z/OS (program number 5635-DB2) and IBM DB2 Version 10.1 for z/OS (program number 5605-DB2).
© Copyright International Business Machines Corporation 2012. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents
Figures ...... ix
Examples ...... xiii
Tables ...... xvii
Notices ...... xix Trademarks ...... xx
Preface ...... xxi The team who wrote this book ...... xxi Now you can become a published author, too! ...... xxiii Comments welcome...... xxiv Stay connected to IBM Redbooks ...... xxiv
Summary of changes...... xxv August 2012, First Edition ...... xxv December 2012, First Update...... xxv
Part 1. Business analytics with DB2 for z/OS ...... 1
Chapter 1. Data warehousing on System z...... 3 1.1 The evolution of business intelligence ...... 4 1.2 Why to implement data warehousing on System z ...... 5 1.2.1 Architecture of the BI solution on System z ...... 6 1.2.2 Functions in DB2 for z/OS for a data warehouse ...... 6 1.2.3 DB2 impact on data warehousing ...... 7 1.2.4 Functions in DB2 10 for z/OS for a data warehouse...... 11 1.3 Positioning of current offerings ...... 17 1.3.1 InfoSphere Warehouse on System z ...... 18 1.3.2 Information Server for System z ...... 19 1.3.3 Cognos for System z...... 19 1.3.4 SPSS for System z ...... 20 1.3.5 Query Management Facility ...... 20 1.3.6 InfoSphere Master Data Management Server ...... 20 1.3.7 InfoSphere BigInsights ...... 21 1.3.8 InfoSphere Streams ...... 21 1.3.9 Data Governance for System z...... 21 1.3.10 Cloud Computing on System z ...... 22 1.3.11 InfoSphere Optim Data Management solutions ...... 22 1.3.12 IBM InfoSphere Guardium database security ...... 22 1.3.13 IBM Smart Analytics System 9700 and 9710 ...... 22 1.4 Analytics workloads...... 23 1.5 DB2 and DB2 Analytics Accelerator as a hybrid solution ...... 27
Chapter 2. The DB2 for z/OS integrated solution ...... 33 2.1 The IBM DB2 Analytics Accelerator ...... 34 2.2 Query processing with the DB2 Analytics Accelerator ...... 37 2.3 Integration of the Accelerator administration into DB2 for z/OS ...... 39 2.4 Loading data into the DB2 Analytics Accelerator ...... 41
© Copyright IBM Corp. 2012. All rights reserved. iii 2.5 DB2 commands for the DB2 Analytics Accelerator...... 42
Part 2. Sample DB2 Analytics Accelerator implementation ...... 49
Chapter 3. The business scenario...... 51 3.1 Query acceleration organization profiles...... 52 3.2 Business scenario overview ...... 56 3.3 Great Outdoors challenges and implementation plan ...... 57 3.4 Data warehouse description ...... 59 3.4.1 Dimensional analysis schema...... 60 3.4.2 Transactional schemas ...... 62 3.5 Sample workload description ...... 64 3.5.1 Simple reports...... 64 3.5.2 Intermediate reports ...... 65 3.5.3 Complex reports ...... 66 3.5.4 Workload scenarios ...... 68
Chapter 4. Feasibility study ...... 71 4.1 The need for a DB2 Analytics Accelerator feasibility study...... 72 4.2 User scenarios for a feasibility study and value assessment ...... 74 4.2.1 Preliminary assessment questionnaire ...... 75 4.2.2 Collecting information for the quick workload assessment ...... 76 4.2.3 Peak data warehouse workload analysis ...... 78 4.3 Virtual accelerator tool (EXPLAIN only) ...... 78 4.3.1 Installing the virtual accelerator without the DB2 Analytics Accelerator ...... 78 4.3.2 Workload assessment using the virtual accelerator ...... 80 4.4 Return on investment calculation ...... 81 4.5 Workload assessment results ...... 83 4.5.1 Summary page ...... 83 4.5.2 Detail pages ...... 84 4.5.3 Strategic and tactical value ...... 86 4.6 Capacity planning and sizing ...... 86 4.6.1 Deciding what you need for hardware...... 87 4.7 Influencing the feasibility study through query rewrite ...... 87 4.7.1 Why a query might not be routed to the DB2 Analytics Accelerator ...... 87 4.7.2 Query re-write scenario...... 87 4.7.3 Other considerations...... 91
Chapter 5. Installation and configuration ...... 93 5.1 Solution overview ...... 94 5.2 Prerequisites for IBM DB2 Analytics Accelerator for z/OS ...... 95 5.2.1 Hardware requirements...... 95 5.2.2 Networking ...... 97 5.2.3 Software requirements ...... 98 5.3 Installation task flow ...... 102 5.4 Authorization needed for installing the DB2 Analytics Accelerator ...... 105 5.4.1 DB2 privileges required...... 105 5.5 Configuring TCP/IP ...... 106 5.6 Installing the IBM DB2 Analytics Accelerator ...... 108 5.7 Installing IBM DB2 Analytics Accelerator Studio...... 109 5.7.1 Installing Accelerator Studio using the product DVD ...... 109 5.7.2 Adding the Accelerator Studio plug-in to IBM Data Studio ...... 109 5.7.3 Enabling automatic software update...... 112 5.8 Enabling the DB2 subsystem for IBM DB2 Analytics Accelerator for z/OS...... 113 iv Optimizing DB2 Queries with IBM DB2 Analytics Accelerator for z/OS 5.9 Setting up the IBM DB2 Analytics Accelerator for z/OS ...... 115 5.9.1 Creating DB2 objects required by the DB2 Analytics Accelerator...... 119 5.10 Connecting the IBM DB2 Analytics Accelerator for z/OS and DB2...... 121 5.10.1 Creating a connection profile to the DB2 subsystem ...... 121 5.10.2 Binding DB2 Query Tuner packages and granting user privileges ...... 123 5.10.3 Obtaining the pairing code for authentication ...... 134 5.10.4 Completing the authentication using the Add New Accelerator wizard...... 136 5.10.5 Testing stored procedures with the DB2 Analytics Accelerator ...... 138 5.11 Updating DB2 Analytics Accelerator software...... 139
Chapter 6. Workload Manager settings for DB2 Analytics Accelerator ...... 143 6.1 General WLM concepts and considerations ...... 145 6.2 WLM considerations for the DB2 address spaces ...... 149 6.3 WLM considerations for the sample workload scenario ...... 153 6.4 WLM considerations for DB2 Analytics Accelerator stored procedures ...... 156 6.5 Defining classification rules for stored procedures ...... 158
Chapter 7. Monitoring DB2 Analytics Accelerator environments...... 161 7.1 DB2 Analytics Accelerator performance monitoring and reporting ...... 162 7.2 How DB2 traces work with DB2 Analytics Accelerator ...... 162 7.2.1 Accounting ...... 162 7.2.2 Statistics ...... 168 7.2.3 OMPE and DB2 Analytics Accelerator-related information...... 171 7.3 Monitoring the DB2 Analytics Accelerator using commands...... 172 7.3.1 Monitoring DB2 threads offloaded to the DB2 Analytics Accelerator ...... 174 7.3.2 Monitoring the DB2 Analytics Accelerator and Netezza status...... 176
Chapter 8. Operational considerations ...... 179 8.1 Identifying DB2 Analytics Accelerator communication errors ...... 180 8.2 Understanding DB2 Analytics Accelerator query failures ...... 183 8.3 Cancelling DB2 Analytics Accelerator threads ...... 185 8.3.1 Delayed job termination after cancel command ...... 185 8.3.2 Stopping DDF when the DB2 Analytics Accelerator is active ...... 186 8.3.3 Active DB2 Analytics Accelerator threads and STOP DB2...... 187 8.4 Preventing out-of-Accelerator query execution ...... 189 8.4.1 Using a WLM Resource Group ...... 190 8.4.2 RLF ...... 190 8.5 Reaching the limit of 100 concurrent queries ...... 196
Chapter 9. Using Studio client to define and load data ...... 201 9.1 DB2 Analytics Accelerator Studio overview ...... 202 9.2 Creating a connection profile to the DB2 subsystem ...... 203 9.2.1 Disconnecting from DB2 subsystem ...... 205 9.2.2 Connecting to a DB2 subsystem...... 206 9.3 Adding an accelerator to a DB2 subsystem ...... 206 9.3.1 Obtaining the pairing code for authentication ...... 206 9.3.2 Adding an accelerator ...... 208 9.3.3 Enabling and disabling an accelerator ...... 210 9.3.4 Virtual accelerator ...... 211 9.4 Adding tables to an accelerator...... 212 9.5 Loading tables into an accelerator ...... 216 9.6 Enabling and disabling a table for query acceleration...... 219
Chapter 10. Query acceleration management ...... 221
Contents v 10.1 Query acceleration criteria ...... 222 10.1.1 SET CURRENT QUERY ACCELERATION ...... 223 10.1.2 Query restrictions ...... 225 10.1.3 Isolation-level considerations ...... 228 10.1.4 Locking and concurrency considerations ...... 228 10.1.5 Profile tables ...... 228 10.2 Accelerated access paths ...... 231 10.2.1 DSN_QUERYINFO_TABLE ...... 232 10.2.2 Displaying an access plan diagram...... 232 10.2.3 Access plan diagrams for queries running on DB2 Analytics Accelerator . . . . 234 10.3 Data-level query acceleration management ...... 237 10.3.1 DB2 Analytics Accelerator tuning ...... 237 10.3.2 Distribution key for data distribution ...... 238 10.3.3 Organizing keys and zone maps...... 239 10.3.4 Best practices for choosing organizing keys...... 241 10.4 DB2 Analytics Accelerator query monitoring and tuning from Data Studio ...... 242 10.4.1 Tracing ...... 246 10.5 Idiosyncrasies of EXPLAIN versus DB2 Analytics Accelerator execution results . . . 254 10.6 DB2 Analytics Accelerator versus traditional DB2 tuning ...... 256 10.6.1 REORG and RUNSTATS ...... 256 10.6.2 Indexes ...... 256 10.6.3 Data clustering ...... 257 10.6.4 Query parallelism ...... 257 10.6.5 System resources ...... 257 10.6.6 SQL tuning ...... 257 10.6.7 Data redundancy considerations ...... 258 10.7 DB2 Analytics Accelerator instrumentation ...... 258 10.8 DB2 commands for DB2 Analytics Accelerator...... 258 10.9 DB2 Analytics Accelerator catalog tables of DB2 for z/OS ...... 259 10.10 DB2 Analytics Accelerator administrative stored procedures ...... 259 10.10.1 Functions of the DB2 Analytics Accelerator stored procedures ...... 260 10.10.2 Components used by DB2 Analytics Accelerator stored procedures ...... 262 10.11 DB2 Analytics Accelerator hardware considerations...... 264
Chapter 11. Latency management...... 267 11.1 DB2 Analytics Accelerator and latency management ...... 268 11.2 Stored procedures for automating DB2 Analytics Accelerator processes...... 270 11.2.1 SYSPROC.ACCEL_ADD_TABLES ...... 271 11.2.2 SYSPROC.ACCEL_LOAD_TABLES ...... 272 11.2.3 SYSPROC.ACCEL_SET_TABLES_ACCELERATION...... 274 11.2.4 SYSPROC.ACCEL_REMOVE_TABLES ...... 275 11.2.5 Process flow for loading tables into DB2 Analytics Accelerator ...... 276 11.3 Refreshing data in a data warehouse ...... 278 11.4 Automating DB2 Analytics Accelerator data maintenance ...... 279 11.4.1 JCL and C samples provided with DB2 Analytics Accelerator ...... 280 11.4.2 JCL and UNIX System Services ...... 281 11.4.3 REXX scripting ...... 282 11.4.4 Administrative Task Scheduler ...... 284 11.4.5 Cross-loader function ...... 285 11.4.6 Full refresh of tables or partitions stored in DB2 Analytics Accelerator ...... 286 11.4.7 Adding data to tables stored in DB2 Analytics Accelerator...... 287 11.5 Enabling tables for acceleration ...... 288
vi Optimizing DB2 Queries with IBM DB2 Analytics Accelerator for z/OS Chapter 12. Performance considerations ...... 301 12.1 General performance considerations ...... 302 12.2 Environment configuration and measurements...... 303 12.2.1 Environment configuration ...... 303 12.2.2 Performance analysis methodology ...... 309 12.3 Existing workload scenario ...... 314 12.3.1 Concurrent users ...... 315 12.3.2 The results of the workload...... 315 12.3.3 Overall CPU and elapsed time observations ...... 316 12.3.4 CPU and elapsed time observations per SQL report type ...... 318 12.3.5 I/O activity ...... 324 12.3.6 DB2 subsystem impacts ...... 324 12.4 DB2 Analytics Accelerator scalability ...... 327 12.5 Other laboratory measurements ...... 331
Chapter 13. Security considerations...... 335 13.1 Data is maintained in DB2 for z/OS ...... 336 13.2 Remote access to the DB2 Analytics Accelerator...... 336 13.2.1 Pluggable authentication module and service passwords ...... 337 13.2.2 Assist onsite support...... 338 13.3 Restricted security features of DB2...... 341 13.3.1 EDITPROC, encryption, and multi-level security (MLS) considerations ...... 341 13.3.2 DB2 auditing considerations ...... 341 13.3.3 Private network considerations ...... 348 13.3.4 Cross-subsystem data access considerations ...... 348 13.4 Security administration ...... 350 13.5 Compliance with security standards ...... 353
Part 3. Additional topics...... 355
Chapter 14. Analytics and reporting on System z ...... 357 14.1 IBM business analytics on System z...... 359 14.2 Scenario serial execution results ...... 359 14.3 IBM Cognos 10 Business Intelligence...... 362 14.3.1 Cognos Business Insight and Business Insight Advanced ...... 363 14.3.2 Cognos 10 dynamic query mode and caching enhancements ...... 364 14.3.3 IBM Cognos 10 - 32-bit versus 64-bit ...... 365 14.3.4 Setting the query acceleration register from IBM Cognos BI ...... 366 14.3.5 Cognos BI report to show accelerated tables ...... 375 14.4 DB2 Query Management Facility ...... 377 14.5 SAP NetWeaver Business Warehouse ...... 378 14.6 SPSS analytics ...... 378
Chapter 15. Data sharing and disaster recovery ...... 381 15.1 Data sharing configurations with DB2 Analytics Accelerator...... 382 15.1.1 Losing an DB2 Analytics Accelerator instance ...... 383 15.1.2 Losing a data sharing member ...... 383 15.2 Implementing disaster recovery with DB2 Analytics Accelerator ...... 384 15.2.1 Table acceleration states ...... 385 15.2.2 Failover scenarios...... 385 15.2.3 Automation of failover scenarios...... 389 15.2.4 Considerations for the order of the scenarios ...... 399
Part 4. Appendixes ...... 403
Contents vii Appendix A. Recommended maintenance ...... 405 OMEGAMON/PE APARs ...... 406 DB2 9 and DB2 10 for z/OS APARs ...... 406
Appendix B. Additional material ...... 409 Locating the Web material ...... 409 Using the Web material ...... 409 System requirements for downloading the Web material ...... 409 Downloading and extracting the Web material ...... 410
Related publications ...... 411 IBM Redbooks ...... 411 Other publications ...... 411 Online resources ...... 412 Help from IBM ...... 413
Index ...... 415
viii Optimizing DB2 Queries with IBM DB2 Analytics Accelerator for z/OS Figures
1-1 The integrated System z solution ...... 6 1-2 Warehousing and Business Analytics on System z; the big picture ...... 18 1-3 DB2 and DB2 Analytics Accelerator: Workload optimized systems ...... 29 2-1 Overview of DB2 Analytics Accelerator components ...... 34 2-2 DB2 Analytics Accelerator technical foundation ...... 35 2-3 Deep integration of DB2 Analytics Accelerator within DB2 for z/OS...... 37 2-4 Query execution flow controlled by the DB2 for z/OS optimizer ...... 38 2-5 Query processing inside the DB2 Analytics Accelerator...... 39 2-6 Loading and refreshing data in DB2 Analytics Accelerator...... 42 3-1 New System z reporting initiative to gain more Insight ...... 53 3-2 Consolidate to data warehouse on System z with accelerator ...... 54 3-3 Modernizing a BI or data warehouse workload on System z ...... 55 3-4 The Great Outdoors organization ...... 57 3-5 Conceptual data warehouse environment ...... 59 3-6 GOSLDW tables, referenced by intermediate and complex report samples...... 61 3-7 GOSL schema, referenced by simple report samples ...... 62 3-8 GORT schema, referenced by simple report samples ...... 63 3-9 Simple dashboard report - GO Business View dashboard ...... 65 3-10 Complex Cognos DMR report - Great Outdoors Region Review Summary ...... 67 3-11 Lost query - query not viable to run effectively without query acceleration...... 68 4-1 DB2 and DB2 Analytics Accelerator workload ...... 72 4-2 Online transaction and analytics processing...... 73 4-3 Value assessment for various client scenarios ...... 74 4-4 Per query assessment using virtual accelerator ...... 81 4-5 ROI assessment process for traditional BI query workload acceleration ...... 82 4-6 Extrapolating workload assessment for ROI...... 83 4-7 Workload analysis results summary for Great Outdoors...... 84 4-8 Assessment result for Great Outdoors - query eligible for Accelerator...... 85 4-9 Assessment result for Great Outdoors - query not eligible for Accelerator offload . . . . 86 4-10 Influencing feasibility study through query re-write ...... 88 4-11 Access path before query re-write - sample SQL ...... 89 4-12 DSN_QUERYINFO_TABLE data before the query re-write ...... 89 4-13 Access plan after query re-write ...... 90 4-14 Sample DSN_QUERYINFO_TABLE row for a query that is not read-only...... 91 5-1 DB2 Analytics Accelerator Solution overview ...... 94 5-2 Possible connections to DB2 Analytics Accelerator ...... 95 5-3 Minimum network configuration ...... 97 5-4 Recommended network configuration ...... 98 5-5 Enhanced HOLDDATA for z/OS and OS/390 web site...... 100 5-6 Download HOLDATA ...... 101 5-7 Installation task flow ...... 103 5-8 Minimal network configuration with IP addresses assigned ...... 107 5-9 IP addresses assigned to recommended network configuration...... 107 5-10 Software updates ...... 110 5-11 Software update and add-ons wizard ...... 110 5-12 Add site window ...... 111 5-13 Selecting the plug-in to install ...... 111 5-14 Installation confirmation ...... 112
© Copyright IBM Corp. 2012. All rights reserved. ix 5-15 Plug-in is added successfully ...... 112 5-16 Preferences - Automatic updates ...... 113 5-17 List of available perspectives ...... 122 5-18 Creating a new connection profile...... 122 5-19 New Connection window...... 123 5-20 Selecting Start Tuning to bind packages and plans ...... 124 5-21 License warning message ...... 124 5-22 Configuration wizard ...... 125 5-23 Binding packages ...... 126 5-24 Creating a database ...... 126 5-25 Creating EXPLAIN tables ...... 127 5-26 Creating Query Tuner ...... 128 5-27 Granting privileges on Query Tuner Packages ...... 129 5-28 Granting execute privilege on Query Tuner Packages to PUBLIC ...... 130 5-29 Summary window ...... 131 5-30 Warning about Workload Center stored procedure ...... 131 5-31 Successful completion of database configuration...... 132 5-32 Prompt for DB2 Analytics Accelerator console password...... 134 5-33 IBM DB2 Analytics Accelerator Console...... 135 5-34 Validity of the pairing code ...... 135 5-35 Accelerator pairing information ...... 135 5-36 Accelerators folder ...... 136 5-37 Object List Editor...... 136 5-38 Add Accelerator wizard ...... 137 5-39 Successfully tested connection to accelerator ...... 137 5-40 Accelerator successfully added to DB2 subsystem ...... 138 5-41 New accelerator in the Accelerator Panel...... 138 5-42 Obtaining DB2 Analytics Accelerator and NPS software versions from DB2 Analytics Accelerator Studio ...... 140 5-43 Saving Eclipse error log to obtain all required version information ...... 141 6-1 WLM components relationship ...... 145 6-2 WLM Service definition formatter ...... 149 7-1 DB2 Analytics Accelerator accounting data flow...... 163 7-2 DB2 Analytics Accelerator Statistics data flow ...... 169 7-3 DISPLAY ACCEL command syntax ...... 172 7-4 DISPLAY THREAD command showing the ACCEL option ...... 175 8-1 DB2 Analytics Accelerator Data Studio showing Accelerator status STOPPED. . . . . 180 8-2 Starting an accelerator in DB2 Analytics Accelerator Data Studio ...... 181 8-3 Start accelerator fails due to communication errors ...... 181 8-4 DB2 Analytics Accelerator Data Studio showing multiple communications errors . . . 182 8-5 DB2 Analytics Accelerator Data Studio showing failed query requests ...... 185 8-6 DB2 Analytics Accelerator Data Studio cannot connect to DB2 ...... 188 8-7 Distributed query in DB2 fails with -905 ...... 195 8-8 Distributed query running to completion in DB2 Analytics Accelerator ...... 195 8-9 SET CURRENT QUERY ACCELERATION syntax ...... 197 9-1 List of perspectives available ...... 203 9-2 Creating a new connection profile...... 204 9-3 New Connection window...... 205 9-4 Administration Explorer - with active connection to a DB2 subsystem ...... 205 9-5 Icon representing DB2 subsystem in Administration Explorer ...... 206 9-6 Prompt for DB2 Analytics Accelerator console password...... 207 9-7 IBM DB2 Analytics Accelerator Console...... 207 9-8 Setting the validity of the pairing code ...... 207 x Optimizing DB2 Queries with IBM DB2 Analytics Accelerator for z/OS 9-9 Accelerator pairing information ...... 208 9-10 Accelerators folder ...... 208 9-11 Object List Editor...... 208 9-12 Add Accelerator wizard ...... 209 9-13 Successfully tested connection to accelerator ...... 209 9-14 Successfully added accelerator to DB2 subsystem ...... 210 9-15 New accelerator in Accelerator panel ...... 210 9-16 Enabling an accelerator ...... 211 9-17 Stopping an accelerator ...... 211 9-18 Adding Virtual Accelerator ...... 212 9-19 Add Virtual Accelerator window ...... 212 9-20 Accelerator view ...... 213 9-21 Add Table wizard ...... 214 9-22 Accelerator view with list of tables in accelerator ...... 214 9-23 Accelerator view ...... 215 9-24 Query Monitor section...... 215 9-25 Loading tables...... 216 9-26 Load Table wizard...... 218 9-27 Loading in progress ...... 218 9-28 Load completed and tables enabled for acceleration ...... 219 9-29 Enabling or disabling a table for acceleration ...... 220 10-1 DB2 Analytics Accelerator offload criteria...... 222 10-2 Sample DSN_STATEMNT_TABLE row when COST_CATEGORY=A ...... 231 10-3 Sample DSN_STATEMNT_TABLE row when COST_CATEGORY=B ...... 231 10-4 Access plan with CURRENT QUERY ACCELERATION = NONE ...... 233 10-5 Access plan with CURRENT QUERY ACCELERATION = ENABLE ...... 234 10-6 Sample access plan diagram - accelerated query with new nodes for Accelerator . 235 10-7 DB2 Analytics Accelerator access plan optimization by altering distribution key . . . 239 10-8 DB2 Analytics Accelerator Studio - Accelerators view ...... 243 10-9 Query monitoring twistie on DB2 Analytics Accelerator Studio...... 244 10-10 Query Monitoring section in DB2 Analytics Accelerator Studio...... 244 10-11 Adjust Query Monitoring Table selected ...... 245 10-12 Tracing from DB2 Analytics Accelerator Studio ...... 247 10-13 Configure Accelerator trace from Studio using available trace profiles...... 248 10-14 Saving DB2 Analytics Accelerator trace from Studio ...... 249 10-15 DB2 Analytics Accelerator Studio - alter the distribution key ...... 250 10-16 Alter distribution/organizing keys from DB2 Analytics Accelerator Studio - Available columns ...... 251 10-17 New distribution/organizing keys observed from DB2 Analytics Accelerator Studio 252 10-18 Alter distribution/organizing keys from DB2 Analytics Accelerator Studio - Query response time degradation...... 252 10-19 DISPLAY ACCEL command output during alter keys process ...... 253 10-20 SQL Results View Options for Max row count settings...... 255 10-21 System overview diagram...... 260 10-22 Components used by DB2 Analytics Accelerator stored procedures ...... 263 10-23 Linear relationship between response time and 3 Accelerator appliance models . 264 10-24 Linear characteristics of different DB2 Analytics Accelerator models...... 265 11-1 Process flow to load tables into DB2 Analytics Accelerator ...... 277 12-1 Overview of performance sources of information used for impact analysis ...... 309 12-2 OMPE PW table organization overview ...... 313 12-3 Before Accelerator: all LPAR CPU utilization and 4-hour MSU rolling average . . . . 317 12-4 After Accelerator: all LPAR CPU utilization and 4-hour MSU rolling average...... 317 12-5 Before DB2 Analytics Accelerator: CPU utilization per report...... 319
Figures xi 12-6 After DB2 Analytics Accelerator: CPU utilization per report ...... 319 12-7 I/O activity during workload in DB2 ...... 324 12-8 I/O activity during workload executed in DB2 Analytics Accelerator...... 324 12-9 DB2 Address space CPU utilization, workload executed in DB2 ...... 325 12-10 DB2 Address space CPU utilization, workload executed in Accelerator...... 325 12-11 Buffer pool activity during workload activity before DB2 Analytics Accelerator. . . . 326 12-12 Buffer pool activity during workload activity with DB2 Analytics Accelerator . . . . . 327 12-13 DB2 Analytics Accelerator concurrency and scalability test ...... 328 12-14 Scalability workload in DB2...... 329 12-15 Scalability workload in DB2...... 330 12-16 Monitoring Accelerator query execution via DB2 Analytics Accelerator Data Studio330 13-1 Sample telnet connection for user through SSH to DB2 Analytics Accelerator . . . . 337 13-2 Components of DB2 Analytics Accelerator installation ...... 338 13-3 GUI functionality to transfer and apply new accelerator server code ...... 339 13-4 AOS prompt for session token ...... 339 13-5 AOS session acceptance window...... 340 13-6 AOS chat window and share control mode option ...... 340 13-7 Monitoring section of Data Studio showing the accelerated query ...... 344 13-8 Minimum network cabling between CEC and DB2 Analytics Accelerator...... 348 13-9 Recommended network cabling between CEC and DB2 Analytics Accelerator. . . . 348 13-10 Multiple DB2 subsystems connected to one Accelerator having tables loaded . . . 349 13-11 Accessing DB2 Analytics Accelerator with the same authentication token...... 349 13-12 Modified table mapping for test subsystem...... 349 13-13 Selecting the Error Log to list procedures or DB2 commands called by the GUI . . 352 14-1 Cognos BI job to execute reports sequentially ...... 362 14-2 IBM Cognos BI server install package decision tree...... 366 14-3 Setting DB2 open session commands in Cognos BI data source connection . . . . . 368 14-4 Example Accelerator query trace file - entry for accelerated Cognos BI report . . . . 371 14-5 Passing stored procedure parameters using DB2 Analytics Accelerator studio . . . . 372 14-6 Query list from DB2 Analytics Accelerator returned as XML output parameter . . . . 374 14-7 Example report showing accelerated tables and currency of data ...... 377 15-1 2-way data sharing configuration with separate Accelerators on each member. . . . 382 15-2 Network configuration ...... 384 15-3 Tables registered/loaded on both accelerators - queries run on IDAA2 with reduced performance ...... 387 15-4 Load process after disaster - App1, App2, and App3 unavailable during load . . . . . 388 15-5 All queries run from surviving data sharing member on IDAA2 with reduced performance ...... 389 15-6 The XML conversion: input and output ...... 390 15-7 Finding the candidate tables ...... 392 15-8 Process for different tables enabled on the two accelerators ...... 396 15-9 Standard sequence of scenarios ...... 400 15-10 Maintenance scenario...... 401
xii Optimizing DB2 Queries with IBM DB2 Analytics Accelerator for z/OS Examples
1-1 Sample query ...... 10 2-1 -START ACCEL command and output ...... 43 2-2 -STOP ACCEL command and output ...... 43 2-3 -DISPLAY ACCEL(*) syntax ...... 43 2-4 -DISPLAY ACCEL output ...... 44 2-5 -DISPLAY ACCEL(*) DETAIL output ...... 44 2-6 DISPLAY THREAD(*) ACCEL(*) output ...... 47 5-1 Sample JCL for SMP/E REPORT MISSINGFIX command...... 101 5-2 Report output ...... 102 5-3 z/OS VIPA definition ...... 108 5-4 Sample DSNZPARM values for DB2 for z/OS Version 10.1...... 114 5-5 Sample DSNZPARM values for DB2 for z/OS Version 9.1...... 114 5-6 Sample WLM environment for DB2 Analytics Accelerator stored procedures ...... 116 5-7 Sample WLM startup procedure ...... 116 5-8 To list WLM environment used by the DB2 stored procedures...... 118 5-9 DISPLAY WLM command...... 118 5-10 DISPLAY WLM output ...... 118 5-11 Sample .profile file ...... 120 5-12 Sample DISPLAY DDF output ...... 120 5-13 Sample clp.properties file ...... 121 5-14 Sample SQL for DSN_QUERYINFO_TABLE ...... 132 5-15 Command used to telnet to the DB2 Analytics Accelerator console...... 134 5-16 XML input to Message parameter of Accelerator procedures for version information 139 5-17 XML output for version information ...... 140 6-1 Print WLM definitions in ISPF ...... 147 6-2 Saving the ISPF list data set...... 147 6-3 Confirmation ISPF list has been kept ...... 148 6-4 Service Definition print ...... 148 6-5 SDSF showing DB2 Address Spaces Service Classes ...... 150 6-6 STCHI service class definition ...... 150 6-7 WLM classification of DB2 address spaces ...... 150 6-8 Installing WLM definitions ...... 151 6-9 Activation of a WLM policy ...... 151 6-10 Selecting the WLM policy to activate ...... 152 6-11 Activation WLM policy feedback message ...... 152 6-12 DISPLAY WLM command output ...... 152 6-13 SDSF showing DB2 Address Spaces Service Classes after changes ...... 153 6-14 Custom Service Class definition for our concurrent workload...... 153 6-15 WLM classification rules, reports ...... 154 6-16 Cognos open session data source connection command block settings for WLM . . 155 6-17 WLM set client info as reported in -DIS THD(*) DETAIL command ...... 155 6-18 WLM client set information as reported in RMF Enclave Classification Data panel . 155 6-19 Error in WLM address space: -471 ...... 157 6-20 Failure as reported in DB2 Analytics Accelerator GUI ...... 157 6-21 WLM classification rules for stored procedures address spaces ...... 159 6-22 WLM classification of stored procedures ...... 159 7-1 OMPE Accounting LAYOUT(LONG) command ...... 163 7-2 OMPE Accounting Report Long Accelerator section ...... 164
© Copyright IBM Corp. 2012. All rights reserved. xiii 7-3 OMPE Accounting LAYOUT(ACCEL) command ...... 164 7-4 OMPE Accounting Layout Accel ...... 164 7-5 OMPE Accounting report, distributed activity section ...... 165 7-6 OMPE SQL DCL block ...... 166 7-7 High DB2 Not accounted time when off-loaded to DB2 Analytics Accelerator ...... 167 7-8 OMPE Accounting Trace Distributed activity section ...... 167 7-9 OMPE Accounting Trace Accelerator activity section...... 168 7-10 OMPE Statistics report layout long command example ...... 169 7-11 OMPE Statistics Long report showing the accelerator section ...... 169 7-12 OMPE Statistics report showing DB2 Analytics Accelerator command counters . . . 171 7-13 Displaying Accelerators status using commands ...... 172 7-14 DISPLAY ACCEL(*) output example ...... 172 7-15 DISPLAY ACCEL command with the DETAIL option ...... 173 7-16 DISPLAY ACCEL DETAIL output example...... 173 7-17 DISPLAY ACCEL DETAIL output sample showing activity...... 174 7-18 Displaying accelerated threads...... 175 7-19 Remote access thread off-loaded to DB2 Analytics Accelerator...... 176 7-20 DIS ACCEL DETAIL showing STATUS=ONLINE...... 176 7-21 DIS ACCEL DETAIL showing STATUS=UNKNOWN ...... 177 8-1 DB2 master address spaces - Accelerator communication error ...... 182 8-2 Simple COUNT(*) test query...... 183 8-3 Example of SQL exception in SPUFI when query is executed in DB2 ...... 183 8-4 DB2 Analytics Accelerator query execution giving DB2 RC=-904 ...... 184 8-5 DIS ACCEL DETAIL command showing query failures ...... 184 8-6 Abnormal thread termination reported in DB2 Master address space sysout...... 185 8-7 DRDA failure for a cancelled query off-loaded to DB2 Analytics Accelerator ...... 185 8-8 STOP DDF followed by DIS DDF ...... 186 8-9 DIS THD command showing ST=AC ...... 186 8-10 STOP DDF ends after query finished in DB2 Analytics Accelerator ...... 187 8-11 DB2 Analytics Accelerator becomes unavailable after DDF stop and start ...... 187 8-12 Stopping DB2 while running DB2 Analytics Accelerator queries ...... 187 8-13 DB2 shutdown in progress ...... 188 8-14 DIS DDF DETAIL command output ...... 188 8-15 DIS ACCEL command output ...... 189 8-16 DB2 STOP completed...... 189 8-17 Creating different DB2 collections...... 190 8-18 Binding DB2 Client packages in new collection ...... 190 8-19 Population the resource limit table for reactive governing of SPUFI...... 191 8-20 Partial output of the D M=CPU system command ...... 191 8-21 RMF CPC Capacity panel...... 192 8-22 Estimating ASUTIME ...... 192 8-23 Starting RLF ...... 193 8-24 START RLF output example...... 193 8-25 RLIMIT action when no Accelerator involved ...... 193 8-26 RLIMIT action when queries are off-loaded to DB2 Analytics Accelerator ...... 193 8-27 DIS THD showing the IP address of a distributed request ...... 194 8-28 Inserting a row in the RLMT tables ...... 194 8-29 Display of concurrent accelerator queries...... 196 8-30 Statistics on concurrent queries ...... 196 8-31 Query rejected from DB2 Analytics Accelerator ...... 197 8-32 Query falling in DB2 Analytics Accelerator ...... 197 8-33 DB2 Master address space reporting a query rejected by DB2 Analytics Accelerator . . 198 xiv Optimizing DB2 Queries with IBM DB2 Analytics Accelerator for z/OS 8-34 OMPE ACCOUNTING LAYOUT (LONG) for a Accelerator rejected DB2 thread. . . 198 8-35 DML section of OMPE Accounting report ...... 199 8-36 Distributed activity section of OMPE Accounting report ...... 199 8-37 Accounting report - Accelerator section ...... 200 9-1 Telnet to DB2 Analytics Accelerator console ...... 206 10-1 Simple query that is eligible for DB2 Analytics Accelerator offload...... 233 10-2 DISPLAY ACCEL(*) command output during alter keys process ...... 253 10-3 EXPLAIN result - Query not accelerated but actually routed to Accelerator...... 254 10-4 EXPLAIN output - query is accelerated but not routed to Accelerator ...... 255 11-1 Obtain last refresh time from SYSACCEL.SYSACCELERATEDTABLES ...... 268 11-2 Last refresh time stamp for table ...... 268 11-3 A trigger definition to update control tables...... 269 11-4 Distinction of data sources ...... 270 11-5 Call statement and XML structure for ACCEL_ADD_TABLES ...... 271 11-6 Call statement and XML structure for SYSPROC.ACCEL_LOAD_TABLES ...... 272 11-7 Call statement and XML structure for ACCEL_SET_TABLES_ACCELERATION . . 275 11-8 Call statement and XML structure for ACCEL_REMOVE_TABLES ...... 275 11-9 Verification if table metadata is available on DB2 Analytics Accelerator ...... 277 11-10 Controlling which stored procedure to execute...... 281 11-11 Calling DB2 for z/OS Command Line Processor through BPXBATCH...... 281 11-12 Content of file /u/pbecker/idaa/loadidaa ...... 281 11-13 Required content of clp.properties ...... 282 11-14 Example of calling stored procedure ACCEL_LOAD_TABLES from REXX ...... 283 11-15 Invoking cross-loader using DB2 Analytics Accelerator ...... 285 11-16 Calling cross-loader using DSNUTILU ...... 286 11-17 Initial table status of GOSLDW.SALES_FACT table ...... 287 11-18 Adding a partition to GOSLDW.SALES_FACT ...... 287 11-19 Modified table status of GOSLDW.SALES_FACT table ...... 287 11-20 XML input for load specification ...... 288 11-21 Rotating partitions of GOSLDW.SALES_FACT ...... 288 11-22 JCL and XML data to load SALES_FACT table ...... 290 11-23 JESMSGLG output for loading SALES_FACT table...... 292 11-24 Job output of step AQTSC03 adding SALES_FACT table to Accelerator ...... 293 11-25 Job output of step AQTSC04 for loading SALES_FACT table ...... 293 11-26 Job output of step AQTSC05 for loading SALES_FACT table ...... 294 11-27 DD Statement AQTP3 for reloading the last partition of SALES_FACT table. . . . . 295 11-28 JCL and XML data to load all other tables ...... 295 11-29 Job output of loading all other tables ...... 299 12-1 Test environment CPU configuration ...... 303 12-2 Test environment CPC capacity ...... 304 12-3 Test environment Real Storage configuration...... 304 12-4 Test environment z/OS information ...... 304 12-5 Test environment DB2 Analytics Accelerator configuration ...... 305 12-6 Test environment DB2 level ...... 305 12-7 DIS Buffer pool showing PGSTEAL(NONE) ...... 308 12-8 DISPLAY VIRSTOR,LFAREA output sample ...... 308 12-9 Extracting SMF data with IFASMFDP...... 310 12-10 Setting up the DB2 and DB2 Analytics Accelerator environment with commands . 311 12-11 Starting DSC traces ...... 312 12-12 ACCESS DATABASE command example ...... 312 12-13 Starting DB2 Analytics Accelerator ...... 312 12-14 DISPLAY ACCEL command ...... 312 12-15 Using the FILE option in OMPE ...... 314
Examples xv 12-16 DISPLAY ACCEL command during DB2 Analytics Accelerator test execution . . . 315 12-17 OMPE Report syntax, before DB2 Analytics Accelerator ...... 319 12-18 OMPE syntax report showing the ORDER command...... 320 12-19 OMPE Report of RI09 DB2 execution, partial view...... 320 12-20 OMPE Report of RI09 DB2 Analytics Accelerator execution, partial view ...... 321 12-21 Accelerator section of the OMPE ACCOUNTING LAYOUT(LONG) report ...... 321 12-22 Scalability workload script...... 328 12-23 Showing 10 ACTV requests and low CPU utilization ...... 331 13-1 Prompt of SSH connection to DB2 Analytics Accelerator installation ...... 337 13-2 Adding audit definition to a table that was defined as accelerated...... 341 13-3 DB2 command to start and stop auditing trace...... 341 13-4 Job to generate an audit report with OMEGAMON...... 342 13-5 Audit trace for Report RI03 without DB2 Analytics Accelerator enabled...... 342 13-6 Audit trace for Report RI03 with DB2 Analytics Accelerator enabled ...... 344 13-7 Audit trace with user information from Cognos ...... 346 13-8 Recommended view definition for accelerated tables on physical accelerators . . . . 350 13-9 Assign execute authority for Accelerator procedures to different user groups . . . . . 352 14-1 Cognos XML command block - set query acceleration...... 368 14-2 Cognos XML command block - call WLM set client info stored proc ...... 371 14-3 Example QUERY_SELECTION parameter for procedure ACCEL_GET_QUERIES 373 14-4 Accelerator Studio output trace file - Cognos BI client information...... 375 15-1 XML output ...... 390 15-2 XML text ...... 390 15-3 Java method sample...... 392 15-4 Disabling tables on source and enabling on target accelerator ...... 393 15-5 Java method for finding registered but not loaded tables ...... 396 15-6 Loading tables...... 398
xvi Optimizing DB2 Queries with IBM DB2 Analytics Accelerator for z/OS Tables
2-1 Available stored procedures to administer DB2 Analytics Accelerator ...... 40 2-2 Invoked DB2-supplied stored procedures...... 40 3-1 GOSLDW table row counts...... 61 3-2 GOSL table row counts...... 63 3-3 GORT table row counts ...... 64 3-4 Parameters used for concurrent workload scenario ...... 69 4-1 Assessment questionnaire - environment details ...... 75 4-2 Assessment questionnaire - data warehouse details ...... 76 4-3 DSN_QUERYINFO_TABLE columns after running EXPLAIN with virtual accelerator . 80 5-1 Hardware prerequisites...... 96 5-2 Supported IBM Netezza models ...... 96 5-3 Network components for minimum configuration...... 97 5-4 Network components needed for high availability configuration ...... 98 5-5 Supported IBM zEnterprise operating systems...... 99 5-6 Supported database management systems ...... 99 10-1 List of DB2 scalar functions supported in DB2 Analytics Accelerator ...... 225 10-2 DSN_PROFILE_ATTRIBUTES table ...... 229 10-3 Two significant columns of DSN_QUERYINFO_TABLE...... 232 10-4 Nodes in access plan diagrams of accelerated queries ...... 235 10-5 Minimum size of tables in DB2 Analytics Accelerator for tuning organizing key. . . . 241 10-6 DB2 Analytics Accelerator catalog tables ...... 259 10-7 Global temporary tables and stored procedures...... 264 11-1 List of tables ...... 288 11-2 Parameters used to load tables into Accelerator using stored procedures...... 289 12-1 Test environment DB2 system parameters...... 306 12-2 DB2 Analytics Accelerator DB2 system parameters...... 306 12-3 Buffer pool configuration ...... 307 12-4 Testing protocol ...... 310 12-5 Workload scenario: Elapsed time before and after Accelerator per report ...... 315 12-6 CPU and elapsed time savings...... 318 12-7 CPU time changes of non-offloaded reports...... 322 12-8 Elapsed time changes of non-offloaded reports ...... 322 12-9 CPU time changes: DB2 Analytics Accelerator offloaded reports...... 323 12-10 Elapsed time changes: DB2 Analytics Accelerator offloaded reports ...... 323 12-11 Workload results: DB2 versus DB2 Analytics Accelerator elapsed times...... 331 12-12 CPU offload and result set size...... 332 13-1 Functionality available to user groups in the Great Outdoors scenario...... 351 14-1 Report serial execution test - Comparison results ...... 360 14-2 Cognos BI session variables passed to WLM client information...... 370 15-1 Example tables and acceleration states ...... 385 A-1 OMEGAMON PE DB2 Analytics Accelerator-related APARs...... 406 A-2 DB2 9 and DB2 10 function APARs related to DB2 Analytics Accelerator support . . 406
© Copyright IBM Corp. 2012. All rights reserved. xvii xviii Optimizing DB2 Queries with IBM DB2 Analytics Accelerator for z/OS Notices
This information was developed for products and services offered in the U.S.A.
IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service.
IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to: IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A.
The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.
This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.
Any references in this information to non-IBM websites are provided for convenience only and do not in any manner serve as an endorsement of those websites. The materials at those websites are not part of the materials for this IBM product and use of those websites is at your own risk.
IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.
Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental.
COPYRIGHT LICENSE:
This information contains sample application programs in source language, which illustrate programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs.
© Copyright IBM Corp. 2012. All rights reserved. xix Trademarks
IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. These and other IBM trademarked terms are marked on their first occurrence in this information with the appropriate symbol (® or ™), indicating US registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml
The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both:
BigInsights™ MVS™ Resource Measurement Facility™ BNT® OMEGAMON® RETAIN® CICS® Optim™ RMF™ Cognos® OS/390® SPSS® DB2® Parallel Sysplex® System z® developerWorks® POWER® Tivoli® DRDA® pureXML® VTAM® DS8000® QMF™ WebSphere® GDPS® Query Management Facility™ z/Architecture® Guardium® RACF® z/OS® IBM® Redbooks® zEnterprise® IMS™ Redpaper™ InfoSphere® Redbooks (logo) ®
The following terms are trademarks of other companies:
Netezza, NPS, and N logo are trademarks or registered trademarks of IBM International Group B.V., an IBM Company.
Intel, Intel logo, Intel Inside logo, and Intel Centrino logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
Linux is a trademark of Linus Torvalds in the United States, other countries, or both.
Microsoft, Windows, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
NOW, and the NetApp logo are trademarks or registered trademarks of NetApp, Inc. in the U.S. and other countries.
Java, and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.
UNIX is a registered trademark of The Open Group in the United States and other countries.
BNT, and Server Mobility are trademarks or registered trademarks of Blade Network Technologies, Inc., an IBM Company.
Other company, product, or service names may be trademarks or service marks of others.
xx Optimizing DB2 Queries with IBM DB2 Analytics Accelerator for z/OS Preface
The IBM® DB2® Analytics Accelerator Version 2.1 for IBM z/OS® (also called DB2 Analytics Accelerator or Query Accelerator in this book and in DB2 for z/OS documentation) is a marriage of the IBM System z® Quality of Service and Netezza® technology to accelerate complex queries in a DB2 for z/OS highly secure and available environment. Superior performance and scalability with rapid appliance deployment provide an ideal solution for complex analysis.
This IBM Redbooks® publication provides technical decision-makers with a broad understanding of the IBM DB2 Analytics Accelerator architecture and its exploitation by documenting the steps for the installation of this solution in an existing DB2 10 for z/OS environment.
In the book we define a business analytics scenario, evaluate the potential benefits of the DB2 Analytics Accelerator appliance, describe the installation and integration steps with the DB2 environment, evaluate performance, and show the advantages to existing business intelligence processes.
The team who wrote this book
This book was produced by a team of specialists from around the world working at the Boeblingen Lab, Germany.
Paolo Bruni is a DB2 Information Management Project Leader at the International Technical Support Organization based in the Silicon Valley Lab. He has authored several IBM Redbooks publications about DB2 for z/OS and related tools, and has conducted workshops and seminars worldwide. During his years with IBM, in development and in the field, Paolo has worked mostly on database systems.
Patric Becker is a Software Architect in the Data Warehousing on System z Center of Excellence at IBM Boeblingen Lab. The team conducts Proofs of Concept for large and complex DWH implementations and supports clients in all areas of DWH topics on System z. Before joining IBM, Patric worked for one of the largest DB2 for z/OS clients in Europe. He has over 14 years of experience with DB2 for z/OS. In the past, Patric has been responsible for developing several high availability DB2 and IBM IMS™ applications. He is also co-author of these IBM Redbooks publications: DB2 for z/OS Using Large Objects, DB2 UDB for z/OS: Application Design for High Performance and Availability, LOBs with DB2 for z/OS: Stronger and Faster, and Co-locating Transactional and Data Warehouse Workloads on System z, SG24-7726.
Willie Favero is an IBM Senior Certified IT Software Specialist and DB2 SME with the IBM Silicon Valley Lab Data Warehouse on System z Swat Team. He has over 30 years of experience working with databases, including more than 24 years working with DB2. Willie is a sought-after speaker for international conferences and user groups. He also publishes articles and white papers, and has a top technical blog on the Internet.
Ravikumar Kalyanasundaram is a Managing Consultant who is currently working on the Lab Services team in IBM Software Group, USA. Ravi has over 20 years of experience with database technology. He provides DB2 System Administration and Performance Management services for large clients on z/OS. He holds a Bachelor’s degree in Electrical
© Copyright IBM Corp. 2012. All rights reserved. xxi and Electronics Engineering and a Masters degree in Business Administration. Ravi is a co-author of three IBM Redbooks: Optimizing Restore and Recovery Solutions with DB2 Recovery Expert for z/OS, SG24-7606; DB2 9 for z/OS Resource Serialization and Concurrency Control, SG24-4725-01; DB210 for z/OS Performance Topics, SG24-7942. He travels to clients all over the world and plays a direct role in increasing the long-term strength and competitive posture of IBM database products and tools. He is a regular contributor to the DB2 for z/OS group in LinkedIn social networking site at http://www.linkedin.com/in/ravikalyanasundaram.
Andrew Keenan is a Managing Consultant in Australia with IBM. He has 15 years experience in business intelligence, management reporting, database systems and data migration projects. He has experience with a number of vendor products within the analytics, reporting, and information management solution areas. Andrew is also a co-author of the IBM Redbooks publication Enterprise Data Warehousing with DB2 9 for z/OS, SG24-7637.
Steffen Knoll is an IT specialist in the Data Warehousing on System z Center of Excellence at IBM Boeblingen Laboratory. The team conducts Proofs of Concept for large and complex DWH implementations, and supports clients in all areas of DWH topics on System z. Previously, Steffen was a senior software developer for the IBM DB2 Analytics Accelerators stored procedures and server components. He holds has a Bachelor’s degree in Computer Science and joined IBM in 2006.
Nin Lei is recognized as an authority in database performance technology, covering both high end and high volume online transaction processing and business intelligence disciplines with interest in Very Large Databases. He is an IBM Distinguished Engineer and Chief Technology Officer for Business Analytics in the System and Technology Group (STG). He is responsible for driving STG systems growth into the business analytics segment by advancing STG assets into business solutions that meet worldwide client needs. Nin delivers valuable technical counsel to key business analytics leaders and executives on technical strategy, direction and projects, and provides leadership across the breadth of our STG development community on business analytics value propositions that improve our technical content in solutions, and assists in platform positioning for specific client workloads.
Cristian Molaro is an IBM Gold Consultant, an independent DB2 specialist, and an instructor, who is based in Belgium. He has been recognized by IBM as an Information Champion in 2009, 2010, and 2011. His main activity is linked to DB2 for z/OS administration and performance. Cristian is co-author of these IBM Redbooks publications: Enterprise Data Warehousing with DB2 9 for z/OS, SG24-7637, 50 TB Data Warehouse Benchmark on IBM System z, SG24-7674, DB2 9 for z/OS: Distributed Functions, SG24-6952-01, Co-locating Transactional and Data Warehouse Workloads on System z, SG24-7726, and DB2 10 for z/OS Performance Topics, SG24-7942. He holds a Chemical Engineering degree and a Masters degree in Management Sciences. He can be reached at [email protected].
P S Prem is a Consulting IT Specialist in the IBM Asia Pacific TechWorks team, in which he leads the IBM Information Management for System z Technical Sales team for Asia Pacific. His areas of expertise include DB2 for z/OS, DB2 tools and data replication. He has 20 years of experience working with System z technologies in application development, technical architecture, and consulting. Prem has presented to DB2 conferences and user groups, and has contributed to IBM Redbooks publications. He has been with IBM for eight years, working primarily in database and DB2 solutions architecture and consulting.
Special thanks to Guenter Schoellmann for his support throughout this project, and to Oliver Draese for providing the content on disaster recovery considerations.
Thanks to the following people for their contributions to this project:
xxii Optimizing DB2 Queries with IBM DB2 Analytics Accelerator for z/OS Emma Jacobs Michael Schwartz International Technical Support Organization
Brian Baggett CJ Chang Gopal Krishnan Ruiping Li Maggie Lin Rebecca Poole Jim Ruddy Roy Smith Lingyun Wang Guogen Zhang IBM Silicon Valley Lab
Peter Bendel Rainer Michael Benirschke Uwe Denneler Oliver Draese Norbert Heck Wolfgang Hengstler Namik Hrle Norbert Jenninger Claus Kempfert Sascha Laudien Guenter Marquardt Frank Neumann Georg Mayer Manfred Oevers Elisabeth Puritscher Helmut Schilling Guenter Schoellmann Knut Stolze IBM Boeblingen Lab
Scott Smith IBM Software Group Australia
Ann Jackson IBM Software Group, Cognos®
Matthew Walli IBM Software Group, Strategy and Technology
Now you can become a published author, too!
Here’s an opportunity to spotlight your skills, grow your career, and become a published author—all at the same time! Join an ITSO residency project and help write a book in your area of expertise, while honing your experience using leading-edge technologies. Your efforts will help to increase product acceptance and customer satisfaction, as you expand your network of technical contacts and relationships. Residencies run from two to six weeks in length, and you can participate either in person or as a remote resident working from your home base.
Preface xxiii Find out more about the residency program, browse the residency index, and apply online at: ibm.com/redbooks/residencies.html
Comments welcome
Your comments are important to us!
We want our books to be as helpful as possible. Send us your comments about this book or other IBM Redbooks publications in one of the following ways: Use the online Contact us review Redbooks form found at: ibm.com/redbooks Send your comments in an email to: [email protected] Mail your comments to: IBM Corporation, International Technical Support Organization Dept. HYTD Mail Station P099 2455 South Road Poughkeepsie, NY 12601-5400
Stay connected to IBM Redbooks