DOCSLIB.ORG

Query Acceleration for Business Using IBM Informix Warehouse Accelerator

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Query Acceleration for Business Using IBM Informix Warehouse Accelerator Front cover IBM® Information Management Software Query Acceleration for Business Using IBM Informix Warehouse Accelerator Technology and architecture of Informix Warehouse Accelerator Data mart design considerations and examples IBM Cognos Business Intelligence integration Whei-Jen Chen Nigel Campbell Martin Fuerderer Frederick Ho Holger Kirstein Keshava Murthy Ramanathan Sivaguru ibm.com/redbooks International Technical Support Organization Query Acceleration for Business Using IBM Informix Warehouse Accelerator November 2013 SG24-8150-00 Note: Before using this information and the product it supports, read the information in “Notices” on page ix. First Edition (November 2013) This edition applies to IBM Informix Version 12.10. © Copyright International Business Machines Corporation 2013. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . ix Trademarks . x Preface . xi Authors . xi Acknowledgements . xiv Now you can become a published author, too! . xv Comments welcome. xv Stay connected to IBM Redbooks . xv Chapter 1. Introduction to IBM Informix Warehouse Accelerator. 1 1.1 Problems that Informix Warehouse Accelerator solves for its customers . 2 1.2 History of Informix Warehouse Accelerator. 2 1.3 Key Informix Warehouse Accelerator technologies. 4 1.3.1 Informix Warehouse Accelerator architecture . 5 1.3.2 Informix and Informix Warehouse Accelerator data mart definition and data loading . 5 1.3.3 Query execution in Informix and Informix Warehouse Accelerator . 6 1.3.4 Data synchronization in both Informix and Informix Warehouse Accelerator . 6 1.4 Informix Warehouse Accelerator architectural options . 7 1.5 Components of Informix Warehouse Accelerator . 8 1.5.1 Coordinator node . 9 1.5.2 Worker node . 9 1.6 Informix Warehouse Accelerator tools . 9 1.7 Business intelligence tools that are used with Informix and Informix Warehouse Accelerator . 10 1.8 Informix Warehouse Accelerator editions . 11 1.9 Informix Warehouse Accelerator positioning. 12 Chapter 2. Designing data marts . 15 2.1 Relational database design overview . 16 2.1.1 Designs for OLTP . 16 2.1.2 Designs for OLAP and dimensional modeling. 19 2.2 Dimensional modeling for Informix Warehouse Accelerator . 23 2.2.1 Degree of denormalization . 24 2.2.2 Composing a data mart. 24 2.2.3 Subsets in a snowflake schema . 26 2.2.4 Overlapping snowflake schemas . 28 © Copyright IBM Corp. 2013. All rights reserved. iii 2.2.5 Types of relationships between tables . 30 2.3 Designing Informix Warehouse Accelerator data marts . 32 2.3.1 Supported data types . 32 2.3.2 Data compression . 32 2.3.3 Dimension tables and multiple Informix Warehouse Accelerator worker nodes . 33 2.3.4 Data mart metadata in the Informix server . 34 Chapter 3. Designing and sizing an IBM Informix Warehouse Accelerator environment. 35 3.1 Architectural considerations . 36 3.1.1 SMP environment . 36 3.1.2 Cluster environment . 40 3.1.3 Virtual machine environment. 42 3.1.4 Changing an existing configuration . 43 3.2 Continuous data mart availability . 44 3.3 Sizing. 44 3.3.1 General resource considerations . 45 3.3.2 Sizing for an SMP environment. 48 3.3.3 Sizing for a cluster environment . 51 3.3.4 Sizing for a VM environment . 53 3.3.5 Network connectivity . 54 Chapter 4. IBM Informix Warehouse Accelerator installation and configuration . 55 4.1 Installation of the Informix Warehouse Accelerator server . 56 4.1.1 Installation of Informix Warehouse Accelerator: Single computer. 56 4.1.2 Installation of Informix Warehouse Accelerator: Cluster . 57 4.2 Configuration tasks . 58 4.2.1 Configuring Informix Warehouse Accelerator . 58 4.2.2 Operating system setup requirements . 62 4.2.3 Configuring the Informix server . 64 4.3 Setting up and starting the accelerator server. 65 4.3.1 Setting up Informix Warehouse Accelerator . 65 4.3.2 Starting Informix Warehouse Accelerator . 65 4.3.3 Connecting Informix server and Informix Warehouse Accelerator . 67 Chapter 5. Creating IBM Informix Warehouse Accelerator data marts . 69 5.1 Data marts as objects in Informix Warehouse Accelerator . 70 5.2 Identifying workloads in your business environments . 71 5.3 Data mart creation by using workload analysis . 72 5.3.1 Workload analysis methods . 73 5.3.2 Workload Analysis by using OAT . 74 5.3.3 Data mart deployment by using OAT . 79 iv Query Acceleration for Business Using IBM Informix Warehouse Accelerator 5.4 Interactive data mart design with IBM Smart Analytics Optimizer Studio . 84 5.5 Embedded data mart creation by using sysdbopen() . 94 5.6 Designing a data mart that is based on SQL trace filtering . 96 5.7 Using Informix TimeSeries data in an Informix Warehouse Accelerator environment . 97 Chapter 6. Query execution . 103 6.1 Overview . 104 6.2 Query execution flow. 105 6.2.1 Step 1: Submitting SQL on the application or BI tools . 107 6.2.2 Step 2: Optimizing and matching the query . 108 6.2.3 Step 3: Local execution. 109 6.2.4 Step 4: Accelerating SQL . 109 6.2.5 Step 5: Query processing on the coordinator node. 110 6.2.6 Step 6: Query processing on worker nodes . 111 6.2.7 Step 7: Results sent to Informix and DRDA over TCP/IP . 112 6.2.8 Step 8: Post processing on the Informix server . 112 6.2.9 Step 9: Returning results. 112 6.3 Enabling query execution . 113 6.4 Query matching . 116 6.4.1 Checklist for query (query block) qualification. 118 6.4.2 Examples for query qualification . 130 6.5 Monitoring query execution . 139 6.6 Summary . 141 Chapter 7. Managing and refreshing an IBM Informix Warehouse Accelerator data mart. 143 7.1 Overview . 144 7.1.1 IBM Informix Open Admin Tool . 145 7.1.2 The Informix and Informix Warehouse Accelerator Stored Procedure API . 146 7.1.3 IBM Smart Analytics Optimizer Studio . 147 7.2 Data synchronization.
Load more

Recommended publications
  • Data Warehouse Fundamentals for Storage Professionals – What You Need to Know EMC Proven Professional Knowledge Sharing 2011
    Data Warehouse Fundamentals for Storage Professionals – What You Need To Know EMC Proven Professional Knowledge Sharing 2011 Bruce Yellin Advisory Technology Consultant EMC Corporation [email protected] Table of Contents Introduction ................................................................................................................................ 3 Data Warehouse Background .................................................................................................... 4 What Is a Data Warehouse? ................................................................................................... 4 Data Mart Defined .................................................................................................................. 8 Schemas and Data Models ..................................................................................................... 9 Data Warehouse Design – Top Down or Bottom Up? ............................................................10 Extract, Transformation and Loading (ETL) ...........................................................................11 Why You Build a Data Warehouse: Business Intelligence .....................................................13 Technology to the Rescue?.......................................................................................................19 RASP - Reliability, Availability, Scalability and Performance ..................................................20 Data Warehouse Backups .....................................................................................................26
    [Show full text]
  • IBM Infosphere Optim Data Masking Solution Mask Data on Demand to Protect Privacy Across the Enterprise
    IBM Software Solution Brief IBM InfoSphere Optim Data Masking solution Mask data on demand to protect privacy across the enterprise Today’s organizations realize that data is a critical enterprise asset, so Highlights protecting that data and the applications that hold it makes good business sense. However, different types of information have different ●● ●●Safeguard personally identifiable informa- protection and privacy requirements. Therefore, organizations must tion, trade secrets, financials and other sensitive data take a holistic approach to protecting and securing their business-critical information: ●● ●●Easily mask data on demand using predefined transformations and site-specific routines ●●●Understand where data exists: Organizations can’t protect sensitive data unless they know where it resides and how it’s related across the ●● ●●Respond in real time to suspicious enterprise. requests for data ●●●Safeguard sensitive data, both structured and unstructured: ●● ●●Ensure a valid business need to know for Structured data contained in databases must be protected from sensitive data unauthorized access using data transformation techniques such as ●● ●●Discover hidden instances of private data masking or encryption. Unstructured data in documents, forms, image so they can be fully protected files, GPS systems and more requires privacy policies to de-identify ●● ●●Support compliance with privacy regula- or mask sensitive data while still allowing needed business information tions and corporate governance standards to be shared. ●●●Protect
    [Show full text]
  • IBM Informix 14.10: the High-Performance, Low-Footprint
    Solution Brief IBM Informix 14.10 IBM Informix 14.10 The high-performance, low-footprint database for analytics on the edge, in the cloud and on premises Enterprise databases have always needed to deliver fast transaction IBM Informix delivers: processing and the replication speeds necessary for continuous availability without adding undue administrative effort or sacrificing • Powerful, optimized time series and security. Yet, new opportunities like the Internet of Things (IoT) have geospatial data management also arisen, bringing an increase in data of various types, which businesses hope to turn into competitive advantage. For that reason, • Automated administration and self-management features many companies have turned to IBM® Informix®, a solution capable of satisfying database and analytics needs at the core of the enterprise or • Footprints under 100 MB for easy IoT at the edge of your IoT network. gateway embedding • IBM InformixHQ for collaboration and IBM Informix is an embeddable, high-performance database for management across multiple instances integrating SQL, NoSQL, JSON, time series and spatial data, which can be up and running in minutes, and is accessible from virtually any • Integrated in-memory warehouse desktop, laptop or mobile device. Its small footprint—lower than 100 MB accelerator in some cases1 —and ability to run on distributed devices with a variety of automated administrative capabilities means IBM Informix is easier to install and manage with fewer administrators, even when used across thousands of devices worldwide. These features make IBM Informix the database of choice for high-performance, multidatabase installations with remote management—as is the case for IoT edge gateways.
    [Show full text]
  • Magic Quadrant for Data Warehouse Database Management Systems
    Magic Quadrant for Data Warehouse Database Management Systems Gartner RAS Core Research Note G00209623, Donald Feinberg, Mark A. Beyer, 28 January 2011, RV5A102012012 The data warehouse DBMS market is undergoing a transformation, including many acquisitions, as vendors adapt data warehouses to support the modern business intelligence and analytic workload requirements of users. This document compares 16 vendors to help you find the right one for your needs. WHAT YOU NEED TO KNOW Despite a troubled economic environment, the data warehouse database management system (DBMS) market returned to growth in 2010, with smaller vendors gaining in acceptance. As predicted in the previous iteration of this Magic Quadrant, 2010 brought major acquisitions, and several of the smaller vendors, such as Aster Data, Ingres and Vertica, took major strides by addressing specific market needs. The year also brought major market growth from data warehouse appliance offerings (see Note 1), with both EMC/Greenplum and Microsoft formally introducing appliances, and IBM, Oracle and Teradata broadening their appliance lines with new offerings. Although we believe that much of the growth was due to replacements of aging or performance-constrained data warehouse environments, we also think that the business value of using data warehouses for new applications such as performance management and advanced analytics has driven — and is driving — growth. All the vendors have stepped up their marketing efforts as the competition has grown. End-user organizations should ignore marketing claims about the applicability and performance capabilities of solutions. Instead, they should base their decisions on customer references and proofs of concept (POCs) to ensure that vendors’ claims will hold up in their environments.
    [Show full text]
  • Cisco and IBM Informix Database Software: Enhancing Collaboration
    White paper Cisco and IBM Informix Database Software: Enhancing Collaboration Introduction Cisco® Collaboration solutions help people work together to solve problems, make decisions, accelerate time to market, and transform entire industries faster, no matter how far apart the participants happen to be located. Businesses of all sizes use Cisco Highlights Collaboration solutions, from small businesses to large enterprises. This white paper addresses In fact, IBM® has a sizeable deployment of Cisco Collaboration a number of the features and technology across its offices worldwide. techniques Cisco uses to embed Informix in its solutions, The infrastructure required to power collaboration solutions like this and why. needs to be robust, scalable, and invisible. Cisco chose to embed IBM Informix® database software in their solutions because of the robust embeddability, high reliability, and extreme performance of Informix. Today, Cisco has over 100,000 instances of Informix Contents running in production environments; a number that continues to grow. When a customer makes a VoIP call using a Cisco 1 Introduction Collaboration solution, they have unknowingly just used Informix! 2 Deployment The number of product teams inside of Cisco using Informix is also growing. As a result, Cisco developed its own internal competency 3 Upgrades center around Informix so that its product groups are leveraging Footprint Optimization best practices and have an internal support community, in addition to the enablement support provided by IBM. 4 Backup and Restore This white paper addresses a number of the features and 5 System Monitoring Interface techniques Cisco uses to embed Informix in its solutions, and why. Storage Space Management It also highlights some of Informix’s newer features.
    [Show full text]
  • IBM Informix Performance Guide
    IBM Informix Version 11.70 IBM Informix Performance Guide SC27-3544-00 IBM Informix Version 11.70 IBM Informix Performance Guide SC27-3544-00 Note Before using this information and the product it supports, read the information in “Notices” on page C-1. This document contains proprietary information of IBM. It is provided under a license agreement and is protected by copyright law. The information contained in this publication does not include any product warranties, and any statements provided in this manual should not be interpreted as such. When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you. © Copyright IBM Corporation 1996, 2010. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Introduction .................................xiii About this publication ...............................xiii Topics beyond the scope of this publication .......................xiii Types of users .................................xiv Software dependencies ..............................xiv Assumptions about your locale ...........................xiv Demonstration databases .............................xiv What's new in performance for Informix, version 11.70 .....................xv Example code conventions ..............................xvii Additional documentation..............................xviii Compliance with industry standards ..........................xviii
    [Show full text]
  • Arcsde for IBM Informix
    ArcGIS® 9 Installation Guide: ArcSDE® for IBM® Informix® Copyright © 2006 ESRI All Rights Reserved. Printed in the United States of America. The information contained in this document is the exclusive property of ESRI. This work is protected under United States copyright law and the copyright laws of the given countries of origin and applicable international laws, treaties, and/or conventions. No part of this work may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying or recording, or by any information storage or retrieval system, except as expressly permitted in writing by ESRI. All requests should be sent to Attention: Contracts Manager, ESRI, 380 New York Street, Redlands, CA 92373, USA. The information contained in this document is subject to change without notice. RESTRICTED/LIMITED RIGHTS LEGEND U.S. Government Restricted/Limited Rights: Any software, documentation, and/or data delivered hereunder is subject to the terms of the License Agreement. In no event shall the Government acquire greater than RESTRICTED/LIMITED RIGHTS. At a minimum, use, duplication, or disclosure by the Government is subject to restrictions as set forth in FAR §52.227-14 Alternates I, II, and III (JUN 1987); FAR §52.227-19 (JUN 1987); and/or FAR §12.211/12.212 [Commercial Technical Data/Computer Software]; DFARS §252.227-7015 (NOV 1995) [Technical Data]; and/or DFARS §227.7202 [Computer Software], as applicable. Contractor/Manufacturer is ESRI, 380 New York Street, Redlands, CA 92373-8100, USA. ESRI, MapObjects, ArcView, ArcIMS, ArcSDE, ArcInfo, ArcEditor, ArcGIS, ArcMap, ArcCatalog, ArcToolbox, ArcObjects, MapObjects, SDE, and the ESRI globe logo are trademarks of ESRI, registered in the United States and the European Community, or certain other jurisdictions.
    [Show full text]
  • Government Contracting M&A Update
    Government Contracting M&A Update “Market Intelligence for Business Owners” Q3 2013 Capstone Partners Investment Banking Advisors BOSTON | CHICAGO | LONDON | LOS ANGELES | PHILADELPHIA | SAN DIEGO | SILICON VALLEY Government Contracting Coverage Report MERGERS & ACQUISITIONS UPDATE With the nation’s attention focused on reducing government spending and sequestration, one would expect mergers & acquisitions in the government contracting space to come CAPSTONE PARTNERS LLC to a standstill. But such is not the case, with the number of acquisitions announced 200 South Wacker Drive through June totaling more than 250. 31st Floor Chicago, IL 60606 M&A Activity: Government Contractors www.capstonellc.com 1000 964 900 852 800 786 772 786 732 751 700 568 Ted Polk 600 521 Transactions Managing Director 500 of 398 (312) 674‐4531 400 [email protected] 300 256 Number 200 100 Lisa Tolliver 0 Director 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 YTD (312) 674‐4532 2013 [email protected] YTD 2013 through June 30, 2013 Source: Capital IQ, Capstone Partners LLC research While the year’s activity is currently on‐track to come in under the 2012 figure, that trend is reflective of what we are seeing in mergers and acquisitions in general. M&A activity across the board has been down in early 2013 compared to 2012, primarily the result of the market continuing to absorb the rash of transactions that were closed at the end of 2012 in anticipation of rising capital gains tax rates. But, while the number of closed transactions has slowed this year, M&A activity continues to be supported by strong market fundamentals, namely reasonably high transaction valuations; strategic acquirers with strong balance sheets; abundant private equity capital; an accessible and affordable debt market; and a modestly expanding U.S.
    [Show full text]
  • Fy11 Education Masterfile 10262010
    Page 1 FY10 CONTRACT #GS-35F-4984H Effective Date October 26, 2010 IBM Education Charge GSA GSA GSA DAYS PUBLIC PRIVATE ADD'L ST. STUDENTS 3A230 Exploring IBM solidDB Universal Cache - Instructor-led online 4.0 2,305 14,186 222 15 3L121 Query XML data with DB2 9 - Instructor-led online 3.0 1,729 10,640 222 15 3L131 Query and Manage XML Data with DB2 9 - Instructor-led online 5.0 2,882 17,733 222 15 3L141 Manage XML data with DB2 9 -Instructor-led online 2.0 1,153 7,093 222 15 3L282 Fast Path to DB2 9 for Experienced Relational DBAs - Instructor-led online 2.0 1,153 7,093 222 15 3L2X1 DB2 9 Administration Workshop for Linux, UNIX, and Windows Instructor Led OnLine4.0 2,305 14,186 222 15 3L2X2 DB2 9 Database Administration Workshop for Linux,UNIX and Windows - ILO 4.0 2,305 14,186 222 15 3L482 DB2 9 for Linux,UNIX and Windows Quickstart for Experienced Relational DBAs-ILO4.0 2,305 14,186 222 15 3L711 DB2 Stored Procedures Programming Workshop - Instructor-led online 2.0 1,153 7,093 222 15 3N230 Exploring IBM solidDB Universal Cache - Flex Instructor Led Online 5.0 2,305 14,186 222 15 3N312 DB2 9.7 for Linux, UNIX, and Windows New Features - Flex Instructor-led online2.0 864 5,320 222 15 3V410 DB2 9 for z/OS Data Sharing Implementation - Instructor Led Online 3.0 1,729 10,640 222 15 3V420 DB2 9 for z/OS Data Sharing Recovery and Restart - Instructor Led Online 2.0 1,153 7,093 222 15 3W700 Basic InfoSphere Streams SPADE programming Instructor-led Online 2.0 1,153 7,093 222 15 3W710 Advanced InfoSphere Streams SPADE Programming Instructor-led
    [Show full text]
  • Informix Best Practices Getting Started with Informix
    Informix Best Practices Getting Started with Informix Webcast – January 26, 2017 By Lester Knutsen Lester Knutsen Lester Knutsen is President of Advanced DataTools Corporation, and has been building large Data Warehouse and Business Systems using Informix Database software since 1983. Lester focuses on large database performance tuning, training and consulting. Lester is a member of the IBM Gold Consultant program and was presented with one of the Inaugural IBM Data Champion awards by IBM. Lester was one of the founders of the International Informix Users Group and the Washington Area Informix User Group. [email protected] www.advancedatatools.com 703-256-0267 x102 Informix Introduction 2 Overview • Informix Products Overview • Informix Architecture – Memory, CPU, Disk Requirements • Planning an Informix Install • Installing Informix • Software Directory Structure • Using Informix SQL • Informix Documentation • Informix Resources on the Web Informix Introduction 3 Informix Products Overview Informix Servers History • Informix C-ISAM • Informix Standard Engine (SE) • Informix OnLine 4.x and 5.x • Informix Dynamic Server 7.x • Informix Extended Parallel Server 8.x • Informix Dynamic Server 9.x and 10.x • Current - Informix 11.x and 12.x Informix Introduction 5 Informix 12.x Editions • No Cost Editions – IBM Informix Developer Edition – IBM Informix Innovator-C Edition • Purchase Editions – IBM Informix Express Edition – IBM Informix Workgroup Edition – IBM Advanced Workgroup Edition – IBM Informix Advanced Developer Edition – IBM
    [Show full text]
  • Approving Agreement with the Nebraska Game and Parks Commission for Enhancement of Hunter Education at the Heartland Public Shooting Park
    City of Grand Island T u Tuesday, September 08, 2009 Council Session Packet City Council: Mayor: Larry Carney Margaret Hornady Scott Dugan John Gericke City Administrator: Peg Gilbert Jeff Pederson Chuck Haase Robert Meyer City Clerk: Mitchell Nickerson RaNae Edwards Bob Niemann Kirk Ramsey Jose Zapata 7:00:00 PM Council Chambers - City Hall 100 East First Street Call to Order City of Grand Island City Council Call to Order This is an open meeting of the Grand Island City Council. The City of Grand Island abides by the Open Meetings Act in conducting business. A copy of the Open Meetings Act is displayed in the back of this room as required by state law. The City Council may vote to go into Closed Session on any agenda item as allowed by state law. Invocation Pledge of Allegiance Roll Call A - SUBMITTAL OF REQUESTS FOR FUTURE ITEMS Individuals who have appropriate items for City Council consideration should complete the Request for Future Agenda Items form located at the Information Booth. If the issue can be handled administratively without Council action, notification will be provided. If the item is scheduled for a meeting or study session, notification of the date will be given. B - RESERVE TIME TO SPEAK ON AGENDA ITEMS This is an opportunity for individuals wishing to provide input on any of tonight's agenda items to reserve time to speak. Please come forward, state your name and address, and the Agenda topic on which you will be speaking. MAYOR COMMUNICATION This is an opportunity for the Mayor to comment on current events, activities, and issues of interest to the community.
    [Show full text]
  • IBM DB2 Query Management Facility for Z/OS
    Analytics May 2016 IBM DB2 Query Management Facility for z/O S QMF Analytics: Anytime, Anyplace, Anyone 2 IBM DB2 Query Management Facility for z/OS Highlights Until now, many companies have found it difficult to deliver ●● ●●Exposes insights across all data types through a single, logical, the secure, accurate and real-time analytical insight required to data source—including mainframe data, non-mainframe data support rapid decisions like these. To keep a competitive edge, and big data sources business analytics are no longer an option, but an enterprise ●● ●●Provides self-service Business Intelligence through a new business requirement of all successful enterprises. A Nucleus simple intuitive interface Research study1 found that, for every dollar spent on analytics, ●● ●●Brings analytics to where the data resides including VSAM, a customer sees an average return of US$13 dollars. ADABAS, DB2, and IMS The IBM® DB2® Query Management Facility™ for z/OS® (IBM QMF™ for z/OS) provides a zero-footprint, mobile- Consider the myriad of decisions made within your business enabled, highly secure business analytics solution. QMF for each day. For example, your organization may only have: z/OS delivers modern analytics by using visual reports and dashboards, available across all current interfaces, including ●●●hours to assess what locations to move inventory to meet mobile devices, web browsers, workstations, and IBM TSO and demands IBM CICS® clients. ●●●minutes to decide which customers are good candidates for tomorrow’s 24-hour discount email QMF for z/OS uses the power, security and robustness of ●●●seconds to determine if a long-term customer visiting your IBM z Systems™ to create analytical solutions that directly website qualifies for special pricing that will help you close access a myriad of data sources, such as relational and non- a sale today—and keep them coming back.
    [Show full text]