DOCSLIB.ORG

Tactics for Pushing SQL to the Relational Databases

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Tactics for Pushing SQL to the Relational Databases Tactics for Pushing SQL to the Relational Technical Paper Databases December 2008 Tactics for Pushing SQL to Relational Databases Table of Contents Introduction ....................................................................................................................1 Audience for this Paper .............................................................................................1 Purpose of the Paper.................................................................................................1 Scope of This Paper ..................................................................................................1 Overview....................................................................................................................1 Background for This Paper........................................................................................2 Important Concepts ...................................................................................................3 SAS/ACCESS® Software ....................................................................................3 SAS/ACCESS® Interface to ODBC.....................................................................3 SAS/ ACCESS Interface to OLE DB...................................................................3 Databases, Relational Databases, and Relational Database Management Systems (RDBMS) ............................................................................................................................4 Using SAS to Analyze Relational Database Information ....................................4 SAS/ACCESS Connectivity via LIBNAME Statements.......................................5 Standard SAS/ACCESS Connectivity versus Java Database Connectivity (JDBC) 5 Establishing SAS and Relational Database Connectivity..........................................6 Verify Compatibility of the Versions of the Operating System, the Relational Database, and SAS ...................................................................................................................................6 Relational Database Server ................................................................................6 Network ...............................................................................................................7 SAS® System.......................................................................................................7 Connect to the Relational Database with a Simple Relational Database Client Tool7 Oracle Connectivity.............................................................................................8 DB2 UDB Connectivity........................................................................................8 Teradata Connectivity .........................................................................................9 Connect to the Relational Database with SAS ..........................................................9 SAS to Oracle Connectivity.................................................................................9 SAS to DB2 Connectivity ..................................................................................10 SAS to Teradata Connectivity...........................................................................10 Common Problems You Might Encounter.........................................................10 Run a SAS Verification Program .............................................................................10 Testing Connectivity to a Relational Database Using a LIBNAME Statement .11 PROC SQL “connect to”....................................................................................11 Encoding Passwords.........................................................................................12 Determining Relational Database Client and Server Versions................................12 i Tactics for Pushing SQL to Relational Databases Oracle Client and Server Versions....................................................................12 DB2 Client and Server Versions .......................................................................13 Teradata Client and Server Versions................................................................13 The Basics: Things to Consider .................................................................................15 Introduction..............................................................................................................15 Minimizing Data Transfer.........................................................................................15 Limiting Columns...............................................................................................15 Limiting Rows....................................................................................................17 Improving Throughput by Using Multi-Row Operations...........................................20 Using the READBUFF Option...........................................................................20 Multi-Row Output Techniques...........................................................................21 Using the INSERTBUFF Option........................................................................21 Using the UPDATEBUFF Option ......................................................................23 Restricting SAS Functions.......................................................................................23 Selecting the SAS Function That SAS/ACCESS Can Pass to the Database...23 Using Expressions Instead of Functions...........................................................25 Assigning a SAS Function Value to a SAS Macro When Possible...................26 Constructing a WHERE Clause Correctly ...............................................................28 Sorting in the Relational Database..........................................................................29 Naming Issues.........................................................................................................30 SAS Names and Support for Database Names................................................30 PROC SQL Reserved Words............................................................................32 Database Reserved Words...............................................................................32 Differences in Behavior...............................................................................................32 NULL Values and MISSING Values ........................................................................32 Matching Differences with NULL or MISSING Values ......................................33 NULL and MISSING Sort Order........................................................................35 Character MISSING Represented as SAS Blank String and Its Ramifications 35 SAS Special MISSING Values..........................................................................36 Repeatable Observation or Row Order ...................................................................36 Repeatable Observation Order and SAS/ACCESS Spooling...........................37 Understanding the Differences between SAS and Database Native Data Types...38 Differences between Database and SAS Data Types ......................................38 Appropriate Choices for Database Columns that Contain Large Numeric Values 39 Handling Large Numeric Key Columns with SAS .............................................39 How Numeric Precision Can Affect WHERE clause or Join Evaluation ...........45 SAS Formats and SAS/ACCESS Default Formatting Rules.............................46 Relational Database VARCHAR Types ............................................................48 Date, Datetime, and Other Temporal Values....................................................49 ii Tactics for Pushing SQL to Relational Databases Large Object Data Types ..................................................................................52 Basic Tracing................................................................................................................53 Trace Information Shows Where Work Performed and Amount of Time Taken.....53 Basic SASTRACE SQL Trace ..........................................................................53 SASTRACE Threaded Read trace....................................................................57 Implicit Pass-Through .................................................................................................58 Introduction..............................................................................................................58 SAS and SQL Generation .......................................................................................58 SQL Generation through SAS/ACCESS...........................................................59 Using SAS PROC SQL .....................................................................................62 Criteria for Implicit Pass-Through............................................................................64 Select DISTINCT...............................................................................................65 Query Contains an SQL Aggregate or COALESCE Function ..........................66 Query Containing a GROUP BY Clause...........................................................66 Query Containing a HAVING Clause................................................................66 Query Containing an ORDER BY Clause.........................................................66 Query Contains an SQL Join ............................................................................66
Load more

Recommended publications
  • PL/SQL User's Guide and Reference 10G Release 1 (10.1) Part No
    PL/SQL User's Guide and Reference 10g Release 1 (10.1) Part No. B10807-01 December 2003 PL/SQL User's Guide and Reference, 10g Release 1 (10.1) Part No. B10807-01 Copyright © 1996, 2003 Oracle. All rights reserved. Primary Author: John Russell Contributors: Shashaanka Agrawal, Cailein Barclay, Dmitri Bronnikov, Sharon Castledine, Thomas Chang, Ravindra Dani, Chandrasekharan Iyer, Susan Kotsovolos, Neil Le, Warren Li, Bryn Llewellyn, Chris Racicot, Murali Vemulapati, Guhan Viswanathan, Minghui Yang The Programs (which include both the software and documentation) contain proprietary information; they are provided under a license agreement containing restrictions on use and disclosure and are also protected by copyright, patent, and other intellectual and industrial property laws. Reverse engineering, disassembly, or decompilation of the Programs, except to the extent required to obtain interoperability with other independently created software or as specified by law, is prohibited. The information contained in this document is subject to change without notice. If you find any problems in the documentation, please report them to us in writing. This document is not warranted to be error-free. Except as may be expressly permitted in your license agreement for these Programs, no part of these Programs may be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose. If the Programs are delivered to the United States Government or anyone licensing or using the Programs on behalf of the United States Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data delivered to U.S.
    [Show full text]
  • Quick Reference to SQL and SQL*Plus
    APPENDIX A ■ ■ ■ Quick Reference to SQL and SQL*Plus This appendix offers quick references for SQL*Plus and the SQL language. It is far from a com- plete reference, but it should still prove useful. The Oracle documentation contains (besides the comprehensive and complete references) an SQL Quick Reference and a SQL*Plus Quick Reference, but this appendix is much more concise than those two Oracle quick references. You may abbreviate most SQL*Plus commands and their components, as long as you don’t introduce ambiguity. This appendix does not show all SQL*Plus command abbreviation possibilities explicitly, in order to enhance its readability. For example, where this appendix lists the COMPUTE command, it should show it as COMP[UTE], because you can abbreviate the SQL*Plus COMPUTE command to COMP. Abbreviation is available only for SQL*Plus commands; you must always enter SQL commands completely. Refer to SQL*Plus User’s Guide and Reference for all of the abbreviations for SQL*Plus commands and their components. ■Tip When writing SQL*Plus scripts, use the full SQL*Plus commands and the full command component names instead of their abbreviations. This will enhance the readability of your scripts. When you are using SQL*Plus interactively, you may want to use the abbreviations. There are some differences between SQL*Plus and iSQL*Plus; however, this appendix does not list those differences. Refer to SQL*Plus User’s Guide and Reference for more details. The Oracle documentation also explicitly shows all abbreviations for SQL*Plus commands and
    [Show full text]
  • PL/SQL User's Guide and Reference 10G Release 2 (10.2) B14261-01
    Oracle® Database PL/SQL User's Guide and Reference 10g Release 2 (10.2) B14261-01 June 2005 Oracle Database PL/SQL User’s Guide and Reference 10g Release 2 (10.2) B14261-01 Copyright © 1996, 2005, Oracle. All rights reserved. Contributors: Shashaanka Agrawal, Cailein Barclay, Eric Belden, Dmitri Bronnikov, Sharon Castledine, Thomas Chang, Ravindra Dani, Chandrasekharan Iyer, Susan Kotsovolos, Neil Le, Warren Li, Bryn Llewellyn, Valarie Moore, Chris Racicot, Murali Vemulapati, John Russell, Guhan Viswanathan, Minghui Yang The Programs (which include both the software and documentation) contain proprietary information; they are provided under a license agreement containing restrictions on use and disclosure and are also protected by copyright, patent, and other intellectual and industrial property laws. Reverse engineering, disassembly, or decompilation of the Programs, except to the extent required to obtain interoperability with other independently created software or as specified by law, is prohibited. The information contained in this document is subject to change without notice. If you find any problems in the documentation, please report them to us in writing. This document is not warranted to be error-free. Except as may be expressly permitted in your license agreement for these Programs, no part of these Programs may be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose. If the Programs are delivered to the United States Government or anyone licensing or using the Programs on behalf of the United States Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data delivered to U.S.
    [Show full text]
  • SQL Engine Reference
    Pervasive.SQL 2000i SQL Engine Reference Reference for Using SQL with Pervasive.SQL 2000 Service Pack 3 Pervasive Software, Inc. 12365 Riata Trace Parkway Building II Austin, TX 78727 USA Telephone: +1 512 231 6000 or 800 287 4383 Fax: +1 512 231 6010 E-Mail: [email protected] Web: http://www.pervasive.com disclaimer PERVASIVE SOFTWARE INC. LICENSES THE SOFTWARE AND DOCUMENTATION PRODUCT TO YOU OR YOUR COMPANY SOLELY ON AN “AS IS” BASIS AND SOLELY IN ACCORDANCE WITH THE TERMS AND CONDITIONS OF THE ACCOMPANYING LICENSE AGREEMENT. PERVASIVE SOFTWARE INC. MAKES NO OTHER WARRANTIES WHATSOEVER, EITHER EXPRESS OR IMPLIED, REGARDING THE SOFTWARE OR THE CONTENT OF THE DOCUMENTATION; PERVASIVE SOFTWARE INC. HEREBY EXPRESSLY STATES AND YOU OR YOUR COMPANY ACKNOWLEDGES THAT PERVASIVE SOFTWARE INC. DOES NOT MAKE ANY WARRANTIES, INCLUDING, FOR EXAMPLE, WITH RESPECT TO MERCHANTABILITY, TITLE, OR FITNESS FOR ANY PARTICULAR PURPOSE OR ARISING FROM COURSE OF DEALING OR USAGE OF TRADE, AMONG OTHERS. trademarks Btrieve, Tango, Client/Server in a Box, and the Pervasive Software logo are registered trademarks of Pervasive Software Inc. Built on Pervasive, Built on Pervasive Software, Extranet in a Box, Pervasive.SQL, Jtrieve, Plug n’ Play Databases, SmartScout, Solution Network, Ultra-light Z-DBA, Z-DBA, ZDBA, UltraLight, MicroKernel Database Engine, and MicroKernel Database Architecture are trademarks of Pervasive Software Inc. Microsoft, MS-DOS, Windows, Windows NT, Win32, Win32s, and Visual Basic are registered trademarks of Microsoft Corporation. Windows 95 is a trademark of Microsoft Corporation. NetWare and Novell are registered trademarks of Novell, Inc. NetWare Loadable Module, NLM, Novell DOS, Transaction Tracking System, and TTS are trademarks of Novell, Inc.
    [Show full text]
  • Programmer's Guide to the Oracle Precompilers Release 10.2
    Oracle® Database Programmer’s Guide to the Oracle Precompilers 10g Release 2 (10.2) B14354-01 June 2005 Oracle Database Programmer’s Guide to the Oracle Precompilers, 10g Release 2 (10.2) B14354-01 Copyright © 2001, 2005, Oracle. All rights reserved. Primary Author: Tom Portfolio Contributing Author: Jack Godwin Contributor: Stephen Arnold, Sanford Dreskin, Pierre Dufour, Steve Faris, Radhakrishna Hari, Nancy Ikeda, Ken Jacobs, Maura Joglekar, Phil Locke, Valarie Moore, Lee Osborne, Jacqui Pons, Tim Smith, Gael Turk, Scott Urman, Peter Vasterd The Programs (which include both the software and documentation) contain proprietary information; they are provided under a license agreement containing restrictions on use and disclosure and are also protected by copyright, patent, and other intellectual and industrial property laws. Reverse engineering, disassembly, or decompilation of the Programs, except to the extent required to obtain interoperability with other independently created software or as specified by law, is prohibited. The information contained in this document is subject to change without notice. If you find any problems in the documentation, please report them to us in writing. This document is not warranted to be error-free. Except as may be expressly permitted in your license agreement for these Programs, no part of these Programs may be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose. If the Programs are delivered to the United States Government or anyone licensing or using the Programs on behalf of the United States Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data delivered to U.S.
    [Show full text]
  • Memo to Users Version 7.4
    IBM i Memo to Users Version 7.4 Memo to Users IBM Note Before using this information and the product it supports, read the information in “Notices” on page 33. This edition applies to version IBM i 7.4 (product number 5770-SS1) and to all subsequent releases and modifications until otherwise indicated in new editions. This version does not run on all reduced instruction set computer (RISC) models nor does it run on CISC models. This document may contain references to Licensed Internal Code. Licensed Internal Code is Machine Code and is licensed to you under the terms of the IBM License Agreement for Machine Code. © Copyright International Business Machines Corporation 1998, 2019. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Chapter 1. PDF file for Memorandum to Users.........................................................1 Chapter 2. About IBM i Memo to Users....................................................................3 Who should read this memorandum........................................................................................................... 3 Additional incompatibility information........................................................................................................3 What's new...................................................................................................................................................3 Installing IBM i 7.4 over IBM i 7.2...............................................................................................................4
    [Show full text]
  • Mn/DOT Physical Data Modeling and Implementation Standards
    Mn/DOT Physical Data Modeling And Implementation Standards Mn/DOT Database Administrators Team Version 2.1 Date: August 2011 Mn/DOT Physical Data Modeling and Implementation Standards Version 2.0 Page 1 of 116 Version History Modified By | Date Version Section(s) Comment Approved By Initial Draft taken from Mike’s documentation, useful content 2/11/2010 1.0 found on the Web, and Team additions. Additions made from comments 2/22/2010 1.1 from the 2/11/2009 DBA Team Meeting. Additions made from comments 3/4/2010 1.2 from the 2/22/2010 DBA Team Meeting. Additions made from comments 3/12/2010 1.3 from the 3/11/2010 DBA Team Meeting. Additions made from comments 3/26/2010 1.4 from the 3/25/2010 DBA Team Meeting. 6//2010 1.5 Final Draft Review 6/22/2010 2.0 1st Published Version 8/8/2011 2.1 PL Added Abbreviations/Acronyms 9/23/2011 2.2 PL Added Dimensional Physical Mn/DOT Physical Data Modeling and Implementation Standards Version 2.0 Page 2 of 116 Table of Contents PHYSICAL DATA MODELING STANDARD ................................................................................................................ 6 PURPOSE ........................................................................................................................................................... 6 SCOPE ................................................................................................................................................................ 6 STANDARD .......................................................................................................................................................
    [Show full text]
  • CA Ideal for CA Datacom Programming Guide
    Programming Guide Version 14.02 This Documentation, which includes embedded help systems and electronically distributed materials (hereinafter referred to as the “Documentation”), is for your informational purposes only and is subject to change or withdrawal by CA at any time. This Documentation may not be copied, transferred, reproduced, disclosed, modified or duplicated, in whole or in part, without the prior written consent of CA. This Documentation is confidential and proprietary information of CA and may not be disclosed by you or used for any purpose other than as may be permitted in (i) a separate agreement between you and CA governing your use of the CA software to which the Documentation relates; or (ii) a separate confidentiality agreement between you and CA. Notwithstanding the foregoing, if you are a licensed user of the software product(s) addressed in the Documentation, you may print or otherwise make available a reasonable number of copies of the Documentation for internal use by you and your employees in connection with that software, provided that all CA copyright notices and legends are affixed to each reproduced copy. The right to print or otherwise make available copies of the Documentation is limited to the period during which the applicable license for such software remains in full force and effect. Should the license terminate for any reason, it is your responsibility to certify in writing to CA that all copies and partial copies of the Documentation have been returned to CA or destroyed. TO THE EXTENT PERMITTED BY APPLICABLE LAW, CA PROVIDES THIS DOCUMENTATION “AS IS” WITHOUT WARRANTY OF ANY KIND, INCLUDING WITHOUT LIMITATION, ANY IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NONINFRINGEMENT.
    [Show full text]
  • PROC SQL: Beyond the Basics Using SAS PROC SQL Beyond the Basics Using SAS® Second Edition ® Lafler
    PROC SQL: Beyond the Basics Using SAS Using Basics the Beyond SQL: PROC PROC SQL Beyond the Basics Using SAS® Second Edition ® Lafler Kirk Paul Lafler From PROC SQL, Second Edition. Full book available for purchase here. Contents About This Book .......................................................................................xv About The Author .................................................................................... xix Acknowledgments ................................................................................... xxi Chapter 1: Designing Database Tables ...................................................... 1 Introduction .................................................................................................................................... 2 Database Design ............................................................................................................................ 2 Conceptual View ...................................................................................................................... 2 Table Definitions ...................................................................................................................... 3 Redundant Information ........................................................................................................... 3 Normalization ........................................................................................................................... 4 Normalization Strategies .......................................................................................................
    [Show full text]
  • PL/SQL User's Guide and Reference
    PL/SQL User’s Guide and Reference Release 2 (9.2) March 2002 Part No. A96624-01 PL/SQL User’s Guide and Reference, Release 2 (9.2) Part No. A96624-01 Copyright © 1996, 2002 Oracle Corporation. All rights reserved. Primary Author: John Russell Contributing Author: Tom Portfolio Contributors: Shashaanka Agrawal, Cailein Barclay, Dmitri Bronnikov, Sharon Castledine, Thomas Chang, Ravindra Dani, Chandrasekharan Iyer, Susan Kotsovolos, Neil Le, Warren Li, Chris Racicot, Murali Vemulapati, Guhan Viswanathan, Minghui Yang The Programs (which include both the software and documentation) contain proprietary information of Oracle Corporation; they are provided under a license agreement containing restrictions on use and disclosure and are also protected by copyright, patent and other intellectual and industrial property laws. Reverse engineering, disassembly or decompilation of the Programs, except to the extent required to obtain interoperability with other independently created software or as specified by law, is prohibited. The information contained in this document is subject to change without notice. If you find any problems in the documentation, please report them to us in writing. Oracle Corporation does not warrant that this document is error-free. Except as may be expressly permitted in your license agreement for these Programs, no part of these Programs may be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose, without the express written permission of Oracle Corporation. If the Programs are delivered to the U.S. Government or anyone licensing or using the programs on behalf of the U.S. Government, the following notice is applicable: Restricted Rights Notice Programs delivered subject to the DOD FAR Supplement are "commercial computer software" and use, duplication, and disclosure of the Programs, including documentation, shall be subject to the licensing restrictions set forth in the applicable Oracle license agreement.
    [Show full text]
  • Derby Reference Manual Version 10.15
    Derby Reference Manual Version 10.15 Derby Document build: February 4, 2020, 5:03:53 PM (PST) Version 10.15 Derby Reference Manual Contents Copyright..............................................................................................................................11 License................................................................................................................................. 12 About this guide..................................................................................................................16 Purpose of this document...................................................................................... 16 Audience................................................................................................................... 16 How this guide is organized...................................................................................16 SQL syntax used in this manual............................................................................17 SQL language reference.....................................................................................................18 Capitalization and special characters....................................................................18 SQL identifiers ........................................................................................................ 18 Rules for SQL identifiers..................................................................................... 19 SQLIdentifier.......................................................................................................
    [Show full text]
  • DB2 Server for VSE & VM SQL Reference
    DB2ServerforVSE&VM SQL Reference Version 7 Release 2 SC09-2989-01 DB2ServerforVSE&VM SQL Reference Version 7 Release 2 SC09-2989-01 | Before using this information and the product it supports, be sure to read the general information under “Notices” on page 467. | This document contains proprietary information of IBM. It is provided under a license agreement and is protected | by copyright law. The information contained in this publication does not include any product warranties, and any | statements provided in this manual should not be interpreted as such. | Order publications through your IBM representative or the IBM branch office serving your locality or by calling | 1-800-879-2755 in the United States or 1-800-IBM-4YOU in Canada. | When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any | way it believes appropriate without incurring any obligation to you. © Copyright International Business Machines Corporation 1988, 2001. All rights reserved. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Summary of Changes ........vii Data Representation Considerations .....29 || Summary of Changes for DB2 Version 7 Release 2 vii Character Conversion ...........29 | Enhancements, New Functions, and New Character Sets and Code Pages .......31 || Capabilities .............vii Coded Character Sets and CCSIDs......31 | Reliability, Availability, and Serviceability Authorization and Privileges ........32 || Improvements............viii Chapter 3. Language Elements ....35 Chapter 1. Introduction ........1 Characters ...............35 Who This Book Is For ...........1 Tokens................36 Prerequisite Knowledge..........1 Spaces...............36 How This Book Is Organized .........1 Comments..............36 Syntax Notation Conventions .........2 Identifiers ...............36 SQL Reserved Words ...........6 SQL Identifiers ............36 Conventions for Representing Mixed Data Values .
    [Show full text]