DOCSLIB.ORG

SQLCAT's Guide to BI and Analytics

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
SQLCAT's Guide to BI and Analytics SQLCAT’s Guide to: BI and Analytics Microsoft SQLCAT Team Summary: This e-book is a collection of some of the more popular technical content that was available on the old SQLCAT.COM site. It covers SQL Server technology ranging from SQL Server 2005 to SQL Server 2012. However, this is not all the content that was available on SQLCAT.COM. To see additional content from that site you can follow the SQLCAT blog which will point to additional content. For more comprehensive content on SQL Server, see the MSDN library. Category: Guide & Reference Applies to: SQL Server Business Intelligence and Analytics Source: SQLCAT Blog E-book publication date: September 2013 Copyright © 2012 by Microsoft Corporation All rights reserved. No part of the contents of this book may be reproduced or transmitted in any form or by any means without the written permission of the publisher. Microsoft and the trademarks listed at http://www.microsoft.com/about/legal/en/us/IntellectualProperty/Trademarks/EN- US.aspx are trademarks of the Microsoft group of companies. All other marks are property of their respective owners. The example companies, organizations, products, domain names, email addresses, logos, people, places, and events depicted herein are fictitious. No association with any real company, organization, product, domain name, email address, logo, person, place, or event is intended or should be inferred. This book expresses the author’s views and opinions. The information contained in this book is provided without any express, statutory, or implied warranties. Neither the authors, Microsoft Corporation, nor its resellers, or distributors will be held liable for any damages caused or alleged to be caused either directly or indirectly by this book. Contents Section 1: Administration ............................................................................................................................. 5 Running Microsoft SQL Server 2008 Analysis Services on Windows Server 2008 vs. Windows Server 2003 and Memory Preallocation: Lessons Learned .................................................................................. 6 Scripts for Stress Testing Analysis Services using ASCMD ...................................................................... 13 A Solution for Collecting Analysis Services Performance Data From Many Sources For Performance Analysis ................................................................................................................................................... 14 Compress Many-to-Many C# Utility ........................................................................................................ 15 Create a Processing Log Script Project .................................................................................................... 16 Powershell Scripts for SQL Server 2008 Analysis Services DMVs ........................................................... 17 Sample Robocopy Script to customer synchronize Analysis Services databases ................................... 18 Section 2: Analysis Services Performance ................................................................................................... 22 Analysis Services Synchronization Best Practices ................................................................................... 23 Microsoft SQL Server 2008 Analysis Services Consolidation Best Practices ........................................... 28 Analysis Services Distinct Count Optimization Using Solid State Devices .............................................. 45 Excel, Cube Formulas, Analysis Services, Performance, Network Latency, and Connection Strings...... 57 Reintroducing Usage-Based Optimization in SQL Server 2008 Analysis Services ................................... 65 Sections 3: Analysis Services Scaleout ........................................................................................................ 72 Analysis Services Load Balancing Solution .............................................................................................. 73 SSAS Monitoring Scripts For Management Data Warehouse ................................................................. 74 ASLB Toolkit ............................................................................................................................................ 75 Section 4: Real World Scenarios ................................................................................................................. 77 Edgenet Realizes the Power of Dynamic IT and Self-Service BI .............................................................. 78 Section 5: Reporting Services ...................................................................................................................... 85 Reporting Services Scale-Out Deployment Best Practices ...................................................................... 87 Report Server Catalog Best Practices ...................................................................................................... 96 Reporting Services Performance Optimizations ................................................................................... 102 Reporting Services Scale-Out Architecture ........................................................................................... 110 SQL Server Reporting Services Disaster Recovery Case Study .............................................................. 116 Scaling Up Reporting Services 2008 vs. Reporting Services 2005: Lessons Learned ............................ 125 Reporting Services Performance in SharePoint Integrated Mode in SQL Server 2008 R2 ................... 139 Deploying a Business Intelligence Solution Using SharePoint 2007, SQL Server 2008 Reporting Services, and PerformancePoint Monitoring Server 2007 with Kerberos ........................................................... 149 Section 6: SQL Server Integration Services ............................................................................................... 159 Increasing Throughput of Pipelines by Splitting Synchronous Transformations into Multiple Tasks .. 160 Moving Large Amounts of Data Between Oracle and SQL Server: Findings and Observations............ 166 SSIS Package For Collecting SSAS DMV Data......................................................................................... 170 The “Balanced Data Distributor” for SSIS ............................................................................................. 171 Section 7: SQL Top 10 ............................................................................................................................... 174 Top 10 Performance and Productivity Reasons to Use SQL Server 2008 for Your Business Intelligence Solutions ............................................................................................................................................... 175 Top 10 SQL Server Integration Services Best Practices ......................................................................... 187 Analysis Services Query Performance Top 10 Best Practices ............................................................... 196 Section 1: Administration Running Microsoft SQL Server 2008 Analysis Services on Windows Server 2008 vs. Windows Server 2003 and Memory Preallocation: Lessons Learned Introduction SQL Server 2005 Service Pack 2 introduced a new advanced configuration setting for Analysis Services that enables an administrator to specify that a certain percentage of memory be allocated to Analysis Services when the service starts (memory preallocation). This configuration setting was introduced because the Microsoft Windows Server 2003 operating system did not scale well with many small virtual memory allocations due to memory fragmentation and inefficiencies in retrieving information already located in memory. With the use of this configuration setting with 64- bit versions of Windows Server 2003 on multiprocessor computers (specifically computers with 16, 32, and 64 cores), the SQL Customer Advisor Team (SQL CAT) observed significant performance gains during Analysis Services processing and querying when memory use substantially exceeds 3 GB. Indeed, when Unisys and Microsoft achieved a record-setting benchmark for Analysis Services cube processing, the memory preallocation configuration setting for Analysis Services was set to 20 rather than to the default setting of 0 (resulting in 20% of physical memory being allocated to Analysis Services). For more information about this benchmark, see Data Warehouse Performance: Unisys and Microsoft Achieve Record-setting Benchmark. The memory manager in Windows Server 2008 includes many performance and scalability enhancements, one of which is a change in the algorithm for scanning pages in memory. Additional memory manager improvements include the following: · Kernel virtual address space is dynamically allocated to improve scalability when a greater number of processors and larger memory configurations are used. The sizes of paged and non-paged memory pools are no longer fixed, so manually reconfiguring systems to prevent resource imbalances is not required. Previously, the sizes of some resources, such as memory pools, were set by registry keys or by SKU. · Kernel virtual address space is made more available in x86 architectures by more efficiently using space in kernel- mode stacks in recursive calls into the kernel. · When a kernel-mode component allocates more than a page of memory, the memory manager now uses the pool memory between
Load more

Recommended publications
  • SQL Server 2017 on Linux Quick Start Guide | 4
    SQL Server 2017 on Linux Quick Start Guide Contents Who should read this guide? ........................................................................................................................ 4 Getting started with SQL Server on Linux ..................................................................................................... 5 Why SQL Server with Linux? ..................................................................................................................... 5 Supported platforms ................................................................................................................................. 5 Architectural changes ............................................................................................................................... 6 Comparing SQL on Windows vs. Linux ...................................................................................................... 6 SQL Server installation on Linux ................................................................................................................ 8 Installing SQL Server packages .................................................................................................................. 8 Configuration capabilities ....................................................................................................................... 11 Licensing .................................................................................................................................................. 12 Administering and
    [Show full text]
  • Bag-Of-Features Image Indexing and Classification in Microsoft SQL Server Relational Database
    Bag-of-Features Image Indexing and Classification in Microsoft SQL Server Relational Database Marcin Korytkowski, Rafał Scherer, Paweł Staszewski, Piotr Woldan Institute of Computational Intelligence Cze¸stochowa University of Technology al. Armii Krajowej 36, 42-200 Cze¸stochowa, Poland Email: [email protected], [email protected] Abstract—This paper presents a novel relational database ar- data directly in the database files. The example of such an chitecture aimed to visual objects classification and retrieval. The approach can be Microsoft SQL Server where binary data is framework is based on the bag-of-features image representation stored outside the RDBMS and only the information about model combined with the Support Vector Machine classification the data location is stored in the database tables. MS SQL and is integrated in a Microsoft SQL Server database. Server utilizes a special field type called FileStream which Keywords—content-based image processing, relational integrates SQL Server database engine with NTFS file system databases, image classification by storing binary large object (BLOB) data as files in the file system. Microsoft SQL dialect (Transact-SQL) statements I. INTRODUCTION can insert, update, query, search, and back up FileStream data. Application Programming Interface provides streaming Thanks to content-based image retrieval (CBIR) access to the data. FileStream uses operating system cache for [1][2][3][4][5][6][7][8] we are able to search for similar caching file data. This helps to reduce any negative effects images and classify them [9][10][11][12][13]. Images can be that FileStream data might have on the RDBMS performance.
    [Show full text]
  • Socrates: the New SQL Server in the Cloud
    Socrates: The New SQL Server in the Cloud Panagiotis Antonopoulos, Alex Budovski, Cristian Diaconu, Alejandro Hernandez Saenz, Jack Hu, Hanuma Kodavalla, Donald Kossmann, Sandeep Lingam, Umar Farooq Minhas, Naveen Prakash, Vijendra Purohit, Hugh Qu, Chaitanya Sreenivas Ravella, Krystyna Reisteter, Sheetal Shrotri, Dixin Tang, Vikram Wakade Microsoft Azure & Microsoft Research ABSTRACT 1 INTRODUCTION The database-as-a-service paradigm in the cloud (DBaaS) The cloud is here to stay. Most start-ups are cloud-native. is becoming increasingly popular. Organizations adopt this Furthermore, many large enterprises are moving their data paradigm because they expect higher security, higher avail- and workloads into the cloud. The main reasons to move ability, and lower and more flexible cost with high perfor- into the cloud are security, time-to-market, and a more flexi- mance. It has become clear, however, that these expectations ble “pay-as-you-go” cost model which avoids overpaying for cannot be met in the cloud with the traditional, monolithic under-utilized machines. While all these reasons are com- database architecture. This paper presents a novel DBaaS pelling, the expectation is that a database runs in the cloud architecture, called Socrates. Socrates has been implemented at least as well as (if not better) than on premise. Specifically, in Microsoft SQL Server and is available in Azure as SQL DB customers expect a “database-as-a-service” to be highly avail- Hyperscale. This paper describes the key ideas and features able (e.g., 99.999% availability), support large databases (e.g., of Socrates, and it compares the performance of Socrates a 100TB OLTP database), and be highly performant.
    [Show full text]
  • SQL Server 2019 Licensing Guide
    Microsoft SQL Server 2019 Licensing guide Contents Overview 3 SQL Server 2019 editions 4 SQL Server and Software Assurance 7 How SQL Server 2019 licenses are sold 9 Server and Cloud Enrolment SQL Server 2019 licensing models 11 Core-based licensing Server+CAL licensing Licensing SQL Server 2019 Big Data Cluster 14 Licensing SQL Server 2019 components 18 Licensing SQL Server 2019 in a virtualized environment 19 Licensing individual virtual machines Licensing for maximum virtualization Licensing SQL Server in containers 23 Licensing individual containers Licensing containers for maximum density Advanced licensing scenarios and detailed examples 27 Licensing SQL Server for high availability Licensing SQL Server for Disaster Recovery Azure Hybrid Benefit Licensing SQL Server for application mobility Licensing SQL Server for non-production use Licensing SQL Server in a multiplexed application environment Additional product information 39 SQL Server 2019 migration options for Software Assurance customers Additional product licensing resources Licensing SQL Server for the Analytics Platform System © 2019 Microsoft Corporation. All rights reserved. This document is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY. Microsoft provides this material solely for informational and marketing purposes. Customers should refer to their agreements for a full understanding of their rights and obligations under Microsoft’s Volume Licensing programs. Microsoft software is licensed not sold. The value and benefit gained through use of Microsoft software and services may vary by customer. Customers with questions about differences between this material and the agreements should contact their reseller or Microsoft account manager. Microsoft does not set final prices or payment terms for licenses acquired through resellers.
    [Show full text]
  • Guide to Migrating from Oracle to SQL Server 2014 and Azure SQL Database
    Guide to Migrating from Oracle to SQL Server 2014 and Azure SQL Database SQL Server Technical Article Writers: Yuri Rusakov (DB Best Technologies), Igor Yefimov (DB Best Technologies), Anna Vynograd (DB Best Technologies), Galina Shevchenko (DB Best Technologies) Technical Reviewer: Dmitry Balin (DB Best Technologies) Published: November 2014 Applies to: SQL Server 2014 Summary: This white paper explores challenges that arise when you migrate from an Oracle 7.3 database or later to SQL Server 2014. It describes the implementation differences of database objects, SQL dialects, and procedural code between the two platforms. The entire migration process using SQL Server Migration Assistant (SSMA) v6.0 for Oracle is explained in depth, with a special focus on converting database objects and PL/SQL code. Created by: DB Best Technologies LLC 2535 152nd Ave NE, Redmond, WA 98052 Tel: +1-855-855-3600 E-mail: [email protected] Web: www.dbbest.com Copyright This is a preliminary document and may be changed substantially prior to final commercial release of the software described herein. The information contained in this document represents the current view of Microsoft Corporation on the issues discussed as of the date of publication. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. This White Paper is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS DOCUMENT. Complying with all applicable copyright laws is the responsibility of the user.
    [Show full text]
  • Installing the Adventureworks Database for SQL Server Express (2008 Or 2005)
    Installing the AdventureWorks Database for SQL Server Express (2008 or 2005) NOTE: This version of the database can be installed with EITHER SQL Server 2005 Express or SQL Server 2008 Express. 1. Get a copy of the software to install. If you have NOT already installed SQL Server Express, you must install this software first! You will need to get the sample database software in ONE of the following ways— download from Microsoft or copy from East campus server in Student lab: A. Download SQL Server AdventureWorks 2005 Sample database from Microsoft and save it to your hard drive. The sample databases are a free download from Microsoft. To download it, go to http://www.codeplex.com/SqlServerSamples . Click on the link AdventureWorks for SQL Server 2005. Then download the AdventureWorksDB.msi. B. Copy the file from the STUDATA folder to your CD. A folder named STUDATA (Student Data) has been set up to contain student data files. This folder is only accessible from East Campus—it is not available online. From My Computer, double click link to STUDATA. Files are in folder CGS2545. For these instructions, you will need the AdventureWorksDB.msi file, but you will need the other files for the class databases, so you should copy them now if you have not already done so! 2. Browse to the location on your hard drive where you have saved the AdventureWorksDB.msi file. Double click the file to start the install process. 3. Follow the instructions in the Install Wizard to complete the process Click Next> to continue.
    [Show full text]
  • Power up Your Microsoft SQL Server with Nutanix
    SOLUTION BRIEF Power Up Your Microsoft SQL Server with Nutanix Gain SQL Server performance and availability while giving administrators their weekends back with transformative database services. KEY BENEFITS POWERING THE NEW ERA OF MICROSOFT SQL SERVER Nutanix delivers a solution for MANAGEMENT Microsoft SQL Server that can Microsoft SQL Server deployments are increasingly critical to organizations. provide a centralized management They are used in everything from departmental databases to business-critical platform that allows you to easily workloads, including ERP, CRM, and BI. At the same time, we are in a data manage your database workloads explosion, where enterprises are gathering more data and growing the SQL and efficiently provide database Server footprint faster than ever before while at the same time tasked with services (DBaaS) to your consolidating their datacenter footprint, controlling costs, and accelerating organization. provisioning. These trends of delivering SQL Server databases as dynamic, virtualized services make it essential to select the right database solution. • Faster Time to Value and Business Agility: Deploy infrastructure and databases in minutes and complex AAG NEED FOR SPEED, SCALE, AND SIMPLICITY clusters in hours instead of days To ensure database administrators are delivering on their promise of protecting and weeks. Deploy dev/test data and keeping critical SQL Server databases available while demand increases, environments up to 10x faster IT must function with the concept of database services or cloudifying their and improve performance databases. The expansion of the SQL Server estate requires a modern database up to 5x. services approach to gain operational simplicity to switch administrators from • Maximize Uptime and Security: a maintenance mode operation to one that can keep up with the demand With native platform resiliency, for innovation.
    [Show full text]
  • Protect and Repurpose Microsoft SQL Server Databases with Dell EMC
    Solution Overview Protect and Repurpose Microsoft SQL Server Databases with Dell EMC PowerStore Enable your Microsoft SQL Server DBAs and application owners to manage their own protection and re-purposing of Microsoft SQL Server database copies and their applications. Simplify, orchestrate, and automate the process of generating, consuming and expiring writable copies for use in test/dev, sandbox, patch testing, reporting, and beyond. A Modern Storage Appliance Designed for the Data Decade Navigating the Data Era with Dell Technologies With 98 of the Fortune 100 running Microsoft SQL Server, it is not only the PowerStore provides our most widely deployed database management system in the worldwide market customers with data-centric, today but also used in some of the world's most mission critical environments. intelligent, and adaptable Today, data is more strategic to businesses of all sizes, and effective storage infrastructure that supports both strategies are critical to creating competitive advantage. According to ESG’s traditional and modern workloads 2019 Data Storage Trends Survey, 63% expect to develop and offer new data- centric products and/or services in the next 24 months. As we enter the data era, the combination of massive amounts of data and technology innovation provides the opportunity for businesses to transform into disruptive, digital powerhouses. In the data era, companies are struggling with more data to manage than ever, driving both opportunity and complexity for our customers. As businesses rush to transform and capitalize on this opportunity, they realize that there are two major forces putting pressure on their IT infrastructure, which is hindering their overall digital transformation efforts: Data – more data types exist (Block, File, Object, Containers, etc.) than ever before and the requirements to support data vary widely.
    [Show full text]
  • APRIL 6–9, 2020 ORLANDO, FL Walt Disney World Swan and Dolphin Resort
    Check the conference website for the latest information, DEVintersection.com Sessions and speakers are subject to change and more are being added as of this printing. Bonus APRIL 6–9, 2020 ORLANDO, FL Walt Disney World Swan and Dolphin Resort DEVintersection.com 203-264-8220 M–F, 9-4 EST SCOTT GUTHRIE DONOVAN BROWN SCOTT HANSELMAN JOHN PAPA KIMBERLY L. Executive Vice President, Principal DevOps Principal Program Principal Developer TRIPP Cloud + AI Platform, Program Manager, Manager, Web Advocate, Microsoft President / Founder, Microsoft Microsoft Platform, Microsoft SQLskills KATHLEEN BOB WARD LESLIE RICHARDSON ZOINER TEJADA JEFF FRITZ DOLLARD Principal Architect Program Manager, CEO & Architect, Senior Program Principal Program Azure Data/SQL Server Microsoft Solliance Manager, Microsoft Manager, Microsoft Team, Microsoft Powered by Register at DEVintersection.com or call 203-264-8220, M-F 9-4 EDT | 1 Sessions Check the conference website for the latest information, DEVintersection.com Sessions and speakers are subject to change and more are being added as of this printing. A Gentle Intro into NoSQL and Angular front-end. In this talk we’ll learn how we can develop Build Full-Stack Applications with ASP. Software development continues to evolve, and so CosmosDB for the ASP.NET/SQL Server a full stack application using Angular and NestJS that feels like NET Core and Blazor do the tools that make developing software easier! we’re coding in Angular only. We’ll also cover some important Developer Jeff Fritz Microsoft Quarterly updates to Visual Studio, new versions topics such as authorization, data validation and how we can of Angular and incremental changes to C# as Santosh Hari New Signature integrate with other npm packages to develop a production ready In this demo-filled session, Jeff Fritz will take you on a whirlwind well as ASP.NET Core means there are many new Do you work on ASP.NET and/or SQL Server (or other RDBMS) application.
    [Show full text]
  • Summation Express Install Guide
    Summation Express Install Guide Introduction This guide will provide steps for: Minimum Prerequisites Installing Summation Express. Installing Licensing software (CodeMeter and License Manager). Minimum Prerequisites Summation Express should only be installed on one machine, whether the machine is running Windows 7 or Windows Server 2008. Before installing Summation Express on a server or a workstation, please consider that: Summation Express should be installed to the workstation that will function as the Evidence Processing computer. The Summation Express workstation will also be the web server for other workstations. Other workstations will connect, via Internet Explorer, to the Summation Express website. Operating System Hardware Configuration Windows Server 2008 R2 Standard 64- Intel Xeon Quad-core (8-cores) Summation Express (Supports 3 bit SP1 Concurrent Users) 16GB RAM 10,000 RPM Windows 7 Professional 64-bit SP1 Intel Core i5 (4-cores) Summation Express (Single User) 8GB RAM 7,200 RPM Installing Summation Express The Summation Express installation process will attempt to install and configure the following items: Microsoft Visual C++ 2010 x64 (Redistributable) Prizm Content Connect Plus 64-bit Prizm Content Connect Plus Configuration BlackIce (ColorPlus printer driver) Microsoft .NET Framework 4.0 (4.0.30319) Microsoft AppFabric 1.1 Microsoft Message Queuing Microsoft Internet Information Services (IIS 7.5) Microsoft SQL Server 2008 Express Edition SummationDesktop (the Summation Express host application) Please follow the steps below to download and extract the Summation Express installer package: 1) Download the installer package from http://summation.accessdata.com. 2) Extract the downloaded ZIP file to a folder. Note: Please allow 30 to 60 minutes to complete the installation process.
    [Show full text]
  • Installing Microsoft Sql Server and Configuring Reporting Services
    INSTALLING MICROSOFT SQL SERVER AND CONFIGURING REPORTING SERVICES TECHNICAL ARTICLE November 2012 Copyright © 2012 NetWrix Corporation. All Rights Reserved. Installing Microsoft SQL Server and Configuring Reporting Services Legal Notice The information in this publication is furnished for information use only, and does not constitute a commitment from NetWrix Corporation of any features or functions discussed. NetWrix Corporation assumes no responsibility or liability for the accuracy of the information presented, which is subject to change without notice. NetWrix is a registered trademark of NetWrix Corporation. The NetWrix logo and all other NetWrix product or service names and slogans are registered trademarks or trademarks of NetWrix Corporation. Active Directory is a trademark of Microsoft Corporation. All other trademarks and registered trademarks are property of their respective owners. Disclaimers This document may contain information regarding the use and installation of non-NetWrix products. Please note that this information is provided as a courtesy to assist you. While NetWrix tries to ensure that this information accurately reflects the information provided by the supplier, please refer to the materials provided with any non-NetWrix product and contact the supplier for confirmation. NetWrix Corporation assumes no responsibility or liability for incorrect or incomplete information provided about non-NetWrix products. © 2012 NetWrix Corporation. All rights reserved. Copyright © 2012 NetWrix Corporation. All Rights Reserved
    [Show full text]
  • SQL Server 2019 Technical White Paper
    Microsoft SQL Server 2019 Technical white paper Published: September 2018 Applies to: Microsoft SQL Server 2019 CTP 2.0 for Windows, Linux, and Docker containers Copyright The information contained in this document represents the current view of Microsoft Corporation on the issues discussed as of the date of publication. This content was developed prior to the product or service’ release and as such, we cannot guarantee that all details included herein will be exactly as what is found in the shipping product. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. The information represents the product or service at the time this document was shared and should be used for planning purposes only. This white paper is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED, OR STATUTORY, AS TO THE INFORMATION IN THIS DOCUMENT. Complying with all applicable copyright laws is the responsibility of the user. Without limiting the rights under copyright, no part of this document may be reproduced, stored in, or introduced into a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), or for any purpose, without the express written permission of Microsoft Corporation. Microsoft may have patents, patent applications, trademarks, copyrights, or other intellectual property rights covering subject matter in this document. Except as expressly provided in any written license agreement from Microsoft, the furnishing of this document does not give you any license to these patents, trademarks, copyrights, or other intellectual property.
    [Show full text]