DOCSLIB.ORG

Space: the Storage Frontier for Distributed DB2 DBA's

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Space: the Storage Frontier for Distributed DB2 DBA's Session: A12 Space: The Storage Frontier for Distributed DB2 DBA’s Jerry Spence National City Corporation May 10, 2007 9:20 a.m. – 10:20 a.m. Platform: DB2 for LUW All Databases reside on storage. Most storage is nothing but boxes of hardware to most people, but the DBA most go beyond the basic and understand how storage is laid out and the components of the storage design and how it relates to the database. This presentation will present storage concepts and how they relate to the database and some considerations for deploying a database on the various storage devices. 1 Objectives: • The hardware side of storage. Arrays, controllers, HBA’s RAID, SAN, Disks • The AIX view of Storage. The logical volume manager • The database view of storage. Tablespaces, Automatic Storage, tables, indexes, pages, extents, pre-fetching • DPF and the storage design. Using the BCU model • Back and recovery and storage strategies. 2 1. Overview: Why you need to understand the storage system and it isn't just a black box you can ignore. 2. The hardware components of Storage: Will discuss Server, Network and Storage array components and how they relate. 3. The OS view of storage. Will discuss AIX logical volume manager and how filesystems are created. 4. Ok I have a database to create, what's next? Will discuss how the storage design impacts the database design and some considerations. 5. Multi-partition and shared nothing: Multiple partitions presents challenges in the storage design. Will discuss some considerations when building a multi-partition database. 6. Backup and Recovery and the storage design: How you define your backup and recovery procedure will have a direct impact on storage usage. Will discuss the various strategies and how the related to disk usage. 2 Overview Storage is a integral part of databases. Databases could not exist with out some media for saving data. Storage comes in many designs and configurations. How storage is used can have a direct impact on the performance of a database. This presentation will give a basic review of storage and how it relates to DB2 databases. 3 3 Storage 4 4 Hardware: The Basics • Hard drives are composed of many parts, but the key parts are the platter, the spindle and motor, read write heads and the Head Actuator. • The platters are circular disks typically made out of a light aluminum alloy, glass and ceramic materials. The platter is coated with a magnetic material. • Platters are magnetized on both sides. • The platters are separated by spacers and attached to a spindle. The spindle is attached to a motor and when the motor spins, the spindle and platters also spin in unison. 5 5 Hardware: The Basics • Read/Write heads as the name infers reads and writes data from the disk platters. • There is generally one head per platter side • The heads fly just above the platter surface. Some distances are as little as 3 nanometres(3 billionths of a meter). • The read and write heads have involved over time from the magnetic coil to GMR (Giant Magnetorestistive) GMR is very sensitive. 6 6 7 7 Hardware: The Basics • The read write heads are mounted to a actuator assembly or head assembly. • The heads are attached to a a device called a slider. • The slider’s function is to support the head and hold it in the correct location over the platter. 8 8 Inside the Disk Drive 9 9 Hardware: How data is stored • Platters are broken down into tracks (concentric rings) and sectors or blocks. A block or sector is generally the smallest addressable unit. • Data is stored or read magnetically via the read/write heads on the surface of the platters. 10 10 The Platter 11 11 Hardware: Terms • Seek Time measures the time it takes to move the read/write heads to tracks on the platters. • Rotational Delay is how long it takes for the read/write heads to move to the sector or block within a track. • Transfer time is the time take to actually move the data to and from the disk. • Areal density or bit density is the amount of data that can be packed on to a storage medium. Gigabits per square inch. 12 12 Hardware: Terms • SATA - Serial Advanced Technology Advancement Based on serial signaling technology. Cables are thinner and more flexible. • Fibre Channel - High Speed • Lun - Logical Unit Number • Controller Software - Software that manages devices. • Mirroring - Raid 1 . Drives mirrored. Two writes. • Disk striping - Spreading data across many disks. 13 http://www.snia.org/education/dictionary/ very good site for network and storage terms 13 Hardware: Storage Arrays • Simply stated, storage arrays are large boxes that hold many hard disks. • IBM, HP, EMC, SUN, Hitachi to name a few offer storage arrays in different sizes and performance ranges. • Storage arrays can be scalable to the multi terabyte range. • Storage arrays include memory cache and come in different sizes. 14 14 Storage Array 15 15 Hardware: RAID • Raid stand for inexpensive arrays of disks. • Provides a method to access multiple disks as if they were one large disk • Data can be spread across multiple disk improving performance because more read/write heads are involved • Reliability can be increased with certain RAID types. • There are multiple RAID Types: 0, 1, 1+0 , 2, 3, 4, 5, 6..ect. 16 * RAID-0: This technique has striping but no redundancy of data. It offers the best performance but no fault-tolerance. * RAID-1: This type is also known as disk mirroring and consists of at least two drives that duplicate the storage of data. There is no striping. Read performance is improved since either disk can be read at the same time. Write performance is the same as for single disk storage. RAID-1 provides the best performance and the best fault-tolerance in a multi-user system. * RAID-2: This type uses striping across disks with some disks storing error checking and correcting (ECC) information. It has no advantage over RAID-3. * RAID-3: This type uses striping and dedicates one drive to storing parity information. The embedded error checking (ECC) information is used to detect errors. Data recovery is accomplished by calculating the exclusive OR (XOR) of the information recorded on the other drives. Since an I/O operation addresses all drives at the same time, RAID-3 cannot overlap I/O. For this reason, RAID-3 is best for single-user systems with long record applications. * RAID-4: This type uses large stripes, which means you can read records from any single drive. This allows you to take advantage of overlapped I/O for read operations. Since all write operations have to update the parity drive, no I/O overlapping is possible. RAID-4 offers no advantage over RAID-5. * RAID-5: This type includes a rotating parity array, thus addressing the write limitation in RAID-4. Thus, all read and write operations can be overlapped. RAID-5 stores parity information but not redundant data (but parity information can be used to reconstruct data). RAID-5 requires at least three and usually five disks for the array. It's best for multi-user systems in which performance is not critical or which do few write operations. * RAID-6: This type is similar to RAID-5 but includes a second parity scheme that is distributed across different drives and thus offers extremely high fault- and drive-failure tolerance. * RAID-7: This type includes a real-time embedded operating system as a controller, caching via a high-speed bus, and other characteristics of a stand-alone computer. One vendor offers this system. * RAID-10: Combining RAID-0 and RAID-1 is often referred to as RAID-10, which offers higher performance than RAID-1 but at much higher cost. There are two subtypes: In RAID-0+1, data is organized as stripes across multiple disks, and then the striped disk sets are mirrored. In RAID-1+0, the data is mirrored and the mirrors are striped. * RAID-50 (or RAID-5+0): This type consists of a series of RAID-5 groups and striped in RAID-0 fashion to improve RAID-5 performance without reducing data protection. * RAID-53 (or RAID-5+3): This type uses striping (in RAID-0 style) for RAID-3's virtual disk blocks. This offers higher performance than RAID-3 but at much higher cost. * RAID-S (also known as Parity RAID): This is an alternate, proprietary method for striped parity RAID from EMC Symmetrix that is no longer in use on current equipment. It appears to be similar to RAID-5 with some performance enhancements as well as the enhancements that come from having a high-speed disk cache on the disk array. 16 Raid 0 17 RAID 0 implements block striping, where data is broken into logical blocks and is striped across several drives. Unlike other RAID levels, there is no facility for redundancy. In the event of a disk failure, data is lost. In block striping, the total disk capacity is equivalent to the sum of the capacities of all drives in the array. This combination of drives appears to the system as a single logical drive. RAID 0 provides the highest performance. It is fast because data can be simultaneously transferred to or from every disk in the array. Furthermore, read/writes to separate drives can be processed concurrently. 17 Raid 1 18 RAID 1 implements disk mirroring, where a copy of the same data is recorded onto two drives. By keeping two copies of data on separate disks, data is protected against a disk failure.
Load more

Recommended publications
  • Fibre Channel Interface
    Fibre Channel Interface Fibre Channel Interface ©2006, Seagate Technology LLC All rights reserved Publication number: 100293070, Rev. A March 2006 Seagate and Seagate Technology are registered trademarks of Seagate Technology LLC. SeaTools, SeaFONE, SeaBOARD, SeaTDD, and the Wave logo are either registered trade- marks or trademarks of Seagate Technology LLC. Other product names are registered trade- marks or trademarks of their owners. Seagate reserves the right to change, without notice, product offerings or specifications. No part of this publication may be reproduced in any form without written permission of Seagate Technol- ogy LLC. Revision status summary sheet Revision Date Writer/Engineer Sheets Affected A 03/08/06 C. Chalupa/J. Coomes All iv Fibre Channel Interface Manual, Rev. A Contents 1.0 Contents . i 2.0 Publication overview . 1 2.1 Acknowledgements . 1 2.2 How to use this manual . 1 2.3 General interface description. 2 3.0 Introduction to Fibre Channel . 3 3.1 General information . 3 3.2 Channels vs. networks . 4 3.3 The advantages of Fibre Channel . 4 4.0 Fibre Channel standards . 5 4.1 General information . 6 4.1.1 Description of Fibre Channel levels . 6 4.1.1.1 FC-0 . .6 4.1.1.2 FC-1 . .6 4.1.1.3 FC-1.5 . .6 4.1.1.4 FC-2 . .6 4.1.1.5 FC-3 . .6 4.1.1.6 FC-4 . .7 4.1.2 Relationship between the levels. 7 4.1.3 Topology standards . 7 4.1.4 FC Implementation Guide (FC-IG) . 7 4.1.5 Applicable Documents .
    [Show full text]
  • HP Storageworks Disk Array XP Operating System Configuration Guide
    HP-UX HP StorageWorks Disk Array XP operating system configuration guide XP48 XP128 XP512 XP1024 XP12000 fifth edition (August 2004) part number: A5951-96014 This guide describes the requirements and procedures for connecting the XP family of disk arrays to an HP-UX system and configuring the new disk array for operation with HP-UX. Copyright © 2003-2004, Hewlett-Packard Development Company, L.P. All rights reserved. Hewlett-Packard Company makes no warranty of any kind with regard to this material, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose. Hewlett-Packard shall not be liable for errors contained herein or for incidental or consequential damages in connection with the furnishing, performance, or use of this material. This document contains proprietary information, which is protected by copyright. No part of this document may be photocopied, reproduced, or translated into another language without the prior written consent of Hewlett-Packard. The information contained in this document is subject to change without notice. HP-UX is a registered trademark of Hewlett-Packard Company. All other product names mentioned herein may be trademarks of their respective companies. Hewlett-Packard Company shall not be liable for technical or editorial errors or omissions contained herein. The information is provided “as is” without warranty of any kind and is subject to change without notice. The warranties for Hewlett-Packard Company products are set forth in the express limited warranty statements accompanying such products. Nothing herein should be construed as constituting an additional warranty. Printed in the U.S.A.
    [Show full text]
  • Connecting the Storage System to the Solaris Host
    Configuration Guide for Solaris™ Host Attachment Hitachi Virtual Storage Platform Hitachi Universal Storage Platform V/VM FASTFIND LINKS Document Organization Product Version Getting Help Contents MK-96RD632-05 Copyright © 2010 Hitachi, Ltd., all rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording, or stored in a database or retrieval system for any purpose without the express written permission of Hitachi, Ltd. (hereinafter referred to as “Hitachi”) and Hitachi Data Systems Corporation (hereinafter referred to as “Hitachi Data Systems”). Hitachi Data Systems reserves the right to make changes to this document at any time without notice and assumes no responsibility for its use. This document contains the most current information available at the time of publication. When new and/or revised information becomes available, this entire document will be updated and distributed to all registered users. All of the features described in this document may not be currently available. Refer to the most recent product announcement or contact your local Hitachi Data Systems sales office for information about feature and product availability. Notice: Hitachi Data Systems products and services can be ordered only under the terms and conditions of the applicable Hitachi Data Systems agreement(s). The use of Hitachi Data Systems products is governed by the terms of your agreement(s) with Hitachi Data Systems. Hitachi is a registered trademark of Hitachi, Ltd. in the United States and other countries. Hitachi Data Systems is a registered trademark and service mark of Hitachi, Ltd.
    [Show full text]
  • Flexarray Virtualization Implementation Guide for Third-Party Storage
    Updated for 8.2.1 FlexArray Virtualization Implementation Guide for Third-Party Storage NetApp, Inc. Telephone: +1 (408) 822-6000 Part number: 215-08542_C0 495 East Java Drive Fax: +1 (408) 822-4501 December 2014 Sunnyvale, CA 94089 Support telephone: +1 (888) 463-8277 U.S. Web: www.netapp.com Feedback: [email protected] Table of Contents | 3 Contents How this guide fits into your implementation planning ........................... 6 Where to find interoperability and limits information for configurations with storage arrays ........................................................ 8 Interoperability information about support for storage arrays .................................... 8 Limits information for configurations with storage arrays ......................................... 9 Use of storage array advanced features ................................................... 10 Data ONTAP systems that can use array LUNs on storage arrays ....... 11 General configuration guidelines for all storage arrays ......................... 12 Requirement for 8-Gb array port initialization ......................................................... 12 EMC CLARiiON and VNX storage arrays ............................................. 13 Required parameters for EMC CLARiiON and VNX storage arrays with Data ONTAP systems .................................................................................................. 13 General configuration guidelines .............................................................................. 13 How EMC CLARiiON
    [Show full text]
  • Logical Partitioning
    Power Systems Logical partitioning Power Systems Logical partitioning Note Before using this information and the product it supports, read the information in “Notices” on page 233. This edition applies to IBM AIX Version 6.1, to IBM AIX 5L™ Version 5.3, to IBM i 6.1 (product number 5722-SS1) , to IBM Virtual I/O Server version 2.1.2.0, and to all subsequent releases and modifications until otherwise indicated in new editions. This version does not run on all reduced instruction set computer (RISC) models nor does it run on CISC models. © Copyright IBM Corporation 2007, 2009. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Logical partitioning ...............................1 What's new in Logical partitioning ............................1 Logical partition overview ...............................2 Benefits of logical partitioning ............................2 Sharing resources between logical partitions ........................3 Managed systems.................................5 Manufacturing default configuration ..........................5 Logical partitioning tools ..............................6 Hardware Management Console ...........................6 Partition profile ...............................7 System profile ...............................11 Partitioning with the Integrated Virtualization Manager ..................11 Virtual Partition Manager.............................13 Physical and virtual hardware resources .........................14
    [Show full text]
  • IBM XIV Host Attachment Kit for HP-UX
    IBM XIV Host Attachment Kit for HP-UX Version 1.6.0 Release Notes First Edition (May 2011) IBM XIV Host Attachment Kit for HP‐UX Version 1.6.0, Release Notes First Edition (May 2011) This document edition applies to Version 1.6.0 of the IBM XIV Host Attachment Kit for HP‐UX software package. Newer document editions may be issued for the same product version in order to add missing information or amend typographical errors. The edition is reset to 'First Edition' for every new product version. © Copyright International Business Machines Corporation 2009, 2011. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. ©2009, 2011 IBM Corporation i IBM XIV Host Attachment Kit for HP‐UX Version 1.6.0, Release Notes Contents Overview....................................................................................................................1 Compatibility and requirements.................................................................................1 Supported HP‐UX versions ........................................................................................................ 1 Supported XIV storage systems ................................................................................................ 1 Supported HBAs ........................................................................................................................ 2 Supported multipath and I/O solutions .................................................................................... 2
    [Show full text]
  • HP Storageworks Disk Array XP OS Configuration Guide: Linux
    HP StorageWorks Disk Array XP operating system configuration guide: Linux XP12000 XP10000 XP1024 XP128 This guide describes the requirements and procedures for connecting the XP family of disk arrays to a Linux system and configuring the new disk array for operation with Linux. Part number: A5951–96094 Seventh edition: (November 2005) Legal and notice information © Copyright 2003-2005 Hewlett-Packard Development Company, L.P. Confidential computer software. Valid license from HP required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor’s standard commercial license. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. Microsoft, Windows, Windows XP, and Windows NT are U.S. registered trademarks of Microsoft Corporation. Linux is a U.S. registered trademark of Linus Torvalds. Disk Array XP operating system configuration guide: Linux Contents Preface......................... 5 Aboutthisguide................................ 5 Intendedaudience............................... 5 Diskarrays.................................. 5 Relateddocumentation............................
    [Show full text]
  • Acceleraid 170LP
    AcceleRAID 170LP Installation Guide DB11-000024-00 First Edition 08P5513 Electromagnetic Compatibility Notices This device complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: 1. This device may not cause harmful interference, and 2. This device must accept any interference received, including interference that may cause undesired operation. This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference in a residential installation. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the instructions, may cause harmful interference to radio communications. However, there is no guarantee that interference will not occur in a particular installation. If this equipment does cause harmful interference to radio or television reception, which can be determined by turning the equipment off and on, the user is encouraged to try to correct the interference by one or more of the following measures: •Reorient or relocate the receiving antenna. •Increase the separation between the equipment and the receiver. •Connect the equipment into an outlet on a circuit different from that to which the receiver is connected. •Consult the dealer or an experienced radio/TV technician for help. Shielded cables for SCSI connection external to the cabinet are used in the compliance testing of this Product. LSI Logic is not responsible for any radio or television interference caused by unauthorized modification of this equipment or the substitution or attachment of connecting cables and equipment other than those specified by LSI Logic.
    [Show full text]
  • Iseries in Storage Area Networks a Guide to Implementing FC Disk and Tape with Iseries
    IBM Front cover iSeries in Storage Area Networks A Guide to Implementing FC Disk and Tape with iSeries Learn how iSeries fits in a SAN environment Plan how to migrate from SCSI to fiber channel disk and tape Understand the new Multipath function Nick Harris Jana Jamsek Joseph Raphael Nancy Roper ibm.com/redbooks International Technical Support Organization iSeries in Storage Area Networks A Guide to Implementing FC Disk and Tape with iSeries March 2005 SG24-6220-01 Note! Before using this information and the product it supports, read the information in “Notices” on page ix. Second Edition (March 2005) This edition applies to V5R1 and V5R2 of OS/400 and V5R3 of i5/OS. © Copyright International Business Machines Corporation 2002, 2005. All rights reserved. Note to U.S Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Contents . iii Notices . ix Trademarks . .x Preface . xi The team that wrote this redbook. xi Become a published author . xiii Comments welcome. xiii Part 1. Introduction and positioning . 1 Chapter 1. Introduction to iSeries and Storage Area Networks (SAN). 3 1.1 Overview of enhancements. 4 1.2 iSeries storage architecture . 4 1.2.1 Single-level storage . 5 1.2.2 iSeries storage management . 5 1.2.3 Main storage . 6 1.2.4 Cache . 7 1.2.5 Direct access storage device . 8 1.2.6 iSeries Fibre Channel support. 9 1.2.7 Multipath support for TotalStorage Enterprise Storage Server (ESS). 10 1.3 Enterprise Storage Server. 10 1.3.1 Storage consolidation .
    [Show full text]
  • Storageworks SWXD3-SE 4.29-GB 3.5-In Disk Drv SBB Prod Notes
    SWXD3-SE 4.29-GB 3.5-Inch Disk Drive SBB Product Notes EK–SM2DG–PN. B01 Thank you for purchasing our SWXD3-SE Stor- mented cache buffer maximizes the cache hit rate ageWorks Building Block (SBB), designed and for sequential reads. manufactured by Digital Equipment Corporation. The SWXD3-SE drive also offers high data in- This 4.29-GB, 3.5-inch low-profile disk drive is tegrity, ensured by a 96-bit Reed-Solomon error compatible with SCSI-2 single-ended 8-bit inter- correction code (ECC). ECC is performed “on the face standards. This drive has been Novell™ and fly,” when data is written to or read from the disk Microsoft™ Windows™ certified and is sup- drive; this scheme will detect and correct a single ported on all Intel™ compatible Windows, Win- 41-bit burst or two 17-bit bursts of defective data dows NT and Novell Systems. It is also supported in a single block on the disk. for use with IBM RS-6000, Sun SPARC systems, and HP9000 700/800 Series platforms. It comes Other special features of note include: labeled for the Sun operating system. • Asynchronous & synchronous data- transfer protocol Overview of SWXD3-SE Drive: • Downloadable SCSI firmware This 3.5-inch drive has a formatted capacity of • Programmable sector size reallocation 4.29 GB. It features an average read seek time of • Tagged command queuing 8 ms and an average latency of 4.2 ms, giving an • Background queue processing average data-read access time of 12.2 ms (without • Self diagnostics cache).
    [Show full text]
  • Storage Area Network (SAN) Security and Performance
    MASTER THESIS Evaluation of Storage Area Network (SAN) Security and Performance Master Thesis in Computer Network Engineering November 2013 Author: Siavash Hajirostam Supervisor: Tony Larsson Examiner: Tony Larsson __________________________________ School of Information Science, Computer and Electrical Engineering Halmstad University PO Box 823, SE-301 18 HALMSTAD Sweden Evaluation of Storage Area Network (SAN) Security and Performance Siavash Hajirostam © Copyright Siavash Hajirostam, 2013. All rights reserved. Master thesis report IDE 1325 School of Information Science, Computer and Electrical Engineering Halmstad University Preface I would like to express my appreciation to my supervisor, Professor Tony Larsson, for the many useful discussions, comments and suggestions on this thesis and also my thanks go to the staff of Halmstad University for giving me the opportunity to study in the computer network engineering program. Finally, my special thanks to my family for their encouragement and support during my stud ies. Siavash Hajirostam Halmstad, November 2013 i Abstract Due to growing the number of Information Technology (IT) users all around the world, consequently the amount of data that needs to be stored is increasing day by day. Single attached disks and old storage technologies cannot manage the storing these amounts of data. Storage Area Network (SAN) is a distributed storage technology to manage the data from several nodes in centralize place and secure. This thesis investigates how SAN works, the file system and protocols that are used in implementation of SAN. The thesis also investigate about other storages technologies such as Network Attached Storage (NAS) and Direct Attached Storage (DAS) to figure out the advantages and disadvantages of SAN , The main focus of the thesis project is on identifying the security vulnerabilities in SAN such as possible attacks in different SAN protocols.
    [Show full text]
  • Lunworks for Solaris Version 1.0
    Document: 313429201 LUNWorks for Solaris Version 1.0 Installation Manual LUNWorks for Solaris Version 1.0 Installation Manual Information contained in this publication is subject to change. In the event of changes, the publication will be revised. Comments concerning its contents should be directed to: Information Development Storage Technology Corporation One StorageTek Drive Louisville, CO 80028-2201 USA Information Control Statement: The information in this document is confidential and proprietary to Storage Technology Corporation and may be used only under terms of the product license or nondisclosure agreement. The information in this document, including any associated software program, may not be disclosed, disseminated, or distributed in any manner without written consent of Storage Technology Corporation. Limitations on Warranties and Liability: This document neither extends nor creates warranties of any nature, expressed or implied. Storage Technology Corporation cannot accept any responsibility for your use of the information in this document or for your use of any associated software program. You are responsible for backing up your data. You should be careful to ensure that your use of the information complies with all applicable laws, rules, and regulations of the jurisdictions in which it is used. No part or portion of this document may be reproduced in any manner or in any form without the written permission of Storage Technology Corporation. © 2000, Storage Technology Corporation, Louisville, CO, USA. All rights reserved.
    [Show full text]