A Whitepaper on Maximum LUN Limitations on HP-UX

Total Page:16

File Type:pdf, Size:1020Kb

A Whitepaper on Maximum LUN Limitations on HP-UX HP-UX Technical Maximum LUN configuration and considerations for HP-UX January 2002 A Whitepaper on Maximum LUN limitations Version 1.0 on HP-UX U.S.A. ©2002 Hewlett-Packard Company Table of Contents 1. Abstract ......................................................................................................................................... 1 2. Definitions...................................................................................................................................... 1 3. Supported LUN Limits on HP-UX ....................................................................................................... 2 4. Device LUN Limits............................................................................................................................ 3 5. Architectural Limits.......................................................................................................................... 3 6. Considerations................................................................................................................................ 3 6.1 Server considerations ................................................................................................................. 4 6.2 Kernel Tunables......................................................................................................................... 4 6.3 Volume Manager considerations................................................................................................. 4 6.4 File System considerations .......................................................................................................... 4 6.5 Scan/Startup/Shutdown times.................................................................................................... 4 7. Roadmap / Futures......................................................................................................................... 5 8. More Information............................................................................................................................ 5 ii Maximum LUN Configurations and Consideration for HP-UX 1. Abstract Mass storage requirements have expanded dramatically over the last few years. High-end HP-UX customers now require Terabytes of storage and thousands of storage devices (LUNs) accessible from a single HP-UX server. This paper will address HP-UX limits on the maximum number of LUNs accessible in various ways from an HP-UX server, and significant LUN limits that exist at a sub- component level such as per-HBA (Host Bus Adapter) limits. The nature of these limits will be defined, and issues, recommendations, or restrictions that apply when operating at or near these limits will be discussed, along with expectations for the future and what to do if you need to exceed existing supported levels. 2. Definitions The primary mass storage device protocol in use on HP-UX and in the workstation and server industry in general is the SCSI device protocol, which is used across both parallel SCSI and Fibre Channel in HP-UX today, and will be used across other links in the future. The SCSI protocol defines the term LU (Logical Unit) to refer to an independently controllable device or to an independently controllable piece of storage in a storage array device. Technically the term LUN (Logical Unit Number) refers to an addressing identifier of the LU, but colloquially it is used to refer to the device or piece of storage, or even a hardware path to the device. In this paper, to distinguish between the actual device and a path to that device, we'll use the term "LUN device" to mean the actual piece of storage, and we'll use the term "LUN path" or simply "LUN" to mean "a specific hardware path to the piece of storage". There can be multiple LUN paths to a given LUN device. On an HP-UX system, a “LUN” can be opened, accessed via appropriate I/O or control operations, and closed. For user access a LUN typically has at least one device file associated with it. Volume Managers or dynamic-multi-pathing modules running in HP-UX may abstract which path is being accessed for a given LUN device, in which case an open of such an abstracted LUN path provides a mechanism for access to the LUN device independently of any specific path. Two cases of abstracted LUN paths currently used on HP-UX occur in alternate path failover functionality (e.g., LVM’s PVLinks), and in dynamic-multi-pathing (DMP) functionality (e.g., Veritas’ Volume Manager (VxVM) and EMC’s PowerPath product). “Dynamic-multi-pathing” (DMP) refers to the capability to determine the various paths to a given LUN device at runtime and to dynamically load- balance I/Os across those paths. As a result, all LUN paths that are accessed via a DMP module are considered load-bearing and hence “active” in the definitions below. DMP modules tend to include the alternate path failover functionality as well, but the key characteristic of DMP modules important for this paper is that they increase the number of “active” paths that exist on the system. LVM’s PVLinks provides a mechanism for abstracting multiple paths (traditionally only 2 paths per LUN device, but recently on 11.0 this has been extended to up to 8 paths per LUN device) for purposes of failover. Only one of the paths is a load-bearing path at any point in time. For purposes of LUN count limitations we’ll define the following terms: · Active LUN: A load-bearing path to a LUN device. · Open LUN: An "Active LUN" or a LUN that is open with only occasional I/O to the LUN. · Visible LUN: An "Open LUN" or a LUN that is typically not open but is visible to ioscan. Page 1 Maximum LUN Configurations and Consideration for HP-UX Each of these three definitions will be used in defining various limits, as described in the next section below. Note that all PVLinks paths to a given LUN device are considered “Open” but only one of the paths is active at any point in time. Hence if a system has 2000 LUN devices attached to it with 2 paths to each device for a total of 4000 LUN paths, all of which are PVLink pairs, then the number of Active LUNs would be 2000 and the number of Open and Visible LUNs would be 4000. On the other hand, if a system has 2000 attached LUN devices with 2 paths to each device, all of which are accessed through a DMP module the number of active LUNs would be 4000. The term HBA (Host Bus Adapter) in this paper is used to refer to a mass storage adapter (e.g., SCSI or Fibre Channel) that attaches to a system I/O bus such as PCI. 3. Supported LUN Limits on HP-UX The limits associated with LUNs on HP-UX are for the most part tested limitations, not architectural. That is, the limits are the limit of what has been tested on HP-UX, and unless otherwise specified are not hard architected limits that would require hardware or software redesign to move beyond. These limits specify the levels at which HP provides general support on HP-UX 10.20, 11.0, and 11i. Customers must contact their HP support personnel to discuss support of higher LUN levels than those indicated below. As of the writing of this paper, HP-UX supports maximum LUN configurations as defined in the following table: Table 1 - Max LUN Limits HP-UX Releases 10.20 11.0 11i Active LUNs 768 2400 4096 Open/Visible LUNs 1536 4800 8192 LUNs/HBA (non-HA) 512 512 512 LUNs/HBA (HA) 320 320 512 The LUNs/HBA (HA and non-HA) rows indicate the maximum number of Visible LUNs supported through a single HBA port. In this context “HA” refers to usage of the HBA in an environment in which the MC-ServiceGuard or ServiceGuard-OPS (Oracle Parallel Server) products are being used. These limits may change over time as larger configurations are tested and supported, and to support ever larger requirements on future releases of HP-UX. Examples of supported configurations on HP-UX 11i, given the definitions and limits in Table 1, would include: a) 4096 LUN devices, with 2 paths to each device, all controlled by LVM’s PVLinks: Þ 4096 Active LUNs, 8192 Open and Visible LUNs b) 4100 LUN devices, with 2 paths to each device, and 4090 of them controlled by LVM’s PVLinks and the other 10 LUNs only used sporadically: Þ 4090 Active LUNs, 8180 Open LUNs, and 8190 Visible LUNs Page 2 Maximum LUN Configurations and Consideration for HP-UX c) 2048 LUN devices, with 4 paths to each device, all controlled by LVM’s PVLinks: Þ 2048 Active LUNs, 8192 Open and Visible LUNs d) 1024 LUN devices, with 4 paths to each device, all accessed via DMP modules: Þ 4096 Active LUNs, 4096 Open and Visible LUNs e) 256 LUN devices, with 16 paths to each device, all accessed via DMP modules: Þ 4096 Active LUNs, 8192 Open and Visible LUNs 4. Device LUN Limits In addition to the system limits specified above, the storage device itself can have various LUN limitations both internally and with respect to the configuration/topology that it can reside within. Make sure you consider all of the possible limits across the storage device, adapter, and the system in your LUN count determinations. Contact the storage device vendor or your HP support personnel for details on device-specific limits. 5. Architectural Limits Architectural limits that exist on HP-UX are well above the supported limits listed above and are not expected to be encountered by customers at those levels. One key architectural limit that currently exists, which will be removed in future releases of HP-UX, is a 32768 LUN limit that results from the 15 bits currently available for LUN addressing in the device file’s minor number. This limit includes so-called “LUN holes” (non-existent
Recommended publications
  • Fibre Channel Interface
    Fibre Channel Interface Fibre Channel Interface ©2006, Seagate Technology LLC All rights reserved Publication number: 100293070, Rev. A March 2006 Seagate and Seagate Technology are registered trademarks of Seagate Technology LLC. SeaTools, SeaFONE, SeaBOARD, SeaTDD, and the Wave logo are either registered trade- marks or trademarks of Seagate Technology LLC. Other product names are registered trade- marks or trademarks of their owners. Seagate reserves the right to change, without notice, product offerings or specifications. No part of this publication may be reproduced in any form without written permission of Seagate Technol- ogy LLC. Revision status summary sheet Revision Date Writer/Engineer Sheets Affected A 03/08/06 C. Chalupa/J. Coomes All iv Fibre Channel Interface Manual, Rev. A Contents 1.0 Contents . i 2.0 Publication overview . 1 2.1 Acknowledgements . 1 2.2 How to use this manual . 1 2.3 General interface description. 2 3.0 Introduction to Fibre Channel . 3 3.1 General information . 3 3.2 Channels vs. networks . 4 3.3 The advantages of Fibre Channel . 4 4.0 Fibre Channel standards . 5 4.1 General information . 6 4.1.1 Description of Fibre Channel levels . 6 4.1.1.1 FC-0 . .6 4.1.1.2 FC-1 . .6 4.1.1.3 FC-1.5 . .6 4.1.1.4 FC-2 . .6 4.1.1.5 FC-3 . .6 4.1.1.6 FC-4 . .7 4.1.2 Relationship between the levels. 7 4.1.3 Topology standards . 7 4.1.4 FC Implementation Guide (FC-IG) . 7 4.1.5 Applicable Documents .
    [Show full text]
  • HP Storageworks Disk Array XP Operating System Configuration Guide
    HP-UX HP StorageWorks Disk Array XP operating system configuration guide XP48 XP128 XP512 XP1024 XP12000 fifth edition (August 2004) part number: A5951-96014 This guide describes the requirements and procedures for connecting the XP family of disk arrays to an HP-UX system and configuring the new disk array for operation with HP-UX. Copyright © 2003-2004, Hewlett-Packard Development Company, L.P. All rights reserved. Hewlett-Packard Company makes no warranty of any kind with regard to this material, including, but not limited to, the implied warranties of merchantability and fitness for a particular purpose. Hewlett-Packard shall not be liable for errors contained herein or for incidental or consequential damages in connection with the furnishing, performance, or use of this material. This document contains proprietary information, which is protected by copyright. No part of this document may be photocopied, reproduced, or translated into another language without the prior written consent of Hewlett-Packard. The information contained in this document is subject to change without notice. HP-UX is a registered trademark of Hewlett-Packard Company. All other product names mentioned herein may be trademarks of their respective companies. Hewlett-Packard Company shall not be liable for technical or editorial errors or omissions contained herein. The information is provided “as is” without warranty of any kind and is subject to change without notice. The warranties for Hewlett-Packard Company products are set forth in the express limited warranty statements accompanying such products. Nothing herein should be construed as constituting an additional warranty. Printed in the U.S.A.
    [Show full text]
  • Connecting the Storage System to the Solaris Host
    Configuration Guide for Solaris™ Host Attachment Hitachi Virtual Storage Platform Hitachi Universal Storage Platform V/VM FASTFIND LINKS Document Organization Product Version Getting Help Contents MK-96RD632-05 Copyright © 2010 Hitachi, Ltd., all rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording, or stored in a database or retrieval system for any purpose without the express written permission of Hitachi, Ltd. (hereinafter referred to as “Hitachi”) and Hitachi Data Systems Corporation (hereinafter referred to as “Hitachi Data Systems”). Hitachi Data Systems reserves the right to make changes to this document at any time without notice and assumes no responsibility for its use. This document contains the most current information available at the time of publication. When new and/or revised information becomes available, this entire document will be updated and distributed to all registered users. All of the features described in this document may not be currently available. Refer to the most recent product announcement or contact your local Hitachi Data Systems sales office for information about feature and product availability. Notice: Hitachi Data Systems products and services can be ordered only under the terms and conditions of the applicable Hitachi Data Systems agreement(s). The use of Hitachi Data Systems products is governed by the terms of your agreement(s) with Hitachi Data Systems. Hitachi is a registered trademark of Hitachi, Ltd. in the United States and other countries. Hitachi Data Systems is a registered trademark and service mark of Hitachi, Ltd.
    [Show full text]
  • Flexarray Virtualization Implementation Guide for Third-Party Storage
    Updated for 8.2.1 FlexArray Virtualization Implementation Guide for Third-Party Storage NetApp, Inc. Telephone: +1 (408) 822-6000 Part number: 215-08542_C0 495 East Java Drive Fax: +1 (408) 822-4501 December 2014 Sunnyvale, CA 94089 Support telephone: +1 (888) 463-8277 U.S. Web: www.netapp.com Feedback: [email protected] Table of Contents | 3 Contents How this guide fits into your implementation planning ........................... 6 Where to find interoperability and limits information for configurations with storage arrays ........................................................ 8 Interoperability information about support for storage arrays .................................... 8 Limits information for configurations with storage arrays ......................................... 9 Use of storage array advanced features ................................................... 10 Data ONTAP systems that can use array LUNs on storage arrays ....... 11 General configuration guidelines for all storage arrays ......................... 12 Requirement for 8-Gb array port initialization ......................................................... 12 EMC CLARiiON and VNX storage arrays ............................................. 13 Required parameters for EMC CLARiiON and VNX storage arrays with Data ONTAP systems .................................................................................................. 13 General configuration guidelines .............................................................................. 13 How EMC CLARiiON
    [Show full text]
  • Logical Partitioning
    Power Systems Logical partitioning Power Systems Logical partitioning Note Before using this information and the product it supports, read the information in “Notices” on page 233. This edition applies to IBM AIX Version 6.1, to IBM AIX 5L™ Version 5.3, to IBM i 6.1 (product number 5722-SS1) , to IBM Virtual I/O Server version 2.1.2.0, and to all subsequent releases and modifications until otherwise indicated in new editions. This version does not run on all reduced instruction set computer (RISC) models nor does it run on CISC models. © Copyright IBM Corporation 2007, 2009. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Logical partitioning ...............................1 What's new in Logical partitioning ............................1 Logical partition overview ...............................2 Benefits of logical partitioning ............................2 Sharing resources between logical partitions ........................3 Managed systems.................................5 Manufacturing default configuration ..........................5 Logical partitioning tools ..............................6 Hardware Management Console ...........................6 Partition profile ...............................7 System profile ...............................11 Partitioning with the Integrated Virtualization Manager ..................11 Virtual Partition Manager.............................13 Physical and virtual hardware resources .........................14
    [Show full text]
  • IBM XIV Host Attachment Kit for HP-UX
    IBM XIV Host Attachment Kit for HP-UX Version 1.6.0 Release Notes First Edition (May 2011) IBM XIV Host Attachment Kit for HP‐UX Version 1.6.0, Release Notes First Edition (May 2011) This document edition applies to Version 1.6.0 of the IBM XIV Host Attachment Kit for HP‐UX software package. Newer document editions may be issued for the same product version in order to add missing information or amend typographical errors. The edition is reset to 'First Edition' for every new product version. © Copyright International Business Machines Corporation 2009, 2011. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. ©2009, 2011 IBM Corporation i IBM XIV Host Attachment Kit for HP‐UX Version 1.6.0, Release Notes Contents Overview....................................................................................................................1 Compatibility and requirements.................................................................................1 Supported HP‐UX versions ........................................................................................................ 1 Supported XIV storage systems ................................................................................................ 1 Supported HBAs ........................................................................................................................ 2 Supported multipath and I/O solutions .................................................................................... 2
    [Show full text]
  • HP Storageworks Disk Array XP OS Configuration Guide: Linux
    HP StorageWorks Disk Array XP operating system configuration guide: Linux XP12000 XP10000 XP1024 XP128 This guide describes the requirements and procedures for connecting the XP family of disk arrays to a Linux system and configuring the new disk array for operation with Linux. Part number: A5951–96094 Seventh edition: (November 2005) Legal and notice information © Copyright 2003-2005 Hewlett-Packard Development Company, L.P. Confidential computer software. Valid license from HP required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor’s standard commercial license. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. Microsoft, Windows, Windows XP, and Windows NT are U.S. registered trademarks of Microsoft Corporation. Linux is a U.S. registered trademark of Linus Torvalds. Disk Array XP operating system configuration guide: Linux Contents Preface......................... 5 Aboutthisguide................................ 5 Intendedaudience............................... 5 Diskarrays.................................. 5 Relateddocumentation............................
    [Show full text]
  • Acceleraid 170LP
    AcceleRAID 170LP Installation Guide DB11-000024-00 First Edition 08P5513 Electromagnetic Compatibility Notices This device complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: 1. This device may not cause harmful interference, and 2. This device must accept any interference received, including interference that may cause undesired operation. This equipment has been tested and found to comply with the limits for a Class B digital device, pursuant to part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference in a residential installation. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the instructions, may cause harmful interference to radio communications. However, there is no guarantee that interference will not occur in a particular installation. If this equipment does cause harmful interference to radio or television reception, which can be determined by turning the equipment off and on, the user is encouraged to try to correct the interference by one or more of the following measures: •Reorient or relocate the receiving antenna. •Increase the separation between the equipment and the receiver. •Connect the equipment into an outlet on a circuit different from that to which the receiver is connected. •Consult the dealer or an experienced radio/TV technician for help. Shielded cables for SCSI connection external to the cabinet are used in the compliance testing of this Product. LSI Logic is not responsible for any radio or television interference caused by unauthorized modification of this equipment or the substitution or attachment of connecting cables and equipment other than those specified by LSI Logic.
    [Show full text]
  • Iseries in Storage Area Networks a Guide to Implementing FC Disk and Tape with Iseries
    IBM Front cover iSeries in Storage Area Networks A Guide to Implementing FC Disk and Tape with iSeries Learn how iSeries fits in a SAN environment Plan how to migrate from SCSI to fiber channel disk and tape Understand the new Multipath function Nick Harris Jana Jamsek Joseph Raphael Nancy Roper ibm.com/redbooks International Technical Support Organization iSeries in Storage Area Networks A Guide to Implementing FC Disk and Tape with iSeries March 2005 SG24-6220-01 Note! Before using this information and the product it supports, read the information in “Notices” on page ix. Second Edition (March 2005) This edition applies to V5R1 and V5R2 of OS/400 and V5R3 of i5/OS. © Copyright International Business Machines Corporation 2002, 2005. All rights reserved. Note to U.S Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Contents . iii Notices . ix Trademarks . .x Preface . xi The team that wrote this redbook. xi Become a published author . xiii Comments welcome. xiii Part 1. Introduction and positioning . 1 Chapter 1. Introduction to iSeries and Storage Area Networks (SAN). 3 1.1 Overview of enhancements. 4 1.2 iSeries storage architecture . 4 1.2.1 Single-level storage . 5 1.2.2 iSeries storage management . 5 1.2.3 Main storage . 6 1.2.4 Cache . 7 1.2.5 Direct access storage device . 8 1.2.6 iSeries Fibre Channel support. 9 1.2.7 Multipath support for TotalStorage Enterprise Storage Server (ESS). 10 1.3 Enterprise Storage Server. 10 1.3.1 Storage consolidation .
    [Show full text]
  • Storageworks SWXD3-SE 4.29-GB 3.5-In Disk Drv SBB Prod Notes
    SWXD3-SE 4.29-GB 3.5-Inch Disk Drive SBB Product Notes EK–SM2DG–PN. B01 Thank you for purchasing our SWXD3-SE Stor- mented cache buffer maximizes the cache hit rate ageWorks Building Block (SBB), designed and for sequential reads. manufactured by Digital Equipment Corporation. The SWXD3-SE drive also offers high data in- This 4.29-GB, 3.5-inch low-profile disk drive is tegrity, ensured by a 96-bit Reed-Solomon error compatible with SCSI-2 single-ended 8-bit inter- correction code (ECC). ECC is performed “on the face standards. This drive has been Novell™ and fly,” when data is written to or read from the disk Microsoft™ Windows™ certified and is sup- drive; this scheme will detect and correct a single ported on all Intel™ compatible Windows, Win- 41-bit burst or two 17-bit bursts of defective data dows NT and Novell Systems. It is also supported in a single block on the disk. for use with IBM RS-6000, Sun SPARC systems, and HP9000 700/800 Series platforms. It comes Other special features of note include: labeled for the Sun operating system. • Asynchronous & synchronous data- transfer protocol Overview of SWXD3-SE Drive: • Downloadable SCSI firmware This 3.5-inch drive has a formatted capacity of • Programmable sector size reallocation 4.29 GB. It features an average read seek time of • Tagged command queuing 8 ms and an average latency of 4.2 ms, giving an • Background queue processing average data-read access time of 12.2 ms (without • Self diagnostics cache).
    [Show full text]
  • Storage Area Network (SAN) Security and Performance
    MASTER THESIS Evaluation of Storage Area Network (SAN) Security and Performance Master Thesis in Computer Network Engineering November 2013 Author: Siavash Hajirostam Supervisor: Tony Larsson Examiner: Tony Larsson __________________________________ School of Information Science, Computer and Electrical Engineering Halmstad University PO Box 823, SE-301 18 HALMSTAD Sweden Evaluation of Storage Area Network (SAN) Security and Performance Siavash Hajirostam © Copyright Siavash Hajirostam, 2013. All rights reserved. Master thesis report IDE 1325 School of Information Science, Computer and Electrical Engineering Halmstad University Preface I would like to express my appreciation to my supervisor, Professor Tony Larsson, for the many useful discussions, comments and suggestions on this thesis and also my thanks go to the staff of Halmstad University for giving me the opportunity to study in the computer network engineering program. Finally, my special thanks to my family for their encouragement and support during my stud ies. Siavash Hajirostam Halmstad, November 2013 i Abstract Due to growing the number of Information Technology (IT) users all around the world, consequently the amount of data that needs to be stored is increasing day by day. Single attached disks and old storage technologies cannot manage the storing these amounts of data. Storage Area Network (SAN) is a distributed storage technology to manage the data from several nodes in centralize place and secure. This thesis investigates how SAN works, the file system and protocols that are used in implementation of SAN. The thesis also investigate about other storages technologies such as Network Attached Storage (NAS) and Direct Attached Storage (DAS) to figure out the advantages and disadvantages of SAN , The main focus of the thesis project is on identifying the security vulnerabilities in SAN such as possible attacks in different SAN protocols.
    [Show full text]
  • Lunworks for Solaris Version 1.0
    Document: 313429201 LUNWorks for Solaris Version 1.0 Installation Manual LUNWorks for Solaris Version 1.0 Installation Manual Information contained in this publication is subject to change. In the event of changes, the publication will be revised. Comments concerning its contents should be directed to: Information Development Storage Technology Corporation One StorageTek Drive Louisville, CO 80028-2201 USA Information Control Statement: The information in this document is confidential and proprietary to Storage Technology Corporation and may be used only under terms of the product license or nondisclosure agreement. The information in this document, including any associated software program, may not be disclosed, disseminated, or distributed in any manner without written consent of Storage Technology Corporation. Limitations on Warranties and Liability: This document neither extends nor creates warranties of any nature, expressed or implied. Storage Technology Corporation cannot accept any responsibility for your use of the information in this document or for your use of any associated software program. You are responsible for backing up your data. You should be careful to ensure that your use of the information complies with all applicable laws, rules, and regulations of the jurisdictions in which it is used. No part or portion of this document may be reproduced in any manner or in any form without the written permission of Storage Technology Corporation. © 2000, Storage Technology Corporation, Louisville, CO, USA. All rights reserved.
    [Show full text]