DOCSLIB.ORG

Iscsi-Based Storage Area Networks for Disaster Recovery Operations Matthew R

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Iscsi-Based Storage Area Networks for Disaster Recovery Operations Matthew R Florida State University Libraries Electronic Theses, Treatises and Dissertations The Graduate School 2005 Iscsi-Based Storage Area Networks for Disaster Recovery Operations Matthew R. Murphy Follow this and additional works at the FSU Digital Library. For more information, please contact [email protected] THE FLORIDA STATE UNIVERSITY COLLEGE OF ENGINEERING iSCSI-based Storage Area Networks for Disaster Recovery Operations By MATTHEW R. MURPHY A Thesis submitted to the Department of Electrical and Computer Engineering in partial fulfillment of the requirements for the degree of Master of Science Degree Awarded: Spring Semester, 2005 The members of the Committee approve the thesis of Matthew R. Murphy defended on April 5, 2005. ______________________________ Bruce A. Harvey Professor Directing Thesis ______________________________ Lois Hawkes Committee Member ___________________________________ Simon Foo Committee Member ___________________________________ Michael Frank Committee Member Approved: _____________________________________________ Leonard Tung, Chair, Department of Electrical & Computer Engineering The Office of Graduate Studies has verified and approved the above named committee members. ii TABLE OF CONTENTS List of Figures..................................................................................................................... v List of Tables ..................................................................................................................... vi ABSTRACT...................................................................................................................... vii INTRODUCTION .............................................................................................................. 1 1. DISASTER RECOVERY............................................................................................... 3 1.1 Recovery Time and Recovery Point Objectives ....................................................... 3 1.2 Increasing Assurance using Remote Backup............................................................ 5 1.3 The Emergence of Storage Area Networks .............................................................. 6 1.4 Fibre Channel Protocol ............................................................................................. 7 1.4.1 The Trouble with Fibre Channel............................................................................ 8 1.5 Origins of iSCSI........................................................................................................ 9 1.5.1 Solutions Provided by iSCSI ............................................................................... 10 1.6 iSCSI vs. NFS ......................................................................................................... 13 2. DISASTER RECOVERY USING iSCSI ..................................................................... 16 2 Fundamentals of iSCSI .............................................................................................. 16 2.1 The Protocol Data Unit ........................................................................................... 17 2.1.1 PDU Structure...................................................................................................... 17 2.2 Layer Interactions ................................................................................................... 18 2.3 iSCSI Login ............................................................................................................ 20 2.3.1 Login Request PDU ............................................................................................. 20 2.3.2 Login Response PDU........................................................................................... 22 2.4 Login Text Parameters............................................................................................ 23 2.4.1 Text Request and Response PDUs....................................................................... 24 2.5 SCSI Read and Write Operations ........................................................................... 25 2.6 iSCSI Discovery Sessions....................................................................................... 27 2.7 Disaster Recovery using iSCSI............................................................................... 28 2.7.1 Small Business Continuity of Operations............................................................ 29 2.7.2 Enterprise Continuity of Operations .................................................................... 30 2.7.3 Remote Backup using iSCSI for Large Organizations ........................................ 32 2.8 Software and Hardware iSCSI Implementations .................................................... 32 2.8.1 Software-based iSCSI .......................................................................................... 33 2.8.2 TCP/IP Offload Engines ...................................................................................... 34 2.8.3 Hardware-based iSCSI......................................................................................... 35 2.8.4 Comparison of Hardware and Software-based iSCSI.......................................... 35 2.9 Cancer Therapy and Research Center Case Study.................................................. 36 2.9.1 Background and Requirements............................................................................ 37 2.9.2 An IP SAN Solution............................................................................................. 38 2.9.3 Results and Performance...................................................................................... 39 2.10 iSCSI RAID Configurations ................................................................................. 40 2.10.1 Distributed iSCSI RAID Configurations ........................................................... 42 2.11 MC/S and Link Aggregation................................................................................. 43 iii 2.11.1 Ensuring In-order PDU Delivery over MC/S .................................................... 45 2.11.2 Benefits of Using MC/S..................................................................................... 46 2.11.3 MC/S Implementation Results........................................................................... 47 2.12 Limitations of iSCSI ............................................................................................. 48 2.12.1 Fault Tolerance .................................................................................................. 48 2.12.2 Load Balancing and Manageability ................................................................... 51 3. PERFORMANCE TESTING OF iSCSI....................................................................... 53 3 Software-based iSCSI Experiments........................................................................... 53 3.1 iSCSI Testbed ......................................................................................................... 53 3.2 Block Size and Throughput .................................................................................... 54 3.2.1 Fast Ethernet Results............................................................................................ 54 3.2.2 Gigabit Ethernet Results ...................................................................................... 55 3.3 iSCSI CPU Utilization ............................................................................................ 58 3.4 CPU Loading Effects on iSCSI Throughput........................................................... 60 3.5 iSCSI at 10 Gbps..................................................................................................... 61 4. CONCLUSION............................................................................................................. 64 APPENDIX....................................................................................................................... 67 REFERENCES ................................................................................................................. 70 BIOGRAPHICAL SKETCH ............................................................................................ 73 iv LIST OF FIGURES Figure 1 – Minimum distance recommendations (in miles) ............................................... 5 Figure 2 – Generic Storage Area Network ......................................................................... 7 Figure 3 – iSCSI Encapsulation........................................................................................ 11 Figure 4 – iSCSI as a remote backup mechanism............................................................. 12 Figure 5 – SCSI device interaction ................................................................................... 16 Figure 6 – PDU and BHS Structure.................................................................................. 18 Figure 7 – iSCSI Layer Interactions ................................................................................. 19 Figure 8 – Login Request PDU......................................................................................... 20 Figure 9 – Login Response PDU ...................................................................................... 22 Figure 10 – Text Request PDU......................................................................................... 24 Figure 11 – Text Response PDU .....................................................................................
Load more

Recommended publications
  • EMC Host Connectivity Guide for Oracle Solaris
    Dell EMC Host Connectivity Guide for Oracle Solaris P/N 300-000-607 REV 56 MAY 2020 Copyright © 2007 – 2020 Dell Inc. or its subsidiaries. All rights reserved. Dell believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS-IS.” DELL MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. USE, COPYING, AND DISTRIBUTION OF ANY DELL SOFTWARE DESCRIBED IN THIS PUBLICATION REQUIRES AN APPLICABLE SOFTWARE LICENSE. Dell Technologies, Dell, EMC, Dell EMC and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be the propertyof their respective owners. Published in the USA. Dell EMC Hopkinton, Massachusetts 01748-9103 1-508-435-1000 In North America 1-866-464-7381 www.DellEMC.com 2 Dell EMC Host Connectivity Guide for Oracle Solaris CONTENTS Preface ....................................................................................................................................... 13 Part 1 Connecting Solaris to Dell EMC Storage Chapter 1 Solaris Operating System Solaris operating system overview........................................................................ 20 Multipathing software ........................................................................................... 21 MPxIO/STMS ...............................................................................................
    [Show full text]
  • Fibre Channel and Iscsi Configuration Guide for the Data ONTAP® 8.0 Release Family
    Fibre Channel and iSCSI Configuration Guide for the Data ONTAP® 8.0 Release Family NetApp, Inc. 495 East Java Drive Sunnyvale, CA 94089 U.S. Telephone: +1 (408) 822-6000 Fax: +1 (408) 822-4501 Support telephone: +1 (888) 463-8277 Web: www.netapp.com Feedback: [email protected] Part number: 215-08164_A0 August 2013 Table of Contents | 3 Contents iSCSI configurations .................................................................................... 6 Single-network HA pair in an iSCSI SAN .................................................................. 6 Multi-network HA pair in an iSCSI SAN ................................................................... 7 Direct-attached single-controller configurations in an iSCSI SAN ............................ 8 VLANs for iSCSI configurations ................................................................................ 9 Static VLANs ................................................................................................ 10 Dynamic VLANs ........................................................................................... 10 Fibre Channel configurations .................................................................... 11 FC onboard and expansion port combinations .......................................................... 11 Fibre Channel supported hop count .......................................................................... 12 Fibre Channel supported speeds ................................................................................ 13 Fibre Channel switch
    [Show full text]
  • Iscsi Testing: What Are the Test Challenges Under the Hood of a 10 Gb Iscsi Storage Product Certification?
    iSCSI testing: What are the test Challenges Under the Hood of a 10 Gb iSCSI Storage Product Certification? Dr. M. K. Jibbe Distinguished Engineer Manager and Technical Lead of Test Architect and Product Certification in India LSI Corporation (Engenio Storage Group) Storage Developer Conference 2009 © 2009 Insert Copyright Information Here. All Rights Reserved. 1 Abstract iSCSI RAID Storage Testing The certification of a 10 Gb iSCSI RAID Storage System elicits a lot of challenges at the development level and the Test / Quality Assurance level. The challenges are due to the fact that a 10 Gb iSCSI is a newly deployed iSCSI host interface in the RAID Storage environment. As a result the size of a development module level test should be designed very carefully to establish a test coverage beyond basic implementation verification, standard RAID testing, or the iSCSI plug fest. These module level tests must tackle the test time windows associated with the following iSCSI characteristics: NIC vs. CNA Device discovery, 10 GB switch traffic control and congestion, Security mechanisms with different Operating systems, Operational parameters associated with I/O retries and recovery Management, Administration, and Integration with Storage products Design For Testability “DFT” mechanisms Diagnostics, problem Isolations IPV4 vs. IPV6 However a number of the module tests above can be leveraged from the certification a 1 Gb iSCSI RAID products. There are specific features such as backup, snapshot, remote mirroring, and cluster application compatibility that must be supported by the RAID product and must be verified during the testing of the RAID controller host interface. Storage Developer Conference 2009 © 2009 Insert Copyright Information Here.
    [Show full text]
  • What Is a Storage Area Network?
    8646_Barker_01_d.qxd 9/20/01 10:21 AM Page 3 CHAPTER1 What Storage Networking Is and What It Can Mean to You n this chapter we’ll learn more about: II What a storage area network is I What properties a storage area network must have, should have, and may have I The importance of software to storage area networks I Why information services professionals should be interested in storage networking I Information processing capabilities enabled by storage area networks I Some quirks in the vocabulary of storage networking What Is a Storage Area Network? According to the Storage Networking Industry Association (and who should know better?): A storage area network (SAN) is any high-performance network whose primary pur- pose is to enable storage devices to communicate with computer systems and with each other. We think that the most interesting things about this definition are what it doesn’t say: I It doesn’t say that a SAN’s only purpose is communication between computers and storage. Many organizations operate perfectly viable SANs that carry occa- sional administrative and other application traffic. I It doesn’t say that a SAN uses Fibre Channel or Ethernet or any other specific interconnect technology. A growing number of network technologies have archi- tectural and physical properties that make them suitable for use in SANs. 3 8646_Barker_01_d.qxd 9/20/01 10:21 AM Page 4 4 STORAGE AREA NETWORK ESSENTIALS I It doesn’t say what kind of storage devices are interconnected. Disk and tape drives, RAID subsystems, robotic libraries, and file servers are all being used pro- ductively in SAN environments today.
    [Show full text]
  • Iscsi SAN Configuration Guide Update 2 and Later for ESX Server 3.5, ESX Server 3I Version 3.5, Virtualcenter 2.5 Iscsi SAN Configuration Guide
    iSCSI SAN Configuration Guide Update 2 and later for ESX Server 3.5, ESX Server 3i version 3.5, VirtualCenter 2.5 iSCSI SAN Configuration Guide iSCSI SAN Configuration Guide Revision: 20090313 Item: EN-000035-01 You can find the most up-to-date technical documentation on our Web site at: http://www.vmware.com/support/ The VMware Web site also provides the latest product updates. If you have comments about this documentation, submit your feedback to: [email protected] © 2007–2009 VMware, Inc. All rights reserved. This product is protected by U.S. and international copyright and intellectual property laws. VMware products are covered by one or more patents listed at http://www.vmware.com/go/patents. VMware, the VMware “boxes” logo and design, Virtual SMP and VMotion are registered trademarks or trademarks of VMware, Inc. in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies. VMware, Inc. 3401 Hillview Ave. Palo Alto, CA 94304 www.vmware.com 2 VMware, Inc. Contents About This Book 7 1 Using ESX Server with a Storage Area Network 11 Understanding Virtualization 12 Network Virtualization 12 Storage Virtualization 12 Storage Area Network Concepts 15 Ports 16 Multipathing and Path Failover 17 Storage System Types 17 Target Compared to LUN Representations 17 iSCSI Naming Conventions 19 Overview of Using ESX Server with a SAN 20 Benefits of Using ESX Server with a SAN 20 Use Cases 21 Finding SAN Configuration Information 21 Basics of Using SAN Storage Systems with an ESX Server 22 Network Configuration and Authentication 22 Sharing a VMFS Across ESX Servers 22 Metadata Updates 24 Volume Display and Rescan 24 Levels of Indirection 24 Data Access: VMFS or RDM 25 Third‐Party Management Applications 26 Discovery, Authentication, and Access Control 26 Error Correction 27 Understanding VMFS and SAN Storage Choices 27 Choosing Larger or Smaller LUNs 27 Making LUN Decisions 28 Tips for Making LUN Decisions 29 VMware, Inc.
    [Show full text]
  • Fibre Channel Solution Guide
    Fibre Channel Solutions Guide 2019 fibrechannel.org FIBRE CHANNEL Powering the next generation private, public, and hybrid cloud storage networks ABOUT THE FCIA The Fibre Channel Industry Association (FCIA) is a non-profit international organization whose sole purpose is to be the independent technology and marketing voice of the Fibre Channel industry. We are committed to helping member organizations promote and position Fibre Channel, and to providing a focal point for Fibre Channel information, standards advocacy, and education. CONTACT THE FCIA For more information: www.fibrechannel.org • [email protected] TABLE OF CONTENTS Foreword .........................................................................................3 FCIA President Introduction.............................................................4 The State of Fibre Channel by Storage Switzerland .......................6 Fibre Channel New Technologies: FC-NVMe-2 ............................... 7 The 2019 Fibre Channel Roadmap ................................................. 8 Fibre Channel’s Future is Bright in Media and Entertainment ......10 Securing Fibre Channel SANs with End-to-End Encryption ..........12 FOREWORD By Rupin Mohan, FCIA Marketing Chairman; Director R&D and CTO, Hewlett-Packard Enterprise It’s 2019, and Fibre Channel continues to remain the premier storage fabric connectivity protocol in today’s data centers. Fibre Channel is deployed by thousands of customers in their data centers around the world and 80–90% of all All-Flash storage arrays are connected to servers via Fibre Channel. Customers have recently made a considerable investment in Gen 6 (32GFC), and given the 4-5-year depreciation cycle, this equipment will continue to run critical business applications requiring reliable, fast and scalable storage infrastructure. The NVMe over Fibre Channel (FC-NVMe) standard is published, and we see products being announced and released in the market across the board.
    [Show full text]
  • Oce14000 10Gbe and 40Gbe Converged Network Adapters And
    CONNECTCONNECT - DATA - DATA SHEET SHEET OCe14000OCe14000 10GbE 10Gb andand 40GbE40Gb ConvergedEthernet Network Network Adapters Adapters High Performance Networking for Enterprise Virtualization and the Cloud High Performance Networking for Enterprise Virtualization and the Cloud OneConnectOneConnect OCe14000 OCe14000 Family Family Overview Key benefits As theOverview fourth generation of the Emulex OneConnect product line, the OCe14000 Key benefits As the fourth generation of the Emulex OneConnect® product line, the OCe14000 n Maximizes server hardware ROI with high virtual family of Converged Network Adapters (CNAs) provides high performance 10Gb n Maximizes server hardware ROI with high family of Ethernet network adapters provides high performance 10Gb Ethernet machine density Ethernet (10GbE) and 40GbE connectivity delivering multiple benefits for the virtual machine density (10GbE) and 40GbE connectivity delivering multiple benefits for the enterprise enterprise cloud, including: n Simplifies deployment of secure, scalable multi- cloud, including: tenantn cloudSimplifies infrastructures deployment of secure, scalable multi- n Increasing data center IT agility and scalability through deployment of a secure n Increasing data center IT agility and scalability through deployment of a secure tenant cloud infrastructures multi-tenant cloud n multi-tenant cloud Minimizes TCO through deployment of heterogeneousn Accelerates workloads applications on Converged performance n Driving scalability and flexibility in converged infrastructures
    [Show full text]
  • Feature-Rich and Fast SCSI Target with CTL and ZFS
    Feature-rich and fast SCSI target with CTL and ZFS Alexander Motin <[email protected]> iXsystems, Inc. RuBSD'2014 CTL – CAM Target Layer Frontends Backends isp0 FC CAM target device CAM SCSI CAM SIM initiator block zvol CTL core ... file TCP ICL iSCSI iSCSI target ramdisk /dev/zero offload CTL functional improvements ... for intelligent performance ●I/O optimization for storage specifics ●Thin-/Resource-provisioning ●I/O offload CTL functional improvements Basic SCSI disk (CTL in early 2014): ●READ CAPACITY(10) ● Get block size and number of blocks ●READ ● Read range of blocks ●WRITE ● Write range of blocks # diskinfo -v /dev/da0 /dev/da0 512 # sectorsize 107374182400 # mediasize in bytes (100G) 209715200 # mediasize in sectors CTL functional improvements Advanced Format (512e) SCSI disks: ●READ CAPACITY(16) ● Get physical block size and offset # diskinfo -v /dev/da0 /dev/da0 512 # sectorsize 107374182400 # mediasize in bytes (100G) 209715200 # mediasize in sectors 8192 # stripesize 0 # stripeoffset CTL functional improvements Basic thin-provisioned disks: ●Logical Block Provisioning VPD VAAI TP Reporting ● Get Supported UNMAP commands ●Block Limits VPD page ● Get UNMAP block size ● Get UNMAP parameters limitations ●WRITE SAME with UNMAP ● Unmap sequential range of blocks ●UNMAP VAAI Unmap ● Unmap arbitrary list of blocks ●Proper overflow error reporting VAAI TP Stun CTL functional improvements Featured thin-provisioned disk: ●GET LBA STATUS ● Get provisioning status of specific block(s) Windows defrag CTL functional improvements Featured
    [Show full text]
  • The Rise & Development of Illumos
    Fork Yeah! The Rise & Development of illumos Bryan Cantrill VP, Engineering [email protected] @bcantrill WTF is illumos? • An open source descendant of OpenSolaris • ...which itself was a branch of Solaris Nevada • ...which was the name of the release after Solaris 10 • ...and was open but is now closed • ...and is itself a descendant of Solaris 2.x • ...but it can all be called “SunOS 5.x” • ...but not “SunOS 4.x” — thatʼs different • Letʼs start at (or rather, near) the beginning... SunOS: A peopleʼs history • In the early 1990s, after a painful transition to Solaris, much of the SunOS 4.x engineering talent had left • Problems compounded by the adoption of an immature SCM, the Network Software Environment (NSE) • The engineers revolted: Larry McVoy developed a much simpler variant of NSE called NSElite (ancestor to git) • Using NSElite (and later, TeamWare), Roger Faulkner, Tim Marsland, Joe Kowalski and Jeff Bonwick led a sufficiently parallelized development effort to produce Solaris 2.3, “the first version that worked” • ...but with Solaris 2.4, management took over day-to- day operations of the release, and quality slipped again Solaris 2.5: Do or die • Solaris 2.5 absolutely had to get it right — Sun had new hardware, the UltraSPARC-I, that depended on it • To assure quality, the engineers “took over,” with Bonwick installed as the gatekeeper • Bonwick granted authority to “rip it out if itʼs broken" — an early BDFL model, and a template for later generations of engineering leadership • Solaris 2.5 shipped on schedule and at quality
    [Show full text]
  • Infiniband Technology Overview
    InfiniBand Technology Overview Dror Goldenberg, Mellanox Technologies SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this material in presentations and literature under the following conditions: Any slide or slides used must be reproduced without modification The SNIA must be acknowledged as source of any material used in the body of any document containing material from these presentations. This presentation is a project of the SNIA Education Committee. InfiniBand Technology Overview 2 © 2008 Storage Networking Industry Association. All Rights Reserved. Abstract InfiniBand Technology Overview The InfiniBand architecture brings fabric consolidation to the data center. Storage networking can concurrently run with clustering, communication and management fabrics over the same infrastructure, preserving the behavior of multiple fabrics. The tutorial provides an overview of the InfiniBand architecture including discussion of High Speed – Low Latency, Channel I/O, QoS scheduling, partitioning, high availability and protocol offload. InfiniBand based storage protocols, iSER (iSCSI RDMA Protocol), NFS over RDMA and SCSI RDMA Protocol (SRP), are introduced and compared with alternative storage protocols, such as iSCSI and FCP. The tutorial further enumerates value-add features that the InfiniBand brings to clustered storage, such as atomic operations and end to end data integrity. Learning Objectives: Understand the InfiniBand architecture and feature set. Understand the benefits of InfiniBand for networked storage. Understand the standard InfiniBand storage protocols. InfiniBand Technology Overview 3 © 2008 Storage Networking Industry Association. All Rights Reserved. Agenda Motivation and General Overview Protocol Stack Layers Storage Protocols over InfiniBand Benefits InfiniBand Technology Overview 4 © 2008 Storage Networking Industry Association.
    [Show full text]
  • Using Oracle ZFS Storage Appliance Fibre Channel and Iscsi with Symantec Storage Foundation/DMP Quickstart Guide
    September 2014 Using Oracle ZFS Storage Appliance Fibre Channel and iSCSI with Symantec Storage Foundation/DMP Quickstart Guide Using Oracle ZFS Storage Appliance Fibre Channel and iSCSI with Symantec Storage Foundation / DMP Overview ............................................................................................. 3 Hardware and Software Requirements ............................................... 3 Configuring Oracle Solaris with Symantec Storage Foundation for Fibre Channel and iSCSI ............................................................... 4 Configuring Linux with Symantec Storage Foundation for Fibre Channel ...................................................................................... 5 Setting the Red Hat Compatible Kernel as Default ......................... 5 Loading the scsi_dh_alua Module During Boot on Linux ........... 5 Creating a UDEV Rule on Linux ...................................................... 6 Installing Required Storage Foundation Patches ................................ 6 Required Storage Foundation 5.x/6.x Patches ............................... 6 Required Storage Foundation Patch for Oracle Solaris and Red Hat Linux Operating Systems ......................................................... 6 Required Storage Foundation Patch for Microsoft Windows Operating Systems ................................................................................. 7 Required Storage Foundation 5.x/6.x ASL/APM Package .............. 7 Required Storage Foundation 5.x/6.x DMP Parameter Settings ....
    [Show full text]
  • Effective Data Backup System Using Storage Area Network Solution
    Effective Data Backup System Using Storage Area Network Solution Ume, L.E. Department of Computer Science, Ebonyi State University, Abakaliki, Ebonyi State, Nigeria Correspondence e-mail: [email protected] Abstract One of the most crucial benefits of the computer system is its ability to manage data send to it for processing. An aspect of data management that all other aspects hinge upon is data storage and retrieval. Data loss has rendered many firms bankrupt. The primary cause of data loss is lack or non- existent of data backup. Storage Area Network Solution (SANS) is internet-based software which will collect clients data and host them in several locations to forestall data loss in case of disaster in one location. The researcher used adobe Dreamweaver (CSC3) embedded with PHP incorporated with MySQL database technology to develop the application. The objectives of the research were realized. Keywords: Backup, Storage area network, Data, Effective and Data loss 1.0 Introduction Storage Area Network (SAN) is a high- (NAS) systems. SAN evolved from the speed sub-network of shared storage concept of taking storage devices and devices. A storage device is a machine that therefore storage traffic, off the LAN and contains nothing but a disk or disks for creating a separate back-end network storing data. A SAN’s architecture works in designed specifically for data. This is a a way that makes all storage devices contrast to the use of a traditional LAN for available to all servers on a LAN or WAN. providing a connection for server-storage, a As more storage devices are added to a strategy that limits overall network SAN, they too will be accessible from any bandwidth.
    [Show full text]