Front cover Storage and Network Convergence Using FCoE and iSCSI Learn how to improve IT service performance and availability Simplify your storage and network infrastructure See how to reduce data center network costs Sangam Racherla Silvio Erdenberger Harish Rajagopal Kai Ruth ibm.com/redbooks International Technical Support Organization Storage and Network Convergence Using FCoE and iSCSI January 2014 SG24-7986-01 Note: Before using this information and the product it supports, read the information in “Notices” on page xi. Second Edition (January 2014) This edition applies to the latest supported Converged Network Adapters and Switches in the IBM System Networking Portfolio of products. © Copyright International Business Machines Corporation 2012, 2014. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . xi Trademarks . xii Preface . xiii Authors. xiii Now you can become a published author, too! . .xv Comments welcome. .xv Stay connected to IBM Redbooks . xvi Part 1. Overview of storage and network convergence . 1 Chapter 1. Introduction to convergence . 3 1.1 What convergence is. 4 1.1.1 Calling it what it is . 4 1.2 Vision of convergence in data centers . 4 1.3 The interest in convergence now . 5 1.4 Fibre Channel SANs today . 5 1.5 Ethernet-based storage today. 6 1.6 Benefits of convergence in storage and network . 7 1.7 Challenge of convergence . 8 1.8 Conclusion . 10 Chapter 2. Fibre Channel over Ethernet . 11 2.1 Background: Data Center Bridging . 12 2.1.1 Priority-based Flow Control: IEEE 802.1Qbb . 12 2.1.2 Enhanced Transmission Selection: IEEE 802.1Qaz. 13 2.1.3 Data Center Bridging Capabilities Exchange–IEEE 802.1Qaz . 14 2.1.4 Congestion Notification: IEEE 802.1Qau . 14 2.2 Standards work related to FCoE . 15 2.2.1 Transparent Interconnection of Lots of Links . 15 2.2.2 Shortest Path Bridging: IEEE 802.1aq . 15 2.3 FCoE concepts . 16 2.3.1 FCoE protocol stack . 16 2.3.2 Topology . 18 2.3.3 FCoE Initialization Protocol and snooping bridges . 20 2.3.4 MAC addresses used by end devices. 21 2.3.5 FCFs, Fabric Mode, and NPIV . 21 2.3.6 Distributed FCF under development . 23 2.4 Technology comparison: FCoE with iSCSI . 26 2.4.1 Similarities. 26 2.4.2 Differences . 26 2.5 Summary of technology used . 27 2.5.1 Initial cost at purchase . 27 2.5.2 Time to deploy . 27 2.5.3 Necessary skills . 28 2.6 Conclusion . 28 Chapter 3. Internet Small Computer System Interface . 29 3.1 Introduction to iSCSI . 30 © Copyright IBM Corp. 2012, 2014. All rights reserved. iii 3.1.1 iSCSI overview . 30 3.1.2 iSCSI protocol in depth . 31 3.2 iSCSI initiators. 35 3.2.1 Software-only solutions. 35 3.2.2 Software with hardware assistance. 36 3.2.3 Hardware-only solutions . 36 3.3 Performance considerations . 37 3.3.1 Jumbo frames . 37 3.3.2 Prioritization and bandwidth allocation . 38 3.4 Multipathing with iSCSI . 38 3.4.1 IEEE 802.3ad Link Aggregation Control Protocol and Etherchannel . 38 3.4.2 Active-Active multipathing. 39 3.4.3 Multiconnection sessions . 39 Chapter 4. IBM products that support FCoE and iSCSI. 41 4.1 Converged Network Adapters (CNAs) . 42 4.1.1 IBM Flex System. 42 4.1.2 BladeCenter . 43 4.1.3 IBM System x and IBM Power Systems . 45 4.2 Switches . 47 4.2.1 Flex Chassis . 47 4.2.2 BladeCenter . 49 4.2.3 Top-of-Rack (ToR) / End-of-Row (EoR) . 53 4.3 Storage systems . 57 4.3.1 IBM SAN Volume Controller . 57 4.3.2 IBM Storwize family. 58 4.3.3 IBM Flex System V7000 Storage Node . 61 4.3.4 IBM XIV Storage System . 61 4.3.5 IBM System Storage.