Fibre Channel Over Ethernet (Fcoe) Data Center Bridging (DCB) Concepts and Protocols
Total Page:16
File Type:pdf, Size:1020Kb
Fibre Channel over Ethernet (FCoE) Data Center Bridging (DCB) Concepts and Protocols Version 15 • Fibre Channel over Ethernet (FCoE) and Ethernet Basics • Storage in an FCoE Environment • EMC RecoverPoint and EMC Celerra MPFS as Solutions • Troubleshooting Basic FCoE and CEE Problems Mark Lippitt Erik Smith David Hughes Copyright © 2008–2015 EMC Corporation. All rights reserved. EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS IS.” EMC CORPORATION MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. EMC2, EMC, and the EMC logo are registered trademarks or trademarks of EMC Corporation in the United State and other countries. All other trademarks used herein are the property of their respective owners. For the most up-to-date regulator document for your product line, go to EMC Online Support (https://support.emc.com). Part number H6290.19 2 Fibre Channel over Ethernet (FCoE) Concepts and Protocols TechBook Contents Chapter 1 Introduction to Fibre Channel over Ethernet Introduction ....................................................................................... 20 History................................................................................................ 22 Benefits ............................................................................................... 24 Terminology....................................................................................... 25 Management tools............................................................................. 27 Cable management recommendations .......................................... 28 Enabling technologies ...................................................................... 29 Converged Network Adapter...................................................29 Fibre Channel Forwarder ..........................................................30 FIP Snooping Bridge...................................................................30 Data Center Bridging (DCB) .....................................................38 Priority Flow Control and PAUSE ...........................................39 Data Center Bridging eXchange ...............................................40 Protocols............................................................................................. 42 FCoE encapsulation....................................................................42 FCoE Initialization Protocol (FIP) ............................................44 Physical connectivity options for FCoE......................................... 58 Optical (fiber) cable ....................................................................58 Twinax (copper) cable................................................................59 Logical connectivity options ........................................................... 61 FCoE fabrics.................................................................................61 Chapter 2 Ethernet Basics Ethernet history................................................................................. 66 Communication modes of operation .......................................66 Ethernet devices..........................................................................69 Auto-negotiation.........................................................................70 Gigabit Ethernet..........................................................................71 Fibre Channel over Ethernet (FCoE) Concepts and Protocols TechBook 3 Contents 10GBaseT .....................................................................................71 40GbE technology.......................................................................72 Protocols............................................................................................. 75 OSI networking protocol ...........................................................75 Ethernet frame-based protocol .................................................80 Ethernet switching concepts ........................................................... 86 Fibre Channel switching versus Ethernet bridging...............86 Gratuitous ARP...........................................................................89 Unicast flood ...............................................................................90 Spanning Tree Protocol (STP)...................................................92 Link Aggregation......................................................................105 Access Control Lists .................................................................112 Ethernet fabric................................................................................. 122 Ethernet fabric overview .........................................................122 Transparent Interconnect of Lots of Links (TRILL).............123 Brocade VCS Fabric technology .............................................123 VLAN ............................................................................................... 133 Description ................................................................................133 History........................................................................................134 802.1Q — VLAN tagging.........................................................135 Chapter 3 EMC Storage in an FCoE Environment FCoE connectivity........................................................................... 142 EMC storage in an FCoE environment........................................ 143 VMAX.........................................................................................143 VNX series .................................................................................145 CLARiiON CX4.........................................................................147 Prior to installing FCoE I/O module........................................... 149 VMAX.........................................................................................149 VNX and CX4............................................................................149 Supported topologies for FCoE storage connectivity................ 150 FCoE storage connectivity best practices and limitations ........ 152 Best practices .............................................................................152 Limitations.................................................................................152 FCoE storage connectivity requirements and support.............. 153 Supported switches ..................................................................153 Cabling support ........................................................................153 Chapter 4 Solutions in an FCoE Environment EMC RecoverPoint with Fibre Channel over Ethernet ............. 156 RecoverPoint replication in an FCoE environment.............156 4 Fibre Channel over Ethernet (FCoE) Concepts and Protocols TechBook Contents Continuous remote replication using a VNX series or CLARiiON splitter ....................................................................157 Continuous data protection using a host-based splitter .....158 Concurrent local and remote data protection using an intelligent fabric-based splitter ...............................................159 Related documentation ............................................................161 EMC Celerra Multi-Path File System in an FCoE environment..................................................................................... 162 Introduction ...............................................................................162 EMC Celerra Multi-Path File System (MPFS).......................164 Setting up MPFS in an FCoE environment on a Linux host..............................................................................................169 MPFS in an FCoE environment using Cisco Nexus switches with redundant path ................................................172 Setting up MPFS in an FCoE environment on a Windows 2003 SP2 host ...........................................................173 Chapter 5 Troubleshooting Basic FCoE and CEE Problems and Case Studies Troubleshooting basic FCoE and CEE problems ........................ 180 Process flow ...............................................................................180 Documentation..........................................................................182 Creating questions ....................................................................182 Creating worksheets.................................................................183 Log messages.............................................................................184 OSI layers ...................................................................................186 FC layers.....................................................................................187 Connectivity problems .............................................................188 Physical interface status...........................................................190 Interface errors ..........................................................................193 MAC layer..................................................................................197 Understanding FCoE