Data Center High Availability Clusters Design Guide
Total Page:16
File Type:pdf, Size:1020Kb
Data Center High Availability Clusters Design Guide Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100 Customer Order Number: Text Part Number: OL-12518-01 THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS. THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY. The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain version of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California. NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE. IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. CCSP,CCVP, CCVP, the Cisco the Cisco Logo, Square and Bridgethe Cisco logo, Square Follow BridgeMe Browsing, logo are and trademarks StackWise are of trademarksCisco Systems, of Cisco Inc.; Systems, Changing Inc.; Changing the Way theWe Way Work, We Work,Live, PLive,lay, Play,and Learnand Learn, is a andservice mark of Cisco Systems, iQuickInc.; and Study Access are service Registrar, marks of Aironet, Cisco Systems, BPX, Inc.;Catalyst, and Access CCDA, Registrar, CCDP, Aironet, CCIE, BPX, CCIP, Catalyst, CCNA, CCDA, CCNP, CCDP, CCSP,CCIE, CCIP, Cisco, CC theNA, CiscoCCNP, CertifiedCisco, the CiscoIntern Certifiedetwork Expert logo, Cisco IOS, Cisco Internetwork Expert logo, Cisco IOS, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Enterprise/Solver, EtherChannel, EtherFast, Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Enterprise/Solver, EtherChannel, EtherFast, EtherSwitch, Fast Step, Follow Me Browsing, EtherSwitch, Fast Step, FormShare, GigaDrive, GigaStack, HomeLink, Internet Quotient, IOS, IP/TV, iQ Expertise, the iQ logo, iQ Net Readiness Scorecard, LightStream, Linksys,FormShare, MeetingPlace, GigaDrive, MGX, GigaStack, the Networkers HomeLink, logo, Networking Internet Academy, Quotient, Network IOS, Registrar, iPhone, Packet IP/TV,, PIX, iQ Post-Routing, Expertise, Pre-Routing, the iQ logo, ProConnect, iQ Net RateMUX,Readiness ScriptShare, Scorecard, iQuick Study, LightStream, SlideCast,Linksys, SMARTnet,MeetingPlace, The FastestMGX, Way Networking to Increase YourAcademy, Internet Network Quotient, andRegistrar, TransPath Packet are registered, PIX, ProConnect, trademarks of CiscoRateMUX, Systems, ScriptShare, Inc. and/or its SlideCast,affiliates in theSMARTnet, United States StackWise, The Fastest Way andto Increase certain other Your countries. Internet Quotient, and TransPath are registered trademarks of Cisco Systems, Inc. and/or its affiliates in the United States and certain other countries. All otherother trademarks trademarks mentioned mentioned in this indocument this document or Website or are Website the property are of the their property respective of owners. their respectiveThe use of the owners. word par Thetner usedoes ofnot the imply word a partnership partner doesrelationship not imply a partnership relationship between Cisco Cisco and and any any other other company. company. (0601R) (0612R) Data Center High Availability Clusters Design Guide © 2006 Cisco Systems, Inc. All rights reserved. CONTENTS Preface i Document Purpose i Intended Audience i Document Organization i CHAPTER 1 Data Center High Availability Clusters 1 High Availability Clusters Overview 1 HA Clusters Basics 4 HA Clusters in Server Farms 5 Applications 6 Concept of Group 7 LAN Communication 9 Virtual IP Address 9 Public and Private Interface 10 Heartbeats 11 Layer 2 or Layer 3 Connectivity 11 Disk Considerations 12 Shared Disk 13 Quorum Concept 13 Network Design Considerations 16 Routing and Switching Design 16 Importance of the Private Link 17 NIC Teaming 18 Storage Area Network Design 21 Complete Design 22 CHAPTER 2 Data Center Transport Technologies 1 Redundancy and Client Protection Technologies 1 Dark Fiber 2 Pluggable Optics Characteristics 3 CWDM 4 DWDM 5 Maximum Distances and BB Credits Considerations 9 CWDM versus DWDM 10 Data Center High Availability Clusters Design Guide OL-12518-01 i Contents Fiber Choice 11 SONET/SDH 12 SONET/SDH Basics 12 SONET UPSR and BLSR 13 Ethernet Over SONET 14 Service Provider Topologies and Enterprise Connectivity 15 Resilient Packet Ring/Dynamic Packet Transport 17 Spatial Reuse Protocol 17 RPR and Ethernet Bridging with ML-series Cards on a SONET Network 18 Metro Offerings 18 CHAPTER 3 Geoclusters 1 Geoclusters Overview 1 Replication and Mirroring 3 Geocluster Functional Overview 5 Geographic Cluster Performance Considerations 7 Server Performance Considerations 8 Disk Performance Considerations 9 Transport Bandwidth Impact on the Application Performance 10 Distance Impact on the Application Throughput 12 Benefits of Cisco FC-WA 13 Distance Impact on the Application IOPS 17 Asynchronous Versus Synchronous Replication 19 Read/Write Ratio 21 Transport Topologies 21 Two Sites 21 Aggregating or Separating SAN and LAN Transport 21 Common Topologies 22 CWDM and DWDM Topologies 22 SONET Topologies 23 Multiprotocol Label Switching Topologies 24 Three or More Sites 25 Hub-and-Spoke and Ring Topologies with CWDM 25 Hub-and-Spoke and Ring Topologies with DWDM 29 Shared Ring with SRP/RPR 32 Virtual Private LAN Service 33 Geocluster Design Models 34 Campus Cluster 34 Metro Cluster 37 Data Center High Availability Clusters Design Guide ii OL-12518-01 Contents Regional Cluster 39 Continental Cluster 40 Storage Design Considerations 43 Manual Disk Failover and Failback 43 Software-Assisted Disk Failover 47 Network Design Considerations 50 LAN Extension and Redundancy 50 EtherChannels and Spanning Tree 51 Public and Private Links 52 Routing Design 52 Local Area Mobility 55 CHAPTER 4 FCIP over IP/MPLS Core 1 Overview 1 Typical Customer Requirements 2 Compression 3 Compression Support in Cisco MDS 3 Security 5 Cisco Encryption Solutions 6 Write Acceleration 7 Using FCIP Tape Acceleration 7 FCIP 8 TCP Operations 8 TCP Parameters 8 Customer Premises Equipment (CPE)—Cisco 9216/9216i and Cisco 7200 10 Cisco 9216 10 Cisco MDS 9216i 11 Cisco 7200 12 CPE Selection—Choosing between the 9216i and 7200 12 QoS Requirements in FCIP 13 Applications 14 Synchronous Replication 14 Asynchronous Replication 14 Service Offerings over FCIP 15 Service Offering Scenario A—Disaster Recovery 15 Service Offering Scenario B—Connecting Multiple Sites 16 Service Offering Scenario C—Host-based Mirroring 17 MPLS VPN Core 18 Using VRF VPNs 19 Data Center High Availability Clusters Design Guide OL-12518-01 iii Contents Testing Scenarios and Results 20 Test Objectives 20 Lab Setup and Topology 20 VPN VRF—Specific Configurations 21 MP BGP Configuration—PE1 21 Gigabit Ethernet Interface Configuration—PE1 22 VRF Configuration—PE1 22 MP BGP Configuration—PE2 22 Gigabit Ethernet Interface Configuration—PE2 22 VRF Configuration—PE2 23 Scenario 1—MDS 9216i Connection to GSR MPLS Core 23 Configuring TCP Parameters on CPE (Cisco MDS 9216) 24 Configuring the MTU 24 Scenario 2—Latency Across the GSR MPLS Core 25 Scenario 3—Cisco MDS 9216i Connection to Cisco 7500 (PE)/GSR (P) 26 Scenario 4—Impact of Failover in the Core 27 Scenario 5—Impact of Core Performance 27 Scenario 6—Impact of Compression on CPE (Cisco 9216i) Performance 28 Application Requirements 29 Remote Tape-Backup Applications 30 Conclusion 30 CHAPTER 5 Extended Ethernet Segments over the WAN/MAN using EoMPLS 1 Introduction 1 Hardware Requirements 1 Enterprise Infrastructure 2 EoMPLS Designs for Data Center Interconnectivity 3 EoMPLS Termination Options 4 MPLS Technology Overview 8 EoMPLS Design and Configuration 11 EoMPLS Overview 11 EoMPLS—MTU Computation 15 Core MTU 15 Edge MTU 17 EoMPLS Configuration 18 Using Core IGP 18 Set MPLS Globally 19 Enable MPLS on Core Links 19 Verify MPLS Connectivity 19 Data Center High Availability Clusters Design Guide iv OL-12518-01 Contents Create EoMPLS Pseudowires 20 Verify EoMPLS Pseudowires 20 Optimize MPLS Convergence 20 Backoff Algorithm 21 Carrier Delay 21 BFD (Bi-Directional Failure Detection) 22 Improving Convergence Using Fast Reroute 24 High Availability for Extended Layer 2 Networks 27 EoMPLS Port-based Xconnect Redundancy with Multiple Spanning Tree Domains 28 IST Everywhere 28 Interaction between IST and MST Regions 29 Configuration 32 EoMPLS Port-based Xconnect Redundancy