Extending the Compactpci Bus Architecture with Infiniband by Chris Eddington

Total Page:16

File Type:pdf, Size:1020Kb

Extending the Compactpci Bus Architecture with Infiniband by Chris Eddington TECHNOLOGY FEATURE Extending the CompactPCI bus architecture with InfiniBand By Chris Eddington InfiniBand technology is a powerful providing chip-to-chip, board-to-board, I Management infrastructure support- new architecture designed to support and chassis-to-chassis interconnects ing fault tolerance, failover, and hot I/O connectivity for advanced Internet based on industry standards. But is it swap functions data center and enterprise infrastruc- really suited for all of these applica- ture deployment. The InfiniBand archi- tions? Is it better than PCI? Does it meet This overview will briefly cover these tecture was developed to overcome the the needs of the future? And if so, how InfiniBand features, keeping in mind I/O bottleneck in today’s server archi- does it assist in the transition? These the application for embedded systems, tectures and is broadly supported by are important questions that system ven- “lightweight” implementations, and the server, storage, and communica- dors must consider. Here is a look at migration from PCI. Although the archi- tions industries. Although its primary InfiniBand adoption in the server mar- tecture has a rich feature set, it is flexible motivation is for next-generation ket and the impact it will have on and has many options that may not be server I/O, InfiniBand will extend its CompactPCI. applicable to all designs. The reader may benefits to the embedded computing consult the references for more details. and telecommunications industries. InfiniBand architecture overview For the first time, a high volume, InfiniBand is a switch-based point- Physical layer industry standard I/O interconnect to-point interconnect architecture. Each The InfiniBand specification defines a is available that extends the role of individual link is based on a four-wire very flexible and scalable physical layer traditional backplane and board buses 2.5 Gbits/sec bidirectional connection that provides room for further growth beyond the physical connector for with a flexible choice of media and scal- in speed and media. These features additional functionality. And this able link speeds. The architecture de- include: technology is designed from the ground fines a layered hardware protocol (phy- up for RAS: reliability, availability, sical, link, network, transport layers) as I Currently defined signal rates of and serviceability. well as a software layer to support fabric 2.5 Gbits/sec(1X), 10 Gbits/sec(4X), management and low latency communi- 30 Gbits/sec(12X) About seven years ago, the embedded cation between devices. Some of the I Low wire count: 4, 16, 48 wires computing and telecommunication in- key features are: for 1X, 4X, 12X dustry chose a new interconnect archi- I Embedded clock and control tecture as the basis of its technology, the I Scalable link speeds starting at I Scalable clock frequency PCI bus. Researchers evaluated and 2.5 Gbits/sec over PCB, copper or I 8B/10B encoding chose this architecture for several rea- fiber cable I Media: copper (for economy) and sons including bandwidth, interop- I Packet-based, switched optical (for distance) erability with a variety of platforms/ communication with data integrity processors, software/application devel- and flow control InfiniBand has defined the electrical opment, and the economies of choosing I Quality of Service (QoS) and mechanical characteristics for sev- a PC-based solution. I Flexible hardware transport eral different media listed in Table 1. mechanisms As the industry again begins to evaluate I Optimized software interface and *InfiniBand defines a backplane con- new switched fabric architectures that Remote Direct Memory Access nector for its chassis specification. How- will meet its needs for years to come, (RDMA) ever, there are many available connec- systems vendors must look at technolo- gies that provide these attributes and Media Transceiver Connector Distance more, while determining how best to Board and Backplane Differential Pair SpeedPac* 20-30 Inches* preserve the investments made with Copper Cable Differential Pair HSSDC2 17 Meters PCI. Multimode Fiber SW (850nm) Fiber LC Duplex 300 Meters Clearly InfiniBand is the logical succes- Singlemode Fiber LW (1350nm) Fiber LC Duplex 10 Kilometers sor to the PCI bus in the computing server architecture and it is unique in Table 1 Copyright 2001 CompactPCI Systems Reprinted from CompactPCI Systems / September 2001 tors that meet the cross talk and imped- Packet switching is used to protect against buffer over- ance requirements of the InfiniBand InfiniBand has defined a flexible set of flow at an endpoint connection that may physical layer. Distance depends on packet forwarding features that allow be multiple hops away. Each receiving other factors such as PCB material, lay- developers to tune an InfiniBand SAN end of a link/connection supplies cred- out practices, use of repeaters, etc. for different system requirements. its to the sending device to specify the These include: amount of data that can be reliably InfiniBand network components received. Data is not transmitted unless An InfiniBand System Area Network I Variable size packet size up to a the receiver advertises credits indicating (SAN) has four basic system compo- maximum (defined as maximum receive buffer space is available. Credit nents that interconnect using InfiniBand transfer unit or MTU) passing between each device is built links as shown in Figure 1. These are: I Choice of MTU size: 256, 512, 1K, into the link and connection protocols to 2K, and 4K bytes guarantee reliable flow control opera- I Host Channel Adapter (HCA) – I A minimum Layer 2 packet header tion. Link-level flow control is handled terminates connection for a host is defined for local switching (LRH) on a per Virtual Lane (VL) basis (dis- node. It includes hardware features I Optional Layer 3 header for global cussed next). to support high performance mem- routing (GRH) ory transfers into CPU memory. I Multicast support Quality of service I Target Channel Adapter (TCA) – I Variant and Invariant Checksums InfiniBand supports QoS through VLs. terminates connection for a periph- (VCRC and ICRC) for data These VLs are separate logical commu- eral node. It defines a subset of integrity nication links that share a single physi- HCA functionality and can be opti- cal link. Each VL has its own buffer and mized for embedded applications. The choice of MTU sizes enables the flow control mechanism for each port I Switch – handles link layer packet control of system characteristics such as in a switch. InfiniBand allows up to 15 forwarding. A switch does not con- packet jitter, encapsulation overhead, general purpose VLs to be supported, sume or generate packets other than and latency characteristics, aiding in the plus one additional lane dedicated for management packets. development of multi-protocol systems. management traffic. I Router – routes packets between The ability to omit global routing infor- subnets. InfiniBand routers divide mation for local subnet destinations QoS is realized at the link layer by iso- InfiniBand networks into subnets reduces the overhead of local communi- lating traffic congestion to individual and do not consume or generate cation. The VCRC is recalculated at VLs. Here’s a simple example of QoS packets other than management each hop and the ICRC is calculated at involving two types of traffic on the packets. the packet destination providing link same fabric: non-real-time data such as and end-to-end data integrity. IP traffic or storage backup sessions is A subnet manager is required to run on coupled with real-time traffic for voice each subnet and handles device and Flow control or multi-media. The system manager connection management tasks. A subnet InfiniBand defines two levels of credit- can assign each type of traffic to a dif- manager may run on a host or embedded based flow control to manage conges- ferent VL, such as VL1 for data and in switches and routers. All system com- tion: link-level flow control and end- VL2 for voice, and give higher priority ponents must include a Subnet Manage- to-end flow control. Link-level flow to the voice traffic. When data traffic ment Agent (SMA) required for handling control applies back pressure to traffic becomes congested due to a large file communication with the subnet manager. on a link, while end-to-end flow control transfer, then the VL1 link buffer begins to fill and flow control kicks in to apply back pressure to the data traffic source. Processor Node CPU CPU CPU If a voice packet (VL2) arrives at this CPU CPU CPU HCA Mem HCA time, it will be scheduled ahead of the Mem HCA congested data traffic. Thus, the voice traffic will still move through the fabric Other IB Subnets Switch Switch Switch Router WANs, LANs with minimal latency. Hardware transport Switch Switch InfiniBand defines a set of transport InfiniBand Fabric services that are implemented in the channel adapter hardware. These ser- TCA Storage I/O I/O Subsystem vices provide a reliable, in-order, con- Switch Chassis Switch Chassis Controller Consoles nection-oriented packet delivery system TCA TCA TCA TCA TCA TCA that is highly efficient compared to soft- I/O I/O I/O I/O I/O I/O ware-implemented transport services. Module Module Module IB Module Module Module Drives TCP/IP, for example, provides reliable packet delivery for Ethernet networks Figure 1 via a list of functions that consume pro- Copyright 2001 CompactPCI Systems Reprinted from CompactPCI Systems / September 2001 TECHNOLOGY FEATURE cessing, such as transmitter data-buffer, Transport Service Description VL QoS sliding-window flow control transmis- sion policy, congestion control algo- Reliable Connection Acknowledged – connection oriented Yes rithms, segmentation and re-assembly, Reliable Datagram Acknowledged – multiplexed Yes and checksum calculation. InfiniBand Unreliable Connection Unacknowledged – connection oriented Yes transport services are efficiently de- signed to be implemented in hardware, Unreliable Datagram Unacknowledged – connectionless Yes offering a significant reduction in mes- Raw Datagram Unacknowledged – connectionless Yes sage latency (see Table 2).
Recommended publications
  • What Is It and How We Use It
    Infiniband Overview What is it and how we use it What is Infiniband • Infiniband is a contraction of "Infinite Bandwidth" o can keep bundling links so there is no theoretical limit o Target design goal is to always be faster than the PCI bus. • Infiniband should not be the bottleneck. • Credit based flow control o data is never sent if receiver can not guarantee sufficient buffering What is Infiniband • Infiniband is a switched fabric network o low latency o high throughput o failover • Superset of VIA (Virtual Interface Architecture) o Infiniband o RoCE (RDMA over Converged Ethernet) o iWarp (Internet Wide Area RDMA Protocol) What is Infiniband • Serial traffic is split into incoming and outgoing relative to any port • Currently 5 data rates o Single Data Rate (SDR), 2.5Gbps o Double Data Rate (DDR), 5 Gbps o Quadruple Data Rate (QDR), 10 Gbps o Fourteen Data Rate (FDR), 14.0625 Gbps o Enhanced Data Rate (EDR) 25.78125 Gbps • Links can be bonded together, 1x, 4x, 8x and 12x HDR - High Data Rate NDR - Next Data Rate Infiniband Road Map (Infiniband Trade Association) What is Infiniband • SDR, DDR, and QDR use 8B/10B encoding o 10 bits carry 8 bits of data o data rate is 80% of signal rate • FDR and EDR use 64B/66B encoding o 66 bits carry 64 bits of data Signal Rate Latency SDR 200ns DDR 140ns QDR 100ns Hardware 2 Hardware vendors • Mellanox o bought Voltaire • Intel o bought Qlogic Infiniband business unit Need to standardize hardware. Mellanox and Qlogic cards work in different ways.
    [Show full text]
  • FICON Native Implementation and Reference Guide
    Front cover FICON Native Implementation and Reference Guide Architecture, terminology, and topology concepts Planning, implemention, and migration guidance Realistic examples and scenarios Bill White JongHak Kim Manfred Lindenau Ken Trowell ibm.com/redbooks International Technical Support Organization FICON Native Implementation and Reference Guide October 2002 SG24-6266-01 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. Second Edition (October 2002) This edition applies to FICON channel adaptors installed and running in FICON native (FC) mode in the IBM zSeries procressors (at hardware driver level 3G) and the IBM 9672 Generation 5 and Generation 6 processors (at hardware driver level 26). © Copyright International Business Machines Corporation 2001, 2002. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . vii Trademarks . viii Preface . ix The team that wrote this redbook. ix Become a published author . .x Comments welcome. .x Chapter 1. Overview . 1 1.1 How to use this redbook . 2 1.2 Introduction to FICON . 2 1.3 zSeries and S/390 9672 G5/G6 I/O connectivity. 3 1.4 zSeries and S/390 FICON channel benefits . 5 Chapter 2. FICON topology and terminology . 9 2.1 Basic Fibre Channel terminology . 10 2.2 FICON channel topology. 12 2.2.1 Point-to-point configuration . 14 2.2.2 Switched point-to-point configuration . 15 2.2.3 Cascaded FICON Directors configuration. 16 2.3 Access control. 18 2.4 Fibre Channel and FICON terminology.
    [Show full text]
  • Infiniband Event-Builder Architecture Test-Beds for Full Rate Data
    International Conference on Computing in High Energy and Nuclear Physics (CHEP 2010) IOP Publishing Journal of Physics: Conference Series 331 (2011) 022008 doi:10.1088/1742-6596/331/2/022008 Infiniband Event-Builder Architecture Test-beds for Full Rate Data Acquisition in LHCb Enrico Bonaccorsi and Juan Manuel Caicedo Carvajal and Jean-Christophe Garnier and Guoming Liu and Niko Neufeld and Rainer Schwemmer CERN, 1211 Geneva 23, Switzerland E-mail: [email protected] Abstract. The LHCb Data Acquisition system will be upgraded to address the requirements of a 40 MHz readout of the detector. It is not obvious that a simple scale-up of the current system will be able to meet these requirements. In this work we are therefore re-evaluating various architectures and technologies using a uniform test-bed and software framework. Infiniband is a rather uncommon technology in the domain of High Energy Physics data acquisition. It is currently mainly used in cluster based architectures. It has however interesting features which justify our interest : large bandwidth with low latency, a minimal overhead and a rich protocol suite. An InfiniBand test-bed has been and set-up, and the purpose is to have a software interface between the core software of the event-builder and the software related to the communication protocol. This allows us to run the same event-builder over different technologies for comparisons. We will present the test-bed architectures, and the performance of the different entities of the system, sources and destinations, according to their implementation. These results will be compared with 10 Gigabit Ethernet testbed results.
    [Show full text]
  • Test, Simulation, and Integration of Fibre Channel Networked Systems by Mike Glass Principal Marketing Engineer Data Device Corporation
    Test, Simulation, and Integration of Fibre Channel Networked Systems By Mike Glass Principal Marketing Engineer Data Device Corporation September 2006 Test, Simulation, and Integration Of Fibre Channel Networked Systems Introduction Fibre Channel is a high-speed networking technology deployed on a number of military/aerospace platforms and programs. These include F- 18E/F, F-16, F-35, B1-B, B-2, E-2D, the Apache Longbow and MMH helicopters, and AESA Radar. Applications for Fibre Channel include mission computers, processor and DSP clusters; data storage; video processing, distribution, and displays; sensors such as radar, FLIR, and video; serial backplanes and IFF. Basic characteristics of Fibre Channel include a choice of copper and optical media options; 1 and 2 Gb operation, including auto-speed negotiation; and operation on multiple topologies including point-to-point, arbitrated loop, and switched fabric. In addition, Fibre Channel provides low latency to the single-digit microsecond level; address scalability with a space up to 224 ports; broadcast and multicast operation; unacknowledged and acknowledged classes of service; a means for providing variable quality of service (QoS); and multiple upper layer protocols (ULPs). Test and simulation applications for deployable Fibre Channel networks include the development of board and box-level systems and sub-systems, network integration, production test, and equipment maintenance. For software development and network integration, it’s often necessary to rely on Fibre Channel testers and analyzers to simulate unavailable equipment for traffic generation and monitoring. Some development and integration environments provide demanding requirements for real-time data monitoring, storage, and subsequent offline analysis. For production test and field maintenance, low cost testers are often better-suited than higher-priced analyzers.
    [Show full text]
  • Etsi Gr Ip6 009 V1.1.1 (2017-03)
    ETSI GR IP6 009 V1.1.1 (2017-03) GROUP REPORT IPv6-based Industrial Internet leveraging 6TiSCH technology Disclaimer The present document has been produced and approved by the IPv6 Integration (IP6) ETSI Industry Specification Group (ISG) and represents the views of those members who participated in this ISG. It does not necessarily represent the views of the entire ETSI membership. 2 ETSI GR IP6 009 V1.1.1 (2017-03) Reference DGR/IP6-0009 Keywords 6TiSCH, IPv6, network ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N° 348 623 562 00017 - NAF 742 C Association à but non lucratif enregistrée à la Sous-Préfecture de Grasse (06) N° 7803/88 Important notice The present document can be downloaded from: http://www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment to one of the following services: https://portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI.
    [Show full text]
  • News Letter V7
    Robin MacGillivray, BCS President, SBC West Message to Telecom Consultants Let me start out by wishing each of you a very Happy New Year, with hopes that 2004 will be your most successful year ever! Through your recommendations you have influenced millions of UPDATE dollars in revenue for the SBC family of companies Solutions for Success and it’s my commitment to you to do all we can to continue to earn your trust and confidence in Consultant/Vendor Sales Group 2004. That’s what “Stand & Deliver” is all about. February 2004 It’s a theme we’re using internally to constantly remind ourselves of our promise to you that we will always be the brand you can trust to deliver World-Class products and reliable service to your clients. It’s my personal goal to Stand & Deliver beyond your expectations. We believe the best competitive strategy we have for keeping Douglas Ireland customers is our ability to meet their needs, the first time, on time, SM everytime. There’s probably nothing more critical to the success of SBC FreedomLink Creating Special our business. As we enter a new year, there are a lot of things going National Wi-Fi Hotspot Network on that may directly impact you and your clients. Here are a few: ͷ SBC Internet Services, Inc. is now creating one of the nation’s We’re now offering Long Distance at incredible prices in all 13 states SBC Long Distance serves. largest wireless Internet access networks, commonly known as ͷ We’re offering all sorts of spectacular packages and bundles to Wi-Fi hotspots, under the FreedomLinkSM marquee.
    [Show full text]
  • Putting Switched Fabric to Work for Software Radio
    PUTTING SWITCHED FABRIC TO WORK FOR SOFTWARE RADIO Rodger H. Hosking (Pentek, Inc., Upper Saddle River, NJ, USA, [email protected]) ABSTRACT In order to take advantage of the wealth of high- volume, low-cost devices for mass-market electronics, and The most difficult problem for designers of high- to reap the same benefits of easier connectivity, even the performance, software radio systems is simply moving data most powerful high-end software radio RISC and DSP within the system because of data throughput limitations. processors from Freescale and Texas Instruments are now Driving this dilemma are processors with higher clock rates sporting gigabit serial interfaces. and wider buses, data converter products with higher sampling rates, more complex digital communication 2. GIGABIT SERIAL STANDARDS standards with increased bandwidths, disk storage devices with faster I/O rates, FPGAs and DSPs offering incredible The descriptive phrase “gigabit serial” covers a truly diverse computational rates, and system connections and network range of implementations and application spaces. Figure 1 links operating at higher speeds. shows most of the popular standards used in embedded Traditional system architectures relying on buses and systems suitable for software radio, along with how each parallel connections between system boards and mezzanines standard is normally deployed in a system. fall far short of delivering the required peak rates, and suffer even worse if they must be shared and arbitrated. New Standard Main Application strategies for solving these problems exploit gigabit serial Gigabit Ethernet Computer Networking links and switched fabric standards to create significantly FibreChannel Data Storage more powerful architectures ideally suited for embedded software radio systems.
    [Show full text]
  • Brocade Mainframe Connectivity Solutions
    PART 1: BROCADE MAINFRAME CHAPTER 2 CONNECTIVITY SOLUTIONS The modern IBM mainframe, also known as IBM zEnterprise, has a distinguished 50-year history BROCADEMainframe I/O and as the leading platform for reliability, availability, serviceability, and scalability. It has transformed Storage Basics business and delivered innovative, game-changing technology that makes the extraordinary possible, and has improved the way the world works. For over 25 of those years, Brocade, MAINFRAME the leading networking company in the IBM mainframe ecosystem, has provided non-stop The primary purpose of any computing system is to networks for IBM mainframe customers. From parallel channel extension to ESCON, FICON, process data obtained from Input/Output devices. long-distance FCIP connectivity, SNA/IP, and IP connectivity, Brocade has been there with IBM CONNECTIVITY and our mutual customers. Input and Output are terms used to describe the SOLUTIONStransfer of data between devices such as Direct This book, written by leading mainframe industry and technology experts from Brocade, discusses Access Storage Device (DASD) arrays and main mainframe SAN and network technology, best practices, and how to apply this technology in your storage in a mainframe. Input and Output operations mainframe environment. are typically referred to as I/O operations, abbreviated as I/O. The facilities that control I/O operations are collectively referred to as the mainframe’s channel subsystem. This chapter provides a description of the components, functionality, and operations of the channel subsystem, mainframe I/O operations, mainframe storage basics, and the IBM System z FICON qualification process. STEVE GUENDERT DAVE LYTLE FRED SMIT Brocade Bookshelf www.brocade.com/bookshelf i BROCADE MAINFRAME CONNECTIVITY SOLUTIONS STEVE GUENDERT DAVE LYTLE FRED SMIT BROCADE MAINFRAME CONNECTIVITY SOLUTIONS ii © 2014 Brocade Communications Systems, Inc.
    [Show full text]
  • Be Based on Ethernet, Infiniband, Or Fibre Channel in DEPTH / STORAGE
    Running SAN traffic over the LAN is becoming a realistic proposition, but will this future converged network be based on Ethernet, InfiniBand, or Fibre Channel IN DEPTH / STORAGE realistic proposition, but will this future converged network e Channel? By Andy Dornan One Network To Rule Them All ONVERGENCE IS about more iSCSI is a viable option, it’s mostly used in than just voice and data. Storage low-end networks that need speeds of 1 Gbps and networking vendors prom- or less. And even here, many users prefer to ise that the next-generation net- keep the SAN separate from the LAN, even if work will unite local and storage both are built from the same commodity Gi- Carea networks, virtualizing both over a single gabit Ethernet switches. network at 20 Gbps, 40 Gbps, or even 100 The new push toward unified networks dif- Gbps. And it isn’t just the networks that are fers from iSCSI in both its ambition and the coming together.The future SAN also involves resources behind it. Vendors from across the convergence of storage with memory. The networking and storage industries are collabo- same principles that originally abstracted rating on new standards that aim to unite mul- storage out of a local server can be applied to tiple networks into one. Startups Xsigo and RAM, too, while storage targets shift from 3Leaf Systems already have shipped propri- hard disks to flash memory. etary hardware and software aimed at virtual Longtime SAN users might feel a sense of I/O that can converge SAN with LAN, though n a m déjà vu.
    [Show full text]
  • Control Plane Vs
    Everything You Wanted To Know about Storage (But Were Too Proud To Ask) Part Mauve J Metz, Cisco Dror Goldenberg, Mellanox Chad Hintz, Cisco Fred Knight, NetApp November 1, 2016 Today’s Presenters J Metz Dror Goldenberg Chad Hintz Fred Knight SNIA Board VP Software SNIA-ESF Standards of Directors Architecture Board Technologist Cisco Mellanox Cisco NetApp 2 SNIA Legal Notice ! " The material contained in this presentation is copyrighted by the SNIA unless otherwise noted. ! " Member companies and individual members may use this material in presentations and literature under the following conditions: ! " Any slide or slides used must be reproduced in their entirety without modification ! " The SNIA must be acknowledged as the source of any material used in the body of any document containing material from these presentations. ! " This presentation is a project of the SNIA. ! " Neither the author nor the presenter is an attorney and nothing in this presentation is intended to be, or should be construed as legal advice or an opinion of counsel. If you need legal advice or a legal opinion please contact your attorney. ! " The information presented herein represents the author's personal opinion and current understanding of the relevant issues involved. The author, the presenter, and the SNIA do not assume any responsibility or liability for damages arising out of any reliance on or use of this information. NO WARRANTIES, EXPRESS OR IMPLIED. USE AT YOUR OWN RISK. 3 About SNIA 4 Agenda ! " Channel vs. Bus Host Network Storage ! " Control Plane vs. Data Plane ! " Fabric vs. Network Channel Busses Control Plane Data Plane Fabric Network 5 Off We Go! ! " Channel vs.
    [Show full text]
  • Starlink Switched Fabric Data Interconnect PMC
    StarLink Switched Fabric Data Interconnect PMC Features Switched Fabric Interconnect PMC The StarLink PMC card 400Mbytes/sec total sustained bandwidth provides the Zero protocol, PCI to PCI transfers converted to packets which user with a automatically route through the fabric flexible, switched fab- 64-bit, 66MHz PCI Interface ric board PCI to StarFabric bridge (2 ports) interconnect system that easily scales from a few to many boards. The 6 port StarFabric switch flexibility of the system is a virtue of the underlying packet 4 ports via PMC Pn4 connectors or switching technology, where data is automatically and trans- – 2 ports via front panel RJ-45’s & 2 ports via Pn4 connectors parently routed through a fabric network of switches to it’s destination. 800 Mbytes switching cross-sectional bandwidth Quality of service features for real-time determinism StarLink is based on StarFabric technology from Stargen Inc. StarFabric is a high-speed serial, switched-fabric technology. Robust LVDS physical layer The system is based on two types of device, a PCI to Star- High availability features Fabric bridge, and a StarFabric switch. The elegance of Star- Fabric is in it’s simplicity, as a network of bridges and Low power operation switches presents itself to the application as a collection of VxWorks drivers bridged PCI devices. Memory attached to one node, is made visible in PCI address space to the other nodes in the net- Air-cooled and conduction-cooled versions available. work. This is an existing architecture in many systems (i.e. cPCI), so from a software interface perspective, a group of cards linked through StarFabric network, appears the same as Description if they were connected to each other through non-transparent Many Signal Processing problems demand the use of multiple PCI to PCI bridges.
    [Show full text]
  • Connectrix Storage Area Networking Portfolio
    Data Sheet Dell EMC Connectrix Storage Area Networking Portfolio Connectrix Enables Business Applications The Connectrix™ family of directors and switches moves your vital business information to where it’s needed securely, with the highest performance, the highest availability and unsurpassed reliability. Connectrix is the only storage networking platform that offers Dell EMC E-Lab™ interoperability testing. Connectrix products can connect physical or virtual servers through Fibre Channel Storage Area Networks (SAN) technology. Connectrix enables all application environments from Oracle, Microsoft and SAP to local backup/restore, and business continuity/disaster recovery solutions over distance. Connectivity Matters for Data Storage: NVMe/FC All-flash storage environments require a network that is deterministic, and easy to manage with low latencies. Connectrix has always delivered low latency, deterministic behavior, scalability and reliability. So, as you move to Solid State Drives (SSD) or Storage Class Memory (SCM), make sure your storage network can keep pace. Today’s storage networks deliver up to 64 Gigabit per second (Gb/s) Fibre Channel speeds. The latest Connectrix systems include exclusive diagnostic and error-collection capabilities, as well as the ability to monitor, analyze and identify specific data automatically to avoid errors, reduce bottlenecks and automate your networking resources. Connectrix models allow seamless transition to Non-Volatile Memory Express Fibre Channel (NVMe/FC) workloads without any hardware upgrade in the SAN. In addition, Connectrix platforms support the concurrent use of both traditional SCSI-based Fibre Channel and NVMe/FC traffic, allowing organizations to easily integrate Fibre Channel networks with NVMe-based storage. Live Optics with SAN Health – Free SAN Assessment If you’re thinking about upgrading your storage environment, make sure your SAN isn’t a bottleneck by running Live Optics with SAN Health.
    [Show full text]