Low Latency Ethernet 10G MAC User Guide

Total Page:16

File Type:pdf, Size:1020Kb

Low Latency Ethernet 10G MAC User Guide Low Latency Ethernet 10G MAC User Guide Last updated for Altera Complete Design Suite: 14.1 Subscribe UG-01144 101 Innovation Drive 2014.12.15 San Jose, CA 95134 Send Feedback www.altera.com TOC-2 Low Latency Ethernet 10G MAC User Guide Contents About this IP Core...............................................................................................1-1 Features......................................................................................................................................................... 1-1 Release Information.....................................................................................................................................1-2 Device Family Support................................................................................................................................1-3 Performance and Resource Utilization.....................................................................................................1-4 Transmit and Receive Latencies.................................................................................................................1-5 Getting Started.................................................................................................... 2-1 Introduction to Altera IP Cores.................................................................................................................2-1 Installing and Licensing IP Cores..............................................................................................................2-2 Specifying IP Core Parameters and Options............................................................................................2-2 Parameterizing the IP Core........................................................................................................................ 2-3 Parameter Settings....................................................................................................................................... 2-4 Generated Files.............................................................................................................................................2-7 Simulating Altera IP Cores in other EDA Tools..................................................................................... 2-7 Upgrading Outdated IP Cores................................................................................................................... 2-9 Migrating IP Cores to a Different Device.................................................................................................2-9 LL Ethernet 10G MAC Design Considerations.....................................................................................2-10 Migrating from Ethernet 10G MAC to LL Ethernet 10G MAC..............................................2-10 Timing Constraints........................................................................................................................2-11 Functional Description....................................................................................... 3-1 Architecture.................................................................................................................................................. 3-1 Interfaces....................................................................................................................................................... 3-2 Frame Types..................................................................................................................................................3-4 Transmit Datapath.......................................................................................................................................3-4 Padding Bytes Insertion.................................................................................................................. 3-4 Address Insertion.............................................................................................................................3-4 CRC-32 Insertion.............................................................................................................................3-5 XGMII Encapsulation..................................................................................................................... 3-6 Inter-Packet Gap Generation and Insertion................................................................................ 3-7 XGMII Transmission...................................................................................................................... 3-7 Unidirectional Feature.................................................................................................................... 3-8 TX Timing Diagrams.......................................................................................................................3-9 Receive Datapath........................................................................................................................................3-13 Minimum Inter-Packet Gap ........................................................................................................3-13 XGMII Decapsulation................................................................................................................... 3-13 CRC Checking................................................................................................................................3-14 Address Checking.......................................................................................................................... 3-14 Frame Type Checking................................................................................................................... 3-14 Length Checking............................................................................................................................ 3-15 Altera Corporation Low Latency Ethernet 10G MAC User Guide TOC-3 CRC and Padding Bytes Removal................................................................................................3-16 Overflow Handling........................................................................................................................ 3-16 RX Timing Diagrams.................................................................................................................... 3-17 Flow Control...............................................................................................................................................3-18 IEEE 802.3 Flow Control.............................................................................................................. 3-18 Priority-Based Flow Control........................................................................................................ 3-20 PHY Configurations..................................................................................................................................3-21 10GBASE-R Register Mode..........................................................................................................3-22 Error Handling (Link Fault).....................................................................................................................3-23 IEEE 1588v2................................................................................................................................................3-24 Architecture....................................................................................................................................3-25 Transmit Datapath.........................................................................................................................3-26 Receive Datapath............................................................................................................................3-27 Frame Format.................................................................................................................................3-27 Configuration Registers...................................................................................... 4-1 Register Access Type Convention............................................................................................................. 4-1 Register Map.................................................................................................................................................4-2 Register Map (with and without Avalon-MM Adapter)........................................................................ 4-2 Primary MAC Address................................................................................................................................4-6 Transmit Configuration and Status Registers..........................................................................................4-7 Flow Control Registers..............................................................................................................................4-10 Unidirectional Control Register.............................................................................................................. 4-12 Receive Configuration and Status Registers...........................................................................................4-13 Transmit Timestamp Registers................................................................................................................4-20 Receive Timestamp Registers...................................................................................................................4-22 PMA Delay for IEEE 1588v2 MAC Registers.......................................................................................
Recommended publications
  • Ciena 5305 Service Aggregation Switch Datasheet
    5305 SERVICE AGGREGATION SWITCH Features and Benefits The 5305 Ethernet/MPLS service aggregation > Features advanced Ethernet and MPLS to support demanding business, mobile switch is purpose-built for Carrier Ethernet backhaul, transport, and residential applications including L2VPN service to deliver cost-effective capacity, scalability, delivery and aggregation, 3G/4G wireless backhaul, FTTx and IP DSLAM and resiliency. With this switch, service Aggregation and L2 backhaul of L3VPNs > Delivers optimal density and service providers can keep pace with the constantly flexibility with a compact modular chassis, supporting incremental increasing demand for bandwidth and next- expansion of service and bandwidth capacity with linear CAPEX outlay generation services that support business, > Supports tens of thousands of services mobile backhaul, transport, and residential on a single system with robust scalability of up to 30,000+ VLANs and applications in metro networks. two million MAC addresses per chassis > Delivers high reliability, five-9s The 5305 is a modular, chassis-based system optimized for metro-edge deployments availability, and 50 ms protection in a wide variety of network topologies, including fiber and microwave rings, point-to- switching resiliency using state-of- the-art hardware and software design point fiber, microwave mesh, and fiber or copper to the subscriber. The switch coupled with advanced control plane supports high-density Gigabit Ethernet (GbE) connectivity to the subscriber edge and and Ethernet OAM capabilities
    [Show full text]
  • Data Center Ethernet 2
    DataData CenterCenter EthernetEthernet Raj Jain Washington University in Saint Louis Saint Louis, MO 63130 [email protected] These slides and audio/video recordings of this class lecture are at: http://www.cse.wustl.edu/~jain/cse570-15/ Washington University in St. Louis http://www.cse.wustl.edu/~jain/cse570-15/ ©2015 Raj Jain 4-1 OverviewOverview 1. Residential vs. Data Center Ethernet 2. Review of Ethernet Addresses, devices, speeds, algorithms 3. Enhancements to Spanning Tree Protocol 4. Virtual LANs 5. Data Center Bridging Extensions Washington University in St. Louis http://www.cse.wustl.edu/~jain/cse570-15/ ©2015 Raj Jain 4-2 Quiz:Quiz: TrueTrue oror False?False? Which of the following statements are generally true? T F p p Ethernet is a local area network (Local < 2km) p p Token ring, Token Bus, and CSMA/CD are the three most common LAN access methods. p p Ethernet uses CSMA/CD. p p Ethernet bridges use spanning tree for packet forwarding. p p Ethernet frames are 1518 bytes. p p Ethernet does not provide any delay guarantees. p p Ethernet has no congestion control. p p Ethernet has strict priorities. Washington University in St. Louis http://www.cse.wustl.edu/~jain/cse570-15/ ©2015 Raj Jain 4-3 ResidentialResidential vs.vs. DataData CenterCenter EthernetEthernet Residential Data Center Distance: up to 200m r No limit Scale: Few MAC addresses r Millions of MAC Addresses 4096 VLANs r Millions of VLANs Q-in-Q Protection: Spanning tree r Rapid spanning tree, … (Gives 1s, need 50ms) Path determined by r Traffic engineered path spanning tree Simple service r Service Level Agreement.
    [Show full text]
  • Converged Networking in the Data Center
    Converged Networking in the Data Center Peter P. Waskiewicz Jr. LAN Access Division, Intel Corp. [email protected] Abstract data center as a whole. In addition to the general power and cooling costs, other areas of focus are the physical The networking world in Linux has undergone some sig- amount of servers and their associated cabling that re- nificant changes in the past two years. With the expan- side in a typical data center. Servers very often have sion of multiqueue networking, coupled with the grow- multiple network connections to various network seg- ing abundance of multi-core computers with 10 Gigabit ments, plus they’re usually connected to a SAN: ei- Ethernet, the concept of efficiently converging different ther a Fiber Channel fabric or an iSCSI infrastructure. network flows becomes a real possibility. These multiple network and SAN connections mean large amounts of cabling being laid down to attach a This paper presents the concepts behind network con- server. Converged Networking takes a 10GbE device vergence. Using the IEEE 802.1Qaz Priority Group- that is capable of Data Center Bridging in hardware, ing and Data Center Bridging concepts to group mul- and consolidates all of those network connections and tiple traffic flows, this paper will demonstrate how dif- SAN connections into a single, physical device and ca- ferent types of traffic, such as storage and LAN traf- ble. The rest of this paper will illustrate the different fic, can efficiently coexist on the same physical connec- aspects of Data Center Bridging, which is the network- tion.
    [Show full text]
  • Interactions Between TCP and Ethernet Flow Control Over Netgear
    Interactions between TCP and Ethernet flow control over Netgear XAVB2001 HomePlug AV links Radika Veera Valli, Grenville Armitage, Jason But, Thuy Nguyen Centre for Advanced Internet Architectures, Technical Report 130121A Swinburne University of Technology Melbourne, Australia [email protected], [email protected], [email protected], [email protected] Abstract—HomePlug AV links are usually slower than buffers along network paths. A side-effect of such loss- the surrounding wired LAN links, creating a bottleneck based CC behaviour is that all traffic sharing the bottle- where traffic may be buffered and delayed. To investigate neck will experience additional latency due to increased the interactions between TCP congestion control and average queueing delays [5]. This is particularly prob- Ethernet flow control we trialled four TCP variants over a lematic for real-time application flows (such as VoIP and HomePlug AV link using two Netgear XAVB2001 devices. We observed that the XAVB2001’s use of Ethernet flow online games) given the growth of arguably-gratuitous control effectively concatenates the buffers in both the buffering (“buffer bloat”) in network devices, interface XAVB2001 and the directly attached sending host. This led cards and network software stacks [6]. to multi-second RTTs when using NewReno and CUBIC In this report we borrow from, and extend, previous (loss-based) TCPs, which is significantly troublesome for work by one of the current authors [7]. Our new work multimedia traffic on home LANs. In contrast, Vegas explores in greater detail the latency and flow control and CDG (delay-based) TCPs kept buffer utilisation low, issues that emerge when end-to-end TCP is allowed to and induced five to ten milliseconds RTT.
    [Show full text]
  • Chapter 2 Link Layer Verilog Hardware Implementation, and One Wireless Broadcast Link, I.E
    Modern Computer Networks: An open source approach Chapter 2 Modern Computer Networks: An open source approach Chapter 2 package, one wired broadcast link, i.e. Ethernet in Section 2.4 along with its Chapter 2 Link Layer Verilog hardware implementation, and one wireless broadcast link, i.e. wireless LAN (WLAN) in Section 2.5 plus a brief on Bluetooth and WiMAX. PPP is Problem Statement popularly used in the last-mile dial-up services or routers carrying various network protocols over point-to-point links. Ethernet has occupied more than 95 percent of To effectively and efficiently transmit data over physical links from one node wired LANs. It is also poised to be ubiquitous in MANs and WANs. In contrast to to one or more nodes, there is much more to do than simply modulating or desktop PCs, which usually use wired links, many devices such as laptop PCs encoding bit stream into signal. Transmission impairments, such as crosstalk and cellular phones are mobile and prefer wireless links such as WLAN, Bluetooth, between two adjacent pairs, can unexpectedly change transmission signal and and WiMAX. thus result in errors. The transmitter might transmit faster than the receiver can Table 2.1 Link protocols. handle. The transmitter has to somehow indicate the destination(s), if on a PAN/LAN MAN/WAN broadcast link, i.e. LAN, and usually needs to name itself to let the receiver know Token Bus (802.4) DQDB (802.6) Token Ring (802.5) HDLC where the source is. If multiple stations share a LAN, an arbitration mechanism is HIPPI X.25 required to determine who can transmit next.
    [Show full text]
  • Understanding Ethernet
    Chapter 1 Understanding Ethernet In This Chapter ▶ Exploring carrier sensing and collision detection methods ▶ Understanding directional traffic and simultaneous transmissions ▶ Examining Ethernet speed limits and wire-rated standards ▶ Exploring Gigabit Ethernet ▶ Distinguishing between local and backbone Ethernet ▶ Recognizing Ethernet interfaces ▶ Understanding Ethernet’s simplicity n today’s connected business world, ubiquitous access to Idigitized information and data is critical. Networking has not only reshaped the information landscape, but it has also vastly increased speeds at which information moves and is consumed. In fact, networking is the key to accessing the com- plex services and applications within which information plays a starring role. Although access to the Internet is essential, all networking begins at the local level. For modern networks, Ethernet is the standard infrastructure upon which local net- works rest. Ethernet comprises a family of frame-based protocols and tech- nologies designed to connect local area networks (LANs) — computersCOPYRIGHTED and devices situated in MATERIAL close proximity and able to communicate with one another. Ethernet draws its name from the fanciful Latin terminology luminiferous aether, which trans- lates to a light-bearing medium once thought to fill space and propagate magnetic waves. As such, Ethernet is a metaphorical reference for the physical transmission medium in the work- place (and at home) that propagates digitized information in electronic form. The term “Ethernet” was originally coined by 4 Carrier Ethernet For Dummies Bob Metcalfe while jointly developing basic Ethernet network computing with David Boggs at Xerox Palo Alto Research Center (PARC). Sensing a Carrier and Handling Collisions Two people on opposite ends of a phone conversation can sense carrier presence (either a dial-tone or a connected call) and handle collisions (overlapping conversations).
    [Show full text]
  • Storage and Network Convergence Using Fcoe and Iscsi
    Front cover Storage and Network Convergence Using FCoE and iSCSI Learn how to improve IT service performance and availability Simplify your storage and network infrastructure See how to reduce data center network costs Sangam Racherla Silvio Erdenberger Harish Rajagopal Kai Ruth ibm.com/redbooks International Technical Support Organization Storage and Network Convergence Using FCoE and iSCSI January 2014 SG24-7986-01 Note: Before using this information and the product it supports, read the information in “Notices” on page xi. Second Edition (January 2014) This edition applies to the latest supported Converged Network Adapters and Switches in the IBM System Networking Portfolio of products. © Copyright International Business Machines Corporation 2012, 2014. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. Contents Notices . xi Trademarks . xii Preface . xiii Authors. xiii Now you can become a published author, too! . .xv Comments welcome. .xv Stay connected to IBM Redbooks . xvi Part 1. Overview of storage and network convergence . 1 Chapter 1. Introduction to convergence . 3 1.1 What convergence is. 4 1.1.1 Calling it what it is . 4 1.2 Vision of convergence in data centers . 4 1.3 The interest in convergence now . 5 1.4 Fibre Channel SANs today . 5 1.5 Ethernet-based storage today. 6 1.6 Benefits of convergence in storage and network . 7 1.7 Challenge of convergence . 8 1.8 Conclusion . 10 Chapter 2. Fibre Channel over Ethernet . 11 2.1 Background: Data Center Bridging . 12 2.1.1 Priority-based Flow Control: IEEE 802.1Qbb .
    [Show full text]
  • TROUBLESHOOTING FEATURES for Media Conversion Products Table of Contents
    WHITE PAPER : TROUBLESHOOTING FEATURES for Media Conversion Products Table of Contents Introduction ......................................................................................................... 3 Link Integrity ....................................................................................................... 4 Ethernet Troubleshooting Features ................................................................... 4 1. Auto Negotiation (AN) ....................................................................................... 4 a. Full Duplex ................................................................................................ 4 b. 100 Mbps Speed ..................................................................................... 4 c. Selective Advertising ................................................................................... 5 d. Rate Converters ....................................................................................... 5 e. FX Auto Negotiation (FX AN) ..................................................................... 5 2. FX LinkLoss (FXLL) ........................................................................................... 6 3. TX LinkLoss (TXLL) ........................................................................................... 6 4. FiberAlert (FA) ................................................................................................... 7 5. LinkLoss & FiberAlert ........................................................................................ 7
    [Show full text]
  • Fairness in a Data Center
    University of New Hampshire University of New Hampshire Scholars' Repository Doctoral Dissertations Student Scholarship Winter 2012 Fairness in a data center MIkkel Hagen University of New Hampshire, Durham Follow this and additional works at: https://scholars.unh.edu/dissertation Recommended Citation Hagen, MIkkel, "Fairness in a data center" (2012). Doctoral Dissertations. 694. https://scholars.unh.edu/dissertation/694 This Dissertation is brought to you for free and open access by the Student Scholarship at University of New Hampshire Scholars' Repository. It has been accepted for inclusion in Doctoral Dissertations by an authorized administrator of University of New Hampshire Scholars' Repository. For more information, please contact [email protected]. Fairness in a data center BY Mikkel Hagen M.S. Computer Science, University of New Hampshire (2008) B.S. Computer Science/Biology/Psychology, St. Bonaventure University (2004) DISSERTATION Submitted to the University of New Hampshire in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Computer Science December 2012 UMI Number: 3537816 All rights reserved INFORMATION TO ALL USERS The quality of this reproduction is dependent upon the quality of the copy submitted. In the unlikely event that the author did not send a complete manuscript and there are missing pages, these will be noted. Also, if material had to be removed, a note will indicate the deletion. Dissertation Publishing UMI 3537816 Published by ProQuest LLC 2013. Copyright in the Dissertation held by the Author. Microform Edition © ProQuest LLC. All rights reserved. This work is protected against unauthorized copying under Title 17, United States Code. uest ProQuest LLC 789 East Eisenhower Parkway P.O.
    [Show full text]
  • 19540 - Telematics 7Th Tutorial - Media Access, Ethernet & Wireshark
    19540 - Telematics 7th Tutorial - Media Access, Ethernet & Wireshark Bastian Blywis Department of Mathematics and Computer Science Institute of Computer Science 26. November, 2009 Institute of Computer Science – Telematics Tutorial – 26. November, 2009 1 Outline 1. Frame Size 2. Packets and Cells 3. FDDI Performance 4. ATM 5. Tunneling 6. Bridge Classification 7. Virtual LANs 8. IEEE 802.1Q and IEEE 802.2 9. Features of Layer 2 Protocols 10. Security Considerations 11. IEEE 802.1D Institute of Computer Science – Telematics Tutorial – 26. November, 2009 2 Frame Size Consider a 10 MBit/s CSMA/CD LAN with a bus of 50m length. The speed of the signal within the transmission medium is 2 ∗ 108m=s. 1. Calculate the upper bound of the collision detection time. 2. Specify the minimum frame length. Institute of Computer Science – Telematics Tutorial – 26. November, 2009 3 Frame Size Maximum time depends on maximum distance: AB 50m 5*10^-7s – Worst case: station A senses a free medium and starts to transmit – Station B senses a free medium and starts to transmit just at the time the signal from A arrives at B – Signal from B has to travel through the whole network until A detects the collision – Maximum time until collision detection, is twice the time of the signal propagation time for the whole network buslength 50m t = 2 ∗ = 2 ∗ = 5 ∗ 10−7s 8 m signalspeed 2 ∗ 10 s Institute of Computer Science – Telematics Tutorial – 26. November, 2009 4 Frame Size To ensure the stations are able to detect a collision, the frame has be take at least t to send: framelength min > t capacity 10MBit framelength > ∗ 5 ∗ 10−7s = 5Bit min s Institute of Computer Science – Telematics Tutorial – 26.
    [Show full text]
  • Network Transport for Data Centers
    X_405082 Advanced Computer Networks Data Center Transport Lin Wang ([email protected]) Period 2, Fall 2020 Course outline Warm-up Video ■ Fundamentals ■ Video streaming ■ Forwarding and routing ■ Video stream analytics ■ Network transport Networking and ML Data centers ■ Networking for ML ■ Data center networking ■ ML for networking ■ Data center transport � Mobile computing Programmability ■ Wireless and mobile ■ Sofware defined networking ■ Programmable forwarding 2 Learning objectives What are the new challenges in data center transport? What design choices do we have for data centers transport design? 3 What is special about data center transport Network ■ Extremely high speed (100+ Gbps) ■ Extremely low latency (10-100s of us) Diverse applications and workloads ■ Large variety in performance requirements Traffic patterns ■ Large long-lived flows vs small short-lived flows ■ Scatter-gather, broadcast, multicast Built out of commodity components: no expensive/customized hardware 4 Congestion control recall Network Do you still remember the goal of congestion control? 5 Congestion control recall Network Congestion control aims to determine the rate to send data on a connection, such that (1) the sender does not overrun the network capability and (2) the network is efficiently utilized 6 TCP Sender Receiver Network ACK ACK ACK Application The transport layer in the network model: Reliable TCP ■ Reliable, in-order delivery using acknowledges ■ Make sure not to overrun the receiver (receiving window, IP rwnd) and the network (congestion window,
    [Show full text]
  • NC-SI Over MCTP Binding Specification 6
    1 2 Document Number: DSP0261 3 Date: 2013-08-22 4 Version: 1.0.0 5 NC-SI over MCTP Binding Specification 6 7 Document Type: Specification 8 Document Status: DMTF Standard 9 Document Language: en-US 10 11 NC-SI over MCTP Binding Specification DSP0261 12 Copyright notice 13 Copyright © 2013 Distributed Management Task Force, Inc. (DMTF). All rights reserved. 14 DMTF is a not-for-profit association of industry members dedicated to promoting enterprise and systems 15 management and interoperability. Members and non-members may reproduce DMTF specifications and 16 documents for uses consistent with this purpose, provided that correct attribution is given. As DMTF 17 specifications may be revised from time to time, the particular version and release date should always be 18 noted. 19 Implementation of certain elements of this standard or proposed standard may be subject to third party 20 patent rights, including provisional patent rights (herein "patent rights"). DMTF makes no representations 21 to users of the standard as to the existence of such rights, and is not responsible to recognize, disclose, 22 or identify any or all such third party patent right, owners or claimants, nor for any incomplete or 23 inaccurate identification or disclosure of such rights, owners or claimants. DMTF shall have no liability to 24 any party, in any manner or circumstance, under any legal theory whatsoever, for failure to recognize, 25 disclose, or identify any such third party patent rights, or for such party’s reliance on the standard or 26 incorporation thereof in its product, protocols or testing procedures.
    [Show full text]