Data Sheet BCM56980 12.8 Tb/s Multilayer Switch Overview pathing technologies; enhanced instrumentation; switching, migration, and robust buffer performance including many- The Broadcom® BCM56980 family is a class of to-one burst absorption capabilities that assist in TCP incast high-performance, high-connectivity network switching scenarios. devices supporting up to 32x 400GbE, 64x 200GbE, or 128x 100GbE switch ports. The device family features a With the BCM56980 device, customers can build data maximum of 32 integrated BlackhawkCores, each with eight centers with much higher server node counts while integrated 50G PAM4 SerDes transceivers and associated simultaneously improving per-port power efficiency. The PCS for native support of XFI, 10GBASE-KR/CR/SR/ER/LR, BCM56980 is built using state-of-the-art silicon process 40GBASE-KR4/CR4/SR4/ER4/LR4, 50GbE, and technology and incorporates advanced power management 100GBASE-KR4/CR4/SR4/ER4/LR4. The BCM56980 features to minimize power based on the features in use. delivers high-bandwidth, glueless network connectivity up to Features 12.8 Tb/s on a single chip. General features: The BCM56980 is a family of Ethernet switches designed to address performance, capacity, and service requirements 256x 50G PAM4 SerDes configuration. for next-generation data center and cloud computing Flexible port configurations: 10GbE to 400GbE support environments. The BCM56980 architecture delivers with run-time reconfigurability (Flexport™). complete Layer 2 (L2) and Layer 3 (L3) switching and Oversubscription to maximize I/O throughput. routing capabilities with maximum port density, while Low pin-to-pin latency in cut-through and store-and-forward modes. consuming minimum power, latency, and board footprint. Supports IEEE 802.3bj Clause 91 Forward Error Software compatibility is maintained across the StrataXGS® Correction (FEC), IEEE 802.3bj Clause 93 product portfolio to simplify customer designs and reduce 100GbE-KR4 transmit training, and IEEE 802.3ap customer time-to-market. Clause 72 10G-KR transmit training. As server interfaces transition to higher Ethernet speeds Data center features: and virtualization continues to increase link utilization, data Hardware-based encapsulation. center networks are demanding switches with dense DCBX congestion management: priority-based flow 100GbE and 400GbE connectivity at the edge and control (PFC), enhanced transmission selection (ETS). aggregation layers. With up to 256 50G PAM4 SerDes that Per virtual machine traffic shaping. conform to IEEE 802.3bs and 802.3cd specifications, and full flexibility in configuring 10/25/40/50/100/200/400GbE StrataXGS scalable architecture supports high-performance ports, a single BCM56980 switching chip can be used to switch designs for L2/L3 packet processing: build scalable, cost-effective Top of Rack (ToR) switch, Full IPv4 and IPv6 routing support. blade switch, and aggregation equipment across the entire Hardware-based encapsulations, including MPLS, data center. The BCM56980 has extensive features to GRE, and ISATAP. address the rapidly increasing scale of data center network Three-stage ContentAware™ processing with ICAP deployments and distributed computing applications: large stage supports exact match feature. L2 and L3 forwarding capacity supporting numerous multi- Dedicated hash table for L2 MAC and L3 host. Flexible ingress/egress counter pools. Broadcom 56980-DS111 July 19, 2019 BCM56980 Data Sheet 12.8 Tb/s Multilayer Switch Features (continued) Additional features: In-band telemetry. Buffering and traffic management: Elephant trap. Integrated high-performance SmartBuffer memory for Comprehensive time synchronization support: maximum burst absorption and service guarantees. – Integrated IEEE 1588v2 processor. Full Quality of Service (QoS) support: – IEEE 802.1AS support. Weighted random early discard (WRED). – Synchronous Ethernet. srTCM and trTCM color marking and metering. – Ingress and egress per packet time stamping. Congestion management capabilities including ECN. sFlow support includes ingress, egress, and flex Dynamic load balancing (DLB) for ECMP groups. sampler. Option to forward truncated sFlow packets to Packetized MMU statistics. remote agent. Network monitoring. Packet sampling (PSAMP) ingress-based mirroring with Elephant trap monitors. option to truncate as well as zero out the payload at different offset. DLB monitors. Two dedicated 1G/10G auxiliary Ethernet ports Latency distribution histogram. x4 PCI Express (PCIe) Gen 3.0 interface to support a Network congestion detection. local CPU. sFlow redirect. Adjustable voltage scaling (AVS) for reduced average Visibility and packet tracing. and peak power. Enhanced load balancing. Enhanced trunk hashing capabilities: RTAG7, Applications symmetric hash, flex hash, and resilient hash. Support for jumbo frames up to 9416 bytes. Data center ToR, blade, and aggregation switching. High-speed vector-based scheduler with 12 queues per Mobile core switches. port and scheduling algorithms: SP, RR, WRR, and Cloud computing. WDRR. Large-scale enterprise campus backbone. Service provider core switching. Figure 1: 12.8 Tb/s Multilayer Switch BC0 BC1 BC2 BC3 BC4 BC14 BC15 10GbE/50GbE/100GbE/200GbE/400GbE MAC Multistage Packet BTM Content Aware Buffer ARM-MC Engine VLAN L2 Processing L3 Processing TSCm management TSCm x4 PCIe x4 10GbE/50GbE/100GbE/200GbE/400GbE MAC BC31 BC30 BC21 BC20 BC19 BC18 BC17 BC16 Broadcom 56980-DS111 2 BCM56980 Data Sheet 12.8 Tb/s Multilayer Switch Table of Contents Chapter 1: Introduction ...................................................................................................................... 6 Chapter 2: Device Overview .............................................................................................................. 7 2.1 Feature List................................................................................................................................................................7 2.2 Target Applications.................................................................................................................................................14 2.2.1 100GbE/200GbE/400GbE Aggregation Switch ..............................................................................................14 Chapter 3: System Interfaces .......................................................................................................... 15 3.1 BlackhawkCore SerDes ..........................................................................................................................................16 3.2 BlackhawkCore Octal SerDes Configuration Guidelines ....................................................................................20 3.2.1 Flexport Configuration.....................................................................................................................................20 3.3 10G Quad MerlinCore SerDes ................................................................................................................................20 3.4 PCIe ..........................................................................................................................................................................21 3.5 LED ...........................................................................................................................................................................21 3.6 MIIM ..........................................................................................................................................................................22 3.7 Broadcom Serial Controller ...................................................................................................................................22 3.8 JTAG.........................................................................................................................................................................23 3.9 BroadSync ...............................................................................................................................................................23 3.9.1 Slave Mode – BroadSync Signals as Inputs ...................................................................................................24 3.9.2 Master Mode – BroadSync Signals as Outputs ..............................................................................................24 Chapter 4: Signal Descriptions ....................................................................................................... 25 4.1 Pin Description........................................................................................................................................................26 4.2 BCM56980 Pin List by Ball Number.......................................................................................................................42 4.3 Device Differences ..................................................................................................................................................42 Chapter 5: Electrical Specifications ................................................................................................ 43 5.1 Operating Conditions .............................................................................................................................................43 5.2 Absolute Maximum Ratings ...................................................................................................................................44