IOS Xrv 9000

IOS XRv 9000

Joachim Jerberg Jensen – [email protected] CCIE SP #42403 Feb 2016 Agenda • XRv 9000 Vision and Overview • How is the XRV 9000 architected • What are the use cases and performance • Licensing

ESP Cisco Network Services Orchestrator (NSO) Cross-Domain Orchestration System

Open Standards and Protocols (Libvirt, Openstack, Netconf/Yang)

Branch Solution Micro-PoD** ½ Rack POD Full Rack POD EPN vCPE vCMTS Web VM DB VM Distributed Distributed vWAASNFVI NPE vEQUAM AGG NFVI DCI vPE NAT FW

Distributed NFVI CPE AGG PE

AGG NPE DCI Customer Premise Agile Carrier Ethernet © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Confidential ** Not available at FCS IOS XRv Vision Statement Common SP Operating System across physical and virtual Data planes

Abstracted Network Services & Automation

SDN Network APIs – NetConf / YANG, etc

IOS XRv

Physical High touch Dataplanes Virtual XR Dataplane Physical cost-optimized Dataplanes / merchant

Virtual XR DP

© 2015 Cisco and/or its affiliates. All rights reserved. Cisco Confidential DISCLAIMER: Many of the products and features described herein remain in varying stages of development and will be offered on a when-and-if-available basis. This roadmap is subject to change at the sole discretion of Cisco, and Cisco will have no liability for delay in the delivery or failure to deliver any of the products or features set forth in this document. The benefit and applications of Router Virtualization

Virtual Enterprise Virtual Virtual L3 VPN Virtual L2 VPN Virtual BGP RR WAN Edge Peering PE PE

• Common Hardware platform (x86) Rapid Creation and Deployment Common x86 Hardware of new Services Familiar IOS XR • Create new Routers in Single Tenant or Multi-Tenant Cloud Orchestrated Elasticity specific roles in seconds

Customer • Wide range of Access / Aggregation Service Provider Core Service Provider Premise Data Center Edge applications Access / Core Internet / 3rd party Aggregation provider

Proven Efficient Carrier Class Virtual Innovative SW based Router based on IOS-XR IOS-XR “HW assists” Proven, Resilient, running on ASR, CRS, NCS

Virtual router based on the widely deployed IOS-XRv 9000 IOS-XR Virtual Router

Elastic Performance “HW in Software” Full Featured Operation, Traffic Manager Scalability with Single/Multi TCAM Policer no serial execution drawbacks Core, Multi- Socket/Server

Process Restart IOS XRv

In-service recovery OSPF EVPN L2TP OSPF OSPF

Less downtime with LLDP LACP ARP SNMP reduced reboots

OSPF LLDP IS-IS FIB RIB

SYSDB LLDP BGP LDP BGP-LS Netflow In-Service Software Patches SMU

TWAMP RSVP VRRP GRE 802.1ag In-service bug-fixes

QOS SR PCEP Y.1731 OSPF OSPF Less downtime with Open Netconf EVPN reduced reboots Flow

32768

Thi 8192 s im 2048 ag e ca Gbps 512 ASR 9922 ASR 9912 ASR 9010 128 ASR 9904

32 IOS XRv 9000 ASR 9001 ASR 9006

Server Lightweight and optimized admin plane Infra management LXC SMU management Admin VM/LXC management Lifecycle Management for CP and DP LXC XR

LINUX Install XR Combined RP+ CP VM Start/Stop/Restart LC functionality Data Plane Upgrade/Downgrade Controller Liveness (Heartbeat monitoring)

LXC Data Plane Referred to as DPA Virtual Forwarder (VF) VF DP GigE 0/0/2 GigE MgmtEth TenGigE

GigE 0/0/1 GigE Nomenclature • Data Plane Controller – DPC Hypervisor vswitch • Data Plane Agent – DPA 0/0/0

IOS-XRv 9000 Full IOS-XR Protocol Stack • RPL • HA (Process restart, NSR) • BGP-LS IOS-XRv Control Plane • BGP-FS • Multi-instance, multi-AS Support • ISIS, OSPF, Segment routing, … IOS-XRv Virtual Forwarder CP/DP Separation DPC PD Abstraction layer RX & Traffic Interface Manager TM DPA support for physical and virtual Classification & TX data plane engines 64 bit Linux Kernel for higher scale Support for chassis distribution with full Flexible CPU/Memory allocation for LC LXCs or light weight RP+LC and thin scale out LC DPA LXC for fault isolation Forwarding Modular and lightweight admin & Features plane TCAM PLU Pkt. replication

IOS-XRv 9000 Innovative virtual forwarder x86-optimized SW based hardware assists: IOS-XRv Control Plane • SW hierarchical traffic manager with 3 level HQoS, High speed interface 512,000 queues classification • SW policers that is color aware and nearly and fine grained load balancing 4x faster than DPDK based SW routers IOS-XRv Virtual Forwarder • SW TCAM with logical super key & heuristic cuts Hierarchical QOS Scheduler algorithms RX & Traffic • on a single CPU core Interface Manager TM • ½ million Queues Classification & TX • 3-Layer H-QOS Data plane optimized for fast convergence and linerate forwarding with features for IMIX traffic Forwarding Elastically Scalable Feature Path Portable 64bit C-code (to ARM based platforms) & Features • ACLs • uRPF Common code base with Cisco nPower X family TCAM PLU Pkt. replication • Marking, Policing • IPv4, IPv6, MPLS • Segment routing • BFD

Child: Hierarchical QOS Scheduler QN QN QN Q1 Q2 Q1 Q2 Q1 Q2 Classes & Queues • Designed for high speed and scale • Strict priority queuing Parent: Subscriber Shapers • Weighted fair queuing • WRED • Policing GrandParent: Virtual Port • ½ million queues • 128,000 policers • 5000 policy-maps GreatGrandParent: Port

Early Fast Discard Server • Class-aware high speed discard mechanism • Protects worker threads • Works on a closed feedback loop with workers Control Plane policing / LPTS • Prioritizes Control class traffic based on • 802.1p • Protects vRouter CP • EXP • Configurable Policers to CP on a per protocol or • IP TOS W W punt-reason basis • Non-IP (e.g: ISIS, LACP, slow protocols, etc • Executed in all data plane workers ) CP • (talk to adbaig) • Config splits high importance traffic from low W W importance traffic • Drop stats for debug

DP LPTS CoPP W Pause / PFC W 10GE 10GE W NIC NIC RX W TX

W 10GE 10GE Pause or PFC Frames W • Last Resort • Have switch police per class conditionally © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Confidential IOS-XRv 9000: High Performance Execution Feature Execution with I/O Parallelism & Interleaving

I/O I/O I/O I/O I/O I/O I/O I/O I/O ACL ACL ACL ACL QOS QOS QOS QOS Net Flow Net Flow Net Flow Net Flow

Non-Optimized Feature Execution

Asynchronous memory access– Hiding I/O latency

I/O I/O I/O I/O I/O I/O I/O I/O I/O I/O I/O Flow Flow Flow Flow ACL QOS Net ACL QOS Net ACL QOS Net ACL QOS Net over serial execution

Pkt. 3 Pkt. 2 Pkt. 1 Pkt. 1 Pkt. 1 Pkt. 1 Pkt. 2 Pkt. 2 Pkt. 2 Pkt. 3 Pkt. 3 Pkt. 3

FIB FIB FIB FIB FIB FIB FIB FIB FIB Stage Stage Stage Stage Stage Stage Stage Stage Stage 1 I/O 2 I/O 3 I/O 1 I/O 2 I/O 3 I/O 1 I/O 2 I/O 3

Non-Optimized Feature Execution Optimized Feature Execution

Pkt. 3 Pkt. 2 Pkt. 1 Pkt. 3 Pkt. 3 Pkt. 3 Pkt. 2 Pkt. 2 Pkt. 2 Pkt. 1 Pkt. 1 Pkt. 1

FIB FIB FIB Stage Stage Stage 1 I/O 2 I/O 3

Time Higher PPS Better Saved @ High Scale TCO pre-Fetch from memory © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Confidential IOS-XRv 9000: Elasticity with Scalability Scalable Up-down to Single/multi Core, Socket and Server

XRv CP XRv CP XRv CP XRv CP

Single Core Multi-Core Multi-Socket Multi-Server

2015 2015 2016+

Control plane and data plane separation architecture that supports scale up and down between single/multi core, socket and server by leveraging the distributed XR architecture

XRv CP XRv CP XRv CP XRv CP

640 GBPS

160 GBPS 8 40 GBPS GBPS

Single Core Multi-Core Multi-Socket Multi-Server

2015 2015 2016+

Performance shown are Performance shown for IMIX traffic packet Multi socket and multi server performance aggregate throughput numbers size with features enabled (ACL, HQoS, numbers are projected roadmap for policing) to resemble real life deployment 4 socket and 4 server systems

1000s or peers, 10s of Millions of Routes

SP Aggregation SP Core Cloud Provider’s CPE Datacenter IOS-XRv VM’s 9000

vRR1 vRR2 vRR3

Add-Path BGP FlowSpec QoS BGP ORR* LPTS (CoPP) BFD

SP Aggregation SP Core Cloud Provider’s Customer Site Datacenter

VM’s IOS-XRv 9000 DCI

vPE for vRR1 vRR2 vRR3 business Internet access Internet

SP Aggregation SP Core Cloud Provider’s Datacenter

IOS-XRv VM’s 9000

VRF VRF

vRR1 vRR2 vRR3

XRv-9000 vPE For L3 VPNs

• No requirement for hop by hop PBR • VPN membership maintained using NSH metadata • Inserting DPI service • No requirement for per VPN Vlans at only for Green traffic • Blue traffic is service complex forwarded normally • No Reclassification, per hop, in service complex • Complete automation of service chain setup and traffic redirection

• Ability to apply much finer grained security policy • Forwarding decisions based upon NSH metadata not IP ACL/PBR

n Rich-feature test configuration: Ingress ACLs, QoS, HQoS, Reverse Path Forwarding and etc. n Generated a mix of IPv4 and IPv6 traffic with 250,000 flows n Tested with Cisco UCS C240 M4 SX hardware platform n 14 CPU cores (out of 16) were pinned for the virtual router n Four 10GE interfaces connecting directly by PCI Passthrough Part 1: http://www.lightreading.com/lg_redirect.asp?piddl_lgid_docid=718760&piddl_lg_pcode=wprightcolumn Part 2 : http://www.lightreading.com/nfv/nfv© 2015 Cisco and/or its affiliates.-tests All- rightsand reserved.-trials/validating Cisco Confidential-ciscos-nfv-infrastructure-pt-2/d/d-id/718898 Virtual Switch Performance Virtual Switch FIB Scalability: Ethernet Forwarding Forwarding performance of the standalone virtual switch with multiple layer 2/layer 3 forwarding table (FIB) entries

n Almost line rate throughput with Cisco‘s VPP for Ethernet forwarding up to 20,000 MAC addresses n OVS performance reduced by 81% when forwarding to 2,000 MAC addresses – unusable for 20,000 MAC addresses

n 77% line rate with Cisco‘s VPP when forwarding to 20,000 IPv4 addresses n OVS performed 19% of line rate throughput when forwarding to 2,000 IP addresses

n Average latency

Service Cisco Network Service Orchestration Orchestrator (NSO)

Server Server

IOS-XRv 9000 IOS-XRv 9000 IOS-XRv 9000

Hypervisor Hypervisor

Cloud VM Cisco Orchestration Prime ESC

• Pay as you grow model, license metered at 1G • License based on a combination of scale, throughput, term and deployment model • Licenses based on Smart licensing Infrastructure • All four Smart licensing deployment models supported • No license/cost for image upgrade, differentiator against competitor • Services based on SWSS

Advanced SW Licenses 1 Select RTU 2 Foundation SW 3 Advanced SW Licenses (mandatory) (mandatory) optional

Optional Advanced SW Virtual Route features (per Gig) Advanced Reflector Software License

Foundation Software Virtual Provider Edge

© 2015 Cisco and/or its affiliates. All rights reserved. Cisco Confidential • Uses Existing PIDs • Purple boundary are future items License Structure • Some licenses are per VM while some Licenses are per Gig

H-QoS

LI Advanced S/W Advanced

IP/MPLS Transport IP/MPLS Transport IP/MPLS Transport IP/MPLS Transport + L2/L2VPN + + L2/L2VPN + L3VPN L3VPN Foundation vRouter RTU – Per VM

© 2015 Cisco and/or its affiliates. All rights reserved. Cisco Confidential © 2013 Cisco and/or its affiliates. All rights reserved. Foundation and Some Advanced S/W Licenses Offer Scale TierCisco Confidential Options33 Features & Roadmap

• Fully functional virtual router with real data plane performance • Control Plane / Data plane separation • Consistent user experience across physical and virtual routers • True pay as you grow model, flexible licensing • Cloud orchestrated for agile service deployment • Innovative SW based hardware Assists

Past ASIC • 400Gbps & 300Mpps Phase 1 NILE Up to PowerPC High Performance • Flexible Internal and external 55G 90nm 10G /slot Dual Core TCAM memory 28 Gbps 1.2 Ghz / 4Gb

• 64K policers & 96K queues Rich QoS • VoQ queuing model Now ASIC Phase 2 CYLON Up to PowerPC 128G 55nm 20G / slot Dual Core 60 Gbps 1.2 Ghz / 4Gb Service • Embedded crypto integration • GNSS receiver module for accurate clocking

Now ASIC Phase 3 Next-gen Up to PowerPC 400G 200 Gbps 100G / Slot Quad Core Optical • Flexible 10GE, 40GE, & 100GE 1.4 Ghz / 8Gb Innovation • OTN switching (post FCS)

Compact, Powerful, Small Intelligent Multi Service Gateway High Density aggregation Access/Aggregation Routers

• Small footprint • Optimized for Multi Service • Designed for space constrained • Complete IOS-XE feature • High interface density locations capabilities • Ideal for medium size sites • High density with mixed interface needs • Ideal for Distributed • Full ISSU support environments • Future ready One Platform, One OS, One Family ASR 907

ASR 903 ASR 902

4 LC / 1 RSP 6 LC / 2 RSP 16 LC / 2 RSP 480G 560G > 2T

• Compact • Scalable • 7RU, 16 interface slots, side-2-side cooling • RSP : up to 400Gbps with services at different scale • Fits in 300mm cabinets (235mm deep) • Ethernet : 1x100GE, 2x40GE, 8x10/1GE, 2x10GE, • Reliable 1x10GE+8x1GE and 8x1GE • Extended operating temp. range -40 to 65 C • TDM/ATM: 4x STM1 / 1x STM4 • Redundant PSUs, FANs and RSPs • Feature rich • ISSU • Carrier Ethernet: EVC, E-OAM, Y.1731, HQoS • Modular • Layer3+: MPLS VPN, MPLS-TP, VPLS • >2 Terabit back-plane capacity - future proof • Timing: SyncE, IEEE 1588-2008, BITS, GNSS • Upgradable RSP and Interfaces • Advanced QoS capability • Flexible Interface Module selections • OAM: Y.1731, IP-SLA , CFM, Link OAM, MPLS OAM • Capable • Hardware: Cisco Carrier Ethernet ASIC • Software: Cisco IOS-XE (Carrier Grade OS) • Manageable • Local USB, Serial and Ethernet Console ports • 4 Dry input contact ports on the FAN tray © 20132014-20142015 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3939 ASR 907 platform GNSS module Slot

RSP Slots 7RU 7RU (12.25”) Fan tray

Features Description Slots 6Line cards, 2 RSP Rack Size 3 RU (Without Air Plenum) 5.22” x 17.44” x 9.22”(H x W x D) Power 2 Load sharing PSUsworks N+1 mode 1.2 KW DC / 1.2 KW AC supplies Fan 1 Fan Tray with optional removable FAN filter Side to side airflow (without Air Plenum) RSP 1+1 RSP redundancy, RSP1 and later Bandwidth Phase 1: 55G Phase 2: 128G Phase 3: 480G

Features Description Slots 4 Line cards, 1 RSP Rack Size 2 RU (Without Air Plenum) 3.56” x 17.44” x 9.22”(H x W x D) Power 2 Load sharing PSUsworks N+1 mode 1.2 KW DC / 1.2 KW AC supplies Fan 1 Fan Tray with optional removable FAN filter Side to side airflow (without Air Plenum) RSP 1 RSP redundancy, RSP2 and later Bandwidth Phase 1: 80G Phase 2: 200G Phase 3: 480G

RSP3C Expanding the modular 2 New RSP’s chassis market with higher throughput ü RSP3C-400-S for ASR 902,903 and service scale ü RSP3C-400-W for ASR 907 ü Increases Capacity to 400Gbps ü Delivers integrated GNSS receiver

3 New IMs: ü 1x100GE CPAX ü 8x1/10GE SFP/SFP+* ü 2x40GE QSFP

Delivering 100G and high-density 10G in (Pre-)aggregation locations

• RSP3-400 Supported on ASR 907 and as a re-packaged version on the ASR 903 • All previous IM modules will be supported • For redundant RSP3-400 new 1200W PSU required, for single RSP systems existing PSU works • Can support e.g. 24x10G + 2x100G or 16x10G + 2x100G + 80x1G on the ASR 907 • Can support e.g. 24x10G + 2x100G or 48x10G on the ASR 903

• Targeting larger throughput and service scale with onboard crypto (up to 5G) and GPS support

• 100G CPAK technology is currently limited to 55°C

RSP1 RSP2 RSP3 on ASR 902 /ASR 903 RSP3 on ASR 907

A900-IMA1X X X X - A900-IMA8S X X X X A900-IMA8T A900-IMA8S1Z - X X X A900-IMA8T1Z A900-IMA2Z - X X X A900-IMA8Z (8x10G) - - X X A900-IMA1C (1x100G) - - X X A900-IMA2F (2x40G) - - X X A900-IMA16D X X X* X* A900-IMA8D - X X* X* A900-IMA32D A900-IMA4OS X X X X

* Support is post FCS, exact release TBD

RSP3 on ASR 902 S00 S01 S02 S03 RSP3 on ASR 903 S00 S01 S02 S03 S04 S05 A900-IMA1X X X X X A900-IMA1X X X X X X X A900-IMA8S A900-IMA8S X X X X X X X X X X A900-IMA8T A900-IMA8T A900-IMA8S1Z A900-IMA8S1Z X X X X X X X X X X A900-IMA8T1Z A900-IMA8T1Z A900-IMA2Z X X X X A900-IMA2Z X X X X X X A900-IMA8Z X X X X A900-IMA8Z X X X X X X A900-IMA1C X - X - A900-IMA1C - - - - X X A900-IMA2F X - X - A900-IMA2F - - - - X X A900-IMA16D X* X* X* X* A900-IMA16D X* X* X* X* X* X* A900-IMA8D A900-IMA8D X* X* X* X* X* X* X* X* X* X* A900-IMA32D A900-IMA32D A900-IMA4OS X X X X A900-IMA4OS X X X X X X * Support is post FCS, exact release TBD

RSP3 on ASR 907 S00 S01 S02 S03 S04 S05 S06 S07 S08 S09 S10 S11 S12 S13 S14 S15 A900-IMA1X ------A900-IMA8S X X X - - X X - - X X - - X X X A900-IMA8T A900-IMA8S1Z - - X - - X X - - X X - - X X X A900-IMA8T1Z A900-IMA2Z - - - X X - - X X - - X X - - - A900-IMA8Z - - - X X - - X X - - X X - - - A900-IMA1C ------X X ------A900-IMA2F - - - X X - - X X - - X X - - - A900-IMA16D X* X* X* X* X* X* X* X* X* X* X* X* X* X* X* X* A900-IMA8D X* X* X* X* X* X* X* X* X* X* X* X* X* X* X* X* A900-IMA32D A900-IMA4OS - - - X X - - X X - - X X - - -

* Support is post FCS, exact release TBD