BRKSPG-2063

Cisco vBNG solution Based on CSR1000V and XRv 9000

Vimal Dharmavarapu, Product Manager Marketing Chengsheng Luo, Senior Product Manager Agenda

• Introducing Cisco vBNG Solutions

• NSO / ESC – VNF Life Cycle Management

• Smart Licensing

• XRv 9000 – IOS XR Based vRouter / vBNG Solution

• CSR1000v – IOS XE Based vRouter / vBNG Solution & Use Cases

• Conclusion

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 3 What this Session will include

• Introduction to CSR1000v and IOS XRv9000 platforms

• Overview of Deployment capabilities and use-cases

• Introduction to vBNG Lifecycle Management

• Impediments to vBNG Performance

• Overview and Benefits with Smart-Licensing

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 4 What this Session will not include

• Roadmap update on vBNG, vRouter Functionality

• Deep-dive on NFVI Solutions

• BNG Roadmap update

• Demo for vBNG

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 5 vBNG Solutions Overview

vBNG VNF Orchestration

CSR 1000v, XRv 9000 Cisco ESC Software for vBNG vBNG Lifecycle Management Solutions Smart License Hardware, Host OS

Automatic Provisioning, Cost UCS, KVM/VMware/…, Savings with License Sharing Performance

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 6 VNF Lifecycle Management ETSI NFV MANO Virtual Network Functions Manager (VNFM)

NSO

ESC

*Source: ETSI NFV MANO WI (working document) BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 8 Cisco Elastic Service Controller (ESC)

NFVO Network / Cloud Engineer ESC is Cisco’s VNFM, for managing Cisco and 3rd Party VNF’s NETCONF REST CLI (yang) ETSI Web GUI

ESC • Programmable / Model Driven • Netconf and REST Interface VNF Lifecycle VNFD model-driven Manager Monitoring & Actions • YANG data model

VIM Abstraction • Open and Modular VIM Drivers • Interop with 3rd party VNF and NFVO REST API • Micro services CIS* AWS* • Abstracts VIM complexity from service orchestration Containers* * Not supported today, and on radar for future

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 9 VNF Life Cycle

onboard Onboard – VNFD, VNF image, day-0 deploy VNF Deploy/Undeploy – ETSI (TOSCA), undeploy NETCONF (YANG), REST (YANG) Elastic Monitor – ICMP ping, SNMP, custom Services Controller Scale – Auto/Manual scale in/out Update* (ESC) monitor Healing – Auto/Manual reboot/redeploy Update – Application upgrade

healing / scale recovery

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 10 ESC VNF Life Cycle Stages Engine Elastic Service Controller

VNF VNF VNF VNF VNF Deploy Alive Recovery Scaling Undeploy

VM VM VM VM VM VM VM Pre Post Pre Post Pre Post Pre Post DeployVM aliveVM DeployVM aliveVM DeployVM aliveVM DeployVM Pre VM Post VNF Alive Pre Post Pre Post Pre Post Deploy aliveVM DeployVM aliveVM DeployVM aliveVM DeployVM Pre Deploy Post Day 1/2 Pre Post Pre Post Pre Post alive Recovery alive Scaling alive Undeploy Day 0

Predefined Predefined Predefined Predefined Predefined Predefined Predefined Action Monitor Action Monitor Action Monitor Action

Custom Custom Custom Custom Custom Custom Custom Script Script Script Script Script Script Script Action Action Action Action Action Action Action List of Actions List of Events Life Cycle Stage Driven • Notify (callback) • Advertise Service • VM Alive • Withdraw Service • Service Alive • Restart VM Monitor Driven • Upper load threshold crossed • Scale up (add a VM) • Lower load threshold crossed • Scale down (remove a VM) • Service fail • Individually customizable • VM not responding action(s) for every event BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public VNF auto-healing with NFVO NSO/ESC

NFVO (NSO)

7. NFVO configures VNF 2. ESC sends VM 6. ESC sends recovery recovery initialized complete success notification to NFVO notification to NFVO 7 2 6 1. ESC detects VM failures 5. ESC reapplies monitoring to VM and ensures the successful ESC 1 5 recovery 3 3. ESC sends reboot or OpenStack redeploy request to 4. Openstack VM VM VM recover VMs in OpenStack recovers the VM 4

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 12 VNF auto-scaling with NFVO NSO/ESC

NFVO (NSO)

7. NFVO configures VNF if 2. ESC sends VM 6. ESC sends VM scale required scale out init out complete with notification to NFVO success notification to 7 NFVO 2 6 1. ESC detects KPI threshold 5. ESC applies the monitor to exceeded the new deployed VMs and get ESC 1 5 VM_ALIVE for all the VMs 3 3. ESC sends new VM Openstac deployment requests 4. Openstack VM VM VM based on the scaling rules deploys more VMs k 4

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 13 KPI Thresholds - VM Monitoring On ESC Threshold Name Threshold Type Metric Value ESC Action Customized Action

VM_ALIVE Rising/Falling ICMP Ping 3 successful Service Booted Verify CSR connectivity Reachability pings Add to Radius VM_OVERLOADED Rising Session Count >7000 Service Scale-Up (add Adjust Radius Load-Balancing VM) VM_OVERLOADED_FULL Rising Session Count >8000 None Adjust Radius Load-Balancing to exclude this CSR

VM_OVERLOADED_LIGHT Falling Session Count <2000 None Adjust Radius Load-Balancing

VM_OVERLOADED_EMPTY Falling Session Count <1 Service Scale-Down Remove CSR from Radius (remove VM) Load-Balancing KPI XML Definition: Specification of actions in the same file: VM_OVERLOADED VM_OVERLOADED 7000 ALWAYS log GT TRUE servicescaleup.sh TRUE sp_script_service_scale_up SUBSCRIBER_SESSION 015 seconds iosxe_config.txt file://cisco/csr_SP_config.sh

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 14 Scalable vBNG solution Enabled By ESC 1.500 active VMs supported by a single ESC x 8.000 Subscribers per CSR1000V = 12.000.000 Subscribers

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 15 Scalable vBNG solution Enabled By ESC 1.000 active VMs supported by a single ESC x 32.000 Subscribers per XRv9000 = 32.000.000 Subscribers

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 16 Smart Licensing

Router

Cisco Smart Cisco Commerce Firewall Software Manager Workspace Usage Software

Direct Deployment Direct Unified Proxy or SCH Communication Transport Gateway s Offline Monthly Inventory Update

Firewall Air Gap

SSMS

Software

Unified Mediated Deployment Mediated Communication s

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 17 XRv 9000 IOS XR Based vRouter / vBNG Solution IOS XRv 9000: Built on proven IOS-XR Inheriting the evolution of XR to eXR IOS-XRv 9000 IOS-XRv 9000

OSPF EVPN L2TP

Process LLDP LACP ARP SNMP Granular Machine Recovery Packaging to Machine OSPF LLDP IS-IS FIB RIB

BGP- SYSDB LLDP BGP LDP Netflow LS Modular

TWAM 802.1a RSVP VRRP GRE SMU P g Patching Adv. App QOS SR PCEP Y.1731 Telemetry Hosting

Open Netconf EVPN Flow

64bit Tool-able Modular More Modular Patchable Extensible

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 19 IOS XRv 9000: Architected for Success

Separate Control Plane & Data-Plane containers, running in a VM environment LXC IOS XR LC + DATA PLANE LXC LXC L2 L3 MCast Designed to mimic Antares(ASR9000) data-path. ADMIN ACL FIB FIB FIB IOS XR RP Easier to use and Easier to trouble-shoot QOS VM GDPlane API RP Comps CM vAntares vAntares Datapath Routing FM vAntaresDatapathDatapath Protocols CISCO’s proprietary SW based HW assists SM produce best-in-class data-path performance

RIB DP Agent Driver ADMIN IPC ADMIN

ADMIN IPC PD

Interface VPP +FD.IO XR System Infra SystemXR

XR SystemXRInfra Manager B I

Ctrl Ctrl

Eth Ctrl Ctrl

Eth Constructed on Open-source VPP & FD.IO

vmxnet3

Mgmt e1000

virtio Projects. Feature & Performance Advantage

10G PCIE 10G Eth LINUX KERNEL –WRL7(3.14) Supports a variety of I/O Options : Virtio,SR- KVM, ESXi IOV,vmxnet3,e1000, PCIE Pass-through

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 20 Key Use-Cases of XRv9000

APPLIANCE Upto 70 Mn Paths VM BASED PROVEN Industry Leading Scale Based on CISCO IOS XR

APPLIANCE ~160 Gbps Throughput IOS-XR running VM BASED PERFORMANCE ELASTIC on ASR, CRS, NCS L2VPN,L3VPN & MCast Full Featured Scalability from Operations; No Single-Core to serial drawbacks Multiple-Core

32K Sessions per VM APPLIANCE “HW in Software” VM BASED Geo-Red with ASR9000 Traffic Manager TCAM Policer

COMMON MANAGMENT NFVI NSO AGNOSTIC Multi-Domain Path Comp Netconf/Yang VM BASED Compatible All XR Prod

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public IOS XRv 9000: Life Cycle Management

cisco

Service Design

My Designs My Deployments

Deployment Wizard Create Select Scope

Deliver New Folder

Deploy

Operate Engineering Testing Optimize OSS BSS

Netconf/Yang

Service Cisco Network Service Powered Orchestration Orchestrator (NSO)

Server Server

Cisco IOS-XRv 9000 IOS-XRv 9000 IOS-XRv 9000 Prime ESC Vnf M

Hypervisor Hypervisor VIM

NFVI

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public IOS XRv 9000: Efficient Virtual Forwarder

IOS-XRv 9000 Innovative virtual forwarder x86-optimized SW based hardware assists: • SW hierarchical traffic manager with 3 level HQoS, IOS-XRv Control Plane 512K queues High speed interface classification • SW policers that is color aware and nearly and fine grained load balancing 4x faster than DPDK based SW routers IOS-XRv Virtual Forwarder • SW TCAM with logical super key & heuristic cuts Hierarchical QOS Scheduler algorithms RX & Traffic • ½ million Queues Interface Manager TM • 3-Layer H-QOS • Data plane optimized for fast convergence Classification & TX

• Portable 64bit C-code (to ARM based platforms) Forwarding Elastically Scalable Feature Path & Features Common code base with Cisco nPower X family • ACLs • uRPF TCAM PLU Pkt. replication • Marking, Policing • IPv4, IPv6, MPLS • Segment routing • BFD

SW based HW Assists

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 23 IOS XR based Virtual Router • Single VM vRouter Egress Traffic Manager Capabilities • CP/DP Separated in Linux Containers • Fully Featured, High Speed, Elastic Virtual data plane • Modular/Lightweight Admin Plane

Up to 8 queues per subport, deep

2

Q1 Q Q1 Q2 Q1 Q2

QN QN • In-Service Software patches (for majority of bugs) QN buffering, 512k total queues/classes: 1 level strict priority, DWRR, WRED* • Single Socket and multi-socket support • PCIe Passthrough for high performance • RSS and Hyperthreading for highest performance Up to 64k Subports (e.g subscribers), shaped (8Kbs to 100Gbs) with

VM priority propagation LXC LXC LXC

IOS XR Up to 8 vPorts (e.g. shaped PONs), Admin Data Control shaped max rate (100Mbs to Plane Plane Plane 1000Gbs)

XRv Linux Kernel WRL7 (3.14) Up to 8 Ports (Physical or Virti/o)

KVM, ESXi

*also Policing, Marking on classes (not done in TM), with up to 128000 policers, 2500 unique policy- maps BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 24 Legend

Dedicated CPU Core

IOS XRv 9000 – Single Socket DPDK & NIC 2c CP, 10c DP (2xRx, 6xWT, 2xTx)

Worker NIC Thread Receive Thread Transmit Thread NIC

DPDK DPDK Driver Worker Load Driver RX Thread Traffic I/F Balance Mgr Output DPDK DPDK Driver Worker Driver Thread

Worker Thread NIC Receive Thread Transmit Thread NIC

DPDK Worker DPDK Driver Driver Load Thread Traffic I/F RX Balance Mgr Output DPDK DPDK XR Driver Worker Driver Admin RP+LC Thread DPC 10 Data plane cores

DPA

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 25 Legend

Dedicated Multi-socket with CP / DP split CPU Core

DPDK Dedicated DP socket Configuration & NIC 2c CP, 10c DP (8xWT) Socket 0 Socket 1 Worker Thread

Worker Thread

NIC ReceiveReceive Thread Thread Tx Thread NIC Worker DPDK DPDK Driver Thread Driver XR RX RX Admin RP+LC DPDK DPDK Worker Driver Driver DPC Thread QPI

Worker NIC Tx Thread NIC Receive Thread Thread DPDK DPDK Driver Driver DPA RX Worker RX DPDK Thread DPDK Driver Driver

Worker Thread

Worker Thread

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 26 cisco

Service Design

My Designs My Deployments

Deployment Wizard Create Select Scope

Deliver New Folder

Deploy

Operate Engineering Testing Optimize OSS BSS OCS HLR AAA CGF PCRF

Unified Netconf/Yang Northbound interface service NSO models Netconf/Yang Service Orchestrator fastmap ESC Cisco device VNF Manager confd Prime ESC XRv 9000 NEDs models Netconf/Yang Openstack api

vBNG vBNG (XRv 9000) (XRv 9000) Data Center IOS XRv 9000 L2/IP/MPLS Network vBNG Deployment Overview Physical BNG (ASR 9000)

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 27 Achieve Real Time Visibility Through Model Driven Telemetry Embrace the Push Model Model-driven Telemetry Event-driven Telemetry

Multiple Representativ Collection e Yang Model Groups

Push Exceeding Fault Model Thresholds Notification, Remediatio n • Cloud-scale performance • Structured, common Yang • Avoid unnecessary • Mandatory for real-time models (OC, Native) for streaming with events automation in the network easy ingestion triggering telemetry

BUILT FOR SCALE EASY TO AUTOMATE INTERESTING DATA ONLY

XRv9000 is Telemetry Ready

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 28 Automating Network Deployment and Operations Model Driven Configuration

Apps App1 App2 App3 Configuration Operational Self Management State Healing APIs Model-Driven APIs YANG Development Kit (YDK) Programmatic Open Interfaces Protocols Protocol NETCONF RESTCONF gRPC

Encoding XML JSON Open Device Programmability

Transport SSH HTTP HTTP/2

Physical and Virtual Network Models XR Data Models (native, open) Model Driven Telemetry BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 29 IOS XR v9000 BNG Performance and Scaling

XR vBNG Performance with Core XR vBNG Performance with Subscriber Addition Addition 80 100 80 100

77 75 75 55 74 50 50 30 71 25 25

68 0 5 0 8 12 16 20 22 8000 16000 24000 32000 No. of Cores (8K DS Subscribers) No. of Subscribers (22 Cores)

Avg. Bi-Directional Throughput (Gbps) Connections per Second Avg. Bi-Directional Throughput (Gbps) Connections per Second

• All tests performed with Dual-Stack IPoE CPU : Intel(R) Xeon(R) CPU E5-2697 v3 @ 2.60GHz Subscribers with Bi-directional IPv4 IMIX No CPU Pinning Traffic (avg. pkt size 321 Bytes) NIC Used = Intel X510 • Each Subscriber interface configured with 26 No. of Ports : 8x10G with 2x10G Per NIC ACE’s per ACL per subscriber and H-QoS No. Of Sockets – 2 with egress shaper and ingress policer Core Distribution: 1xCP,1xAP,nxDP for all test cases • Session and Service Accounting configured RAM: 16G per NUMA, 32G per VM for 5-minute interval All tests with performed with No Drop Rate – 0.00001% soaked for 3 hours

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 30 XR Geo-Redundancy Overview

Profitable Customer Experiences Stateful Redundancy BNG can be geographically spread out with only L3 connectivity for BNG Sync Can be used for Physical/Virtual Deployments 1:1, M:1 and M:N Redundancy Redundancy in case of • Access Link Failures Multiple Geographically Separated BNG • Line Card Failures • RP Failures • Chassis Failures • Site Failures • VM Failure

Access Node (DSLAM/OLT) Multiple Technology Support Access Nodes are dual/multi-homed for redundancy using a variety of technologies based on the SP network design and choices - MCLAG, Dual Homed, Ring (G.8032), PWHE, CPE etc… Transparent Switching CPEs see one BNG Gateway

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 31 Smart Licenses can be shared across XR BNG’s (Physical and Virtual) Typical overhead of licenses per box ~15% * Average overhead of licenses with Smart Licensing per network ~5%* Option to right size purchase with Subscription based model (annual/tri-annual pricing )

Cost Savings with Smart Licensing

Up to 40% Savings

8k 64k 128k 256k 512k 1024k

Cost With Traditional License Cost With Smart License Additional Overhead Saving

* Average of actual number of licenses procured v/s licenses consumed from live deployments with 8 customers in 5 countries

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 32 What does Mobile Local Loop achieve?

In many markets, wireline connectivity penetration is low or costly or time consuming. There is a better connection of cellular networks and better bandwidth availability

Mobile Local Loop(MLL) solution enables faster time to market and easier customer acquisition, leveraging wireless access

MPLS VPN connectivity over any Ability to connect multiple customers wireless access; 2G,3G,4G WIFI with single CPE- Multi-tenancy

Separate billing capabilities per No Routing complexity on MPLS CE- customer flow PE link

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 34 PMIPv6 in MPLS VPN Wireless Last Mile

vLMA – XRv9000 Multi-VRF CE/PE Routing Anchor

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 35 Mobile Local Loop Solution View

vLMA Multi-VRF CE/PE XRv9000

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 36 Cisco Umbrella (OPENDNS) – Brief Overview

• An extension of DNS () providing phishing protection and content filtering functionalities.

• A cloud based security platform that provides the first line of defense against threats on the internet.

• Identify and block threats before they reach customers’ network or endpoints.

• Provides more visibility into the threats targeting the users.

• Umbrella servers in cloud, • 208.67.222.222 • 208.67.220.220

• Using the additional RR header in DNS requests, Umbrella server classifies and apply the policies specific to the network device XR Umbrella Connector - XR device acting as connector will append the specific RR header in each DNS request passing through the device

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 38 OpenDNS Overview without DNS Encrypt

OpenDNS

DNS HTTP(S) recursive server server (block page)

BNG DNS Request (1) Internet DNS Response (4) Approved Content (5) Web Servers Client

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 39 OpenDNS Overview without DNS Encrypt XR-OpenDNS Open DNS Client Connector

1 Provision Customer Policy Get Token for Device Registration

2 Device (interface) Registration

Device ID DNS Query 3 DNS Query + EDNS 4 Apply Customer Policy

DNS Response 5 DNS Response

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 40 OpenDNS Overview with DNS Encrypt

OpenDNS

DNS HTTP(S) recursive server server (block page)

BNG DNS Request (1) Internet DNS Response (4) Approved Content (5) Web Servers Client

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 41 OpenDNS Overview with DNS Encrypt

Client XR-OpenDNS Connector Open DNS

Provision Policy, Get Token

DNSCrypt Key Request DNSCrypt Key Device (interface) Registration Device id DNS Query

Add EDNS And Encrypt Query

Encrypted DNS Query

Apply Customer Policy

Encrypted DNS Response

Decrypt Response DNS Response

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 42 OPENDNS (Umbrella) – XR Device Registration

• curl -X POST 'https://api.opendns.com/v3/networkdevices' -H • 'Authorization:OpenDNS, • api_key="B0E16D15C32D4E8C996B635AFA9005B9", • token="E36931477BFD4CE37102F3FECDFCBD8000249400"' • -d '{"model":"CiscoIOS- XRv9000","macAddress":"000c29eca028","label”:”PolicyTesting1","serialNumber":"3BDC76A2FF3"}'

• Response • {"deviceId":"010a6c689f50620b”, • ”deviceKey":"CiscoIOS-XRv9000-000c29eca028", • "label”:”PolicyTesting1”, • ”serialNumber":"3BDC76A2FF3", • "phishing":1,"createdAt":1515997008,"originId":125051350,"apiKey":"b0e16d15c32d4e8c996b635afa9005b9","device TypeId":1,"vendorId":51,"organizationId":2399374}

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 43 Sample Configuration

! New CLI ! Set this 8 bytes device-id in opendns header for all subscribers subscribers dns-device-id 0x010A6C68 0x9F50620B !

With above configuration, XRV9K Data plane (Micro-Code) will automatically insert 30 bytes of OPENDNS header in every DNS request packet sent by the Subscribers. First 22 bytes are a fixed content, last 8 bytes represents DEVICE-ID, taken from above configuration. IP source/destination of the packet is not altered. DNS requests should be destined to Umbrella servers. DNS Response packets are not altered by XR. Sent as it is towards Subscribers.

Note: This is just a sample configuration developed for the POC. Productized version of CLI may vary. Subscriber specific device-id may be provided, so that the policies can be different based upon subscriber’s internet-plan.

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 44 Cisco Umbrella Dashboard Devices & Policies

Displays registered list of devices and policies applied

Current policy is to allow only EDU & Financial related domains Block every other domains BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public DNS Request - Blocked Domain

• Response IP is for blocked page

• Current policy is to block any social networking domain

• Additional RR is incremented by 1

• 30 bytes of OPENDNS header is appended in end

• 8 bytes device-id used as per configuration

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 46 DNS Request – Allowed Domain

• Response IP is proper

• Current policy is to allow banking related domains

• Additional RR is incremented by 1

• 30 bytes of OPENDNS header is appended in end

• 8 bytes device-id used as per configuration

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 47 Cisco Umbrella Reporting

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public CSR1000v IOS XE Based vRouter / vBNG Solution & Use Cases Cisco Cloud Services Router (CSR) 1000V Cisco IOS XE Software in a Virtual Appliance Form-Factor Software • Same IOS XE software as ASR1000 and ISR4000

Infrastructure Agnostic • Runs on x86 platforms • Supported Hypervisors: VMware ESXi, Suse Linux KVM, RHEL KVM, Citrix Xen, Microsoft Hyper-V, Cisco NFVIS and CSP2100 • Supported Cloud Platforms: Amazon AWS, Microsoft Azure, Google Cloud Platform

Performance Elasticity • Available licenses range from 10 Mbps to 10 Gbps • CPU footprint ranges from 1vCPU to 8vCPU

License Options • Term based 1 year, 3 year or 5 year

Enterprise-class Networking with Rapid Programmability Deployment and Flexibility • NetConf/Yang, RESTConf, Guest Shell and SSH/Telnet

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 50 CSR1000v Multi-VM System Architecture

VM1(4vCPU CSR 1000v) CSR VMFman2(1vCPU/ CSR 1000HQFv) IOS PPE PPE Pkt Rx CSR 1 1 1 1 CMan Scheduler IRQ vNIC1 vNICn VM Kernel VMFman3 (2vCPU/ CSRHQF 1000v) IOS PPE Pkt Rx CSR 2 2 2 2 CMan Scheduler IRQ vNIC vNIC VM Kernel Guest OSFman Scheduler/ HQF 1 n • Example: 3 CSR VMs scheduled on IOS PPE Pkt Rx 3 3 3 3 CMan Scheduler IRQ vNIC1 vNICn VM Kernel a 2-socket 8-core x86 Guest1 vCPU OS1 vCPU Scheduler2 1 vCPU 1 1 vCPU 0 3 – Different CSR footprints shown Guest OS2 Scheduler vCPU0 3 3 vCPU0 vCPU1 • Type 1 Hypervisor – No additional Host OS represented X86 Server vSwitch 2 vCPU1 • HV Scheduler algorithm governs 3 vCPU0 HV Kernel how vCPU/IRQ/vNIC/VMKernel 2

vNICn Process Queue processes are allocated to pCPUs VM Kernel1 Linux HV Scheduler • Note the various schedulers – Running ships-in-the-night Socket0 Socket1

pCPU0 pCPU1 pCPU2 pCPU3 pCPU0 pCPU1 pCPU2 pCPU3

pCPU4 pCPU5 pCPU6 pCPU7 pCPU4 pCPU5 pCPU6 pCPU7 Memor Storage Memor y y BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 51 CSR 1000v IOS XE Threads to vCPU Associations

IOS XE processing threads in the Guest OS are statically mapped to vCPUs threads vCPU threads in turn are allocated to physical cores by the hypervisor scheduler

CSR Control Plane Data Plane Data Plane Data Plane Rx footprint PPE HQF processing 1 vCPU vCPU 0 2 vCPU vCPU 0 vCPU 1 4 vCPU vCPU 0 vCPU 1 & 2 vCPU 3 8 vCPU vCPU 0 vCPU 1-5 vCPU 6 vCPU 7

NOTE: vCPU allocations subject to change without further notice

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 52 Network Driver Matters! performance

Kernel Driver Virtual Kernel Driver Virtual Virtual Kernel Driver Machine virtqueueQEMU FE Machine virtqueue Machine

QEMU Driver User-space Compute Host Compute Host Compute Host switch User space User space User space Tap Device

OVS / LB Compute Host Compute Host Compute Host Kernel space Kernel Drivers Kernel space Kernel space

eth1 eth1 eth1 Kernel space vswitch User space DPDK SRIOV AWS Enhanced Networking

BRKSPG-2063 © 2019 CiscoAzure and/or its Accelerated affiliates. All rights reserved. Networking Cisco Public CSR 1000V Performance on VMWare ESXi/vSwitch

Model Inc UCSC-C240-M3S Processor Type Intel® Xeon® CPU E5-2643 v2 @ 3.50GHz

ESXi Version VMWare ESXi 6.5.0

IOS-XE Version IOS-XE 16.8.1

ESXi / vSwitch / Single Feature / IMIX 5000 4500 4000 3500 3000 2500 2000 1500

1000 Throughput(Mbps) 500 0 IPSec (Single IPSEC(3DES CEF ACL NAT L4 FW Basic QoS Basic HQoS AES) ) 1 vCPU 4459 4423 744 156 2300 3415 4375 1908 2 vCPU 4535 4707 775 156 2460 3701 4687 2688 4 vCPU 3125 3120 1364 261 2666 3497 3281 2080 Traffic Profile : IMIX {64 byes (58.33%), 594 bytes (33.33%), 1518 bytes (8.33%)} PDR(Packet Drop Rate): 0.01% BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 54 CSR 1000V Performance on VMWare ESXi/SR-IOV Model Cisco Systems Inc UCSC-C240-M3S

Processor Type Intel® Xeon® CPU E5-2643 v2 @ 3.50GHz

ESXi Version VMWare ESXi 6.5.0

IOS-XE Version IOS-XE 16.8.1 ESXi / SR-IOV/ Single Feature / IMIX 18000 16000 14000 12000 10000 8000 6000 4000

Throughput(Mbps) 2000 0 IPSec (Single CEF ACL NAT L4 FW Basic QoS AES) 1 vCPU 6538 4727 1062 3361 3809 5764 2 vCPU 7219 5192 1140 3569 4058 6291 4 vCPU 8757 6983 1780 3838 3843 7774 8 vCPU 16937 14605 2943 6467 7763 15418

Traffic Profile : IMIX {64 byes (58.33%), 594 bytes (33.33%), 1518 bytes (8.33%)} PDR(Packet Drop Rate): 0.01% *The max throughput license we offer today is 10Gbps BRKSPGand please-2063 contact us© if 2019 you Cisco have and/or use its affiliates. case All requires rights reserved. more Cisco than Public 10G Cisco CSR 1000V Performance on Public Clouds

IOS-XE 16.8.1 release, large packet, with Intel Meltdown and Spectre fix.

Size CEF IPSEC Size CEF IPSEC Size CEF IPSEC (Mbps) (Mbps) (Mbps) (Mbps) (Mbps) (Mbps) T2.medium 450 200 D2_v2 1200 900 N1-standard-1 1850 1100 M3.Medium 300 250 DS2_v2 1200 1100 N1-standard-2 3700 1250 C4.large 650 650 D3_v2 1250 1000 N1-standard-4 7450 2000 C4.xlarge 850 850 DS3_v2 1250 1100 N1-standard-8 7850 3800 C3.2xlarge 1300 1000 D4_v2 1200 1100 C4.2xlarge 2300 2300 DS4_v2 1250 1100 C4.4xlarge 4600 4200 C4.8xlarge 6200 4500

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 56 CSR1000v vBNG Key Numbers to Remember

8.000 PPPoE / IPoE sessions

2,5 Gbps throughput for PPP sessions per CSR1000v *

5 Gbps throughput for IP sessions per CSR1000v *

* single instance, IMIX, without IO/Performance optimization

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 57 Tier1 SP Use Case - CSR1000v as virtual BNG

RT OSS

Network Control Orchestrator

HGWs L2 VLAN attachments vBRAS vLNS – Retail ISP LNS –Retail ISP x86 servers

vBNG vLNS IPv6 IPv6 Core tunnels vRouter LNS VPEF CSR vLNS LNS VMs LNS Internet CSR LNS VMs

HGWs DHCPv4 RADIUS IPv6 tunnel L2TPv2oIPv4 Retailer end-points tunnels RADIUS

WAN Network Data Center Physical LNS

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 58 Use Case – PPPoE in L2TPv3 Over IPv6 Tunnels

OLT/ DSLAM

Edge/Agg DCI Router GW Router PPPoE CPE1 IPv6 Network CPE1 PPPoE

IPoE OLT/ CPE1 DSLAM

OLT/ DSLAM

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 59 Use Case - PPPoVXLAN to vBNG with GEO Resiliency CPU 5x vBRAS @ 2Gbps (12c, 48GB) vBRAS stateless tunnel (CSR1000V) core core (eg. VXLAN) vBRAS R1 (CSR1000V) VTEP HV core core (ASR1K / ASR9K) DC-1 core VTEP vBRAS (CSR1000V) PE HV core core (ASR1K / ASR9K) PPP core Switch Access ISIS/BGP vBRAS Node Client (CSR1000V) core core anycast backup tunnel endpoint vBRAS • VxLAN Tunnel is established (CSR1000V) core core vSwitch between aggregation Switch Pan-IP and vBNG CPU 5x vBRAS @ 2Gbps • vBNG extracts PPP packets (12c, 48GB) vBRAS out of the VxLAN Tunnel and (CSR1000V) core core terminates PPP vBRAS (CSR1000V) core core VTEP • Simple BDI Interface on vBNG: DC-2 HV core interface BDI10 vBRAS HV (CSR1000V) core core no ip address core ISIS/BGP vlan-id dot1q 2000 vBRAS R2 pppoe enable group global (CSR1000V) (ASR1K / ASR9K) core core ! vBRAS ! (CSR1000V) core core vSwitch BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 60 ISP Use Case - CSR1000v As virtual LNS

Wholesaler Edge Edge ASR9K MPLS Core

Mobile Wholesaler Mobile MPLS VPN

Wholesaler Wholesaler Edge LAC Edge ASR9K CSR1000v LNS

CSR1000v LNS

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 61 Conclusion Summary of The Whole Presentation

• Cisco offers both IOS XE (CSR1000v) and IOS XR (XRv 9000) based vBNG solutions

• Both vBNG solutions include: • Cisco vBNG VNF: CSR 1000V and/or XRv 9000 • NSO / ESC Orchestration Software • UCS Server Hardware and Setup Optimization • Smart Licensing, Monitoring and Operation Guidance

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 63 With Cisco vBNG solutions you can build

Cost- Scalable Flexible Effective

Broadband Aggregation BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public Cisco Webex Teams

Questions? Use Cisco Webex Teams (formerly Cisco Spark) to chat with the speaker after the session How 1 Find this session in the Cisco Events Mobile App 2 Click “Join the Discussion” 3 Install Webex Teams or go directly to the team space 4 Enter messages/questions in the team space cs.co/ciscolivebot#BRKSPG-2063

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 65 Complete your online session survey

• Please complete your Online Session Survey after each session

• Complete 4 Session Surveys & the Overall Conference Survey (available from Thursday) to receive your Cisco Live T- shirt

• All surveys can be completed via the Cisco Events Mobile App or the Communication Stations

Don’t forget: Cisco Live sessions will be available for viewing on demand after the event at ciscolive.cisco.com

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 66 Continue Your Education

Related Demos in Walk-in Meet the sessions the Cisco self-paced engineer Showcase labs 1:1 meetings

BRKSPG-2063 © 2019 Cisco and/or its affiliates. All rights reserved. Cisco Public 67 Don’t miss the Service Provider Hub !

5G Virtual Reality Demos Experience Experience 7 Essential Enjoy “Running with the 5G Bull” Technology and 3 Generate immersive demo Revenue with 5G demos and join our guided demo tours

More Sessions Check out the Service Provider Digital Transformation Assessment Technology Track by Take a meeting session to benchmark your scanning the code digital readiness against your industry peers

Want to see use cases, solution details and more. Visit www.cisco.com/go/sp Thank you