Carrier : Extending Ethernet from the LAN to WAN and beyond

30th September 2014

Professor Andy Sutton CEng FIET MITP FBCS

1 Contents

• Networking protocol architecture • Ethernet – the LAN protocol • Telco wide area networking • Introduction to the MEF • • Carrier Ethernet 2.0 • Use case review – international leased lines and mobile backhaul • Latest developments • Summary

2 Networking architecture models ISO OSI / Arpanet / IETF / Cisco…

Application Application Presentation Application Application /Process Session

Transport Transport Transport Host to Host Network Network Internetwork

Data Link Data Link Network Network Interface Physical Interface Physical

3 Ethernet

• Xerox PARC Ethernet was developed at Xerox PARC during the 1970s • This original Ethernet used a shared coax cable to transmit data between basic computers • Robert Metcalfe was one of the inventors and was largely responsible for commercial promotion and industry adoption during the 1980s • The Standard • IEEE 802.3 - 1985

• The Famous Diagram  • Robert Metcalfe presented this diagram in 1976 to the National Computer Conference.

4 Ethernet has evolved…

• Ethernet transmission speeds have evolved to support 10, 100, 1000 and 10000Mbps with 100000Mbps systems being deployed in backbone networks – work is on-going on even faster data rates! • Ethernet LAN topology has evolved, less CSMA/CD on access cables as networks are increasingly based on switched Ethernet • Full duplex operation is common on modern 100 and 1000Mbps links • Most commonly used Ethernet frames are formatted in accordance with the Ethernet 2 (also known as DIX Ethernet) frame format:

Pre- SFD Destination Source Type CRC Data Payload amble Address Address field 46 - 1500 bytes 7 bytes 1 byte 6 bytes 6 bytes 2 bytes 4 bytes

5 Ethernet copper cable specifications

• Cat 3 is only good for 10Base-T (10 Mbps) and telephony • Cat 5/5e can be used for 100Base-Tx (100 Mbps) - This type of cable has many more twists per metre than cat 3. • Cat 6 can be used for 1000Base-T (1 Gbps) - It uses thicker conductors and better insulation than cat 5 – Increasingly the norm nowadays… • PoE can operate over cat 5 or 6

6 Wide range of fibre connectivity

SC ST MTRJ LC 7 Ethernet & Virtual LAN’s 802.1Q - 2005 introduced the concept of Virtual LAN’s

• Original frame for reference (from earlier slide):

Pre- SFD Destination Source Type CRC Data Payload amble Address Address field 46 - 1500 bytes 7 bytes 1 byte 6 bytes 6 bytes 2 bytes 4 bytes

• 802.1Q frame – also known as C-tag frame in Carrier Ethernet terminology

Destination Source VLAN Type CRC Data Payload Address Address tag field 46 - 1500 bytes 6 bytes 6 bytes 4 bytes 2 bytes 4 bytes

TPID PCP CFI VID

0x8100 (.1Q tag) 16 bits 3 bit 1 bit 12 bits 8 Telco wide area networks

• Fixed telecommunications network operators have traditionally been the providers of wide area connectivity • This has been provided with telco specific transmission technologies • These digital technologies have traditionally been based on time division multiplexing (TDM) principles - PDH and SDH • Plesiochronous Digital Hierarchy and Synchronous Digital Hierarchy

9 An Overview of the Work of the MEF

10 Since 2001, Developing, Marketing and Certifying Standards for Carrier Ethernet Services

Standards Operations Education Compliance

11 Global Expansion from Metro to Carrier Ethernet

• The Beginning: – The MEF was formed in 2001 to develop ubiquitous business services for Enterprise users principally accessed over optical metropolitan networks to connect their Enterprise LANs

• Expansion to Carrier Ethernet – The success of Metro Ethernet Services caught the imagination of the world as the concept expanded to include • Worldwide services traversing national and global networks • Access networks to provide availability to a much wider class of user over fiber, copper, cable, PON, and wireless • Economy of scale from the resulting converged business, residential and wireless networks sharing the same infrastructure and services • Scalability & rapid deployment of business applications • Adoption of the certification program – While retaining the cost model and simplicity of Ethernet

12 Carrier Ethernet Defined for Service Providers: for Business Users:

A set of certified network elements A ubiquitous, standardized, carrier- that connect to transport Carrier class Service and Network defined Ethernet services for all users, locally by five attributes that distinguish it & worldwide from familiar

LAN based Ethernet Carrier Ethernet services are carried over physical Ethernet networks and other legacy transport technologies

13 The 5 Attributes Carrier Ethernet (1)

Attribute 1: Standardized Services

• E-Line, E-LAN provide transparent, private line, virtual private line and multi-point to multi-point LAN services. • A ubiquitous service providing globally & locally via standardized equipment • Requires no changes to customer LAN equipment or networks and accommodates existing network connectivity such as, time- sensitive, TDM traffic and signaling • Ideally suited to converged voice, video & data networks • Wide choice and granularity of bandwidth and quality of service options

14 The 5 Attributes Carrier Ethernet (2)

Attribute 2: Scalability

• The ability for millions to use a network service that is ideal for the widest variety of business, information, communications and entertainment applications with voice, video and data • Spans Access & Metro to National & Global Services over a wide variety of physical infrastructures implemented by a wide range of Service Providers • Scalability of bandwidth from 1Mbps to 10Gbps and beyond, in granular increments

15 The 5 Attributes Carrier Ethernet (3)

Attribute 3: Reliability

• The ability for the network to detect & recover from incidents without impacting users • Meeting the most demanding quality and availability requirements • Rapid recovery time when problems do occur, as low as 50ms

16 The 5 Attributes Carrier Ethernet (4)

Attribute 4: Quality of Service

• Wide choice and granularity of bandwidth and quality of service options • Service Level Agreements (SLAs) that deliver end-to-end performance matching the requirements for voice, video and data over converged business and residential networks • Provisioning via SLAs that provide end-to-end performance based on CIR, frame loss, delay and delay variation characteristics

17 The 5 Attributes Carrier Ethernet (5)

Attribute 5: Service Management

• The ability to monitor, diagnose and centrally manage the network, using standards-based vendor independent implementations • Carrier-class OAM • Rapid service provisioning

18 Carrier Ethernet Terminology

• UNI (User-to-Network Interface) – Physical interface/demarcation between service provider and subscriber – Service start/end point • Ethernet Virtual Connection (EVC) – An association of two or more UNIs • Three types of EVC – Point-to-Point – Multipoint-to-Multipoint – Rooted Multipoint (Point-to-Multipoint) • EVCs and Services In a Carrier Ethernet network, data is transported across Point-to-Point, Point-to- Multipoint and Multipoint-to-Multipoint EVCs according to the attributes and definitions of the E-Line and E-LAN services • NNI (Network-to-Network Interface) – Demarcation/peering point • Between service providers (ENNI) • Between service provider internal networks (I-NNI)

1919 20 A new generation of CARRIER ETHERNET

Eight Ethernet virtual and port-based services Delivers 3 powerful features: Standardized Multi-CoS, Interconnect, Manageability Enables enriched Mobile & Business Services Enterprise and Cloud Applications, New simple Ethernet access connections Supported by new services-oriented Certification

21 Carrier Ethernet Generations Framework

Generations Future

A Carrier Carrier Ethernet 1.0 Carrier Ethernet 2.0 Carrier Ethernet Ethernet networks and networks and services Future Generation Generation services enable enable multiple classes networks and services defines the standardized of service and will enable simplified, evolution of MEF Ethernet services to manageability over automated service compliant be delivered over interconnected provider delivery networks and one provider’s networks services network

22 Attributes

2 Mbps CIR for control CoS 6

CoS 4 10 Mbps CIR for VoIP EVC New CE 2.0 Class 1

20Mbps CIR for UNI CoS 2 CE 2.0 Multi-CoS VPN data traffic of Service Extensions

68Mbps for Internet Access EVC2 Industry’s First Standardized Multi-CoS Application & Distance-Oriented Performance Objectives for Next Gen SLAs Enables New Level of Network Efficiency, Responsiveness for Enterprises & MBH

CE 2.0 Service Management CE 2.0 Interconnect Automated management Brings Scalability Integrates autonomous, Cloud 3 Recent/New Specs for Retail Provider’s CE networks, as a CE single Network ENNI CE Exchange SOAM, FM/PM regional/global network ENNI New Metrics New WholesaleUNI Service UNI Wholesale simplifies lowers costs,Access adds Network revenue

23 Service Types 4 Port-Based services, 4 VLAN Aware Services

E-Line E-LAN • Virtual Private Lines (EPL) • Multipoint L2 VPNs • Ethernet Private Lines (EVPL) • Transparent LAN Service UNI • Ethernet Internet Access UNI • Multicast Networks Multi-point to Multi-point EVC UNI Point-to-Point EVC UNI UNI

E-Tree E- Access • Rooted Multi-Point L2 VPNs • Wholesale Access Services • Traffic Segregation Point-to-Point EVC • Access EPL UNI UNI ENN • EP-Tree, EVP-Tree Rooted • AccessUNI EVPL I Carrier Ethernet Multipoint EVC Access Network Carrier Ethernet UNI UNI Service Provider E-Access

24 Carrier Ethernet 1.0 & 2.0 Overview

Carrier Ethernet Generation Characteristics Standardized Multi-CoS, Managed, Interconnected Services E-Line E-LAN E-Line E-LAN E-Tree E-Access Services MEF 6.1 & 6.1.1, 33 MEF 6 Specs & IAs MEF 22.1 Supporting Work

Attributes MEF 10.2 & 10.2.1, 26.1 MEF 10 & IAs MEF 13, 20, 23.1 Management MEF 7, 15 MEF 7.1, 16, 17, 30, 31 Enabled Applications

MBH 2G/3G Migration 4G MBH Migration, MBH Optimization Local, Regional, National, Global Business Services Metro, Regional Application , distance oriented, Private Cloud Wholesale - Buy/Sell Access Services

IA= Implementation Agreement See “MEF Technical Foundation” on MEF site 25 Services Using E-Line Service Type

Ethernet Private Line (EPL) • Replaces a TDM Private line • Port-based service with single service (EVC) across dedicated UNIs providing site-to-site connectivity • Often delivered over SONET/SDH • Most popular with new providers due to its simplicity • Example shows two CEs devices each with dedicated port on Network equipment

UNI Separate Hosted Ports CE Application or UNIs Branch Office CE

Carrier Ethernet Network ISP POP CE Internet

Point-to-Point CE UNI

26 Services Using E-Line Service Type

Ethernet Virtual Private Line (EVPL) • More than just replacement of Frame Relay or ATM Layer 2 VPN services • Enables multiple virtual service sconnections each with multiple classes of service, delivered over single physical connection (UNI) to customer premises • Most efficient service and becoming the most popular – Optimizes use of bandwidth and ports • Supports “hub & spoke” connectivity via Service Multiplexed UNI at hub site

Service Internet Multiplexed UNI UNI Ethernet UNI CE

Carrier Ethernet Network CE

UNI CE Point-to-Point

27 Services Using E-LAN Service Type

EP-LAN UNI

Ethernet Private LAN UNI • Port-Based CE • Each UNI is dedicated to the CE EP-LAN service CE • Example use: Transparent LAN UNI Multipoint-to-Multipoint

EVP-LAN ISP POP Internet

CE Ethernet Virtual Private LAN UNI UNI • VLAN-Aware • Service Multiplexing allowed at UNI Point-to-Point CE • Example use : Internet access and corporate VPN via one UNI CE CE UNI

Multipoint-to-Multipoint UNI

28 Services Using E-Tree Service Type

Ethernet Private Tree (EV-Tree) EP-Tree UNI • Allow root-root and root-leaf communication Rooted-Multipoint (but not leaf-leaf) Leaf

• Provides traffic segregation for cloud services, Root Leaf franchise applications, etc. CE Leaf UNI • Requires dedication of the UNIs to the single EP-Tree service

EVP-Tree Ethernet Virtual Private Tree (EVP-Tree) UNI CE • Allows each UNI to support multiple Rooted-Multipoint simultaneous services Multipoint to Root Multipoint • Multiple Roots are supported for resiliency • Leaf for one service may be root for another service UNI CE

29 Services Using E-Access Service Type E-Access Service Type defined in MEF 33 – Simplifies and standardizes Access service interconnection,

buying & selling wholesale Ethernet, Carrier Ethernet UNI (Access) * delivery of off-net services Service Provider End-User

Carrier Ethernet ENNI (Retail)* UNI Access EPL Service Providers, • First UNI-ENNI Wholesale Service Carrier Ethernet Exchanges, etc. End-User • Port based: at the UNI UNI Access EPL • May form part of EP-LAN service Ethernet Virtual Connection (EVC)

Access UNI Retail Access EVPL Service Service Provider Provider • UNI-ENNI Wholesale Service End- UNI ENNI User • VLAN-Aware Service (at the UNI) UNI • May form part of EVP-LAN service

*The Retail Service Provider typically has the business relationship with the End-User End-User end user and contracts with the Access Service provider. However, in more Access EVPL than 90% of cases service providers take both roles, often at the same time. Other market terms may also apply. The terms Operator Virtual Connection, OVC, or Operator should not be used in MEF marketing presentations Ethernet Virtual Connection (EVC)

30 Carrier Ethernet is Delivered Over Variety of Access Media

Carrier Ethernet provides consistent services delivered to users connected over the widest variety of access networks

Ethernet Direct Fiber Ethernet Ethernet Ethernet over Packet Wireless G.8032 Ethernet Ring MSO/ Cable COAX

Direct Fiber Bonded Copper IEEE 802.3z, ae, G.8031, etc. Ethernet Carrier 1 Ethernet SONET/ SDH TDM PON Fiber WDM Ethernet Carrier 2 Fiber

DS3/E3 Bonded T1/E1

Ethernet Ethernet Ethernet UNI ENNI Ethernet Ethernet

31 Terminology

Note that provider edge (UNI-N) devices are wholly within the provider Carrier Ethernet Network UNI & ENNI demarcation points match diagrams in MEF 26 and later. Where practical, lines between UNI-C and UNI-N etc., are not shown. The demarcation points touch the edge of the clouds

End User EVC Subscriber End User Headquarters Subscriber Branch Site UNI Service Provider 1 ENNI Service Provider 2 UNI CE

Carrier Ethernet Network Carrier Ethernet Network CE ENNI-N UNI-N UNI-C UNI Hosted Internet Applications Notes EVC: Ethernet Virtual Connection UNI: User Network Interface. the physical demarcation point between the responsibility of the Service Provider and the responsibility of the Subscriber ENNI: External Network to Network Interface; the physical demarcation point between the responsibility of the two Service Providers Best delivered using MEF certified services and products

“In a Carrier Ethernet network, data is transported across Point-to-Point and Multipoint-to-Multipoint Ethernet Virtual Connections according to the attributes and definitions of the E-Line, E-LAN, and E-Tree services”

32 CE 2.0 Manageability

Many Management Related Projects: very active MEF Area Recent and New Management Related Technical Work Management Information Model (MEF 7.2) SOAM Fault Management IA (MEF 30.1) SOAM FM MIB (MEF 31) SOAM Performance Monitoring IA (MEF 35) SOAM PM MIB (MEF 36) SOAM FM & PM YANG Modules (MEF 38, MEF 39) UNI and EVC Definition of Managed Objects (MEF 40) Upcoming Management Related Technical Work Service Activation Testing (SAT) SOAM Fault Management Phase 2 IA Ethernet Service Latching Loopback Service Activation Testing PDU & Protocol Cloud/Dynamic Ethernet Information Model Upcoming Related Services Technical Work MEF 10.3 UNI & EVC Service Attributes Ethernet Access Services with vNID option

33 Interoperability events

Source: http://www.eantc.com/ 34 802.1ah frame Carrier Ethernet scalability Payload Ethertype Original frame 802.1Q frame 802.1ad frame C-VID Ethertype Payload Payload Payload S-VID Ethertype Ethertype Ethertype Ethertype DA DA VID C-VID SA SA Ethertype Ethertype DA S-VID I-TAG Ethertype SA Ethertype DA B-VID Ethertype SA B-DA Provider Bridging - Q in Q Provider Backbone Bridging - Mac in Mac B-SA 35 Ethernet leased line Site B

Once the physical connection and UNI is established the local carrier can offer a wide range of additional services over this infrastructure – office interconnect, Internet access, IP telephony etc… Local tail to connect ‘far-end’

Local Carrier Ethernet E-NNI operator who E-NNI ‘owns’ the customer

Transit MEN/CEN

Site A

36 Mobile backhaul

• Mobile backhaul is the term used to describe the connectivity between a cellular radio base station and the mobile operators core network site • Backhaul transmission has evolved from TDM E1’s with PDH and SDH to Carrier Ethernet • Legacy base station interfaces’ were carried over Carrier Ethernet backhaul via pseudo-wire emulation techniques • The latest generation of cellular base stations have an IP transport network layer presented via a 1Gigabit Ethernet interface to the Carrier Ethernet transport network • Examples include BT MEAS, VM GE and Ethernet capable microwave radio systems

37 CE mobile backhaul

38 Latest development - Cloud…

Source: http://metroethernetforum.org/carrier-ethernet/cloud-services 39 Summary

• Carrier Ethernet, driven by the work of the MEF, has fundamentally changed the way wide area and global network connectivity is delivered • Carrier Ethernet offers abstraction between the Ethernet transmission and Ethernet services layer • Global standardisation has created a mass market for Carrier Ethernet products and services • Telco’s are migrating towards Ethernet transmission and Ethernet services, slowly phasing out legacy TDM products • Carrier Ethernet is not LAN based Ethernet, there are many enhancements… • Check out the MEF website: • http://metroethernetforum.org/

40 Sources of information

Metro Ethernet Forum: http://www.metroethernetforum.org/ Ethernet Academy: http://www.ethernetacademy.net European Advanced Networking Test Centre: http://www.eantc.com/ IEEE Ethernet specifications: http://standards.ieee.org/about/get/802/802.3.html

MEF-CECP 2.0 Exam Study Guide - Jon Kieffer and Ralph Santitoro - ISBN: 978149474243

Mobile backhaul overview: http://eandt.theiet.org/magazine/2011/05/better-backhaul.cfm 4G technology: http://mycommunity.theiet.org/communities/videos/210/768 Mobile backhaul evolution: https://www.academia.edu/11199967/Mobile_Backhaul_Evolution

41 Thank You!

[email protected]

42