Industry & Technology Developments: Ultrahd and IP Video Production

Industry & technology developments: UltraHD and IP video production

BRKSPV-3112

Thomas Kernen Consulting Systems Engineer Agenda

• Beyond HD: Ultra High Definition • Next generation: IP video production infrastructure

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public 3 Beyond HD: Ultra High Definition Why Ultra High Definition? History of High Definition • Early work to improve SD systems: – Baird 600 line color system in 1940 – French 819 lines (1949 - 1983) • Initial HD systems: – NHK Color in 1972 (1125 lines) – MUSE (1125 lines) in Japan with commercial broadcasting from 1994 – HD-MAC trials from 1990 to 1993 (1152 lines) • Current HD systems: – ATSC approved in December 1996, official public HD service launch in 1998 – Commercial DVB broadcasts started on January 1st 2004 (Euro1080 channel)

• Higher spatial resolution • Better immersion with larger field of view – Shorter ideal viewing distance than HD • Higher frame rates for better motion portrayal • Benefit for larger displays (50” and above) • Comparable to high end cinema experience • Next sales cycles for displays manufactures • To be introduced with new services

Source: ITU BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public 6 Ultra High Definition systems: 2 levels ITU-R BT.2020 • Ultra HD-1: 3840x2160 24, 50, 60, 120Hz – Near term evolution: 4x the resolution of current High Definition • Ultra HD-2: 7680x4320 24, 50, 60, 120Hz – Long term evolution with ongoing trials, 16 times the resolution of current HD • Improved colorimetry: – Covers 99% of Pointer’s gamut of real surface colors – HD colorimetry (Rec.709) misses out Red London Buses & Green in the Californian Highway Signs • 10 and 12-bit depth • Progressive scanning mode only – No support for interlaced legacy

• Content dependent • Provides an impression of higher resolution • In broadcast world, higher than 50/60Hz • New issues with conversions between rates? • Further research being conducted in this space

• Brightness levels on modern displays much higher than when CRT based specifications where designed – CRT: 100 nits (cd/m2). Modern displays >1000 nits. Some prototype models >6000 nits . Camera vendors providing digital sensors with higher dynamic capabilities . Provide detail in low contrast situations: – Details in high brightness or dark areas . Improve light reflection (specular) on materials and light sources – Realism and aesthetics . Multiple industry proposals under discussion

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public UHD-1 (4K) and UHD-2 (8K) Production Uncompressed delivery • 2160p50/60 (10-bit 4:2:0 & 4:2:2) 12 Gbit/s • 2160p50/60 (12-bit 4:2:0, 4:2:2, 4:4:4) 24 Gbit/s • 4320p50/60 (10-bit 4:2:0 & 4:2:2) 48 Gbit/s • 4320p50/60 (12-bit 4:2:0, 4:2:2, 4:4:4) 96 Gbit/s

• ITU-R BT.2020-1 (production standard) additionally supports 120Hz – 100Hz and 120/1001 under discussion

• Double the bitrates for High Frame Rate!

• H.264/AVC Intra updated to support UHD resolutions in contribution • MPEG-2 TS based specifications updated – Signaling & bitstream definition: codec, spatial resolution, color space • CE Vendors: Initially pushing for higher resolution and no additional features – Baseline requirements: 2160p50/60, Rec. 709, 8-bit, PCM 2.0 audio = QuadHD! • Broadcasters, content producers: Full value proposition to clearly differentiate – Many believe that if UHD is to succeed, must disrupt the market as HD did vs. SD or color vs. B&W • Studios mandating use of HDCP 2.2 for UHD content protection

• Theatrical productions: – 35 or 70mm cinema print (scanned and converted to 4K format) – 4K Digital Cinema production, editing and play out in cinemas Note: 4K Digital Cinema resolution is 4096x2160 • Broadcast productions: – Trials for shooting live content • Sports: Roland Garros, Wimbledon, Sochi Olympics, FIFA World Cup, Commonwealth Games • Natural History: Survival (BBC), Galapagos (BSkyB) • Drama: House of Cards, Marco Polo and many of the 2014/2015 shows – Requires new production tools/trucks, photography style, lenses, makeup, lighting, … • Distribution: – Rely on new HEVC encoding standard. Trials with H.264/AVC also exist – HDMI 2.0 supports up to 4K@60fps

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Delivery Over the top • Netflix – UHD support announced at CES 2014 – 2 profiles: 11Mbit/s and 15Mbit/s – Display partners: Sony, LG, Samsung, Vizio – HDR: Marco Polo in UHD HDR • 20% more bandwidth required • If constraint, drops back to HDR SD vs. dropping HDR – HDR display partners: Sony, LG • Amazon Instant Video – Announced at CES 2014 – Display partner: Samsung – Content providers: Warner Bros., Lionsgate, 20th Century Fox, and Discovery • Others: Technicolor M-GO, Comcast, DirecTV, YouTube BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public 19 Satellite IPTV Cable

20 BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Delivery Ultra HD Blu-Ray • Announced at CES 2015 • Available by end of 2015 • UHD-1 (3840×2160) • HEVC encoded 10-bit video • Video bitrate up to 100Mbit/s • High Dynamic Range • Frame Rate up to 60Hz • BT.2020 colour gamut • New 66GB and 100GB discs required

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public 21 Complex ecosystem Worldwide coordination required • Production – Interfaces and content exchange – SMPTE/ITU-R driven • Contribution – DVB standards – EBU/VSF recommendations • Distribution – DVB/SCTE/ATSC/ARIB standards – Industry forums (Digital Europe, CEA) • CE vendors – Interfaces and “marketing labels”

• SMPTE: Production – Interfaces: ST 425-5 (Quad 3G-SDI links) & ST 2082 (12G-SDI) – HDR: ST 2084 (HDR EOTF) & ST 2086 (Metadata) – Ultra HD Ecosystem report https://www.smpte.org/standards/reports • DVB Ultra HD 1 phase 1: Distribution – 2160p50/60 with Rec.709 & 2020 color gamut, HEVC 10 bit support – TS 101 154 v.1.12.1 approved. Bluebook available. ETSI version pending • DVB Ultra HD 1 phase 2 under discussion, possible additions are: – High Frame Rate, High Dynamic Range, full Rec.2020 color gamut, new audio systems • Work ongoing in SCTE for US cable market

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public 23 Dolby Vision Combination of enhancements to build a UHD system • Initially announced at CES 2014 • Partnerships and specifications from production to delivery • Displays: Sharp, TCL and Vizio • Chipsets: Sigma Designs, Altera • Content providers: Netflix, VUDU, Amazon Instant Video, and Microsoft Xbox Video, Warner Bros • Post Production editing: Filmlight, SGO, Blackmagic • Projection: Christie

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public 24 Ultra High Definition Summary • Higher spatial resolution, frame rates and wider field of view – More realistic and immersive experience • More accurate colour representation, higher dynamic range • Production and distribution chains need upgraded • HEVC to distribute content due to higher bandwidth requirements • New displays and HDMI 2.0 specification to enable delivery to end point • Distribution standards (DVB, SCTE, ATSC, ARIB) need to update specifications • OTT ahead of the delivery game for now • QuadHD isn’t Ultra HD!

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public 25 Next generation IP video production infrastructure Production Post Primary Secondary Consumption Production Contribution Post Consumer Production Distribution/OTT Distribution Contribution production MAM Direct to Home (DTH)

IP Home Over The Air (DTT) News Gathering Post Production IP IP Network Telco (Wireline)

Sport Events IP Cable

IP Studio-to-Studio Production Data Center CDN OTT Wireless

Professional Media Networks IP enabled distribution

• Interconnecting live, professional-quality video over Ethernet inside the broadcast production facility • Converging from SDI & Ethernet flows to just Ethernet • Moving from SDI matrix switches to a scalable data center interconnect model using modern Ethernet switching

Standardisation

Ethernet commoditization

Ultra High Definition

Remote Production

Video File Editing Transfer

Contribution Network

Production /Master Control

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Network requirements for Media Production Guaranteed Low Latency • Deterministic, bounded & guaranteed end-to-end Latency Precision Time & Sync • Video/Audio endpoint sync & lock, with micro-sec accuracy Network Resilience and Zero Congestion Loss • Reservation of network resources across redundant paths for zero congestion loss Network Programmability and Orchestration • Granular real time Network Visibility, Control and troubleshooting Network Security • Protect network operations from any malicious attacks

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public 32 Standardisation Industry efforts to address all-IP Production • SMPTE’s Beyond the Digital Conversion: The Integration of Information Technology and Professional Media – https://www.smpte.org/standards/reports • JT-NM RFT Gap Analysis Report – https://tech.ebu.ch/docs/groups/jtnm/GapAnalysisReport_231213.pdf • JT-NM Phase 2 Interim Report – https://tech.ebu.ch/docs/groups/jtnm/JT- NM%20Phase%202%20Interim%20Report%20for%20IBC.pdf • Major technical challenges: – Transport of essence (audio and video) over IP – Synchronization of audio/video endpoints – Integration into control systems

Source: an anonymous broadcast engineer

• Digital sources are very tightly synchronized: Less than 1 microsecond • Frame synchronizers used to compensate for timing variations • Common sync distribution reduces dependencies on individual sync generators • Locking to a common sync and time reduces frame drops/repeats • Synchronization within studio must happen within seconds • Common sync simplifies conversion between different video systems • Common time allows simple time stamping • Common time would allow simple storage and replay of the video content

Service Providers Industrial Solutions Financing and Trading

Smart Grid Media Science

• Standard for a Precision Clock Synchronization Protocol for Networked Measurement and Control Systems • Precision Time Protocol (PTP) is, like NTP, a Two Way Time Transfer protocol (TWTT). • PTP has been designed to obtain accuracies down to the nanoseconds … if every elements are correctly implemented. • IEEE 1588 has been originally specified for plug-and-play time synchronization solution. • Original interest for telecom because dedicated standard and “precision” marketing.

Frequency Time

205-12#sh clock *13:38:54.805 UTC Mon Apr 2 2014

R A N N

Reference Slower Faster Slower or faster Δ = frequency offset Regularity = stability

(1) Time reference can be But stability important too ! • Absolute (e.g. UTC) • Relative

Mon Apr 2 2014 Mon Apr 2 2014 13:38:54.815 +/- xxx UTC 13:38:54.805 UTC(1)

R A

Mon Apr 2 2014 Assuming perfect synchronisation Mon Apr 2 2014 13:38:54.805 UTC 13:38:54.805 UTC

R A

Mon Apr 2 2014 Slower Mon Apr 2 2014 13:38:55.805 UTC Before next update 13:38:55.795 UTC

R A

• Transfer and distribute frequency and/or time reference(s) to distinct end systems • With synchronisation specifications from one or multiple sources allowing high quality recovery.

Packet Network R B

Primary Reference(s) Local Reference

Master clock(s) Node architecture Network type, environment and application Standard specifications

Network links Network nodes

Master time = TM MASTER SLAVE Slave time = TS = TM + offset

Offset = TS - TM

Timestamps known by Sync Offset + DelayMS = t2 – t1 slave DelayMS t1 t = t + Offset + Delay 2 1 MS t1, t2 t2 t3 Delay_Req t1, t2, t3 DelaySM - Offset = t4 – t3 DelaySM t4 = t3 + DelaySM - Offset t4 Delay_Resp t1, t2, t3, t4

• IEEE 1588 defines clocks supporting the Precision Time Protocol (PTP). • As network intermediate nodes, Boundary Clocks (BC) and Transparent Clocks (TC) aim correcting delay variations, in both directions (asymmetry).

Ordinary Clock Boundary Transparent Ordinary Clock grandmaster Clock Clock Leaf Slave

PTP PTP Reference Recovered Clock Clock

PTP

46 AVB Building Blocks

AVB

802.1AS 802.1Qat 802.1Qav Forwarding and Timing Stream Queuing for Time Reservation Sensitive Steams Protocol

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Audio Video Bridging (AVB) - Details • 802.1BA: Overall AVB system • 802.1Qat: Stream Reservation architecture Protocol • 2ms bounded latency through 7 switches • End-to-End Registration/Reservation of time-sensitive streams • 802.1Qav: Forwarding and queuing for Time-Sensitive Streams • IEEE 1722 “Layer 2 Protocol • AVB frames forwarded with Working Group for Time-Sensitive precedence over Best Effort traffic Streams” • Credit-based traffic shaping of AVB • 1722 defines Audio/Video Transport traffic to smooth flows Protocol (AVTP) • 802.1AS: IEEE 1588 (Precision • SDI mapped into AVTP Professional Time Protocol) Profile Video Format (APVF) • Layer 2 profile of IEEE 1588 • APVF has frame count, line number, • Synchronization to 1μs over 7 switch packet index in a line hops

Specification Year Description Notes RFC 3497 2003 RTP Payload Format Comprehensive Header Data video-aware Pro-MPEG CoP #4 2004 Transmission of Studio Streams RFC3497 RTP mapping over IP Networks w/exceptions SMPTE ST 2022-6 2012 Transport of High Bit Rate Video-aware Header Data, Media Signals over IP Networks but sparse (HBRMT)

• Goal is to design a IEEE 1588 “SMPTE Broadcast profile” • Focuses specifically on Time and Synchronisation requirements: – ST 2059-1: SMPTE Epoch and signal alignment – ST 2059-2: SMPTE IEEE 1588 profile • Key points: – Layer 3 PTP model – IPv4 or IPv6 PTP messages – Unicast only or mixed (unicast/multicast) PTP message model – Network requirements currently unspecified • Migrate thousands of “genlocked” devices on a TV station campus – From dedicated RF distribution to IP based infrastructure

• Combine with additional standards for creating a full model: – Leverage IEEE 1588 PTP hardware network capabilities where/when available – Bandwidth reservation/control mechanism – IP QoS mechanisms and capable hardware – SMPTE 2022-6 (or others) for media essence transport • Keep in mind: – “Tailored”: You get what you design & install – Dependent on choice of network elements and end point performance – System evolves with the sum of the components

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public AES 67: Audio applications of networks High performance streaming audio-over-IP interoperability • Series of Audio over IP standards in existence requiring interoperability – Ravenna, Livewire, Q-LAN, Dante • Includes timing (PTP profile), QoS and media streaming components • Targeted latency (worst case 10ms, typically 1ms) • Published in September 2013 – 1st interop workshop in October 2014 – Preparing standard update to fix language • Supported by: Riedel, ALC NetworX, Wheatstone, Digigram, QSC, …

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public IBC 2014 Joint Live IP Production demo • BBC R&D / Stagebox – PTP endpoints • Cisco – HW PTP Boundary Clocks • Tektronix / Semtech – Hybrid SPG / PTP GrandMaster • Trilogy – IP Intercom

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public SMPTE ATC 2014 PTP deployments in large networks • PTP network with bandwidth contention: 4x 3G-SDI over 10GE • Precision: 1000s ns (PTP unaware) vs. 10s ns (PTP aware) • Understand the PTP requirements for your use case

S2_DEV03_DEV04_DEV05_4.log 3 Cascaded BCs with 3 SDI Streams 100 Filtered Offset Filtered Offset 4000

50 2000

ns ns 0 0

-2000 -50

-4000 -100 0 50 100 150 200 250 300 0 50 100 150 200 250 300 s s

BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public SDN separates the control & data plane – Separates decision-making of where traffic is sent (Control Plane) from the system that forwards traffic (Data Plane). Software – Hides lower level complexities but provides control for higher layers Defined Benefits • Scalable Networking • Easy to use (SDN) • Dynamic Problem – Overused/Many Incarnations

• IP Network provides connectivity REST, using complex routing decisions RESTCONF APIs • Applications best understand their traffic flows, the networking Network behaviour needs and connectivity Controller requirements. OF, Netconf/Yang, REST/JSON • Network Controller abstracts the network and routing complexity while providing control to the higher layers. IP Network • Control System with Network Controller provide the policy control system BRKSPV-3112 © 2015 Cisco and/or its affiliates. All rights reserved. Cisco Public Media Data Center SDN in Broadcast Production Control System Studio

SDI to IP Network Controller Gateway

SDI to IP Gateway

Video Audio Monitoring Graphic Multiviewer Production Control Room Switcher Mixer devices Systems

Playout, Recording and Backup

• Moving from dedicated (SDI) infrastructure to Ethernet/IP platforms – Content (essence) encapsulation via SMPTE ST 2022-6 • Requires tight Ethernet based timing capabilities – Rely on IEEE 1588 enabled network infrastructure, especially for large scale deployments – Understand timing requirements: per use case • Enables new and simplified workflows

• Ultra High Definition will enable a more immersive experience – Phased technology deployment • Broadcast production industry is moving to all-IP infrastructure – Consolidation of live and post-production onto media centric networks

• Visit the World of Solutions for – Cisco Campus – Walk in Labs – Technical Solution Clinics • Meet the Engineer • Lunch time Table Topics • DevNet zone related labs and sessions • Recommended Reading: for reading material and further resources for this session, please visit www.pearson-books.com/CLMilan2015

• Please complete your online session evaluations after each session. Complete 4 session evaluations & the Overall Conference Evaluation (available from Thursday) to receive your Cisco Live T-shirt.

• All surveys can be completed via the Cisco Live Mobile App or the Communication Stations

• Demos in the Cisco Campus • Walk-in Self-Paced Labs • Table Topics • Meet the Engineer 1:1 meetings