Usage of Signaling Code Points for Automating UHD and HD Production-to-Distribution Workflows Yasser Syed & Chris Seeger Comcast/NBCU

Comcast TPX 1 VIPER Architecture Simpler Times - Delivering to TVs

720 1920 601

HD 486 1080 1080i

709

• SD - HD Conversions • Resolution, Standard Dynamic Range and 601/709 Color Spaces • 4:3 - 16:9 Conversions • 4:2:0 - 8-bit YUV video

Comcast TPX 2 VIPER Architecture What is UHD / 4K, HFR, HDR, WCG?

HIGH WIDE HIGHER HIGHER DYNAMIC RESOLUTION COLOR FRAME RATE RANGE 4K 60p Brighter and More Colorful Darker Pixels Pixels

MORE FASTER BETTER PIXELS PIXELS PIXELS

ENABLED BY DOLBYVISION

Comcast TPX 3 VIPER Architecture Volume of Scripted Workflows is Growing

Not considering: • Live Events (news/sports) • Localized events but with wider distributions • User-generated content

Comcast TPX 4 VIPER Architecture More Formats to Distribute to More Devices

Standard Definition

Broadcast/Cable IPTV WiFi DVDs/Files • More display devices: TVs, Tablets, Mobile Phones, Laptops • More display formats: SD, HD, HDR, 4K, 8K, 10-bit, 8-bit, 4:2:2, 4:2:0 • More distribution paths: Broadcast/Cable, IPTV, WiFi, Laptops • Integration/Compositing at receiving device

Comcast TPX 5 VIPER Architecture Signal Normalization AUTOMATED LOGIC FOR CONVERSION IN • Compositing, grading, editing SDR HLG PQ depends on proper signal BT.709 BT.2100 BT.2100 normalization of all source files (i.e. - Still Graphics & Titling, Bugs, Tickers, Requires Conversion Native Lower-Thirds, weather graphics, etc.) • ALL content must be moved into a single color volume space. Normalized Compositing • Transformation from different Timeline/Switcher/Transcoder - PQ-BT.2100 colourspaces (BT.601, BT.709, BT.2020) and transfer functions (Gamma 2.4, PQ, HLG) Convert Native • Correct signaling allows automation of conversion settings. SDR PQ BT.709 BT.2100

AUTOMATED LOGIC FOR CONVERSION OUT Comcast TPX 6 VIPER Architecture Production to Distribution Environment

Cinema / Scripted TV

Live Events

Production Production Service CAPTURE With Distribution Distribution Signaling

4:4:4 / 4:2:2 4:4:4 / 4:2:2 4:4:4 / 4:2:2 4:4:4 / 4:2:0 Y’CbCr / ICtCp Y’CbCr / ICtCp Y’CbCr / ICtCp Y’CbCr / ICtCp 16 / 12 / 10-bit 16 / 12 / 10-bit 16 / 12 / 10-bit 10 / 8-bit PQ / SLog3 / HLG PQ / SLog3 / HLG PQ / SLog3 / HLG PQ / SDR-Gamma BT.709 / BT.2020 BT.709 / BT.2020 BT.709 / BT.2020 BT.709 / BT.2020

Original Final Chroma subsampling

Original Transfer Function (BT.709/BT.1886, PQ, HLG, SLog3) Final Colour Transfer Function

Original Bit Depth Final Bit Depth

Original Color Primaries Final Color Primaries

Comcast TPX 7 VIPER Architecture With Over 47 Different Standards How Do we Signal Correctly?

Comcast TPX 8 VIPER Architecture Distribution A Simplified Single-Stream HDR Workflow Today

Comcast TPX 9 VIPER Architecture Distribution: A Simplified Single-Stream HDR Workflow Today

Comcast TPX VIPER Architecture Look-Up-Table Conversion

• Lookup Table(LUT) must explicitly match the content for conversions to be correct. Parameters include:

• Signal Range - Level IN/OUT • Type I = Narrow-Range-In, Narrow-Range-Out • Type II = Full-Range-In, Full-Range-Out • Type III = • Full-Range-In with Narrow-Range-Signal-In • Narrow-Range-Signal-Out with Full Range Out • These LUTs support super-white/black • • For matrix conversions to/from YCbCr to RGB • Transfer function • For correct output signaling for next device or process • Matrix Coefficients

Comcast TPX 11 VIPER Architecture Chroma Errors

• Chroma Subsampling Differences (4:4:4 or 4:2:2 to 4:2:0) • Proper alignment of concatenated signals depend on chroma-loc to prevent chroma artifacts caused by shifts.

Comcast TPX 12 VIPER Architecture Greater Diversity and Volume - Automation Becomes A Necessity

• Use of signaling and metadata • Allows automated conversion of legacy content • Independently developed tools using the standards-based signaling can be integrated into these automated workflows using the new signaling and metadata methods

Comcast TPX 13 VIPER Architecture ITU-T H-Series Supplemental 19/ ISO-IEC 23091-4 Technical Record (2019)

• Single filtered document with over 47 different standards references for SDR/HDR/WCG signalling • ISO/ITU-T Series-H Supplement 19; October 2019 (Usage Of Video Signal Type Coding Points) • Created by an active cross industry group over a 2 year span • Identifies commonly used combinations of video properties of content by industry • Identifies commonly used grading environments (Mastering Display Color Volume - MDCV) • References for both baseband(SDI/ST.2110) and file-based domains • Contains references for conversions such as the ITU-R recommendations for HDR to SDR Conversions, or HLG to PQ Conversions

Comcast TPX 14 VIPER Architecture Video Properties / Common Usage Combinations

System identifier BT2100_PQ_YCC BT2100_HLG_YCC Colour Light Container space properties

Colour primaries BT.2020 / BT.2100 BT.2020 / BT.2100 4:2:0 chroma sample Colour Colour Integer Transfer characteristics BT.2100 PQ BT.2100 HLG Tag Dynamic Transfer location properties Gamut Primaries represent code level range function alignment ation scaling Colour representation Y′CbCr Y′CbCr (ChromaLocT Full/narrow range Narrow Narrow ype) Vertically Other 4:2:0 chroma sample HD interstitial Co-sited Co-sited BT601_525 Y′CbCr Narrow location alignment (ChromaLocTy or SD pe = 0) ColourPrimaries 9 9 BT.601 Vertically a interstitial CICP TransferCharacteristics 16 18 BT601_625 Y′CbCr Narrow parameters (ChromaLocTy Rec. ITU-T H.273 | ISO/IEC NCG pe = 0) MatrixCoefficients 9 9 23091-2 Vertically interstitial BT709_YCC SDR BT.709 Y′CbCr Narrow VideoFullRangeFlag 0 0 (ChromaLocTy BT.709 pe = 0) Colour primaries urn:smpte:ul:06.0E.2B.34.04.01.01.0D.04.01.01.01.03.04.00.00 BT709_RGB R′G′B′ Narrow N/A

urn:smpte:ul:06.0E.2B.34.04.0 FR709_RGB R′G′B′ Full N/A urn:smpte:ul:06.0E.2B.34.04.01.01. Transfer characteristic 1.01.0D.04.01.01.01.01.0B.00. Co-sited 0D.04.01.01.01.01.0A.00.00 BT2020_YCC_ 00 Y′CbCr Narrow NCL (ChromaLocTy BT.2020 pe = 2) BT2020_RGB R′G′B′ Narrow N/A SMPTE MXF parameters Coding equations urn:smpte:ul:06.0E.2B.34.04.01.01.0D.04.01.01.01.02.06.00.00 SMPTE ST 2067-21 FR2020_RGB R′G′B′ Full N/A Co-sited Inferred (indicated in black reference level, white reference level, BT2100_PQ_Y Full/narrow level range Y′CbCr Narrow colour range) CC (ChromaLocTy pe = 2) 4:2:0 chroma sample Inferred Inferred Co-sited UHD BT2100_PQ_I WCG PQ ICTCP Narrow location alignment (ChromaLoc (ChromaLoc CTCP (ChromaLocTy pe = 2) Type = 2) Type = 2) BT2100_PQ_R BT.2100 HDR R′G′B′ Narrow N/A GB a For purposes of backward compatibility for an HEVC or AVC encoded Rec. ITU-R BT.2100 HLG bitstream to be Co-sited interpreted as Rec. ITU-R BT.2020 (SDR WCG) video, the bitstream may be marked in the VUI with the BT2100_HLG_ Y′CbCr Narrow transfer_characteristics syntax element value 14 as using Rec. ITU-R BT.2020 transfer characteristics while also YCC (ChromaLocTy sending an alternative transfer characteristics SEI message with the preferred_transfer_characteristics syntax HLG pe = 2) element of the SEI message equal to 18 with each coded video sequence to identify the preferred interpretation as BT2100_HLG_ R′G′B′ Narrow N/A Rec. ITU-R BT.2100 HLG video. Such a usage is specified in ETSI 101 154. RGB

Comcast TPX 15 VIPER Architecture Baseband Workflows

Standard Source format data (resolution)a SD HD UHD 720 × 480 720 × 576 1280 × 720 1920 × 1080 2048 × 1080 3840 × 2160 4096 × 2160 7680 × 4320

ST 259M (SD-SDI) √ √ BT.656M (SD-SDI) √ √ ST 292-1 (HD-SDI) √ √ √ BT.1120-9 (HD-SDI) √

ST 372-1 (Dual link HD-SDI) √ √

ST 425-1 (3G-SDI) √ √

BT.1120-9 (Dual link HD-SDI/3G-SDI) √

ST 425-5 (Quad link 3G-SDI) √ √

ST 2081-10 (6G-SDI) √ √ √ √

ST 2082-10 (12G-SDI) √ √

ST 2082-12 (Quad link 12G-SDI) √ √ √

ST 2036-3 (Single/multi-link 10G-SDI) √ √

BT.2077-2 (U-SDI) √ √

a Cells with check marks (√) indicate “used combinations”. Cells without check marks indicate “not used combinations”.

Comcast TPX 16 VIPER Architecture Mastering Display Colour Volume

System identifier P3D65x1000n0005 P3D65x4000n005 BT2100x108n0005 Colour primaries {xR, yR} (red) {0.6800, 0.3200} {0.6800, 0.3200} {0.7080, 0.2920} Mastering Display Colour Colour primaries {xG, yG} () {0.2650, 0.6900} {0.2650, 0.6900} {0.1700, 0.7970} Volume (MDCV) Colour primaries {xB, yB} (blue) {0.1500, 0.0600} {0.1500, 0.0600} {0.1310, 0.0460} Properties defined in White point chromaticity {x, y} {0.3127, 0.3290} (D65) SMPTE ST 2086 Maximum luminance [cd/m2] 1000 4000 108 Minimum luminance [cd/m2] 0.0005 for OLED 0.005 for LED LCD 0.0005 for laser HEVC Display_primaries_x[2]/y[2] (red) {34000, 16000} {34000, 16000} {35400, 14600} AVC Display_primaries_x[0]/y[0] (green) {13250, 34500} {13250, 34500} {8500, 39850} MDCV SEI messages Display_primaries_x[1]/y[1] (blue) {7500, 3000} {7500, 3000} {6550, 2300} Rec. ITU-T H.265 White_point_x/y {15635, 16450} ISO/IEC 23008-2 max/min_display_mastering_luminance {10000000, 5} {40000000, 50} {1080000, 5} Registration identifier urn:smpte:ul:060e2b34.0101010e.04200401.01010000 Mastering Display Color Primaries {34000, 16000} {34000, 16000} {35400, 14600} Coded decimal (red, SMPTE Unique Label {13250, 34500} {13250, 34500} {8500, 39850} green, blue) {7500, 3000} {7500, 3000} {6550, 2300} Mastering Display Registration identifier urn:smpte:ul:060e2b34.0101010e.04200401.01020000 White Point SMPTE MXF parameters Coded decimal {15635, 16450} SMPTE Unique Label SMPTE ST 2067-21 Mastering Display Registration identifier urn:smpte:ul:060e2b34.0101010e.04200401.01030000 Max Luminance Coded decimal 10000000 40000000 1080000 SMPTE Unique Label Mastering Display Registration identifier urn:smpte:ul:060e2b34.0101010e.04200401.01040000 Minimum Luminance Coded decimal 5 50 5 SMPTE Unique Label

Comcast TPX 17 VIPER Architecture Thank-You

Questions?

Comcast TPX 18 VIPER Architecture