SMPTE ST 2094 and Dynamic Metadata
Total Page:16
File Type:pdf, Size:1020Kb
SMPTE Standards Update SMPTE Professional Development Academy – Enabling Global Education SMPTE Standards Webcast Series SMPTE Professional Development Academy – Enabling Global Education SMPTE ST 2094 and Dynamic Metadata Lars Borg Principal Scientist Adobe linkedin: larsborg My first TV © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) SMPTE Standards Update Webcasts Professional Development Academy Enabling Global Education • Series of quarterly 1-hour online (this is is 90 minutes), interactive webcasts covering select SMPTE standards • Free to everyone • Sessions are recorded for on-demand viewing convenience SMPTE.ORG and YouTube © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) © 2016• Powered by SMPTE® Professional Development Academy • Enabling Global Education • www.smpte.org © 2017 • Powered by SMPTE® Professional Development Academy | Enabling Global Education • www.smpte.org SMPTE Standards Update SMPTE Professional Development Academy – Enabling Global Education Your Host Professional Development Academy • Joel E. Welch Enabling Global Education • Director of Education • SMPTE © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) 3 Views and opinions expressed during this SMPTE Webcast are those of the presenter(s) and do not necessarily reflect those of SMPTE or SMPTE Members. This webcast is presented for informational purposes only. Any reference to specific companies, products or services does not represent promotion, recommendation, or endorsement by SMPTE © 2017 • Powered by SMPTE® Professional Development Academy | Enabling Global Education • www.smpte.org SMPTE Standards Update SMPTE Professional Development Academy – Enabling Global Education Today’s Guest Speaker Professional Development Academy Lars Borg Enabling Global Education Principal Scientist in Digital Video and Audio Engineering Adobe © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) 5 What? Professional Development Academy Enabling Global Education • HDR vs SDR • Tone mapping • HDR systems & tone mapping options • Dynamic metadata © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) © 2017 • Powered by SMPTE® Professional Development Academy | Enabling Global Education • www.smpte.org SMPTE Standards Update SMPTE Professional Development Academy – Enabling Global Education High Dynamic Range - Slim, Wide, Tall Volumes Professional Development Academy Enabling Global Education Tall High dynamic range Slim Wide 10-100x brighter peaks 100x darker than SDR ref 40% wider Saturated colors © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) Wide Color Gamut makes deeper colors available Same RGB - different displays © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) 8 © 2017 • Powered by SMPTE® Professional Development Academy | Enabling Global Education • www.smpte.org SMPTE Standards Update SMPTE Professional Development Academy – Enabling Global Education HDR brightness ranges and gamuts Professional Development Academy Brighter Enabling Global Education HDR HDR media color volume U H is much larger than D H A R HDR display color U D C H A E volume M D S e SS A L DD C d i RR O D a L More E colorful D 709 P3 2020 Darker © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) Comparing SDR and HDR system details Professional Development Academy Enabling Global Education Old: SDR TV New: HDR TV Feature (Rec. 709, Rec. 601) (Rec. 2100) Max Resolution 1920 x 1080 7680 x 4320 Max Frame rate 60 fps 120 fps Bit depth 8 or 10 10 or 12 Media Color Volume Small (Rec. 709) Wide (2020) and Tall (10,000 nits) Display Color Gamut Small (Rec. 709) Medium (P3) typically 300 nits, At least 1,000 nits (LCD), Display Peak Brightness studio mon. 100 nits 530 nits (OLED) Transfer Characteristics BT.1886 Gamma 2.4 PQ curve or HLG curve Color models RGB, YCbCr + ICtCp (Constant Intensity) Compression MPEG-2, AVC, J2K AVC, J2K, HEVC Color Volume Metadata None None, HDR10, or ST2094 © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) 10 © 2017 • Powered by SMPTE® Professional Development Academy | Enabling Global Education • www.smpte.org SMPTE Standards Update SMPTE Professional Development Academy – Enabling Global Education Which grade first? You pick! Professional Development Academy Enabling Global Education • HDR first Media HDR SDR • Most exciting version first • SDR grades from HDR version • Best for real-time workflows Media SDR • SDR first HDR • Do the money-making (2017!) version first • HDR uses SDR master files, not 10-bit SDR distribution images • HDR and SDR independently graded from master media HDR • Very expensive (double effort) Media • Highest quality for both versions SDR • Some colorists find it difficult to grade both HDR and SDR! © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) 11 Why do I need tone mapping? Professional Development Academy Enabling Global Education Clipped highlights and shadows Compressed highlights and shadows © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) 12 © 2017 • Powered by SMPTE® Professional Development Academy | Enabling Global Education • www.smpte.org SMPTE Standards Update SMPTE Professional Development Academy – Enabling Global Education Standout Experience What are Professional Development Academy Dynamic Metadata for Enabling Global Education my HDR DMCVT Color Volume Transform signal options? HDR10 Static Metadata (Ultra HD Blu-ray) PQ Perceptual Quantizer (ST 2084) No metadata (UHD Alliance Premium) SDR ? HLG Hybrid Log Gamma No metadata Simplicity © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) 13 Static Tone Mapping – HDR10 Professional Development Academy Optimized only for the brightest scene in the contents Enabling Global Education 200 nit 500 1500 nit 4,000 4000 nit Illustrations courtesy of YT Kim, Samsung © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) 14 © 2017 • Powered by SMPTE® Professional Development Academy | Enabling Global Education • www.smpte.org SMPTE Standards Update SMPTE Professional Development Academy – Enabling Global Education Dynamic Tone Mapping – DMCVT Professional Development Academy Optimizes each scene Enabling Global Education 500 200 nit 500 500 1500 nit 1,500 500 4000 nit 4,000 © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) 15 Dynamic Tone Mapping can preserve SDR image quality Professional Development Academy Enabling Global Education • SDR footage inserted in HDR program needs special handling when converting to SDR • To preserve original SDR imagery and prevent loss of image quality • Dynamic Metadata provides the info From SDR Archive B On SDR display A B C Static or no Metadata Compromised SDR A B C Dynamic Range Dynamic Dynamic Metadata A B C HDR tag SDR tag HDR tag Preserved SDR © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) 16 © 2017 • Powered by SMPTE® Professional Development Academy | Enabling Global Education • www.smpte.org SMPTE Standards Update SMPTE Professional Development Academy – Enabling Global Education ST 2094 — Dynamic Metadata for Color Volume Transforms (DMCVT) Professional Development Academy Enabling Global Education • Color transforms optimized for each scene, and each display • SMPTE ST 2094, in six parts, published 2016 • Carried in HEVC SEI, ETSI TS 103 433, CTA 861-G • Standardizes HDR color transform technologies from • Dolby (Parametric Tone Mapping) • Philips (Parameter-based Color Volume Reconstruction) • Technicolor (Reference-based Color Volume Remapping) • Samsung (Scene-based Color Volume Mapping) • And 80 other participating companies © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) 17 ST 2094 Document Structure Professional Development Academy Enabling Global Education ST 2094-10 App 1 ST 2094-20 App 2 ST 2094-1 Core ST 2094-2 KLV Common metadata ST 2094-30 App 3 Key-Length-Value items and structures encoding and ST 2094-40 App 4 MXF container Applications, specializations © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) © 2017 • Powered by SMPTE® Professional Development Academy | Enabling Global Education • www.smpte.org SMPTE Standards Update SMPTE Professional Development Academy – Enabling Global Education Parallel metadata track(s) Professional Development Academy Enabling Global Education Video track For HDR x Metadata For display y track(s) For display z • Master HDR video track • Metadata tracks carry supplementary color grading information • Select where to apply the metadata • By time, window, target display © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) The ST 2094 metadata set Professional Development Academy Each ST 2094 metadata set specifies one of each of: Enabling Global Education Method Target Display Time Interval Window Transform Which? For what display? When? Where? What to do? Rec. 709 ⇤ ◼︎◼︎◼︎◼︎◼︎◼︎ ⇥ Rec. 2020 ⇤ ◼︎◼︎◼︎ ⇥ UHDA OLED ◼︎ App # Color Volume: Start and duration Pixel coordinates 4 flavors of RGB primaries, Baseline = full screen parameter sets Version # WP, max/min © 2017 by the Society of Motion Picture & Television Engineers®, Inc. (SMPTE®) 20 © 2017 • Powered by SMPTE® Professional Development Academy | Enabling Global Education • www.smpte.org SMPTE Standards Update SMPTE Professional