MPEG Standardization Roadmap October 2017 Version Why a Standardisation Roadmap? • MPEG has created, and is still producing, media standards that enable huge markets to flourish • MPEG works on requirements from industry • Many industries represented in MPEG, but not all of MPEG’s customers can or need to participate in the process • MPEG wants to inform its customers about its long- term plans (~ 5 years out) • … and collect feedback and requirements from these customers • … including in this session What is in the Roadmap • Our roadmap is a short document. • It briefly outlines MPEG’s most important standards MPEG Standards 1990 1995 2000 2005 2010 2015 Digital Music Custom Fonts on Television Distribution Web & DigiPub Internet Mobile Video HD Distribution UHD & Immersive Audio Services MPEG-2 MP3 Video & MPEG-4 AAC AVC OFF HEVC 3D Audio Systems Video MP4 FF DASH MMT MLAF Media Storage and Unified Media Second Streaming Streaming Screen New Forms of Digital Television What is in the Roadmap • Our roadmap is a short document. • It briefly outlines MPEG’s most important standards • It then gives an overview of MPEG’s activities Multimedia Platform MPEG’s Areas Systems, video, Technologies MPEG- audio and U,V of Activity transport MPEG- E,M Technologies MPEG- for content B,C,D, Device and e-commerce application DASH interfaces MPEG-A Multimedia Application Compression of Formats (combinations video, audio MPEG-21 of content formats) and 3DG MPEG-7 Description of video, MPEG- audio and multimedia 1,2,4,H,I for content search What is in the Roadmap • Our roadmap is a short document. • It briefly outlines MPEG’s most important standards • … it then gives an overview of MPEG’s activities • … and then an overview of all MPEG’s standards 1990 1995 2000 2005 2010 2015 MP1 L2 MP3 AAC Surround USAC 3D Audio Audio SAOC DRC Video SP ASP AVC HEVC Video Video BIFS AFX OFF ARAF Graphics Media- MDS CENC CEL/MCO CDVS related DID MPEG-V UD PS/TS MP4 FF DASH TT Systems MMT Colour MPEG-1 MPEG-2 MPEG-4 MPEG-7 MPEG-21 coding MPEG-A MPEG-B MPEG-C MPEG-D MPEG-H MPEG-V All acronyms are explained in the companion document to this presentation Significant Developments Shape MPEG’s Roadmap • The relentless increase of IP-distributed and Mobile media • Higher quality • More immersive media (UHD, VR, AR) • The Internet of Media Things & Wearables • Cloud-based media processing, storage and delivery Jan 2017 2018 2019 2020 2021 2022 Genome Compression Descriptors for Video Analysis (CDVA) Coding Network Media Processing Interfaces AR/VR Audio extension Audio Wave Field Coding Point Cloud Compression Internet Video Coding New, Immersive Video Codec Light Field Coding HDR TR HDR TR 2 OMAF OMAF v2 Hybrid Natural Synthetic Scenes CMAF IoMT Systems Media Orchestration and Tools Jan 2017 2018 2019 2020 2021 2022 Genome Compression Descriptors for Video Analysis (CDVA) Coding Network Media Processing Interfaces AR/VR Audio extension Audio Wave Field Coding Point Cloud Compression Internet Video Coding New, Immersive Video Codec Light Field Coding HDR TR HDR TR 2 OMAF OMAF v2 Cross-platform Hybrid Natural Synthetic Scenes CMAF Media Distribution IoMT Systems Media Orchestration and Tools Jan 2017 2018 2019 2020 2021 2022 Genome Compression Descriptors for Video Analysis (CDVA) Coding Network Media Processing Interfaces AR/VR Audio extension Audio Wave Field Coding Point Cloud Compression Internet Video Coding New, Immersive Video Codec Light Field Coding HDR TR HDR TR 2 VR360, on-demand OMAF OMAF v2 and live (3 DoF) Cross-platform Hybrid Natural Synthetic Scenes CMAF Media Distribution IoMT Systems Media Orchestration and Tools Jan 2017 2018 2019 2020 2021 2022 Genome Compression Descriptors for Video Analysis (CDVA) Coding Network Media Processing Interfaces AR/VR Audio extension Audio Wave Field Coding Point CloudImmersive Compression Media Internet Video Coding with 6 Degrees of Freedom New, Immersive Video Codec Light Field Coding HDR TR HDR TR 2 Combining Natural and Synthetic content VR360, on-demand OMAF OMAF v2 and live (3 DoF) Cross-platform Hybrid Natural Synthetic Scenes CMAF Media Distribution IoMT Systems Media Orchestration and Tools MPEG-I New MPEG project: ISO/IEC 23090 Coded Representation of Immersive Media 8 parts currently envisaged: 1. Architectures 2. Omnidirectional Media AF 3. New & Immersive Video Coding 4. New & Immersive Audio Coding 5. Point Cloud Coding 6. Metadata for Immersive Services and Applications 7. Metrics for Immersive Services and Applications 8. Network-Based Media Processing New & Immersive Video Codec – Timeline (MPEG-I pt. 3) Step Year Month Collection of test material 2017 Jan Preliminary CfE 2017 Jan Final CfE 2017 Apr Assessment of CfE responses 2017 Jul Preliminary CfP 2017 Jul Final CfP 2017 Oct Bitstream submission 2018 Feb Subjective tests 2018 Apr Delivery of standard 2020 Oct 15 Questions to MPEG’s Customers • Which needs do you see for media standardisation, between now and years out? • What MPEG standardisation roadmap would best meet your needs? • To accommodate your use cases, what should MPEG's priorities be for the delivery of specific standards? For example, do you urgently need something that may enable basic functionality now, or can you wait for a more optimal solution to be released later?.