MPEG Workshop
Next Generation Media Services and Technologies
Media Tech. R&D Center
Dr. Jongmin Lee (Center Leader) • The time will soon come when everyone can create, deliver and consume video data everywhere based on 5G network infra
• Mobile video service is now rapidly evolving Main keyword: 4K/8K UHD, AR/VR, 3-D, N-screen
• Many SKT’s multi-media services are developed / developing based on MPEG technologies and systems HEVC, AVC, MMT, etc. Media Service Trend Media Service Trend • Mobile video traffic is rapidly increasing
□ Video Traffic □ Audio,Video Web, Traffic etc. Traffic
Daily average T Byte
`16 `17 `18 `19 `20 `21 Global Mobile Live Broadcasting Traffic forecast, Cisco 2016
All these devices increase mobile video traffic ! Media Service Trend • Mobile Media Market Trend $ Billion □ Desktop 554 □ Smart phone / Tablets
179 ’20 ’14
Global Online Media Market
$ Million 7801 Media Devices (%), *Ref. from StatCounter (2016.10) 6345 5136 4149 7.5 ’14 2,587 3069 1,926 4.5 ’14 ’15 ’16 ’17 ’18 ’19 ’20 ’12 ’14 South Korea Media Market
*Ref. from STRABASE (2014.12)
Cord-cutting ratio in US. Media Service Trend
Source: Mary Meeker, Internet Trends 2016 SKT’s Media Services • Fixed IPTV ( ), Mobile IPTV ( ), 360 VR VoD / Live, etc
8K UHD IPTV Trial (`15.10), UHD Multi-View (`16.9) Adaptive 4K IPTV Commercialization (`14.4) Oksusu VR Streaming Service(`16.10)
Oksusu Mobile IPTV Commercialization (`17.10) AI Voice Recognizer / Speaker 360 VR Real-time Streaming SKT’s Global Working • Developing the next-generation TV platform for the U.S market • Various MPEG technologies were adopted into ATSC 3.0, especially, HEVC, DASH, and MMT. • Highly contributed to the MPEG, MMT standard activity. • Hybrid media delivery is the core function leads an enhanced UX of media consumption. • Adopted the various MPEG technologies in SKT’s media services • HEVC, and MMT (including mobile MMT) were integrated in ‘Oksusu’
• Leads the MPEG project with global companies for preparing the 5G media infrastructures. SK’s Media Integrated Platform and Services for 5G Network Architecture for SK’s Media Services • SK’s Media Service Delivery System is configured as ①Create & Casting, ②Encoding & Value Add, ③Delivery & Publish with live and VoD types
Create & Casting [Source] Encoding & Value Add [Head end] Deliver & Publish [CDN- 서초/일산/분당 IDC] Live Player
Live Up Live Relay Live Relay Streaming streaming Streaming Live Streaming Encoding & Baseband Live Meta Mgmt. Streaming Signal Controller (EPG) Origin/Edge Cameras
Live DVR & FileLive & LiveServices 서비스 Transcode Ads. Mux Control Message Control Message VoDVoD서비스 VoD Player Media Services Cast & Media Media Upload Process Delivery Platform Mgr Scheduleer Indicator API
Download & File Upload File Upload VoD Pull VoD Streaming
Upload Storage Cache Media Files Controller Origin/Edge T-MIP: SKT – Media Integrated Platform • Media Service Functional Architecture Subscriber Billing & Media Services Mgmt. Auth.
Media Platform Open API & SDK Orchestrator API
Layer Media Service Management API IPTV
Security & Upload Processing Publisher Value added Analysis
Broadcast Ads. Mgmt. Policy Statistics
Cast Mgr 360 AR/VR Analytics Tool Ops. Programming & Injector Mgr. Flow Mobile TV Cast URL Live/VoD Smart URL Chatting DRM
Indicator Encode/Trans. Indicator Injector Infra Layer Infra StreamSwitch/ One time URL Device/Region Media Processing Media UpScaler HDR/SR Time Shift generator Detector
OTT Media vInfra Management API
Media Deliver Indicator Media Service App. AV vCache vStreamer MLR Container
Encoder MCN Infra Layer Infra
Media Delivery Media Infrastructure Abstraction Resoure Alloc. App Distributer Multi Commander App Repo.
Open H/W (Head End/IDC/AWS) Repository Processor T-MIP: SKT – Media Integrated Platform • Architectural Model for Media Service Entity Attachment
Media Services & Applications (B2B services and B2C services)
MA reference point point
MAL reference AO (Media API Layer)
MP reference point
point reference reference
MPL PO (Media Processing Layer)
MD reference point
reference reference point MOL
MDL DO (Media Delivery Layer)
MI reference point
point
reference reference (Media Orchestrator Layer) Orchestrator (Media
MIAL IO (Media Infra Abstraction Layer)
MR reference point
Media Resources (Fixed/mobile network + Cloud infra[e.g., AWS, Azure) SKT-MIP based Solutions • OVP-Online Video Platform
Interworking Contract Purchase/Install web admin. Open API SDK Doc. Sample Service System Load tool - CDN Media system Balancing - Storage - Transcoder - Streaming SVR - Media Solution Upload Conversion Contents Delivery Live Chatting Tech. Management Cloud Development/Install Flexible Contents Mgmt. System Operation Service - Media System Interworking - Contents Mgmt. Publishing 360 VR Player Adv. Statics Broadcasting
Resource System Monitoring Service Development/Install Server Mass Storage Global 24-HR - 24 Hours Operation Media Services CDN Monitoring - Actual Service based on Sample App. Or Web
SKT Provides Media Services including resource and technology as Cloud Service All Functions are provided with Open API / SDK
SKT-MIP based Solutions • T-Live Streaming
‘Waiting for up to 30s’ Available to Stream
Chunk Chunk Chunk Chunk Chunk HLS (23.ts) (24.ts) (25.ts) (26.ts) (27.ts) 0 10 20 30 40 t Chunklist.m3u8
Origin ‘Just 2s delay’ Content MPU (Media Processing Unit) Source Available to Stream - Frame based Transport SKT Live Streaming 0 10 t SKT-MIP based Solutions
T Live Streaming Cloud based Personal Broadcasting Platform • Ultra Low Latency Guaranteed Mobile Streaming Tech. • Individual Participation Possible • Latency: <3s, Sync: <0.1s, Bandwidth Saving: 10% • Low Latency Streaming, Chatting, Ads. Insertion
Encoding, DVR, Publishing Site To Be DRM, Schedule, Mobile NVoD, CMS… IPTV Seoul As Is Live MCN T-Live Casting Channel Streaming Chunk #1 Chunk #2 Chunk #3 Chunk #4 Chunk #5 HD (1.ts) SD (2.ts) HD (3.ts) HD (4.ts) SD (5.ts) Social Busan Broadcasting Network 4 8 12 16 20 Platform Ad Tutoring Injection Service
Value Proposition Value Proposition Provide Personal Broadcasting Tech. supporting Low Latency decreases for mobile live streaming (15s→3s) Latency / High Visual Quality Supporting User Position Dependent Ads. Insertion
High Visual Quality / Low Latency 360 VR Unified Elastic Cache Streaming System • Optimization for Cache Storage and Processing • Live Stitching supporting 4K/60fps • 360 VR Live Broadcasting and Provide Player • Adaptive View Port based on User Viewpoint
Value Proposition Value Proposition Cache Storage Performance Enhanced (>9 times) 65% Data Compression with Adaptive View Port Tech. SKT-MIP based Solutions
Online Video Platform UHD Multi-Screen Solution • Provide Infra and Solution with PaaS Type for Internet • Provide one UHD screen with 4 separate FHD screens Broadcasting Services • HEVC Tile Syntax Used
Upload Encoding Contents Mgmt. Streaming Statics
Publishing Security Player Ads. Recording
Value Proposition Value Proposition Interworking with CDN for B2B (VoD, Live) Service High Visual Quality and STB Resource Saving with Provides N-screen, Ads. Insertion, Programing, CMS HEVC Tile Syntax
H/E HDRHigh Dynamic Range Conversion Super Resolution (H/E Adoption) • SDR(Standard Dynamic Range) Contents to HDR • Video Up-scaling with AI DNN based Algorithm Contents at H/E (Head End) Side • FHD to UHD at H/E with High Performance H/W
[non-HDR ] [HDR]
Value Proposition Value Proposition Premium HDR IPTV Services Possible for Both Premium 4K IPTV Services Possible for Both VoD/Real- VoD/Real-Time Streaming Time Streaming Network Based Media Processing • NBMP will be the dominant technology for future media service of 5G. SKT’s 5G Architecture
Media Source
Network-Based Media Processing
w/ 5G infra.
Key function : enhance the media quality using N/W resources Media Player SK’s AR/VR Platform and Services for 5G Network SKT’s AR / VR Platform • is Total AR / VR Service Platform
http://developers.sktelecom.com SKT’s AR / VR Platform • is Total AR / VR Service Platform SKT’s AR / VR Platform • VR Studio. You can create and play VR contents in there
Google I/O 2017 (/w Google Daydream) SKT’s AR / VR Platform • Developed Services Status Social Service
T real AR 저작 도구 및 AR Browser Collaboration
1. 대상 이미지 촬영 2. 콘텐츠 배치 3. AR 서비스 실행 AR Mobile Google I/O 2015 Authoring (‘15.1) AR Authoring (‘15.1) Game & Entertainment
Remote AR T real Telepresence Medical Service Remote Design (‘15.10) (‘17.1)
Marketing & Event T real 3D System Google I/O 2017 T real AR Game (‘16.6) Unity VR Studio(‘15.1)Daydream VR Studio (’17.1)
AR Baseball Game Play Adventure (’17.3)
T.um Theater (‘15.3) Education Productivity T real Adventure(‘15.3)
tvN Event (‘16.10) Mobile Symphony EV Visualizer Education AR/VR AR City Demo Remote Assist Orchestra AR (‘15.10) (‘16.3) (‘16.4) (‘15.8) Prototype (‘16.8) SKT’s AR / VR Services • AR Entertainment for Baseball Game
SKT’s AR / VR Services • 360 VR Live Trial Services (4K, Real-time)
High Quality
SKT AR / VR Services • 360 VR Streaming Services (BMW Driving Center)
Functional Architecture
360 Camera Stitching TLS Streaming Player (T5 Gopro x 6) & Encoding (/w 5G N/W) (HMD, phone) SKT AR / VR Services • 360 VR Streaming Services (Korean Pro Baseball Game)
Strong Immersiveness is obtained via 360 VR Video with Multi-Cameras
360 Video Transmission
3rd Base 1st Base Camera Camera
Home Camera SKT AR / VR Services • 360 VR Streaming Services (CES2018)
• 360 VR Streaming Services (in Collaboration with Kia Motors@CES2018) • Real-time Streaming via 5G Submarine Fiber-Optic Cables Between KOR-USA Conclusion • SKT is preparing 5G revolution era with innovative service platforms and solutions
• SKT is especially interested in technology for effective multi-media processing and fast delivery
• SKT is also proposing these platforms and solutions to MPEG and hoping these solutions to be popularized soon
• Flexible standardization is required for faster and effective video processing and delivery VR targeted video compression is being standardized in MPEG T-MIP and T-Real can be standardized