5G Network Infra
Total Page:16
File Type:pdf, Size:1020Kb
MPEG Workshop Next Generation Media Services and Technologies Media Tech. R&D Center Dr. Jongmin Lee (Center Leader) • The time will soon come when everyone can create, deliver and consume video data everywhere based on 5G network infra • Mobile video service is now rapidly evolving Main keyword: 4K/8K UHD, AR/VR, 3-D, N-screen • Many SKT’s multi-media services are developed / developing based on MPEG technologies and systems HEVC, AVC, MMT, etc. Media Service Trend Media Service Trend • Mobile video traffic is rapidly increasing □ Video Traffic □ Audio,Video Web, Traffic etc. Traffic Daily average T Byte `16 `17 `18 `19 `20 `21 Global Mobile Live Broadcasting Traffic forecast, Cisco 2016 All these devices increase mobile video traffic ! Media Service Trend • Mobile Media Market Trend $ Billion □ Desktop 554 □ Smart phone / Tablets 179 ’20 ’14 Global Online Media Market $ Million 7801 Media Devices (%), *Ref. from StatCounter (2016.10) 6345 5136 4149 7.5 ’14 2,587 3069 1,926 4.5 ’14 ’15 ’16 ’17 ’18 ’19 ’20 ’12 ’14 South Korea Media Market *Ref. from STRABASE (2014.12) Cord-cutting ratio in US. Media Service Trend Source: Mary Meeker, Internet Trends 2016 SKT’s Media Services • Fixed IPTV ( ), Mobile IPTV ( ), 360 VR VoD / Live, etc 8K UHD IPTV Trial (`15.10), UHD Multi-View (`16.9) Adaptive 4K IPTV Commercialization (`14.4) Oksusu VR Streaming Service(`16.10) Oksusu Mobile IPTV Commercialization (`17.10) AI Voice Recognizer / Speaker 360 VR Real-time Streaming SKT’s Global Working • Developing the next-generation TV platform for the U.S market • Various MPEG technologies were adopted into ATSC 3.0, especially, HEVC, DASH, and MMT. • Highly contributed to the MPEG, MMT standard activity. • Hybrid media delivery is the core function leads an enhanced UX of media consumption. • Adopted the various MPEG technologies in SKT’s media services • HEVC, and MMT (including mobile MMT) were integrated in ‘Oksusu’ • Leads the MPEG project with global companies for preparing the 5G media infrastructures. SK’s Media Integrated Platform and Services for 5G Network Architecture for SK’s Media Services • SK’s Media Service Delivery System is configured as ①Create & Casting, ②Encoding & Value Add, ③Delivery & Publish with live and VoD types Create & Casting [Source] Encoding & Value Add [Head end] Deliver & Publish [CDN- 서초/일산/분당 IDC] Live Player Live Up Live Relay Live Relay Streaming streaming Streaming Live Streaming Encoding & Baseband Live Meta Mgmt. Streaming Signal Controller (EPG) Origin/Edge Cameras Live DVR & FileLive & LiveServices 서비스 Transcode Ads. Mux Control Message Control Message VoDVoD서비스 VoD Player Media Services Cast & Media Media Upload Process Delivery Platform Mgr Scheduleer Indicator API Download & File Upload File Upload VoD Pull VoD Streaming Upload Storage Cache Media Files Controller Origin/Edge T-MIP: SKT – Media Integrated Platform • Media Service Functional Architecture Subscriber Billing & Media Services Mgmt. Auth. Media Platform Open API & SDK Orchestrator API Layer Media Service Management API IPTV Security & Upload Processing Publisher Value added Analysis Broadcast Ads. Mgmt. Policy Statistics Cast Mgr 360 AR/VR Analytics Tool Ops. Programming & Injector Mgr. Flow Mobile TV Cast URL Live/VoD Smart URL Chatting DRM Indicator Encode/Trans. Indicator Injector Infra Layer Infra StreamSwitch/ One time URL Device/Region Media Processing Media UpScaler HDR/SR Time Shift generator Detector OTT Media vInfra Management API Media Deliver Indicator Media Service App. AV vCache vStreamer MLR Container Encoder MCN Infra Layer Infra Media Delivery Media Infrastructure Abstraction Resoure Alloc. App Distributer Multi Commander App Repo. Open H/W (Head End/IDC/AWS) Repository Processor T-MIP: SKT – Media Integrated Platform • Architectural Model for Media Service Entity Attachment Media Services & Applications (B2B services and B2C services) MA reference point point MAL reference AO (Media API Layer) MP reference point point reference reference MPL PO (Media Processing Layer) MD reference point reference reference point MOL MDL DO (Media Delivery Layer) MI reference point point reference reference (Media Orchestrator Layer) Orchestrator (Media MIAL IO (Media Infra Abstraction Layer) MR reference point Media Resources (Fixed/mobile network + Cloud infra[e.g., AWS, Azure) SKT-MIP based Solutions • OVP-Online Video Platform Interworking Contract Purchase/Install web admin. Open API SDK Doc. Sample Service System Load tool - CDN Media system Balancing - Storage - Transcoder - Streaming SVR - Media Solution Upload Conversion Contents Delivery Live Chatting Tech. Management Cloud Development/Install Flexible Contents Mgmt. System Operation Service - Media System Interworking - Contents Mgmt. Publishing 360 VR Player Adv. Statics Broadcasting Resource System Monitoring Service Development/Install Server Mass Storage Global 24-HR - 24 Hours Operation Media Services CDN Monitoring - Actual Service based on Sample App. Or Web SKT Provides Media Services including resource and technology as Cloud Service All Functions are provided with Open API / SDK SKT-MIP based Solutions • T-Live Streaming ‘Waiting for up to 30s’ Available to Stream Chunk Chunk Chunk Chunk Chunk HLS (23.ts) (24.ts) (25.ts) (26.ts) (27.ts) 0 10 20 30 40 t Chunklist.m3u8 Origin ‘Just 2s delay’ Content MPU (Media Processing Unit) Source Available to Stream - Frame based Transport SKT Live Streaming 0 10 t SKT-MIP based Solutions T Live Streaming Cloud based Personal Broadcasting Platform • Ultra Low Latency Guaranteed Mobile Streaming Tech. • Individual Participation Possible • Latency: <3s, Sync: <0.1s, Bandwidth Saving: 10% • Low Latency Streaming, Chatting, Ads. Insertion Encoding, DVR, Publishing Site To Be DRM, Schedule, Mobile NVoD, CMS… IPTV Seoul As Is Live MCN T-Live Casting Channel Streaming Chunk #1 Chunk #2 Chunk #3 Chunk #4 Chunk #5 HD (1.ts) SD (2.ts) HD (3.ts) HD (4.ts) SD (5.ts) Social Busan Broadcasting Network 4 8 12 16 20 Platform Ad Tutoring Injection Service Value Proposition Value Proposition Provide Personal Broadcasting Tech. supporting Low Latency decreases for mobile live streaming (15s→3s) Latency / High Visual Quality Supporting User Position Dependent Ads. Insertion High Visual Quality / Low Latency 360 VR Unified Elastic Cache Streaming System • Optimization for Cache Storage and Processing • Live Stitching supporting 4K/60fps • 360 VR Live Broadcasting and Provide Player • Adaptive View Port based on User Viewpoint Value Proposition Value Proposition Cache Storage Performance Enhanced (>9 times) 65% Data Compression with Adaptive View Port Tech. SKT-MIP based Solutions Online Video Platform UHD Multi-Screen Solution • Provide Infra and Solution with PaaS Type for Internet • Provide one UHD screen with 4 separate FHD screens Broadcasting Services • HEVC Tile Syntax Used Upload Encoding Contents Mgmt. Streaming Statics Publishing Security Player Ads. Recording Value Proposition Value Proposition Interworking with CDN for B2B (VoD, Live) Service High Visual Quality and STB Resource Saving with Provides N-screen, Ads. Insertion, Programing, CMS HEVC Tile Syntax H/E HDRHigh Dynamic Range Conversion Super Resolution (H/E Adoption) • SDR(Standard Dynamic Range) Contents to HDR • Video Up-scaling with AI DNN based Algorithm Contents at H/E (Head End) Side • FHD to UHD at H/E with High Performance H/W [non-HDR ] [HDR] Value Proposition Value Proposition Premium HDR IPTV Services Possible for Both Premium 4K IPTV Services Possible for Both VoD/Real- VoD/Real-Time Streaming Time Streaming Network Based Media Processing • NBMP will be the dominant technology for future media service of 5G. SKT’s 5G Architecture Media Source Network-Based Media Processing w/ 5G infra. Key function : enhance the media quality using N/W resources Media Player SK’s AR/VR Platform and Services for 5G Network SKT’s AR / VR Platform • is Total AR / VR Service Platform http://developers.sktelecom.com SKT’s AR / VR Platform • is Total AR / VR Service Platform SKT’s AR / VR Platform • VR Studio. You can create and play VR contents in there Google I/O 2017 (/w Google Daydream) SKT’s AR / VR Platform • Developed Services Status Social Service T real AR 저작 도구 및 AR Browser Collaboration 1. 대상 이미지 촬영 2. 콘텐츠 배치 3. AR 서비스 실행 AR Mobile Google I/O 2015 Authoring (‘15.1) AR Authoring (‘15.1) Game & Entertainment Remote AR T real Telepresence Medical Service Remote Design (‘15.10) (‘17.1) Marketing & Event T real 3D System Google I/O 2017 T real AR Game (‘16.6) Unity VR Studio(‘15.1)Daydream VR Studio (’17.1) AR Baseball Game Play Adventure (’17.3) T.um Theater (‘15.3) Education Productivity T real Adventure(‘15.3) tvN Event (‘16.10) Mobile Symphony EV Visualizer Education AR/VR AR City Demo Remote Assist Orchestra AR (‘15.10) (‘16.3) (‘16.4) (‘15.8) Prototype (‘16.8) SKT’s AR / VR Services • AR Entertainment for Baseball Game SKT’s AR / VR Services • 360 VR Live Trial Services (4K, Real-time) High Quality SKT AR / VR Services • 360 VR Streaming Services (BMW Driving Center) Functional Architecture 360 Camera Stitching TLS Streaming Player (T5 Gopro x 6) & Encoding (/w 5G N/W) (HMD, phone) SKT AR / VR Services • 360 VR Streaming Services (Korean Pro Baseball Game) Strong Immersiveness is obtained via 360 VR Video with Multi-Cameras 360 Video Transmission 3rd Base 1st Base Camera Camera Home Camera SKT AR / VR Services • 360 VR Streaming Services (CES2018) • 360 VR Streaming Services (in Collaboration with Kia Motors@CES2018) • Real-time Streaming via 5G Submarine Fiber-Optic Cables Between KOR-USA Conclusion • SKT is preparing 5G revolution era with innovative service platforms and solutions • SKT is especially interested in technology for effective multi-media processing and fast delivery • SKT is also proposing these platforms and solutions to MPEG and hoping these solutions to be popularized soon • Flexible standardization is required for faster and effective video processing and delivery VR targeted video compression is being standardized in MPEG T-MIP and T-Real can be standardized .