CLOUD BROWSING TF WEB and TV IG W3C W3C TPAC MEETING, OCTOBER 26Th, 2015 SAPPORO Alexandra Mikityuk, Dr
Total Page:16
File Type:pdf, Size:1020Kb
Browser CLOUD BROWSING TF WEB AND TV IG W3C W3C TPAC MEETING, OCTOBER 26th, 2015 SAPPORO Alexandra Mikityuk, Dr. Oliver Friedrich TELEKOM INNOVATION LABORATORIES AGENDA • Introduction: § W3C relevance § From virtual Set-Top Box to Cloud RTEs and APIs • Cloud Browsing TF § Outline/ Problem statement § Group scope/ goals § Participants so far (W3C and non-W3C members) § Working mode (TF IG, CG) • What is done so far: Cloud Browser APIs § Cloud Browsing Reference Architecture: Function placement - from client- server to virtual OS § Cloud Browsing Use Cases/ APIs § Basic Use Cases § Practical tests TELEKOM INNOVATION LABORATORIES 10/26/15 2 CLOUD BROWSING W3C RELEVANCE • Web & TV IG and corresponding TFs and WGs cover and provide ideas and specifications for nearly all use-cases relevant for TV • The focus is on (device-) APIs providing access to content, data and hardware functionalities • T-Labs have evangelized inside DT to make use of W3C’s, HbbTV’s and OIPF’s specifications over the last years and succeeded: all future deployments will be browser-based and will support W3C and HbbTV specs. • Open issues: what to do with legacy devices (STBs) and even new, low performance devices not supporting a local browser • Solution: put the browser into the Cloud • But: what happens if the browser does not run on the local device? Something feels wrong with regards to the existing specifications. • Feasibility has been proven with the help of different partners but now it’s time to look at the Cloud Browsers in a more mature manner: in W3C TELEKOM INNOVATION LABORATORIES 10/26/15 3 INTRODUCTION From virtual Set-Top Box to Cloud RTEs and APIs VIRTUAL SET-TOP BOX Multiple media data Home UI stream/H.264 Virtual Set-Top Box IP 01 RC Commands Cloud TELEKOM INNOVATION LABORATORIES – streng vertraulich, vertraulich, intern, öffentlich – 10/26/15 5 CLOUD BROWSER TO ENABLE CLOUD USER INTERFACE CLIENT data LOCAL UI BACK EXECUTION OFFICES MULTISCREE N API CLIENT data VIDEO Browser CLOUD-BASED EXECUTION Cloud-rendered ui implementations § Cloud-rendered UI is a concept that enables the shift of the browser from § Cloud UI: Cablevision Systems, the STB into the Cloud. Therefore, the rendering of the content/ User Ziggo, Charter Communications, Interface happens in the browser in the Cloud. The UI is then delivered to Glashart Media, Liberty Global, the STB in the H.264 MPEG-TS stream. Dish § The STB runs a lightweight client that handles video decoding and the key § Adds, OTT: BrightLine, events. Operators has already begun to deploy CloudTV services Cablevision, UPC Hungary TELEKOM INNOVATION LABORATORIES 10/26/15 6 CLOUD BROWSING TASK FORCE WEB AND TV IG OUTLINE • Over the last decade Web browsers have reached desktop, mobile and also TV domains. • Beside connected TVs, more and more new STB deployments all over the world make use of Web browser technology as their core runtime environment for portals and applications. • However, there are a lot of new coming low-end devices like HDMI-Dongles and lightweight STBs that would never be able to execute the Web browser locally. • Indeed, also millions of legacy devices already do not have enough hardware capacity to support Web browser technologies. TELEKOM INNOVATION LABORATORIES 10/26/15 8 PROBLEM STATEMENT • In the last decade, after the Browser has Security become a runtime environment for STB TV-related Technologies Browser-related Technologies middleware, a lot of work has been done Cloud Browser RTE Core by standardization bodies on the definition Approach 1 Approach k of device APIs. Cloud UIs Approach n Different Functionalities • These APIs were required to enable the with respect to local browser to talk to the local resources the Approach 1-n HbbTV Service Tuner EPG Multi-device of the STBs interaction Remote • In the mobile domain the major work has Control Encrypted Media been completed by W3C, whereas in the Extentions TV domain by the HbbTV and OIPF. Media Source Extentions • Analog to this, new emerged Cloud browser Runtime Environments (RTEs) require the definition of APIs that would Cloud Browser APIs enable communication between the Cloud browser and the client. Security Technologies Enabler • This is currently a gap on the way to endow Cloud User Interface (UI) Terminal Approach 1 Approach k Approach n Functions Cloud UI architectures with a rich future perspective. TELEKOM INNOVATION LABORATORIES 10/26/15 9 CLOUD BROWSING TF SCOPE, GOAL & OPEN QUESTIONS Scope/goal: • Reference architecture • Definition of Scenarios and Use Cases • Definition of missing APIs for Cloud RTE adaptation • Interface definition • Align the definition of existing gaps with the work of WGs and CGs Results: • Cloud Browser API definition/ description • Demonstrate where this TF addresses the limit of current standards Open Questions: à Interface definition can not be done within a TF IG àTF IG or CG? à Privacy? TELEKOM INNOVATION LABORATORIES – streng vertraulich, vertraulich, intern, öffentlich – 10/26/15 10 GAP IN EXISTING STANDARDS Cloud Browsing TF will look into existing technologies and will identify the gap for CB RTE adaptation: • Canvas • WebGL • WebSocket • Webcrypto Cloud Browsing TF will look into existing API CGs and WGs and will identify the gap for CB RTE adaptation: • TVAPI CG • TV Control API • Presentation API • Device API TELEKOM INNOVATION LABORATORIES – streng vertraulich, vertraulich, intern, öffentlich – 10/26/15 11 CLOUD BROWING TF PARTICIPANTS W3C Members Non-W3C Members § Alexandra Mikityuk, Deutsche Telekom § Active Video § Oliver Friedrich, Deutsche Telekom § TVersity § Louay Bassbouss, Fraunhofer FOKUS § Zenterio § Calin Ciordas, Irdeto § Metrological § Dale Rochon, AT&T § Massive Interactive § John Luther, JW Player § University of Sannio § Kumanan Yogaratnam, Espial § Daniel Davis, W3C § Paul Higgs, Ericsson § Bob Lund, CableLabs § Nilo Mitra, Ericsson § Kaz Ashimura, W3C § Harrison Hongseo Yun, Entrix (SK Telecom) § KPN? TELEKOM INNOVATION LABORATORIES – streng vertraulich, vertraulich, intern, öffentlich – 10/26/15 12 CLOUD BROWING TF TIMELINE • 3 to 6 Task Force month Community • To be Group? done Working • To be Group? done TELEKOM INNOVATION LABORATORIES – streng vertraulich, vertraulich, intern, öffentlich – 10/26/15 13 CLOUD BROWSING What IS DONE SO FAR CLOUD BROWSING REFERENCE ARCHITECTURE REFERENCE ARCHITECTURE Decoder Processing Storage H.264/ Trans- nPVR, EPG*/ PVR* MPEG-2 code Timeshi STBs, legacy STBs, Connected TVs Vo D Executor Renderer Composer • UI • Apps VoD, LiveTV • UI • Video • Updates • Video • App • App Smartphones web audio/video CAS, Session, H.264/ DRM NetworK MPEG-2 HDMI S-cKs, HTML5 Content Common Interface CSS3 Protec-on Management Encoder modules Applicaons < EPG*: Electronic Program Guide PVR*: Personal Video Recorder TELEKOM INNOVATION LABORATORIES 10/26/15 16 REFERENCE ARCHITECTURE SINGLE AND DOUBLE STREAMS Double Stream Single Stream UI/App + Content UI & Apps UI & Content RC Commands RC Commands Zero Client StacK Zero Client StacK GUI Client Applicaon DecodingHTTP/ UDP box with dual DSP UI rendering + service composition Session Manager UI renderingMedia Player on the server on the server Composition of A/V streaming and UI GPU virtualization (VM for Operang System/ Drivers CA/DRM Operang System/ Drivers CA/DRM in the STB displays) Forwarding of RCHardware commands via http Forwarding ofHardware RC commands via http Pure decoding box with H.264 TELEKOM INNOVATION LABORATORIES – streng vertraulich, vertraulich,decoding intern, öffentlich – 10/26/15 17 PROBLEM STATEMENT: CLOUD BROWSER -- DEVICE API Service App Content Renderi Executio Handlin Protecti ng CLIENT n g on Browser TRADEOFF Session Auth, AuthZ, Start/Invoke/Suspend/Kill/List/ Double, Status… Video Playback, Trick functions (fast forward, fast rewind), Pull/Push… User Refresh/Interrupt/Update/Save status/Key handling (Key Interface events, mouse events)/Set Frame (Multiscreen)… Service Video Tuner, EPG, PVR, Ad Insertion, Multi- device, PiP… Security Is encrypted/Define DRM System/Key Request/ Response/ CA/EME… Signaling Control channel, DVB SI Tables (AIT Data for HbbTV support) TELEKOM INNOVATION LABORATORIES 10/26/15 18 FUNCTION PLACEMENT: SERVER VS. CLIENT Service App Content Renderi Executio Handlin Protecti ng n g on TRADEOFF Securi Apps ty What goes into HbbT PVR the cloud? V Live EPG TV Time Qualit shiftin y g probes TELEKOM INNOVATION LABORATORIES – streng vertraulich, vertraulich, intern, öffentlich – 10/26/15 19 VIRTUAL OS Hardware function s Middleware Media Player function s Virtual OS function Media Stack Codecs s function ….. s TELEKOM INNOVATION LABORATORIES – streng vertraulich, vertraulich, intern, öffentlich – 10/26/15 20 CLOUD BROWSING USE CASES/ APIS CLOUD BROWSERS USE CASES Video Tuner/ § Red-buttonContent synchronization between Multi-device EPG § HbbTV2.0 adds tools to launch and § Tuner and EPG APIs are traditionally the server and the client side. manage applications running on a implemented in the STB based on § The AIT tables are sometimes companion screen. DVB broadcast specifications. different depending on the geo § If parts or the complete application § Equivalent APIs need to be location of the user. running on the client and the 2nd developed to replace existing Tuner § For scenarios where the Red-Button screen device are shifted to the and EPG features. signaling is terminated on the STB cloud the related multi device § A hybrid approach should also be the integrity of the signal must be interaction functions should be discussed, e.g. Tuner