From Scene Descriptions to Multimedia Web Applications

Total Page:16

File Type:pdf, Size:1020Kb

From Scene Descriptions to Multimedia Web Applications HABILITATION A` DIRIGER DES RECHERCHES DE L'UNIVERSITE´ PIERRE ET MARIE CURIE HABILITATION A` DIRIGER DES RECHERCHES Sp´ecialit´e: Sciences pour l'ing´enieur pr´esent´eepar Cyril CONCOLATO Interactive Media Streaming Soutenue le 25/10/2016 devant le jury compos´ede M. Vincent CHARVILLAT Professeur, Universit´ede Toulouse Rapporteur M. Dick BULTERMAN Professeur, Vrije Universiteit Amsterdam Rapporteur M. Carsten GRIWODZ Professeur, Universitetet i Oslo Rapporteur M. Pierre SENS Professeur, Universit´eParis 6 Examinateur M. Gwendal SIMON Ma^ıtrede Conf´erences,HDR, Telecom Bretagne Examinateur M. Christian TIMMERER Associate Professor, Universit¨atKlagenfurt Examinateur M. Jean-Claude DUFOURD Directeur d'´etudes,Telecom ParisTech Examinateur ii Contents 1 Foreword 1 2 Introduction 5 3 From Scene Descriptions to Web Applications 7 3.1 Scene Description Activities . 8 3.1.1 MPEG-4 BIFS . 8 3.1.2 Mixing Scene Description formats . 8 3.1.3 Extending the SVG format . 9 3.2 Interactive Media Applications . 11 3.2.1 Synchronized and Interactive Streams . 11 3.2.2 Personalized Interactive Application . 13 3.3 Communicating Web Applications . 15 3.3.1 Widgets . 15 3.3.2 Multi-screen Web Applications . 17 3.4 Conclusion . 17 4 Multimedia Application Adaptation 19 4.1 Adaptive Images . 20 4.2 Multimedia Documents Adaptation . 21 4.3 Broadcast-Friendly Adaptation using Scalable Multimedia Doc- uments . 23 4.4 Conclusion . 26 5 HTTP Adaptive Streaming 27 5.1 Standardization activities . 28 5.2 Adaptive Streaming of Text Content . 28 5.3 HTTP Streaming Latency . 30 5.4 Adaptive Streaming of Tiled Videos . 33 5.5 Conclusion . 34 iii 6 Multimedia Application Delivery 35 6.1 Document Streaming . 36 6.2 Electronic Program Guide Streaming . 36 6.3 Application broadcasting . 38 6.4 Application delivery over MPEG-DASH . 38 6.5 Application delivery over ISOBMFF . 39 6.6 Hybrid Multimedia Delivery . 39 6.7 Application delivery over Hybrid networks . 40 6.8 Conclusion . 41 7 Conclusion and perspectives 43 Bibliography 47 iv Chapter 1 Foreword At the time of writing of this report, I have been carrying research activities for the past 15 years, mostly at Telecom ParisTech, formerly Ecole Nationale Sup´erieurede T´el´ecommunications, in Paris, France. Telecom ParisTech is a public institution and as such dissemination is a very important part of the research. Dissemination often takes the form of published papers. I have published so far 60 papers in journals or con- ference proceedings. I have also applied for more than 18 patents. A list of my published papers available online in my publications page1 and many are listed in the bibliography chapter of this report. Figure 1.1 presents a graphical overview of some of my publications, since my PhD, between 2008 and 2015, along a timeline, highlighting the topics I have covered and the links between publications. These topics will be covered in this report. The impact of the dissemination of a researcher is often measured with paper citations. According to my Google Scholar's profile2, I've been cited 423 times. This does not unfortunately measure the impact of my contribu- tions to open-source software, which is a particularity of my research activity and that I consider a complementary and important dissemination activity. Most, if not all, of my research leads to publication of open-source software, in particular within GPAC3, a multimedia platform developed at Telecom ParisTech. My GitHub profile page4 indicates a total of 568 contributions to open-source software in the last year. My OpenHub profile page5 indicates 1Full list of publications https://concolato.wp.mines-telecom.fr/publications/ 2Google Profile page https://scholar.google.fr/citations?user= ySXws0oAAAAJ&hl=fr&oi=ao 3Website of the GPAC project http://gpac.io 4Personal GitHub page https://github.com/cconcolato 5Personal OpenHub page see https://www.openhub.net/p/gpac/contributors/2598440182341747 1 Web & & Web Widget & & Widget Streaming MultiScreen Video Streaming MMSP MMSP 2015 Web 3D 2015 internet delivery internet Multimedia 2015 Multimedia XML Prague XML 2015 Latency and Hybrid Hybrid and Latency Streaming Services Graphical Web 2015 mediaand easier for MPEG-DASH for Low MPEG-DASH Fast DASH Bootstrap Fast Packaging web graphics Packaging Synchronized Delivery of Synchronized Scene 3D Scenes with Audio and 3D Scenes & Hybrid & In-Browser XML Document In-Browser XML Broadcast Broadcast Adaptation Adaptation Adaptation & Streaming & DocEng 2015 Oriented Web Page Oriented Web Page MSoS: A Multi-Screen- MSoS: A Segmentation Approach Segmentation Scene Scene Open Open Source Description DASH IISA 2014 IISA of Low LiveLatency of Browser Streaming using MPEG-Streaming using DocEng 2014 DocEng Overhead and Performance Overhead Performance and MMSys 2013 MMSys Refactoring Web Refactoring Web The Virtual Splitter: Virtual The Applications for the for Applications Multiscreen Environment Live HTTP Streaming of HTTP Streaming of Live Legend Video and Subtitles Video withinand a Subtitles on the onWeb the MMSP MMSP 2013 SIGGRAPH SIGGRAPH 2013 curve imagescurve from boundary elements Biharmonic diffusion diffusion Biharmonic Graphical Graphical Web 2013 Streaming Server Streaming SVG animations Streaming SVG animations DashCast, A DASH DashCast, Live MMSys 2013 MMSys Distributed DASH Dataset Distributed The MPEG The MPEG Digital Media Springer 2012 Springer Representation ofRepresentation and playback MediaSync 2013 MediaSync using MPEG DASH MPEG using MMSys 2012 Hybrid Broadcast Services Broadcast Hybrid broadband networks broadband GPAC, toolbox for GPAC,interactive for toolbox SIG Multimedia SIG 2012 Records multimedia packaging, delivery packaging, delivery multimedia multimedia content over content over multimedia Synchronized delivery of of Synchronized delivery uncoordinated broadcast uncoordinated broadcast Figure 1.1: Timeline of my academic publications MMSys 2011 Applications EuroiTV 2011 Recording and Recording and Usages of DASH for DASH Usagesfor of Rich Services Rich Media Delivery of HbbTVDelivery of multimedia documents MTAP 2011 Communicating and and Communicating migratable interactive migratable Multimedia 2011 Multimodal Recordings Dance from Performance Enhanced Visualisation of VisualisationEnhanced of Automatically Synchronised Automatically SAPMIA 2010 Adaptive Video and Video and Adaptive Multimedia Documents Metadata Display using Display using Metadata the Distance the using GPAC using Movid 2010 MELECON 2010 MELECON Multimedia 2011 Multimedia MTAP 2010 Mobile Devices and Devices Mobile and Experimenting with Experimenting SVG Electronic SVG Gestures to aControl Program Guides SVG Open 2010 Open SVG Multimedia Advances Multimedia A of Analysis Formative Annotation based Annotation based mobile applications mobile A Model for the for Model Delivery A Multimedia Application from Multimedia Application over Broadcast Channels Broadcast over of Interactive Applications Interactive Applications of presentation of videos for of presentation personalized adaptation personalizedand MMEDIA MMEDIA 2010 graphics graphics formats primitive for vector vector for primitive SuperPath: a SuperPath: necessary MTAP 2009 MTAS 2009 MTAS Widgets Widgets Mobility Widgets Authoring Authoring of Scalable Multimedia Documents Multimedia 2 SVG 2009 Open DocEng 2009 Experiences SVG Communicating Communications Documents UCMEDIA 2009 UCMEDIA WIAMIS 2009 Mobile Multimedia Mobile 2009 MM for Dynamic Widgets Dynamicfor Declarative Interfaces Declarative Interfaces mobile applications mobile and presentation of and of presentation Summarization of Summarization annotated videos for videos annotated EuroiTV 2009 EuroiTV Scalable Multimedia Scalable Multimedia Conversion of Images to Conversion of Natural-Language-based Natural-Language-based Declarative EPG Declarative Personalized adaptation Personalized adaptation and Presentation of Presentation and Multimedia Multimedia Documents Generation, Streaming Generation, DocEng 2008 Playback of Mixed Playback Radio ICCE 2009 ICCE DocEng 2008 An MPEG-based An MPEG-based Scalable Multimedia Scalable Multimedia Documents for Digital Documents and devices mobile Widget System forWidget System CE DocEng 2008 Trans. CE 2008 Trans. Vector Scalable Graphics Player for Player Graphics Constrained Devices Design of an Efficient of an Design Adaptation of Scalable of Adaptation Multimedia Documents ICME 2008 TVC/CGI 2008 TVC/CGI in Broadcast Home Networks Home Environments Multimedia Access in AccessMultimedia User-Centric Universal Spatial Scene Adaptation 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 TPT 2007 TPT optimisations Descriptions de de Descriptions représentations et représentations scènes multimédia : scènes a total of about 700 contributions to GPAC since the beginning of these statistics. A confirmation that my open source activity is important for my research is that my most cited paper is the first paper presenting GPAC at the ACM Multimedia Conference [44]. When analyzing someone's research record, it is also interesting to see who he/she publishes with. I've published my academic papers with 81 different persons from 20 different institutions, but mostly research centers and few universities. This highlights an important aspect of my research activities, that most of them have been carried through collaborations with companies, rather than with other universities. This is the consequence I believe of two characteristics. First, most of my research has been funded either by the French research
Recommended publications
  • Tr 126 907 V14.0.0 (2017-04)
    ETSI TR 126 907 V14.0.0 (2017-04) TECHNICAL REPORT Universal Mobile Telecommunications System (UMTS); LTE; HTML5 for a new presentation layer in 3GPP services (3GPP TR 26.907 version 14.0.0 Release 14) 3GPP TR 26.907 version 14.0.0 Release 14 1 ETSI TR 126 907 V14.0.0 (2017-04) Reference RTR/TSGS-0426907ve00 Keywords LTE,UMTS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N° 348 623 562 00017 - NAF 742 C Association à but non lucratif enregistrée à la Sous-Préfecture de Grasse (06) N° 7803/88 Important notice The present document can be downloaded from: http://www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within ETSI Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment to one of the following services: https://portal.etsi.org/People/CommiteeSupportStaff.aspx Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of ETSI.
    [Show full text]
  • WAVE Interoperability Boot Camp
    Thank You to Our Sponsors WAVE Interoperability Boot Camp October 2nd, 2018 Technology & Standards Forum | Los Angeles, CA AGENDA • Introduction to WAVE – Paul Hearty, Sony Electronics • Presentations: • WAVE Technical Overview – Will Law, Akamai • WAVE Content Specification – Mike Bergman, CTA • WAVE Applications Environment – Mark Vickers, Comcast • WAVE Device Playback Capabilities – Mike Bergman, CTA • WAVE Test Suites – Mike Bergman, CTA • Q&A/Wrap-up – Paul Hearty, Moderator Overview of the WAVE Project Paul Hearty / Sony Electronics, Inc. Introduction to WAVE • What are the problems WAVE is addressing? • What are the WAVE solutions? • WAVE participating companies • WAVE work structure Supporting a fragmented OTT world • Fragmentation impacts content providers and device makers: • Multiple streaming formats (HLS, HDS, DASH, Smooth) • Multiple device types from laptops to phones to gaming consoles • Inconsistent device performance capabilities • Inconsistent device compliance to industry specifications • The result: • Content providers: Increased cost to prepare, store and support OTT • Device makers: Increased test and support costs for devices Commercial OTT Video Issues: WAVE Solution Device Playback Device HTML5 Reference Content Capabilities Platform Content Specification Testable requirements Reference application • Based on MPEG Common • covering most common framework Media Application Format playback interoperability • Based on HTML5 (CMAF) issues. • Provides functional • Compatible with DASH and guidelines for playback HLS.
    [Show full text]
  • Specification for Devices 2020
    Certify Devices Specification for Devices 2020 Version: 4.20-r1 Date: 2019-12-19 Specification for Devices 2020, v4.20 © Vewd Software AS 2020. All rights reserved. _____________________________________________________________________________________ CONTENTS 1. REVISION HISTORY 2. INTRODUCTION 2.1. Scope 2.2. Versions for requirements and software 2.2.1. Backward compatibility 2.3. Definitions 2.4. Compliance terminology used in this document 2.4.1. REQUIRED and CONDITIONALLY REQUIRED features 2.4.1.1. DRM 2.4.1.2. Codecs and media formats 2.4.1.3. Keys on the remote control 2.4.1.4. Resolution 3. TECHNICAL REQUIREMENTS 3.1. HTML5 <video> and <audio> 3.1.1. Media element 3.1.1.1. Requirements for video and audio media elements 3.1.1.2. Requirements for video media elements 3.1.1.3. Codec support 3.1.2. Track element 3.1.2.1. Requirements for all track elements 3.1.2.2. Requirements for text track elements 3.2. Media streaming 3.2.1. Transport protocols 3.2.2. Progressive download 3.2.3. Adaptive Bitrate streaming protocols 3.2.3.1. Apple HTTP Live Streaming (HLS) 3.2.3.1.1. Restrictions for HLS content 3.2.3.2. MPEG-DASH 3.2.3.2.1. Restrictions for MPEG-DASH content 3.2.3.3. Microsoft Smooth Streaming (MSSS) 3.2.3.3.1. Restrictions for Smooth Streaming content 3.3. Media Source Extensions (MSE) 3.4. Subtitles and Closed Captioning 3.5. DRM 3.5.1. Content Decryption Modules (CDMs) 3.5.1.1. ClearKey 3.5.1.2.
    [Show full text]
  • Media Source Extensions
    static void _f_do_barnacle_install_properties(GObjectClass *gobject_class) { GParamSpec *pspec; Media Source Extensions /* Party code attribute */ pspec = g_param_spec_uint64 (F_DO_BARNACLE_CODE, "Barnacle code.", "Barnacle code", on WebKit using GStreamer 0, G_MAXUINT64, G_MAXUINT64 /* default value */, G_PARAM_READABLE | G_PARAM_WRITABLE | G_PARAM_PRIVATE); g_object_class_install_property (gobject_class, F_DO_BARNACLE_PROP_CODE, Enrique Ocaña González [email protected] Motivation for MSE ● HTML5 video tag: <video src=ºmovie.mp4º type=ºvideo/mp4º /> ● Improvement: Blob URI ● Adaptive streaming and time shift limitations ● Solution: Media Source Extensions (MSE) https://w3c.github.io/media-source/ ● JavaScript can generate and feed video data ● More control on the player state How to use MSE SourceBuffer ● Append API for JavaScript: Data... ● HTMLMediaElement, Blob SourceBuffer ● MediaSource, SourceBuffer MediaSource ● Blob URL {Audio,Video,Text}Track HTMLMediaElement <audio> <video> <video id="video"></video> MediaPlayer <script> var video = document.getElementById(©video©); var ms = new MediaSource(); ms.addEventListener(©sourceopen©, function() { var videoSb = ms.addSourceBuffer(©video/mp4; codecs="avc1.640028"©); var audioSb = ms.addSourceBuffer(©audio/mp4; codecs="mp4a.40.2"©); videoSb.appendData(...); audioSb.appendData(...); }); var blobUrl = URL.createObjectURL(ms); video.src = blobUrl; </script> Design PlatformTimeRanges m_mediaSource m_mediaElement MediaSource SourceBuffer PrivateClient PrivateClient MediaPlayer m_client MediaPlayerClient
    [Show full text]
  • W2: Encoding 2017: Codecs & Packaging for Pcs, Mobile
    W2: ENCODING 2017: CODECS & PACKAGING FOR PCS, MOBILE, & OTT/STB/SMART TVS Jan Ozer www.streaminglearningcenter.com [email protected]/ 276-235-8542 @janozer Agenda •Fundamentals •Targeting your platforms •Producing and delivering your streams •Configuring your streams Shameless Plug • All tables from this book • Published 12/16 • Retail - $49.95 – print • PDF - $39.95 • Show special: • $40 • PDF included no extra charge • Limited supply available (only books bought at show) Fundamentals • Compression related • Delivery paradigms • Bitrate control (CBR/VBR) • I-, B-, and P-frames • Choosing a codec • Codecs/container formats Compression-Related Fundamentals • Delivery paradigms: Single vs. Adaptive Bitrate (ABR) • Bitrate control techniques • I-, B- and P-frames Adaptive Streaming • Adaptive streaming • Delivered adaptively based upon playback CPU and • Single input file (live or VOD) connection bandwidth • Encoded to multiple outputs • Technically complex, but optimizes experience across all platforms and connection types Illustration courtesy of www.bitmovin.net Single vs. Adaptive • Single file delivers inferior experience • Very simple to achieve via Gen 1 HTML5 (video tag) and support in mobile • This approach excludes adaptive, DRM, live, and advertising support • Resources: • Webinar: Distributing to Desktops and Mobile Devices via HTML5 (bit.ly/Ozer_MSE_EME) • Video tutorial: Supporting HTML5 with Flash Fallback in Squeeze 9 (bit.ly/squeeze_html5) • Our focus is on adaptive delivery ABR Technology Overview • Two types of systems
    [Show full text]
  • Hbbtv 2.0.3 Explained” Hbbtv Specification Naming
    What's new in the HbbTV Specification “HbbTV 2.0.3 Explained” HbbTV Specification Naming Informal Name Formal Name HbbTV 1.0 TS 102 796 V1.1.1 HbbTV 1.5 TS 102 796 V1.2.1 HbbTV 2.0 TS 102 796 V1.3.1 HbbTV 2.0.1 TS 102 796 V1.4.1 HbbTV 2.0.2 TS 102 796 V1.5.1 HbbTV 2.0.3 TS 102 796 V1.6.1 (tbc) ??? ??? HbbTV Association | Copyright © HbbTV 2 3 Elements to HbbTV 2.0.3 • Errata to HbbTV 2.0.1/2 – Fixing bugs in the spec • Updates to existing features – Goal for 2.0.3 was “low hanging fruit” that are easy to specify & test • No big new features – these were deferred to the next iteration – Critical updates already widely supported in practice – One small new feature • Removing unused and replaced features – Cannot keep adding features and never removing anything HbbTV Association | Copyright © HbbTV 3 What are Errata? • Fixes to bugs in the spec • HbbTV publishes >1 document for each errata – May be cosmetic release • Punctuation, cross-references, … – A list of the changes to the specification(s) – Might be language that’s unclear or hard to – A version of the specification(s) with the errata understand integrated & changes tracked – May be ambiguities • All HbbTV errata have an issue number • Something that can genuinely be interpreted in – Issue numbers can be used to cross-reference more than one way between the two documents – May be conflicts & inconsistencies – HbbTV members can use the number to lookup • Statements that actually say different things the discussion in our issue tracking system – Things that are hard or even impossible
    [Show full text]
  • Standards for Web Applications on Mobile: Current State and Roadmap
    Standards for Web Applications on Mobile: current state and roadmap January 2014 Latest version http://www.w3.org/Mobile/mobile-web-app-state/ This version http://www.w3.org/2014/01/mobile-web-app-state/ (PDF version) Previous version http://www.w3.org/2013/09/mobile-web-app-state/ Web technologies have become powerful enough that they are used to build full-featured applications; this has been true for many years in the desktop and laptop computer realm, but is increasingly so on mobile devices as well. This document summarizes the various technologies developed in W3C that increase the capabilities of Web applications, and how they apply more specifically to the mobile context. A good subset of these technologies are described and explained in the W3C on-line training on programming Web applications. 1. Graphics ...................................................................................................................................................................................3 2. Multimedia.............................................................................................................................................................................10 3. Device Adaptation .................................................................................................................................................................14 4. Forms .....................................................................................................................................................................................17
    [Show full text]
  • Secure Remote Service Execution for Web Media Streaming
    Secure Remote Service Execution for Web Media Streaming vorgelegt von Dipl.-Ing. Alexandra Mikityuk geb. in Leningrad, UdSSR von der Fakultät IV – Elektrotechnik und Informatik der Technischen Universität Berlin zur Erlangung des akademischen Grades Doktor der Ingenieurwissenschaften - Dr.-Ing. - genehmigte Dissertation Promotionsausschuss: Vorsitzender: Prof. Dr. Thomas Magedanz, Technische Universität Berlin Gutachter: Prof. Dr. Jean-Pierre Seifert, Technische Universität Berlin Gutachter: Prof. Dr. Jean-Claude Dufourd, ParisTech Gutachter: Prof. Dr.-Ing. Ina Schieferdecker, Technische Universität Berlin Tag der wissenschaftlichen Aussprache: 29. August 2017 Berlin 2017 D 83 Abstract Through continuous advancements in streaming and Web technologies over the past decade, the Web has become a platform for media delivery. Web standards like HTML5 have been designed accordingly, allowing for the delivery of applications, high-quality streaming video, and hooks for interoperable content protection. Efficient video encoding algorithms such as AVC/HEVC and streaming protocols such as MPEG-DASH have served as additional triggers for this evolution. Users now employ Web browsers as a tool for receiving streaming media and rendering Web applications, and browsers have been embedded into almost every kind of connected device. The drawback of these technical developments and quick rate of user adoption is that modern Web browsers have introduced significant constraints on devices’ capabilities. First, the computational requirements have risen continuously, resulting in a cycle where modern devices can be nearly outdated after a year or two. Second, as the integration of browser technologies is a complicated matter, not every platform provides the same performance. Different Operating Systems (OSs), chipsets and software engines are the main reasons for this difference in performance.
    [Show full text]
  • HTML5 MSE Playback of MPEG 360 VR Tiled Streaming Javascript Implementation of MPEG-OMAF Viewport-Dependent Video Profile with HEVC Tiles
    HTML5 MSE Playback of MPEG 360 VR Tiled Streaming JavaScript implementation of MPEG-OMAF viewport-dependent video profile with HEVC tiles Dimitri Podborski, Jangwoo Son, Gurdeep Singh Bhullar, Robert Skupin, Yago Sanchez Cornelius Hellge, Thomas Schierl Fraunhofer Heinrich Hertz Institute Multimedia Communications Group Berlin, Germany [email protected] ABSTRACT 1 INTRODUCTION Virtual Reality (VR) and 360-degree video streaming have gained Virtual Reality (VR) and 360-degree video streaming have gained significant attention in recent years. First standards have been popularity among researchers and the multimedia industry in re- published in order to avoid market fragmentation. For instance, cent years. For example, in addition to many published research 3GPP released its first VR specification to enable 360-degree video papers in this area, several standardization organizations such as streaming over 5G networks which relies on several technologies ISO/IEC, MPEG and 3GPP have published their first specifications specified in ISO/IEC 23090-2, also known as MPEG-OMAF. While on VR [1][6]. One such specification is the result of an MPEG some implementations of OMAF-compatible players have already activity and is referred to as the Omnidirectional Media Format been demonstrated at several trade shows, so far, no web browser- (OMAF) that specifies a storage and delivery format for 360-degree based implementations have been presented. In this demo paper multimedia content. OMAF particularly defines the HEVC-based we describe a browser-based JavaScript player implementation of viewport-dependent media profile for video which allows to stream the most advanced media profile of OMAF: HEVC-based viewport- HEVC tiles of different resolutions and finally combine them into dependent OMAF video profile, also known as tile-based streaming, a single bitstream so that only one video is decoded on the client with multi-resolution HEVC tiles.
    [Show full text]
  • CTA Specification, CTA-5000) and W3C (As a Final Community Group Report), by Agreement Between the Two Organizations
    CCTTAA SSppeecciiffiiccaattiioonn Web Application Video Ecosystem – Web Media API Snapshot 2017 CTA-5000 December 2017 NOTICE Consumer Technology Association (CTA)™ Standards, Bulletins and other technical publications are designed to serve the public interest through eliminating misunderstandings between manufacturers and purchasers, facilitating interchangeability and improvement of products, and assisting the purchaser in selecting and obtaining with minimum delay the proper product for his particular need. Existence of such Standards, Bulletins and other technical publications shall not in any respect preclude any member or nonmember of the Consumer Technology Association from manufacturing or selling products not conforming to such Standards, Bulletins or other technical publications, nor shall the existence of such Standards, Bulletins and other technical publications preclude their voluntary use by those other than Consumer Technology Association members, whether the document is to be used either domestically or internationally. WAVE Specifications are developed under the WAVE Rules of Procedure, which can be accessed at the WAVE public home page (https://cta.tech/Research-Standards/Standards- Documents/WAVE-Project/WAVE-Project.aspx) WAVE Specifications are adopted by the Consumer Technology Association in accordance with clause 5.4 of the WAVE Rules of Procedures regarding patent policy. By such action, the Consumer Technology Association does not assume any liability to any patent owner, nor does it assume any obligation whatever to parties adopting the Standard, Bulletin or other technical publication. This document does not purport to address all safety problems associated with its use or all applicable regulatory requirements. It is the responsibility of the user of this document to establish appropriate safety and health practices and to determine the applicability of regulatory limitations before its use.
    [Show full text]
  • Data-Independent Sequencing with the Timing Object
    Data-independent sequencing with the Timing Object ∗ A JavaScript Sequencer for single-device and multi-device Web media. Ingar M. Arntzen Nj˚alT. Borch Norut Northern Research Institute Norut Northern Research Institute Tromsø, Norway Tromsø, Norway [email protected] [email protected] ABSTRACT Keywords Media players and frameworks all depend on the ability sequencing, web, timed data, timing object, timed visual- to produce correctly timed audiovisual effects. More for- ization, multimedia, media synchronization, multi-device, mally, sequencing is the process of translating timed data distributed, intra-destination media synchronization, inter- into correctly timed presentation. Though sequencing logic destination media synchronization is a central part of all multimedia applications, it tends to be tightly integrated with specific media formats, authoring 1. INTRODUCTION models, timing/control primitives and/or predefined UI el- Multimedia frameworks are always built around the idea ements. In this paper, we present the Sequencer, a generic of organizing and playing back media relative to some time- sequencing tool cleanly separated from data, timing/control line. For continuous media, audio and video frames are laid and UI. Data-independent sequencing implies broad utility out back-to-back, usually filling the entire timeline. For dis- as well as simple integration of different data types and de- crete media, such as timed subtitles or timed comments, the livery methods in multimedia applications. UI-independent distribution (along the timeline) may often be more non- sequencing simplifies integration of new data types into vi- uniform and possibly sparse. In this paper we focus exclu- sual and interactive components. Integration with an exter- sively on the sequencing of discretely timed media - or more nal timing object [7] ensures that media components based generally - timed data.
    [Show full text]
  • Tr 126 907 V16.0.0 (2021-04)
    ETSI TR 126 907 V16.0.0 (2021-04) TECHNICAL REPORT Universal Mobile Telecommunications System (UMTS); LTE; 5G; HTML5 for a new presentation layer in 3GPP services (3GPP TR 26.907 version 16.0.0 Release 16) 3GPP TR 26.907 version 16.0.0 Release 16 1 ETSI TR 126 907 V16.0.0 (2021-04) Reference RTR/TSGS-0426907vg00 Keywords 5G,LTE,UMTS ETSI 650 Route des Lucioles F-06921 Sophia Antipolis Cedex - FRANCE Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16 Siret N° 348 623 562 00017 - APE 7112B Association à but non lucratif enregistrée à la Sous-Préfecture de Grasse (06) N° w061004871 Important notice The present document can be downloaded from: http://www.etsi.org/standards-search The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI deliverable is the one made publicly available in PDF format at www.etsi.org/deliver. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at https://portal.etsi.org/TB/ETSIDeliverableStatus.aspx If you find errors in the present document, please send your comment to one of the following services: https://portal.etsi.org/People/CommiteeSupportStaff.aspx Notice of disclaimer & limitation of liability The information provided in the present deliverable is directed solely to professionals who have the appropriate degree of experience to understand and interpret its content in accordance with generally accepted engineering or other professional standard and applicable regulations.
    [Show full text]