Data-independent sequencing with the Timing Object ∗ A JavaScript Sequencer for single-device and multi-device Web media. Ingar M. Arntzen Nj˚alT. Borch Norut Northern Research Institute Norut Northern Research Institute Tromsø, Norway Tromsø, Norway
[email protected] [email protected] ABSTRACT Keywords Media players and frameworks all depend on the ability sequencing, web, timed data, timing object, timed visual- to produce correctly timed audiovisual effects. More for- ization, multimedia, media synchronization, multi-device, mally, sequencing is the process of translating timed data distributed, intra-destination media synchronization, inter- into correctly timed presentation. Though sequencing logic destination media synchronization is a central part of all multimedia applications, it tends to be tightly integrated with specific media formats, authoring 1. INTRODUCTION models, timing/control primitives and/or predefined UI el- Multimedia frameworks are always built around the idea ements. In this paper, we present the Sequencer, a generic of organizing and playing back media relative to some time- sequencing tool cleanly separated from data, timing/control line. For continuous media, audio and video frames are laid and UI. Data-independent sequencing implies broad utility out back-to-back, usually filling the entire timeline. For dis- as well as simple integration of different data types and de- crete media, such as timed subtitles or timed comments, the livery methods in multimedia applications. UI-independent distribution (along the timeline) may often be more non- sequencing simplifies integration of new data types into vi- uniform and possibly sparse. In this paper we focus exclu- sual and interactive components. Integration with an exter- sively on the sequencing of discretely timed media - or more nal timing object [7] ensures that media components based generally - timed data.