Design of a distributed architecture for enriching media experience in home theaters Citation for published version (APA): Hu, J. (2006). Design of a distributed architecture for enriching media experience in home theaters. Technische Universiteit Eindhoven. https://doi.org/10.6100/IR611954 DOI: 10.6100/IR611954 Document status and date: Published: 01/01/2006 Document Version: Publisher’s PDF, also known as Version of Record (includes final page, issue and volume numbers) Please check the document version of this publication: • A submitted manuscript is the version of the article upon submission and before peer-review. There can be important differences between the submitted version and the official published version of record. People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website. • The final author version and the galley proof are versions of the publication after peer review. • The final published version features the final layout of the paper including the volume, issue and page numbers. Link to publication General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal. If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license above, please follow below link for the End User Agreement: www.tue.nl/taverne Take down policy If you believe that this document breaches copyright please contact us at: [email protected] providing details and we will investigate your claim. Download date: 04. Oct. 2021 Jun Hu Design of a Distributed Architecture for Enriching Media Experience in Home Theaters Design of a Distributed Architecture for Enriching Media Experience in Home Theaters PROEFONTWERP ter verkrijging van de graad van doctor aan de Technische Universiteit Eindhoven, op gezag van de Rector Magnificus, prof.dr.ir. C.J. van Duijn, voor een commissie aangewezen door het College voor Promoties in het openbaar te verdedigen op woensdag 30 augustus 2006 om 16.00 uur door Jun Hu geboren te Jiangsu, China De documentatie van het proefontwerp is goedgekeurd door de promotoren: prof.dr.ir. L.M.G. Feijs en prof.dr. E.H.L. Aarts Copromotor: dr.ir. M.D. Janse c 2006 Jun Hu §¡ All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, transmitted, in any form or by any means, electronic, mechanical, photocopying, recording, or otherwise, without the prior written permission from the copyright holder. Typeset with LATEX 2ε Cover design by Christoph Bartneck and Jun Hu Printed by Printservice Technische Universiteit Eindhoven ISBN-10: 90-386-2768-8 ISBN-13: 978-90-386-2768-7 A catalogue record is available from the Library Eindhoven University of Technology To Wenwen and Xiaoxiao Acknowledgements This PhD is the result of a process to which many people contributed. First of all I am really grateful to my promotor, prof.dr. Emile Aarts, Vice President of Philips Research, for allowing me to share his vision of Ambient Intelligence and providing me with opportunities to conduct a big part of this work at the Media Interaction group of Philips Research Eindhoven, at the time he was the group leader. Discussions with him had been always intriguing and inspiring. He stretched the horizons of my ambitions but at the same time helped me to keep a clear focus. My special appreciation goes to my co-promotor, dr.ir. Maddy Janse from Philips Research. Some years ago she introduced me to the 2-year postmaster program User- system Interaction and since then, she has been always encouraging and supportive during my postmaster study and later the PhD project. As the project leader of two European projects (NexTV and ICE-CREAM), she has given me a lot of opportunities and a great deal of freedom in these projects, allowing me to focus on my own research and design interests. I would like to thank prof.dr.ir. Loe Feijs for being my promotor, my supervisor, and best of all, a friend. Loe not only guided me through the successive stages of this project, but also participated in several parts of the research. I would also thank him for his faith in me during the entire project and for his quick and careful reading during the difficult phases of writing. Every thesis has its errors in the documentation process and my first drafts had a number of mistakes; but thanks to his patient work of proofreading, these mistakes have been kept to a minimum. I would like to thank the reading committee very much for going through the pages, and for their insightful comments and criticisms. The reading committee consisted of prof.dr.ir. Berry Eggen and prof.dr. Yibin Hou, in addition to my promotors. I am also grateful to prof.dr.ir. Jeu Schouten, prof.dr. Kees Overbeeke, prof.dr. Matthias Rauterberg and prof.dr. Don Bouwhuis for kindly accepting the positions in the doctorate committee, and also for their support in the course of this project. Apart from the committee, Richard Appleby and Yuechen Qian read through some chapters or sections and gave me insightful comments or helped me to improve the text. Loe translated the summary into samenvatting; Joep Frens, Philip Ross and v vi Acknowledgements Rian van Herk helped to improve the translation. Joep did also the last-minute layout check to remove bad page breaks and ugly hyphenations right before I sent everything to the printer. I have been always enjoying my coffee, my lunch, and of course my research and design together with my colleague at Designed Intelligence group since I joined. In the group are René Ahn, Christoph Bartneck, Loe Feijs, Joep Frens, Kees Overbeeke, Matthias Rauterberg, Philip Ross, Yuechen Qian, Peter Peters and Stephan Wensveen. Besides the other things, Christoph helped to build the Lego robots and to SPSS the experiment results, and also kindly proposed and drafted the tangram cover design for this thesis; Yuechen moved to Philips Research but his comments on the early versions of the formal specifications were very helpful; Joep and Stephan shared with me a lot of sympathy in getting the PhD done; Kees often came to my door and smiled with questions like “finished yet?” to ensure my diligence never waned. I would also express my gratitude to the secretaries to the Designed Intelligence group, Helen Maas-Zaan and Rian van Herk, for all the many things they helped me with, which are simply too numerous to mention. As mentioned in this thesis, some parts of this work were done together with Magdalena Bukowska (NexTV user study), Hyun-joo Kong (ICE-CREAM user evaluation) and Christoph Bartneck (TheInterview experiment). The collaboration was very pleasant and beneficial for me and I hope they enjoyed it too. Finally, and most importantly, great thanks are due to my family: my wife Wen (M>), for her love, and her unconditional and continual support at every level that can only be given, not expected; my son, Xiaoxiao (Mark, §Y), for sparing me a lot of time by doing great at school and managing himself at home; my parents Jinlin Hu (§7) and Shushan Chen (Ôé), my parents-in-law Dong Xu (MÀ) and Xiao Wu (Ç¡), my brother Ping Hu (§²) and my sisters-in-law Binbin (MQQ) and Duoduo (Mùù), for their help and support. a\õc5|±ÚÏ" Jun Hu July 2006, Eindhoven Contents Acknowledgements v List of Figures xvii List of Tables xxi 1 Introduction 1 1.1 Focus of this thesis ............................. 4 1.2 Approach .................................. 5 1.2.1 Spiral model ............................ 5 1.2.2 Architecture-based design ..................... 6 1.3 Outline of this thesis ............................ 7 I Requirements and Concepts 9 2 Explorations and Requirements 11 2.1 NexTV and TOONS ............................ 11 2.1.1 Getting the user input ....................... 12 2.1.2 Requirements of TOONS ..................... 14 2.1.3 Three versions of TOONS ..................... 18 2.2 ICE-CREAM and DeepSea ......................... 19 2.2.1 DeepSea scenario ......................... 20 2.2.2 Functional requirements ..................... 22 2.2.3 Levels of interaction ........................ 22 2.3 Requirements after DeepSea ....................... 23 2.4 Rapid Robotic Prototyping ......................... 24 2.5 Concluding remarks ............................ 24 vii viii CONTENTS 3 StoryML 25 3.1 Conceptual model of TOONS ....................... 25 3.2 When technologies meet the requirements ............... 26 3.2.1 Open standards for synchronized multimedia .......... 26 3.2.2 Architectures for interactive television .............. 27 3.3 Design of StoryML ............................. 28 3.3.1 Why XML ............................. 29 3.3.2 Simplified model of interactive story ............... 29 3.3.3 Environment and actors ...................... 30 3.3.4 Media Objects ........................... 30 3.3.5 Timeline .............................. 32 3.4 Implementation of StoryML Player .................... 32 3.4.1 PAC based architecture ...................... 32 3.4.2 Extending PAC for timed media ................. 33 3.4.3 Architecture of the StoryML Player ................ 35 3.4.4 Media and Interaction Synchronization ............. 37 3.5 Lessons learnt from StoryML ....................... 37 3.5.1 Pros ................................. 37 3.5.2 Cons ................................ 38 4 Interactive Play Markup Language 39 4.1 Play ..................................... 39 4.1.1 Timing in a play .......................... 40 4.1.2 Mapping: Assigning roles to actors ...............