Ref. Ares(2013)3156899 - 02/10/2013 Remote Collaborative Real-Time Multimedia Experience over the Future Internet ROMEO Grant Agreement Number: 287896 D6.5 Second report on server, peer, user terminal, security and content registration modules development ROMEO WP6 Page 1/82 Document description Name of document Second report on server, peer, user terminal, security and content registration modules development Abstract This document defines the progress of development activities in the second year of the project. Document identifier D6.5 Document class Deliverable Version 1.0 Author(s) H. Marques, H. Silva, E. Logota, J. Rodriguez (IT) K. Georgiev, E. Angelov (MMS) Fernando Pascual (TID) K. Birkos, A Likourgiotis, A Kordelas (UP), M. Urban, M. Meier, P. tho Pesch (IRT) X. Shi (Mulsys) E. Ekmekcioglu, C.Kim, H. Lim (US) O. Altunbaş, C. Özkan, E. Çimen Öztürk (TTA) N. Tizon (VITEC) D. Didier (TEC) H.Weigold, J. Lauterjung (R&S) G. O. Tanık (ARC) QAT team P. tho Pesch (IRT), B. Demirtaş (ARCELIK), X. Shi (MULSYS) Date of creation 02-Aug-2013 Date of last modification 28-Sep-2013 Status Final Destination European Commission WP number WP6 Dissemination Level Public Deliverable Nature Report ROMEO WP6 Page 2/82 TABLE OF CONTENTS TABLE OF CONTENTS ............................................................................................................. 3 LIST OF FIGURES...................................................................................................................... 5 LIST OF TABLES ....................................................................................................................... 7 1 INTRODUCTION ................................................................................................................. 8 1.1 Purpose of the document ............................................................................................ 8 1.2 Scope of the work ........................................................................................................ 8 1.3 Structure of the document ........................................................................................... 8 2 SERVER COMPONENTS ................................................................................................... 9 2.1 Content Generation ..................................................................................................... 9 2.1.1 Content Capturing ............................................................................................... 9 2.1.2 Visual Attention Modelling ................................................................................... 9 2.1.3 Media Encoding and TS Generation ................................................................. 10 2.2 P2P ............................................................................................................................ 19 2.2.1 Topology Builder/Multicast Tree Manager ........................................................ 19 2.2.2 P2P Transmitter ................................................................................................ 25 2.2.3 P2P Packetisation ............................................................................................. 26 2.3 Authentication, Registry and Security ....................................................................... 27 2.3.1 Description ........................................................................................................ 27 2.4 A/V Communication Overlay ..................................................................................... 30 2.4.1 Conference Controller ....................................................................................... 33 2.4.2 A/V Content Distributor ...................................................................................... 34 2.4.3 A/V Content Receiver ........................................................................................ 34 3 PEER COMPONENTS ...................................................................................................... 35 3.1 P2P ............................................................................................................................ 35 3.1.1 Topology Controller ........................................................................................... 35 3.1.2 Chunk Selection ................................................................................................ 36 3.1.3 P2P Transmitter/Receiver ................................................................................. 38 3.1.4 P2P Depacketisation ......................................................................................... 39 3.2 DVB Reception .......................................................................................................... 39 3.2.1 Fixed/Portable Terminals .................................................................................. 39 3.2.2 Mobile Terminals ............................................................................................... 41 3.3 Synchronisation ......................................................................................................... 42 3.3.1 Play-out Synchronisation................................................................................... 42 3.3.2 Collaborative Synchronisation ........................................................................... 44 3.4 A/V Communication Overlay ..................................................................................... 44 3.5 Video Decoding ......................................................................................................... 46 ROMEO WP6 Page 3/82 3.5.1 Video decoding for fixed and portable terminals ............................................... 46 3.5.2 Video decoding for the mobile terminal ............................................................. 47 3.5.3 Audio Decode and Rendering ........................................................................... 49 3.5.4 Audio Decoder ................................................................................................... 49 3.5.5 Renderer for Fixed Terminal ............................................................................. 51 3.5.6 Renderer Interface for Portable and Mobile Terminal ....................................... 51 3.5.7 Renderer for Portable Terminal ......................................................................... 52 3.5.8 Renderer for Mobile Terminal ........................................................................... 52 3.6 Video Rendering ........................................................................................................ 52 3.6.1 Video rendering for fixed terminal ..................................................................... 52 3.6.2 Video rendering for mobile terminal .................................................................. 54 3.7 A/V Adaptation and Network Monitor ........................................................................ 55 3.7.1 Audio/video adaptation decision block .............................................................. 55 3.7.2 Network Monitoring Subsystem ........................................................................ 56 3.8 User Interface and Control ........................................................................................ 59 3.8.1 DVB Reception UI ............................................................................................. 59 3.8.2 Renderer Module UI .......................................................................................... 60 3.8.3 Overlay Module UI ............................................................................................. 60 3.8.4 User Generated Content UI............................................................................... 61 4 NETWORK RELATED COMPONENTS ........................................................................... 62 4.1 Mobility ...................................................................................................................... 62 4.1.1 Media Independent Handover (MIH) ................................................................. 62 4.1.2 Media Aware Proxy ........................................................................................... 64 4.1.3 Proxy Mobile IP ................................................................................................. 68 4.2 Virtualisation .............................................................................................................. 70 4.2.1 Description and current status .......................................................................... 70 4.2.2 Future work ....................................................................................................... 71 4.3 Internet Resource and Admission Control System ................................................... 71 4.3.1 Resource and Admission Manager (RAM) ........................................................ 72 4.3.2 Resource Controller (RC) .................................................................................. 74 5 CONCLUSION .................................................................................................................. 76 6 REFERENCES .................................................................................................................. 77 APPENDIX A: GLOSSARY OF ABBREVIATIONS ................................................................. 78 ROMEO WP6 Page 4/82 LIST OF FIGURES Figure 1 - Overview of the Visual