IST Amigo Project Deliverable D2.2 State of the art analysis including assessment of system architectures for ambient intelligence Public IST-004182 Amigo Project Number : IST-004182 Project Title : Amigo Deliverable Type : Public Deliverable Number : D2.2 Title of Deliverable : State of the art analysis including assessment of system architectures for ambient intelligence Nature of Deliverable : Public Internal Document Number : Amigo_D2.2_WP2_final.doc Contractual Delivery Date : 28 February 2005 Actual Delivery Date : 11 April 2005 Contributing WPs : WP2 Author(s) : France Telecom: Fano Ramparany, Jérôme Pierson, Thibaud Flury, Gilles Privat, Anne Gérodolle Ikerlan: Herrasti Natividad Inria: Frédéric Le Mouël, Laurent Réveillère, Nikolaoas Georgantas, Sonia Ben Mokhtar, Ferda Tartanoglu, Valérie Issarny, Christophe Cerisara. Knowledge: Basilis Kladis Microsoft: Mark Gilbert, Ron Mevissen Philips: Bram van der Wal, Harmke de Groot, Michael van Hartskamp, Peter van der Stok Stichting Telematica Instituut: Henk Eertink, Remco Poortinga, Tom Broens Telefonica: Sara Carro Martinez, Javier Arribas, José María Miranda Fraunhofer IMS: Gerd vom Bögel VTT: Päivi Kallio, Jiehan Zhou, Julia Kantorovitch Abstract This report presents state-of-the-art system architectures that serve as technological building blocks and background technologies for the Amigo system, which aims to enable ambient intelligence in the networked home environment. The Amigo project specifically aims to solve the main technological issues that endanger the usability of a networked home system in which traditionally separated domains (i.e., home automation, personal computing, consumer electronics and mobile communications) need to be effectively merged. The Amigo project then investigates solutions for the seamless integration and improvement of services from the four domains, offering home users easy, intelligent and meaningful interfaces and services. This report presents: The technological building blocks for the networked nodes of the home environment including wireless and stationary computing nodes, home networking technologies, IP-based protocols, real-time protocols, and operating systems. April 11, 20005 Public 1/81 IST-004182 Amigo Most popular existing service-oriented middleware architectures like OSGi, UPnP, Web services and service discovery protocols, which enable interoperability among heterogeneous applications deployed on the heterogeneous devices of the networked home environment; Middleware support for security and privacy, QoS, and accounting and billing; Intelligent user services, including context management, multimodal user interfaces, and user modelling and profiling, which make home environment much more attractive to the user; Software system architectures aimed at ambient intelligence proposed within projects such as MIT Oxygen, IST Ozone, and ITEA Ambience. Keyword list Ambient intelligence, ambient system architecture, home system, service-oriented middleware, service discovery protocols, QoS, security, privacy, intelligent services, context awareness, multimodal interfaces, modelling, profiling. April 11, 20005 Public 2/81 IST-004182 Amigo Table of contents Table of contents......................................................................................3 Figures ......................................................................................................5 Tables........................................................................................................6 1 Introduction.......................................................................................12 2 Platform and infrastructure elements.............................................14 2.1 Nodes ........................................................................................................................ 14 2.1.1 PDAs and Smart Phones.................................................................................... 14 2.1.2 PC....................................................................................................................... 14 2.1.3 TV and set-top box ............................................................................................. 15 2.1.4 Game console..................................................................................................... 16 2.1.5 Domestic appliances........................................................................................... 16 2.1.6 Smartcards ......................................................................................................... 18 2.1.7 Sensors............................................................................................................... 19 2.1.8 Actuators............................................................................................................. 20 2.2 Networks................................................................................................................... 20 2.2.1 Home networks................................................................................................... 20 2.2.1.1 Wireless networks...................................................................................................................... 22 2.2.2 IP-based protocols.............................................................................................. 24 2.2.3 Ad-hoc routing and hybrid protocols ................................................................... 26 2.2.4 Real-time protocols............................................................................................. 28 2.3 Operation Systems .................................................................................................. 29 2.3.1 Linux ................................................................................................................... 29 2.3.2 Windows ............................................................................................................. 30 2.3.3 Symbian.............................................................................................................. 31 3 Service oriented middleware ...........................................................33 3.1 Service oriented architectures ............................................................................... 33 3.1.1 OSGi ................................................................................................................... 34 3.1.2 UPnP .................................................................................................................. 37 3.1.3 Web Services...................................................................................................... 40 3.1.3.1 UDDI .......................................................................................................................................... 41 3.1.3.2 Web Service composition........................................................................................................... 42 3.1.3.3 Semantic modelling.................................................................................................................... 42 3.2 Service discovery protocols ................................................................................... 44 3.2.1 SLP ..................................................................................................................... 45 3.2.2 Jini ...................................................................................................................... 45 3.2.3 SSDP .................................................................................................................. 45 3.2.4 Summary: ........................................................................................................... 46 April 11, 20005 Public 3/81 IST-004182 Amigo 3.3 Interoperability ......................................................................................................... 46 3.4 Security and Privacy................................................................................................ 47 3.5 QoS management .................................................................................................... 49 3.6 Content management .............................................................................................. 50 3.7 Accounting and billing ............................................................................................ 51 4 Intelligent user services...................................................................54 4.1 Context management .............................................................................................. 54 4.1.1 Semantic context modelling................................................................................ 55 4.1.2 Location awareness............................................................................................ 57 4.2 Multimodal user interactions .................................................................................. 60 4.2.1 Speech processing ............................................................................................. 65 4.3 User modelling and profiling .................................................................................. 66 5 Ambient system architectures.........................................................68 5.1 Oxygen...................................................................................................................... 68 5.1.1 Concepts used...................................................................................................