Reality Sensing, Mining and Augmentation for Mobile Citizen–Government Dialogue FP7-288815 D3.2 eGovernance augmented reality application Dissemination level: Public (PU) Contractual date of delivery: Month 33, 2014-10-31 Actual date of delivery: 2014-10-31 Workpackage: WP3 - Mobile Augmented Reality Task: T3.2 – eGovernance augmentation layer Type: Prototype Approval Status: Final Version: v0.7 Number of pages: 126 Filename: D3.2-eGovernance augmented reality Abstract D3.2 reports on the activities performed during the second phase of the project in the context of WP3. During this period, there has been mainly three different activity tracks constituting WP3 contribution to Live+Gov, namely: a) the enhancement of the platform for mobile augmented reality and the generation of the eGovernance augmented layers, b) the development of a mechanism for personalized content delivery, and c) the review of methods and tools for data aggregation and visualization, as well as the thorough presentation of the analytic tools that have been developed to facilitate the decision makers in making more informed decisions. All three activity tracks are presented in detail placing emphasis on the reasons that have motivated our work and the concrete outcomes of our developments. The information in this document reflects only the author’s views and the European Community is not liable for any use that may be made of the information contained therein. The information in this document is provided as is and no guarantee or warranty is given that the information is fit for any particular purpose. The user thereof uses the information at its sole risk and liability. This work was supported by the EU 7th Framework Programme under grant number IST-FP7- 288815 in project Live+Gov (www.liveandgov.eu) Page 1 Copyright © Copyright 2013 Live+Gov Consortium consisting of: 1. Universität Koblenz-Landau 2. Centre for Research and Technology Hellas 3. Yucat BV 4. Mattersoft OY 5. Fundacion BiscayTIK 6. EuroSoc GmbH This document may not be copied, reproduced, or modified in whole or in part for any purpose without written permission from the Live+Gov Consortium. In addition to such written permission to copy, reproduce, or modify this document in whole or part, an acknowledgement of the authors of the document and all applicable portions of the copyright notice must be clearly referenced. All rights reserved. Page 2 D3.2 – Final History Version Date Reason Revised by 0.1 2014-05-27 Draft skeleton - alpha version S. Nikolopoulos and Y. Kompatsiaris 0.2 2014-09-03 Version for collecting input S. Nikolopoulos, D. Ververidis, G. Liaros, A. Papazoglou-Chalkias, E. Chatzilari, A. Maronidis, G. Chantas 0.3 2014-09-27 Version incorporating the first round of inputs L. Niittylä, C. Schaefer 0.4 2014-10-15 Version incorporating the second round of inputs L. Niittylä, C. Schaefer, – beta version D. Ververidis, G. Liaros, P. Minnigh, M. Terpstra 0.5 2014-10-24 Version incorporating the comments from S. Nikolopoulos internal review 0.6 2014-10-30 Added a section on the sentiment analysis of S. Nikolopoulos and A. social content Papazoglou-Chalkias 0.7 2014-10-31 Proof editing and additional refinements – final S. Nikolopoulos and Y. version Kompatsiaris Author list Organization Name Contact Information CERTH Dimitrios Ververidis [email protected] CERTH Elisavet Chatzilari [email protected] CERTH Giorgos Liaros [email protected] CERTH Tasos Papazoglou Chalikias [email protected] CERTH Spiros Nikolopoulos [email protected] CERTH Yiannis Kompatsiaris [email protected] CERTH Giannis Chantas [email protected] CERTH Anastasios Maronidis [email protected] YCT Pieter Minnigh [email protected] YCT Marjolein Terpstra [email protected] UKOB Christoph Schaefer [email protected] MTS Laura Niittylä [email protected] BIZ Maite de Arana [email protected] Page 3 D3.2 – Final Executive Summary D3.2 is organized in four main sections (Section 2-5) that are used to report on the activities that have taken place during the second phase of the project. These sections are complemented by an introductory section that provides an overview of the deliverable and a summary section that concludes with some important insights that we have gained during the Live+Gov experience. In what refers to the main sections, Section 2 reports on the improvements that we have performed in addressing the project’s revised requirements, as well as on the major developments that we have undertaken in order to automatically serve content across platforms and vendors. Section 3 describes the personalization mechanism that has been developed to deliver traffic-related information in a personalized manner. Section 4 reviews some of the most widely established methods and tools for data visualization, while Section 5 provides a thorough analysis of the analytic tools that have been developed to facilitate the extraction of valuable insights for each of the Live+Gov use cases. Finally, D3.2 incorporates a number of Appendices that provide details about the technical investigations that we have undertaken to select the most appropriate libraries and services for implementing the analytic tools. Page 4 D3.2 – Final Abbreviations and Acronyms API Application Programming Interface AR Augmented Reality AREL Augmented Reality Experience Language ARML Augmented Reality Markup Language CMS Content Management System ESA Explicit Semantic Analysis HTTP Hypertext Transfer Protocol IBS Image BaSed augmented reality IST Information Society Technologies JSON JavaScript Object Notation KML Keyhole Markup Language LBS Location BaSed augmented reality MVC Model-View-Controller NGD Normalized Google Distance NRD Normalized Relevance Distance REST Representational State Transfer SMS Short Messaging Service VR Virtual Reality W3C World Wide Web Consortium XML eXtensible Markup Language Page 5 D3.2 – Final Table of Contents 1. INTRODUCTION ....................................................................................................... 13 2. MOBILE AUGMENTED REALITY FOR EGOVERNANCE ................................................. 15 2.1 Overview ............................................................................................................. 15 2.2 Revised requirements and extensions compared to the first prototype ................ 15 2.3 Improving the augmented reality experience ....................................................... 17 2.4 Serving AR content automatically across platforms and vendors .......................... 20 2.4.1 Motivation............................................................................................................................ 21 2.4.2 Existing solutions for creating and publishing AR content .................................................. 23 2.4.3 Urban Planning AR directory ................................................................................................ 25 2.4.4 FastAR on Sobipro ................................................................................................................ 26 2.4.5 Conclusions .......................................................................................................................... 32 2.5 eGovernance Augmentation Layers...................................................................... 33 2.5.1 Urban planning .................................................................................................................... 33 2.5.2 Mobility ................................................................................................................................ 35 3. PERSONALIZED CONTENT DELIVERY ......................................................................... 37 3.1 Motivation .......................................................................................................... 37 3.2 Personalized traffic-related information .............................................................. 37 3.2.1 Extracting the commuting habits ......................................................................................... 37 3.2.2 Building the user’s profile .................................................................................................... 38 3.2.3 Generating personalized suggestions .................................................................................. 39 3.3 Privacy ................................................................................................................ 40 3.4 Related apps and how Live+Gov goes beyond ...................................................... 40 4. VISUALIZATION TOOLS FOR DATA COMPREHENSION ............................................... 43 4.1 Introduction ........................................................................................................ 43 4.2 Map based visualisations ..................................................................................... 45 4.2.1 Types of map-based visualizations ...................................................................................... 45 4.2.2 Map visualizations on the web ............................................................................................ 48 4.2.3 Map visualizations on mobile devices ................................................................................. 49 4.3 Image-based visualisations .................................................................................. 49 4.3.1 Types of image-based visualizations ...................................................................................