A Framework for the Integration of Multimodal Intuitive Controls in Smart Buildings

Total Page:16

File Type:pdf, Size:1020Kb

A Framework for the Integration of Multimodal Intuitive Controls in Smart Buildings FAKULTÄT FÜR INFORMATIK DER TECHNISCHEN UNIVERSITÄT MÜNCHEN MIBO – A Framework for the Integration of Multimodal Intuitive Controls in Smart Buildings Sebastian Matthias Peters FAKULTÄT FÜR INFORMATIK DER TECHNISCHEN UNIVERSITÄT MÜNCHEN Forschungs- und Lehreinheit 1 Angewandte Softwaretechnik MIBO – A Framework for the Integration of Multimodal Intuitive Controls in Smart Buildings Sebastian Matthias Peters Vollständiger Abdruck der von der Fakultät für Informatik der Technischen Universität München zur Erlangung des akademischen Grades eines Doktors der Naturwissenschaften (Dr. rer. nat.) genehmigten Dissertation. Vorsitzender: Univ.-Prof. Dr. Hans-Michael Gerndt Prüfer der Dissertation: 1. Univ.-Prof. Bernd Brügge, Ph.D. 2. Prof. Vivian Loftness, Ph.D. Carnegie Mellon University, Pittsburgh, PA, U.S.A. Die Dissertation wurde am 10.05.2016 bei der Technischen Universität München eingereicht und durch die Fakultät für Informatik am 04.07.2016 angenommen. Acknowledgments This work would not have been possible without the support of so many people. I would like to thank everybody who supported me during my research and thus con- tributed to it. It is not even possible to name everybody on a single page but please be sure that I am very thankful for everyone’s help. First, I would like to express my deep gratitude to Bernd Brügge and Vivian Loftness, who have been much more to me than supervisors. Your infinite inspiration, passion and enthusiasm has clearly driven my motivation in this research during these four years. With your trust in me and my work, you gave me the freedom to run my own research as an independent and responsible scientist. You have both created invaluable environments of opportunities and creativity in Munich and Pittsburgh – thank you for everything! I would also like to thank all members of the Chair for Applied Software Engineering. I learned a lot from all of you, and I am indebted for your support and the social envi- ronment you have all contributed to. Special thanks to Stephan Krusche for your helpful advices and reviews. At the same time, I am very grateful to all members of the Intelligent Workplace at Carnegie Mellon University for supporting me during my research abroad and for keeping up the friendship and the invaluable exchange between our institutions. I thank my students and co-authors who contributed to my research, in particular Arno Schneider, Jan Ole Johanßen, Dominic Henze, Stefan Nosovic, Nadine v. Frankenberg and Masashi Beheim. Finally, I would like to express my love and gratitude to my family, and to my girlfriend Mira. Writing a dissertation requires more than a researcher’s full attention. I am indebted for your love and devotion, your constant support and understanding. You are the source of joy and happiness in my life. v Abstract With the Internet of Things expanding into our homes and offices, we can expect fixtures in buildings to become more interconnected and more numerous as part of an increasingly complex and powerful integrated smart environment. However, this raises new challenges in the area of usability since today’s rooms are already cluttered with multiple user in- terfaces in the form of buttons and remote controls. In the future, as more technology is embedded into buildings, users must have the opportunity to choose and to combine a het- erogeneous set of devices and modalities. Multimodal User Interaction technology aims at creating natural and intuitively usable interfaces, allowing a user to interact with systems in a way similar to human-to-human communication. The combination of modalities, such as gestures, speech and gaze-tracking provides occupants with an integrated and intuitive interface for diverse addressable fixtures in buildings. However, creating multimodal in- terfaces remains a complex and highly specialized task. This research describes MIBO – a framework to enable and define multimodal intu- itive building controls. It supports the integration and combination of multiple interaction modalities, e.g., gesture recognition, speech recognition, eye-tracking but also traditional button controls and performs the multimodal fusion. It also provides a meta model and an extensible domain-specific language to describe a multimodal interaction model and to separate it from its implementation. This enables prototyping of new control systems for developers and allows end-users the configuration of desired interactions in a building. The framework has been applied in three real-world applications, each in at least two dif- ferent buildings with more than 20 users, demonstrating the feasibility and efficiency of our approach. vii Contents Acknowledgements v Abstract vii 1. Introduction 1 1.1. Problem Statement . .2 1.2. Contribution . .3 1.3. Scope . .4 1.4. Research Approach . .5 1.5. Outline of the Dissertation . .5 2. Foundations 7 2.1. Ubiquitous Computing . .8 2.2. Ambient Intelligence . .8 2.3. Smart Environments . .9 2.3.1. Smart Buildings . 11 2.3.2. Context Awareness . 16 2.3.3. Energy Awareness . 18 2.3.4. Disability Awareness . 19 2.4. Cyber-Physical Systems . 20 2.5. Internet of Things . 21 2.6. Natural User Interfaces . 22 2.6.1. Unimodal User Interfaces . 22 2.6.2. Multimodal User Interfaces . 26 2.7. Intuitive User Interfaces . 29 3. Requirements for Intuitive Controls in Smart Buildings 33 3.1. Methodology . 33 ix Contents 3.2. Requirements Identification . 35 3.2.1. Study Design . 36 3.2.2. Results . 38 3.3. Visionary Scenarios . 40 3.3.1. Scenario 1: Intuitive Building Control . 41 3.3.2. Scenario 2: Building Configuration . 41 3.3.3. Scenario 3: Prototyping . 41 3.3.4. Scenario 4: Ambient Assisted Living . 42 3.4. Application Domain Requirements . 42 3.5. Solution Domain Requirements . 47 3.6. Summary . 47 4. Framework Design 49 4.1. Introduction . 49 4.1.1. Multimodal Parsing and Integration . 49 4.1.2. Architectures and Frameworks for Multimodal Interfaces . 51 4.1.3. Building Automation and Control Systems . 54 4.2. Application Domain . 57 4.3. MIBO Software Architecture . 61 4.3.1. Blackboard Architectural Style . 62 4.3.2. Subsystem Decomposition . 65 4.3.3. Multimodal Fusion and Integration . 68 4.3.4. Multi-Device User Feedback . 69 4.3.5. Access Control and Security . 70 4.3.6. Design Rationale . 71 5. MiboML – A DSL for Multimodal Interaction Models in Smart Buildings 73 5.1. Design Goals of MiboML . 74 5.2. MiboML Grammar . 76 5.2.1. Core Grammar . 76 5.2.2. Modality Extension Grammar . 77 5.2.3. Grammar Parsing . 77 5.3. Lexical Representation . 78 5.4. Conflict Resolution . 80 5.5. IDE for Multimodal Interaction Models . 82 x Contents 6. Case Studies 85 6.1. HomeGestures – A Gesture-based Smartphone Control for Smart Buildings 85 6.1.1. Interaction Design . 86 6.1.2. Implementation . 87 6.1.3. Related Work . 90 6.1.4. Evaluation . 93 6.2. NICE – Hands-free Natural User Interfaces in Smart Buildings . 94 6.2.1. Interaction Design . 95 6.2.2. Implementation . 96 6.2.3. Related Work . 97 6.2.4. Evaluation . 99 6.3. SISSI – Smart Interface for Speech Service Integration . 104 6.3.1. Interaction Design . 105 6.3.2. Implementation . 107 6.3.3. Related Work . 110 6.3.4. Evaluation . 112 7. Conclusion 119 7.1. Contributions . 120 7.2. Limitations . 123 7.3. Future Work . 124 Appendix 131 A. Glossary 131 B. History of Gesture-based User Interfaces 133 C. Voice-based User Interfaces for Smart Buildings 135 Bibliography 137 xi 1. Introduction Modern sedentary lifestyles have led to the fact that a majority of Americans spend ap- proximately 22 hours per day indoors [BLS14]. Within buildings, lighting comfort, ther- mal comfort and indoor air quality rank among the top ten leading tenant complaints [IFMA12]. These conditions and their effects on occupants and residents are measured by Indoor Environmental Quality (IEQ). Better indoor environmental quality can enhance the lives of building occupants and increase the resale value of the building [Coyle14]. Par- ticularly, in office buildings, increasing the IEQ level and thus, the employees’ health and productivity over the long run, can have a large return on investment, since personnel costs of salaries typically surpass building operating costs. Hartkopf, Loftness et al. have shown that occupant behavior and feedback are necessary to achieve the desired building performance [Hartkopf86] and research by Park, Choi and Daum has proven that occupants can be a good sensor and controller for IEQ performance [Park15] [Choi10] [Daum11]. Furthermore, Gu has shown that the ability to individually adjust heating, lighting and ventilation influences the IEQ and thus well-being, satisfaction and productivity of occupants [Gu11]. Additionally, the aspect of energy use in buildings is intrinsically tied to IEQ perfor- mance. Gu has shown that providing the users with individual control can have a positive impact on the energy consumption of occupants [Gu11]. This is remarkable when taking into account that buildings in the United States account for 41% of total energy use and 73% of total electricity consumption [DOE13]. Therefore, energy savings in buildings are crucial to reducing our dependence on fossil fuels and greenhouse gas emissions. This research assumes that providing individual control to building occupants is a key to comfort, well being and energy efficiency. However, this control must be simple, fast and natural. 1 1. Introduction 1.1. Problem Statement Buildings tend to rely on large zones of control [Loftness09], meaning that lighting, heating and ventilation are controlled for large areas with many occupants at once. This results in both, discomfort for occupants and a waste of energy because each occupant may have dif- ferent needs, depending on the individual task, clothing or habits [Park15]. Large control zones potentially tend to over-cool, over-heat and over-light entire areas, that may only be occupied by few people.
Recommended publications
  • Solving Human Centric Challenges in Ambient Intelligence Environments to Meet Societal Needs
    Solving Human Centric Challenges in Ambient Intelligence Environments to Meet Societal Needs A Dissertation Presented to the Faculty of the School of Engineering and Applied Science University of Virginia In Partial Fulfillment of the requirements for the Degree Doctor of Philosophy (Computer Science) by Erin Griffiths December 2019 © 2019 Erin Griffiths Approval Sheet This dissertation is submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy (Computer Science) Erin Griffiths This dissertation has been read and approved by the Examining Committee: Kamin Whitehouse, Adviser Jack Stankovic, Committee Chair Mary Lou Soffa A.J. Brush John Lach Accepted for the School of Engineering and Applied Science: Dean, School of Engineering and Applied Science December 2019 i To everyone who has helped me along the way. ii Abstract In the world today there exists a large number of problems that are of great societal concern, but suffer from a problem called the tragedy of the commons where there isn`t enough individual incentive for people to change their behavior to benefit the whole. One of the biggest examples of this is in energy consumption where research has shown that we can reduce 20-50% of the energy used in buildings if people would consistently modify their behavior. However, consistent behavior modification to meet societal goals that are often low priority on a personal level is often prohibitively difficult in the long term. Even systems design to assist in meeting these needs may be unused or disabled if they require too much effort, infringe on privacy, or are frustratingly inaccurate.
    [Show full text]
  • Understanding Expressions of Internet of Things
    Understanding Expressions of Internet of Things Kuo Chun, Tseng*, Rung Huei, Liang ** * Department of Industrial and Commercial Design, National Taiwan University of Science and Technology, Taipei, Taiwan, [email protected] ** Department of Industrial and Commercial Design, National Taiwan University of Science and Technology, Taipei, Taiwan, [email protected] Abstract: A recent surge of research on Internet of Things (IoT) has given people new opportunities and challenges. Unfortunately, little research has been done on conceptual framework, which is a crucial aspect to envision IoT design. We found that designers usually felt helpless when designing smart objects in contrast to traditional ones and needed more resources for potential expressions of interactive embodiment with this new technology. Moreover, it appears to be unrealistic to expect the designer to follow the programming thinking and theory of MEMS (Micro Electro Mechanical Systems) field. Therefore, instead of focusing on exploring the technology, this paper proposes an analytical framing and investigates interactive expressions of embodiment on smart objects that help designers understand and handle the technology as design material to design smart objects during the coming era of IoT. To achieve this goal, first we conceptualize an IoT artifact as an object that has four capabilities and provide a clear framework for understanding a thing and multiple things over time and space in ecology of IoT things powered by a cloud-based mechanism. Second, we show the analytical results of three categories: smart things and design agenda over cloud in respect of time and space. Third, drawing on the taxonomy of embodiment in tangible interfaces by Fishkin K.
    [Show full text]
  • Emerging Edge Computing Technologies for Distributed Iot Systems
    ACCEPTED FROM OPEN CALL Emerging Edge Computing Technologies for Distributed IoT Systems Ali Alnoman, Shree Krishna Sharma, Waleed Ejaz and Alagan Anpalagan ABSTRACT This remarkable increase in the number of con- nected devices needs to be accompanied by an The ever-increasing growth of connected equivalent increase in resource provisioning to avoid smart devices and IoT verticals is leading to the any sort of service disruption. Although the existing crucial challenges of handling the massive amount cloud computing paradigm is highly capable of han- of raw data generated by distributed IoT systems dling the massive amount of data, it is not suitable and providing timely feedback to the end-users. for distributed IoT systems due to the potentially Although the existing cloud computing paradigm incurred delays [2]. For this reason, providing com- has an enormous amount of virtual computing puting, storage, and communication functionalities power and storage capacity, it might not be able at the network edge helps not only in reducing the to satisfy delay-sensitive applications since com- end-to-end delay, but also can alleviate the burdens puting tasks are usually processed at the distant on cloud-servers and backhaul links. Furthermore, cloud-servers. To this end, edge/fog computing due to the physical proximity of edge devices with has recently emerged as a new computing par- end-users, edge computing can support distributed adigm that helps to extend cloud functionalities IoT applications that require location awareness and to the network edge. Despite several benefits of higher Quality of Service (QoS) [2, 3]. edge computing including geo-distribution, mobil- In contrast to the conventional IoT architec- ity support and location awareness, various com- ture, where storage and computing operations munication and computing related challenges are mostly performed in the cloud-center, distrib- need to be addressed for future IoT systems.
    [Show full text]
  • Emerging Edge Computing Technologies for Distributed Internet of Things (Iot) Systems
    IEEE WIRELESS COMMUNICATIONS MAGAZINE (DRAFT) 1 Emerging Edge Computing Technologies for Distributed Internet of Things (IoT) Systems Ali Alnoman, Shree Krishna Sharma, Waleed Ejaz, and Alagan Anpalagan Abstract The ever-increasing growth in the number of connected smart devices and various Internet of Things (IoT) verticals is leading to a crucial challenge of handling massive amount of raw data generated from distributed IoT systems and providing real-time feedback to the end-users. Although existing cloud- computing paradigm has an enormous amount of virtual computing power and storage capacity, it is not suitable for latency-sensitive applications and distributed systems due to the involved latency and its centralized mode of operation. To this end, edge/fog computing has recently emerged as the next generation of computing systems for extending cloud-computing functions to the edges of the network. Despite several benefits of edge computing such as geo-distribution, mobility support and location awareness, various communication and computing related challenges need to be addressed in realizing edge computing technologies for future IoT systems. In this regard, this paper provides a holistic view on the current issues and effective solutions by classifying the emerging technologies in regard to the joint coordination of radio and computing resources, system optimization and intelligent resource management. Furthermore, an optimization framework for edge-IoT systems is proposed to enhance various performance metrics such as throughput, delay, resource utilization and energy consumption. Finally, a Machine Learning (ML) based case study is presented along with some numerical results to illustrate the significance of edge computing. arXiv:1811.11268v1 [cs.NI] 26 Oct 2018 I.
    [Show full text]
  • Fuzzy Fog Computing: a Linguistic Approach for Knowledge Inference in Wearable Devices
    Fuzzy Fog Computing: A Linguistic Approach for Knowledge Inference in Wearable Devices B Javier Medina1( ), Macarena Espinilla1, Daniel Zafra1,LuisMart´ınez1, and Christopher Nugent2 1 Department of Computer Science, University of Jaen, Ja´en, Spain [email protected] 2 School of Computing and Mathematics, Ulster University, Jordanstown, UK Abstract. Fog Computing has emerged as a new paradigm where the processing of data and collaborative services are embedded within smart objects, which cooperate between them to reach common goals. In this work, a rule-based Inference Engine based on fuzzy linguistic approach is integrated in the smart devices. The linguistic representation of local and remote sensors is defined by protoforms, which configure the antecedents of the rules in the Inference Engine. A case study where two inhabi- tants with a wearable device conduct activities in a Smart Lab is pre- sented. Each wearable device infers the daily activities within the wear- able devices by means of the rule-based Inference Engine. Keywords: Fog computing sensors · Linguistic terms · Rule-based inference engine · Wearable devices 1 Introduction Since last years, Ambient Intelligence (AmI) [1] and the Ubiquitous Computing (UC) [2] have developed new computing paradigms integrating intelligence sys- tems in the sensor and environments for an ambient assisted living [3]. These trends have enabled analyzing daily human activities from computer sciences by means of pervasive and mobile computing [4]. In this way, activity recognition has resulted a challenging research topic because of supervising elderly people to stay with the best quality of life as long as possible in their sustainable, healthy and manufacturing homes [5], whose percentage of population over 65 up to 15% [6].
    [Show full text]
  • Freedom and Privacy in Ambient Intelligence,’ Ethics and Information Technology 7(3), 157-166
    This is a preprint version of the following article: Brey, P. (2006). ‘Freedom and Privacy in Ambient Intelligence,’ Ethics and Information Technology 7(3), 157-166. Freedom and Privacy in Ambient Intelligence Abstract This paper analyzes ethical aspects of the new paradigm of Ambient Intelligence, which is a combination of Ubiquitous Computing with Intelligent User Interfaces. After an introduction to the approach, two key ethical dimensions will be analyzed: freedom and privacy. It is argued that Ambient Intelligence, though often designed to enhance freedom and control, has the potential to limit freedom and autonomy as well. Ambient Intelligence also harbors great privacy risks, and these are explored as well. Keywords Ambient Intelligence, Ubiquitous Computing, Intelligent User Interfaces, smart objects, invisible computers, freedom, autonomy, privacy THE PROMISE OF AMBIENT INTELLIGENCE Envision the following scenario: A young mother is on her way home, driving together with her 8-month old daughter who is sleeping in her child seat on the passenger side of the car. The infant is protected by an intelligent system called SBE 2 against airbag deployment, which could be fatal in the case of an accident. SBE 2 detects when there is a child seat on the passenger seat instead of a person and automatically disables the airbag (...) Arriving home, a surveillance camera recognizes the young mother, automatically disables the alarm, unlocks the front door as she approaches it and turns on the lights to a level of brightness that the home control system has learned she likes. After dropping off her daughter, the young mother gets ready for grocery shopping.
    [Show full text]
  • A Social and Technological View of Ambient Intelligence in Everyday Life
    A social and technological view of Ambient Intelligence in Everyday Life: What bends the trend? Key Deliverable The European Media and Technology in Everyday Life Network, 2000-2003 Yves Punie1 Institute for Prospective Technological Studies Directorate General Joint Research Centre European Commission Table of contents General Preface 3 IPTS Preface 4 Executive summary 5 Introduction 8 1. The Ambient Intelligence Vision 12 2. Socio-Economic and Policy-Related Issues 25 3. The Technological Dimension 42 4. Smart Homes and Living 55 5. What bends the Trend? Challenges for AmI 61 Notes 67 References and Appendices 71 EMTEL - General preface The European Media Technology and Everyday Life Network (EMTEL) was funded by the European Commission (grant number HPRN ET 2000 00063) under the 5th Framework Programme. It was constituted as a research and training network within the programme, Improving Knowledge Potential and oriented towards “creating a user friendly information society”. EMTEL conducted interdisciplinary social scientific research and training between 2000 and 2003. This report is one of 12 submitted to the EU in September 2003 as final deliverables for the project. Copies are available on www.lse.ac.uk/collections/EMTEL and a full list of the publications can be found as an Appendix to this report. Contributing partners were as follows: • ASCoR, The University of Amsterdam • COMTEC, Dublin City University • IPTS, Seville • LENTIC, The University of Liège • Media@lse, London School or Economics (co-ordinating centre) • NTNU, University of Trondheim • SMIT, Free University of Brussels • TNO, Delft • SINTEF, Trondheim. EMTEL sought to bring together young and experienced researchers in a shared project to investigate the so-called information society from the perspective of everyday life.
    [Show full text]
  • A Fog-Based Flexible Architecture for Enabling Privacy-By-Design Iot-Based Communal Smart Environments †
    sensors Article PyFF: A Fog-Based Flexible Architecture for Enabling Privacy-by-Design IoT-Based Communal Smart Environments † Fatima Zohra Benhamida 1,2,* , Joan Navarro 3 , Oihane Gómez-Carmona 2 , Diego Casado-Mansilla 2 , Diego López-de-Ipiña 2 and Agustín Zaballos 3 1 Laboratoire des Méthodes de Conception des Systèmes, Ecole Nationale Supérieure D’Informatique, Algiers 16309, Algeria 2 DeustoTech, University of Deusto, 48007 Bilbao, Spain; [email protected] (O.-G.C.); [email protected] (D.C.-M.); [email protected] (D.L.-d.-I.) 3 Grup de Recerca en Internet Technologies & Storage (GRITS), La Salle—Universitat Ramon Llull, C/Quatre Camins, 30, 08022 Barcelona, Spain; [email protected] (J.N.); [email protected] (A.Z.) * Correspondence: [email protected] † This paper is an extended version of our paper published in CPSSIoT2019: 1st Workshop on Cyber-Physical Social Systems co-located with the 9th International Conference on the Internet of Things (IoT 2019). Abstract: The advent of the Internet of Things (IoT) and the massive growth of devices connected to the Internet are reshaping modern societies. However, human lifestyles are not evolving at the same pace as technology, which often derives into users’ reluctance and aversion. Although it is essential Citation: Benhamida, F.Z.; to consider user involvement/privacy while deploying IoT devices in a human-centric environment, Navarro, J.; Gómez-Carmona, O.; current IoT architecture standards tend to neglect the degree of trust that humans require to adopt Casado-Mansilla, D.; these technologies on a daily basis. In this regard, this paper proposes an architecture to enable López-de-Ipiña, D.; Zaballos, A.
    [Show full text]
  • Enhancing Telehealth Big Data Through Fog Computing Harishchandra Dubey
    University of Rhode Island DigitalCommons@URI Department of Electrical, Computer, and Department of Electrical, Computer, and Biomedical Engineering Faculty Publications Biomedical Engineering 2015 Fog Data: Enhancing Telehealth Big Data Through Fog Computing Harishchandra Dubey Jing Yang See next page for additional authors Follow this and additional works at: https://digitalcommons.uri.edu/ele_facpubs The University of Rhode Island Faculty have made this article openly available. Please let us know how Open Access to this research benefits oy u. This is a pre-publication author manuscript of the final, published article. Terms of Use This article is made available under the terms and conditions applicable towards Open Access Policy Articles, as set forth in our Terms of Use. Authors Harishchandra Dubey, Jing Yang, Nick Constant, Amir Mohammad Amiri, Qing Yang, and Kunal Mankodiya Fog Data: Enhancing Telehealth Big Data Through Fog Computing Harishchandra Dubey#, Jing Yang, Nick Constant, Amir Mohammad Amiri, Qing Yang+, Kunal Makodiya* Department of Electrical, Computer, and Biomedical Engineering University of Rhode Island, Kingston, RI 02881, USA #[email protected], [email protected],*[email protected] ABSTRACT decision-making [1]. For example, in the healthcare domain, The size of multi-modal, heterogeneous data collected through various telehealth enables the use of sensors within or on the human sensors is growing exponentially. It demands intelligent data body. Wearable sensors such as ECG and activity monitors are reduction, data mining and analytics at edge devices. Data a specific type of medical sensors placed on the human body compression can reduce the network bandwidth and transmission allowing non-invasive, unobtrusive, 24/7 data collection for power consumed by edge devices.
    [Show full text]
  • Mobility, Citizens, Innovation and Technology in Digital and Smart Cities
    future internet Article Mobility, Citizens, Innovation and Technology in Digital and Smart Cities Thays A. Oliveira 1,* , Yuri B. Gabrich 2 , Helena Ramalhinho 3 , Miquel Oliver 1 , Miri W. Cohen 4 , Luiz S. Ochi 5 , Serigne Gueye 6, Fábio Protti 5, Alysson A. Pinto 7, Diógenes V.M. Ferreira 8 , Igor M. Coelho 2 and Vitor N. Coelho 5,9 1 Department of Information and Communication Technologies, Universitat Pompeu Fabra, Edifici Tànger, 122-140, 08018 Barcelona, Spain; [email protected] 2 Department of Computer Science, Universidade do Estado do Rio de Janeiro, Pavilhão João Lyra Filho, 6o andar—Bloco B, Rua São Francisco Xavier, 524—Maracanã, Rio de Janeiro—RJ 20.550-013, Brazil; [email protected] (Y.B.G.); [email protected] (I.M.C.) 3 Department of Economics and Business, Universitat Pompeu Fabra, Carrer de Ramon Trias Fargas, 25-27, 08005 Barcelona, Spain; [email protected] 4 Department of Software Engineering, Braude College of Engineering, P.O.Box 78 Snunit 51, Karmiel 21982, Israel; [email protected] 5 Institute of Computer Science, Universidade Federal Fluminense, Av. Gal. Milton Tavares de Souza, São Domingos, Niterói—RJ 24210-310, Brazil; [email protected] (L.S.O.); [email protected] (F.P.); [email protected] (V.N.C.) 6 Laboratoire d’Informatique d’Avignon, Université d’Avignon et des Pays du Vaucluse, 339 Chemin des Meinajaries, Agroparc BP 91228, 84911 Avignon CEDEX 9, France; [email protected] 7 Graduate Program in Materials Engineering, Universidade Federal de Ouro Preto, Praça Tiradentes,
    [Show full text]
  • Dynamic Learning of the Environment for Eco-Citizen Behavior
    THTHESEESE`` En vue de l’obtention du DOCTORAT DE L’UNIVERSITE´ DE TOULOUSE D´elivr´epar : l’Universit´eToulouse III - Paul Sabatier (UT3 Paul Sabatier) Cotutelle internationale Universit`adegli Studi di Catania Pr´esent´eeet soutenue le 14/12/2020 par : Davide Andrea GUASTELLA Dynamic Learning of the Environment for Eco-Citizen Behavior JURY MARIE-PIERRE GLEIZES Professeur d’Universite´ Co-Directrice MASSIMO COSSENTINO Directeur de recherche Co-Directeur VALERIE´ CAMPS Maˆıtre de Conference Co-Encadrante CESARE FABIO VALENTI Maˆıtre de Conference Co-Encadrant JEAN-PAUL JAMONT Professeur d’Universite´ Rapporteur ANDREA OMICINI Professeur d’Universite´ Rapporteur LAURENT VERCOUTER Professeur d’Universite´ Examinateur GIANCARLO FORTINO Professeur d’Universite´ Examinateur Ecole´ doctorale et sp´ecialit´e: MITT : Domaine Math´ematiques: Math´ematiquesappliqu´ees Unit´ede Recherche : Institut de Recherche en Informatique de Toulouse (IRIT) Directeur(s)/Encadrant(s) de Th`ese: Val´erieCamps, Massimo Cossentino, Marie-Pierre Gleizes et Cesare Fabio Valenti Rapporteurs : Jean-Paul Jamont et Andrea Omicini II Davide Andrea Guastella DYNAMIC AND REAL-TIME LEARNING OF THE ENVIRONMENT FOR ECO-CITIZEN BEHAVIOR IN SMART CITIES Thesis Supervisors Marie Pierre Gleizes, Full Professor, Universite´ Toulouse III Paul Sabatier Val´erieCamps, Associate Professor, Universite´ Toulouse III Paul Sabatier Cesare Valenti, Associate Professor, Universita` degli Studi di Palermo Massimo Cossentino, Senior Research Scientist, Consiglio Nazionale delle Ricerche (CNR) HE development of sustainable smart cities requires the deployment of Information and Com- T munication Technology (ICT) to ensure better services and available information at any time and everywhere. As IoT devices become more powerful and low-cost, the implementation of an extensive sensor network for an urban context can be expensive.
    [Show full text]
  • D4.1 Device Selection Report
    D4.1 Device Selection 806999 – RADAR-AD Remote Assessment of Disease and Relapse: Alzheimer’s disease WP4 - Development of a technology-enabled system to measure identified functional domains via smartphone, wearable and fixed home-based sensors D4.1 Device Selection Report Publishable Summary Wearables and smart devices are increasingly integrated into our lives, flooding the retail market and literature research. Besides lifestyle applications, they could be utilized as digital biomarkers in elderly care, through activity and behavioral monitoring. In this deliverable, we selected the most appropriate choices of wearable and smart devices, available in literature and the market, considering the three Tiers of trials that will be carried out for the RADAR-AD project. Consequently, we first examined the available sources for all current wearables, smart home (ambient) devices and smartphone apps. Their most important criteria, pros and cons and specs are fully listed for each Tier and category. Then, we produced a shortlist table of suggestions, including devices and apps that match the project’s needs. In the end, all partners conversed through biweekly WP4 device selection track calls, biweekly WP4-wide calls and several WP5 and cross- WP calls, as well as physical and remote Project Steering Board meetings, so as to unanimously make a final selection to be used in each respective Tier of the project. The selection also takes into account functional domains from WP2 as well as Patient Advisory Board suggestions and probe test outcomes. 1 D4.1 Device Selection DoW Extract Task 4.1: Device Evaluation, Selection and Refinement to Digitally Measure Functional Tasks (months 1 - 18, CERTH, OXF, JANSSEN, Takeda, Lilly, Novartis) The task entails two main subtasks, closely connected to one another, in order to select, bench test, extract features and realistically configure pilot devices according to instructions from WP2 - for WP5.
    [Show full text]