Volume 1.0 Lacueva Pérez F. J. Brandl, P. Mayo Macías S. Gracia Bandrés, M.A. Project Deliverable 2.1 Romero Martín, D. Technology Monitoring: Report on Information Needed For Workers in the Smart Factory Worker-Centric Workplaces in Smart Factories www.facts4workers.eu Series: Heading Published by: FACTS4WORKERS: Worker-Centric Workplaces in Smart Factories. FoF 2014/636778 Volume 1.0: Technology Monitoring: Report on Information Needed For the Industrial Challenges Workers with Taxonomy Reference / Citation Lacueva Perez, F. J., Brandl, P., Mayo Macias, S. Gracia Bandrés, M.A., Romero Martín, D. (2015) Project Report – FACTS4WORKERS: Worker-Centric Workplace in Smart Factories www.facts4workers.eu 1. Printing, November 2015 Cover Design: Florian Ott, Cooperation Systems Center Munich Worker-Centric Workplaces in Smart Factories E-Mail: [email protected] Internet: www.facts4workers.eu This document is published under a Creative Commons Attribution Non Commercial No Derives license. You are free to copy and redistribute the material in any medium or format. You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use. You may not use the material for commercial purposes. If you remix, transform, or build upon the material, you may not distribute the modified material. http://creativecommons.org/licenses/by-nc-nd/4.0/ Project Deliverable 2.1, Volume 1.0 About this document Executive Summary D2.1, Technology Monitoring: Report on Information Needed for the Industrial Challenges Workers with Taxonomy is part of the work in progress of the “FACTorieS for WORKERS” (FACTS4WORKERS) project and specifically of the T2.1 task of WP2. Developing the WP2, Worker-centric HCI/HMI Building Blocks, aims to develop (in a co-creation worker-centric process with shop-floor staff) the smart factory solution’s worker-centric HCI/HMI HCI/HMI building blocks building blocks, characterised by maximum usability, user experience (UX) and technology acceptance. As a preliminary work, or expressed as “parallel guiding work”, Task 2.1, Analysis of Technical Requirements and Technology Monitoring will create and maintain a state of the art regarding available and trending technologies (devices, software developments and tools etc.) within the very dynamic field of today’s HCI technology (smart glasses, smart textiles etc.). Furthermore, Task 2.1 will review new (disrupting) HCI paradigms and will relate them to already established (and sometimes outdated) HCI paradigms. D2.1 is the result of the work of T2.1. Its final objective is to create a vision of the Creating a vision current and future developments of HCI technologies and paradigms that will of current and allow other WP2 tasks to obtain the maximum benefit when implementing HCI future developments of building blocks, as well as support future technologies adaptation as they HCI become available during the project execution. D2.1 will also provide a general technologies evaluation of existing technologies considering their applicability on the factories’ and paradigms shop floor but always observing project objectives and industrial challenges reflected in the project proposal. The technologies evaluation will be provided as a taxonomy of technologies that will be evaluated on a TRL-based scale. The taxonomy will be updated in subsequent versions in order to track the technology maturity evolution during the project life. It will also comment on the observed state of technology. i Project Deliverable 2.1, Volume 1.0 Keywords HCI critical taxonomy, Industry 4.0, Factory of The Future, Shop floor, Smart devices, Wearables, Augmented Reality. ii Project Deliverable 2.1, Volume 1.0 Document authors and reviewers The following individuals have made a direct contribution to the document. Please note that many others have also supported our work, and we thank them all sincerely. Lead Authors Name Organisation Role Francisco J. Lacueva ITA WP2 Peter Brandl EVO WP2 – Leader Featuring Authors Name Organisation Role M. A. Gracia ITA WP2 S. Mayo ITA WP2 D. Romero ITA WP2 M. A. Gracia ITA WP2 Reviewers Name Organisation Role Martin Wifling ViF Project Coordinator Alexander Richter UZH WP1 – Leader Gianni Campatelli UFI WP3 – Leader iii <Table of Contents Table of Contents Executive Summary .................................................................................................................... i Keywords ..................................................................................................................................... ii DOCUMENT AUTHORS AND REVIEWERS ................................................ III TABLE OF CONTENTS ...................................................................................... V TABLE OF FIGURES ......................................................................................... IX INDEX OF ABBREVIATIONS ......................................................................... XI 1 INTRODUCTION ..................................................................................... 13 2 METHODOLOGY FOR SELECTING TECHNOLOGIES AND TECHNIQUES ........................................................................................... 17 3 HUMAN–COMPUTER INTERACTION: THEORETICAL BACKGROUND......................................................................................... 21 3.1 Interaction ....................................................................................................................... 25 3.2 Human ............................................................................................................................... 29 3.3 Computer ......................................................................................................................... 30 4 HCI-ENABLING TECHNOLOGIES ........................................................ 33 4.1 Conventional Technologies ....................................................................................... 33 4.1.1 Text Entry .......................................................................................................................... 34 4.1.2 Display Devices ................................................................................................................ 36 4.1.3 Screen Positioning, Pointing and Drawing Technologies............................... 39 V V <Table of Contents 4.1.4 Printers ................................................................................................................................42 4.2 Touch-Sensitive Screens (Touchscreens)............................................................. 44 4.3 Image and Video Devices ............................................................................................ 44 4.4 Computer Vision ............................................................................................................ 47 4.4.1 Recognition ........................................................................................................................48 4.4.2 Motion Analysis................................................................................................................49 4.4.3 Scene Reconstruction ....................................................................................................49 4.4.4 OpenCV ................................................................................................................................49 4.5 Gesture Recognition, Behavioural or Gesture Analytics ................................. 50 4.6 Eye Tracking ................................................................................................................... 53 4.7 Audio Input/Output Technologies .......................................................................... 54 4.7.1 Speech Recognition ........................................................................................................54 4.7.2 Text-to-Speech .................................................................................................................57 4.8 Context-Aware Technologies .................................................................................... 58 4.8.1 Positioning, Location and Identification Technologies ...................................59 4.8.2 Quantified Self ..................................................................................................................64 4.8.3 Emotion Detection, Affective Computing, Mood Recognition.......................65 4.9 Haptic Interaction ......................................................................................................... 67 4.10 Brain–Computer Interaction ..................................................................................... 67 5 HCI SYSTEMS ........................................................................................... 71 5.1 Mobile Devices ............................................................................................................... 71 5.1.1 Mobile Devices Features ..............................................................................................71 5.1.2 Rugged Mobile Devices .................................................................................................73 5.2 Wearable User Interfaces ........................................................................................... 75 5.2.1 Smart Watches .................................................................................................................75