D2.3 Design Guidelines for the Rapid-Api Industrial Design of Multimodal Interactive Expressive Technology
Total Page:16
File Type:pdf, Size:1020Kb
REALTIME ADAPTIVE PROTOTYPING FOR D2.3 DESIGN GUIDELINES FOR THE RAPID-API INDUSTRIAL DESIGN OF MULTIMODAL INTERACTIVE EXPRESSIVE TECHNOLOGY D2.3 DESIGN GUIDELINES FOR THE RAPID-API Grant Agreement nr 644862 Project title Realtime Adaptive Prototyping for Industrial Design of Multimodal Interactive eXpressive technology Project acronym RAPID-MIX Start date of project (dur.) Feb 1st, 2015 (3 years) Document reference RAPIDMIX-WD-WP2-UPF-D2.3.docx Report availability PU - Public Document due Date June 30th, 2016 Actual date of delivery July 31st, 2016 Leader UPF Reply to Sebastian Mealla C. ([email protected]) Additional main contributors Panos Papiots (UPF) (author’s name / partner acr.) Carles F. Julia (UPF) Frederic Bevilacqua (IRCAM) Joseph Larralde (IRCAM) Norbert Schnell (IRCAM) Mick Grierson (GS) Rebecca Fiebrink (GS) Francisco Bernardo (GS) Michael Zbyszyński (GS) xavier boissarie (ORBE) Hugo Silva (PLUX) Document status Final version (reviewed by GS) This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement N° 644862 D2.3 DESIGN GUIDELINES FOR THE RAPID-API Page 1 of 32- MIX_WD_WP1_DeliverableTemplate_20120314_MTG-UPF Page 1 of 32 EXECUTIVE SUMMARY This deliverable updates the user-centred design specifications defined in D2.2 to include guidelines for the RAPID-API development, according to the requirements of research and SME partners, and end-users beyond the consortium. D2.3 DESIGN GUIDELINES FOR THE RAPID-API Page 2 of 32 TABLE OF CONTENTS 1 INTRODUCTION ......................................................................................................................................... 5 1.1 Target Users of the RAPID-API ............................................................................................................... 5 1.2 Glossary ................................................................................................................................................... 6 2 Guidelines from Special Interest Groups .................................................................................................... 6 2.1 Interactive Machine Learning (IML) .......................................................................................................... 7 2.1.1 Challenges ............................................................................................................................................ 7 2.1.2 Related Works ....................................................................................................................................... 7 2.1.3 Use cases within RAPID-MIX ................................................................................................................ 8 2.1.4 Guidelines ............................................................................................................................................. 8 2.2 Online repositories and collaborative communities .................................................................................. 9 2.2.1 Challenges .......................................................................................................................................... 10 2.2.2 Related Works ..................................................................................................................................... 10 2.2.3 Use cases within RAPID-MIX .............................................................................................................. 10 2.2.4 Guidelines ........................................................................................................................................... 10 2.3 Sensors and hardware platforms ........................................................................................................... 12 2.3.1 Challenges .......................................................................................................................................... 12 2.3.2 Related Works ..................................................................................................................................... 12 2.3.3 Use cases within RAPID-MIX .............................................................................................................. 12 2.3.4 Guidelines ........................................................................................................................................... 13 2.4 Feature extraction .................................................................................................................................. 15 2.4.1 Challenges .......................................................................................................................................... 15 2.4.2 Related Works ..................................................................................................................................... 15 2.4.3 Use cases within RAPID-MIX .............................................................................................................. 16 2.4.4 Guidelines ........................................................................................................................................... 16 3 FEEDBACK FROM TARGET USERS ...................................................................................................... 17 3.1.1 The Sonar Innovation Challenge ......................................................................................................... 17 D2.3 DESIGN GUIDELINES FOR THE RAPID-API Page 3 of 32 3.1.2 Structure & participants ....................................................................................................................... 18 3.2 RAPID-MIX actions within the SIC ......................................................................................................... 20 3.2.1 Challenge 1: Expressive gaming through gesture interaction ............................................................. 20 3.2.2 Challenge 2: Collective smartphone experience ................................................................................. 21 3.3 Outcomes ............................................................................................................................................... 21 3.3.1 Challenge 1 Prototype ......................................................................................................................... 21 3.3.2 Challenge 2 Prototype ......................................................................................................................... 23 3.4 Insights from interviews .......................................................................................................................... 24 3.4.1 User preference and compatibility ....................................................................................................... 24 3.4.2 Advantages of RAPID-MIX technologies ............................................................................................ 24 3.4.3 Limitations of the RAPID-MIX technologies ........................................................................................ 24 3.4.4 Insights from Mentors .......................................................................................................................... 25 4 CONCLUSION .......................................................................................................................................... 26 4.1 Interdependence of RAPID-API components ......................................................................................... 26 D2.3 DESIGN GUIDELINES FOR THE RAPID-API Page 4 of 32 1 INTRODUCTION The main goal of Work Package 2 (WP2) is to create and continuously update Design Guidelines for the next generation of Multimodal, Interactive and Expressive (MIX) technology. Tasks within WP2 seek to ensure that needs of industrial and end-users are at the core of these design specifications, resulting from focus group activities with core SME partners to end-users from targeted creative communities. As described in the DoW, this deliverable further extends our initial design guidelines for rapid prototyping (D2.2) with user-centred design (UCD) specifications for the RAPID-API, whose first version will be presented in M21. Therefore, this document illustrates the progression of our product development cycle, from prototyping to API development. This deliverable has been collectively framed through two main UCD actions: the creation of Special Interest Groups (SIG) within the consortium (whose topics responded to needs of SME partners) and the deployment of candidate technologies for the RAPID-API in a creative industries context (Sonar Innovation Challenge, Barcelona, from May 9th till June 17th, 2016). The SIGs were the chosen instrument to organize the internal discussion by grouping consortium members according to their expertise. The Innovation challenge, on the other hand, aimed at bringing RAPID-MIX technologies outside the consortium, to be used in a prototyping process, similarly to our previous UCD actions in the Barcelona Music Hack Day (see D2.2). This deliverable is structured as follows: 1. Presentation and rationale behind the SIGs. Report on the challenges, use cases, and suggested guidelines by each group. List of desired features for the RAPID-API. 2. Feedback from target users within the creative industries. Presentation of the Sonar Innovation Challenge, the role of RAPID-MIX, outcomes and insights from participants. 3. Conclusions