Filipe Calegario a Physical Prototyping Toolkit

Computational Synthesis and Creative Systems Filipe Calegario Designing Digital Musical Instruments Using Probatio A Physical Prototyping Toolkit Computational Synthesis and Creative Systems Series Editors François Pachet, Paris, France Pablo Gervás, Madrid, Spain Andrea Passerini, Trento, Italy Mirko Degli Esposti, Bologna, Italy Creativity has become the motto of the modern world: everyone, every institution, and every company is exhorted to create, to innovate, to think out of the box. This calls for the design of a new class of technology, aimed at assisting humans in tasks that are deemed creative. Developing a machine capable of synthesizing completely novel instances from a certain domain of interest is a formidable challenge for computer science, with potentially ground-breaking applications in fields such as biotechnology, design, and art. Creativity and originality are major requirements, as is the ability to interact with humans in a virtuous loop of recommendation and feedback. The problem calls for an interdisciplinary perspective, combining fields such as machine learning, artificial intelligence, engineering, design, and experimental psychology. Related questions and challenges include the design of systems that effectively explore large instance spaces; evaluating automatic generation systems, notably in creative domains; designing systems that foster creativity in humans; formalizing (aspects of) the notions of creativity and originality; designing productive collaboration scenarios between humans and machines for creative tasks; and understanding the dynamics of creative collective systems. This book series intends to publish monographs, textbooks and edited books with a strong technical content, and focuses on approaches to computational synthesis that contribute not only to specific problem areas, but more generally introduce new problems, new data, or new well-defined challenges to computer science. More information about this series at http://www.springer.com/series/15219 Filipe Calegario Designing Digital Musical Instruments Using Probatio A Physical Prototyping Toolkit Filipe Calegario Centro de Informática (CIn-UFPE) Federal University of Pernambuco Recife, Pernambuco, Brazil ISSN 2509-6575 ISSN 2509-6583 (electronic) Computational Synthesis and Creative Systems ISBN 978-3-030-02891-6 ISBN 978-3-030-02892-3 (eBook) https://doi.org/10.1007/978-3-030-02892-3 Library of Congress Control Number: 2018959876 © Springer Nature Switzerland AG 2019 This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or the editors give a warranty, express or implied, with respect to the material contained herein or for any errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. This Springer imprint is published by the registered company Springer Nature Switzerland AG The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland To Alissa ¼) Preface The last decade has witnessed a considerable rise in physical, programmable, interactive artifacts. Sensors, devices, platforms, and frameworks have become more accessible, and more people are programming the physical world beyond the screen. Interactive devices for artistic expression present challenges that are worth investigating because the interaction often needs a high level of skill that is hard to achieve. Therefore, interactive artistic approaches can teach us valuable lessons applicable to other levels of interaction design and human-computer interaction. One class of artistic, physical interactive objects is the digital musical instrument (DMI). DMIs are artifacts in which gestural control and sound production are physically decoupled but digitally mapped. This provides freedom for a DMI designer since several combinations are possible, but this also increases the com- plexity of the design space. Besides, structured methods and guidelines that would help in the design have not yet been established. To address this issue, prototyping seems to be a promising approach, as a prototype is a tool not only for testing and communicating ideas but also for generating them. As a DMI is a means to produce music, its prototype should provide real-time sound feedback for control gestures. For that reason, in the DMI context, nonfunctional prototypes are not entirely suitable. On the other hand, the development of functional prototypes demands more time and effort, and consequently they can be a bottleneck in iterative design. How can we provide structured and exploratory paths to generate DMI ideas? How can we decrease the time and effort involved in building functional DMI prototypes? To deal with these questions, we propose the concept of instrumental inheritance, that is, the application of gestural and/or structural components of existing instruments to generate ideas for new instruments. To support analysis and combination, we leverage a traditional design method, the morphological chart, in which existing artifacts are split into parts, presented in a visual form, and then recombined to produce new ideas. Finally, integrating the concept and the method in a concrete object, we developed a physical prototyping toolkit for building functional DMI prototypes: Probatio, a modular system of blocks and supports to prototype instruments based on certain ways of holding and gestural controls for musical interaction. vii viii Preface The evaluation of the toolkit showed that it contributed to reducing the time to achieve a functional prototype and also influenced the increase in the number of cycles of idea exploration. Also, users reported more musical engagement with Probatio in comparison to a generic sensor toolkit. We believe that the current version of the system provides a set of features that can work as a platform for user interaction analysis and subsequent recommendation of module combinations. Recife, Brazil Filipe Calegario December 2017 Contents 1 Introduction ........................................... 1 1.1 Context . 1 1.2 Objectives . 3 1.3 Approach ......................................... 3 1.4 Document Outline . 4 2 Challenges in Designing DMIs ............................. 5 2.1 Digital Musical Instruments . 5 2.1.1 DMI Classification . 7 2.2 The Challenge of Multiple Combinations . .................. 7 2.2.1 Gestural Controller . .......................... 7 2.2.2 Sound Output ................................. 9 2.2.3 Mapping ..................................... 10 2.2.4 Feedback . 11 2.2.5 Summary . 12 2.3 The Challenge of Expressivity and Virtuosity . 13 2.4 The Challenge of Evaluation and Evolution ................. 13 2.5 The Challenge of No Previous Knowledge .................. 14 2.6 The Challenge of Multiple Stakeholders and Contexts of Use . 15 2.7 Final Considerations .................................. 16 3 Design Process ......................................... 19 3.1 Idea Exploration . 20 3.2 Prototyping ........................................ 24 3.3 Final Considerations .................................. 30 4 State of the Art ......................................... 31 4.1 Frameworks and Approaches for DMI Design . 31 4.2 Functional Prototype in DMI Design ...................... 36 4.2.1 Tools for Physical and Functional Prototyping . 36 ix x Contents 4.2.2 The Trade-Off Area ............................. 38 4.3 Final Considerations .................................. 42 5 Early Exploration ....................................... 45 5.1 Methodological Approach . ........................... 45 5.2 Project Batebit . 46 5.2.1 Interviews .................................... 47 5.2.2 Workshops ................................... 47 5.2.3 Pandivá . ................................... 49 5.2.4 Sandbox Wow . .............................. 51 5.3 Summary .......................................... 53 6 Proposition ............................................ 55 6.1 Scope and Basis ..................................... 55 6.2 Instrumental Inheritance . ............................ 56 6.2.1 Related Concepts . 57 6.2.2 Possible Evidence .............................. 58 6.2.3 Discussion . ....................... 59 6.3 Morphological Chart for DMI Idea Generation . 60 6.3.1 What Is Morphological Analysis? ................... 60 6.3.2 Morphological Chart Based on Instrumental Inheritance . 62 6.4 Development of the Functional Prototyping Toolkit for DMI .... 64 6.4.1 Guidelines ................................... 66 6.4.2 Implementation Decisions . ..................... 66 6.4.3 Physical Structure .............................. 67 6.4.4 Connection Slots . .............................

Load more