Group 4 P4 Project May 23, 2013 Medialogy 4 AAU-CPH Page 1 of 156 Group 4 P4 Project May 23, 2013 Medialogy 4 AAU-CPH (This page is intentionally left blank) Page 2 of 156 Group 4 P4 Project May 23, 2013 Medialogy 4 AAU-CPH Semester:: 4th Title: Audiolized Art Aalborg University Copenhagen A.C. Meyers Vænge 15 th th Project Period: 4 February -24 May 2013 2450 København SV Telefon: 9940 2500 Semester Theme: Semester Coordinator: Sonic Interaction: Design and Evaluation Secretary: Supervisor(s): Kasper Søndergaard Abstract: Project group no.: This report is about augmenting static art through the implementation of sound interactivity, with the 404 goal of making it more interesting of an experience. Members: The report researches the various fields of art and sound interaction. Based on this research, a Andrea Keiser prototype sound-interactive artwork is designed and developed. This early prototype is then used for experiments, so as to obtain the point-of-view of the Frederik Bærentsen users, for improving the prototype. The completed prototype is then tested in a final experiment in Martin Høyer Poulsen contrast to a similar, but motionless artwork. The results from the final experiment are then analyzed. The results show that; though variation of test Patrick Lehmann Hald subjects is somewhat narrow, results show a clear indication of the interactive artwork being more Niclas Bach Nielsen interesting than the motionless artwork. Pedersen Nicky Sabinsky Copies: 3 Pages: 156 Page 3 of 156 Finished: yes Group 4 P4 Project May 23, 2013 Medialogy 4 AAU-CPH (This page is intentionally left blank) Page 4 of 156 Group 4 P4 Project May 23, 2013 Medialogy 4 AAU-CPH 1. INTRODUCTION .............................................................................................................................. 9 1.1 Initial Problem Statement ......................................................................................................................... 9 2. PRE ANALYSIS ............................................................................................................................... 11 2.1 Introduction ............................................................................................................................................ 11 2.2 Art ........................................................................................................................................................... 11 2.2.1 Art Definitions ............................................................................................................................................ 11 2.2.2 Digital Art ................................................................................................................................................... 13 2.3 Sound Art ................................................................................................................................................ 13 2.3.1 Sound Installations ..................................................................................................................................... 14 2.3.2 FS/Partial .................................................................................................................................................... 15 2.3.3 Spine ........................................................................................................................................................... 16 2.3.4 Dyskograf ................................................................................................................................................... 17 2.3.5 Drawing with Sound ................................................................................................................................... 19 2.3.6 Reactive Sparks .......................................................................................................................................... 19 2.3.7 Sound-Reactive Drawings .......................................................................................................................... 20 2.4 Sub conclusion ........................................................................................................................................ 21 2.5 Final Problem Statement ......................................................................................................................... 21 3. ANALYSIS ........................................................................................................................................ 22 3.1 Art ........................................................................................................................................................... 22 3.1.1 Grid System ................................................................................................................................................ 22 3.1.2 Golden Ratio............................................................................................................................................... 23 3.1.3 Static Art ..................................................................................................................................................... 24 3.1.4 Dynamic Art ................................................................................................................................................ 25 3.1.5 Storytelling in Art ....................................................................................................................................... 27 3.2 Sound ...................................................................................................................................................... 29 3.2.1 Sound Definition ........................................................................................................................................ 29 3.2.2 Audio Features ........................................................................................................................................... 30 3.2.3 Sound Recognition ..................................................................................................................................... 35 3.3 Computational Auditory Scene Analysis .................................................................................................. 37 3.4 Interaction .............................................................................................................................................. 38 3.4.1 Interaction Design ...................................................................................................................................... 39 3.4.2 Sound Interaction ....................................................................................................................................... 40 3.4.3 Art Interaction ............................................................................................................................................ 41 Page 5 of 156 Group 4 P4 Project May 23, 2013 Medialogy 4 AAU-CPH 3.5 Intuitiveness............................................................................................................................................ 42 3.6 Technology available ............................................................................................................................... 44 3.6.1 Java ............................................................................................................................................................. 44 3.6.2 Processing .................................................................................................................................................. 45 3.6.3 Max 6 .......................................................................................................................................................... 45 3.6.4 Chosen Technology .................................................................................................................................... 46 3.7 Target Group ........................................................................................................................................... 48 3.8 Design Requirements .............................................................................................................................. 50 3.8.1 Functional ................................................................................................................................................... 50 3.8.2 Non-functional ........................................................................................................................................... 50 4. DESIGN ............................................................................................................................................ 51 4.1 Design Idea.............................................................................................................................................. 51 4.2 Art on Screen .......................................................................................................................................... 53 4.2.1 Graphics Choice .......................................................................................................................................... 54 4.2.2 Image Color ................................................................................................................................................ 54 4.3 Interesting ..............................................................................................................................................