DOCSLIB.ORG

A Survey on the Use of 2D Touch Interfaces for Musical Expression Diemo Schwarz, Wanyu Liu, Frédéric Bevilacqua

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
A Survey on the Use of 2D Touch Interfaces for Musical Expression Diemo Schwarz, Wanyu Liu, Frédéric Bevilacqua A Survey on the Use of 2D Touch Interfaces for Musical Expression Diemo Schwarz, Wanyu Liu, Frédéric Bevilacqua To cite this version: Diemo Schwarz, Wanyu Liu, Frédéric Bevilacqua. A Survey on the Use of 2D Touch Interfaces for Musical Expression. New Interfaces for Musical Expression (NIME), Jul 2020, Birmingham, United Kingdom. hal-02557522 HAL Id: hal-02557522 https://hal.archives-ouvertes.fr/hal-02557522 Submitted on 29 Apr 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. A Survey on the Use of 2D Touch Interfaces for Musical Expression Diemo Schwarz Wanyu Liu Frédéric Bevilacqua STMS UMR9912 STMS UMR9912 STMS UMR9912 Ircam–CNRS–SU Ircam–CNRS–SU Ircam–CNRS–SU 1, place Igor-Stravinsky 1, place Igor-Stravinsky 1, place Igor-Stravinsky 75004 Paris, France 75004 Paris, France 75004 Paris, France [email protected] [email protected] [email protected] ABSTRACT and really useful, because they are robust and fast, have Expressive 2D multi-touch interfaces have in recent years a high resolution and a low price, and are easily replace- moved from research prototypes to industrial products, able. At the same time, experimentation is still ongoing with many Kickstarter projects (TouchKeys piano overlay, from repurposed generic computer input devices to con- 1 trollers specially designed for musical expression. A host Trill ). of practitioners use this type of devices in many different This fortunate situation leads many researchers and prac- ways, with different gestures and sound synthesis or trans- titioners to turn to touch interaction for music perfor- formation methods. In order to get an overview of existing mance [6], but also poses the question how they are us- and desired usages, we launched an on-line survey that col- ing these devices, with which gestures, mappings, control lected 37 answers from practitioners in and outside of aca- layout, and sound generators. For instance, touch sur- demic and design communities. In the survey we inquired faces allow for embodied musical performance using con- about the participants' devices, their strengths and weak- trol paradigms of timbre spaces [12, 14, 8], symbolic and nesses, the layout of control dimensions, the used gestures continuous gestural parameter control, hand-shape recogni- and mappings, the synthesis software or hardware, and the tion, or gesture following and recognition. While these in- use of audio descriptors and machine learning. The results terfaces can be approached intuitively, exploiting their full can inform the design of future interfaces, gesture analysis potential for expressivity remains an open question. For and mapping, and give directions for the need and use of this, the technical implementation, gesture processing and machine learning for user adaptation. sound mapping, as well as the human gesture learning must be addressed conjointly. To better understand these questions we launched an on- Author Keywords line survey2 that inquired about the participants' devices, controllers, touch interfaces, 2D, DMI, NIME, survey their strengths and weaknesses, the layout of control di- mensions, the used gestures and mappings, the synthesis CCS Concepts software or hardware and the use of audio descriptors and machine learning. •Applied computing ! Sound and music computing; Performing arts; 2. PREVIOUS WORK 1. INTRODUCTION The recent study by Sullivan and Wanderley [11] can be used as a reference for the demographics of users of general Touch surfaces are an interface of choice for musical ex- electronic instruments and DMIs, since they went to great pression. After their debut in the 1990s without pressure lengths to reach non-academic musicians (by posting their sensitivity and only single touch (Korg Kaoss Pad, XY- survey in music stores and enticing users without a profes- pads in synthesisers), pressure-sensing and multi-touch de- sional motivation to help out fellow researchers/designers vices have, after long years of being prototypes (Wessel's by offering a raffle of music gear). Their focus was on fac- slabs [13]) or small-series|rather exclusive|products (Tac- tors that contribute to the uptake and continued use of new tex STC-1000 [8], Lemur, Continuum Fingerboard), be- instruments in performance, and they also offer an overview come adopted by the electronic musical instrument indus- of other existing questionnaire-based surveys in the NIME try (Roli Blocks, Linnstrument, Jou´e), and by small spe- field. Our study is complementary in that it goes into the cialist companies (Madrona Labs Soundplane, Zvuk Ma- details of usage of one specific type of NIME. chines Zvuk9). In parallel, computer input peripherals (Wa- There are studies on specific systems, e.g. ¸Camcı [2] sur- com graphic tablets, PQ-Labs multi-touch screen overlays, veyed 2D touch interaction on a multi-touch tablet in the Sensel Morph) or tablet computers (iPad) have appeared use case of their customizable granular synthesis software. that can be used for music performance. These recent in- Regarding machine learning, the link with 2D touch inter- dustrially produced touch devices have become ubiquitous action is pursued increasingly often [1, 4, 5]. 3. THE SURVEY We authored an online questionnaire in Google Forms,2 or- Licensed under a Creative Commons Attribution ganised in 8 sections with 46 questions in 3 larger parts. 4.0 International License (CC BY 4.0). Copyright 1 remains with the author(s). https://www.kickstarter.com/projects/423153472/ trill-touch-sensing-for-makers NIME’20, July 21-25, 2020, Royal Birmingham Conservatoire, 2 Birmingham City University, Birmingham, United Kingdom. available at https://forms.gle/PgXSbMPBu73fr4oP6 30.0% 30.0% 30.0% 20.0% 20.0% 20.0% 10.0% 10.0% 10.0% 0.0% 0.0% 0.0% 0 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 0 10 20 30 40 50 60 70 80 90 (a) age in years (Q1) (b) years of formal music training (Q6) (c) years of experience in digital audio (Q7) Figure 1: Distribution of age and musical experience (n = 34; 35; 37 responses, respectively).4 Solo academia 21 - 50 times small 16.2% 13.5% 8.3% 25.8% large 11 - 20 times 35.5% 13.5% 27.8% Group/Ensemble both 54.1% 29.7% 63.9% music 73.0% Both 0 to 10 times 38.7% medium (a) (b) (c) (d) Figure 2: (a) Respondents background (Q4, Q5, n = 37), (b) number of public performances per year (Q10, n = 37), (c) maximum venue size (Q11, n = 31), (d) solo/group performance (Q12, n = 36).4 The first part inquired about the demographics of the par- electronic into EDM, Electro-Acoustic, and expliciting Con- ticipants, the second part about the touch input device and temporary in the Avant-garde/Experimental category (ab- the synthesis software or hardware, the third part about breviated here as Avant./Expe./Contemp.). Respondents the control layout and the used gestures. For reference, the could choose up to three genres and could specify additional numbered list of questions is available in the print-ready sub-genres or styles (Q9). The latter didn't add much in- one-page form.3 formation and is thus not reported here. The number of We sent invitations to relevant mailing-lists in the field self-reported public performances per year (Q10), maximum of computer music, new interfaces, movement computing, venue size (Q11), and solo or group performance (Q12) is and the communities around major research centres and shown in figures 2b{2d. software environments, and received 37 responses. The questions were always optional and mostly free-form and were analyzed qualitatively using techniques taken from Avant./Expe./Contemp. 32 (32.7%) Electro-Acoustic 26 (26.5%) Grounded Theory [10]: Answers underwent one or two Stage/Theater 9 (9.2%) rounds of coding to allow qualitative analysis and to un- Classical 8 (8.2%) cover common topics and their frequencies of occurrences. Jazz 8 (8.2%) Pop/Rock 5 (5.1%) Electronic Dance Music (EDM) 3 (3.1%) 3.1 Demographics Folk 3 (3.1%) The participants' origin (Q3) was almost exclusively from Country 1 (1.0%) R&B 1 (1.0%) Europe and North America (the only exception was one Blues 1 (1.0%) participant from China), with France, USA, Canada, UK, Rap 1 (1.0%) Germany making up 3/4 of the origins; 89% of them identi- fied themselves as male, 3 as women, one preferred not to Figure 3: Primary genre(s) of music performed or produced say (Q2). Their age distribution (Q1) is shown in figure 1a, (Q8, n = 37).4 with mean of 48.94 and median of 46 years. Answers to the questions about background (Q5) and oc- The panel of our participants are mostly comparable with cupation (Q4) in figure 2a were coded for \academia" (code Sullivan and Wanderley's [11], except for number of perfor- for researchers, teachers, designers, students), \music"(code mances per year, where they report 12% \50 times or more", for professional musicians), and \both". and gender, where they had 29% non-male responses, prob- Regarding musical training, participants had a mean of ably reflecting a more diverse panel of potential and actual 21.06 and median of 19 years of formal musical training respondents, extending further into non-academic musicians (Q6, figure 1b), and mean of 20.73 and median of 20 years and being less specific than our target group.
Load more

Recommended publications
  • ZGMTH Zeitschrift Der Gesellschaft Für Musiktheorie Herausgegeben Von
    Zeitschrift der ZGMTH Gesellschaft für Musiktheorie 14. Jahrgang 2017 Herausgegeben von Ariane Jeßulat, Ullrich Scheideler, Kilian Sprau, Christian Utz, Verena Weidner, Felix Wörner A01-Titelimpressum.indd 1 07.09.18 17:31 ZGMTH Zeitschrift der Gesellschaft für Musiktheorie e. V. https://doi.org/10.31751/zgmth Wissenschaftlicher Beirat der Gesellschaft für Musiktheorie: Jean-Michel Bardez (Paris), Thomas Christensen (Chicago), Nicholas Cook (Cambridge), Jonathan Cross (Oxford), Hermann Danuser (Berlin), Helga de la Motte- Haber (Berlin), Hartmut Fladt (Berlin), Allen Forte (†, New Haven), Inga Mai Groote (Zürich), Renate Groth (†, Bonn), Thomas Kabisch (Trossingen), Eckehard Kiem (†, Freiburg), Clemens Kühn (Dresden), Nicolas Meeùs (Paris), Alexander Rehding (Cambridge, MA), Christian Martin Schmidt (Berlin), Michiel Schuijer (Amsterdam). 14. Jahrgang 2017 https://doi.org/10.31751/42 (Ausgabe 14/1); https://doi.org/10.31751/44 (Ausgabe 14/2) Herausgeber: Prof. Dr. Ariane Jeßulat, Alt-Friedrichsfelde 126, 10315 Berlin, [email protected] Dr. Ullrich Scheideler, Müllerstraße 150, 13353 Berlin, [email protected] Dr. Kilian Sprau, Georg-Hann-Str. 17, 81247 München, [email protected] Univ.-Prof. Dr. Christian Utz, Mariahilferstraße 56/27, A-1070 Wien, [email protected] Dr. Verena Weidner, Wittstocker Str. 8, 10553 Berlin, [email protected] Dr. Felix Wörner, Manzentalstraße 37, 79541 Lörrach, [email protected] Die Herausgeber sind per E-Mail erreichbar unter: [email protected]. Layout: Poli Quintana / Oliver Schwab-Felisch Satz: Werner Eickhoff-Maschitzki, Umschlag: Oliver Schwab-Felisch Notensatz und Grafik: Werner Eickhoff-Maschitzki Erscheinungsweise: jährlich. Beiträge und Anfragen senden Sie vorzugsweise in elektronischer Form an: [email protected]. Postzusendungen (z. B. Rezensionsexemplare von Druckschriften) nimmt entgegen: Prof.
    [Show full text]
  • Trautonium - Wikipedia
    18/2/2018 Trautonium - Wikipedia Trautonium The T rautonium is a monophonic electronic musical instrument invented[1] about 1929 by Friedrich Trautwein in Berlin at the Musikhochschule's music and radio lab, the Rundfunkversuchstelle.[2] Soon Oskar Sala joined him, continuing development until Sala's death in 2002. Contents Telefunken Volkstrautonium, 1933 (Telefunken Trautonium Ela T 42 (1933–35)) a Description product version of the Trautonium co-developed by Telefunken, Friedrich Trautwein and Oskar Sala Manufacturers since 1931. Present Trautonium performers Gallery See also Notes Sources External links Description Instead of a keyboard, its manual is made of a resistor wire over a metal plate, which is pressed to create a sound. Expressive playing was possible with this wire by gliding on it, creating vibrato with small movements. Volume was controlled by the pressure of the finger on the wire and board. The first Trautoniums were marketed by Telefunken from 1933–35 (200 were made). The sounds were at first produced by neon-tube relaxation oscillators [3] (later, thyratrons, then transistors), which produced sawtooth-like waveforms.[4] The pitch was determined by the amount of resistive wire chosen by the performer (allowing vibrato, quarter-tones, and portamento). The oscillator output was fed into two parallel resonant filter circuits. A footpedal controlled the volume ratio of the output of the two filters, which was sent to an amplifier.[5] On 20 June 1930 Oskar Sala and Paul Hindemith gave a public performance at the Berliner
    [Show full text]
  • The Hybrid Mobile Instrument: Recoupling the Haptic, the Physical, and the Virtual
    THE HYBRID MOBILE INSTRUMENT: RECOUPLING THE HAPTIC, THE PHYSICAL, AND THE VIRTUAL A DISSERTATION SUBMITTED TO THE DEPARTMENT OF MUSIC AND THE COMMITTEE ON GRADUATE STUDIES OF STANFORD UNIVERSITY IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY Romain Pierre Denis Michon June 2018 © 2018 by Romain Pierre Denis Michon. All Rights Reserved. Re-distributed by Stanford University under license with the author. This work is licensed under a Creative Commons Attribution- Noncommercial 3.0 United States License. http://creativecommons.org/licenses/by-nc/3.0/us/ This dissertation is online at: http://purl.stanford.edu/rd318qn0219 ii I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Chris Chafe, Co-Adviser I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Julius Smith, III, Co-Adviser I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Ge Wang I certify that I have read this dissertation and that, in my opinion, it is fully adequate in scope and quality as a dissertation for the degree of Doctor of Philosophy. Matthew Wright, Approved for the Stanford University Committee on Graduate Studies. Patricia J. Gumport, Vice Provost for Graduate Education This signature page was generated electronically upon submission of this dissertation in electronic format.
    [Show full text]
  • On the Playing of Monodic Pitch in Digital Music Instruments
    Proceedings ICMC|SMC|2014 14-20 September 2014, Athens, Greece ON THE PLAYING OF MONODIC PITCH IN DIGITAL MUSIC INSTRUMENTS Vincent Goudard Hugues Genevois Lionel Feugere` Institut Jean Le Rond d’Alembert, Institut Jean Le Rond d’Alembert, LIMSI-CNRS, UMR 7190 - equipe´ LAM, UMR 7190 - equipe´ LAM, F-91403 Orsay Cedex, France. UPMC Univ Paris 06, UPMC Univ Paris 06, UPMC Univ Paris 06, F-75005 Paris, France. F-75005 Paris, France. F-75005 Paris, France. [email protected] [email protected] [email protected] ABSTRACT sweeps. Iannis Xenakis’ Metastasis, created in 1955 at Donaueschingen festival, stands among the most signifi- This paper addresses the issue of controlling monodic pitch cant works that arised from this research. in digital musical instruments (DMIs), with a focus on in- The concept of pitch, and the theories on harmony brought struments for which the pitch needs to be played with accu- up with it, is a vast field of study. This article focuses on racy. Indeed, in many cultures, music is based on discrete playing techniques, that allow to control precisely the pitch sets of ordered notes called scales, so the need to control on a digital music instrument (DMI). As developers and pitch has a predominant role in acoustical instruments as players of such musical instruments, we will take here a well as in most of the DMIs. But the freedom of param- closer look at the interfaces and algorithms meant for con- eter mapping allowed by computers, as well as the wide tinuous control of pitch. This article will aim at reviewing range of interfaces, opens a large variety of strategies to existing techniques as well as introduce techniques devel- control pitch in the DMIs.
    [Show full text]
  • 2008 a Chronology of Electronic and Computer Music
    (without A Chronology / History of Electronic and Computer Music and Related Events 1900 - 2014 frames) Last updated 5 January 2013 This page is currently being maintained. Please send suggestions and corrections to a subject of 'Chronology' gets my attention. © Copyright 2008-2014* Paul Doornbusch. This is a somewhat extended and updated version based on the same item originally published in The Oxford Handbook of Computer Music late in 2009. When attempting such a chronology or timeline, even one such as this which mostly ignores the commercial music world, it quickly becomes apparent that there is so much activity that it will necessarily be incomplete. It is impossible to list all of the events which have taken place in any locale or time. Given these limitations, perhaps this is still of some limited use as some sort of chronological overview of computer music research and related events, and I welcome suggestions for updates. This concentrates on electronic and computer music and includes fewer details of commercial music than a more comprehensive chronology might. Please see the references for a more detailed treatment of events (note 1). Year Selected Significant Musical Main Technological Events Electronic / Computer Events Music Events < Cylinder and disk recordings 1900 are common, as is the telephone. Moving pictures exist, but not with sound. 1906 First public performances of J. L. Baird creates the first Thaddeus Cahill's working (electromechanical) Dynamophone, also known as television. the Telharmonium (developed in 1897). Frank Conrad makes the first radio broadcast of audio. Lee De Forest develops the Triode (thermionic valve) or Audion tube, the first vacuum tube, which brought with it electronic amplification.
    [Show full text]
  • Intimate Control for Physical Modeling Synthesis
    Intimate Control for Physical Modeling Synthesis by Randall Evan Jones B.Sc. University of Wisconsin–Madison 1993 A Thesis Submitted in Partial Fullfillment of the Requirements for the Degree of MASTER OF SCIENCE in the Department of Computer Science c Randall Evan Jones, 2008 University of Victoria All rights reserved. This thesis may not be reproduced in whole or in part, by photocopy or other means, without the permission of the author. ii Intimate Control for Physical Modeling Synthesis by Randall Evan Jones B.Sc. University of Wisconsin–Madison 1993 Supervisory Committee Dr. George Tzanetakis (Department of Computer Science) Supervisor Dr. W. Andrew Schloss (School of Music) Co-Supervisor Dr. Peter Driessen (Department of Electrical and Computer Engineering) Outside Member Dr. W. Tecumseh Fitch (School of Psychology, University of St. Andrews, Scotland) External Examiner iii Supervisory Committee Dr. George Tzanetakis (Department of Computer Science) Supervisor Dr. W. Andrew Schloss (School of Music) Co-Supervisor Dr. Peter Driessen (Department of Electrical and Computer Engineering) Outside Member Dr. W. Tecumseh Fitch (School of Psychology, University of St. Andrews, Scotland) External Examiner Abstract Physical modeling synthesis has proven to be a successful method of synthesizing real- istic sounds, but providing expressive controls for performance remains a major challenge. This thesis presents a new approach to playing physical models, based on multidimensional signals. Its focus is on the long-term research question, “How can we make a computer- mediated instrument with control intimacy equal to the most expressive acoustic instru- ments?” In the material world, the control and sounding properties of an instrument or other object are intimately linked by the object’s construction.
    [Show full text]
  • Intimate Control for Physical Modeling Synthesis
    Intimate Control for Physical Modeling Synthesis by Randall Evan Jones B.Sc. University of Wisconsin–Madison 1993 A Thesis Submitted in Partial Fullfillment of the Requirements for the Degree of MASTER OF SCIENCE in the Department of Computer Science c Randall Evan Jones, 2008 University of Victoria All rights reserved. This thesis may not be reproduced in whole or in part, by photocopy or other means, without the permission of the author. ii Intimate Control for Physical Modeling Synthesis by Randall Evan Jones B.Sc. University of Wisconsin–Madison 1993 Supervisory Committee Dr. George Tzanetakis (Department of Computer Science) Supervisor Dr. W. Andrew Schloss (School of Music) Co-Supervisor Dr. Peter Driessen (Department of Electrical and Computer Engineering) Outside Member Dr. W. Tecumseh Fitch (School of Psychology, University of St. Andrews, Scotland) External Examiner iii Supervisory Committee Dr. George Tzanetakis (Department of Computer Science) Supervisor Dr. W. Andrew Schloss (School of Music) Co-Supervisor Dr. Peter Driessen (Department of Electrical and Computer Engineering) Outside Member Dr. W. Tecumseh Fitch (School of Psychology, University of St. Andrews, Scotland) External Examiner Abstract Physical modeling synthesis has proven to be a successful method of synthesizing real- istic sounds, but providing expressive controls for performance remains a major challenge. This thesis presents a new approach to playing physical models, based on multidimensional signals. Its focus is on the long-term research question, “How can we make a computer- mediated instrument with control intimacy equal to the most expressive acoustic instru- ments?” In the material world, the control and sounding properties of an instrument or other object are intimately linked by the object’s construction.
    [Show full text]
  • On the Playing of Monodic Pitch in Digital Music Instruments Vincent Goudard, Hugues Genevois, Lionel Feugère
    On the playing of monodic pitch in digital music instruments Vincent Goudard, Hugues Genevois, Lionel Feugère To cite this version: Vincent Goudard, Hugues Genevois, Lionel Feugère. On the playing of monodic pitch in digital music instruments. ICMC/SMC 2014, Sep 2014, Athènes, Greece. pp.1418. hal-01073240 HAL Id: hal-01073240 https://hal.archives-ouvertes.fr/hal-01073240 Submitted on 9 Oct 2014 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Proceedings ICMC|SMC|2014 14-20 September 2014, Athens, Greece ON THE PLAYING OF MONODIC PITCH IN DIGITAL MUSIC INSTRUMENTS Vincent Goudard Hugues Genevois Lionel Feugere` Institut Jean Le Rond d’Alembert, Institut Jean Le Rond d’Alembert, LIMSI-CNRS, UMR 7190 - equipe´ LAM, UMR 7190 - equipe´ LAM, F-91403 Orsay Cedex, France. UPMC Univ Paris 06, UPMC Univ Paris 06, UPMC Univ Paris 06, F-75005 Paris, France. F-75005 Paris, France. F-75005 Paris, France. [email protected] [email protected] [email protected] ABSTRACT sweeps. Iannis Xenakis’ Metastasis, created in 1955 at Donaueschingen festival, stands among the most signifi- This paper addresses the issue of controlling monodic pitch cant works that arised from this research.
    [Show full text]
  • Buttons, Handles, and Keys
    %XWWRQV+DQGOHVDQG.H\V$GYDQFHVLQ&RQWLQXRXV&RQWURO .H\ERDUG,QVWUXPHQWV $QGUHZ0F3KHUVRQ Computer Music Journal, Volume 39, Number 2, Summer 2015, pp. 28-46 (Article) 3XEOLVKHGE\7KH0,73UHVV For additional information about this article http://muse.jhu.edu/journals/cmj/summary/v039/39.2.mcpherson.html Access provided by Queen Mary, University of London (5 Jan 2016 09:47 GMT) Andrew McPherson Buttons, Handles, and Centre for Digital Music Queen Mary University of London Mile End Road, London E1 4NS, UK Keys: Advances in [email protected] Continuous-Control Keyboard Instruments Abstract: The keyboard is one of the most popular and enduring musical interfaces ever created. Today, the keyboard is most closely associated with the acoustic piano and the electronic keyboards inspired by it, which share the essential feature of being discrete: Notes are defined temporally by their onset and release only, with little control over each note beyond velocity and timing. Many keyboard instruments have been invented, however, that let the player continuously shape each note. This article provides a review of keyboards whose keys allow continuous control, from early mechanical origins to the latest digital controllers and augmented instruments. Two of the author’s own contributions will be described in detail: a portable optical scanner that can measure continuous key angle on any acoustic piano, and the TouchKeys capacitive multi-touch sensors, which measure the position of fingers on the key surfaces. These two instrument technologies share the trait that they transform the keys of existing keyboards into fully continuous controllers. In addition to their ability to shape the sound of a sustaining note, both technologies also give the keyboardist new dimensions of articulation beyond key velocity.
    [Show full text]
  • DVD Program Notes
    DVD Program Notes Part One: Colby Leider, Curator Motivated by my interests both in mation artist Stephanie Maxwell, Curator’s Note multichannel composition and alter- maps and weaves an uncharted terri- nate controllers, this compilation is tory of sound and image that have built loosely around contrasting been subjected to physical manipula- To highlight some of the outstanding themes of the subtle stasis of audio- tion, even as it embraces relatively surround audio, multimedia work, visual ambience versus the biting simple building blocks of points, and new musical controllers being drive of jagged pointillism, of slow- lines, curves, and largely isolated created by members of the computer moving glaciers against pins and nee- events in both its visual and its mu- music community, the editors of dles. Simply stated, these works sical material. Computer Music Journal decided to speak to the intensity of experience Copper Islands, by composer and issue a two-hour DVD-Video disc to that can be created by either slow or video artist Kristine H. Burns, ex- accompany Volume 27. The disc is fast rates of change of materials. plores a delicate interplay between playable on any DVD-equipped com- Benjamin Broening’s (after) grace- sounds and abstract isomorphic tex- puter or commercial home-theater fully navigates through a referential tures. Consisting of relatively simple DVD player, and the built-in Dolby fantasy on works by John Dowland synthesized video and audio, the Digital decoder found on most home- and William Byrd. The result is a work exhibits an astonishing com- theater audio amplifiers will allow kind of blissful faded memory and a plexity of gestalt through the contin- many of the works to be heard in 5.1 powerful reminder of the computer’s uous yet subtle shift of audio-visual surround (Left, Center, Right, Left ability to help composers investigate, synchrony.
    [Show full text]
  • ZGMTH Zeitschrift Der Gesellschaft Für Musiktheorie Dreyer
    Zeitschrift der ZGMTH Gesellschaft für Musiktheorie Dreyer, Hubertus / Horn, Pascal (2017): Schnittstellen zwischen performance und Ana- lyse von Popmusik. Performative Produktionsprozesse in Pink Floyds Album Wish You Were Here und Jordan Rudess’ Coverversion von Genesis’ Dance on a Volcano. ZGMTH 14/1, 133–159. https://doi.org/10.31751/888 © 2017 Hubertus Dreyer ([email protected]; Pascal Horn ([email protected]) Dieser Text erscheint im Open Access und ist lizenziert unter einer Creative Commons Namensnennung 4.0 International Lizenz. This is an open access article licensed under a Creative Commons Attribution 4.0 Inter- national License. eingereicht / submitted: 16/03/2017 angenommen / accepted: 29/03/2017 veröffentlicht / first published: 30/06/2017 zuletzt geändert / last updated: 13/09/2018 B06-17-1-06 Deckblatt Dreyer.indd 1 11.09.18 17:39 Schnittstellen zwischen performance und Analyse von Popmusik Performative Produktionsprozesse in Pink Floyds Album Wish You Were Here und Jordan Rudess’ Coverversion von Genesis’ Dance on a Volcano1 Hubertus Dreyer, Pascal Horn ABSTRACT: In Popmusik ist die in jüngerer Zeit von den musical performance studies gene- rell hinterfragte Trennung zwischen ›Werk‹ und ›Interpretation‹ kaum anwendbar, performance (gerade auch, wenn sie vorwiegend im Studio stattfindet) kann als ein integraler Bestandteil eines Songs oder Albums verstanden werden. Der vorliegende Beitrag versucht, Schnittstellen zwischen der Analyse von performance und musikalischer Analyse von Popmusik aufzuzeigen: Einerseits gibt eine Untersuchung der Studioarbeit von Popkünstler*innen nicht nur Einblicke in die Entstehung von Popmusik, sondern erlaubt auch Rückschlüsse auf Ästhetik und musika- lische Konzepte der Künstler*innen, die wiederum Anhaltspunkte für die musikalische Analyse bieten.
    [Show full text]
  • C 2010 Zuofu Cheng a NOVEL CONTINUOUS PITCH ELECTRONIC WIND INSTRUMENT CONTROLLER
    c 2010 Zuofu Cheng A NOVEL CONTINUOUS PITCH ELECTRONIC WIND INSTRUMENT CONTROLLER BY ZUOFU CHENG THESIS Submitted in partial fulllment of the requirements for the degree of Master of Science in Electrical and Computer Engineering in the Graduate College of the University of Illinois at Urbana-Champaign, 2010 Urbana, Illinois Adviser: Lecturer Lippold Haken ABSTRACT We present a design for an electronic continuous pitch wind controller for musical performance. It uses a combination of linear position, magnetic reed, and air pressure sensors to generate three fully continuous control dimensions. Each control dimension is encoded and transmitted using the industry standard MIDI protocol to allow the instrument to interface with a large variety of synthesizers to control dierent parameters of the synthesis algorithm in real time, allowing for a high degree of expressiveness not possible with existing electronic wind instrument controllers. The rst part of the thesis will provide a justication for the design of a novel instrument, and present some of the theory behind pitch representation, encoding, and transmission with respect to digital systems. The remainder of the thesis will present the particular design and explain the workings of its various subsystems. ii ACKNOWLEDGMENTS I am grateful to my thesis adviser, Dr. Lippold Haken for his tireless support in the conception, design, and production of this instrument and his expertise in computer music. I would like to extend my thanks to the Department of Electrical and Computer Engineering at the University of Illinois for providing me with the nancial support and scholarship that went into this work. I would like to thank Craig A.
    [Show full text]