Motion as the Connection Between Audio and Visuals and how it may inform the design of new audiovisual instruments Niall Moody Centre for Music Technology University of Glasgow UK
[email protected] ABSTRACT by an examination of how motion may connect the two do- While it is often claimed that any connection between visual mains, and a number of example mappings between audio art and music is strictly subjective, this paper attempts to and visuals are presented. prove that motion can be used to connect the two domains in a manner that, though not objective in the true sense of 2. A BRIEF HISTORY OF AUDIO-VISUAL the word, will nevertheless be perceived in a similar fashion RELATIONS by multiple people. The paper begins with a brief history of This section will present a brief overview of what the au- attempts to link audio and visuals, followed by a discussion thor feels are the most significant attempts to link audio of Michel Chion’s notion of synchresis in film, upon which and visuals, beginning with Father Louis-Bertrand Castel’s the aforementioned claim is based. Next is an examination original ‘colour organ’ from the mid-1700s. The section is of motion in both audio and moving images, and a prelim- subdivided into various subgenres of, or threads within, au- inary look at the kind of mappings which may be possible. diovisual art, though it should be noted that there is con- As this is all done with a view to the design of new musi- siderable overlap between these sections, and they are in no cal, or audiovisual, instruments, the paper finishes with a way intended as comprehensive categories.