Interacting with Generative Music Through Live Coding

Total Page:16

File Type:pdf, Size:1020Kb

Interacting with Generative Music Through Live Coding Interacting with Generative Music through Live Coding Author Brown, Andrew R, Sorensen, Andrew Published 2009 Journal Title Contemporary Music Review DOI https://doi.org/10.1080/07494460802663991 Copyright Statement © 2009 Taylor & Francis. This is an electronic version of an article published in Contemporary Music Review, Vol. 28(1), 2009, pp. 17-29. Contemporary Music Review is available online at: http://www.informaworld.com with the open URL of your article. Downloaded from http://hdl.handle.net/10072/39923 Griffith Research Online https://research-repository.griffith.edu.au Brown, A. R. and Sorensen, A. (2009). "Interacting with Generative Music through Live Coding." Interacting with generative music through live coding Andrew R. Brown and Andrew Sorensen Queensland University of Technology & Australasian CRC for Interaction Design Keywords: live coding, performance, algorithm, interaction Abstract All music performances are generative to the extent that the actions of performers produce musical sounds, but in this article we focus on performative interaction with generative music in a more compositional sense. In particular we discuss how live coding of music involve the building and management of generative processes. We suggest that the human interaction with generative processes that occurs in live coding provides a unique perspective on the generative music landscape, especially significant is the way in which generative algorithms are represented in code to best afford interaction and modification during performance. We also discuss the features of generative processes that make them more or less suitable for live coding performances. We situate live coding practice within historical and theoretical contexts and ground the discussion with regular reference to our experiences performing in the live coding duo aa-cell. Introduction The practice of live coding involves writing and modifying computer programs that generate music in real-time. Often this music making activity occurs in a live performance situation with the code source projected for the audience. While it is possible to trigger sound events directly while live coding it is much more efficient to create generative processes that autonomously make music, freeing the performer to build or modify code for the next stage of the performance. Therefore, being able to efficiently describe generative processes as software is a primary concern for the live coder. In particular we have found that the following criteria apply to generative processes for use in live coding. Generative processes should be: - succinct and quick to type - widely applicable to a variety of musical circumstances - computationally efficient allowing real-time evaluation - responsive and adaptive by minimising future commitments - modifiable through the exposure of appropriate parameters For the live coder, software code is a medium of expression through which creative ideas are articulated and in this article we will focus on how generative processes facilitate that expression. Computer programming code is the music notation of live coding performances (McLean 2004). The code represents the musician’s ideas and describes the musical outcome to the computer and to those with the knowledge to read it. Notated in code, the music is available for reflection, reuse and modification. It can be saved, replayed, shared with others or analysed. This affords reflection in action that has been shown to be highly valuable in creative tasks in many domains (Schön 1987) and generative processes facilitate this in ways not previously possible in live performance. In performance, the code is often modified substantially and therefore that which remains at the Brown, A. R. and Sorensen, A. (2009). "Interacting with Generative Music through Live Coding." end is often insufficient to represent the whole performance. For a full transcription of a live coding performance all of the changes would need to be logged. There are many other aspects of live coding performance beyond those discussed here and for further details of the history and scope of live coding practices the reader is directed to other literature (Collins et al. 2003, Brown 2006). The authors have several years of experience in live coding, primarily performing as the duo aa-cell in numerous concerts. Originally our live coding practice was purely musical but in recent times our performances have included live coding of visual material as well. During performances the visual material and code are usually projected for the audience to view. Figure 1 shows aa-cell performing at a concert in Brisbane, Australia in 2008, and figure 2 shows a snap shot of the projected image during the performance. Figure 1. The live coding duo aa-cell in performance. Figure 2. The screen projected for audiences to view during an aa-cell concert. Direct and meta creation How is live coding a musical activity? Banging a drum creates sound, and potentially music, through a direct connection between a human action or gesture and a sound source. Only in a trivial sense can this be considered generative, and it is possible in live coding performances to emulate this direct creation by manually triggering the evaluation of one-shot code fragments. However, if live coding were limited to this direct evaluation it would be severely crippled as an expressive practice. In this article we are more concerned with generative music in an expansive sense, where substantial musical outputs are produced by an algorithm. Typically, there is considerable leverage in this process where the effort of describing the algorithm is minimal compared to the effort that would have been required (if it were even possible) to describe directly the musical material that is produced. Generative music practices have, therefore, a link with conceptual visual art and formalist music composition movements from the 20th century. These practices all share an emphasis on process as a creative driver and an indirect mediation between artist and artistic form, a process described as metacreation by Mitchell Whitelaw (2004). In live coding concerts, performers often set up computational processes that generate an ongoing stream of musical output allowing the performer to turn their attention to writing or modifying processes. The computer plays a mediating role by executing the process and producing the sound. It is the ability to harness generative material that allows live coding performers to participate in a new kind of performance where they exercise indirect, or meta, control over the creation of their music. Stylistically, much of the music produced by live coding has aesthetic links to other electronic music genres including musique concrète, electronic dance music, glitch music, and noise art; a grouping that is not overly coherent from the point of Brown, A. R. and Sorensen, A. (2009). "Interacting with Generative Music through Live Coding." view of aesthetics, but shares a concern for processes involving electronic sound systems. While performing with generative processes is relatively novel within this community, there seems to be an openness to it not found in many other music communities. This openness is likely a result of both the valuing of experimentation or novelty as well as the historical reliance on recorded sound for composition and performance, including DJing. Music making is understood as a construction and moulding of sound materials, rather than as a transcription of the musician’s imagination. There is also an active interest in the role of technologies as drivers of innovation. Within this receptive environment it is not surprising that live coding activities have begun to flourish and spread. Tools and technologies Marcus Pearce and his colleagues (2002) articulate a sentiment about the role of coding in music making that resonates with us and many other computer musicians; that the development of software is a central component of computer music making. If a computer program is written by the composer, the development of the program is an integral part of the compositional process (since ultimately it is driven by the same motivations). Since the program is designed solely for use by its developer, there are no methodological constraints placed on its construction. Furthermore, there is no need to define any rigorous criteria for success nor to use such criteria in evaluating the program and the compositions. If the composer intends the music for public consumption, then they may only be evaluated in the same way that composers and compositions are usually appraised: through audience reactions at performances, record sales, critical reviews and so on. (Pearce et al. 2002 p.123.) In live coding practice this view of software development as music making finds its logical, if perhaps crazy to some, conclusion: writing software becomes part of the performance. Code becomes the musical score; a score that is written, modified and executed as part of the performance. In this way live coding practices combine aspects of composition, arranging, improvisation and performance. The code acts as an intermediary between imagination and sound and is elaborated and transformed in performance within a tight feedback loop. This has similarities to the real-time interaction between musicians and prepared algorithmic processes, described as ‘hyperimprovisation’ by Roger Dean (2003). The use of generative processes in these practices is clearly significant for both the efficient production
Recommended publications
  • An AI Collaborator for Gamified Live Coding Music Performances
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Falmouth University Research Repository (FURR) Autopia: An AI Collaborator for Gamified Live Coding Music Performances Norah Lorway,1 Matthew Jarvis,1 Arthur Wilson,1 Edward J. Powley,2 and John Speakman2 Abstract. Live coding is \the activity of writing (parts of) regards to this dynamic between the performer and audience, a program while it runs" [20]. One significant application of where the level of risk involved in the performance is made ex- live coding is in algorithmic music, where the performer mod- plicit. However, in the context of the system proposed in this ifies the code generating the music in a live context. Utopia3 paper, we are more concerned with the effect that this has on is a software tool for collaborative live coding performances, the performer themselves. Any performer at an algorave must allowing several performers (each with their own laptop pro- be prepared to share their code publicly, which inherently en- ducing its own sound) to communicate and share code during courages a mindset of collaboration and communal learning a performance. We propose an AI bot, Autopia, which can with live coders. participate in such performances, communicating with human performers through Utopia. This form of human-AI collabo- 1.2 Collaborative live coding ration allows us to explore the implications of computational creativity from the perspective of live coding. Collaborative live coding takes its roots from laptop or- chestra/ensemble such as the Princeton Laptop Orchestra (PLOrk), an ensemble of computer based instruments formed 1 Background at Princeton University [19].
    [Show full text]
  • Chuck: a Strongly Timed Computer Music Language
    Ge Wang,∗ Perry R. Cook,† ChucK: A Strongly Timed and Spencer Salazar∗ ∗Center for Computer Research in Music Computer Music Language and Acoustics (CCRMA) Stanford University 660 Lomita Drive, Stanford, California 94306, USA {ge, spencer}@ccrma.stanford.edu †Department of Computer Science Princeton University 35 Olden Street, Princeton, New Jersey 08540, USA [email protected] Abstract: ChucK is a programming language designed for computer music. It aims to be expressive and straightforward to read and write with respect to time and concurrency, and to provide a platform for precise audio synthesis and analysis and for rapid experimentation in computer music. In particular, ChucK defines the notion of a strongly timed audio programming language, comprising a versatile time-based programming model that allows programmers to flexibly and precisely control the flow of time in code and use the keyword now as a time-aware control construct, and gives programmers the ability to use the timing mechanism to realize sample-accurate concurrent programming. Several case studies are presented that illustrate the workings, properties, and personality of the language. We also discuss applications of ChucK in laptop orchestras, computer music pedagogy, and mobile music instruments. Properties and affordances of the language and its future directions are outlined. What Is ChucK? form the notion of a strongly timed computer music programming language. ChucK (Wang 2008) is a computer music program- ming language. First released in 2003, it is designed to support a wide array of real-time and interactive Two Observations about Audio Programming tasks such as sound synthesis, physical modeling, gesture mapping, algorithmic composition, sonifi- Time is intimately connected with sound and is cation, audio analysis, and live performance.
    [Show full text]
  • Confessions-Of-A-Live-Coder.Pdf
    Proceedings of the International Computer Music Conference 2011, University of Huddersfield, UK, 31 July - 5 August 2011 CONFESSIONS OF A LIVE CODER Thor Magnusson ixi audio & Faculty of Arts and Media University of Brighton Grand Parade, BN2 0JY, UK ABSTRACT upon writing music with programming languages for very specific reasons and those are rarely comparable. This paper describes the process involved when a live At ICMC 2007, in Copenhagen, I met Andrew coder decides to learn a new musical programming Sorensen, the author of Impromptu and member of the language of another paradigm. The paper introduces the aa-cell ensemble that performed at the conference. We problems of running comparative experiments, or user discussed how one would explore and analyse the studies, within the field of live coding. It suggests that process of learning a new programming environment an autoethnographic account of the process can be for music. One of the prominent questions here is how a helpful for understanding the technological conditioning functional programming language like Impromptu of contemporary musical tools. The author is conducting would influence the thinking of a computer musician a larger research project on this theme: the part with background in an object orientated programming presented in this paper describes the adoption of a new language, such as SuperCollider? Being an avid user of musical programming environment, Impromptu [35], SuperCollider, I was intrigued by the perplexing code and how this affects the author’s musical practice. structure and work patterns demonstrated in the aa-cell performances using Impromptu [36]. I subsequently 1. INTRODUCTION decided to embark upon studying this environment and perform a reflexive study of the process.
    [Show full text]
  • Estuary: Browser-Based Collaborative Projectional Live Coding of Musical Patterns
    Estuary: Browser-based Collaborative Projectional Live Coding of Musical Patterns David Ogborn Jamie Beverley Luis Navarro del Angel McMaster University McMaster University McMaster University [email protected] [email protected] [email protected] Eldad Tsabary Alex McLean Concordia University Deutsches Museum [email protected] [email protected] ABSTRACT This paper describes the initial design and development of Estuary, a browser-based collaborative projectional editing environment built on top of the popular TidalCycles language for the live coding of musical pattern. Key features of Estuary include a strict form of structure editing (making syntactical errors impossible), a click-only border-free approach to interface design, explicit notations to modulate the liveness of different parts of the code, and a server-based network collaboration system that can be used for many simultaneous collaborative live coding performances, as well as to present different views of the same live coding activity. Estuary has been developed using Reflex-DOM, a Haskell-based framework for web development whose strictness promises robustness and security advantages. 1 Goals 1.1 Projectional Editing and Live Coding The interface of the text editor is focused on alphabetic characters rather than on larger tokens that directly represent structures specific to a certain way of notating algorithms. Programmers using text editors, including live coding artists using text-based programming languages as their media, then have to devote cognitive resources to dealing with various kinds of mistakes and delays, including but not limited to accidentally typing the wrong character, not recalling the name of an entity, attempting to use a construct from one language in another, and misrecognition of “where one is” in the hierarchy of structures, among many other possible challenges.
    [Show full text]
  • Live Coding Practice
    Proceedings of the 2007 Conference on New Interfaces for Musical Expression (NIME07), New York, NY, USA Live Coding Practice Click Nilson University of Sussex Department of Informatics Falmer, Brighton, BN1 9QH +44 (0)1273 877837 [email protected] ABSTRACT I wish to discuss the practice of live coding, not only as an area of investigation and activity, but also in the sense of Live coding is almost the antithesis of immediate physical actually practising to improve ability. I shall describe the musicianship, and yet, has attracted the attentions of a number results of a month long experiment where live coding was of computer-literate musicians, as well as the music-savvy undertaken every day in an attempt to cast live coding as akin programmers that might be more expected. It is within the to more familiar forms of musical practice. context of live coding that I seek to explore the question of practising a contemporary digital musical instrument, which is Exercises will be discussed that may be found efficacious to often raised as an aside but more rarely carried out in research improve live coding abilities. In relation to these, literature (though see [12]). At what stage of expertise are the members from developmental and educational psychology (both of of the live coding movement, and what practice regimes might music and computing), and theories of expertise and skill help them to find their true potential? acquisition, were consulted. The possibility of expert performance [7] in live coding is discussed. Keywords I should state at the outset that I will be focusing primarily on Practice, practising, live coding one particular form of live coding in this paper, that of programming a computer on a concert platform as a performance act, often as an unaccompanied soloist.
    [Show full text]
  • Virtual Agents in Live Coding: a Short Review
    FINAL DRAFT – Submitted to eContact! (https://econtact.ca) Special issue: 21.1 — Take Back the Stage: Live coding, live audiovisual, laptop orchestra… Virtual Agents in Live Coding: A Short Review ...................................................................................... 2 Introduction ................................................................................................................................................................. 2 Conceptual Foundations .......................................................................................................................................... 3 Broader Context ............................................................................................................................................................................ 3 Virtuality, Agency, and Virtual Agency ............................................................................................................................... 4 Machine Musicianship, Musical Metacreation, and Musical Cyborgs .................................................................... 5 Theoretical Frameworks ........................................................................................................................................................... 6 Examples in Practice ................................................................................................................................................. 7 Betablocker ....................................................................................................................................................................................
    [Show full text]
  • Quaverseries: a Live Coding Environment for Music Performance Using Web Technologies
    QuaverSeries: A Live Coding Environment for Music Performance Using Web Technologies Qichao Lan Alexander Refsum Jensenius RITMO RITMO Department of Musicology Department of Musicology University of Oslo University of Oslo [email protected] [email protected] ABSTRACT live coding languages is mainly borrowed from other pro- QuaverSeries consists of a domain-specific language and a gramming languages. For example, the use of parentheses single-page web application for collaborative live coding in is ubiquitous in programming languages, and it is adopted music performances. Its domain-specific language borrows in almost every live coding language. That is the case even principles from both programming and digital interface de- though live coding without the parentheses is (more) read- sign in its syntax rules, and hence adopts the paradigm able for humans [12]. of functional programming. The collaborative environment Inheriting standard programming syntax may create dif- features the concept of `virtual rooms', in which performers ficulties for non-programmers who want to get started with can collaborate from different locations, and the audience live coding. We have therefore been exploring how it is pos- can watch the collaboration at the same time. Not only is sible to design a live coding syntax based on the design prin- the code synchronised among all the performers and online ciples of digital musical interface design. This includes ele- audience connected to the server, but the code executing ments such as audio effect chains, sequencers, patches, and command is also broadcast. This communication strategy, so on. The aim has been to only create a rule by 1) bor- achieved by the integration of the language design and the rowing from digital musicians' familiarity with the digital environment design, provides a new form of interaction for interfaces mentioned above, or 2) reusing the syntax from web-based live coding performances.
    [Show full text]
  • Organised Sound Live Coding in Laptop Performance
    Organised Sound http://journals.cambridge.org/OSO Additional services for Organised Sound: Email alerts: Click here Subscriptions: Click here Commercial reprints: Click here Terms of use : Click here Live coding in laptop performance NICK COLLINS, ALEX McLEAN, JULIAN ROHRHUBER and ADRIAN WARD Organised Sound / Volume 8 / Issue 03 / December 2003, pp 321 ­ 330 DOI: 10.1017/S135577180300030X, Published online: 21 April 2004 Link to this article: http://journals.cambridge.org/abstract_S135577180300030X How to cite this article: NICK COLLINS, ALEX McLEAN, JULIAN ROHRHUBER and ADRIAN WARD (2003). Live coding in laptop performance. Organised Sound, 8, pp 321­330 doi:10.1017/S135577180300030X Request Permissions : Click here Downloaded from http://journals.cambridge.org/OSO, IP address: 139.184.30.132 on 14 May 2013 Live coding in laptop performance NICK COLLINS,1 ALEX McLEAN, JULIAN ROHRHUBER and ADRIAN WARD 1St. John’s College, Cambridge, CB2 1TP E-mail: [email protected], [email protected], [email protected], [email protected] URL: http://www.sicklincoln.org, http://www.slab.org, http://swiki.hfbk-hamburg.de:8888/MusicTechnology/6, http://www.slub.org Seeking new forms of expression in computer music, a small code and run aesthetic. We do not formally set out in number of laptop composers are braving the challenges of this article the choice between scripting languages like coding music on the fly. Not content to submit meekly to the Perl, Ruby or SuperCollider, believing that decision to rigid interfaces of performance software like Ableton Live or be a matter for the individual composer/programmer. Reason, they work with programming languages, building Yet there is undoubtedly a sense in which the language their own custom software, tweaking or writing the programs can influence one’s frame of mind, though we do not themselves as they perform.
    [Show full text]
  • Supercopair: Collaborative Live Coding on Supercollider Through the Cloud
    SuperCopair: Collaborative Live Coding on SuperCollider through the cloud Antonio Deusany de Carvalho Junior Sang Won Lee Georg Essl Universidade de São Paulo University of Michigan University of Michigan [email protected] [email protected] [email protected] ABSTRACT In this work we present the SuperCopair package, which is a new way to integrate cloud computing into a collaborative live coding scenario with minimum efforts in the setup. is package, created in Coffee Script for Atom.io, is developed to interact with SuperCollider and provide opportunities for the crowd of online live coders to collaborate remotely on distributed performances. Additionally, the package provides the advantages of cloud services offered by Pusher. Users can share code and evaluate lines or selected portions of code on computers connected to the same session, either at the same place and/or remotely. e package can be used for remote performances or rehearsal purposes with just an Internet connection to share code and sounds. In addition, users can take advantage of code sharing to teach SuperCollider online or fix bugs in the algorithm. 1. Introduction Playing in a live coding ensemble oen invites the utilization of network capability. Exchanging data over the network facilitates collaboration by supporting communication, code sharing, and clock synchronization among musicians. ese kinds of functions require live coding musicians to develop additional extensions to their live coding environments. Due to the diversity of the live coding environment and the collaboration strategies seled for performances, implementing such a function has been tailored to meet some ensemble’s requirements. In addition, networking among machines oen requires additional configuration and setup, for example, connecting to specific machines using an IP address.
    [Show full text]
  • Deadmau5, Derek Bailey, and the Laptop Instrument – Improvisation, Composition, and Liveness in Live Coding
    Deadmau5, Derek Bailey, and the Laptop Instrument – Improvisation, Composition, and Liveness in Live Coding Adam Parkinson Renick Bell EAVI, Goldsmiths Tama Art University [email protected] [email protected] ABSTRACT Dance music superstar Deadmau5 and the improvising guitarist Derek Bailey represent, through their writing and prac- tice, two very different approaches to performing live. By critically considering the practice of live coding in relation to these divergent approaches, we discuss live coding with regards to where the liveness lies and how the laptop and soware are treated as a musical instrument. Each practice uses the laptop as a musical tool in a very different way. Live coding uses the laptop as an instrument in a manner that draws upon the techniques and strategies of free improvisation, in contrast to Deadmau5’s notion of laptop as playback device and the live performance as spectacle. We discuss Dead- mau5’s practice in relation to Francisco Lopez’s notion of the possibilities of electronic performance, and ideas about labour and liveness. 1. Introduction In this paper, we will explore the practice of live coding in relation to two very different but related practices: the performance practice of dance music “superstar” Deadmaus, and the “non-idiomatic” free improvisation discussed in particular by British guitarist Derek Bailey in his book Improvisation: its Nature and Practice in Music (Bailey 1993). For the former, the “live” show is a synaesthetic, perfectly coordinated, precisely pre-planned immersive audio-visual experience in which the performer simply presses “play”, whereas for the laer, the “live” show is continually composed in real-time.
    [Show full text]
  • Herding Cats: Observing Live Coding in the Wild
    Herding cats: observing live coding in the wild Article (Published Version) Magnusson, Thor (2014) Herding cats: observing live coding in the wild. Computer Music Journal, 38 (1). pp. 8-16. ISSN 0148-9267 This version is available from Sussex Research Online: http://sro.sussex.ac.uk/id/eprint/47039/ This document is made available in accordance with publisher policies and may differ from the published version or from the version of record. If you wish to cite this item you are advised to consult the publisher’s version. Please see the URL above for details on accessing the published version. Copyright and reuse: Sussex Research Online is a digital repository of the research output of the University. Copyright and all moral rights to the version of the paper presented here belong to the individual author(s) and/or other copyright owners. To the extent reasonable and practicable, the material made available in SRO has been checked for eligibility before being made available. Copies of full text items generally can be reproduced, displayed or performed and given to third parties in any format or medium for personal research or study, educational, or not-for-profit purposes without prior permission or charge, provided that the authors, title and full bibliographic details are credited, a hyperlink and/or URL is given for the original metadata page and the content is not changed in any way. http://sro.sussex.ac.uk Thor Magnusson Herding Cats: Observing Department of Music University of Sussex Falmer, Brighton, BN1 9QJ, UK Live Coding in the Wild [email protected] Abstract: After an eventful decade of live-coding activities, this article seeks to explore the practice with the aim of situating it in the history of contemporary arts and music.
    [Show full text]
  • Reflections on Live Coding Collaboration
    Reflections on Live Coding Collaboration xCoAx 2015 Alex McLean Computation ICSRiM, School of Music, University of Leeds, UK Communication [email protected] Aesthetics and X Keywords: live coding, algorave, jazz improv, collaboration Glasgow Scotland 2015.xCoAx.org Reflections on a number of live coding collaborations with impro- visors, choreographers and performance artists, drawing from informal discussion and audience feedback. 214 1 Introduction Through my practice as a live coder of music, I have enjoyed var- ied collaborations with percussionists, live artists, performance artists, dancers and choreographers, as well as other live coders. In the following short paper I will reflect on a number of these collaborations, including with/within algorave, live Jazz improv, performance art and choreography practice. Some focus will be on the role of time and language, as core themes in live coding, but I will also consider wider cultural issues, and of the role of col- laboration in making live coding meaningful. I conclude by con- sidering how technology could better support close collaboration in the future. Throughout, informal reports by collaborators and audience members are drawn from, as well as reflections as a live coding performer. 2 Making collaboration visible: Inter- and intra-technology When performing with technology on stage, there can be a linger- ing feeling that some aspect of the performance is invisible. Slub have projected screens since inception in the year 2000 (Collins et al. 2003), a habit which has been taken up by the live coding community at large (Ward et al. 2004). Slub consists of Adrian Ward, Dave Griffiths and myself in various combinations (Fig.
    [Show full text]