DOCSLIB.ORG

Jythonmusic: an Environment for Developing Interactive Music Systems

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Jythonmusic: an Environment for Developing Interactive Music Systems JythonMusic: An Environment for Developing Interactive Music Systems Bill Manaris, Pangur Brougham- Dana Hughes Andrew R. Brown Cook Computer Science Dept. Queensland Conservatorium Computer ScienceNIME Dept. Proceedings University of Colorado, Template Boulder, USA for LaTeXGriffith University, Australia College of Charleston, USA [email protected] [email protected] [email protected], [email protected] Ben Trovato⇤ G.K.M. Tobin† Lars Thørväld‡ ABSTRACT wheel, etc.), controller type (e.g., mobile phone, motion Institute for Clarity in Institute for Claritysensor, in glove, joystick,The digital Thørväld controller, Group glass sensor, etc.), and JythonMusic is a softwareDocumentation environment for developing interactiveDocumentation 1 Thørväld Circle musical experiences1932 and Wallamaloo systems. It Lane is based on jMusic, a softwareP.O. Box 1212computer software usedHekla,. [3]. Iceland environmentWallamaloo, for computer-assisted New Zealandcomposition, whichDublin, was extended Ohio 43017-6221 Several audio librarieslarst@affiliation.org and software packages for musical within the [email protected] decade into a more comprehensivewebmaster@marysville- framework programming have been developed over the last two decades. providing composers and software developers with librariesohio.com for In addition to manipulating audio, many focus on other music making, image manipulation, building graphical user characteristics such as live coding, sample-level manipulation, interfaces, andLawrence interacting with P. Leipunerexternal devices via MIDI andSean OSC Fogarty, or minimal programmingAnon requirements. Nymous Well-established Brookhaven Laboratories NASA Ames Researchpackages Center include ChucK [Redacted6], SuperCollider [7], Pure Data [8], among others.Brookhaven This environment National is freeLab and open source. It isMoffett based Field 8600 Datapoint Drive on Python, therefore it provides more economical syntax relative to Csound [9], Minim [10], and Gibber [11]. P.O. Box 5000 California 94035 Most of the aboveSan packages Antonio, assume Texas 78229programs are generated Java- and C/[email protected] languages. JythonMusic rests [email protected] top of Java, [email protected] so it provides access to the complete Java API and external Java- or executed in a console, and are not focused on simplifying based libraries as needed. Also, it works seamlessly with other GUI development in addition to generating audio. Instead, GUI ABSTRACTsoftware, such as PureData, Max/MSP, and Processing. The paper Pleasedevelopment read theeither comments relies on in thepackages nime-template.tex available in the fileunderlying to see how language to create (e.g., the Java CCS Swing), Concept or a Classifi-separate GUI Thisprovides paper an providesoverview aof sampleimportant of JythonMusic a LATEX document libraries forrelate thed to NIMEconstructing conference interactive series. musical It conforms, experiences. somewhat It demonstrates loosely, totheir cations!development environment (e.g., Qt GUI used by SuperCollider, thescope formatting and utility guidelines by summarizing for ACM several SIG Proceedings.projects developed It is anusing Tcl/Tk used by Pure Data). These may require learning alternateJythonMusicstyle, including which produces interactive a tighter-lookingsound art installations,paper and new 1.relatively INTRODUCTION very complex APIs that expose needless low-level wasinterfaces designed for insound response manipulation to concerns and expressed,spatialization, by authors,as well as Thecomponentsproceedings toare the the musician records of(e.g., a conference. the Java ACMSwing seeks package overvarious page-budgets. explorations on It mapping complements among themotion, document gesture Author’sand music. to givecontains these well conference over 100 by-products classes, including a uniform, managers, high-quality events, (Alternate) Guide to Preparing ACM SIG Proceedings Us- appearance.listeners, Toetc.), do this,or ACMpossibl hasy someentirely rigid requirementsnew languages. ing LATEX2✏ and BibTEX. This source file has been written forAlternatively, the format ofusers the proceedingsmay utilize documents:existing front there ends. is a For Author Keywords A with the intention of being compiled under LTEX2✏ and specifiedinstance, format several (balanced front ends double have columns), been developed a specified for setChucK Music and interaction, user interfaces, interactive sound art and BibTeX. ofsince fonts its (Arial inception, or Helvetica specifically and TimesAudicle Roman) [12] and in miniAudicle certain installationsTo make, best musical use mapping, of this sample Python, document, software libraries run it through specified[13, 14 sizes]. While (for these instance, provide 9 point a more for streamline body copy).d interface, and LA TEX and BibTeX, and compare this source code with your Theuseful good visualizations, news is, with they only still arely handful heavily of on manual an embedded set- compiled PDF file. A compiled PDF version is available to 1 CCS Concepts tings,consolethe for LAT realEX- documenttime coding, class and file do handlesnot provide all ofa robust this for set of help• Applied you withcomputing the ‘look → Sound and feel.’and musicThe computing paper submit-; • Human- you.widgets for building GUI-based musical instruments. Third- tedcentered to the computing NIME → conference Interaction design must; • be Information stored in systems an Theparty remainder GUI libraries of this are document available isfor concerned some environments with show- (e.g., A4-sized PDF file, so North Americans should take → Open source software; ing,for in Processing, the context ofused an “actual”by Minim), document, though thethese LAT EhaveXcom- varying care not to inadvertently generate letter paper-sized mands specifically available for denoting the structure of a PDF files. This paper template should prevent that from levels of complexity and maintenance. proceedings Finally, paper,modern rather web browsers than with allow giving building rigorous cross descrip--platform happening if the pdflatex program is used to generate the tions or explanations of such commands. PDF1. INTRODUCTION file. musical interfaces using web technologies (HTML5, JavaScript, CSS, etc.), while leveraging the inherent layout and InteractiveThe abstract computer should music preferably systems be betweenemerged 100in the and last 200 40 2.networking THE BODY capabilitiesOF THEof the browser. PAPER NexusUI provides an words.years with the development of increasingly more powerful and API for UI widget and sending OSC messages via UDP, as well versatile I/O devices and software frameworks for interaction. Typically, the body of a paper is organized into a hierar- chicalas builders structure, for converting with numbered a Max/MSP or unnumbered patch and drag headings-and-drop These advances in technology, as is usually the case through Author Keywords forinterfaces sections, subsections,[15]. Similarly, sub-subsections, a simple browser and even-based smaller API for history, have been exploited in music to develop new and NIME, proceedings, LATEX, template sections.creating The and commandstoring interfaces\section for thatthe Gibberish.js precedes this audio para- library innovative computer-based and electroacoustic music systems, 2 graphis presented is part of insuch [16].a hierarchy. LATEX handles the num- compositions, and interactive experiences [1]. bering This and paper placement present ofs JythonMusic these headings (http://jythonmusic.org for you, when you ), a CCS Rowe Concepts defines interactive computer music systems as music usesoftware the appropriate framework heading for commandsdeveloping around interactive the titles musical of systems that respond to human input, which gives them the Applied computing Sound and music comput- theexperiences. headings. IfJythonMusic you want a is sub-subsection an open-source or environme smaller partnt with •ability to participate in live! performances [2]. ing; Performing arts; Information systems Music toan be extensive unnumbered online in yourAPI reference. output, simply It has appendbeen used an aster-to develop retrieval; Paine [3] extends this •to create a more thorough taxonomy! of isk to the command name. Examples of both numbered and various interactive sound art and installations, among other systems for interactive musical performance, or digital musical unnumbered headings will appear throughout the balance projects, which explore various mapping strategies, and explore iDr.nterfaces Trovato (DMI) insisted. H hise takes name into be first.account existing musical of this sample document. ⇤ relationships among motion, gesture and music.1 †instrumentThe secretary taxonomies disavows, such any knowledgeas the Hornbostel of this author’sand Sachs ac- [4] Because the entire article is contained in the document tions.instrument taxonomy, consisting of aerophones, chordophones, environment,2. JythonMusic you can indicate the start of a new paragraph This author is the one who did all the really hard work. with a blank line in your input file; that is why this sentence ‡idiophones, membranophones, and electrophones. He then JythonMusic is based on Python. It was originally developed forms a separate paragraph. superimposes the dimensions specified by Birnbaum, et al. [5]. for teaching computer programming in a musical context [17], Finally, Paine introduces additional dimensions to form a 1Two
Load more

Recommended publications
  • Synchronous Programming in Audio Processing Karim Barkati, Pierre Jouvelot
    Synchronous programming in audio processing Karim Barkati, Pierre Jouvelot To cite this version: Karim Barkati, Pierre Jouvelot. Synchronous programming in audio processing. ACM Computing Surveys, Association for Computing Machinery, 2013, 46 (2), pp.24. 10.1145/2543581.2543591. hal- 01540047 HAL Id: hal-01540047 https://hal-mines-paristech.archives-ouvertes.fr/hal-01540047 Submitted on 15 Jun 2017 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. A Synchronous Programming in Audio Processing: A Lookup Table Oscillator Case Study KARIM BARKATI and PIERRE JOUVELOT, CRI, Mathématiques et systèmes, MINES ParisTech, France The adequacy of a programming language to a given software project or application domain is often con- sidered a key factor of success in software development and engineering, even though little theoretical or practical information is readily available to help make an informed decision. In this paper, we address a particular version of this issue by comparing the adequacy of general-purpose synchronous programming languages to more domain-specific
    [Show full text]
  • Chuck: a Strongly Timed Computer Music Language
    Ge Wang,∗ Perry R. Cook,† ChucK: A Strongly Timed and Spencer Salazar∗ ∗Center for Computer Research in Music Computer Music Language and Acoustics (CCRMA) Stanford University 660 Lomita Drive, Stanford, California 94306, USA {ge, spencer}@ccrma.stanford.edu †Department of Computer Science Princeton University 35 Olden Street, Princeton, New Jersey 08540, USA [email protected] Abstract: ChucK is a programming language designed for computer music. It aims to be expressive and straightforward to read and write with respect to time and concurrency, and to provide a platform for precise audio synthesis and analysis and for rapid experimentation in computer music. In particular, ChucK defines the notion of a strongly timed audio programming language, comprising a versatile time-based programming model that allows programmers to flexibly and precisely control the flow of time in code and use the keyword now as a time-aware control construct, and gives programmers the ability to use the timing mechanism to realize sample-accurate concurrent programming. Several case studies are presented that illustrate the workings, properties, and personality of the language. We also discuss applications of ChucK in laptop orchestras, computer music pedagogy, and mobile music instruments. Properties and affordances of the language and its future directions are outlined. What Is ChucK? form the notion of a strongly timed computer music programming language. ChucK (Wang 2008) is a computer music program- ming language. First released in 2003, it is designed to support a wide array of real-time and interactive Two Observations about Audio Programming tasks such as sound synthesis, physical modeling, gesture mapping, algorithmic composition, sonifi- Time is intimately connected with sound and is cation, audio analysis, and live performance.
    [Show full text]
  • Audio Visual Instrument in Puredata
    Francesco Redente Production Analysis for Advanced Audio Project Option - B Student Details: Francesco Redente 17524 ABHE0515 Submission Code: PAB BA/BSc (Hons) Audio Production Date of submission: 28/08/2015 Module Lecturers: Jon Pigrem and Andy Farnell word count: 3395 1 Declaration I hereby declare that I wrote this written assignment / essay / dissertation on my own and without the use of any other than the cited sources and tools and all explanations that I copied directly or in their sense are marked as such, as well as that the dissertation has not yet been handed in neither in this nor in equal form at any other official commission. II2 Table of Content Introduction ..........................................................................................4 Concepts and ideas for GSO ........................................................... 5 Methodology ....................................................................................... 6 Research ............................................................................................ 7 Programming Implementation ............................................................. 8 GSO functionalities .............................................................................. 9 Conclusions .......................................................................................13 Bibliography .......................................................................................15 III3 Introduction The aim of this paper will be to present the reader with a descriptive analysis
    [Show full text]
  • Pdates Actuator’S Outputs
    M2 ATIAM – IM Graphical reactive programming Esterel, SCADE, Pure Data Philippe Esling [email protected] 1 M2 STL – PPC – UPMC First thing’s first Today we will see reactive programming languages • Theory • ESTEREL • SCADE • Pure Data However our goal is to see how to apply this to musical data (audio) and real-time constraints Hence all exercises are done with Pure Data • Pure data is open source, free and cross-platform • Works as Max/Msp (have almost all same features) • Can easily be embedded on UDOO cards (special distribution) So go now to download it and install it right away https://puredata.info/downloads/pure-data 2 M2 STL – PPC – UPMC Reactive programming: Basic notions Goals and aims Here we aim towards creating critical, reactive, embedded software. 3 M2 STL – PPC – UPMC Reactive programming: Basic notions Goals and aims Here we aim towards creating critical, reactive, embedded software. The mandatory notions that we should get first are • Embedded • Critical • Safety • Reactive • Determinism 4 M2 STL – PPC – UPMC Reactive programming: Basic notions Goals and aims Here we aim towards creating critical, reactive, embedded software. The mandatory notions that we should get first are ? • Embedded • Critical • Safety • Reactive • Determinism 5 M2 STL – PPC – UPMC Reactive programming: Basic notions Goals and aims Here we aim towards creating critical, reactive, embedded software. The mandatory notions that we should get first are • Embedded An embedded system is a computer • Critical system with a dedicated function • Safety within a larger mechanical or • Reactive electrical system, often with real- • Determinism time computing constraints. 6 M2 STL – PPC – UPMC Reactive programming: Basic notions Goals and aims Here we aim towards creating critical, reactive, embedded software.
    [Show full text]
  • Kronos Reimagining Musical Signal Processing
    Kronos Reimagining Musical Signal Processing Vesa Norilo March 14, 2016 PREFACE First of all, I wish to thank my supervisors; Dr. Kalev Tiits, Dr. Marcus Castrén and Dr. Lauri Savioja,thanks for guidanceand acknowledgements and some necessary goading. Secondly; this project would never have materialized without the benign influence of Dr Mikael Laurson and Dr Mika Kuuskankare. I learned most of my research skills working as a research assistant in the PWGL project, which I had the good fortune to join at a relatively early age. Very few get such a head start. Most importantly I want to thank my family, Lotta and Roi, for their love, support and patience. Many thanks to Roi’s grandparents as well, who have made it possible for us to juggle an improb- able set of props: freelance musician careers, album productions, trips around the world, raising a baby and a couple of theses on the side. This thesis is typeset in LATEX with the Ars Classica stylesheet generously shared by Lorenzo Pantieri. This report is a part of the portfolio required for the Applied Studies Program for the degree of Doctorthe applied of Music. It studies consists of an program introductory portfolio essay, supporting appendices and six internationally peer reviewed articles. The portfolio comprises of this report and a software package, Kronos. Kronos is a programming language development environment designed for musical signal processing. The contributions of the package include the specification and implementation of a compiler for this language. Kronos is intended for musicians and music technologists. It aims to facilitate creation of sig- nal processors and digital instruments for use in the musical context.
    [Show full text]
  • Table of Contents Pure Data
    Table of Contents Pure Data............................................................................................................................................................1 Real Time Graphical Programming..................................................................................................................2 Graphical Programming...........................................................................................................................2 Real Time.................................................................................................................................................3 What is digital audio? ........................................................................................................................................4 Frequency and Gain.................................................................................................................................4 Sampling Rate and Bit Depth..................................................................................................................4 Speed and Pitch Control..........................................................................................................................5 Volume Control, Mixing and Clipping....................................................................................................6 The Nyquist Number and Foldover/Aliasing...........................................................................................6 DC Offset.................................................................................................................................................7
    [Show full text]
  • A Comparison of Solenoid-Based Strategies for Robotic Drumming
    A COMPARISON OF SOLENOID-BASED STRATEGIES FOR ROBOTIC DRUMMING Ajay Kapur 1,2,3 Trimpin Eric Singer2 Afzal Suleman1 George Tzanetakis1 Music Intelligence and Sound Technology Interdisciplinary Centre (MISTIC) 1 University of Victoria, Victoria, British Columbia, Canada League of Electronic Urban Music Robots (LEMUR) 2 Brooklyn, New York, USA KarmetiK Technology (A Division of KarmetiK LLC) 3 Reno, Nevada, USA ABSTRACT drums gives the students a more realistic paradigm for concentrated rehearsal. Solenoids are important components of robotic A number of different drumming robots have been drumming systems and several designs have been designed in the academic and artistic communities. proposed. In this paper, we compare different designs Researchers at Harvard University struggled to create an in terms of speed and dynamic range and discuss the accurate robotic drum roll [1], while next door tradeoffs involved. The evaluation is performed in the researchers at MIT developed Cog to control the context of MahaDeviBot, a custom built 12-armed MIDI number of times a stick can bounce [2]. Gil Weinberg controlled mechanical device that performs a variety of developed Haile to explore human to robot interaction Indian folk instruments, including frame-drums, bells, [3]. Mitsuo Kawato continues to develop hydraulic and shakers. To measure speed and dynamic range a systems for humanoid drumming [4]. Many artists have haptic robotic feedback system using piezo sensors was presented a number of different pieces including built. The evaluation methods presented are modular Baginsky’s “Thelxiapeia” for modified rototom [5], and can be administered to any hyperinstrument, new MacMurtie’s life size sculptures [6], Gordon Monohans interface or robotic system to inform composers about “Machine Matrix” [7], and Miles van Dorssen’s “Cell the strengths and limitation of different designs to guide Project” including an 8 octave Xylophone, Bamboo composition and performance.
    [Show full text]
  • Distributed Musical Decision-Making in an Ensemble of Musebots: Dramatic Changes and Endings
    Distributed Musical Decision-making in an Ensemble of Musebots: Dramatic Changes and Endings Arne Eigenfeldt Oliver Bown Andrew R. Brown Toby Gifford School for the Art and Design Queensland Sensilab Contemporary Arts University of College of Art Monash University Simon Fraser University New South Wales Griffith University Melbourne, Australia Vancouver, Canada Sydney, Australia Brisbane, Australia [email protected] [email protected] [email protected] [email protected] Abstract tion, while still allowing each musebot to employ different A musebot is defined as a piece of software that auton- algorithmic strategies. omously creates music and collaborates in real time This paper presents our initial research examining the with other musebots. The specification was released affordances of a multi-agent decision-making process, de- early in 2015, and several developers have contributed veloped in a collaboration between four coder-artists. The musebots to ensembles that have been presented in authors set out to explore strategies by which the musebot North America, Australia, and Europe. This paper de- ensemble could collectively make decisions about dramatic scribes a recent code jam between the authors that re- structure of the music, including planning of more or less sulted in four musebots co-creating a musical structure major changes, the biggest of which being when to end. that included negotiated dynamic changes and a negoti- This is in the context of an initial strategy to work with a ated ending. Outcomes reported here include a demon- stration of the protocol’s effectiveness across different distributed decision-making process where each author's programming environments, the establishment of a par- musebot agent makes music, and also contributes to the simonious set of parameters for effective musical inter- decision-making process.
    [Show full text]
  • Boston Symphony Orchestra Concert Programs, Summer, 1990
    FESTIVAL OF CONTE AUGUST 4th - 9th 1990 j:*sT?\€^ S& EDITION PETERS -&B) t*v^v- iT^^ RECENT ADDITIONS TO OUR CONTEMPORARY MUSIC CATALOGUE P66438a John Becker Concerto for Violin and Orchestra. $20.00 Violin and Piano (Edited by Gregory Fulkerson) P67233 Martin Boykan String Quartet no. 3 $40.00 (Score and Parts) (1988 Walter Hinrichsen Award) P66832 George Crumb Apparition $20.00 Elegiac Songs and Vocalises for Soprano and Amplified Piano P67261 Roger Reynolds Whispers Out of Time $35.00 String Orchestra (Score)* (1989 Pulitzer Prize) P67283 Bruce J. Taub Of the Wing of Madness $30.00 Chamber Orchestra (Score)* P67273 Chinary Ung Spiral $15.00 Vc, Pf and Perc (Score) (1989 Grawemeyer and Friedheim Award) P66532 Charles Wuorinen The Blue Bamboula $15.00 Piano Solo * Performance materials availablefrom our rental department C.F. PETERS CORPORATION ^373 Park Avenue So./New York, NY 10016/Phone (212) 686-4l47/Fax (212) 689-9412 1990 FESTIVAL OF CONTEMPORARY MUSIC Oliver Knussen, Festival Coordinator by the sponsored TanglewGDd TANGLEWOOD MUSIC CENTER Music Leon Fleisher, Artistic Director Center Gilbert Kalish, Chairman of the Faculty Lukas Foss, Composer-in-Residence Oliver Knussen, Coordinator of Contemporary Music Activities Bradley Lubman, Assistant to Oliver Knussen Richard Ortner, Administrator Barbara Logue, Assistant to Richard Ortner James E. Whitaker, Chief Coordinator Carol Wood worth, Secretary to the Faculty Harry Shapiro, Orchestra Manager Works presented at this year's Festival were prepared under the guidance of the following Tanglewood Music Center Faculty: Frank Epstein Donald MacCourt Norman Fischer John Oliver Gilbert Kalish Peter Serkin Oliver Knussen Joel Smirnoff loel Krosnick Yehudi Wyner 1990 Visiting Composer/Teachers Elliott Carter John Harbison Tod Machover Donald Martino George Perle Steven Stucky The 1990 Festival of Contemporary Music is supported by a gift from Dr.
    [Show full text]
  • Procedural Sequencing 1 Göran Sandström
    Procedural Sequencing 1 Göran Sandström Bachelor Thesis Spring 2013 School of Health and Society Department Design and Computer Science Procedural Sequencing A New Form of Procedural Music Creation Author: Göran Sandström Instructor: Anders-Petter Andersson Examiner: Daniel Einarsson Procedural Sequencing 2 Göran Sandström School of Health and Society Department Design and Computer Science Kristianstad University SE-291 88 Kristianstad Sweden Author, Program and Year: Göran Sandström, Interactive Sound Design, 2010 Instructor: Anders-Petter Andersson, PhD. Sc., HKr Examination: This graduation work on 15 higher education credits is a part of the requirements for a Degree of Bachelor in Computer Science Title: Procedural Sequencing Language: English Approved By: _________________________________ Daniel Einarsson Date Examiner Procedural Sequencing 3 Göran Sandström Table of Contents List of Abbreviations and Acronyms............................................................................4 List of Figures...............................................................................................................4 Abstract.........................................................................................................................5 1. Introduction.............................................................................................6 1.1 Aim and Purpose.....................................................................................................6 1.2 Method....................................................................................................................6
    [Show full text]
  • Philharmonia Baroque Orchestra Sunday / July 18 / 4:00Pm / Venetian Theater
    SUMMER 2 0 2 1 Contents 2 Welcome to Caramoor / Letter from the CEO and Chairman 3 Summer 2021 Calendar 8 Eat, Drink, & Listen! 9 Playing to Caramoor’s Strengths by Kathy Schuman 12 Meet Caramoor’s new CEO, Edward J. Lewis III 14 Introducing in“C”, Trimpin’s new sound art sculpture 17 Updating the Rosen House for the 2021 Season by Roanne Wilcox PROGRAM PAGES 20 Highlights from Our Recent Special Events 22 Become a Member 24 Thank You to Our Donors 32 Thank You to Our Volunteers 33 Caramoor Leadership 34 Caramoor Staff Cover Photo: Gabe Palacio ©2021 Caramoor Center for Music & the Arts General Information 914.232.5035 149 Girdle Ridge Road Box Office 914.232.1252 PO Box 816 caramoor.org Katonah, NY 10536 Program Magazine Staff Caramoor Grounds & Performance Photos Laura Schiller, Publications Editor Gabe Palacio Photography, Katonah, NY Adam Neumann, aanstudio.com, Design gabepalacio.com Tahra Delfin,Vice President & Chief Marketing Officer Brittany Laughlin, Director of Marketing & Communications Roslyn Wertheimer, Marketing Manager Sean Jones, Marketing Coordinator Caramoor / 1 Dear Friends, It is with great joy and excitement that we welcome you back to Caramoor for our Summer 2021 season. We are so grateful that you have chosen to join us for the return of live concerts as we reopen our Venetian Theater and beautiful grounds to the public. We are thrilled to present a full summer of 35 live in-person performances – seven weeks of the ‘official’ season followed by two post-season concert series. This season we are proud to showcase our commitment to adventurous programming, including two Caramoor-commissioned world premieres, three U.S.
    [Show full text]
  • Chunity: Integrated Audiovisual Programming in Unity
    Chunity: Integrated Audiovisual Programming in Unity Jack Atherton Ge Wang CCRMA, Stanford University CCRMA, Stanford University Stanford, CA, United States Stanford, CA, United States [email protected] [email protected] Figure 1: Chunity is a programming environment for the creation of interactive audiovisual software. It combines the strongly-timed audio synthesis of the ChucK language with the high-performance graphics of the Unity game engine. ABSTRACT 1. INTRODUCTION Chunity is a programming environment for the design of in- This paper describes the Chunity project, which combines teractive audiovisual games, instruments, and experiences. the audio programming language ChucK with the game en- It embodies an audio-driven, sound-first approach that inte- gine Unity for the creation of artful and interactive audiovi- grates audio programming and graphics programming in the sual applications. Chunity is both a tool and a workflow for same workflow, taking advantage of strongly-timed audio creating tools, games, toys, instruments, and experiences. programming features of the ChucK programming language As music researchers who work with the interplay be- and the state-of-the-art real-time graphics engine found in tween sound and graphics, we seek to create tools that pri- Unity. We describe both the system and its intended work- oritize audio and allow systems to be audio-driven when flow for the creation of expressive audiovisual works. Chu- helpful (e.g. for precise, musically-timed graphics). nity was evaluated as the primary software platform in a We chose to work with ChucK and Unity to combine computer music and design course, where students created the respective affordances of each.
    [Show full text]