DOCSLIB.ORG

Introduction to Algorithmic Composition and Sound Synthesis! Instructor: Dr

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Introduction to Algorithmic Composition and Sound Synthesis! Instructor: Dr !MAT 276IA: Introduction to Algorithmic Composition and Sound Synthesis! Instructor: Dr. Charlie Roberts - [email protected]! !Assisted by: Ryan McGee - [email protected]! !Credits: 4! Time: Wednesday / Friday 10:00AM - 11:50AM! Room: Elings Hall, 2003 (MAT Conference Room)! !Office Hours: TBD! // Course Synopsis! This course provides an introduction to techniques of electroacoustic music production through the lenses of sound synthesis and the algorithm. We will begin with basic acoustics and digital audio theory, and !advance to sound synthesis techniques and algorithms for exploring their use.! The course will explore these topics using the browser-based, creative coding environment Gibber (http:// gibber.mat.ucsb.edu). The language used in Gibber is JavaScript and a basic overview of JavaScript will be provided. No programming experience is required (although some small amount of previous programming is preferred, please contact the instructor if you have questions about this), and Gibber is written with beginning programmers in mind. Despite this, it offers a number of advanced features not available in most contemporary music programming languages, including sample-accurate timing and intra-block audio graph modification, audio-rate modulation of timing with concurrent clocks, and powerful abstractions for sequencing and defining musical mappings. It possesses a versatile graphics library and !many interactive affordances.! JavaScript is becoming an increasingly important language in the electroacoustic landscape. It is used in a variety of DAWs (such as Logic Pro and Reaper) and is an important part of the Max/MSP ecosystem. Learning the basics of JavaScript also means that you can create interactive compositions for the !browser, the best vehicle for widespread dissemination of audiovisual works.! Students will leave the course with a high-level understanding of various synthesis techniques: additive, subtractive, granular, FM, and physical modeling, as well as knowledge of digital audio effects. They will explore the use of algorithms to create compositions using these synthesis techniques. Finally, they will publish their work to the web as compositions that are synthesized in realtime using browser-based audio !technologies.! !Course discussions will be accompanied by both in-class and assigned listenings,! // Instructor Bios! Charlie Roberts is a Postdoctoral Fellow in the AlloSphere Research Group at UCSB, where his research explores human-computer interaction in virtual reality and creative coding environments. He is the primary author of Gibber, a creative coding environment for the browser, and has given performances in the US, Europe and Asia using it to improvise audiovisual art. His upcoming scholarly work includes an article on Gibber in the Computer Music Journal, an invited chapter in the Oxford Handbook of Algorithmic Music, !and an article on using Gibber to teach in the Journal of Music, Technology and Education.! Ryan McGee is an engineer, composer, and new media artist experienced in the development of custom and commercial software for spatial audio, sonification, sound design, interactivity, and mobile applications. He holds a BSEE from the University of Texas at Dallas and a MS in Multimedia Engineering from UCSB. Ryan is currently completing his PhD dissertation on Spatial Modulation Synthesis, a novel !technique unifying sound spatialization and timbre.! // Grades! 30% - Four mini-assignments exploring specific concepts presented in class! 25% - Midterm composition / documentation! 30% - Final composition / documentation! !15% - Participation! // Attendance! Don’t miss class! If you have to miss, please let Ryan and I know beforehand. Missing multiple classes !will results in a lowering of the participation portion of your grade.! !// Schedule! Week 1. Introduction to Gibber and JavaScript! In this first week, we will focus on learning the basics of JavaScript while having fun with Gibber. The musical emphasis will be on creating rhythmic patterns using percussion instruments. By the end of the week, students will understand the basics of JavaScript (object notation, variables, and function calls) and !the possibilities of Gibber and web-based audio composition.! Week 2. Acoustics, the Sampling Theorem, Sine Waves and Additive Synthesis! We start by discussing the physics of audio production and the phenomenology of audio reception. We then move to principles for converting digital audio representations into physical waveforms, and !conclude the week with an overview of sine waves, additive synthesis, and enveloping.! Week 3. Filters, Subtractive Synthesis, and Modulation! The frequency content of canonical waveforms (triangle, saw, square, PWM etc.) is discussed, followed by a discussion of audio filters. We progress from our previous week’s discussion of envelopes to include !the use of low-frequency oscillators and envelope followers for modulation.! Week 4. Twentieth-Century Algorithms in Action: Serialism, Twelve-Tone Technique and Algorithmic Processing! What are possibilities for the algorithmic manipulation of musical sets? We discuss serial techniques and look at time-based approaches for manipulating musical information. Along the way we learn more about creating and manipulating functions in JavaScript, and the powerful pattern manipulations available in !Gibber.! Week 5. Frequency Modulation and Human-Computer Interaction ! We learn how to make your favorite sounds from 80s pop-music using the synthesis technique of frequency modulation. We also look at more contemporary uses of frequency modulation, and discuss the !incorporation of interactive elements into algorithmic music.! Week 6. Realtime Composition and Live Coding Performance! Live Coding is a (typically) improvisatory performance practice where audiovisual works are programmed in front of audience members. What are the temporal strategies live coders use in their performances? !How can these strategies be employed in “traditional” algorithmic composition?! Week 7. Algorithms part 2 and Digital Audio FX! We discuss canonical digital audio effects and explore algorithms for manipulating them. We also discuss a variety of algorithms typically used in media arts practice, such as the Boids flocking algorithm, Conway’s Game of Life, and L-Systems, covering their historical use in composition and their manipulation in Gibber.! ! ! Week 8. Sampling, Re-sampling, and Granular Synthesis! How can live audio input be incorporated into compositional strategies? What is the potential of sampling algorithmic output and processing it? What algorithms effectively process sampled algorithmic output? !Granular synthesis using audio samples is also explored.! Week 9. An Introduction to Visual Music and Audiovisual Mapping! Gibber contains a variety of graphical affordances and abstractions for easily creating mappings between audio and visual objects. How can we design algorithms that effectively manipulate both audio and visual elements concurrently? What types of connections between audio and visual signals are most easily !perceived by audiences?! Week 10. Other Music Programming Languages + Final Project Workshop! What does all of this look like in other music programming languages? We briefly compare and contrast audio synthesis and algorithm use in Gibber with other environments such as SuperCollider, ChucK, Tidal, and Overtone. We’ll also leave time to get assistance from Ryan, Charlie and your fellow classmates in preparing your final projects for presentation..
Load more

Recommended publications
  • Computer-Assisted Composition a Short Historical Review
    MUMT 303 New Media Production II Charalampos Saitis Winter 2010 Computer-Assisted Composition A short historical review Computer-assisted composition is considered amongst the major musical developments that characterized the twentieth century. The quest for ‘new music’ started with Erik Satie and the early electronic instruments (Telharmonium, Theremin), explored the use of electricity, moved into the magnetic tape recording (Stockhausen, Varese, Cage), and soon arrived to the computer era. Computers, science, and technology promised new perspectives into sound, music, and composition. In this context computer-assisted composition soon became a creative challenge – if not necessity. After all, composers were the first artists to make substantive use of computers. The first traces of computer-assisted composition are found in the Bells Labs, in the U.S.A, at the late 50s. It was Max Matthews, an engineer there, who saw the possibilities of computer music while experimenting on digital transmission of telephone calls. In 1957, the first ever computer programme to create sounds was built. It was named Music I. Of course, this first attempt had many problems, e.g. it was monophonic and had no attack or decay. Max Matthews went on improving the programme, introducing a series of programmes named Music II, Music III, and so on until Music V. The idea of unit generators that could be put together to from bigger blocks was introduced in Music III. Meanwhile, Lejaren Hiller was creating the first ever computer-composed musical work: The Illiac Suit for String Quartet. This marked also a first attempt towards algorithmic composition. A binary code was processed in the Illiac Computer at the University of Illinois, producing the very first computer algorithmic composition.
    [Show full text]
  • Chuck: a Strongly Timed Computer Music Language
    Ge Wang,∗ Perry R. Cook,† ChucK: A Strongly Timed and Spencer Salazar∗ ∗Center for Computer Research in Music Computer Music Language and Acoustics (CCRMA) Stanford University 660 Lomita Drive, Stanford, California 94306, USA {ge, spencer}@ccrma.stanford.edu †Department of Computer Science Princeton University 35 Olden Street, Princeton, New Jersey 08540, USA [email protected] Abstract: ChucK is a programming language designed for computer music. It aims to be expressive and straightforward to read and write with respect to time and concurrency, and to provide a platform for precise audio synthesis and analysis and for rapid experimentation in computer music. In particular, ChucK defines the notion of a strongly timed audio programming language, comprising a versatile time-based programming model that allows programmers to flexibly and precisely control the flow of time in code and use the keyword now as a time-aware control construct, and gives programmers the ability to use the timing mechanism to realize sample-accurate concurrent programming. Several case studies are presented that illustrate the workings, properties, and personality of the language. We also discuss applications of ChucK in laptop orchestras, computer music pedagogy, and mobile music instruments. Properties and affordances of the language and its future directions are outlined. What Is ChucK? form the notion of a strongly timed computer music programming language. ChucK (Wang 2008) is a computer music program- ming language. First released in 2003, it is designed to support a wide array of real-time and interactive Two Observations about Audio Programming tasks such as sound synthesis, physical modeling, gesture mapping, algorithmic composition, sonifi- Time is intimately connected with sound and is cation, audio analysis, and live performance.
    [Show full text]
  • Chunking: a New Approach to Algorithmic Composition of Rhythm and Metre for Csound
    Chunking: A new Approach to Algorithmic Composition of Rhythm and Metre for Csound Georg Boenn University of Lethbridge, Faculty of Fine Arts, Music Department [email protected] Abstract. A new concept for generating non-isochronous musical me- tres is introduced, which produces complete rhythmic sequences on the basis of integer partitions and combinatorics. It was realized as a command- line tool called chunking, written in C++ and published under the GPL licence. Chunking 1 produces scores for Csound2 and standard notation output using Lilypond3. A new shorthand notation for rhythm is pre- sented as intermediate data that can be sent to different backends. The algorithm uses a musical hierarchy of sentences, phrases, patterns and rhythmic chunks. The design of the algorithms was influenced by recent studies in music phenomenology, and makes references to psychology and cognition as well. Keywords: Rhythm, NI-Metre, Musical Sentence, Algorithmic Compo- sition, Symmetry, Csound Score Generators. 1 Introduction There are a large number of powerful tools that enable algorithmic composition with Csound: CsoundAC [8], blue[11], or Common Music[9], for example. For a good overview about the subject, the reader is also referred to the book by Nierhaus[7]. This paper focuses on a specific algorithm written in C++ to produce musical sentences and to generate input files for Csound and lilypond. Non-isochronous metres (NI metres) are metres that have different beat lengths, which alternate in very specific patterns. They have been analyzed by London[5] who defines them with a series of well-formedness rules. With the software presented in this paper (from now on called chunking) it is possible to generate NI metres.
    [Show full text]
  • Contributors to This Issue
    Contributors to this Issue Stuart I. Feldman received an A.B. from Princeton in Astrophysi- cal Sciences in 1968 and a Ph.D. from MIT in Applied Mathemat- ics in 1973. He was a member of technical staf from 1973-1983 in the Computing Science Research center at Bell Laboratories. He has been at Bellcore in Morristown, New Jersey since 1984; he is now division manager of Computer Systems Research. He is Vice Chair of ACM SIGPLAN and a member of the Technical Policy Board of the Numerical Algorithms Group. Feldman is best known for having written several important UNIX utilities, includ- ing the MAKE program for maintaining computer programs and the first portable Fortran 77 compiler (F77). His main technical interests are programming languages and compilers, software confrguration management, software development environments, and program debugging. He has worked in many computing areas, including aþbraic manipulation (the portable Altran sys- tem), operating systems (the venerable Multics system), and sili- con compilation. W. Morven Gentleman is a Principal Research Oftcer in the Com- puting Technology Section of the National Research Council of Canada, the main research laboratory of the Canadian govern- ment. He has a B.Sc. (Hon. Mathematical Physics) from McGill University (1963) and a Ph.D. (Mathematics) from princeton University (1966). His experience includes 15 years in the Com- puter Science Department at the University of Waterloo, ûve years at Bell Laboratories, and time at the National Physical Laboratories in England. His interests include software engi- neering, embedded systems, computer architecture, numerical analysis, and symbolic algebraic computation. He has had a long term involvement with program portability, going back to the Altran symbolic algebra system, the Bell Laboratories Library One, and earlier.
    [Show full text]
  • 1 a NEW MUSIC COMPOSITION TECHNIQUE USING NATURAL SCIENCE DATA D.M.A Document Presented in Partial Fulfillment of the Requiremen
    A NEW MUSIC COMPOSITION TECHNIQUE USING NATURAL SCIENCE DATA D.M.A Document Presented in Partial Fulfillment of the Requirements for the Degree Doctor of Musical Arts in the Graduate School of The Ohio State University By Joungmin Lee, B.A., M.M. Graduate Program in Music The Ohio State University 2019 D.M.A. Document Committee Dr. Thomas Wells, Advisor Dr. Jan Radzynski Dr. Arved Ashby 1 Copyrighted by Joungmin Lee 2019 2 ABSTRACT The relationship of music and mathematics are well documented since the time of ancient Greece, and this relationship is evidenced in the mathematical or quasi- mathematical nature of compositional approaches by composers such as Xenakis, Schoenberg, Charles Dodge, and composers who employ computer-assisted-composition techniques in their work. This study is an attempt to create a composition with data collected over the course 32 years from melting glaciers in seven areas in Greenland, and at the same time produce a work that is expressive and expands my compositional palette. To begin with, numeric values from data were rounded to four-digits and converted into frequencies in Hz. Moreover, the other data are rounded to two-digit values that determine note durations. Using these transformations, a prototype composition was developed, with data from each of the seven Greenland-glacier areas used to compose individual instrument parts in a septet. The composition Contrast and Conflict is a pilot study based on 20 data sets. Serves as a practical example of the methods the author used to develop and transform data. One of the author’s significant findings is that data analysis, albeit sometimes painful and time-consuming, reduced his overall composing time.
    [Show full text]
  • Composing Interactions
    Composing Interactions Giacomo Lepri Master Thesis Instruments & Interfaces STEIM - Institute of Sonology Royal Conservatoire in The Hague The Netherlands May 2016 “Any musical innovation is full of danger to the whole State, and ought to be prohibited. (...) When modes of music change, the State always change with them. (...) Little by little this spirit of licence, finding a home, imperceptibly penetrates into manners and customs; whence, issuing with greater force, it invades contracts between man and man, and from contracts goes on to laws and constitutions, in utter recklessness, ending at last, by an overthrow of all rights, private as well as public.” Plato, The Republic 1 Acknowledgements First of all, I would like to express my gratitude to my family. Their love, support and advice are the most precious gifts I ever received. Thanks to Joel Ryan & Kristina Andersen, for their ability to convey the magic, make visible the invisible and p(l)ay attention. Thanks to Richard Barrett, for his musical sensitivity, artistic vision and gathering creativity. Thanks to Peter Pabon, for his outstanding teachings, competences and support. Thanks to Johan van Kreij, for his important practical and conceptual advises, suggestions and reflections. Thanks to Alberto Boem & Dan Gibson, for the fruitful and worthwhile discussion that produced many of the concepts introduced in chapter 2. Thanks to Kees Tazelaar, for the passion, foresight and expertise that characterise his work. Thanks to all the people that contribute to the Institute of Sonology and STEIM. Thanks to their ability to valorise the past and project the future. Thanks to my fellow students Semay and Ivan, for the joy and sharing.
    [Show full text]
  • Algorithmic Composition with Open Music and Csound: Two Examples
    Algorithmic Composition with Open Music and Csound: two examples Fabio De Sanctis De Benedictis ISSM \P. Mascagni" { Leghorn (Italy) [email protected] Abstract. In this paper, after a concise and not exhaustive review about GUI software related to Csound, and brief notes about Algorithmic Com- position, two examples of Open Music patches will be illustrated, taken from the pre-compositive work in some author's compositions. These patches are utilized for sound generation and spatialization using Csound as synthesis engine. Very specific and thorough Csound programming ex- amples will be not discussed here, even if automatically generated .csd file examples will be showed, nor will it be possible to explain in detail Open Music patches; however we retain that what will be described can stimulate the reader towards further deepening. Keywords: Csound, Algorithmic Composition, Open Music, Electronic Music, Sound Spatialization, Music Composition 1 Introduction As well-known, \Csound is a sound and music computing system"([1], p. 35), founded on a text file containing synthesis instructions and the score, that the software reads and transforms into sound. By its very nature Csound can be supported by other software that facilitates the writing of code, or that, provided by a graphic interface, can use Csound itself as synthesis engine. Dave Phillips has mentioned several in his book ([2]): hYdraJ by Malte Steiner; Cecilia by Jean Piche and Alexander Burton; Silence by Michael Go- gins; the family of HPK software, by Didiel Debril and Jean-Pierre Lemoine.1 The book by Bianchini and Cipriani encloses Windows software for interfacing Csound, and various utilities ([6]).
    [Show full text]
  • Assessment: Computer Music
    1 Computer Music Assessment: Computer Music There are two parts to the assessment. 1. Task 1 (Sound Synthesizer with GUI) Programming project with 1000 word write- up. Submitted Thursday Week 7 SPRING term (50%) 2. Task 2 (Algorithmic Composition) Programming project with 1000 word write-up. Submitted Assessment Block 2 (50%) All submissions will be electronic, via the Study Direct site for the module. Programming Tasks: You will have to submit everything required to compile and run the programs, with the writeup. It is strongly suggested you zip everything up into one submission file. The time of submission will be strictly adhered to as recorded on Study Direct. When you submit your SuperCollider code, don’t forget to include any sound samples and to indicate any third party dependencies! (do not use obscure third party libraries unless you have cleared with me that I can get hold of them). You must either use Mac OS X, or your work must be compatible in principle with cross-platform compilation. Direct assessment will be undertaken of your code; it must run out of the box. Note that there is an upload limit on Study Direct. If you need very large audio files as part of the project, you should place them online within another zip (e.g. just one download link) and provide a link to download this in a README document with your submission. The only external data that will be accepted in this fashion is auxiliary audio or video data; no programming code should be placed externally. Each task should be accompanied by a 1000 word writeup in a PDF document (you can export as PDF from Word, for example) detailing your solutions to the exercise.
    [Show full text]
  • Algorithmic Composition of Popular Music
    Algorithmic Composition of Popular Music Anders Elowsson,*1 Anders Friberg*1 *1 Speech, Music and Hearing, KTH Royal Institute of Technology, Sweden [email protected], [email protected] every composer of popular music. But perhaps the most ABSTRACT important lesson, often neglected in scientific research, is the Human composers have used formal rules for centuries to compose emphasis on the composer as a listener. In this project, a music, and an algorithmic composer – composing without the aid of constant evaluation of the sounding results has been used to human intervention – can be seen as an extension of this technique. An shape the songs into music that better corresponds to the genre. algorithmic composer of popular music (a computer program) has Let us take a look at the more scientific approaches to music been created with the aim to get a better understanding of how the composition. A lot of work has been done on classical music composition process can be formalized and at the same time to get a (Cope, 2000; Tanaka et al, 2010; Farbood & Schoner, 2001). A better understanding of popular music in general. With the aid of reason for the interest in this type of music may perhaps be an statistical findings a theoretical framework for relevant methods are already established formalization such as species counterpoint presented. The concept of Global Joint Accent Structure is introduced, made famous by Johann Joseph Fux. Another reason may be the as a way of understanding how melody and rhythm interact to help the special position that classical music has reached within music listener form expectations about future events.
    [Show full text]
  • 107 Musical Composition: Man Or Machine?
    Musical Composition: Man or Machine? The Algorithmic Composer Sam Agnew The use of computers in the composition of music is a topic of controversial debate among scholars, musicians and composers as well as Artificial Intelligence experts. Music is generally thought of as an artistic field of human expression, which is seemingly far from being related to Computer Science or Mathematics. Contrary to popular belief, however, these fields are much more related than they seem. As exemplified by composers such as David Cope or Bruce Jacob, algorithms and computer programs can be used to create new pieces of music, and are effectively able to emulate this form of expression previously exclusive only to humans. In this research, I intend to explore the use of computers and algorithms in the composition of music. I will touch on some of the key issues that are often linked with the use of computers as compositional tools, and I will explain these breakthroughs in the field of Artificial Intelligence and Creativity as well as in Musicology and other related musical fields. Computers process information algorithmically, through a finite set of logical instructions. This algorithmic process can be extended to realms outside of the computer as well, exemplified by musicians such as John Cage and his use of randomness to compose music. Further breakthroughs in the field of Artificial Intelligence range from producing new musical works or imitating the style of well-known musicians, to simpler applications such as producing counterpoint for a given melody, or providing variations on a given theme. I will discuss all of these subjects and examples as well as the philosophical implications of what it means for a “machine” to create music.
    [Show full text]
  • The Algorithmic Composition of Classical Music Through Data Mining
    College of Saint Benedict and Saint John's University DigitalCommons@CSB/SJU All College Thesis Program, 2016-2019 Honors Program 4-2018 The Algorithmic Composition of Classical Music through Data Mining Tom Donald Richmond College of Saint Benedict/Saint John's University, [email protected] Imad Rahal College of Saint Benedict/Saint John's University, [email protected] Follow this and additional works at: https://digitalcommons.csbsju.edu/honors_thesis Part of the Artificial Intelligence and Robotics Commons, and the Other Computer Sciences Commons Recommended Citation Richmond, Tom Donald and Rahal, Imad, "The Algorithmic Composition of Classical Music through Data Mining" (2018). All College Thesis Program, 2016-2019. 52. https://digitalcommons.csbsju.edu/honors_thesis/52 This Thesis is brought to you for free and open access by DigitalCommons@CSB/SJU. It has been accepted for inclusion in All College Thesis Program, 2016-2019 by an authorized administrator of DigitalCommons@CSB/SJU. For more information, please contact [email protected]. Algorithmic Composition of Classical Music through Data Mining An All College Thesis College of Saint Benedict and Saint John’s University by Tom Donald Richmond April, 2018 Algorithmic Composition of Classical Music through Data Mining By Tom Donald Richmond Approved By: _____________________________________________ Dr. Imad Rahal, Professor of Computer Science _____________________________________________ Dr. Mike Heroux, Scientist-in-Residence of Computer Science _____________________________________________
    [Show full text]
  • Algorithmic Composition of Music in Real-Time with Soft Constraints Max Meier
    Algorithmic Composition of Music in Real-Time with Soft Constraints Max Meier Dissertation an der Fakultät für Mathematik, Informatik und Statistik der Ludwig-Maximilians-Universität München zur Erlangung des Grades Doctor rerum naturalium (Dr. rer. nat.) vorgelegt von Max Meier eingereicht im September 2014 All you have to do is touch the right key at the right time and the instrument will play itself. (J. S. Bach) Berichterstatter: Prof. Dr. Martin Wirsing Prof. Dr. Elisabeth André Prof. Dr. Andreas Butz Tag des Rigorosums: 8.12.2014 Eidesstattliche Versicherung (Siehe Promotionsordnung vom 12.07.11, § 8, Abs. 2 Pkt. .5.) Hiermit erkläre ich an Eidesstatt, dass die Dissertation von mir selbstständig, ohne unerlaubte Beihilfe angefertigt ist. Max Meier Ort, Datum Unterschrift Doktorand/in Abstract Music has been the subject of formal approaches for a long time, ranging from Pythagoras’ elementary research on tonal systems to J. S. Bach’s elaborate formal composition techniques. Especially in the 20th century, much music was composed based on formal techniques: Algorithmic approaches for composing music were developed by composers like A. Schoenberg as well as in the scientific area. So far, a variety of mathematical techniques have been employed for composing music, e.g. probability models, artificial neural networks or constraint- based reasoning. In the recent time, interactive music systems have become popular: existing songs can be replayed with musical video games and original music can be interactively composed with easy-to-use applications running e.g. on mobile devices. However, applications which algorithmically generate music in real-time based on user interaction are mostly experimental and limited in either interactivity or musicality.
    [Show full text]