Teaching Sound Synthesis in C/C ++ on the Raspberry Pi

Total Page:16

File Type:pdf, Size:1020Kb

Teaching Sound Synthesis in C/C ++ on the Raspberry Pi Teaching Sound Synthesis in C=C++ on the Raspberry Pi Henrik von Coler and David Runge Audio Communication Group, TU Berlin [email protected] [email protected] Abstract added, they are not considered for exploring ap- For a sound synthesis programming class in C/C++, plied sound synthesis algorithms in this class. a Raspberry Pi 3 was used as runtime and develop- In a more application-based context, graphi- ment system. The embedded system was equipped cal programming environments like Pure Data with an Arch Linux ARM, a collection of libraries (Pd), MAX MSP or others would be the first for sound processing and interfacing, as well as with choice. They allow rapid progress and interme- basic examples. All material used in and created diate results. However, they are not the best for the class is freely available in public git reposito- platform to enhance the knowledge of sound ries. After a unit of theory on sound synthesis and Linux system basics, students worked on projects synthesis algorithms on a sample-wise level by in groups. This paper is a progress report, point- nature. ing out benefits and drawbacks after the first run of the seminar. The concept delivered a system with C/C++ delivers a reasonable compromise be- acceptable capabilities and latencies at a low price. tween low level access and the comfort of using Usability and robustness, however, need to be im- available libraries for easy interfacing with hard- proved in future attempts. ware. For using C/C++ in the development of sound synthesis software, a software devel- Keywords opment kit (SDK) or application programming Jack, Raspberry Pi, C/C++ Programming, Educa- interface (API) is needed in order to offer access tion, Sound Synthesis, MIDI, OSC, Arch Linux to the audio hardware. Digital audio workstations (DAW) use plug- 1 Introduction ins programmed with SDKs and APIs like Stein- The goal of the seminar outlined in this pa- berg's VST, Apple's Audio Units, Digidesign's per was to enable students with different back- RTAS, the Linux Audio Developer's Simple grounds and programming skills the develop- Plugin API (LADSPA) and its successor LV2, ment of standalone real-time sound synthesis which offer quick access to developing audio projects. Such a class on the programming synthesis and processing units. A plugin-host of sound synthesis algorithms is, among other is necessary to run the resulting programs and things, defined by the desired level of depth in the structure is predefined by the chosen plat- signal processing. It may convey an application- form. The JUCE framework [34] offers the oriented overview or a closer look at algorithms possibility of developing cross platform applica- on a sample-wise signal processing level, as in tions with many builtin features. Build targets this case. Based on this decision, the choice can be audio-plugins for different systems and of tools, respectively the programming environ- standalone applications, including Jack clients, ment should be made. which would present an alternative to the cho- sen approach. Script languages like Matlab or Python are Another possibility is the programming of widely used among students and offer a comfort- Pd externals in the C programming language able environment, especially for students with- with the advantage of quick merging of the self- out a background in computer science. They programmed components with existing Pd in- are well suited for teaching fundamentals and ternals. FAUST [6] also provides means for cre- theoretical aspects of signal processing due to ating various types of audio plugins and stan- advanced possibilities of debugging and visual- dalone applications. Due to a lack in functional isation. Although real-time capabilities can be programming background it was not chosen. For various reasons we settled for the Jack Unfortunately the on-board audio interface API [18] to develop command line programs on of the Raspberry Pi could not be configured a Linux system. for real-time audio applications. It does not feature an input and the Jack server could • Jack clients are used in the research on bin- only be started with high latencies. After try- aural synthesis and sound field synthesis, ing several interfaces, a Renkforce USB-Audio- for example by the WONDER interface [15] Adapter was chosen, since it delivered an ac- or the SoundScape Renderer [14]. Results ceptable performance at a price of 10 e. The of the projects might thus be potentially Jack server did perform better with other inter- integrated into existing contexts. faces, yet at a higher price and with a larger • Jack clients offer quick connection to other housing. clients, making them as modular as audio- Students were equipped with MIDI interfaces plugins in a DAW. from the stock of the research group and private • The Jack API is easy to use, even for be- devices. The complete cost for one system, in- ginners. Once the main processing func- cluding the Raspberry Pi 3 with housing, SD tion is understood, students can immedi- card, power adapter and the audio interface, ately start inserting their own code. were thus kept at about 70 e(vs. the integrated low-latency platform bela[5], that still ranks at • The omission of a graphical user interface around 120 eper unit). for the application leaves more space for focusing on the audio-related problems. 2.2 Operating System • The proposed environment is independent of proprietary components. First tests on the embedded system involved Raspbian [12], as it is highly integrated and has a graphical environment preinstalled, that A main objective of the seminar was to equip eases the use for beginners. Integration with the students with completely identical systems the libraries used for the course proved to be for development. This avoids troubles in han- more complicated however, as they needed to dling different operating systems and hardware be added to the software repository for the ex- configurations. Since no suitable computer pool amples. was available, we aimed at providing a set of machines as cheap as possible for developing, A more holistic approach, integrating the op- compiling and running the applications. The erating system, was aimed at, in order to leave students were thus provided with a Raspberry as few dependencies on the students' side as pos- Pi 3 in groups of two. Besides being one of the sible and not having to deal with the hosting of cheapest development systems, it offers the ad- a custom repository of packages for Raspbian. vantage of resulting in a highly portable, quasi Due to previous experience with low latency se- embedded synthesizer for the actual use in live tups using Arch Linux [7], Arch Linux ARM applications. [2] was chosen. With its package manager pac- man [9] and the Arch Build System [1] an easy The remainder of this paper is organized as system-wide integration of all used libraries and follows: Section 2 introduces the used hard- and software was achieved by providing them as pre- software, as well as the infrastructure. Section 3 installed packages (with them either being avail- presents the concept of the seminar. Section 4 able in the standard repositories, or the Arch briefly summarizes the experiences and evalu- User Repository[3]). Using Arch Linux ARM, ates the concept. it was also possible to guarantee a systemd [13] 2 Technical Outline based startup of the needed components, which is further described in Section 2.5. At the time 2.1 Hardware of preparation for the course, the 64bit vari- A Raspberry Pi 3 was used as development ant (AArch64) - using the mainline kernel - was and runtime system. The most recent version not available yet. At the time of writing it is at that time was equipped with 1.2GHz 64-bit still considered experimental, as some vendor quad-core ARMv8 CPU, 802.11n Wireless LAN, libraries are not yet available for it. Instead the a Bluetooth adapter, 1GB RAM, 4 USB ports ARMv7 variant of the installation image was 40 GPIO pins and various other features [11]. used, which is the default for Raspberry Pi 2. 2.3 Libraries As these settings were not realizable with the All libraries installed on the system are listed internal audio card, the snd-bcm2835 module - in Tab. 1. For communicating with the au- the driver in use for it - was blacklisted using dio hardware, the Jack API was installed. The /etc/modprobe.d/*, to not use the sound device jackcpp framework adds a C++ interface to at all. Jack. Additional libraries allowed the handling For automatic start of the low-latency au- of audio file formats, ALSA-MIDI interfacing, dio server and its clients, systemd user ser- Open Sound Control, configuration files and vices were introduced, that follow a user session Fast Fourier Transforms. based setup. The session of the main system user is started automatically as per systemd's [email protected]. This is achieved by enabling the Table 1: Libraries installed on the development linger status of said user with the help of loginctl system [8], which activates its session during boot and Library Ref. Purpose starts its enabled services. jack2 [18] Jack audio API A specialized systemd user service [30] allows jackcpp [26] C++ wrapper for jack2 for Jack's startup with an elevated CPU sched- uler without the use of dbus [21]. The stu- sndfile [19] Read and write audio files dents' projects could be automatically started rtmidi [32] Connect to MIDI devices as user services, that rely on the audio server liblo [23] OSC support being started by enabling services such as this example: yaml [20] Configuration files [ Unit ] fftw3 [22] Fourier transform Description=Example project boost [4] Various applications After=jack@rpi-usb-44100.
Recommended publications
  • Embedded Real-Time Audio Signal Processing with Faust Romain Michon, Yann Orlarey, Stéphane Letz, Dominique Fober, Dirk Roosenburg
    Embedded Real-Time Audio Signal Processing With Faust Romain Michon, Yann Orlarey, Stéphane Letz, Dominique Fober, Dirk Roosenburg To cite this version: Romain Michon, Yann Orlarey, Stéphane Letz, Dominique Fober, Dirk Roosenburg. Embedded Real- Time Audio Signal Processing With Faust. International Faust Conference (IFC-20), Dec 2020, Paris, France. hal-03124896 HAL Id: hal-03124896 https://hal.archives-ouvertes.fr/hal-03124896 Submitted on 29 Jan 2021 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Proceedings of the 2nd International Faust Conference (IFC-20), Maison des Sciences de l’Homme Paris Nord, France, December 1-2, 2020 EMBEDDED REAL-TIME AUDIO SIGNAL PROCESSING WITH FAUST Romain Michon,a;b Yann Orlarey,a Stéphane Letz,a Dominique Fober,a and Dirk Roosenburgd;e aGRAME – Centre National de Création Musicale, Lyon, France bCenter for Computer Research in Music and Acoustics, Stanford University, USA dTIMARA, Oberlin Conservatory of Music, USA eDepartment of Physics, Oberlin College, USA [email protected] ABSTRACT multi-channel audio, etc.). These products work in conjunction with specialized Linux distributions where audio processing tasks FAUST has been targeting an increasing number of embedded plat- forms for real-time audio signal processing applications in recent are carried out outside of the operating system, allowing for the years.
    [Show full text]
  • Extending the Faust VST Architecture with Polyphony, Portamento and Pitch Bend Yan Michalevsky Julius O
    Extending the Faust VST Architecture with Polyphony, Portamento and Pitch Bend Yan Michalevsky Julius O. Smith Andrew Best Department of Electrical Center for Computer Research in Blamsoft, Inc. Engineering, Music and Acoustics (CCRMA), [email protected] Stanford University Stanford University [email protected] AES Fellow [email protected] Abstract VST (Virtual Studio Technology) plugin stan- We introduce the vsti-poly.cpp architecture for dard was released by Steinberg GmbH (famous the Faust programming language. It provides sev- for Cubase and other music and sound produc- eral features that are important for practical use of tion products) in 1996, and was followed by the Faust-generated VSTi synthesizers. We focus on widespread version 2.0 in 1999 [8]. It is a partic- the VST architecture as one that has been used tra- ularly common format supported by many older ditionally and is supported by many popular tools, and newer tools. and add several important features: polyphony, note Some of the features expected from a VST history and pitch-bend support. These features take plugin can be found in the VST SDK code.2 Faust-generated VST instruments a step forward in Examining the list of MIDI events [1] can also terms of generating plugins that could be used in Digital Audio Workstations (DAW) for real-world hint at what capabilities are expected to be im- music production. plemented by instrument plugins. We also draw from our experience with MIDI instruments and Keywords commercial VST plugins in order to formulate sound feature requirements. Faust, VST, Plugin, DAW In order for Faust to be a practical tool for generating such plugins, it should support most 1 Introduction of the features expected, such as the following: Faust [5] is a popular music/audio signal pro- • Responding to MIDI keyboard events cessing language developed by Yann Orlarey et al.
    [Show full text]
  • Audio Signal Processing in Faust
    Audio Signal Processing in Faust Julius O. Smith III Center for Computer Research in Music and Acoustics (CCRMA) Department of Music, Stanford University, Stanford, California 94305 USA jos at ccrma.stanford.edu Abstract Faust is a high-level programming language for digital signal processing, with special sup- port for real-time audio applications and plugins on various software platforms including Linux, Mac-OS-X, iOS, Android, Windows, and embedded computing environments. Audio plugin formats supported include VST, lv2, AU, Pd, Max/MSP, SuperCollider, and more. This tuto- rial provides an introduction focusing on a simple example of white noise filtered by a variable resonator. Contents 1 Introduction 3 1.1 Installing Faust ...................................... 4 1.2 Faust Examples ...................................... 5 2 Primer on the Faust Language 5 2.1 Basic Signal Processing Blocks (Elementary Operators onSignals) .......... 7 2.2 BlockDiagramOperators . ...... 7 2.3 Examples ........................................ 8 2.4 InfixNotationRewriting. ....... 8 2.5 Encoding Block Diagrams in the Faust Language ................... 9 2.6 Statements ...................................... ... 9 2.7 FunctionDefinition............................... ...... 9 2.8 PartialFunctionApplication . ......... 10 2.9 FunctionalNotationforOperators . .......... 11 2.10Examples ....................................... 11 1 2.11 Summary of Faust NotationStyles ........................... 11 2.12UnaryMinus ..................................... 12 2.13 Fixing
    [Show full text]
  • Proyecto Fin De Grado
    ESCUELA TÉCNICA SUPERIOR DE INGENIERÍA Y SISTEMAS DE TELECOMUNICACIÓN PROYECTO FIN DE GRADO TÍTULO: Implementación de un sintetizador en un kit de desarrollo de bajo coste AUTOR: Arturo Fernández TITULACIÓN: Grado en Ingeniería de Sonido e Imagen TUTOR: Antonio Mínguez Olivares DEPARTAMENTO: Teoría de la señal y Comunicación VºBº Miembros del Tribunal Calificador: PRESIDENTE: Eduardo Nogueira Díaz TUTOR: Antonio Mínguez Olivares SECRETARIO: Francisco Javier Tabernero Gil Fecha de lectura: Calificación: El Secretario, Agradecimientos − A mis padres y mi hermana, por apoyarme en todos los aspectos (con discrepancias inevitables) a lo largo de esta carrera de fondo. − A mis amigos y la novia, por no verme el pelo durante largos periodos de tiempo. − A los profesores que han conseguido despertar mi interés y dedicarme horas en tutorías. − A mi tutor por aceptar mi propuesta y tutelar el proyecto sin pensárselo. − A mi cuñado Rafa, que, a pesar de estar eternamente abarrotado, sacaba un hueco para ayudarme en los momentos más difíciles, motivarme y guiarme a lo largo de todos estos años. Sin su ayuda, esto no habría sido posible. − Finalmente, darme las gracias a mí mismo, por aguantar este ritmo de vida, tener la ambición de seguir y afrontar nuevos retos. Como me dice mi padre: “Tú hasta que no llegues a la Luna, no vas a parar, ¿no?”. Implementación de un sintetizador en un kit de desarrollo de bajo coste Resumen La realización de este proyecto consiste en el diseño de un sintetizador ‘Virtual Analógico’ basado en sintetizadores de los años 60 y 70. Para ello, se estudia la teoría que conforma la topología básica de los sintetizadores sustractivos, así como, los elementos que intervienen en la generación y modificación del sonido.
    [Show full text]
  • Guido Van Rossum on PYTHON 3 Get Your Sleep From
    JavaScript | Inform 6 & 7 | Falcon | Sleep | Enlightenment | PHP LINUX JOURNAL ™ THE STATE OF LINUX AUDIO SOFTWARE LANGUAGES Since 1994: The Original Magazine of the Linux Community OCTOBER 2008 | ISSUE 174 Inform 7 REVIEWED JavaScript | Inform 6 & 7 | Falcon | Sleep Enlightenment PHP Audio | Inform 6 & 7 Falcon JavaScript Don’t Get Eaten HP Media by a Grue! Vault 5150 Scalent’s Managing Virtual Operating PHP Code Environment Guido van Rossum on PYTHON 3 Get Your Sleep from OCTOBER Java www.linuxjournal.com 2008 $5.99US $5.99CAN 10 ISSUE Martin Messner Enlightenment E17 Insights from SUSE’s Lightweight Alternative 174 + Security Team Lead to KDE and GNOME 0 09281 03102 4 MULTIPLY ENERGY EFFICIENCY AND MAXIMIZE COOLING. THE WORLD’S FIRST QUAD-CORE PROCESSOR FOR MAINSTREAM SERVERS. THE NEW QUAD-CORE INTEL® XEON® PROCESSOR 5300 SERIES DELIVERS UP TO 50% 1 MORE PERFORMANCE*PERFORMANCE THAN PREVIOUS INTEL XEON PROCESSORS IN THE SAME POWERPOWER ENVELOPE.ENVELOPE. BASEDBASED ONON THETHE ULTRA-EFFICIENTULTRA-EFFICIENT INTEL®INTEL® CORE™CORE™ MICROMICROARCHITECTURE, ARCHITECTURE IT’S THE ULTIMATE SOLUTION FOR MANAGING RUNAWAY COOLING EXPENSES. LEARN WHYWHY GREAT GREAT BUSINESS BUSINESS COMPUTING COMPUTING STARTS STARTS WITH WITH INTEL INTEL INSIDE. INSIDE. VISIT VISIT INTEL.CO.UK/XEON INTEL.COM/XEON. RELION 2612 s 1UAD #ORE)NTEL®8EON® RELION 1670 s 1UAD #ORE)NTEL®8EON® PROCESSOR PROCESSOR s 5SERVERWITHUPTO4" s )NTEL@3EABURG CHIPSET s )DEALFORCOST EFFECTIVE&ILE$" WITH-(ZFRONTSIDEBUS APPLICATIONS s 5PTO'"2!-IN5CLASS s 2!32ELIABILITY !VAILABILITY LEADINGMEMORYCAPACITY 3ERVICEABILITY s -ANAGEMENTFEATURESTOSUPPORT LARGECLUSTERDEPLOYMENTS 34!24).'!4$2429.00 34!24).'!4$1969.00 Penguin Computing provides turnkey x86/Linux clusters for high performance technical computing applications.
    [Show full text]
  • An Old-School Polyphonic Synthesizer Samplv1
    local projects linuxaudio.org Show-off my open-source stuff, mostly of the Linux Audio/MIDI genre Vee One Suite 0.9.4 - A Late Autumn'18 Release 12 December, 2018 - 19:00 — rncbc Greetings! The Vee One Suite of so called old-school software instruments, synthv1, as a polyphonic subtractive synthesizer, samplv1, a polyphonic sampler synthesizer, drumkv1 as yet another drum-kit sampler and padthv1 as a polyphonic additive synthesizer, are being released for the late in Autumn'18. All still available in dual format: a pure stand-alone JACK client with JACK-session, NSM (Non Session management) and both JACK MIDI and ALSA MIDI input support; a LV2 instrument plug-in. The changes for this special season are the following: Make sure all LV2 state sample file references are resolved to their original and canonical file- paths (not symlinks). (applies to samplv1 and drumkv1 only) Fixed a severe bug on saving the LV2 plug-in state: the sample file reference was being saved with the wrong name identifier and thus gone missing on every session or state reload thereafter.(applies to samplv1 only). Sample waveform drawing is a bit more keen to precision. Old deprecated Qt4 build support is no more. Normalized wavetable oscillator phasors. Added missing include <unistd.h> to shut up some stricter compilers from build failures. The Vee One Suite are free, open-source Linux Audio software, distributed under the terms of the GNU General Public License (GPL) version 2 or later. And here they go again! synthv1 - an old-school polyphonic synthesizer synthv1 0.9.4 (late-autumn'18) released! synthv1 is an old-school all-digital 4-oscillator subtractive polyphonic synthesizer with stereo fx.
    [Show full text]
  • Avlinux MX Edition (AVL-MXE) User Manual
    AVLinuxAVLinux MXMX EditionEdition (AVL-MXE)(AVL-MXE) UserUser ManualManual Prepared by: Glen MacArthur DISCLAIMER (PLEASE READ) : Debian/GNU Linux comes with no guarantees so consequentially neither does AVL-MXE. I accept no responsibility for any hardware/software malfunctions or data loss resulting from its use. It is important to note that the AVL-MXE ISO may contain software that is non-free and may be distributed under special licensing arrangements with the original developers, re-distributing the AVL-MXE ISO with the non-free content included is a violation of these licenses. AVL-MXE may potentially contain Multimedia Codecs that may be under patent in certain countries, it is the Users responsibility to know the law as it applies to their own respective countries before downloading or installing AVL-MXE. 1 Bookmarks ➔ About This Manual ➔ G etting Help ➔ A New Chapter for AV L inux ! ➔ AVL-MXE Features at a Glance ➔ Included Trusted Debian Repositories ➔ External/Independent Software in AVL-MXE ➔ Specific AVL-MXE Tools and Packages ➔ Known Issues in AVL-MXE ➔ Downloading the AVL-MXE ISO File ➔ Running AVL-MXE as a ‘LiveISO’ ➔ The Network Assistant for WiFi ➔ Installing AVL-MXE ➔ Installation Suggestions ➔ The AVL-MXE Assistant ➔ The Kernel Conundrum ➔ XFCE4 with Openbox ➔ Slim Login Manager ➔ Getting Around in XFCE4 ➔ Thunar File Manager ➔ QT5 Configuration Tool ➔ MX-Snapshot in AVL-MXE ➔ Software Installation Notes ➔ Audio and MIDI in AVL-MXE ➔ Initial Setup of Ardour and Mixbus32C ➔ Running Windows Audio Software ➔ Saving and Restoring JACK Connections ➔ Commercial Software Demos in AVL-MXE ➔ Thanks and Acknowledgements 2 About This Manual This is a new User Manual for a new project, it is currently a Work-In-Progress and will be for some time I’m sure.
    [Show full text]
  • Studioware: Applications List Studioware: Applications List
    2021/07/27 06:26 (UTC) 1/4 Studioware: Applications List Studioware: Applications List This is the full list of applications and supporting libraries/plugins etc. plus their location in git and on our package server: audio/amps/guitarix2 audio/codecs/lame audio/desktop/evince audio/development/guile1.8 audio/development/libsigc++ audio/development/libsigc++-legacy12 audio/development/ntk audio/development/phat audio/development/pysetuptools audio/development/scons audio/development/scrollkeeper audio/development/vamp-plugin-sdk audio/drums/hydrogen audio/editors/audacity audio/editors/denemo audio/editors/mscore audio/editors/rosegarden audio/effects/jack-rack audio/effects/rakarrack audio/graphics/fontforge audio/graphics/frescobaldi audio/graphics/goocanvas audio/graphics/lilypond audio/graphics/mftrace audio/graphics/potrace audio/graphics/pygoocanvas audio/graphics/t1utils audio/libraries/atkmm audio/libraries/aubio audio/libraries/cairomm audio/libraries/clalsadrv audio/libraries/clthreads audio/libraries/clxclient audio/libraries/dssi audio/libraries/fltk audio/libraries/glibmm audio/libraries/gnonlin audio/libraries/gst-python audio/libraries/gtkmm audio/libraries/gtksourceview audio/libraries/imlib2 audio/libraries/ladspa_sdk audio/libraries/lash audio/libraries/libavc1394 SlackDocs - https://docs.slackware.com/ Last update: 2019/04/24 17:34 (UTC) studioware:applications_list https://docs.slackware.com/studioware:applications_list audio/libraries/libdca audio/libraries/libgnomecanvas audio/libraries/libgnomecanvasmm audio/libraries/libiec61883
    [Show full text]
  • Ardour 3 Download Linux
    Ardour 3 download linux on Linux, OS X and Windows. Get Ardour Now Ardour's core user group: people who want to record, edit, mix and master audio and MIDI projects. When you ​Download · ​The Ardour Manual · ​Ardour Community · ​Features. Just download and run Ardour on your Linux, OS X or Windows computer. But if you're hoping to modify Ardour or get involved in our development process. Before You Start (Linux Edition). Please read EVERYTHING on this page before proceeding to use Ardour. How To Install. If you downloaded source code, these. You can use it to record, edit and mix multi-track audio. You can produce your own CDs, mix video soundtracks, or just experiment with new ideas about music. Download ardour linux packages for ALTLinux, Arch Linux, CentOS, Debian, Fedora, Mageia, OpenMandriva, openSUSE, PCLinuxOS, ROSA, Slackware. Free Download Ardour for Linux - A professional-grade multi-track and multi-channel audio recorder and DAW for Linux and Mac. From Paul Davis: Ardour for Linux features unlimited audio tracks and buses, non-destructive, non-linear editing with unlimited undo, anything-to-anywhere. Anyway, is there a way that I could download Ardour (any of the versions) But in general less than 3% of you do pay. Linux User: Ardour, free digital audio workstation application, has reached the release for almost one month. The new release brings many technical. The big news is, as expected, Ardour 3 will add MIDI recording, .. If you use Linux, you can download the full version from your distro's. In this video, we cover how to install Ardour on Ubuntu Linux.
    [Show full text]
  • DAW Plugins for Web Browsers Jari Kleimola Dept
    DAW Plugins for Web Browsers Jari Kleimola Dept. of Media Technology School of Science, Aalto University Otaniementie 17, Espoo, Finland [email protected] ABSTRACT ScriptProcessor node (or its future AudioWorker reincarnation) A large collection of Digital Audio Workstation (DAW) plugins is for custom DSP development in JavaScript. Unfortunately, available on the Internet in open source form. This paper explores scripting support leads to inevitable performance penalties, which their reuse in browser environments, focusing on hosting options can be mitigated by using Mozilla’s high performance asm.js [6] that do not require manual installation. Two options based on and Emscripten [12] virtual machine as an optimized runtime Emscripten and PNaCl are introduced, implemented, evaluated, platform on top of JavaScript. Google’s Portable Native Client and released as open source. We found that ported DAW effect (PNaCl) technology [4] provides another solution for accelerated and sound synthesizer plugins complement and integrate with the custom DSP development. Instead of compiling C/C++ source Web Audio API, and that the existing preset patch collections code into a subset of JavaScript as in Emscripten, PNaCl employs make the plugins readily usable in online contexts. The latency bitcode modules that are embedded into the webpage, and measures are higher than in native plugin implementations, but translated into native executable form ahead of runtime. expected to reduce with the emerging AudioWorker node. Emscripten/asm.js and PNaCl technologies work directly from the open web and do not require manual installation. Categories and Subject Descriptors Since Emscripten and PNaCl are both based on C/C++ source Information systems~Browsers, Applied computing~Sound and code compilation, reuse of existing codebases in web platforms music computing, Software and its engineering~Real-time systems comes as an additional benefit.
    [Show full text]
  • Ambisonics Plug-In Suite for Production and Performance Usage
    Ambisonics plug-in suite for production and performance usage Matthias KRONLACHNER Institute of Electronic Music and Acoustics, Graz (student) M.K. Ciurlionioˇ g. 5-15 LT - 03104 Vilnius [email protected] Abstract only) plug-in suite offers 3D encoders for 1st and nd th Ambisonics is a technique for the spatialization of 2 order as well as 2D encoders for 5 order. sound sources within a circular or spherical loud- For the plug-ins created in this work, speaker arrangement. This paper presents a suite of the C++ cross-platform programming library Ambisonics processors, compatible with most stan- JUCE5 [Storer, 2012] has been used to develop 1 dard DAW plug-in formats on Linux, Mac OS X audio plug-ins compatible to most DAWs on and Windows. Some considerations about usabil- Linux, Mac OS X and Windows. JUCE is be- ity did result in features of the user interface and automation possibilities, not available in other sur- ing developed and maintained by Julian Storer, round panning plug-ins. The encoder plug-in may be who used it as the base of the DAW Track- connected to a central program for visualisation and tion. JUCE is released under the GNU Public remote control purposes, displaying the current posi- Licence. A commercial license may be acquired tion and audio level of every single track in the DAW. for closed source projects. It is possible to build To enable monitoring of Ambisonics content without JUCE audio processors as LADSPA, VST, AU, an extensive loudspeaker setup, binaural decoders RTAS and AAX plug-ins or as Jack standalone for headphone playback have been implemented.
    [Show full text]
  • Tehnologije in Izvedbe Zvočnih Vtičnikov
    UNIVERZA V LJUBLJANI FAKULTETA ZA RAČUNALNIŠTVO IN INFORMATIKO Jure Turel Tehnologije in izvedbe zvočnih vtičnikov DIPLOMSKO DELO NA UNIVERZITETNEM ŠTUDIJU Mentor: prof. dr. Dušan Kodek Ljubljana, 2010 IZJAVA O AVTORSTVU diplomskega dela Spodaj podpisani Jure Turel, z vpisno številko 63030071, sem avtor diplomskega dela z naslovom: Tehnologije in izvedbe zvočnih vtičnikov S svojim podpisom zagotavljam, da: sem diplomsko delo izdelal samostojno pod mentorstvom prof. dr. Dušana Kodeka so elektronska oblika diplomskega dela, naslov (slov., angl.), povzetek (slov., angl.), ter ključne besede (slov., angl.) identični s tiskano obliko diplomskega dela soglašam z javno objavo elektronske oblike diplomskega dela v zbirki "Dela FRI" V LJUBLJANI, DNE 15.6.2010 PODPIS AVTORJA:__________________ ZAHVALA Zahvaljujem se staršem, še posebej mami, ki mi je študij omogočila in podpirala tudi ob najtežjih trenutkih. Špela, hvala tudi tebi, da si me spodbujala in stala ob strani. Zahvala gre tudi profesorju dr. Dušanu Kodeku za mentorstvo in strokovne nasvete. Kazalo POVZETEK ........................................................................................................................................... 1 ABSTRACT ........................................................................................................................................... 2 1. UVOD ................................................................................................................................................. 3 1.1 CILJI .................................................................................................................................
    [Show full text]