DOCSLIB.ORG

NUMERICAL SOUND SYNTHESIS Ii Numerical Sound Synthesis

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
NUMERICAL SOUND SYNTHESIS Ii Numerical Sound Synthesis NUMERICAL SOUND SYNTHESIS ii Numerical Sound Synthesis Stefan Bilbao November 27, 2007 iii iv Contents Preface xiii 1 Sound Synthesis and Physical Modeling 1 1.1 AbstractDigitalSoundSynthesis . .......... 2 1.1.1 AdditiveSynthesis . .. .. .. .. .. .. .. .. .. .. .. .. .... 3 1.1.2 SubtractiveSynthesis . ..... 5 1.1.3 WavetableSynthesis . .... 5 1.1.4 AMandFMSynthesis.............................. 7 1.1.5 OtherMethods .................................. 8 1.2 PhysicalModeling ................................ ..... 9 1.2.1 LumpedMass-SpringNetworks . ..... 10 1.2.2 ModalSynthesis ................................ .. 11 1.2.3 DigitalWaveguides. .... 13 1.2.4 HybridMethods ................................. 16 1.2.5 DirectNumericalSimulation . ...... 17 1.3 PhysicalModeling: ALargerView . ........ 20 1.3.1 Physical Models as Descended from Abstract Synthesis ............ 20 1.3.2 Connections: Direct Simulation and Other Methods . ........... 21 1.3.3 ComplexityofMusicalSystems . ...... 22 1.3.4 Why? ........................................ 25 2 Time Series and Difference Operators 27 2.1 TimeSeries ...................................... ... 28 2.2 Shift, Difference and AveragingOperators . ............ 29 2.2.1 TemporalWidth ofDifference Operators. ........ 30 2.2.2 CombiningDifferenceOperators . ...... 31 2.2.3 TaylorSeriesandAccuracy . ..... 32 2.2.4 Identities .................................... .. 33 2.3 FrequencyDomainAnalysis . ....... 34 2.3.1 Laplace and z transforms ............................. 34 2.3.2 Frequency Domain Interpretation of Differential and Difference Operators . 35 2.3.3 Recursions and Polynomials in z ......................... 36 2.3.4 Difference Operatorsand Digital Filters . .......... 38 2.4 Energetic Manipulations and Identities . ............. 41 v 2.4.1 Time Derivatives of Products of Functions or Time Series........... 42 2.4.2 ProductIdentities ............................. .... 44 2.4.3 QuadraticForms ................................ .. 44 2.5 Problems ........................................ .. 46 3 The Oscillator 49 3.1 TheSimpleHarmonicOscillator . ........ 50 3.1.1 SinusoidalSolution. ..... 50 3.1.2 Energy........................................ 52 3.1.3 AsFirst-OrderSystem. .... 52 3.1.4 CoupledSystemsofOscillators . ....... 53 3.2 ASimpleScheme................................... ... 53 3.2.1 AsRecursion ................................... 54 3.2.2 Initialization ................................ .... 54 3.2.3 NumericalInstability. ...... 54 3.2.4 FrequencyDomainAnalysis . ..... 55 3.2.5 Accuracy ...................................... 56 3.2.6 EnergyAnalysis ................................ .. 57 3.2.7 ComputationalConsiderations . ....... 58 3.3 OtherSchemes .................................... ... 59 3.3.1 UsingTime-averagingOperators . ....... 59 3.3.2 ASecond-orderFamilyofSchemes . ...... 60 3.3.3 WaveDigitalFilters .. .. .. .. .. .. .. .. .. .. .. .. .... 61 3.3.4 AnExactSolution ............................... .. 64 3.3.5 FurtherMethods ................................ .. 65 3.4 LumpedMass-SpringNetworks . ....... 65 3.5 Loss ............................................ 66 3.5.1 Energy........................................ 67 3.5.2 FiniteDifferenceScheme. ..... 68 3.5.3 NumericalDecayTime. ... 69 3.5.4 AnExactSolution ............................... .. 71 3.6 Sources ......................................... .. 71 3.7 Problems ........................................ .. 72 3.8 ProgrammingExercises . ...... 75 4 The Oscillator in Musical Acoustics 77 4.1 NonlinearOscillators. ........ 78 4.2 LosslessOscillators.. .. .. .. .. .. .. .. .. .. .. .. ........ 78 4.2.1 TheCubicNonlinearOscillator . ....... 79 4.2.2 PowerLawNonlinearities . ..... 82 4.2.3 One-sided Nonlinearities and Collisions: Hammers andMallets ........ 82 4.2.4 Center-limited Nonlinearities . ......... 86 4.3 LossyOscillators ................................ ...... 87 4.3.1 TheBow ...................................... 87 4.3.2 ReedandLipModels .............................. 91 4.4 Problems ........................................ .. 91 vi 4.5 ProgrammingExercises . ...... 93 5 Grid Functions and Finite Difference Operators in One Dimension 95 5.1 PartialDifferentialOperators . .......... 95 5.1.1 ClassificationofPDEs . .... 96 5.1.2 LaplaceandFourierTransforms. ....... 97 5.1.3 Inner Products and Energetic Manipulations . .......... 99 5.2 Grid Functions and Difference Operators in One Dimension .............. 100 5.2.1 Time Difference andAveragingOperators . ........ 101 5.2.2 SpatialDifferenceOperators . ...... 101 5.2.3 Mixed Spatial-Temporal Difference Operators . ........... 102 5.2.4 Interpolation and Spreading Operators . .......... 103 5.2.5 AccuracyofDifferenceOperators . ....... 105 5.2.6 FrequencyDomainInterpretation. ........ 106 5.2.7 Matrix Interpretation of Difference Operators . ............ 108 5.2.8 Boundary Conditions and Imaginary Grid Points . .......... 108 5.2.9 InnerProductsandIdentities . ....... 110 5.2.10 SummationbyParts .. .. .. .. .. .. .. .. .. .. .. .. .. 111 5.2.11 SomeBounds................................... 111 5.2.12 Interpolation and Spreading Revisited . ........... 112 5.3 CoordinateChanges ............................... ..... 112 5.4 Problems ........................................ 113 5.5 ProgrammingExercises . ...... 115 6 The 1D Wave Equation 117 6.1 DefinitionandProperties . ....... 118 6.1.1 LinearArrayofMassesandSprings . ...... 119 6.1.2 Non-dimensionalizedForm. ...... 120 6.1.3 InitialConditions.. .. .. .. .. .. .. .. .. .. .. .. ..... 120 6.1.4 Strikes and Plucks: Time Evolution of Solution . ........... 121 6.1.5 DispersionRelation .. .. .. .. .. .. .. .. .. .. .. .. .... 122 6.1.6 PhaseandGroupVelocity. .... 122 6.1.7 Travelling Wave Solutions . ...... 123 6.1.8 EnergyAnalysis ................................ 123 6.1.9 BoundaryConditions . .. .. .. .. .. .. .. .. .. .. .. .. 124 6.1.10 BoundsonSolutionSize . ..... 126 6.1.11 Modes........................................ 128 6.2 A Simple Finite Difference Scheme . ........ 131 6.2.1 Initialization ................................ .... 132 6.2.2 vonNeumannAnalysis. .. 132 6.2.3 NumericalDispersion . .... 134 6.2.4 Accuracy ...................................... 136 6.2.5 EnergyAnalysis ................................ 137 6.2.6 NumericalBoundaryConditions . ...... 138 6.2.7 Bounds on Solution Size and Numerical Stability . ........... 139 6.2.8 StateSpaceFormandModes . .. 142 vii 6.2.9 OutputandInterpolation . ..... 144 6.2.10 Implementation Details and Computational Requirements........... 145 6.2.11 Digital Waveguide Interpretation . .......... 147 6.3 OtherSchemes .................................... .. 149 6.3.1 A Stencil-width Five Scheme . ..... 149 6.3.2 ACompactImplicitScheme. .... 150 6.4 ModalSynthesis .................................. .... 153 6.5 Loss ............................................ 153 6.5.1 FiniteDifferenceScheme. ..... 154 6.6 A Comparative Study: Physical Modeling Sound Synthesis Methods . 155 6.6.1 Accuracy ...................................... 155 6.6.2 MemoryUse .................................... 155 6.6.3 Precomputation ................................ 156 6.6.4 OperationCount ................................ 156 6.6.5 Stability..................................... 156 6.6.6 GeneralityandFlexibility . ....... 156 6.7 Problems ........................................ 156 6.8 ProgrammingExercises . ...... 159 7 Bars and Linear Strings 161 7.1 TheIdealUniformBar.............................. ..... 161 7.1.1 Dispersion.................................... 162 7.1.2 Energy Analysis and Boundary Conditions . ........ 163 7.1.3 Modes........................................ 164 7.1.4 A Simple Finite Difference Scheme . ...... 166 7.1.5 AnImplicitScheme .............................. 170 7.2 StiffStrings..................................... .... 172 7.2.1 EnergyandBoundaryConditions. ...... 173 7.2.2 Modes........................................ 174 7.2.3 FiniteDifferenceSchemes . ..... 174 7.3 FrequencyDependentLoss. ....... 175 7.3.1 EnergyandBoundaryConditions. ...... 177 7.3.2 FiniteDifferenceSchemes . ..... 177 7.4 CouplingwithBowModels .. .. .. .. .. .. .. .. .. .. .. ..... 178 7.5 Coupling with Hammer and Mallet Models . ........ 180 7.6 MultipleStrings ................................. ..... 181 7.7 PreparedStrings ................................. ..... 183 7.7.1 SpringsandDampers ............................. 183 7.7.2 Masses........................................ 187 7.7.3 RattlingElements .............................. .. 188 7.8 CoupledStringsandBars . ...... 188 7.8.1 ConnectionTypes ............................... 190 7.8.2 FiniteDifferenceSchemes . ..... 191 7.9 Spatial Variation and Stretched Coordinates . .............. 193 7.9.1 StringsofVaryingDensity. ...... 193 7.9.2 BarsofVaryingCross-sectionalArea . ......... 196 viii 7.10Problems ....................................... .. 199 7.11 ProgrammingExercises . ....... 201 8 Nonlinear String Vibration 203 8.1 TheKirchhoff-CarrierStringModel. .......... 203 8.1.1 Amplitude-dependent Pitch . ...... 204 8.1.2 Energy Analysis and Boundary Conditions . ........ 205 8.1.3 FiniteDifferenceSchemes . ..... 205 8.1.4 AQuasi-modalForm.............................. 208 8.1.5 LossandPitchGlides ............................ .. 209 8.1.6 ADigitalWaveguideForm . .. 209 8.1.7 ANonlinearBarModel ............................ 209 8.2 General Planar Nonlinear String Motion . ........... 209 8.2.1 Coupling Between Transverse and Longitudinal Modes and Phantom Partials
Load more

Recommended publications
  • Granular Synthesis and Physical Modeling with This Manual Is Released Under the Creative Commons Attribution 3.0 Unported License
    Granular synthesis and physical modeling with This manual is released under the Creative Commons Attribution 3.0 Unported License. You may copy, distribute, transmit and adapt it, for any purpose, provided you include the following attribution: Kaivo and the Kaivo manual by Madrona Labs. http://madronalabs.com. Version 1.3, December 2016. Written by George Cochrane and Randy Jones. Illustrated by David Chandler. Typeset in Adobe Minion using the TEX document processing system. Any trademarks mentioned are the sole property of their respective owners. Such mention does not imply any endorsement of or associa- tion with Madrona Labs. Introduction “The future evolution of virtual devices is less constrained than that of real devices.” –Julius O. Smith Kaivo is a software instrument combining two powerful synthesis techniques (physical modeling and granular synthesis) in an easy-to- use semi-modular package. It’s laid out a bit like an acoustic instru- For more information on the theory be- ment; the GRANULATOR module acts like the player’s touch, exciting hind Kaivo, see Chapter 1, “Physi-who? Granu-what?” one or more tuned objects (here, the RESONATOR module, based on physical models of resonant objects) that come together in a central resonating body (the BODY module, also physics-based). This allows for a natural (or uncanny) sense of space, pleasing in- teractions between voices, and a ton of expressive potential—all traits in short supply in digital synthesis. The acoustic comparison begins to pale when you realize that your “touch” is really a granular sam- ple player with scads of options, and that the physical properties of the resonating modules are widely variable, and in real time.
    [Show full text]
  • The Sonification Handbook Chapter 9 Sound Synthesis for Auditory Display
    The Sonification Handbook Edited by Thomas Hermann, Andy Hunt, John G. Neuhoff Logos Publishing House, Berlin, Germany ISBN 978-3-8325-2819-5 2011, 586 pages Online: http://sonification.de/handbook Order: http://www.logos-verlag.com Reference: Hermann, T., Hunt, A., Neuhoff, J. G., editors (2011). The Sonification Handbook. Logos Publishing House, Berlin, Germany. Chapter 9 Sound Synthesis for Auditory Display Perry R. Cook This chapter covers most means for synthesizing sounds, with an emphasis on describing the parameters available for each technique, especially as they might be useful for data sonification. The techniques are covered in progression, from the least parametric (the fewest means of modifying the resulting sound from data or controllers), to the most parametric (most flexible for manipulation). Some examples are provided of using various synthesis techniques to sonify body position, desktop GUI interactions, stock data, etc. Reference: Cook, P. R. (2011). Sound synthesis for auditory display. In Hermann, T., Hunt, A., Neuhoff, J. G., editors, The Sonification Handbook, chapter 9, pages 197–235. Logos Publishing House, Berlin, Germany. Media examples: http://sonification.de/handbook/chapters/chapter9 18 Chapter 9 Sound Synthesis for Auditory Display Perry R. Cook 9.1 Introduction and Chapter Overview Applications and research in auditory display require sound synthesis and manipulation algorithms that afford careful control over the sonic results. The long legacy of research in speech, computer music, acoustics, and human audio perception has yielded a wide variety of sound analysis/processing/synthesis algorithms that the auditory display designer may use. This chapter surveys algorithms and techniques for digital sound synthesis as related to auditory display.
    [Show full text]
  • Combining Granular Synthesis with Frequency Modulation
    Combining granular synthesis with frequency modulation. Kim ERVIK Øyvind BRANDSEGG Department of music Department of music University of Science and Technology University of Science and Technology Norway Norway [email protected] [email protected] Abstract acoustical events. Sound as particles has been Both granular synthesis and frequency used in applications like independent time and modulation are well-established synthesis pitch scaling, formant modification, analog synth techniques that are very flexible. This paper modeling, clouds of sound, granular delays and will investigate different ways of combining reverbs, etc [3]. Examples of granular synthesis the two techniques. It will describe the rules parameters are density, grain pitch, grain duration, of spectra that emerge when combining, compare it to similar synthesis techniques and grain envelope, the global arrangement of the suggest some aesthetic perspectives on the grains, and of course the content of the grains matter. (which can be a synthetic waveform or sampled sound). Granular synthesis gives the musician vast Keywords expressive possibilities [10]. Granular synthesis, frequency modulation, 1.3 FM synthesis partikkel, csound, sound synthesis Frequency modulation has been a known method of coding audio into radio signal since the beginning of commercial radio. In 1964 that John Chowning discovered the implication of frequency modulation of audio working on synthesis of brass instrument at Stanford [2]. He discovered that modulating the frequency resulted in sideband emerging from the carrier frequency. Fig 1:Grain Pitch modulation Yamaha later implemented the technique in the hugely successful DX7. 1 Introduction If we consider FM synthesis using sinusoidal carrier and modulation oscillator, the spectral 1.1 Method components present in a FM sound can be mathematically stated as in figure 2.
    [Show full text]
  • Neural Granular Sound Synthesis
    Neural Granular Sound Synthesis Adrien Bitton Philippe Esling Tatsuya Harada IRCAM, CNRS UMR9912 IRCAM, CNRS UMR9912 The University of Tokyo, RIKEN Paris, France Paris, France Tokyo, Japan [email protected] [email protected] [email protected] ABSTRACT Granular sound synthesis is a popular audio generation technique based on rearranging sequences of small wave- resynthesis generated sequence match decode form windows. In order to control the synthesis, all grains grains in a given corpus are analyzed through a set of acoustic continuous + f(↵) descriptors. This provides a representation reflecting some discrete + condition + form of local similarities across the grains. However, the grain space + quality of this grain space is bound by that of the descrip- + + + grain tors. Its traversal is not continuously invertible to signal grain + + latent space sample and does not render any structured temporality. library dz acoustic R We demonstrate that generative neural networks can im- analysis encode plement granular synthesis while alleviating most of its target signal shortcomings. We efficiently replace its audio descriptor input basis by a probabilistic latent space learned with a Vari- signal ational Auto-Encoder. In this setting the learned grain space is invertible, meaning that we can continuously syn- thesize sound when traversing its dimensions. It also im- Figure 1. Left: A grain library is analysed and scattered (+) into the acoustic dimensions. A target is defined, by analysing an other signal (o) plies that original grains are not stored for synthesis. An- or as a free trajectory, and matched to the library through the acoustic other major advantage of our approach is to learn struc- descriptors.
    [Show full text]
  • Concatenative Sound Synthesis: the Early Years
    CONCATENATIVE SOUND SYNTHESIS: THE EARLY YEARS Diemo Schwarz Ircam – Centre Pompidou 1, place Igor-Stravinsky, 75003 Paris, France http://www.ircam.fr/anasyn/schwarz http://concatenative.net [email protected] ABSTRACT Concatenative sound synthesis (CSS) methods use a large database of source sounds, segmented into units, Concatenative sound synthesis is a promising method and a unit selection algorithm that finds the sequence of of musical sound synthesis with a steady stream of work units that match best the sound or phrase to be synthe- and publications for over five years now. This article of- sised, called the target. The selection is performed ac- fers a comparative survey and taxonomy of the many dif- cording to the descriptors of the units, which are charac- ferent approaches to concatenative synthesis throughout teristics extracted from the source sounds, or higher level the history of electronic music, starting in the 1950s, even descriptors attributed to them. The selected units can then if they weren't known as such at their time, up to the recent be transformed to fully match the target specification, and surge of contemporary methods. Concatenative sound are concatenated. However, if the database is sufficiently synthesis methods use a large database of source sounds, large, the probability is high that a matching unit will be segmented into units, and a unit selection algorithm that found, so the need to apply transformations, which always finds the units that match best the sound or musical phrase degrade sound quality, is reduced. The units can be non- to be synthesised, called the target. The selection is per- uniform (heterogeneous), i.e.
    [Show full text]
  • Chroma Palette: Chromatic Maps of Sound As Granular Synthesis
    Proceedings of the 2007 Conference on New Interfaces for Musical Expression (NIME07), New York, NY, USA Chroma Palette: Chromatic Maps of Sound As Granular Synthesis Interface Justin Donaldson Ian Knopke Chris Raphael Indiana University School of Indiana University School of Indiana University School of Informatics Informatics Informatics 1900 E. 10th Street, Room 931 1900 E. 10th Street, Room 932 1900 E. 10th Street, Room 933 Bloomington, IN 47406 Bloomington, IN 47406 Bloomington, IN 47406 [email protected] [email protected] [email protected] ABSTRACT There are many different categories of granular synthesis, Chroma based representations of acoustic phenomenon are such as synchronous, quasi-synchronous, and asynchronous representations of sound as pitched acoustic energy. A frame- forms, referring to the regularity with which grains are wise chroma distribution over an entire musical piece is a useful reassembled. Grains are usually windowed, both to aid resynthesis and straightforward representation of its musical pitch over time. and to avoid audible clicks. However, the choice of window This paper examines a method of condensing the block-wise function can also have a pronounced effect on the resulting timbre chroma information of a musical piece into a two dimensional and is an important component of the synthesis process. Granular embedding. Such an embedding is a representation or map of the synthesis has similarities to other common analysis/resynthesis different pitched energies in a song, and how these energies relate methodologies such as the short-term Fourier transform and to each other in the context of the song. The paper presents an wavelet-based techniques. Figure 1 shows an example of an interactive version of this representation as an exploratory envelope windowing and overlap arrangement for four different analytical tool or instrument for granular synthesis.
    [Show full text]
  • Physically-Based Parametric Sound Synthesis and Control
    Physically-Based Parametric Sound Synthesis and Control Perry R. Cook Princeton Computer Science (also Music) Course Introduction Parametric Synthesis and Control of Real-World Sounds for virtual reality games production auditory display interactive art interaction design Course #2 Sound - 1 Schedule 0:00 Welcome, Overview 0:05 Views of Sound 0:15 Spectra, Spectral Models 0:30 Subtractive and Modal Models 1:00 Physical Models: Waveguides and variants 1:20 Particle Models 1:40 Friction and Turbulence 1:45 Control Demos, Animation Examples 1:55 Wrap Up Views of Sound • Sound is a recorded waveform PCM playback is all we need for interactions, movies, games, etc. (Not true!!) • Time Domain x( t ) (from physics) • Frequency Domain X( f ) (from math) • Production what caused it • Perception our image of it Course #2 Sound - 2 Views of Sound Time Domain is most closely related to Production Frequency Domain is most closely related to Perception we will see that many hybrids abound Views of Sound: Time Domain Sound is produced/modeled by physics, described by quantities of • Force force = mass * acceleration • Position x(t) actually < x(t), y(t), z(t) > • Velocity Rate of change of position dx/dt • Acceleration Rate of change of velocity dv/dt Examples: Mass+Spring+Damper Wave Equation Course #2 Sound - 3 Mass/Spring/Damper F = ma = - ky - rv - mg F = ma = - ky - rv (if gravity negligible) d 2 y r dy k + + y = 0 dt2 m dt m ( ) D2 + Dr / m + k / m = 0 2nd Order Linear Diff Eq. Solution 1) Underdamped: -t/τ ω y(t) = Y0 e cos( t ) exp.
    [Show full text]
  • Soft Sound: a Guide to the Tools and Techniques of Software Synthesis
    California State University, Monterey Bay Digital Commons @ CSUMB Capstone Projects and Master's Theses Spring 5-20-2016 Soft Sound: A Guide to the Tools and Techniques of Software Synthesis Quinn Powell California State University, Monterey Bay Follow this and additional works at: https://digitalcommons.csumb.edu/caps_thes Part of the Other Music Commons Recommended Citation Powell, Quinn, "Soft Sound: A Guide to the Tools and Techniques of Software Synthesis" (2016). Capstone Projects and Master's Theses. 549. https://digitalcommons.csumb.edu/caps_thes/549 This Capstone Project is brought to you for free and open access by Digital Commons @ CSUMB. It has been accepted for inclusion in Capstone Projects and Master's Theses by an authorized administrator of Digital Commons @ CSUMB. Unless otherwise indicated, this project was conducted as practicum not subject to IRB review but conducted in keeping with applicable regulatory guidance for training purposes. For more information, please contact [email protected]. California State University, Monterey Bay Soft Sound: A Guide to the Tools and Techniques of Software Synthesis Quinn Powell Professor Sammons Senior Capstone Project 23 May 2016 Powell 2 Introduction Edgard Varèse once said: “To stubbornly conditioned ears, anything new in music has always been called noise. But after all, what is music but organized noises?” (18) In today’s musical climate there is one realm that overwhelmingly leads the revolution in new forms of organized noise: the realm of software synthesis. Although Varèse did not live long enough to see the digital revolution, it is likely he would have embraced computers as so many millions have and contributed to these new forms of noise.
    [Show full text]
  • The Evolution of Granular Synthesis: an Overview of Current Research
    International Symposium on The Creative and Scientific Legacies of Iannis Xenakis, 8-10 June 2006, University of Guelph, Toronto, Canada ________________________________________________________ The evolution of granular synthesis: an overview of current research Curtis Roads Media Arts and Technology University of California Santa Barbara CA 93106-6065 USA 9 June 2006 This lecture presents an overview of several projects pursued over the past five years in our laboratories at Santa Barbara. All this research is based on a scientific model of sound initially proposed by Dennis Gabor (1946), and soon afterward extended to music by Iannis Xenakis (1960). Granular analysis (also called atomic decomposition) and granular synthesis have evolved over more than five decades from a paper theory and primitive experiments into a broad range of applied techniques. Specific to the granular model is its focus on the microacoustic time scale (typically 1 to 100 ms). Granular methods treat sound as a stream of acoustic particles in both the time domain and the time-frequency (TF) domain. For more details, see Roads (2002; Kling, et al. 2005). In this lecture, I first very briefly trace the history of the idea of sound particles. Next I will demonstrate PulsarGenerator, an application developed by Alberto de Campo and me in 2001 for a specific type of particle synthesis with links to past analog techniques. I will also demonstrate the SweepingQGranulator, a tool that I wrote in the SuperCollider language for the microfiltration of granulated sound. The latest threads in this line of research go in two directions. The first is a time-frequency analysis method known as matching pursuit decomposition.
    [Show full text]
  • Morphing of Granular Sounds
    Proc. of the 18th Int. Conference on Digital Audio Effects (DAFx-15), Trondheim, Norway, Nov 30 - Dec 3, 2015 MORPHING OF GRANULAR SOUNDS Sadjad Siddiq Advanced Technology Division, Square Enix Co., Ltd. Tokyo, Japan [email protected] ABSTRACT Granular sounds are commonly used in video games but the con- ventional approach of using recorded samples does not allow sound designers to modify these sounds. In this paper we present a tech- nique to synthesize granular sound whose tone color lies at an arbi- trary point between two given granular sound samples. We first ex- tract grains and noise profiles from the recordings, morph between them and finally synthesize sound using the morphed data. Dur- ing sound synthesis a number of parameters, such as the number of grains per second or the loudness distribution of the grains, can be altered to vary the sound. The proposed method does not only al- low to create new sounds in real-time, it also drastically reduces the Figure 1: Summary of granular synthesis. Grains are at- memory footprint of granular sounds by reducing a long recording tenuated and randomly added to the final mix. to a few hundred grains of a few milliseconds length each. simplest case their amplitude is attenuated randomly. Depending 1. INTRODUCTION on the probability distribution of the attenuation factors, this can 1.1. Granular synthesis in video games have a very drastic effect on the granularity and tone color of the produced sound. For a more detailed introduction to granular syn- In previous work we described the morphing between simple im- thesis refer to [4] or [5].
    [Show full text]
  • CM3106 Chapter 5: Digital Audio Synthesis
    CM3106 Chapter 5: Digital Audio Synthesis Prof David Marshall [email protected] and Dr Kirill Sidorov [email protected] www.facebook.com/kirill.sidorov School of Computer Science & Informatics Cardiff University, UK Digital Audio Synthesis Some Practical Multimedia Digital Audio Applications: Having considered the background theory to digital audio processing, let's consider some practical multimedia related examples: Digital Audio Synthesis | making some sounds Digital Audio Effects | changing sounds via some standard effects. MIDI | synthesis and effect control and compression Roadmap for Next Few Weeks of Lectures CM3106 Chapter 5: Audio Synthesis Digital Audio Synthesis 2 Digital Audio Synthesis We have talked a lot about synthesising sounds. Several Approaches: Subtractive synthesis Additive synthesis FM (Frequency Modulation) Synthesis Sample-based synthesis Wavetable synthesis Granular Synthesis Physical Modelling CM3106 Chapter 5: Audio Synthesis Digital Audio Synthesis 3 Subtractive Synthesis Basic Idea: Subtractive synthesis is a method of subtracting overtones from a sound via sound synthesis, characterised by the application of an audio filter to an audio signal. First Example: Vocoder | talking robot (1939). Popularised with Moog Synthesisers 1960-1970s CM3106 Chapter 5: Audio Synthesis Subtractive Synthesis 4 Subtractive synthesis: Simple Example Simulating a bowed string Take the output of a sawtooth generator Use a low-pass filter to dampen its higher partials generates a more natural approximation of a bowed string instrument than using a sawtooth generator alone. 0.5 0.3 0.4 0.2 0.3 0.1 0.2 0.1 0 0 −0.1 −0.1 −0.2 −0.2 −0.3 −0.3 −0.4 −0.5 −0.4 0 2 4 6 8 10 12 14 16 18 20 0 2 4 6 8 10 12 14 16 18 20 subtract synth.m MATLAB Code Example Here.
    [Show full text]
  • Implementing Real-Time Granular Synthesis Ross Bencina Draft of 31St August 2001
    Copyright ©2000-2001 Ross Bencina, All rights reserved. Implementing Real-Time Granular Synthesis Ross Bencina Draft of 31st August 2001. Overview This article describes a flexible architecture for Real-Time Granular Synthesis that accommodates a number of Granular Synthesis variants including Tapped Delay Line, Stored Sample and Synthetic Grain Granular Synthesis in both Pitch Synchronous and Asynchronous forms. Three efficient algorithms for generating grain envelopes are reviewed and two methods for generating stochastic grain onset times are discussed. Readers are advised to consult the literature for further information on the theory and applications of Granular Synthesis.1, 2, 3,4,5 Background Granular Synthesis or Granulation is a flexible method for creating animated sonic textures. Sounds produced by granular synthesis have an organic quality sometimes reminiscent of sounds heard in nature: the sound of a babbling brook, or leaves rustling in a tree. Forms of granular processing involving sampled sound may be used to create time stretching, time freezing, time smearing, pitch shifting and pitch smearing effects. Perceptual continua for granular sounds include gritty / smooth and dense / sparse. The metaphor of sonic clouds has been used to describe sounds generated using Granular Synthesis. By varying synthesis parameters over time, gestures evocative of accumulation / dispersal, and condensation / evaporation may be created. The output of a Granular Synthesizer or Granulator is a mixture of many individual grains of sound. The sonic quality of a granular texture is a result of the distribution of grains in time and of the parameters selected for the synthesis of each grain. Typically, grains are quite short in duration and are often distributed densely in time so that the resultant sound is perceived as a fused texture.
    [Show full text]