Future Spatial Audio: Subjective Evaluation of 3D Surround Systems

Total Page:16

File Type:pdf, Size:1020Kb

Future Spatial Audio: Subjective Evaluation of 3D Surround Systems Future Spatial Audio: Subjective Evaluation of 3D Surround Systems Paul James Power Acoustics Research Centre School of Computing, Science and Engineering College of Science and Technology University of Salford, Salford, UK Submitted in Partial Fulfilment of The Requirements of The Degree of Doctor of Philosophy Contents 1 Introduction ................................................................................................................................... 1 1.1 Perceptual Benefits of the Inclusion of Surround Channels ................................................... 1 1.1 Approach ................................................................................................................................. 2 1.2 Research Objectives ................................................................................................................ 3 1.3 Organisation of the Thesis ...................................................................................................... 4 1.4 Contributions to the Field ....................................................................................................... 6 2 Literature Review ......................................................................................................................... 8 2.1 History of Surround Systems .................................................................................................. 8 2.2 Surround With Height ............................................................................................................. 9 2.3 Spatial Rendering Methods in 3D Audio .............................................................................. 10 2.4 Perceptual Cues ..................................................................................................................... 11 2.5 Summary ............................................................................................................................... 16 2.6 Recording Localization Judgements ..................................................................................... 17 2.7 Summary ............................................................................................................................... 18 2.8 Localisation in Reproduced Sound ....................................................................................... 18 2.9 Summary ............................................................................................................................... 22 2.10 Number of Channels and Positioning in 3D Surround Systems and its Impact on Envelopment ..................................................................................................................................... 23 2.11 Spatial Audio Quality in 3D Surround .................................................................................. 25 2.12 Summary ............................................................................................................................... 31 2.13 Initial Area for Investigation ................................................................................................. 32 3 Surround Sound Development ................................................................................................... 33 3.1 Introduction ........................................................................................................................... 33 3.2 Development of Spatial Audio Systems ............................................................................... 33 3.2.1 Mono ............................................................................................................................. 33 3.2.2 Binaural ......................................................................................................................... 33 3.2.3 Stereo ............................................................................................................................ 34 3.2.4 Quadraphonics .............................................................................................................. 36 3.2.5 5.1 Surround .................................................................................................................. 37 ii 3.2.6 Summary ....................................................................................................................... 39 3.3 Surround With Height ........................................................................................................... 39 3.3.1 NHK 22.2 ...................................................................................................................... 39 3.3.2 Dolby Pro Logic IIz ...................................................................................................... 40 3.3.3 10.2 ................................................................................................................................ 41 3.3.4 Dolby Atmos ................................................................................................................. 43 3.3.5 Summary ....................................................................................................................... 43 3.4 Spatializing Methods for 3D Reproduction .......................................................................... 44 3.4.1 Vector Base Amplitude Panning ................................................................................... 44 3.5 Ambisonic Encoding/Decoding ............................................................................................ 46 3.5.1 Introduction ................................................................................................................... 46 3.5.2 Ambisonic Encoding ..................................................................................................... 47 3.5.3 SoundField Microphone ................................................................................................ 47 3.5.4 Eigenmike ..................................................................................................................... 48 3.5.5 Theoretical Encoding .................................................................................................... 49 3.5.6 Resolution of Different Ambisonic Orders ................................................................... 51 3.5.7 Decoder Types .............................................................................................................. 53 3.5.8 Dual Band Decoder ....................................................................................................... 55 3.5.9 Limits to Correct Soundfield Reconstruction ............................................................... 56 3.5.10 Near Field Compensation .............................................................................................. 56 3.5.11 Speaker Array Configuration ........................................................................................ 56 3.5.12 Platonic Solids .............................................................................................................. 57 3.5.13 Irregular Layouts ........................................................................................................... 58 3.5.14 With Height Irregular Layout Solutions ....................................................................... 58 3.6 Normalisation Schemes......................................................................................................... 58 3.6.1 FurseMalham (FuMa) ................................................................................................... 59 3.6.2 N3D ............................................................................................................................... 59 3.6.3 SN3D ............................................................................................................................. 59 3.7 Summary ............................................................................................................................... 60 iii 3.8 Human Hearing Mechanisms in Spatial Audio ..................................................................... 61 3.8.1 Median Plane ................................................................................................................ 62 3.8.2 Frontal Plane ................................................................................................................. 63 3.8.3 Cone of Confusion ........................................................................................................ 64 3.8.4 Precedence Effect .......................................................................................................... 64 3.8.5 Masking ......................................................................................................................... 65 3.8.6 Summary ....................................................................................................................... 67 3.9 Assessment of Spatial Audio Quality ................................................................................... 67 3.9.1 Spatial Impression in Concert Hall Acoustics .............................................................. 71 3.10 Purpose of Spatial Audio Systems ........................................................................................ 71 3.10.1 Objective Measures ....................................................................................................... 72 3.10.2 Importance of the Direction of Reflections in Concert Hall Acoustics in Terms
Recommended publications
  • Developing Sound Spatialization Tools for Musical Applications with Emphasis on Sweet Spot and Off-Center Perception
    Sweet [re]production: Developing sound spatialization tools for musical applications with emphasis on sweet spot and off-center perception Nils Peters Music Technology Area Department of Music Research Schulich School of Music McGill University Montreal, QC, Canada October 2010 A thesis submitted to McGill University in partial fulfillment of the requirements for the degree of Doctor of Philosophy. c 2010 Nils Peters 2010/10/26 i Abstract This dissertation investigates spatial sound production and reproduction technology as a mediator between music creator and listener. Listening experiments investigate the per- ception of spatialized music as a function of the listening position in surround-sound loud- speaker setups. Over the last 50 years, many spatial sound rendering applications have been developed and proposed to artists. Unfortunately, the literature suggests that artists hardly exploit the possibilities offered by novel spatial sound technologies. Another typical drawback of many sound rendering techniques in the context of larger audiences is that most listeners perceive a degraded sound image: spatial sound reproduction is best at a particular listening position, also known as the sweet spot. Structured in three parts, this dissertation systematically investigates both problems with the objective of making spatial audio technology more applicable for artistic purposes and proposing technical solutions for spatial sound reproductions for larger audiences. The first part investigates the relationship between composers and spatial audio tech- nology through a survey on the compositional use of spatialization, seeking to understand how composers use spatialization, what spatial aspects are essential and what functionali- ties spatial audio systems should strive to include. The second part describes the development process of spatializaton tools for musical applications and presents a technical concept.
    [Show full text]
  • 1 Luigi Nono's Transformation, Creation, and Discovery of Musical Space
    Luigi Nono's transformation, creation, and discovery of musical space Hyun Höchsmann [Visiting Professor, East China Normal University, Shanghai] Abstract: It is the inaudible, the unheard that does not fill the space but discovers the space, uncovers the space as if we too have become part of sound and we were sounding ourselves (Luigi Nono). Emphasising the necessity for contemporary music to 'intervene in the sonic reality of our time', Nono strove to expand the conception of musical space in three directions: the transformation of non-musical space with the performance of his music in factories and prisons, the creation of a new musical space for the opera, Prometeo, and the discovery of the inner musical space of sound and silence, 'the inaudible, the unheard', in which we 'become part of sound' and we are 'sounding ourselves'. Nono aimed at 'the composition of music that wants to restore infinite possibilities in listening today, by use of non- geometrical space'. With the conception of opera as 'azione scenica' (stage activity) and a 'theatre of consciousness', Nono's 'musical space' for the performance of Prometeo was realised within a colossal wooden structure (by Renzo Piano) combining the stage, the set, and the orchestra pit into a single element. With the conviction that it is the composer's and the listener's responsibility to recognise how every sound is politically charged by its historical associations, Nono affirmed the simultaneity of musical invention and moral commitment and political action for justice and freedom. _____________________________________________ 'A new way of thinking music' To wake up the ear, the eyes, human thinking, intelligence, the most exposed inwardness.
    [Show full text]
  • Teaching Post-Tonal Music to Twenty-First- Century Students Author(S): Miguel A
    Department of Music Theory, Jacobs School of Music, Indiana University A Pedagogical and Psychological Challenge: Teaching Post-Tonal Music to Twenty-First- Century Students Author(s): Miguel A. Roig-Francolí Source: Indiana Theory Review, Vol. 33, No. 1-2 (Summer 2017), pp. 36-68 Published by: Indiana University Press on behalf of the Department of Music Theory, Jacobs School of Music, Indiana University Stable URL: https://www.jstor.org/stable/10.2979/inditheorevi.33.1-2.02 Accessed: 03-09-2018 01:27 UTC JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about JSTOR, please contact [email protected]. Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at https://about.jstor.org/terms Indiana University Press, Department of Music Theory, Jacobs School of Music, Indiana University are collaborating with JSTOR to digitize, preserve and extend access to Indiana Theory Review This content downloaded from 129.74.250.206 on Mon, 03 Sep 2018 01:27:00 UTC All use subject to https://about.jstor.org/terms A Pedagogical and Psychological Challenge: Teaching Post-Tonal Music to Twenty-First-Century Students Miguel A. Roig-Francolí University of Cincinnati ost-tonal music has a pr problem among young musicians, and many not-so-young ones. Anyone who has recently taught a course on the theory and analysis of post-tonal music to a general Pmusic student population mostly made up of performers, be it at the undergraduate or master’s level, will probably immediately understand what the title of this article refers to.
    [Show full text]
  • The Composition and Performance of Spatial Music
    The Composition and Performance of Spatial Music A dissertation submitted to the University of Dublin for the degree of Doctor of Philosophy Enda Bates Trinity College Dublin, August 2009. Department of Music & Department of Electronic and Electrical Engineering Trinity College Dublin Declaration I hereby declare that this thesis has not been submitted as an exercise for a degree at this or any other University and that it is entirely my own work. I agree that the Library may lend or copy this thesis upon request. Signed, ___________________ Enda Bates ii Summary The use of space as a musical parameter is a complex issue which involves a number of different, yet interrelated factors. The technical means of performance, the sonic material, and the overall musical aesthetic must all work in tandem to produce a spatial impression in the listener which is in some way musically significant. Performances of spatial music typically involve a distributed audience and often take place in an acoustically reverberant space. This situation is quite different from the case of a single listener at home, or the composer in the studio. As a result, spatial strategies which are effective in this context may not be perceived correctly when transferred to a performance venue. This thesis examines these complex issues in terms of both the technical means of spatialization, and the compositional approach to the use of space as a musical parameter. Particular attention will be paid to the effectiveness of different spatialization techniques in a performance context, and what this implies for compositional strategies which use space as a musical parameter.
    [Show full text]
  • 2013-Pressrelease-OKTOPHONIE
    Park Avenue Armory Adds Two Performances for Karlheinz Stockhausen’s electronic masterpiece OKTOPHONIE, presented in a lunar environment created by Rirkrit Tiravanija Due to Overwhelming Demand Additional Performances Added, March 23 & 25 New York, NY—February 28, 2013—Due to overwhelming initial demand stemming from the 2013 artistic season announcement, Park Avenue Armory announced today the addition of two performances of the New York premiere of Karlheinz Stockhausen’s OKTOPHONIE. Part of Stockhausen’s magnum opus “Licht” (or “Light”) OKTOPHONIE is a trailblazing electronic music experience where the audience is surrounded by eight groups of loudspeakers, enveloping them in a sonic environment. OKTOPHONIE, which will be performed by one of his original collaborators Kathinka Pasveer, exemplifies Stockhausen’s work as a compositional pioneer who grappled with spatial music as he bent the rules and redefined the listening experience. Staging the work as the composer originally intended—in outer space—Rirkrit Tiravanija has been commissioned by the Armory to create a ritualized lunar experience, a floating seating installation within the Armory’s soaring drill hall that heightens the listeners’ octophonic experience and transports them to another realm. The audience will don white cloaks for the journey, carried along by the all- encompassing score, itself a meditation on the transformation from plunging darkness into blinding light. The Armory’s 2013 season will also include WS, a monumental installation by Paul McCarthy; The Machine, a play by one of Britain’s fastest rising young playwrights, Matt Charman, that chronicles Garry Kasparov’s 1997 chess game against IBM’s Deep Blue super-computer, a contest that set man against machine; Massive Attack V Adam Curtis, a new kind of imaginative experience conceived by Adam Curtis and Robert Del Naja mixing music, film, politics, and moments of illusion, performed by Massive Attack and special guests; and Robert Wilson’s powerful new staging of The Life and Death of Marina Abramović.
    [Show full text]
  • Framing Spatial Music: Approaching Spatialisation Through ‘Musical Paintings’
    Framing Spatial Music: Approaching spatialisation through ‘musical paintings’. I. Costabile Postgraduate Researcher at the Department of Music, University of Liverpool Keywords: Spatial music, mixed-media, sound art Abstract. This paper presents an on-going project that is concerned with the development of new formats for the exhibition of mixed-media and spatial music works in art galleries. This project was developed as part of practice-based research in composition that investigates new aesthetic possibilities of sound spatialisation. A variety of unique spaces have been designed to the experience of sound spatialisation in galleries, from Bernhard Leitner’s architectural works in the 1970s to the present, where a variety of multichannel installations continue to be exhibited worldwide. The dimensions of these spaces can be extensive, requiring the use of many loudspeakers, but it can also be minimal. This new project focuses on the latter possibility, taking as a starting point the aesthetics of traditional painting. It attempts to recreate an analogy to the spatialisation of visual objects inside a frame, exchanging visual material for sound. A ‘musical painting’, a term suggested by the author due to its hybrid form, is composed by the spatialisation of sound inside a small area, in which the spectators position themselves in front of the sound field to experience the composition. These pieces are comprised of an array of loudspeakers and a compact multichannel system hidden behind a canvas. This approach offers a range of possibilities to the field of composition and sound art, as it can be representative (e.g. soundscapes), performative, interactive or conceptual.
    [Show full text]
  • History of 3D Sound
    HISTORY OF 3D SOUND BRAXTON BOREN American University Introduction The history of 3D sound is complicated by the fact that, despite how much the concept may appear to be a late-20th century technological buzzword, it is not at all new. Indeed, just as Jens Blauert famously reminded us that “there is no non-spatial hearing” (Blauert, 1997), so too due to the nature of our world all sound is inherently three-dimensional (Begault, 2000). For the majority of human history the listener – the hunter in the field, a singing congregant within a cavernous stone church, or the audience member at a live performance – perceived sound concomitantly with its spatial setting. In this sense it is the late-20th century view that is out of step with historical sound perception. The advent of audio recording in the 19th century led to the development of zero-dimensional (mono) sound, and later one-dimensional (stereo), and two-dimensional (quad and other surround formats) reproduction techniques. Due to the greater sensitivity of the human auditory system along the horizontal plane, early technology understandably focused on this domain. Our capability to mechanically synthesize full 3D auditory environments is relatively recent, compared to our long history of shaping sound content and performance spaces. The effect of physical space is not limited to the perceived physical locations of sounds – different spaces can also affect music in the time domain (e.g. late reflection paths) or frequency 1 domain (by filtering out high-frequency content). Often a listener’s experience of a space’s effect on sound – such as singing in the shower or listening to a choir in a reverberant stone church – is describing primarily non-localized qualities, which could be captured more or less in a monaural recording.
    [Show full text]
  • Exploring Compositional Relationships Between Acousmatic Music and Electronica
    Exploring compositional relationships between acousmatic music and electronica Ben Ramsay Submitted in partial fulfilment of the requirements for the degree of Doctor of Philosophy De Montfort University Leicester 2 Table of Contents Abstract ................................................................................................................................. 4 Acknowledgements ............................................................................................................... 5 DVD contents ........................................................................................................................ 6 CHAPTER 1 ......................................................................................................................... 8 1.0 Introduction ................................................................................................................ 8 1.0.1 Research imperatives .......................................................................................... 11 1.0.2 High art vs. popular art ........................................................................................ 14 1.0.3 The emergence of electronica ............................................................................. 16 1.1 Literature Review ......................................................................................................... 18 1.1.1 Materials .............................................................................................................. 18 1.1.2 Spaces .................................................................................................................
    [Show full text]
  • Komponieren Mit Skulpturalen Klangphänomenen in Der Computermusik Dissertation
    Komponieren mit skulpturalen Klangphänomenen in der Computermusik Dissertation Gerriet K. Sharma Matrikel Nummer: S0773304 Universität für Musik und Darstellende Kunst Graz Künstlerisch-wissenschaftliches Doktoratsstudium Komposition und Musiktheorie ID-V795500 Betreut durch: Professor Marko Ciciliani (Universität für Musik und Darstellende Kunst Graz) Professor Robert Höldrich (Universität für Musik und Darstellende Kunst Graz) Professor Marco Stroppa (Hochschule für Musik und Darstellende Kunst Stuttgart) Professorin Elena Ungeheuer (Universität Würzburg) vorgelegt bei der künstlerisch-wissenschaftlichen Doktoratsschule am 6. September 2016 Dank Ich bedanke mich bei meinen Doktoratssbetreuern Marko Ciciliani, Robert Höldrich und Marco Stroppa und meiner Doktoratsbetreuerin Elena Unge- heuer für die besondere Unterstützung in den letzten drei Jahren. In jedem Einzelverhältnis ist ein besonderer Austausch entstanden, der auf jeweils sei- ne Art zum Teil sehr konkrete Probleme lösen konnte, aber auch häufig An- stoß gab, langfristige und komplexe Fragen zu verstehen und diesen künstle- risch forschend nachzugehen. Weiter möchte ich mich beim Institut für Elektronische Musik und Akustik der Kunstuniversität Graz bedanken. Beides, die Kollegialität und der fachliche Anspruch haben ein Umfeld geschaffen, in dem diese Arbeit langsam und be- ständig wachsen konnte, an dem sich ihr Anspruch messen musste und in dem Ideen ihren Raum hatten. Mein Dank gilt auch der künstlerisch-wissenschaftlichen Doktoratschule der Kunstuniversität Graz, die meine Vortrags- und Konzertaktivitäten in den letz- ten Jahren gefördert und unterstützt hat und in deren Programmen ich ent- scheidende Denkanstöße für die Entwicklung dieser Arbeit bekommen habe. Ich bedanke mich auch bei Gerhard Eckel, Martin Rumori und David Pirrò, de- ren Unterstützung in den Jahren vor Beginn dieser Arbeit mich überhaupt erst in die Lage versetzt hat, meine Forschungsfragen aus der künstlerischen Praxis heraus zu formulieren und später zu verfolgen.
    [Show full text]
  • Laborsonortranslatingmusic2015
    www.laborsonor.de Music Festival & syMposiuM | 28. – 30. august 2015 | ballhaus ost | berlin Sie tauchen ein in die Klänge der anderen. Sie ziehen Sie Sich an wie ein Kleid und gehen für einen abend damit herum. waS wäre, wenn ich die andere wäre. Sie nehmen Sie Sich. zu herzen, hef- ten Sie Sich an die bruSt oder StecKen Sie Sich in die taSche. Sie Spannen Semipermeable membrane umeinander und tauSchen flüssigeS und feSteS, durchSichtigeS und eingefärbteS, roheS und gegrillteS, unverdaulicheS und deliKateS. die muSiK der anderen begegnet ihrer art, mit muSiK umzugehen. wie holen Sie Sie herüber zu Sich? waS löSt die muSiK in ihnen auS? wie löSen Sie daS? die muSiK der anderen, durchlaufen durch den prozess deS hörenS, zuhörenS, verStehenS, Sich-an- eignenS, deS aussortierenS, deS umwandelnS, deS wiederbele- benS, deS überführenS in daS eigene. welche reSonanz hat daS? welcheS echo bleibt? und wie hat Sich daS eigene verwandelt? they immerSe themSelveS into the Sound of another. they put it on liKe a dress and go out and about for the evening. what if i were the other? they taKe it. to the heart, pin it on their cheSt or put it in their pocKet. they Stretch Semi-permeable membraneS around each other and exchange—liquidS and SolidS, tranSpa- rencieS and colorS, raw and grilled, the inedible aS well aS delicacieS. the muSic of the other rendezvouS with their wayS of tending to muSic. how doeS it come across to them? what doeS the muSic trigger in them? how do they reSolve thiS? the muSic of the other passeS through a process and onto their own by meanS of hearing, liStening, underStanding, appropri- ating, Sorting out, tranSforming, reviving and tranSferring.
    [Show full text]
  • Space As Reference: Representations of Space in Electroacoustic Music
    Peer-Reviewed Paper JMM: The Journal of Music and Meaning, vol. 12, 2013/2014 Space as Reference: Representations of Space in Electroacoustic Music Dr Frederico Macedo, University of the State of Santa Catarina, Brazil Abstract This article discusses in detail the use of spatial references in electroacoustic music, which is the fourth of the five senses of space I identified in a broader investigation on the meaning of space in music, electroacoustic music and sound art. The expression space as reference refers to the use of the referential properties of sound to suggest or produce spatial impressions and associations. I start discussing the controversies related to the use of referential meaning in music, and how, since the development of electroacoustic music, it has become a crucial aspect in the characterization and definition of its different branches and aesthetic orientations. Then I discuss how a number of composers of electroacoustic music have conceptualized and worked with reference in their compositional practice. In the next section I discuss how soundscape composition has been working with spatial reference as a central aspect of its aesthetic principles. Afterwards, I expose how representation has been used as a structural element in the works Night Song I and Night Song II, and how these works can be characterized in terms of the terminology suggested by the aforementioned composers. In the conclusion, I discuss how the categories of abstraction and representation can be understood as relative and complimentary concepts, suggesting that, for the composer, it would be interesting to keep both aspects in mind, as both of them are relevant for the reception of their compositional work.
    [Show full text]
  • Martha Brech Composed Space in Luigi Nono's Live-Electronic
    Proceedings of the Electroacoustic Music Studies Network Conference, Florence (Italy), June 20-23, 2018. www.ems-network.org Martha Brech Composed Space in Luigi Nono’s Live-Electronic Composition Prometeo Research project: History and Technology of Musical Spaces Audio Communication Group, Technical University Berlin [email protected] Introduction Among the electroacoustical space compositions of the pre-digital era, Luigi Nono’s Prometeo, tragedia dell’ ascolto (1985) is extraordinary—not only because it is still performed regularly today, it is also an extremely complex work of the mixed category. Nono composed it as a texture of interwoven musical fragments, some based on lyrics that Nono had fragmented and rearranged from a libretto by Massimo Cacciari’s which itself was based on antique Greek mythologies, Ayschylos’ Prometheus tragedy, and modern literature excerpts from Friedrich Hölderlin and Walter Benjamin. Performing the work requires four orchestra groups, solo wind and string groups, a glass soloist (used as percussion), a mixed choir, a group of five solo singers and two speakers, a huge amount of equipment for live electronics (such as harmonizer, vocoder, reverb, delay, a sound motion device called Halaphon etc.), and at least twelve loudspeakers. Each group of musicians and each loudspeaker are placed on an individual position in the performance hall. Because until today only little was known about precisely how space is involved in the composition and what its functions are therein, the focus of my research project on spatial composition in the analogue era lies, at the moment, on the spatial aspects and their composition and representation in Prometeo —and that is also the focus of this paper.
    [Show full text]