DOCSLIB.ORG

3-D Sound for Virtual Reality and Multimedia

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
3-D Sound for Virtual Reality and Multimedia NASA/TM—2000–000000 3-D Sound for Virtual Reality and Multimedia Durand R. Begault Ames Research Center, Moffett Field, California April 2000 The NASA STI Program Office ... in Profile Since its founding, NASA has been dedicated to · CONFERENCE PUBLICATION. the advancement of aeronautics and space Collected papers from scientific and science. The NASA Scientific and Technical technical conferences, symposia, Information (STI) Program Office plays a key seminars, or other meetings sponsored part in helping NASA maintain this important or co-sponsored by NASA. role. · SPECIAL PUBLICATION. Scientific, The NASA STI Program Office is operated by technical, or historical information from Langley Research Center, the lead center for NASA programs, projects, and missions, NASA’s scientific and technical information. often concerned with subjects having The NASA STI Program Office provides access substantial public interest. to the NASA STI Database, the largest collection of aeronautical and space science STI · TECHNICAL TRANSLATION. in the world. The Program Office is also English-language translations of foreign NASA’s institutional mechanism for scientific and technical material disseminating the results of its research and pertinent to NASA’s mission. development activities. These results are published by NASA in the NASA STI Report Specialized services that complement the STI Series, which includes the following report Program Office’s diverse offerings include types: creating custom thesauri, building customized databases, organizing and publishing research · TECHNICAL PUBLICATION. Reports of results ... even providing videos. completed research or a major significant phase of research that present the results For more information about the NASA STI of NASA programs and include extensive Program Office, see the following: data or theoretical analysis. Includes compilations of significant scientific and · Access the NASA STI Program Home technical data and information deemed to Page at http://www.sti.nasa.gov be of continuing reference value. NASA counterpart of peer-reviewed formal · E-mail your question via the Internet to professional papers, but having less [email protected] stringent limitations on manuscript length and extent of graphic presentations. · Fax your question to the NASA STI Help Desk at (301) 621-0134 · TECHNICAL MEMORANDUM. Scientific and technical findings that are · Telephone the NASA STI Help Desk at preliminary or of specialized interest, e.g., (301) 621-0390 quick release reports, working papers, and bibliographies that contain minimal · Write to: annotation. Does not contain extensive NASA STI Help Desk analysis. NASA Center for AeroSpace Information · CONTRACTOR REPORT. Scientific and 7121 Standard Drive technical findings by NASA-sponsored Hanover, MD 21076-1320 contractors and grantees. NASA/TM—2000–000000 3-D Sound for Virtual Reality and Multimedia Durand R. Begault Ames Research Center, Moffett Field, California National Aeronautics and Space Administration Ames Research Center Moffett Field, California 94035 April 2000 Acknowledgments Without the assistance and support of Justine, Pat, Denise, Chloe, Nigel, tre, Bill, Lars, Joel, Rick, Dr. B, Jenifer, Reuben, and many others, the completion of this book would not have been possible. About the Cover Cylindrical Surface Plot of the Head-Related Transfer Function: Magnitude Response as a Function of Frequency over Azimuth Angle on a Radial Axis, by William Martens of E-mu/Creative Technology Center. The cover photograph shows a visualization of the magnitude response (gain) of the head-related transfer function (HRTF) measured at the eardrum position of the anthropomorphic mannequin KEMAR. HRTFs were measured for 19 loudspeaker directions circling the side of the head facing the loudspeaker placed at ear level. The surface was constructed by interpolating the gain within each of 50 log-spaced frequency bands for the 19 HRTFs using a bicubic spline. The lowest band was centered on 55 Hz, the highest on 21,331 Hz. The distance of the surface from the origin and the color indicates the gain at a particular frequency and azimuth, which ranges from blue-black at the lowest gain (-43.9 dB) to a desaturated yellow at the peak gain (14.6 dB). Available from: NASA Center for AeroSpace Information National Technical Information Service 7121 Standard Drive 5285 Port Royal Road Hanover, MD 21076-1320 Springfield, VA 22161 301-621-0390 703-605-6000 Table of Contents Preface to the NASA Technical Memorandum version...................................................................ix Preface..............................................................................................................................................x Overview......................................................................................................................................xii CHAPTER ONE..............................................................................................................................1 Virtual Auditory Space: Context, Acoustics, and Psychoacoustics..................................................1 Context..........................................................................................................................................1 Source-Medium-Receiver Model: Natural versus Virtual Spatial Hearing........................................4 Application Types.............................................................................................................................7 Virtual Audio: A Special Case......................................................................................................11 Components.................................................................................................................................12 So What Is 3-D Sound Good For?................................................................................................13 Surround versus 3-D Sound.........................................................................................................16 Characteristics of Sound Sources....................................................................................................17 Describing Waveforms.................................................................................................................17 Periodic and Aperiodic Waveforms..............................................................................................17 Digital Sound and Signal Processing............................................................................................20 Harmonics...................................................................................................................................20 Fourier Analysis...........................................................................................................................21 Amplitude Envelope....................................................................................................................25 Perception.......................................................................................................................................25 Psychoacoustics and Applications................................................................................................25 Perceptual Correlates of Frequency, Intensity, and Spectral Content.............................................27 Cognition.....................................................................................................................................29 CHAPTER TWO...........................................................................................................................31 Overview of Spatial Hearing Part I: Azimuth and Elevation Perception.....................................31 Interaural Time and Intensity Cues...............................................................................................31 Lateralization...........................................................................................................................31 Physical Basis of Lateralization................................................................................................32 ITD Envelope Cue....................................................................................................................33 Perception of Lateralization.....................................................................................................34 The Precedence Effect.................................................................................................................36 ITD, IID, and Barn Owls: A Neurological Processing Model.........................................................37 Head Movement and Source Movement Cues................................................................................39 Head Movement...........................................................................................................................39 Moving Sound Sources................................................................................................................40 Spectral Cues Provided by the Pinnae............................................................................................40 Ambiguous ITD and IID Cues.....................................................................................................40 The Head-Related Transfer Function............................................................................................41 A Do-It-Yourself Experiment with Spectral
Load more

Recommended publications
  • Alive Dead Media 2020: Tracker and Chip Music
    Alive Dead Media 2020: Tracker and Chip Music 1st day introduction, Markku Reunanen Pics gracefully provided by Wikimedia Commons Arrangements See MyCourses for more details, but for now: ● Whoami, who’s here? ● Schedule of this week: history, MilkyTracker with Yzi, LSDJ with Miranda Kastemaa, holiday, final concert ● 80% attendance, two tunes for the final concert and a little jingle today ● Questions about the practicalities? History of Home Computer and Game Console Audio ● This is a vast subject: hundreds of different devices and chips starting from the late 1970s ● In the 1990s starts to become increasingly standardized (or boring, if you may :) so we’ll focus on earlier technology ● Not just hardware: how did you compose music with contemporary tools? ● Let’s hear a lot of examples – not using Zoom audio The Home Computer Boom ● At its peak in the 1980s, but started somewhat earlier with Apple II (1977), TRS-80 (1977) and Commodore PET (1977) ● Affordable microprocessors, such as Zilog Z80, MOS 6502 and the Motorola 6800 series ● In the 1980s the market grew rapidly with Commodore VIC-20 (1980) and C-64 (1982), Sinclair ZX Spectrum (1982), MSX compatibles (1983) … and many more! ● From enthusiast gadgets to game machines Enter the 16-bits ● Improving processors: Motorola 68000 series, Intel 8088/8086/80286 ● More colors, more speed, more memory, from tapes to floppies, mouse(!) ● Atari ST (1984), Commodore Amiga (1985), Apple Macintosh (1984) ● IBM PC and compatibles (1981) popular in the US, improving game capability Not Just Computers ● The same technology powered game consoles of the time ● Notable early ones: Fairchild Channel F (1976), Atari VCS aka.
    [Show full text]
  • Canadian Beatles Albums Identification Guide Updated: 22 De 16
    Canadian Beatles Albums Identification Guide Updated: 22 De 16 Type 1 Rainbow Label Capitol Capitol Records of Canada contracted Beatlemania long before their larger and better-known counterpart to the south. Canadian Capitol's superior decision-making brought Beatles records to Canada in early 1963. After experimenting with the release of a few singles, Capitol was eager to release the Beatles' second British album in Canada. Sources differ as to the release date of the LP, but surely by December 2, 1963, Canada's version of With the Beatles became the first North American Beatles album. Capitol-USA and Capitol-Canada were negotiating the consolidation of their releases, but the US release of The Beatles' Second Album had a title and contained songs that were inappropriate for Canadian release. After a third unique Canadian album, album and single releases were unified. From Something New on, releases in the two countries were nearly identical, although Capitol-Canada continued to issue albums in mono only. At the time when Beatlemania With the Beatles came out, most Canadian pop albums were released in the "6000 Series." The label style in 1963 was a rainbow label, similar to the label used in the United States but with print around the rim of the label that read, "Mfd. in Canada by Capitol Records of Canada, Ltd. Registered User. Copyrighted." Those albums which were originally issued on this label style are: Title Catalog Number Beatlemania With the Beatles T-6051 (mono) Twist and Shout T-6054 (mono) Long Tall Sally T-6063 (mono) Something New T-2108 (mono) Beatles' Story TBO-2222 (mono) Beatles '65 T-2228 (mono) Beatles '65 ST-2228 (stereo) Beatles VI (mono) T-2358 Beatles VI (stereo) ST-2358 NOTE: In 1965, shortly before the release of Beatles VI, Capitol-Canada began to release albums in both mono and stereo.
    [Show full text]
  • Introduction Chapter 2 — Windows Software
    UltraSound owners have a variety of sound needs. This is a guide to help you find the best way to use your new UltraSound for your own applications. Using your UltraSound with many games is as simple as selecting UltraSound from the list of sound cards in the game’s setup. You’ll hear extraordinary wavetable sound as soon as you begin the game. To use UltraSound with games that do not yet support the card directly, you may need some help getting started. UltraSound works with programs written for General MIDI, Sound Blaster, Ad Lib, Roland MT-32, and Roland SCC1. Read Chapter 6, “Game Sound Support,” for an explanation of the sound options available with UltraSound. Explore the file playing, recording, and mixing features of your UltraSound right away using the simple sound applets that come with Windows version 3.1 or later. Use Media Player to play sound files with your UltraSound. Or hook up a microphone and use Sound Recorder to record, mix, and play your own sounds. See the Windows manual or Sound Recorder’s on-line help for instructions. Open the UltraSound Mixer to enable inputs and outputs, set playback volume, and control CD and Microphone inputs. The settings you choose from the Mixer applet are only valid for the current Windows session until you save them. Once you have had a chance to explore your UltraSound’s features with these simple applications, try the great bonus software included in your UltraSound package. Advanced Gravis has included a number of terrific software applications for recording, playing, mixing, and composing sounds and music with your new UltraSound.
    [Show full text]
  • Linux Sound Subsystem Documentation Release 4.13.0-Rc4+
    Linux Sound Subsystem Documentation Release 4.13.0-rc4+ The kernel development community Sep 05, 2017 CONTENTS 1 ALSA Kernel API Documentation 1 1.1 The ALSA Driver API ............................................ 1 1.2 Writing an ALSA Driver ........................................... 89 2 Designs and Implementations 145 2.1 Standard ALSA Control Names ...................................... 145 2.2 ALSA PCM channel-mapping API ..................................... 147 2.3 ALSA Compress-Offload API ........................................ 149 2.4 ALSA PCM Timestamping ......................................... 152 2.5 ALSA Jack Controls ............................................. 155 2.6 Tracepoints in ALSA ............................................ 156 2.7 Proc Files of ALSA Drivers ......................................... 158 2.8 Notes on Power-Saving Mode ....................................... 161 2.9 Notes on Kernel OSS-Emulation ..................................... 161 2.10 OSS Sequencer Emulation on ALSA ................................... 165 3 ALSA SoC Layer 171 3.1 ALSA SoC Layer Overview ......................................... 171 3.2 ASoC Codec Class Driver ......................................... 172 3.3 ASoC Digital Audio Interface (DAI) .................................... 174 3.4 Dynamic Audio Power Management for Portable Devices ...................... 175 3.5 ASoC Platform Driver ............................................ 180 3.6 ASoC Machine Driver ............................................ 181 3.7 Audio Pops
    [Show full text]
  • See Cartridge Glossary
    32 Cartridge-making Dictionary Audio-Technica’s guide to cartridge-making terminology 33rpm Bonded diamond Channel Balance Connecting (the phono cartridge) very often denotes 12” LP Vinyl records Bonded diamond refers to a The channel balance of a cartridge is the (1949-Today), that should be played at stylus where the diamond tip is ability of the transducer to reproduce left a speed of 33 1/3 rpm, rpm stands for glued on a metal shank that is and right channels in the same manner. Rotation Per Minute. itself glued into the hole of the Channel balance should be part of the cantilever. This construction may cartridge specifications, it expresses the 45rpm increase the mass of the overall tip and possible output difference in dB from one 45rpm very often denotes 7” Vinyl records, affect transient reproduction compared channel to another. A cartridge with ideal (1949-Today) that should be played at a with nude styli that are preferred and used channel balance will playback any mono speed of 45rpm, rpm stands for Rotation on higher-priced models. signal with equal level in both channels. Per Minute. The channel balance will be 0dB. The ratio of the signals between the two channels To install a Phono cartridge, connect the 78rpm Boron (boron cantilever) is specified in dB. Channel imbalance four wires of the cartridge headshell to the 78rpm very often denotes 10” Shellac SP Boron is a chemical element from the can result in several factors independent correct terminals on the back of the Gramophone records (1925-1950) that metalloid family, extracted from Borax and from the cartridge itself: mechanical cartridge.
    [Show full text]
  • Vinyl Theory
    Vinyl Theory Jeffrey R. Di Leo Copyright © 2020 by Jefrey R. Di Leo Lever Press (leverpress.org) is a publisher of pathbreaking scholarship. Supported by a consortium of liberal arts institutions focused on, and renowned for, excellence in both research and teaching, our press is grounded on three essential commitments: to publish rich media digital books simultaneously available in print, to be a peer-reviewed, open access press that charges no fees to either authors or their institutions, and to be a press aligned with the ethos and mission of liberal arts colleges. This work is licensed under the Creative Commons Attribution- NonCommercial 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc/4.0/ or send a letter to Creative Commons, PO Box 1866, Mountain View, CA 94042, USA. The complete manuscript of this work was subjected to a partly closed (“single blind”) review process. For more information, please see our Peer Review Commitments and Guidelines at https://www.leverpress.org/peerreview DOI: https://doi.org/10.3998/mpub.11676127 Print ISBN: 978-1-64315-015-4 Open access ISBN: 978-1-64315-016-1 Library of Congress Control Number: 2019954611 Published in the United States of America by Lever Press, in partnership with Amherst College Press and Michigan Publishing Without music, life would be an error. —Friedrich Nietzsche The preservation of music in records reminds one of canned food. —Theodor W. Adorno Contents Member Institution Acknowledgments vii Preface 1 1. Late Capitalism on Vinyl 11 2. The Curve of the Needle 37 3.
    [Show full text]
  • Video Games: 3Duis for the Masses Joseph J
    Video Games: 3DUIs for the Masses Joseph J. LaViola Jr. Ivan Poupyrev Welcome, Introduction, & Roadmap 3DUIs 101 3DUIs 201 User Studies and 3DUIs Guidelines for Developing 3DUIs Video Games: 3DUIs for the Masses The Wii Remote and You 3DUI and the Physical Environment Beyond Visual: Shape, Haptics and Actuation in 3DUI Conclusion CHI 2009 Course Notes - LaViola | Kruijff | Bowman | Poupyrev | Stuerzlinger 163 !3DUI and Video Games – Why? ! Video games ! multi-billion dollar industry: $18.8 billion in 2007 ! major driving force in home entertainment: average gamer today is 33 years old ! advanced 3D graphics in HOME rather then universities or movies studios ! Driving force in technological innovation ! graphics algorithms and hardware, sound, AI, etc. ! technological transfer to healthcare, biomedical research defence, education (example: Folding@Home) ! Recent innovations in 3D user interfaces ! graphics is not enough anymore ! complex spatial, 3D user interfaces are coming to home (example: Nintendo Wii) ! Why 3D user interfaces for games? ! natural motion and gestures ! reduce complexity ! more immersive and engaging ! Research in 3D UI for games is exiting ! will transfer 3DUI to other practical applications, e.g. education and medicine LaViola | Kruijff | Bowman | Poupyrev | Stuerzlinger 164 - Video game industry $10.5 billions in US in 2005, $25.4 billions worldwide; -Not for kids anymore: average player is 33 years old, the most frequent game buyer is 40 years old; -Technological transfer and strong impact on other areas of technology: The poster on this slide (www.allposters.com) demonstrates a very common misconception. In fact its completely opposite, the rapid innovation in games software and hardware allows for economical and practical applications of 3D computers graphics in healthcare, biomedical research, education and other critical areas.
    [Show full text]
  • Sound-HOWTO.Pdf
    The Linux Sound HOWTO Jeff Tranter [email protected] v1.22, 16 July 2001 Revision History Revision 1.22 2001−07−16 Revised by: jjt Relicensed under the GFDL. Revision 1.21 2001−05−11 Revised by: jjt This document describes sound support for Linux. It lists the supported sound hardware, describes how to configure the kernel drivers, and answers frequently asked questions. The intent is to bring new users up to speed more quickly and reduce the amount of traffic in the Usenet news groups and mailing lists. The Linux Sound HOWTO Table of Contents 1. Introduction.....................................................................................................................................................1 1.1. Acknowledgments.............................................................................................................................1 1.2. New versions of this document.........................................................................................................1 1.3. Feedback...........................................................................................................................................2 1.4. Distribution Policy............................................................................................................................2 2. Sound Card Technology.................................................................................................................................3 3. Supported Hardware......................................................................................................................................4
    [Show full text]
  • Arcade Guns User Manual
    User Manual (v2.5) Table of Contents Recommended Links ..................................................................................................................................... 2 Supported Operating Systems ...................................................................................................................... 3 Quick Start Guide .......................................................................................................................................... 3 Default Light Gun Settings ............................................................................................................................ 4 Positioning the IR Sensor Bar ........................................................................................................................ 5 Light Gun Calibration .................................................................................................................................... 6 MAME (Multiple Arcade Machine Emulator) Setup ..................................................................................... 7 PlayStation 2 Console Games Setup ............................................................................................................. 9 Congratulations on your new Arcade Guns™ light guns purchase! We know you will enjoy them as much as we do! Recommended Links 2 Arcade Guns™ User Manual © Copyright 2019. Harbo Entertainment LLC. All rights reserved. Arcade Guns Home Page http://www.arcadeguns.com Arcade Guns Pro Utility Software (Windows XP, Vista,
    [Show full text]
  • Fcc and Am Stereo: a Deregulatory Breach of Duty
    THE FCC AND AM STEREO: A DEREGULATORY BREACH OF DUTY JASON B. MEYERt The trend toward governmental deregulation of private enterprise, which began in earnest in the 1970's1 and has gathered momentum under the Reagan administration, has had a significant effect on the telecommunications industry. The Federal Communications Commis- sion (FCC) has reduced regulation of operation and maintenance log- ging2 and eliminated minimum aural transmission power require- ments.' Similarly, a major effort has been made in Congress to enact a bill deregulating broadcast programming.4 In 1984 the FCC justified eliminating or relaxing many licensing requirements on the grounds that such "actions further the Commission's goals of creating, to the maximum extent possible, an unregulated, competitive environment for t A.B. 1980, Princeton University; J.D. Candidate, 1985, University of Pennsylva- nia. The author wrote this Comment while a student at the University of Pennsylvania Law School. I See, e.g., Depository Institutions Deregulation and Monetary Control Act of 1980, Pub. L. No. 96-221, 94 Stat. 132 (codified at scattered sections of Titles 12, 15, 22 & 42 of the U.S.C.) (reducing regulatory control of banks); Airline Deregulation Act of 1978, Pub. L. No. 95-504, 92 Stat. 1705 (codified at 49 U.S.C. §§ 1300-02, 1305-08, 1324, 1341, 1371-79, 1382, 1384, 1386, 1389, 1461, 1482, 1486, 1490, 1504, 1551-52) (reducing regulatory control of airlines). I See Operating and Maintenance Logs for Broadcast and Broadcast Auxiliary Stations, 48 Fed. Reg. 38,473 (1983). ' The Commission abolished minimum aural power requirements that had previ- ously created a situation in which a station's aural range well exceeded its visual range.
    [Show full text]
  • Foundations for Music-Based Games
    Die approbierte Originalversion dieser Diplom-/Masterarbeit ist an der Hauptbibliothek der Technischen Universität Wien aufgestellt (http://www.ub.tuwien.ac.at). The approved original version of this diploma or master thesis is available at the main library of the Vienna University of Technology (http://www.ub.tuwien.ac.at/englweb/). MASTERARBEIT Foundations for Music-Based Games Ausgeführt am Institut für Gestaltungs- und Wirkungsforschung der Technischen Universität Wien unter der Anleitung von Ao.Univ.Prof. Dipl.-Ing. Dr.techn. Peter Purgathofer und Univ.Ass. Dipl.-Ing. Dr.techn. Martin Pichlmair durch Marc-Oliver Marschner Arndtstrasse 60/5a, A-1120 WIEN 01.02.2008 Abstract The goal of this document is to establish a foundation for the creation of music-based computer and video games. The first part is intended to give an overview of sound in video and computer games. It starts with a summary of the history of game sound, beginning with the arguably first documented game, Tennis for Two, and leading up to current developments in the field. Next I present a short introduction to audio, including descriptions of the basic properties of sound waves, as well as of the special characteristics of digital audio. I continue with a presentation of the possibilities of storing digital audio and a summary of the methods used to play back sound with an emphasis on the recreation of realistic environments and the positioning of sound sources in three dimensional space. The chapter is concluded with an overview of possible categorizations of game audio including a method to differentiate between music-based games.
    [Show full text]
  • Linux Hardware Compatibility HOWTO
    Linux Hardware Compatibility HOWTO Steven Pritchard Southern Illinois Linux Users Group [email protected] 3.1.5 Copyright © 2001−2002 by Steven Pritchard Copyright © 1997−1999 by Patrick Reijnen 2002−03−28 This document attempts to list most of the hardware known to be either supported or unsupported under Linux. Linux Hardware Compatibility HOWTO Table of Contents 1. Introduction.....................................................................................................................................................1 1.1. Notes on binary−only drivers...........................................................................................................1 1.2. Notes on commercial drivers............................................................................................................1 1.3. System architectures.........................................................................................................................1 1.4. Related sources of information.........................................................................................................2 1.5. Known problems with this document...............................................................................................2 1.6. New versions of this document.........................................................................................................2 1.7. Feedback and corrections..................................................................................................................3 1.8. Acknowledgments.............................................................................................................................3
    [Show full text]