DOCSLIB.ORG

An Analysis of Accurate, Real-Time Reproduction of 3D Acoustics in Virtual Environments

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
An Analysis of Accurate, Real-Time Reproduction of 3D Acoustics in Virtual Environments An Analysis of Accurate, Real-Time Reproduction of 3D Acoustics in Virtual Environments A Dissertation Presented to the Graduate Faculty of the University of Louisiana at Lafayette In Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy Scott McDermott Fall 2014 © Scott McDermott 2014 All Rights Reserved An Analysis of Accurate, Real-Time Reproduction of 3D Acoustics in Virtual Environments Scott David McDermott APPROVED: C.-H. Henry Chu, Chair Christoph Borst Professor of Computer Science Associate Professor of Computer Science The Center for Advanced Computer Studies The Center for Advanced Computer Studies Anthony Maida Mary Farmer-Kaiser Associate Professor of Computer Science Interim Dean of the Graduate School The Center for Advanced Computer Studies Acknowledgments I would like to acknowledge the many people, both friends and family, who have supported me (or patiently sat by and watched me toil) through the many, many years that it took to get to this point. You are too numerous to list here, but your collective strength and encouragement was the foundation of my efforts. We are nothing without those near us. Thank you all! To my wife Diana, who, through the countless years of trials and chaos has learned how to be patient and yet constant, consistent and yet not insistent. Simply put, there would have been no possibility of conclusion without your love and encouragement. Thanks are simply not sufficient. I would be remiss not to mention my daughter and son, who make my life complete. I had every intention to complete this before each of your births so that you would not need to suffer through my distraction. Thank you as well for being patient and understanding. I hope that you have learned perseverance and resolve from this experience. Finally, to my advisor, Dr. Henry Chu, others probably cannot comprehend how patient and helpful you have been through all of these years. Simply put, I would not have finished this document, many times over, except for your understanding and backing. Table of Contents Acknowledgments.................................................................................................................... iv Table of Figures ....................................................................................................................... ix Table of Tables ..........................................................................................................................x Table of Equations ...................................................................................................................11 Introduction ..............................................................................................................................12 Abstract ........................................................................................................................12 What is 3D Sound? ......................................................................................................13 Goals ............................................................................................................................15 Objectives ....................................................................................................................16 Algorithms ...............................................................................................................................18 Previous Work .............................................................................................................20 Geometrical vs. Wave Equation Based Methods .............................................21 Beam Trees (2004) ...........................................................................................22 Accelerated Beam Tracing (2009) ...................................................................22 Precomputed Wave Simulation (2010) ............................................................23 Augmented Reality (2011) ...............................................................................24 Reverberation Shading (2011) .........................................................................25 Beam Tracing with Refraction (2012) .............................................................25 Precomputed Acoustic Transfer Operators (2012) ..........................................26 Spatial Sound and Visual Fidelity (2013) ........................................................27 Hybrid Approach - Acoustic Radiance Transfer (2013) ..................................28 Wave-Based Sound in Open Scenes (2013) ....................................................29 Current Work ...............................................................................................................30 Direct Paths Algorithm ....................................................................................31 Brute Force Algorithm .....................................................................................33 Reflected Paths Algorithm ...............................................................................34 Bouncing Reflections Algorithm .....................................................................36 Wall Dispersion Algorithm ..............................................................................41 Matrices of Impulses Algorithm ......................................................................42 Physics Algorithm ............................................................................................43 Stochastic Algorithm .......................................................................................44 Design and Implementation .....................................................................................................45 Implementation Overview ...........................................................................................45 Algorithmic Goal .............................................................................................46 Latency .............................................................................................................47 vi Object-Oriented Design ...................................................................................48 The TDS Simulator and Algorithms ............................................................................48 The TDS Simulator ..........................................................................................49 Scene3D Data Structure ...............................................................................................52 Environment3D Hierarchy ...............................................................................52 Structure Data File ...............................................................................53 Structure Objects ..................................................................................57 Room Objects .......................................................................................58 Faces Objects .......................................................................................58 Wall Openings Objects ........................................................................58 Acoustic Materials ...............................................................................59 Sound3D Data Structure ..............................................................................................59 AcousticsAlgorithm Hierarchy ........................................................................60 SoundPlaySimple Algorithm Object....................................................60 SoundPlayDirectX Algorithm Object ..................................................61 SoundPlayAlg Object...........................................................................62 SoundPlayDirectPaths Algorithm Object ............................................63 SoundPlayBouncingReflections Algorithm Object .............................64 Reverberations Data Structure .........................................................................64 Impulse Response Data Structure ....................................................................66 Attenuation Algorithm .....................................................................................67 Sound Storage ..................................................................................................72 Sound File Storage ...............................................................................73 Sound Sample Storage .........................................................................75 Convolution Algorithm ....................................................................................77 Integrated Libraries ......................................................................................................80 OpenGL® Library ...........................................................................................82 DirectSound® Library .....................................................................................83 FFTW Library ..................................................................................................84 Experiment Structure ...................................................................................................89 Testing Modes ..................................................................................................89 Experimental Testing Data Structure ...............................................................90 Portability .....................................................................................................................90
Load more

Recommended publications
  • THINC: a Virtual and Remote Display Architecture for Desktop Computing and Mobile Devices
    THINC: A Virtual and Remote Display Architecture for Desktop Computing and Mobile Devices Ricardo A. Baratto Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Graduate School of Arts and Sciences COLUMBIA UNIVERSITY 2011 c 2011 Ricardo A. Baratto This work may be used in accordance with Creative Commons, Attribution-NonCommercial-NoDerivs License. For more information about that license, see http://creativecommons.org/licenses/by-nc-nd/3.0/. For other uses, please contact the author. ABSTRACT THINC: A Virtual and Remote Display Architecture for Desktop Computing and Mobile Devices Ricardo A. Baratto THINC is a new virtual and remote display architecture for desktop computing. It has been designed to address the limitations and performance shortcomings of existing remote display technology, and to provide a building block around which novel desktop architectures can be built. THINC is architected around the notion of a virtual display device driver, a software-only component that behaves like a traditional device driver, but instead of managing specific hardware, enables desktop input and output to be intercepted, manipulated, and redirected at will. On top of this architecture, THINC introduces a simple, low-level, device-independent representation of display changes, and a number of novel optimizations and techniques to perform efficient interception and redirection of display output. This dissertation presents the design and implementation of THINC. It also intro- duces a number of novel systems which build upon THINC's architecture to provide new and improved desktop computing services. The contributions of this dissertation are as follows: • A high performance remote display system for LAN and WAN environments.
    [Show full text]
  • A Software-Based Remote Receiver Solution
    Martin Ewing, AA6E 28 Wood Rd, Branford, CT 06520; [email protected] A Software-Based Remote Receiver Solution Need to get your receiver off site to avoid interference? Here is how one amateur connected a remote radio to a club station using a mixture of Linux, Windows, and Python. The local interference environment is an station computer would run control software details are available at www.aa6e.net/wiki/ increasing problem for ham radio operation, to manage the remote operation. W1HQ_remote. Hardware construction is making weak signal operation impossible This article focuses mostly on the straightforward for anyone with moderate at some times and frequencies. The ARRL software — how we developed a mixed C experience. Staff Club Station, W1HQ, has this problem and Python (and mixed Linux and Windows) in spades when W1AW, just across the project with audio and Internet aspects. System Overview parking lot, is transmitting bulletins and Interested readers will probably want to Figure 1 shows the overall system design. code practice on seven bands with high consult the code listings. These are provided The BeagleBoard XM or “BBXM” is an power. Operating W1HQ on HF in the prime at www.aa6e.net/wiki/rrx_code and are inexpensive (~$150) single board computer evening hours is not possible. There is no also available for download from the ARRL with a 1 GHz ARM processor, Ethernet problem transmitting in this environment QEX files website.1 Additional project and USB connections, and on-board audio — it’s a receiver problem. We could solve 2 1 capability. It has 512 MB of RAM and the problem by setting up a full remote base Notes appear on page 6.
    [Show full text]
  • Microsoft Directshow: a New Media Architecture
    TECHNICAL PAPER Microsoft Directshow: A New Media Architecture By Amit Chatterjee and Andrew Maltz The desktop revolution in production and post-production has dramatical- streaming. Other motivating factors are ly changed the way film and television programs are made, simultaneously the new hardware buses such as the reducing equipment costs and increasing operator eficiency. The enabling IEEE 1394 serial bus and Universal digital innovations by individual companies using standard computing serial bus (USB), which are designed with multimedia devices in mind and platforms has come at a price-these custom implementations and closed promise to enable broad new classes of solutions make sharing of media and hardware between applications difi- audio and video application programs. cult if not impossible. Microsoft s DirectShowTMStreaming Media To address these and other require- Architecture and Windows Driver Model provide the infrastructure for ments, Microsoft introduced Direct- today’s post-production applications and hardware to truly become inter- ShowTM, a next-generation media- operable. This paper describes the architecture, supporting technologies, streaming architecture for the and their application in post-production scenarios. Windows and Macintosh platforms. In development for two and a half years, Directshow was released in August he year 1989 marked a turning Additionally, every implementation 1996, primarily as an MPEG-1 play- Tpoint in post-production equip- had to fight with operating system back vehicle for Internet applications, ment design with the introduction of constraints and surprises, particularly although the infrastructure was desktop digital nonlinear editing sys- in the areas of internal stream synchro- designed with a wide range of applica- tems.
    [Show full text]
  • Windows Phone API Quickstart
    Windows Phone API QuickStart Fundamental Types and Threading and cont. cont. Wallet▲ Date / Time Synchronization .NET Microsoft.Phone.Maps.Controls Microsoft.Devices Map, MapLayer, MapOverlay, .NET Microsoft.Phone.Maps.Services Microsoft.Phone.Tasks Windows Runtime PhotoCamera, CameraButtons, CameraVideo- ♦♣ Windows Runtime + GeocodeQuery, ReverseGeocodeQuery, Route- AddWalletItem Windows.Foundation ♦ BrushExtensions Windows.System.Threading Microsoft.Phone Query Microsoft.Phone.Wallet DateTime, Uri ThreadPool, ThreadPoolTimer Microsoft.Phone.Tasks Wallet, Deal, WalletTransactionItem, WalletAgent ♦♣ ♦ PictureDecoder Windows.Foundation.Collections Windows.UI.Core MapsTask, MapsDirectionsTask, MapDownload- Microsoft.Phone.Tasks ▲ IIterable<T>, IVector <T>, IMap<TK, TV>, IVec- CoreDispatcher, CoreWindow, erTask Multitasking torView <T> MediaPlayerLauncher, CameraCaptureTask, ♦ Note: You can get the current dispatcher from PhotoChooserTask, ShareMediaTask, SaveRing- System.Device.Location Windows.Storage.Streams CoreWindow.GetForCurrentThread() GeoCoordinateWatcher .NET Buffer toneTask Microsoft.Xna.Framework.Audio Microsoft.Phone.BackgroundAudio .NET BackgroundAudioPlayer, AudioTrack, AudioPlay- Microphone, SoundEffect, DynamicSoundEffec- ▲ .NET System tInstance erAgent, AudioStreamingAgent ♦ + VoIP System WindowsRuntimeSystemExtensions Microsoft.Xna.Framework.Media Microsoft.Phone.BackgroundTransfer ■ Object, Byte, Char, Int32, Single, Double, String, System.Threading MediaLibrary, MediaPlayer, Song Windows Runtime BackgroundTransferService,
    [Show full text]
  • 5.1-Channel PCI Sound Card
    PSCPSC705705 5.1-Channel PCI Sound Card • Play all games in 5.1-channel surround sound, including EAX™ 2.0, A3D™ 1.0 and even ordinary stereo games! • Full compatablility with EAX™ 1.0, EAX™ 2.0 and A3D™ 1.0 games • Hear high-impact 3D sound from games, movies, music, and external sources using two, four, or six speakers. • 96 distinct 3D voices, 256 distinct DirectSound voices & 576 distinct synthesized Wavetable voices. • Included software: Sonic Foundry® SIREN Xpress™, Acid XPress™, QSound AudioPix™. 5.1-Channel PCI Sound Card PSCPSC705705 Arouse your senses. Make your games come to life with the excite- Technical Specifications ment of full-blown home cinema. Seismic Edge supports the latest multi-channel audio games and DVD movies, and can transform stereo Digital Acceleration sources into deep-immersion 5.1-channel surround sound. (5.1 refers • 96 streams of 3D audio acceleration including reverb, obstruction, and occlusion to five main speakers – front left, right and center, and rear left and • 256 streams of DirectSound accelerations and digital mixing right – and one bass subwoofer.) All this without straining your com- • Full-duplex, 48khz digital recording and playback puter’s resources, because complex audio demands are handled on- • 64 hardware sample rate conversion channels up to 48khz board by Seismic Edge’s powerful computing chip.You’ve never experi- • Wavetable and FM Synthesis enced games like this before! • DirectInput devices Experience state-of-the-art 360º Surround Sound. An embed- Comprehensive Connectivity ded, patented QSound algorithm extracts complex and distinct 5.1- • 5.1-channel (6 channel) analog output channel information from stereo or ProLogic sources.
    [Show full text]
  • Microsoft Palladium
    Microsoft Palladium: A Business Overview Combining Microsoft Windows Features, Personal Computing Hardware, and Software Applications for Greater Security, Personal Privacy, and System Integrity by Amy Carroll, Mario Juarez, Julia Polk, Tony Leininger Microsoft Content Security Business Unit June 2002 Legal Notice This is a preliminary document and may be changed substantially prior to final commercial release of the software described herein. The information contained in this document represents the current view of Microsoft Corporation on the issues discussed as of the date of publication. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. This White Paper is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, AS TO THE INFORMATION IN THIS DOCUMENT. Complying with all applicable copyright laws is the responsibility of the user. Without limiting the rights under copyright, no part of this document may be reproduced, stored in or introduced into a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), or for any purpose, without the express written permission of Microsoft Corporation. Microsoft may have patents, patent applications, trademarks, copyrights, or other intellectual property rights covering subject matter in this document. Except as expressly provided in any written license agreement from Microsoft, the furnishing of this document does not give you any license to these patents, trademarks, copyrights, or other intellectual property. Unless otherwise noted, the example companies, organizations, products, domain names, e-mail addresses, logos, people, places and events depicted herein are fictitious, and no association with any real company, organization, product, domain name, e-mail address, logo, person, place or event is intended or should be inferred.
    [Show full text]
  • Directx 11 Extended to the Implementation of Compute Shader
    DirectX 1 DirectX About the Tutorial Microsoft DirectX is considered as a collection of application programming interfaces (APIs) for managing tasks related to multimedia, especially with respect to game programming and video which are designed on Microsoft platforms. Direct3D which is a renowned product of DirectX is also used by other software applications for visualization and graphics tasks such as CAD/CAM engineering. Audience This tutorial has been prepared for developers and programmers in multimedia industry who are interested to pursue their career in DirectX. Prerequisites Before proceeding with this tutorial, it is expected that reader should have knowledge of multimedia, graphics and game programming basics. This includes mathematical foundations as well. Copyright & Disclaimer Copyright 2019 by Tutorials Point (I) Pvt. Ltd. All the content and graphics published in this e-book are the property of Tutorials Point (I) Pvt. Ltd. The user of this e-book is prohibited to reuse, retain, copy, distribute or republish any contents or a part of contents of this e-book in any manner without written consent of the publisher. We strive to update the contents of our website and tutorials as timely and as precisely as possible, however, the contents may contain inaccuracies or errors. Tutorials Point (I) Pvt. Ltd. provides no guarantee regarding the accuracy, timeliness or completeness of our website or its contents including this tutorial. If you discover any errors on our website or in this tutorial, please notify us at [email protected]
    [Show full text]
  • 3D Graphics for Virtual Desktops Smackdown
    3D Graphics for Virtual Desktops Smackdown 3D Graphics for Virtual Desktops Smackdown Author(s): Shawn Bass, Benny Tritsch and Ruben Spruijt Version: 1.11 Date: May 2014 Page i CONTENTS 1. Introduction ........................................................................ 1 1.1 Objectives .......................................................................... 1 1.2 Intended Audience .............................................................. 1 1.3 Vendor Involvement ............................................................ 2 1.4 Feedback ............................................................................ 2 1.5 Contact .............................................................................. 2 2. About ................................................................................. 4 2.1 About PQR .......................................................................... 4 2.2 Acknowledgements ............................................................. 4 3. Team Remoting Graphics Experts - TeamRGE ....................... 6 4. Quotes ............................................................................... 7 5. Tomorrow’s Workspace ....................................................... 9 5.1 Vendor Matrix, who delivers what ...................................... 18 6. Desktop Virtualization 101 ................................................. 24 6.1 Server Hosted Desktop Virtualization directions ................... 24 6.2 VDcry?! ...........................................................................
    [Show full text]
  • 3D-SOUND PROGRAMMING with MICROSOFT DIRECTX Surround Sound in Practice
    3D-SOUND PROGRAMMING WITH MICROSOFT DIRECTX Surround sound in practice Thesis of the University of Applied Sciences Degree programme in Business Information Technology Visamäki Fall 2013 Ville Niskanen Mr. Ville Niskanen ABSTRACT Unit Visamäki Name of degree programme Business Information Technology Option System development Author Ville Niskanen Year 2013-11-28 Subject of Bachelor’s thesis 3D-sound programming with Microsoft Di- rectX - Surround sound in practice. port. e sis. e ment. e ABSTRACT The thesis work done consists of computer application that plays various 3D-sound effects. The application has been realized with the main applica- tion and the actual sound effects have been implemented in the form of ex- traneous plug-in files. Rough implementation of the produced program structure has been described in this thesis document essay part. As the subject of the thesis has been an individual research project there have been no work life relations. The objectives of the thesis have been quite simple targeting, as can be presumed based on foregoing, in programming application that plays vari- is under the Creative Commons CCO license agre license CCO Commons Creative the under is ous 3D-sound effects, and furthermore creating mathematical algorithms report to implement 3D-sound effects. esis esis The knowledge basis, based on the fact that Microsoft DirectX-program- ming environment, as well as likely all Microsoft-programming compo- nents, is well-documented, and on the actual Microsoft DirectX-program- ming documentation found from the www, and furthermore on the materi- al found from the web covering the subject of digital signal processing.
    [Show full text]
  • Peliohjelmointi Windows Phone 8:Lle
    Toni Bäckström Peliohjelmointi Windows Phone 8:lle Metropolia Ammattikorkeakoulu Insinööri (AMK) Tietotekniikka Insinöörityö 21.5.2014 Tiivistelmä Tekijä(t) Toni Bäckström Otsikko Peliohjelmointi Windows Phone 8:lle Sivumäärä 35 sivua Aika 21.5.2014 Tutkinto Insinööri (AMK) Koulutusohjelma Tietotekniikka Suuntautumisvaihtoehto Ohjelmistotekniikka Ohjaaja(t) Lehtori Juha Pekka Kämäri Lehtori Jorma Räty Tässä insinöörityössä tutustutaan Windows Phone 8 -mobiilikäyttöjärjestelmään peliohjelmoijan näkökulmasta. Työn tavoitteena oli erityisesti esitellä Microsoftin itse kehittämiä XNA- ja DirectX-peliohjelmointikirjastoja teoriassa ja käytännössä. Työn aluksi käydään läpi hieman Windows Phonen historiaa ja yleisesti kehittämistä Windows Phone 8:lle. Tämän jälkeen luodaan katsaus Windows Phone 8:aan pelialustana. Työn suurin osuus on XNA:n ja DirectX:n esittely teoriassa; kummastakin menetelmästä käydään läpi grafiikan, äänen ja syötteiden käsittely sekä esitellään tärkeimpiä yleisiä ominaisuuksia. Lisäksi katsotaan molempien menetelmien historiaan ja tulevaisuuteen. XNA:n todetaan olevan DirectX:ää selvästi helpompi ohjelmoida, mutta sen kehityksen loputtua ei XNA:n tulevaisuus ole yhtä turvattu kuin DirectX:n. Työssä esitellään myös apukirjasto DirectX Toolkit, jolla DirectX:n käytöstä saadaan huomattavasti yksinkertaisempaa. Käytännössä XNA:ta ja DirectX:ää tutkitaan kehittämällä pienimuotoinen peli kumpaakin menetelmää käyttäen. Yksinkertaisen 2D-pelin ohjelmoinnissa käytettiin hyvin pitkälti samoja keinoja, jotka teoriaosuudessa oli esitelty.
    [Show full text]
  • Windows Mobile Game Development Ebook, Epub
    WINDOWS MOBILE GAME DEVELOPMENT PDF, EPUB, EBOOK Adam Dawes | 460 pages | 12 Aug 2010 | Springer | 9781430270645 | English | United States Windows Mobile Game Development PDF Book These game design tools would help you manage your quest. To continue downloading, click here. Real-time rendering tool. The UI map helps all involved stakeholders understand the game's interface and navigation paths, and can expose potential roadblocks and dead ends early in the development cycle. Windows desktop applications forums. Price: free version is limited. Improve performance by getting exclusive or priority access to hardware resources using Game Mode APIs. Syon Infomedia has experts who will help you build and operate the games for Windows. In fact, these tools are great for juniors, because they provide all they need to develop a unique and interesting project. Build and scale your games using Azure. It seems that you're in Germany. Accept Decline. A UI map is a layout of game navigation and menus expressed as a flowchart. Though easy to use, C has numerous advanced language features like polymorphism, delegates, lambdas, closures, iterator methods, covariance, and Language-Integrated Query LINQ expressions. Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. Lua language that Corona SDK uses to work with is pretty easy to learn and code with. Film-quality visual effects creation tool. It would mean that the requirements of Windows Mobile Games will also rise, don't worry! PAGE 1.
    [Show full text]
  • Collection Titles
    Direct e-Learning Solutions for Today’s Careers CBT Direct’s IT Pro Collection Available: 7476 Collection Titles Coming Soon: 557 .NET 2.0 for Delphi Programmers Architecture Tivoli OMEGAMON XE for DB2 Performance .NET 3.5 CD Audio Player: Create a CD Audio 3D Computer Graphics: A Mathematical Expert on z/OS Player in .NET 3.5 Using WPF and DirectSound Introduction with OpenGL A Field Guide to Digital Color .NET Development for Java Programmers "3D for the Web: Interactive 3D animation using A First Look at Solution Installation for .NET Development Security Solutions 3ds max; Flash and Director " Autonomic Computing .NET Domain-Driven Design with C#: Problem - 3D Game Programming All in One A Guide to Global E-Commerce: Issues to Design - Solution 3D Graphics ReferencePoint Suite Consider When Selling Internationally Over the .NET E-Commerce Programming 3D Modeling in AutoCAD: Creating and Using Internet .NET Enterprise Development in C#: From 3D Models in AutoCAD 2000; 2000i; 2002; A Guide to MATLAB Object-Oriented Design to Deployment Second Edition Programming .NET Enterprise Development in VB.NET: From 3D Programming for Windows: Three- A Guide to Software Configuration Design to Deployment Dimensional Graphics Programming for the Management .NET for Visual FoxPro Developers Windows Presentation Foundation A Guide to Software Package Evaluation and .NET Framework ReferencePoint Suite 3ds max 5 Bible Selection .NET Framework Solutions: In Search of the 3ds max 5 For Dummies A Guide to the Project Management Body of Lost Win32 API
    [Show full text]