2016 AES CONFERENCE AUDIO FOR VIRTUAL AND AUGMENTED REALITY FRIDAY, SEPT 30 THRU SATURDAY, OCT 1 LOS ANGELES CONVENTION CENTER CONFERENCE PROGRAM PLATINUM SPONSORS MESSAGE FROM THE CONFERENCE CO-CHAIRS Welcome to the first AES International Conference on Audio for Virtual and Augmented Reality! We are really proud to present this amazing technical program, which is the result GOLD SPONSORS of many months of extremely hard teamwork. We aimed for the best content we could possibly provide, and here you have it. We are extremely thankful to our great presenters, authors, keynote speakers and sponsors. Together, we made this possible and we sincerely hope you will take away a lot of useful information. Also, I´d like to extend our special thanks to our delegates, coming from all over the world to ANDRES MAYO attend this truly unique event, and to our really hard working team of volunteers, which ultimately made it possible to Conference Co-chair pack this awesome quality and quantity of knowledge in 2 full days crammed with papers, workshops, tutorials and even a technical showcase. Welcome to the show! SPONSORS I would like to extend a warm welcome to all of our delegates, authors, presenters and sponsors. This conference has been a dream of Andres’ and mine since May of 2015. The world of VR / AR has grown so quickly, so fast that we knew we had to bring a conference dedicated specifically to this topic to the audio community. We could not have done this without the hard work and dedication of an incredible conference committee. VR / AR provides entirely new opportunities for audio as it is now part of the experience, not just an aid in conveying story. It has been speculated by Wall Street that VR / AR will LINDA GEDEMER be “as game changing as the advent of the PC”; so we’re in for an incredible journey. I believe the authors, presenters and Conference Co-chair sponsors here are some of the best visionaries to lead us on that journey. Please, enjoy the conference. 1201 SOUTH FIGUEROA STREET LOS ANGELES LOS ANGELES, CALIFORNIA 90015 CONFERENCE CONVENTION (213) 741-1151 COMMITTEE CENTER LACC Attendee Directions LA Live Entertainment District Visitor Information Centers Metro Guide ANDRES LINDA RICHARD BRIAN GREG MAYO GEDEMER WOLLRICH SEAGRAVE KADORIAN Program Content Event Logistics Conference Conference Business & Finance Assistant/Secretary Chair Co-Chair Co-Chair Chair/Treasurer First floor of Los Angeles Convention Center, showing main entrance to West Hall. GARY PABLO "TANGO" STEPHEN GRAHAM SARAH EPSTEIN FORMICA O’HARA KIRK STEVENSON Website Social Media Convention Volunteer Sales Session Coordinator Coordinator Coordinator Director Chair PROGRAM AND SIGNAGE DESIGNER: EZEQUIEL COLAVITA The committee would also like to recognize the hard work of these contributors (in alphabetical order): VIVIANA AKEL Plugged Minds CHRIS CAIN University of California, Santa Cruz. MICHELLE GOSSMAN Event Manager, Los Angeles Convention Center MEL LAMBERT Content-Creators.com DAVID SCHEIRMAN Second floor of Los Angeles Convention Center, showing stairs to Lecture Theater and Workshop/Tutorials areas. President-Elect, AES PROGRAM THEATER THEATER OVERVIEW SET UP | 8:00AM TUTORIAL 3 | 2:00PM SET UP | 8:00AM WORKSHOP 5 | CANCELLED OPENING KEYNOTE Spatial Audio and Sound Real-Time Production Chain | 8:30AM Propagation WORKSHOP 1 | 8:30AM for Immersive 3D Audio Philip Lelyveld for VR: New Developments, End-to-End VR Audio Implementations, and Solution for Fully Immersive/ WORKSHOP 6 | 2:45PM BREAK | 9:30AM Integration Interactive Experience Positioning Sounds in VR Post Production BREAK TUTORIAL 1 | 9:45AM BREAK | 3:30PM | 9:15AM Audio Recording and BREAK | 3:30PM Production for TUTORIAL 4 WORKSHOP 2 | 9:30AM ° | 3:45PM WORKSHOP 7 Virtual Reality/360 3D Audio Post-Production Object Based Audio Mixing | 3:45PM Applications Workflows for VR for AR/VR Applications OZO Audio Workflow BREAK BREAK | 10:15AM | 11:15AM BREAK | 4:30PM WORKSHOP 8 | 4:30PM Using MEMS Microphones TUTORIAL 2 WORKSHOP 3 | 11:30AM TUTORIAL 5 | 4:45PM | 10:30AM for Ambisonic Audio in a Creating Immersive & Facebook 360 Spatial Live Streaming Spherical How Can Audiology and Video Camera Aesthetic Hearing Workstation: Auditory Spaces for Tools, Workflows and Best Science Inform AVAR Practices BREAK SA Virtual and Augmented and Vice Versa? | 5:15PM Reality BREAK BREAK | 11:15AM WORKSHOP 9 LUNCH | 6:15PM | 5:30PM | 12:30PM A Lightweight & Versatile TUR FRI WORKSHOP 4 TUTORIAL 6 | 6:30PM | 11:30AM 3D-Audio Codec for Storing LUNCH TIME SESSION 1 Immersive Sound Capture & Transmitting Immersive | 12:45PM VR Audio - The for Cinematic Virtual Reality Audio and its Application to Creating Scientifically Valid Convergence Live VR 360 Events Spatial Audio for VR and AR: of Sound Professions DAY DAY LUNCH Theory, Tools and Workflows | 12:30PM BREAK SEPTEMBER 30 | 6:15PM OCTOBER 01 LUNCH TIME SESSION 2 | 12:45PM Challenges in Live Virtual CLOSING KEYNOTE | 6:30PM George Sanger ROOM 409A Reality Audio SET UP | 8:00AM ROOM 409A PAPER SESSION 1 | 9:45AM BREAK | 3:00PM Sound Localization SET UP | 8:00AM in 3D Space PAPER SESSION 4 | 3:15PM BREAK Capture, Rendering and WORKSHOP 10 PAPER SESSION 7 | 11:15AM Mixing for VR Part 1 | 8:30AM | 2:00PM Audio Content Creation for Music for PAPER SESSION 2 BREAK VR VR/AR Projects | 11:30AM | 5:30PM with Standard DAWs Real -World Case PAPER SESSION 5 BREAK | 3:45PM Studies Part 1 |5:45PM BREAK | 9:15AM Streaming Immersive LUNCH | 12:45PM Audio Content PAPER SESSION 6 | 9:30AM PAPER SESSION 8 | 4:00PM Perceptual Consideration Capture, Rendering and for VR/AR Mixing for VR Part 2 PAPER SESSION 3 | 2:00PM Real -World Case LUNCH Studies Part 2 | 12:30PM OPENING KEYNOTE CLOSING KEYNOTE THE JOURNEY FUTURE NOSTALGIA, INTO VIRTUAL AND HERE AND NOW: AUGMENTED REALITY LET’S LOOK BACK ON TODAY by Philip Lelyveld - VR/AR Initiative FROM 20 YEARS HENCE Program Manager, USC Entertainment Technology Center by George Sanger - Magic Leap Virtual, Augmented, and Mixed Reality have the potential of delivering Two decades of progress can change interactive experiences that take us to how we live and think in ways that places of emotional resonance, give boggle the mind. Audio is a small us agency to form our own experiential piece of that, but it’s our piece. 20 memories and become part of the years ago, the PC got rudimentary everyday lives we will live in the future. sound cards; now the entire Philip Lelyveld will define what Virtual, “multitrack recording studio” lives Augmented, and Mixed Reality are, on our computers. Some of us saw present recent developments that will that development as inevitable, but shape how they will potentially impact in 1996 those smart people sounded entertainment, work, learning, social fairly edgy, to say the least. And of interaction, and life in general, and those smart people, who among them raise rarely-mentioned but important saw that texting would be the “killer issues that will impact how VR/AR/MR app” for smart phones, in many ways is adopted. Just as TV programming trumping audio communication? progressed from live broadcasts of staged performances to today’s very Let’s take our accumulated wisdom complex language of multithread long- from the past 20 years of growth and form content, so VR/AR/MR will progress non-growth of audio and computing, from the current ‘early days’ of projecting and see if we can’t get some feel existing media language with a few for what it will be like in this room 20 tweaks into a headset experience to a years from now, looking back. new VR/AR/MR-specific language that both the creatives and the audience With luck, we will be nodding our understand. Philip’s goal is to bring you heads sagely, saying, “Yep, we saw up to speed on the current state, the that one coming way back in 2016!” potential, and the known barriers to adoption of Virtual, Augmented, and Mixed Reality. Saturday, October 01 | 6:30 PM AVAR Theater Friday, September 30 | 8:30 AM AVAR Theater TUTORIALS THEATER | 2:OOPM SPATIAL AUDIO AND SOUND THEATER | 9:45AM PROPAGATION FOR VR: NEW THEATER | 4:45PM THEATER | 12:45AM DEVELOPMENTS, AUDIO RECORDING HOW CAN AUDIOLOGY AND LUNCHTIME SESSION 1: IMPLEMENTATIONS, THEATER | 3:45PM HEARING SCIENCE INFORM AND PRODUCTION AND INTEGRATION FOR VIRTUAL CREATING 3D AUDIO POST- AVAR, AND VICE VERSA? THEATER | 11:30AM SCIENTIFICALLY PRODUCTION REALITY/360° Chair: APPLICATIONS CREATING VALID SPATIAL AUDIO DINESH MANOCHA WORKFLOWS FOR VR Chair: FOR VR AND AR: DR. CHRIS STECKER IMMERSIVE THEORY, TOOLS AND Univ. of North Carolina @ VIKTOR PHOENIX & AESTHETIC WORKFLOWS Chapel Hill SCOTT GERSHIN Vanderbuilt University School Chair: AUDITORY SPACES of Medicine JAN PLOGSTIES Participants: FOR VIRTUAL AND DR. ANISH CHANDA Technicolor Fraunhofer Instiute AUGMENTED REALITY RAMANI DURAISWAMI Participants: Impulsonic Inc. ABSTRACT DR. ERICK GALLUN Participants: ADAM O’DONOVAN NEIL WAKEFIELD Overview of solutions VA National Center for CHRIS PIKE VisiSonics Corp. Linden Lab to some of the creative CHANEL SUMMERS Rehabilitative Audiological BBC Research & Development and practical challenges Research University of Southern ABSTRACT ABSTRACT DR. NILS PETERS encountered in the California DR. DAN TOLLIN Qualcomm Technologies Inc. The goal of VR and AR is to immerse In this tutorial, we give an overview audio post-production of recent research and tools for University of Colorado DILLON COWER Syndicate 17 LLC the user in a created world by fooling pipeline for 360 videos immersive spatial audio and sound and Virtual Reality.