Audio for Virtual and Augmented Reality

Total Page:16

File Type:pdf, Size:1020Kb

Audio for Virtual and Augmented Reality 2016 AES CONFERENCE AUDIO FOR VIRTUAL AND AUGMENTED REALITY FRIDAY, SEPT 30 THRU SATURDAY, OCT 1 LOS ANGELES CONVENTION CENTER CONFERENCE PROGRAM PLATINUM SPONSORS GOLD SPONSORS SPONSORS MESSAGE FROM THE CONFERENCE CO-CHAIRS Welcome to the first AES International Conference on Audio for Virtual and Augmented Reality! We are really proud to present this amazing technical program, which is the result of many months of extremely hard teamwork. We aimed for the best content we could possibly provide, and here you have it. We are extremely thankful to our great presenters, authors, keynote speakers and sponsors. Together, we made this possible and we sincerely hope you will take away a lot of useful information. Also, I´d like to extend our special thanks to our delegates, coming from all over the world to ANDRES MAYO attend this truly unique event, and to our really hard working team of volunteers, which ultimately made it possible to Conference Co-chair pack this awesome quality and quantity of knowledge in 2 full days crammed with papers, workshops, tutorials and even a technical showcase. Welcome to the show! I would like to extend a warm welcome to all of our delegates, authors, presenters and sponsors. This conference has been a dream of Andres’ and mine since May of 2015. The world of VR / AR has grown so quickly, so fast that we knew we had to bring a conference dedicated specifically to this topic to the audio community. We could not have done this without the hard work and dedication of an incredible conference committee. VR / AR provides entirely new opportunities for audio as it is now part of the experience, not just an aid in conveying story. It has been speculated by Wall Street that VR / AR will LINDA GEDEMER be “as game changing as the advent of the PC”; so we’re in for an incredible journey. I believe the authors, presenters and Conference Co-chair sponsors here are some of the best visionaries to lead us on that journey. Please, enjoy the conference. 1201 SOUTH FIGUEROA STREET LOS ANGELES LOS ANGELES, CALIFORNIA 90015 CONVENTION (213) 741-1151 CENTER LACC Attendee Directions LA Live Entertainment District Visitor Information Centers Metro Guide First floor of Los Angeles Convention Center, showing main entrance to West Hall. Second floor of Los Angeles Convention Center, showing stairs to Lecture Theater and Workshop/Tutorials areas. CONFERENCE COMMITTEE ANDRES LINDA RICHARD BRIAN GREG MAYO GEDEMER WOLLRICH SEAGRAVE KADORIAN Program Content Event Logistics Conference Conference Business & Finance Assistant/Secretary Chair Co-Chair Co-Chair Chair/Treasurer GARY PABLO "TANGO" STEPHEN GRAHAM SARAH EPSTEIN FORMICA O’HARA KIRK STEVENSON Website Social Media Convention Volunteer Sales Session Coordinator Coordinator Coordinator Director Chair PROGRAM AND SIGNAGE DESIGNER: EZEQUIEL COLAVITA The committee would also like to recognize the hard work of these contributors (in alphabetical order): VIVIANA AKEL Plugged Minds CHRIS CAIN University of California, Santa Cruz. MICHELLE GOSSMAN Event Manager, Los Angeles Convention Center MEL LAMBERT Content-Creators.com DAVID SCHEIRMAN President-Elect, AES PROGRAM THEATER OVERVIEW SET UP | 8:00AM TUTORIAL 3 | 2:00PM OPENING KEYNOTE Spatial Audio and Sound | 8:30AM Propagation Philip Lelyveld for VR: New Developments, Implementations, and BREAK | 9:30AM Integration TUTORIAL 1 | 9:45AM BREAK | 3:30PM Audio Recording and Production for TUTORIAL 4 ° | 3:45PM Virtual Reality/360 3D Audio Post-Production Applications Workflows for VR BREAK | 11:15AM BREAK | 4:30PM TUTORIAL 2 | 11:30AM TUTORIAL 5 | 4:45PM Creating Immersive & How Can Audiology and Aesthetic Hearing Auditory Spaces for Science Inform AVAR Virtual and Augmented and Vice Versa? Reality BREAK LUNCH | 6:15PM FRI | 12:30PM TUTORIAL 6 | 6:30PM LUNCH TIME SESSION 1 | 12:45PM VR Audio - The Creating Scientifically Valid Convergence DAY Spatial Audio for VR and AR: of Sound Professions SEPTEMBER 30 Theory, Tools and Workflows ROOM 409A SET UP | 8:00AM PAPER SESSION 1 | 9:45AM BREAK | 3:00PM Sound Localization in 3D Space PAPER SESSION 4 | 3:15PM BREAK Capture, Rendering and | 11:15AM Mixing for VR Part 1 PAPER SESSION 2 | 11:30AM BREAK | 5:30PM Real -World Case Studies Part 1 PAPER SESSION 5 |5:45PM Streaming Immersive LUNCH | 12:45PM Audio Content PAPER SESSION 3 | 2:00PM Real -World Case Studies Part 2 THEATER SET UP | 8:00AM WORKSHOP 5 | CANCELLED Real-Time Production Chain WORKSHOP 1 | 8:30AM for Immersive 3D Audio End-to-End VR Audio Solution for Fully Immersive/ WORKSHOP 6 | 2:45PM Interactive Experience Positioning Sounds in VR Post Production BREAK | 9:15AM BREAK | 3:30PM WORKSHOP 2 | 9:30AM Object Based Audio Mixing WORKSHOP 7 | 3:45PM for AR/VR Applications OZO Audio Workflow BREAK | 10:15AM WORKSHOP 8 | 4:30PM Using MEMS Microphones WORKSHOP 3 | 10:30AM for Ambisonic Audio in a Facebook 360 Spatial Live Streaming Spherical Workstation: Video Camera Tools, Workflows and Best Practices BREAK SA | 5:15PM BREAK | 11:15AM WORKSHOP 9 | 5:30PM A Lightweight & Versatile TUR WORKSHOP 4 | 11:30AM 3D-Audio Codec for Storing Immersive Sound Capture & Transmitting Immersive for Cinematic Virtual Reality Audio and its Application to Live VR 360 Events DAY LUNCH | 12:30PM BREAK | 6:15PM OCTOBER 01 LUNCH TIME SESSION 2 | 12:45PM Challenges in Live Virtual CLOSING KEYNOTE | 6:30PM Reality Audio George Sanger ROOM 409A SET UP | 8:00AM WORKSHOP 10 | 8:30AM PAPER SESSION 7 | 2:00PM Audio Content Creation for Music for VR VR/AR Projects with Standard DAWs BREAK | 3:45PM BREAK | 9:15AM PAPER SESSION 6 | 9:30AM PAPER SESSION 8 | 4:00PM Perceptual Consideration Capture, Rendering and for VR/AR Mixing for VR Part 2 LUNCH | 12:30PM OPENING KEYNOTE CLOSING KEYNOTE THE JOURNEY FUTURE NOSTALGIA, INTO VIRTUAL AND HERE AND NOW: AUGMENTED REALITY LET’S LOOK BACK ON TODAY by Philip Lelyveld - VR/AR Initiative FROM 20 YEARS HENCE Program Manager, USC Entertainment Technology Center by George Sanger - Magic Leap Virtual, Augmented, and Mixed Reality have the potential of delivering Two decades of progress can change interactive experiences that take us to how we live and think in ways that places of emotional resonance, give boggle the mind. Audio is a small us agency to form our own experiential piece of that, but it’s our piece. 20 memories and become part of the years ago, the PC got rudimentary everyday lives we will live in the future. sound cards; now the entire Philip Lelyveld will define what Virtual, “multitrack recording studio” lives Augmented, and Mixed Reality are, on our computers. Some of us saw present recent developments that will that development as inevitable, but shape how they will potentially impact in 1996 those smart people sounded entertainment, work, learning, social fairly edgy, to say the least. And of interaction, and life in general, and those smart people, who among them raise rarely-mentioned but important saw that texting would be the “killer issues that will impact how VR/AR/MR app” for smart phones, in many ways is adopted. Just as TV programming trumping audio communication? progressed from live broadcasts of staged performances to today’s very Let’s take our accumulated wisdom complex language of multithread long- from the past 20 years of growth and form content, so VR/AR/MR will progress non-growth of audio and computing, from the current ‘early days’ of projecting and see if we can’t get some feel existing media language with a few for what it will be like in this room 20 tweaks into a headset experience to a years from now, looking back. new VR/AR/MR-specific language that both the creatives and the audience With luck, we will be nodding our understand. Philip’s goal is to bring you heads sagely, saying, “Yep, we saw up to speed on the current state, the that one coming way back in 2016!” potential, and the known barriers to adoption of Virtual, Augmented, and Mixed Reality. Saturday, October 01 | 6:30 PM AVAR Theater Friday, September 30 | 8:30 AM AVAR Theater TUTORIALS THEATER | 9:45AM THEATER | 12:45AM AUDIO RECORDING AND PRODUCTION LUNCHTIME SESSION 1: FOR VIRTUAL CREATING REALITY/360° THEATER | 11:30AM SCIENTIFICALLY APPLICATIONS CREATING VALID SPATIAL AUDIO IMMERSIVE FOR VR AND AR: & AESTHETIC THEORY, TOOLS AND Chair: AUDITORY SPACES WORKFLOWS JAN PLOGSTIES FOR VIRTUAL AND Fraunhofer Instiute AUGMENTED REALITY RAMANI DURAISWAMI Participants: ADAM O’DONOVAN CHRIS PIKE VisiSonics Corp. BBC Research & Development CHANEL SUMMERS University of Southern ABSTRACT DR. NILS PETERS California Qualcomm Technologies Inc. The goal of VR and AR is to immerse Syndicate 17 LLC DILLON COWER the user in a created world by fooling Google VR the human perceptual system into ABSTRACT perceiving rendered objects as real. ABSTRACT This presentation will This must be done without the brain discuss the challenges experiencing fatigue: accurate audio At IBC, AES 139th, CES and other representation plays a crucial role events Virtual Reality has been a and provide specific solutions for creating in achieving this. Unlike vision with huge topic. VR producers more and a narrow foveated field of view, more realize the potential and need audio within interactive virtual and augmented human hearing covers all directions for spatial audio processing for VR in full 3D. Spatial audio systems applications. This workshop will reality experiences. Audio techniques will must provide realistic rendering discuss the following topics: of sound objects in full 3D to 1. How to record audio for 360° video? be revealed that can be used today to advance complement stereo visual rendering. - Can we use the same techniques We will describe several areas of as for Movie/TV productions? Does a storytelling and gameplay in virtual environments our research, initially conducted at B-format mic do the trick? the University of Maryland over a 2.
Recommended publications
  • TV in VR Changho Choi, Peter Langner, Praveen Reddy, Satender Saroha, Sunil Srinivasan, Naveen Suryavamsh
    TV in VR Changho Choi, Peter Langner, Praveen Reddy, Satender Saroha, Sunil Srinivasan, Naveen Suryavamsh Introduction The evolution of storytelling has gone through various phases. Earliest known methods were through plain text. Plays and theatres were used to bring some of these stories to life but for the most part, artists relied on their audience to imagine the fictional worlds they were describing. Illustrations were a nice addition to help visualize an artist's perception. With the advent of cinema in the early 1900’s starting with silent films to the current summer blockbusters with their CGI, 3D and surround sound – viewers are transported into these imaginary worlds – to experience these worlds just as the creators of this content envisioned it. Virtual reality, with its ability to provide an immersive medium with a sense of presence and depth is the next frontier of storytelling. Seminal events in history ­ Moon landing in 1969 When Neil Armstrong and Buzz Aldrin took the first steps on the moon ­ it captured the imagination of the world. The culmination of a grand vision and the accompanying technological breakthroughs brought about an event that transfixed generations to come. As it happened in the 1969, the enabling technology for experiencing this event was the trusted radio or through grainy broadcasts of television anchors describing the events as they were described to them! Super Bowl 49 As the Seattle Seahawks stood a yard away from winning the Super Bowl in 2015, 115 million people watched on NBC in the United States alone. In front of their big screen TVs and every possible option explained to them by the commentators, the casual and the rabid football fan alike watched as the Seahawks lost due to a confluence of events.
    [Show full text]
  • People & Planet Report 2016
    People & Planet Report 2016 1.0 About this report We would like to thank you for reading the Nokia People & Planet Report 2016. The report presents and discusses the key ethical, environmental, and socio- economic issues most material to our business and stakeholders during the 2016 fiscal year. Sustainability 2016 About Approach Improve Protect Integrity Respect Together Data Assurance Nokia People & Planet Report 2016 2 7.01.0 ImprovingAbout people’sthis report lives with technology The scope of this report The scope of this report is Nokia Group, including Nokia’s Networks business. However, the numeric Further information Nokia's Networks business groups, Nokia data regarding our facilities energy use, waste, and Technologies, and Group Common and Other water include the whole Nokia Group. The chapters We have published annual corporate responsibility Your feedback Functions, in 2016. ‘Improving people’s lives with technology’ and reports since 1999 and the reports are available in We welcome your ‘Making change happen together’ include references digital format on our website from as far back as views and questions For an explanation of how we chose what to include to activities that took place in early 2017 but this is 2003 at nokia.com/sustainability on our activities and in this year’s report, please refer to the section indicated in the text separately. our performance. If Materiality: Identifying our key priorities. We also discuss sustainability and corporate you would like to share Reporting frameworks and responsibility topics in our official annual reports, your opinions, please At the end of 2015, our shareholders voted including the annual report on Form 20-F that contact us at overwhelmingly to approve the Alcatel-Lucent assurance is filed with the U.S.
    [Show full text]
  • Live Delivery of Neurosurgical Operating Theater Experience in Virtual Reality
    Live delivery of neurosurgical operating theater experience in virtual reality Marja Salmimaa (SID Senior Member) Abstract — A system for assisting in microneurosurgical training and for delivering interactive mixed Jyrki Kimmel (SID Senior Member) reality surgical experience live was developed and experimented in hospital premises. An interactive Tero Jokela experience from the neurosurgical operating theater was presented together with associated medical Peter Eskolin content on virtual reality eyewear of remote users. Details of the stereoscopic 360-degree capture, surgery imaging equipment, signal delivery, and display systems are presented, and the presence Toni Järvenpää (SID Member) Petri Piippo experience and the visual quality questionnaire results are discussed. The users reported positive scores Kiti Müller on the questionnaire on topics related to the user experience achieved in the trial. Jarno Satopää Keywords — Virtual reality, 360-degree camera, stereoscopic VR, neurosurgery. DOI # 10.1002/jsid.636 1 Introduction cases delivering a sufficient quality, VR experience is important yet challenging. In general, perceptual dimensions Virtual reality (VR) imaging systems have been developed in affecting the quality of experience can be categorized into the last few years with great professional and consumer primary dimensions such as picture quality, depth quality, interest.1 These capture devices have either two or a few and visual comfort, and into additional ones, which include, more camera modules, providing only a monoscopic view, or for example, naturalness and sense of presence.5 for instance eight or more cameras to image the surrounding VR systems as such introduce various features potentially environment in stereoscopic, three-dimensional (3-D) affecting the visual experience and the perceived quality of fashion.
    [Show full text]
  • (Virtual) Reality the OZO Allows the Director and Crew to View Their Shots, Adjust Exposure and View Stitch – for Video Europe Mark Locations, All Live
    Virtual reality/360º Virtual reality/360º One early lesson I learned was the difference between 360 video and VR. Frankly, I was a bit disappointed to discover that, from a VR purist’s point of view, what I’d been shooting was not actually VR. It was merely 360 video. VR, you see, has Stitch lines are like fault lines in the Earth’s crust, liable to be as good as its name – virtual reality. And reality, as we all to erupt at a moment’s notice with a double image, or a know, is 3D. Hence, true VR cameras capture video in stereo, ghost, or a horrible jutting chin where someone’s face The with multiple left and right lenses capturing the landscape twice, just as our eyes do, to be recombined in the headset has been imperfectly duplicated in two lenses. later to create a sense of depth. Without this vital element of immersion, it might still be a fascinating wrap-a-round these up, the computer is able to stitch two separate images essential experience, but it isn’t VR. together, slowly building up a 360-degree panorama. The Nevertheless, whether it’s VR or 360 video, the stitching annoying thing is that the control points which work for one process is the same and there are some universal truths frame may not work for the next. From moment to moment, the that will probably remain valid for a few more years. One relationship between objects changes – people walk past, trees stitch hard truth is that any algorithm that automatically stitches sway in the wind, inquisitive little kids approach the camera and images together will not give perfect results every time.
    [Show full text]
  • Applications of VR
    Applications of VR Copyright 2018 © Virtual Reality at Berkeley Functions of VR: Gaming/Entertainment Simulation/Training 360 Content Telepresence Visualization Gaming and Entertainment 3 Gaming Fitness Theme Parks What makes gaming in VR different? ● Immersion ● 3D Sound ● Room-Scale ● Interactive (like the Wii but better) Arguably the biggest driver in the VR industry currently Fitness VR Roller Coasters Simulation and Training 8 Medical Industrial Aerospace Others Medical: Surgical Training Medical: Exposure Therapy Conquering Fears: - Arachnophobia - Acrophobia Treating PTSD - Learning how to handle “triggers” in a safe and controlled environment Medical: Phantom Limb Pain Phantom Limb Pain - Sensations that an individual experiences relating to a limb or an organ that is not physically part of the body. In VR, patients play games using a virtual limb, which helps them gain some control and learn, for example, how to relax that painfully clenched fist. Industrial: Driving Simulator By incorporating VR into motion/driving simulators, users will no longer be limited to the view in front of them (front screens). Rather, VR will enable users to see all of the virtual environment. Industrial: Virtual CAD Uses: ● Visualizing/prototyping models before fabrication. ● Collaboration Industrial: Volkswagen ● Vehicle Assembly ● Onboarding Aerospace: NASA NASA has been using VR at the Johnson Space Center in Houston, Texas to train astronauts for spacewalks since 1992. Others: 360 Content 360 Photos 360 Cameras Quite a few 360 cameras on the market. - Ricoh Theta (~$330) - Samsung Gear 360 (~$180) 360 Video - A video where you can see all around you. - Captured using a 360 camera. Nokia OZO Price: Too much ($45K-60K) 360 Animations - Animation where you can see all around you.
    [Show full text]
  • Technological Change 2013-2016 Change Technological Publication of the Committee for the Future 2/2016
    technological change 2013-2016 publication of the committee for the future 2/2016 technological change 2013-2016 Preliminary investigation of the development of radical technologies after the 2013 review 2/2016 isbn 978-951-53-3616-3 (paperback) • isbn 978-951-53-3617-0 (pdf) issn 2342-6594 (printed) • issn 2342-6608 (web) TECHNOLOGICAL CHANGE 2013–2016 Preliminary investigation: Development of radical technologies after the review in 2013 (100 Opportunities For Finland And The World, Publication Of The Committee For The Future 11/2014) Risto Linturi publication of the committee for the future 2/2016 Cover: freeimageslive.com Back cover: Part of the Artwork Tulevaisuus, Väinö Aaltonen (1932), photo Vesa Lindqvist. Committee for the Future FI-00102 Parliament of Finland www.parliament.fi Helsinki 2016 ISBN 978-951-53-3616-3 (paperback) ISBN 978-951-53-3617-0 (PDF) ISSN 2342-6594 (printed) ISSN 2342-6608 (web) Contents Foreword ......................................................................................................................... 5 1 Introduction, summary of observations and recommendations ................................ 8 1.1 A Hundred New Opportunities for Finland: Radical Technological Solutions ...... 8 1.2 Crowdsourcing after the publication of TuVRad9/2013 and acknowledgements ..................................................................................................... 9 1.3 Objectives of the preliminary investigation ...................................................... 11 1.4 The fastest-progressing baskets in the TuvRad9/2013 Top 25 category .......... 12 1.5 The fastest-progressing baskets in the TuVRad9/2016 Top 26–100 category . 13 1.6 New baskets and fields of technology that are proposed for monitoring ........ 14 1.7 Structural improvements to the report ............................................................ 15 1.8 Regional and international application of the four-level model ....................... 16 1.9 Interactive updating of the report with the help of database .........................
    [Show full text]
  • Virtual & Augmented Reality
    EXCERPTED FROM THE ORIGINAL: See inside cover for details. FINANCIAL BACKING GLOBAL INTEREST SHIPPING OUT SELLING OUT INTEREST IN THE PAST READY TO BUILD A WAVE OF CONTENT ON THE WAY RETAIL VALUE HOME REDESIGN, REIMAGINED EASIER TO IMAGINE YOURSELF AT HOME Video • Jaunt The Ecosystem • NextVR Virtual Reality / Augmented Reality • VRSE • Oculus Story Studio • GoPro • IG Port Processors Games • TI Applications • Sony • Qualcomm • Ubisoft 3D Audio • STMicro Graphics • CCP Games • Nvidia • TI • Realtek • Oculus Story Studio • AMD • Wolfson • Himax • Tammeka Games • Qualcomm • Realtek • MediaTek • Pixel Titans • Intel • Capcom Augmented Reality Virtual Reality Engineering • Microsoft HoloLens • Facebook Oculus Head–mounted devices • Autodesk • Google Glass • Samsung Gear VR • Dassault Systèmes • Magic Leap • Google Cardboard • IrisVR • Atheer • HTC Vive • Visidraft • Osterhout Design • Sony PSVR • MakeVR Memory Group • Vuzix iWear (DRAM/SSD) • VR Union Claire • Micron Healthcare • Samsung • Psious • SK Hynix • zSpace • Toshiba • Conquer Mobile • 3D Systems Social • Altspace VR • High Fidelity • Podrift Commerce • Sixense {shopping} • Matterport {real estate} Display • Samsung • JDI Cameras • Himax • 360Heros • Crystal • GoPro Odyssey 3D Lenses • Nokia OZO • Wearality • Jaunt NEO • Zeiss • Matterport Pro 3D Components • Canon • Nikon Haptics • Largan • Alps Position/ Room Tracker • AAC • Hon Hai • Nidec • Pegatron • Flex • Jabil • HTC Motion Sensors • Leap Motion • InvenSense • TI • STMicro • Honeywell The Ecosystem Virtual Reality / Augmented
    [Show full text]
  • Virtual Reality Een Realiteit Voor Uw Portefeuille? of Kijkt U Liever Door Een Roze Bril Naar Uw Rendement?
    Virtual Reality Een realiteit voor uw portefeuille? Of kijkt u liever door een roze bril naar uw rendement? Tom Simonts Marktenspecialist Bolero Hype Cycle van Gartner Het “make or break”-punt werd overschreden Bedrijf Datum Evenement Qualcomm Jan-12 Startkapitaal op voor de mobiele AR-start-up Blippar Google Apr-12 Augmented reality-bril, Google Glass, voorgesteld aan het publiek Sony Mar-14 Project Morpheus wordt geboren en later omgedoopt tot PlayStation VR HP Mar-14 Lanceert Aurasma 3.0, een AR-platform dat het verwierf via Autonomy Facebook Mar-14 Overname Oculus, een VR-start-up, voor 2 miljard USD Samsung Sep-14 presenteert eigen VR-bril, Samsung Gear VR, in samenwerking met Oculus Google Oct-14 Investeert 542 miljoen USD in start-up Magic Leap Intel Apr-15 Investeert in Series A-financiering voor de VR-start-up WorldViz Apple May-15 neemt Metaio over, een AR-softwareproducent Disney Sep-15 FJaunt, een VR-content start-up, voor 65 miljoen dollar Microsoft Oct-15 neemt Havok over, een 3D Physics-engine voor videospelletjes Comcast Nov-15 Financieringsronde NextVR voor 30,5 miljoen USD, voor live evenementen Apple Nov-15 Overname Faceshift, een bedrijf in gezichtsherkenning en animatie Fox Jan-16 Minderheidsbelang in producent van VR/AR-brillen Osterhout Design Group Marktverwachtingen Verwachte groei van omzet uit hardware en software Disruptiepotentieel Software sector . Geschatte omzet : 35 miljard dollar . Inkomsten uit VR/AR-software . 60% zal worden gegenereerd door de consument . 40% door bedrijven en de openbare sector . Videospelletjes zal de eerste markt zijn waar VR/AR zich zal ontwikkelen .
    [Show full text]
  • IMMERSIVE MEDIA a STATE of the INDUSTRY May 2017
    IMMERSIVE MEDIA A STATE OF THE INDUSTRY May 2017 VR/AR Project VR/AR Project vrarproject.com [email protected] VR/AR Project New Amsterdam Media 1 VR/AR Project May 1, 2017 Rev 3.0 Editor: Seth Shapiro Deputy Editors: Bryce Paul & Andriy Pishchalenko Contributors: Perisa Brown, John Canning, Amy Dai, Xingting Gu, Hudson Leiser, Francisco Serna, Kinsey Thompson V2 Seth Shapiro 2016 Andriy Pishchalenko V1 Seth Shapiro 2015 Andriy Pishchalenko [email protected] VR/AR Project New Amsterdam Media 2 VR/AR Project [email protected] VR/AR Project New Amsterdam Media 3 VR/AR Project THIS IS AN OPEN COMMUNITY PROJECT. THIS IS A SNAPSHOT OF A RAPIDLY EVOLVING LANDSCAPE. TO OPT IN FOR FUTURE VERSIONS OF THIS PAPER, JOIN US AT VRARPROJECT.COM EMAIL US AT [email protected] [email protected] VR/AR Project New Amsterdam Media 4 VR/AR Project TABLE OF CONTENTS I 1. Preface 7 2. Overview 8 3. Enterprise Use Cases 9 Advertising & Marketing 9 Aerospace & Defense 11 Construction 12 Education 14 Entertainment 15 Fashion 18 Finance 19 Gaming 21 Healthcare 24 Live Events 26 Real Estate 28 Retail 29 Training 31 Travel & Hospitality 32 4. Computer Rendered VR 35 5. Live Action VR 37 6. Web VR 38 7. Social VR 39 8. Location-Based VR 42 Theme parks 42 VRcades 44 9. Smartphone VR/AR 46 10. VR Head Mounted Displays (HMDs) 49 11. AR/MR Head Mounted Displays (HMDs) 54 12. Spatial Audio 59 13. Haptics, Accessories, and Control Systems 63 Omnidirectional Treadmills 66 Exercise and fitness 29 Haptic Suits 64 Galvanic Vestibular Stimulation (GVS) 67 [email protected] VR/AR Project New Amsterdam Media 5 VR/AR Project TABLE OF CONTENTS II Advanced movement tracking 66 14.
    [Show full text]
  • Realidad-Virtual-2016-V1.Pdf
    Juan Barambones Realidad Virtual 2016 Intro. Hace un año publiqué por primera vez es- mos, con posicionamiento incluido y sin te libro-guía con el fin de integrar en un úni- cables. La eliminación de los cables, una co documento un resumen de todo lo el reducción de peso, y sobre todo un precio ecosistema que se va generando alrede- ajustado, será un paso importante para la dor de la Realidad Virtual. Durante la prepa- adopción masiva de esta de esta tecnolo- ración de la segunda edición, he visto có- gía. mo en este último año, el interés por esta tecnología ha ido creciendo de forma expo- Las cámaras 360 también han experimen- nencial, y seguramente lo siga haciendo tado un gran auge, después de que mu- en el futuro. chas empresas pequeñas hayan sacado con esfuerzo sus productos, otras más Los grandes actores de la Realidad Virtual grandes como Samsung, o LG han hecho han movido ficha, y con los tres dispositi- lo propio en un mercado que cada vez se vos más importantes ya en el mercado, es ha vuelto más competitivo. cuestión de tiempo que la Realidad Virtual se haga un hueco en nuestras casas. Se Sin duda son momentos apasionantes, úni- puede decir que 2016 es el año 0, a partir cos, los que estamos viviendo en el nuevo de aquí será cuestión de tiempo que se ex- renacer de la Realidad Virtual. Aproveché- tienda. moslo para crear experiencias y aplicacio- nes que cambien el mundo, podemos ser Los proyectos recientemente presentados mejores personas con la Realidad Virtual.
    [Show full text]
  • Playing with Virtual Reality: Early Adopters of Commercial Immersive Technology
    Playing with Virtual Reality: Early Adopters of Commercial Immersive Technology Maxwell Foxman Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy under the Executive Committee of the Graduate School of Arts and Sciences COLUMBIA UNIVERSITY 2018 © 2018 Maxwell Foxman All rights reserved ABSTRACT Playing with Virtual Reality: Early Adopters of Commercial Immersive Technology Maxwell Foxman This dissertation examines early adopters of mass-marketed Virtual Reality (VR), as well as other immersive technologies, and the playful processes by which they incorporate the devices into their lives within New York City. Starting in 2016, relatively inexpensive head-mounted displays (HMDs) were manufactured and distributed by leaders in the game and information technology industries. However, even before these releases, developers and content creators were testing the devices through “development kits.” These de facto early adopters, who are distinctly commercially-oriented, acted as a launching point for the dissertation to scrutinize how, why and in what ways digital technologies spread to the wider public. Taking a multimethod approach that combines semi-structured interviews, two years of participant observation, media discourse analysis and autoethnography, the dissertation details a moment in the diffusion of an innovation and how publicity, social forces and industry influence adoption. This includes studying the media ecosystem which promotes and sustains VR, the role of New York City in framing opportunities and barriers for new users, and a description of meetups as important communities where devotees congregate. With Game Studies as a backdrop for analysis, the dissertation posits that the blurry relationship between labor and play held by most enthusiasts sustains the process of VR adoption.
    [Show full text]
  • OZO Setup Guide and Requirements
    OZO+ C A M E R A S E T U P G U I D E A N D REQUIREMENTS Updated 15th August 2017 References OZO Remote V2.1 2 Pre-requisites Before starting, you will need to have the following configurations. All software and/or drivers must be installed prior to installing OZO Remote 2.0. See the attached appendices for various guidelines. For MacPros®: Supported Operating System Mac OS X® 10.11 El Capitan; macOS™ X® 10.12 Sierra Supported Hardware Mac Pro® (Late 2013) with Dual AMD FirePro™ D500 or D700 (recommended) Blackmagic Recorder: Blackmagic UltraStudio Mini Recorder (Thunderbolt™ 2) Blackmagic HyperDeck Studio Pro (Thunderbolt™ 2) Software requirements Blackmagic Desktop Video 10.9.5 Optional: Blackmagic Hyperdeck 5.1 Oculus Runtime for OS X 0.5.0.1-beta 3 For MacBook Pros® (Late 2013): Supported Operating System Mac OS X® 10.11 El Capitan; macOS™ X® 10.12 Sierra Supported Hardware MacBook Pro® (Late 2013) with discrete AMD or Nvidia GPU Blackmagic Recorder: Blackmagic UltraStudio Mini Recorder (Thunderbolt™ 2) Blackmagic HyperDeck Studio Pro (Thunderbolt™ 2) Software requirements Blackmagic Desktop Video 10.9.5 Optional: Blackmagic Hyperdeck 5.1 Oculus Runtime for OS X 0.5.0.1-beta 4 For MacBook Pros® (Late 2016): Supported Operating System Mac OS X® 10.12 Sierra Supported Hardware MacBook Pro® 15” (Late 2016) with discrete AMD Radeon™ Pro GPU Apple ThunderboltTM 3 (USB-C) to ThunderboltTM 2 Adapter or StarTech ThunderboltTM 3 to ThunderboltTM 2 Adapter (TBT3TBTADAP) Blackmagic Recorder: Blackmagic UltraStudio Mini Recorder (Thunderbolt™
    [Show full text]