Telepresence and Remote Communication Through Virtual Reality Gabriella Rydenfors

Total Page:16

File Type:pdf, Size:1020Kb

Telepresence and Remote Communication Through Virtual Reality Gabriella Rydenfors LiU-ITN-TEK-A--17/012--SE Telepresence and remote communication through virtual reality Gabriella Rydenfors 2017-06-09 Department of Science and Technology Institutionen för teknik och naturvetenskap Linköping University Linköpings universitet nedewS ,gnipökrroN 47 106-ES 47 ,gnipökrroN nedewS 106 47 gnipökrroN LiU-ITN-TEK-A--17/012--SE Telepresence and remote communication through virtual reality Examensarbete utfört i Datateknik vid Tekniska högskolan vid Linköpings universitet Gabriella Rydenfors Handledare Karljohan Lundin Palmerius Examinator Camilla Forsell Norrköping 2017-06-09 Upphovsrätt Detta dokument hålls tillgängligt på Internet – eller dess framtida ersättare – under en längre tid från publiceringsdatum under förutsättning att inga extra- ordinära omständigheter uppstår. Tillgång till dokumentet innebär tillstånd för var och en att läsa, ladda ner, skriva ut enstaka kopior för enskilt bruk och att använda det oförändrat för ickekommersiell forskning och för undervisning. Överföring av upphovsrätten vid en senare tidpunkt kan inte upphäva detta tillstånd. All annan användning av dokumentet kräver upphovsmannens medgivande. För att garantera äktheten, säkerheten och tillgängligheten finns det lösningar av teknisk och administrativ art. Upphovsmannens ideella rätt innefattar rätt att bli nämnd som upphovsman i den omfattning som god sed kräver vid användning av dokumentet på ovan beskrivna sätt samt skydd mot att dokumentet ändras eller presenteras i sådan form eller i sådant sammanhang som är kränkande för upphovsmannens litterära eller konstnärliga anseende eller egenart. För ytterligare information om Linköping University Electronic Press se förlagets hemsida http://www.ep.liu.se/ Copyright The publishers will keep this document online on the Internet - or its possible replacement - for a considerable time from the date of publication barring exceptional circumstances. The online availability of the document implies a permanent permission for anyone to read, to download, to print out single copies for your own use and to use it unchanged for any non-commercial research and educational purpose. Subsequent transfers of copyright cannot revoke this permission. All other uses of the document are conditional on the consent of the copyright owner. The publisher has taken technical and administrative measures to assure authenticity, security and accessibility. According to intellectual property law the author has the right to be mentioned when his/her work is accessed as described above and to be protected against infringement. For additional information about the Linköping University Electronic Press and its procedures for publication and for assurance of document integrity, please refer to its WWW home page: http://www.ep.liu.se/ © Gabriella Rydenfors Master Thesis Telepresence and remote communication through virtual reality Supervisors: Jonathan Nilsson Voysys AB Author: Torkel Danielsson Gabriella Rydenfors Voysys AB Karl-Johan Lundin Palmerius Link¨opingUniversity Examiner: Camilla Forsell in the Department of Science and Technology June 2017 LINKOPING¨ UNIVERSITY Abstract Institute of Technology Department of Science and Technology Master of Science in Computer Science and Media Technology Telepresence and remote communication through virtual reality by Gabriella Rydenfors This Master Thesis concerns a telepresence implementation which utilizes state-of-the- art virtual reality combined with live 360◦ video. Navigation interfaces for telepresence with virtual reality headsets were developed and evaluated through a user study. An evaluation of telepresence as a communication media was performed, comparing it to video communication. The result showed that telepresence was a better communication media than video communication. Contents Abstract i List of Figures v List of Tables vi Abbreviations vii 1 Introduction 1 1.1 Background . 1 1.2 Problemdescription .............................. 2 1.3 Purpose ..................................... 2 1.4 Researchquestions ............................... 3 1.5 Method ..................................... 3 1.6 Limitations . 4 2 Background and related work 5 2.1 Virtualreality.................................. 5 2.2 Telepresence................................... 6 2.3 Hardwareoverview............................... 6 2.3.1 HTC Vive . 6 2.3.2 Telepresence robot . 6 2.4 Softwareoverview ............................... 7 2.4.1 OdenVR................................. 7 2.4.2 OpenVR................................. 7 2.4.3 GStreamer ............................... 7 2.5 Related works and technology . 8 2.5.1 Navigation algorithms in telepresence . 8 2.5.2 Telepresence as a communication tool . 9 3 Telepresence robot 11 3.1 Robot description . 11 3.1.1 Hardware . 12 3.1.1.1 Stepper Motor . 12 3.1.1.2 Zoom H2n . 14 3.1.1.3 OdenVR Cube . 14 3.1.1.4 Router . 15 ii Contents iii 3.1.2 Software . 15 3.1.2.1 TCP server . 15 3.1.2.2 Network protocol . 15 3.1.2.3 Automatic startup for required programs . 15 3.2 Audio communication . 16 3.2.1 GStreamer . 16 3.2.2 Audio communication . 17 3.2.2.1 Windows . 17 3.2.2.2 Raspberry Pi . 18 3.3 Navigation interfaces . 18 3.3.1 Button based navigation interfaces . 19 3.3.1.1 Car inspired remote control . 19 3.3.1.2 Touch based remote control . 19 3.3.2 Hand orientation based navigation interfaces . 20 3.3.2.1 Point based navigation . 21 3.3.2.2 Crosshair inspired navigation . 21 3.3.3 Head orientation based navigation interfaces . 21 3.3.3.1 Gaze based navigation . 21 3.3.3.2 Touch based remote control relative head direction . 22 4 User evaluation 24 4.1 Evaluation of navigation interface . 24 4.1.1 Procedure................................ 25 4.2 Evaluation of telepresence as a communication tool . 26 4.2.1 Measurement method . 26 4.2.2 Procedure................................ 27 5 Results 29 5.1 Steeringinterfaces ............................... 29 5.2 Telepresenceexperience . 30 5.2.1 The interactant ............................. 30 5.2.2 The inhabitor .............................. 31 5.2.3 The combined result . 32 6 Discussion 34 6.1 Navigation interface evaluation . 34 6.2 Telepresence compared to video communication . 35 6.2.1 Measurement method . 35 6.2.2 Evaluation procedure . 35 6.2.3 Result.................................. 36 6.2.3.1 The interactant ....................... 36 6.2.3.2 The inhabitor ........................ 37 6.3 Telepresencerobot ............................... 38 6.3.1 ZOOM H2N microphone . 38 6.3.2 Camera height . 39 6.4 Audio communication . 39 Contents iv 7 Conclusion and future work 40 7.1 Navigation interfaces for telepresence . 40 7.2 Measurement method for communication . 41 7.3 Telepresence as a communication tool in comparison with video commu- nication ..................................... 41 7.4 Futurework................................... 42 7.4.1 Semi autonomic navigation . 42 7.4.2 Image stabilization . 42 7.4.3 Global network . 43 A Communication measurement method 44 A.1 Efficiency .................................... 44 A.2 Participation . 44 A.3 Process Satisfaction . 45 A.4 Solution Satisfaction . 45 A.5 Negative Socio-Emotional Behavior . 45 A.6 Co-presence................................... 45 A.7 Cognitive load . 46 B Evaluation Questionnaire 47 Bibliography 51 List of Figures 3.1 Telepresencerobot ............................... 12 3.2 Stepper motor . 13 3.3 OdenVRCube ................................. 14 3.4 AGStreamerPipeline ............................. 16 3.5 Soundpipelineonwindows .......................... 18 3.6 Sound pipeline on Raspberry Pi . 18 3.7 Car inspired remote control . 20 3.8 Touch based remote control . 20 3.9 Point based navigation . 21 3.10 Crosshair inspired navigation . 22 3.11 Gaze based navigation . 22 4.1 Navigation interface study . 25 4.2 Telepresence evaluation . 27 5.1 Navigation interface test result . 29 5.2 Preferred communication method by the interactant . 31 5.3 Preferred communication method by the inhabitor . 32 6.1 The interactant’s process satisfaction for the telepresence communication 37 6.2 The interactant’s process satisfaction for the video communication . 37 v List of Tables 3.1 List of components on the telepresence robot . 13 4.1 The test order in evaluation of telepresence and video as communication methods..................................... 27 5.1 Time and correctness comparison between telepresence and video com- munication ................................... 30 5.2 Summary of measured variables for the interactant . 30 5.3 Summary of measured variables for the inhabitor . 32 5.4 Summary of measured variables for both the interactant and inhabitor . 33 7.1 Preferable communication method with regard to the measured variable . 42 vi Abbreviations VR Virtual Reality HMD Head Mounted Display IMU Inertial Measurement Unit USB Universal Serial Bus FOV Field Of View RTP Real-time Transport Protocol TCP Transmission Control Protocol SDK Software Development Kit API Aapplication Programming Interface LiPo Lithium Polymer UDP User Datagram Protocol LGPL Lesser General Public License vii Chapter 1 Introduction This master thesis concerns telepresence as a communication tool and is made for the Department of Science and Technology at Link¨oping University and Voysys AB. This chapter includes an introduction to telepresence, the background of this project and how it relates to Voysys. 1.1 Background The thought of traveling instantly (like teleporting) has enchanted humanity and inspired the invention of ever faster transportation options. With
Recommended publications
  • The Application of Virtual Reality in Engineering Education
    applied sciences Review The Application of Virtual Reality in Engineering Education Maged Soliman 1 , Apostolos Pesyridis 2,3, Damon Dalaymani-Zad 1,*, Mohammed Gronfula 2 and Miltiadis Kourmpetis 2 1 College of Engineering, Design and Physical Sciences, Brunel University London, London UB3 3PH, UK; [email protected] 2 College of Engineering, Alasala University, King Fahad Bin Abdulaziz Rd., Dammam 31483, Saudi Arabia; [email protected] (A.P.); [email protected] (M.G.); [email protected] (M.K.) 3 Metapower Limited, Northwood, London HA6 2NP, UK * Correspondence: [email protected] Abstract: The advancement of VR technology through the increase in its processing power and decrease in its cost and form factor induced the research and market interest away from the gaming industry and towards education and training. In this paper, we argue and present evidence from vast research that VR is an excellent tool in engineering education. Through our review, we deduced that VR has positive cognitive and pedagogical benefits in engineering education, which ultimately improves the students’ understanding of the subjects, performance and grades, and education experience. In addition, the benefits extend to the university/institution in terms of reduced liability, infrastructure, and cost through the use of VR as a replacement to physical laboratories. There are added benefits of equal educational experience for the students with special needs as well as distance learning students who have no access to physical labs. Furthermore, recent reviews identified that VR applications for education currently lack learning theories and objectives integration in their design.
    [Show full text]
  • Design Architecture in Virtual Reality
    Design Architecture in Virtual Reality by Anisha Sankar A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master of Architecture Waterloo, Ontario, Canada, 2019 © Anisha Sankar 2019 Author’s Declaration I hereby declare that I am the sole author of this thesis. This is a true copy of the thesis, including any required final revisions, as accepted by my examiners. I understand that my thesis may be made electronically available to the public. - iii - Abstract Architectural representation has newly been introduced to Virtual Real- ity (VR) technology, which provides architects with a medium to show- case unbuilt designs as immersive experiences. Designers can use specialized VR headsets and equipment to provide a client or member of their design team with the illusion of being within the digital space they are presented on screen. This mode of representation is unprec- edented to the architectural field, as VR is able to create the sensation of being encompassed in an environment at full scale, potentially elic- iting a visceral response from users, similar to the response physical architecture produces. While this premise makes the technology highly applicable towards the architectural practice, it might not be the most practical medium to communicate design intent. Since VR’s conception, the primary software to facilitate VR content creation has been geared towards programmers rather than architects. The practicality of inte- grating virtual reality within a traditional architectural design workflow is often overlooked in the discussion surrounding the use of VR to rep- resent design projects. This thesis aims to investigate the practicality of VR as part of a de- sign methodology, through the assessment of efficacy and efficiency, while studying the integration of VR into the architectural workflow.
    [Show full text]
  • Learn More: Windows Mixed Reality Platform + Steamvr
    NOT FOR USE IN INDIA FAQ HP REVERB VR HEADSET PROFESSIONAL EDITION, STEAMVR & WINDOWS MIXED REALITY 2 1.0 STEAMVR 3 2.0 HP REVERB VR HEADSET PRO EDITION 6 3.0 WINDOWS MIXED REALITY 7 LEARN MORE: WINDOWS MIXED 4.0 GENERAL VR REALITY PLATFORM + STEAMVR Frequently asked questions about HP’s professional head-mounted display (HMD) - built on the Windows Mixed Reality (WMR) platform - and integration with SteamVR. The HP Reverb Virtual Reality Headset - Professional Edition offers stunning immersive computing with significant ease of setup and use in a cost effective solution. This solution is well suited for Engineering Product Dev and design reviews, AEC (Architecture, Engineering & Construction) reviews, location-based entertainment, and MRO (Maintenance, Repair and Overhaul) training use environments. HIGHLIGHT: Take advantage of the complete Windows 10 Mixed Reality and SteamVR ecosystems. The HP Reverb VR Headset Pro HP Reverb Virtual Reality Headset - Professional Edition is not recommended for children under the age of Edition is built on the Windows IMPORTANT NOTE: 13. All users should read the HP Reverb Virtual Reality Headset - Professional Edition User Guide to reduce the risk of personal Mixed Reality platform. injury, discomfort, property damage, and other potential hazards and for important information related to your health and Integration with SteamVR safety when using the headset. Windows Mixed Reality requires Windows 10 October 2018 Update installed on the workstation requires the Windows Mixed or PC. Features may require software or other 3rd-party applications to provide the described functionality. To minimize the Reality bridge app. possibility of experiencing discomfort using a VR application, ensure that the PC system is equipped with the appropriate graphics and CPU for the VR application.
    [Show full text]
  • Immersive Virtual Reality Attacks and the Human Joystick Peter Casey University of New Haven
    University of New Haven Masthead Logo Digital Commons @ New Haven Electrical & Computer Engineering and Computer Electrical & Computer Engineering and Computer Science Faculty Publications Science 3-27-2019 Immersive Virtual Reality Attacks and the Human Joystick Peter Casey University of New Haven Ibrahim Baggili University of New Haven, [email protected] Ananya Yarramreddy University of New Haven Follow this and additional works at: https://digitalcommons.newhaven.edu/ electricalcomputerengineering-facpubs Part of the Computer Engineering Commons, Electrical and Computer Engineering Commons, Forensic Science and Technology Commons, and the Information Security Commons Publisher Citation Casey, P., Baggili, I., & Yarramreddy, A. (2019). Immersive Virtual Reality Attacks and the Human Joystick. IEEE Transactions on Dependable and Secure Computing. doi:10.1109/TDSC.2019.2907942 Comments This material is based upon work supported by the National Science Foundation under Grant No. 1748950. © © 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The ev rsion of record may be found at http://dx.doi.org/10.1109/ TDSC.2019.2907942. Dr. Baggili was appointed to the University of New Haven's Elder Family Endowed Chair in 2015. 1 Immersive Virtual Reality Attacks and the Human Joystick Peter Casey, Ibrahim Baggili, and Ananya Yarramreddy Abstract—This is one of the first accounts for the security analysis of consumer immersive Virtual Reality (VR) systems.
    [Show full text]
  • Self Representation and Interaction in Immersive Virtual Reality
    Self Representation and Interaction in Immersive Virtual Reality Eros Viola a, Fabio Solari b and Manuela Chessa c Dept. of Informatics, Bioengineering, Robotics, and Systems Engineering, University of Genoa, Italy Keywords: Virtual Reality, Self Representation, Intel Realsense D435, Interaction, Leap Motion, Manus Prime Haptic Gloves, Alignment, Rigid Transformation, Live Correction. Abstract: Inserting a self-representation in Virtual Reality is an open problem with several implications for both the sense of presence and interaction in virtual environments. To cope the problem with low cost devices, we de- vise a framework to align the measurements of different acquisition devices used while wearing a tracked VR head-mounted display (HMD). Specifically, we use the skeletal tracking features of an RGB-D sensor (Intel Realsense d435) to build the user’s avatar, and compare different interaction technologies: a Leap Motion, the Manus Prime haptic gloves, and the Oculus Controllers. The effectiveness of the proposed systems is assessed through an experimental session, where an assembly task is proposed with the three different interaction medi- ums, with and without the self-representation. Users reported their feeling by answering the User Experience and Igroup Presence Questionnaires, and we analyze the total time to completion and the error rate. 1 INTRODUCTION The focus is to develop a framework that is compat- ible with the most common head-mounted displays In current Virtual Reality (VR) applications, the vi- (HMDs), and that can also be extended to other track- sual feedback of the user’s body is often missing, de- ing devices, both for the body tracking and for the spite the abundance of enabling technologies, which hands and fingers tracking.
    [Show full text]
  • Subject Index
    863 Subject Index ‘Note: Page numbers followed by “f” indicate figures, “t” indicate tables and “b” indicate boxes.’ A Affordances, 112–114 A/D conversion. See Analog to Digital conversion in virtual reality, 114–117 (A/D conversion) false affordances, 116 AAAD. See Action at a distance (AAAD) reinforcing perceived affordances, 116–117 AAR. See After-action review (AAR) After-action review (AAR), 545f, 630, 630f, 634–635, 645, Absolute input, 198–200 761 Abstract haptic representations, 439 Affordances of VR, 114–117 Abstract synthesis, 495 Agency, 162, 164, 181 Abstraction triangle, 448 Agents, 552–553, 592–593, 614, 684–685 Accelerometers, 198–199, 218 AIFF. See Audio interchange file format (AIFF) Accommodation, 140–141, 273–275, 320, 570, 804 Airfoils, 13 Action at a distance (AAAD), 557–558 AIs. See Artificial intelligences (AIs) Activation mechanism, 554–556, 583 Aladdin’s Magic Carpet Ride VR experience, 185–186, 347, Active haptic displays, 516 347f, 470, 505, 625, 735, 770–771 Active input, 193–196 Alberti, Leon Battista, 28 Active surfaces, 808 Alice system for programming education, Adaptability, 122–123 758–759 Adaptive rectangular decomposition (ARD), 502 AlloSphere, 51–52, 51f, 280 Additive sound creation techniques, 499 Allstate Impaired Driver Simulator, 625, 629f Advanced Realtime Tracking (ART), 53–54, 213f Alpha delta fiber (Aδ fiber), 149 Advanced Robotics Research Lab (ARRL), 369 Alphanumeric value selection, 591–593 Advanced systems, 11–12 Ambient sounds, 436–437, 505 Advanced texture mapping techniques, 469–473 Ambiotherm device, 372, 373f Adventure (games), 12 Ambisonics, 354 Adverse effect, 351 Ambulatory platforms, 242–243 Aestheticism, 414 American Sign Language (ASL), 552–553 Affine transformations, 486–487 Amount/type of information, 196–198 864 | SUBJECT INDEX Amplification, 349–350 ARToolKit (ARTK), 48–49, 715–716 Amplifier, 349–350, 349f Ascension Technologies, 41–44, 44f, 46–47, 86–87 Anaglyphic 3D, 270f, 7f, 30, 49, 269–270, 271f ASL.
    [Show full text]
  • Envrment: Investigating Experience in a Virtual User-Composed Environment
    ENVRMENT: INVESTIGATING EXPERIENCE IN A VIRTUAL USER-COMPOSED ENVIRONMENT A Thesis presented to the Faculty of California Polytechnic State University, San Luis Obispo In Partial Fulfillment of the Requirements for the Degree Master of Science in Computer Science by Matthew Key December 2020 c 2020 Matthew Key ALL RIGHTS RESERVED ii COMMITTEE MEMBERSHIP TITLE: EnVRMent: Investigating Experience in a Virtual User-Composed Environment AUTHOR: Matthew Key DATE SUBMITTED: December 2020 COMMITTEE CHAIR: Zo¨eWood, Ph.D. Professor of Computer Science COMMITTEE MEMBER: Christian Eckhardt, Ph.D. Professor of Computer Science COMMITTEE MEMBER: Franz Kurfess, Ph.D. Professor of Computer Science iii ABSTRACT EnVRMent: Investigating Experience in a Virtual User-Composed Environment Matthew Key Virtual Reality is a technology that has long held society's interest, but has only recently began to reach a critical mass of everyday consumers. The idea of modern VR can be traced back decades, but because of the limitations of the technology (both hardware and software), we are only now exploring its potential. At present, VR can be used for tele-surgery, PTSD therapy, social training, professional meetings, conferences, and much more. It is no longer just an expensive gimmick to go on a momentary field trip; it is a tool, and as with the automobile, personal computer, and smartphone, it will only evolve as more and more adopt and utilize it in various ways. It can provide a three dimensional interface where only two dimensions were previously possible. It can allow us to express ourselves to one another in new ways regardless of the distance between individuals.
    [Show full text]
  • Memory Forensics of Immersive Virtual Reality with the HTC Vive
    DIGITAL FORENSIC RESEARCH CONFERENCE Inception: Virtual Space in Memory Space in Real Space – Memory Forensics of Immersive Virtual Reality with the HTC Vive By Peter Casey, Rebecca Lindsay-Decusati, Ibrahim Baggili, and Frank Breitinger From the proceedings of The Digital Forensic Research Conference DFRWS 2019 USA Portland, OR (July 15th - 19th) DFRWS is dedicated to the sharing of knowledge and ideas about digital forensics research. Ever since it organized the first open workshop devoted to digital forensics in 2001, DFRWS continues to bring academics and practitioners together in an informal environment. As a non-profit, volunteer organization, DFRWS sponsors technical working groups, annual conferences and challenges to help drive the direction of research and development. https://dfrws.org Digital Investigation 29 (2019) S13eS21 Contents lists available at ScienceDirect Digital Investigation journal homepage: www.elsevier.com/locate/diin DFRWS 2019 USA d Proceedings of the Nineteenth Annual DFRWS USA Inception: Virtual Space in Memory Space in Real Space e Memory Forensics of Immersive Virtual Reality with the HTC Vive Peter Casey*, Rebecca Lindsay-Decusati, Ibrahim Baggili, Frank Breitinger University of New Haven, 300 Boston Post Rd, West Haven, CT, 06516, USA article info abstract Article history: Virtual Reality (VR) has become a reality. With the technology's increased use cases, comes its misuse. Malware affecting the Virtual Environment (VE) may prevent an investigator from ascertaining virtual information from a physical scene, or from traditional “dead” analysis. Following the trend of anti- Keywords: forensics, evidence of an attack may only be found in memory, along with many other volatile data Memory forensics points.
    [Show full text]
  • Immersive Visualization in Biomedical Computational Fluid Dynamics and Didactic Teaching and Learning John Thomas Venn Marquette University
    Marquette University e-Publications@Marquette Master's Theses (2009 -) Dissertations, Theses, and Professional Projects Immersive Visualization in Biomedical Computational Fluid Dynamics and Didactic Teaching and Learning John Thomas Venn Marquette University Recommended Citation Venn, John Thomas, "Immersive Visualization in Biomedical Computational Fluid Dynamics and Didactic Teaching and Learning" (2018). Master's Theses (2009 -). 459. https://epublications.marquette.edu/theses_open/459 IMMERSIVE VISUALIZATION IN BIOMEDICAL COMPUTATIONAL FLUID DYNAMICS AND DIDACTIC TEACHING AND LEARNING By John T. Venn A Thesis Submitted to the Faculty of the Graduate School, Marquette University, in Partial Fulfillment of the Requirements for the Degree of Master of Science Milwaukee, Wisconsin May 2018 ABSTRACT IMMERSIVE VISUALIZATION IN BIOMEDICAL COMPUTATIONAL FLUID DYNAMICS AND DIDACTIC TEACHING AND LEARNING John T. Venn Marquette University, 2018 Virtual reality (VR) can stimulate active learning, critical thinking, decision making and improved performance. It requires a medium to show virtual content, which is called a virtual environment (VE). The MARquette Visualization Lab (MARVL) is an example of a VE. Robust processes and workflows that allow for the creation of content for use within MARVL further increases the userbase for this valuable resource. A workflow was created to display biomedical computational fluid dynamics (CFD) and complementary data in a wide range of VE’s. This allows a researcher to study the simulation in its natural three-dimensional (3D) morphology. In addition, it is an exciting way to extract more information from CFD results by taking advantage of improved depth cues, a larger display canvas, custom interactivity, and an immersive approach that surrounds the researcher. The CFD to VR workflow was designed to be basic enough for a novice user.
    [Show full text]
  • A Method for Viewing and Interacting with Medical Volumes in Virtual Reality Jordan King Williams Iowa State University
    Iowa State University Capstones, Theses and Graduate Theses and Dissertations Dissertations 2019 A method for viewing and interacting with medical volumes in virtual reality Jordan King Williams Iowa State University Follow this and additional works at: https://lib.dr.iastate.edu/etd Part of the Computer Sciences Commons Recommended Citation Williams, Jordan King, "A method for viewing and interacting with medical volumes in virtual reality" (2019). Graduate Theses and Dissertations. 17125. https://lib.dr.iastate.edu/etd/17125 This Thesis is brought to you for free and open access by the Iowa State University Capstones, Theses and Dissertations at Iowa State University Digital Repository. It has been accepted for inclusion in Graduate Theses and Dissertations by an authorized administrator of Iowa State University Digital Repository. For more information, please contact [email protected]. A method for viewing and interacting with medical volumes in virtual reality by Jordan Williams A thesis submitted to the graduate faculty in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE Co-majors: Human Computer Interaction; Computer Engineering Program of Study Committee: Eliot Winer, Major Professor Adarsh Krishnamurthy James Oliver The student author, whose presentation of the scholarship herein was approved by the program of study committee, is solely responsible for the content of this thesis. The Graduate College will ensure this thesis is globally accessible and will not permit alterations after a degree is conferred. Iowa State University Ames, Iowa 2019 Copyright © Jordan Williams, 2019. All rights reserved. ii TABLE OF CONTENTS LIST OF FIGURES ....................................................................................................................... iv LIST OF JOURNAL FIGURES .................................................................................................... iv LIST OF TABLES ........................................................................................................................
    [Show full text]
  • Platform Overview. December 2020 Contents
    Platform Overview. December 2020 Contents. Contents. .................................................................................................................................... 2 Introduction. ............................................................................................................................... 3 Glue overview. ............................................................................................................................ 4 Glue Teams .............................................................................................................................................................. 4 Authentication .................................................................................................................................................... 4 Glue Team Spaces .................................................................................................................................................. 5 Spatial audio ....................................................................................................................................................... 5 3D avatars ............................................................................................................................................................ 5 Objects ................................................................................................................................................................. 5 Persistence .........................................................................................................................................................
    [Show full text]
  • Interactive Multimodal and Procedurally-Assisted Creation of VR Environments
    FACULDADE DE ENGENHARIA DA UNIVERSIDADE DO PORTO Interactive Multimodal and Procedurally-Assisted Creation of VR Environments João Pedro Martins Ferreira Mestrado Integrado em Engenharia Informática e Computação Supervisor: Rui Rodrigues Second Supervisor: Rui Nóbrega September 21, 2020 Interactive Multimodal and Procedurally-Assisted Creation of VR Environments João Pedro Martins Ferreira Mestrado Integrado em Engenharia Informática e Computação September 21, 2020 Abstract Virtual reality has become very popular all throughout the late 2010s due to the arrival of better and more affordable technologies to the consumer market, which in turn, has grown massively. This makes it so that virtual reality starts being used across many fields, from education to health, and the creation of virtual reality content spikes in demand. However, as we will show, the creation of virtual reality content has not managed to keep up with these advances, and research into new alternatives is needed. In this dissertation we explore the gap that exists in the creation of better ways to develop virtual reality content, harnessing the power of virtual reality interaction and readily available systems. More specifically, we focus on how it is possible to help the creation of virtual reality environment using 3D model repositories, voice controls and procedural tools. We strive for a tool that makes the technical process behind the creation of virtual reality environments as intuitive as possible, leaving only the creative process to the user. Put simply, our research goal is to find out if such a tool could be created that not only made it easier and faster for proficient users to make environment prototypes while instantaneously visualising the final product, but at the same time, made it possible for inexperienced users without 3D modelling abilities and even VR experience to also be able to create their own environments without the need for extensive training.
    [Show full text]