DOCSLIB.ORG

Dissertation

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Dissertation ENVIRONMENTAL PHYSICAL–VIRTUAL INTERACTION TO IMPROVE SOCIAL PRESENCE WITH A VIRTUAL HUMAN IN MIXED REALITY by KANGSOO KIM B.S. Hanyang University, 2009 M.S. Hanyang University, 2011 M.S. University of Central Florida, 2015 A dissertation submitted in partial fulfilment of the requirements for the degree of Doctor of Philosophy in the Department of Computer Science in the College of Engineering and Computer Science at the University of Central Florida Orlando, Florida Fall Term 2018 Major Professor: Gregory F. Welch c 2018 Kangsoo Kim ii ABSTRACT Interactive Virtual Humans (VHs) are increasingly used to replace or assist real humans in various applications, e.g., military and medical training, education, or entertainment. In most VH research, the perceived social presence with a VH, which denotes the user’s sense of being socially connected or co-located with the VH, is the decisive factor in evaluating the social influence of the VH—a phenomenon where human users’ emotions, opinions, or behaviors are affected by the VH. The purpose of this dissertation is to develop new knowledge about how characteristics and behaviors of a VH in a Mixed Reality (MR) environment can affect the perception of and resulting behavior with the VH, and to find effective and efficient ways to improve the quality and performance of social interactions with VHs. Important issues and challenges in real–virtual human interactions in MR, e.g., lack of physical–virtual interaction, are identified and discussed through several user studies incorporating interactions with VH systems. In the studies, different features of VHs are prototyped and evaluated, such as a VH’s ability to be aware of and influence the surrounding physical environment, while measuring objective behavioral data as well as collecting subjective responses from the participants. The results from the studies support the idea that the VH’s aware- ness and influence of the physical environment can improve not only the perceived social presence with the VH, but also the trustworthiness of the VH within a social context. The findings will contribute towards designing more influential VHs that can benefit a wide range of simulation and training applications for which a high level of social realism is important, and that can be more easily incorporated into our daily lives as social companions, providing reliable relationships and convenience in assisting with daily tasks. iii To my parents, family, and friends. iv ACKNOWLEDGMENTS First, I would like to thank my wonderful advisor, Prof. Greg Welch, for guiding and supporting me with full of inspiration, ideas, and patience on the journey of this dissertation research. Greg was not just my academic advisor, but a great mentor who opened my eyes to various aspects of research and cared for me and my family’s well-being. Without his thoughtfulness, compassion, and respect, it would have been difficult for me to complete this work. It was a great pleasure being and working with him as one of his PhD students in an important part of my life. I would also like to acknowledge all other committee members: Prof. Jeremy Bailenson, Prof. Gerd Bruder, Prof. Stephen Fiore, Prof. Avelino Gonzalez, and Prof. Gita Sukthankar. Of course all the inputs from the committees are invaluable, but especially I want to thank Jeremy and Gerd for sharing their insights and thoughts, and actually spending a lot of time together to discuss to make things right for my research. Special thanks to all the current and former members of the SREAL lab: Prof. Charles Hughes, Dr. Leila Barmaki, Dr. Kate Ingraham, Dr. Sungchul Jung, Dr. Arjun Nagendran, Dr. Andrew Raij, Luke Bölling, Salam Daher, Manuel Gonzalez, Steffen Haesler, Jason Hochreiter, Eric Imperiale, Brian Kelly, Barbara Lee, Myungho Lee, Divine Maloney, Nahal Norouzi, Ryan Patrick, Remo Pillat, Ryan Schubert, and Greg Wiatroski. I acknowledge Prof. Eleazar Vasquez and Prof. Xin Yan for sharing their expertise in study design and statistical analysis with me. I also want to thank Dr. Peter Squire (Office of Naval Research) for the continuous funds for our lab and my work during the entire period of my PhD program. I would like to thank Prof. Jong-Il Park (my BS and MS advisor at Hanyang University) and Prof. Woontack Woo (my undergraduate intern advisor at GIST) for their introduction and guidance to the research field of AR/MR. In addition, I want to thank all the research advisors, colleagues, and v friends in Korea including Prof. Sang-Hwa Lee, Dr. Byung-Kuk Seo, Dr. Junyeong Choi, Jungsik Park, Jae-Hyek Han, Youngju son, Prof. Ahyoung Choi, Prof. Changgu Kang, Dr. Youngkyoon Jang, Dr. Sejin Oh, Dr. Mingyu Park, and Dr. Choonsung Shin. From my college years to present, interacting with them always encouraged me to move forward. Special thanks to Byung-Kuk, Youngkyoon, and Choonsung for sharing their thoughts and discussing my research together. I had three wonderful internship opportunities at Universal Creative, Facebook, and US Army Research Lab-West in the middle of my PhD program. Here I would like to thank all the people who helped and worked with me including my intern managers: Justin Schwartz, Dr. Sophie Kim, and Dr. Celso de Melo. During the journey of my PhD, I met a lot of researchers and collaborators from different fields who have influenced me and my research directly or indirectly. I would thank all those people including Prof. Mark Billinghurst, Prof. Jonathan Gratch, Prof. Dongsik Jo, Prof. Sin-Hwa Kang, Prof. Si- Jung Kim, Prof. Gale Lucas, and Dr. Jongwook Kim. I learned a lot from them while reading about their research, discussing research ideas and working together with them. Particularly I want to thank Sangwoo Cho for sharing all the happiness and difficulty together as PhD students. Finally, I would like to thank my family, the most important people in my life. My lovely wife and little kids, Jihyun Kim, Juli Kim, and Daniel Kim. Their endless support and cheer for me made this work possible. Thanks to my sister, Seoyoun Kim, who has always walked one step ahead and guided me since our childhood. Also, I thank my parents-in-law, Jinbae Kim and Kwangock Seo, for their considerate and warm heart supporting me and my family. The most special and sincere thanks go to my beloved parents, Jongo Kim and Jongsook Lee, who are the origin and the role model of my life. They have always shown faith in me and given me liberty to choose what I desired. I could have the strength and patience to work through all these years for their selfless dedication. Thank you so much from the bottom of my heart. vi TABLE OF CONTENTS LIST OF FIGURES . xv LIST OF TABLES . .xviii CHAPTER 1: INTRODUCTION . 1 1.1 Research Motivation and Objectives . 3 1.2 Exploration Areas and Scope of the Dissertation Research . 5 1.3 Thesis Statements and Contributions . 7 1.4 Outline of the Dissertation . 9 CHAPTER 2: BACKGROUND . 12 2.1 Pervasive Mixed Reality . 12 2.1.1 Mixed Reality in Reality–Virtuality Continuum . 13 2.1.2 Ubiquitous Computing and Artificial Intelligence . 17 2.2 Presence and Social Influence . 19 2.3 Virtual Humans in Mixed Reality . 22 2.3.1 Robotic Humans . 23 vii 2.3.2 Virtual Humans . 24 2.3.2.1 Virtual Humans in Monitors and Immersive Projection . 25 2.3.2.2 Virtual Humans in Immersive VR HMD . 26 2.3.2.3 Virtual Humans in AR HMD . 27 2.3.2.4 Virtual Humans without Visual Embodiment . 29 2.4 User Studies with Virtual Humans . 30 2.4.1 Social Presence and Co-Presence with Virtual Humans . 30 2.4.2 Behavioral Influences of Virtual Humans . 32 2.4.3 Trust and Confidence in Virtual Humans . 34 CHAPTER 3: PROPOSED ENVIRONMENTAL PHYSICAL–VIRTUAL INTERACTION INMR..................................... 36 3.1 Visual Embodiment of Virtual Humans . 36 3.2 Interaction: Awareness and Influence . 37 3.3 Plausibility and Coherence . 40 CHAPTER 4: INFLUENCE OF PHYSICAL BODY IN HUMAN BEHAVIOR . 43 4.1 Material . 44 4.1.1 Technological Human Surrogate . 44 viii 4.1.1.1 RoboThespian (Robotic Human Surrogate) . 44 4.1.1.2 Human in the Loop . 45 4.1.2 Experimental Setup . 47 4.1.2.1 Surrogate and Environment Settings . 47 4.1.2.2 Surrogate Control and Communication Connections . 48 4.2 Methods . 51 4.3 Participants and Procedure . 53 4.4 Measures and Hypotheses . 55 4.4.1 Data Collection and Human Observer . 55 4.4.2 Dependent Variables . 57 4.5 Results . 58 4.5.1 Proactivity and Reactivity . 64 4.5.2 Commitment . 68 4.5.3 Compliance . 69 4.5.4 Photo Proximity . 71 4.6 Discussion . 73 4.7 Summary . 76 ix CHAPTER 5: SPATIAL AND BEHAVIORAL COHERENCE IN MR . 78 5.1 Virtual Human’s Physical–Virtual Conflict . 78 5.1.1 Material . 79 5.1.1.1 Physical Environment and Recordings . 79 5.1.1.2 Virtual Humans and Human Controller . 79 5.1.2 Methods . 81 5.1.3 Participants and Procedure . 82 5.1.4 Measures and Hypotheses . 84 5.1.4.1 Physicality and Interaction in Physical Space . 84 5.1.4.2 Copresence . 85 5.1.4.3 Sense . 85 5.1.4.4 Realism . 85 5.1.4.5 Godspeed Questionnaire . 85 5.1.5 Results . 86 5.1.6 Subjective Responses . 86 5.1.6.1 Physicality and Interaction in Physical Space . 86 5.1.6.2 Copresence . 88 x 5.1.6.3 Sense & Realism . 88 5.1.6.4 Godspeed Questionnaire . 88 5.1.7 Avoidance Behavior . 90 5.1.8 Discussion . 91 5.1.9 Summary .
Load more

Recommended publications
  • Immersive Realities for Learning and Performance “VR, AR, Mixed Reality & More in 2018"
    Immersive Realities for Learning and Performance “VR, AR, Mixed Reality & More in 2018" An Updated Report from The MASIE Center Author: Bobby Carlton | Foreword: Elliott Masie May 23, 2018 Learning CONSORTIUM masie.com NOVEMBER 4 – 7, 2018 | ORLANDO, FL Lea “VR, AR, Mixed Reality & More in 2018" & More Reality AR, Mixed “VR, Immersive Realities Immersive masie.com for Learning and Performance Learning for r Author: Bobby Carlton | Foreword: Elliott Masie ning Foreword: An Updated Report from The MASIE Center CONSO “Boldly Go... Where the Learner Has Not Gone Before” R TIUM My good friend, actor George Takei, shared with me the excitement that the cast and crew felt when shooting Star Trek back in 1966. They were all excited by the possibility of a virtual and immersive reality. They imagined that they could scan a planet, a person, or an NOVEMBER 4 – 7, 2018 | ORLANDO, FL 2018 | ORLANDO, 4 – 7, NOVEMBER object and simulate, play with, or even destroy it (virtually) while May 23, 2018 being deeply immersed in the experience. And, they knew that someday this fiction would become reality. Ever since, I have been tracking, using, experimenting with, and researching the ever-changing and emerging worlds of virtual reality, augmented reality, mixed reality, and other immersive reality technologies and software. They keep getting better, though they still aren’t totally "there" yet. The challenge is to bridge the gap between their promise and actual use in workplaces to drive learning and performance. The good news is that in the past three years we have made major jumps forward.
    [Show full text]
  • The Impact of Co-Located Play on Social Presence and Game Experience in a VR Game
    The Impact of Co-Located Play on Social Presence and Game Experience in a VR Game Marcello A. Gómez Maureira LIACS, Leiden University Niels Bohrweg 1, Leiden, The Netherlands [email protected] Fons Verbeek LIACS, Leiden University Niels Bohrweg 1, Leiden, The Netherlands [email protected] ABSTRACT This exploratory case study looks at the scenario of virtual reality (VR) gaming in a so- cial setting. We raise the question whether game experience and social presence (measured through a questionnaire) are impacted by physically separating players versus co-located play. We asked 34 participants to play a two-player VR game using head mounted displays in which they shared a virtual environment. We compared two conditions: 1) playing in the same physical space, allowing direct communication between players and 2) playing in separated rooms, with communication via intercom. Our results indicate no differences between the two testing conditions. Based on this, we conclude that current VR technology can facilitate a multi-user game experience, played from separate locations, that is experi- enced as if it were played co-located. We see the outcome of the study as an encouragement for designers to involve social elements in online, multi-user VR games. Keywords virtual reality games, social gaming, multiplayer gaming, head mounted displays, player incorporation INTRODUCTION Digital games have spearheaded a wide range of technological advances, frequently fo- cusing on advancing visual aesthetics and novel interfaces as a way to immerse people in experiences that designers have crafted for them. One of the most recent trends in digital game technology is the use of virtual reality (VR) devices.
    [Show full text]
  • Vuzix Corporation Annual Report 2021
    Vuzix Corporation Annual Report 2021 Form 10-K (NASDAQ:VUZI) Published: March 15th, 2021 PDF generated by stocklight.com UNITED STATES SECURITIES AND EXCHANGE COMMISSION Washington, D.C. 20549 FORM 10-K ☑ ANNUAL REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE SECURITIES EXCHANGE ACT OF 1934 For the fiscal year ended December 31, 2020 ☐ TRANSITION REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE SECURITIES EXCHANGE ACT OF 1934 Commission file number: 001-35955 Vuzix Corporation ( Exact name of registrant as specified in its charter ) Delaware 04-3392453 (State of incorporation) (I.R.S. employer identification no.) 25 Hendrix Road West Henrietta, New York 14586 (Address of principal executive office) (Zip code) (585) 359-5900 (Registrant’s telephone number including area code) Securities registered pursuant to Section 12(b) of the Act: Title of each class: Trading Symbol(s) Name of each exchange on which registered Common Stock, par value $0.001 VUZI Nasdaq Capital Market Securities registered pursuant to Section 12(g) of the Act: None. Indicate by check mark if the registrant is a well-known seasoned issuer, as defined in Rule 405 of the Securities Act. Yes ◻ No þ Indicate by check mark if the registrant is not required to file reports pursuant to Section 13 or Section 15(d) of the Exchange Act. Yes ◻ No þ Indicate by check mark whether the registrant: (1) has filed all reports required to be filed by Section 13 or 15(d) of the Securities Exchange Act of 1934 during the preceding 12 months (or for such shorter period that the registrant was required to file such reports), and (2) has been subject to such filing requirements for the past 90 days.
    [Show full text]
  • Advances in Artificial Reality and Tele-Existence
    R. Liang, Z. Pan, A. Cheok, M. Haller, R.W.H. Lau, H. Saito (Eds.) Advances in Artificial Reality and Tele-Existence 16th International Conference on Artificial Reality and Telexistence, ICAT 2006, Hangzhou, China, November 28 - December 1, 2006, Proceedings Series: Information Systems and Applications, incl. Internet/Web, and HCI, Vol. 4282 This book constitutes the refereed proceedings of the 16th International Conference on Artificial Reality and Telexistence, ICAT 2006, held in Hangzhou, China in November/ December 2006. The 138 revised full papers presented were carefully reviewed and selected from a total of 523 submissions. The papers are organized in topical sections on anthropomorphic intelligent robotics, artificial life, augmented reality, mixed reality, distributed and collaborative VR system, haptics, human factors of VR, innovative applications of VR, motion tracking, real time computer simulation, tools and technique for modeling VR systems, ubiquitous/wearable computing, virtual heritage, virtual medicine and health science, virtual reality, as well as VR interaction and navigation techniques. 2006, XLVI, 1350 p. In 2 volumes, not available separately. Printed book Softcover ▶ 159,99 € | £144.00 | $219.00 ▶ *171,19 € (D) | 175,99 € (A) | CHF 213.21 eBook Available from your bookstore or ▶ springer.com/shop MyCopy Printed eBook for just ▶ € | $ 24.99 ▶ springer.com/mycopy Order online at springer.com ▶ or for the Americas call (toll free) 1-800-SPRINGER ▶ or email us at: [email protected]. ▶ For outside the Americas call +49 (0) 6221-345-4301 ▶ or email us at: [email protected]. The first € price and the £ and $ price are net prices, subject to local VAT. Prices indicated with * include VAT for books; the €(D) includes 7% for Germany, the €(A) includes 10% for Austria.
    [Show full text]
  • Evaluation of Virtual Reality Tracking Systems Underwater
    International Conference on Artificial Reality and Telexistence Eurographics Symposium on Virtual Environments (2019) Y. Kakehi and A. Hiyama (Editors) Evaluation of Virtual Reality Tracking Systems Underwater Raphael Costa1,Rongkai Guo2,and John Quarles1 1University of Texas at San Antonio, USA 2Kennesaw State University, USA Abstract The objective of this research is to compare the effectiveness of various virtual reality tracking systems underwater. There have been few works in aquatic virtual reality (VR) - i.e., VR systems that can be used in a real underwater environment. Moreover, the works that have been done have noted limitations on tracking accuracy. Our initial test results suggest that inertial measurement units work well underwater for orientation tracking but a different approach is needed for position tracking. Towards this goal, we have waterproofed and evaluated several consumer tracking systems intended for gaming to determine the most effective approaches. First, we informally tested infrared systems and fiducial marker based systems, which demonstrated significant limitations of optical approaches. Next, we quantitatively compared inertial measurement units (IMU) and a magnetic tracking system both above water (as a baseline) and underwater. By comparing the devices’ rotation data, we have discovered that the magnetic tracking system implemented by the Razer Hydra is approximately as accurate underwater as compared to a phone-based IMU. This suggests that magnetic tracking systems should be further explored as a possibility
    [Show full text]
  • Morton Heilig, Through a Combination of Ingenuity, Determination, and Sheer Stubbornness, Was the First Person to Attempt to Create What We Now Call Virtual Reality
    Morton Hei Iig "The [in em a of the Future" << 2 2 >> (1955) ;!fo11o11 Hdlir;. Sens<muna. Cuuri<S_) oJS1o11 Fi1lur. "Thus, individually and collectively, by thoroughly applying the methodology of art, the cinema of the future will become the first art form to reveal the new scientific world to man in the .full sensual vividness and dynamic vitality of his consciousness." 239 240 Horton Heilig << Morton Heilig, through a combination of ingenuity, determination, and sheer stubbornness, was the first person to attempt to create what we now call virtual reality. In the 1 950s it occurred to him that all the sensory splendor of life could be simulated with "reality machines." Heilig was a Hollywood cinematographer, and it was as an extension of cinema that he thought such a machine might be achieved. With his inclination, albeit amateur, toward the ontological aspirations of science, He ilig proposed that an artist's expressive powers would be enhanced by a scientific understanding of the senses and perception. His premise was sim­ ple but striking for its time: if an artist controlled the multisensory stimulation of the audience, he could provide them with the illusion and sensation of first­ person experience, of actually " being there." Inspired by short-Jived curiosities such as Cinerama and 3-D movies, it oc­ curred to Heilig that a logical extension of cinema would be to immerse the au­ dience in a fabricated world that engaged all the senses. He believed that by expanding cinema to involve not only sight and sound but also taste, touch, and smell, the traditional fourth wal l of film and theater would dissolve, transport­ ing the audience into an inhabitable, virtual world; a kind of "experience theater." Unable to find support in Hollywood for his extraordinary ideas, Heilig moved to Mexico City In 1954, finding himself in a fertile mix of artists, filmmakers, writers, and musicians.
    [Show full text]
  • Hyperreality and Virtual Worlds: When the Virtual Is Real
    sphera.ucam.edu ISSNe: 2695-5725 ● Número 19 ● Vol.II ● Año 2019 ● pp. 36-58 Hyperreality and virtual worlds: when the virtual is real Paulo M. Barroso, Polytechnic Institute of Viseu (Portugal) [email protected] Received: 12/11/19 ● Accepted: 10/12/19 ● Published: 19/12/19 How to reference this paper: Barroso, Paulo M. (2019). Hyperreality and virtual worlds: when the virtual is real, Sphera Publica, 2(19), 36‐58. Abstract This article questions what is hyperreality and underlines the role of the signs/images fostering the perception of a virtual world. It argues the potentiality of signs as artefacts. Starting from Agamben’s perspective regarding contemporary, the hyperreality is understood as a modern, visual and mass manifestation of the need for simulacra in a non-referential virtual world. How hyperreality, spectacle, simulation, and appearance emerge out of reality? What is authentic or real are issues raised using images and technological devices. The images are popular and amplify the effects of distraction and social alienation. The image is immediately absorbed, spectacular, attractive, a peculiar ready-to-think that eliminates or dilutes the concepts and produces a fast culture. Through a reflexive strategy, this article is conceptual (it has no case study or empirical work) and has the purpose of problematize the experience of hyperreality, which is reshaping and restructuring patterns of social life and social interdependence, and the ways we see, think, feel, act or just mean and interpret the reality. Keywords Hyperreality, image, real, virtual worlds, technology Barroso Hiperrealidad y mundos virtuales Hiperrealidad y mundos virtuales: cuando lo virtual es real Paulo M.
    [Show full text]
  • Virtual and Augmented Reality Applications in Medicine And
    OPEN ACCESS Freely available online iology: C ys ur h re P n t & R y e Anatomy & Physiology: s m e o a t r a c n h A ISSN: 2161-0940 Current Research Reie Article Virtual and Augmented Reality Applications in Medicine and Surgery- The Fantastic Voyage is here Wayne L Monsky1*, Ryan James2, Stephen S Seslar3 1Division of Interventional Radiology, Department of Radiology, University of Washington Medical Center, Washington, USA; 2Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington, USA; 3Division of Pediatric Cardiology, Department of Pediatrics, Seattle Children's Hospital, University of Washington, Seattle, WA, USA ABSTRACT Virtual Reality (VR), Augmented Reality (AR) and Head Mounted Displays (HMDs) are revolutionizing the way we view and interact with the world, affecting nearly every industry. These technologies are allowing 3D immersive display and understanding of anatomy never before possible. Medical applications are wide-reaching and affect every facet of medical care from learning gross anatomy and surgical technique to patient-specific pre-procedural planning and intra-operative guidance, as well as diagnostic and therapeutic approaches in rehabilitation, pain management, and psychology. The FDA is beginning to approve these approaches for clinical use. In this review article, we summarize the application of VR and AR in clinical medicine. The history, current utility and future applications of these technologies are described. Keywords: Virtual reality; Augmented reality; Surgery; Medicine; Anatomy; Therapy INTRODUCTION DEFINITIONS AND BRIEF HISTORY Recalling the 1966 science fiction film “Fantastic Voyage”, watching The human visual system in amazement as the doctors traveled inside the patient’s body to repair a brain injury.
    [Show full text]
  • "Physics Considerations for a Simulated Reality"
    Physics considerations for a simulated reality Max Hodak 1 Why build a simulated reality? ined, but that of defining a suitable physics system. We conjecture that there is a relationship between Video games have a powerful natural appeal. Our the depth of a virtual world and the sophistication of physical world imposes harsh constraints: atoms are its underlying physics. difficult to work with compared to bits, and the Any non-trivial universe must contain informa- scarcity of both materials and the capacity to trans- tion, and we can phrase the central problem in world form them leads to a tough environment. By con- design as one of writing down the information that trast, video games can be anything we want them defines a universe; informally, we can state that a to be: players can fly, use magic, or even have their universe without information has zero depth. We can own planet, all the while exercising mental faculties start from a premise that information in any universe in just as satisfying a way as they would in our base is found in two forms: matter and its interactions. reality. As computer processing power continues to improve and the space of games we can build expands, a natural opportunity arises to build simulated real- 2 Naturalness ities that are as engaging and emotionally immersive as our base reality, but with fewer constraints and a Before we think about physics as it is usually under- greater capacity for easier creative expression. stood, let's briefly look at video game \physics" as Video game design is challenging on multiple lev- it exists today.
    [Show full text]
  • Evaluating Performance Benefits of Head Tracking in Modern Video
    Evaluating Performance Benefits of Head Tracking in Modern Video Games Arun Kulshreshth Joseph J. LaViola Jr. Department of EECS Department of EECS University of Central Florida University of Central Florida 4000 Central Florida Blvd 4000 Central Florida Blvd Orlando, FL 32816, USA Orlando, FL 32816, USA [email protected] [email protected] ABSTRACT PlayStation Move, TrackIR 5) that support 3D spatial in- teraction have been implemented and made available to con- We present a study that investigates user performance ben- sumers. Head tracking is one example of an interaction tech- efits of using head tracking in modern video games. We nique, commonly used in the virtual and augmented reality explored four di↵erent carefully chosen commercial games communities [2, 7, 9], that has potential to be a useful ap- with tasks which can potentially benefit from head tracking. proach for controlling certain gaming tasks. Recent work on For each game, quantitative and qualitative measures were head tracking and video games has shown some potential taken to determine if users performed better and learned for this type of gaming interface. For example, Sko et al. faster in the experimental group (with head tracking) than [10] proposed a taxonomy of head gestures for first person in the control group (without head tracking). A game ex- shooter (FPS) games and showed that some of their tech- pertise pre-questionnaire was used to classify participants niques (peering, zooming, iron-sighting and spinning) are into casual and expert categories to analyze a possible im- useful in games. In addition, previous studies [13, 14] have pact on performance di↵erences.
    [Show full text]
  • Audio Challenges in Virtual and Augmented Reality Devices
    Audio challenges in virtual and augmented reality devices Dr. Ivan Tashev Partner Software Architect Audio and Acoustics Research Group Microsoft Research Labs - Redmond In memoriam: Steven L. Grant Sep 15, 2016 IWAENC Audio challenges in virtual and augmented reality devices 2 In this talk • Devices for virtual and augmented reality • Binaural recording and playback • Head Related Functions and their personalization • Object-based rendering of spatial audio • Modal-based rendering of spatial audio • Conclusions Sep 15, 2016 IWAENC Audio challenges in virtual and augmented reality devices 3 Colleagues and contributors: Hannes Gamper David Johnston Ivan Tashev Mark R. P. Thomas Jens Ahrens Microsoft Research Microsoft Research Microsoft Research Dolby Laboratories Chalmers University, Sweden Sep 15, 2016 IWAENC Audio challenges in virtual and augmented reality devices 4 Devices for Augmented and Virtual Reality They both need good spatial audio Sep 15, 2016 IWAENC Audio challenges in virtual and augmented reality devices 5 Augmented vs. Virtual Reality • Augmented reality (AR) is a live direct or indirect view of a physical, real-world environment whose elements are augmented (or supplemented) by computer-generated sensory input such as sound, video, graphics • Virtual reality (VR) is a computer technology that replicates an environment, real or imagined, and simulates a user's physical presence in a way that allows the user to interact with it. It artificially creates sensory experience, which can include sight, touch, hearing, etc. Sep
    [Show full text]
  • Study on Telexistence XCV: a Telediagnosis Platform Based on Mixed Reality And
    3B-05 This article is a technical report without peer review, and its polished and/or extended version may be published elsewhere 第 24 回日本バーチャルリアリティ学会大会論文集（2019 年 9 月） Study on Telexistence XCV: A Telediagnosis Platform Based on Mixed Reality and Bio-signal Display Device Junkai Fu1)，Yasuyuki Inoue2)，Fumihiro Kato2) ，Susumu Tachi 2) 1) 東京大学 新領域創成科学研究科 （〒277-8561 千葉県柏市柏の葉 5-1- 5, [email protected] ） 2) 東京大学 高齢社会総合研究機構 （〒113-0032 東京都文京区本郷 7-3-1, {y-inoue,fumihiro.kato,tachi}@tachilab.org） Abstract： We propose a telediagnosis system that allows medical staff to interact with a remote patient through telexistence robot system. The system consists of an audio-visual telexistence system (TX-toolkit), a surrogate arm equipped with thermal and pressure displays, and body temperature and heartbeat measurement equipment. By using this system, the medical staff can examine the patient as if he or she is observing the patient face to face． Keywords：Teledignosis, Telexistence, Haptics, Mixed reality 1. Introduction Moreover, palpation based on VR simulation has also been Recent years many countries have come into an aging society. proposed. Timothy et al. use artificial force to simulate the The aged have to live by themselves because their children have feeling of human skin and apply the system into the palpation no time to take care of them due to their hard work. Hence the and insertion training[3]. To achieve telemedicine, a robot own health care targeted at the aged is an urgent matter. partial function as a human is also a viable way. Garingo et al. Telemedicine is suitable to do this.
    [Show full text]