Supernatural and Comfortable User Interfaces for Basic 3D Interaction Tasks
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Jason T. Jaslow 201-679-0733 • [email protected] • Emergereality.Com • Linkedin.Com/In/Jasonjaslow • Github.Com/Jjaslow
Jason T. Jaslow 201-679-0733 • [email protected] • emergereality.com • linkedin.com/in/jasonjaslow • github.com/jjaslow Qualifications Profile Versatile professional with a wide range of expertise spanning more than 20 years including multiple startup experiences with successful exits, business management, marketing, data analytics, and software development. • Skilled in planning, constructing, and launching pioneering business application tools through a strong comprehension of assorted complex Augmented Reality (AR) and Virtual Reality (VR) technologies. • Adept in all components of product development, customer relationship management, operations analysis, and continuous process improvement. • Exceptionally analytical with a dedication to excellence at all organizational levels. • Talent for assessing and swiftly resolving complicated technical discrepancies. Core Technologies Software: Unity, Mixed Reality Toolkit, ARCore, AR Foundation, Vuforia, Photon PUN, AWS, Git, Blender, Adobe Creative Suite (PS, IL, IN), Microsoft Office (Word, Excel, PowerPoint), Google Suite Languages / C#, HTML, CSS, JavaScript, SQL, Methodologies: Search Engine Optimization (SEO), Search Engine Marketing (SEM) Experience Highlights Kairos XR, Remote Unity Developer Virtual Reality Software Engineer, 2021 – Present One of 4 developers on a remote-only team creating Virtual Reality training simulations in Unity. • A Virtual Reality training simulation for a major Middle-Eastern gas exploration company. My focus was on coding the training procedures for using -
Morton Heilig, Through a Combination of Ingenuity, Determination, and Sheer Stubbornness, Was the First Person to Attempt to Create What We Now Call Virtual Reality
Morton Hei Iig "The [in em a of the Future" << 2 2 >> (1955) ;!fo11o11 Hdlir;. Sens<muna. Cuuri<S_) oJS1o11 Fi1lur. "Thus, individually and collectively, by thoroughly applying the methodology of art, the cinema of the future will become the first art form to reveal the new scientific world to man in the .full sensual vividness and dynamic vitality of his consciousness." 239 240 Horton Heilig << Morton Heilig, through a combination of ingenuity, determination, and sheer stubbornness, was the first person to attempt to create what we now call virtual reality. In the 1 950s it occurred to him that all the sensory splendor of life could be simulated with "reality machines." Heilig was a Hollywood cinematographer, and it was as an extension of cinema that he thought such a machine might be achieved. With his inclination, albeit amateur, toward the ontological aspirations of science, He ilig proposed that an artist's expressive powers would be enhanced by a scientific understanding of the senses and perception. His premise was sim ple but striking for its time: if an artist controlled the multisensory stimulation of the audience, he could provide them with the illusion and sensation of first person experience, of actually " being there." Inspired by short-Jived curiosities such as Cinerama and 3-D movies, it oc curred to Heilig that a logical extension of cinema would be to immerse the au dience in a fabricated world that engaged all the senses. He believed that by expanding cinema to involve not only sight and sound but also taste, touch, and smell, the traditional fourth wal l of film and theater would dissolve, transport ing the audience into an inhabitable, virtual world; a kind of "experience theater." Unable to find support in Hollywood for his extraordinary ideas, Heilig moved to Mexico City In 1954, finding himself in a fertile mix of artists, filmmakers, writers, and musicians. -
Evaluating Performance Benefits of Head Tracking in Modern Video
Evaluating Performance Benefits of Head Tracking in Modern Video Games Arun Kulshreshth Joseph J. LaViola Jr. Department of EECS Department of EECS University of Central Florida University of Central Florida 4000 Central Florida Blvd 4000 Central Florida Blvd Orlando, FL 32816, USA Orlando, FL 32816, USA [email protected] [email protected] ABSTRACT PlayStation Move, TrackIR 5) that support 3D spatial in- teraction have been implemented and made available to con- We present a study that investigates user performance ben- sumers. Head tracking is one example of an interaction tech- efits of using head tracking in modern video games. We nique, commonly used in the virtual and augmented reality explored four di↵erent carefully chosen commercial games communities [2, 7, 9], that has potential to be a useful ap- with tasks which can potentially benefit from head tracking. proach for controlling certain gaming tasks. Recent work on For each game, quantitative and qualitative measures were head tracking and video games has shown some potential taken to determine if users performed better and learned for this type of gaming interface. For example, Sko et al. faster in the experimental group (with head tracking) than [10] proposed a taxonomy of head gestures for first person in the control group (without head tracking). A game ex- shooter (FPS) games and showed that some of their tech- pertise pre-questionnaire was used to classify participants niques (peering, zooming, iron-sighting and spinning) are into casual and expert categories to analyze a possible im- useful in games. In addition, previous studies [13, 14] have pact on performance di↵erences. -
Audio Challenges in Virtual and Augmented Reality Devices
Audio challenges in virtual and augmented reality devices Dr. Ivan Tashev Partner Software Architect Audio and Acoustics Research Group Microsoft Research Labs - Redmond In memoriam: Steven L. Grant Sep 15, 2016 IWAENC Audio challenges in virtual and augmented reality devices 2 In this talk • Devices for virtual and augmented reality • Binaural recording and playback • Head Related Functions and their personalization • Object-based rendering of spatial audio • Modal-based rendering of spatial audio • Conclusions Sep 15, 2016 IWAENC Audio challenges in virtual and augmented reality devices 3 Colleagues and contributors: Hannes Gamper David Johnston Ivan Tashev Mark R. P. Thomas Jens Ahrens Microsoft Research Microsoft Research Microsoft Research Dolby Laboratories Chalmers University, Sweden Sep 15, 2016 IWAENC Audio challenges in virtual and augmented reality devices 4 Devices for Augmented and Virtual Reality They both need good spatial audio Sep 15, 2016 IWAENC Audio challenges in virtual and augmented reality devices 5 Augmented vs. Virtual Reality • Augmented reality (AR) is a live direct or indirect view of a physical, real-world environment whose elements are augmented (or supplemented) by computer-generated sensory input such as sound, video, graphics • Virtual reality (VR) is a computer technology that replicates an environment, real or imagined, and simulates a user's physical presence in a way that allows the user to interact with it. It artificially creates sensory experience, which can include sight, touch, hearing, etc. Sep -
Study on Telexistence XCV: a Telediagnosis Platform Based on Mixed Reality And
3B-05 This article is a technical report without peer review, and its polished and/or extended version may be published elsewhere 第 24 回日本バーチャルリアリティ学会大会論文集(2019 年 9 月) Study on Telexistence XCV: A Telediagnosis Platform Based on Mixed Reality and Bio-signal Display Device Junkai Fu1),Yasuyuki Inoue2),Fumihiro Kato2) ,Susumu Tachi 2) 1) 東京大学 新領域創成科学研究科 (〒277-8561 千葉県柏市柏の葉 5-1- 5, [email protected] ) 2) 東京大学 高齢社会総合研究機構 (〒113-0032 東京都文京区本郷 7-3-1, {y-inoue,fumihiro.kato,tachi}@tachilab.org) Abstract: We propose a telediagnosis system that allows medical staff to interact with a remote patient through telexistence robot system. The system consists of an audio-visual telexistence system (TX-toolkit), a surrogate arm equipped with thermal and pressure displays, and body temperature and heartbeat measurement equipment. By using this system, the medical staff can examine the patient as if he or she is observing the patient face to face. Keywords:Teledignosis, Telexistence, Haptics, Mixed reality 1. Introduction Moreover, palpation based on VR simulation has also been Recent years many countries have come into an aging society. proposed. Timothy et al. use artificial force to simulate the The aged have to live by themselves because their children have feeling of human skin and apply the system into the palpation no time to take care of them due to their hard work. Hence the and insertion training[3]. To achieve telemedicine, a robot own health care targeted at the aged is an urgent matter. partial function as a human is also a viable way. Garingo et al. Telemedicine is suitable to do this. -
Virtual and Augmented Reality
Virtual and Augmented Reality Virtual and Augmented Reality: An Educational Handbook By Zeynep Tacgin Virtual and Augmented Reality: An Educational Handbook By Zeynep Tacgin This book first published 2020 Cambridge Scholars Publishing Lady Stephenson Library, Newcastle upon Tyne, NE6 2PA, UK British Library Cataloguing in Publication Data A catalogue record for this book is available from the British Library Copyright © 2020 by Zeynep Tacgin All rights for this book reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, without the prior permission of the copyright owner. ISBN (10): 1-5275-4813-9 ISBN (13): 978-1-5275-4813-8 TABLE OF CONTENTS List of Illustrations ................................................................................... x List of Tables ......................................................................................... xiv Preface ..................................................................................................... xv What is this book about? .................................................... xv What is this book not about? ............................................ xvi Who is this book for? ........................................................ xvii How is this book used? .................................................. xviii The specific contribution of this book ............................. xix Acknowledgements ........................................................... -
Téléprésence, Immersion Et Interactions Pour Le Reconstruction
THÈSE Pour obtenir le grade de DOCTEUR DE L’UNIVERSITÉ DE GRENOBLE Spécialité : Mathématiques et Informatique Arrêté ministériel : 7 août 2006 Présentée par Benjamin PETIT Thèse dirigée par Edmond BOYER et codirigée par Bruno RAFFIN préparée au sein des laboratoires LJK et LIG dans l’école doctorale MSTII Téléprésence, immersion et tel-00584001, version 1 - 7 Apr 2011 tel-00584001, version 1 - 7 interaction pour la reconstruction 3D temps-réel Thèse soutenue publiquement le 21 Février 2011 devant le jury composé de : Mme. Indira, THOUVENIN Enseignant chercheur à l’Université de Technologie de Compiègne, Président Mr. Bruno, ARNALDI Professeur à l’INSA Rennes, Rapporteur Mme. Saida, BOUAKAZ Professeur à l’Université Claude Bernard Lyon 1, Rapporteur Mr. Edmond, BOYER Directeur de recherche à l’INRIA Grenoble, Membre Mr. Bruno, RAFFIN Chargé de recherche à l’INRIA Grenoble, Membre tel-00584001, version 1 - 7 Apr 2011 Remerciements Je voudrais commencer par remercier Edmond et Bruno pour avoir encadrer ma thèse. Ce fut un plaisir de travailler avec vous. Merci également aux membres de mon jury d’avoir accepté de rapporter cette thèse. Merci pour vos commentaires très constructifs. Pendant ma thèse j’ai eu l’occasion de travailler avec différentes personnes. Ces collaborations ont été très enrichissantes. Je voudrais remercier plus spécifiquement Jean-Denis qui m’a aidé à remettre sur pied la plateforme Grimage, Thomas avec qui j’ai passé de longues heures à développer les applications et démonstrations de ma thèse et enfin Hervé pour son excellent support sur la plateforme Grimage. J’aimerais remercier également Clément et Florian pour m’avoir transmis leur savoir sur la plateforme Grimage, Nicolas et Jean-François pour leur aide technique. -
Virtual Reality: Principles and Applications Frédéric Mérienne
Virtual Reality: Principles and Applications Frédéric Mérienne To cite this version: Frédéric Mérienne. Virtual Reality: Principles and Applications. Encyclopedia of Computer Science and Technology, Taylor and Francis, pp.1-11, 2017, 10.1081/E-ECST2-140000194. hal-01728062 HAL Id: hal-01728062 https://hal.archives-ouvertes.fr/hal-01728062 Submitted on 9 Mar 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Virtual Reality: Principles and Applications Fre´de´ric Merienne Le2i, Arts et Metiers, France Abstract Virtual reality aims at immersing a user in a virtual environment. Dedicated virtual reality technologies of human–computer interaction enable to make the link between the user and a virtual environment in capturing the user’s motion, acting on his senses as well as computing the virtual experience in real-time. The immersion in virtual environment is evaluated through the user’s perception and reaction. Virtual reality is used in a large variety of application domains which need multisensory interaction and navigation facilities. Virtual prototyping is also used in the industry to improve design process. INTRODUCTION digital representation in the design process of the object. The principle and main issues of virtual prototyping are Virtual reality is widely used in different application exposed. -
History of Virtual Reality
History of Virtual Reality Reading: 3D User Interfaces: Theory and Practice (2nd Edition), Ch. 2 Evan Suma Rosenberg | CSCI 5619 | Fall 2020 This course content is offered under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license. 1838 – Wheatstone Stereoscope The Wheatstone stereoscope used angled mirrors (A) to reflect stereoscopic drawings (E) towards the viewer’s eyes. 1849 – Brewster Stereoscope P. Hoberman, D. Krum, E. Suma, and M. Bolas. Immersive training games for smartphone-based head mounted displays. IEEE Virtual Reality, 2012. 1903 – Parallax Barrier 1929 – Link Flight Simulator Edward Link developed a mechanical flight simulator for training. Simulator was instrument-only (flying blind with no visuals). 1956 – Sensorama Morton Heilig’s Sensorama was an immersive multisensory experience that combined 3D film, stereo sound, vibration, wind, and even smell. 1960 – Telesphere Mask The first head-mounted display (HMD) was patented by Heilig in 1960. 1965 – The Ultimate Display • 3D Display: “A display connected to a digital computer gives us a chance to gain familiarity with concepts not realizable in the physical world. It is a looking glass into a mathematical wonderland.” • Motion Tracking: “The computer can easily sense the positions of almost any of our body muscles.” • Haptics: “The ultimate display would, of course, be a room within which the computer can control the existence of matter. A chair displayed in such a room would be good enough to sit in. Handcuffs displayed in such a room would be confining, and a bullet displayed in such a room would be fatal.” 1968 - Sword of Damocles First virtual reality head-mounted display system, created by Ivan Sutherland and Bob Sproull. -
A Telediagnosis Platform Based on Telexistence: Investigation of the Roles of Presence and Tactile Information in Telemedicine
Department of Complexity Science and Engineering Graduate School of Frontier Sciences The University of Tokyo 2020 Master's Thesis A Telediagnosis Platform based on Telexistence: Investigation of the Roles of Presence and Tactile Information in Telemedicine (テレイグジスタンスに基づく遠隔診断プラットフォーム―遠隔 医療における存在感と触覚手がかりの役割の調査―) March 2020 by Junkai Fu Supervisor:Prof. Hiroyuki Shinoda Abstract This paper proposes a telediagnosis system that allows medical staff to examine remote patients through telexistence robot system with tactile sensor/display. The system consists of three components of an audio-visual telexistence system for telecommunication, a skin-like tactile display equipped with thermal and pressure display devices, and body temperature and heartbeat measurement equipment. In comparison with conventional telephone and videophone, this MR system is expected to allow a medical staff to examine the patient more carefully as if he or she is observing the patient face to face.To test this, 12 medical doctors and nurses evaluated this system. According to the results, the effects of telexistence and tactile display on telediagnosis are discussed. Also, the feasibility of the system for improving the realism of telediagnosis is verified and discussed. Index 1 Introduction ..................................................................................................................................................1 1.1 Virtual Reality (VR) ........................................................................................................................1 -
An Educational Physics Laboratory in Mobile Versus Room Scale Virtual Reality - a Comparative Study
An Educational Physics Laboratory in Mobile Versus Room Scale Virtual Reality - A Comparative Study Johanna Pirker1, Isabel Lesjak1, Mathias Parger1, and Christian G¨utl1;2 1 Graz University of Technology, Austria [email protected], [email protected], [email protected], [email protected] 2 Curtin University, Western Australia [email protected] Abstract. Despite year-long efforts in education, studying and under- standing physical phenomena still proves to be a challenge to both learn- ers and educators. However, with the current rise of Virtual Reality expe- riences, interactive immersive simulations in 3D are becoming a promis- ing tool with great potential to enhance and support traditional class- room setups and experiences in an engaging and immersive way. The paper describes the evaluation of the physics laboratory Maroon pre- sented on two distinct VR setups: first, a mobile and cost-efficient but simpler VR experience with the Samsung GEAR and second, a more interactive room scale experience with the HTC VIVE. First results of both preliminary empirical studies indicate that the VIVE environment increases user interactivity and engagement whereas the GEAR setup benefits from portability and better flexibility. In this paper we discuss device-specific design aspects and provide a comparison focusing on as- pects such as immersion, engagement, presence and motivation. Keywords: virtual reality, immersion, physics education 1 Introduction The improvement of science education is still a topic under frequent discussion in the world today. In physics education in particular in, the situation is two- fold: many teachers are challenged in teaching concepts to an increasing number of students, who in turn often face issues themselves in trying to understand the concepts taught while linking theoretical formulas to natural phenomena. -
Guidelines on Successfully Porting Non-Immersive Games to Virtual
Guidelines on Successfully Porting Non-Immersive Games to Virtual Reality: A Case Study in Minecraft John Porter III Matthew Boyer Andrew Robb Clemson University Clemson University Clemson University Clemson, SC, USA Clemson, SC, USA Clemson, SC, USA [email protected] [email protected] [email protected] ABSTRACT top 10 best seller list on the Steam marketplace after it was Virtual reality games have grown rapidly in popularity since released for pre-ordering. the first consumer VR head-mounted displays were released When porting a game to VR, one of the major challenges faced in 2016, however comparatively little research has explored by developers is adapting the controls of the non-immersive how this new medium impacts the experience of players. In game to work in the new immersive context. Several options this paper, we present a study exploring how user experience are open to developers. At the most basic level, developers can changes when playing Minecraft on the desktop and in im- change nothing and continue to allow users to play the game mersive virtual reality. Fourteen players completed six 45 using a keyboard or a gamepad. This method relies purely on minute sessions, three played on the desktop and three in VR. indirect input, as no aspect of the player’s bodily motion is The Gaming Experience Questionnaire, the i-Group presence used to interact with the game (expect for head motion). At the questionnaire, and the Simulator Sickness Questionnaire were most advanced level, developers can completely recreate the administered after each session, and players were interviewed controls to take full advantage of the motion controls afforded at the end of the experiment.