USER EXPERIENCE GUIDELINES for DESIGN of VIRTUAL REALITY GRAPHICAL USER INTERFACES Controlled by Head Orientation Input

Total Page:16

File Type:pdf, Size:1020Kb

USER EXPERIENCE GUIDELINES for DESIGN of VIRTUAL REALITY GRAPHICAL USER INTERFACES Controlled by Head Orientation Input USER EXPERIENCE GUIDELINES FOR DESIGN OF VIRTUAL REALITY GRAPHICAL USER INTERFACES controlled by head orientation input Bachelor Degree Project in Cognitive Science Three years Level 30 ECTS Spring term 2016 Sofia Fröjdman Supervisor: Tarja Susi Examiner: Niklas Torstensson Abstract With the recent release of head-mounted displays for consumers, virtual reality experiences are more accessible than ever. However, there is still a shortage of research concerning how to design user interfaces in virtual reality for good experiences. This thesis focuses on what aspects should be considered when designing a graphical user interface in virtual reality - controlled by head orientation input - for a qualitative user experience. The research has included a heuristic evaluation, interviews, usability tests, and a survey. A virtual reality prototype of a video on demand service was investigated and served as the application for the research. Findings from the analysis of the data were application specific pragmatic and hedonic goals of the users, relevant to the subjective user experience, and current user experience problems with the prototype tested. In combination with previous recommendations, the result led to the development of seven guidelines. However, these guidelines are considered only to serve as a foundation for future research since they need to be validated. New head-mounted displays and virtual reality applications are released every day and with the increasing number of users, there will be a continuous need for more research. Keywords: Virtual reality graphical user interface, Head orientation input, Head-mounted display, User experience, Video on demand service Popular scientific abstract As a result of the recent release of head-mounted displays and virtual reality sets, such as Oculus Rift, Samsung Gear VR, and Google Cardboard, virtual reality has turned in to a big technology trend. Since the virtual reality experiences just recently have begun to become available for consumers, there is still a lacK of research concerning the users experience of them. How should user interfaces be designed for virtual reality to be easy and fun to use and how should the user interface be controlled in the best possible way? This thesis focuses on the only available control method that is possible to use with all different head-mounted displays and virtual reality sets. The way the user with a head-mounted display turn his or her head in different directions, allow the user to see more of the virtual world, and this could also be used to project a gaze cursor in the centre of the user’s field of view. If the user then stays with the gaze cursor over a certain object in the user interface for a predetermined period of time, a selection can be made. This thesis focuses on answering the question of what aspects should be considered when designing a user interface in virtual reality, controlled in this way, for qualitative user experiences. A prototype application of a video on demand service in virtual reality was used for part of the research and tested by users. Additionally, users were interviewed and asKed in a survey about their goals, Knowledge, preferences, and expectations. The result of the research showed the goals of why users wanted to use a video on demand service in virtual reality with a head-mounted display and what they wanted to be able to do in such an application. It also showed current user experience problems with the application that was tested. Based on these results, together with previous recommendations found in literature, new guidelines were developed. However, these need to be tested and further confirmed before they can be used. With the release of new head-mounted displays and virtual reality applications every day, there will be a growing number of user, and this will lead to an increasing need for research about how to improve the experiences as well. Acknowledgements Writing this thesis has been a challenging but very exciting process. Moreover, it has been a tremendous learning experience, and I am very grateful for all the inspiring and supportive people around me who have helped me along the process. Foremost, I would liKe to express my sincere gratitude to my supervisor Tarja Susi for all the continuous support and guidance during these months. I would also liKe to thanK NiKlas Torstensson for his feedbacK and encouragement. Moreover, I would like to thanK people at Accedo for welcoming and supporting me as well as sharing their Knowledge. I specifically want to thanK my Accedo supervisor, José Somolinos, who has inspired me and introduced me to the world of virtual reality. My sincere thanKs also go to all the participants in the research who has taken their time to help me. Last but not least, I would liKe to thanK my family and friends for their never-ending encouragement and support. Contents List of abbreviations ............................................................................................................................ 1 Introduction ..................................................................................................................................... 1 2 Background ..................................................................................................................................... 3 2.1 Virtual reality and related concepts ........................................................................................... 3 2.2 Virtual reality graphical user interface ...................................................................................... 5 2.3 Head-mounted display ............................................................................................................... 7 2.4 Head orientation input and head gaze ........................................................................................ 9 2.5 User experience ....................................................................................................................... 11 2.6 Video on demand service ......................................................................................................... 12 2.7 Research related design principles for virtual reality graphical user interfaces ...................... 13 2.8 Research aim and objective ..................................................................................................... 16 2.8.1 Expected contributions ..................................................................................................... 17 2.8.2 Limitations ........................................................................................................................ 17 3 Method ........................................................................................................................................... 18 3.1 Research design ....................................................................................................................... 18 3.2 Heuristic evaluation ................................................................................................................. 19 3.3 Interview .................................................................................................................................. 21 3.4 Usability test ............................................................................................................................ 22 3.5 Survey ...................................................................................................................................... 24 4 Procedure ....................................................................................................................................... 25 4.1 Accedo’s virtual reality video on demand prototype ............................................................... 25 4.2 Heuristic evaluation procedure ................................................................................................ 27 4.3 Interview and usability test procedure ..................................................................................... 28 4.4 Survey procedure ..................................................................................................................... 32 5 Result and analysis ....................................................................................................................... 34 5.1 Heuristic evaluation result and analysis .................................................................................. 35 5.2 Interview result and analysis ................................................................................................... 36 5.3 Usability test result and analysis .............................................................................................. 38 5.4 Survey result and analysis ....................................................................................................... 44 5.5 Comprehensive analysis .......................................................................................................... 47 5.5.1 Identifying the users’ goals, needs, behaviours, preferences, and context of use ............ 47 5.5.2 Analysis of the discovered user experience problems ...................................................... 48 6 Suggested guidelines ..................................................................................................................... 51 7 Conclusion and discussion ........................................................................................................... 56 7.1
Recommended publications
  • User Interface Design Issues in HCI
    IJCSNS International Journal of Computer Science and Network Security, VOL.18 No.8, August 2018 153 User Interface Design Issues In HCI Waleed Iftikhar, Muhammad Sheraz Arshad Malik, Shanza Tariq, Maha Anwar, Jawad Ahmad, M. Saad sultan Department of Computing, Riphah International University, Faisalabad, Pakistan Summary Command line is the interface that allows the user to This paper presents an important analysis on a literature review interact with the computer by directly using the commands. which has the findings in design issues from the year 1999 to But there is an issue that the commands cannot be changed, 2018. This study basically discusses about all the issues related they are fixed and computer only understands the exact to design and user interface, and also gives the solutions to make commands. the designs or user interface more attractive and understandable. This study is the guideline to solve the main issues of user Graphical user interface is the interface that allows the interface. user to interact with the system, because this is user There is important to secure the system for modern applications. friendly and easy to use. This includes the graphics, The use of internet is quickly growing from years. Because of pictures and also attractive for all type of users. The this fast travelling lifestyle, where they lets the user to attach with command line is black and white interface. This interface systems from everywhere. When user is ignoring the is also known as WIMPS because it uses windows, icons, functionalities in the system then the system is not secure but, in menus, pointers.
    [Show full text]
  • Designing for Increased Autonomy & Human Control
    IFIP Workshop on Intelligent Vehicle Dependability and Security (IVDS) January 29, 2021 Designing for Increased Autonomy & Human Control Ben Shneiderman @benbendc Founding Director (1983-2000), Human-Computer Interaction Lab Professor, Department of Computer Science Member, National Academy of Engineering Photo: BK Adams IFIP Workshop on Intelligent Vehicle Dependability and Security (IVDS) January 29, 2021 Designing for Increased Automation & Human Control Ben Shneiderman @benbendc Founding Director (1983-2000), Human-Computer Interaction Lab Professor, Department of Computer Science Member, National Academy of Engineering Photo: BK Adams What is Human-Centered AI? Human-Centered AI Amplify, Augment, Enhance & Empower People Human Responsibility Supertools and Active Appliances Visual Interfaces to Prevent/Reduce Explanations Audit Trails to Analyze Failures & Near Misses Independent Oversight à Reliable, Safe & Trustworthy Supertools Digital Camera Controls Navigation Choices Texting Autocompletion Spelling correction Active Appliances Coffee maker, Rice cooker, Blender Dishwasher, Clothes Washer/Dryer Implanted Cardiac Pacemakers NASA Mars Rovers are Tele-Operated DaVinci Tele-Operated Surgery “Robots don’t perform surgery. Your surgeon performs surgery with da Vinci by using instruments that he or she guides via a console.” https://www.davincisurgery.com/ Bloomberg Terminal A 2-D HCAI Framework Designing the User Interface Balancing automation & human control First Edition: 1986 Designing the User Interface Balancing automation &
    [Show full text]
  • Virtual Reality Headsets
    VIRTUAL REALITY HEADSETS LILY CHIANG VR HISTORY • Many companies (Virtuality, Sega, Atari, Sony) jumped on the VR hype in the 1990s; but commercialization flopped because both hardware and software failed to deliver on the promised VR vision. • Any use of the VR devices in the 2000s was limited to the military, aviation, and medical industry for simulation and training. • VR hype resurged after Oculus successful KickStarter campaign; subsequently acquired by Facebook for $2.4 bn. • Investments rushed into the VR industry as major tech firms such as Google, Samsung, and Microsoft and prominent VC firms bet big on the VR revolution. LIST OF VIRTUAL REALITY HEADSET FIRMS Company Name Entered Exited Disposition Company Name Entered Exited Disposition Company Name Entered Exited Disposition LEEP Optics 1979 1998 Bankrupt Meta Altergaze 2014 Ongoing VPL Research 1984 1990 Bankrupt SpaceGlasses 2012 Ongoing Archos VR 2014 Ongoing Division Group Sulon Cortex 2012 Ongoing AirVr 2014 Ongoing LTD 1989 1999 Acquired Epson Moverio Sega VR 1991 1994 Bankrupt BT-200 2012 Ongoing 360Specs 2014 Ongoing Virtuality 1991 1997 Acquired i2i iPal 2012 Ongoing Microsoft VictorMaxx 1992 1998 Bankrupt Star VR 2013 Ongoing Hololens Systems 2015 Ongoing Durovis Dive 2013 Ongoing Razr OSVR 2015 Ongoing Atari Jaguar VR 1993 1996 Discontinued Vrizzmo 2013 Ongoing Virtual I-O 1993 1997 Bankrupt Cmoar 2015 Ongoing CastAR 2013 Ongoing eMagin 1993 Ongoing Dior Eyes VR 2015 Ongoing VRAse 2013 Ongoing Virtual Boy 1994 1995 Discontinued Yay3d VR 2013 Ongoing Impression Pi
    [Show full text]
  • Design and Evaluation of a Perceptually Adaptive Rendering System for Immersive Virtual Reality Environments Kimberly Ann Weaver Iowa State University
    Iowa State University Capstones, Theses and Retrospective Theses and Dissertations Dissertations 2007 Design and evaluation of a perceptually adaptive rendering system for immersive virtual reality environments Kimberly Ann Weaver Iowa State University Follow this and additional works at: https://lib.dr.iastate.edu/rtd Part of the Cognitive Psychology Commons, and the Computer Sciences Commons Recommended Citation Weaver, Kimberly Ann, "Design and evaluation of a perceptually adaptive rendering system for immersive virtual reality environments" (2007). Retrospective Theses and Dissertations. 14895. https://lib.dr.iastate.edu/rtd/14895 This Thesis is brought to you for free and open access by the Iowa State University Capstones, Theses and Dissertations at Iowa State University Digital Repository. It has been accepted for inclusion in Retrospective Theses and Dissertations by an authorized administrator of Iowa State University Digital Repository. For more information, please contact [email protected]. Design and evaluation of a perceptually adaptive rendering system for immersive virtual reality environments by Kimberly Ann Weaver A thesis submitted to the graduate faculty in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE Major: Human Computer Interaction Program of Study Committee: Derrick Parkhurst (Major Professor) Chris Harding Shana Smith Iowa State University Ames, Iowa 2007 Copyright © Kimberly Ann Weaver, 2007. All rights reserved. UMI Number: 1449653 Copyright 2007 by Weaver, Kimberly Ann All rights reserved. UMI Microform 1449653 Copyright 2008 by ProQuest Information and Learning Company. All rights reserved. This microform edition is protected against unauthorized copying under Title 17, United States Code. ProQuest Information and Learning Company 300 North Zeeb Road P.O.
    [Show full text]
  • An Augmented Reality Social Communication Aid for Children and Adults with Autism: User and Caregiver Report of Safety and Lack of Negative Effects
    bioRxiv preprint doi: https://doi.org/10.1101/164335; this version posted July 19, 2017. The copyright holder for this preprint (which was not certified by peer review) is the author/funder. All rights reserved. No reuse allowed without permission. An Augmented Reality Social Communication Aid for Children and Adults with Autism: User and caregiver report of safety and lack of negative effects. An Augmented Reality Social Communication Aid for Children and Adults with Autism: User and caregiver report of safety and lack of negative effects. Ned T. Sahin1,2*, Neha U. Keshav1, Joseph P. Salisbury1, Arshya Vahabzadeh1,3 1Brain Power, 1 Broadway 14th Fl, Cambridge MA 02142, United States 2Department of Psychology, Harvard University, United States 3Department of Psychiatry, Massachusetts General Hospital, Boston * Corresponding Author. Ned T. Sahin, PhD, Brain Power, 1 Broadway 14th Fl, Cambridge, MA 02142, USA. Email: [email protected]. Abstract Background: Interest has been growing in the use of augmented reality (AR) based social communication interventions in autism spectrum disorders (ASD), yet little is known about their safety or negative effects, particularly in head-worn digital smartglasses. Research to understand the safety of smartglasses in people with ASD is crucial given that these individuals may have altered sensory sensitivity, impaired verbal and non-verbal communication, and may experience extreme distress in response to changes in routine or environment. Objective: The objective of this report was to assess the safety and negative effects of the Brain Power Autism System (BPAS), a novel AR smartglasses-based social communication aid for children and adults with ASD. BPAS uses emotion-based artificial intelligence and a smartglasses hardware platform that keeps users engaged in the social world by encouraging “heads-up” interaction, unlike tablet- or phone-based apps.
    [Show full text]
  • Edgenuity Preview Guide
    Quick Preview Guide Edgenuity Courseware Quick Preview Guide Table of Contents Foreword ............................................................................................................................. 1 The Student Experience ........................................................................................................ 2 Log In To Edgenuity ....................................................................................................................2 The Student Home Page ..............................................................................................................3 Exploring Assignments .................................................................................................................3 The Educator Experience ...................................................................................................... 4 Log In To Edgenuity ....................................................................................................................4 The Educator Home Page .............................................................................................................5 Course Management ....................................................................................................................6 Student Management ..................................................................................................................7 Preview Dual Credit Courses .................................................................................................. 9 Foreword
    [Show full text]
  • Exploring the User Interface Affordances of File Sharing
    CHI 2006 Proceedings • Activity: Design Implications April 22-27, 2006 • Montréal, Québec, Canada Share and Share Alike: Exploring the User Interface Affordances of File Sharing Stephen Voida1, W. Keith Edwards1, Mark W. Newman2, Rebecca E. Grinter1, Nicolas Ducheneaut2 1GVU Center, College of Computing 2Palo Alto Research Center Georgia Institute of Technology 3333 Coyote Hill Road 85 5th Street NW, Atlanta, GA 30332–0760, USA Palo Alto, CA 94304, USA {svoida, keith, beki}@cc.gatech.edu {mnewman, nicolas}@parc.com ABSTRACT and folders shared with other users on a single computer, With the rapid growth of personal computer networks and often as a default system behavior; files shared with other the Internet, sharing files has become a central activity in computers over an intranet or home network; and files computer use. The ways in which users control the what, shared with other users around the world on web sites and how, and with whom of sharing are dictated by the tools FTP servers. Users also commonly exchange copies of they use for sharing; there are a wide range of sharing documents as email attachments, transfer files during practices, and hence a wide range of tools to support these instant messaging sessions, post digital photos to online practices. In practice, users’ requirements for certain photo album services, and swap music files using peer–to– sharing features may dictate their choice of tool, even peer file sharing applications. though the other affordances available through that tool Despite these numerous venues for and implementations of may not be an ideal match to the desired manner of sharing.
    [Show full text]
  • The Application of Virtual Reality in Engineering Education
    applied sciences Review The Application of Virtual Reality in Engineering Education Maged Soliman 1 , Apostolos Pesyridis 2,3, Damon Dalaymani-Zad 1,*, Mohammed Gronfula 2 and Miltiadis Kourmpetis 2 1 College of Engineering, Design and Physical Sciences, Brunel University London, London UB3 3PH, UK; [email protected] 2 College of Engineering, Alasala University, King Fahad Bin Abdulaziz Rd., Dammam 31483, Saudi Arabia; [email protected] (A.P.); [email protected] (M.G.); [email protected] (M.K.) 3 Metapower Limited, Northwood, London HA6 2NP, UK * Correspondence: [email protected] Abstract: The advancement of VR technology through the increase in its processing power and decrease in its cost and form factor induced the research and market interest away from the gaming industry and towards education and training. In this paper, we argue and present evidence from vast research that VR is an excellent tool in engineering education. Through our review, we deduced that VR has positive cognitive and pedagogical benefits in engineering education, which ultimately improves the students’ understanding of the subjects, performance and grades, and education experience. In addition, the benefits extend to the university/institution in terms of reduced liability, infrastructure, and cost through the use of VR as a replacement to physical laboratories. There are added benefits of equal educational experience for the students with special needs as well as distance learning students who have no access to physical labs. Furthermore, recent reviews identified that VR applications for education currently lack learning theories and objectives integration in their design.
    [Show full text]
  • User Interface for Volume Rendering in Virtual Reality Environments
    User Interface for Volume Rendering in Virtual Reality Environments Jonathan Klein∗ Dennis Reuling† Jan Grimm‡ Andreas Pfau§ Damien Lefloch¶ Martin Lambersk Andreas Kolb∗∗ Computer Graphics Group University of Siegen ABSTRACT the gradient or the curvature at the voxel location into account and Volume Rendering applications require sophisticated user interac- require even more complex user interfaces. tion for the definition and refinement of transfer functions. Tradi- Since Virtual Environments are especially well suited to explore tional 2D desktop user interface elements have been developed to spatial properties of complex 3D data, bringing Volume Render- solve this task, but such concepts do not map well to the interaction ing applications into such environments is a natural step. However, devices available in Virtual Reality environments. defining new user interfaces suitable both for the Virtual Environ- ment and for the Volume Rendering application is difficult. Pre- In this paper, we propose an intuitive user interface for Volume vious approaches mainly focused on porting traditional 2D point- Rendering specifically designed for Virtual Reality environments. and-click concepts to the Virtual Environment [8, 5, 9]. This tends The proposed interface allows transfer function design and refine- to be unintuitive, to complicate the interaction, and to make only ment based on intuitive two-handed operation of Wand-like con- limited use of available interaction devices. trollers. Additional interaction modes such as navigation and clip In this paper, we propose an intuitive 3D user interface for Vol- plane manipulation are supported as well. ume Rendering based on interaction devices that are suitable for The system is implemented using the Sony PlayStation Move Virtual Reality environments.
    [Show full text]
  • Utilization of Immersive 360 Degree Spherical Videos and Google Cardboard in Medical Training and Simulation: a Novel and Multi-Dimensional Way of Learning
    Utilization of Immersive 360 Degree Spherical Videos and Google Cardboard in Medical Training and Simulation: A Novel and Multi-dimensional Way of Learning Shoeb Mohiuddin, MD CA-2 Daniel Roshan, MD CA-2 Heike Knorpp, MD University of Illinois at Chicago Financial Disclosure We have no relevant financial or nonfinancial relationships within the products or services described, reviewed, evaluated or compared in this presentation. To view video, search on YouTube App: “STA 2016 Abstract Demo” or go to https://youtu.be/yr5EDF_taa8 Outline ● Generation X & Learning ● Experiential Learning ● 360 Degree Videos ● Google Cardboard Viewers ● Video Demonstration ● Pros & Cons ● Questions To view video, search on YouTube App: “STA 2016 Abstract Demo” or go to https://youtu.be/yr5EDF_taa8 Generation X, Technology, and Learning Majority of anesthesia residents are Millennial students with divergent learning needs from their predecessors that desire interactive learning through experiential and immersive learning. - Psychosocial influences - Physiological changes of the brain that change the way information is processed Generational difference in learning creates challenges for educators to teach trainees that speak a “different language” Be aware of cognitive biases. Keil Centre. http://www.keilcentre.co. uk/news/cognitive-biases/. Accessed: 1/3/2016. (Chu, 2012) To view video, search on YouTube App: “STA 2016 Abstract Demo” or go to https://youtu.be/yr5EDF_taa8 Educational Preferences of Millennials ● Learning and working in teams ● Structure with achievement-oriented goals ● Engagement and experience ● Visual and kinesthetic educational modalities and environments ● Learning about things that they feel matter to them (Chu, 2012) To view video, search on YouTube App: “STA 2016 Abstract Demo” or go to https://youtu.be/yr5EDF_taa8 Experiential Learning Experiential learning is referred to as learning through action, learning by doing, learning through experience, and learning through discovery and exploration.
    [Show full text]
  • Lightdb: a DBMS for Virtual Reality Video
    LightDB: A DBMS for Virtual Reality Video Brandon Haynes, Amrita Mazumdar, Armin Alaghi, Magdalena Balazinska, Luis Ceze, Alvin Cheung Paul G. Allen School of Computer Science & Engineering University of Washington, Seattle, Washington, USA {bhaynes, amrita, armin, magda, luisceze, akcheung}@cs.washington.edu http://lightdb.uwdb.io ABSTRACT spherical panoramic VR videos (a.k.a. 360◦ videos), encoding one We present the data model, architecture, and evaluation of stereoscopic frame of video can involve processing up to 18× more LightDB, a database management system designed to efficiently bytes than an ordinary 2D video [30]. manage virtual, augmented, and mixed reality (VAMR) video con- AR and MR video applications, on the other hand, often mix tent. VAMR video differs from its two-dimensional counterpart smaller amounts of synthetic video with the world around a user. in that it is spherical with periodic angular dimensions, is nonuni- Similar to VR, however, these applications have extremely de- formly and continuously sampled, and applications that consume manding latency and throughput requirements since they must react such videos often have demanding latency and throughput require- to the real world in real time. ments. To address these challenges, LightDB treats VAMR video To address these challenges, various specialized VAMR sys- data as a logically-continuous six-dimensional light field. Further- tems have been introduced for preparing and serving VAMR video more, LightDB supports a rich set of operations over light fields, data (e.g., VRView [71], Facebook Surround 360 [20], YouTube and automatically transforms declarative queries into executable VR [75], Google Poly [25], Lytro VR [41], Magic Leap Cre- physical plans.
    [Show full text]
  • (VR): a Case Study of the HTC Vive Pro Eye's Usability
    healthcare Article Eye-Tracking for Clinical Ophthalmology with Virtual Reality (VR): A Case Study of the HTC Vive Pro Eye’s Usability Alexandra Sipatchin 1,*, Siegfried Wahl 1,2 and Katharina Rifai 1,2 1 Institute for Ophthalmic Research, University of Tübingen, 72076 Tübingen, Germany; [email protected] (S.W.); [email protected] (K.R.) 2 Carl Zeiss Vision International GmbH, 73430 Aalen, Germany * Correspondence: [email protected] Abstract: Background: A case study is proposed to empirically test and discuss the eye-tracking status-quo hardware capabilities and limitations of an off-the-shelf virtual reality (VR) headset with embedded eye-tracking for at-home ready-to-go online usability in ophthalmology applications. Methods: The eye-tracking status-quo data quality of the HTC Vive Pro Eye is investigated with novel testing specific to objective online VR perimetry. Testing was done across a wide visual field of the head-mounted-display’s (HMD) screen and in two different moving conditions. A new automatic and low-cost Raspberry Pi system is introduced for VR temporal precision testing for assessing the usability of the HTC Vive Pro Eye as an online assistance tool for visual loss. Results: The target position on the screen and head movement evidenced limitations of the eye-tracker capabilities as a perimetry assessment tool. Temporal precision testing showed the system’s latency of 58.1 milliseconds (ms), evidencing its good potential usage as a ready-to-go online assistance tool for visual loss. Conclusions: The test of the eye-tracking data quality provides novel analysis useful for testing upcoming VR headsets with embedded eye-tracking and opens discussion regarding expanding future introduction of these HMDs into patients’ homes for low-vision clinical usability.
    [Show full text]