Understanding Intuitive Gestures in Wearable Mixed Reality Environments
Total Page:16
File Type:pdf, Size:1020Kb
Iowa State University Capstones, Theses and Graduate Theses and Dissertations Dissertations 2020 Understanding intuitive gestures in wearable mixed reality environments Karen Marie Doty Iowa State University Follow this and additional works at: https://lib.dr.iastate.edu/etd Recommended Citation Doty, Karen Marie, "Understanding intuitive gestures in wearable mixed reality environments" (2020). Graduate Theses and Dissertations. 18080. https://lib.dr.iastate.edu/etd/18080 This Thesis is brought to you for free and open access by the Iowa State University Capstones, Theses and Dissertations at Iowa State University Digital Repository. It has been accepted for inclusion in Graduate Theses and Dissertations by an authorized administrator of Iowa State University Digital Repository. For more information, please contact [email protected]. Understanding intuitive gestures in wearable mixed reality environments by Karen Marie Doty A dissertation submitted to the graduate faculty in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY Major: Human Computer Interaction Program of Study Committee: James Lathrop, Co-major Professor Alex Braidwood, Co-major Professor Stephen Gilbert Larysa Nadolny Andrea Quam The student author, whose presentation of the scholarship herein was approved by the program of study committee, is solely responsible for the content of this dissertation. The Graduate College will ensure this dissertation is globally accessible and will not permit alterations after a degree is conferred. Iowa State University Ames, Iowa 2020 Copyright ©Karen Marie Doty, 2020. All rights reserved. ii DEDICATION To Chad, who showed me to look past the way things are, moreover, to look toward to the way things should be. You are my constant support and pillar of strength. To Stella, may the future be beautiful and kind. iii TABLE OF CONTENTS Page LIST OF FIGURES ............................................................................................................ v LIST OF TABLES ............................................................................................................. vi NOMENCLATURE ......................................................................................................... vii ACKNOWLEDGMENTS ............................................................................................... viii ABSTRACT ....................................................................................................................... ix CHAPTER 1. INTRODUCTION: ...................................................................................... 1 1.1 Objective and Significance ...................................................................................... 3 1.1.1 Research Questions ......................................................................................... 3 1.2 Definition of Main Terms ........................................................................................ 4 1.3 Introduction to the Microsoft HoloLens .................................................................. 5 CHAPTER 2. LITERATURE REVIEW: ........................................................................... 8 2.1 Interacting with Holograms ..................................................................................... 9 2.2 Mixed Reality in the Microsoft HoloLens ............................................................... 9 2.2.1 Voice Commands in the Microsoft HoloLens ............................................... 11 2.3 Three Dimensional User Interfaces Best Practices ................................................ 12 2.4 Models and Theories in Human Computer Interaction ......................................... 17 2.4.1 The Gulf of Execution and The Gulf of Evaluation ...................................... 17 2.4.2 Seven Stages of Action .................................................................................. 20 2.4.3 Seven Principles of Design ............................................................................ 22 2.4.4 Conceptual Models ........................................................................................ 25 2.4.5 Usability, Embodied Interaction & Ergonomics ........................................... 26 2.4.6 Accessibility in MR HUDs ............................................................................ 29 2.5 Gestures in Mixed Reality Head’s Up Displays .................................................... 29 2.5.1 Design and Implementation of Gestures in Mixed Reality Environments .... 31 2.6 Literature Review Conclusion ............................................................................... 31 CHAPTER 3. MIXED REALITY INTUITIVE GESTURES TEST: .............................. 33 3.1 Testing Overview and Parameters ......................................................................... 33 3.1.1 Testing Parameters Mixed Reality Intuitive Gesture Test Part One and Two 33 3.1.2 Testing Environment ...................................................................................... 34 3.1.3 Testing Procedures ......................................................................................... 35 3.1.4 Test Script ....................................................................................................... 36 3.1.5 Test Questions ................................................................................................ 38 3.1.6 Mixed Reality Intuitive Gestures Test Part Two ............................................ 40 iv 3.2 Testing Methodology and Data Collection ............................................................ 40 3.2.1 Gesture Categories ........................................................................................... 41 CHAPTER 4. TESTING RESULTS: ............................................................................... 43 4.1 Results for Mixed Reality Intuitive Gestures Part One ......................................... 43 4.1.1 Analysis ........................................................................................................... 44 4.1.2 Data Measurement ........................................................................................... 45 4.2 Results for Mixed Reality Intuitive Gestures Part Two ........................................ 54 4.2.1 Results and Analysis ........................................................................................ 54 4.2.2 Causation Coding Data and Analysis .............................................................. 54 4.2.3 Second Cycle Categorization ........................................................................... 57 4.2.4 Results of Coding Data .................................................................................... 60 4.2.5 Preliminary Information Part Two .................................................................. 63 4.2.6 Fisher's Exact Test ........................................................................................... 65 4.2.7 Assumptions for Fisher's Exact Test ............................................................... 67 4.2.8 Summary of Results ......................................................................................... 74 CHAPTER 5. EVALUATION ......................................................................................... 77 5.1 Research Questions, Results and Reflection ......................................................... 78 5.2 Framework and Best Practices in User Experience for MR UIs .......................... 84 5.3 Limitations of Study .............................................................................................. 89 5.4 Conclusive Statements and Suggestions ............................................................... 90 5.5 Future Directions .................................................................................................. 92 5.6 Chapter Summary and Closing Statement ............................................................ 95 REFERENCES ................................................................................................................. 96 APPENDIX A. IRB DOCUMENTS .............................................................................. 100 APPENDIX B. TEST RESULTS ................................................................................... 115 APPENDIX C. CODED DATA ..................................................................................... 189 v LIST OF FIGURES Page Figure 1.1 Microsoft HoloLens ........................................................................................ 5 Figure 3.1 Testing Environment .................................................................................... 35 Figure 3.2 Three-Dimensional Hologram ...................................................................... 39 Figure 3.3 Two-Dimensional Hologram. ....................................................................... 39 Figure 4.1 Age of Participants. ...................................................................................... 43 Figure 4.2 Previous Use of Augmented Reality. ........................................................... 44 Figure 4.3 Gesture Type Questions 1 - 6 ...................................................................... 53 Figure 4.4 Coded Gestural Influence, Question 1, Scenario 1. ...................................... 60 Figure 4.5 Coded Gestural Influence, Question 2-4, Scenario 2 ................................... 61 Figure 4.6 Coded Gestural Influence, Question 5 & 6, Scenario