Dissertations and Theses 12-2019 The Effectiveness of Augmented Reality for Astronauts on Lunar Missions: An Analog Study Godfrey Valencio D’souza Follow this and additional works at: https://commons.erau.edu/edt Part of the Aerospace Engineering Commons This Thesis - Open Access is brought to you for free and open access by Scholarly Commons. It has been accepted for inclusion in Dissertations and Theses by an authorized administrator of Scholarly Commons. For more information, please contact [email protected]. THE EFFECTIVENESS OF AUGMENTED REALITY FOR ASTRONAUTS ON LUNAR MISSIONS: AN ANALOG STUDY By Godfrey Valencio D’souza A Thesis Submitted to the College of Aviation, School of Graduate Studies, in Partial Fulfillment of the Requirements for the Degree of Master of Science in Aeronautics Embry-Riddle Aeronautical University Daytona Beach, Florida December 2019 THE EFFECTIVENESS OF AUGMENTED REALITY FOR ASTRONAUTS ON ii Acknowledgements I would like to sincerely thank Dr. Jennifer Thropp for your immense support during my graduate degree. Thank you for your support and guidance of my project, and for the unfailing patience and understanding as I worked through its entire development. Without your guidance and immense experience, this project would not have turned out to be a success. Thank you to my committee member, Dr. Robert L. Thomas, for your time and dedication to my researcher and the hours you devoted. I could not have accomplished this without you. I am most grateful to my mom and dad, Annie and Peter, for always teaching me to work hard and strive towards excellence in everything I do. Without you, I would not have been where I am today. I also would like to thank Brenna for her constant love, support and inputs throughout the project. Lastly, I would like to God for the gifts of knowledge and understanding, and all the blessings I have received throughout the years of my life here at Embry-Riddle Aeronautical University. iii Abstract Researcher: Godfrey Valencio D’souza Title: THE EFFECTIVENESS OF AUGMENTED REALITY FOR ASTRONAUTS ON LUNAR MISSIONS: AN ANALOG STUDY Institution: Embry-Riddle Aeronautical University Degree: Master of Science in Aeronautics Year: 2019 The uses of augmented reality and head-up displays are becoming more prominent in industries such as aviation, automotive, and medicine. An augmented reality device such as the Microsoft HoloLens can project holograms onto the user’s natural field of view to assist with completion of a variety of tasks. Unfortunately, only a little research and development has begun in the space sector for astronauts using these head-up displays. Future lunar missions could incorporate augmented reality for astronauts to ease task load and improve accuracy. This study evaluated the usability, subjective workload, and task performance of 22 participants using the Microsoft HoloLens to complete tasks that are analogous to those completed by astronauts on a lunar mission, including navigation, rock sample collection, and maintenance tasks. Results from the usability survey, NASA-TLX, and usability interview suggested that augmented reality could support astronaut missions by means of reduced workload and task errors. Usability data information collected from the participants sought to improve on the user interface and confirmed the aforementioned results. The researcher concluded that further research must be conducted to test the development of augmented reality interfaces along with the usability aspect by the National Aeronautics and Space Administration astronauts. iv Table of Contents Page Thesis Review Committee .............................................................................................. ii Acknowledgements ....................................................................................................... iii Abstract .......................................................................................................................... iv List of Tables.................................................................................................................. xi List of Figures ...............................................................................................................xii Chapter I Introduction .............................................................................................. 1 Significance of Study .................................................................... 2 Statement of the Problem .............................................................. 3 Purpose Statement......................................................................... 4 Research Questions ....................................................................... 4 Hypotheses ................................................................................... 5 Delimitations ................................................................................ 6 Limitations and Assumptions ........................................................ 7 Definition of Terms....................................................................... 8 List of Acronyms .......................................................................... 9 II Review of the Relevant Literature........................................................... 11 Augmented Reality ..................................................................... 11 Heads Up/Head-Worn/Head-Mounted Displays .......................... 12 Usability Considerations of Augmented Reality .......................... 12 Integration of Augmented Reality into the Industry ..................... 15 v Microsoft HoloLens .................................................................... 16 Microsoft HoloLens in industrial settings ........................ 16 NASA’s Astronauts ......................................................... 17 Spacesuit systems ............................................................ 18 International Space Station .............................................. 19 Apollo Missions and Astronaut Rock Sample Collection . 19 ISS Tasks ........................................................................ 20 Astronaut Workload ........................................................ 21 Future Lunar Missions ..................................................... 21 NASA and the Microsoft HoloLens ................................. 22 Summary .................................................................................... 24 III Methodology .......................................................................................... 27 Research Approach ..................................................................... 27 Design and Procedures ................................................................ 27 Tools for Development .................................................... 29 Windows 10 OS .............................................................. 29 Unity ............................................................................... 29 Mixed Reality Toolkit ..................................................... 30 Mixed Reality Camera ..................................................... 30 Animated Cursor ............................................................. 31 Gesture (air tap)............................................................... 31 Voice Input...................................................................... 31 Canvas ............................................................................ 32 vi Maintenance Animations ................................................. 32 Vuforia Configuration ..................................................... 33 World Holograms ............................................................ 33 AR UI ............................................................................. 34 Dynamics 365 Remote Assist .......................................... 34 Deploying and Testing the Application ............................ 36 Mission Control ............................................................... 36 HoloLens Familiarization Training .................................. 37 Pre-study Briefing ................................................ 37 HoloLens Training Application ............................ 37 Mission Training .................................................. 38 Astronaut Missions .......................................................... 41 Mission 1 ........................................................................ 41 Maintenance Task ................................................ 41 Navigation and Rock Sample Collection Task ...... 42 Remote Assistance Task ...................................... 42 Mission 2 ........................................................................ 43 Maintenance Task ................................................ 43 Navigation and Rock Sample Collection Task ...... 43 Remote Assistance Task ...................................... 43 Apparatus and Materials.............................................................. 44 Microsoft HoloLens ........................................................ 44 Lunar Environment.......................................................... 45 vii Collection Samples .......................................................... 46 Lunar Base ...................................................................... 47 Lunar Bacteria Filter Component ..................................... 47 Astronaut Tools ............................................................... 48 Population/Sample .....................................................................