I EYE TRACKER ANALYSIS of DRIVER VISUAL FOCUS AREAS at SIMULATED INTERSECTIONS by Jacob Mauk Submitted in Partial Fulfillment Of
Total Page:16
File Type:pdf, Size:1020Kb
EYE TRACKER ANALYSIS OF DRIVER VISUAL FOCUS AREAS AT SIMULATED INTERSECTIONS by Jacob Mauk Submitted in Partial Fulfillment of the Requirements for the Degree of Master of Computing and Information Systems YOUNGSTOWN STATE UNIVERSITY December, 2020 i EYE TRACKER ANALYSIS OF DRIVER VISUAL FOCUS AREAS AT SIMULATED INTERSECTIONS Jake Mauk I hereby release this thesis to the public. I understand that this thesis will be made available from the OhioLINK ETD Center and the Maag Library Circulation Desk for public access. I also authorize the University or other individuals to make copies of this thesis as needed for scholarly research. Signature: ____________________________________ Jacob Mauk, Student Date Approvals: __________________________________ John Sullins, Thesis Advisor Date __________________________________ Alina Lazar, Committee Member Date __________________________________ Abdu Arslanyilmaz, Committee Member Date __________________________________ Dr. Salvatore A. Sanders, Dean of Graduate Studies Date ii Abstract Automobiles are rapidly transitioning from a human controlled machine, to a machine that controls itself. With every passing year, new works are published detailing how self-driving vehicles are becoming closer to a reality that we will encounter on our streets. While the technology to get these vehicles has been pushed more, one of the biggest obstacles they face is what actions to take at intersections, where they are faced with traffic signals, cross traffic, cars making turns, and pedestrians. In this thesis, an analysis to determine what areas a human driver focuses on aims to provide insight for a more accurate review of where driver attention is focused. Participants used a driving simulation to drive through several intersections with planned distractions and events at each to record their reactions. The goal of this is to provide more data for a more direct application that involves intersection dangers and driving awareness, such as in self-driving cars. By identifying the areas where a human will focus, a model can use this data for its own observations to make improvements. The results indicated that a driver would tend to focus most of their attention while driving on the road directly in front of them, which may not always be the most efficient way to detect potential problems. iii Acknowledgements First, I would like to thank my family, for helping to support me at the beginning and throughout my time in college so that I could adequately focus on my studies and be where I am now. I would like to thank my advisor Dr. John Sullins, for helping me with scheduling questions throughout both my undergraduate and graduate program, as well as being the main source of help for advisement on this thesis. I have to thank all of my friends, from those who directly supported me in times of need, to those who were always by my side for every step along the way, without them I would not be here today. Lastly, I would like to thank the girl from “Lo-fi Hip Hop Radio – Beats to Relax/Study to” for always providing me with a working companion and music to keep me focused during long hours of work. iv TABLE OF CONTENTS LIST OF FIGURES.................................................................................................. vii LIST OF TABLES .................................................................................................... ix CHAPTER 1 INTRODUCTION .......................................................................... 1 1.1 Motivation ....................................................................................................... 2 1.2 Research Questions ........................................................................................... 3 1.3 Contributions ................................................................................................... 4 1.4 Organization .................................................................................................... 5 CHAPTER 2 BACKGROUND AND RELATED WORK .................................... 6 2.1 Eye Tracking Technology ................................................................................. 6 2.2 Autonomous Vehicles ...................................................................................... 7 CHAPTER 3 SOFTWARE AND HARDWARE DESCRIPTION...................... 10 3.1 Eye Tracking Hardware .................................................................................. 10 3.2 Simulation Hardware ...................................................................................... 12 3.3 Simulation Software ....................................................................................... 13 CHAPTER 4 EXPERIMENT METHODOLOGY ............................................. 15 4.1 COVID-19 Safety Precautions ........................................................................ 15 4.2 Simulation Steps ............................................................................................ 16 4.3 Trial Recording .............................................................................................. 16 v 4.4 Scenarios ....................................................................................................... 17 CHAPTER 5 RESULTS ...................................................................................... 28 5.1 Interactions .................................................................................................... 28 5.1.1 Lights ................................................................................................. 29 5.1.1 Pedestrians ......................................................................................... 30 5.1.1 Active Vs. Passive ............................................................................... 31 5.2 Expectations .................................................................................................. 32 5.3 Discussion ..................................................................................................... 34 CHAPTER 6 CONCLUSIONS AND FUTURE WORK .................................... 36 6.1 Conclusions ................................................................................................... 36 6.2 Future Work .................................................................................................. 36 APPENDIX A: STUDY MATERIAL .................................................................... 38 REFERENCES ........................................................................................................ 47 vi LIST OF FIGURES Figure 1. An example of a heatmap ............................................................................ 10 Figure 2. An example of a fixation map....................................................................... 11 Figure 3. The simulator seating and setup.................................................................... 12 Figure 4. Scenario 1 ................................................................................................... 17 Figure 5. Scenario 2 ................................................................................................... 18 Figure 6. Scenario 3 ................................................................................................... 19 Figure 7. Scenario 4 ................................................................................................... 19 Figure 8. Scenario 5 ................................................................................................... 20 Figure 9. Scenario 6 ................................................................................................... 20 Figure 10. Scenario 7.................................................................................................. 21 Figure 11. Scenario 8.................................................................................................. 22 Figure 12. Scenario 9.................................................................................................. 22 Figure 13. Scenario 10................................................................................................ 23 Figure 14. Scenario 11................................................................................................ 24 Figure 15. Scenario 12................................................................................................ 24 Figure 16. Scenario 13................................................................................................ 25 Figure 17. Scenario 14................................................................................................ 26 Figure 18. Scenario 15................................................................................................ 26 Figure 19. The “Jaywalker” Scenario .......................................................................... 31 vii Figure 20. A composite of all users heatmaps ............................................................. 32 Figure 21. User 4’s heatmap ...................................................................................... 33 viii LIST OF TABLES Table 1 A table of overall driver performance at each scenario..................................... 28 ix CHAPTER 1 INTRODUCTION Autonomous driving is an emerging field of technology that has made rapid advancements in recent years, and demand for perfect technology continues to drive it forward. One of the most complex situations for an autonomous vehicle to encounter is an intersection. To “see” the world around them, an