Visualization Methods and User Interface Design Guidelines for Rapid Decision Making in Complex Multi-Task Time-Critical Environments
Total Page:16
File Type:pdf, Size:1020Kb
Wright State University CORE Scholar Browse all Theses and Dissertations Theses and Dissertations 2009 Visualization Methods and User Interface Design Guidelines for Rapid Decision Making in Complex Multi-Task Time-Critical Environments Sriram Mahadevan Wright State University Follow this and additional works at: https://corescholar.libraries.wright.edu/etd_all Part of the Operations Research, Systems Engineering and Industrial Engineering Commons Repository Citation Mahadevan, Sriram, "Visualization Methods and User Interface Design Guidelines for Rapid Decision Making in Complex Multi-Task Time-Critical Environments" (2009). Browse all Theses and Dissertations. 914. https://corescholar.libraries.wright.edu/etd_all/914 This Dissertation is brought to you for free and open access by the Theses and Dissertations at CORE Scholar. It has been accepted for inclusion in Browse all Theses and Dissertations by an authorized administrator of CORE Scholar. For more information, please contact [email protected]. VISUALIZATION METHODS AND USER INTERFACE DESIGN GUIDELINES FOR RAPID DECISION MAKING IN COMPLEX MULTI-TASK TIME-CRITICAL ENVIRONMENTS A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy By SRIRAM MAHADEVAN B.S., University of Madras, 2000 M.S., Wright State University, 2003 2009 Wright State University COPYRIGHT BY SRIRAM MAHADEVAN 2009 WRIGHT STATE UNIVERSITY SCHOOL OF GRADUATE STUDIES 01/21/2009 I HEREBY RECOMMEND THAT THE DISSERTATION PREPARED UNDER MY SUPERVISION BY Sriram Mahadevan ENTITLED Visualization Methods and User Interface Design Guidelines for Rapid Decision Making in Complex Multi-Task Time- Critical Environments BE ACCEPTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF Doctor of Philosophy. Raymond Hill, Ph.D. Dissertation Director Ramana Grandhi, Ph.D. Director, Ph.D. in Engineering Joseph F. Thomas, Jr., Ph.D. Dean, School of Graduate Studies Committee on Final Examination Raymond Hill, Ph.D. Frank W. Ciarallo, Ph.D. Yan Liu, Ph.D. S. Narayanan, Ph.D., P.E. Edward Pohl, Ph.D. Dan Voss, Ph.D. ABSTRACT Mahadevan, Sriram. Ph.D., Engineering Ph.D. Program, Department of Biomedical, Industrial, and Human Factors Engineering, Wright State University, 2009. Visualization Methods and User Interface Design Guidelines for Rapid Decision Making in Complex Multi-Task Time-Critical Environments Real-world scenarios are complex dynamic systems that are often overloaded with information. Effective performance of these dynamic systems depends on the objects in such systems and the relationship among them. The control of many of these systems is semi- automated. Human operators constantly monitor and control these systems, assess the situation and often make decisions under time pressure. However, this supervisory control paradigm in a dual-task environment can be a very challenging task. Existing interface design methodologies and techniques have not delved deeply enough into defining information displays for complex, dynamic, time-critical, dual-task environments with capabilities for rapid task change awareness and task resumption while continuously maintaining situation awareness. This research focuses on designing user displays with advanced cueing techniques to support performance in complex dynamic dual-task environments. A primary question addressed in this study is whether visualization methods such as status-at-a-glance displays, interruption recovery tools, and course of action planning tools would assist in maintaining situation awareness, resuming tasks quickly, and effectively perform decision making tasks. The research examines interface design methods to support supervisory awareness in primary and secondary task situations, rapid assimilation when switching to a secondary task, rapid re-assessment upon return to the primary task or secondary task, a course of action solution explorer for successful mission planning/re-planning, and notification systems such iv as alerts to inform operators about interrupting tasks. This research provides a means to realize an ―at-a-glance‖ decision making environment. The methodology adopted in this research effort used a three-stage process. In stage one, the effect of interruptions on trust and coordination among team members was studied. For stages two and three, the operator tasks and the interface protocols for accomplishing the tasks were designed based on the operator function model. Visual display components were designed to maintain situation awareness, resume the interrupted task scenario quickly, and plan/re-plan course of action for missions and anticipate system status. Multi-modal alert techniques are designed to notify the operator about the interrupting task scenario. The hypotheses related to each stage and the designed components were empirically evaluated using human participants. Results showed that providing an user interface with status-at-a-glance display and interruption recovery tool and other task resumption cues assists the user in maintaining situation awareness and gain change awareness quickly. It was also found that course of action solution exploration tool assists users in quickly designing a feasible course of action and also allows users to re-plan the course of action based on requirements. The use of alerts helps to inform users about a secondary task that would need their attention. A primary contribution from this research is defining a set of user interface design guidelines for use on small screen displays for dual-task supervisory monitoring and control scenarios. Other significant contributions include the design of the status-at-a-glance display, along with the interruption recovery tool, mission planning tool, and the evaluation of alert techniques in such complex, dynamic, time-critical environments. v TABLE OF CONTENTS 1. INTRODUCTION ............................................................................................................ 1 2. RESEARCH BACKGROUND ........................................................................................ 6 2.1 Decision Support Systems (DSS) ............................................................................. 6 2.2 Information Visualization ......................................................................................... 9 2.3 Attention Management............................................................................................ 21 2.4 Information Uncertainty.......................................................................................... 22 2.5 Situation Awareness................................................................................................ 26 2.5.1 Workload............................................................................................................. 29 2.6 Status-at-a-glance display methodology ................................................................. 31 2.7 Mental Simulations ................................................................................................. 33 2.8 Trust ........................................................................................................................ 37 2.9 Interface design in time-critical applications ......................................................... 44 2.10 Studies conducted in dual-task environments ......................................................... 52 2.11 Methodologies for User Interface Design ............................................................... 71 2.11.1 Operator Function Model (OFM) ....................................................................... 72 2.11.2 Direct Manipulation Interfaces ........................................................................... 73 2.11.3 Abstraction Hierarchy (AH) ............................................................................... 79 2.11.4 Ecological Interface Design (EID) ...................................................................... 81 2.11.5 GOMS Model...................................................................................................... 82 2.11.6 Cognitive Task Analysis (CTA) ......................................................................... 83 3. GAPS IN EXISTING KNOWLEDGE ........................................................................... 86 4. RESEARCH METHODOLOGY.................................................................................... 95 4.1 Introduction ............................................................................................................. 95 4.2 Methodology ........................................................................................................... 96 4.3 Research Questions ................................................................................................. 99 4.4 Domain Description .............................................................................................. 101 4.4.1 Sense and Respond Logistics (SRL) ................................................................. 102 4.4.2 Unmanned Aerial Vehicles (UAVs) ................................................................. 103 4.5 Visual Display Guidelines and Visualization Techniques .................................... 109 4.5.1 Initial proposed user interface design guidelines for dynamic dual-tasks ........ 109 4.5.2 Icon Representation .......................................................................................... 111 vi 4.5.3 Status-at-a-glance display ................................................................................