Single-Pilot Workload Management in Entry-Level Jets
Total Page：16
File Type：pdf, Size：1020Kb
Federal Aviation Administration DOT/FAA/AM-13/17 Office of Aerospace Medicine Washington, DC 20591 Single-Pilot Workload Management in Entry-Level Jets Barbara K. Burian1 Shawn Pruchnicki2 Jason Rogers3 Bonny Christopher2 Kevin Williams3 Evan Silverman2 Gena Drechsler, Andy Mead, Carla Hackworth3 Barry Runnels3 1NASA Ames Research Center Moffett Field, CA 94035 2San Jose State University San Jose, CA 95112 3FAA Civil Aerospace Medical Institute Oklahoma City, OK 73125 September 2013 Final Report NOTICE This document is disseminated under the sponsorship of the U.S. Department of Transportation in the interest of information exchange. The United States Government assumes no liability for the contents thereof. ___________ This publication and all Office of Aerospace Medicine technical reports are available in full-text from the Civil Aerospace Medical Institute’s publications Web site: www.faa.gov/go/oamtechreports Technical Report Documentation Page 1. Report No. 2. Government Accession No. 3. Recipient's Catalog No. DOT/FAA/AM-13/17 4. Title and Subtitle 5. Report Date Single-Pilot Workload Management in Entry-Level Jets September 2013 6. Performing Organization Code 7. Author(s) 8. Performing Organization Report No. Burian BK,1 Pruchnicki S,2 Rogers J,3 Christopher B,2 Williams K,3 Silverman E,2 Drechsler G,3 Mead A,3 Hackworth C,3 Runnels B3 9. Performing Organization Name and Address 10. Work Unit No. (TRAIS) 1 NASA Ames Research Center, Moffett Field, CA 94035 11. Contract or Grant No. 2 San Jose State University, San Jose, CA 95112 3FAA Civil Aerospace Medical Institute, Oklahoma City, OK 73125 12. Sponsoring Agency name and Address Office of Aerospace Medicine 13. Type of Report and Period Covered Federal Aviation Administration 800 Independence Ave., S.W. Washington, DC 20591 14. Sponsoring Agency Code 15. Supplemental Notes Work was accomplished under approved task AM-HRR-521 16. Abstract Researchers from the NASA Ames Flight Cognition Lab and the FAA’s Flight Deck Human Factors Research Laboratory at the Civil Aerospace Medical Institute (CAMI) examined task and workload management by single pilots in Very Light Jets (VLJs), also called Entry-Level Jets (ELJs). Fourteen certificated Cessna Citation Mustang (C510-S) pilots flew an experimental flight with two legs involving high workload management under Instrument Flight Rules (IFR) in a Cessna Citation Mustang ELJ level 5 flight training device at CAMI. Eight of the pilots were Mustang owner-operators, and the other six flew the Citation Mustang as part of their jobs as professional pilots. In addition to the Cessna Citation Mustang simulator, data collection included instantaneous self-assessment of perceived workload, NASA Task Load Index (TLX) workload measures, researcher observations, final debriefing interviews, and three questionnaires: Cockpit Set-up Preferences, Demographics, and Automation Experiences and Perceptions. To facilitate analysis, the major high workload tasks during the cruise portion of flight were grouped into four events. Approximately two-thirds of the tasks within the four events were accomplished by the participants with no difficulties. Though all participants committed a variety of errors during all four high workload events (e.g., readback error, airspeed violation), most errors were not directly related to overall task success. We did find a significant effect on task performance success related to hours of experience only for the first event. We also found that some type of error using the G1000 avionics was at the root of the problem for most participants who had difficulty accomplishing one or more of the tasks. All participants committed a variety of errors during all four high workload events (e.g., readback error, airspeed violation), but most were not directly related to overall task success. Implications of the findings are discussed, and techniques demonstrated by our participants that we have characterized as “best practices” have been identified. Recommended strategies for automation use and countermeasures to task overload and workload breakdowns have also been provided. 17. Key Words 18. Distribution Statement Workload Management, Glass Cockpit Displays, Human Document is available to the public Factors, Single-Pilot Operations, Automation Use, Very through the Internet: www.faa.gov/go/oamtechreports Light Jet, Entry-Level Jet 19. Security Classif. (of this report) 20. Security Classif. (of this page) 21. No. of Pages 22. Price Unclassified Unclassified 127 Form DOT F 1700.7 (8-72) Reproduction of completed page authorized i ACKNOWLEDGMENTS This work was sponsored by the Federal Aviation Administration: AFS-800, Flight Standards Service – General Aviation and Commercial Division, and funded through the Federal Aviation Administration: ANG-C1, Human Factors Division. Early work on the study and scenario design was supported by the Integrated Intelligent Flight Deck Project of NASA’s Aviation Safety Program. As part of this study, we relied on the experience of two air traffic control subject matter experts (SMEs), Art Gilman and Greg Elwood. In addition, we sought guidance during study design and data analysis from our Garmin G1000/Cessna 510 Citation Mustang aircraft pilot SME, Dave Fry. Their expertise contributed greatly to this project. We thank Jerry Ball for programming the scenarios developed by NASA into the Cessna 510 Citation Mustang simulator, assisting with data collection, and trouble-shooting during the experiment. Our appreciation also goes to Kali Holcomb for her support with data collection and working behind the scenes during the experiment. Thank you is also due to Captain Randy Phillips (ret.) and Dr. Lynne Martin, who were centrally involved in the development of earlier versions of the experimental flight scenarios and associated task analyses. We are also grateful for the help extended by Dr. Durand Begault in conducting the voice analyses for this study. Finally, we extend our sincere appreciation to the Cessna Mustang pilots who completed questionnaires and who served as participants in this study. Their desire to further the cause of aviation safety, their willingness to participate, and the insights they so generously shared, were essential to the success of the study. We are very grateful. iii CONTENTS Introduction -----------------------------------------------------------------------------------------------------------------------------------1 Jet Single-Pilot Workload ----------------------------------------------------------------------------------------------------------------1 Approaches to Measuring Workload ---------------------------------------------------------------------------------------------------1 Automation Use ---------------------------------------------------------------------------------------------------------------------------2 The Current Report -----------------------------------------------------------------------------------------------------------------------3 Methods -----------------------------------------------------------------------------------------------------------------------------------------3 Participants ---------------------------------------------------------------------------------------------------------------------------------3 Materials ------------------------------------------------------------------------------------------------------------------------------------3 Design ------------------------------------------------------------------------------------------------------------------------------------ 12 Procedure --------------------------------------------------------------------------------------------------------------------------------- 12 Data Management and Preparation ----------------------------------------------------------------------------------------------------- 13 Simulator Flight Performance Data and Data Extraction ------------------------------------------------------------------------- 13 Graphs ------------------------------------------------------------------------------------------------------------------------------------ 16 Google Earth Plots ---------------------------------------------------------------------------------------------------------------------- 17 Flight Communication Transcription ------------------------------------------------------------------------------------------------ 18 Voice Analysis---------------------------------------------------------------------------------------------------------------------------- 18 Video Data ------------------------------------------------------------------------------------------------------------------------------- 19 Results------------------------------------------------------------------------------------------------------------------------------------------ 20 Participant Demographics ------------------------------------------------------------------------------------------------------------- 20 Autopilot Use During the Experimental Flight ------------------------------------------------------------------------------------- 21 Analysis of Workload and Task Management of Four En Route Events -------------------------------------------------------- 22 Event 1: Interception of the Broadway (BWZ) Radial ---------------------------------------------------------------------------- 22 Event 2: Reroute and Descent to Meet a Crossing Restriction at a Waypoint ------------------------------------------------- 30 Event 3: Expedited Descent ----------------------------------------------------------------------------------------------------------