Aeronautical Decision Making: Experience, Training and Behaviour
Total Page:16
File Type:pdf, Size:1020Kb
Aeronautical decision making: Experience, training and behaviour Richard Batt A thesis submitted for the degree of Doctor of Philosophy at the University of Otago, Dunedin, New Zealand. 1 November 2005 Richard Batt 6 Bishop Place, Melba ACT 2615, Australia. [email protected] [email protected] [email protected] to Lincoln i Abstract Decision making is fundamental to all aspects of flying operations. The results that flow from poor aeronautical decision making can be both swift and devastating. The work of this thesis uses data from a variety of sources to investigate the following aspects of aeronautical decision making; • accident and incident case histories and pilot decision making • case-based versus rule-based pilot decision training • pilot behaviours in the face of adverse weather The first part of thesis uses survey data to gain a better understanding of the role of accident and incident case histories in aviation safety and training. Anecdotal evidence suggests that exposure to case-based information can leave a lasting impression on a pilot and significantly influence their flying behaviour. To investigate this aspect more formally, information was obtained from a survey of 138 pilots. A questionnaire was then distributed to pilots worldwide and responses were received from 409 pilots, from all areas of aviation. The combined experience of pilots who responded was over 700,000 hours flying time. The second part of the thesis uses experimental data to compare the effectiveness of aviation safety training using case-based material or rule- based material. Two experiments were carried out, based on the two areas that account for the majority of fatal general aviation accidents: flight into adverse weather and low flying. A total of 114 participants took part in the experimental studies. The third part of the thesis is based on a set of 491 aviation accident and incident reports drawn from the Australian Transport Safety Bureau occurrence database. The study compares three groups of pilots who differed in their response to adverse weather conditions, as demonstrated by the following behaviours; • VFR flight into IMC • a weather-related precautionary landing • some other significant weather avoidance action A number of common themes emerged from the three parts of the thesis. There is strong support for the importance of case-based material in aviation safety and training. However, the results also suggest that aeronautical decision making can be best understood in terms of a model that combines both case-based and rule-based reasoning. Rule-based material provides a basic framework of standard procedures and recommended practices, particularly for novices, while case-based material adds detail and salience to the framework, particularly in the form of affective markers linked to particular case histories. One important aspect of the results can be summed up by the adage that 'a safe pilot is a proactive pilot'. That is, it is imperative for a pilot to take control of the situation before the situation takes control of them. The results also emphasise the dynamic nature of aeronautical decision making. A pilot may make a series of good decisions, but that is no automatic protection against a subsequent poor decision putting the safety of the flight at risk. Hence, it is critical that a pilot does not fly to the limit of their abilities, or let past success breed complacency. iii Acknowledgements I would like to record my very sincere appreciation to Dr David O’Hare of the Department of Psychology, University of Otago, for his insightful and patient supervision. Thank you, also, to Dr O'Hare and the Department of Psychology for the initial award of a Summer Scholarship that first introduced me to aviation psychology, and to Dunedin, from both of which many things have come. I would also like to acknowledge my mother, Phoebe, for the inspiration that learning is a life-long pursuit. Most importantly, I would like to sincerely thank my wife, Janice, for her continual help, encouragement, and support throughout the project. v Contents Abstract i Acknowledgements iii 1. Introduction 1 1.1. The central nature of decision making 1 1.2. Thesis outline 4 1.2.1. Accident and incident case histories and pilot decision making 5 1.2.2. Case-based versus rule-based pilot decision training 7 1.2.3. Pilot behaviours in the face of adverse weather 7 1.2.4. Outline of literature review 8 1.3. Decision making 10 1.3.1. The ‘analytical’ view of decision making 11 1.3.2. Are humans flawed decision makers? 13 1.3.3. New perspectives in decision making research 18 1.3.4. Decision making as ‘intuition’ 24 1.3.5. Affect and decision making 26 1.3.6. Decision making in complex, dynamic, and time-limited situations 30 1.3.7. Practical aspects of decision making 39 1.4. Expertise 42 1.5. Case-based reasoning 50 1.5.1. The case-based reasoning approach to decision making 51 1.5.2. Applications of case-based systems 57 1.5.3. Hybrid case-based and rule-based systems 59 1.6. Aeronautical decision making 61 1.6.1. Definition of aeronautical decision making 61 1.6.2. Growth in aeronautical decision making research 62 1.6.3. Why aeronautical decision making is important 64 1.6.4. Major themes in aeronautical decision making research 66 1.6.5. Affect and aeronautical decision making 80 1.6.6. The 'ARTFUL' aeronautical decision maker 81 1.7. Weather-related decision making 83 1.7.1. Weather accident statistics 83 1.7.2. Weather-related decision making research 86 1.7.3. A conceptual framework for weather-related decision making 91 Part 1 Occurrence case histories and pilot decision making 95 2. Identifying the effect of case histories on ADM 99 vi 2.1. Survey outline 99 2.2. Survey results 101 2.2.1. Are accident and incident case-histories recalled at critical flight times? 101 2.2.2. Other issues raised in survey responses 122 3. Quantifying the effect of case histories on ADM 129 3.1. Questionnaire outline 129 3.2. Questionnaire results 130 3.2.1. Demographic profile of pilots 130 3.2.2. Flying history and experience 131 3.2.3. Exposure to safety related aviation material 138 3.2.4. Are accident and incident case-histories recalled at critical flight times? 139 3.2.5. Pilots’ beliefs about learning from experience 142 3.2.6. Factors affecting pilots’ beliefs about learning from experience 144 Part 2 Case-based versus rule-based pilot decision training 149 4. When To Turn Back 155 4.1. Method 156 4.1.1. Bad weather flying training material 156 4.1.2. Bad weather flying test material 160 4.1.3. The Icarus flight simulation program 160 4.2. Data analyses 172 4.2.1. Experimental variables 172 4.2.2. Dependent variable - Final cloud 172 4.2.3. Training variables 173 4.2.4. Decision variables 174 4.2.5. Demographic variables 175 4.2.6. Psychological variable 175 4.2.7. Flight performance variables 175 4.2.8. Flight performance group 179 4.3. Results 182 4.3.1. Distribution of final cloud scores 182 4.3.2. The effect of training group on weather-related decision making 183 4.3.3. The effect of training on skilled and attentive participants 184 4.3.4. The effect of training time and training score on weather- related decision making 186 4.3.5. The effect of decision variables on weather-related decision making 186 4.3.6. The effect of demographic variables on weather-related decision making 187 vii 4.3.7. The effect of Need for Cognition score on weather- related decision making 187 4.3.8. Interactions between variables affecting final cloud scores 187 5. How Low To Go 189 5.1. Method 189 5.1.1. Low-flying training material 189 5.1.2. Low flying test material 192 5.1.3. The How Low To Go low-flying decision making scenario 193 5.2. Data analyses 195 5.2.1. Experimental variables 195 5.2.2. Dependent variable - Final altitude 195 5.2.3. Training variables 196 5.2.4. Decision variables 196 5.2.5. Decision group 199 5.2.6. Demographic variables 201 5.2.7. Psychological variable 201 5.3. Results 201 5.3.1. Distribution of final altitude scores 202 5.3.2. The effect of training group on low flying decision making 202 5.3.3. The effect of training for the quick decision group 203 5.3.4. The effect of training time and training score on low flying decision making 205 5.3.5. The effect of demographic variables on low flying decision making 205 5.3.6. The effect of Need for Cognition score on low flying decision making 206 5.3.7. Interactions between variables affecting final altitude scores 206 Part 3 Pilot behaviours in the face of adverse weather 207 6. Identifying pilot weather-related behaviours 211 6.1. Weather-related decision making group dataset 211 6.1.1. The Australian Transport Safety Bureau database 211 6.1.2. Selection of weather-related decision making occurrences 212 6.1.3. VRF into IMC occurrences 216 6.1.4. Precautionary landing occurrences 219 6.1.5. Weather avoidance occurrences 220 6.2. Weather-related decision making group data analyses 222 6.2.1. Occurrence outcome 222 viii 6.2.2. Pilot demographics 227 6.2.3. Operational factors 232 6.2.4. Aircraft characteristics 234 6.2.5. Geographical and environment factors 236 6.2.6.