Neuroergonomics Also by Addie Johnson TRAINING for a RAPIDLY CHANGING WORKPLACE: Applications of Psychological Research (Ed
Total Page:16
File Type:pdf, Size:1020Kb
Neuroergonomics Also by Addie Johnson TRAINING FOR A RAPIDLY CHANGING WORKPLACE: Applications of psychological research (ed. with Quiñones, M.). Also by Robert W. Proctor CONTEXTUALISM IN PSYCHOLOGICAL RESEARCH? A critical review (with Capaldi, E. J.) EXPERIMENTAL PSYCHOLOGY (ed. with Healy, A. F.) (1st and 2nd editions). PSYCHOLOGY OF SCIENCE: Implicit and explicit processes (ed. with Capaldi, E. J.). WHY SCIENCE MATTERS: Understanding the methods of psychological research (with Capaldi, E. J.). CULTURAL FACTORS IN SYSTEMS DESIGN: Decision making and action (ed. with Nof, S. & Yih, Y.). ATTENTION (ed. with Read, L. E.). STIMULUS- RESPONSE COMPATIBILITY: An integrated perspective (ed. with Reeve, T. G.). HUMAN FACTORS IN SIMPLE AND COMPLEX SYSTEMS (ed. with Van Zandt, T.). STIMULUS- RESPONSE COMPATIBILITY PRINCIPLES: Data, theory, and application (with Vu, K.-P. L.). HANDBOOK OF HUMAN FACTORS IN WEB DESIGN (ed. with Vu, K.-P. L.) (1st and 2nd editions). Also by Addie Johnson and Robert W. Proctor Theory and practice. SKILL ACQUISITION AND HUMAN PERFORMANCE. Neuroergonomics A Cognitive Neuroscience Approach to Human Factors and Ergonomics Edited by Addie Johnson Psychology Department, University of Groningen, the Netherlands and Robert W. Proctor Department of Psychological Sciences, Purdue University, USA Addie Johnson and Robert W. Proctor © 2013 Individual Chapters © Contributors 2013 Softcover reprint of the hardcover 1st edition 2013 ISBN 978-0-230-29972-6 All rights reserved. No reproduction, copy or transmission of this publication may be made without written permission. No portion of this publication may be reproduced, copied or transmitted save with written permission or in accordance with the provisions of the Copyright, Designs and Patents Act 1988, or under the terms of any licence permitting limited copying issued by the Copyright Licensing Agency, Saffron House, 6–10 Kirby Street, London EC1N 8TS. Any person who does any unauthorized act in relation to this publication may be liable to criminal prosecution and civil claims for damages. The authors have asserted their rights to be identified as the authors of this work in accordance with the Copyright, Designs and Patents Act 1988. First published 2013 by PALGRAVE MACMILLAN Palgrave Macmillan in the UK is an imprint of Macmillan Publishers Limited, registered in England, company number 785998, of Houndmills, Basingstoke, Hampshire RG21 6XS. Palgrave Macmillan in the US is a division of St Martin’s Press LLC, 175 Fifth Avenue, New York, NY 10010. Palgrave Macmillan is the global academic imprint of the above companies and has companies and representatives throughout the world. Palgrave® and Macmillan® are registered trademarks in the United States, the United Kingdom, Europe and other countries. ISBN 978-1-349-33530-5 ISBN 978-1-137-31652-3 (eBook) DOI 10.1057/9781137316523 This book is printed on paper suitable for recycling and made from fully managed and sustained forest sources. Logging, pulping and manufacturing processes are expected to conform to the environmental regulations of the country of origin. A catalogue record for this book is available from the British Library. A catalog record for this book is available from the Library of Congress. 10 9 8 7 6 5 4 3 2 1 22 21 20 19 18 17 16 15 14 13 Contents List of Tables and Figures ix Preface xiii Acknowledgements xiv Notes on Contributors xv List of Abbreviations xviii Prologue xxi 1 The Working Brain 1 Addie Johnson, Jacob Jolij, Raja Parasuraman and Paolo Toffanin Brain structures and networks 4 A default mode of brain function 5 Assessing and influencing brain function 6 TMS and tDCS 6 fNIRS 7 EEG 8 Information processing in the brain 12 Perception 12 Working memory 13 Attention and arousal 15 Decision-making 19 Action and motor control 20 Emotion and social interaction 20 Prediction of prospective activity 22 Direct augmentation of human performance 23 Conclusion 25 2 Cognitive Neuroergonomics of Perception 26 Jacob Jolij, Addie Johnson and Robert W. Proctor Visual processing 29 Top- down and bottom- up processing in perception 32 Learning to see 35 Auditory perception and sonification 38 Touch and the display of haptic information 40 Multimodal perception 43 v vi Contents Perception of space and self 46 Perceptual docking for robotic control 49 Conclusion 50 3 Visual Attention and Display Design 51 Jason S. McCarley and Kelly S. Steelman Modes of orienting 52 Why is mental processing selective? 55 Perceptual selection 56 Central selection 57 Applications to display design 58 Visual search 58 Grouping and object displays 61 Head- up and head- mounted displays 64 Large- scale attention 65 Conclusion 68 4 Attentional Resources and Control 69 Paolo Toffanin and Addie Johnson Quantifying and describing attention 70 Eye movements and pupil diameter 70 EEG 71 Brain networks and fMRI 76 fNIRS 77 Augmented interaction 78 Brain–computer interfaces 79 Adaptive interfaces 82 Augmenting attention and cognition 85 Enhancing attention through training 86 Using drugs to enhance attention 89 Conclusion 90 5 Performance Monitoring and Error- related Brain Activity 91 Addie Johnson and Rasa Gulbinaite Performance monitoring 93 Neural correlates of performance monitoring 96 Error- and feedback- related processing 99 Error prediction 101 Applications based on error- and feedback- related neural signals 103 Maintaining attentional control 104 Contents vii Learning from errors 106 Online classification of feedback processing 108 Conclusion 109 6 Neuroergonomics of Sleep and Alertness 110 Jon Tippin, Nazan Aksan, Jeffrey Dawson and Matthew Rizzo The neurobiology of sleep and alertness 111 Sleepiness, performance and sleepiness countermeasures 111 OSA and driving 114 Effects of disordered sleep on arousal and cognition 115 Self- awareness of sleep impairments 116 Impaired sleep in OSA and PAP treatment 117 Assessing naturalistic driving behaviour in the real world 119 Case study 122 Conclusion 127 7 Affective and Social Neuroergonomics 129 Jacob Jolij and Yana Heussen The neural basis of emotion 130 How emotion guides vision and cognition 133 Reading emotional states 135 The social brain 138 Social human–computer communication and interaction 139 Social robotics 141 Conclusion 143 8 Neuroergonomics of Individual Differences in Cognition: Molecular Genetic Studies 144 Raja Parasuraman Genomics 144 Why look at individual differences? 146 A theoretical framework for the molecular genetics of cognition 150 Visual attention 152 Working memory 154 Decision-making 155 Conclusion 160 9 Validating Models of Complex, Real- life Tasks Using fMRI 163 Jelmer P. Borst, Niels A. Taatgen and Hedderik van Rijn Standard fMRI analysis 164 Cognitive architectures 165 viii Contents Cognitive architectures and fMRI 165 Task and model 167 The task 167 The model 169 ROI analysis 170 Model- based fMRI analysis 174 Applications to task design 176 Conclusion 179 References 181 Subject Index 233 Author Index 239 List of Tables and Figures Tables 1.1 Components of the event- related potentials (ERP), their onset, topography and the functionality they reflect 9 2.1 Guidelines for the design of auditory icons 40 6.1 Substances that affect arousal and sleep, their mechanisms of action and side effects 113 Figures 1.1 The location of some major areas of relevance for information processing in the brain and the areas proposed by Posner and Rothbart (2007) to be involved in alerting, attentional orienting and executive function 15 2.1 A spectrogram of a one- second sound generated by The vOICe. Reprinted with permission (http://www. seeingwithsound.com) 46 3.1 Low display proximity between vertical tape gauges (a) allows an operator to read the value of a single gauge easily, but increases the difficulty of comparing values across the two gauges. High display proximity between the gauges (b) allows for easier comparisons across the gauges but makes the task of isolating and reading a single gauge more difficult 62 4.1 A user interface such as that used by Müller et al. (2008). The image on the left shows the interface as it is displayed when the user ‘moves’ the arrow to selects the hexagon containing the letter ‘I’. The image on the right shows the interface as displayed once the original contents of the hexagons have been replaced by the items in the previously selected hexagon 81 5.1 Conditional accuracy functions in the Eriksen flanker task. As illustrated, reaction times for both fast compatible and incompatible trials are at chance level, which indicates that influence of the flankers is strongest early in the trial and ix x List of Tables and Figures is reduced gradually as attention is focused on the target. [Adapted from Gratton, G., Coles, M. G., Sirevaag, E. J., Eriksen, C. W., & Donchin, E. (1988). Pre- and poststimulus activation of response channels: A psychophysiological analysis. Journal of Experimental Psychology. Human Perception and Performance, 14, 331–344. Used with permission from the American Psychological Association.] 97 5.2 Electroencephalography (EEG) components related to performance monitoring [upper panel: correct- related negativity (CRN) and error- related negativity (ERN); lower panel: feedback- related negativity (FRN)] 101 6.1 Video and electronic data from the black box event recorder. Cameras capture driver behaviour (upper left panel) and forward view of the road (lower left panel; in this case indicating that approach to an intersection where traffic is stopped at a traffic signal). GPS indicates the location of the