Open Archive Toulouse Archive Ouverte (OATAO )

OATAO is an open access repository that collects the work of some Toulouse researchers and makes it freely available over the web where possible.

This is a publisher's version published in: https://oatao.univ-toulouse.fr/21820

Official URL : http://doi.org/10.1016/C2016-0-02196-4

To cite this version :

Ayaz, Hasan and Dehais, Frédéric Neuroergonomics: the brain at work and in everyday life. (2019) Elsevier. ISBN 9780128119266

Any correspondence concerning this service should be sent to the repository administrator: [email protected]

Neuroergonomics This page intentionally left blank

Neuroergonomics The Brain at Work and in Everyday Life

Edited by

Hasan Ayaz Drexel University, Philadelphia, PA, United States

Frédéric Dehais ISAE-SUPAERO, Université de Toulouse, Toulouse, France Academic Press is an imprint of Elsevier 125 London Wall, London EC2Y 5AS, United Kingdom 525 B Street, Suite 1650, San Diego, CA 92101, United States 50 Hampshire Street, 5th Floor, Cambridge, MA 02139, United States The Boulevard, Langford Lane, Kidlington, Oxford OX5 1GB, United Kingdom

Copyright © 2019 Elsevier Inc. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or any information storage and retrieval system, without permission in writing from the publisher. Details on how to seek permission, further information about the Publisher’s permissions policies and our arrangements with organizations such as the Copyright Clearance Center and the Copyright Licensing Agency, can be found at our website: www.elsevier.com/permissions.

This book and the individual contributions contained in it are protected under copyright by the Publisher (other than as may be noted herein).

Notices Knowledge and best practice in this field are constantly changing. As new research and experience broaden our understanding, changes in research methods, professional practices, or medical treatment may become necessary.

Practitioners and researchers must always rely on their own experience and knowledge in evaluating and using any information, methods, compounds, or experiments described herein. In using such information or methods they should be mindful of their own safety and the safety of others, including parties for whom they have a professional responsibility.

To the fullest extent of the law, neither the Publisher nor the authors, contributors, or editors, assume any liability for any injury and/or damage to persons or property as a matter of products liability, negligence or otherwise, or from any use or operation of any methods, products, instructions, or ideas contained in the material herein.

Library of Congress Cataloging-in-Publication Data A catalog record for this book is available from the Library of Congress

British Library Cataloguing-in-Publication Data A catalogue record for this book is available from the British Library

ISBN: 978-0-12-811926-6

For information on all Academic Press publications visit our website at https://www.elsevier.com/books-and-journals

Publisher: Nikki Levy Acquisition Editor: Natalie Farra Editorial Project Manager: Kathy Padilla Production Project Manager: Poulouse Joseph Designer: Mark Rogers

Typeset by TNQ Technologies Dedication

This book is dedicated to Professor Raja Parasuraman who unexpectedly passed on March 22, 2015. Raja Parasuraman’s pioneering work led to the emergence of Neuroergonomics as a new scientific field. He made significant contributions to a number of disciplines from human factors to cognitive . His early work included important contributions to topics such as vigilance and human interaction with automated systems. He later consolidated his interests in human factors and cognitive neuroscience to develop a new discipline called Neuroergonomics, which he defined as the study of the brain and behavior at work. His advice to young researchers was to be passionate in order to develop theory and knowledge that can guide the design of technologies and ­environments for people. His legacy, the field of Neuroergonomics, will live on in countless faculties and students whom he advised and inspired with unmatched humility throughout the span of his distinguished career. Raja Parasuraman was an impressive human being, a very kind person, and an absolutely inspiring individual who will be remembered by everyone who had the chance to meet him. This page intentionally left blank

Contents

List of Contributors xxi 3. The Use of Functional Near-Infrared Spectroscopy in Neuroergonomics Hasan Ayaz, Meltem Izzetoglu, Kurtulus Izzetoglu Section I and Banu Onaral Introduction Introduction 17 Measure 17 1. Progress and Direction in Physiological and Physical Principles 17 Processing 18 Neuroergonomics Motion Artifacts 18 Frédéric Dehais and Hasan Ayaz Superficial Layers 19 Physiological Signals 19 Introduction 3 Analyze 19 Understanding the Brain in Everyday Activities 3 Applications 20 Adapting Interaction 4 Aerospace: Cognitive Workload Assessment Augmenting 5 of Air Traffic Controllers 20 Conclusion and Future Challenges 5 Aerospace: Expertise Development With Book Organization 5 Piloting Tasks 21 References 6 Healthcare: Cognitive Aging 21 Conclusion 22 References 22 Section II 4. Why is Eye Tracking an Essential Methods Part of Neuroergonomics? 2. The Use of in Vsevolod Peysakhovich, Frédéric Dehais and Neuroergonomics Andrew T. Duchowski Klaus Gramann and Markus Plank Eye Movements 27 Pupil Diameter 28 Introduction 11 Eye–Computer Interface 28 Physiological Foundation of the EEG 11 References 29 EEG Amplifiers 12 EEG Sensors 12 Signal Processing 13 5. The Use of tDCS and rTMS Data Analysis in the Time Domain—Event- Methods in Neuroergonomics Related Potentials 13 Daniel Callan and Stephane Perrey Data Analysis in the Frequency Domain— Spectral Variations 13 Introduction 31 Applications 14 TMS Principles 31 Summary 14 tDCS Principles 32 References 15 Conclusion 33 References 33

vii viii Contents

6.  Sonography 9. Neuroergonomics for Aviation in Neuroergonomics Daniel E. Callan and Frédéric Dehais Tyler H. Shaw, Amanda E. Harwood, Introduction 55 Kelly Satterfield and Victor S. Finomore Challenges 55 TCD Instrumentation and Application 35 Electro-Encephalography 56 TCD and Task Characteristics 36 Functional Near Infra Red Spectroscopy 56 TCD and Supervisory Control 36 Brain Computer Interface and Neuro-Adaptive TCD and Operator Characteristics 37 Technology 57 TCD and the Effects of Operator Experience 38 Neurostimulation 57 TCD and the Effects of Cognitive Aging 38 Conclusion 57 Conclusion 39 References 57 References 40 Further Reading 41 10. MoBI—Mobile Brain/Body Imaging 7. Brain–Computer Interface Evelyn Jungnickel, Lukas Gehrke, Marius Klug and Klaus Gramann Contributions to Neuroergonomics Introduction 59 Fabien Lotte and Raphaëlle N. Roy Physiological Principles 59 Introduction 43 Instrumentation 60 Signal Processing 44 Signal Processing and Analysis Approaches 60 Preprocessing 44 Applications 61 Feature Extraction 44 References 62 Classification 45 Adaptation 45 11. Experiments With Participants: Some Contributions to Neuroergonomics 45 Ethical Considerations Mental States 45 Offline Use: Evaluation 46 Catherine Tessier and Vincent Bonnemains Online Use: Adaptation 46 Introduction 65 Perspectives 46 Who Is Involved in the Experiment? 65 References 46 The Investigator 65 The Participants 65 8. Neuroergonomics of Simulators and Information Given to the Participants 66 Behavioral Research Methods Can the Criteria Really Be Satisfied? 66 To What Extent Is the Participant Informed? 66 Carryl L. Baldwin Potential Benefits and Risks 66 Overview 49 Incidental Findings 67 Simulations and Neuroergonomics 49 Data 67 Advantages 49 Which Data Is Really Necessary? 67 Challenges 49 Personal Data 67 Important Issues 50 Anonymization and Pseudonymization 67 Transfer of Training 50 Data Storage and Access 68 Fidelity 50 Toward Experiment Results Publication 68 Validity 50 Approval by an Ethics Committee 68 Generalizability 50 Conflicts of Interest 68 Part Task 51 More Scientific Integrity Issues 69 Whole Task 51 Conclusion 69 Simulator Sickness 51 Acknowledgments 69 Adaptation Period 52 References 69 Behavioral Research Methods 52 Baseline Performance 52 Control Conditions 52 Conclusion 52 References 53 Contents ix

Section III 15. Is Mindfulness Helping the Brain to Neuroadaptive Interfaces and Drive? Insights From Behavioral Data Operator Assessment and Future Directions for Research Emanuelle Reynaud and Jordan Navarro 12. Neural Efficiency and Mental Introduction 93 Workload: Locating the Red Line MMP and Driving 93 Stephen Fairclough, Kate Ewing, Christopher Method 93 Burns and Ute Kreplin Results 94 Discussion 95 Introduction 73 MMP and the Driving Brain 95 Neural Efficiency 73 Rationale 95 Study One 74 Method 96 Study Two 75 Results 96 Summary 76 Discussion 96 References 76 General Discussion and Conclusion 97 References 97 13. Drowsiness Detection During a Driving Task Using fNIRS 16. Tracking Mental Workload by Multimodal Measurements in the Rayyan A. Khan, Noman Naseer and Operating Room Muhammad J. Khan Ahmet Omurtag, Raphaëlle N. Roy, Introduction 79 Frédéric Dehais, Luc Chatty Literature Review 80 and Marc Garbey Methods 80 Support Vector Machine 81 Introduction 99 Linear Discriminant Analysis 82 Methods 100 Results 82 Results 101 Discussion 82 Discussion 102 Conclusion 84 Conclusion 102 References 84 References 102 Further Reading 85 17. Toward Brain-Based Interaction 14. Neural Oscillation Dynamics Between Humans and Technology: of Emerging Interest in Does Age Matter? Neuroergonomics Mathias Vukelić, Kathrin Pollmann and Robert J. Gougelet Matthias Peissner Neuroergonomists Should Know About Introduction 105 Neural Oscillations 87 Methods 105 Neural Oscillation Dynamics of Emerging Participants 105 Interest 87 Experimental Procedure and Data Recording 105 Amplitude, Frequency, and Phase EEG Data Analysis 106 Modulation of Neural Oscillations 87 Results 106 Amplitude, Frequency, and Phase Subjective Ratings 106 Coupling of Neural Oscillations 89 Event-Related Potentials 106 Waveform Shape and Neural Noise 89 Discussion 107 Leveraging Neural Oscillations in Acknowledgments 108 Neuroergonomics 89 References 108 References 90 x Contents

18. Mobile Neuroergonomics: Action, 21. Preliminary Validation of an Adaptive Interfaces, Cognitive Load, and Tactical Training Model: Cognitive Selective Alignment With Performance-Targeted Ryan McKendrick Training Intervention Model Quinn Kennedy, Travis Carlson and Lee Sciarini Action, Environment, and the Brain 111 Action, Technology, and the Brain 113 Introduction 127 Neuroergonomics and Selective Attention 115 Methods 128 Conclusion 115 CAPTTIM Classification 129 References 116 Results 129 Discussion 130 19. Computational Models for Near-Real- Acknowledgments 131 Time Performance Predictions Based on References 131 Physiological Measures of Workload Further Reading 131 Matthias D. Ziegler, Bartlett A. Russell, 22. Neural Efficiency Metrics in Amanda E. Kraft, Michael Krein, Neuroergonomics: Theory and Jon Russo and William D. Casebeer Applications Introduction 117 Adrian Curtin and Hasan Ayaz Methods 118 Participants 118 Introduction 133 Task Design 118 Measuring Neural Correlates of Cognitive Results 119 Load: Electroencephalography 134 Discussion 120 Measuring Neural Correlates of Cognitive Acknowledgments 120 Load: Functional Near-Infrared References 120 Spectroscopy 135 Calculating and Employing Measures of 20. EEG-Based Mental Workload Neural Efficiency 136 Assessment During Real Driving: A Discussion: Application, Challenges, and Taxonomic Tool for Neuroergonomics Limitations 137 in Highly Automated Environments Conclusion 138 References 138 Gianluca Di Flumeri, Gianluca Borghini, Pietro Aricò, Nicolina Sciaraffa, Paola Lanzi, Simone Pozzi, Valeria Vignali, Claudio Lantieri, Arianna Bichicchi, Andrea Simone and Fabio Babiloni Section IV Introduction 121 Neurostimulation Applications Material and Methods 122 Experimental Protocol 122 23. Neuromodulatory Effects of EEG Recording and Processing 123 Transcranial Direct Current Eye Tracking Recording and Processing 123 Stimulation Revealed by Functional Performed Data Analysis 123 Magnetic Resonance Imaging Results 124 Discussion 125 Brian Falcone and Daniel E. Callan Conclusions 125 References 145 Acknowledgments 125 References 125 Contents xi

24. Neurophysiological Correlates of 27. Psychophysical Equivalence of Static tDCS-Induced Modulation of Cortical Versus Dynamic Stimuli in a Two- Sensorimotor Networks: A Simultaneous Alternative Forced-Choice Detection fNIRS–EEG Study Task Makii Muthalib, Pierre Besson, Anirban Dutta, Gabriella M. Hancock Mitsuhiro Hayashibe and Stephane Perrey Introduction 165 Introduction 147 Methods 165 Methods 148 Results 166 Design and Protocol 148 Discussion 166 tDCS 148 References 168 fNIRS 149 EEG 149 28. Functional Near-Infrared Spectroscopy: fNIRS and EEG Analysis 149 Results 149 Proof of Concept for Its Application in Discussion 149 Conclusion 150 Stefano I. Di Domenico, Achala H. Rodrigo, Acknowledgments 150 Mengxi Dong, Marc A. Fournier, Hasan Ayaz, References 150 Richard M. Ryan and Anthony C. Ruocco 25. Opinion: The Use of Online/Offline A Brief Introduction to fNIRS and Its Terminology for Transcranial Direct Potential for Social Neuroscience 169 The Current Study 170 Current Stimulation Can Bring Method 170 Confusion Participants 170 Pierre Besson, Vincent Cabibel, Mark Muthalib Personality Judgment Task 170 fNIRS Procedures and Signal Processing 170 and Stephane Perrey Results 172 Acknowledgments 154 Discussion 172 References 154 References 172

29. Quantifying Brain Hemodynamics Section V During Neuromuscular Fatigue Emerging Applications in Decision- Joohyun Rhee and Ranjana K. Mehta Making, Usability, Trust & Emotions Introduction 175 Methods 175 26. Neural Signatures of Advice Utilization Participants 175 During Human–Machine Agent Procedures 175 Interactions: Functional Magnetic Measurements 176 Resonance Imaging and Effective NIRS Analyses 176 Connectivity Evidence Data Presentation 178 Results and Discussion 179 Kimberly Goodyear and Frank Krueger References 180 Introduction 159 Background 159 30. Web Usability Testing With Concurrent Empirical Evidence 160 fNIRS and Eye Tracking Summary 162 Siddharth Bhatt, Atahan Agrali, Kevin McCarthy, Acknowledgments 163 Rajneesh Suri and Hasan Ayaz References 163 Introduction 181 Methods 182 Results 182 xii Contents

Survey Measures 182 Section VI Behavioral Measures 182 Eye-Tracking Measures 182 Entries From the Inaugural International Neural Measures 184 Neuroergonomics Conference Conclusion 184 References 185 33. Technical Manifestations of the Further Reading 186 Everted Brain: The Impact and Legacy of Raja Parasuraman 31. Hybrid Collaborative Brain–Computer Interfaces to Augment Group Peter A. Hancock Decision-Making Davide Valeriani, Caterina Cinel and Riccardo Poli 34. Can We Trust Autonomous Systems? Peter A. Hancock, Kimberly L. Stowers and Introduction 187 Theresa T. Kessler Methods 187 Participants 187 Aim 199 Experiments 188 Methods 199 Data Recording and Group Decisions 188 Results 199 Results 189 Conclusions 199 Individual Performance 189 Group Performance 189 Conclusions 189 35. Learning and Modulating Spatial Acknowledgments 190 Probabilities in Virtual Environments References 190 Amy L. Holloway, Peter Chapman and Alastair D. Smith 32. How to Recognize Emotions Without Signal Processing: An Application of Background 201 Aims 201 Convolutional Neural Network to Methods 201 Physiological Signals Results and Conclusions 201 Nicolas Martin, Jean-Marc Diverrez, Sonia Em, Study 1 201 Nico Pallamin and Martin Ragot Study 2 201 Study 3 202 Introduction 191 Emotion Recognition 191 36. Physiological Markers for UAV Deep Learning Algorithms 191 Operator Monitoring Deep Learning Applied to Physiological Signals 192 Raphaëlle N. Roy, Thibault Gateau, Angela Bovo, Current Study 192 Frédéric Dehais and Caroline P.C. Chanel Method 192 Aims of This Chapter 203 Results 193 Methods 203 Discussion and Conclusion 193 Futures Work 193 Results 203 Acknowledgments 193 Conclusions 204 References 193 References 204 37. Estimating Cognitive Workload Levels While Driving Using Functional Near- Infrared Spectroscopy (fNIRS) Anirudh Unni, Klas Ihme, Meike Jipp and Jochem W. Rieger Introduction and Aim 205 Methods 205 Results 205 Contents xiii

Discussion and Conclusion 205 Conclusion 213 Acknowledgments 206 References 214 References 206 42. Assessing Driver Frustration Using 38. Auditory Neglect in the Cockpit: Functional Near-Infrared Spectroscopy Using ERPs to Disentangle Early From (fNIRS) Late Processes in the Inattentional Klas Ihme, Anirudh Unni, Jochem W. Rieger and Deafness Phenomenon Meike Jipp Sébastien Scannella, Raphaëlle N. Roy, Introduction and Aim 215 Amine Laouar and Frédéric Dehais Methods 215 Introduction and Aims 207 Results 215 Methods 207 Discussion and Conclusion 215 Results 207 Acknowledgments 216 Discussion and Conclusion 207 Reference 216 References 208 43. The Spatial Release of Cognitive Load in 39. Immediate Effects of Ankle Foot Multi-Talker Situation Orthosis During Gait Initiation: Guillaume Andéol, Clara Suied, Sébastien Impaired Balance Control and Scannella and Frédéric Dehais Change in Ankle Electromyographic Activity Acknowledgments 217 References 217 Arnaud Delafontaine, Jean-Louis Honeine, Manh-Cuong Do and Olivier Gagey 44. Decreased Intra-Hemispheric Prefrontal Aims 209 Connectivity and Impaired Performance Methods 209 After Induction of Cognitive Fatigue Results 209 During a State of Sleep Deprivation. Conclusions 209 An Optical Imaging Study References 209 Guillermo Borragán, Céline Guillaume, 40. Toward a Better Understanding of Hichem Slama, Carlos Guerrero-Mosquera and Philippe Peigneux Human Prioritization. A Dual-Task Study References 219 Benoît Valéry, Nadine Matton, Sébastien Scannella 45. Bright Light Exposure Does Not and Frédéric Dehais Prevent the Deterioration of Alertness Objective 211 Induced by Sustained High Cognitive Background 211 Load Demands Methods 211 Results 211 Guillermo Borragán, Gaétane Deliens, Conclusions 211 Philippe Peigneux and Rachel Leproult Fundings 211 Theoretical Framework and Study Goal 221 References 212 Methods 221 Results 221 41. Assessing Load Discussion and Conclusion 221 in Real Flight Condition With Wireless fNIRS Frédéric Dehais, Hasan Ayaz and Thibault Gateau Introduction and Aims 213 Methods 213 Results 213 xiv Contents

46. A -Based Driver 51. Anticipatory Postural Control of Stability Model for the Design of Driving During Gait Initiation Over Obstacles Assistance Systems of Different Height and Distance Franck Mars and Philippe Chevrel Under Reaction-Time and Self-Initiated Instructions Aims 223 Methods 223 Eric Yiou, Romain Artico, Claudine Teyssedre, Results 223 Ombeline Labaune and Paul Fourcade Conclusions 223 Aims 233 Methods 233 47. Effect of Postural Chain Mobility Results 233 on Body Balance and Motor Conclusions 234 Performance References 234 Alain Hamaoui 52. Effect of Age on Behavioral Performance Aims 225 and Metabolic Brain Activity During Methods 225 Dual-Task Results 225 Conclusions 225 Nounagnon F. Agbangla, Michel Audiffren, References 225 Jean Pylouster and Cédric T. Albinet Aim and Methods 235 48. Effect of Seat and Backrest Sloping on Results 235 the Biomechanical Strain Sustained by Single Task 235 the Body Dual-Task 235 Discussion and Conclusion 235 Nadège Tebbache and Alain Hamaoui References 236 Aims 227 Methods 227 53. Using Machine Learning Algorithms Results 227 to Develop Adaptive Man–Machine Conclusions 227 Interfaces References 227 Dargent Lauren, Branthomme Arnaud, Kou Paul, Girod Hervé and Morellec Olivier 49. Effect of Human Exposure to Whole-Body Vibration in Transport Context 237 Aim 237 Hiba Souissi and Alain Hamaoui Method 237 Aims 229 Expected Results 237 Methods 229 Conclusion 238 Results 229 References 238 Conclusion 229 References 229 54. Link Between Out-of-the-Loop Performance Problem and Mind 50. Electroencephalography (EEG) Activity Wandering: How to Keep the Associated With Manual Lifting Tasks: Operator in the Loop A Neuroergonomics Study Jonas Gouraud, Bruno Berberian and Awad Aljuaid, Waldemar Karwowski, Arnaud Delorme Petros Xanthopoulos and Peter A. Hancock References 239 Contents xv

55. Applied Neuroergonomic: Recent Results 250 Updates From Automotive Industry Discussion and Conclusion 250 Case Studies Reference 250 Ivan Macuzic, Evanthia Giagloglou, 60. Attending to the Auditory Scene Ivana Živanovic-Macuzic and Branislav Jeremic Improves Situational Awareness Aims 241 Menja Scheer, Heinrich H. Bülthoff and Methods 241 Lewis L. Chuang Results and Conclusions 241 Acknowledgments 241 Aim 251 Further Reading 241 Methods 251 Results 251 56. Multi-Brain Computing: BCI Conclusion 251 Monitoring and Real-Time References 252 Decision Making 61. Individual Differences and Detection Anton Nijholt Response Task Reaction Times References 243 Antonia S. Conti, Moritz Späth and Klaus Bengler 57. Toward Mental Workload Aims 253 Measurement Using Multimodal Methods 253 EEG–fNIRS Monitoring Results 253 Conclusions 254 Hubert Banville, Mark Parent, Sébastien Tremblay References 254 and Tiago H. Falk Aims 245 62. Cognitive Components of Path Methods 245 Integration: Implications for Simulator Results 245 Studies of Human Navigation Conclusion 245 Alastair D. Smith and Lydia Dyer Acknowledgments 245 References 246 Aims 255 Method 255 58. The Effects of Transcranial Direct Results 255 Current Stimulation (tDCS) on Conclusions 255 Adapting to Temporal Lag in Virtual Environments 63. Vector-Based Phase Analysis Approach for Initial Dip Detection Hayley Thair and Roger Newport Using HbO and HbR Aims 247 Amad Zafar, Keum-Shik Hong and Methods 247 Muhammad J. Khan Results 247 Conclusions 247 Introduction 257 References 247 Aims 257 Methods 257 59. Why Do Auditory Warnings During Results 257 Steering Allow for Faster Visual Target Conclusions 258 Acknowledgments 258 Recognition? References 258 Christiane Glatz, Heinrich H. Bülthoff and Lewis L. Chuang Introduction and Aim 249 Methods 249 xvi Contents

64. Subjective and Objective 69. Brain–Computer Interface: Analysis Methods to Continuously of Different Virtual Keyboards for Monitor Workload Improving Usability Horia A Maior, Sarah Sharples and Max L. Wilson Liliana Garcia, Véronique Lespinet-Najib, Mathilde Menoret, Bernard Claverie, References 260 Jean M. André and Ricardo Ron-Angevin Further Reading 260 Acknowledgments 269 65. Decision Making and Executive References 270 Functioning in Aortic Valve Resection: About the Design of an Ergonomic 70. A Method for Prediction of Aortic Valve Resection Tool Behavioral Errors From Single-Trial Electrophysiological Data René Patesson and Eric Brangier Hiroki Ora and Yoshihiro Miyake Reference 262 Further Reading 262 Aims 271 Methods 271 66. Short-Duration Affective States Results 271 Induced by Emotional Words Conclusion 271 Improve Response Inhibition: Reference 271 An Event-Related Potential Study 71. Neuro-Functional Correlates of the Magdalena Senderecka, Michal Ociepka, Out-of-the-Loop Performance Magdalena Matyjek and Bartlomiej Kroczek Problem: Impact on Performance Aim 263 Monitoring Method 263 Bertille Somon, Aurélie Campagne, Results 263 Arnaud Delorme and Bruno Berberian Conclusions 263 Acknowledgments 264 Acknowledgments 273 References 264 References 273

67. Predicting Audience Preferences 72. Recent Advances in EEG-Based for Television Advertisements Neuroergonomics for Human– Using Functional Brain Imaging Computer Interaction Atahan Agrali, Siddharth Bhatt, Rajnesh Suri, Jérémy Frey, Martin Hachet and Fabien Lotte Kurtulus Izzetoglu, Banu Onaral and References 275 Hasan Ayaz References 266 73. Attention and Driving Performance Modulations Due 68. When Does the Brain Respond to Anger State: Contribution of to Information During Visual Electroencephalographical Data Scanning? Franck Techer, Christophe Jallais, Yves Nina Flad, Heinrich H. Bülthoff and Corson and Alexandra Fort Lewis L. Chuang References 277 Aims 267 Further Reading 277 Methods 267 Results 267 Conclusion 268 References 268 Contents xvii

74. Development of Intelligent Early 79. Toward an Online Index of the Warning System for Hypoglycemia Attentional Response to Auditory Attacks Alarms in the Cockpit: Is Pupillary Ali Berkol, Emre O. Tartan and Gozde Kara Response Robust Enough? Alexandre Marois, Johnathan Crépeau, Acknowledgments 279 Sébastien Tremblay and François Vachon References 279 Aims 289 75. Out-of-the-loop (OOL) Performance Methods 289 Problem: Characterization and Results 289 Compensation Conclusions 289 References 290 Bruno Berberian Acknowledgments 281 80. Functional of Prefrontal Cortex Activity During 76. The Impact of Visual Scan Strategies on a Problem Solving Versus Motor Active Surveillance Performance: An Task in Children With and Eye-Tracking Study Without Autism Jean-Denis Thériault, Benoit Roberge-Vallières, Nancy Getchell and Ling-Yin Liang Daniel Lafond, Sébastien Tremblay and Aims 291 François Vachon Method 291 Aims 283 Results 291 Methods 283 Conclusions 292 Results 283 Conclusions 284 81. Differential Within and Between Reference 284 Effects on Prefrontal Hemodynamics of fNIRS Guided HD-tDCS 77. Using Neural Correlates for Enhancing Customer Experience Through Effective Ryan McKendrick, Melissa Scheldrup, Visual Price Placement Raja Parasuraman and Hasan Ayaz Rajneesh Suri, Nancy M. Puccinelli, Dhruv Grewal, Anne L. Roggeveen, Atahan Agrali, Hasan Ayaz, 82. Neuroergonomics In Situ: Kurtulus Izzetoglu and Banu Onaral Differentiation Between Naviation Displays References 286 Ryan McKendrick, Raja Parasuraman, Rabia Murtza, 78. Human Decision-Making During Alice Formwalt, Wendy Baccus, Martin Paczynski Crowd Evacuations: The Role of Stress, and Hasan Ayaz Conflicting Information, and Social Interactions 83. Embodied and Situated Cognitive Nikolai W.F. Bode Neuroscience Ryan McKendrick, Ranjana Mehta, Hasan Ayaz, References 287 Melissa Scheldrup and Raja Parasuraman xviii Contents

84. Workload Transition, Cognitive Load 89. Effects of an Acute Social Stressor States, and Adaptive Autonomous on Trustworthiness Judgements, Transportation Physiological and Subjective Measures– Ryan McKendrick Differences Between Civilians and Military Personnel 85. Towards Neuroadaptive Technology: Martijn Bijlsma, Alexander Toet, Helma van den Implicitly Controlling a Cursor Though Berg and Anne-Marie Brouwer a Passive Brain–Computer Interface Aims 309 Methods 309 Thorsten O. Zander, Lauens R. Krol and Results 309 Klaus Gramann Conclusions 310 References 310 86. A Random Practice Schedule Provides Better Retention and Transfer Than 90. Meta-Cognitive Skills Modeling: Blocked When Learning Computer Communication and Reasoning Mazes: Preliminary Results Among Agents Nancy Getchell, Alex Schilder, Emily Wusch and Laurent Chaudron, Hélio Kadogami, Nicolas Maille Amy Trask and Guillaume Roumy Aims 303 Further Reading 311 Method 303 Results 303 91. Assessing Differences in Emotional Conclusions 303 Expressivity Between Expert and Non Expert Video Game Players Using Facial 87. Detection of Mind-Wandering in Electromyography Driving: Contributions of Cardiac Marc-André Bouchard, Jérémy Bergeron-Boucher, Measurement and Eye Movements Cindy Chamberland, Sébastien Tremblay and G. Pepin, S. Malin, J. Navarro, Alexandra Fort, Philip L. Jackson Christophe Jallais and C. Gabaude Aim 313 Acknowledgments 305 Method 313 References 305 Results 313 Conclusion 314 88. Electroencephalography and Eye References 314 Tracking Signatures of Target Encoding During Guided Search 92. Mental Fatigue Assessment in Prolonged BCI Use Through EEG and Anne-Marie Brouwer, Maarten A.J. Hogervorst, fNIRS Bob Oudejans, Anthony J. Ries and Jonathan Touryan Amanda Sargent, Terry Heiman-Patterson, Sara Feldman, Patricia A. Shewokis and Hasan Ayaz Aims 307 Methods 307 References 316 Results 307 Conclusions 308 93. Neuroergonomic Multimodal Acknowledgments 308 Neuroimaging During a Simulated References 308 Aviation Pursuit Task Robert J. Gougelet, Cengiz Terzibas and Daniel E. Callan Aims 317 Methods 317 Results and Conclusions 317 References 318 Contents xix

94. The Use of Neurometric and Biometric 98. EEG and FNIRS Connectivity Features Research Methods in Understanding the for Mental Workload Assessment: A User Experience of First-Time Buyers in Preliminary Study E-Commerce Raphaëlle N. Roy, Alexandre Moly, Frédéric Tuna E. Çakar, Kerem Rızvanoğlu, Özgürol Öztürk Dehais and Sébastien Scannella and Deniz Zengin Çelik Introduction 327 Aim 319 Aims 327 Method 319 Methods 327 Results 319 Results 327 Conclusion 320 Discussion 328 References 320 Reference 328

95. An Applied Driving Evaluation 99. Using Cognitive Models to Understand of Electrodermal Potential as a In-Car Distraction Measurement of Attentional State Christian P. Janssen Bruce Mehler, Ben D. Sawyer, Acknowledgments 329 Tom McWilliams and Bryan Reimer References 329 References 321 100. Concurrent fNIRS and TMS for 96. Applied Potential: Neuroergonomic Neurocognitive Enhancement on a Error Detection in Single Electrode Speed-of-Processing Task Electroencephalography Adrian Curtin, Shanbao Tong, Yingying Tang, Ben D. Sawyer, Waldemar Karwowski, Junfeng Sun, Jijun Wang and Hasan Ayaz Petros Xanthopoulos and Peter A. Hancock References 332 References 324

97. Negative Mood States in Index 333 Neuroergonomics Ahmad Fadzil M. Hani, Ying Xing Feng and Tong Boon Tang Supplementary (Research Framework) 326 References 326

View publication stats