Open Archive Toulouse Archive Ouverte (OATAO ) OATAO is an open access repository that collects the wor of some Toulouse researchers and ma es it freely available over the web where possible. This is a publisher's version published in: https://oatao.univ-toulouse.fr/21820 Official URL : http://doi.org/10.1016/C2016-0-02196-4 To cite this version : Ayaz, Hasan and Dehais, Frédéric Neuroergonomics: the brain at work and in everyday life. (2019) Elsevier. ISBN 9780128119266 Any correspondence concerning this service should be sent to the repository administrator: [email protected] Neuroergonomics This page intentionally left blank Neuroergonomics The Brain at Work and in Everyday Life Edited by Hasan Ayaz Drexel University, Philadelphia, PA, United States Frédéric Dehais ISAE-SUPAERO, Université de Toulouse, Toulouse, France Academic Press is an imprint of Elsevier 125 London Wall, London EC2Y 5AS, United Kingdom 525 B Street, Suite 1650, San Diego, CA 92101, United States 50 Hampshire Street, 5th Floor, Cambridge, MA 02139, United States The Boulevard, Langford Lane, Kidlington, Oxford OX5 1GB, United Kingdom Copyright © 2019 Elsevier Inc. All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or any information storage and retrieval system, without permission in writing from the publisher. Details on how to seek permission, further information about the Publisher’s permissions policies and our arrangements with organizations such as the Copyright Clearance Center and the Copyright Licensing Agency, can be found at our website: www.elsevier.com/permissions. This book and the individual contributions contained in it are protected under copyright by the Publisher (other than as may be noted herein). Notices Knowledge and best practice in this field are constantly changing. As new research and experience broaden our understanding, changes in research methods, professional practices, or medical treatment may become necessary. Practitioners and researchers must always rely on their own experience and knowledge in evaluating and using any information, methods, compounds, or experiments described herein. In using such information or methods they should be mindful of their own safety and the safety of others, including parties for whom they have a professional responsibility. To the fullest extent of the law, neither the Publisher nor the authors, contributors, or editors, assume any liability for any injury and/or damage to persons or property as a matter of products liability, negligence or otherwise, or from any use or operation of any methods, products, instructions, or ideas contained in the material herein. Library of Congress Cataloging-in-Publication Data A catalog record for this book is available from the Library of Congress British Library Cataloguing-in-Publication Data A catalogue record for this book is available from the British Library ISBN: 978-0-12-811926-6 For information on all Academic Press publications visit our website at https://www.elsevier.com/books-and-journals Publisher: Nikki Levy Acquisition Editor: Natalie Farra Editorial Project Manager: Kathy Padilla Production Project Manager: Poulouse Joseph Designer: Mark Rogers Typeset by TNQ Technologies Dedication This book is dedicated to Professor Raja Parasuraman who unexpectedly passed on March 22, 2015. Raja Parasuraman’s pioneering work led to the emergence of Neuroergonomics as a new scientific field. He made significant contributions to a number of disciplines from human factors to cognitive neuroscience. His early work included important contributions to topics such as vigilance and human interaction with automated systems. He later consolidated his interests in human factors and cognitive neuroscience to develop a new discipline called Neuroergonomics, which he defined as the study of the brain and behavior at work. His advice to young researchers was to be passionate in order to develop theory and knowledge that can guide the design of technologies and environments for people. His legacy, the field of Neuroergonomics, will live on in countless faculties and students whom he advised and inspired with unmatched humility throughout the span of his distinguished career. Raja Parasuraman was an impressive human being, a very kind person, and an absolutely inspiring individual who will be remembered by everyone who had the chance to meet him. This page intentionally left blank Contents List of Contributors xxi 3. The Use of Functional Near-Infrared Spectroscopy in Neuroergonomics Hasan Ayaz, Meltem Izzetoglu, Kurtulus Izzetoglu Section I and Banu Onaral Introduction Introduction 17 Measure 17 Physiological and Physical Principles 17 1. Progress and Direction in Processing 18 Neuroergonomics Motion Artifacts 18 Frédéric Dehais and Hasan Ayaz Superficial Layers 19 Physiological Signals 19 Introduction 3 Analyze 19 Understanding the Brain in Everyday Activities 3 Applications 20 Adapting Interaction 4 Aerospace: Cognitive Workload Assessment Augmenting Cognition 5 of Air Traffic Controllers 20 Conclusion and Future Challenges 5 Aerospace: Expertise Development With Book Organization 5 Piloting Tasks 21 References 6 Healthcare: Cognitive Aging 21 Conclusion 22 References 22 Section II 4. Why is Eye Tracking an Essential Methods Part of Neuroergonomics? 2. The Use of Electroencephalography in Vsevolod Peysakhovich, Frédéric Dehais and Neuroergonomics Andrew T. Duchowski Klaus Gramann and Markus Plank Eye Movements 27 Pupil Diameter 28 Introduction 11 Eye–Computer Interface 28 Physiological Foundation of the EEG 11 References 29 EEG Amplifiers 12 EEG Sensors 12 Signal Processing 13 5. The Use of tDCS and rTMS Data Analysis in the Time Domain—Event- Methods in Neuroergonomics Related Potentials 13 Daniel Callan and Stephane Perrey Data Analysis in the Frequency Domain— Spectral Variations 13 Introduction 31 Applications 14 TMS Principles 31 Summary 14 tDCS Principles 32 References 15 Conclusion 33 References 33 vii viii Contents 6. Transcranial Doppler Sonography 9. Neuroergonomics for Aviation in Neuroergonomics Daniel E. Callan and Frédéric Dehais Tyler H. Shaw, Amanda E. Harwood, Introduction 55 Kelly Satterfield and Victor S. Finomore Challenges 55 TCD Instrumentation and Application 35 Electro-Encephalography 56 TCD and Task Characteristics 36 Functional Near Infra Red Spectroscopy 56 TCD and Supervisory Control 36 Brain Computer Interface and Neuro-Adaptive TCD and Operator Characteristics 37 Technology 57 TCD and the Effects of Operator Experience 38 Neurostimulation 57 TCD and the Effects of Cognitive Aging 38 Conclusion 57 Conclusion 39 References 57 References 40 Further Reading 41 10. MoBI—Mobile Brain/Body Imaging Evelyn Jungnickel, Lukas Gehrke, Marius Klug 7. Brain–Computer Interface and Klaus Gramann Contributions to Neuroergonomics Introduction 59 Fabien Lotte and Raphaëlle N. Roy Physiological Principles 59 Introduction 43 Instrumentation 60 Signal Processing 44 Signal Processing and Analysis Approaches 60 Preprocessing 44 Applications 61 Feature Extraction 44 References 62 Classification 45 Adaptation 45 11. Experiments With Participants: Some Contributions to Neuroergonomics 45 Ethical Considerations Mental States 45 Offline Use: Evaluation 46 Catherine Tessier and Vincent Bonnemains Online Use: Adaptation 46 Introduction 65 Perspectives 46 Who Is Involved in the Experiment? 65 References 46 The Investigator 65 The Participants 65 8. Neuroergonomics of Simulators and Information Given to the Participants 66 Behavioral Research Methods Can the Criteria Really Be Satisfied? 66 To What Extent Is the Participant Informed? 66 Carryl L. Baldwin Potential Benefits and Risks 66 Overview 49 Incidental Findings 67 Simulations and Neuroergonomics 49 Data 67 Advantages 49 Which Data Is Really Necessary? 67 Challenges 49 Personal Data 67 Important Issues 50 Anonymization and Pseudonymization 67 Transfer of Training 50 Data Storage and Access 68 Fidelity 50 Toward Experiment Results Publication 68 Validity 50 Approval by an Ethics Committee 68 Generalizability 50 Conflicts of Interest 68 Part Task 51 More Scientific Integrity Issues 69 Whole Task 51 Conclusion 69 Simulator Sickness 51 Acknowledgments 69 Adaptation Period 52 References 69 Behavioral Research Methods 52 Baseline Performance 52 Control Conditions 52 Conclusion 52 References 53 Contents ix Section III 15. Is Mindfulness Helping the Brain to Neuroadaptive Interfaces and Drive? Insights From Behavioral Data Operator Assessment and Future Directions for Research Emanuelle Reynaud and Jordan Navarro 12. Neural Efficiency and Mental Introduction 93 Workload: Locating the Red Line MMP and Driving 93 Stephen Fairclough, Kate Ewing, Christopher Method 93 Burns and Ute Kreplin Results 94 Discussion 95 Introduction 73 MMP and the Driving Brain 95 Neural Efficiency 73 Rationale 95 Study One 74 Method 96 Study Two 75 Results 96 Summary 76 Discussion 96 References 76 General Discussion and Conclusion 97 References 97 13. Drowsiness Detection During a Driving Task Using fNIRS 16. Tracking Mental Workload by Multimodal Measurements in the Rayyan A. Khan, Noman Naseer and Operating Room Muhammad J. Khan Ahmet Omurtag, Raphaëlle N. Roy, Introduction 79 Frédéric Dehais, Luc Chatty Literature Review 80 and Marc Garbey Methods 80 Support Vector Machine 81 Introduction 99 Linear Discriminant Analysis 82 Methods 100 Results 82 Results 101 Discussion 82 Discussion 102 Conclusion