Decoding Upper-Limb Kinematics from Electrocorticography

Total Page:16

File Type:pdf, Size:1020Kb

Decoding Upper-Limb Kinematics from Electrocorticography Decoding Upper-Limb Kinematics from Electrocorticography Ewan Scott Nurse ORCID: 0000-0001-8981-0074 Submitted in partial fulfillment of the requirements of the degree of Doctor of Philosophy (with coursework component) December 2017 Department of Biomedical Engineering Melbourne School of Engineering The University of Melbourne Abstract Brain-computer interfaces (BCIs) are technologies for assisting individuals with motor impairments. Activity from the brain is recorded and then processed by a computer to control assistive devices. The prominent method for recording neural activity uses microelectrodes that penetrate the cortex to record from localized populations of neurons. This causes a severe inflammatory response, making this method unsuitable after approximately 1-2 years. Electrocorticog- raphy (ECoG), a method of recording potentials from the cortical surface, is a prudent alternative that shows promise as the basis of a clinically viable BCI. This thesis investigates aspects of ECoG relevant to the translation of BCI devices: signal longevity, motor information encoding, and decoding intended movement. Data was assessed from a first-in-human ECoG device trial to quantify changes in ECoG over multiple years. The mean power, calculated daily, was steady for all patients. It was demonstrated that the device could consistently record ECoG signal statistically distinct from noise up to approximately 100 Hz for the duration of the study. Therefore, long-term implanted ECoG can be expected to record movement-related high-gamma signals from humans for many years without deterioration of signal. ECoG was recorded from patients undertaking a two-dimensional center- out task. This data was used to generate encoder-decoder directional tuning models to describe and predict arm movement direction from ECoG. All four patients demonstrated channels that were significantly tuned to the direction of motion. Significant tuning was found across the cortex and was not fo- cused on primary motor areas. Decoding significantly above chance with a population-vector approach was achieved in three of the four patients. Decod- ing accuracy was significantly improved by weighting the population vector by each channel's tuning signal-to-noise ratio. Hence, directional tuning exists in i ii high-frequency ECoG during movement preparation, and movement angle can be decoded using population vector methods. Having confirmed the existence of direction-related information in the recorded data, artificial neural network models were created to decode intended move- ment direction. A convolutional neural network (CNN) model had significantly higher decoding accuracy than a fully connected model for all four patients for decoding movement direction. Training models on data from all patients and testing on a single patient improved decoding performance for all but the best performing patient with the CNN model. Decoding using data from multiple time-points with a CNN model and averaging the results boosted accuracy when using the mode of the outputs. Overall, it was demonstrated that ar- tificial neural network models can decode intended movement direction from ECoG recordings of a two-dimensional center-out task. This thesis presents results that demonstrate ECoG has the desired signal properties for a clinically-relevant BCI. ECoG is shown to be robust over mul- tiple years, encode direction-related information and can be decoded with high accuracy. Declaration I hereby declare that this thesis comprises only my original work towards the degree of Doctor of Philosophy at the University of Melbourne. All work included in this thesis, except where acknowledged in the Statement of Au- thorship, is my original work. All other work has been duly acknowledged. This thesis is fewer than the maximum word limit of 100,000 words exclu- sive of tables, figures, bibliographies and appendices. Signed: Ewan Nurse December 2017 iii Statement of Authorship I hereby declare that this thesis and the work presented in it are original and generated by me as the result of my own investigations. Except where acknowledged below, I was responsible for the experimental design, data col- lection, data analysis, software programming, and generation of images and graphical data. The data analyzed in Chapter 2 was collected as part of a first-in-human device trial conducted by NeuroVista Corporation (Seattle, USA) and the Melbourne University Epilepsy Group. This study is presented in Cook et al. (2013) Due to the multidisciplinary nature of clinical neurosciences, it would not have been possible to collect the data, described in Chapter 3 and analyzed in Chapters 4 and 5, if it were not for the contributions detailed below. • Dr. Dean Freestone, Dr. Alan Lai and Mr. Simon Vogrin assisted with center-out task data collection. • A. Prof. Wendyl D'Souza conducted the clinical functional electrical stimulation • Mr. Simon Vogrin supervised the acquisition of all structural imaging and performed the CT-MRI co-registration. iv v The following chapters contain published works that have resulted from the research presented in this thesis. • Chapter 2 is a modified version of the peer-reviewed published article: Nurse, E.S., John, S.E., Freestone, D.R., Oxley, T.J., Ung, H., Berkovic, S. F., O'Brien, T.J., Cook, M.J. and Grayden, D.B., 2017, Consistency of long-term of subdural electrocorticography in humans, IEEE Transactions on Biomedical Engineering, 10.1109/TBME.2017.2768442. This work is also related to the peer-reviewed published article: Ung, H., Baldassano, S.N., Bink, H., Krieger, A.M., Williams, S., Vitale, F., Wu, C., Freestone, D., Nurse, E., Leyde, K., Davis, K.A., Cook, M. and Litt, B. 2017. Intracranial EEG fluctuates over months after implanting electrodes in human brain. Journal of Neural Engineering, 14(5), p.056011. • Chapter 4 is modified version of the peer-reviewed published article: Nurse, E.S., Freestone, D.R., Oxley, T.J., Ackland, D.C., Vo- grin, S.J., Murphy, M., O'Brien, T.J., Cook, M.J. and Grayden, D.B., 2015, Movement related directional tuning from broadband electrocorticography in humans. In 7th International IEEE/EMBS Conference on Neural Engineering (NER), 22-24 April 2015, (pp. 33-36). • Chapter 5 has been influenced by the following peer-reviewed published articles: Kiral-Kornek, I., Mendis, D., Nurse, E.S., Mashford, B.S., Free- stone, D.R., Grayden, D.B. and Harrer, S., 2017, TrueNorth-enabled real-time classification of EEG data for brain-computer interfacing. In 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 11-15 July 2017, (pp. 1648-1651). vi Nurse, E., Mashford, B.S., Yepes, A.J., Kiral-Kornek, I., Harrer, S. and Freestone, D.R., 2016, Decoding EEG and LFP signals us- ing deep learning: heading TrueNorth. In Proceedings of the ACM International Conference on Computing Frontiers, 16-18 May 2016, (pp. 259-266). Nurse, E.S., Karoly, P.J., Grayden, D.B. and Freestone, D.R., 2015. A generalizable brain-computer interface (bci) using machine learning for feature discovery. PloS One, 10(6), p.e0131328. • A number of conference abstracts have also been published: Nurse, E.S., John, S.E., Freestone, D.R., O'Brien, T.J., Cook, M.J. and Grayden, D.B., Reliability of Long-Term of Subdural Elec- trocorticography in Humans, International Conference on Medical Bionics, 20 - 23 November, 2016. Nurse, E.S., John, S.E., Freestone, D.R., O'Brien, T.J., Cook, M.J. and Grayden, D.B., Spectral features in long-term ambulatory electrocorticography, Melbourne Symposium on Brain Computer In- terfaces and Rehabilitation, 9 October, 2015. Nurse, E.S., John, S.E., Freestone, D.R., O'Brien, T.J., Cook, M.J. and Grayden, D.B., Long-term spectral properties of human electrocorticography, NeuroEng - the Australiasian Workshop on Computational Neuroscience, 26 - 28 August, 2015. Nurse, E.S., Oxley, T.J., Freestone, D.R., Vogrin, S., Murphy, M., Morokoff, A., O'Brien, T.J., Cook, M. J, and Grayden, D.B., Cortically localised directional tuning of arm movements: recording during ECoG monitoring, Annual Meeting of Epilepsy Melbourne, 17 - 18 September, 2014. Acknowledgements It is my pleasure to thank those who have made this thesis possible. Thank you all for your time, encouragement, thoughts and love: I owe my deepest gratitude to Prof. David Grayden and Dr. Dean Free- stone for introducing me to the field of neural engineering and encouraging me to undertake a PhD. There are too many individual things to thank David for, so I will just say thank you for being such an encouraging and thoughtful su- pervisor. Thank you Dean for being my cheer-leader, for pulling me out of my comfort zone when I needed it, and your down-to-earth style of leadership. My profound thanks to Profs. Mark Cook and Terence O'Brien for the privilege of allowing me to work in a clinical setting and see the most important reason we do neuroscience. It has been an honour to work with people whose careers have touched so many lives. Thanks to Dr. Thomas Oxley for the opportunities you've given me, your energy, and for always having the big picture in mind. Thank you to all my supervisors for their unwavering generosity, support, and patience when I wandered. This project was greatly enriched by the mentorship of Sam John and the other members of the Vascular Bionics Laboratory: Nick, Steve, Gil and Amos. It has been a joy to be involved in such a unique project. I am greatly indebted to my co-workers from the NeuroEngineering Lab- oratory and beyond for their friendship, broad expertise, and advise. This includes: Pip, Tim, Kerry, Shannon, Rob, Isabell, Matias, Yan, Elma, Tania, Daniel, Giulia, Peter, Andre, Kat, Miao, William, Colin, Farhad, Pat and Brayden. The clinical aspects of this work were greatly supported by Simon `Vogs' Vogrin, Alan Lai, Wendyl D'Souza and Linda Seiderer. Thank you for all your vii viii help navigating the `wonderful world of EEG' (a direct and deeply concerning quote from Vogs).
Recommended publications
  • Human Cortical Oscillations: a Neuromagnetic View Through the Skull
    R EVIEW R. Hari and R. Salmelin – Human cortical rhythms VA -IN S I N V Human cortical oscillations: a O E N I neuromagnetic view through the skull M G AG I N Riitta Hari and Riitta Salmelin The mammalian cerebral cortex generates a variety of rhythmic oscillations, detectable directly from the cortex or the scalp. Recent non-invasive recordings from intact humans, by means of neuromagnetometers with large sensor arrays, have shown that several regions of the healthy human cortex have their own intrinsic rhythms, typically 8–40 Hz in frequency, with modality- and frequency-specific reactivity. The conventional hypotheses about the functional significance of brain rhythms extend from epiphenomena to perceptual binding and object segmentation. Recent data indicate that some cortical rhythms can be related to periodic activity of peripheral sensor and effector organs. Trends Neurosci. (1997) 20, 44–49 EURONES IN THE HUMAN BRAIN, especially in signals can be identified easily. By contrast, MEG (and Nthalamic nuclei and in the cerebral cortex, ex- EEG) sensors pick up signals from extensive brain hibit intrinsic oscillations1–3, which probably form the regions, which might be even several centimetres basis for macroscopic rhythms, detectable with electro- away from the sensor. Therefore the sites of active encephalography (EEG) and magnetoencephalography neuronal populations have to be deduced from the (MEG). Analysis of cortical rhythms forms an essential measured signal distribution. Although this ‘inverse part of clinical EEG evaluation, which relies on corre- problem’ does not have a unique solution in the gen- lations between the signal phenomenology and brain eral case6,9, modelling the generators of MEG signals as disorders.
    [Show full text]
  • Brain Activity Relating to the Contingent Negative Variation: an Fmri Investigation
    www.elsevier.com/locate/ynimg NeuroImage 21 (2004) 1232–1241 Brain activity relating to the contingent negative variation: an fMRI investigation Y. Nagai,a,* H.D. Critchley,b E. Featherstone,b P.B.C. Fenwick,c M.R. Trimble,a and R.J. Dolanb a Institute of Neurology, Department of Clinical and Experimental Epilepsy, London WC1N 3BG, UK b Wellcome Department of Imaging Neuroscience, Institute of Neurology, UCL, London WC1N 3BG, UK c Institute of Psychiatry, KCL, London SE5 8AF GB, UK Received 6 May 2003; revised 30 October 2003; accepted 31 October 2003 The contingent negative variation (CNV) is a long-latency electro- and S2) at the vertex, has been termed the ‘‘expectancy wave’’ encephalography (EEG) surface negative potential with cognitive and (Walter et al., 1964). A more general model of the CNVencapsulates motor components, observed during response anticipation. CNV is an a concept of cortical arousal related to anticipatory attention, index of cortical arousal during orienting and attention, yet its preparation, motivation, and information processing (Tecce, 1972). functional neuroanatomical basis is poorly understood. We used Neurophysiological studies indicate that cortical surface-nega- functional magnetic resonance imaging (fMRI) with simultaneous EEG and recording of galvanic skin response (GSR) to investigate tive potentials, such as the CNV, result from depolarization of CNV-related central neural activity and its relationship to peripheral apical dendrites of cortical pyramidal cells by thalamic afferents autonomic arousal. In a group analysis, blood oxygenation level and reflect excitation over an extended cortical area (Birbaumer et dependent (BOLD) activity during the period of CNV generation was al., 1990).
    [Show full text]
  • Electroencephalographic Correlates of Temporal Bayesian Belief Updating and Surprise
    Electroencephalographic Correlates of Temporal Bayesian Belief Updating and Surprise a,b,* a b,c d c,e Antonino Visalli , Mariagrazia Capizzi , Ettore Ambrosini , Bruno Kopp , Antonino Vallesi a Department of Neuroscience, University of Padova, 35128 Padova, Italy b Department of General Psychology, University of Padova, 35131 Padova, Italy c Department of Neuroscience & Padova Neuroscience Center, University of Padova, 35131 Padova, Italy d Department of Neurology, Hannover Medical School, 30625 Hannover, Germany e Brain Imaging and Neural Dynamics Research Group, IRCCS San Camillo Hospital, 30126 Venice, Italy *Address for correspondence: Antonino Visalli Department of Neuroscience, University of Padova Via Giustiniani 5, 35128 Padova, Italy Phone number: (+39) 049 8214450 Email: [email protected] 1 Abstract The brain predicts the timing of forthcoming events to optimize responses to them. Temporal predictions have been formalized in terms of the hazard function, which integrates prior beliefs on the likely timing of stimulus occurrence with information conveyed by the passage of time. However, how the human brain updates prior temporal beliefs is still elusive. Here we investigated electroencephalographic (EEG) signatures associated with Bayes-optimal updating of temporal beliefs. Given that updating usually occurs in response to surprising events, we sought to disentangle EEG correlates of updating from those associated with surprise. Twenty-siX participants performed a temporal foreperiod task, which comprised a subset of surprising events not eliciting updating. EEG data were analyzed through a regression-based massive approach in the electrode and source space. Distinct late positive, centro-parietally distributed, event-related potentials (ERPs) were associated with surprise and belief updating in the electrode space.
    [Show full text]
  • Readiness Potentials Driven by Non-Motoric Processes ⇑ Prescott Alexander A,1, , Alexander Schlegel A,1, Walter Sinnott-Armstrong B, Adina L
    Consciousness and Cognition 39 (2016) 38–47 Contents lists available at ScienceDirect Consciousness and Cognition journal homepage: www.elsevier.com/locate/concog Readiness potentials driven by non-motoric processes ⇑ Prescott Alexander a,1, , Alexander Schlegel a,1, Walter Sinnott-Armstrong b, Adina L. Roskies c, Thalia Wheatley a, Peter Ulric Tse a a Department of Psychological and Brain Sciences, Dartmouth College, HB 6207 Moore Hall, Hanover, NH 03755, USA b Philosophy Department and Kenan Institute for Ethics, Duke University, Box 90432, Durham, NC 27708, USA c Department of Philosophy, Dartmouth College, HB 6035 Thornton Hall, Hanover, NH 03755, USA article info abstract Article history: An increase in brain activity known as the ‘‘readiness potential” (RP) can be seen over cen- Received 14 June 2015 tral scalp locations in the seconds leading up to a volitionally timed movement. This activ- Revised 9 November 2015 ity precedes awareness of the ensuing movement by as much as two seconds and has been Accepted 24 November 2015 hypothesized to reflect preconscious planning and/or preparation of the movement. Using Available online 9 December 2015 a novel experimental design, we teased apart the relative contribution of motor-related and non-motor-related processes to the RP. The results of our experiment reveal that Keywords: robust RPs occured in the absence of movement and that motor-related processes did Readiness potential not significantly modulate the RP. This suggests that the RP measured here is unlikely to Volition Libet reflect preconscious motor planning or preparation of an ensuing movement, and instead Consciousness may reflect decision-related or anticipatory processes that are non-motoric in nature.
    [Show full text]
  • Magnetoencephalographic Representation of the Sensorimotor
    1649 J Neurol Neurosurg Psychiatry: first published as 10.1136/jnnp.74.12.1649 on 24 November 2003. Downloaded from PAPER Magnetoencephalographic representation of the sensorimotor hand area in cases of intracerebral tumour M Oishi, M Fukuda, S Kameyama, T Kawaguchi, H Masuda, R Tanaka ............................................................................................................................... J Neurol Neurosurg Psychiatry 2003;74:1649–1654 Objective: To assess the clinical value of magnetoencephalography (MEG) in localising the primary hand motor area and evaluating cortical distortion of the sensorimotor cortices in patients with intracerebral tumour. Methods: 10 normal volunteers (controls) and 14 patients with an intracerebral tumour located around the central region were studied. Somatosensory evoked magnetic fields (SEFs) following median nerve stimulation, and movement related cerebral magnetic fields (MRCFs) following index finger extension, were measured in all subjects and analysed by the equivalent current dipole (ECD) method to ascertain the See end of article for authors’ affiliations neuronal sources of the primary sensory and motor components (N20m and MF, respectively). These ECD ....................... locations were defined as the primary hand sensory and motor areas and the positional relations between these two functional areas in controls and patients were investigated. Correspondence to: Dr M Oishi, Department of Results: The standard range of ECD locations of MF to N20m was determined in controls. In 11 of the 14 Neurosurgery, National patients, MRCFs could identify the primary motor hand area. ECD locations of MF were significantly closer Nishi-Niigata Central to the N20m in the medial-lateral direction in patients than in controls. In patients with a tumour located Hospital, 1-14-1 Masago, Niigata 950-2085, Japan; below the sensorimotor hand area, relative ECD locations of MF to N20m moved anteriorly over the [email protected] standard range determined in the control subjects.
    [Show full text]
  • Analysis of a Choice-Reaction Task Yields a New Interpretation of Libet's Experiments ⁎ Christoph S
    Available online at www.sciencedirect.com International Journal of Psychophysiology 67 (2008) 151–157 www.elsevier.com/locate/ijpsycho Fast track report Analysis of a choice-reaction task yields a new interpretation of Libet's experiments ⁎ Christoph S. Herrmann a,b,e, , Michael Pauen b,d,f, Byoung-Kyong Min a, Niko A. Busch a, Jochem W. Rieger c a Otto-von-Guericke-University, Dept. for Biological Psychology, Magdeburg, Germany b Center for Behavioural Brain Sciences, Magdeburg, Germany c Otto-von-Guericke-University, Dept., for Neurology II, Magdeburg, Germany d Humboldt-University, Institute for Philosophy, Berlin, Germany e Max Planck Institute for Human Cognitive and Brain Science, Leipzig, Germany f Berlin School of Mind and Brain, Germany Received 23 March 2007; received in revised form 11 October 2007; accepted 15 October 2007 Available online 22 November 2007 Abstract Benjamin Libet has demonstrated that the readiness potential precedes the time at which participants consciously decide to perform an intentional motor act, and suggested that free will is an illusion. We performed an experiment where participants observed a stimulus on a computer monitor and were instructed to press one of two buttons, depending on the presented stimulus. We found neural activity preceding the motor response, similar to Libet's experiments. However, this activity was already present prior to stimulus presentation, and thus before participants could decide which button to press. Therefore, we argue that this activity does not specifically determine behaviour. Instead, it may reflect a general expectation. This interpretation would not interfere with the notion of free will. © 2007 Elsevier B.V.
    [Show full text]
  • A Neural Precursor of the Decision to Withhold Action
    Veto and Vacillation: A Neural Precursor of the Decision to Withhold Action Erman Misirlisoy and Patrick Haggard Downloaded from http://mitprc.silverchair.com/jocn/article-pdf/26/2/296/1780468/jocn_a_00479.pdf by MIT Libraries user on 17 May 2021 Abstract ■ The capacity to inhibit a planned action gives human behavior voluntary omission but not a rule-based omission. We also used its characteristic flexibility. How this mechanism operates and the regular temporal pattern of the action sequences to explore what factors influence a decision to act or not act remain relatively brain processes linked to omitting an action by time-locking EEG unexplored. We used EEG readiness potentials (RPs) to examine averagestotheinferredtimewhenanactionwouldhaveoc- preparatory activity before each action of an ongoing sequence, in curred had it not been omitted. When omissions were instructed which one action was occasionally omitted. We compared RPs be- by a rule, there was a negative-going trend in the EEG, recalling tween sequences in which omissions were instructed by a rule the rising ramp of an RP. No such component was found for (e.g., “omit every fourth action”) and sequences in which the voluntary omissions. The results are consistent with a model in participant themselves freely decided which action to omit. RP which spontaneously fluctuating activity in motor areas of the amplitude was reduced for actions that immediately preceded a brain could bias “free” decisions to act or not. ■ INTRODUCTION with anterior areas generating abstract aspects of a plan In everyday life, our initial impulses do not always produce and posterior motor areas executing them or generating optimal actions.
    [Show full text]
  • Movement-Related Cortical Magnetic Fields Associated with Self-Paced Tongue Protrusion in Humans
    Title Movement-related cortical magnetic fields associated with self-paced tongue protrusion in humans Author(s) Maezawa, Hitoshi; Oguma, Hidetoshi; Hirai, Yoshiyuki; Hisadome, Kazunari; Shiraishi, Hideaki; Funahashi, Makoto Neuroscience Research, 117, 22-27 Citation https://doi.org/10.1016/j.neures.2016.11.010 Issue Date 2017-04 Doc URL http://hdl.handle.net/2115/68828 © 2017. This manuscript version is made available under the CC-BY-NC-ND 4.0 license Rights http://creativecommons.org/licenses/by-nc-nd/4.0/ Rights(URL) http://creativecommons.org/licenses/by-nc-nd/4.0/ Type article (author version) File Information Manuscript.pdf Instructions for use Hokkaido University Collection of Scholarly and Academic Papers : HUSCAP Movement-related cortical magnetic fields associated with self-paced tongue protrusion in humans Hitoshi Maezawaa,*, Hidetoshi Ogumab, Yoshiyuki Hiraia, Kazunari Hisadomea, Hideaki Shiraishic, Makoto Funahashia aDepartment of Oral Physiology, Graduate School of Dental Medicine, Hokkaido University, Kita-ku, Sapporo, Hokkaido 060-8586, Japan bSchool of Dental Medicine, Hokkaido University, Kita-ku, Sapporo, Hokkaido 060-8586, Japan cDepartment of Pediatrics, Graduate School of Medicine, Hokkaido University, Kita-ku, Sapporo 060-8638, Japan *Corresponding author: Hitoshi Maezawa, DDS, PhD Address: Department of Oral Physiology, Graduate School of Dental Medicine, Hokkaido University, Kita-ku, Sapporo, Hokkaido 060-8586, Japan TEL: 81-11-706-4229; FAX: 81-11-706-4229 E-mail: [email protected] Short title: Readiness
    [Show full text]
  • 1 Event-Related Brain Potentials: an Introduction Michael G
    1 Event-related brain potentials: an introduction Michael G . H. Coles and Michael D . Rugg 1.1 INTRODUCTION This book is concerned with the intersection of two research areas: event-related brain potentials (ERPs) and cognitive psychology. In particular, we will be considering what has been learned and what might be learned about human cognitive func- tion by measuring the .electrical activity of the brain through electrodes placed on the scalp. In this first chapter we focus on the methodology of ERP research and on the problem of isolating ERP components, while in Chapter 2 we review issues that arise in making inferences from ERPs about cognition. We begin by considering how an ERP signal is obtained, as well as how such a signal is analysed. We consider at some length the issue of the definition of a component and we provide a brief review of some of the more well-known com- ponents. This latter review is intended to give a historical context for cognitive ERP research and the chapter as a whole should provide the reader with some understanding of the vocabulary of the ERP researcher and the ‘lore’ of the cognitive electrophysiologist. 1.2 ERP RECORDING AND ANALYSIS In this section we review some of the basic facts and concepts germane to ERP record- ing and analysis. (Portions of this section are derived from Coles eta/. (1990); see also Allison et a/. (1986), Nunez (1981), and Picton (1985), for further information.) 1.2.1 Derivation When a pair of electrodes are attached to the surface of the human scalp and connected to a differential amplifier, the output of the amplifier reveals a pattern of variation in voltage over time.
    [Show full text]
  • Timing of Readiness Potentials Reflect a Decision-Making Process in the Human Brain
    bioRxiv preprint doi: https://doi.org/10.1101/338806; this version posted June 4, 2018. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-NC-ND 4.0 International license. Timing of readiness potentials reflect a decision-making process in the human brain 1 2,1 3 1,4 Kitty K. Lui ,​ Michael D. Nunez ,​ Jessica M. Cassidy ,​ Joachim Vandekerckhove ,​ Steven C. ​ ​ ​ ​ 3,5 1,2,* Cramer ,​ Ramesh Srinivasan ​ ​ 1 Department​ of Cognitive Sciences, University of California, Irvine USA 2 Department​ of Biomedical Engineering, University of California, Irvine USA 3 Department​ of Neurology, University of California, Irvine USA 4 Department​ of Statistics, University of California, Irvine USA 5 Department​ of Anatomy & Neurobiology, University of California, Irvine USA * Corresponding​ Author bioRxiv preprint doi: https://doi.org/10.1101/338806; this version posted June 4, 2018. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY-NC-ND 4.0 International license. Abstract Perceptual decision making has several underlying components including stimulus encoding, perceptual categorization, response selection, and response execution. Evidence accumulation is believed to be the underlying mechanism of decision-making and plays a decisive role in determining response time. Previous studies in animals and humans have shown parietal cortex activity that exhibits characteristics of evidence accumulation in tasks requiring difficult perceptual categorization to reach a decision.
    [Show full text]
  • ERP TUTORIAL 1 a Brief Introduction to the Use of Event-Related Potentials
    ERP TUTORIAL 1 A Brief Introduction to the Use of Event-Related Potentials (ERPs) in Studies of Perception and Attention Geoffrey F. Woodman Vanderbilt University Vanderbilt Vision Research Center Center for Integrative and Cognitive Neuroscience Abstract Due to the precise temporal resolution of electrophysiological recordings, the event-related potential (ERP) technique has proven particularly valuable for testing theories of perception and attention. Here, I provide a brief tutorial of the ERP technique for consumers of such research and those considering the use of human electrophysiology in their own work. My discussion begins with the basics regarding what brain activity ERPs measure and why they are well suited to reveal critical aspects of perceptual processing, attentional selection, and cognition that are unobservable with behavioral methods alone. I then review a number of important methodological issues and often forgotten facts that should be considered when evaluating or planning ERP experiments. Electroencephalogram (EEG) technique continue to make it one of the most recordings were the first method developed for widely used methods to study the architecture direct and noninvasive measurements brain of cognitive processing. activity from human subjects (Adrian & The primary goal of this tutorial is to Yamagiwa, 1935; Berger, 1929; Jasper, 1937, introduce researchers who are unfamiliar with 1948). By noting when stimuli were presented ERPs to their use, interpretation, and and tasks were performed, early studies dissemination in studies of sensation, examining the raw EEG sought to characterize perception, attention, and cognition. I hope the changes in the state of electrical activity that the uninitiated readers will become better during sensory processing and the consumers of ERP research.
    [Show full text]
  • The Brain, Explained’: a Response Process Theory of Brain Function
    Preprints (www.preprints.org) | NOT PEER-REVIEWED | Posted: 7 June 2018 doi:10.20944/preprints201806.0092.v1 Short Version of ‘The Brain, Explained’: A Response Process Theory of Brain Function Ari Rappoport The Hebrew University of Jerusalem, Israel [email protected] www.cs.huji.ac.il/~arir Abstract Understanding brain function is one of the most important open problems in science today. At present, there is no concrete theory for how the brain works. Here, a the- ory is presented that provides a detailed mechanistic biological account of the brain’s capacities. Brain function is managed by a response (R) process that is structurally similar to the immune response, and shows anatomical and molecular specificity. Dif- ferent R process stages utilize different cortical layers, hippocampus fields, basal gan- glia paths, GABAergic interneurons, cerebellum paths, and molecular agents such as dopamine, serotonin and opioids. We show how the R process supports hierarchical action sequences, language and thought. The theory is supported by a large body of experimental evidence in many modalities, and accounts for virtually all of the major facts known about the brain at the system level. Keywords. Neuroscience, basal ganglia, cortical layers, cerebellum, habenula, inhi- bition, predictions, dopamine, serotonin, acetylcholine, opioids, mirror neurons, place cells, language, imagery, working memory. 1 Introduction How the brain works is one of the major open problems in science today. Following New- ton, Einstein, Darwin and many others, we understand many aspects of the physical world and life. However, we do not understand how living organisms act and think. These ca- pacities are known to be mediated by the brain, but currently there exists no brain theory or anything close to it [Grillner, 2014], despite the enormous amount of invested research effort.
    [Show full text]