Martina Corazzol Master Thesis

Total Page:16

File Type:pdf, Size:1020Kb

Martina Corazzol Master Thesis Aalborg University, Biomedical Engineering and Informatics, Spring Semester, 2012 Master Thesis "Classification of movements of the rat based on intra-cortical signals using artificial neural network and support vector machine" Martina Corazzol Department of Health Science & Technology Frederik Bajers Vej 7D2 9220 Aalborg Telephone (+45) 9940 9940 Fax (+45) 9815 4008 http://www.hst.aau.dk Title: Synopsis: "Classification of movements of the rat based on intra-cortical signals using artifi- cial neural network and support vector ma- Background chine" The goal of intra-cortical brain computer in- terface (BCI) is to restore the lost function- alities in disabled patients suffering from Project period: severely impaired movements. BCIs have the Master Thesis, Spring 2012 advantage to create a direct communication pathway between the brain and an external Project group: device for restoring disability. This is pos- Group 12gr1085 sible by decoding signals from the primary motor cortex and translating them into com- Members: mands for a prosthetic device. The project Martina Corazzol aim was to develop a decoding method based on a rat model. Previously recorded data and an already develop pre-processing method were used. The experimental design Supervisor: was developed starting from intra-cortical Winnie Jensen (IC) signal recorded in the rat primary mo- tor cortex (M1). The data pre-processing included denoising with wavelet technique, Assistant Supervisor: spike detection, and feature extraction. After Sofyan Hammad Himaidan Hammad the firing rates of intra-cortical neurons were extracted, artificial neural network (ANN) and support vector machine (SVM) were ap- plied to classify the rat movements into two No. printed Copies: 4 possible classes, Hit or No Hit. The misclas- sification error rates obtained from denoised No. of Pages: 73 and not denoised data were statistically dif- No. of Appendix Pages: 27 ferent (p<0.05), proving the efficiency of the denoising technique. ANN and SVM pro- Total no. of pages: 100 vided comparable classification errors, rang- ing between 14% and 39%. Completed: 1st of June 2012 The contents of this report is freely accessible, however publication (with source references) is only allowed upon agreement with the authors. Preface This report has been composed by the project group 12gr1085, during the 4th semester of the Master of Science in Biomedical Engineering and Informatics with speciality in Medical Sys- tems at the Institute for Health Science and Technology at Aalborg University, Denmark. This project is inserted in an ongoing study about decoding algorithm for characterizing and predicting primary motor cortex (M1) responses during a behavioural task. Therefore, the data recorded during the previous study were used in this project to classify the movements of the rat by using artificial neural network and support vector machine. The reference style used in the report is according to the Harvard method [Last name, Year]. The references are indicated before and after a full stop. If a reference is indicated before a full stop it refers only to the sentence, whereas if it stands after a full stop it refers to the entire section. The references listed in succession are arranged by the year starting with the oldest one. Figures and tables are numbered with reference to the chapter e.g. figure 1 in chapter 2 is "Figure 2.1". The captions are set below the figures or tables. I would like to thank my co-supervisor Sofyan Hammad for the data he provides me and for the assistance during the data processing. Moreover, I would like to thank my supervisor Win- nie Jensen for the technical assistance during the project. This report is prepared by: Martina Corazzol 5 Acronyms BCI Brain Computer Interface BMI Brain Machine Interface CNS Central Nervous System ANN Artificial Neural Network SVM Support Vector Machine M1 Primary Motor Cortex S1/S2 Somatosensory Area 1 and 2 PMA Premotor Area, d dorsal and v ventral SMP Supplementary Motor Area RFA Rostral Forelimb Area IC Intra-Cortical Signal CM Corticomotor neurons fMRI Functional Magnetic Resonance Imaging fNIRS Functional Near-Infrared Spectroscopy MEG Magnetoencephalogram EEG Electroencephalogram ECoG Electrocorticogram LFP Local Field Potential SUA Single Unit Activity MUA Multi Units Activity 6 Table Of Contents Table Of Contents 7 Chapter 1 Introduction 11 1.1 Initiating problem formulation . 12 I Problem Analysis 13 Chapter 2 Elements of a BCI 15 2.1 Principal components of a BCI . 15 2.2 The motor cortex . 17 2.2.1 The primary motor cortex . 18 2.2.2 The premotor cortex . 18 2.2.3 The supplementary motor area . 19 2.2.4 Role of the motor cortex in voluntary movement . 20 2.2.5 Area of interest for the implantation . 21 2.3 Data acquisition: recording techniques . 22 2.3.1 Non-invasive techniques . 22 2.3.2 Invasive techniques . 23 2.4 Neural coding principles and parameter extraction . 24 2.4.1 Single-unit and multi-unit recordings . 24 2.5 External devices and classification . 26 2.5.1 Previous animal experiments . 26 2.5.2 Primates . 26 2.5.3 Rodents . 28 2.5.4 Prediction algorithms . 29 2.6 Feedback and plasticity . 30 2.6.1 Motor imagery . 30 2.6.2 Plasticity . 30 2.7 The rat as a model . 30 2.7.1 Cortical organization in the rat . 31 2.7.2 The motor cortex of the rat . 31 2.7.3 Impairments . 33 2.7.4 Reaching Movement . 33 2.8 Summary of the problem analysis . 33 Chapter 3 Problem Formulation 35 3.1 Problem formulation . 35 7 3.2 Limitations . 35 3.2.1 Development of a real time algorithm and external control device . 35 3.3 Solution strategy . 35 II Problem Solution 37 Chapter 4 Experimental Protocol 39 4.1 Behavioural training . 39 4.2 Materials . 40 4.3 Experimental setup . 40 4.4 Implant procedure . 41 4.5 Recordings . 42 4.6 Good channels detection . 43 Chapter 5 Data Analysis 45 5.1 Data processing algorithm . 45 5.2 Time windows: Hit and NoHit data . 45 5.3 Denoising . 46 5.4 Spike detection . 47 5.5 Feature extraction . 48 5.6 Artificial neural network design . 49 5.6.1 Input vector and target vector . 49 5.6.2 Built the network . 50 5.6.3 Dividing the data . 52 5.6.4 Training the network . 53 5.6.5 Number of neurons in the hidden layer . 53 5.7 Summary of ANN design choices . 55 5.8 Support vector machine classification . 56 5.9 Summary of the SVM design choices . 57 5.10 Evaluating classifier performance . 57 5.11 Misclassification error rate . 58 Chapter 6 Results 59 6.1 Classify denoised and not denoised data with ANN . 59 6.2 Classify denoised and not denoised data with SVM . 61 6.3 Comparison between ANN and SVM classifiers . 63 Chapter 7 Discussion 65 7.1 Methodological considerations . 65 7.2 Data Analysis . 66 7.3 Results . 67 7.4 BCI improvements . 67 7.5 Future prospectives . 68 Chapter 8 Conclusion 69 Bibliography 71 8 TABLE OF CONTENTS A Appendix 75 A.1 The Cerebral Cortex . 75 A.1.1 Lobes . 75 A.1.2 Layers . 76 B Appendix 79 B.1 Artificial neural network . 79 B.2 The neuron . 80 B.3 Models of the neuron . 80 B.4 McCuoolgh and Pitts neural networks . 82 B.5 Gradient Descendent Methods . 83 B.6 Different types of neural network . 83 B.7 Backpropagation . 84 B.8 Initializing Weight . 84 B.9 Feedforward network . 84 B.10 Training the network . 85 C Appendix 87 C.1 Support vector machine . 87 D Appendix 92 D.1 Additional tables and results . 92 9 Introduction 1 Traumatic lesions of the central nervous system (CNS), as well as neurodegenerative disorders, such as amyotrophic lateral sclerosis (ALS), brain stem stroke, muscular dystrophy, cerebral palsy (CP) or "locked-in" syndrome are causes of severe motor deficits in a large number of patients. Every year, spinal cord alone is responsible for the occurrence of 11,000 new cases of paralysis in the United States alone. These cases have to be summed to the over 200,000 es- timated patients who have to cope with partial (paraplegic) or almost total (i.e., quadriplegic) body paralysis only in.
Recommended publications
  • Image Recognition by Spiking Neural Networks
    TALLINN UNIVERSITY OF TECHNOLOGY Faculty of Information Technology Nikolai Jefimov 143689IASM IMAGE RECOGNITION BY SPIKING NEURAL NETWORKS Master's thesis Supervisor: Eduard Petlenkov PhD Tallinn 2017 TALLINNA TEHNIKAÜLIKOOL Infotehnoloogia teaduskond Nikolai Jefimov 143689IASM KUJUTISE TUVASTAMINE IMPULSI NÄRVIVÕRKUDEGA Magistritöö Juhendaja: Eduard Petlenkov PhD Tallinn 2017 Author’s declaration of originality I hereby certify that I am the sole author of this thesis. All the used materials, references to the literature and the work of others have been referred to. This thesis has not been presented for examination anywhere else. Author: Nikolai Jefimov 30.05.2017 3 Abstract The aim of this thesis is to present opportunities on implementations of spiking neural network for image recognition and proving learning algorithms in MATLAB environment. In this thesis provided examples of the use of common types of artificial neural networks for image recognition and classification. Also presented spiking neural network areas of use, as well as the principles of image recognition by this type of neural network. The result of this work is the realization of the learning algorithm in MATLAB environment, as well as the ability to recognize handwritten numbers from the MNIST database. Besides this presented the opportunity to recognizing Latin letters with dimensions of 3x3 and 5x7 pixels. In addition, were proposed User Guide for masters course ISS0023 Intelligent Control System in TUT. This thesis is written in English and is 62 pages long, including 6 chapters, 61 figures and 4 tables. 4 Annotatsioon Kujutise tuvastamine impulsi närvivõrkudega Selle väitekiri eesmärgiks on tutvustada impulsi närvivõrgu kasutamisvõimalused, samuti näidata õpetamise algoritmi MATLAB keskkonnas.
    [Show full text]
  • Table of Contents Welcome from the General Chair
    Table of Contents Welcome from the General Chair . .v Organizing Committee . vi Program Committee . vii-ix IJCNN 2011 Reviewers . ix-xiii Conference Topics . xiv-xv INNS Officers and Board of Governors . xvi INNS President’s Welcome . xvii IEEE CIS Officers and ADCOM . xviii IEEE CIS President’s Welcome . xix Cooperating Societies and Sponsors . xx Conference Information . xxi Hotel Maps . xxii. Schedule-At-A-Glance . xxiii-xxvii Schedule Grids . xxviii-xxxiii IJCNN 2012 Call for Papers . xxxiv-xxxvi Program . 1-31 Detailed Program . 33-146 Author Index . 147 i ii The 2011 International Joint Conference on Neural Networks Final Program July 31 – August 5, 2011 Doubletree Hotel San Jose, California, USA Sponsored by: International Neural Network Society iii The 2011 International Joint Conference on Neural Networks IJCNN 2011 Conference Proceedings © 2011 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redis- tribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE. For obtaining permission, write to IEEE Copyrights Manager, IEEE Operations Center, 445 Hoes Lane, PO Box 1331, Piscataway, NJ 08855-1331 USA. All rights reserved. Papers are printed as received from authors. All opinions expressed in the Proceedings are those of the authors and are not binding on The Institute of Electrical and Electronics Engineers, Inc. Additional
    [Show full text]
  • Based, Distributed Synapses
    Research Collection Doctoral Thesis Robust online learning in neuromorphic systems with spike- based, distributed synapses Author(s): Stefanini, Fabio Publication Date: 2013 Permanent Link: https://doi.org/10.3929/ethz-a-010118610 Rights / License: In Copyright - Non-Commercial Use Permitted This page was generated automatically upon download from the ETH Zurich Research Collection. For more information please consult the Terms of use. ETH Library DISS. ETH NO. 21337 Robust online learning in neuromorphic systems with spike-based, distributed synapses A dissertation submitted to ETH ZURICH for the degree of Doctor of Sciences presented by Fabio Stefanini Institute of Neuroinformatics Laurea di Dottore in Fisica Università degli Studi di Roma “La Sapienza” born April, 19th, 1983 citizen of Italy accepted on the recommendation of Prof. Dr. Rodney Douglas, examiner Prof. Dr. Giacomo Indiveri, co-examiner Prof. Dr. Stefano Fusi, co-examiner 2013 Classification in VLSI ii To my wife. Classification in VLSI iv Abstract Neuromorphic Very Large Scale Integration (VLSI) hardware offers a low-power and compact electronic substrate for implementing distributed plastic synapses for artificial systems. However, the technology used for constructing analog neuromorphic circuits has limited resolution and high intrinsic variability, leading to large circuit mismatch. Consequently, neuromorphic synapse circuits are imprecise and thus the mapping of pre-defined models onto neural processing systems built with such components is practically unfeasible. This problem of variability can be avoided by off-loading learning to ad-hoc digital resources external to the synapse but this work-around introduces communication bottlenecks and so compromises compactness and power efficiency. Here I propose a more direct solution using a system composed of aggregated classifiers and distributed, stochastic learning to exploit the intrinsic variability and mismatch of the substrate.
    [Show full text]
  • Neuromorphic Engineering - Wikipedia
    Neuromorphic engineering - Wikipedia https://en.wikipedia.org/wiki/Neuromorphic_engineering Neuromorphic engineering Neuromorphic engineering, also known as neuromorphic computing,[1][2][3] is a concept developed by Carver Mead,[4] in the late 1980s, describing the use of very-large-scale integration (VLSI) systems containing electronic analog circuits to mimic neuro-biological architectures present in the nervous system.[5] In recent times, the term neuromorphic has been used to describe analog, digital, mixed-mode analog/digital VLSI, and software systems that implement models of neural systems (for perception, motor control, or multisensory integration). The implementation of neuromorphic computing on the hardware level can be realized by oxide-based memristors,[6] spintronic memories,[7] threshold switches, and transistors.[8] A key aspect of neuromorphic engineering is understanding how the morphology of individual neurons, circuits, applications, and overall architectures creates desirable computations, affects how information is represented, influences robustness to damage, incorporates learning and development, adapts to local change (plasticity), and facilitates evolutionary change. Neuromorphic engineering is an interdisciplinary subject that takes inspiration from biology, physics, mathematics, computer science, and electronic engineering to design artificial neural systems, such as vision systems, head-eye systems, auditory processors, and autonomous robots, whose physical architecture and design principles are based on those
    [Show full text]
  • The Posthuman Management Matrix: Understanding the Organizational Impact of Radical Biotechnological Convergence
    Part Three Abstract. In this text we present the Posthuman Management Matrix, a model for understanding the ways in which organizations of the future will be af- fected by the blurring – or even dissolution – of boundaries between human beings and computers. In this model, an organization’s employees and con- sumers can include two different kinds of agents (human and artificial) who may possess either of two sets of characteristics (anthropic or computer-like); the model thus defines four types of possible entities. For millennia, the only type of relevance for management theory and practice was that of human agents who possess anthropic characteristics – i.e., natural human beings. During the 20th Century, the arrival of computers and industrial robots made relevant a second type: that of artificial agents possessing computer-like char- acteristics. Management theory and practice have traditionally overlooked the remaining two types of possible entities – human agents possessing computer-like phys- ical and cognitive characteristics (which can be referred to as ‘cyborgs’) and artificial agents possessing anthropic physical and cognitive characteristics (which for lack of a more appropriate term might be called ‘bioroids’) – be- cause such agents did not yet exist to serve as employees or consumers for organizations. However, in this text we argue that ongoing developments in neuroprosthetics, genetic engineering, virtual reality, robotics, and artificial intelligence are indeed giving rise to such types of agents and that new spheres of management theory and practice will be needed to allow organiza- tions to understand the operational, legal, and ethical issues that arise as their pools of potential workers and customers evolve to include human beings whose bodies and minds incorporate ever more computerized elements and artificial entities that increasingly resemble biological beings.
    [Show full text]
  • Engineering Optimization Using Artificial Neural Network
    International Journal of Innovations in Engineering and Technology (IJIET) Engineering Optimization using Artificial Neural Network Ravi Katukam Convener-Engineering Innovation, Cyient Limited, Hyderabad Prajna Behera Graduate Student IIT Kanpur Abstarct - Neural network is one of the important components in Artificial Intelligence (AI). It is a computational model for storing and retrieving acquired knowledge .It has been studied for many years in the hope of achieving human-like performance in many fields, such as speech and image recognition as well as information retrieval. ANNs consists of dense interconnected computing units that are simple models for complex neurons in biological systems. The knowledge is acquired during a learning process and is stored in the synaptic weights of the inter-nodal connections. The main advantage of neural network is their ability to represent complex input/output relationships. The performance of an ANN is measured according to an error between target and actual output, complexity of ANN, training time etc. The topologicalstructure of an ANN can be characterized by the arrangement of the layers and neurons, the nodal connectivity, and the nodal transfer function. This paper contains development of a simple graphical user interface in MATLAB that uses neural network algorithm for prediction of output for a set of inputs according to the learning example given. The developed tool is used to predict material removal rate and tool ware by taking speed, feed and depth of cut as input parameter from a CNC milling machine. This tool is also used for predicting volume and stress of an inboard fixed trailing edge rib for different combination of thickness parameters.
    [Show full text]
  • Coupling Resistive Switching Devices with Neurons: State of the Art and Perspectives
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Frontiers - Publisher Connector PERSPECTIVE published: 15 February 2017 doi: 10.3389/fnins.2017.00070 Coupling Resistive Switching Devices with Neurons: State of the Art and Perspectives Alessandro Chiolerio 1*, Michela Chiappalone 2, Paolo Ariano 1 and Sergio Bocchini 1 1 Center for Sustainable Future Technologies, Istituto Italiano di Tecnologia, Torino, Italy, 2 Neuroscience and Brain Technologies Department, Istituto Italiano di Tecnologia, Genova, Italy Here we provide the state-of-the-art of bioelectronic interfacing between biological neuronal systems and artificial components, focusing the attention on the potentiality offered by intrinsically neuromorphic synthetic devices based on Resistive Switching (RS). Neuromorphic engineering is outside the scopes of this Perspective. Instead, our focus is on those materials and devices featuring genuine physical effects that could be sought as non-linearity, plasticity, excitation, and extinction which could be directly and more naturally coupled with living biological systems. In view of important applications, such as prosthetics and future life augmentation, a cybernetic parallelism is traced, between biological and artificial systems. We will discuss how such intrinsic features could reduce Edited by: the complexity of conditioning networks for a more natural direct connection between Ramona Samba, biological and synthetic worlds. Putting together living systems with RS devices could Natural and Medical Sciences Institute, Germany represent a feasible though innovative perspective for the future of bionics. Reviewed by: Keywords: cybernetics, bio-electronic systems, resistive switching devices, memristors, neuromorphic devices, Alexander Dityatev, multielectrode arrays German Center for Neurodegenerative Diseases (DZNE), Germany Stefano Vassanelli, INTRODUCTION University of Padua, Italy *Correspondence: The brain is the most powerful and complex known computational system.
    [Show full text]
  • Data Analysis Foundations – Neural Networks Quadrant 1 – E-Text
    e-PGPathshala Subject : Computer Science Paper: Data Analytics Module No 17: CS/DA/17 - Data Analysis Foundations – Neural Networks Quadrant 1 – e-text 1.1 Introduction Neural networks process information in a similar way the human brain does. Neural networks take a different approach to problem solving than that of conventional computers. Artificial neural networks (ANNs) or connectionist systems are a computational model used in machine learning, computer science and other research disciplines, which is based on a large collection of connected simple units called artificial neurons, loosely analogous to axons in a biological brain. Connections between neurons carry an activation signal of varying strength. If the combined incoming signals are strong enough, the neuron becomes activated and the signal travels to other neurons connected to it. Such systems can be trained from examples, rather than explicitly programmed, and excel in areas where the solution or feature detection is difficult to express in a traditional computer program. Like other machine learning methods, neural networks have been used to solve a wide variety of tasks, like computer vision and speech recognition, that are difficult to solve using ordinary rule-based programming. This chapter gives an overview on neural networks. 1.2 Learning Outcomes • Learn the basics of Neural Network • Know applications of Neural Network 1.3 Neural network – The Big Picture Neural network is a computer modeling approach to computation that is loosely based upon the architecture of
    [Show full text]