DOCSLIB.ORG

Graph Neural Networks in Network Neuroscience Arxiv:2106.03535V1

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Graph Neural Networks in Network Neuroscience Arxiv:2106.03535V1 Graph Neural Networks in Network Neuroscience Alaa Bessadok,1;2;3 Mohamed Ali Mahjoub,2;3 and Islem Rekik1;4 1BASIRA lab, Faculty of Computer and Informatics, Istanbul Technical University, Istanbul, Turkey, Postal code; email: [email protected] 2Higher Institute of Informatics and Communication Technologies, University of Sousse, Tunisia, 4011 3National Engineering School of Sousse, University of Sousse, LATIS- Laboratory of Advanced Technology and Intelligent Systems, Sousse, Tunisia, 4023 4School of Science and Engineering, Computing, University of Dundee, UK Xxxx. Xxx. Xxx. Xxx. 2021. AA:1{27 Keywords https://doi.org/10.1146/((please add brain graph, connectome, graph neural network, graph topology, article doi)) graph theory, geometric deep learning Copyright © 2021 by Annual Reviews. All rights reserved Abstract Noninvasive medical neuroimaging has yielded many discoveries about the brain connectivity. Several substantial techniques mapping morpho- logical, structural and functional brain connectivities were developed to create a comprehensive road map of neuronal activities in the human brain {namely brain graph. Relying on its non-Euclidean data type, graph neural network (GNN) provides a clever way of learning the deep arXiv:2106.03535v1 [cs.LG] 7 Jun 2021 graph structure and it is rapidly becoming the state-of-the-art leading to enhanced performance in various network neuroscience tasks. Here we review current GNN-based methods, highlighting the ways that they have been used in several applications related to brain graphs such as missing brain graph synthesis and disease classification. We conclude by charting a path toward a better application of GNN models in network neuroscience field for neurological disorder diagnosis and population graph integration. The list of papers cited in our work is available at https://github.com/basiralab/GNNs-in-Network-Neuroscience. 1 Contents 1. INTRODUCTION ............................................................................................ 2 2. WHAT DO GRAPH NEURAL NETWORKS OFFER TO NETWORK NEUROSCIENCE? ................ 4 2.1. GNN overview ........................................................................................... 4 2.2. Literature search and taxonomy definition ............................................................. 6 2.3. Brain graph prediction .................................................................................. 6 2.4. Brain graph integration ................................................................................. 12 2.5. Brain graph classification ............................................................................... 13 3. DISCUSSION AND OUTLOOK ............................................................................. 17 3.1. Toward clinical translation .............................................................................. 17 3.2. Outlook.................................................................................................. 21 1. INTRODUCTION Understanding how the underpinning connections in the biological neural system account for human brain functions has been a preoccupation of researchers for several years (1, 2, 3). To accomplish this aim, network neuroscience field has emerged with the aim of mapping the endogenous activity generated by neurons. Particularly, neuroscientists modeled the brain as a graph where nodes represent the anatomical brain regions connected by edges referring to morphological, functional, or structural connectivities relating pairwise nodes (4, 5, 6). Conventionally, three types of brain graphs can be defined from different medical modalities: morphological, structural, and functional brain graphs, which are derived from structural T1-weighted, diffusion-weighted and resting-state functional MRI, respectively (7, 8, 9, 10, 11). Such graph representation of the brain gives rise to the understanding of the life span of brain wiring across three axes. The first one represents the time axis where we can track the brain connectivity changes over time from birth to age or foresee a transition from a healthy to a disordered state. By deepening our understanding of the relationship between the brain connectivities at a first timepoint and its follow-up acquisitions, we may produce novel diagnostic tools for better identifying neurological disorders at a very early stage (e.g., Alzheimer's disease and autism) (12, 13). The second axis refers to the resolution of the brain graph which yields to discovering new inter-regional connections that Three axes to hold the brain. Specifically, a brain can be modeled by a low-resolution or super-resolution generate brain connectome where the former one has fewer nodes (i.e., region of interest (ROIs)) and graphs: From a single brain graph, edges than the latter. Mainly, each connectome scale represents its own specific window existing works can into the topographic organization of the brain (14). Thus, this diversity in resolution will generate different certainly increase the performance of early disease diagnosis (15) as it helps better capture types of brain the multi-level nested complexity of the brain as a connectome. Ultimately, knowing that connectivities neurological disorders affect the brain in different ways, one may boost the diagnosis by (domain axis), produce higher leveraging the complementary information present in multiple modalities such as functional resolution graphs and morphological connectivities (7, 17, 16). Therefore, the third axis refers to the domain (resolution axis) and in which the brain data was collected, which is commonly referred to in network neuroscience predict graph as the `neuroimaging modality' (e.g., functional MRI or diffusion MRI) utilized to generate topological changes the brain connectome type (e.g., functional or structural). Such cross-domain multimodal over time (time axis). representation of the brain connectivity provides invaluable complementary information for brain mapping in health and disease. 2 Bessadok et al. Ideally, one would have a connectomic dataset that spans all these dimensions to benefit from the complementary between different brain network representations. Such multimodal Morphological brain graph: Recently dataset will provide rich information that helps generate a holistic connectional roadmap invented by (16, 7), encoding different facets of the brain thereby understanding typical and atypical brain con- this type of brain nectivities (3, 6). Although several connectomic datasets have been proliferated such as the graphs is derived Human Connectome Project (HCP) (18), the Baby Connectome Project (BCP) (19) and the from T1-weighted Connectome Related to Human Disease (CRHD) (20), they often have missing observations MRI and involves cortical measures due to various reasons such as high-cost of clinical scans and time-consuming preprocessing such as sulcal depth step of neuroimaging data. To overcome this obstacle, various graph generative models and cortical emerged (21, 24, 22, 15, 23) based on different machine learning (ML) architectures. Such thickness to estimate models aim to generate a holistic mapping of the brain from minimal resources where the the distance in prediction of multimodal (21), high-resolution (22, 15) and temporal evolution (24, 23) of morphology between brain regions. brain networks is achieved from single-domain, single-time and single-scale source brain graph, respectively. Leveraging such brain graph generative models in a real clinical setting Structural brain graph: It consists of will be beneficial in several aspects: for a disordered subject having only a morphological a brain graph brain graph derived from T1-weighted MRI, one can chart out all the missing modalities derived from (diffusion and functional) over time and at various resolutions. This will reduce the scanning diffusion tensor time as well as the time-consuming neuroimage processing pipelines. Basically, from one imaging (DTI) or single baseline brain graph, we can predict all its variations across different domains, resolu- diffusion spectrum imaging (DSI) tions and timepoints. Another line of ML-based generative models have been implemented (8, 10, 2) where via graph integration (25, 26, 27, 28). The integration aims to generate a representative edges between each template of a population of brain muligraphs with a shared neurological state (e.g., autistic). pair of nodes This generated connectional brain template (CBT) encodes a holistic mapping of shared measures the degree traits within a population of brain multigraphs. of white matter connectivity between Although these machine learning frameworks are powerful and have a great impact the associated pair on the fast development of computer-aided brain connectomics, they are still learned in a of ROIs. dichotomized way where different sub-parts of the framework are trained independently. Functional brain Therefore, being agnostic to cumulative errors is undeniably substantial for making predic- graph: tions that are interpretable in the clinical world. Recent studies aimed to solve this issue by Conventionally leveraging deep learning (DL) models such as convolutional neural network (CNN) which is derived from inherently trained in an end-to-end fashion (36). While effective when compared to tradi- functional MRI (fMRI) using a tional machine learning methods, still DL methods do not generalize well to non-Euclidean measure of data types (e.g., graphs). More specifically, directly applying DL methods to graphs over- correlation (e.g.,
Load more

Recommended publications
  • Computational Anatomy: Model Construction and Application for Anatomical Structures Recognition in Torso CT Images
    The First International Symposium on the Project “Computational Anatomy” Computational Anatomy: Model Construction and Application for Anatomical Structures Recognition in Torso CT Images Hiroshi Fujita #1, Takeshi Hara #2, Xiangrong Zhou #3, Huayue Chen *4, and Hiroaki Hoshi **5 # Department of Intelligent Image Information, Graduate School of Medicine, Gifu University * Department of Anatomy, Graduate School of Medicine, Gifu University ** Department of Radiology, Graduate School of Medicine, Gifu University Yanagido 1-1, Gifu 501-1194, Japan 1 [email protected] 2 [email protected] 3 [email protected] 4 [email protected] 5 [email protected] Abstract—This paper describes the purpose and recent summary advanced CAD system that aims at multi-disease detection of our research work which is a part of research project from multi-organ [2]. The traditional approach for lesion “Computational anatomy for computer-aided diagnosis and detection prepares a pattern for a specific lesion type and therapy: Frontiers of medical image sciences” that was funded searches the lesion candidates in CT images by a pattern by Grant-in-Aid for Scientific Research on Innovative Areas, matching process. In the case of multi-disease detection from MEXT, Japan. The main purpose of our research in this project focus on model construction of computational anatomy and multi-organ, generating and matching a lot of prior lesion model applications for analyzing and recognizing the anatomical patterns from CT images can be tedious and sometimes not structures of human torso region using high-resolution torso X- possible.
    [Show full text]
  • Using Deep Learning Convolutional Neural Network
    Yang et al. BioMed Eng OnLine (2018) 17:138 https://doi.org/10.1186/s12938-018-0587-0 BioMedical Engineering OnLine RESEARCH Open Access Multimodal MRI‑based classifcation of migraine: using deep learning convolutional neural network Hao Yang†, Junran Zhang*†, Qihong Liu and Yi Wang *Correspondence: [email protected] Abstract †Hao Yang and Junran Zhang Background: Recently, deep learning technologies have rapidly expanded into medi- contributed equally to this work cal image analysis, including both disease detection and classifcation. As far as we Department of Medical know, migraine is a disabling and common neurological disorder, typically character- Information Engineering, ized by unilateral, throbbing and pulsating headaches. Unfortunately, a large number School of Electrical Engineering and Information, of migraineurs do not receive the accurate diagnosis when using traditional diagnostic Sichuan University, Chengdu, criteria based on the guidelines of the International Headache Society. As such, there Sichuan, China is substantial interest in developing automated methods to assist in the diagnosis of migraine. Methods: To the best of our knowledge, no studies have evaluated the potential of deep learning technologies in assisting with the classifcation of migraine patients. Here, we used deep learning methods in combination with three functional measures (the amplitude of low-frequency fuctuations, regional homogeneity and regional functional correlation strength) based on rs-fMRI data to distinguish not only between migraineurs and healthy controls, but also between the two subtypes of migraine. We employed 21 migraine patients without aura, 15 migraineurs with aura, and 28 healthy controls. Results: Compared with the traditional support vector machine classifer, which has an accuracy of 83.67%, our Inception module-based convolutional neural network approach showed a signifcant improvement in classifcation output (over 86.18%).
    [Show full text]
  • A Review on Deep Learning in Medical Image Reconstruction ∗
    A Review on Deep Learning in Medical Image Reconstruction ∗ Haimiao Zhang† and Bin Dong†‡ June 26, 2019 Abstract. Medical imaging is crucial in modern clinics to provide guidance to the diagnosis and treatment of diseases. Medical image reconstruction is one of the most fundamental and important components of medical imaging, whose major objective is to acquire high-quality medical images for clinical usage at the minimal cost and risk to the patients. Mathematical models in medical image reconstruction or, more generally, image restoration in computer vision, have been playing a promi- nent role. Earlier mathematical models are mostly designed by human knowledge or hypothesis on the image to be reconstructed, and we shall call these models handcrafted models. Later, handcrafted plus data-driven modeling started to emerge which still mostly relies on human designs, while part of the model is learned from the observed data. More recently, as more data and computation resources are made available, deep learning based models (or deep models) pushed the data-driven modeling to the extreme where the models are mostly based on learning with minimal human designs. Both handcrafted and data-driven modeling have their own advantages and disadvantages. Typical hand- crafted models are well interpretable with solid theoretical supports on the robustness, recoverability, complexity, etc., whereas they may not be flexible and sophisticated enough to fully leverage large data sets. Data-driven models, especially deep models, on the other hand, are generally much more flexible and effective in extracting useful information from large data sets, while they are currently still in lack of theoretical foundations.
    [Show full text]
  • Deep Learning in Bioinformatics
    Deep Learning in Bioinformatics Seonwoo Min1, Byunghan Lee1, and Sungroh Yoon1,2* 1Department of Electrical and Computer Engineering, Seoul National University, Seoul 08826, Korea 2Interdisciplinary Program in Bioinformatics, Seoul National University, Seoul 08826, Korea Abstract In the era of big data, transformation of biomedical big data into valuable knowledge has been one of the most important challenges in bioinformatics. Deep learning has advanced rapidly since the early 2000s and now demonstrates state-of-the-art performance in various fields. Accordingly, application of deep learning in bioinformatics to gain insight from data has been emphasized in both academia and industry. Here, we review deep learning in bioinformatics, presenting examples of current research. To provide a useful and comprehensive perspective, we categorize research both by the bioinformatics domain (i.e., omics, biomedical imaging, biomedical signal processing) and deep learning architecture (i.e., deep neural networks, convolutional neural networks, recurrent neural networks, emergent architectures) and present brief descriptions of each study. Additionally, we discuss theoretical and practical issues of deep learning in bioinformatics and suggest future research directions. We believe that this review will provide valuable insights and serve as a starting point for researchers to apply deep learning approaches in their bioinformatics studies. *Corresponding author. Mailing address: 301-908, Department of Electrical and Computer Engineering, Seoul National University, Seoul 08826, Korea. E-mail: [email protected]. Phone: +82-2-880-1401. Keywords Deep learning, neural network, machine learning, bioinformatics, omics, biomedical imaging, biomedical signal processing Key Points As a great deal of biomedical data have been accumulated, various machine algorithms are now being widely applied in bioinformatics to extract knowledge from big data.
    [Show full text]
  • Medical Image Computing: Machine-Learning Methods and Advanced-MRI Applications
    Medical Image Computing: Machine-learning methods and Advanced-MRI applications Overview Medical imaging is increasingly being used as a first step for clinical diagnosis of a large number of diseases, including disorders of the brain, heart, lung, kidney, muscle, etc. Among the modalities that find widespread use is magnetic resonance imaging (MRI), due its ability to image bones as well as soft tissue. In the case of major abnormalities such as tumors, a radiologist can easily spot abnormalities in the MR images. However, subtle changes in the tissue are difficult to locate for the human eye. Hence, advanced image processing techniques can be of great medical value to assist the radiologist as well as to understand the basic mechanism of action in a large number of diseases. Further, early diagnosis is critical for better clinical outcome. This course is designed as an introductory course in medical image processing and analysis for engineers and quantitative scientists, including students and faculty. It will primarily focus on MR imaging and analysis with a special emphasis on brain and mental disorders. Apart from the basics such as edge detection and segmentation, we will also cover advanced concepts such as shape analysis, probabilistic clustering, nonlinear dimensionality reduction, and diffusion MRI processing. This course will also have several hands-on segments that will allow the students to get a first-hand feel of the opportunities and challenges in medical image analysis. Course participants will learn these topics through lectures and hands-on experiments. Also, case studies and assignments will be shared to stimulate research motivation of participants.
    [Show full text]
  • MR Images, Brain Lesions, and Deep Learning
    applied sciences Review MR Images, Brain Lesions, and Deep Learning Darwin Castillo 1,2,3,* , Vasudevan Lakshminarayanan 2,4 and María José Rodríguez-Álvarez 3 1 Departamento de Química y Ciencias Exactas, Sección Fisicoquímica y Matemáticas, Universidad Técnica Particular de Loja, San Cayetano Alto s/n, Loja 11-01-608, Ecuador 2 Theoretical and Experimental Epistemology Lab, School of Optometry and Vision Science, University of Waterloo, Waterloo, ON N2L3G1, Canada; [email protected] 3 Instituto de Instrumentación para Imagen Molecular (i3M) Universitat Politècnica de València—Consejo Superior de Investigaciones Científicas (CSIC), E-46022 Valencia, Spain; [email protected] 4 Departments of Physics, Electrical and Computer Engineering and Systems Design Engineering, University of Waterloo, Waterloo, ON N2L3G1, Canada * Correspondence: [email protected]; Tel.: +593-07-370-1444 (ext. 3204) Featured Application: This review provides a critical review of deep/machine learning algo- rithms used in the identification of ischemic stroke and demyelinating brain diseases. It eval- uates their strengths and weaknesses when applied to real world clinical data. Abstract: Medical brain image analysis is a necessary step in computer-assisted/computer-aided diagnosis (CAD) systems. Advancements in both hardware and software in the past few years have led to improved segmentation and classification of various diseases. In the present work, we review the published literature on systems and algorithms that allow for classification, identification, and detection of white matter hyperintensities (WMHs) of brain magnetic resonance (MR) images, specifically in cases of ischemic stroke and demyelinating diseases. For the selection criteria, we used bibliometric networks. Of a total of 140 documents, we selected 38 articles that deal with the main objectives of this study.
    [Show full text]
  • Medical Image Processing: from Formation to Interpretation
    Technical Article Share on Twitter Facebook LinkedIn Email Medical Image Processing: From Formation to Interpretation Anton Patyuchenko Analog Devices, Inc. Technological advancements achieved in medical imaging over the last Core Areas of Medical Image Processing century created unprecedented opportunities for noninvasive diagnostic There are numerous concepts and approaches for structuring the field of and established medical imaging as an integral part of healthcare systems medical image processing that focus on different aspects of its core areas today. One of the major areas of innovation representing these advance- illustrated in Figure 1. These areas shape three major processes underlying ments is the interdisciplinary field of medical image processing. this field—image formation, image computing, and image management. This field of rapid development deals with a broad number of processes The process of image formation is comprised of data acquisition and ranging from raw data acquisition to digital image communication that image reconstruction steps, providing a solution to a mathematical inverse underpin the complete data flow in modern medical imaging systems. problem. The purpose of image computing is to improve interpretability of Nowadays, these systems offer increasingly higher resolutions in spatial the reconstructed image and extract clinically relevant informa tion from it. and intensity dimensions, as well as faster acquisition times resulting in an Finally, image management deals with compression, archiving, retrieval, extensive amount of high quality raw image data that must be properly and communication of the acquired images and derived information. processed and interpreted to attain accurate diagnostic results. This article focuses on the key areas of medical image processing, consid- ers the context of specific imaging modalities, and discusses the key challenges and trends in this field.
    [Show full text]
  • Computational Anatomy for Multi-Organ Analysis in Medical Imaging: a Review
    Medical Image Analysis 56 (2019) 44–67 Contents lists available at ScienceDirect Medical Image Analysis journal homepage: www.elsevier.com/locate/media Computational anatomy for multi-organ analysis in medical imaging: A review ∗ Juan J. Cerrolaza a, , Mirella López Picazo b,c, Ludovic Humbert c, Yoshinobu Sato d, Daniel Rueckert a, Miguel Ángel González Ballester b,e, Marius George Linguraru f,g a Biomedical Image Analysis Group, Imperial College London, United Kingdom b BCN Medtech, Dept. of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain c Galgo Medical S.L., Spain d Graduate School of Information Science, Nara Institute of Science and Technology (NAIST), Nara, Japan e ICREA, Barcelona, Spain f Sheickh Zayed Institute for Pediatric Surgicaonl Innovation, Children’s National Health System, Washington DC, USA g School of Medicine and Health Sciences, George Washington University, Washington DC, USA a r t i c l e i n f o a b s t r a c t Article history: The medical image analysis field has traditionally been focused on the development of organ-, and Received 20 August 2018 disease-specific methods. Recently, the interest in the development of more comprehensive computa- Revised 5 February 2019 tional anatomical models has grown, leading to the creation of multi-organ models. Multi-organ ap- Accepted 13 April 2019 proaches, unlike traditional organ-specific strategies, incorporate inter-organ relations into the model, Available online 15 May 2019 thus leading to a more accurate representation of the complex human anatomy. Inter-organ relations Keywords: are not only spatial, but also functional and physiological.
    [Show full text]
  • Introduction to Medical Image Computing
    1 MEDICAL IMAGE COMPUTING (CAP 5937)- SPRING 2017 LECTURE 1: Introduction Dr. Ulas Bagci HEC 221, Center for Research in Computer Vision (CRCV), University of Central Florida (UCF), Orlando, FL 32814. [email protected] or [email protected] 2 • This is a special topics course, offered for the second time in UCF. Lorem Ipsum Dolor Sit Amet CAP5937: Medical Image Computing 3 • This is a special topics course, offered for the second time in UCF. • Lectures: Mon/Wed, 10.30am- 11.45am Lorem Ipsum Dolor Sit Amet CAP5937: Medical Image Computing 4 • This is a special topics course, offered for the second time in UCF. • Lectures: Mon/Wed, 10.30am- 11.45am • Office hours: Lorem Ipsum Dolor Sit Amet Mon/Wed, 1pm- 2.30pm CAP5937: Medical Image Computing 5 • This is a special topics course, offered for the second time in UCF. • Lectures: Mon/Wed, 10.30am-11.45am • Office hours: Mon/Wed, 1pm- 2.30pm • No textbook is Lorem Ipsum Dolor Sit Amet required, materials will be provided. • Avg. grade was A- last CAP5937: Medical Image Computing spring. 6 Image Processing Computer Vision Medical Image Imaging Computing Sciences (Radiology, Biomedical) Machine Learning 7 Motivation • Imaging sciences is experiencing a tremendous growth in the U.S. The NYT recently ranked biomedical jobs as the number one fastest growing career field in the nation and listed bio-medical imaging as the primary reason for the growth. 8 Motivation • Imaging sciences is experiencing a tremendous growth in the U.S. The NYT recently ranked biomedical jobs as the number one fastest growing career field in the nation and listed bio-medical imaging as the primary reason for the growth.
    [Show full text]
  • Lars Ruthotto
    Lars Ruthotto 400 Dowman Dr, W408 [email protected] 30322 Atlanta, GA http://www.mathcs.emory.edu/~lruthot/ United States @lruthotto Education Doctor of Natural Sciences, University of M¨unster,Germany, 2012, thesis entitled Hyperelastic Image Registration - Theory, Numerical Methods, and Applications, advisors: Martin Burger and Jan Modersitzki. Diploma in Mathematics, University of M¨unster,Germany, 2010. Full-time Positions Associate Professor, Departments of Mathematics and Computer Science, Emory University, since Sept. 2020. Assistant Professor, Departments of Mathematics and Computer Science, Emory University, Sept. 2014 { Aug. 2020. Postdoctoral Research Fellow, Department of Mathematics / Earth and Ocean Sciences, University of British Columbia, Canada, Jan. 2013 { Aug. 2014. Research and Teaching Assistant, Institute of Mathematics and Image Computing, University of L¨ubeck, Germany, Oct. 2010 { Dec. 2012. Research Assistant, Institute of Biomagnetism and Biosignalanalysis, University of M¨unster,Germany, Aug. and Sept. 2010. Research and Teaching Assistant, Institute for Computational and Applied Mathematics, University of M¨unster,Germany, April 2010 { July 2010. Other Positions Senior Fellow, Institute for Pure and Applied Mathematics (IPAM), Long program on Machine Learning for Physics and the Physics of Learning Tutorials, Sept. 2019 { Dec. 2019. Senior Consultant, XTract Technologies Inc., Jan. 2017 { Sept. 2019. Publications Submitted Papers and Preprints [P.6] Onken D, Nurbekyan L, Li X, Wu Fung S, Osher S, Ruthotto
    [Show full text]
  • Lecture 1: Introduction to Medical Image Computing
    1 MEDICAL IMAGE COMPUTING (CAP 5937)- SPRING 2016 LECTURE 1: Introduction Dr. Ulas Bagci HEC 221, Center for Research in Computer Vision (CRCV), University of Central Florida (UCF), Orlando, FL 32814. [email protected] or [email protected] 2 • This is a special topics course, offered for the first time in UCF. Lorem Ipsum Dolor Sit Amet CAP5937: Medical Image Computing 3 • This is a special topics course, offered for the first time in UCF. • Lectures: Mon/Wed, 10.30am- 11.45am Lorem Ipsum Dolor Sit Amet CAP5937: Medical Image Computing 4 • This is a special topics course, offered for the first time in UCF. • Lectures: Mon/Wed, 10.30am- 11.45am • Office hours: Lorem Ipsum Dolor Sit Amet Mon/Wed, 1pm- 2.30pm CAP5937: Medical Image Computing 5 • This is a special topics course, offered for the first time in UCF. • Lectures: Mon/Wed, 10.30am-11.45am • Office hours: Mon/Wed, 1pm- 2.30pm Lorem Ipsum Dolor Sit Amet • No textbook is required, materials will be provided. CAP5937: Medical Image Computing 6 Image Processing Computer Vision Medical Image Imaging Computing Sciences (Radiology, Biomedical) Machine Learning 7 Motivation • Imaging sciences is experiencing a tremendous growth in the U.S. The NYT recently ranked biomedical jobs as the number one fastest growing career field in the nation and listed bio-medical imaging as the primary reason for the growth. 8 Motivation • Imaging sciences is experiencing a tremendous growth in the U.S. The NYT recently ranked biomedical jobs as the number one fastest growing career field in the nation and listed bio-medical imaging as the primary reason for the growth.
    [Show full text]
  • Multimodal Neuroimaging Computing: the Workflows, Methods, and Platforms
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Sydney eScholarship Brain Informatics (2015) 2:181–195 DOI 10.1007/s40708-015-0020-4 Multimodal neuroimaging computing: the workflows, methods, and platforms Sidong Liu • Weidong Cai • Siqi Liu • Fan Zhang • Michael Fulham • Dagan Feng • Sonia Pujol • Ron Kikinis Received: 29 July 2015 / Accepted: 20 August 2015 / Published online: 4 September 2015 Ó The Author(s) 2015. This article is published with open access at Springerlink.com Abstract The last two decades have witnessed the 1 Introduction explosive growth in the development and use of noninva- sive neuroimaging technologies that advance the research Neuroimaging has profoundly advanced neuroscience on human brain under normal and pathological conditions. research and clinical care rapidly in the past two decades, Multimodal neuroimaging has become a major driver of prominently by magnetic resonance imaging (MRI), com- current neuroimaging research due to the recognition of the plemented positron emission tomography (PET), and clinical benefits of multimodal data, and the better access electroencephalography (EEG)/magnetoencephalography to hybrid devices. Multimodal neuroimaging computing is (MEG). The art of neuroimaging today is shaped by three very challenging, and requires sophisticated computing to concurrent, interlinked technological developments [1]: address the variations in spatiotemporal resolution and Data Acquisition The advances of imaging instrumen- merge the biophysical/biochemical information. We review tation have enabled digital image acquisition, as well as the current workflows and methods for multimodal neu- electronic data storage and communication systems, such roimaging computing, and also demonstrate how to con- as the picture archiving and communication system duct research using the established neuroimaging (PACS).
    [Show full text]