Pattern Recognition Software and Techniques for Biological Image Analysis

Total Page:16

File Type:pdf, Size:1020Kb

Pattern Recognition Software and Techniques for Biological Image Analysis Education Pattern Recognition Software and Techniques for Biological Image Analysis Lior Shamir, John D. Delaney, Nikita Orlov, D. Mark Eckley, Ilya G. Goldberg* Laboratory of Genetics, National Institute on Aging/National Institutes of Health, Baltimore, Maryland, United States of America Abstract other imaging devices. Automated image rules. An example of unsupervised learn- acquisition systems integrated with labo- ing is clustering, where a dataset can be The increasing prevalence of auto- ratory automation have produced image divided into several groups based on pre- mated image acquisition systems is datasets that are too large for manual existing definitions of what constitutes a enabling new types of microscopy processing. This trend led to a new type of cluster, or the number of clusters expected. experiments that generate large biological experiment, in which the image A review of machine learning in the image datasets. However, there is a analysis must be performed by machines. context of bioinformatics (as opposed to perceived lack of robust image analysis systems required to process Clearly, this approach is different than the imaging) can be found in [3]. these diverse datasets. Most auto- bulk of the microscopy performed for the Traditionally, analysis of digital micros- mated image analysis systems are past ,400 years. However, while the copy images requires identifying regions of tailored for specific types of micros- availability of automated microscopy, lab- interest (ROIs) or ‘‘objects’’ within the copy, contrast methods, probes, and oratory automation, computing resources, images. Once a region is isolated from the even cell types. This imposes signif- and digital imaging and storage devices background, the resolution and dynamic icant constraints on experimental has been increasing consistently, in some range afforded by digital microscopy design, limiting their application to cases the bottleneck for high-throughput allows many types of measurements and the narrow set of imaging methods imaging experiments is the efficacy of statistics to be collected about the object in for which they were designed. One computer vision, image analysis, and question, such as intensity, shape, size, and of the approaches to address these pattern recognition methods [1]. Comput- position, as well as the number of objects limitations is pattern recognition, er-based image analysis provides an ob- and their distribution [4]. This region which was originally developed for jective method of scoring visual content selection can be done manually by draw- remote sensing, and is increasingly independently of subjective manual inter- ing boxes or free-hand regions using an being applied to the biology do- main.Thisapproachreliesontrain- pretation, while potentially being more interactive tool [5], or automatically using ing a computer to recognize pat- sensitive, more consistent, and more computer algorithms known as segmenta- ternsinimagesratherthan accurate [2]. These advantages are not tion algorithms [4,6]. While most image developing algorithms or tuning limited to massive image datasets, as they analysis continues to rely on region parameters for specific image pro- allow microscopy to be used as a routine identification, PR can also be used to cessing tasks. The generality of this assay system even on a small scale. process whole images or images tiled on a approach promises to enable data An effective computational approach to grid without a prior region identification mining in extensive image reposito- objectively analyze image datasets is step [7]. ries, and provide objective and pattern recognition (PR, see Box 1). PR Traditional image processing is there- quantitative imaging assays for rou- is a machine-learning approach where the fore predicated on the question, ‘‘can my tine use. Here, we provide a brief machine finds relevant patterns that dis- objects of interest be identified?’’. In overview of the technologies behind tinguish groups of objects after being contrast, PR is predicated on the question, pattern recognition and its use in trained on examples (i.e., supervised ‘‘can these groups of images be distin- computer vision for biological and machine learning). In contrast, the other guished?’’. In this context, the input to a biomedical imaging. We list available software tools that can be used by approach to machine learning and artifi- PR algorithm may be an entire image, a biologists and suggest practical ex- cial intelligence is unsupervised learning, sub-image region identified with segmen- perimental considerations to make where the machine finds new patterns tation algorithms, or simply image samples the best use of pattern recognition without relying on prior training exam- in the form of rectangular tiles. Thus, in techniques for imaging assays. ples, usually by using a set of pre-defined contrast to selecting and tuning a segmen- Citation: Shamir L, Delaney JD, Orlov N, Eckley DM, Goldberg IG (2010) Pattern Recognition Software and Techniques for Biological Image Analysis. PLoS Comput Biol 6(11): e1000974. doi:10.1371/journal.pcbi.1000974 Introduction Editor: Fran Lewitter, Whitehead Institute, United States of America Computer-aided analysis of microscopy Published November 24, 2010 images has been attracting considerable This is an open-access article distributed under the terms of the Creative Commons Public Domain declaration attention in the past few years, particularly which stipulates that, once placed in the public domain, this work may be freely reproduced, distributed, in the context of high-content screening transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. (HCS). The link between images and Funding: This research was supported entirely by the Intramural Research Program of the NIH, National physiology is well established, and it is Institute on Aging (Z01:AG000685-02). The funders had no role in the decision to publish or preparation of the common knowledge that a significant manuscript. portion of what we know about biology Competing Interests: The authors have declared that no competing interests exist. relies on different types of microscopy and * E-mail: [email protected] PLoS Computational Biology | www.ploscompbiol.org 1 November 2010 | Volume 6 | Issue 11 | e1000974 Box 1. Pattern Recognition Overview of Bioimage PR Systems N PR is the task of automatically detecting patterns in datasets and using them to Although there are many examples of characterize new data. PR is a form of machine learning, which itself is a field within artificial intelligence. Machine learning can be divided into two major PR systems, the process can be summa- groups. In supervised learning, or PR, a computer system is trained using a set of rized in several steps (Figure 1). pre-defined classes, and then used to classify unknown objects based on the As with traditional image processing patterns detected in training. In unsupervised learning there are no classes approaches based on object identification defined a priori, and the computer system subdivides or clusters the data, alone, PR can also benefit from various usually by using a set of general rules. An example of supervised learning is techniques to subdivide images into ROIs. automatic detection of protein localization, in which the computer system is The three principal reasons for doing so trained using images of probes for known sub-cellular compartments [10]. An are to 1) reduce the number of pixels the example of unsupervised learning is clustering an expression profiling PR algorithm needs to consider all at once microarray experiment into groups of genes with similar expression patterns. to improve response time or increase N Other approaches to PR include semi-supervised learning, which uses pre- statistical power, 2) bias the PR algorithm defined classes to find new similarity relationships and define new groups, and to process objects of interest rather than reinforcement learning, in which decisions are improved iteratively based on a background, and 3) center or align objects feedback mechanism and specified reward criteria. In this educational article we that have inherent orientation. ROI de- focus on the application of supervised learning to automated analysis of tection algorithms and tools are described microscopy image datasets. more thoroughly in the Finding Regions of Interest section. The second step is the extraction of tation algorithm, PR requires training a (and solely) on the availability and image content descriptors (image features), computer to distinguish groups of images. distinguishability of control images. which are values that describe the image These groups correspond to experimental Thus, a PR approach to an imaging content numerically. These values can controls, and the set of images within a experiment is very closely tied to the reflect various texture parameters of the group encompasses the variation within biological experiment itself rather than image, the statistical distribution of pixel each control. Given these groups of intermediate measurements from image intensities, edges, colors, etc. While the images, the machine can learn on its processing, or familiarity with the algo- dimensionality of the raw pixels can own what aspects of the images represent rithms necessary to produce these mea- typically reach ,1,000,000 (assuming a natural experimental variation and are surements. PR can be used in tandem microscopy image of 1000|1000 pixels), therefore irrelevant,
Recommended publications
  • Management of Large Sets of Image Data Capture, Databases, Image Processing, Storage, Visualization Karol Kozak
    Management of large sets of image data Capture, Databases, Image Processing, Storage, Visualization Karol Kozak Download free books at Karol Kozak Management of large sets of image data Capture, Databases, Image Processing, Storage, Visualization Download free eBooks at bookboon.com 2 Management of large sets of image data: Capture, Databases, Image Processing, Storage, Visualization 1st edition © 2014 Karol Kozak & bookboon.com ISBN 978-87-403-0726-9 Download free eBooks at bookboon.com 3 Management of large sets of image data Contents Contents 1 Digital image 6 2 History of digital imaging 10 3 Amount of produced images – is it danger? 18 4 Digital image and privacy 20 5 Digital cameras 27 5.1 Methods of image capture 31 6 Image formats 33 7 Image Metadata – data about data 39 8 Interactive visualization (IV) 44 9 Basic of image processing 49 Download free eBooks at bookboon.com 4 Click on the ad to read more Management of large sets of image data Contents 10 Image Processing software 62 11 Image management and image databases 79 12 Operating system (os) and images 97 13 Graphics processing unit (GPU) 100 14 Storage and archive 101 15 Images in different disciplines 109 15.1 Microscopy 109 360° 15.2 Medical imaging 114 15.3 Astronomical images 117 15.4 Industrial imaging 360° 118 thinking. 16 Selection of best digital images 120 References: thinking. 124 360° thinking . 360° thinking. Discover the truth at www.deloitte.ca/careers Discover the truth at www.deloitte.ca/careers © Deloitte & Touche LLP and affiliated entities. Discover the truth at www.deloitte.ca/careers © Deloitte & Touche LLP and affiliated entities.
    [Show full text]
  • Survey of Databases Used in Image Processing and Their Applications
    International Journal of Scientific & Engineering Research Volume 2, Issue 10, Oct-2011 1 ISSN 2229-5518 Survey of Databases Used in Image Processing and Their Applications Shubhpreet Kaur, Gagandeep Jindal Abstract- This paper gives review of Medical image database (MIDB) systems which have been developed in the past few years for research for medical fraternity and students. In this paper, I have surveyed all available medical image databases relevant for research and their use. Keywords: Image database, Medical Image Database System. —————————— —————————— 1. INTRODUCTION Measurement and recording techniques, such as electroencephalography, magnetoencephalography Medical imaging is the technique and process used to (MEG), Electrocardiography (EKG) and others, can create images of the human for clinical purposes be seen as forms of medical imaging. Image Analysis (medical procedures seeking to reveal, diagnose or is done to ensure database consistency and reliable examine disease) or medical science. As a discipline, image processing. it is part of biological imaging and incorporates radiology, nuclear medicine, investigative Open source software for medical image analysis radiological sciences, endoscopy, (medical) Several open source software packages are available thermography, medical photography and for performing analysis of medical images: microscopy. ImageJ 3D Slicer ITK Shubhpreet Kaur is currently pursuing masters degree OsiriX program in Computer Science and engineering in GemIdent Chandigarh Engineering College, Mohali, India. E-mail: MicroDicom [email protected] FreeSurfer Gagandeep Jindal is currently assistant processor in 1.1 Images used in Medical Research department Computer Science and Engineering in Here is the description of various modalities that are Chandigarh Engineering College, Mohali, India. E-mail: used for the purpose of research by medical and [email protected] engineering students as well as doctors.
    [Show full text]
  • Sistema De Detección Y Ubicación De Marcadores Visuales Para El Rastreo De Robots Móviles
    1 UNIVERSIDAD NACIONAL AUTÓNOMA DE MÉXICO FACULTAD DE INGENIERÍA SISTEMA DE DETECCIÓN Y UBICACIÓN DE MARCADORES VISUALES PARA EL RASTREO DE ROBOTS MÓVILES T E S I S Que para obtener el título de INGENIERO MECATRÓNICO P R E S E N T A EMMANUEL TAPIA BRITO DIRECTOR DE TESIS: DR. VÍCTOR JAVIER GONZÁLEZ VILLELA MÉXICO D.F. JULIO 2013 Dedicatoria A mis padres, por su incondicional apoyo, por ser fuente de inspiración, por su esfuerzo derramado día a día y por aguantarme durante todos estos años. * A Getsemaní por llenar de inmenso amor y alegría mi corazón y por haber compartido conmigo una gran etapa de mi vida. * A Sofía por brindarme tu apoyo y el amor que me dio ánimos para alcanzar esta meta. * A todos mis amigos por haber formado parte de mi vida universitaria. 3 4 Agradecimientos A la Universidad Nacional Autónoma de México por la excelente educación recibida. * A los profesores de la Facultad de Ingeniería, en especial a los del Departamento de Ingeniería Mecatrónica, a quienes debo mi formación profesional. * Al grupo de trabajo MRG, por su soporte técnico y ayuda en la realización de esta Tesis. * Al Dr. Víctor Javier González Villela por la oportunidad, motivación y confianza brindada durante la realización de este proyecto. * A Oscar X. Hurtado Reynoso, por su gran ayuda en la etapa de pruebas con el robot. * A la DGAPA por el apoyo brindado a través del proyecto PAPIIT 1N115811 con título “Investigación y desarrollo en sistemas mecatrónicos: robótica móvil, robótica paralela, robótica híbrida y teleoperación”. 5 6 Resumen Esta tesis presenta los puntos principales del desarrollo de un sistema de visión por computadora con el objetivo de emplearlo como medio de asistencia para el con- trol de robots móviles.
    [Show full text]
  • List of Computational Software
    Appendix A List of Computational Software A.1 DICOM Viewers The listed DICOM viewers have similar functionality Acculite www.accuimage.com MicroDicom www.microdicom.com DICOM Works www.dicomworks.com Sante DICOM Viewer www.santesoft.com Mango ric.uthscsa.edu/mango OsiriX (MAC) www.osirix-viewer.com AMIDE amide.sourceforge.net Irfanview www.irfanview.com XNView www.xnview.com A.2 Open Source Medical Imaging and Segmentation CVIPTools A UNIX/Win32-based package and contains a collection of C and C++computer imaging tools that includes edge/line detec- tion, segmentation, and many other functions (www.ee.siue.edu/CVIPtools) Fiji/ImageJ A Java-based image processing package that uses additional plugins for a variety of functionalities including segmentation algorithms (pacific.mpi-cbg.de/wiki/index.php/Fiji) GemIdent An interactive program that is designed for colour segmentation in images with few colours, and the objects of interest look alike with small variation (www.gemident.com) ITK-SNAP An interactive software application that allows users to nav- igate three-dimensional medical images, manually delineate anatomical regions of interest, and perform automatic image segmentation (www.itksnap.org) J. Tu et al., Computational Fluid and Particle Dynamics in the Human Respiratory System, 339 Biological and Medical Physics, Biomedical Engineering DOI 10.1007/978-94-007-4488-2, © Springer Science+Business Media Dordrecht 2013 340 Appendix A List of Computational Software Megawave 2 Made up of C library modules, that contains original algorithms written by researchers and is run using Unix/Linux (megawave.cmla.ens-cachan.fr) MITK and 3Dmed Made up of C++ library for integrated medical image process- ing, segmentation, and registration algorithms (www.mitk.net/download.htm) Slicer Has a GUI that allows manual and automatic segmentation, reg- istration, and three-dimensional visualization.
    [Show full text]
  • Review of Graph, Medical and Color Image Base Segmentation Techniques
    IOSR Journal of Electrical and Electronics Engineering (IOSRJEEE) ISSN : 2278-1676 Volume 1, Issue 1 (May-June 2012), PP 01-19 www.iosrjournals.org Review of Graph, Medical and Color Image base Segmentation Techniques Patel Janakkumar Baldevbhai1, R.S. Anand2 1Image & Signal Processing Group, Electrical Engineering Department, Research Scholar, EED, Indian Institute of Technology Roorkee, Uttarakhand, India,Pin:247 667. 2Electrical Engineering Department, Professor, EED, Indian Institute of Technology Roorkee, Uttarakhand, India Abstract—This literature review attempts to provide a brief overview of some of the most common segmentation techniques, and a comparison between them.It discusses Graph based methods, Medical image segmentation research papers and Color Image based Segmentation Techniques. With the growing research on image segmentation, it has become important to categorise the research outcomes and provide readers with an overview of the existing segmentation techniques in each category. In this paper, different image segmentation techniques starting from graph based approach to color image segmentation and medical image segmentation, which covers the application of both techniques, are reviewed.Information about open source software packages for image segmentation and standard databases are provided. Finally, summaries and review of research work for image segmentation techniques along with quantitative comparisons for assessing the segmentation results with different parameters are represented in tabular format, which are the extracts of many research papers. Index Terms—Graph based segmentation technique, medical image segmentation, color image segmentation, watershed (WS) method, F-measure, computerized tomography (CT) images I. Introduction Image segmentation is the process of separating or grouping an image into different parts. There are currently many different ways of performing image segmentation, ranging from the simple thresholding method to advanced color image segmentation methods.
    [Show full text]
  • Mapping Spatial Heterogeneity in the Tumor Microenvironment: a New Era for Digital Pathology Andreas Heindl1,2, Sidra Nawaz1,2 and Yinyin Yuan1,2
    Laboratory Investigation (2015) 95, 377–384 & 2015 USCAP, Inc All rights reserved 0023-6837/15 $32.00 PATHOBIOLOGY IN FOCUS Mapping spatial heterogeneity in the tumor microenvironment: a new era for digital pathology Andreas Heindl1,2, Sidra Nawaz1,2 and Yinyin Yuan1,2 The emergent field of digital pathology employing automated image analysis techniques is to revolutionize traditional pathology at the center of clinical diagnostics. Histological images provide important tumor features unavailable in molecular profiling or omics data— the spatial context of tumor and stromal cells at single-cell resolution. Methods to map the spatial and morphological patterns of cancer and normal cells can contribute to a more comprehensive understanding of the highly heterogeneous tumor microenvironment. This review focuses on methods that help expand our knowledge of intra-tumoral spatial heterogeneity of the tumor microenvironment and their potential synergies with molecular profiling technologies. Laboratory Investigation (2015) 95, 377–384; doi:10.1038/labinvest.2014.155; published online 19 January 2015 Aided by advanced image analysis technologies, digital useful for offering measurements of temporal sampling, 3D pathology is revolutionizing histopathology by providing vasculature and heterogeneity of metastatic tumors.11,12 objective assessment of cellular components within tumor Whilst the sensitivity and specificity of imaging techniques samples and assisting tumor grading.1,2 To date, remarkable have advanced dramatically in recent years, pathology
    [Show full text]
  • List of Useful Computational Software
    Appendix A List of Useful Computational Software A.1 Dicom Viewers The listed DICOM viewers have similar functionality 3DimViewer www.3dim-laboratory.cz/en/software/3dimviewer Acculite www.accuimage.com Agnosco www.e-dicom.com Aliza DICOM Viewer www.aliza-dicom-viewer.com AMIDE www.amide.sourceforge.net Athena DICOM www.medicalharbour.com/en/athena-dicom-viewer Cobra DICOM www.exxim-cc.com/free_DICOMviewer.html Dicompyler www.dicompyler.com DICOMWorks www.dicomworks.com JiveX www.visus.com/en/downloads/jivex-dicom-viewer.html Irfanview www.irfanview.com Mango www.ric.uthscsa.edu/mango MicroDicom www.microdicom.com Onis DICOM viewer www.onis-viewer.com Open DICOM viewer www.sourceforge.net/projects/opendicomviewer OsiriX (MAC) www.osirix-viewer.com Sante DICOM Viewer www.santesoft.com Weasis www.nroduit.github.io xMedCon www.xmedcon.sourceforge.net//Main/HomePage XNView www.xnview.com © Springer Nature Singapore Pte Ltd. 2021 301 K. Inthavong et al. (eds.), Clinical and Biomedical Engineering in the Human Nose, Biological and Medical Physics, Biomedical Engineering, https://doi.org/10.1007/978-981-15-6716-2 302 Appendix A: List of Useful Computational Software A.2 Open Source Medical Imaging and Segmentation 3D Slicer www.slicer.org CVIPTools www.ee.siue.edu/CVIPtools Fiji/ImageJ www.pacific.mpi-cbg.de/wiki/index.php/Fiji GemIdent www.gemident.com ITK-SNAP www.itksnap.org Nasal-GEOM https://dx.doi.org/10.17632/d23m5ykyw2.1 A.3 Commercial Medical Imaging and Segmentation 3D Doctor www.ablesw.com/3d-doctor Amira www.visageimaging.com/amira.html
    [Show full text]
  • Image Processing
    Image processing PDF generated using the open source mwlib toolkit. See http://code.pediapress.com/ for more information. PDF generated at: Thu, 20 May 2010 09:07:15 UTC Contents Articles Image processing 1 Image processing 1 Digital image processing 3 Digital imaging 5 Medical imaging 6 Digital images 14 Quantization (signal processing) 14 Brightness 16 Luminance 17 Contrast (vision) 19 Color space 23 Color mapping 27 Color management 28 Digital Imaging and Communications in Medicine 32 JPEG 2000 40 Operations on images 53 Linear filter 53 Histogram 57 Image histogram 62 Color histogram 64 Affine transformation 66 Scaling (geometry) 70 Rotation (mathematics) 72 Color balance 77 Image registration 82 Segmentation (image processing) 85 References Article Sources and Contributors 93 Image Sources, Licenses and Contributors 95 Article Licenses License 96 1 Image processing Image processing In electrical engineering and computer science, image processing is any form of signal processing for which the input is an image, such as photographs or frames of video; the output of image processing can be either an image or a set of characteristics or parameters related to the image. Most image-processing techniques involve treating the image as a two-dimensional signal and applying standard signal-processing techniques to it. Image processing usually refers to digital image processing, but optical and analog image processing are also possible. This Monochrome black/white image article is about general techniques that apply to all of them. The acquisition of images (producing the input image in the first place) is referred to as imaging. Typical operations Among many other image processing operations are: • Euclidean geometry transformations such as enlargement, reduction, and rotation • Color corrections such as brightness and contrast adjustments, color mapping, The red, green, and blue color channels of a photograph by Sergei Mikhailovich Prokudin-Gorskii.
    [Show full text]
  • A Deep Learning Computer Vision System for Image Based Cytometry
    A DEEP LEARNING COMPUTER VISION SYSTEM FOR IMAGE BASED CYTOMETRY by Michal Lisicki Submitted in partial fulfillment of the requirements for the degree of Master of Computer Science at Dalhousie University Halifax, Nova Scotia December 2014 c Copyright by Michal Lisicki, 2014 To my always supportive family, who never let me give up ii Table of Contents List of Tables ................................... vi List of Figures .................................. vii Abstract ...................................... xi List of Abbreviations and Symbols Used .................. xii Acknowledgements ............................... xiv Chapter 1 Introduction .......................... 1 1.1 Objectives and scope of the thesis .................... 1 1.2 Complete Blood Count .......................... 3 1.3Contribution................................ 3 1.4 Outline ................................... 5 Chapter 2 Background analysis ..................... 6 2.1Physiologybackground.......................... 6 2.1.1 Complete Blood Count ...................... 6 2.1.2 DifferentialWBCcount..................... 10 2.2 Standard biological image analysis pipeline ............... 12 2.3Relatedworkincomputervision..................... 13 2.3.1 Problemsrelatedtolowqualityimages............. 13 2.3.2 Examples of image cytometry systems ............. 14 2.4 Related work in machine learning . ................. 16 Chapter 3 Tools and related applications ............... 19 3.1Background................................ 19 3.2ImageJandFiji.............................. 19 3.3OpenCV.................................
    [Show full text]