Computational Imaging and Simulations Technologies in Biomedicine (CISTIB)1 Networking Research Center on Bioengineering, Biomaterials and Nanomedicine (CIBER-BBN)

Total Page:16

File Type:pdf, Size:1020Kb

Computational Imaging and Simulations Technologies in Biomedicine (CISTIB)1 Networking Research Center on Bioengineering, Biomaterials and Nanomedicine (CIBER-BBN) GIMIAS Graphical Interface for Medical Image Analysis and Simulation Presenter: Maarten Nieber Computational Imaging and Simulations Technologies In Biomedicine (CISTIB)1 Networking Research Center on Bioengineering, Biomaterials and Nanomedicine (CIBER-BBN) 1Departament of Technology Universitat Pompeu Fabra Barcelona, Spain www.cilab.upf.edu Outline General introduction: what is GIMIAS? Timeline: where are we now? Open Source model: which parts of GIMIAS are public? Questions 2 •Fast •Allow team work •No license restriction Zmd s Zfem2stl Remesh Integration Medical stl2vtk Application geoZernikeMoments Different (teams of) researchers contribute to the same application 3 GIMIAS Application Core C++ (Windows and Linux compilers) Visualization based on VTK and MITK Image processing based on ITK Graphical interface based on wxWidgets 4 GRID computati Remote on database access GIMIAS Application Core Scripting Data Report Sharing generation 5 GIMIAS Application Core Angio Plugin DICOM Plugin Mesh Plugin 6 Your application GIMIAS Application Core Angio Plugin DICOM Plugin Mesh Plugin 7 Plugins 9 10 11 12 Widgets 14 Scene View 15 Data List 16 Data sharing 17 GIMIAS Core Plugin class class DataList DataListWidget class Widget subset claasss WorkingDngDataata synchronize class SceneView 18 How your WorkingData is processed class YourPlugin WorkingData Input image output mesh class class YourWidget event call class YourAPI YourProcessor 19 GIMIAS Core Plugin class class DataList DataListWidget class Widget subset claasss WorkingDngDataata synchronize class SceneView 20 Complexity of the objects class YourPlugin WorkingData Simple class WorkingData class Processor Requires: passing data to the API, calling class NotifyObservers() YourProcessor Intermediate class Widget Requires: UpdateWidget(), UpdateWorkingData(), Validate() Future work: automatic code generation Complex class SceneView Usually requires: interactors Future work: simplify C++ interface 21 GIMIAS - Timeline Jul-08 Oct-07 First GIMIAS Jan-09 Started the wx Porting and Open-source mayor GIMIAS Open-source architecture redesign Today beta-release Update-release Jan-08 Apr-08 Jul-08 Oct-08 Jan-09 Apr-09 Oct 07 Jun 09 22 GIMIAS - Timeline Jul-08 Oct-07 First GIMIAS Jan-09 Started the wx Porting and Open-source mayor GIMIAS Open-source architecture redesign Today beta-release Update-release Jan-08 Apr-08 Jul-08 Oct-08 Jan-09 Apr-09 Oct 07 Jun 09 • GIMIAS webpage • SVN repository • Plugins: • Standard sandbox plugin • DICOM plugin • View plugin • Segmentation plugin 23 GIMIAS - Timeline Jul-08 Oct-07 First GIMIAS Jan-09 Started the wx Porting and Open-source mayor GIMIAS Open-source architecture redesign Today beta-release Update-release Jan-08 Apr-08 Jul-08 Oct-08 Jan-09 Apr-09 Oct 07 Jun 09 Second release: • Updates on the previously released features (software, webpage, documentation, etc) •Developers manual: mature version •Mesh Editing plugin •We expect to have releases 24 every 6 months. GIMIAS - Timeline Jul-08 Oct-07 First GIMIAS Jan-09 Started the wx Porting and Open-source mayor GIMIAS Open-source architecture redesign Today beta-release Update-release Jan-08 Apr-08 Jul-08 Oct-08 Jan-09 Apr-09 Oct 07 Jun 09 Future work: • Scripting • (Remote) databases • Distributed (GRID) computing • Report generation 25 Open source model GIMIAS open source part BSD License GIMIAS close source part Proprietary technology of the CISTIB and partners Open source part includes: Ability to integrate your Widgets, SceneViews, Processors etc Basic services, such as scripting, database access, report generation DICOM Plugin Functionalities built on public source Segmentation plugin: itkConnectedThreshold Meshing plugin: Netgen meshing library 26 More information? Contact me or Nacho Larrabide: [email protected] [email protected] Or visit the GIMIAS webpage www.gimias.org 27.
Recommended publications
  • Using Camitk for Rapid Prototyping of Interactive Computer Assisted Medical Intervention Applications*
    Using CamiTK for Rapid Prototyping of Interactive Computer Assisted Medical Intervention Applications* Emmanuel Promayon, Céline Fouard, Mathieu Bailet, Aurélien Deram, Gaëlle Fiard, Nikolai Hungr, Vincent Luboz, Yohan Payan, Johan Sarrazin, Nicolas Saubat, Sonia Yuki Selmi, Sandrine Voros, Philippe Cinquin and Jocelyne Troccaz Abstract— Computer Assisted Medical Intervention (CAMI hereafter) is a complex multi-disciplinary field. CAMI research requires the collaboration of experts in several fields as diverse as medicine, computer science, mathematics, instrumentation, signal processing, mechanics, modeling, automatics, optics, etc. CamiTK1 is a modular framework that helps researchers and clinicians to collaborate together in order to prototype CAMI applications by regrouping the knowledge and expertise from each discipline. It is an open-source, cross-platform generic and modular tool written in C++ which can handle medical images, surgical navigation, biomedicals simulations and robot control. This paper presents the Computer Assisted Medical Intervention ToolKit (CamiTK) and how it is used in various applications in our research team. Figure 1. Using CamiTK in the CAMI perception – I. INTRODUCTION decision – action loop. The field of CAMI emerged about 30 years ago from the A) Related Work converging evolution of medicine, physics, materials, Numerous programming frameworks exist, generally electronics, computer science and robotics. CAMI aims at focusing on one or two fields of CAMI. For example, some of providing tools that allow the clinician to use multi-modal the most popular free and open-source libraries or data in a rational and quantitative way in order to plan, applications for scientific visualization [2] are Vtk2, simulate and accurately and safely execute mini-invasive Paraview2, VolView2, as well as proprietary software such as medical interventions.
    [Show full text]
  • A Survey of Medical Image Processing Tools
    See discussions, stats, and author profiles for this publication at: http://www.researchgate.net/publication/282610419 A Survey of Medical Image Processing Tools CONFERENCE PAPER · AUGUST 2015 DOI: 10.13140/RG.2.1.3364.4241 2 AUTHORS, INCLUDING: Siau-Chuin Liew Universiti Malaysia Pahang 24 PUBLICATIONS 30 CITATIONS SEE PROFILE Available from: Siau-Chuin Liew Retrieved on: 07 October 2015 provided by UMP Institutional Repository View metadata, citation and similar papers at core.ac.uk CORE brought to you by A Survey of Medical Image Processing Tools Lay-Khoon Lee Siau-Chuin Liew 1Faculty of Computer Systems and Software Engineering; 2Faculty of Computer Systems and Software Engineering; Universiti Malaysia Pahang, Universiti Malaysia Pahang, 26300 Gambang, Pahang, Malaysia 26300 Gambang, Pahang, Malaysia Abstract—A precise analysis of medical image is an important registration, segmentation, visualization, reconstruction, stage in the contouring phase throughout radiotherapy simulation and diffusion preparation. Medical images are mostly used as radiographic techniques in diagnosis, clinical studies and treatment planning. Medical image processing tool are also similarly as important. With a medical image processing tool, it is possible to speed up and enhance the operation of the analysis of the medical image. This paper describes medical image processing software tool which attempts to secure the same kind of programmability advantage for exploring applications of the pipelined processors. These tools simulate complete systems consisting of several of the proposed processing components, in a configuration described by a graphical schematic diagram. In this paper, fifteen different medical image processing tools will be compared in several aspects. The main objective of the comparison is to gather and analysis on the tool in order to recommend users of different operating systems on what type of medical image tools to be used when analysing different types of imaging.
    [Show full text]
  • Segmentation Tools Frederic Cervenansky What Is Open-Source
    Through the forest of open source segmentation tools Frederic Cervenansky What is Open-Source Open source doesn’t just mean access to source code 1 - Free Redistribution (no restriction from selling or giving away the software as a component) 2 - Source Code ( as well as compiled form) 3 - Derived Works (copyleft license) 4 - Integrity of The Author's Source Code (users have a right to know who is the original author) 5 – Distribution of License (no need of a third license) 6 and more What criteria to discriminate software? Usability Code Langage Segmentation methods Plugins – Extensions Organ/structure specificity Software Organs specific Code Segmentation Plugins Citations* Language Methods ImageJ no Java Automatic Yes 723 Fiji No ( Cell) Java Automatic Yes 1254 Freesurfer Brain C++, bash Automatic no 470 ITK no C++ Automatic Yes-no 512 Slicer3D No (Brain) C++ Manual- Automatic Yes 75 FSL Brain C++, bash Automatic No 690 SPM Brain matlab Automatic Yes 7574 pubmed … --- --- --- --- --- *: JAVA Bio-imaging Plugins system User friendly IMAGEJ 2D and 3D limitation No hierarchy in plugins ImgLib (n-dimensional, repackaging, sharing improvement) KMeans Color Quantization Color Picker Fiji Marching IMAGEJ2 Icy Threshold Learning Active Contours Squassh KMeans Clustering Texture Level Set Maximum Entropy Threshold HK-Means Graph Cut Maximum Multi Entropy Threshold Active Cells Bad Indexation: Seeded Region Growing Toolbox dithering as Snake. segmenation tool Brain Organ specific Fully automatic FreeSurfer Allow to restart at divergent steps. Both available Fully automatic through VIP Catalog of tools FSL BET ( Brain Extraction) FAST (GM and WM automated Segmentation). SPM Modified gaussian mixture model Need a matlab license.
    [Show full text]
  • Transaction / Regular Paper Title
    International Journal of Bio-Science and Bio-Technology Vol.6, No.2 (2014), pp.187-194 http://dx.doi.org/10.14257/ijbsbt.2014.6.2.19 Medical Image Processing: A Challenging Analysis Atul Mishra, Abhishek Rai and Akhilesh Yadav BBD University, Lucknow, India [email protected], [email protected], [email protected] Abstract Medical image processing is an multifaceted field at the intersection of computer science, electrical engineering, physics, mathematics and medicine. Medical Image processing has developed versatile computational and mathematical methods for solving problems pertain- ing to medical images and their use for biomedical research and clinical care. The prominent and important motive of Medical Image Processing is to extract clinically relevant infor- mation or knowledge from medical images. MIP focuses on the computational analysis of the images, not their acquisition. The methods can be grouped categorized as: image segmenta- tion, image registration, image-based physiological modeling, Research in Medical Image Processing (MIP) is mainly driven by a technology oriented point of view. MIP research should always be able to give an answer to the question of what is the potential benefit of a solved MIP problem or a newly developed MIP-based system supporting a diagnostic or therapeutic process, in terms of outcome criteria like, e.g., Quality Adjusted Life Years (QALYs) for the patient or cost savings in health care. This paper presents the concept and the strategy of how the Most Relevant MIP problems (MRMIP) shall be identified and as- sessed in the context of improving evaluation of MIP solutions. Keywords: MIP, CAD, MRMP 1.
    [Show full text]
  • An Open Source Framework for Efficient Development Of
    GIMIAS: An open source framework for efficient development of research tools and clinical prototypes Ignacio Larrabide a;b;∗, Pedro Omedas b;a, Yves Martelli b;a, Xavier Planes b;a, Maarten Nieber b;a, Juan A. Moya b;a, Constantine Butakoff b;a, Rafael Sebasti´an b;a, Oscar Camara b;a, Mathieu De Craene b;a, Bart H. Bijnens c;b;a, and Alejandro F. Frangi b;a;c Center for Computational Imaging and Simulation Technologies in Biomedicine (CISTIB) aNetworking Biomedical Research Center on Bioengineering, Biomaterials and Nanomedicine (CIBER-BBN), Barcelona, Spain bUniversitat Pompeu Fabra, Barcelona, Spain cInstituci´oCatalana de Recerca i Estudis Avan¸cats(ICREA), Barcelona, Spain ignacio.larrabide,pedro.omedas,[email protected] Abstract. GIMIAS is a workflow-oriented environment for addressing advanced biomedical image computing and build personalized computa- tional models, which is extensible through the development of application- specific plug-ins. In addition, GIMIAS provides an open source frame- work for efficient development of research and clinical software proto- types integrating contributions from the Virtual Physiological Human community while allowing business-friendly technology transfer and com- mercial product development. This framework has been fully developed in ANSI-C++ on top of well known open source libraries like VTK, ITK and wxWidgets among others. Based on GIMIAS, in this paper is presented a workflow for medical image analysis and simulation of the heart. Key words: Biomedical imaging, cardiovascular modeling, Virtual Phys- iological Human, personalized simulations, open source software 1 Introduction The integrative multi-scale and multi-disciplinar community that tries to under- stand the human patho-physiology is internationally known as \IUPS Physiome Project" [1,2] or, in the European context as \Virtual Physiological Human" (VPH) [3].
    [Show full text]
  • Research Software Engineer in Healthcare Data Analytics Solutions
    CANDIDATE BRIEF Research Software Engineer in Healthcare Data Analytics Solutions, Faculty of Engineering Salary: Grade 7 (£32,548 – £38,833 p.a.) Reference: ENGCP1076 Closing date: 06 September 2018 Fixed-term until 31 December 2020 We will consider flexible working arrangements Research Software Engineer in Healthcare Data Analytics Solutions School of Computing Are you a full stack developer who enjoys working with innovative technology? Do you have a background in cloud computing frameworks and big data analysis with experience in biomedical imaging pipelines? Do you have a passion for large heterogeneous data systems and working across the full stack? Are you ready to think out-of-the-box, innovate and find solutions to challenging distributed systems problems? The Centre for Computational Imaging and Simulation Technologies in Biomedicine (CISTIB), within the Faculties of Engineering and Medicine & Health, involves various academics and their research groups. CISTIB focuses on algorithmic and applied research in the areas of computational imaging, and image-based computational physiology modelling and simulation. CISTIB contributes in different areas of medical image computing and image-based biomechanical and computational physiology modelling. CISTIB works in close cooperation with clinicians from various research centres from the University of Leeds and the academic hospitals of the Leeds Teaching Hospital Trust Foundation, the largest NHS Trust of the UK. Clinical areas where CISTIB members have contributed to, and made substantive innovations in the field are focused around the cardiovascular, musculoskeletal and neural systems, where they have developed diagnostic and prognostic quantitative image-based biomarkers and methods and systems for interventional planning and guidance. The centre hosts academic members from the University of Leeds and Research Fellows, Research Associates, PhD Students and Scientific Software Developers forming a cross-disciplinary team committed to clinical translation of their innovations.
    [Show full text]
  • Big Data in Healthcare: Management, Analysis and Future Prospects
    Dash et al. J Big Data (2019) 6:54 https://doi.org/10.1186/s40537-019-0217-0 SURVEY PAPER Open Access Big data in healthcare: management, analysis and future prospects Sabyasachi Dash1†, Sushil Kumar Shakyawar2,3†, Mohit Sharma4,5 and Sandeep Kaushik6* *Correspondence: sandeep.kaushik. Abstract [email protected]; ‘Big data’ is massive amounts of information that can work wonders. It has become a [email protected] †Sabyasachi Dash and topic of special interest for the past two decades because of a great potential that is Sushil Kumar Shakyawar hidden in it. Various public and private sector industries generate, store, and analyze contributed equally to this big data with an aim to improve the services they provide. In the healthcare indus- work 6 3B’s Research try, various sources for big data include hospital records, medical records of patients, Group, Headquarters results of medical examinations, and devices that are a part of internet of things. of the European Biomedical research also generates a signifcant portion of big data relevant to public Institute of Excellence on Tissue Engineering healthcare. This data requires proper management and analysis in order to derive and Regenerative Medicine, meaningful information. Otherwise, seeking solution by analyzing big data quickly AvePark - Parque de becomes comparable to fnding a needle in the haystack. There are various challenges Ciência e Tecnologia, Zona Industrial da Gandra, Barco, associated with each step of handling big data which can only be surpassed by using 4805-017 Guimarães, high-end computing solutions for big data analysis. That is why, to provide relevant Portugal solutions for improving public health, healthcare providers are required to be fully Full list of author information is available at the end of the equipped with appropriate infrastructure to systematically generate and analyze big article data.
    [Show full text]
  • A Study of Open Source Toolkits of Image Processing for Healthcare
    Global Journal of Researches in Engineering: F Electrical and Electronics Engineering Volume 17 Issue 3 Version 1.0 Year 2017 Type: Double Blind Peer Reviewed International Research Journal Publisher: Global Journals Inc. (USA) Online ISSN: 2249-4596 & Print ISSN: 0975-5861 A Study of Open Source Toolkits of Image Processing for Healthcare Industry Garima Sharma Bhagat Phool Singh Mahila Vishwavidyalaya Abstract- Image processing is used in every sector of life. The development of medical field is entirely contingent on image processing algorithms. Radiologists utilize these algorithms for detection of diseases such as tumors. These algorithms are designed using proprietary tools which enhance the cost of disease detection. In this paper, various open source toolkits for medical image processing such as ITK, VTK, VV, 3D Slicer, Bioi mage XD are explored. We have also performed various image processing operations such as inversion, enhancement and segmentation using these toolkits. These toolkits provide a cost effective solution to healthcare industry. Keywords: ITK, VTK, OPENCV, 3d slicer, BIOIMAGEXD, proprietary tools. GJRE-F Classification: FOR Code: 080106 AStudyofOpenSourceToolkitsofImageProcessingforHealthcareIndustry Strictly as per the compliance and regulations of : © 2017. Garima Sharma. This is a research/review paper, distributed under the terms of the Creative Commons Attribution- Noncommercial 3.0 Unported License http://creativecom mons.org/ licenses/by-nc/3.0/), permitting all non commercial use, distribution, and reproduction in any medium, provided the original work is properly cited. A Study of Open Source Toolkits of Image Processing for Healthcare Industry Garima Sharma Abstract- Image processing is used in every sector of life. The designed toolkits for radiologist which can perform all development of medical field is entirely contingent on image the operations required for medical field.
    [Show full text]
  • List of Open-Source Health Software
    10/05/2017 List of open-source health software - Wikipedia List of open-source health software From Wikipedia, the free encyclopedia This is an old revision of this page, as edited by G-eight (talk | contribs) at 13:04, 22 December 2015 (Added Bahmni as one of the available Open Source hospital systems with links to its website, and to referenced pages from OpenMRS.). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision (https://en.wikipedia.org/wiki/List_of_open- source_health_software). (diff) ← Previous revision | Latest revision (diff) | Newer revision → (diff) The following is a list of software packages and applications licensed under an open-source license or in the public domain for use in the health care industry. Contents 1 Public health and biosurveillance 2 Dental management and patient record 3 Electronic health or medical record 4 Medical practice management software 5 Health system management 6 Logistics & Supply Chain 7 Imaging/visualization 8 Medical information systems 9 Research 10 Mobile devices 11 Out-of-the-box distributions 12 Interoperability testing 13 See also 14 References Public health and biosurveillance Epi Info is public domain statistical software for epidemiology developed by Centers for Disease Control and Prevention. Spatiotemporal Epidemiological Modeler is a tool, originally developed at IBM Research, for modeling and visualizing the spread of infectious diseases. Dental management and patient record Open Dental is the first open-source dental management package with very broad capabilities on record management, patient scheduling and dental office management. Electronic health or medical record Bahmni (http://www.bahmni.org) is an open source hospital system designed for low resource settings.
    [Show full text]
  • Using Camitk for Rapid Prototyping of Interactive Computer Assisted Medical Intervention Applications*
    Using CamiTK for Rapid Prototyping of Interactive Computer Assisted Medical Intervention Applications* Emmanuel Promayon, Céline Fouard, Mathieu Bailet, Aurélien Deram, Gaëlle Fiard, Nikolai Hungr, Vincent Luboz, Yohan Payan, Johan Sarrazin, Nicolas Saubat, Sonia Yuki Selmi, Sandrine Voros, Philippe Cinquin and Jocelyne Troccaz Abstract— Computer Assisted Medical Intervention (CAMI hereafter) is a complex multi-disciplinary field. CAMI research requires the collaboration of experts in several fields as diverse as medicine, computer science, mathematics, instrumentation, signal processing, mechanics, modeling, automatics, optics, etc. CamiTK1 is a modular framework that helps researchers and clinicians to collaborate together in order to prototype CAMI applications by regrouping the knowledge and expertise from each discipline. It is an open-source, cross-platform generic and modular tool written in C++ which can handle medical images, surgical navigation, biomedicals simulations and robot control. This paper presents the Computer Assisted Medical Intervention ToolKit (CamiTK) and how it is used in various applications in our research team. Figure 1. Using CamiTK in the CAMI perception – I. INTRODUCTION decision – action loop. The field of CAMI emerged about 30 years ago from the A) Related Work converging evolution of medicine, physics, materials, Numerous programming frameworks exist, generally electronics, computer science and robotics. CAMI aims at focusing on one or two fields of CAMI. For example, some of providing tools that allow the clinician to use multi-modal the most popular free and open-source libraries or data in a rational and quantitative way in order to plan, applications for scientific visualization [2] are Vtk2, simulate and accurately and safely execute mini-invasive Paraview2, VolView2, as well as proprietary software such as medical interventions.
    [Show full text]
  • 2D-Visualization of 3D Medical Images Within a Distributed System: a Short Survey Masoud Davari Dolatabadi, Aras Dargazany, Hadis Nouri
    Proceedings of the World Congress on Engineering and Computer Science 2014 Vol I WCECS 2014, 22-24 October, 2014, San Francisco, USA 2D-Visualization of 3D Medical Images within A Distributed System: A Short Survey Masoud Davari Dolatabadi, Aras Dargazany, Hadis Nouri Abstract—Current standalone systems in the area of Min- imally Invasive Cancer Treatment (MICT) are not providing satisfying possibilities for researchers and Interventional Ra- diologist (IRs) to share their contributions. There are a lot of standalone simulation software implementations, which provide different services for the mentioned purpose. However, in all of the services, one of the most important concepts, transferring the experience which has gained from one simulated procedure, is missed. In contrast, by using a web based system, different communities would be capable of sharing the medical data and simulation. These potential advantages lead us to devel- oping a web based system for visualizing the medical data. Furthermore, 2D-visualization and applying image processing algorithms in 3D medical images is one of the most important elements of the very front-end of the software framework and Fig. 1. Overview of the sample structure for medical image data also technically demanding. Therefore, we are obliged to answer visualization and its relation to the 2D viewer system with functionality. the question ”What is the efficient method for web-based 2D representation of 3D medical images in distributed system?”. Based on the evaluation of performance result in different test cases, such as evaluating the architecture, method usage and on visualization technology advances, studies and estimating modularity in distributed systems, and readability of the most tools which are needed by physicians for treatment.
    [Show full text]
  • Open Source Software in a Practical Approach for Post Processing of Radiologic Images
    Radiol med DOI 10.1007/s11547-014-0437-5 COMPUTER APPLICATIONS Open source software in a practical approach for post processing of radiologic images Gianluca Valeri · Francesco Antonino Mazza · Stefania Maggi · Daniele Aramini · Luigi La Riccia · Giovanni Mazzoni · Andrea Giovagnoni Received: 3 February 2014 / Accepted: 12 March 2014 © Italian Society of Medical Radiology 2014 Abstract 3D Slicer, MedINRIA, MITK 3M3, VolView, VR Render; Purpose The purpose of this paper is to evaluate the use while OsiriX received 10. of open source software (OSS) to process DICOM images. Conclusions OsiriX appears to be the only program able Materials and methods We selected 23 programs for to perform all the operations taken into consideration, simi- Windows and 20 programs for Mac from 150 possible OSS lar to a workstation equipped with proprietary software, programs including DICOM viewers and various tools allowing the analysis and interpretation of images in a sim- (converters, DICOM header editors, etc.). The programs ple and intuitive way. OsiriX is a DICOM PACS worksta- selected all meet the basic requirements such as free avail- tion for medical imaging and software for image process- ability, stand-alone application, presence of graphical user ing for medical research, functional imaging, 3D imaging, interface, ease of installation and advanced features beyond confocal microscopy and molecular imaging. This appli- simple display monitor. Capabilities of data import, data cation is also a good tool for teaching activities because it export, metadata, 2D viewer, 3D viewer, support platform facilitates the attainment of learning objectives among stu- and usability of each selected program were evaluated on a dents and other specialists.
    [Show full text]