DOCSLIB.ORG

Arxiv:1904.08610V1 [Cs.CV] 18 Apr 2019

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Arxiv:1904.08610V1 [Cs.CV] 18 Apr 2019 A Client/Server Based Online Environment for Manual Segmentation of Medical Images Daniel Wild∗ Maximilian Webery Jan Eggerz Institute of Computer Graphics and Vision Graz University of Technology Graz / Austria Computer Algorithms for Medicine Lab Graz / Austria Abstract 1 Introduction Segmentation is a key step in analyzing and processing Image segmentation is an important step in the analysis medical images. Due to the low fault tolerance in medical of medical images. It helps to study the anatomical struc- imaging, manual segmentation remains the de facto stan- ture of body parts and is useful for treatment planning and dard in this domain. Besides, efforts to automate the seg- monitoring of diseases over time. Segmentation can ei- mentation process often rely on large amounts of manu- ther be done manually by outlining the regions of an im- ally labeled data. While existing software supporting man- age by hand or with the help of semi-automatic or au- ual segmentation is rich in features and delivers accurate tomatic algorithms. A lot of research focuses on semi- results, the necessary time to set it up and get comfort- automatic and automatic algorithms, as manual segmenta- able using it can pose a hurdle for the collection of large tion can be quite tedious and time-consuming work. But datasets. even for the development of automated segmentation sys- This work introduces a client/server based online envi- tems, some ground truth has to be found, telling the system ronment, referred to as Studierfenster, that can be used to what exactly constitutes a correct segmentation. As the perform manual segmentations directly in a web browser. avoidance of errors is of especially high importance in the The aim of providing this functionality in the form of a medical domain, this ground truth is typically delivered web application is to ease the collection of ground truth by physicians, as they have the necessary expert knowl- segmentation datasets. Providing a tool that is quickly ac- edge to reliably decide what should be part of a segmen- cessible and usable on a broad range of devices, offers the tation and what not. To form the ground truth physicians potential to accelerate this process. The manual segmen- can make use of manual or semi-automated segmentation tation workflow of Studierfenster consists of dragging and techniques. dropping the input file into the browser window and slice- Software supporting such techniques usually requires a by-slice outlining the object under consideration. The final local installation on the computer of the user and some segmentation can then be exported as a file storing its con- training time to get comfortable with the extensive features tours and as a binary segmentation mask. available. This necessary preparation time can be a hurdle arXiv:1904.08610v1 [cs.CV] 18 Apr 2019 In order to evaluate the usability of Studierfenster, a user for the collection of a big amount of data, which is typi- study was performed. The user study resulted in a mean of cally needed to develop a robust automated segmentation 6.3 out of 7.0 possible points given by users, when asked algorithm. Web-based tools have the advantage that they about their overall impression of the tool. The evaluation require no installation time and can be adapted quickly to also provides insights into the results achievable with the the needs of a particular data collection task, without hav- tool in practice, by presenting two ground truth segmenta- ing to distribute updates to each user individually. tions performed by physicians. This work describes the development of a client/server based online environment for manual segmentation, re- Keywords: Segmentation, Web Application, Medical ferred to as Studierfenster (www.studierfenster. Image Analysis at or http://studierfenster.tugraz.at) in ∗[email protected] the rest of the work, that can be used directly in a web [email protected] browser. Thus there is no need to install any software, [email protected] as the tool is readily available in the web browser of the Proceedings of CESCG 2019: The 23rd Central European Seminar on Computer Graphics user. Another advantage is the platform independence of Studierfenster, which keeps its potential user base as big as possible. Following this first outline of the motivation behind the development of Studierfenster, Section 2 briefly discusses related work. Sections 3 and 4 then go into more detail on the implementation of Studierfenster. The expert eval- uation described in Section 5 and the user study described in Section 6 constitute the evaluation of the tool. The fi- nal Section 7 gives a short conclusion and suggests areas of improvement and approaches for future work. Figure 1: An architectural model of the mask generation process. 2 Related Work seen in Figure 1. In the following, this conversion pro- There is a wide range of offline software tools available cess will be used to describe the architecture behind the that offer sophisticated medical image analysis and pro- segmentation tool in more detail. cessing capabilities, including tools for manual segmenta- tion. Examples include 3D Slicer [4] and MeVisLab [3], [5]. The drawback of these tools is that they require a lo- 3.1 Client cal installation and are thus not readily available on any device. The process starts on the client side with the user opening Examples of actively supported web-based tools up a web browser and navigating to the domain that hosts useable for medical imaging include the OHIF the HTML, CSS and JavaScript files of the segmentation Viewer (https://viewer.ohif.org), Par- tool. These files are then transferred to the user so that the aview Glance (https://kitware.github.io/ segmentation tool can be used directly in the web browser. paraview-glance) and Slice:Drop [7], the medical Now the user is able to load a volume file in the viewer image viewer used as the basis for the development of and carry out a segmentation of some area of interest. The Studierfenster. While some tools, like the OHIF Viewer, resulting segmentation contours are all stored in JavaScript provide simple analysis tools like a ruler for length variables for now. If the user decides to save the seg- measurements or annotation tools, others, like Paraview mentation contours directly as a file in the Visualization Glance and Slice:Drop, provide only visualization ca- Toolkit (VTK) [10] format and without conversion to an pabilities. What is missing is a tool that provides more NRRD volume mask, no additional communication with sophisticated analysis tools or even processing routines the server is necessary. The process of carrying out a seg- directly in the web-browser. mentation and saving only its contours as a VTK file thus makes no use of the server backend. 3 Software Architecture 3.2 Server This section gives a high-level overview of the architec- The primary component of the server backend is the tural model behind the segmentation tool developed in this Python Flask server instance, as it is responsible for han- work. dling all the communication with the client. The first mo- Slice:Drop, which is the medical image viewer this tool ment this Python Flask server comes into play is during is built upon, uses a purely client-oriented approach. This the process of converting the segmentation contours to an means that all the necessary computations for visualiza- NRRD volume mask. If the user decides to do so, the seg- tion are carried out on the client using JavaScript and no mentation contours are internally written to a VTK file on files have to be uploaded to the host server. The most re- the client. This file is then immediately uploaded to the cent version of Slice:Drop at the time of writing is lim- server, however. To be able to construct an NRRD volume ited in its functionality, however. While it does provide mask with the same size, spacing, and orientation as the a volume rendering view and three 2D views in the ax- original file, the corresponding information of the original ial, sagittal and coronal direction, it does not provide any file has to be uploaded additionally. In order to not having image processing capabilities. For the presented segmen- to upload the entire original file, this metadata is extracted tation extension of Slice:Drop, an additional server back- from the file on the client and then uploaded to the server end was developed. An exemplary use case of the server as a small separate JSON file. backend is the conversion of the segmentation contours to Once the segmentation and the metadata file are both a filled Nearly Raw Raster Data (NRRD) volume mask. uploaded, the client asks the server to invoke the C++ The architectural scheme behind this conversion can be volume mask generation program, which is explained in Proceedings of CESCG 2019: The 23rd Central European Seminar on Computer Graphics more detail in Section 4.3. During the conversion process, the C++ program continuously reports the progress to the Python Flask server, which then hands over the progress information to the client. As soon as the conversion is finished, the C++ program writes the NRRD volume to the file system of the server, from where it is handed over by the Python Flask server to the client for downloading. Due to the modular design of the server backend, it is also possible to integrate other processing capabilities into it. An exemplary additional server module, which was in- tegrated to prove said modularity, is a volume file con- verter. The converter takes volume files as input and pro- duces a volume file in the NRRD file format.
Load more

Recommended publications
  • Image Segmentation Using K-Means Clustering and Thresholding
    International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395 -0056 Volume: 03 Issue: 05 | May-2016 www.irjet.net p-ISSN: 2395-0072 Image Segmentation using K-means clustering and Thresholding Preeti Panwar1, Girdhar Gopal2, Rakesh Kumar3 1M.Tech Student, Department of Computer Science & Applications, Kurukshetra University, Kurukshetra, Haryana 2Assistant Professor, Department of Computer Science & Applications, Kurukshetra University, Kurukshetra, Haryana 3Professor, Department of Computer Science & Applications, Kurukshetra University, Kurukshetra, Haryana ------------------------------------------------------------***------------------------------------------------------------ Abstract - Image segmentation is the division or changes in intensity, like edges in an image. Second separation of an image into regions i.e. set of pixels, pixels category is based on partitioning an image into regions in a region are similar according to some criterion such as that are similar according to some predefined criterion. colour, intensity or texture. This paper compares the color- Threshold approach comes under this category [4]. based segmentation with k-means clustering and thresholding functions. The k-means used partition cluster Image segmentation methods fall into different method. The k-means clustering algorithm is used to categories: Region based segmentation, Edge based partition an image into k clusters. K-means clustering and segmentation, and Clustering based segmentation, thresholding are used in this research
    [Show full text]
  • Computer Vision Segmentation and Perceptual Grouping
    CS534 A. Elgammal Rutgers University CS 534: Computer Vision Segmentation and Perceptual Grouping Ahmed Elgammal Dept of Computer Science Rutgers University CS 534 – Segmentation - 1 Outlines • Mid-level vision • What is segmentation • Perceptual Grouping • Segmentation by clustering • Graph-based clustering • Image segmentation using Normalized cuts CS 534 – Segmentation - 2 1 CS534 A. Elgammal Rutgers University Mid-level vision • Vision as an inference problem: – Some observation/measurements (images) – A model – Objective: what caused this measurement ? • What distinguishes vision from other inference problems ? – A lot of data. – We don’t know which of these data may be useful to solve the inference problem and which may not. • Which pixels are useful and which are not ? • Which edges are useful and which are not ? • Which texture features are useful and which are not ? CS 534 – Segmentation - 3 Why do these tokens belong together? It is difficult to tell whether a pixel (token) lies on a surface by simply looking at the pixel CS 534 – Segmentation - 4 2 CS534 A. Elgammal Rutgers University • One view of segmentation is that it determines which component of the image form the figure and which form the ground. • What is the figure and the background in this image? Can be ambiguous. CS 534 – Segmentation - 5 Grouping and Gestalt • Gestalt: German for form, whole, group • Laws of Organization in Perceptual Forms (Gestalt school of psychology) Max Wertheimer 1912-1923 “there are contexts in which what is happening in the whole cannot be deduced from the characteristics of the separate pieces, but conversely; what happens to a part of the whole is, in clearcut cases, determined by the laws of the inner structure of its whole” Muller-Layer effect: This effect arises from some property of the relationships that form the whole rather than from the properties of each separate segment.
    [Show full text]
  • Image Segmentation Based on Histogram Analysis Utilizing the Cloud Model
    Computers and Mathematics with Applications 62 (2011) 2824–2833 Contents lists available at SciVerse ScienceDirect Computers and Mathematics with Applications journal homepage: www.elsevier.com/locate/camwa Image segmentation based on histogram analysis utilizing the cloud model Kun Qin a,∗, Kai Xu a, Feilong Liu b, Deyi Li c a School of Remote Sensing Information Engineering, Wuhan University, Wuhan, 430079, China b Bahee International, Pleasant Hill, CA 94523, USA c Beijing Institute of Electronic System Engineering, Beijing, 100039, China article info a b s t r a c t Keywords: Both the cloud model and type-2 fuzzy sets deal with the uncertainty of membership Image segmentation which traditional type-1 fuzzy sets do not consider. Type-2 fuzzy sets consider the Histogram analysis fuzziness of the membership degrees. The cloud model considers fuzziness, randomness, Cloud model Type-2 fuzzy sets and the association between them. Based on the cloud model, the paper proposes an Probability to possibility transformations image segmentation approach which considers the fuzziness and randomness in histogram analysis. For the proposed method, first, the image histogram is generated. Second, the histogram is transformed into discrete concepts expressed by cloud models. Finally, the image is segmented into corresponding regions based on these cloud models. Segmentation experiments by images with bimodal and multimodal histograms are used to compare the proposed method with some related segmentation methods, including Otsu threshold, type-2 fuzzy threshold, fuzzy C-means clustering, and Gaussian mixture models. The comparison experiments validate the proposed method. ' 2011 Elsevier Ltd. All rights reserved. 1. Introduction In order to deal with the uncertainty of image segmentation, fuzzy sets were introduced into the field of image segmentation, and some methods were proposed in the literature.
    [Show full text]
  • Image Segmentation with Artificial Neural Networs Alongwith Updated Jseg Algorithm
    IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-ISSN: 2278-2834,p- ISSN: 2278-8735.Volume 9, Issue 4, Ver. II (Jul - Aug. 2014), PP 01-13 www.iosrjournals.org Image Segmentation with Artificial Neural Networs Alongwith Updated Jseg Algorithm Amritpal Kaur*, Dr.Yogeshwar Randhawa** M.Tech ECE*, Head of Department** Global Institute of Engineering and Technology Abstract: Image segmentation plays a very crucial role in computer vision. Computational methods based on JSEG algorithm is used to provide the classification and characterization along with artificial neural networks for pattern recognition. It is possible to run simulations and carry out analyses of the performance of JSEG image segmentation algorithm and artificial neural networks in terms of computational time. A Simulink is created in Matlab software using Neural Network toolbox in order to study the performance of the system. In this paper, four windows of size 9*9, 17*17, 33*33 and 65*65 has been used. Then the corresponding performance of these windows is compared with ANN in terms of their computational time. Keywords: ANN, JSEG, spatial segmentation, bottom up, neurons. I. Introduction Segmentation of an image entails the partition and separation of an image into numerous regions of related attributes. The level to which segmentation is carried out as well as accepted depends on the particular and exact problem being solved. It is the one of the most significant constituent of image investigation and pattern recognition method and still considered as the most challenging and difficult problem in field of image processing. Due to enormous applications, image segmentation has been investigated for previous thirty years but, still left over a hard problem.
    [Show full text]
  • Inviwo — a Visualization System with Usage Abstraction Levels
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, VOL X, NO. Y, MAY 2019 1 Inviwo — A Visualization System with Usage Abstraction Levels Daniel Jonsson,¨ Peter Steneteg, Erik Sunden,´ Rickard Englund, Sathish Kottravel, Martin Falk, Member, IEEE, Anders Ynnerman, Ingrid Hotz, and Timo Ropinski Member, IEEE, Abstract—The complexity of today’s visualization applications demands specific visualization systems tailored for the development of these applications. Frequently, such systems utilize levels of abstraction to improve the application development process, for instance by providing a data flow network editor. Unfortunately, these abstractions result in several issues, which need to be circumvented through an abstraction-centered system design. Often, a high level of abstraction hides low level details, which makes it difficult to directly access the underlying computing platform, which would be important to achieve an optimal performance. Therefore, we propose a layer structure developed for modern and sustainable visualization systems allowing developers to interact with all contained abstraction levels. We refer to this interaction capabilities as usage abstraction levels, since we target application developers with various levels of experience. We formulate the requirements for such a system, derive the desired architecture, and present how the concepts have been exemplary realized within the Inviwo visualization system. Furthermore, we address several specific challenges that arise during the realization of such a layered architecture, such as communication between different computing platforms, performance centered encapsulation, as well as layer-independent development by supporting cross layer documentation and debugging capabilities. Index Terms—Visualization systems, data visualization, visual analytics, data analysis, computer graphics, image processing. F 1 INTRODUCTION The field of visualization is maturing, and a shift can be employing different layers of abstraction.
    [Show full text]
  • A Review on Image Segmentation Clustering Algorithms Devarshi Naik , Pinal Shah
    Devarshi Naik et al, / (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 5 (3) , 2014, 3289 - 3293 A Review on Image Segmentation Clustering Algorithms Devarshi Naik , Pinal Shah Department of Information Technology, Charusat University CSPIT, Changa, di.Anand, GJ,India Abstract— Clustering attempts to discover the set of consequential groups where those within each group are more closely related to one another than the others assigned to different groups. Image segmentation is one of the most important precursors for image processing–based applications and has a crucial impact on the overall performance of the developed systems. Robust segmentation has been the subject of research for many years, but till now published work indicates that most of the developed image segmentation algorithms have been designed in conjunction with particular applications. The aim of the segmentation process consists of dividing the input image into several disjoint regions with similar characteristics such as colour and texture. Keywords— Clustering, K-means, Fuzzy C-means, Expectation Maximization, Self organizing map, Hierarchical, Graph Theoretic approach. Fig. 1 Similar data points grouped together into clusters I. INTRODUCTION II. SEGMENTATION ALGORITHMS Images are considered as one of the most important Image segmentation is the first step in image analysis medium of conveying information. The main idea of the and pattern recognition. It is a critical and essential image segmentation is to group pixels in homogeneous component of image analysis system, is one of the most regions and the usual approach to do this is by ‘common difficult tasks in image processing, and determines the feature. Features can be represented by the space of colour, quality of the final result of analysis.
    [Show full text]
  • A Client/Server Based Online Environment for the Calculation of Medical Segmentation Scores
    A Client/Server based Online Environment for the Calculation of Medical Segmentation Scores Maximilian Weber, Daniel Wild, Jürgen Wallner, Jan Egger Abstract— Image segmentation plays a major role in medical for medical image segmentation are often very large due to the imaging. Especially in radiology, the detection and development broadly ranged possibilities offered for all areas of medical of tumors and other diseases can be supported by image image processing. Often huge updates are needed, which segmentation applications. Tools that provide image require nightly builds, even if only the functionality of segmentation and calculation of segmentation scores are not segmentation is needed by the user. Examples are 3D Slicer available at any time for every device due to the size and scope [8], MeVisLab [9] and MITK [10], [11], which have installers of functionalities they offer. These tools need huge periodic that are already over 1 GB. In addition, in sensitive updates and do not properly work on old or weak systems. environments, like hospitals, it is mostly not allowed at all to However, medical use-cases often require fast and accurate install these kind of open-source software tools, because of results. A complex and slow software can lead to additional security issues and the potential risk that patient records and stress and thus unnecessary errors. The aim of this contribution data is leaked to the outside. is the development of a cross-platform tool for medical segmentation use-cases. The goal is a device-independent and The second is the need of software for easy and stable always available possibility for medical imaging including manual segmentation training.
    [Show full text]
  • Medical Image Processing Software
    Wohlers Report 2018 Medical Image Processing Software Medical image Patient-specific medical devices and anatomical models are almost always produced using radiological imaging data. Medical image processing processing software is used to translate between radiology file formats and various software AM file formats. Theoretically, any volumetric radiological imaging dataset by Andy Christensen could be used to create these devices and models. However, without high- and Nicole Wake quality medical image data, the output from AM can be less than ideal. In this field, the old adage of “garbage in, garbage out” definitely applies. Due to the relative ease of image post-processing, computed tomography (CT) is the usual method for imaging bone structures and contrast- enhanced vasculature. In the dental field and for oral- and maxillofacial surgery, in-office cone-beam computed tomography (CBCT) has become popular. Another popular imaging technique that can be used to create anatomical models is magnetic resonance imaging (MRI). MRI is less useful for bone imaging, but its excellent soft tissue contrast makes it useful for soft tissue structures, solid organs, and cancerous lesions. Computed tomography: CT uses many X-ray projections through a subject to computationally reconstruct a cross-sectional image. As with traditional 2D X-ray imaging, a narrow X-ray beam is directed to pass through the subject and project onto an opposing detector. To create a cross-sectional image, the X-ray source and detector rotate around a stationary subject and acquire images at a number of angles. An image of the cross-section is then computed from these projections in a post-processing step.
    [Show full text]
  • Markov Random Fields and Stochastic Image Models
    Markov Random Fields and Stochastic Image Models Charles A. Bouman School of Electrical and Computer Engineering Purdue University Phone: (317) 494-0340 Fax: (317) 494-3358 email [email protected] Available from: http://dynamo.ecn.purdue.edu/»bouman/ Tutorial Presented at: 1995 IEEE International Conference on Image Processing 23-26 October 1995 Washington, D.C. Special thanks to: Ken Sauer Suhail Saquib Department of Electrical School of Electrical and Computer Engineering Engineering University of Notre Dame Purdue University 1 Overview of Topics 1. Introduction (b) Non-Gaussian MRF's 2. The Bayesian Approach i. Quadratic functions ii. Non-Convex functions 3. Discrete Models iii. Continuous MAP estimation (a) Markov Chains iv. Convex functions (b) Markov Random Fields (MRF) (c) Parameter Estimation (c) Simulation i. Estimation of σ (d) Parameter estimation ii. Estimation of T and p parameters 4. Application of MRF's to Segmentation 6. Application to Tomography (a) The Model (a) Tomographic system and data models (b) Bayesian Estimation (b) MAP Optimization (c) MAP Optimization (c) Parameter estimation (d) Parameter Estimation 7. Multiscale Stochastic Models (e) Other Approaches (a) Continuous models 5. Continuous Models (b) Discrete models (a) Gaussian Random Process Models 8. High Level Image Models i. Autoregressive (AR) models ii. Simultaneous AR (SAR) models iii. Gaussian MRF's iv. Generalization to 2-D 2 References in Statistical Image Modeling 1. Overview references [100, 89, 50, 54, 162, 4, 44] 4. Simulation and Stochastic Optimization Methods [118, 80, 129, 100, 68, 141, 61, 76, 62, 63] 2. Type of Random Field Model 5. Computational Methods used with MRF Models (a) Discrete Models i.
    [Show full text]
  • Getting Started First Steps with Mevislab
    Getting Started First Steps with MeVisLab 1 Getting Started Getting Started Copyright © 2003-2021 MeVis Medical Solutions Published 2021-05-11 2 Table of Contents 1. Before We Start ................................................................................................................... 10 1.1. Welcome to MeVisLab ............................................................................................... 10 1.2. Coverage of the Document ........................................................................................ 10 1.3. Intended Audience ..................................................................................................... 11 1.4. Conventions Used in This Document .......................................................................... 11 1.4.1. Activities ......................................................................................................... 11 1.4.2. Formatting ...................................................................................................... 11 1.5. How to Read This Document ..................................................................................... 12 1.6. Related MeVisLab Documents ................................................................................... 12 1.7. Glossary (abbreviated) ............................................................................................... 13 2. The Nuts and Bolts of MeVisLab ........................................................................................... 15 2.1. MeVisLab Basics ......................................................................................................
    [Show full text]
  • Segmentation of Brain Tumors from MRI Images Using Convolutional Autoencoder
    applied sciences Article Segmentation of Brain Tumors from MRI Images Using Convolutional Autoencoder Milica M. Badža 1,2,* and Marko C.ˇ Barjaktarovi´c 2 1 Innovation Center, School of Electrical Engineering, University of Belgrade, 11120 Belgrade, Serbia 2 School of Electrical Engineering, University of Belgrade, 11120 Belgrade, Serbia; [email protected] * Correspondence: [email protected]; Tel.: +381-11-321-8455 Abstract: The use of machine learning algorithms and modern technologies for automatic segmen- tation of brain tissue increases in everyday clinical diagnostics. One of the most commonly used machine learning algorithms for image processing is convolutional neural networks. We present a new convolutional neural autoencoder for brain tumor segmentation based on semantic segmenta- tion. The developed architecture is small, and it is tested on the largest online image database. The dataset consists of 3064 T1-weighted contrast-enhanced magnetic resonance images. The proposed architecture’s performance is tested using a combination of two different data division methods, and two different evaluation methods, and by training the network with the original and augmented dataset. Using one of these data division methods, the network’s generalization ability in medical diagnostics was also tested. The best results were obtained for record-wise data division, training the network with the augmented dataset. The average accuracy classification of pixels is 99.23% and 99.28% for 5-fold cross-validation and one test, respectively, and the average dice coefficient is 71.68% and 72.87%. Considering the achieved performance results, execution speed, and subject generalization ability, the developed network has great potential for being a decision support system Citation: Badža, M.M.; Barjaktarovi´c, in everyday clinical practice.
    [Show full text]
  • GPU-Based Multi-Volume Rendering of Complex Data in Neuroscience and Neurosurgery
    DISSERTATION GPU-based Multi-Volume Rendering of Complex Data in Neuroscience and Neurosurgery ausgeführt zum Zwecke der Erlangung des akademischen Grades eines Doktors der technischen Wissenschaften unter der Leitung von Ao.Univ.Prof. Dipl.-Ing. Dr.techn. Eduard Gröller, Institut E186 für Computergraphik und Algorithmen, und Dipl.-Ing. Dr.techn. Markus Hadwiger, VRVis Zentrum für Virtual Reality und Visualisierung, und Dipl.-Math. Dr.techn. Katja Bühler, VRVis Zentrum für Virtual Reality und Visualisierung, eingereicht an der Technischen Universität Wien, bei der Fakultät für Informatik, von Dipl.-Ing. (FH) Johanna Beyer, Matrikelnummer 0426197, Gablenzgasse 99/24 1150 Wien Wien, im Oktober 2009 DISSERTATION GPU-based Multi-Volume Rendering of Complex Data in Neuroscience and Neurosurgery Abstract Recent advances in image acquisition technology and its availability in the medical and bio-medical fields have lead to an unprecedented amount of high-resolution imaging data. However, the inherent complexity of this data, caused by its tremendous size, complex structure or multi-modality poses several challenges for current visualization tools. Recent developments in graphics hardware archi- tecture have increased the versatility and processing power of today’s GPUs to the point where GPUs can be considered parallel scientific computing devices. The work in this thesis builds on the current progress in image acquisition techniques and graphics hardware architecture to develop novel 3D visualization methods for the fields of neurosurgery and neuroscience. The first part of this thesis presents an application and framework for plan- ning of neurosurgical interventions. Concurrent GPU-based multi-volume ren- dering is used to visualize multiple radiological imaging modalities, delineating the patient’s anatomy, neurological function, and metabolic processes.
    [Show full text]