UCLA Electronic Theses and Dissertations
Total Page:16
File Type:pdf, Size:1020Kb
UCLA UCLA Electronic Theses and Dissertations Title High Throughput Image Labeling and Lung/Lobar Segmentation on Chest CT using Deep Learning Permalink https://escholarship.org/uc/item/4p06c8qq Author Wang, Xiaoyong N/A Publication Date 2019 Peer reviewed|Thesis/dissertation eScholarship.org Powered by the California Digital Library University of California UNIVERSITY OF CALIFORNIA Los Angeles A dissertation submitted in partial satisfaction of the requirements for the degree Doctor of Philosophy in Bioengineering by Xiaoyong Wang 2019 © Copyright by Xiaoyong Wang 2019 ABSTRACT OF THE DISSERTATION High Throughput Image Labeling and Lung/Lobar Segmentation on Chest CT using Deep Learning by Xiaoyong Wang Doctor of Philosophy in Bioengineering University of California, Los Angeles, 2019 Professor Alex Anh-Tuan Bui, Co-Chair Professor Matthew Sherman Brown, Co-Chair Chest CT is the most common modality in thoracic imaging, especially for diagnosis of diffuse lung disease and lung cancer screening. When mining image data from PACS or clinical trials or processing large volumes of data without curation, the relevant scans must be identified among irrelevant or redundant data. Only images acquired with appropriate technical factors, patient positioning, and physiological conditions may be applicable to a particular image processing or machine learning task. Following identification of appropriate images for processing, accurate lung and lobar segmentation is a pre-requisite for the subsequent quantitative image analysis, e.g. air trapping measurement, emphysema scoring, fibrosis scoring, nodule detection, etc. Fully automated segmentation on a diverse spectrum of pathological lungs is still a challenge in clinical practice. Both the labeling and segmentation steps currently require ii significant manual intervention by image analysts and are prohibitive for large scale processing of big data. The goal of this dissertation is to fully automate the labeling and segmentation tasks in chest CT with high accuracy. In this dissertation, an image based high throughput labeling pipeline using deep learning was proposed, it aimed to identify anatomical coverage, scan direction, scan posture, lung coverage completeness, contrast usage and breath-hold types. They were posed as different classification problems and some of them required further segmentation and identification of anatomical landmarks. Images of different view planes were used depending on the specific classification problem. All of our models achieved an accuracy > 99% on their respective test sets across different tasks using a research database from multi-center clinical trials. Based on the comprehensive labels from deep learning models, an optimal image series at each time point for a given patient was selected prior to lung and lobar segmentation. Two fully convolutional networks were proposed to sequentially achieve accurate lung and lobar segmentation. Firstly, a 2D ResNet-101 based network was used for lung segmentation and 575 chest CT scans from multi-center clinical trials were used with radiologist approved lung segmentation. Secondly, a 3D DenseNet based network is applied to segment the 5 lobes and a total of 1280 different CT scans were used with radiologist approved lobar segmentation as ground truth. The dataset included various pathological lung diseases and stratified sampling was used to form the training and test sets with a ratio of 4:1 to ensure a balanced number and type of abnormality were present. Using 5-fold cross validation a mean Dice coefficient of 0.988 ± 0.012 and Average Surface Distance of 0.562 ± 0.49 mm were achieved by the proposed 2D CNN iii on lung segmentation. The 3D DenseNet on lobar segmentation achieved a Dice score of 0.959 ± 0.087 and an Average surface distance of 0.873 ± 0.61mm. iv The dissertation of Xiaoyong Wang is approved. Jonathan G Goldin Denise R Aberle Dan Ruan William Hsu Alex Anh-Tuan Bui, Co-Chair Matthew S Brown, Co-Chair University of California, Los Angeles 2019 v Dedicated to my beloved family and friends! vi Table of Contents LIST OF FIGURES ............................................................................................................................................ x LIST OF TABLES ............................................................................................................................................xiii ACKNOWLEGEMENTS ................................................................................................................................. xiv VITA ............................................................................................................................................................. xvi Chapter 1: Introduction ................................................................................................................................ 1 1.1 Overview ............................................................................................................................................. 1 1.2 Motivation ........................................................................................................................................... 2 1.3 Deep learning in medical imaging ....................................................................................................... 5 1.3.1 Classification ................................................................................................................................ 5 1.3.2 Detection ...................................................................................................................................... 7 1.3.3 Segmentation ............................................................................................................................... 9 1.4 Contributions .................................................................................................................................... 11 1.5 Organization of this dissertation ....................................................................................................... 12 Chapter 2: Automated image labeling on chest CT .................................................................................... 13 2.1 Anatomical coverage......................................................................................................................... 14 2.1.1 Introduction ............................................................................................................................... 14 2.1.2 Methods ..................................................................................................................................... 16 2.1.3 Materials .................................................................................................................................... 18 2.1.4 Results ........................................................................................................................................ 21 2.1.5 Discussion ................................................................................................................................... 22 2.1.6 Conclusion .................................................................................................................................. 26 2.2 Scan direction .................................................................................................................................... 26 2.2.1 Introduction ............................................................................................................................... 26 2.2.2 Materials and Methods .............................................................................................................. 27 2.2.3 Results ........................................................................................................................................ 29 2.2.4 Discussion ................................................................................................................................... 30 2.2.5 Conclusion .................................................................................................................................. 32 2.3 Scan posture...................................................................................................................................... 32 2.3.1 Introduction ............................................................................................................................... 32 2.3.2 Materials and Methods .............................................................................................................. 33 2.3.3 Results ........................................................................................................................................ 35 2.3.4 Discussion ................................................................................................................................... 37 vii 2.3.5 Conclusion .................................................................................................................................. 40 2.4 Lung coverage completeness ............................................................................................................ 40 2.4.1 Introduction ............................................................................................................................... 40 2.4.2 Materials and methods .............................................................................................................. 40 2.4.3 Results .......................................................................................................................................