Linköping University Medical Dissertations No. 1050
Quantifying image quality in diagnostic radiology using simulation of the imaging system and model observers
Gustaf Ullman
Radiation Physics, Department of Medicine and Health Faculty of Health Sciences Linköping University, Sweden
Linköping 2008
©Gustaf Ullman, 2008
Cover picture/illustration: An oil painting by Gustaf Ullman representing a chest radiograph
Published articles and figures have been reprinted with the permission of the copyright holder.
Printed in Sweden by LiU‐Tryck, Linköping, Sweden, 2008
ISBN 978‐91‐7393‐952‐2 ISSN 0345‐0082
ii
Don’t worry about saving these songs! And if one of our instruments breaks, it doesn’t matter
We have fallen into the place where everything is Music.
The strumming and the flute notes rise into the atmosphere, and even if the whole world’s harp should burn up, there would still be hidden instruments playing.
So the candle flickers and goes out. We have a piece of flint and a spark.
This singing art is sea foam. The graceful movements come from a pearl somewhere on the ocean floor.
Poems reach up like spindrift and the edge of driftwood along the beach, wanting!
They derive from a slow and powerful root that we can’t see
Stop the words now. Open the window in the center of your chest, and let the spirits fly in and out.
Jalal al‐Din Rumi
iii
iv CONTENTS
1. INTRODUCTION...... 1 1.1. Radiation protection in diagnostic radiology...... 1 1.2. Optimisation of diagnostic radiology ...... 2 1.3. Optimisation using a Monte Carlo based computational model ... 2
2. OBJECTIVE ...... 5
3. MONTE CARLO BASED COMPUTATIONAL MODEL OF THE IMAGING SYSTEM...... 7 3.1. Introduction...... 7 3.2. Computational model of the x‐ray imaging systems ...... 9 3.2.1. Model of the imaging system...... 9 3.2.2. Monte Carlo simulation of photon transport...... 14 3.2.3. Scoring quantities...... 18 3.2.4. Calculated quantities...... 19 3.3. Calculation of images from the high‐resolution phantom ...... 20 3.4. Uncertainties...... 22 3.4.1. Stochastic uncertainties ...... 22 3.4.2. Systematic uncertainties...... 22
4. ASSESSMENT OF IMAGE QUALITY ...... 25 4.1. Introduction...... 25 4.2. Image quality assessment as developed in this work...... 26 4.2.1. The task...... 26 4.2.2. Model of the imaging system and patient...... 27 4.2.3. Observers...... 29 4.2.4. Figures of merit ...... 30
5. RESULTS AND DISCUSSION ...... 41 5.1. Ideal observer with a simplified patient‐model ...... 41
v Contents
5.2. Low resolution voxel phantom ...... 43 5.3. High resolution voxel phantom...... 44 5.4. Ideal observer with simple anatomical background...... 46 5.5. Correlation to human observers ...... 49 5.6. Model observers with complex anatomical background ...... 52
6. SUMMARY AND CONCLUSIONS...... 59
7. FUTURE WORK ...... 61
8. ACKNOWLEDGEMENTS ...... 63
9. REFERENCES...... 65
vi Abstract
ABSTRACT
Accurate measures of both clinical image quality and patient radiation risk are needed for successful optimisation of medical imaging with ionising radiation. Optimisation in diagnostic radiology means finding the image acquisition technique that maximises the perceived information content and minimises the radiation risk or keeps it at a reasonably low level. The assessment of image quality depends on the diagnostic task and may in addition to system and quantum noise also be hampered by overlying projected anatomy.
The main objective of this thesis is to develop methods for assessment of image quality in simulations of projection radiography. In this thesis, image quality is quantified by modelling the whole x‐ray imaging system including the x‐ray tube, patient, anti‐scatter device, image detector and the observer. This is accomplished by using Monte Carlo (MC) simulation methods that allow simultaneous estimates of measures of image quality and patient dose. Measures of image quality include the signal‐to‐noise‐ratio, SNR, of pathologic lesions and radiation risk is estimated by using organ doses to calculate the effective dose. Based on high‐resolution anthropomorphic phantoms, synthetic radiographs were calculated and used for assessing image quality with model‐observers (Laguerre‐Gauss (LG) Hotelling observer) that mimic real, human observers. Breast and particularly chest imaging were selected as study cases as these are particularly challenging for the radiologists.
In chest imaging the optimal tube voltage in detecting lung lesions was investigated in terms of their SNR and the contrast of the lesions relative to the ribs. It was found that the choice of tube voltage depends on whether SNR of the lesion or the interfering projected anatomy (i.e. the ribs) is most important for detection. The Laguerre‐Gauss (LG) Hotelling observer is influenced by the projected anatomical background and includes this into its figure‐of‐merit,
SNRhot,LG. The LG‐observer was found to be a better model of the radiologist than the ideal observer that only includes the quantum noise in its analysis. The measures of image quality derived from our model are found to correlate relatively well with the radiologist’s assessment of image quality. Therefore MC simulations can be a valuable and an efficient tool in the search for dose‐ efficient imaging systems and image acquisition schemes.
vii
List of papers
LIST OF PAPERS
This thesis is based on the following papers
I. Gustaf Ullman, Michael Sandborg, David R Dance, Martin Yaffe, Gudrun Alm Carlsson. A search for optimal x‐ray spectra in iodine contrast media mammography. Phys. Med. Biol. 50, 3143–3152 (2005)* II. Gustaf Ullman, Michael Sandborg, David R Dance, Roger Hunt, and Gudrun Alm Carlsson. Distributions of scatter to primary ratios and signal to noise ratios per pixel in digital chest imaging. Radiat Prot Dosim, 114, no 1‐3, 355‐358 (2005)* III. Gustaf Ullman, Michael Sandborg, David R Dance, Roger A Hunt and Gudrun Alm Carlsson. Towards optimization in digital chest radiography using Monte Carlo modelling. Phys Med Biol 51, 2729‐ 2743 (2006)* IV. Michael Sandborg, Anders Tingberg, Gustaf Ullman, David R Dance and Gudrun Alm Carlsson. Comparison of clinical and physical measures of image quality in chest and pelvis computed radiography at different tube voltages. Med. Phys. 33(11) 4169‐4175 (2006)* V. Gustaf Ullman, Alexandr Malusek, Michael Sandborg, David R. Dance and Gudrun Alm Carlsson. Calculation of images from an anthropomorphic chest phantom using Monte Carlo methods. Proc of SPIE 6142, (2006)* VI. Gustaf Ullman, Magnus Båth, Gudrun Alm Carlsson, David R Dance, Markku Tapiovaara, and Michael Sandborg. Development of a Monte Carlo based model for optimization using the Laguerre‐Gauss Hotelling observer. (To be submitted to Med Phys)
*Reprints have been included with the permission from the publisher
ix List of papers
Other peer reviewed papers by the author not included in the thesis
1. Gustaf Ullman, Michael Sandborg, David R Dance, Roger Hunt, and Gudrun Alm Carlsson. The influence of patient thickness, tube voltage and image detector on patient dose and detail signal to noise ratio in digital chest imaging. Radiat Prot Dosim, 114, no 1‐3, 294‐297, 2005 2. Markus Håkansson, Magnus Båth, Sara Börjesson, Susanne Kheddache, Gustaf Ullman, Lars Gunnar Månsson. Nodule detection in digital chest radiography: effect of nodule location. Radiat Prot Dosim 114, no 1‐3, 92‐96, 2005 3. R A Hunt, D R Dance, P R Bakic, A D A Maidment, M Sandborg, G Ullman and G Alm Carlsson. Calculation of the properties of digital mammograms using a computer simulation. Radiat Prot Dosim 114, no 1‐3, 395‐398, 2005 4. D R Dance, R A Hunt, P R Bakic, A D A Maidment, M Sandborg, G Ullman and G Alm Carlsson. Breast dosimetry using a high‐resolution voxel phantom. Radiat Prot Dosim 114, no 1‐3, 359‐363, 2005 5. Roger A Hunt, David R Dance, Marc Pachoud, Gudrun Alm Carlsson, Michael Sandborg, Gustaf Ullman and Francis R Verdun. Monte Carlo simulation of a mammographic test phantom. Radiat Prot Dosim, 114, no 1‐3, 432‐435, 2005.
Conference presentations
1. Ullman G, Sandborg M, Dance D R, Skarpathiotakis M, Yaffe MJ, Alm Carlsson G. (2002) A search for optimal x‐ray energy spectra in digital iodine subtraction mammography using Monte Carlo simulation of the imaging chain. Digital Mammography IWDM 2002: Proceedings of the Workshop, Bremen, Germany, June 2002. Ed. Peitgen H‐O (Springer‐ Verlag, Berlin) pp152‐154, 2002 2. M. Båth, M. Håkansson, S. Börjesson, S. Kheddache, C. Hoeschen, O. Tischenko, F. O. Bochud, F. R. Verdun, G. Ullman, L. G. Månsson. Investigation of components affecting the detection of lung nodules in digital chest radiography. Accepted for presentation at Medical Imaging, 12‐17 February 2005, San Diego, USA. Proc. SPIE 5749, 231‐242, 2005.
x List of papers
Internal reports (not reviewed)
1. Gustaf Ullman, Michael Sandborg, Roger Hunt and David R Dance. Implementation of simulation of pathologies in chest and breast imaging Report no 94, ISRN ULI‐RAD‐R‐‐94—SE, 2003 2. Gustaf Ullman, Michael Sandborg and Gudrun Alm Carlsson. Validation of a voxel‐phantom based Monte Carlo model and calibration of digital systems. Report no 95, ISRN ULI‐RAD‐R‐‐95—SE, 2003 3. Gustaf Ullman, M Sandborg, D R Dance, R Hunt and G Alm Carlsson Optimisation of chest radiology by computer modelling of image quality measures and patient effective dose Report no 97, ISRN ULI‐ RAD‐R‐‐97—SE, 2004 4. Gustaf Ullman, M Sandborg, Anders Tingberg, D R Dance, Roger Hunt and G Alm Carlsson Comparison of clinical and physical measures of image quality in chest PA and pelvis AP views at varying tube voltages Report no 98, ISRN ULI‐RAD‐R‐‐98—SE, 2004 5. Gustaf Ullman, M Sandborg, D R Dance, M Båth, M Håkansson, S Börjesson, R Hunt and G Alm Carlsson On the extent of quantum noise limitation in digital chest radiography Report no 99, ISRN ULI‐RAD‐R‐‐ 99—SE, 2004 6. Gustaf Ullman, Michael Sandborg, David R Dance, Roger Hunt and Gudrun Alm Carlsson Distributions of scatter‐to‐primary and signal‐to‐ noise ratios per pixel in digital chest imaging Report no 100, ISRN ULI‐ RAD‐R‐‐100—SE, 2004
xi
Abbreviations
ABBREVIATIONS
AGD Average glandular dose ALARA As low as reasonable achievable APR Apical pulmonary region AUC Area under the ROC curve BKE Background known exactly BV Background varying C Contrast CC Cranio‐caudal C/CB Nodule‐to‐bone contrast Crel Relative contrast DQE Detective quantum efficiency E Effective dose FN False negative FOM Figure of merit FP False positive Ht Equivalent dose HIL Hilar region Kc, air Collision air kerma LG Laguerre‐Gauss LAT Lateral pulmonary region LME Lower mediastinal region LNT Linear non‐threshold hypothesis MC Monte Carlo MTF Modulation transfer function NPS Noise power spectrum PA Posterior Anterior RET Retrocardial region ROC Receiver operating characteristics SKE Signal known exactly SNR Signal‐to‐noise ratio SNRhot, LG Laguerre‐Gauss Hotelling observer signal‐to‐noise ratio SNRI Ideal observer signal‐to‐noise ratio SNRp Signal‐to‐noise ratio per pixel TN True negative
xiii List of papers
TP True positive UME Upper mediastinal region VGA Visual grading analysis VGAS VGA score
p ε A Energy imparted per unit area from primary photons s ε A Energy imparted per unit area from scattered photons
λ p Mean energy imparted per primary photon 2 λ p Mean squared energy imparted per primary photon
λ s Mean energy imparted per scattered photon 2 λ s Mean squared energy imparted per scattered photon
xiv Introduction
1. INTRODUCTION
1.1. Radiation protection in diagnostic radiology Diagnostic x‐ray examinations can support the radiologist with valuable information that can be utilised to give a patient an accurate diagnosis, and subsequently a successful treatment. However, imaging with ionising radiation is also associated with a small risk for cancer induction or genetic detriment. When x‐ray photons are scattered or absorbed inside the cells of the human body, ionisations occur that can alter molecular structures and thus make harm to the cell. The most important damage to the cell is damage in the DNA since this may induce mutations. Ultimately, the damage may lead to that the cell is killed, and if enough cells are killed, the function of the tissue or organ will be deteriorated. This type of acute harm due to large radiation exposures is referred to as a deterministic effect. However, at the relatively low radiation exposures in diagnostic radiology, the damages caused by ionising radiation are often rather easily repaired. Yet, sometimes the damage on the DNA is more complex. This can cause mutations or chromosome aberrations, which in turn may lead to a modified cell but with retained reproduction capacity. In some cases, such modified cells can result in a cancer. In the case where the harmful effects of ionising radiation are only known statistically, it is referred to as a stochastic effect. The risk related to stochastic effects to a human from exposure from ionising radiation is often quantified with the effective dose, E (ICRP 1991, ICRP 2007).
According to the linear non‐threshold (LNT) hypothesis, there is a linear relation between the effective dose and risk for cancer induction (ICRP 2005) and means that the collective dose can be used as a measure of the harm to the population. The collective dose from medical radiography is according to the Swedish radiation protection authority (Andersson et al 2007) 8000 manSv per year or 0.9 mSv on average per capita, and contributes the largest fraction of the total dose to the population from man‐made sources.
Diagnostic radiology is invaluable for the health care but due to the radiation risks, radiation protection of the patient becomes an important issue. Three different principles are used for radiation protection (ICRP 2007). The first principle is justification. Ionising radiation should only be used in those situations where it brings more good than harm. The second principle is
1 Introduction optimisation. It means that, in those cases where the use of ionising radiation is justified, doses should be kept as low as reasonable achievable. This is often referred to as the ALARA (As Low As Reasonably Achievable) principle. The third principle is dose limits to the individual. However, this principle is more applicable for personnel rather than for patients in diagnostic radiology.
1.2. Optimisation of diagnostic radiology Optimisation means to balance the diagnostic information (image quality) and patient dose so as to maximize the ratio between the two; either to keep the information constant and minimize the dose or to increase information at constant dose. The dose to the patient undergoing an x‐ray examination has, in digital systems, a close relation to the quantum noise in the image. The quantum noise depends on the number of photons incident on the image detector and is approximately described with a compound poisson distribution, which takes the energy absorption properties of the detector into account. If we use too few photons, the image will be noisy and it will make it difficult or even impossible for the radiologist to give a correct diagnosis. It may also take longer time for the radiologist to give a diagnosis using a noisy image. Yet, above a certain dose level, the quantum noise may become negligible in comparison to the noise naturally present in the projected anatomy (Hoeschen et al 2005). There will therefore be limited benefit to increase the dose above this level.
How to make the trade off between the dose to the patient and the image quality is a complex subject. A key aspect for the optimisation of diagnostic radiology is to understand the relative importance of the quantum noise in the image and the structures in the projected anatomy that act as noise. Several authors including Kundel et al (1985), Samei et al (1999), Burgess et al (2001) and Håkansson et al (2005b) have acknowledged the importance of projected anatomy in relation to quantum noise. The consensus from these studies is that at normal exposures, the projected anatomy is the most important factor in hampering the detection of subtle nodules in chest radiographs and mammograms.
1.3. Optimisation using a Monte Carlo based computational model One method that has been utilised to search in a systematic way for the optimal imaging parameters in diagnostic radiology is to use a model of the imaging system, including the patient and observer, and to simulate the photon transport through the imaging system using the Monte Carlo method.
2 Introduction
With this method it is possible to simultaneously calculate the dose to the patient and measures of image quality.
However, the physical measures of image quality derived from simulations must in some sense give us information on the usefulness of the image for a radiologist to solve a specific clinical task. Our physical measures of image quality must therefore correlate to clinical measures of image quality. Two methods for assessment of clinical image quality are given attention in this work, receiver operating characteristics (ROC) (Metz 1986) and visual grading analysis (VGA) (Tingberg 2000). A challenge in this work has been to develop a model, which includes realistic measures of image quality that takes the projected anatomy into account.
3
Objective
2. OBJECTIVE
While patient doses are relatively straightforward to calculate, image quality assessment is a more complex task and crucial for the optimisation process. The main objective of this thesis is therefore to further develop methods for assessment of image quality in x‐ray projection radiography. The main method is Monte Carlo photon transport simulation (Monte Carlo model) through the whole x‐ray imaging system including a model of the image observer. As study cases, chest posterior‐anterior (PA) and mammography cranio‐caudal (CC) projections are used as these are particularly challenging for the radiologist.
The specific objectives are:
• To study how physical measures influencing image quality are distributed over the image plane (paper II)
• To develop methods for calculating physical image quality measures from simulated radiographs and search for correlations between these measures and measures of clinical image quality (papers III and IV)
• To develop patient models of higher realism and finer anatomical structures for calculation of synthetic x‐ray images to be used for image quality analysis (papers V and VI)
• To complete our model of the imaging system by including a more realistic model observer that can be used to directly make any task‐ related clinical image quality assessment from synthetic images calculated by the model (papers V and VI)
• To use our model of the imaging system towards optimisation of image quality and patient dose (paper I and III)
5
Monte Carlo model
3. MONTE CARLO BASED COMPUTATIONAL MODEL OF THE IMAGING SYSTEM
3.1. Introduction The Monte Carlo method relies on taking random samples from known distributions and is particularly useful for studying complex problems with many degrees of freedom. One of the first applications of the method was in Los Alamos, USA, during the Second World War where it was used to simulate neutron diffusion. Today, Monte Carlo methods are employed in widely diverse fields, from the evaluation of shares on the stock market (Glasserman 2003) to the calculation of energy levels of molecules with quantum Monte Carlo (Ceperley and Alder 1986).
In radiation physics, the Monte Carlo method is employed for simulating radiation transport, mathematically described by the Bolzmann equation. There are several general‐purpose computer codes available for the study of radiation transport, for example, MCNP (Monte Carlo N‐Particle transport) (Briesmeister 2000) developed in Los Alamos and designed to transport neutrons, electrons and photons; EGSnrc (Electron Gamma Shower) (Kawrakow and Rogers 2003, Nelson et al 1985), initially developed in Stanford, which transports photons and electrons; PENELOPE (PENetration and Energy Loss Of Positrons and Electrons) (Baro et al 1995) developed at University of Barcelona, and used to transports electrons, positrons and photons.
In diagnostic radiology, one of the most common applications of the Monte Carlo method is in patient dosimetry. There are several Monte Carlo computer codes that are used to estimate the effective dose. Jones and Wall (1985) used the Monte Carlo method to compute organ doses using a mathematical representation (Cristy 1980) of a human anatomy. Zankl and Wittman (2001) have developed a family of more realistic, segmented anthropomorphic voxel phantoms for organ dosimetry for external photon beams. Zankl and Petoussi‐ Henss (2002) calculated conversion factors based on the VIP man (Spitzer and Whitlock 1998) anthropomorphic model. The user‐friendly Monte Carlo computer program PCXMC by Servomaa and Tapiovaara (1998) calculates
7 Monte Carlo model organ and effective doses based on either measured air kerma‐area product or entrance air kerma values.
There are also Monte Carlo codes developed for optimisation in diagnostic radiology. Such codes rely on the fact that they are able to estimate both organ or effective doses and measures of image quality. The main application of the Monte Carlo method is for estimating the negative effect of scattered photons reaching the image detector. Chan and Doi (1985) used the Monte Carlo method to characterise scattered radiation in x‐ray imaging. Chan et al (1985) also investigated the performance of anti‐scatter grids in screen‐film imaging whereas Sandborg et al (1994a) did task‐dependent, anti‐scatter grid optimisation for digital imaging. More recently McVey et al (2003) did an optimisation study of lumbar spine radiography and Lazos et al (2003) have developed a software package for mammography. The Lazos model also includes a realistic model of the breast (Bliznakova et al 2003). Son et al (2006) have developed software that calculates images from the visual human (VIP man)(Xu et al 2000). They have used the EGSnrc code as a basis of the model, used model observers and calculated effective dose.
In this work we have used an in‐house Monte Carlo code VOXMAN adapted for conditions usually encountered in diagnostic radiology. It originates from Dance and Day (1984) and Persliden (1986) who independently developed computer programs to estimate scattered radiation in the image plane in mammography and conventional radiography, respectively. A few years later, Dance et al (1992) and Sandborg et al (1994b) merged the codes and did further validation of the computer programs. McVey et al (2003) replaced the simple homogeneous water or tissue phantoms, used in the earlier versions of the code, by a voxelised anthropomorphic male phantom developed by Zubal et al (1994). This step enabled more realistic organ dosimetry and made it possible to describe how measures of physical image quality vary in the image plane behind the patient.
The main focus of this thesis is on chest imaging. Therefore we have mainly used the VOXMAN model, adapted to simulate chest radiography. In paper I we used the version of the computer program dedicated for mammography. This computer program was further developed by Hunt et al (2005) to incorporate an anthropomorphic model of the breast developed by Bakic et al (2002). A brief description of the VOXMAN model is presented below.
8 Monte Carlo model
3.2. Computational model of the x‐ray imaging systems The Monte Carlo based computational method used in this thesis models the x‐ray imaging system and simulates photon transport from the source through patient, anti‐scatter grid and into the image detector. The computational method consists of the following components: