Multi-Channel Potts-Based Reconstruction for Multi-Spectral Computed Tomography Lukas Kiefer1;2, Stefania Petra1, Martin Storath3 and Andreas Weinmann2 1 Mathematical Imaging Group, Heidelberg University, Germany 2 Department of Mathematics and Natural Sciences, University of Applied Sciences Darmstadt, Germany 3 Department of Applied Natural Sciences and Humanities, University of Applied Sciences Würzburg-Schweinfurt, Germany Abstract. We consider reconstructing multi-channel images from measurements performed by photon-counting and energy-discriminating detectors in the setting of multi-spectral X- ray computed tomography (CT). Our aim is to exploit the strong structural correlation that is known to exist between the channels of multi-spectral CT images. To that end, we adopt the multi-channel Potts prior to jointly reconstruct all channels. This nonconvex prior produces piecewise constant solutions with strongly correlated channels. In particular, edges are strictly enforced to have the same spatial position across channels which is a benefit over TV-based methods whose channel-couplings are typically less strict. We consider the Potts prior in two frameworks: (a) in the context of a variational Potts model, and (b) in a Potts-superiorization approach that perturbs the iterates of a basic iterative least squares solver. We identify an al- ternating direction method of multipliers (ADMM) approach as well as a Potts-superiorized conjugate gradient method as particularly suitable. In numerical experiments, we compare the Potts prior based approaches to existing TV-type approaches on realistically simulated multi- spectral CT data and obtain improved reconstruction for compound solid bodies. Keywords: multi-spectral computed tomography, image reconstruction, structural regulariza- tion, multi-channel Potts prior, superiorization, Potts model, piecewise constant Mumford- Shah model, non-convex optimization, ADMM 1. Introduction We consider the multi-channel reconstruction problem which arises in multi-spectral X-ray computed tomography (CT). X-ray imaging entails polychromatic X-ray sources, i.e. emitted photons have a spectrum of energies. Conventional energy-integrating CT detectors do not capture different energies. However, there are materials which may not be distinguished from arXiv:2009.05814v2 [math.NA] 10 Mar 2021 one another in conventional CT as their linear attenuation coefficients (LAC) are nearly equal. Yet, their LAC’s might differ when the whole energy spectrum is considered. Thus, such materials may be distinguished, when measurements at multiple energy-levels are available. In this paper we exploit this phenomenon by using energy-discriminating photon counting detectors [67]. As in conventional CT, due to acquisition noise, sampling effects and modeling effects, the task of reconstructing volume functions from multi-spectral CT data corresponds to solving an ill-posed inverse problem. This calls for regularization which is often performed by imposing prior structural knowledge on the unknown solution in the form of a penalty called prior function. Typically, the prior function is made part of an energy minimization Multi-Channel Potts-Based Reconstruction for Multi-Spectral Computed Tomography 2 model of Tikhonov-type; see, e.g., [62, 46]. In principle, one could apply conventional priors and data models in CT to reconstruct separately each channel of the multi-channel images in multi-spectral CT. However, it is well-known that the channel images in multi-spectral CT are strongly correlated: transitions between materials manifest as edges in the channel images and these edges share the same spatial positions across the channels. Therefore, an appropriate prior should enforce this spatial correlation of the channels and aid the reconstruction of particularly noise-prone channels on hand of the less problematic channels. To this end, multi-channel extensions of the total variation prior have been proposed [36, 62, 46, 74, 47]. Typically, these TV-type priors enforce inter-channel correlations by imposing higher costs if the edges are not aligned over the channels. However, these priors are essentially based on penalizing the `1-norm of the channel-wise gradients, and do not necessarily ensure that the resulting boundaries between materials completely align over the channels. Another side- effect of penalizing the `1-norm of the gradient, is that it leads to contrast reduction, i.e. in the reconstructed image the jump heights between regions with constant intensities are reduced. In this paper we propose the use of the Potts prior for the reconstruction of compound solid bodies from multi-spectral CT measurements. The Potts prior penalizes the length of the jump set of the image, i.e. the support of the gradient as a subset of the domain. As a result, it produces piecewise constant images with sharply localized edges such that the total boundary length of all segments is small. Further, the Potts prior has no contrast diminishing effect [72]. The Potts prior is an established nonconvex regularizer for joint image reconstruction and partitioning as well as for the reconstruction of approximately piecewise constant images given via indirect measurements; see Section 1.1 for a discussion on related work. Its multi-channel extension –the multi-channel Potts prior– has the appealing property that jumps in multiple channels only cost once if they are located in the same spatial position. Therefore, in comparison to TV-type priors, the multi-channel Potts prior produces sharply localized edges which are strictly enforced to share spatial positions across channels. The strong channel-coupling provided by the multi-channel Potts prior is especially attractive for multi-spectral CT reconstruction of compound solid bodies. We illustrate this by comparing the multi-channel Potts prior to existing TV-based priors. We note that for piecewise smooth images, as they often appear in medical applications, the use of piecewise smooth Mumford- Shah models is advisable [4, 34, 42]. In the context of smooth signals, the result of the Potts prior may be interpreted as a partitioning of the signal. Being nonsmooth and nonconvex, the (multi-channel) Potts prior calls for tailored algorithmic approaches. To this end, we consider two approaches based on energy minimization and superiorization, respectively. In particular, we apply the multi-channel Potts prior within the variational Potts model (also known as the piecewise constant Mumford-Shah model) and within a new Potts-based superiorization approach. 1.1. Related Work We first review work related to multi-spectral CT, followed by work on the Potts model. We conclude with work on superiorization. The reconstruction problem and priors in multi-spectral CT. We start out with related work concerning the reconstruction problem in multi-spectral CT. Kazantsev et al. [46] consider multi-spectral measurements obtained from energy-discriminating photon-counting detectors and propose a prior based on directional total variation (dTV) [6] to exploit structural similarities between channels. The reference channels for dTV are chosen probabilistically in each iteration on the basis of signal-to-noise ratios. The authors compare their method to other existing TV-based approaches by reconstructing the geocore phantom, which we also consider Multi-Channel Potts-Based Reconstruction for Multi-Spectral Computed Tomography 3 in our experiments. Toivanen et al. [74] study variational methods for the reconstruction of three channels obtained by sequential measurements following low dose acquisition protocols. In [36], the authors propose an approach of compressive sensing type, where the multi-channel reconstruction is modeled as the sum of a low-rank and a sparse matrix. In [62], the authors use total nuclear variation to regularize the reconstruction and enforce structural correlation between channels. Furthermore, channel-coupling regularizers based on tensor nuclear norms are proposed in [65]. Another interesting problem in multi-spectral CT –apart from the reconstruction problem– is the material decomposition problem. It describes the task of determining the pixel-wise material composition after the multi-channel image has been reconstructed (typically with channel-wise filtered backprojection). Variational approaches to the material decomposition problem were proposed in [54, 32, 31]. The Potts model. The Potts prior is often used in the context of energy minimization methods. This class of methods model the result as the minimizer of an energy function that comprises a data fidelity term and a regularizing term. Thereby, the result is close to the available data and it is regularized by enforcing prior knowledge. The Potts prior together with a data fidelity term yields the Potts model. We start with work on the Potts model for directly sensed image data. Originally named after R. Potts due to his work on statistical mechanics [58], Geman and Geman [37] adopted the Potts model for the edge- preserving reconstruction of piecewise constant images and proposed an algorithmic approach based on simulated annealing. The problem was first considered from the viewpoint of variational calculus by Mumford and Shah [55]. Shortly afterwards, Ambrosio and Tortorelli proposed approximations by smooth functionals which are frequently adopted for algorithmic approaches [1]. Other popular algorithmic approaches use active contours [26], graph cuts [12], convex relaxations [57, 25] and the ADMM [71]. We proceed with related