Metal artifact reduction in 2D CT images with self-supervised cross-domain learning.

The presence of metallic implants often introduces severe metal artifacts in the x-ray computed tomography (CT) images, which could adversely influence clinical diagnosis or dose calculation in radiation therapy. In this work, we present a novel deep-learning-based approach for metal artifact reduction (MAR). In order to alleviate the need for anatomically identical CT image pairs (i.e. metal artifact-corrupted CT image and metal artifact-free CT image) for network learning, we propose a self-supervised cross-domain learning framework. Specifically, we train a neural network to restore the metal trace region values in the given metal-free sinogram, where the metal trace is identified by the forward projection of metal masks. We then design a novel filtered backward projection (FBP) reconstruction loss to encourage the network to generate more perfect completion results and a residual-learning-based image refinement module to reduce the secondary artifacts in the reconstructed CT images. To preserve the fine structure details and fidelity of the final MAR image, instead of directly adopting convolutional neural network (CNN)-refined images as output, we incorporate the metal trace replacement into our framework and replace the metal-affected projections of the original sinogram with the prior sinogram generated by the forward projection of the CNN output. We then use the FBP algorithms for final MAR image reconstruction. We conduct an extensive evaluation on simulated and real artifact data to show the effectiveness of our design. Our method produces superior MAR results and outperforms other compelling methods. We also demonstrate the potential of our framework for other organ sites.

An irregular metal trace inpainting network for x-ray CT metal artifact reduction.

PURPOSE: Metal implants in the patient's body can generate severe metal artifacts in x-ray computed tomography (CT) images. These artifacts may cover the tissues around the metal implants in CT images and even corrupt the tissue regions, thus affecting disease diagnosis using these images. Previous deep learning metal trace inpainting methods used both valid pixels of uncorrupted areas and invalid pixels of corrupted areas to patch metal trace (i.e., the holes of removed metal-corrupted regions). Such methods cannot recover fine details well and often suffer information mismatch due to interference of invalid pixels, thus incurring considerable secondary artifacts. In this paper, we develop a new irregular metal trace inpainting network for reducing metal artifacts. METHODS: We develop a new deep learning network to patch irregular metal trace in metal-corrupted sinograms to reduce metal artifacts for isometric fan-beam CT. Our new method patches irregular metal trace in CT sinograms using only valid pixels, avoiding interference from invalid pixels. Furthermore, to enable the inpainting network to recover as many details as possible, we design an auxiliary inpainting network to suppress the probable secondary artifacts in CT images to assist fine detail restoration. The image produced by the auxiliary network is then projected onto a sinogram via a forward projection (FP) algorithm and is fused with the sinogram predicted by the inpainting network in order to predict the final recovered sinogram. Our entire network is trained end-to-end to extract cross-domain information between the sinogram domain and CT image domain. RESULTS: We compare our proposed method with two traditional and four deep learning-based metal trace inpainting methods, and with an iterative reconstruction method on four datasets: dental fillings (panoramic and local perspectives), hip prostheses, and spine fixations. We use both quantitative and qualitative indices to evaluate our method, and the analyses suggest that our method reduces the most metal artifacts and produces the best quality CT images. Additionally, our proposed method takes 0.1512 s on average to process a CT slice, which meets the clinical requirement. CONCLUSIONS: This paper proposes a new deep learning network to patch irregular metal trace in corrupted sinograms to reduce metal artifacts. Our method restores more fine details in irregular metal trace and has a superior capability on metal artifact reduction compared with state-of-the-art methods.

Promising Generative Adversarial Network Based Sinogram Inpainting Method for Ultra-Limited-Angle Computed Tomography Imaging.

Limited-angle computed tomography (CT) image reconstruction is a challenging problem in the field of CT imaging. In some special applications, limited by the geometric space and mechanical structure of the imaging system, projections can only be collected with a scanning range of less than 90°. We call this kind of serious limited-angle problem the ultra-limited-angle problem, which is difficult to effectively alleviate by traditional iterative reconstruction algorithms. With the development of deep learning, the generative adversarial network (GAN) performs well in image inpainting tasks and can add effective image information to restore missing parts of an image. In this study, given the characteristic of GAN to generate missing information, the sinogram-inpainting-GAN (SI-GAN) is proposed to restore missing sinogram data to suppress the singularity of the truncated sinogram for ultra-limited-angle reconstruction. We propose the U-Net generator and patch-design discriminator in SI-GAN to make the network suitable for standard medical CT images. Furthermore, we propose a joint projection domain and image domain loss function, in which the weighted image domain loss can be added by the back-projection operation. Then, by inputting a paired limited-angle/180° sinogram into the network for training, we can obtain the trained model, which has extracted the continuity feature of sinogram data. Finally, the classic CT reconstruction method is used to reconstruct the images after obtaining the estimated sinograms. The simulation studies and actual data experiments indicate that the proposed method performed well to reduce the serious artifacts caused by ultra-limited-angle scanning.

Two methods for reducing moving metal artifacts in cone-beam CT.

PURPOSE: In image-guided radiation therapy, fiducial markers or clips are often used to determine the position of the tumor. These markers lead to streak artifacts in cone-beam CT (CBCT) scans. Standard inpainting-based metal artifact reduction (MAR) methods fail to remove these artifacts in cases of large motion. We propose two methods to effectively reduce artifacts caused by moving metal inserts. METHODS: The first method (MMAR) utilizes a coarse metal segmentation in the image domain and a refined segmentation in the rawdata domain. After an initial reconstruction, metal is segmented and forward projected giving a coarse metal mask in the rawdata domain. Inside the coarse mask, metal is segmented by utilizing a 2D Sobel filter. Metal is removed by linear interpolation in the refined metal mask. The second method (MoCoMAR) utilizes a motion compensation (MoCo) algorithm [Med Phys. 2013;40:101913] that provides us with a motion-free volume (3D) or with a time series of motion-free volumes (4D). We then apply the normalized metal artifact reduction (NMAR) [Med Phys. 2010;37:5482-5493] to these MoCo volumes. Both methods were applied to three CBCT data sets of patients with metal inserts in the thorax or abdomen region and a 4D thorax simulation. The results were compared to volumes corrected by a standard MAR1 [Radiology. 1987;164:576-577]. RESULTS: MMAR and MoCoMAR were able to remove all artifacts caused by moving metal inserts for the patients and the simulation. Both new methods outperformed the standard MAR1, which was only able to remove artifacts caused by metal inserts with little or no motion. CONCLUSIONS: In this work, two new methods to remove artifacts caused by moving metal inserts are introduced. Both methods showed good results for a simulation and three patients. While the first method (MMAR) works without any prior knowledge, the second method (MoCoMAR) requires a respiratory signal for the MoCo step and is computationally more demanding and gives no benefit over MMAR, unless MoCo images are desired.

Gaussian diffusion sinogram inpainting for X-ray CT metal artifact reduction.

BACKGROUND: Metal objects implanted in the bodies of patients usually generate severe streaking artifacts in reconstructed images of X-ray computed tomography, which degrade the image quality and affect the diagnosis of disease. Therefore, it is essential to reduce these artifacts to meet the clinical demands. METHODS: In this work, we propose a Gaussian diffusion sinogram inpainting metal artifact reduction algorithm based on prior images to reduce these artifacts for fan-beam computed tomography reconstruction. In this algorithm, prior information that originated from a tissue-classified prior image is used for the inpainting of metal-corrupted projections, and it is incorporated into a Gaussian diffusion function. The prior knowledge is particularly designed to locate the diffusion position and improve the sparsity of the subtraction sinogram, which is obtained by subtracting the prior sinogram of the metal regions from the original sinogram. The sinogram inpainting algorithm is implemented through an approach of diffusing prior energy and is then solved by gradient descent. The performance of the proposed metal artifact reduction algorithm is compared with two conventional metal artifact reduction algorithms, namely the interpolation metal artifact reduction algorithm and normalized metal artifact reduction algorithm. The experimental datasets used included both simulated and clinical datasets. RESULTS: By evaluating the results subjectively, the proposed metal artifact reduction algorithm causes fewer secondary artifacts than the two conventional metal artifact reduction algorithms, which lead to severe secondary artifacts resulting from impertinent interpolation and normalization. Additionally, the objective evaluation shows the proposed approach has the smallest normalized mean absolute deviation and the highest signal-to-noise ratio, indicating that the proposed method has produced the image with the best quality. CONCLUSIONS: No matter for the simulated datasets or the clinical datasets, the proposed algorithm has reduced the metal artifacts apparently.

Study of metal artifacts reduction method of CT image / 国际生物医学工程杂志

Computed tomography (CT) has been widely used in clinical diagnosis and made a great contribution to diagnosis by providing anatomical information with high-resolution.However,when metal implants exist in patients' body,reconstructed CT images are seriously interfered by metal artifacts.Metal artifacts are usually expressed as many dark and bright radiant streak artifacts which seriously reduce diagnosis reliability and bring errors into the calculation of dose distribution in radiotherapy.Therefore,the study of metal artifact reduction (MAR)is of great importance.This article reviews main methods on MAR developed in recent years,and give deep analysis on some of the methods.