Cross-modality image translation: CT image synthesis of MR brain images using multi generative network with perceptual supervision.

BACKGROUND: Computed tomography (CT) and magnetic resonance imaging (MRI) are the mainstream imaging technologies for clinical practice. CT imaging can reveal high-quality anatomical and physiopathological structures, especially bone tissue, for clinical diagnosis. MRI provides high resolution in soft tissue and is sensitive to lesions. CT combined with MRI diagnosis has become a regular image-guided radiation treatment plan. METHODS: In this paper, to reduce the dose of radiation exposure in CT examinations and ameliorate the limitations of traditional virtual imaging technologies, we propose a Generative MRI-to-CT transformation method with structural perceptual supervision. Even though structural reconstruction is structurally misaligned in the MRI-CT dataset registration, our proposed method can better align structural information of synthetic CT (sCT) images to input MRI images while simulating the modality of CT in the MRI-to-CT cross-modality transformation. RESULTS: We retrieved a total of 3416 brain MRI-CT paired images as the train/test dataset, including 1366 train images of 10 patients and 2050 test images of 15 patients. Several methods (the baseline methods and the proposed method) were evaluated by the HU difference map, HU distribution, and various similarity metrics, including the mean absolute error (MAE), structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), and normalized cross-correlation (NCC). In our quantitative experimental results, the proposed method achieves the lowest MAE mean of 0.147, highest PSNR mean of 19.27, and NCC mean of 0.431 in the overall CT test dataset. CONCLUSIONS: In conclusion, both qualitative and quantitative results of synthetic CT validate that the proposed method can preserve higher similarity of structural information of the bone tissue of target CT than the baseline methods. Furthermore, the proposed method provides better HU intensity reconstruction for simulating the distribution of the CT modality. The experimental estimation indicates that the proposed method is worth further investigation.

Contrast-enhanced to noncontrast CT transformation via an adjacency content-transfer-based deep subtraction residual neural network.

To reduce overall patient radiation exposure in some clinical scenarios (since cancer patients need frequent follow-ups), noncontrast CT is not used in some institutions. However, although less desirable, noncontrast CT could provide additional important information. In this article, we propose a deep subtraction residual network based on adjacency content transfer to reconstruct noncontrast CT from contrast CT and maintain image quality comparable to that of a CT scan originally acquired without contrast. To address the slight structural dissimilarity of the paired CT images (noncontrast CT and contrast CT) due to involuntary physiological motion, we introduce a contrastive loss network derived from the adjacency content-transfer strategy. We evaluate the results of various similarity metrics (MSE, SSIM, NRMSE, PSNR, MAE) and the fitting curve (HU distribution) of the output mapping to estimate the reconstruction performance of the algorithm. To build the model, we randomly select a total of 15,405 CT paired images (noncontrast CT and contrast-enhanced CT) for training and 10,270 CT paired images for testing. The proposed algorithm preserves the robust structures from the contrast-enhanced CT scans and learns the noncontrast attenuation pattern from the noncontrast CT scans. During the evaluation, the deep subtraction residual network achieves higher MSE, MAE, NRMSE, and PSNR scores (by 30%) than those of the baseline models (BEGAN, CycleGAN, Pixel2Pixel) and better simulates the HU curve of noncontrast CT attenuation. After validation based on an analysis of the experimental results, we can report that the noncontrast CT images reconstructed by our proposed algorithm not only preserve the high-quality structures from the contrast-enhanced CT images, but also mimic the CT attenuation of the originally acquired noncontrast CT images.