Deep learning method for reducing metal artifacts in dental cone-beam CT using supplementary information from intra-oral scan.

Objective.Recently, dental cone-beam computed tomography (CBCT) methods have been improved to significantly reduce radiation dose while maintaining image resolution with minimal equipment cost. In low-dose CBCT environments, metallic inserts such as implants, crowns, and dental fillings cause severe artifacts, which result in a significant loss of morphological structures of teeth in reconstructed images. Such metal artifacts prevent accurate 3D bone-teeth-jaw modeling for diagnosis and treatment planning. However, the performance of existing metal artifact reduction (MAR) methods in handling the loss of the morphological structures of teeth in reconstructed CT images remains relatively limited. In this study, we developed an innovative MAR method to achieve optimal restoration of anatomical details.Approach.The proposed MAR approach is based on a two-stage deep learning-based method. In the first stage, we employ a deep learning network that utilizes intra-oral scan data as side-inputs and performs multi-task learning of auxiliary tooth segmentation. The network is designed to improve the learning ability of capturing teeth-related features effectively while mitigating metal artifacts. In the second stage, a 3D bone-teeth-jaw model is constructed with weighted thresholding, where the weighting region is determined depending on the geometry of the intra-oral scan data.Main results.The results of numerical simulations and clinical experiments are presented to demonstrate the feasibility of the proposed approach.Significance.We propose for the first time a MAR method using radiation-free intra-oral scan data as supplemental information on the tooth morphological structures of teeth, which is designed to perform accurate 3D bone-teeth-jaw modeling in low-dose CBCT environments.

Feasibility of Deep Learning-Based Noise and Artifact Reduction in Coronal Reformation of Contrast-Enhanced Chest Computed Tomography.

PURPOSE: This study aimed to evaluate the feasibility of a deep learning method for imaging artifact and noise reduction in coronal reformation of contrast-enhanced chest computed tomography (CT). METHODS: A total of 19,052 coronal reformatted chest CT images of 110 CT image sets (55 pairs of concordant 16- and 320-row CT image sets) were included and used to train a deep learning algorithm for artifact and noise correction. For internal validation, 4093 coronal reformatted CT images of 25 patients from 16-row CT images underwent correction processing. For external validation, chest CT images of 30 patients (1028 coronal reformatted CT images), acquired in other institutions using different scanners, were subjected to correction processing. For both validations, image quality was compared between original ("CT origin ") and deep learning-based corrected ("CT correct ") CT images. Quantitative analysis for stair-step artifact (coefficient of variance of CT density on coronal reformation), image noise, signal-to-noise ratio, and contrast-to-noise ratio were evaluated. Subjective image quality scores were assigned for image contrast, artifact, and conspicuity of major structures. RESULTS: CT correct showed significantly reduced stair-step artifact (mean coefficient of variance: CT origin 7.35 ± 2.0 vs CT correct 5.17 ± 2.4, P < 0.001) and image noise and improved signal-to-noise ratio and contrast-to-noise ratio in the aorta, pulmonary artery, and liver, compared with those of CT origin ( P < 0.01). On subjective analysis, CT correct had higher image contrast, lower artifact, and better conspicuity than CT origin . Most results of the external validation were consistent with those obtained from the internal validation, except for those concerning the pulmonary artery. CONCLUSIONS: Deep learning-based artifact correction significantly improved the image quality of coronal reformation chest CT by reducing image noise and artifacts.

A fidelity-embedded learning for metal artifact reduction in dental CBCT.

PURPOSE: Dental cone-beam computed tomography (CBCT) has been increasingly used for dental and maxillofacial imaging. However, the presence of metallic inserts, such as implants, crowns, and dental braces, violates the CT model assumption, which leads to severe metal artifacts in the reconstructed CBCT image, resulting in the degradation of diagnostic performance. In this study, we used deep learning to reduce metal artifacts. METHODS: The metal artifacts, appearing as streaks and shadows, are nonlocal and highly associated with various factors, including the geometry of metallic inserts, energy-dependent attenuation, and energy spectrum of the incident X-ray beam, making it difficult to learn their complicated structures directly. To provide a step-by-step environment in which deep learning can be trained, we propose an iterative learning approach in which the network at each iteration step learns the correction error caused by the previous network, while enforcing the data fidelity in the projection domain. To generate a realistic paired training dataset, metal-free CBCT scans were collected from patients without metallic inserts, and then simulated metal projection data were added to generate the corresponding metal-corrupted projection data. RESULTS: The feasibility of the proposed method was investigated in clinical metal-affected CBCT scans, as well as simulated metal-affected CBCT scans. The results show that the proposed method significantly reduces metal artifacts while preserving the morphological structures near metallic objects and outperforms direct image domain learning. CONCLUSION: The proposed fidelity-embedded learning can effectively reduce metal artifacts in dental CBCT compared with direct image domain learning.

Denoising of pediatric low dose abdominal CT using deep learning based algorithm.

OBJECTIVES: To evaluate standard dose-like computed tomography (CT) images generated by a deep learning method, trained using unpaired low-dose CT (LDCT) and standard-dose CT (SDCT) images. MATERIALS AND METHODS: LDCT (80 kVp, 100 mAs, n = 83) and SDCT (120 kVp, 200 mAs, n = 42) images were divided into training (42 LDCT and 42 SDCT) and validation (41 LDCT) sets. A generative adversarial network framework was used to train unpaired datasets. The trained deep learning method generated virtual SDCT images (VIs) from the original LDCT images (OIs). To test the proposed method, LDCT images (80 kVp, 262 mAs, n = 33) were collected from another CT scanner using iterative reconstruction (IR). Image analyses were performed to evaluate the qualities of VIs in the validation set and to compare the performance of deep learning and IR in the test set. RESULTS: The noise of the VIs was the lowest in both validation and test sets (all p<0.001). The mean CT number of the VIs for the portal vein and liver was lower than that of OIs in both validation and test sets (all p<0.001) and was similar to those of SDCT. The contrast-to-noise ratio of portal vein and the signal-to-noise ratio (SNR) of portal vein and liver of VIs were higher than those of SDCT (all p<0.05). The SNR of VIs in test sets was the highest among three images. CONCLUSION: The deep learning method trained by unpaired datasets could reduce noise of LDCT images and showed similar performance to SAFIRE. It can be applied to LDCT images of older CT scanners without IR.

Restoration of amyloid PET images obtained with short-time data using a generative adversarial networks framework.

Our purpose in this study is to evaluate the clinical feasibility of deep-learning techniques for F-18 florbetaben (FBB) positron emission tomography (PET) image reconstruction using data acquired in a short time. We reconstructed raw FBB PET data of 294 patients acquired for 20 and 2 min into standard-time scanning PET (PET20m) and short-time scanning PET (PET2m) images. We generated a standard-time scanning PET-like image (sPET20m) from a PET2m image using a deep-learning network. We did qualitative and quantitative analyses to assess whether the sPET20m images were available for clinical applications. In our internal validation, sPET20m images showed substantial improvement on all quality metrics compared with the PET2m images. There was a small mean difference between the standardized uptake value ratios of sPET20m and PET20m images. A Turing test showed that the physician could not distinguish well between generated PET images and real PET images. Three nuclear medicine physicians could interpret the generated PET image and showed high accuracy and agreement. We obtained similar quantitative results by means of temporal and external validations. We can generate interpretable PET images from low-quality PET images because of the short scanning time using deep-learning techniques. Although more clinical validation is needed, we confirmed the possibility that short-scanning protocols with a deep-learning technique can be used for clinical applications.

Diagnostic Performance of a New Convolutional Neural Network Algorithm for Detecting Developmental Dysplasia of the Hip on Anteroposterior Radiographs.

OBJECTIVE: To evaluate the diagnostic performance of a deep learning algorithm for the automated detection of developmental dysplasia of the hip (DDH) on anteroposterior (AP) radiographs. MATERIALS AND METHODS: Of 2601 hip AP radiographs, 5076 cropped unilateral hip joint images were used to construct a dataset that was further divided into training (80%), validation (10%), or test sets (10%). Three radiologists were asked to label the hip images as normal or DDH. To investigate the diagnostic performance of the deep learning algorithm, we calculated the receiver operating characteristics (ROC), precision-recall curve (PRC) plots, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) and compared them with the performance of radiologists with different levels of experience. RESULTS: The area under the ROC plot generated by the deep learning algorithm and radiologists was 0.988 and 0.988-0.919, respectively. The area under the PRC plot generated by the deep learning algorithm and radiologists was 0.973 and 0.618-0.958, respectively. The sensitivity, specificity, PPV, and NPV of the proposed deep learning algorithm were 98.0, 98.1, 84.5, and 99.8%, respectively. There was no significant difference in the diagnosis of DDH by the algorithm and the radiologist with experience in pediatric radiology (p = 0.180). However, the proposed model showed higher sensitivity, specificity, and PPV, compared to the radiologist without experience in pediatric radiology (p < 0.001). CONCLUSION: The proposed deep learning algorithm provided an accurate diagnosis of DDH on hip radiographs, which was comparable to the diagnosis by an experienced radiologist.

RETOUCH: The Retinal OCT Fluid Detection and Segmentation Benchmark and Challenge.

Retinal swelling due to the accumulation of fluid is associated with the most vision-threatening retinal diseases. Optical coherence tomography (OCT) is the current standard of care in assessing the presence and quantity of retinal fluid and image-guided treatment management. Deep learning methods have made their impact across medical imaging, and many retinal OCT analysis methods have been proposed. However, it is currently not clear how successful they are in interpreting the retinal fluid on OCT, which is due to the lack of standardized benchmarks. To address this, we organized a challenge RETOUCH in conjunction with MICCAI 2017, with eight teams participating. The challenge consisted of two tasks: fluid detection and fluid segmentation. It featured for the first time: all three retinal fluid types, with annotated images provided by two clinical centers, which were acquired with the three most common OCT device vendors from patients with two different retinal diseases. The analysis revealed that in the detection task, the performance on the automated fluid detection was within the inter-grader variability. However, in the segmentation task, fusing the automated methods produced segmentations that were superior to all individual methods, indicating the need for further improvements in the segmentation performance.

CT sinogram-consistency learning for metal-induced beam hardening correction.

PURPOSE: This paper proposes a sinogram-consistency learning method to deal with beam hardening-related artifacts in polychromatic computerized tomography (CT). The presence of highly attenuating materials in the scan field causes an inconsistent sinogram that does not match the range space of the Radon transform. When the mismatched data are entered into the range space during CT reconstruction, streaking and shading artifacts are generated owing to the inherent nature of the inverse Radon transform METHODS: The proposed learning method aims to repair inconsistent sinogram by removing the primary metal-induced beam hardening factors along the metal trace in the sinogram. Taking account of the fundamental difficulty in obtaining sufficient training data in a medical environment, the learning method is designed to use simulated training data and a patient's implant type-specific learning model is used to simplify the learning process. RESULTS: The feasibility of the proposed method is investigated using a dataset, consisting of real CT scans of pelvises containing simulated hip prostheses. The anatomical areas in training and test data are different, in order to demonstrate that the proposed method extracts the beam hardening features, selectively. The results show that our method successfully corrects sinogram inconsistency by extracting beam hardening sources by means of deep learning. CONCLUSION: This paper proposed a deep learning method of sinogram correction for beam hardening reduction in CT for the first time. Conventional methods for beam hardening reduction are based on regularizations, and have the fundamental drawback of being not easily able to use manifold CT images, while a deep learning approach has the potential to do so.

Technical Note: A model-based sinogram correction for beam hardening artifact reduction in CT.

PURPOSE: This study aims to propose a physics-based method of reducing beam-hardening artifacts induced by high-attenuation materials such as metal stents or other metallic implants. METHODS: The proposed approach consists of deriving a sinogram inconsistency formula representing the energy dependence of the attenuation coefficient of high-attenuation materials. This inconsistency formula more accurately represents the inconsistencies of the sinogram than that of a previously reported formula (called the MAC-BC method). This is achieved by considering the properties of the high-attenuation materials, which include the materials' shapes and locations and their effects on the incident X-ray spectrum, including their attenuation coefficients. RESULTS: Numerical simulation and phantom experiment demonstrate that the modeling error of MAC-BC method are nearly completely removed by means of the proposed method. CONCLUSION: The proposed method reduces beam-hardening artifacts arising from high-attenuation materials by relaxing the assumptions of the MAC-BC method. In doing so, it outperforms the original MAC-BC method. Further research is required to address other potential sources of metal artifacts, such as photon starvation, scattering, and noise.

Metal Artifact Reduction for Polychromatic X-ray CT Based on a Beam-Hardening Corrector.

This paper proposes a new method to correct beam hardening artifacts caused by the presence of metal in polychromatic X-ray computed tomography (CT) without degrading the intact anatomical images. Metal artifacts due to beam-hardening, which are a consequence of X-ray beam polychromaticity, are becoming an increasingly important issue affecting CT scanning as medical implants become more common in a generally aging population. The associated higher-order beam-hardening factors can be corrected via analysis of the mismatch between measured sinogram data and the ideal forward projectors in CT reconstruction by considering the known geometry of high-attenuation objects. Without prior knowledge of the spectrum parameters or energy-dependent attenuation coefficients, the proposed correction allows the background CT image (i.e., the image before its corruption by metal artifacts) to be extracted from the uncorrected CT image. Computer simulations and phantom experiments demonstrate the effectiveness of the proposed method to alleviate beam hardening artifacts.

Computed tomographic beam-hardening artefacts: mathematical characterization and analysis.

This paper presents a mathematical characterization and analysis of beam-hardening artefacts in X-ray computed tomography (CT). In the field of dental and medical radiography, metal artefact reduction in CT is becoming increasingly important as artificial prostheses and metallic implants become more widespread in ageing populations. Metal artefacts are mainly caused by the beam-hardening of polychromatic X-ray photon beams, which causes mismatch between the actual sinogram data and the data model being the Radon transform of the unknown attenuation distribution in the CT reconstruction algorithm. We investigate the beam-hardening factor through a mathematical analysis of the discrepancy between the data and the Radon transform of the attenuation distribution at a fixed energy level. Separation of cupping artefacts from beam-hardening artefacts allows causes and effects of streaking artefacts to be analysed. Various computer simulations and experiments are performed to support our mathematical analysis.

Metal artifact reduction in CT by identifying missing data hidden in metals.

There is increasing demand in the field of dental and medical radiography for effective metal artifact reduction (MAR) in computed tomography (CT) because artifact caused by metallic objects causes serious image degradation that obscures information regarding the teeth and/or other biological structures. This paper presents a new MAR method that uses the Laplacian operator to reveal background projection data hidden in regions containing data from metal. In the proposed method, we attempted to decompose the projection data into two parts: data from metal only (metal data), and background data in the absence of metal. Removing metal data from the projections enables us to perform sparsity-driven reconstruction of the metal component and subsequent removal of the metal artifact. The results of clinical experiments demonstrated that the proposed MAR algorithm improves image quality and increases the standard of 3D reconstruction images of the teeth and mandible.