Your browser doesn't support javascript.
loading
Show: 20 | 50 | 100
Results 1 - 20 de 58
Filter
1.
Magn Reson Med ; 2024 May 22.
Article in English | MEDLINE | ID: mdl-38775077

ABSTRACT

PURPOSE: To develop a digital reference object (DRO) toolkit to generate realistic breast DCE-MRI data for quantitative assessment of image reconstruction and data analysis methods. METHODS: A simulation framework in a form of DRO toolkit has been developed using the ultrafast and conventional breast DCE-MRI data of 53 women with malignant (n = 25) or benign (n = 28) lesions. We segmented five anatomical regions and performed pharmacokinetic analysis to determine the ranges of pharmacokinetic parameters for each segmented region. A database of the segmentations and their pharmacokinetic parameters is included in the DRO toolkit that can generate a large number of realistic breast DCE-MRI data. We provide two potential examples for our DRO toolkit: assessing the accuracy of an image reconstruction method using undersampled simulated radial k-space data and assessing the impact of the B 1 + $$ {\mathrm{B}}_1^{+} $$ field inhomogeneity on estimated parameters. RESULTS: The estimated pharmacokinetic parameters for each region showed agreement with previously reported values. For the assessment of the reconstruction method, it was found that the temporal regularization resulted in significant underestimation of estimated parameters by up to 57% and 10% with the weighting factor λ = 0.1 and 0.01, respectively. We also demonstrated that spatial discrepancy of v p $$ {v}_p $$ and PS $$ \mathrm{PS} $$ increase to about 33% and 51% without correction for B 1 + $$ {\mathrm{B}}_1^{+} $$ field. CONCLUSION: We have developed a DRO toolkit that includes realistic morphology of tumor lesions along with the expected pharmacokinetic parameter ranges. This simulation framework can generate many images for quantitative assessment of DCE-MRI reconstruction and analysis methods.

3.
Radiology ; 310(1): e230764, 2024 Jan.
Article in English | MEDLINE | ID: mdl-38165245

ABSTRACT

While musculoskeletal imaging volumes are increasing, there is a relative shortage of subspecialized musculoskeletal radiologists to interpret the studies. Will artificial intelligence (AI) be the solution? For AI to be the solution, the wide implementation of AI-supported data acquisition methods in clinical practice requires establishing trusted and reliable results. This implementation will demand close collaboration between core AI researchers and clinical radiologists. Upon successful clinical implementation, a wide variety of AI-based tools can improve the musculoskeletal radiologist's workflow by triaging imaging examinations, helping with image interpretation, and decreasing the reporting time. Additional AI applications may also be helpful for business, education, and research purposes if successfully integrated into the daily practice of musculoskeletal radiology. The question is not whether AI will replace radiologists, but rather how musculoskeletal radiologists can take advantage of AI to enhance their expert capabilities.


Subject(s)
Artificial Intelligence , Commerce , Humans , Radionuclide Imaging , Physical Examination , Radiologists
4.
IEEE Trans Med Imaging ; 42(12): 3817-3832, 2023 Dec.
Article in English | MEDLINE | ID: mdl-37656651

ABSTRACT

Data-driven approaches recently achieved remarkable success in magnetic resonance imaging (MRI) reconstruction, but integration into clinical routine remains challenging due to a lack of generalizability and interpretability. In this paper, we address these challenges in a unified framework based on generative image priors. We propose a novel deep neural network based regularizer which is trained in a generative setting on reference magnitude images only. After training, the regularizer encodes higher-level domain statistics which we demonstrate by synthesizing images without data. Embedding the trained model in a classical variational approach yields high-quality reconstructions irrespective of the sub-sampling pattern. In addition, the model shows stable behavior when confronted with out-of-distribution data in the form of contrast variation. Furthermore, a probabilistic interpretation provides a distribution of reconstructions and hence allows uncertainty quantification. To reconstruct parallel MRI, we propose a fast algorithm to jointly estimate the image and the sensitivity maps. The results demonstrate competitive performance, on par with state-of-the-art end-to-end deep learning methods, while preserving the flexibility with respect to sub-sampling patterns and allowing for uncertainty quantification.


Subject(s)
Image Processing, Computer-Assisted , Neural Networks, Computer , Image Processing, Computer-Assisted/methods , Algorithms , Magnetic Resonance Imaging/methods
5.
IEEE Signal Process Mag ; 40(1): 98-114, 2023 Jan.
Article in English | MEDLINE | ID: mdl-37304755

ABSTRACT

Physics-driven deep learning methods have emerged as a powerful tool for computational magnetic resonance imaging (MRI) problems, pushing reconstruction performance to new limits. This article provides an overview of the recent developments in incorporating physics information into learning-based MRI reconstruction. We consider inverse problems with both linear and non-linear forward models for computational MRI, and review the classical approaches for solving these. We then focus on physics-driven deep learning approaches, covering physics-driven loss functions, plug-and-play methods, generative models, and unrolled networks. We highlight domain-specific challenges such as real- and complex-valued building blocks of neural networks, and translational applications in MRI with linear and non-linear forward models. Finally, we discuss common issues and open challenges, and draw connections to the importance of physics-driven learning when combined with other downstream tasks in the medical imaging pipeline.

6.
J Comput Assist Tomogr ; 47(2): 212-219, 2023.
Article in English | MEDLINE | ID: mdl-36790870

ABSTRACT

PURPOSE: To assess deep learning denoised (DLD) computed tomography (CT) chest images at various low doses by both quantitative and qualitative perceptual image analysis. METHODS: Simulated noise was inserted into sinogram data from 32 chest CTs acquired at 100 mAs, generating anatomically registered images at 40, 20, 10, and 5 mAs. A DLD model was developed, with 23 scans selected for training, 5 for validation, and 4 for test.Quantitative analysis of perceptual image quality was assessed with Structural SIMilarity Index (SSIM) and Fréchet Inception Distance (FID). Four thoracic radiologists graded overall diagnostic image quality, image artifact, visibility of small structures, and lesion conspicuity. Noise-simulated and denoised image series were evaluated in comparison with one another, and in comparison with standard 100 mAs acquisition at the 4 mAs levels. Statistical tests were conducted at the 2-sided 5% significance level, with multiple comparison correction. RESULTS: At the same mAs levels, SSIM and FID between noise-simulated and reconstructed DLD images indicated that images were closer to a perfect match with increasing mAs (closer to 1 for SSIM, and 0 for FID).In comparing noise-simulated and DLD images to standard-dose 100-mAs images, DLD improved SSIM and FID. Deep learning denoising improved SSIM of 40-, 20-, 10-, and 5-mAs simulations in comparison with standard-dose 100-mAs images, with change in SSIM from 0.91 to 0.94, 0.87 to 0.93, 0.67 to 0.87, and 0.54 to 0.84, respectively. Deep learning denoising improved FID of 40-, 20-, 10-, and 5-mAs simulations in comparison with standard-dose 100-mAs images, with change in FID from 20 to 13, 46 to 21, 104 to 41, and 148 to 69, respectively.Qualitative image analysis showed no significant difference in lesion conspicuity between DLD images at any mAs in comparison with 100-mAs images. Deep learning denoising images at 10 and 5 mAs were rated lower for overall diagnostic image quality ( P < 0.001), and at 5 mAs lower for overall image artifact and visibility of small structures ( P = 0.002), in comparison with 100 mAs. CONCLUSIONS: Deep learning denoising resulted in quantitative improvements in image quality. Qualitative assessment demonstrated DLD images at or less than 10 mAs to be rated inferior to standard-dose images.


Subject(s)
Deep Learning , Humans , Radiation Dosage , Tomography, X-Ray Computed/methods , Image Processing, Computer-Assisted/methods , Radiographic Image Interpretation, Computer-Assisted/methods , Algorithms , Signal-To-Noise Ratio
7.
Radiology ; 307(2): e220425, 2023 04.
Article in English | MEDLINE | ID: mdl-36648347

ABSTRACT

Background MRI is a powerful diagnostic tool with a long acquisition time. Recently, deep learning (DL) methods have provided accelerated high-quality image reconstructions from undersampled data, but it is unclear if DL image reconstruction can be reliably translated to everyday clinical practice. Purpose To determine the diagnostic equivalence of prospectively accelerated DL-reconstructed knee MRI compared with conventional accelerated MRI for evaluating internal derangement of the knee in a clinical setting. Materials and Methods A DL reconstruction model was trained with images from 298 clinical 3-T knee examinations. In a prospective analysis, patients clinically referred for knee MRI underwent a conventional accelerated knee MRI protocol at 3 T followed by an accelerated DL protocol between January 2020 and February 2021. The equivalence of the DL reconstruction of the images relative to the conventional images for the detection of an abnormality was assessed in terms of interchangeability. Each examination was reviewed by six musculoskeletal radiologists. Analyses pertaining to the detection of meniscal or ligament tears and bone marrow or cartilage abnormalities were based on four-point ordinal scores for the likelihood of an abnormality. Additionally, the protocols were compared with use of four-point ordinal scores for each aspect of image quality: overall image quality, presence of artifacts, sharpness, and signal-to-noise ratio. Results A total of 170 participants (mean age ± SD, 45 years ± 16; 76 men) were evaluated. The DL-reconstructed images were determined to be of diagnostic equivalence with the conventional images for detection of abnormalities. The overall image quality score, averaged over six readers, was significantly better (P < .001) for the DL than for the conventional images. Conclusion In a clinical setting, deep learning reconstruction enabled a nearly twofold reduction in scan time for a knee MRI and was diagnostically equivalent with the conventional protocol. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Roemer in this issue.


Subject(s)
Deep Learning , Male , Humans , Magnetic Resonance Imaging/methods , Knee Joint/diagnostic imaging , Knee/diagnostic imaging , Signal-To-Noise Ratio
8.
Radiol Artif Intell ; 4(6): e210313, 2022 Nov.
Article in English | MEDLINE | ID: mdl-36523647

ABSTRACT

Purpose: To explore the limits of deep learning-based brain MRI reconstruction and identify useful acceleration ranges for general-purpose imaging and potential screening. Materials and Methods: In this retrospective study conducted from 2019 through 2021, a model was trained for reconstruction on 5847 brain MR images. Performance was evaluated across a wide range of accelerations (up to 100-fold along a single phase-encoded direction for two-dimensional [2D] sections) on the fastMRI test set collected at New York University, consisting of 558 image volumes. In a sample of 69 volumes, reconstructions were classified by radiologists for identification of two clinical thresholds: (a) general-purpose diagnostic imaging and (b) potential use in a screening protocol. A Monte Carlo procedure was developed to estimate reconstruction error with only undersampled data. The model was evaluated on both in-domain and out-of-domain data. The 95% CIs were calculated using the percentile bootstrap method. Results: Radiologists rated 100% of 69 volumes as having sufficient image quality for general-purpose imaging at up to 4× acceleration and 65 of 69 volumes (94%) as having sufficient image quality for screening at up to 14× acceleration. The Monte Carlo procedure estimated ground truth peak signal-to-noise ratio and mean squared error with coefficients of determination greater than 0.5 at 2× to 20× acceleration levels. Out-of-distribution experiments demonstrated the model's ability to produce images substantially distinct from the training set, even at 100× acceleration. Conclusion: For 2D brain images using deep learning-based reconstruction, maximum acceleration for potential screening was three to four times higher than that for diagnostic general-purpose imaging.Keywords: MRI Reconstruction, High Acceleration, Deep Learning, Screening, Out of Distribution Supplemental material is available for this article. © RSNA, 2022.

9.
IEEE Trans Comput Imaging ; 8: 449-461, 2022.
Article in English | MEDLINE | ID: mdl-35795003

ABSTRACT

This work proposes an alternating learning approach to learn the sampling pattern (SP) and the parameters of variational networks (VN) in accelerated parallel magnetic resonance imaging (MRI). We investigate four variations of the learning approach, that alternates between improving the SP, using bias-accelerated subset selection, and improving parameters of the VN, using ADAM. The variations include the use of monotone or non-monotone alternating steps and systematic reduction of learning rates. The algorithms learn an effective pair to be used in future scans, including an SP that captures fewer k-space samples in which the generated undersampling artifacts are removed by the VN reconstruction. The quality of the VNs and SPs obtained by the proposed approaches is compared against different methods, including other kinds of joint learning methods and state-of-art reconstructions, on two different datasets at various acceleration factors (AF). We observed improvements visually and in three different figures of merit commonly used in deep learning (RMSE, SSIM, and HFEN) on AFs from 2 to 20 with brain and knee joint datasets when compared to the other approaches. The improvements ranged from 1% to 62% over the next best approach tested with VNs. The proposed approach has shown stable performance, obtaining similar learned SPs under different initial training conditions. We observe that the improvement is not only due to the learned sampling density, it is also due to the learned position of samples in k-space. The proposed approach was able to learn effective pairs of SPs and reconstruction VNs, improving 3D Cartesian accelerated parallel MRI applications.

10.
Sci Data ; 9(1): 152, 2022 04 05.
Article in English | MEDLINE | ID: mdl-35383186

ABSTRACT

Improving speed and image quality of Magnetic Resonance Imaging (MRI) using deep learning reconstruction is an active area of research. The fastMRI dataset contains large volumes of raw MRI data, which has enabled significant advances in this field. While the impact of the fastMRI dataset is unquestioned, the dataset currently lacks clinical expert pathology annotations, critical to addressing clinically relevant reconstruction frameworks and exploring important questions regarding rendering of specific pathology using such novel approaches. This work introduces fastMRI+, which consists of 16154 subspecialist expert bounding box annotations and 13 study-level labels for 22 different pathology categories on the fastMRI knee dataset, and 7570 subspecialist expert bounding box annotations and 643 study-level labels for 30 different pathology categories for the fastMRI brain dataset. The fastMRI+ dataset is open access and aims to support further research and advancement of medical imaging in MRI reconstruction and beyond.


Subject(s)
Brain , Image Processing, Computer-Assisted , Knee Joint , Brain/diagnostic imaging , Brain/pathology , Humans , Knee Joint/diagnostic imaging , Knee Joint/pathology , Magnetic Resonance Imaging
11.
Invest Radiol ; 57(8): 517-526, 2022 08 01.
Article in English | MEDLINE | ID: mdl-35239614

ABSTRACT

OBJECTIVES: Despite significant progress, artifact-free visualization of the bone and soft tissues around hip arthroplasty implants remains an unmet clinical need. New-generation low-field magnetic resonance imaging (MRI) systems now include slice encoding for metal artifact correction (SEMAC), which may result in smaller metallic artifacts and better image quality than standard-of-care 1.5 T MRI. This study aims to assess the feasibility of SEMAC on a new-generation 0.55 T system, optimize the pulse protocol parameters, and compare the results with those of a standard-of-care 1.5 T MRI. MATERIALS AND METHODS: Titanium (Ti) and cobalt-chromium total hip arthroplasty implants embedded in a tissue-mimicking American Society for Testing and Materials gel phantom were evaluated using turbo spin echo, view angle tilting (VAT), and combined VAT and SEMAC (VAT + SEMAC) pulse sequences. To refine an MRI protocol at 0.55 T, the type of metal artifact reduction techniques and the effect of various pulse sequence parameters on metal artifacts were assessed through qualitative ranking of the images by 3 expert readers while taking measured spatial resolution, signal-to-noise ratios, and acquisition times into consideration. Signal-to-noise ratio efficiency and artifact size of the optimized 0.55 T protocols were compared with the 1.5 T standard and compressed-sensing SEMAC sequences. RESULTS: Overall, the VAT + SEMAC sequence with at least 6 SEMAC encoding steps for Ti and 9 for cobalt-chromium implants was ranked higher than other sequences for metal reduction ( P < 0.05). Additional SEMAC encoding partitions did not result in further metal artifact reductions. Permitting minimal residual artifacts, low magnetic susceptibility Ti constructs may be sufficiently imaged with optimized turbo spin echo sequences obviating the need for SEMAC. In cross-platform comparison, 0.55 T acquisitions using the optimized protocols are associated with 45% to 64% smaller artifacts than 1.5 T VAT + SEMAC and VAT + compressed-sensing/SEMAC protocols at the expense of a 17% to 28% reduction in signal-to-noise ratio efficiency. B 1 -related artifacts are invariably smaller at 0.55 T than 1.5 T; however, artifacts related to B 0 distortion, although frequently smaller, may appear as signal pileups at 0.55 T. CONCLUSIONS: Our results suggest that new-generation low-field SEMAC MRI reduces metal artifacts around hip arthroplasty implants to better advantage than current 1.5 T MRI standard of care. While the appearance of B 0 -related artifacts changes, reduction in B 1 -related artifacts plays a major role in the overall benefit of 0.55 T.


Subject(s)
Arthroplasty, Replacement, Hip , Artifacts , Chromium , Cobalt , Image Enhancement/methods , Magnetic Resonance Imaging/methods , Titanium
12.
Magn Reson Med ; 87(5): 2536-2550, 2022 05.
Article in English | MEDLINE | ID: mdl-35001423

ABSTRACT

PURPOSE: To develop a deep learning approach to estimate the local capillary-level input function (CIF) for pharmacokinetic model analysis of DCE-MRI. METHODS: A deep convolutional network was trained with numerically simulated data to estimate the CIF. The trained network was tested using simulated lesion data and used to estimate voxel-wise CIF for pharmacokinetic model analysis of breast DCE-MRI data using an abbreviated protocol from women with malignant (n = 25) and benign (n = 28) lesions. The estimated parameters were used to build a logistic regression model to detect the malignancy. RESULT: The pharmacokinetic parameters estimated using the network-predicted CIF from our breast DCE data showed significant differences between the malignant and benign groups for all parameters. Testing the diagnostic performance with the estimated parameters, the conventional approach with arterial input function (AIF) showed an area under the curve (AUC) between 0.76 and 0.87, and the proposed approach with CIF demonstrated similar performance with an AUC between 0.79 and 0.81. CONCLUSION: This study shows the feasibility of estimating voxel-wise CIF using a deep neural network. The proposed approach could eliminate the need to measure AIF manually without compromising the diagnostic performance to detect the malignancy in the clinical setting.


Subject(s)
Breast Neoplasms , Deep Learning , Algorithms , Breast Neoplasms/diagnostic imaging , Contrast Media/pharmacokinetics , Female , Humans , Magnetic Resonance Imaging/methods , Reproducibility of Results
13.
Elife ; 112022 01 28.
Article in English | MEDLINE | ID: mdl-35088711

ABSTRACT

1H MRI maps brain structure and function non-invasively through versatile contrasts that exploit inhomogeneity in tissue micro-environments. Inferring histopathological information from magnetic resonance imaging (MRI) findings, however, remains challenging due to absence of direct links between MRI signals and cellular structures. Here, we show that deep convolutional neural networks, developed using co-registered multi-contrast MRI and histological data of the mouse brain, can estimate histological staining intensity directly from MRI signals at each voxel. The results provide three-dimensional maps of axons and myelin with tissue contrasts that closely mimic target histology and enhanced sensitivity and specificity compared to conventional MRI markers. Furthermore, the relative contribution of each MRI contrast within the networks can be used to optimize multi-contrast MRI acquisition. We anticipate our method to be a starting point for translation of MRI results into easy-to-understand virtual histology for neurobiologists and provide resources for validating novel MRI techniques.


Subject(s)
Brain/diagnostic imaging , Animals , Deep Learning , Histological Techniques , Image Processing, Computer-Assisted , Magnetic Resonance Imaging , Mice , Mice, Inbred C57BL , Neural Networks, Computer
14.
IEEE Trans Med Imaging ; 41(2): 279-291, 2022 02.
Article in English | MEDLINE | ID: mdl-34506279

ABSTRACT

Recent deep learning approaches focus on improving quantitative scores of dedicated benchmarks, and therefore only reduce the observation-related (aleatoric) uncertainty. However, the model-immanent (epistemic) uncertainty is less frequently systematically analyzed. In this work, we introduce a Bayesian variational framework to quantify the epistemic uncertainty. To this end, we solve the linear inverse problem of undersampled MRI reconstruction in a variational setting. The associated energy functional is composed of a data fidelity term and the total deep variation (TDV) as a learned parametric regularizer. To estimate the epistemic uncertainty we draw the parameters of the TDV regularizer from a multivariate Gaussian distribution, whose mean and covariance matrix are learned in a stochastic optimal control problem. In several numerical experiments, we demonstrate that our approach yields competitive results for undersampled MRI reconstruction. Moreover, we can accurately quantify the pixelwise epistemic uncertainty, which can serve radiologists as an additional resource to visualize reconstruction reliability.


Subject(s)
Magnetic Resonance Imaging , Bayes Theorem , Reproducibility of Results , Uncertainty
15.
J Magn Reson Imaging ; 56(1): 184-195, 2022 07.
Article in English | MEDLINE | ID: mdl-34877735

ABSTRACT

BACKGROUND: Early diagnosis and treatment of prostate cancer (PCa) can be curative; however, prostate-specific antigen is a suboptimal screening test for clinically significant PCa. While prostate magnetic resonance imaging (MRI) has demonstrated value for the diagnosis of PCa, the acquisition time is too long for a first-line screening modality. PURPOSE: To accelerate prostate MRI exams, utilizing a variational network (VN) for image reconstruction. STUDY TYPE: Retrospective. SUBJECTS: One hundred and thirteen subjects (train/val/test: 70/13/30) undergoing prostate MRI. FIELD STRENGTH/SEQUENCE: 3.0 T; a T2 turbo spin echo (TSE) T2-weighted image (T2WI) sequence in axial and coronal planes, and axial echo-planar diffusion-weighted imaging (DWI). ASSESSMENT: Four abdominal radiologists evaluated the image quality of VN reconstructions of retrospectively under-sampled biparametric MRIs (bp-MRI), and standard bp-MRI reconstructions for 20 test subjects (studies). The studies included axial and coronal T2WI, DWI B50 seconds/mm2 and B1000 seconds/mm (4-fold T2WI, 3-fold DWI), all of which were evaluated separately for image quality on a Likert scale (1: non-diagnostic to 5: excellent quality). In another 10 test subjects, three readers graded lesions on bp-MRI-which additionally included calculated B1500 seconds/mm2 , and apparent diffusion coefficient map-according to the Prostate Imaging Reporting and Data System (PI-RADS v2.1), for both VN and standard reconstructions. Accuracy of PI-RADS ≥3 for clinically significant cancer was computed. Projected scan time of the retrospectively under-sampled biparametric exam was also computed. STATISTICAL TESTS: One-sided Wilcoxon signed-rank test was used for comparison of image quality. Sensitivity, specificity, positive predictive value, and negative predictive value were calculated for lesion detection and grading. Generalized estimating equation with cluster effect was used to compare differences between standard and VN bp-MRI. A P-value of <0.05 was considered statistically significant. RESULTS: Three of four readers rated no significant difference for overall quality between the standard and VN axial T2WI (Reader 1: 4.00 ± 0.56 (Standard), 3.90 ± 0.64 (VN) P = 0.33; Reader 2: 4.35 ± 0.74 (Standard), 3.80 ± 0.89 (VN) P = 0.003; Reader 3: 4.60 ± 0.50 (Standard), 4.55 ± 0.60 (VN) P = 0.39; Reader 4: 3.65 ± 0.99 (Standard), 3.60 ± 1.00 (VN) P = 0.38). All four readers rated no significant difference for overall quality between standard and VN DWI B1000 seconds/mm2 (Reader 1: 2.25 ± 0.62 (Standard), 2.45 ± 0.75 (VN) P = 0.96; Reader 2: 3.60 ± 0.92 (Standard), 3.55 ± 0.82 (VN) P = 0.40; Reader 3: 3.85 ± 0.72 (Standard), 3.55 ± 0.89 (VN) P = 0.07; Reader 4: 4.70 ± 0.76 (Standard); 4.60 ± 0.73 (VN) P = 0.17) and three of four readers rated no significant difference for overall quality between standard and VN DWI B50 seconds/mm2 (Reader 1: 3.20 ± 0.70 (Standard), 3.40 ± 0.75 (VN) P = 0.98; Reader 2: 2.85 ± 0.81 (Standard), 3.00 ± 0.79 (VN) P = 0.93; Reader 3: 4.45 ± 0.72 (Standard), 4.05 ± 0.69 (VN) P = 0.02; Reader 4: 4.50 ± 0.69 (Standard), 4.45 ± 0.76 (VN) P = 0.50). In the lesion evaluation study, there was no significant difference in the number of PI-RADS ≥3 lesions identified on standard vs. VN bp-MRI (P = 0.92, 0.59, 0.87) with similar sensitivity and specificity for clinically significant cancer. The average scan time of the standard clinical biparametric exam was 11.8 minutes, and this was projected to be 3.2 minutes for the accelerated exam. DATA CONCLUSION: Diagnostic accelerated biparametric prostate MRI exams can be performed using deep learning methods in <4 minutes, potentially enabling rapid screening prostate MRI. LEVEL OF EVIDENCE: 3 TECHNICAL EFFICACY: Stage 5.


Subject(s)
Deep Learning , Prostatic Neoplasms , Diffusion Magnetic Resonance Imaging/methods , Humans , Magnetic Resonance Imaging/methods , Male , Prostate/diagnostic imaging , Prostate/pathology , Prostatic Neoplasms/diagnostic imaging , Prostatic Neoplasms/pathology , Retrospective Studies
16.
IEEE Trans Med Imaging ; 40(9): 2306-2317, 2021 09.
Article in English | MEDLINE | ID: mdl-33929957

ABSTRACT

Accelerating MRI scans is one of the principal outstanding problems in the MRI research community. Towards this goal, we hosted the second fastMRI competition targeted towards reconstructing MR images with subsampled k-space data. We provided participants with data from 7,299 clinical brain scans (de-identified via a HIPAA-compliant procedure by NYU Langone Health), holding back the fully-sampled data from 894 of these scans for challenge evaluation purposes. In contrast to the 2019 challenge, we focused our radiologist evaluations on pathological assessment in brain images. We also debuted a new Transfer track that required participants to submit models evaluated on MRI scanners from outside the training set. We received 19 submissions from eight different groups. Results showed one team scoring best in both SSIM scores and qualitative radiologist evaluations. We also performed analysis on alternative metrics to mitigate the effects of background noise and collected feedback from the participants to inform future challenges. Lastly, we identify common failure modes across the submissions, highlighting areas of need for future research in the MRI reconstruction community.


Subject(s)
Image Processing, Computer-Assisted , Magnetic Resonance Imaging , Brain/diagnostic imaging , Humans , Machine Learning , Neuroimaging
17.
J Magn Reson Imaging ; 53(4): 1015-1028, 2021 04.
Article in English | MEDLINE | ID: mdl-32048372

ABSTRACT

Artificial intelligence (AI) shows tremendous promise in the field of medical imaging, with recent breakthroughs applying deep-learning models for data acquisition, classification problems, segmentation, image synthesis, and image reconstruction. With an eye towards clinical applications, we summarize the active field of deep-learning-based MR image reconstruction. We review the basic concepts of how deep-learning algorithms aid in the transformation of raw k-space data to image data, and specifically examine accelerated imaging and artifact suppression. Recent efforts in these areas show that deep-learning-based algorithms can match and, in some cases, eclipse conventional reconstruction methods in terms of image quality and computational efficiency across a host of clinical imaging applications, including musculoskeletal, abdominal, cardiac, and brain imaging. This article is an introductory overview aimed at clinical radiologists with no experience in deep-learning-based MR image reconstruction and should enable them to understand the basic concepts and current clinical applications of this rapidly growing area of research across multiple organ systems.


Subject(s)
Artificial Intelligence , Image Processing, Computer-Assisted , Algorithms , Artifacts , Humans , Radiography
18.
Magn Reson Med ; 85(1): 413-428, 2021 01.
Article in English | MEDLINE | ID: mdl-32662910

ABSTRACT

PURPOSE: To develop and evaluate a neural network-based method for Gibbs artifact and noise removal. METHODS: A convolutional neural network (CNN) was designed for artifact removal in diffusion-weighted imaging data. Two implementations were considered: one for magnitude images and one for complex images. Both models were based on the same encoder-decoder structure and were trained by simulating MRI acquisitions on synthetic non-MRI images. RESULTS: Both machine learning methods were able to mitigate artifacts in diffusion-weighted images and diffusion parameter maps. The CNN for complex images was also able to reduce artifacts in partial Fourier acquisitions. CONCLUSIONS: The proposed CNNs extend the ability of artifact correction in diffusion MRI. The machine learning method described here can be applied on each imaging slice independently, allowing it to be used flexibly in clinical applications.


Subject(s)
Image Processing, Computer-Assisted , Neural Networks, Computer , Artifacts , Diffusion Magnetic Resonance Imaging , Magnetic Resonance Imaging
19.
Magn Reson Med ; 85(4): 1821-1839, 2021 04.
Article in English | MEDLINE | ID: mdl-33179826

ABSTRACT

PURPOSE: The aim of this work is to shed light on the issue of reproducibility in MR image reconstruction in the context of a challenge. Participants had to recreate the results of "Advances in sensitivity encoding with arbitrary k-space trajectories" by Pruessmann et al. METHODS: The task of the challenge was to reconstruct radially acquired multicoil k-space data (brain/heart) following the method in the original paper, reproducing its key figures. Results were compared to consolidated reference implementations created after the challenge, accounting for the two most common programming languages used in the submissions (Matlab/Python). RESULTS: Visually, differences between submissions were small. Pixel-wise differences originated from image orientation, assumed field-of-view, or resolution. The reference implementations were in good agreement, both visually and in terms of image similarity metrics. DISCUSSION AND CONCLUSION: While the description level of the published algorithm enabled participants to reproduce CG-SENSE in general, details of the implementation varied, for example, density compensation or Tikhonov regularization. Implicit assumptions about the data lead to further differences, emphasizing the importance of sufficient metadata accompanying open datasets. Defining reproducibility quantitatively turned out to be nontrivial for this image reconstruction challenge, in the absence of ground-truth results. Typical similarity measures like NMSE of SSIM were misled by image intensity scaling and outlier pixels. Thus, to facilitate reproducibility, researchers are encouraged to publish code and data alongside the original paper. Future methodological papers on MR image reconstruction might benefit from the consolidated reference implementations of CG-SENSE presented here, as a benchmark for methods comparison.


Subject(s)
Image Processing, Computer-Assisted , Magnetic Resonance Imaging , Algorithms , Brain/diagnostic imaging , Humans , Reproducibility of Results
20.
Sci Rep ; 10(1): 19144, 2020 11 05.
Article in English | MEDLINE | ID: mdl-33154515

ABSTRACT

In this study we use undersampled MRI acquisition methods to obtain accelerated 3D mono and biexponential spin-lattice relaxation time in the rotating frame (T1ρ) mapping of knee cartilage, reducing the usual long scan time. We compare the accelerated T1ρ maps obtained by deep learning-based variational network (VN) and compressed sensing (CS). Both methods were compared with spatial (S) and spatio-temporal (ST) filters. Complex-valued fitting was used for T1ρ parameters estimation. We tested with seven in vivo and six synthetic datasets, with acceleration factors (AF) from 2 to 10. Median normalized absolute deviation (MNAD), analysis of variance (ANOVA), and coefficient of variation (CV) were used for analysis. The methods CS-ST, VN-S, and VN-ST performed well for accelerating monoexponential T1ρ mapping, with MNAD around 5% for AF = 2, which increases almost linearly with the AF to an MNAD of 13% for AF = 8, with all methods. For biexponential mapping, the VN-ST was the best method starting with MNAD of 7.4% for AF = 2 and reaching MNAD of 13.1% for AF = 8. The VN was able to produce 3D-T1ρ mapping of knee cartilage with lower error than CS. The best results were obtained by VN-ST, improving CS-ST method by nearly 7.5%.


Subject(s)
Cartilage, Articular/diagnostic imaging , Image Processing, Computer-Assisted/methods , Knee Joint/diagnostic imaging , Magnetic Resonance Imaging/methods , Adult , Female , Humans , Imaging, Three-Dimensional/methods , Male , Retrospective Studies , Young Adult
SELECTION OF CITATIONS
SEARCH DETAIL
...