Quantitative evaluation of Saliency-Based Explainable artificial intelligence (XAI) methods in Deep Learning-Based mammogram analysis.

BACKGROUND: Explainable Artificial Intelligence (XAI) is prominent in the diagnostics of opaque deep learning (DL) models, especially in medical imaging. Saliency methods are commonly used, yet there's a lack of quantitative evidence regarding their performance. OBJECTIVES: To quantitatively evaluate the performance of widely utilized saliency XAI methods in the task of breast cancer detection on mammograms. METHODS: Three radiologists drew ground-truth boxes on a balanced mammogram dataset of women (n = 1496 cancer-positive and negative scans) from three centers. A modified, pre-trained DL model was employed for breast cancer detection, using MLO and CC images. Saliency XAI methods, including Gradient-weighted Class Activation Mapping (Grad-CAM), Grad-CAM++, and Eigen-CAM, were evaluated. We utilized the Pointing Game to assess these methods, determining if the maximum value of a saliency map aligned with the bounding boxes, representing the ratio of correctly identified lesions among all cancer patients, with a value ranging from 0 to 1. RESULTS: The development sample included 2,244 women (75%), with the remaining 748 women (25%) in the testing set for unbiased XAI evaluation. The model's recall, precision, accuracy, and F1-Score in identifying cancer in the testing set were 69%, 88%, 80%, and 0.77, respectively. The Pointing Game Scores for Grad-CAM, Grad-CAM++, and Eigen-CAM were 0.41, 0.30, and 0.35 in women with cancer and marginally increased to 0.41, 0.31, and 0.36 when considering only true-positive samples. CONCLUSIONS: While saliency-based methods provide some degree of explainability, they frequently fall short in delineating how DL models arrive at decisions in a considerable number of instances.

Inter-reader agreement of the prostate imaging quality (PI-QUAL) score for basic readers in prostate MRI: A multi-center study.

BACKGROUND: The Prostate Imaging Quality (PI-QUAL) score is the first step toward image quality assessment in multi-parametric prostate MRI (mpMRI). Previous studies have demonstrated moderate to excellent inter-rater agreement among expert readers; however, there is a need for studies to assess the inter-reader agreement of PI-QUAL scoring in basic prostate readers. OBJECTIVES: To assess the inter-reader agreement of the PI-QUAL score amongst basic prostate readers on multi-center prostate mpMRI. METHODS: Five basic prostate readers from different centers assessed the PI-QUAL scores independently using T2-weighted images, diffusion-weighted imaging (DWI) including apparent diffusion coefficient (ADC) maps, and dynamic-contrast-enhanced (DCE) images on mpMRI data obtained from five different centers following Prostate Imaging-Reporting and Data System Version 2.1. The inter-reader agreements amongst radiologists for PI-QUAL were evaluated using weighted Cohen's kappa. Further, the absolute agreements in assessing the diagnostic adequacy of each mpMRI sequence were calculated. RESULTS: A total of 355 men with a median age of 71 years (IQR, 60-78) were enrolled in the study. The pair-wise kappa scores ranged from 0.656 to 0.786 for the PI-QUAL scores, indicating good inter-reader agreements between the readers. The pair-wise absolute agreements ranged from 0.75 to 0.88 for T2W imaging, from 0.74 to 0.83 for the ADC maps, and from 0.77 to 0.86 for DCE images. CONCLUSIONS: Basic prostate radiologists from different institutions provided good inter-reader agreements on multi-center data for the PI-QUAL scores.

Deep learning for assessing image quality in bi-parametric prostate MRI: A feasibility study.

BACKGROUND: Although systems such as Prostate Imaging Quality (PI-QUAL) have been proposed for quality assessment, visual evaluations by human readers remain somewhat inconsistent, particularly among less-experienced readers. OBJECTIVES: To assess the feasibility of deep learning (DL) for the automated assessment of image quality in bi-parametric MRI scans and compare its performance to that of less-experienced readers. METHODS: We used bi-parametric prostate MRI scans from the PI-CAI dataset in this study. A 3-point Likert scale, consisting of poor, moderate, and excellent, was utilized for assessing image quality. Three expert readers established the ground-truth labels for the development (500) and testing sets (100). We trained a 3D DL model on the development set using probabilistic prostate masks and an ordinal loss function. Four less-experienced readers scored the testing set for performance comparison. RESULTS: The kappa scores between the DL model and the expert consensus for T2W images and ADC maps were 0.42 and 0.61, representing moderate and good levels of agreement. The kappa scores between the less-experienced readers and the expert consensus for T2W images and ADC maps ranged from 0.39 to 0.56 (fair to moderate) and from 0.39 to 0.62 (fair to good). CONCLUSIONS: Deep learning (DL) can offer performance comparable to that of less-experienced readers when assessing image quality in bi-parametric prostate MRI, making it a viable option for an automated quality assessment tool. We suggest that DL models trained on more representative datasets, annotated by a larger group of experts, could yield reliable image quality assessment and potentially substitute or assist visual evaluations by human readers.

Subacute and Recurrent Transient Perivascular Inflammation of the Carotid Artery (TIPIC syndrome) and Supraclavicular Lymphadenopathy Associated with Ipsilateral Intramuscular m-RNA COVID-19 Vaccine.

We describe a case of recurrent transient perivascular inflammation of the carotid artery (TIPIC) syndrome and associated supraclavicular lymphadenopathy after ipsilateral intramuscular administration of an mRNA-based COVID-19 vaccine.