Analyzing Racial Differences in Imaging Joint Replacement Registries Using Generative Artificial Intelligence: Advancing Orthopaedic Data Equity.

Background: Discrepancies in medical data sets can perpetuate bias, especially when training deep learning models, potentially leading to biased outcomes in clinical applications. Understanding these biases is crucial for the development of equitable healthcare technologies. This study employs generative deep learning technology to explore and understand radiographic differences based on race among patients undergoing total hip arthroplasty. Methods: Utilizing a large institutional registry, we retrospectively analyzed pelvic radiographs from total hip arthroplasty patients, characterized by demographics and image features. Denoising diffusion probabilistic models generated radiographs conditioned on demographic and imaging characteristics. Fréchet Inception Distance assessed the generated image quality, showing the diversity and realism of the generated images. Sixty transition videos were generated that showed transforming White pelvises to their closest African American counterparts and vice versa while controlling for patients' sex, age, and body mass index. Two expert surgeons and 2 radiologists carefully studied these videos to understand the systematic differences that are present in the 2 races' radiographs. Results: Our data set included 480,407 pelvic radiographs, with a predominance of White patients over African Americans. The generative denoising diffusion probabilistic model created high-quality images and reached an Fréchet Inception Distance of 6.8. Experts identified 6 characteristics differentiating races, including interacetabular distance, osteoarthritis degree, obturator foramina shape, femoral neck-shaft angle, pelvic ring shape, and femoral cortical thickness. Conclusions: This study demonstrates the potential of generative models for understanding disparities in medical imaging data sets. By visualizing race-based differences, this method aids in identifying bias in downstream tasks, fostering the development of fairer healthcare practices.

The ABCs of Subarachnoid Hemorrhage Blood Volume Measurement: A Simplified Quantitative Method Predicts Outcomes and Delayed Cerebral Ischemia.

BACKGROUND: We developed a simplified ABC/2-derived method to estimate total subarachnoid hemorrhage volume (SAHV) on noncontrast computed tomography in patients with aneurysmal SAH and compared the clinical and radiographic outcomes. METHODS AND RESULTS: In this retrospective observational cohort study, we analyzed 277 patients with SAH admitted to our Comprehensive Stroke Center between 2012 and 2022. We derived a mathematical model (model 1) by measuring SAH basal cisternal blood volume using an ABC/2-derived ellipsoid formula (A=width/thickness, B=length, C=vertical extension) on head noncontrast computed tomography in 5 major SAH cisternal compartments. We compared model 1 against a manual segmentation method (model 2) on noncontrast computed tomography. Data were analyzed using logistic regression analysis, t test, receiver operator characteristic curves, and area under the curve analysis. There was no significant difference in cisternal SAHV analysis between the 2 models (P=0.14). Mean SAHV by the simplified method was 7.0 mL (95% CI, 5.89-8.09) for good outcome and 16.6 mL (95% CI, 13.49-19.77) for poor outcome. Patients with delayed cerebral ischemia had higher SAHV, with a cutoff value of 10 mL. CONCLUSIONS: Our simplified ABC/2-derived method to estimate SAHV is comparable to manual segmentation and can be performed in low-resource settings. Higher total SAHV was associated with worse outcomes and higher risk of delayed cerebral ischemia. A potential dose-response relationship was observed, with SAHV >10 mL predicting worse outcomes and higher risk of DCI.

Generative AI in oncological imaging: Revolutionizing cancer detection and diagnosis.

Generative AI is revolutionizing oncological imaging, enhancing cancer detection and diagnosis. This editorial explores its impact on expanding datasets, improving image quality, and enabling predictive oncology. We discuss ethical considerations and introduce a unique perspective on personalized cancer screening using AI-generated digital twins. This approach could optimize screening protocols, improve early detection, and tailor treatment plans. While challenges remain, generative AI in oncological imaging offers unprecedented opportunities to advance cancer care and improve patient outcomes.

Fully Automated Deep Learning Model to Detect Clinically Significant Prostate Cancer at MRI.

Background Multiparametric MRI can help identify clinically significant prostate cancer (csPCa) (Gleason score ≥7) but is limited by reader experience and interobserver variability. In contrast, deep learning (DL) produces deterministic outputs. Purpose To develop a DL model to predict the presence of csPCa by using patient-level labels without information about tumor location and to compare its performance with that of radiologists. Materials and Methods Data from patients without known csPCa who underwent MRI from January 2017 to December 2019 at one of multiple sites of a single academic institution were retrospectively reviewed. A convolutional neural network was trained to predict csPCa from T2-weighted images, diffusion-weighted images, apparent diffusion coefficient maps, and T1-weighted contrast-enhanced images. The reference standard was pathologic diagnosis. Radiologist performance was evaluated as follows: Radiology reports were used for the internal test set, and four radiologists' PI-RADS ratings were used for the external (ProstateX) test set. The performance was compared using areas under the receiver operating characteristic curves (AUCs) and the DeLong test. Gradient-weighted class activation maps (Grad-CAMs) were used to show tumor localization. Results Among 5735 examinations in 5215 patients (mean age, 66 years ± 8 [SD]; all male), 1514 examinations (1454 patients) showed csPCa. In the internal test set (400 examinations), the AUC was 0.89 and 0.89 for the DL classifier and radiologists, respectively (P = .88). In the external test set (204 examinations), the AUC was 0.86 and 0.84 for the DL classifier and radiologists, respectively (P = .68). DL classifier plus radiologists had an AUC of 0.89 (P < .001). Grad-CAMs demonstrated activation over the csPCa lesion in 35 of 38 and 56 of 58 true-positive examinations in internal and external test sets, respectively. Conclusion The performance of a DL model was not different from that of radiologists in the detection of csPCa at MRI, and Grad-CAMs localized the tumor. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Johnson and Chandarana in this issue.

The Impact of Social Deprivation on Anterior Urethral Stricture Recurrence After Urethroplasty - A Trauma and Urologic Reconstructive Network of Surgeons (TURNS) Analysis.

INTRODUCTION AND OBJECTIVES: Several factors influence recurrence after urethral stricture repair. The impact of socioeconomic factors on stricture recurrence after urethroplasty is poorly understood. This study aims to assess the impact that social deprivation, an area-level measure of disadvantage, has on urethral stricture recurrence after urethroplasty. METHODS: We performed a retrospective review of patients undergoing urethral reconstruction by surgeons participating in a collaborative research group. Home zip code was used to calculate Social Deprivation Indices (SDI; 0-100), which quantifies the level of disadvantage across several sociodemographic domains collected in the American Community Survey. Patients without zip code data were excluded from the analysis. The Cox Proportional Hazards model was used to study the association between SDI and the hazard of functional recurrence, adjusting for stricture characteristics as well as age and body mass index. RESULTS: Median age was 46.0 years with a median follow up of 367 days for the 1452 men included in the study. Patients in the fourth SDI quartile (worst social deprivation) were more likely to be active smokers with traumatic and infectious strictures compared to the first SDI quartile. Patients in the fourth SDI quartile had 1.64 times the unadjusted hazard of functional stricture recurrence vs patients in the first SDI quartile (95% CI 1.04-2.59). Compared to anastomotic ± excision, substitution only repair had 1.90 times the unadjusted hazard of recurrence. The adjusted hazard of recurrence was 1.08 per 10-point increase in SDI (95% CI 1.01-1.15, P = .027). CONCLUSIONS: Patient social deprivation identifies those at higher risk for functional recurrence after anterior urethral stricture repair, offering an opportunity for preoperative counseling and postoperative surveillance. Addressing these social determinants of health can potentially improve outcomes in reconstructive surgery.

A Multi-View Deep Learning Model for Thyroid Nodules Detection and Characterization in Ultrasound Imaging.

Thyroid Ultrasound (US) is the primary method to evaluate thyroid nodules. Deep learning (DL) has been playing a significant role in evaluating thyroid cancer. We propose a DL-based pipeline to detect and classify thyroid nodules into benign or malignant groups relying on two views of US imaging. Transverse and longitudinal US images of thyroid nodules from 983 patients were collected retrospectively. Eighty-one cases were held out as a testing set, and the rest of the data were used in five-fold cross-validation (CV). Two You Look Only Once (YOLO) v5 models were trained to detect nodules and classify them. For each view, five models were developed during the CV, which was ensembled by using non-max suppression (NMS) to boost their collective generalizability. An extreme gradient boosting (XGBoost) model was trained on the outputs of the ensembled models for both views to yield a final prediction of malignancy for each nodule. The test set was evaluated by an expert radiologist using the American College of Radiology Thyroid Imaging Reporting and Data System (ACR-TIRADS). The ensemble models for each view achieved a mAP0.5 of 0.797 (transverse) and 0.716 (longitudinal). The whole pipeline reached an AUROC of 0.84 (CI 95%: 0.75-0.91) with sensitivity and specificity of 84% and 63%, respectively, while the ACR-TIRADS evaluation of the same set had a sensitivity of 76% and specificity of 34% (p-value = 0.003). Our proposed work demonstrated the potential possibility of a deep learning model to achieve diagnostic performance for thyroid nodule evaluation.

Development of a deep learning model for the automated detection of green pixels indicative of gout on dual energy CT scan.

Background: Dual-energy CT (DECT) is a non-invasive way to determine the presence of monosodium urate (MSU) crystals in the workup of gout. Color-coding distinguishes MSU from calcium following material decomposition and post-processing. Most software labels MSU as green and calcium as blue. There are limitations in the current image processing methods of segmenting green-encoded pixels. Additionally, identifying green foci is tedious, and automated detection would improve workflow. This study aimed to determine the optimal deep learning (DL) algorithm for segmenting green-encoded pixels of MSU crystals on DECTs. Methods: DECT images of positive and negative gout cases were retrospectively collected. The dataset was split into train (N = 28) and held-out test (N = 30) sets. To perform cross-validation, the train set was split into seven folds. The images were presented to two musculoskeletal radiologists, who independently identified green-encoded voxels. Two 3D Unet-based DL models, Segresnet and SwinUNETR, were trained, and the Dice similarity coefficient (DSC), sensitivity, and specificity were reported as the segmentation metrics. Results: Segresnet showed superior performance, achieving a DSC of 0.9999 for the background pixels, 0.7868 for the green pixels, and an average DSC of 0.8934 for both types of pixels, respectively. According to the post-processed results, the Segresnet reached voxel-level sensitivity and specificity of 98.72 % and 99.98 %, respectively. Conclusion: In this study, we compared two DL-based segmentation approaches for detecting MSU deposits in a DECT dataset. The Segresnet resulted in superior performance metrics. The developed algorithm provides a potential fast, consistent, highly sensitive and specific computer-aided diagnosis tool. Ultimately, such an algorithm could be used by radiologists to streamline DECT workflow and improve accuracy in the detection of gout.

Feasibility of Observing Cerebrovascular Disease Phenotypes with Smartphone Monitoring: Study Design Considerations for Real-World Studies.

Accelerated by the adoption of remote monitoring during the COVID-19 pandemic, interest in using digitally captured behavioral data to predict patient outcomes has grown; however, it is unclear how feasible digital phenotyping studies may be in patients with recent ischemic stroke or transient ischemic attack. In this perspective, we present participant feedback and relevant smartphone data metrics suggesting that digital phenotyping of post-stroke depression is feasible. Additionally, we proffer thoughtful considerations for designing feasible real-world study protocols tracking cerebrovascular dysfunction with smartphone sensors.

MedYOLO: A Medical Image Object Detection Framework.

Artificial intelligence-enhanced identification of organs, lesions, and other structures in medical imaging is typically done using convolutional neural networks (CNNs) designed to make voxel-accurate segmentations of the region of interest. However, the labels required to train these CNNs are time-consuming to generate and require attention from subject matter experts to ensure quality. For tasks where voxel-level precision is not required, object detection models offer a viable alternative that can reduce annotation effort. Despite this potential application, there are few options for general-purpose object detection frameworks available for 3-D medical imaging. We report on MedYOLO, a 3-D object detection framework using the one-shot detection method of the YOLO family of models and designed for use with medical imaging. We tested this model on four different datasets: BRaTS, LIDC, an abdominal organ Computed tomography (CT) dataset, and an ECG-gated heart CT dataset. We found our models achieve high performance on a diverse range of structures even without hyperparameter tuning, reaching mean average precision (mAP) at intersection over union (IoU) 0.5 of 0.861 on BRaTS, 0.715 on the abdominal CT dataset, and 0.995 on the heart CT dataset. However, the models struggle with some structures, failing to converge on LIDC resulting in a mAP@0.5 of 0.0.

Whole-body low-dose computed tomography in patients with newly diagnosed multiple myeloma predicts cytogenetic risk: a deep learning radiogenomics study.

OBJECTIVE: To develop a whole-body low-dose CT (WBLDCT) deep learning model and determine its accuracy in predicting the presence of cytogenetic abnormalities in multiple myeloma (MM). MATERIALS AND METHODS: WBLDCTs of MM patients performed within a year of diagnosis were included. Cytogenetic assessments of clonal plasma cells via fluorescent in situ hybridization (FISH) were used to risk-stratify patients as high-risk (HR) or standard-risk (SR). Presence of any of del(17p), t(14;16), t(4;14), and t(14;20) on FISH was defined as HR. The dataset was evenly divided into five groups (folds) at the individual patient level for model training. Mean and standard deviation (SD) of the area under the receiver operating curve (AUROC) across the folds were recorded. RESULTS: One hundred fifty-one patients with MM were included in the study. The model performed best for t(4;14), mean (SD) AUROC of 0.874 (0.073). The lowest AUROC was observed for trisomies: AUROC of 0.717 (0.058). Two- and 5-year survival rates for HR cytogenetics were 87% and 71%, respectively, compared to 91% and 79% for SR cytogenetics. Survival predictions by the WBLDCT deep learning model revealed 2- and 5-year survival rates for patients with HR cytogenetics as 87% and 71%, respectively, compared to 92% and 81% for SR cytogenetics. CONCLUSION: A deep learning model trained on WBLDCT scans predicted the presence of cytogenetic abnormalities used for risk stratification in MM. Assessment of the model's performance revealed good to excellent classification of the various cytogenetic abnormalities.

Transition-zone PSA-density calculated from MRI deep learning prostate zonal segmentation model for prediction of clinically significant prostate cancer.

PURPOSE: To develop a deep learning (DL) zonal segmentation model of prostate MR from T2-weighted images and evaluate TZ-PSAD for prediction of the presence of csPCa (Gleason score of 7 or higher) compared to PSAD. METHODS: 1020 patients with a prostate MRI were randomly selected to develop a DL zonal segmentation model. Test dataset included 20 cases in which 2 radiologists manually segmented both the peripheral zone (PZ) and TZ. Pair-wise Dice index was calculated for each zone. For the prediction of csPCa using PSAD and TZ-PSAD, we used 3461 consecutive MRI exams performed in patients without a history of prostate cancer, with pathological confirmation and available PSA values, but not used in the development of the segmentation model as internal test set and 1460 MRI exams from PI-CAI challenge as external test set. PSAD and TZ-PSAD were calculated from the segmentation model output. The area under the receiver operating curve (AUC) was compared between PSAD and TZ-PSAD using univariate and multivariate analysis (adjusts age) with the DeLong test. RESULTS: Dice scores of the model against two radiologists were 0.87/0.87 and 0.74/0.72 for TZ and PZ, while those between the two radiologists were 0.88 for TZ and 0.75 for PZ. For the prediction of csPCa, the AUCs of TZPSAD were significantly higher than those of PSAD in both internal test set (univariate analysis, 0.75 vs. 0.73, p < 0.001; multivariate analysis, 0.80 vs. 0.78, p < 0.001) and external test set (univariate analysis, 0.76 vs. 0.74, p < 0.001; multivariate analysis, 0.77 vs. 0.75, p < 0.001 in external test set). CONCLUSION: DL model-derived zonal segmentation facilitates the practical measurement of TZ-PSAD and shows it to be a slightly better predictor of csPCa compared to the conventional PSAD. Use of TZ-PSAD may increase the sensitivity of detecting csPCa by 2-5% for a commonly used specificity level.

Synthetically enhanced: unveiling synthetic data's potential in medical imaging research.

BACKGROUND: Chest X-rays (CXR) are essential for diagnosing a variety of conditions, but when used on new populations, model generalizability issues limit their efficacy. Generative AI, particularly denoising diffusion probabilistic models (DDPMs), offers a promising approach to generating synthetic images, enhancing dataset diversity. This study investigates the impact of synthetic data supplementation on the performance and generalizability of medical imaging research. METHODS: The study employed DDPMs to create synthetic CXRs conditioned on demographic and pathological characteristics from the CheXpert dataset. These synthetic images were used to supplement training datasets for pathology classifiers, with the aim of improving their performance. The evaluation involved three datasets (CheXpert, MIMIC-CXR, and Emory Chest X-ray) and various experiments, including supplementing real data with synthetic data, training with purely synthetic data, and mixing synthetic data with external datasets. Performance was assessed using the area under the receiver operating curve (AUROC). FINDINGS: Adding synthetic data to real datasets resulted in a notable increase in AUROC values (up to 0.02 in internal and external test sets with 1000% supplementation, p-value <0.01 in all instances). When classifiers were trained exclusively on synthetic data, they achieved performance levels comparable to those trained on real data with 200%-300% data supplementation. The combination of real and synthetic data from different sources demonstrated enhanced model generalizability, increasing model AUROC from 0.76 to 0.80 on the internal test set (p-value <0.01). INTERPRETATION: Synthetic data supplementation significantly improves the performance and generalizability of pathology classifiers in medical imaging. FUNDING: Dr. Gichoya is a 2022 Robert Wood Johnson Foundation Harold Amos Medical Faculty Development Program and declares support from RSNA Health Disparities grant (#EIHD2204), Lacuna Fund (#67), Gordon and Betty Moore Foundation, NIH (NIBIB) MIDRC grant under contracts 75N92020C00008 and 75N92020C00021, and NHLBI Award Number R01HL167811.

Accelerometer-Measured Behavior Patterns in Incident Cerebrovascular Disease: Insights for Preventative Monitoring From the UK Biobank.

BACKGROUND: The goal was to compare patterns of physical activity (PA) behaviors (sedentary behavior [SB], light PA, moderate-to-vigorous PA [MVPA], and sleep) measured via accelerometers for 7 days between patients with incident cerebrovascular disease (CeVD) (n=2141) and controls (n=73 938). METHODS AND RESULTS: In multivariate models, cases spent 3.7% less time in MVPA (incidence rate ratio [IRR], 0.963 [95% CI, 0.929-0.998]) and 1.0% more time in SB (IRR, 1.010 [95% CI, 1.001-1.018]). Between 12 and 24 months before diagnosis, cases spent more time in SB (IRR, 1.028 [95% CI, 1.001-1.057]). Within the year before diagnosis, cases spent less time in MVPA (IRR, 0.861 [95% CI, 0.771-0.964]). Although SB time was not associated with CeVD risk, MVPA time, both total min/d (hazard ratio [HR], 0.998 [95% CI, 0.997-0.999]) and guideline threshold adherence (≥150 min/wk) (HR, 0.909 [95% CI, 0.827-0.998]), was associated with decreased CeVD risk. Comorbid burden had a significant partial mediation effect on the relationship between MVPA and CeVD. Cases slept more during 12:00 to 17:59 hours (IRR, 1.091 [95% CI, 1.002-1.191]) but less during 0:00 to 5:59 hours (IRR, 0.984 [95% CI, 0.977-0.992]). No between-group differences were significant at subgroup analysis. CONCLUSIONS: Daily behavior patterns were significantly different in patients before CeVD. Although SB was not associated with CeVD risk, the association between MVPA and CeVD risk is partially mediated by comorbid burden. This study has implications for understanding observable behavior patterns in cerebrovascular dysfunction and may help in developing remote monitoring strategies to prevent or reduce cerebrovascular decline.

A Guideline for Open-Source Tools to Make Medical Imaging Data Ready for Artificial Intelligence Applications: A Society of Imaging Informatics in Medicine (SIIM) Survey.

In recent years, the role of Artificial Intelligence (AI) in medical imaging has become increasingly prominent, with the majority of AI applications approved by the FDA being in imaging and radiology in 2023. The surge in AI model development to tackle clinical challenges underscores the necessity for preparing high-quality medical imaging data. Proper data preparation is crucial as it fosters the creation of standardized and reproducible AI models while minimizing biases. Data curation transforms raw data into a valuable, organized, and dependable resource and is a fundamental process to the success of machine learning and analytical projects. Considering the plethora of available tools for data curation in different stages, it is crucial to stay informed about the most relevant tools within specific research areas. In the current work, we propose a descriptive outline for different steps of data curation while we furnish compilations of tools collected from a survey applied among members of the Society of Imaging Informatics (SIIM) for each of these stages. This collection has the potential to enhance the decision-making process for researchers as they select the most appropriate tool for their specific tasks.

Advancing Precision Medicine: Algebraic Topology and Differential Geometry in Radiology and Computational Pathology.

Precision medicine aims to provide personalized care based on individual patient characteristics, rather than guideline-directed therapies for groups of diseases or patient demographics. Images-both radiology- and pathology-derived-are a major source of information on presence, type, and status of disease. Exploring the mathematical relationship of pixels in medical imaging ("radiomics") and cellular-scale structures in digital pathology slides ("pathomics") offers powerful tools for extracting both qualitative and, increasingly, quantitative data. These analytical approaches, however, may be significantly enhanced by applying additional methods arising from fields of mathematics such as differential geometry and algebraic topology that remain underexplored in this context. Geometry's strength lies in its ability to provide precise local measurements, such as curvature, that can be crucial for identifying abnormalities at multiple spatial levels. These measurements can augment the quantitative features extracted in conventional radiomics, leading to more nuanced diagnostics. By contrast, topology serves as a robust shape descriptor, capturing essential features such as connected components and holes. The field of topological data analysis was initially founded to explore the shape of data, with functional network connectivity in the brain being a prominent example. Increasingly, its tools are now being used to explore organizational patterns of physical structures in medical images and digitized pathology slides. By leveraging tools from both differential geometry and algebraic topology, researchers and clinicians may be able to obtain a more comprehensive, multi-layered understanding of medical images and contribute to precision medicine's armamentarium.