Preoperative Prediction of Axillary Lymph Node Metastasis in Patients With Breast Cancer Through Multimodal Deep Learning Based on Ultrasound and Magnetic Resonance Imaging Images.

ABSTRACT

RATIONALE AND OBJECTIVES: Deep learning can enhance the performance of multimodal image analysis, which is known for its noninvasive attributes and complementary efficacy, in predicting axillary lymph node (ALN) metastasis. Therefore, we established a multimodal deep learning model incorporating ultrasound (US) and magnetic resonance imaging (MRI) images to predict ALN metastasis in patients with breast cancer. MATERIALS AND METHODS: A retrospective cohort of patients with histologically confirmed breast cancer from two hospitals composed of the primary cohort (n = 465) and the external validation cohort (n = 123). All patients had undergone both preoperative US and MRI scans. After data preprocessing, three convolutional neural network models were used to analyze the US and MRI images, respectively. After integrating the US and MRI deep learning prediction results (DLUS and DLMRI, respectively), a multimodal deep learning (DLMRI+US+Clinical parameter) model was constructed. The predictive ability of the proposed model was compared to that of the DLUS, DLMRI, combined bimodal (DLMRI+US), and clinical parameter models. Evaluation was performed using the area under the receiver operating characteristic curves (AUCs) and decision curves. RESULTS: A total of 588 patients with breast cancer participated in this study. The DLMRI+US+Clinical parameter model outperformed the alternative models, achieving the highest AUCs of 0.819 (95% confidence interval [CI] 0.734-0.903) and 0.809 (95% CI 0.723-0.895) on the internal and external validation sets, respectively. The decision curve analysis confirmed its clinical usefulness. CONCLUSION: The DLMRI+US＋Clinical parameter model demonstrates the feasibility and reliability of its performance for ALN metastasis prediction in patients with breast cancer.