Application value of artificial intelligence model based on deep learning in Breast Ultrasound Imaging Reporting and Data System: breast nodules classification / 肿瘤研究与临床

ABSTRACT

Objective:To explore the application value of artificial intelligence (AI) model based on deep learning in breast nodules classification of Breast Imaging Reporting and Data System of ultrasound (BI-RADS-US).Methods:The ultrasound images of 2 426 breast nodules from 1 558 female patients with breast diseases at Beijing Tongren Hospital, Capital Medical University between December 2006 and December 2019 were collected . The image data sets were divided into training (63%), verification (7%), and test (30%) subsets for the construction of AI model. The diagnostic efficiencies of AI model, doctors' arbitration results and doctors' diagnosis with or without AI model assistance were analyzed by using receiver operating characteristic (ROC) curve. The Cohen weighted Kappa statistic was used to compare the consistency of BI-RADS-US classification among 5 ultrasound doctors' diagnosis with or without AI model assistance. And the changes of BI-RADS-US classification were analyzed before and after each doctor adopted AI model assistance.Results:The differences in diagnostic efficiencies of AI model, doctors' arbitration results and doctors' diagnosis with or without AI model assistance were statistically significant (all P > 0.05). The consistency among 5 ultrasound doctors was improved due to AI model assistance and Kappa value was increased from 0.433 (category 3), 0.600 (category 4a), 0.614 (category 4b), 0.570 (category 4c) and 0.495 (category 5) to 0.812, 0.704, 0.823, 0.690 and 0.509 (all P < 0.05), respectively. The upgrade and downgrade of BI-RADS-US classification occurred in 5 doctors after the classification of AI model assistance. Downgrade from category 4 to 3 in benign nodules of 56.6% (47/76) and upgrade from category 4 to 5 in malignant nodules of 69.4% (34/49) were mostly observed. Conclusions:AI-assisted BI-RADS-US classification can effectively improve the consistency of classification among the doctors without reducing the diagnostic efficiency. AI model shows clinical values in reducing unnecessary biopsy of partial benign lesions and increasing diagnostic accuracy of partial malignant lesions through the adjustment of breast nodule classification.