ABSTRACT
Objective:To evaluate deep learning for differentiating invasion depth of colorectal adenomas under image enhanced endoscopy (IEE).Methods:A total of 13 246 IEE images from 3 714 lesions acquired from November 2016 to June 2021 were retrospectively collected in Renmin Hospital of Wuhan University, Shenzhen Hospital of Southern Medical University and the First Hospital of Yichang to construct a deep learning model to differentiate submucosal deep invasion and non-submucosal deep invasion lesions of colorectal adenomas. The performance of the deep learning model was validated in an independent test and an external test. The full test was used to compare the diagnostic performance between 5 endoscopists and the deep learning model. A total of 35 videos were collected from January to June 2021 in Renmin Hospital of Wuhan University to validate the diagnostic performance of the endoscopists with the assistance of deep learning model.Results:The accuracy and Youden index of the deep learning model in image test set were 93.08% (821/882) and 0.86, which were better than those of endoscopists [the highest were 91.72% (809/882) and 0.78]. In video test set, the accuracy and Youden index of the model were 97.14% (34/35) and 0.94. With the assistance of the model, the accuracy of endoscopists was significantly improved [the highest was 97.14% (34/35)].Conclusion:The deep learning model obtained in this study could identify submucosal lesions with deep invasion accurately for colorectal adenomas, and could improve the diagnostic accuracy of endoscopists.
ABSTRACT
Objective:To construct a deep learning-based diagnostic system for gastrointestinal submucosal tumor (SMT) under endoscopic ultrasonography (EUS), so as to help endoscopists diagnose SMT.Methods:From January 1, 2019 to December 15, 2021, at the Digestive Endoscopy Center of Renmin Hospital of Wuhan University, 245 patients with SMT confirmed by pathological diagnosis who underwent EUS and endoscopic submucosal dissection were enrolled. A total of 3 400 EUS images were collected. Among the images, 2 722 EUS images were used for training of lesion segmentation model, while 2 209 EUS images were used for training of stromal tumor and leiomyoma classification model; 283 and 191 images were selected as independent test sets to evaluate lesion segmentation model and classification model, respectively. Thirty images were selected as an independent data set for human-machine competition to compare the lesion classification accuracy between lesion classification models and 6 endoscopists. The performance of the segmentation model was evaluated by indexes such as Intersection-over-Union and Dice coefficient. The performance of the classification model was evaluated by accuracy. Chi-square test was used for statistical analysis.Results:The average Intersection-over-Union and Dice coefficient of lesion segmentation model were 0.754 and 0.835, respectively, and the accuracy, recall and F1 score were 95.2%, 98.9% and 97.0%, respectively. Based on the lesion segmentation, the accuracy of classification model increased from 70.2% to 92.1%. The results of human-machine competition showed that the accuracy of classification model in differential diagnosis of stromal tumor and leiomyoma was 86.7% (26/30), which was superior to that of 4 out of the 6 endoscopists(56.7%, 17/30; 56.7%, 17/30; 53.3%, 16/30; 60.0%, 18/30; respectively), and the differences were statistically significant( χ2=7.11, 7.36, 8.10, 6.13; all P<0.05). There was no significant difference between the accuracy of the other 2 endoscopists(76.7%, 23/30; 73.3%, 22/30; respectively) and model(both P<0.05). Conclusion:This system could be used for the auxiliary diagnosis of SMT under ultrasonic endoscope in the future, and to provide a powerful evidence for the selection of subsequent treatment decisions.
ABSTRACT
Objective:To develop an endoscopic ultrasonography (EUS) station recognition and pancreatic segmentation system based on deep learning and to validate its efficacy.Methods:Data of 269 EUS procedures were retrospectively collected from Renmin Hospital of Wuhan University between December 2016 and December 2019, and were divided into 3 datasets: (1)Dataset A of 205 procedures for model training containing 16 305 images for classification training and 1 953 images for segmentation training; (2)Dataset B of 44 procedures for model testing containing 1 606 images for classification testing and 480 images for segmentation testing; (3) Dataset C of 20 procedures with 150 images for comparing the performance between models and endoscopists. EUS experts (with more than 10 years of experience) A and B classified and labeled all images of dataset A, B and C through discussion, and the results were used as the gold standard. EUS expert C and senior EUS endoscopists (with more than 5 years of experience) D and E classified and labeled the images in dataset C, and the results were used for comparison with model. The main outcomes included accuracy of classification, Dice (F1 score) of segmentation and Cohen Kappa coefficient of consistency analysis.Results:In test dataset B, the model achieved a mean accuracy of 94.1% in classification. The mean Dice of pancreatic and vascular segmentation were 0.826 and 0.841 respectively. In dataset C, the classification accuracy of the model reached 90.0%. The classification accuracy of expert C, senior endoscopist D and E were 89.3%, 88.7% and 87.3%, respectively. The Dice of pancreatic and vascular segmentation in the model were 0.740 and 0.859, 0.708 and 0.778 for expert C, 0.747 and 0.875 for senior endoscopist D, and 0.774 and 0.789 for senior endoscopist E. The model was comparable to the expert level.Consistency analysis showed that there was high consistency between the model and endoscopists (the Kappa coefficient was 0.823 between model and expert C, 0.840 between model and senior endoscopist D, and 0.799 between model and senior endoscopist E).Conclusion:EUS station classification and pancreatic segmentation system based on deep learning can be used for quality control of pancreatic EUS, with a comparable performance of classification and segmentation to that of EUS experts.
