Development of auxiliary substation system for endoscopic ultrasound bile duct scanning based on deep learning / 中华消化内镜杂志

ABSTRACT

Objective:To construct a deep learning-based artificial intelligence endoscopic ultrasound (EUS) bile duct scanning substation system to assist endoscopists in learning multi-station imaging and improve their operation skills.Methods:A total of 522 EUS videos in Renmin Hospital of Wuhan University and Wuhan Union Hospital from May 2016 to October 2020 were collected, and images were captured from these videos, including 3 000 white light images and 31 003 EUS images from Renmin Hospital of Wuhan University, and 799 EUS images from Wuhan Union Hospital. The pictures were divided into training set and test set in the EUS bile duct scanning system. The system included filtering model of white light gastroscopy images (model 1), distinguishing model of standard station images and non-standard station images (model 2) and substation model of EUS bile duct scanning standard images (model 3), which were used to classify the standard images into liver window, stomach window, duodenal bulb window, and duodenal descending window. Then 110 pictures were randomly selected from the test set for a man-machine competition to compare the accuracy of multi-station imaging by experts, advanced endoscopists and the artificial intelligence model.Results:The accuracies of model 1 and model 2 were 100.00% (1 200/1 200) and 93.36% (2 938/3 147) respectively. Those of model 3 on the internal validation dataset in each classification were 97.23% (1 687/1 735) in liver window, 96.89% (1 681/1 735) in stomach window, 98.73% (1 713/1 735) in duodenal bulb window, and 97.18% (1 686/1 735) in duodenal descending window. And those on the external validation dataset were 89.61% (716/799) in liver window, 92.74% (741/799) in stomach window, 90.11% (720/799) in duodenal bulb window, and 92.24% (737/799) in duodenal descending window. In the man-machine competition, the accuracy of the substation model was 89.09% (98/110), which was higher than that of senior endoscopists [85.45% (94/110), 74.55% (82/110), and 85.45% (94/110)] and close to the level of experts [92.73% (102/110) and 90.00% (99/110)].Conclusion:The deep learning-based EUS bile duct scanning system constructed in the current study can assist endoscopists to perform standard multi-station scanning in real time more accurately and improve the completeness and quality of EUS.