A detection model of colorectal polyps based on YOLO and ResNet deep convolutional neural networks (with video) / 中华消化内镜杂志

ABSTRACT

Objective:To establish a deep convolutional neural network (DCNN) model based on YOLO and ResNet algorithm for automatic detection of colorectal polyps and to test its function.Methods:Colonoscopy images and videos collected from the database of Digestive Endoscopy Center of Renmin Hospital of Wuhan University from January 2018 to March 2019 were divided into three databases (database 1, 3, 4). The public database CVC-ClinicDB (composed of 612 polyp images extracted from 29 colonoscopy videos provided by Barcelona Hospital, Spain) was used as the database 2. Database 1 (4 700 colonoscopy images from January 2018 to November 2018, including 3 700 intestinal polyp images and 1 000 non-polyp images) was used for establishing training and verifying the DCNN model. Database 2 (CVC-ClinicDB) and database 3 (720 colonoscopy images from January 2019 to March 2019, including 320 intestinal polyp images and 400 non-polyp images) were used for testing the DCNN model on image detection. Database 4 (15 colonoscopy videos in December 2019, containing 33 polyps) was used for testing the DCNN model on video detection. The sensitivity, specificity, accuracy and false positive rate of the DCNN model for detecting intestinal polyps were calculated.Results:The sensitivity of the DCNN model for detecting intestinal polyps in database 2 was 93.19% (602/646). In database 3, the DCNN model showed the accuracy of 95.00% (684/720), sensitivity of 98.13% (314/320), specificity of 92.50% (370/400), and false positive rate of 7.50% (30/400) for detecting intestinal polyps. In database 4, the DCNN model achieved a per-polyp-sensitivity of 100.00% (33/33), a per-image-accuracy of 96.29% (133 840/138 998), a per-image-sensitivity of 90.24% (4 066/4 506), a per-image-specificity of 96.49% (129 774/134 492), and a per-image-false positive rate of 3.51% (4 718/134 492).Conclusion:The DCNN model constructed in the study has a high sensitivity and specificity for automatic detection of colorectal polyps both in the colonoscopy images and videos, has a low false positive rate in the videos, and has the potential to assist endoscopists in diagnosis of colorectal polyps.