COMPUTER-AIDED DIAGNOSIS IMPROVES CHARACTERIZATION OF BARRETT'S NEOPLASIA BY GENERAL ENDOSCOPISTS.

BACKGROUND & AIMS: Characterization of visible abnormalities in Barrett esophagus (BE) patients can be challenging, especially for unexperienced endoscopists. This results in suboptimal diagnostic accuracy and poor inter-observer agreement. Computer-aided diagnosis (CADx) systems may assist endoscopists. We aimed to develop, validate and benchmark a CADx system for BE neoplasia. METHODS: The CADx system received pretraining with ImageNet with consecutive domain-specific pretraining with GastroNet which includes 5 million endoscopic images. It was subsequently trained and internally validated using 1,758 narrow-band imaging (NBI) images of early BE neoplasia (352 patients) and 1,838 NBI images of non-dysplastic BE (173 patients) from 8 international centers. CADx was tested prospectively on corresponding image and video test sets with 30 cases (20 patients) of BE neoplasia and 60 cases (31 patients) of non-dysplastic BE. The test set was benchmarked by 44 general endoscopists in two phases (phase 1: no CADx assistance; phase 2: with CADx assistance). Ten international BE experts provided additional benchmark performance. RESULTS: Stand-alone sensitivity and specificity of the CADx system were 100% and 98% for images and 93% and 96% for videos, respectively. CADx outperformed general endoscopists without CADx assistance in terms of sensitivity (p=0.04). Sensitivity and specificity of general endoscopist increased from 84% to 96% and 90 to 98% with CAD assistance (p<0.001), respectively. CADx assistance increased endoscopists' confidence in characterization (p<0.001). CADx performance was similar to Barrett experts. CONCLUSION: CADx assistance significantly increased characterization performance of BE neoplasia by general endoscopists to the level of expert endoscopists. The use of this CADx system may thereby improve daily Barrett surveillance.

The use of a real-time computer-aided detection system for visible lesions in the Barrett's esophagus during live endoscopic procedures: a pilot study (video).

BACKGROUND AND AIMS: This pilot study evaluated the performance of a recently developed computer-aided detection (CADe) system for Barrett's neoplasia during live endoscopic procedures. METHODS: Fifteen patients with a visible lesion and 15 without were included in this study. A CAD-assisted workflow was used that included a slow pullback video recording of the entire Barrett's segment with live CADe assistance, followed by CADe-assisted level-based video recordings every 2 cm of the Barrett's segment. Outcomes were per-patient and per-level diagnostic accuracy of the CAD-assisted workflow, in which the primary outcome was per-patient in vivo CADe sensitivity. RESULTS: In the per-patient analyses, the CADe system detected all visible lesions (sensitivity 100%). Per-patient CADe specificity was 53%. Per-level sensitivity and specificity of the CADe assisted workflow were 100% and 73%, respectively. CONCLUSIONS: In this pilot study, detection by the CADe system of all potentially neoplastic lesions in Barrett's esophagus was comparable to that of an expert endoscopist. Continued refinement of the system may improve specificity. External validation in larger multicenter studies is planned. (Clinical trial registration number: NCT05628441.).

Towards a robust and compact deep learning system for primary detection of early Barrett's neoplasia: Initial image-based results of training on a multi-center retrospectively collected data set.

INTRODUCTION: Endoscopic detection of early neoplasia in Barrett's esophagus is difficult. Computer Aided Detection (CADe) systems may assist in neoplasia detection. The aim of this study was to report the first steps in the development of a CADe system for Barrett's neoplasia and to evaluate its performance when compared with endoscopists. METHODS: This CADe system was developed by a consortium, consisting of the Amsterdam University Medical Center, Eindhoven University of Technology, and 15 international hospitals. After pretraining, the system was trained and validated using 1.713 neoplastic (564 patients) and 2.707 non-dysplastic Barrett's esophagus (NDBE; 665 patients) images. Neoplastic lesions were delineated by 14 experts. The performance of the CADe system was tested on three independent test sets. Test set 1 (50 neoplastic and 150 NDBE images) contained subtle neoplastic lesions representing challenging cases and was benchmarked by 52 general endoscopists. Test set 2 (50 neoplastic and 50 NDBE images) contained a heterogeneous case-mix of neoplastic lesions, representing distribution in clinical practice. Test set 3 (50 neoplastic and 150 NDBE images) contained prospectively collected imagery. The main outcome was correct classification of the images in terms of sensitivity. RESULTS: The sensitivity of the CADe system on test set 1 was 84%. For general endoscopists, sensitivity was 63%, corresponding to a neoplasia miss-rate of one-third of neoplastic lesions and a potential relative increase in neoplasia detection of 33% for CADe-assisted detection. The sensitivity of the CADe system on test sets 2 and 3 was 100% and 88%, respectively. The specificity of the CADe system varied for the three test sets between 64% and 66%. CONCLUSION: This study describes the first steps towards the establishment of an unprecedented data infrastructure for using machine learning to improve the endoscopic detection of Barrett's neoplasia. The CADe system detected neoplasia reliably and outperformed a large group of endoscopists in terms of sensitivity.

Linked color imaging improves identification of early gastric cancer lesions by expert and non-expert endoscopists.

BACKGROUND AND AIMS: Early gastric cancer (EGC) lesions are often subtle and endoscopically poorly visible. The aim of this study is to evaluate the additive effect of linked color imaging (LCI) next to white-light endoscopy (WLE) for identification of EGC, when assessed by expert and non-expert endoscopists. METHODS: Forty EGC cases were visualized in corresponding WLE and LCI images. Endoscopists evaluated the cases in 3 assessment phases: Phase 1: WLE images only; Phase 2: LCI images only; Phase 3: WLE and LCI images side-to-side. First, 3 expert endoscopists delineated all cases. A high level of agreement between the expert delineations corresponded with a high AND/OR ratio. Subsequently, 62 non-experts indicated their preferred biopsy location. Outcomes of the study are as follows: (1) difference in expert AND/OR ratio; (2) accuracy of biopsy placement by non-expert endoscopists; and (3) preference of imaging modality by non-expert endoscopists. RESULTS: Quantitative agreement between experts increased significantly when LCI was available (0.58 vs. 0.46, p = 0.007). This increase was more apparent for the more challenging cases (0.21 vs. 0.47, p < 0.001). Non-experts placed the biopsy mark more accurately with LCI (82.3% vs. 87.2%, p < 0.001). Again this increase was more profound for the more challenging cases (70.4% vs. 83.4%, p < 0.001). Non-experts indicated to prefer LCI over WLE. CONCLUSION: The addition of LCI next to WLE improves visualization of EGC. Experts reach higher consensus on discrimination between neoplasia and inflammation when using LCI. Non-experts improve their targeted biopsy placement with the use of LCI. LCI therefore appears to be a useful tool for identification of EGC.

Toward improved endoscopic surveillance with multidiameter single fiber reflectance spectroscopy in patients with Barrett's esophagus.

Patients with Barrett's esophagus are at an increased risk to develop esophageal cancer and, therefore, undergo regular endoscopic surveillance. Early detection of neoplasia enables endoscopic treatment, which improves outcomes. However, early Barrett's neoplasia is easily missed during endoscopic surveillance. This study investigates multidiameter single fiber reflectance spectroscopy (MDSFR) to improve Barrett's surveillance. Based on the concept of field cancerization, it may be possible to identify the presence of a neoplastic lesion from measurements elsewhere in the esophagus or even the oral cavity. In this study, MDSFR measurements are performed on non-dysplastic Barrett's mucosa, squamous mucosa, oral mucosa, and the neoplastic lesion (if present). Based on logistic regression analysis on the scattering parameters measured by MDSFR, a classifier is developed that can predict the presence of neoplasia elsewhere in the Barrett's segment from measurements on the non-dysplastic Barrett's mucosa (sensitivity 91%, specificity 71%, AUC = 0.77). Classifiers obtained from logistic regression analysis for the squamous and oral mucosa do not result in an AUC significantly different from 0.5.

Multi-stage domain-specific pretraining for improved detection and localization of Barrett's neoplasia: A comprehensive clinically validated study.

Patients suffering from Barrett's Esophagus (BE) are at an increased risk of developing esophageal adenocarcinoma and early detection is crucial for a good prognosis. To aid the endoscopists with the early detection for this preliminary stage of esophageal cancer, this work concentrates on the development and extensive evaluation of a state-of-the-art computer-aided classification and localization algorithm for dysplastic lesions in BE. To this end, we have employed a large-scale endoscopic data set, consisting of 494,355 images, in combination with a novel semi-supervised learning algorithm to pretrain several instances of the proposed neural network architecture. Next, several Barrett-specific data sets that are increasingly closer to the target domain with significantly more data compared to other related work, were used in a multi-stage transfer learning strategy. Additionally, the algorithm was evaluated on two prospectively gathered external test sets and compared against 53 medical professionals. Finally, the model was also evaluated in a live setting without interfering with the current biopsy protocol. Results from the performed experiments show that the proposed model improves on the state-of-the-art on all measured metrics. More specifically, compared to the best performing state-of-the-art model, the specificity is improved by more than 20% points while simultaneously preserving high sensitivity and reducing the false positive rate substantially. Our algorithm yields similar scores on the localization metrics, where the intersection of all experts is correctly indicated in approximately 92% of the cases. Furthermore, the live pilot study shows great performance in a clinical setting with a patient level accuracy, sensitivity, and specificity of 90%. Finally, the proposed algorithm outperforms each individual medical expert by at least 5% and the average assessor by more than 10% over all assessor groups with respect to accuracy.

Improving Temporal Stability and Accuracy for Endoscopic Video Tissue Classification Using Recurrent Neural Networks.

Early Barrett's neoplasia are often missed due to subtle visual features and inexperience of the non-expert endoscopist with such lesions. While promising results have been reported on the automated detection of this type of early cancer in still endoscopic images, video-based detection using the temporal domain is still open. The temporally stable nature of video data in endoscopic examinations enables to develop a framework that can diagnose the imaged tissue class over time, thereby yielding a more robust and improved model for spatial predictions. We show that the introduction of Recurrent Neural Network nodes offers a more stable and accurate model for tissue classification, compared to classification on individual images. We have developed a customized Resnet18 feature extractor with four types of classifiers: Fully Connected (FC), Fully Connected with an averaging filter (FC Avg(n = 5)), Long Short Term Memory (LSTM) and a Gated Recurrent Unit (GRU). Experimental results are based on 82 pullback videos of the esophagus with 46 high-grade dysplasia patients. Our results demonstrate that the LSTM classifier outperforms the FC, FC Avg(n = 5) and GRU classifier with an average accuracy of 85.9% compared to 82.2%, 83.0% and 85.6%, respectively. The benefit of our novel implementation for endoscopic tissue classification is the inclusion of spatio-temporal information for improved and robust decision making, and it is the first step towards full temporal learning of esophageal cancer detection in endoscopic video.

Machine learning in GI endoscopy: practical guidance in how to interpret a novel field.

There has been a vast increase in GI literature focused on the use of machine learning in endoscopy. The relative novelty of this field poses a challenge for reviewers and readers of GI journals. To appreciate scientific quality and novelty of machine learning studies, understanding of the technical basis and commonly used techniques is required. Clinicians often lack this technical background, while machine learning experts may be unfamiliar with clinical relevance and implications for daily practice. Therefore, there is an increasing need for a multidisciplinary, international evaluation on how to perform high-quality machine learning research in endoscopy. This review aims to provide guidance for readers and reviewers of peer-reviewed GI journals to allow critical appraisal of the most relevant quality requirements of machine learning studies. The paper provides an overview of common trends and their potential pitfalls and proposes comprehensive quality requirements in six overarching themes: terminology, data, algorithm description, experimental setup, interpretation of results and machine learning in clinical practice.

Deep learning algorithm detection of Barrett's neoplasia with high accuracy during live endoscopic procedures: a pilot study (with video).

BACKGROUND AND AIMS: We assessed the preliminary diagnostic accuracy of a recently developed computer-aided detection (CAD) system for detection of Barrett's neoplasia during live endoscopic procedures. METHODS: The CAD system was tested during endoscopic procedures in 10 patients with nondysplastic Barrett's esophagus (NDBE) and 10 patients with confirmed Barrett's neoplasia. White-light endoscopy images were obtained at every 2-cm level of the Barrett's segment and immediately analyzed by the CAD system, providing instant feedback to the endoscopist. At every level, 3 images were evaluated by the CAD system. Outcome measures were diagnostic performance of the CAD system per level and per patient, defined as accuracy, sensitivity, and specificity (ground truth was established by expert assessment and corresponding histopathology), and concordance of 3 sequential CAD predictions per level. RESULTS: Accuracy, sensitivity, and specificity of the CAD system in a per-level analyses were 90%, 91%, and 89%, respectively. Nine of 10 neoplastic patients were correctly diagnosed. The single lesion not detected by CAD showed NDBE in the endoscopic resection specimen. In only 1 NDBE patient, the CAD system produced false-positive predictions. In 75% of all levels, the CAD system produced 3 concordant predictions. CONCLUSIONS: This is one of the first studies to evaluate a CAD system for Barrett's neoplasia during live endoscopic procedures. The system detected neoplasia with high accuracy, with only a small number of false-positive predictions and with a high concordance rate between separate predictions. The CAD system is thereby ready for testing in larger, multicenter trials. (Clinical trial registration number: NL7544.).

Blue-light imaging and linked-color imaging improve visualization of Barrett's neoplasia by nonexpert endoscopists.

BACKGROUND AND AIMS: Endoscopic recognition of early Barrett's neoplasia is challenging. Blue-light imaging (BLI) and linked-color imaging (LCI) may assist endoscopists in appreciation of neoplasia. Our aim was to evaluate BLI and LCI for visualization of Barrett's neoplasia in comparison with white-light endoscopy (WLE) alone, when assessed by nonexpert endoscopists. METHODS: In this web-based assessment, corresponding WLE, BLI, and LCI images of 30 neoplastic Barrett's lesions were delineated by 3 expert endoscopists to establish ground truth. These images were then scored and delineated by 76 nonexpert endoscopists from 3 countries and with different levels of expertise, in 4 separate assessment phases with a washout period of 2 weeks. Assessments were as follows: assessment 1, WLE only; assessment 2, WLE + BLI; assessment 3, WLE + LCI; assessment 4, WLE + BLI + LCI. The outcomes were (1) appreciation of macroscopic appearance and ability to delineate lesions (visual analog scale [VAS] scores); (2) preferred technique (ordinal scores); and (3) assessors' delineation performance in terms of overlap with expert ground truth. RESULTS: Median VAS scores for phases 2 to 4 were significantly higher than in phase 1 (P < .001). Assessors preferred BLI and LCI over WLE for appreciation of macroscopic appearance (P < .001) and delineation (P < .001). Linear mixed-effect models showed that delineation performance increased significantly in phase 4. CONCLUSIONS: The use of BLI and LCI has significant additional value for the visualization of Barrett's neoplasia when used by nonexpert endoscopists. Assessors appreciated the addition of BLI and LCI better than the use of WLE alone. Furthermore, this addition led to improved delineation performance, thereby allowing for better acquisition of targeted biopsy samples. (The Netherlands Trial Registry number: NL7541.).

Deep-Learning System Detects Neoplasia in Patients With Barrett's Esophagus With Higher Accuracy Than Endoscopists in a Multistep Training and Validation Study With Benchmarking.

BACKGROUND & AIMS: We aimed to develop and validate a deep-learning computer-aided detection (CAD) system, suitable for use in real time in clinical practice, to improve endoscopic detection of early neoplasia in patients with Barrett's esophagus (BE). METHODS: We developed a hybrid ResNet-UNet model CAD system using 5 independent endoscopy data sets. We performed pretraining using 494,364 labeled endoscopic images collected from all intestinal segments. Then, we used 1704 unique esophageal high-resolution images of rigorously confirmed early-stage neoplasia in BE and nondysplastic BE, derived from 669 patients. System performance was assessed by using data sets 4 and 5. Data set 5 was also scored by 53 general endoscopists with a wide range of experience from 4 countries to benchmark CAD system performance. Coupled with histopathology findings, scoring of images that contained early-stage neoplasia in data sets 2-5 were delineated in detail for neoplasm position and extent by multiple experts whose evaluations served as the ground truth for segmentation. RESULTS: The CAD system classified images as containing neoplasms or nondysplastic BE with 89% accuracy, 90% sensitivity, and 88% specificity (data set 4, 80 patients and images). In data set 5 (80 patients and images) values for the CAD system vs those of the general endoscopists were 88% vs 73% accuracy, 93% vs 72% sensitivity, and 83% vs 74% specificity. The CAD system achieved higher accuracy than any of the individual 53 nonexpert endoscopists, with comparable delineation performance. CAD delineations of the area of neoplasm overlapped with those from the BE experts in all detected neoplasia in data sets 4 and 5. The CAD system identified the optimal site for biopsy of detected neoplasia in 97% and 92% of cases (data sets 4 and 5, respectively). CONCLUSIONS: We developed, validated, and benchmarked a deep-learning computer-aided system for primary detection of neoplasia in patients with BE. The system detected neoplasia with high accuracy and near-perfect delineation performance. The Netherlands National Trials Registry, Number: NTR7072.