Real-time classification of tumour and non-tumour tissue in colorectal cancer using diffuse reflectance spectroscopy and neural networks to aid margin assessment.

BACKGROUND: Colorectal cancer is the third most commonly diagnosed malignancy and the second leading cause of mortality worldwide. A positive resection margin following surgery for colorectal cancer is linked with higher rates of local recurrence and poorer survival. The authors investigated diffuse reflectance spectroscopy (DRS) to distinguish tumour and non-tumour tissue in ex-vivo colorectal specimens, to aid margin assessment and provide augmented visual maps to the surgeon in real-time. METHODS: Patients undergoing elective colorectal cancer resection surgery at a London-based hospital were prospectively recruited. A hand-held DRS probe was used on the surface of freshly resected ex-vivo colorectal tissue. Spectral data were acquired for tumour and non-tumour tissue. Binary classification was achieved using conventional machine learning classifiers and a convolutional neural network (CNN), which were evaluated in terms of sensitivity, specificity, accuracy and the area under the curve. RESULTS: A total of 7692 mean spectra were obtained for tumour and non-tumour colorectal tissue. The CNN-based classifier was the best performing machine learning algorithm, when compared to contrastive approaches, for differentiating tumour and non-tumour colorectal tissue, with an overall diagnostic accuracy of 90.8% and area under the curve of 96.8%. Live on-screen classification of tissue type was achieved using a graduated colourmap. CONCLUSION: A high diagnostic accuracy for a DRS probe and tracking system to differentiate ex-vivo tumour and non-tumour colorectal tissue in real-time with on-screen visual feedback was highlighted by this study. Further in-vivo studies are needed to ensure integration into a surgical workflow.

A YOLOv5-based network for the detection of a diffuse reflectance spectroscopy probe to aid surgical guidance in gastrointestinal cancer surgery.

PURPOSE: A positive circumferential resection margin (CRM) for oesophageal and gastric carcinoma is associated with local recurrence and poorer long-term survival. Diffuse reflectance spectroscopy (DRS) is a non-invasive technology able to distinguish tissue type based on spectral data. The aim of this study was to develop a deep learning-based method for DRS probe detection and tracking to aid classification of tumour and non-tumour gastrointestinal (GI) tissue in real time. METHODS: Data collected from both ex vivo human tissue specimen and sold tissue phantoms were used for the training and retrospective validation of the developed neural network framework. Specifically, a neural network based on the You Only Look Once (YOLO) v5 network was developed to accurately detect and track the tip of the DRS probe on video data acquired during an ex vivo clinical study. RESULTS: Different metrics were used to analyse the performance of the proposed probe detection and tracking framework, such as precision, recall, mAP 0.5, and Euclidean distance. Overall, the developed framework achieved a 93% precision at 23 FPS for probe detection, while the average Euclidean distance error was 4.90 pixels. CONCLUSION: The use of a deep learning approach for markerless DRS probe detection and tracking system could pave the way for real-time classification of GI tissue to aid margin assessment in cancer resection surgery and has potential to be applied in routine surgical practice.

Real-time Tracking and Classification of Tumor and Nontumor Tissue in Upper Gastrointestinal Cancers Using Diffuse Reflectance Spectroscopy for Resection Margin Assessment.

Importance: Cancers of the upper gastrointestinal tract remain a major contributor to the global cancer burden. The accurate mapping of tumor margins is of particular importance for curative cancer resection and improvement in overall survival. Current mapping techniques preclude a full resection margin assessment in real time. Objective: To evaluate whether diffuse reflectance spectroscopy (DRS) on gastric and esophageal cancer specimens can differentiate tissue types and provide real-time feedback to the operator. Design, Setting, and Participants: This was a prospective ex vivo validation study. Patients undergoing esophageal or gastric cancer resection were prospectively recruited into the study between July 2020 and July 2021 at Hammersmith Hospital in London, United Kingdom. Tissue specimens were included for patients undergoing elective surgery for either esophageal carcinoma (adenocarcinoma or squamous cell carcinoma) or gastric adenocarcinoma. Exposures: A handheld DRS probe and tracking system was used on freshly resected ex vivo tissue to obtain spectral data. Binary classification, following histopathological validation, was performed using 4 supervised machine learning classifiers. Main Outcomes and Measures: Data were divided into training and testing sets using a stratified 5-fold cross-validation method. Machine learning classifiers were evaluated in terms of sensitivity, specificity, overall accuracy, and the area under the curve. Results: Of 34 included patients, 22 (65%) were male, and the median (range) age was 68 (35-89) years. A total of 14 097 mean spectra for normal and cancerous tissue were collected. For normal vs cancer tissue, the machine learning classifier achieved a mean (SD) overall diagnostic accuracy of 93.86% (0.66) for stomach tissue and 96.22% (0.50) for esophageal tissue and achieved a mean (SD) sensitivity and specificity of 91.31% (1.5) and 95.13% (0.8), respectively, for stomach tissue and of 94.60% (0.9) and 97.28% (0.6) for esophagus tissue. Real-time tissue tracking and classification was achieved and presented live on screen. Conclusions and Relevance: This study provides ex vivo validation of the DRS technology for real-time differentiation of gastric and esophageal cancer from healthy tissue using machine learning with high accuracy. As such, it is a step toward the development of a real-time in vivo tumor mapping tool for esophageal and gastric cancers that can aid decision-making of resection margins intraoperatively.

Real-time tracking of a diffuse reflectance spectroscopy probe used to aid histological validation of margin assessment in upper gastrointestinal cancer resection surgery.

SIGNIFICANCE: Diffuse reflectance spectroscopy (DRS) allows discrimination of tissue type. Its application is limited by the inability to mark the scanned tissue and the lack of real-time measurements. AIM: This study aimed to develop a real-time tracking system to enable localization of a DRS probe to aid the classification of tumor and non-tumor tissue. APPROACH: A green-colored marker attached to the DRS probe was detected using hue-saturation-value (HSV) segmentation. A live, augmented view of tracked optical biopsy sites was recorded in real time. Supervised classifiers were evaluated in terms of sensitivity, specificity, and overall accuracy. A developed software was used for data collection, processing, and statistical analysis. RESULTS: The measured root mean square error (RMSE) of DRS probe tip tracking was 1.18 ± 0.58 mm and 1.05 ± 0.28 mm for the x and y dimensions, respectively. The diagnostic accuracy of the system to classify tumor and non-tumor tissue in real time was 94% for stomach and 96% for the esophagus. CONCLUSIONS: We have successfully developed a real-time tracking and classification system for a DRS probe. When used on stomach and esophageal tissue for tumor detection, the accuracy derived demonstrates the strength and clinical value of the technique to aid margin assessment in cancer resection surgery.