Tongue Tumor Detection in Hyperspectral Images Using Deep Learning Semantic Segmentation.

OBJECTIVE: The utilization of hyperspectral imaging (HSI) in real-time tumor segmentation during a surgery have recently received much attention, but it remains a very challenging task. METHODS: In this work, we propose semantic segmentation methods, and compare them with other relevant deep learning algorithms for tongue tumor segmentation. To the best of our knowledge, this is the first work using deep learning semantic segmentation for tumor detection in HSI data using channel selection, and accounting for more spatial tissue context, and global comparison between the prediction map, and the annotation per sample. Results, and Conclusion: On a clinical data set with tongue squamous cell carcinoma, our best method obtains very strong results of average dice coefficient, and area under the ROC-curve of [Formula: see text], and [Formula: see text], respectively on the original spatial image size. The results show that a very good performance can be achieved even with a limited amount of data. We demonstrate that important information regarding tumor decision is encoded in various channels, but some channel selection, and filtering is beneficial over the full spectra. Moreover, we use both visual (VIS), and near-infrared (NIR) spectrum, rather than commonly used only VIS spectrum; although VIS spectrum is generally of higher significance, we demonstrate NIR spectrum is crucial for tumor capturing in some cases. SIGNIFICANCE: The HSI technology augmented with accurate deep learning algorithms has a huge potential to be a promising alternative to digital pathology or a doctors' supportive tool in real-time surgeries.

Diffuse reflectance spectroscopy as a tool for real-time tissue assessment during colorectal cancer surgery.

Colorectal surgery is the standard treatment for patients with colorectal cancer. To overcome two of the main challenges, the circumferential resection margin and postoperative complications, real-time tissue assessment could be of great benefit during surgery. In this ex vivo study, diffuse reflectance spectroscopy (DRS) was used to differentiate tumor tissue from healthy surrounding tissues in patients with colorectal neoplasia. DRS spectra were obtained from tumor tissue, healthy colon, or rectal wall and fat tissue, for every patient. Data were randomly divided into training (80%) and test (20%) sets. After spectral band selection, the spectra were classified using a quadratic classifier and a linear support vector machine. Of the 38 included patients, 36 had colorectal cancer and 2 had an adenoma. When the classifiers were applied to the test set, colorectal cancer could be discriminated from healthy tissue with an overall accuracy of 0.95 (±0.03). This study demonstrates the possibility to separate colorectal cancer from healthy surrounding tissue by applying DRS. High classification accuracies were obtained both in homogeneous and inhomogeneous tissues. This is a fundamental step toward the development of a tool for real-time in vivo tissue assessment during colorectal surgery.