ImSpect: Image-driven self-supervised learning for surgical margin evaluation with mass spectrometry.

PURPOSE: Real-time assessment of surgical margins is critical for favorable outcomes in cancer patients. The iKnife is a mass spectrometry device that has demonstrated potential for margin detection in cancer surgery. Previous studies have shown that using deep learning on iKnife data can facilitate real-time tissue characterization. However, none of the existing literature on the iKnife facilitate the use of publicly available, state-of-the-art pretrained networks or datasets that have been used in computer vision and other domains. METHODS: In a new framework we call ImSpect, we convert 1D iKnife data, captured during basal cell carcinoma (BCC) surgery, into 2D images in order to capitalize on state-of-the-art image classification networks. We also use self-supervision to leverage large amounts of unlabeled, intraoperative data to accommodate the data requirements of these networks. RESULTS: Through extensive ablation studies, we show that we can surpass previous benchmarks of margin evaluation in BCC surgery using iKnife data, achieving an area under the receiver operating characteristic curve (AUC) of 81%. We also depict the attention maps of the developed DL models to evaluate the biological relevance of the embedding space CONCLUSIONS: We propose a new method for characterizing tissue at the surgical margins, using mass spectrometry data from cancer surgery.

Uncertainty estimation for margin detection in cancer surgery using mass spectrometry.

PURPOSE: Rapid evaporative ionization mass spectrometry (REIMS) is an emerging technology for clinical margin detection. Deployment of REIMS depends on construction of reliable deep learning models that can categorize tissue according to its metabolomic signature. Challenges associated with developing these models include the presence of noise during data acquisition and the variance in tissue signatures between patients. In this study, we propose integration of uncertainty estimation in deep models to factor predictive confidence into margin detection in cancer surgery. METHODS: iKnife is used to collect 693 spectra of cancer and healthy samples acquired from 91 patients during basal cell carcinoma resection. A Bayesian neural network and two baseline models are trained on these data to perform classification as well as uncertainty estimation. The samples with high estimated uncertainty are then removed, and new models are trained using the clean data. The performance of proposed and baseline models, with different ratios of filtered data, is then compared. RESULTS: The data filtering does not improve the performance of the baseline models as they cannot provide reliable estimations of uncertainty. In comparison, the proposed model demonstrates a statistically significant improvement in average balanced accuracy (75.2%), sensitivity (74.1%) and AUC (82.1%) after removing uncertain training samples. We also demonstrate that if highly uncertain samples are predicted and removed from the test data, sensitivity further improves to 88.2%. CONCLUSIONS: This is the first study that applies uncertainty estimation to inform model training and deployment for tissue recognition in cancer surgery. Uncertainty estimation is leveraged in two ways: by factoring a measure of input noise in training the models and by including predictive confidence in reporting the outputs. We empirically show that considering uncertainty for model development can help improve the overall accuracy of a margin detection system using REIMS.

Domain adaptation and self-supervised learning for surgical margin detection.

PURPOSE: One in five women who undergo breast conserving surgery will need a second revision surgery due to remaining tumor. The iKnife is a mass spectrometry modality that produces real-time margin information based on the metabolite signatures in surgical smoke. Using this modality and real-time tissue classification, surgeons could remove all cancerous tissue during the initial surgery, improving many facets of patient outcomes. An obstacle in developing a iKnife breast cancer recognition model is the destructive, time-consuming and sensitive nature of the data collection that limits the size of the datasets. METHODS: We address these challenges by first, building a self-supervised learning model from limited, weakly labeled data. By doing so, the model can learn to contextualize the general features of iKnife data from a more accessible cancer type. Second, the trained model can then be applied to a cancer classification task on breast data. This domain adaptation allows for the transfer of learnt weights from models of one tissue type to another. RESULTS: Our datasets contained 320 skin burns (129 tumor burns, 191 normal burns) from 51 patients and 144 breast tissue burns (41 tumor and 103 normal) from 11 patients. We investigate the effect of different hyper-parameters on the performance of the final classifier. The proposed two-step method performed statistically significantly better than a baseline model (p-value < 0.0001), by achieving an accuracy, sensitivity and specificity of 92%, 88% and 92%, respectively. CONCLUSION: This is the first application of domain transfer for iKnife REIMS data. We showed that having a limited number of breast data samples for training a classifier can be compensated by self-supervised learning and domain adaption on a set of unlabeled skin data. We plan to confirm this performance by collecting new breast samples and extending it to incorporate other cancer tissues.

Navigated tissue characterization during skin cancer surgery.

PURPOSE: Basal cell carcinoma (BCC) is the most commonly diagnosed skin cancer and is treated by surgical resection. Incomplete tumor removal requires surgical revision, leading to significant healthcare costs and impaired cosmesis. We investigated the clinical feasibility of a surgical navigation system for BCC surgery, based on molecular tissue characterization using rapid evaporative ionization mass spectrometry (REIMS). METHODS: REIMS enables direct tissue characterization by analysis of cell-specific molecules present within surgical smoke, produced during electrocautery tissue resection. A tissue characterization model was built by acquiring REIMS spectra of BCC, healthy skin and fat from ex vivo skin cancer specimens. This model was used for tissue characterization during navigated skin cancer surgery. Navigation was enabled by optical tracking and real-time visualization of the cautery relative to a contoured resection volume. The surgical smoke was aspirated into a mass spectrometer and directly analyzed with REIMS. Classified BCC was annotated at the real-time position of the cautery. Feasibility of the navigation system, and tissue classification accuracy for ex vivo and intraoperative surgery were evaluated. RESULTS: Fifty-four fresh excision specimens were used to build the ex vivo model of BCC, normal skin and fat, with 92% accuracy. While 3 surgeries were successfully navigated without breach of sterility, the intraoperative performance of the ex vivo model was low (< 50%). Hypotheses are: (1) the model was trained on heterogeneous mass spectra that did not originate from a single tissue type, (2) during surgery mixed tissue types were resected and thus presented to the model, and (3) the mass spectra were not validated by pathology. CONCLUSION: REIMS-navigated skin cancer surgery has the potential to detect and localize remaining tumor intraoperatively. Future work will be focused on improving our model by using a precise pencil cautery tip for burning localized tissue types, and having pathology-validated mass spectra.

Perioperative margin detection in basal cell carcinoma using a deep learning framework: a feasibility study.

PURPOSE: Basal cell carcinoma (BCC) is the most commonly diagnosed cancer and the number of diagnosis is growing worldwide due to increased exposure to solar radiation and the aging population. Reduction of positive margin rates when removing BCC leads to fewer revision surgeries and consequently lower health care costs, improved cosmetic outcomes and better patient care. In this study, we propose the first use of a perioperative mass spectrometry technology (iKnife) along with a deep learning framework for detection of BCC signatures from tissue burns. METHODS: Resected surgical specimen were collected and inspected by a pathologist. With their guidance, data were collected by burning regions of the specimen labeled as BCC or normal, with the iKnife. Data included 190 scans of which 127 were normal and 63 were BCC. A data augmentation approach was proposed by modifying the location and intensity of the peaks of the original spectra, through noise addition in the time and frequency domains. A symmetric autoencoder was built by simultaneously optimizing the spectral reconstruction error and the classification accuracy. Using t-SNE, the latent space was visualized. RESULTS: The autoencoder achieved an accuracy (standard deviation) of 96.62 (1.35%) when classifying BCC and normal scans, a statistically significant improvement over the baseline state-of-the-art approach used in the literature. The t-SNE plot of the latent space distinctly showed the separability between BCC and normal data, not visible with the original data. Augmented data resulted in significant improvements to the classification accuracy of the baseline model. CONCLUSION: We demonstrate the utility of a deep learning framework applied to mass spectrometry data for surgical margin detection. We apply the proposed framework to an application with light surgical overhead and high incidence, the removal of BCC. The learnt models can accurately separate BCC from normal tissue.

Effect of formulation pH on transdermal penetration of antiemetics formulated in poloxamer lecithin organogel.

The purpose of this study was to assess the impact of altering formulation pH on the transdermal penetration of several commonly used antiemetic, weakly basic drugs incorporated into poloxamer lecithin organogel vehicle. Poloxamer lecithin organogel formulations containing promethazine hydrochloride (25 mg/mL), metoclopramide hydrochloride (10 mg/mL), and ondansetron hydrochloride (8 mg/mL) were examined for both drug release and transdermal penetration across porcine skin in modified Franz diffusion cells for a period of 24 hours. For the transdermal studies, each antiemetic drug was formulated at a pH above and below their acid dissociation constant (pKa) in an attempt to assure that the drug would be primarily in their respective ionized or non-ionized states. In addition, drug content in skin was assessed at the end of the 24-hour experiment. Drug content analysis was determined via high-performance liquid chromatography. As a percent of total drug release from the poloxamer lecithin organogel vehicle, promethazine hydrochloride demonstrated the most transdermal drug penetration after 24 hours (30.2% +/- 20.2%), followed by ondansetron hydrochloride (2.7% +/- 1.1%) and metoclopramide hydrochloride (1.8% +/- 1.6%). Subsequently, the pH of the Pluronic F-127 gel was adjusted in order to ensure that each antiemetic drug would be primarily in its unionized state. The transdermal permeation of each antiemetic drug primarily in its unionized state increased over that observed with the drug primarily in its ionized state after 24 hours (promethazine: 1.6-fold increase; metoclopramide: 1.3-fold increase; ondansetron: 1.8-fold increase). A similar trend was noted in the amount of each drug found in the skin after 24 hours (promethazine: 1.2-fold increase; metoclopramide: 2.4-fold increase; ondansetron: 3.0-fold increase). These results suggest that proper optimization of drug ionization state may be a useful strategy for compounding pharmacists to increase the efficacy of drugs intended for inclusion in transdermal formulations.