Clustering Methods for Vibro-Acoustic Sensing Features as a Potential Approach to Tissue Characterisation in Robot-Assisted Interventions.

This article provides a comprehensive analysis of the feature extraction methods applied to vibro-acoustic signals (VA signals) in the context of robot-assisted interventions. The primary objective is to extract valuable information from these signals to understand tissue behaviour better and build upon prior research. This study is divided into three key stages: feature extraction using the Cepstrum Transform (CT), Mel-Frequency Cepstral Coefficients (MFCCs), and Fast Chirplet Transform (FCT); dimensionality reduction employing techniques such as Principal Component Analysis (PCA), t-Distributed Stochastic Neighbour Embedding (t-SNE), and Uniform Manifold Approximation and Projection (UMAP); and, finally, classification using a nearest neighbours classifier. The results demonstrate that using feature extraction techniques, especially the combination of CT and MFCC with dimensionality reduction algorithms, yields highly efficient outcomes. The classification metrics (Accuracy, Recall, and F1-score) approach 99%, and the clustering metric is 0.61. The performance of the CT-UMAP combination stands out in the evaluation metrics.

Contact Endoscopy - Narrow Band Imaging (CE-NBI) data set for laryngeal lesion assessment.

The endoscopic examination of subepithelial vascular patterns within the vocal fold is crucial for clinicians seeking to distinguish between benign lesions and laryngeal cancer. Among innovative techniques, Contact Endoscopy combined with Narrow Band Imaging (CE-NBI) offers real-time visualization of these vascular structures. Despite the advent of CE-NBI, concerns have arisen regarding the subjective interpretation of its images. As a result, several computer-based solutions have been developed to address this issue. This study introduces the CE-NBI data set, the first publicly accessible data set that features enhanced and magnified visualizations of subepithelial blood vessels within the vocal fold. This data set encompasses 11144 images from 210 adult patients with pathological vocal fold conditions, where CE-NBI images are annotated using three distinct label categories. The data set has proven invaluable for numerous clinical assessments geared toward diagnosing laryngeal cancer using Optical Biopsy. Furthermore, given its versatility for various image analysis tasks, we have devised and implemented diverse image classification scenarios using Machine Learning (ML) approaches to address critical clinical challenges in assessing laryngeal lesions.

Concept of a fully-implantable system to monitor tumor recurrence.

Current treatment for glioblastoma includes tumor resection followed by radiation, chemotherapy, and periodic post-operative examinations. Despite combination therapies, patients face a poor prognosis and eventual recurrence, which often occurs at the resection site. With standard MRI imaging surveillance, histologic changes may be overlooked or misinterpreted, leading to erroneous conclusions about the course of adjuvant therapy and subsequent interventions. To address these challenges, we propose an implantable system for accurate continuous recurrence monitoring that employs optical sensing of fluorescently labeled cancer cells and is implanted in the resection cavity during the final stage of tumor resection. We demonstrate the feasibility of the sensing principle using miniaturized system components, optical tissue phantoms, and porcine brain tissue in a series of experimental trials. Subsequently, the system electronics are extended to include circuitry for wireless energy transfer and power management and verified through electromagnetic field, circuit simulations and test of an evaluation board. Finally, a holistic conceptual system design is presented and visualized. This novel approach to monitor glioblastoma patients is intended to early detect recurrent cancerous tissue and enable personalization and optimization of therapy thus potentially improving overall prognosis.

Vibro-acoustic sensing of tissue-instrument-interactions allows a differentiation of biological tissue in computerised palpation.

BACKGROUND: The shift towards minimally invasive surgery is associated with a significant reduction of tactile information available to the surgeon, with compensation strategies ranging from vision-based techniques to the integration of sensing concepts into surgical instruments. Tactile information is vital for palpation tasks such as the differentiation of tissues or the characterisation of surfaces. This work investigates a new sensing approach to derive palpation-related information from vibration signals originating from instrument-tissue-interactions. METHODS: We conducted a feasibility study to differentiate three non-animal and three animal tissue specimens based on palpation of the surface. A sensor configuration was mounted at the proximal end of a standard instrument opposite the tissue-interaction point. Vibro-acoustic signals of 1680 palpation events were acquired, and the time-varying spectrum was computed using Continuous-Wavelet-Transformation. For validation, nine spectral energy-related features were calculated for a subsequent classification using linear Support Vector Machine and k-Nearest-Neighbor. RESULTS: Indicators derived from the vibration signal are highly stable in a set of palpations belonging to the same tissue specimen, regardless of the palpating subject. Differences in the surface texture of the tissue specimens reflect in those indicators and can serve as a basis for differentiation. The classification following a supervised learning approach shows an accuracy of >93.8% for the three-tissue classification tasks and decreases to 78.8% for a combination of all six tissues. CONCLUSIONS: Simple features derived from the vibro-acoustic signals facilitate the differentiation between biological tissues, showing the potential of the presented approach to provide information related to the interacting tissue. The results encourage further investigation of a yet little-exploited source of information in minimally invasive surgery.

Vibro-Acoustic Sensing of Instrument Interactions as a Potential Source of Texture-Related Information in Robotic Palpation.

The direct tactile assessment of surface textures during palpation is an essential component of open surgery that is impeded in minimally invasive and robot-assisted surgery. When indirectly palpating with a surgical instrument, the structural vibrations from this interaction contain tactile information that can be extracted and analysed. This study investigates the influence of the parameters contact angle α and velocity v→ on the vibro-acoustic signals from this indirect palpation. A 7-DOF robotic arm, a standard surgical instrument, and a vibration measurement system were used to palpate three different materials with varying α and v→. The signals were processed based on continuous wavelet transformation. They showed material-specific signatures in the time-frequency domain that retained their general characteristic for varying α and v→. Energy-related and statistical features were extracted, and supervised classification was performed, where the testing data comprised only signals acquired with different palpation parameters than for training data. The classifiers support vector machine and k-nearest neighbours provided 99.67% and 96.00% accuracy for the differentiation of the materials. The results indicate the robustness of the features against variations in the palpation parameters. This is a prerequisite for an application in minimally invasive surgery but needs to be confirmed in realistic experiments with biological tissues.

Surgeons' requirements for a surgical support system to improve laparoscopic access.

Creating surgical access is a critical step in laparoscopic surgery. Surgeons have to insert a sharp instrument such as the Veress needle or a trocar into the patient's abdomen until the peritoneal cavity is reached. They solely rely on their experience and distorted tactile feedback in that process, leading to a complication rate as high as 14% of all cases. Recent studies have shown the feasibility of surgical support systems that provide intraoperative feedback regarding the insertion process to improve laparoscopic access outcomes. However, to date, the surgeons' requirements for such support systems remain unclear. This research article presents the results of an explorative study that aimed to acquire data about the information that helps surgeons improve laparoscopic access outcomes. The results indicate that feedback regarding the reaching of the peritoneal cavity is of significant importance and should be presented visually or acoustically. Finally, a solution should be straightforward and intuitive to use, should support or even improve the clinical workflow, but also cheap enough to facilitate its usage rate. While this study was tailored to laparoscopic access, its results also apply to other minimally invasive procedures.

Endoscopic Imaging Technology Today.

One of the most applied imaging methods in medicine is endoscopy. A highly specialized image modality has been developed since the first modern endoscope, the "Lichtleiter" of Bozzini was introduced in the early 19th century. Multiple medical disciplines use endoscopy for diagnostics or to visualize and support therapeutic procedures. Therefore, the shapes, functionalities, handling concepts, and the integrated and surrounding technology of endoscopic systems were adapted to meet these dedicated medical application requirements. This survey gives an overview of modern endoscopic technology's state of the art. Therefore, the portfolio of several manufacturers with commercially available products on the market was screened and summarized. Additionally, some trends for upcoming developments were collected.

Deep Convolution Neural Network for Laryngeal Cancer Classification on Contact Endoscopy-Narrow Band Imaging.

(1) Background: Contact Endoscopy (CE) and Narrow Band Imaging (NBI) are optical imaging modalities that can provide enhanced and magnified visualization of the superficial vascular networks in the laryngeal mucosa. The similarity of vascular structures between benign and malignant lesions causes a challenge in the visual assessment of CE-NBI images. The main objective of this study is to use Deep Convolutional Neural Networks (DCNN) for the automatic classification of CE-NBI images into benign and malignant groups with minimal human intervention. (2) Methods: A pretrained Res-Net50 model combined with the cut-off-layer technique was selected as the DCNN architecture. A dataset of 8181 CE-NBI images was used during the fine-tuning process in three experiments where several models were generated and validated. The accuracy, sensitivity, and specificity were calculated as the performance metrics in each validation and testing scenario. (3) Results: Out of a total of 72 trained and tested models in all experiments, Model 5 showed high performance. This model is considerably smaller than the full ResNet50 architecture and achieved the testing accuracy of 0.835 on the unseen data during the last experiment. (4) Conclusion: The proposed fine-tuned ResNet50 model showed a high performance to classify CE-NBI images into the benign and malignant groups and has the potential to be part of an assisted system for automatic laryngeal cancer detection.

Vascular Auscultation of Carotid Artery: Towards Biometric Identification and Verification of Individuals.

BACKGROUND: Biometric sensing is a security method for protecting information and property. State-of-the-art biometric traits are behavioral and physiological in nature. However, they are vulnerable to tampering and forgery. METHODS: The proposed approach uses blood flow sounds in the carotid artery as a source of biometric information. A handheld sensing device and an associated desktop application were built. Between 80 and 160 carotid recordings of 11 s in length were acquired from seven individuals each. Wavelet-based signal analysis was performed to assess the potential for biometric applications. RESULTS: The acquired signals per individual proved to be consistent within one carotid sound recording and between multiple recordings spaced by several weeks. The averaged continuous wavelet transform spectra for all cardiac cycles of one recording showed specific spectral characteristics in the time-frequency domain, allowing for the discrimination of individuals, which could potentially serve as an individual fingerprint of the carotid sound. This is also supported by the quantitative analysis consisting of a small convolutional neural network, which was able to differentiate between different users with over 95% accuracy. CONCLUSION: The proposed approach and processing pipeline appeared promising for the discrimination of individuals. The biometrical recognition could clinically be used to obtain and highlight differences from a previously established personalized audio profile and subsequently could provide information on the source of the deviation as well as on its effects on the individual's health. The limited number of individuals and recordings require a study in a larger population along with an investigation of the long-term spectral stability of carotid sounds to assess its potential as a biometric marker. Nevertheless, the approach opens the perspective for automatic feature extraction and classification.

Study of needle punctures into soft tissue through audio and force sensing: can audio be a simple alternative for needle guidance?

PURPOSE: Percutaneous needle insertion is one of the most common minimally invasive procedures. The clinician's experience and medical imaging support are essential to the procedure's safety. However, imaging comes with inaccuracies due to artifacts, and therefore sensor-based solutions were proposed to improve accuracy. However, sensors are usually embedded in the needle tip, leading to design limitations. A novel concept was proposed for capturing tip-tissue interaction information through audio sensing, showing promising results for needle guidance. This work demonstrates that this audio approach can provide important puncture information by comparing audio and force signal dynamics during insertion. METHODS: An experimental setup for inserting a needle into soft tissue was prepared. Audio and force signals were synchronously recorded at four different insertion velocities, and a dataset of 200 recordings was acquired. Indicators related to different aspects of the force and audio were compared through signal-to-signal and event-to-event correlation analysis. RESULTS: High signal-to-signal correlations between force and audio indicators regardless of the insertion velocity were obtained. The force curvature indicator obtained the best correlation performances to audio with more than [Formula: see text] of the correlations higher than 0.6. The event-to-event correlation analysis shows that a puncture event in the force is generally identifiable in audio and that their intensities firmly related. CONCLUSIONS: Audio contains valuable information for monitoring needle tip/tissue interaction. Significant dynamics obtained from a well-known sensor as force can also be extracted from audio, regardless of insertion velocities.

Cyclist Effort Features: A Novel Technique for Image Texture Characterization Applied to Larynx Cancer Classification in Contact Endoscopy-Narrow Band Imaging.

BACKGROUND: Feature extraction is an essential part of a Computer-Aided Diagnosis (CAD) system. It is usually preceded by a pre-processing step and followed by image classification. Usually, a large number of features is needed to end up with the desired classification results. In this work, we propose a novel approach for texture feature extraction. This method was tested on larynx Contact Endoscopy (CE)-Narrow Band Imaging (NBI) image classification to provide more objective information for otolaryngologists regarding the stage of the laryngeal cancer. METHODS: The main idea of the proposed methods is to represent an image as a hilly surface, where different paths can be identified between a starting and an ending point. Each of these paths can be thought of as a Tour de France stage profile where a cyclist needs to perform a specific effort to arrive at the finish line. Several paths can be generated in an image where different cyclists produce an average cyclist effort representing important textural characteristics of the image. Energy and power as two Cyclist Effort Features (CyEfF) were extracted using this concept. The performance of the proposed features was evaluated for the classification of 2701 CE-NBI images into benign and malignant lesions using four supervised classifiers and subsequently compared with the performance of 24 Geometrical Features (GF) and 13 Entropy Features (EF). RESULTS: The CyEfF features showed maximum classification accuracy of 0.882 and improved the GF classification accuracy by 3 to 12 percent. Moreover, CyEfF features were ranked as the top 10 features along with some features from GF set in two feature ranking methods. CONCLUSION: The results prove that CyEfF with only two features can describe the textural characterization of CE-NBI images and can be part of the CAD system in combination with GF for laryngeal cancer diagnosis.

Auscultation System for Acquisition of Vascular Sounds - Towards Sound-Based Monitoring of the Carotid Artery.

INTRODUCTION: Atherosclerotic diseases of the carotid are a primary cause of cerebrovascular events such as stroke. For the diagnosis and monitoring angiography, ultrasound- or magnetic resonance-based imaging is used which requires costly hardware. In contrast, the auscultation of carotid sounds and screening for bruits - audible patterns related to turbulent blood flow - is a simple examination with comparably little technical demands. It can indicate atherosclerotic diseases and justify further diagnostics but is currently subjective and examiner dependent. METHODS: We propose an easy-to-use computer-assisted auscultation system for a stable and reproducible acquisition of vascular sounds of the carotid. A dedicated skin-transducer-interface was incorporated into a handheld device. The interface comprises two bell-shaped structures, one with additional acoustic membrane, to ensure defined skin contact and a stable propagation path of the sound. The device is connected wirelessly to a desktop application allowing real-time visualization, assessment of signal quality and input of supplementary information along with storage of recordings in a database. An experimental study with 5 healthy subjects was conducted to evaluate usability and stability of the device. Five recordings per carotid served as data basis for a wavelet-based analysis of the stability of spectral characteristics of the recordings. RESULTS: The energy distribution of the wavelet-based stationary spectra proved stable for measurements of a particular carotid with the majority of the energy located between 3 and 40 Hz. Different spectral properties of the carotids of one individual indicate the presence of sound characteristics linked to the particular vessel. User-dependent parameters such as variations of the applied contact pressure appeared to have minor influence on the general stability. CONCLUSION: The system provides a platform for reproducible carotid auscultation and the creation of a database of pathological vascular sounds, which is a prerequisite to investigate sound-based vascular monitoring.

Laryngeal Lesion Classification Based on Vascular Patterns in Contact Endoscopy and Narrow Band Imaging: Manual Versus Automatic Approach.

Longitudinal and perpendicular changes in the vocal fold's blood vessels are associated with the development of benign and malignant laryngeal lesions. The combination of Contact Endoscopy (CE) and Narrow Band Imaging (NBI) can provide intraoperative real-time visualization of the vascular changes in the laryngeal mucosa. However, the visual evaluation of vascular patterns in CE-NBI images is challenging and highly depends on the clinicians' experience. The current study aims to evaluate and compare the performance of a manual and an automatic approach for laryngeal lesion's classification based on vascular patterns in CE-NBI images. In the manual approach, six observers visually evaluated a series of CE+NBI images that belong to a patient and then classified the patient as benign or malignant. For the automatic classification, an algorithm based on characterizing the level of the vessel's disorder in combination with four supervised classifiers was used to classify CE-NBI images. The results showed that the manual approach's subjective evaluation could be reduced by using a computer-based approach. Moreover, the automatic approach showed the potential to work as an assistant system in case of disagreements among clinicians and to reduce the manual approach's misclassification issue.

Evaluation of Vascular Patterns Using Contact Endoscopy and Narrow-Band Imaging (CE-NBI) for the Diagnosis of Vocal Fold Malignancy.

The endoscopic detection of perpendicular vascular changes (PVC) of the vocal folds has been associated with vocal fold cancer, dysplastic lesions, and papillomatosis, according to a classification proposed by the European Laryngological Society (ELS). The combination of contact endoscopy with narrow-band imaging (NBI-CE) allows intraoperatively a highly contrasted, real-time visualization of vascular changes of the vocal folds. Aim of the present study was to determine the association of PVC to specific histological diagnoses, the level of interobserver agreement in the detection of PVC, and their diagnostic effectiveness in diagnosing laryngeal malignancy. The evaluation of our data confirmed the association of PVC to vocal fold cancer, dysplastic lesions, and papillomatosis. The level of agreement between the observers in the identification of PVC was moderate for the less-experienced observers and almost perfect for the experienced observers. The identification of PVC during NBI-CE proved to be a valuable indicator for diagnosing malignant and premalignant lesions.

Superficial skin cancer therapy with Y-90 microspheres: A feasibility study on patch preparation.

BACKGROUND: Radiation therapy using beta particles is an interesting treatment for very superficial skin lesions. Due to their low penetration in tissue and rapid dose fall-off, beta particles can protect underlying bony structures and surrounding healthy tissue while irradiating the skin tumor. In the current work, a simple method for the fabrication of a radioactive patch for use in skin cancer therapy based on a beta-emitting isotope is presented. MATERIALS AND METHODS: The beta radiation sources were Y-90 microspheres currently used for catheter-based radioembolization of unresectable liver tumors. The microspheres were filtered through a syringe filter to trap them on the cellulose nitrate paper of the filter and create a radioactive patch. In the current study, to avoid the need for a hot laboratory, the experiment was done using nonradioactive microspheres. An optical microscope was used to verify the distribution of the particles on the filter paper. RESULTS: Visual evaluation of the patches showed that using the proposed method, therapeutic skin patches with a fairly uniform distribution of microspheres can be created. CONCLUSION: The proposed simple method may be used in creating radiotherapeutic patches using Y-90 microspheres for radiation therapy of thin skin lesions located close to sensitive structures.

Novel automated vessel pattern characterization of larynx contact endoscopic video images.

PURPOSE: Contact endoscopy (CE) is a minimally invasive procedure providing real-time information about the cellular and vascular structure of the superficial layer of laryngeal mucosa. This method can be combined with optical enhancement methods such as narrow band imaging (NBI). However, these techniques have some problems like subjective interpretation of vascular patterns and difficulty in differentiation between benign and malignant lesions. We propose a novel automated approach for vessel pattern characterization of larynx CE + NBI images in order to solve these problems. METHODS: In this approach, five indicators were computed to characterize the level of vessel's disorder based on evaluation of consistency of gradient and two-dimensional curvature analysis and then 24 features were extracted from these indicators. The method evaluated the ability of the extracted features to classify CE + NBI images based on the vascular pattern and based on the laryngeal lesions. Four datasets were generated from 32 patients involving 1485 images. The classification scenarios were implemented using four supervised classifiers. RESULTS: For classification of CE + NBI images based on the vascular pattern, polykernel support vector machine (SVM), SVM with radial basis function (RBF), k-nearest neighbor (kNN), and random forest (RF) show an accuracy of 97%, 96%, 96%, and 96%, respectively. For the classification based on the histopathology, Polykernel SVM showed an accuracy of 84%, 86% and 84%, RBF SVM showed an accuracy of 81%, 87% and 83%, kNN showed an accuracy of 89%, 87%, 91%, RF showed an accuracy of 90%, 88% and 91% for classification between benign histopathologies, between malignant histopathologies and between benign and malignant lesions, respectively. CONCLUSION: These promising results show that the proposed method could solve the problem of subjectivity in interpretation of vascular patterns and also support the clinicians in the early detection of benign, pre-malignant and malignant lesions.

Epileptic seizure detection using cross-bispectrum of electroencephalogram signal.

PURPOSE: The automatic detection of epileptic seizures in EEG data from extended recordings can make an important contribution to the diagnosis of epilepsy as it can efficiently reduce the workload of medical staff. METHODS: This paper describes how features based on cross-bispectrum can help with the detection of epileptic seizure activity in EEG data. Features were extracted from multi-channel intracranial EEG (iEEG) data from the Freiburg iEEG recordings of 21 patients with focal epilepsy. These features were used as a support vector machine classifier input to discriminate ictal from inter-ictal states. A post-processing method was applied to the classifier output in order to improve classification accuracy. RESULTS: A sensitivity of 95.8%, specificity of 96.7%, and accuracy of 96.8% were achieved. The false detection rate (FDR) was zero for 10 patients and very low for the rest. CONCLUSIONS: The results show that the proposed method distinguishes better between ictal and inter-ictal iEEG epochs than other seizure detection methods. The proposed method has a higher accuracy index than achievable with a number of previously described approaches. Also, the method is rapid and easy and may be helpful in online epileptic seizure detection and prediction systems.

Radiation therapy techniques in the treatment of skin cancer: an overview of the current status and outlook.

Nonmelanoma skin cancer (NMSC) is a major health concern due to its high incidence rate, its negative impact on the quality of life of patients as well as the associated economic burden to the healthcare system. Surgery is currently the primary treatment offered for skin cancer patients but not applicable or available in all cases. Radiation therapy (RT), with its long successful history in the management of cancer, has shown to be an effective alternative or complementary method in cutaneous oncology. Specifically, for dermatology applications, RT is very often the preferred option due to its favorable cosmetic results, besides the excellent control rate of the tumor. During the last 120 years since the introduction of treatments based on ionizing radiation, several techniques in this area have been developed. Radionuclide brachytherapy, electronic brachytherapy, X-ray therapies with kilovolt (kV) to megavolt (MV) photons and electron beam therapy are the established methods that are currently used on skin cancer patients. The purpose of this article is to overview these techniques and discuss the pros and cons of these methods in dermatology practices. Additionally, a new approach of beta RT of superficial skin tumors is discussed, which may offer exciting features in the management of NMSC.

Proximal detection of guide wire perforation using feature extraction from bispectral audio signal analysis combined with machine learning.

Artery perforation during a vascular catheterization procedure is a potentially life threatening event. It is of particular importance for the surgeons to be aware of hidden or non-obvious events. To minimize the impact it is crucial for the surgeon to detect such a perforation very early. We propose a novel approach to identify perforations based on the acquisition and analysis of audio signals on the outside proximal end of a guide wire. The signals were acquired using a stethoscope equipped with a microphone and attached to the proximal end of the guide wire via a 3D printed adapter. Bispectral analysis was employed to extract acoustic signatures in the signal and several features were extracted from the bispectrum of the signal. Finally, three machine learning algorithms - K-nearest Neighbor, Support Vector Machine (SVM), and Artificial Neural Network (ANN)- were used to classify a signal as a perforation or as an artifact. The bispectrum-based features resulted in valuable features allowing a perforation to be clearly identifiable from other occurring events. A perforation leaves a clear audio signal trace in the time-frequency domain. The recordings were classified as perforation, friction or guide wire bump using SVM with 97% (polykernel) and 98.62% (RBF) accuracy, k-nearest Neighbor an accuracy of 98.28% and ANN with accuracy of 98.73% was obtained. The presented approach shows that interactions starting at the tip of a guide wire can be picked up at its proximal end providing a valuable additional information that could be used during a guide wire procedure.

Improved Acquisition of Vibroarthrographic Signals of the Knee Joint.

This paper presents an improved solution for vibroarthrographic measurements. Four different setups for sensor attachment to the knee were assessed with a focus on the stability and reproducibility of the measured signals. By means of power spectral density estimates, the main signal components were compared and afterwards evaluated by conducting a cross-correlation analysis.