Open access segmentations of intraoperative brain tumor ultrasound images.

PURPOSE: Registration and segmentation of magnetic resonance (MR) and ultrasound (US) images could play an essential role in surgical planning and resectioning brain tumors. However, validating these techniques is challenging due to the scarcity of publicly accessible sources with high-quality ground truth information. To this end, we propose a unique set of segmentations (RESECT-SEG) of cerebral structures from the previously published RESECT dataset to encourage a more rigorous development and assessment of image-processing techniques for neurosurgery. ACQUISITION AND VALIDATION METHODS: The RESECT database consists of MR and intraoperative US (iUS) images of 23 patients who underwent brain tumor resection surgeries. The proposed RESECT-SEG dataset contains segmentations of tumor tissues, sulci, falx cerebri, and resection cavity of the RESECT iUS images. Two highly experienced neurosurgeons validated the quality of the segmentations. DATA FORMAT AND USAGE NOTES: Segmentations are provided in 3D NIFTI format in the OSF open-science platform: https://osf.io/jv8bk. POTENTIAL APPLICATIONS: The proposed RESECT-SEG dataset includes segmentations of real-world clinical US brain images that could be used to develop and evaluate segmentation and registration methods. Eventually, this dataset could further improve the quality of image guidance in neurosurgery.

Receptive Field Size as a Key Design Parameter for Ultrasound Image Segmentation with U-Net.

Automatic and accurate segmentation of medical images is an important task due to the direct impact of this procedure on both disease diagnosis and treatment. Segmentation of ultrasound (US) imaging is particularly challenging due to the presence of speckle noise. Recent deep learning approaches have demonstrated remarkable findings in image segmentation tasks, including segmentation of US images. However, many of the newly proposed structures are either task specific and suffer from poor generalization, or are computationally expensive. In this paper, we show that the receptive field plays a more significant role in the network's performance compared to the network's depth or the number of parameters. We further show that by controlling the size of the receptive field, a deep network can instead be replaced by a shallow network.

LUMINOUS database: lumbar multifidus muscle segmentation from ultrasound images.

BACKGROUND: Among the paraspinal muscles, the structure and function of the lumbar multifidus (LM) has become of great interest to researchers and clinicians involved in lower back pain and muscle rehabilitation. Ultrasound (US) imaging of the LM muscle is a useful clinical tool which can be used in the assessment of muscle morphology and function. US is widely used due to its portability, cost-effectiveness, and ease-of-use. In order to assess muscle function, quantitative information of the LM must be extracted from the US image by means of manual segmentation. However, manual segmentation requires a higher level of training and experience and is characterized by a level of difficulty and subjectivity associated with image interpretation. Thus, the development of automated segmentation methods is warranted and would strongly benefit clinicians and researchers. The aim of this study is to provide a database which will contribute to the development of automated segmentation algorithms of the LM. CONSTRUCTION AND CONTENT: This database provides the US ground truth of the left and right LM muscles at the L5 level (in prone and standing positions) of 109 young athletic adults involved in Concordia University's varsity teams. The LUMINOUS database contains the US images with their corresponding manually segmented binary masks, serving as the ground truth. The purpose of the database is to enable development and validation of deep learning algorithms used for automatic segmentation tasks related to the assessment of the LM cross-sectional area (CSA) and echo intensity (EI). The LUMINOUS database is publicly available at http://data.sonography.ai . CONCLUSION: The development of automated segmentation algorithms based on this database will promote the standardization of LM measurements and facilitate comparison among studies. Moreover, it can accelerate the clinical implementation of quantitative muscle assessment in clinical and research settings.

Two-stage ultrasound image segmentation using U-Net and test time augmentation.

PURPOSE: Detecting breast lesions using ultrasound imaging is an important application of computer-aided diagnosis systems. Several automatic methods have been proposed for breast lesion detection and segmentation; however, due to the ultrasound artefacts, and to the complexity of lesion shapes and locations, lesion or tumor segmentation from ultrasound breast images is still an open problem. In this paper, we propose using a lesion detection stage prior to the segmentation stage in order to improve the accuracy of the segmentation. METHODS: We used a breast ultrasound imaging dataset which contained 163 images of the breast with either benign lesions or malignant tumors. First, we used a U-Net to detect the lesions and then used another U-Net to segment the detected region. We could show when the lesion is precisely detected, the segmentation performance substantially improves; however, if the detection stage is not precise enough, the segmentation stage also fails. Therefore, we developed a test-time augmentation technique to assess the detection stage performance. RESULTS: By using the proposed two-stage approach, we could improve the average Dice score by 1.8% overall. The improvement was substantially more for images wherein the original Dice score was less than 70%, where average Dice score was improved by 14.5%. CONCLUSIONS: The proposed two-stage technique shows promising results for segmentation of breast US images and has a much smaller chance of failure.

Ultrasound segmentation using U-Net: learning from simulated data and testing on real data.

Segmentation of ultrasound images is an essential task in both diagnosis and image-guided interventions given the ease-of-use and low cost of this imaging modality. As manual segmentation is tedious and time consuming, a growing body of research has focused on the development of automatic segmentation algorithms. Deep learning algorithms have shown remarkable achievements in this regard; however, they need large training datasets. Unfortunately, preparing large labeled datasets in ultrasound images is prohibitively difficult. Therefore, in this study, we propose the use of simulated ultrasound (US) images for training the U-Net deep learning segmentation architecture and test on tissue-mimicking phantom data collected by an ultrasound machine. We demonstrate that the trained architecture on the simulated data is transferrable to real data, and therefore, simulated data can be considered as an alternative training dataset when real datasets are not available. The second contribution of this paper is that we train our U-Net network on envelope and B-mode images of the simulated dataset, and test the trained network on real envelope and B-mode images of phantom, respectively. We show that test results are superior for the envelope data compared to B-mode image.

Convolutional neural network for high-accuracy functional near-infrared spectroscopy in a brain-computer interface: three-class classification of rest, right-, and left-hand motor execution.

The aim of this work is to develop an effective brain-computer interface (BCI) method based on functional near-infrared spectroscopy (fNIRS). In order to improve the performance of the BCI system in terms of accuracy, the ability to discriminate features from input signals and proper classification are desired. Previous studies have mainly extracted features from the signal manually, but proper features need to be selected carefully. To avoid performance degradation caused by manual feature selection, we applied convolutional neural networks (CNNs) as the automatic feature extractor and classifier for fNIRS-based BCI. In this study, the hemodynamic responses evoked by performing rest, right-, and left-hand motor execution tasks were measured on eight healthy subjects to compare performances. Our CNN-based method provided improvements in classification accuracy over conventional methods employing the most commonly used features of mean, peak, slope, variance, kurtosis, and skewness, classified by support vector machine (SVM) and artificial neural network (ANN). Specifically, up to 6.49% and 3.33% improvement in classification accuracy was achieved by CNN compared with SVM and ANN, respectively.