A multi-modal deep neural network for multi-class liver cancer diagnosis.

Liver disease is a potentially asymptomatic clinical entity that may progress to patient death. This study proposes a multi-modal deep neural network for multi-class malignant liver diagnosis. In parallel with the portal venous computed tomography (CT) scans, pathology data is utilized to prognosticate primary liver cancer variants and metastasis. The processed CT scans are fed to the deep dilated convolution neural network to explore salient features. The residual connections are further added to address vanishing gradient problems. Correspondingly, five pathological features are learned using a wide and deep network that gives a benefit of memorization with generalization. The down-scaled hierarchical features from CT scan and pathology data are concatenated to pass through fully connected layers for classification between liver cancer variants. In addition, the transfer learning of pre-trained deep dilated convolution layers assists in handling insufficient and imbalanced dataset issues. The fine-tuned network can predict three-class liver cancer variants with an average accuracy of 96.06% and an Area Under Curve (AUC) of 0.832. To the best of our knowledge, this is the first study to classify liver cancer variants by integrating pathology and image data, hence following the medical perspective of malignant liver diagnosis. The comparative analysis on the benchmark dataset shows that the proposed multi-modal neural network outperformed most of the liver diagnostic studies and is comparable to others.

LASSO Homotopy-Based Sparse Representation Classification for fNIRS-BCI.

Brain-computer interface (BCI) systems based on functional near-infrared spectroscopy (fNIRS) have been used as a way of facilitating communication between the brain and peripheral devices. The BCI provides an option to improve the walking pattern of people with poor walking dysfunction, by applying a rehabilitation process. A state-of-the-art step-wise BCI system includes data acquisition, pre-processing, channel selection, feature extraction, and classification. In fNIRS-based BCI (fNIRS-BCI), channel selection plays a vital role in enhancing the classification accuracy of the BCI problem. In this study, the concentration of blood oxygenation (HbO) in a resting state and in a walking state was used to decode the walking activity and the resting state of the subject, using channel selection by Least Absolute Shrinkage and Selection Operator (LASSO) homotopy-based sparse representation classification. The fNIRS signals of nine subjects were collected from the left hemisphere of the primary motor cortex. The subjects performed the task of walking on a treadmill for 10 s, followed by a 20 s rest. Appropriate filters were applied to the collected signals to remove motion artifacts and physiological noises. LASSO homotopy-based sparse representation was used to select the most significant channels, and then classification was performed to identify walking and resting states. For comparison, the statistical spatial features of mean, peak, variance, and skewness, and their combination, were used for classification. The classification results after channel selection were then compared with the classification based on the extracted features. The classifiers used for both methods were linear discrimination analysis (LDA), support vector machine (SVM), and logistic regression (LR). The study found that LASSO homotopy-based sparse representation classification successfully discriminated between the walking and resting states, with a better average classification accuracy (p < 0.016) of 91.32%. This research provides a step forward in improving the classification accuracy of fNIRS-BCI systems. The proposed methodology may also be used for rehabilitation purposes, such as controlling wheelchairs and prostheses, as well as an active rehabilitation training technique for patients with motor dysfunction.

Analyzing Classification Performance of fNIRS-BCI for Gait Rehabilitation Using Deep Neural Networks.

This research presents a brain-computer interface (BCI) framework for brain signal classification using deep learning (DL) and machine learning (ML) approaches on functional near-infrared spectroscopy (fNIRS) signals. fNIRS signals of motor execution for walking and rest tasks are acquired from the primary motor cortex in the brain's left hemisphere for nine subjects. DL algorithms, including convolutional neural networks (CNNs), long short-term memory (LSTM), and bidirectional LSTM (Bi-LSTM) are used to achieve average classification accuracies of 88.50%, 84.24%, and 85.13%, respectively. For comparison purposes, three conventional ML algorithms, support vector machine (SVM), k-nearest neighbor (k-NN), and linear discriminant analysis (LDA) are also used for classification, resulting in average classification accuracies of 73.91%, 74.24%, and 65.85%, respectively. This study successfully demonstrates that the enhanced performance of fNIRS-BCI can be achieved in terms of classification accuracy using DL approaches compared to conventional ML approaches. Furthermore, the control commands generated by these classifiers can be used to initiate and stop the gait cycle of the lower limb exoskeleton for gait rehabilitation.

RMS-UNet: Residual multi-scale UNet for liver and lesion segmentation.

Precise segmentation is in demand for hepatocellular carcinoma or metastasis clinical diagnosis due to the heterogeneous appearance and diverse anatomy of the liver on scanned abdominal computed tomography (CT) images. In this study, we present an automatic unified registration-free deep-learning-based model with residual block and dilated convolution for training end-to-end liver and lesion segmentation. A multi-scale approach has also been utilized to explore novel inter-slice features with multi-channel input images. A novel objective function is introduced to deal with fore- and background pixels imbalance based on the joint metric of dice coefficient and absolute volumetric difference. Further, batch normalization is used to improve the learning without any loss of useful information. The proposed methodology is extensively validated and tested on 30% of the publicly available Dircadb, LiTS, Sliver07, and Chaos datasets. A comparative analysis is conducted based on multiple evaluation metrics frequently used in segmentation competitions. The results show substantial improvement, with mean dice scores of 97.31, 97.38, 97.39 and 95.49% for the Dircadb, LiTS, Sliver07, and Chaos liver test sets, and 91.92 and 86.70% for Dircadb and LiTS lesion segmentation. It should be noted that we achieve the best lesion segmentation performance on common datasets. The obtained qualitative and quantitative results demonstrate that our proposed model outperform other state-of-the-art methods for liver and lesion segmentation, with competitive performance on additional datasets. Henceforth, it is envisaged as being applicable to pertinent medical segmentation applications.

Enhancing Classification Performance of fNIRS-BCI by Identifying Cortically Active Channels Using the z-Score Method.

A state-of-the-art brain-computer interface (BCI) system includes brain signal acquisition, noise removal, channel selection, feature extraction, classification, and an application interface. In functional near-infrared spectroscopy-based BCI (fNIRS-BCI) channel selection may enhance classification performance by identifying suitable brain regions that contain brain activity. In this study, the z-score method for channel selection is proposed to improve fNIRS-BCI performance. The proposed method uses cross-correlation to match the similarity between desired and recorded brain activity signals, followed by forming a vector of each channel's correlation coefficients' maximum values. After that, the z-score is calculated for each value of that vector. A channel is selected based on a positive z-score value. The proposed method is applied to an open-access dataset containing mental arithmetic (MA) and motor imagery (MI) tasks for twenty-nine subjects. The proposed method is compared with the conventional t-value method and with no channel selected, i.e., using all channels. The z-score method yielded significantly improved (p < 0.0167) classification accuracies of 87.2 ± 7.0%, 88.4 ± 6.2%, and 88.1 ± 6.9% for left motor imagery (LMI) vs. rest, right motor imagery (RMI) vs. rest, and mental arithmetic (MA) vs. rest, respectively. The proposed method is also validated on an open-access database of 17 subjects, containing right-hand finger tapping (RFT), left-hand finger tapping (LFT), and dominant side foot tapping (FT) tasks.The study shows an enhanced performance of the z-score method over the t-value method as an advancement in efforts to improve state-of-the-art fNIRS-BCI systems' performance.

Enhancing classification accuracy of fNIRS-BCI using features acquired from vector-based phase analysis.

OBJECTIVE: In this paper, a novel methodology for feature extraction to enhance classification accuracy of functional near-infrared spectroscopy (fNIRS)-based two-class and three-class brain-computer interface (BCI) is presented. APPROACH: Novel features are extracted using vector-based phase analysis method. Changes in oxygenated [Formula: see text] and de-oxygenated [Formula: see text]) haemoglobin are used to calculate four novel features: change in cerebral blood volume ([Formula: see text]), change in cerebral oxygen exchange ([Formula: see text]), vector magnitude (|L|) and angle (k). [Formula: see text] is the sum and [Formula: see text] is difference of [Formula: see text] and [Formula: see text], whereas |L| is magnitude and k is angle of vector. fNIRS signals of seven healthy subjects, corresponding to left-hand index finger tapping (LFT), right-hand index finger tapping (RFT) and rest are acquired from motor cortex using multi-channel continuous-wave imaging system. After removing physiological and instrumental noises from the acquired signals, the four novel features are calculated. For validation, conventional temporal, spatial and spatiotemporal features; mean, peak, slope, variance, kurtosis and skewness are also calculated using [Formula: see text] and[Formula: see text]. All possible two-feature and three-feature combinations of the novel and conventional features are then used to classify two-class (LFT vs RFT) and three-class (LFT vs RFT vs rest) fNIRS-BCI using linear discriminant analysis. MAIN RESULTS: Results demonstrate that combination of four novel features yields significantly higher average classification accuracies of 98.7 ± 1.0% and 85.4 ± 1.4% as compared to 68.7 ± 6.9% and 53.6 ± 10.6% using conventional features for two-class and three-class problem, respectively. Validation of proposed method on an open access database containing RFT, LFT and dominant side foot tapping tasks for 30 subjects also shows improvement in average classification accuracies for two-class and three-class fNIRS-BCIs. SIGNIFICANCE: This study provides a step forward in improving the classification accuracies of state-of-the-art fNIRS-BCIs by showing significant improvement in classification accuracies of two-class and three-class fNIRS-BCIs using novel features extracted by vector-based phase analysis.

fNIRS-based Neurorobotic Interface for gait rehabilitation.

BACKGROUND: In this paper, a novel functional near-infrared spectroscopy (fNIRS)-based brain-computer interface (BCI) framework for control of prosthetic legs and rehabilitation of patients suffering from locomotive disorders is presented. METHODS: fNIRS signals are used to initiate and stop the gait cycle, while a nonlinear proportional derivative computed torque controller (PD-CTC) with gravity compensation is used to control the torques of hip and knee joints for minimization of position error. In the present study, the brain signals of walking intention and rest tasks were acquired from the left hemisphere's primary motor cortex for nine subjects. Thereafter, for removal of motion artifacts and physiological noises, the performances of six different filters (i.e. Kalman, Wiener, Gaussian, hemodynamic response filter (hrf), Band-pass, finite impulse response) were evaluated. Then, six different features were extracted from oxygenated hemoglobin signals, and their different combinations were used for classification. Also, the classification performances of five different classifiers (i.e. k-Nearest Neighbour, quadratic discriminant analysis, linear discriminant analysis (LDA), Naïve Bayes, support vector machine (SVM)) were tested. RESULTS: The classification accuracies obtained from SVM using the hrf were significantly higher (p < 0.01) than those of the other classifier/ filter combinations. Those accuracies were 77.5, 72.5, 68.3, 74.2, 73.3, 80.8, 65, 76.7, and 86.7% for the nine subjects, respectively. CONCLUSION: The control commands generated using the classifiers initiated and stopped the gait cycle of the prosthetic leg, the knee and hip torques of which were controlled using the PD-CTC to minimize the position error. The proposed scheme can be effectively used for neurofeedback training and rehabilitation of lower-limb amputees and paralyzed patients.

Enhancing Classification Performance of Functional Near-Infrared Spectroscopy- Brain-Computer Interface Using Adaptive Estimation of General Linear Model Coefficients.

In this paper, a novel methodology for enhanced classification of functional near-infrared spectroscopy (fNIRS) signals utilizable in a two-class [motor imagery (MI) and rest; mental rotation (MR) and rest] brain-computer interface (BCI) is presented. First, fNIRS signals corresponding to MI and MR are acquired from the motor and prefrontal cortex, respectively, afterward, filtered to remove physiological noises. Then, the signals are modeled using the general linear model, the coefficients of which are adaptively estimated using the least squares technique. Subsequently, multiple feature combinations of estimated coefficients were used for classification. The best classification accuracies achieved for five subjects, for MI versus rest are 79.5, 83.7, 82.6, 81.4, and 84.1% whereas those for MR versus rest are 85.5, 85.2, 87.8, 83.7, and 84.8%, respectively, using support vector machine. These results are compared with the best classification accuracies obtained using the conventional hemodynamic response. By means of the proposed methodology, the average classification accuracy obtained was significantly higher (p < 0.05). These results serve to demonstrate the feasibility of developing a high-classification-performance fNIRS-BCI.

Optimal feature selection from fNIRS signals using genetic algorithms for BCI.

In this paper, a novel technique for determination of the optimal feature combinations and, thereby, acquisition of the maximum classification performance for a functional near-infrared spectroscopy (fNIRS)-based brain-computer interface (BCI), is proposed. After obtaining motor-imagery and rest signals from the motor cortex, filtering is applied to remove the physiological noises. Six features (signal slope, signal mean, signal variance, signal peak, signal kurtosis and signal skewness) are then extracted from the oxygenated hemoglobin (HbO). Afterwards, the hybrid genetic algorithm (GA)-support vector machine (SVM) is applied in order to determine and classify 2- and 3-feature combinations across all subjects. The SVM classifier is applied to classify motor imagery versus rest. Moreover, four time windows (0-20s, 0-10s, 11-20s and 6-15s) are selected, and the hybrid GA-SVM is applied in order to extract the optimal 2- and 3-feature combinations. In the present study, the 11-20s time window showed significantly higher classification accuracies - the minimum accuracy was 91% - than did the other time windows (p<0.05). The proposed hybrid GA-SVM technique, by selecting optimal feature combinations for an fNIRS-based BCI, shows positive classification-performance-enhancing results.