LFP-Net: A deep learning framework to recognize human behavioral activities using brain STN-LFP signals.

BACKGROUND: Recognition of human behavioral activities using local field potential (LFP) signals recorded from the Subthalamic Nuclei (STN) has applications in developing the next generation of deep brain stimulation (DBS) systems. DBS therapy is often used for patients with Parkinson's disease (PD) when medication cannot effectively tackle patients' motor symptoms. A DBS system capable of adaptively adjusting its parameters based on patients' activities may optimize therapy while reducing the stimulation side effects and improving the battery life. METHOD: STN-LFP reveals motor and language behavior, making it a reliable source for behavior classification. This paper presents LFP-Net, an automated machine learning framework based on deep convolutional neural networks (CNN) for classification of human behavior using the time-frequency representation of STN-LFPs within the beta frequency range. CNNs learn different features based on the beta power patterns associated with different behaviors. The features extracted by the CNNs are passed through fully connected layers and then to the softmax layer for classification. RESULTS: Our experiments on ten PD patients performing three behavioral tasks including "button press", "target reaching", and "speech" show that the proposed approach obtains an average classification accuracy of ∼88 %. Comparison with existing methods: The proposed method outperforms other state-of-the-art classification methods based on STN-LFP signals. Compared to well-known deep neural networks such as AlexNet, our approach gives a higher accuracy using significantly fewer parameters. CONCLUSIONS: CNNs show a high performance in decoding the brain neural response, which is crucial in designing the automatic brain-computer interfaces and closed-loop systems.

Studying the Effects of Deep Brain Stimulation and Medication on the Dynamics of STN-LFP Signals for Human Behavior Analysis.

This paper presents the results of our recent work on studying the effects of deep brain stimulation (DBS) and medication on the dynamics of brain local field potential (LFP) signals used for behavior analysis of patients with Parkinson's disease (PD). DBS is a technique used to alleviate the severe symptoms of PD when pharmacotherapy is not very effective. Behavior recognition from the LFP signals recorded from the subthalamic nucleus (STN) has application in developing closed-loop DBS systems, where the stimulation pulse is adaptively generated according to subjects' performing behavior. Most of the existing studies on behavior recognition that use STN-LFPs are based on the DBS being "off". This paper discovers how the performance and accuracy of automated behavior recognition from the LFP signals are affected under different paradigms of stimulation on/off. We first study the notion of beta power suppression in LFP signals under different scenarios (stimulation on/off and medication on/off). Afterward, we explore the accuracy of support vector machines in predicting human actions ("button press" and "reach") using the spectrogram of STN-LFP signals. Our experiments on the recorded LFP signals of three subjects confirm that the beta power is suppressed significantly when the patients take medication (p-value < 0.002) or stimulation (p-value < 0.0003). The results also show that we can classify different behaviors with a reasonable accuracy of 85% even when the high-amplitude stimulation is applied.

A hierarchical structure for human behavior classification using STN local field potentials.

BACKGROUND: Classification of human behavior from brain signals has potential application in developing closed-loop deep brain stimulation (DBS) systems. This paper presents a human behavior classification using local field potential (LFP) signals recorded from subthalamic nuclei (STN). METHOD: A hierarchical classification structure is developed to perform the behavior classification from LFP signals through a multi-level framework (coarse to fine). At each level, the time-frequency representations of all six signals from the DBS leads are combined through an MKL-based SVM classifier to classify five tasks (speech, finger movement, mouth movement, arm movement, and random segments). To lower the computational cost, we alternatively use the inter-hemispheric synchronization of the LFPs to make three pairs out of six bipolar signals. Three classifiers are separately trained at each level of the hierarchical approach, which lead to three labels. A fusion function is then developed to combine these three labels and determine the label of the corresponding trial. RESULTS: Using all six LFPs with the proposed hierarchical approach improves the classification performance. Moreover, the synchronization-based method reduces the computational burden considerably while the classification performance remains relatively unchanged. COMPARISON WITH EXISTING METHODS: Our experiments on two different datasets recorded from nine subjects undergoing DBS surgery show that the proposed approaches remarkably outperform other methods for behavior classification based on LFP signals. CONCLUSION: The LFP signals acquired from STNs contain useful information for recognizing human behavior. This can be a precursor for designing the next generation of closed-loop DBS systems.

A Multiple Kernel Learning approach for human behavioral task classification using STN-LFP signal.

Deep Brain Stimulation (DBS) has gained increasing attention as an effective method to mitigate Parkinson's disease (PD) disorders. Existing DBS systems are open-loop such that the system parameters are not adjusted automatically based on patient's behavior. Classification of human behavior is an important step in the design of the next generation of DBS systems that are closed-loop. This paper presents a classification approach to recognize such behavioral tasks using the subthalamic nucleus (STN) Local Field Potential (LFP) signals. In our approach, we use the time-frequency representation (spectrogram) of the raw LFP signals recorded from left and right STNs as the feature vectors. Then these features are combined together via Support Vector Machines (SVM) with Multiple Kernel Learning (MKL) formulation. The MKL-based classification method is utilized to classify different tasks: button press, mouth movement, speech, and arm movement. Our experiments show that the lp-norm MKL significantly outperforms single kernel SVM-based classifiers in classifying behavioral tasks of five subjects even using signals acquired with a low sampling rate of 10 Hz. This leads to a lower computational cost.

An Optimized LMMSE Based Method for 3D MRI Denoising.

Post-acquisition denoising of magnetic resonance (MR) images is an important step to improve any quantitative measurement of the acquired data. In this paper, assuming a Rician noise model, a new filtering method based on the linear minimum mean square error (LMMSE) estimation is introduced, which employs the self-similarity property of the MR data to restore the noise-less signal. This method takes into account the structural characteristics of images and the Bayesian mean square error (Bmse) of the estimator to address the denoising problem. In general, a twofold data processing approach is developed; first, the noisy MR data is processed using a patch-based L(2)-norm similarity measure to provide the primary set of samples required for the estimation process. Afterwards, the Bmse of the estimator is derived as the optimization function to analyze the pre-selected samples and minimize the error between the estimated and the underlying signal. Compared to the LMMSE method and also its recently proposed SNR-adapted realization (SNLMMSE), the optimized way of choosing the samples together with the automatic adjustment of the filtering parameters lead to a more robust estimation performance with our approach. Experimental results show the competitive performance of the proposed method in comparison with related state-of-the-art methods.

An MRI denoising method using image data redundancy and local SNR estimation.

This paper presents an LMMSE-based method for the three-dimensional (3D) denoising of MR images assuming a Rician noise model. Conventionally, the LMMSE method estimates the noise-less signal values using the observed MR data samples within local neighborhoods. This is not an efficient procedure to deal with this issue while the 3D MR data intrinsically includes many similar samples that can be used to improve the estimation results. To overcome this problem, we model MR data as random fields and establish a principled way which is capable of choosing the samples not only from a local neighborhood but also from a large portion of the given data. To follow the similar samples within the MR data, an effective similarity measure based on the local statistical moments of images is presented. The parameters of the proposed filter are automatically chosen from the estimated local signal-to-noise ratio. To further enhance the denoising performance, a recursive version of the introduced approach is also addressed. The proposed filter is compared with related state-of-the-art filters using both synthetic and real MR datasets. The experimental results demonstrate the superior performance of our proposal in removing the noise and preserving the anatomical structures of MR images.