Macroscopic brain dynamics beyond contralateral primary motor cortex for movement prediction.

This study investigates the complex relationship between upper limb movement direction and macroscopic neural signals in the brain, which is critical for understanding brain-computer interfaces (BCI). Conventional BCI research has primarily focused on a local area, such as the contralateral primary motor cortex (M1), relying on the population-based decoding method with microelectrode arrays. In contrast, macroscopic approaches such as electroencephalography (EEG) and magnetoencephalography (MEG) utilize numerous electrodes to cover broader brain regions. This study probes the potential differences in the mechanisms of microscopic and macroscopic methods. It is important to determine which neural activities effectively predict movements. To investigate this, we analyzed MEG data from nine right-handed participants while performing arm-reaching tasks. We employed dynamic statistical parametric mapping (dSPM) to estimate source activity and built a decoding model composed of long short-term memory (LSTM) and a multilayer perceptron to predict movement trajectories. This model achieved a high correlation coefficient of 0.79 between actual and predicted trajectories. Subsequently, we identified brain regions sensitive to predicting movement direction using the integrated gradients (IG) method, which assesses the predictive contribution of each source activity. The resulting salience map demonstrated a distribution without significant differences across motor-related regions, including M1. Predictions based solely on M1 activity yielded a correlation coefficient of 0.42, nearly half as effective as predictions incorporating all source activities. This suggests that upper limb movements are influenced by various factors such as movement coordination, planning, body and target position recognition, and control, beyond simple muscle activity. All of the activities are needed in the decoding model using macroscopic signals. Our findings also revealed that contralateral and ipsilateral hemispheres contribute equally to movement prediction, implying that BCIs could potentially benefit patients with brain damage in the contralateral hemisphere by utilizing brain signals from the ipsilateral hemisphere. In conclusion, this study demonstrates that macroscopic activity from large brain regions significantly contributes to predicting upper limb movement. Non-invasive BCI systems would require a comprehensive collection of neural signals from multiple brain regions.

Motor Intentions Decoded from fMRI Signals.

Motor intention is a high-level brain function related to planning for movement. Although studies have shown that motor intentions can be decoded from brain signals before movement execution, it is unclear whether intentions relating to mental imagery of movement can be decoded. Here, we investigated whether differences in spatial and temporal patterns of brain activation were elicited by intentions to perform different types of motor imagery and whether the patterns could be used by a multivariate pattern classifier to detect such differential intentions. The results showed that it is possible to decode intentions before the onset of different types of motor imagery from functional MR signals obtained from fronto-parietal brain regions, such as the premotor cortex and posterior parietal cortex, while controlling for eye movements and for muscular activity of the hands. These results highlight the critical role played by the aforementioned brain regions in covert motor intentions. Moreover, they have substantial implications for rehabilitating patients with motor disabilities.

Bioethics and Neurosurgery: An Overview of Existing and Emerging Topics for the Practicing Neurosurgeon.

Neurosurgery is field with complex ethical issues. In this article, we aim to provide an overview of key and emerging ethical issues in neurosurgery with a focus on issues relevant to practicing neurosurgeons. These issues include those of informed consent, capacity, clinical trials, emerging neurotechnology, innovation, equity and justice, and emerging bioethics areas including community engagement and organizational ethics. We argue bioethics can help neurosurgeons think about and address these issues, and in turn, the field of bioethics can benefit from engagement by neurosurgeons. Several ideas for increasing engagement in bioethics are proposed.

Evoking artificial speech perception through invasive brain stimulation for brain-computer interfaces: current challenges and future perspectives.

Encoding artificial perceptions through brain stimulation, especially that of higher cognitive functions such as speech perception, is one of the most formidable challenges in brain-computer interfaces (BCI). Brain stimulation has been used for functional mapping in clinical practices for the last 70 years to treat various disorders affecting the nervous system, including epilepsy, Parkinson's disease, essential tremors, and dystonia. Recently, direct electrical stimulation has been used to evoke various forms of perception in humans, ranging from sensorimotor, auditory, and visual to speech cognition. Successfully evoking and fine-tuning artificial perceptions could revolutionize communication for individuals with speech disorders and significantly enhance the capabilities of brain-computer interface technologies. However, despite the extensive literature on encoding various perceptions and the rising popularity of speech BCIs, inducing artificial speech perception is still largely unexplored, and its potential has yet to be determined. In this paper, we examine the various stimulation techniques used to evoke complex percepts and the target brain areas for the input of speech-like information. Finally, we discuss strategies to address the challenges of speech encoding and discuss the prospects of these approaches.

Enhancing poststroke hand movement recovery: Efficacy of RehabSwift, a personalized brain-computer interface system.

This study explores the efficacy of our novel and personalized brain-computer interface (BCI) therapy, in enhancing hand movement recovery among stroke survivors. Stroke often results in impaired motor function, posing significant challenges in daily activities and leading to considerable societal and economic burdens. Traditional physical and occupational therapies have shown limitations in facilitating satisfactory recovery for many patients. In response, our study investigates the potential of motor imagery-based BCIs (MI-BCIs) as an alternative intervention. In this study, MI-BCIs translate imagined hand movements into actions using a combination of scalp-recorded electrical brain activity and signal processing algorithms. Our prior research on MI-BCIs, which emphasizes the benefits of proprioceptive feedback over traditional visual feedback and the importance of customizing the delay between brain activation and passive hand movement, led to the development of RehabSwift therapy. In this study, we recruited 12 chronic-stage stroke survivors to assess the effectiveness of our solution. The primary outcome measure was the Fugl-Meyer upper extremity (FMA-UE) assessment, complemented by secondary measures including the action research arm test, reaction time, unilateral neglect, spasticity, grip and pinch strength, goal attainment scale, and FMA-UE sensation. Our findings indicate a remarkable improvement in hand movement and a clinically significant reduction in poststroke arm and hand impairment following 18 sessions of neurofeedback training. The effects persisted for at least 4 weeks posttreatment. These results underscore the potential of MI-BCIs, particularly our solution, as a prospective tool in stroke rehabilitation, offering a personalized and adaptable approach to neurofeedback training.

Revolutionizing Neurology: The Role of Artificial Intelligence in Advancing Diagnosis and Treatment.

Artificial intelligence (AI) has emerged as a powerful tool in the field of neurology, significantly impacting the diagnosis and treatment of neurological disorders. Recent technological breakthroughs have given us access to a plethora of information relevant to many aspects of neurology. Neuroscience and AI share a long history of collaboration. Along with great potential, we encounter obstacles relating to data quality, ethics, and inherent difficulty in applying data science in healthcare. Neurological disorders pose intricate challenges due to their complex manifestations and variability. Automating image interpretation tasks, AI algorithms accurately identify brain structures and detect abnormalities. This accelerates diagnosis and reduces the workload on medical professionals. Treatment optimization benefits from AI simulations that model different scenarios and predict outcomes. These AI systems can currently perform many of the sophisticated perceptual and cognitive capacities of biological systems, such as object identification and decision making. Furthermore, AI is rapidly being used as a tool in neuroscience research, altering our understanding of brain functioning. It has the ability to revolutionize healthcare as we know it into a system in which humans and robots collaborate to deliver better care for our patients. Image analysis activities such as recognizing particular brain regions, calculating changes in brain volume over time, and detecting abnormalities in brain scans can be automated by AI systems. This lessens the strain on radiologists and neurologists while improving diagnostic accuracy and efficiency. It is now obvious that cutting-edge artificial intelligence models combined with high-quality clinical data will lead to enhanced prognostic and diagnostic models in neurological illness, permitting expert-level clinical decision aids across healthcare settings. In conclusion, AI's integration into neurology has revolutionized diagnosis, treatment, and research. As AI technologies advance, they promise to unravel the complexities of neurological disorders further, leading to improved patient care and quality of life. The symbiosis of AI and neurology offers a glimpse into a future where innovation and compassion converge to reshape neurological healthcare. This abstract provides a concise overview of the role of AI in neurology and its transformative potential.

Decentralising the Self - Ethical Considerations in Utilizing Decentralised Web Technology for Direct Brain Interfaces.

The rapidly advancing field of brain-computer (BCI) and brain-to-brain interfaces (BBI) is stimulating interest across various sectors including medicine, entertainment, research, and military. The developers of large-scale brain-computer networks, sometimes dubbed 'Mindplexes' or 'Cloudminds', aim to enhance cognitive functions by distributing them across expansive networks. A key technical challenge is the efficient transmission and storage of information. One proposed solution is employing blockchain technology over Web 3.0 to create decentralised cognitive entities. This paper explores the potential of a decentralised web for coordinating large brain-computer constellations, and its associated benefits, focusing in particular on the conceptual and ethical challenges this innovation may pose pertaining to (1) Identity, (2) Sovereignty (encompassing Autonomy, Authenticity, and Ownership), (3) Responsibility and Accountability, and (4) Privacy, Safety, and Security. We suggest that while a decentralised web can address some concerns and mitigate certain risks, underlying ethical issues persist. Fundamental questions about entity definition within these networks, the distinctions between individuals and collectives, and responsibility distribution within and between networks, demand further exploration.

Decoding lower-limb kinematic parameters during pedaling tasks using deep learning approaches and EEG.

Stroke is a neurological condition that usually results in the loss of voluntary control of body movements, making it difficult for individuals to perform activities of daily living (ADLs). Brain-computer interfaces (BCIs) integrated into robotic systems, such as motorized mini exercise bikes (MMEBs), have been demonstrated to be suitable for restoring gait-related functions. However, kinematic estimation of continuous motion in BCI systems based on electroencephalography (EEG) remains a challenge for the scientific community. This study proposes a comparative analysis to evaluate two artificial neural network (ANN)-based decoders to estimate three lower-limb kinematic parameters: x- and y-axis position of the ankle and knee joint angle during pedaling tasks. Long short-term memory (LSTM) was used as a recurrent neural network (RNN), which reached Pearson correlation coefficient (PCC) scores close to 0.58 by reconstructing kinematic parameters from the EEG features on the delta band using a time window of 250 ms. These estimates were evaluated through kinematic variance analysis, where our proposed algorithm showed promising results for identifying pedaling and rest periods, which could increase the usability of classification tasks. Additionally, negative linear correlations were found between pedaling speed and decoder performance, thereby indicating that kinematic parameters between slower speeds may be easier to estimate. The results allow concluding that the use of deep learning (DL)-based methods is feasible for the estimation of lower-limb kinematic parameters during pedaling tasks using EEG signals. This study opens new possibilities for implementing controllers most robust for MMEBs and BCIs based on continuous decoding, which may allow for maximizing the degrees of freedom and personalized rehabilitation.

A model-based brain switch via periodic motor imagery modulation for asynchronous brain-computer interfaces.

OBJECTIVE: Brain switches provide a tangible solution to asynchronized brain-computer interface (aBCI), which decodes user intention without a pre-programmed structure. However, most brain switches based on electroencephalography (EEG) signals have high false positive rates (FPRs), resulting in less practicality. This research aims to improve the operating mode and usability of the brain switch. APPROACH: Here, we propose a novel virtual physical model-based brain switch that leverages periodic active modulation. An optimization problem of minimizing the triggering time subject to a required FPR is formulated, numerical and analytical approximate solutions are obtained based on the model. MAIN RESULTS: Our motor imagery(MI)-based brain switch can reach 0.8FP/h FPR with a median triggering time of 58s. We evaluated the proposed brain switch during online device control, and their average FPRs substantially outperformed the conventional brain switches in the literature. We further improved the proposed brain switch with the Common Spatial Pattern (CSP) and optimization method. An average FPR of 0.3 FPs/hour was obtained for the MI-CSP-based brain switch, and the average triggering time improved to 21.6s. SIGNIFICANCE: This study provides a new approach that could significantly reduce the brain switch's FPR to less than 1 Fps/hour, which was less than 10% of the FPR (decreasing by more than a magnitude of order) by other endogenous methods, and the reaction time (RT) was comparable to the state-of-the-art approaches. This represents a significant advancement over the current non-invasive asynchronous BCI and will open widespread avenues for translating BCI towards clinical applications.

Multiclass Classification of Visual Electroencephalogram Based on Channel Selection, Minimum Norm Estimation Algorithm, and Deep Network Architectures.

This work addresses the challenge of classifying multiclass visual EEG signals into 40 classes for brain-computer interface applications using deep learning architectures. The visual multiclass classification approach offers BCI applications a significant advantage since it allows the supervision of more than one BCI interaction, considering that each class label supervises a BCI task. However, because of the nonlinearity and nonstationarity of EEG signals, using multiclass classification based on EEG features remains a significant challenge for BCI systems. In the present work, mutual information-based discriminant channel selection and minimum-norm estimate algorithms were implemented to select discriminant channels and enhance the EEG data. Hence, deep EEGNet and convolutional recurrent neural networks were separately implemented to classify the EEG data for image visualization into 40 labels. Using the k-fold cross-validation approach, average classification accuracies of 94.8% and 89.8% were obtained by implementing the aforementioned network architectures. The satisfactory results obtained with this method offer a new implementation opportunity for multitask embedded BCI applications utilizing a reduced number of both channels (<50%) and network parameters (<110 K).

"Your Thoughts are (were) Free!": Brain-Computer-Interfaces, Neurofeedback, Detection of Deception, and the Future of Mind-Reading.

This review describes the historical developement and rationale of clinically relevant research on neurophysiological "mind reading" paradims: Brain- Computer-Interfaces, detection of deception, brain stimulation and neurofeedback and the clinical applications in drug resistant epilepsy, chronic stroke, and communication with paralyzed locked-in persons. The emphasis lies on completely locked-in patients with amyotrophic lateral sclerosis using non-invasive and invasive brain computer interfaces and neurofeedback to restore verbal communication with the social environment. In the second part of the article we argue that success and failure of neurophysiological "mind reading" paradigms may be explained with a motor theory of thinking and emotion in combination with learning theory. The ethical implications of brain computer interface and neurofeedback approaches, particularly for severe chronic paralysis and loss of communication diseases and decisions on hastened death and euthanasia are discussed.

Consistent spectro-spatial features of human ECoG successfully decode naturalistic behavioral states.

Objective: Understanding the neural correlates of naturalistic behavior is critical for extending and confirming the results obtained from trial-based experiments and designing generalizable brain-computer interfaces that can operate outside laboratory environments. In this study, we aimed to pinpoint consistent spectro-spatial features of neural activity in humans that can discriminate between naturalistic behavioral states. Approach: We analyzed data from five participants using electrocorticography (ECoG) with broad spatial coverage. Spontaneous and naturalistic behaviors such as "Talking" and "Watching TV" were labeled from manually annotated videos. Linear discriminant analysis (LDA) was used to classify the two behavioral states. The parameters learned from the LDA were then used to determine whether the neural signatures driving classification performance are consistent across the participants. Main results: Spectro-spatial feature values were consistently discriminative between the two labeled behavioral states across participants. Mainly, θ, α, and low and high γ in the postcentral gyrus, precentral gyrus, and temporal lobe showed significant classification performance and feature consistency across participants. Subject-specific performance exceeded 70%. Combining neural activity from multiple cortical regions generally does not improve decoding performance, suggesting that information regarding the behavioral state is non-additive as a function of the cortical region. Significance: To the best of our knowledge, this is the first attempt to identify specific spectro-spatial neural correlates that consistently decode naturalistic and active behavioral states. The aim of this work is to serve as an initial starting point for developing brain-computer interfaces that can be generalized in a realistic setting and to further our understanding of the neural correlates of naturalistic behavior in humans.

Stability of ECoG high gamma signals during speech and implications for a speech BCI system in an individual with ALS: a year-long longitudinal study.

Objective.Speech brain-computer interfaces (BCIs) have the potential to augment communication in individuals with impaired speech due to muscle weakness, for example in amyotrophic lateral sclerosis (ALS) and other neurological disorders. However, to achieve long-term, reliable use of a speech BCI, it is essential for speech-related neural signal changes to be stable over long periods of time. Here we study, for the first time, the stability of speech-related electrocorticographic (ECoG) signals recorded from a chronically implanted ECoG BCI over a 12 month period.Approach.ECoG signals were recorded by an ECoG array implanted over the ventral sensorimotor cortex in a clinical trial participant with ALS. Because ECoG-based speech decoding has most often relied on broadband high gamma (HG) signal changes relative to baseline (non-speech) conditions, we studied longitudinal changes of HG band power at baseline and during speech, and we compared these with residual high frequency noise levels at baseline. Stability was further assessed by longitudinal measurements of signal-to-noise ratio, activation ratio, and peak speech-related HG response magnitude (HG response peaks). Lastly, we analyzed the stability of the event-related HG power changes (HG responses) for individual syllables at each electrode.Main Results.We found that speech-related ECoG signal responses were stable over a range of syllables activating different articulators for the first year after implantation.Significance.Together, our results indicate that ECoG can be a stable recording modality for long-term speech BCI systems for those living with severe paralysis.Clinical Trial Information.ClinicalTrials.gov, registration number NCT03567213.

Towards electrophysiological measurement of presence in virtual reality through auditory oddball stimuli.

Objective.Presence is an important aspect of user experience in virtual reality (VR). It corresponds to the illusion of being physically located in a virtual environment (VE). This feeling is usually measured through questionnaires that disrupt presence, are subjective and do not allow for real-time measurement. Electroencephalography (EEG), which measures brain activity, is increasingly used to monitor the state of users, especially while immersed in VR.Approach.In this paper, we present a way of evaluating presence, through the measure of the attention dedicated to the real environment via an EEG oddball paradigm. Using breaks in presence, this experimental protocol constitutes an ecological method for the study of presence, as different levels of presence are experienced in an identical VE.Main results.Through analysing the EEG data of 18 participants, a significant increase in the neurophysiological reaction to the oddball, i.e. the P300 amplitude, was found in low presence condition compared to high presence condition. This amplitude was significantly correlated with the self-reported measure of presence. Using Riemannian geometry to perform single-trial classification, we present a classification algorithm with 79% accuracy in detecting between two presence conditions.Significance.Taken together our results promote the use of EEG and oddball stimuli to monitor presence offline or in real-time without interrupting the user in the VE.

Riemannian transfer learning based on log-Euclidean metric for EEG classification.

Introduction: Brain computer interfaces (BCI), which establish a direct interaction between the brain and the external device bypassing peripheral nerves, is one of the hot research areas. How to effectively convert brain intentions into instructions for controlling external devices in real-time remains a key issue that needs to be addressed in brain computer interfaces. The Riemannian geometry-based methods have achieved competitive results in decoding EEG signals. However, current Riemannian classifiers tend to overlook changes in data distribution, resulting in degenerated classification performance in cross-session and/or cross subject scenarios. Methods: This paper proposes a brain signal decoding method based on Riemannian transfer learning, fully considering the drift of the data distribution. Two Riemannian transfer learning methods based log-Euclidean metric are developed, such that historical data (source domain) can be used to aid the training of the Riemannian decoder for the current task, or data from other subjects can be used to boost the training of the decoder for the target subject. Results: The proposed methods were verified on BCI competition III, IIIa, and IV 2a datasets. Compared with the baseline that without transfer learning, the proposed algorithm demonstrates superior classification performance. In contrast to the Riemann transfer learning method based on the affine invariant Riemannian metric, the proposed method obtained comparable classification performance, but is much more computationally efficient. Discussion: With the help of proposed transfer learning method, the Riemannian classifier obtained competitive performance to existing methods in the literature. More importantly, the transfer learning process is unsupervised and time-efficient, possessing potential for online learning scenarios.

Multiclass motor imagery classification with Riemannian geometry and temporal-spectral selection.

Motor imagery (MI) based brain-computer interfaces (BCIs) decode the users' intentions from electroencephalography (EEG) to achieve information control and interaction between the brain and external devices. In this paper, firstly, we apply Riemannian geometry to the covariance matrix extracted by spatial filtering to obtain robust and distinct features. Then, a multiscale temporal-spectral segmentation scheme is developed to enrich the feature dimensionality. In order to determine the optimal feature configurations, we utilize a linear learning-based temporal window and spectral band (TWSB) selection method to evaluate the feature contributions, which efficiently reduces the redundant features and improves the decoding efficiency without excessive loss of accuracy. Finally, support vector machines are used to predict the classification labels based on the selected MI features. To evaluate the performance of our model, we test it on the publicly available BCI Competition IV dataset 2a and 2b. The results show that the method has an average accuracy of 79.1% and 83.1%, which outperforms other existing methods. Using TWSB feature selection instead of selecting all features improves the accuracy by up to about 6%. Moreover, the TWSB selection method can effectively reduce the computational burden. We believe that the framework reveals more interpretable feature information of motor imagery EEG signals, provides neural responses discriminative with high accuracy, and facilitates the performance of real-time MI-BCI.

Authentication with a one-dimensional CNN model using EEG-based brain-computer interface.

Brain-computer interface (BCI) technology uses electroencephalogram (EEG) signals to create a direct interaction between the human body and its surroundings. Motor imagery (MI) classification using EEG signals is an important application that can help a rehabilitated or motor-impaired stroke patient perform certain tasks. Robust classification of these signals is an important step toward making the use of EEG more practical in many applications and less dependent on trained professionals. Deep learning methods have produced impressive results in BCI in recent years, especially with the availability of large electroencephalography (EEG) data sets. Dealing with EEG-MI signals is difficult because noise and other signal sources can interfere with the electrical amplitude of the brain, and its generalization ability is limited, so it is difficult to improve EEG classifiers. To address these issues, this paper presents a methodology based on one-dimensional convolutional neural networks (1-D CNN) for motor imagery (MI) recognition for the right hand, left hand, feet, and sedentary task. The proposed model is a lightweight model with fewer parameters and has an accuracy of 91.75%. Then, in an innovative exploitation of the four output classes, there is an idea that allows people with disabilities who are deprived of security measures, such as entering a secret code, to use the output classification, such as password codes. It is also an idea for a unique authentication system that is more secure and less vulnerable to theft or the like for a healthy person at the same time.

Optimizing motor imagery BCI models with hard trials removal and model refinement.

Deep learning models have demonstrated remarkable performance in the classification of motor imagery BCI systems. However, these models exhibit sensitivity to challenging trials, often called hard trials, leading to performance degradation. In this paper, we address this issue by proposing two novel methods for identifying and mitigating the impact of hard trials on model performance. The first method leverages model prediction scores to discern hard trials. The second approach employs a quantitative explainable artificial intelligence (XAI) approach, enabling a more transparent and interpretable means of hard trial identification. The identified hard trials are removed from the entire motor imagery training and validation dataset, and the deep learning model is further re-trained using the dataset without hard trials. To evaluate the efficacy of these proposed methods, experiments were conducted on the Open BMI dataset. The results for hold-out analysis show that the proposed quantitative XAI- based hard trial removal method has statistically improved the average classification accuracy of the baseline deep CNN model from 63.77% to 68.70%, withp-value =7.66e-11for the subject-specific MI classification. Additionally, analyzing the scalp map representing the average relevance scores of correctly classified trials compared to a misclassified trial provides a deeper insight into identifying hard trials. The results indicate that the proposed quantitaive-based XAI approach outperformes the prediction-score-based approach in hard trial identification.

A novel feature extraction method PSS-CSP for binary motor imagery - based brain-computer interfaces.

In order to improve the performance of binary motor imagery (MI) - based brain-computer interfaces (BCIs) using electroencephalography (EEG), a novel method (PSS-CSP) is proposed, which combines spectral subtraction with common spatial pattern. Spectral subtraction is an effective denoising method which is initially adopted to process MI-based EEG signals for binary BCIs in this work. On this basis, we proposed a novel feature extraction method called power spectral subtraction-based common spatial pattern (PSS-CSP) , which calculates the differences in power spectrum between binary classes of EEG signals and uses the differences in the feature extraction process. Additionally, support vector machine (SVM) algorithm is used for signal classification. Results show the proposed method (PSS-CSP) outperforms certain existing methods, achieving a classification accuracy of 76.8% on the BCIIV dataset 2b, and 76.25% and 77.38% on the OpenBMI dataset session 1 and session 2, respectively.