Short progressive muscle relaxation or motor coordination training does not increase performance in a brain-computer interface based on sensorimotor rhythms (SMR).

Brain computer interfaces (BCIs) allow for controlling devices through modulation of sensorimotor rhythms (SMR), yet a profound number of users is unable to achieve sufficient accuracy. Here, we investigated if visuo-motor coordination (VMC) training or Jacobsen's progressive muscle relaxation (PMR) prior to BCI use would increase later performance compared to a control group who performed a reading task (CG). Running the study in two different BCI-labs, we achieved a joint sample size of N=154 naïve participants. No significant effect of either intervention (VMC, PMR, control) was found on resulting BCI performance. Relaxation level and visuo-motor performance were associated with later BCI performance in one BCI-lab but not in the other. These mixed results do not indicate a strong potential of VMC or PMR for boosting performance. Yet further research with different training parameters or experimental designs is needed to complete the picture.

Real-time inference of word relevance from electroencephalogram and eye gaze.

OBJECTIVE: Brain-computer interfaces can potentially map the subjective relevance of the visual surroundings, based on neural activity and eye movements, in order to infer the interest of a person in real-time. APPROACH: Readers looked for words belonging to one out of five semantic categories, while a stream of words passed at different locations on the screen. It was estimated in real-time which words and thus which semantic category interested each reader based on the electroencephalogram (EEG) and the eye gaze. MAIN RESULTS: Words that were subjectively relevant could be decoded online from the signals. The estimation resulted in an average rank of 1.62 for the category of interest among the five categories after a hundred words had been read. SIGNIFICANCE: It was demonstrated that the interest of a reader can be inferred online from EEG and eye tracking signals, which can potentially be used in novel types of adaptive software, which enrich the interaction by adding implicit information about the interest of the user to the explicit interaction. The study is characterised by the following novelties. Interpretation with respect to the word meaning was necessary in contrast to the usual practice in brain-computer interfacing where stimulus recognition is sufficient. The typical counting task was avoided because it would not be sensible for implicit relevance detection. Several words were displayed at the same time, in contrast to the typical sequences of single stimuli. Neural activity was related with eye tracking to the words, which were scanned without restrictions on the eye movements.

Neural indicators of the depth of cognitive processing for user-adaptive neurotechnological applications.

The ability to infer implicit user variables in realtime and in an unobtrusive way would open a broad variety of applications such as adapting the user interface in human-computer interaction or developing safety assistance systems in industrial workplaces. Such information may be extracted from behavior, peripheral physiology and brain activity. Each of these sensors has its advantages and disadvantages suggesting that finally all available features should be fused. While in Brain-Computer Interface (BCI) research powerful methods for the real-time extraction of information from brain signals have been developed, comparatively little effort was spent on the extraction of hidden user states. As a further step in this direction, we propose a novel experimental paradigm to study the feasibility of quantifying how deeply presented information is processed in the brain. An investigation of event-related potentials (ERPs) demonstrates the effectiveness of our task in inducing different levels of cognitive processing and shows which features of brain activity provide discriminative information.

Decoding auditory attention to instruments in polyphonic music using single-trial EEG classification.

OBJECTIVE: Polyphonic music (music consisting of several instruments playing in parallel) is an intuitive way of embedding multiple information streams. The different instruments in a musical piece form concurrent information streams that seamlessly integrate into a coherent and hedonistically appealing entity. Here, we explore polyphonic music as a novel stimulation approach for use in a brain-computer interface. APPROACH: In a multi-streamed oddball experiment, we had participants shift selective attention to one out of three different instruments in music audio clips. Each instrument formed an oddball stream with its own specific standard stimuli (a repetitive musical pattern) and oddballs (deviating musical pattern). MAIN RESULTS: Contrasting attended versus unattended instruments, ERP analysis shows subject- and instrument-specific responses including P300 and early auditory components. The attended instrument can be classified offline with a mean accuracy of 91% across 11 participants. SIGNIFICANCE: This is a proof of concept that attention paid to a particular instrument in polyphonic music can be inferred from ongoing EEG, a finding that is potentially relevant for both brain-computer interface and music research.

Neuromuscular electrical stimulation induced brain patterns to decode motor imagery.

OBJECTIVE: Regardless of the paradigm used to implement a brain-computer interface (BCI), all systems suffer from BCI-inefficiency. In the case of patients the inefficiency can be high. Some solutions have been proposed to overcome this problem, however they have not been completely successful yet. METHODS: EEG from 10 healthy users was recorded during neuromuscular electrical stimulation (NMES) of hands and feet and during motor imagery (MI) of the same limbs. Features and classifiers were computed using part of these data to decode MI. RESULTS: Offline analyses showed that it was possible to decode MI using a classifier based on afferent patterns induced by NMES and even infer a better model than with MI data. CONCLUSION: Afferent NMES motor patterns can support the calibration of BCI systems and be used to decode MI. SIGNIFICANCE: This finding might be a new way to train sensorimotor rhythm (SMR) based BCI systems for healthy users having difficulties to attain BCI control. It might also be an alternative to train MI-based BCIs for users who cannot perform real movements but have remaining afferents (ALS, stroke patients).

Gaze-independent brain-computer interfaces based on covert attention and feature attention.

There is evidence that conventional visual brain-computer interfaces (BCIs) based on event-related potentials cannot be operated efficiently when eye movements are not allowed. To overcome this limitation, the aim of this study was to develop a visual speller that does not require eye movements. Three different variants of a two-stage visual speller based on covert spatial attention and non-spatial feature attention (i.e. attention to colour and form) were tested in an online experiment with 13 healthy participants. All participants achieved highly accurate BCI control. They could select one out of thirty symbols (chance level 3.3%) with mean accuracies of 88%-97% for the different spellers. The best results were obtained for a speller that was operated using non-spatial feature attention only. These results show that, using feature attention, it is possible to realize high-accuracy, fast-paced visual spellers that have a large vocabulary and are independent of eye gaze.

Toward unsupervised adaptation of LDA for brain-computer interfaces.

There is a step of significant difficulty experienced by brain-computer interface (BCI) users when going from the calibration recording to the feedback application. This effect has been previously studied and a supervised adaptation solution has been proposed. In this paper, we suggest a simple unsupervised adaptation method of the linear discriminant analysis (LDA) classifier that effectively solves this problem by counteracting the harmful effect of nonclass-related nonstationarities in electroencephalography (EEG) during BCI sessions performed with motor imagery tasks. For this, we first introduce three types of adaptation procedures and investigate them in an offline study with 19 datasets. Then, we select one of the proposed methods and analyze it further. The chosen classifier is offline tested in data from 80 healthy users and four high spinal cord injury patients. Finally, for the first time in BCI literature, we apply this unsupervised classifier in online experiments. Additionally, we show that its performance is significantly better than the state-of-the-art supervised approach.

On-line differentiation of neuroelectric activities: algorithms and applications.

This paper discusses machine learning methods and their application to Brain-Computer Interfacing. A particular focus is placed on linear classification methods which can be applied in the BCI context. Finally, we provide an overview of the Berlin-Brain Computer Interface (BBCI).

Improving speed and accuracy of brain-computer interfaces using readiness potential features.

To enhance human interaction with machines, research interest is growing to develop a 'brain-computer interface', which allows communication of a human with a machine only by use of brain signals. So far, the applicability of such an interface is strongly limited by low bit-transfer rates, slow response times and long training sessions for the subject. The Berlin Brain-Computer Interface (BBCI) project is guided by the idea to train a computer by advanced machine learning techniques both to improve classification performance and to reduce the need of subject training. In this paper we present two directions in which brain-computer interfacing can be enhanced by exploiting the lateralized readiness potential: (1) for establishing a rapid response BCI system that can predict the laterality of upcoming finger movements before EMG onset even in time critical contexts, and (2) to improve information transfer rates in the common BCI approach relying on imagined limb movements.