Towards single-trial classification of invasively recorded auditory evoked potentials in cochlear implant users.

Objective.One promising approach towards further improving cochlear implants (CI) is to use brain signals controlling the device in order to close the auditory loop. Initial electroencephalography (EEG) studies have already shown promising results. However, they are based on noninvasive measurements, whereas implanted electrodes are expected to be more convenient in terms of everyday-life usability. If additional measurement electrodes were implanted during CI surgery, then invasive recordings should be possible. Furthermore, implantation will provide better signal quality, higher robustness to artefacts, and thus enhanced classification accuracy.Approach.In an initial project, three additional epidural electrodes were temporarily implanted during the surgical procedure. After surgery, different auditory evoked potentials (AEPs) were recorded both invasively (epidural) and using surface electrodes, with invasively recorded signals demonstrated as being markedly superior. In this present analysis, cortical evoked response audiometry (CERA) signals recorded in seven patients were used for single-trial classification of sounds with different intensities. For classification purposes, we used shrinkage-regularized linear discriminant analysis (sLDA). Clinical speech perception scores were also investigated.Main results.Analysis of CERA data from different subjects showed single-trial classification accuracies of up to 99.2% for perceived vs. non-perceived sounds. Accuracies of up to 89.1% were achieved in classification of sounds perceived at different intensities. Highest classification accuracies were achieved by means of epidural recordings. Required loudness differences seemed to correspond to speech perception in noise.Significance.The proposed epidural recording approach showed good classification accuracy into sound perceived and not perceived when the best-performing electrodes were selected. Classifying different levels of sound stimulation accurately proved more challenging. At present, the methods explored in this study would not be sufficiently reliable to allow automated closed-loop control of CI parameters. However, our findings are an important initial contribution towards improving applicability of closed auditory loops and for next-generation automatic fitting approaches.

Cooperation in mind: Motor imagery of joint and single actions is represented in different brain areas.

In this study brain activity during motor imagery (MI) of joint actions, compared to single actions and rest conditions, was investigated using functional magnetic resonance imaging (fMRI). To the best of our knowledge, this is the first neuroimaging study which directly investigated the neural correlates of joint action motor imagery. Twenty-one healthy participants imagined three different motor tasks (dancing, carrying a box, wiping). Each imagery task was performed at two kinds: alone (single action MI) or with a partner (joint action MI). We hypothesized that to imagine a cooperative task would lead to a stronger cortical activation in motor related areas due to a higher vividness and intensification of the imagery. This would be elicited by the integration of the action simulation of the virtual partner to one's own action. Comparing the joint action and the single action condition with the rest condition, we found significant activation in the precentral gyrus and precuneus respectively. Furthermore the joint action MI showed higher activation patterns in the premotor cortex (inferior and middle frontal gyrus) compared to the single action MI. The imagery of a more vivid and engaging task, like our joint action imagery, could improve rehabilitation processes since a more distributed brain activity is found. Furthermore, the joint action imagery compared to single action imagery might be an appropriate BCI task due to its clear spatial distinction of activation.

Classification of unconscious like/dislike decisions: First results towards a novel application for BCI technology.

More and more applications for BCI technology emerge that are not restricted to communication or control, like gaming, rehabilitation, Neuro-IS research, neuro-economics or security. In this context a so called passive BCI, a system that derives its outputs from arbitrary brain activity for enriching a human-machine interaction with implicit information on the actual user state will be used. Concretely EEG-based BCI technology enables the use of signals related to attention, intentions and mental state, without relying on indirect measures based on overt behavior or other physiological signals which is an important point e.g. in Neuromarketing research. The scope of this pilot EEG-study was to detect like/dislike decisions on car stimuli just by means of ERP analysis. Concretely to define user preferences concerning different car designs by implementing an offline BCI based on shrinkage LDA classification. Although classification failed in the majority of participants the elicited early (sub) conscious ERP components reflect user preferences for cars. In a broader sense this study should pave the way towards a "product design BCI" suitable for neuromarketing research.

Separating heart and brain: on the reduction of physiological noise from multichannel functional near-infrared spectroscopy (fNIRS) signals.

OBJECTIVE: Functional near-infrared spectroscopy (fNIRS) is an emerging technique for the in vivo assessment of functional activity of the cerebral cortex as well as in the field of brain-computer interface (BCI) research. A common challenge for the utilization of fNIRS in these areas is a stable and reliable investigation of the spatio-temporal hemodynamic patterns. However, the recorded patterns may be influenced and superimposed by signals generated from physiological processes, resulting in an inaccurate estimation of the cortical activity. Up to now only a few studies have investigated these influences, and still less has been attempted to remove/reduce these influences. The present study aims to gain insights into the reduction of physiological rhythms in hemodynamic signals (oxygenated hemoglobin (oxy-Hb), deoxygenated hemoglobin (deoxy-Hb)). APPROACH: We introduce the use of three different signal processing approaches (spatial filtering, a common average reference (CAR) method; independent component analysis (ICA); and transfer function (TF) models) to reduce the influence of respiratory and blood pressure (BP) rhythms on the hemodynamic responses. MAIN RESULTS: All approaches produce large reductions in BP and respiration influences on the oxy-Hb signals and, therefore, improve the contrast-to-noise ratio (CNR). In contrast, for deoxy-Hb signals CAR and ICA did not improve the CNR. However, for the TF approach, a CNR-improvement in deoxy-Hb can also be found. SIGNIFICANCE: The present study investigates the application of different signal processing approaches to reduce the influences of physiological rhythms on the hemodynamic responses. In addition to the identification of the best signal processing method, we also show the importance of noise reduction in fNIRS data.

Watching object related movements modulates mirror-like activity in parietal brain regions.

OBJECTIVE: We studied the activation of cortical motor and parietal areas during the observation of object related grasping movements. By manipulating the type of an object (realistic versus abstract) and the type of grasping (correct versus incorrect), we addressed the question how observing such object related movements influences cortical rhythmicity, especially the mu-rhythm, in the context of an "extended" human mirror neuron system (MNS). METHODS: Multichannel electroencephalogram (EEG) was recorded during the observation of different object-related grasping actions in twenty healthy subjects. Different movies were presented, showing sequences of correct or incorrect hand grasping actions related to an abstract or realistic (daily life) object. RESULTS: Event-related de/synchronization (ERD/ERS) analyses revealed a larger ERD in the upper alpha (10-12 Hz), beta (16-20 Hz) and gamma (36-40 Hz) frequency bands over parietal brain regions depending on the type of grasping. The type of object only influenced ERD patterns in the gamma band range (36-40 Hz) at parietal sites suggesting a strong relation of gamma band activity and cortical object representation. Abstract and realistic objects produced lower beta band synchronization at central sites only, whereas depending on the type of grasping an ERS in the upper alpha band (10-12 Hz) was observed. CONCLUSION: Depending on the type of the grasped object and the type of grasping stronger parietal cortical activation occurred during movement observation. SIGNIFICANCE: Discussing the results in terms of an "extended" human mirror neuron system (MNS), it could be concluded that beside sensorimotor areas a stronger involvement of parietal brain regions was found depending on the type of object and grasping movement observed.

Spatio-temporal differences in brain oxygenation between movement execution and imagery: a multichannel near-infrared spectroscopy study.

Near-infrared spectroscopy (NIRS) was used to assess human motor-cortex oxygenation changes in response to self-paced movements as well as movement imagery. We used a 24 channel NIRS-system which allows non-invasive monitoring of cerebral oxygenation changes in the human brain induced by cortical activity. From previous studies it is known that motor imagery activates sensorimotor areas similar to those activated during execution of the same movement. Sixteen healthy subjects were recruited and the changes in concentration of oxygenated hemoglobin (oxy-Hb) and deoxygenated hemoglobin (deoxy-Hb) were examined during a simple right and left hand tapping task and during kinesthetic movement imagery. All subjects showed significant increases in oxy-Hb during both tasks compared to the resting period, but with different onset latencies of oxygenation. During left and right movement imagery, the oxy-Hb concentration increased about 2 s later compared to real movement execution. Furthermore, the oxygenation found was bilaterally represented for both tasks but with temporal differences. The present study reported new results concerning timing and topographical distribution of the hemodynamic response during motor imagery measured by near-infrared spectroscopy.