Classification of Articulator Movements and Movement Direction from Sensorimotor Cortex Activity.

For people suffering from severe paralysis, communication can be difficult or nearly impossible. Technology systems called brain-computer interfaces (BCIs) are being developed to assist these people with communication by using their brain activity to control a computer without any muscle activity. To benefit the development of BCIs that employ neural activity related to speech, we investigated if neural activity patterns related to different articulator movements can be distinguished from each other. We recorded with electrocorticography (ECoG), the neural activity related to different articulator movements in 4 epilepsy patients and classified which articulator participants moved based on the sensorimotor cortex activity patterns. The same was done for different movement directions of a single articulator, the tongue. In both experiments highly accurate classification was obtained, on average 92% for different articulators and 85% for different tongue directions. Furthermore, the data show that only a small part of the sensorimotor cortex is needed for classification (ca. 1 cm2). We show that recordings from small parts of the sensorimotor cortex contain information about different articulator movements which might be used for BCI control. Our results are of interest for BCI systems that aim to decode neural activity related to (actual or attempted) movements from a contained cortical area.

Decoding spoken phonemes from sensorimotor cortex with high-density ECoG grids.

For people who cannot communicate due to severe paralysis or involuntary movements, technology that decodes intended speech from the brain may offer an alternative means of communication. If decoding proves to be feasible, intracranial Brain-Computer Interface systems can be developed which are designed to translate decoded speech into computer generated speech or to instructions for controlling assistive devices. Recent advances suggest that such decoding may be feasible from sensorimotor cortex, but it is not clear how this challenge can be approached best. One approach is to identify and discriminate elements of spoken language, such as phonemes. We investigated feasibility of decoding four spoken phonemes from the sensorimotor face area, using electrocorticographic signals obtained with high-density electrode grids. Several decoding algorithms including spatiotemporal matched filters, spatial matched filters and support vector machines were compared. Phonemes could be classified correctly at a level of over 75% with spatiotemporal matched filters. Support Vector machine analysis reached a similar level, but spatial matched filters yielded significantly lower scores. The most informative electrodes were clustered along the central sulcus. Highest scores were achieved from time windows centered around voice onset time, but a 500 ms window before onset time could also be classified significantly. The results suggest that phoneme production involves a sequence of robust and reproducible activity patterns on the cortical surface. Importantly, decoding requires inclusion of temporal information to capture the rapid shifts of robust patterns associated with articulator muscle group contraction during production of a phoneme. The high classification scores are likely to be enabled by the use of high density grids, and by the use of discrete phonemes. Implications for use in Brain-Computer Interfaces are discussed.

Give me a sign: decoding four complex hand gestures based on high-density ECoG.

The increasing understanding of human brain functions makes it possible to directly interact with the brain for therapeutic purposes. Implantable brain computer interfaces promise to replace or restore motor functions in patients with partial or complete paralysis. We postulate that neuronal states associated with gestures, as they are used in the finger spelling alphabet of sign languages, provide an excellent signal for implantable brain computer interfaces to restore communication. To test this, we evaluated decodability of four gestures using high-density electrocorticography in two participants. The electrode grids were located subdurally on the hand knob area of the sensorimotor cortex covering a surface of 2.5-5.2 cm(2). Using a pattern-matching classification approach four types of hand gestures were classified based on their pattern of neuronal activity. In the two participants the gestures were classified with 97 and 74% accuracy. The high frequencies (>65 Hz) allowed for the best classification results. This proof-of-principle study indicates that the four gestures are associated with a reliable and discriminable spatial representation on a confined area of the sensorimotor cortex. This robust representation on a small area makes hand gestures an interesting control feature for an implantable BCI to restore communication for severely paralyzed people.

Brain implants for substituting lost motor function: state of the art and potential impact on the lives of motor-impaired seniors.

Recent scientific achievements bring the concept of neural prosthetics for reinstating lost motor function closer to medical application. Current research involves severely paralyzed people under the age of 65, but implications for seniors with stroke or trauma-induced impairments are clearly on the horizon. Demographic changes will lead to a shortage of personnel to care for an increasing population of senior citizens, threatening maintenance of an acceptable level of care and urging ways for people to live longer at their home independent from personal assistance. This is particularly challenging when people suffer from disabilities such as partial paralysis after stroke or trauma, where daily personal assistance is required. For some of these people, neural prosthetics can reinstate some lost motor function and/or lost communication, thereby increasing independence and possibly quality of life. In this viewpoint article, we present the state of the art in decoding brain activity in the service of brain-computer interfacing. Although some noninvasive applications produce good results, we focus on brain implants that benefit from better quality brain signals. Fully implantable neural prostheses for home use are not available yet, but clinical trials are being prepared. More sophisticated systems are expected to follow in the years to come, with capabilities of interest for less severe paralysis. Eventually the combination of smart robotics and brain implants is expected to enable people to interact well enough with their environment to live an independent life in spite of motor disabilities.

Task-free electrocorticography frequency mapping of the motor cortex.

OBJECTIVE: Electrocortical stimulation mapping (ESM) is the current gold standard for functional mapping of the eloquent cortex prior to epilepsy surgery. The procedure is, however, time-consuming and quite demanding for patients. Electrocorticography frequency mapping (ECoG mapping) has been suggested as an adjunct method. Here, we investigated whether it is possible to perform mapping of motor regions using ECoG data of spontaneous movements. METHODS: Using the video registration of seven epilepsy patients who underwent electrocorticography and ESM, we selected periods of spontaneous hand and arm movements and periods of rest. Frequency analysis was performed, and electrodes showing a significant change in power (4-7, 8-14, 15-25, 26-45 or 65-95 Hz) were compared with those being identified as relevant for hand and/or arm movement by ESM. RESULTS: All frequency bands showed a high specificity (>0.80), and the 65-95 Hz frequency band additionally had a high sensitivity (0.82) for identifying ESM positive electrodes. CONCLUSIONS: Our data show a good match between ECoG mapping of spontaneous movements and ESM data. SIGNIFICANCE: The accurate match suggests that ECoG mapping of the motor cortex using spontaneous movements may be a valuable complement to ESM, especially when other options requiring patient cooperation fail.

Frequency specific spatial interactions in human electrocorticography: V1 alpha oscillations reflect surround suppression.

Electrical brain signals are often decomposed into frequency ranges that are implicated in different functions. Using subdural electrocorticography (ECoG, intracranial EEG) and functional magnetic resonance imaging (fMRI), we measured frequency spectra and BOLD responses in primary visual cortex (V1) and intraparietal sulcus (IPS). In V1 and IPS, 30-120 Hz (gamma, broadband) oscillations allowed population receptive field (pRF) reconstruction comparable to fMRI estimates. Lower frequencies, however, responded very differently in V1 and IPS. In V1, broadband activity extends down to 3 Hz. In the 4-7 Hz (theta) and 18-30 Hz (beta) ranges broadband activity increases power during stimulation within the pRF. However, V1 9-12 Hz (alpha) frequency oscillations showed a different time course. The broadband power here is exceeded by a frequency-specific power increase during stimulation of the area outside the pRF. As such, V1 alpha oscillations reflected surround suppression of the pRF, much like negative fMRI responses. They were consequently highly localized, depending on stimulus and pRF position, and independent between nearby electrodes. In IPS, all 3-25 Hz oscillations were strongest during baseline recording and correlated between nearby electrodes, consistent with large-scale disengagement. These findings demonstrate V1 alpha oscillations result from locally active functional processes and relate these alpha oscillations to negative fMRI signals. They highlight that similar oscillations in different areas reflect processes with different functional roles. However, both of these roles of alpha seem to reflect suppression of spiking activity.

The effects of blood vessels on electrocorticography.

Electrocorticography, primarily used in a clinical context, is becoming increasingly important for fundamental neuroscientific research, as well as for brain-computer interfaces. Recordings from these implanted electrodes have a number of advantages over non-invasive recordings in terms of band width, spatial resolution, smaller vulnerability to artifacts and overall signal quality. However, an unresolved issue is that signals vary greatly across electrodes. Here, we examine the effect of blood vessels lying between an electrode and the cortex on signals recorded from subdural grid electrodes. Blood vessels of different sizes cover extensive parts of the cortex causing variations in the electrode-cortex connection across grids. The power spectral density of electrodes located on the cortex and electrodes located on blood vessels obtained from eight epilepsy patients is compared. We find that blood vessels affect the power spectral density of the recorded signal in a frequency-band-specific way, in that frequencies between 30 and 70 Hz are attenuated the most. Here, the signal is attenuated on average by 30-40% compared to electrodes directly on the cortex. For lower frequencies this attenuation effect is less pronounced. We conclude that blood vessels influence the signal properties in a non-uniform manner.

Functional MRI-based identification of brain areas involved in motor imagery for implantable brain-computer interfaces.

For the development of minimally invasive brain-computer interfaces (BCIs), it is important to accurately localize the area of implantation. Using fMRI, we investigated which brain areas are involved in motor imagery. Twelve healthy subjects performed a motor execution and imagery task during separate fMRI and EEG measurements. fMRI results showed that during imagery, premotor and parietal areas were most robustly activated in individual subjects, but surprisingly, no activation was found in the primary motor cortex. EEG results showed that spectral power decreases in contralateral sensorimotor rhythms (8-24 Hz) during both movement and imagery. To further verify the involvement of the motor imagery areas found with fMRI, one epilepsy patient performed the same task during both fMRI and ECoG recordings. Significant ECoG low (8-24 Hz) and high (65-95 Hz) frequency power changes were observed selectively on premotor cortex and these co-localized with fMRI. During a subsequent BCI task, excellent performance (91%) was obtained based on ECoG power changes from the localized premotor area. These results indicate that other areas than the primary motor area may be more reliably activated during motor imagery. Specifically, the premotor cortex may be a better area to implant an invasive BCI.

Retrograde fluorescent microsphere tracing of retinal and central afferents to the nucleus of the optic tract in pigmented and albino rats.

The pretectal nucleus of the optic tract is involved in optokinetic nystagmus. Albino animals suffer from inverse optokinetic nystagmus, possibly due to a smaller number of ipsilateral projections. Animals with laterally placed eyes have an asymmetric nystagmus, attributed to a presumed lack of binocular cortical input to the nucleus of the optic tract. Moreover, a direct input from the ipsilateral retina is controversial. We investigated the retinal and central afferents to the nucleus of the optic tract in the rat by retrograde tracing using fluorescent latex microspheres. Ipsilaterally projecting retinal ganglion cells were observed in pigmented and also in albino rats. Projections from the visual cortex and primary visual nuclei were demonstrated.