Visual context affects the perceived timing of tactile sensations elicited through intra-cortical microstimulation.

Intra-cortical microstimulation (ICMS) is a technique to provide tactile sensations for a somatosensory brain-machine interface (BMI). A viable BMI must function within the rich, multisensory environment of the real world, but how ICMS is integrated with other sensory modalities is poorly understood. To investigate how ICMS percepts are integrated with visual information, ICMS and visual stimuli were delivered at varying times relative to one another. Both visual context and ICMS current amplitude were found to bias the qualitative experience of ICMS. In two tetraplegic participants, ICMS and visual stimuli were more likely to be experienced as occurring simultaneously when visual stimuli were more realistic, demonstrating an effect of visual context on the temporal binding window. The peak of the temporal binding window varied but was consistently offset from zero, suggesting that multisensory integration with ICMS can suffer from temporal misalignment. Recordings from primary somatosensory cortex (S1) during catch trials where visual stimuli were delivered without ICMS demonstrated that S1 represents visual information related to ICMS across visual contexts.

Primary somatosensory cortex organization for engineering artificial somatosensation.

Somatosensory deficits from stroke, spinal cord injury, or other neurologic damage can lead to a significant degree of functional impairment. The primary (SI) and secondary (SII) somatosensory cortices encode information in a medial to lateral organization. SI is generally organized topographically, with more discrete cortical representations of specific body regions. SII regions corresponding to anatomical areas are less discrete and may represent a more functional rather than topographic organization. Human somatosensory research continues to map cortical areas of sensory processing with efforts primarily focused on hand and upper extremity information in SI. However, research into SII and other body regions is lacking. In this review, we synthesize the current state of knowledge regarding the cortical organization of human somatosensation and discuss potential applications for brain computer interface. In addition to accurate individualized mapping of cortical somatosensation, further research is required to uncover the neurophysiological mechanisms of how somatosensory information is encoded in the cortex.

Suppression of cortical electrostimulation artifacts using pre-whitening and null projection.

Objective.Invasive brain-computer interfaces (BCIs) have shown promise in restoring motor function to those paralyzed by neurological injuries. These systems also have the ability to restore sensation via cortical electrostimulation. Cortical stimulation produces strong artifacts that can obscure neural signals or saturate recording amplifiers. While front-end hardware techniques can alleviate this problem, residual artifacts generally persist and must be suppressed by back-end methods.Approach.We have developed a technique based on pre-whitening and null projection (PWNP) and tested its ability to suppress stimulation artifacts in electroencephalogram (EEG), electrocorticogram (ECoG) and microelectrode array (MEA) signals from five human subjects.Main results.In EEG signals contaminated by narrow-band stimulation artifacts, the PWNP method achieved average artifact suppression between 32 and 34 dB, as measured by an increase in signal-to-interference ratio. In ECoG and MEA signals contaminated by broadband stimulation artifacts, our method suppressed artifacts by 78%-80% and 85%, respectively, as measured by a reduction in interference index. When compared to independent component analysis, which is considered the state-of-the-art technique for artifact suppression, our method achieved superior results, while being significantly easier to implement.Significance.PWNP can potentially act as an efficient method of artifact suppression to enable simultaneous stimulation and recording in bi-directional BCIs to biomimetically restore motor function.

S1 represents multisensory contexts and somatotopic locations within and outside the bounds of the cortical homunculus.

Recent literature suggests that tactile events are represented in the primary somatosensory cortex (S1) beyond its long-established topography; in addition, the extent to which S1 is modulated by vision remains unclear. To better characterize S1, human electrophysiological data were recorded during touches to the forearm or finger. Conditions included visually observed physical touches, physical touches without vision, and visual touches without physical contact. Two major findings emerge from this dataset. First, vision strongly modulates S1 area 1, but only if there is a physical element to the touch, suggesting that passive touch observation is insufficient to elicit neural responses. Second, despite recording in a putative arm area of S1, neural activity represents both arm and finger stimuli during physical touches. Arm touches are encoded more strongly and specifically, supporting the idea that S1 encodes tactile events primarily through its topographic organization but also more generally, encompassing other areas of the body.

Motor skill learning decreases movement variability and increases planning horizon.

We investigated motor skill learning using a path tracking task, where human subjects had to track various curved paths at a constant speed while maintaining the cursor within the path width. Subjects' accuracy increased with practice, even when tracking novel untrained paths. Using a "searchlight" paradigm, where only a short segment of the path ahead of the cursor was shown, we found that subjects with a higher tracking skill differed from the novice subjects in two respects. First, they had lower movement variability, in agreement with previous findings. Second, they took a longer section of the future path into account when performing the task, i.e., had a longer planning horizon. We estimate that between one-third and one-half of the performance increase in the expert group was due to the longer planning horizon. An optimal control model with a fixed horizon (receding horizon control) that increases with tracking skill quantitatively captured the subjects' movement behavior. These findings demonstrate that human subjects not only increase their motor acuity but also their planning horizon when acquiring a motor skill.NEW & NOTEWORTHY We show that when learning a motor skill humans are using information about the environment from an increasingly longer amount of the movement path ahead to improve performance. Crucial features of the behavioral performance can be captured by modeling the behavioral data with a receding horizon optimal control model.

Exploring Cognition with Brain-Machine Interfaces.

Traditional brain-machine interfaces decode cortical motor commands to control external devices. These commands are the product of higher-level cognitive processes, occurring across a network of brain areas, that integrate sensory information, plan upcoming motor actions, and monitor ongoing movements. We review cognitive signals recently discovered in the human posterior parietal cortex during neuroprosthetic clinical trials. These signals are consistent with small regions of cortex having a diverse role in cognitive aspects of movement control and body monitoring, including sensorimotor integration, planning, trajectory representation, somatosensation, action semantics, learning, and decision making. These variables are encoded within the same population of cells using structured representations that bind related sensory and motor variables, an architecture termed partially mixed selectivity. Diverse cognitive signals provide complementary information to traditional motor commands to enable more natural and intuitive control of external devices.

The Neurophysiological Representation of Imagined Somatosensory Percepts in Human Cortex.

Intracortical microstimulation (ICMS) in human primary somatosensory cortex (S1) has been used to successfully evoke naturalistic sensations. However, the neurophysiological mechanisms underlying the evoked sensations remain unknown. To understand how specific stimulation parameters elicit certain sensations we must first understand the representation of those sensations in the brain. In this study we record from intracortical microelectrode arrays implanted in S1, premotor cortex, and posterior parietal cortex of a male human participant performing a somatosensory imagery task. The sensations imagined were those previously elicited by ICMS of S1, in the same array of the same participant. In both spike and local field potential recordings, features of the neural signal can be used to classify different imagined sensations. These features are shown to be stable over time. The sensorimotor cortices only encode the imagined sensation during the imagery task, while posterior parietal cortex encodes the sensations starting with cue presentation. These findings demonstrate that different aspects of the sensory experience can be individually decoded from intracortically recorded human neural signals across the cortical sensory network. Activity underlying these unique sensory representations may inform the stimulation parameters for precisely eliciting specific sensations via ICMS in future work.SIGNIFICANCE STATEMENT Electrical stimulation of human cortex is increasingly more common for providing feedback in neural devices. Understanding the relationship between naturally evoked and artificially evoked neurophysiology for the same sensations will be important in advancing such devices. Here, we investigate the neural activity in human primary somatosensory, premotor, and parietal cortices during somatosensory imagery. The sensations imagined were those previously elicited during intracortical microstimulation (ICMS) of the same somatosensory electrode array. We elucidate the neural features during somatosensory imagery that significantly encode different aspects of individual sensations and demonstrate feature stability over almost a year. The correspondence between neurophysiology elicited with or without stimulation for the same sensations will inform methods to deliver more precise feedback through stimulation in the future.

Proprioceptive and cutaneous sensations in humans elicited by intracortical microstimulation.

Pioneering work with nonhuman primates and recent human studies established intracortical microstimulation (ICMS) in primary somatosensory cortex (S1) as a method of inducing discriminable artificial sensation. However, these artificial sensations do not yet provide the breadth of cutaneous and proprioceptive percepts available through natural stimulation. In a tetraplegic human with two microelectrode arrays implanted in S1, we report replicable elicitations of sensations in both the cutaneous and proprioceptive modalities localized to the contralateral arm, dependent on both amplitude and frequency of stimulation. Furthermore, we found a subset of electrodes that exhibited multimodal properties, and that proprioceptive percepts on these electrodes were associated with higher amplitudes, irrespective of the frequency. These novel results demonstrate the ability to provide naturalistic percepts through ICMS that can more closely mimic the body's natural physiological capabilities. Furthermore, delivering both cutaneous and proprioceptive sensations through artificial somatosensory feedback could improve performance and embodiment in brain-machine interfaces.

Ownership and Agency of an Independent Supernumerary Hand Induced by an Imitation Brain-Computer Interface.

To study body ownership and control, illusions that elicit these feelings in non-body objects are widely used. Classically introduced with the Rubber Hand Illusion, these illusions have been replicated more recently in virtual reality and by using brain-computer interfaces. Traditionally these illusions investigate the replacement of a body part by an artificial counterpart, however as brain-computer interface research develops it offers us the possibility to explore the case where non-body objects are controlled in addition to movements of our own limbs. Therefore we propose a new illusion designed to test the feeling of ownership and control of an independent supernumerary hand. Subjects are under the impression they control a virtual reality hand via a brain-computer interface, but in reality there is no causal connection between brain activity and virtual hand movement but correct movements are observed with 80% probability. These imitation brain-computer interface trials are interspersed with movements in both the subjects' real hands, which are in view throughout the experiment. We show that subjects develop strong feelings of ownership and control over the third hand, despite only receiving visual feedback with no causal link to the actual brain signals. Our illusion is crucially different from previously reported studies as we demonstrate independent ownership and control of the third hand without loss of ownership in the real hands.