Design-development of an at-home modular brain-computer interface (BCI) platform in a case study of cervical spinal cord injury.

OBJECTIVE: The objective of this study was to develop a portable and modular brain-computer interface (BCI) software platform independent of input and output devices. We implemented this platform in a case study of a subject with cervical spinal cord injury (C5 ASIA A). BACKGROUND: BCIs can restore independence for individuals with paralysis by using brain signals to control prosthetics or trigger functional electrical stimulation. Though several studies have successfully implemented this technology in the laboratory and the home, portability, device configuration, and caregiver setup remain challenges that limit deployment to the home environment. Portability is essential for transitioning BCI from the laboratory to the home. METHODS: The BCI platform implementation consisted of an Activa PC + S generator with two subdural four-contact electrodes implanted over the dominant left hand-arm region of the sensorimotor cortex, a minicomputer fixed to the back of the subject's wheelchair, a custom mobile phone application, and a mechanical glove as the end effector. To quantify the performance for this at-home implementation of the BCI, we quantified system setup time at home, chronic (14-month) decoding accuracy, hardware and software profiling, and Bluetooth communication latency between the App and the minicomputer. We created a dataset of motor-imagery labeled signals to train a binary motor imagery classifier on a remote computer for online, at-home use. RESULTS: Average bluetooth data transmission delay between the minicomputer and mobile App was 23 ± 0.014 ms. The average setup time for the subject's caregiver was 5.6 ± 0.83 min. The average times to acquire and decode neural signals and to send those decoded signals to the end-effector were respectively 404.1 ms and 1.02 ms. The 14-month median accuracy of the trained motor imagery classifier was 87.5 ± 4.71% without retraining. CONCLUSIONS: The study presents the feasibility of an at-home BCI system that subjects can seamlessly operate using a friendly mobile user interface, which does not require daily calibration nor the presence of a technical person for at-home setup. The study also describes the portability of the BCI system and the ability to plug-and-play multiple end effectors, providing the end-user the flexibility to choose the end effector to accomplish specific motor tasks for daily needs. Trial registration ClinicalTrials.gov: NCT02564419. First posted on 9/30/2015.

Brain-Computer interface control of stepping from invasive electrocorticography upper-limb motor imagery in a patient with quadriplegia.

Introduction: Most spinal cord injuries (SCI) result in lower extremities paralysis, thus diminishing ambulation. Using brain-computer interfaces (BCI), patients may regain leg control using neural signals that actuate assistive devices. Here, we present a case of a subject with cervical SCI with an implanted electrocorticography (ECoG) device and determined whether the system is capable of motor-imagery-initiated walking in an assistive ambulator. Methods: A 24-year-old male subject with cervical SCI (C5 ASIA A) was implanted before the study with an ECoG sensing device over the sensorimotor hand region of the brain. The subject used motor-imagery (MI) to train decoders to classify sensorimotor rhythms. Fifteen sessions of closed-loop trials followed in which the subject ambulated for one hour on a robotic-assisted weight-supported treadmill one to three times per week. We evaluated the stability of the best-performing decoder over time to initiate walking on the treadmill by decoding upper-limb (UL) MI. Results: An online bagged trees classifier performed best with an accuracy of 84.15% averaged across 9 weeks. Decoder accuracy remained stable following throughout closed-loop data collection. Discussion: These results demonstrate that decoding UL MI is a feasible control signal for use in lower-limb motor control. Invasive BCI systems designed for upper-extremity motor control can be extended for controlling systems beyond upper extremity control alone. Importantly, the decoders used were able to use the invasive signal over several weeks to accurately classify MI from the invasive signal. More work is needed to determine the long-term consequence between UL MI and the resulting lower-limb control.

Implantable brain-computer interface for neuroprosthetic-enabled volitional hand grasp restoration in spinal cord injury.

Loss of hand function after cervical spinal cord injury severely impairs functional independence. We describe a method for restoring volitional control of hand grasp in one 21-year-old male subject with complete cervical quadriplegia (C5 American Spinal Injury Association Impairment Scale A) using a portable fully implanted brain-computer interface within the home environment. The brain-computer interface consists of subdural surface electrodes placed over the dominant-hand motor cortex and connects to a transmitter implanted subcutaneously below the clavicle, which allows continuous reading of the electrocorticographic activity. Movement-intent was used to trigger functional electrical stimulation of the dominant hand during an initial 29-weeks laboratory study and subsequently via a mechanical hand orthosis during in-home use. Movement-intent information could be decoded consistently throughout the 29-weeks in-laboratory study with a mean accuracy of 89.0% (range 78-93.3%). Improvements were observed in both the speed and accuracy of various upper extremity tasks, including lifting small objects and transferring objects to specific targets. At-home decoding accuracy during open-loop trials reached an accuracy of 91.3% (range 80-98.95%) and an accuracy of 88.3% (range 77.6-95.5%) during closed-loop trials. Importantly, the temporal stability of both the functional outcomes and decoder metrics were not explored in this study. A fully implanted brain-computer interface can be safely used to reliably decode movement-intent from motor cortex, allowing for accurate volitional control of hand grasp.

Chronic recordings from the marmoset motor cortex reveals modulation of neural firing and local field potentials overlap with macaques.

Objective.The common marmoset has been increasingly used in neural interfacing studies due to its smaller size, easier handling, and faster breeding compared to Old World non-human primate (NHP) species. While assessment of cortical anatomy in marmosets has shown strikingly similar layout to macaques, comprehensive assessment of electrophysiological properties underlying forelimb reaching movements in this bridge species does not exist. The objective of this study is to characterize electrophysiological properties of signals recorded from the marmoset primary motor cortex (M1) during a reach task and compare with larger NHP models such that this smaller NHP model can be used in behavioral neural interfacing studies.Approach and main results.Neuronal firing rates and local field potentials (LFPs) were chronically recorded from M1 in three adult, male marmosets. Firing rates, mu + beta and high gamma frequency bands of LFPs were evaluated for modulation with respect to movement. Firing rate and regularity of neurons of the marmoset M1 were similar to that reported in macaques with a subset of neurons showing selectivity to movement direction. Movement phases (rest vs move) was classified from both neural spiking and LFPs. Microelectrode arrays provide the ability to sample small regions of the motor cortex to drive brain-machine interfaces (BMIs). The results demonstrate that marmosets are a robust bridge species for behavioral neuroscience studies with motor cortical electrophysiological signals recorded from microelectrode arrays that are similar to Old World NHPs.Significance. As marmosets represent an interesting step between rodent and macaque models, successful demonstration that neuron modulation in marmoset motor cortex is analogous to reports in macaques illustrates the utility of marmosets as a viable species for BMI studies.

Spinal cord neural interfacing in common marmosets (Callithrix jacchus).

OBJECTIVE: Spinal cord injury remains an ailment with no comprehensive cure, and affected patients suffer from a greatly diminished quality of life. This large population could significantly benefit from prosthetic technologies to replace missing limbs, reanimate nonfunctional limbs, and enable new modes of technologies to restore muscle control and function. While cortically driven brain machine interfaces have achieved great success in interfacing with an external device to restore lost functions, interfacing with the spinal cord can provide an additional site to record motor control signals, which can have its own advantages, despite challenges from using a smaller non-human primate (NHP) model. The goal of this study is to develop such a spinal cord neural interface to record motor signals from the high cervical levels of the spinal cord in a common marmoset (Callithrix jacchus) model. Approach and main results. Detailed methods are discussed for this smaller NHP model that includes behavioral training, surgical methods for electrode placement, connector placement and wire handling, electrode specifications and modifications for accessing high cervical level interneurons and motorneurons. The study also discusses the methods and challenges involved in behavioral multi-channel extracellular recording from the marmoset spinal cord, including the major recording failure mechanisms encountered during the study. SIGNIFICANCE: Marmosets provide a good step between rodent and larger NHP models due to their small size, ease of handling, cognitive abilities, and similarities to other primate motor systems. The study shows the feasibility of recording spinal cord signals and using marmosets as a smaller NHP model in behavioral neuroscience studies. Interfacing with the spinal cord in chronically implanted animals can provide useful information about how motor control signals within the spinal cord are transformed to cause limb movements.

Long-term stability of neural signals from microwire arrays implanted in common marmoset motor cortex and striatum.

Current neuroprosthetics rely on stable, high quality recordings from chronically implanted microelectrode arrays (MEAs) in neural tissue. While chronic electrophysiological recordings and electrode failure modes have been reported from rodent and larger non-human primate (NHP) models, chronic recordings from the marmoset model have not been previously described. The common marmoset is a New World primate that is easier to breed and handle compared to larger NHPs and has a similarly organized brain, making it a potentially useful smaller NHP model for neuroscience studies. This study reports recording stability and signal quality of MEAs chronically implanted in behaving marmosets. Six adult male marmosets, trained for reaching tasks, were implanted with either a 16-channel tungsten microwire array (five animals) or a Pt-Ir floating MEA (one animal) in the hand-arm region of the primary motor cortex (M1) and another MEA in the striatum targeting the nucleus accumbens (NAcc). Signal stability and quality was quantified as a function of array yield (active electrodes that recorded action potentials), neuronal yield (isolated single units during a recording session), and signal-to-noise ratio (SNR). Out of 11 implanted MEAs, nine provided functional recordings for at least three months, with two arrays functional for 10 months. In general, implants had high yield, which remained stable for up to several months. However, mechanical failure attributed to MEA connector was the most common failure mode. In the longest implants, signal degradation occurred, which was characterized by gradual decline in array yield, reduced number of isolated single units, and changes in waveform shape of action potentials. This work demonstrates the feasibility of longterm recordings from MEAs implanted in cortical and deep brain structures in the marmoset model. The ability to chronically record cortical signals for neural prosthetics applications in the common marmoset extends the potential of this model in neural interface research.

Common marmoset (Callithrix jacchus) as a primate model for behavioral neuroscience studies.

BACKGROUND: The common marmoset (Callithrix jacchus) has been proposed as a suitable bridge between rodents and larger primates. They have been used in several types of research including auditory, vocal, visual, pharmacological and genetics studies. However, marmosets have not been used as much for behavioral studies. NEW METHOD: Here we present data from training 12 adult marmosets for behavioral neuroscience studies. We discuss the husbandry, food preferences, handling, acclimation to laboratory environments and neurosurgical techniques. In this paper, we also present a custom built "scoop" and a monkey chair suitable for training of these animals. RESULTS: The animals were trained for three tasks: 4 target center-out reaching task, reaching tasks that involved controlling robot actions, and touch screen task. All animals learned the center-out reaching task within 1-2 weeks whereas learning reaching tasks controlling robot actions task took several months of behavioral training where the monkeys learned to associate robot actions with food rewards. COMPARISON TO EXISTING METHOD: We propose the marmoset as a novel model for behavioral neuroscience research as an alternate for larger primate models. This is due to the ease of handling, quick reproduction, available neuroanatomy, sensorimotor system similar to larger primates and humans, and a lissencephalic brain that can enable implantation of microelectrode arrays relatively easier at various cortical locations compared to larger primates. CONCLUSION: All animals were able to learn behavioral tasks well and we present the marmosets as an alternate model for simple behavioral neuroscience tasks.

Feedback for reinforcement learning based brain-machine interfaces using confidence metrics.

OBJECTIVE: For brain-machine interfaces (BMI) to be used in activities of daily living by paralyzed individuals, the BMI should be as autonomous as possible. One of the challenges is how the feedback is extracted and utilized in the BMI. Our long-term goal is to create autonomous BMIs that can utilize an evaluative feedback from the brain to update the decoding algorithm and use it intelligently in order to adapt the decoder. In this study, we show how to extract the necessary evaluative feedback from a biologically realistic (synthetic) source, use both the quantity and the quality of the feedback, and how that feedback information can be incorporated into a reinforcement learning (RL) controller architecture to maximize its performance. APPROACH: Motivated by the perception-action-reward cycle (PARC) in the brain which links reward for cognitive decision making and goal-directed behavior, we used a reward-based RL architecture named Actor-Critic RL as the model. Instead of using an error signal towards building an autonomous BMI, we envision to use a reward signal from the nucleus accumbens (NAcc) which plays a key role in the linking of reward to motor behaviors. To deal with the complexity and non-stationarity of biological reward signals, we used a confidence metric which was used to indicate the degree of feedback accuracy. This confidence was added to the Actor's weight update equation in the RL controller architecture. If the confidence was high (>0.2), the BMI decoder used this feedback to update its parameters. However, when the confidence was low, the BMI decoder ignored the feedback and did not update its parameters. The range between high confidence and low confidence was termed as the 'ambiguous' region. When the feedback was within this region, the BMI decoder updated its weight at a lower rate than when fully confident, which was decided by the confidence. We used two biologically realistic models to generate synthetic data for MI (Izhikevich model) and NAcc (Humphries model) to validate proposed controller architecture. MAIN RESULTS: In this work, we show how the overall performance of the BMI was improved by using a threshold close to the decision boundary to reject erroneous feedback. Additionally, we show the stability of the system improved when the feedback was used with a threshold. SIGNIFICANCE: The result of this study is a step towards making BMIs autonomous. While our method is not fully autonomous, the results demonstrate that extensive training times necessary at the beginning of each BMI session can be significantly decreased. In our approach, decoder training time was only limited to 10 trials in the first BMI session. Subsequent sessions used previous session weights to initialize the decoder. We also present a method where the use of a threshold can be applied to any decoder with a feedback signal that is less than perfect so that erroneous feedback can be avoided and the stability of the system can be increased.

A confidence metric for using neurobiological feedback in actor-critic reinforcement learning based brain-machine interfaces.

Brain-Machine Interfaces (BMIs) can be used to restore function in people living with paralysis. Current BMIs require extensive calibration that increase the set-up times and external inputs for decoder training that may be difficult to produce in paralyzed individuals. Both these factors have presented challenges in transitioning the technology from research environments to activities of daily living (ADL). For BMIs to be seamlessly used in ADL, these issues should be handled with minimal external input thus reducing the need for a technician/caregiver to calibrate the system. Reinforcement Learning (RL) based BMIs are a good tool to be used when there is no external training signal and can provide an adaptive modality to train BMI decoders. However, RL based BMIs are sensitive to the feedback provided to adapt the BMI. In actor-critic BMIs, this feedback is provided by the critic and the overall system performance is limited by the critic accuracy. In this work, we developed an adaptive BMI that could handle inaccuracies in the critic feedback in an effort to produce more accurate RL based BMIs. We developed a confidence measure, which indicated how appropriate the feedback is for updating the decoding parameters of the actor. The results show that with the new update formulation, the critic accuracy is no longer a limiting factor for the overall performance. We tested and validated the system onthree different data sets: synthetic data generated by an Izhikevich neural spiking model, synthetic data with a Gaussian noise distribution, and data collected from a non-human primate engaged in a reaching task. All results indicated that the system with the critic confidence built in always outperformed the system without the critic confidence. Results of this study suggest the potential application of the technique in developing an autonomous BMI that does not need an external signal for training or extensive calibration.

Using reinforcement learning to provide stable brain-machine interface control despite neural input reorganization.

Brain-machine interface (BMI) systems give users direct neural control of robotic, communication, or functional electrical stimulation systems. As BMI systems begin transitioning from laboratory settings into activities of daily living, an important goal is to develop neural decoding algorithms that can be calibrated with a minimal burden on the user, provide stable control for long periods of time, and can be responsive to fluctuations in the decoder's neural input space (e.g. neurons appearing or being lost amongst electrode recordings). These are significant challenges for static neural decoding algorithms that assume stationary input/output relationships. Here we use an actor-critic reinforcement learning architecture to provide an adaptive BMI controller that can successfully adapt to dramatic neural reorganizations, can maintain its performance over long time periods, and which does not require the user to produce specific kinetic or kinematic activities to calibrate the BMI. Two marmoset monkeys used the Reinforcement Learning BMI (RLBMI) to successfully control a robotic arm during a two-target reaching task. The RLBMI was initialized using random initial conditions, and it quickly learned to control the robot from brain states using only a binary evaluative feedback regarding whether previously chosen robot actions were good or bad. The RLBMI was able to maintain control over the system throughout sessions spanning multiple weeks. Furthermore, the RLBMI was able to quickly adapt and maintain control of the robot despite dramatic perturbations to the neural inputs, including a series of tests in which the neuron input space was deliberately halved or doubled.

Towards autonomous neuroprosthetic control using Hebbian reinforcement learning.

OBJECTIVE: Our goal was to design an adaptive neuroprosthetic controller that could learn the mapping from neural states to prosthetic actions and automatically adjust adaptation using only a binary evaluative feedback as a measure of desirability/undesirability of performance. APPROACH: Hebbian reinforcement learning (HRL) in a connectionist network was used for the design of the adaptive controller. The method combines the efficiency of supervised learning with the generality of reinforcement learning. The convergence properties of this approach were studied using both closed-loop control simulations and open-loop simulations that used primate neural data from robot-assisted reaching tasks. MAIN RESULTS: The HRL controller was able to perform classification and regression tasks using its episodic and sequential learning modes, respectively. In our experiments, the HRL controller quickly achieved convergence to an effective control policy, followed by robust performance. The controller also automatically stopped adapting the parameters after converging to a satisfactory control policy. Additionally, when the input neural vector was reorganized, the controller resumed adaptation to maintain performance. SIGNIFICANCE: By estimating an evaluative feedback directly from the user, the HRL control algorithm may provide an efficient method for autonomous adaptation of neuroprosthetic systems. This method may enable the user to teach the controller the desired behavior using only a simple feedback signal.

Feature extraction and unsupervised classification of neural population reward signals for reinforcement based BMI.

New reinforcement based paradigms for building adaptive decoders for Brain-Machine Interfaces involve using feedback directly from the brain. In this work, we investigated neuromodulation in the Nucleus Accumbens (reward center) during a multi-target reaching task and investigated how to extract a reinforcing or non-reinforcing signal that could be used to adapt a BMI decoder. One of the challenges in brain-driven adaptation is how to translate biological neuromodulation into a single binary signal from the distributed representation of the neural population, which may encode many aspects of reward. To extract these signals, feature analysis and clustering were used to identify timing and coding properties of a user's neuromodulation related to reward perception. First, Principal Component Analysis (PCA) of reward related neural signals was used to extract variance in the firing and the optimum time correlation between the neural signal and the reward phase of the task. Next, k-means clustering was used to separate data into two classes.