Distributed functions of prefrontal and parietal cortices during sequential categorical decisions.

Comparing sequential stimuli is crucial for guiding complex behaviors. To understand mechanisms underlying sequential decisions, we compared neuronal responses in the prefrontal cortex (PFC), the lateral intraparietal (LIP), and medial intraparietal (MIP) areas in monkeys trained to decide whether sequentially presented stimuli were from matching (M) or nonmatching (NM) categories. We found that PFC leads M/NM decisions, whereas LIP and MIP appear more involved in stimulus evaluation and motor planning, respectively. Compared to LIP, PFC showed greater nonlinear integration of currently visible and remembered stimuli, which correlated with the monkeys' M/NM decisions. Furthermore, multi-module recurrent networks trained on the same task exhibited key features of PFC and LIP encoding, including nonlinear integration in the PFC-like module, which was causally involved in the networks' decisions. Network analysis found that nonlinear units have stronger and more widespread connections with input, output, and within-area units, indicating putative circuit-level mechanisms for sequential decisions.

Mice Preferentially Use Increases in Cerebral Cortex Spiking to Detect Changes in Visual Stimuli.

Whenever the retinal image changes, some neurons in visual cortex increase their rate of firing whereas others decrease their rate of firing. Linking specific sets of neuronal responses with perception and behavior is essential for understanding mechanisms of neural circuit computation. We trained mice of both sexes to perform visual detection tasks and used optogenetic perturbations to increase or decrease neuronal spiking primary visual cortex (V1). Perceptual reports were always enhanced by increments in V1 spike counts and impaired by decrements, even when increments and decrements in spiking were generated in the same neuronal populations. Moreover, detecting changes in cortical activity depended on spike count integration rather than instantaneous changes in spiking. Recurrent neural networks trained in the task similarly relied on increments in neuronal activity when activity has costs. This work clarifies neuronal decoding strategies used by cerebral cortex to translate cortical spiking into percepts that can be used to guide behavior.SIGNIFICANCE STATEMENT Visual responses in the primary visual cortex (V1) are diverse, in that neurons can be either excited or inhibited by the onset of a visual stimulus. We selectively potentiated or suppressed V1 spiking in mice while they performed contrast change detection tasks. In other experiments, excitation or inhibition was delivered to V1 independent of visual stimuli. Mice readily detected increases in V1 spiking while equivalent reductions in V1 spiking suppressed the probability of detection, even when increases and decreases in V1 spiking were generated in the same neuronal populations. Our data raise the striking possibility that only increments in spiking are used to render information to structures downstream of V1.

Neuronal BIN1 Regulates Presynaptic Neurotransmitter Release and Memory Consolidation.

BIN1, a member of the BAR adaptor protein family, is a significant late-onset Alzheimer disease risk factor. Here, we investigate BIN1 function in the brain using conditional knockout (cKO) models. Loss of neuronal Bin1 expression results in the select impairment of spatial learning and memory. Examination of hippocampal CA1 excitatory synapses reveals a deficit in presynaptic release probability and slower depletion of neurotransmitters during repetitive stimulation, suggesting altered vesicle dynamics in Bin1 cKO mice. Super-resolution and immunoelectron microscopy localizes BIN1 to presynaptic sites in excitatory synapses. Bin1 cKO significantly reduces synapse density and alters presynaptic active zone protein cluster formation. Finally, 3D electron microscopy reconstruction analysis uncovers a significant increase in docked and reserve pools of synaptic vesicles at hippocampal synapses in Bin1 cKO mice. Our results demonstrate a non-redundant role for BIN1 in presynaptic regulation, thus providing significant insights into the fundamental function of BIN1 in synaptic physiology relevant to Alzheimer disease.

Reevaluating the Role of Persistent Neural Activity in Short-Term Memory.

A traditional view of short-term working memory (STM) is that task-relevant information is maintained 'online' in persistent spiking activity. However, recent experimental and modeling studies have begun to question this long-held belief. In this review, we discuss new evidence demonstrating that information can be 'silently' maintained via short-term synaptic plasticity (STSP) without the need for persistent activity. We discuss how the neural mechanisms underlying STM are inextricably linked with the cognitive demands of the task, such that the passive maintenance and the active manipulation of information are subserved differently in the brain. Together, these recent findings point towards a more nuanced view of STM in which multiple substrates work in concert to support our ability to temporarily maintain and manipulate information.

Circuit mechanisms for the maintenance and manipulation of information in working memory.

Recently it has been proposed that information in working memory (WM) may not always be stored in persistent neuronal activity but can be maintained in 'activity-silent' hidden states, such as synaptic efficacies endowed with short-term synaptic plasticity. To test this idea computationally, we investigated recurrent neural network models trained to perform several WM-dependent tasks, in which WM representation emerges from learning and is not a priori assumed to depend on self-sustained persistent activity. We found that short-term synaptic plasticity can support the short-term maintenance of information, provided that the memory delay period is sufficiently short. However, in tasks that require actively manipulating information, persistent activity naturally emerges from learning, and the amount of persistent activity scales with the degree of manipulation required. These results shed insight into the current debate on WM encoding and suggest that persistent activity can vary markedly between short-term memory tasks with different cognitive demands.

Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilization.

Humans and most animals can learn new tasks without forgetting old ones. However, training artificial neural networks (ANNs) on new tasks typically causes them to forget previously learned tasks. This phenomenon is the result of "catastrophic forgetting," in which training an ANN disrupts connection weights that were important for solving previous tasks, degrading task performance. Several recent studies have proposed methods to stabilize connection weights of ANNs that are deemed most important for solving a task, which helps alleviate catastrophic forgetting. Here, drawing inspiration from algorithms that are believed to be implemented in vivo, we propose a complementary method: adding a context-dependent gating signal, such that only sparse, mostly nonoverlapping patterns of units are active for any one task. This method is easy to implement, requires little computational overhead, and allows ANNs to maintain high performance across large numbers of sequentially presented tasks, particularly when combined with weight stabilization. We show that this method works for both feedforward and recurrent network architectures, trained using either supervised or reinforcement-based learning. This suggests that using multiple, complementary methods, akin to what is believed to occur in the brain, can be a highly effective strategy to support continual learning.

Mnemonic Encoding and Cortical Organization in Parietal and Prefrontal Cortices.

Persistent activity within the frontoparietal network is consistently observed during tasks that require working memory. However, the neural circuit mechanisms underlying persistent neuronal encoding within this network remain unresolved. Here, we ask how neural circuits support persistent activity by examining population recordings from posterior parietal (PPC) and prefrontal (PFC) cortices in two male monkeys that performed spatial and motion direction-based tasks that required working memory. While spatially selective persistent activity was observed in both areas, robust selective persistent activity for motion direction was only observed in PFC. Crucially, we find that this difference between mnemonic encoding in PPC and PFC is associated with the presence of functional clustering: PPC and PFC neurons up to ∼700 µm apart preferred similar spatial locations, and PFC neurons up to ∼700 µm apart preferred similar motion directions. In contrast, motion-direction tuning similarity between nearby PPC neurons was much weaker and decayed rapidly beyond ∼200 µm. We also observed a similar association between persistent activity and functional clustering in trained recurrent neural network models embedded with a columnar topology. These results suggest that functional clustering facilitates mnemonic encoding of sensory information.SIGNIFICANCE STATEMENT Working memory refers to our ability to temporarily store and manipulate information. Numerous studies have observed that, during working memory, neurons in higher cortical areas, such as the parietal and prefrontal cortices, mnemonically encode the remembered stimulus. However, several recent studies have failed to observe mnemonic encoding during working memory, raising the question as to why mnemonic encoding is observed during some, but not all, conditions. In this study, we show that mnemonic encoding occurs when a cortical area is organized such that nearby neurons preferentially respond to the same stimulus. This result provides plausible neuronal conditions that allow for mnemonic encoding, and gives us further understanding of the brain's mechanisms that support working memory.

Task-specific versus generalized mnemonic representations in parietal and prefrontal cortices.

Our ability to learn a wide range of behavioral tasks is essential for responding appropriately to sensory stimuli according to behavioral demands, but the underlying neural mechanism has been rarely examined by neurophysiological recordings in the same subjects across learning. To understand how learning new behavioral tasks affects neuronal representations, we recorded from posterior parietal cortex (PPC) before and after training on a visual motion categorization task. We found that categorization training influenced cognitive encoding in PPC, with a marked enhancement of memory-related delay-period encoding during the categorization task that was absent during a motion discrimination task before categorization training. In contrast, the prefrontal cortex (PFC) exhibited strong delay-period encoding during both discrimination and categorization tasks. This reveals a dissociation between PFC's and PPC's roles in working memory, with general engagement of PFC across multiple tasks, in contrast with more task-specific mnemonic encoding in PPC.

Virtual typing by people with tetraplegia using a self-calibrating intracortical brain-computer interface.

Brain-computer interfaces (BCIs) promise to restore independence for people with severe motor disabilities by translating decoded neural activity directly into the control of a computer. However, recorded neural signals are not stationary (that is, can change over time), degrading the quality of decoding. Requiring users to pause what they are doing whenever signals change to perform decoder recalibration routines is time-consuming and impractical for everyday use of BCIs. We demonstrate that signal nonstationarity in an intracortical BCI can be mitigated automatically in software, enabling long periods (hours to days) of self-paced point-and-click typing by people with tetraplegia, without degradation in neural control. Three key innovations were included in our approach: tracking the statistics of the neural activity during self-timed pauses in neural control, velocity bias correction during neural control, and periodically recalibrating the decoder using data acquired during typing by mapping neural activity to movement intentions that are inferred retrospectively based on the user's self-selected targets. These methods, which can be extended to a variety of neurally controlled applications, advance the potential for intracortical BCIs to help restore independent communication and assistive device control for people with paralysis.

Reprint of "Non-causal spike filtering improves decoding of movement intention for intracortical BCIs".

BACKGROUND: Multiple types of neural signals are available for controlling assistive devices through brain-computer interfaces (BCIs). Intracortically recorded spiking neural signals are attractive for BCIs because they can in principle provide greater fidelity of encoded information compared to electrocorticographic (ECoG) signals and electroencephalograms (EEGs). Recent reports show that the information content of these spiking neural signals can be reliably extracted simply by causally band-pass filtering the recorded extracellular voltage signals and then applying a spike detection threshold, without relying on "sorting" action potentials. NEW METHOD: We show that replacing the causal filter with an equivalent non-causal filter increases the information content extracted from the extracellular spiking signal and improves decoding of intended movement direction. This method can be used for real-time BCI applications by using a 4ms lag between recording and filtering neural signals. RESULTS: Across 18 sessions from two people with tetraplegia enrolled in the BrainGate2 pilot clinical trial, we found that threshold crossing events extracted using this non-causal filtering method were significantly more informative of each participant's intended cursor kinematics compared to threshold crossing events derived from causally filtered signals. This new method decreased the mean angular error between the intended and decoded cursor direction by 9.7° for participant S3, who was implanted 5.4 years prior to this study, and by 3.5° for participant T2, who was implanted 3 months prior to this study. CONCLUSIONS: Non-causally filtering neural signals prior to extracting threshold crossing events may be a simple yet effective way to condition intracortically recorded neural activity for direct control of external devices through BCIs.

Neural Point-and-Click Communication by a Person With Incomplete Locked-In Syndrome.

A goal of brain-computer interface research is to develop fast and reliable means of communication for individuals with paralysis and anarthria. We evaluated the ability of an individual with incomplete locked-in syndrome enrolled in the BrainGate Neural Interface System pilot clinical trial to communicate using neural point-and-click control. A general-purpose interface was developed to provide control of a computer cursor in tandem with one of two on-screen virtual keyboards. The novel BrainGate Radial Keyboard was compared to a standard QWERTY keyboard in a balanced copy-spelling task. The Radial Keyboard yielded a significant improvement in typing accuracy and speed-enabling typing rates over 10 correct characters per minute. The participant used this interface to communicate face-to-face with research staff by using text-to-speech conversion, and remotely using an internet chat application. This study demonstrates the first use of an intracortical brain-computer interface for neural point-and-click communication by an individual with incomplete locked-in syndrome.

Non-causal spike filtering improves decoding of movement intention for intracortical BCIs.

BACKGROUND: Multiple types of neural signals are available for controlling assistive devices through brain-computer interfaces (BCIs). Intracortically recorded spiking neural signals are attractive for BCIs because they can in principle provide greater fidelity of encoded information compared to electrocorticographic (ECoG) signals and electroencephalograms (EEGs). Recent reports show that the information content of these spiking neural signals can be reliably extracted simply by causally band-pass filtering the recorded extracellular voltage signals and then applying a spike detection threshold, without relying on "sorting" action potentials. NEW METHOD: We show that replacing the causal filter with an equivalent non-causal filter increases the information content extracted from the extracellular spiking signal and improves decoding of intended movement direction. This method can be used for real-time BCI applications by using a 4ms lag between recording and filtering neural signals. RESULTS: Across 18 sessions from two people with tetraplegia enrolled in the BrainGate2 pilot clinical trial, we found that threshold crossing events extracted using this non-causal filtering method were significantly more informative of each participant's intended cursor kinematics compared to threshold crossing events derived from causally filtered signals. This new method decreased the mean angular error between the intended and decoded cursor direction by 9.7° for participant S3, who was implanted 5.4 years prior to this study, and by 3.5° for participant T2, who was implanted 3 months prior to this study. CONCLUSIONS: Non-causally filtering neural signals prior to extracting threshold crossing events may be a simple yet effective way to condition intracortically recorded neural activity for direct control of external devices through BCIs.

A comparison of lateral and medial intraparietal areas during a visual categorization task.

Categorization is essential for interpreting sensory stimuli and guiding our actions. Recent studies have revealed robust neuronal category representations in the lateral intraparietal area (LIP). Here, we examine the specialization of LIP for categorization and the roles of other parietal areas by comparing LIP and the medial intraparietal area (MIP) during a visual categorization task. MIP is involved in goal-directed arm movements and visuomotor coordination but has not been implicated in non-motor cognitive functions, such as categorization. As expected, we found strong category encoding in LIP. Interestingly, we also observed category signals in MIP. However, category signals were stronger and appeared with a shorter latency in LIP than MIP. In this task, monkeys indicated whether a test stimulus was a category match to a previous sample with a manual response. Test-period activity in LIP showed category encoding and distinguished between matches and non-matches. In contrast, MIP primarily reflected the match/non-match status of test stimuli, with a strong preference for matches (which required a motor response). This suggests that, although category representations are distributed across parietal cortex, LIP and MIP play distinct roles: LIP appears more involved in the categorization process itself, whereas MIP is more closely tied to decision-related motor actions.

Advantages of closed-loop calibration in intracortical brain-computer interfaces for people with tetraplegia.

OBJECTIVE: Brain-computer interfaces (BCIs) aim to provide a means for people with severe motor disabilities to control their environment directly with neural activity. In intracortical BCIs for people with tetraplegia, the decoder that maps neural activity to desired movements has typically been calibrated using 'open-loop' (OL) imagination of control while a cursor automatically moves to targets on a computer screen. However, because neural activity can vary across contexts, a decoder calibrated using OL data may not be optimal for 'closed-loop' (CL) neural control. Here, we tested whether CL calibration creates a better decoder than OL calibration even when all other factors that might influence performance are held constant, including the amount of data used for calibration and the amount of elapsed time between calibration and testing. APPROACH: Two people with tetraplegia enrolled in the BrainGate2 pilot clinical trial performed a center-out-back task using an intracortical BCI, switching between decoders that had been calibrated on OL versus CL data. MAIN RESULTS: Even when all other variables were held constant, CL calibration improved neural control as well as the accuracy and strength of the tuning model. Updating the CL decoder using additional and more recent data resulted in further improvements. SIGNIFICANCE: Differences in neural activity between OL and CL contexts contribute to the superiority of CL decoders, even prior to their additional 'adaptive' advantage. In the near future, CL decoder calibration may enable robust neural control without needing to pause ongoing, practical use of BCIs, an important step toward clinical utility.

A mutual information approach to automate identification of neuronal clusters in Drosophila brain images.

Mapping neural circuits can be accomplished by labeling a small number of neural structures per brain, and then combining these structures across multiple brains. This sparse labeling method has been particularly effective in Drosophila melanogaster, where clonally related clusters of neurons derived from the same neural stem cell (neuroblast clones) are functionally related and morphologically highly stereotyped across animals. However identifying these neuroblast clones (approximately 180 per central brain hemisphere) manually remains challenging and time consuming. Here, we take advantage of the stereotyped nature of neural circuits in Drosophila to identify clones automatically, requiring manual annotation of only an initial, smaller set of images. Our procedure depends on registration of all images to a common template in conjunction with an image processing pipeline that accentuates and segments neural projections and cell bodies. We then measure how much information the presence of a cell body or projection at a particular location provides about the presence of each clone. This allows us to select a highly informative set of neuronal features as a template that can be used to detect the presence of clones in novel images. The approach is not limited to a specific labeling strategy and can be used to identify partial (e.g., individual neurons) as well as complete matches. Furthermore this approach could be generalized to studies of neural circuits in other organisms.

Spatial attention enhances the selective integration of activity from area MT.

Distinguishing which of the many proposed neural mechanisms of spatial attention actually underlies behavioral improvements in visually guided tasks has been difficult. One attractive hypothesis is that attention allows downstream neural circuits to selectively integrate responses from the most informative sensory neurons. This would allow behavioral performance to be based on the highest-quality signals available in visual cortex. We examined this hypothesis by asking how spatial attention affects both the stimulus sensitivity of middle temporal (MT) neurons and their corresponding correlation with behavior. Analyzing a data set pooled from two experiments involving four monkeys, we found that spatial attention did not appreciably affect either the stimulus sensitivity of the neurons or the correlation between their activity and behavior. However, for those sessions in which there was a robust behavioral effect of attention, focusing attention inside the neuron's receptive field significantly increased the correlation between these two metrics, an indication of selective integration. These results suggest that, similar to mechanisms proposed for the neural basis of perceptual learning, the behavioral benefits of focusing spatial attention are attributable to selective integration of neural activity from visual cortical areas by their downstream targets.

Reach and grasp by people with tetraplegia using a neurally controlled robotic arm.

Paralysis following spinal cord injury, brainstem stroke, amyotrophic lateral sclerosis and other disorders can disconnect the brain from the body, eliminating the ability to perform volitional movements. A neural interface system could restore mobility and independence for people with paralysis by translating neuronal activity directly into control signals for assistive devices. We have previously shown that people with long-standing tetraplegia can use a neural interface system to move and click a computer cursor and to control physical devices. Able-bodied monkeys have used a neural interface system to control a robotic arm, but it is unknown whether people with profound upper extremity paralysis or limb loss could use cortical neuronal ensemble signals to direct useful arm actions. Here we demonstrate the ability of two people with long-standing tetraplegia to use neural interface system-based control of a robotic arm to perform three-dimensional reach and grasp movements. Participants controlled the arm and hand over a broad space without explicit training, using signals decoded from a small, local population of motor cortex (MI) neurons recorded from a 96-channel microelectrode array. One of the study participants, implanted with the sensor 5 years earlier, also used a robotic arm to drink coffee from a bottle. Although robotic reach and grasp actions were not as fast or accurate as those of an able-bodied person, our results demonstrate the feasibility for people with tetraplegia, years after injury to the central nervous system, to recreate useful multidimensional control of complex devices directly from a small sample of neural signals.

Behavioral time course of microstimulation in cortical area MT.

Electrical stimulation of the brain is a valuable research tool and has shown therapeutic promise in the development of new sensory neural prosthetics. Despite its widespread use, we still do not fully understand how current passed through a microelectrode interacts with functioning neural circuits. Past behavioral studies have suggested that weak electrical stimulation (referred to as microstimulation) of sensory areas of cortex produces percepts that are similar to those generated by normal sensory stimuli. In contrast, electrophysiological studies using in vitro or anesthetized preparations have shown that neural activity produced by brief microstimulation is radically different and longer lasting than normal responses. To help reconcile these two aspects of microstimulation, we examined the temporal properties that microstimulation has on visual perception. We found that brief application of subthreshold microstimulation in the middle temporal (MT) area of visual cortex produced smaller and longer-lasting effects on motion perception compared with an equivalent visual stimulus. In agreement with past electrophysiological studies, a computer simulation reproduced our behavioral effects when the time course of a single microstimulation pulse was modeled with three components: an immediate fast strong excitatory component, followed by a weaker inhibitory component, and then followed by a long duration weak excitatory component. Overall, these results suggest the behavioral effects of microstimulation in our experiments were caused by the unique and long-lasting temporal effects microstimulation has on functioning cortical circuits.

Olfactory information processing in Drosophila.

In both insect and vertebrate olfactory systems only two synapses separate the sensory periphery from brain areas required for memory formation and the organisation of behaviour. In the Drosophila olfactory system, which is anatomically very similar to its vertebrate counterpart, there has been substantial recent progress in understanding the flow of information from experiments using molecular genetic, electrophysiological and optical imaging techniques. In this review, we shall focus on how olfactory information is processed and transformed in order to extract behaviourally relevant information. We follow the progress from olfactory receptor neurons, through the first processing area, the antennal lobe, to higher olfactory centres. We address both the underlying anatomy and mechanisms that govern the transformation of neural activity. We emphasise our emerging understanding of how different elementary computations, including signal averaging, gain control, decorrelation and integration, may be mapped onto different circuit elements.