Constraints on persistent activity in a biologically detailed network model of the prefrontal cortex with heterogeneities.

Persistent activity, the maintenance of neural activation over short periods of time in cortical networks, is widely thought to underlie the cognitive function of working memory. A large body of modeling studies has reproduced this kind of activity using cell assemblies with strengthened synaptic connections. However, almost all of these studies have considered persistent activity within networks with homogeneous neurons and synapses, making it difficult to judge the validity of such model results for cortical dynamics, which is based on highly heterogeneous neurons. Here, we consider persistent activity in a detailed, strongly data-driven network model of the prefrontal cortex with heterogeneous neuron and synapse parameters. Surprisingly, persistent activity could not be reproduced in this model without incorporating further constraints. We identified three factors that prevent successful persistent activity: heterogeneity in the cell parameters of interneurons, heterogeneity in the parameters of short-term synaptic plasticity and heterogeneity in the synaptic weights. We also discovered a general dynamic mechanism that prevents persistent activity in the presence of heterogeneities, namely a gradual drop-out of cell assembly neurons out of a bistable regime as input variability increases. Based on this mechanism, we found that persistent activity is recovered if heterogeneity is compensated, e.g., by a homeostatic plasticity mechanism. Cell assemblies shaped in this way may be potentially targeted by distinct inputs or become more responsive to specific tuning or spectral properties. Finally, we show that persistent activity in the model is robust against external noise, but the compensation of heterogeneities may prevent the dynamic generation of intrinsic in vivo-like irregular activity. These results may help informing the ongoing debate about the neural basis of working memory.

Prefrontal oscillations modulate the propagation of neuronal activity required for working memory.

Cognition involves using attended information, maintained in working memory (WM), to guide action. During a cognitive task, a correct response requires flexible, selective gating so that only the appropriate information flows from WM to downstream effectors that carry out the response. In this work, we used biophysically-detailed modeling to explore the hypothesis that network oscillations in prefrontal cortex (PFC), leveraging local inhibition, can independently gate responses to items in WM. The key role of local inhibition was to control the period between spike bursts in the outputs, and to produce an oscillatory response no matter whether the WM item was maintained in an asynchronous or oscillatory state. We found that the WM item that induced an oscillatory population response in the PFC output layer with the shortest period between spike bursts was most reliably propagated. The network resonant frequency (i.e., the input frequency that produces the largest response) of the output layer can be flexibly tuned by varying the excitability of deep layer principal cells. Our model suggests that experimentally-observed modulation of PFC beta-frequency (15-30 Hz) and gamma-frequency (30-80 Hz) oscillations could leverage network resonance and local inhibition to govern the flexible routing of signals in service to cognitive processes like gating outputs from working memory and the selection of rule-based actions. Importantly, we show for the first time that nonspecific changes in deep layer excitability can tune the output gate's resonant frequency, enabling the specific selection of signals encoded by populations in asynchronous or fast oscillatory states. More generally, this represents a dynamic mechanism by which adjusting network excitability can govern the propagation of asynchronous and oscillatory signals throughout neocortex.

Biased competition in the absence of input bias revealed through corticostriatal computation.

Classical accounts of biased competition require an input bias to resolve the competition between neuronal ensembles driving downstream processing. However, flexible and reliable selection of behaviorally relevant ensembles can occur with unbiased stimulation: striatal D1 and D2 spiny projection neurons (SPNs) receive balanced cortical input, yet their activity determines the choice between GO and NO-GO pathways in the basal ganglia. We here present a corticostriatal model identifying three mechanisms that rely on physiological asymmetries to effect rate- and time-coded biased competition in the presence of balanced inputs. First, tonic input strength determines which one of the two SPN phenotypes exhibits a higher mean firing rate. Second, low-strength oscillatory inputs induce higher firing rate in D2 SPNs but higher coherence between D1 SPNs. Third, high-strength inputs oscillating at distinct frequencies can preferentially activate D1 or D2 SPN populations. Of these mechanisms, only the latter accommodates observed rhythmic activity supporting rule-based decision making in prefrontal cortex.

Feature-specific prediction errors and surprise across macaque fronto-striatal circuits.

To adjust expectations efficiently, prediction errors need to be associated with the precise features that gave rise to the unexpected outcome, but this credit assignment may be problematic if stimuli differ on multiple dimensions and it is ambiguous which feature dimension caused the outcome. Here, we report a potential solution: neurons in four recorded areas of the anterior fronto-striatal networks encode prediction errors that are specific to feature values of different dimensions of attended multidimensional stimuli. The most ubiquitous prediction error occurred for the reward-relevant dimension. Feature-specific prediction error signals a) emerge on average shortly after non-specific prediction error signals, b) arise earliest in the anterior cingulate cortex and later in dorsolateral prefrontal cortex, caudate and ventral striatum, and c) contribute to feature-based stimulus selection after learning. Thus, a widely-distributed feature-specific eligibility trace may be used to update synaptic weights for improved feature-based attention.

Flexible resonance in prefrontal networks with strong feedback inhibition.

Oscillations are ubiquitous features of brain dynamics that undergo task-related changes in synchrony, power, and frequency. The impact of those changes on target networks is poorly understood. In this work, we used a biophysically detailed model of prefrontal cortex (PFC) to explore the effects of varying the spike rate, synchrony, and waveform of strong oscillatory inputs on the behavior of cortical networks driven by them. Interacting populations of excitatory and inhibitory neurons with strong feedback inhibition are inhibition-based network oscillators that exhibit resonance (i.e., larger responses to preferred input frequencies). We quantified network responses in terms of mean firing rates and the population frequency of network oscillation; and characterized their behavior in terms of the natural response to asynchronous input and the resonant response to oscillatory inputs. We show that strong feedback inhibition causes the PFC to generate internal (natural) oscillations in the beta/gamma frequency range (>15 Hz) and to maximize principal cell spiking in response to external oscillations at slightly higher frequencies. Importantly, we found that the fastest oscillation frequency that can be relayed by the network maximizes local inhibition and is equal to a frequency even higher than that which maximizes the firing rate of excitatory cells; we call this phenomenon population frequency resonance. This form of resonance is shown to determine the optimal driving frequency for suppressing responses to asynchronous activity. Lastly, we demonstrate that the natural and resonant frequencies can be tuned by changes in neuronal excitability, the duration of feedback inhibition, and dynamic properties of the input. Our results predict that PFC networks are tuned for generating and selectively responding to beta- and gamma-rhythmic signals due to the natural and resonant properties of inhibition-based oscillators. They also suggest strategies for optimizing transcranial stimulation and using oscillatory networks in neuromorphic engineering.

DynaSim: A MATLAB Toolbox for Neural Modeling and Simulation.

DynaSim is an open-source MATLAB/GNU Octave toolbox for rapid prototyping of neural models and batch simulation management. It is designed to speed up and simplify the process of generating, sharing, and exploring network models of neurons with one or more compartments. Models can be specified by equations directly (similar to XPP or the Brian simulator) or by lists of predefined or custom model components. The higher-level specification supports arbitrarily complex population models and networks of interconnected populations. DynaSim also includes a large set of features that simplify exploring model dynamics over parameter spaces, running simulations in parallel using both multicore processors and high-performance computer clusters, and analyzing and plotting large numbers of simulated data sets in parallel. It also includes a graphical user interface (DynaSim GUI) that supports full functionality without requiring user programming. The software has been implemented in MATLAB to enable advanced neural modeling using MATLAB, given its popularity and a growing interest in modeling neural systems. The design of DynaSim incorporates a novel schema for model specification to facilitate future interoperability with other specifications (e.g., NeuroML, SBML), simulators (e.g., NEURON, Brian, NEST), and web-based applications (e.g., Geppetto) outside MATLAB. DynaSim is freely available at http://dynasimtoolbox.org. This tool promises to reduce barriers for investigating dynamics in large neural models, facilitate collaborative modeling, and complement other tools being developed in the neuroinformatics community.

Attentional Selection Can Be Predicted by Reinforcement Learning of Task-relevant Stimulus Features Weighted by Value-independent Stickiness.

Attention includes processes that evaluate stimuli relevance, select the most relevant stimulus against less relevant stimuli, and bias choice behavior toward the selected information. It is not clear how these processes interact. Here, we captured these processes in a reinforcement learning framework applied to a feature-based attention task that required macaques to learn and update the value of stimulus features while ignoring nonrelevant sensory features, locations, and action plans. We found that value-based reinforcement learning mechanisms could account for feature-based attentional selection and choice behavior but required a value-independent stickiness selection process to explain selection errors while at asymptotic behavior. By comparing different reinforcement learning schemes, we found that trial-by-trial selections were best predicted by a model that only represents expected values for the task-relevant feature dimension, with nonrelevant stimulus features and action plans having only a marginal influence on covert selections. These findings show that attentional control subprocesses can be described by (1) the reinforcement learning of feature values within a restricted feature space that excludes irrelevant feature dimensions, (2) a stochastic selection process on feature-specific value representations, and (3) value-independent stickiness toward previous feature selections akin to perseveration in the motor domain. We speculate that these three mechanisms are implemented by distinct but interacting brain circuits and that the proposed formal account of feature-based stimulus selection will be important to understand how attentional subprocesses are implemented in primate brain networks.

Mapping of functionally characterized cell classes onto canonical circuit operations in primate prefrontal cortex.

Microcircuits are composed of multiple cell classes that likely serve unique circuit operations. But how cell classes map onto circuit functions is largely unknown, particularly for primate prefrontal cortex during actual goal-directed behavior. One difficulty in this quest is to reliably distinguish cell classes in extracellular recordings of action potentials. Here we surmount this issue and report that spike shape and neural firing variability provide reliable markers to segregate seven functional classes of prefrontal cells in macaques engaged in an attention task. We delineate an unbiased clustering protocol that identifies four broad spiking (BS) putative pyramidal cell classes and three narrow spiking (NS) putative inhibitory cell classes dissociated by how sparse, bursty, or regular they fire. We speculate that these functional classes map onto canonical circuit functions. First, two BS classes show sparse, bursty firing, and phase synchronize their spiking to 3-7 Hz (theta) and 12-20 Hz (beta) frequency bands of the local field potential (LFP). These properties make cells flexibly responsive to network activation at varying frequencies. Second, one NS and two BS cell classes show regular firing and higher rate with only marginal synchronization preference. These properties are akin to setting tonically the excitation and inhibition balance. Finally, two NS classes fired irregularly and synchronized to either theta or beta LFP fluctuations, tuning them potentially to frequency-specific subnetworks. These results suggest that a limited set of functional cell classes emerges in macaque prefrontal cortex (PFC) during attentional engagement to not only represent information, but to subserve basic circuit operations.

Anterior Cingulate Cortex Cells Identify Process-Specific Errors of Attentional Control Prior to Transient Prefrontal-Cingulate Inhibition.

Errors indicate the need to adjust attention for improved future performance. Detecting errors is thus a fundamental step to adjust and control attention. These functions have been associated with the dorsal anterior cingulate cortex (dACC), predicting that dACC cells should track the specific processing states giving rise to errors in order to identify which processing aspects need readjustment. Here, we tested this prediction by recording cells in the dACC and lateral prefrontal cortex (latPFC) of macaques performing an attention task that dissociated 3 processing stages. We found that, across prefrontal subareas, the dACC contained the largest cell populations encoding errors indicating (1) failures of inhibitory control of the attentional focus, (2) failures to prevent bottom-up distraction, and (3) lapses when implementing a choice. Error-locked firing in the dACC showed the earliest latencies across the PFC, emerged earlier than reward omission signals, and involved a significant proportion of putative inhibitory interneurons. Moreover, early onset error-locked response enhancement in the dACC was followed by transient prefrontal-cingulate inhibition, possibly reflecting active disengagement from task processing. These results suggest a functional specialization of the dACC to track and identify the actual processes that give rise to erroneous task outcomes, emphasizing its role to control attentional performance.

Burst firing synchronizes prefrontal and anterior cingulate cortex during attentional control.

BACKGROUND: It is widely held that single cells in anterior cingulate and lateral prefrontal cortex (ACC/PFC) coordinate their activity during attentional processes, although cellular activity that may underlie such coordination across ACC/PFC has not been identified. We thus recorded cells in five ACC/PFC subfields of macaques engaged in a selective attention task, characterized those spiking events that indexed attention, and identified how spiking of distinct cell populations synchronized between brain areas. RESULTS: We found that cells in ACC/PFC increased the firing of brief 200 Hz spike bursts when subjects shifted attention and engaged in selective visual processing. In contrast to nonburst spikes, burst spikes synchronized over large distances to local field potentials at narrow beta (12-20 Hz) and at gamma (50-75 Hz) frequencies. Long-range burst synchronization was anatomically specific, functionally connecting those subfields in area 24 (ACC) and area 46 (PFC) that are key players of attentional control. By splitting cells into putative excitatory (pE) and inhibitory (pI) cells by their broad and narrow spikes, we identified that bursts of pI cells preceded and that bursts of pE cells followed in time periods of maximal beta coherent network activity. In contrast, gamma bursts were transient impulses with equal timing across cell classes. CONCLUSIONS: These findings suggest that processes underlying burst firing and burst synchronization are candidate mechanisms to coordinate attention information across brain areas. We speculate that distinct burst-firing motifs realize beta and gamma synchrony to trigger versus maintain functional network states during goal-directed behavior.

A tweaking principle for executive control: neuronal circuit mechanism for rule-based task switching and conflict resolution.

A hallmark of executive control is the brain's agility to shift between different tasks depending on the behavioral rule currently in play. In this work, we propose a "tweaking hypothesis" for task switching: a weak rule signal provides a small bias that is dramatically amplified by reverberating attractor dynamics in neural circuits for stimulus categorization and action selection, leading to an all-or-none reconfiguration of sensory-motor mapping. Based on this principle, we developed a biologically realistic model with multiple modules for task switching. We found that the model quantitatively accounts for complex task switching behavior: switch cost, congruency effect, and task-response interaction; as well as monkey's single-neuron activity associated with task switching. The model yields several testable predictions, in particular, that category-selective neurons play a key role in resolving sensory-motor conflict. This work represents a neural circuit model for task switching and sheds insights in the brain mechanism of a fundamental cognitive capability.

Reconciling coherent oscillation with modulation of irregular spiking activity in selective attention: gamma-range synchronization between sensory and executive cortical areas.

In this computational work, we investigated gamma-band synchronization across cortical circuits associated with selective attention. The model explicitly instantiates a reciprocally connected loop of spiking neurons between a sensory-type (area MT) and an executive-type (prefrontal/parietal) cortical circuit (the source area for top-down attentional signaling). Moreover, unlike models in which neurons behave as clock-like oscillators, in our model single-cell firing is highly irregular (close to Poisson), while local field potential exhibits a population rhythm. In this "sparsely synchronized oscillation" regime, the model reproduces and clarifies multiple observations from behaving animals. Top-down attentional inputs have a profound effect on network oscillatory dynamics while only modestly affecting single-neuron spiking statistics. In addition, attentional synchrony modulations are highly selective: interareal neuronal coherence occurs only when there is a close match between the preferred feature of neurons, the attended feature, and the presented stimulus, a prediction that is experimentally testable. When interareal coherence was abolished, attention-induced gain modulations of sensory neurons were slightly reduced. Therefore, our model reconciles the rate and synchronization effects, and suggests that interareal coherence contributes to large-scale neuronal computation in the brain through modest enhancement of rate modulations as well as a pronounced attention-specific enhancement of neural synchrony.

An integrated microcircuit model of attentional processing in the neocortex.

Selective attention is a fundamental cognitive function that uses top-down signals to orient and prioritize information processing in the brain. Single-cell recordings from behaving monkeys have revealed a number of attention-induced effects on sensory neurons, and have given rise to contrasting viewpoints about the neural underpinning of attentive processing. Moreover, there is evidence that attentional signals originate from the prefrontoparietal working memory network, but precisely how a source area of attention interacts with a sensory system remains unclear. To address these questions, we investigated a biophysically based network model of spiking neurons composed of a reciprocally connected loop of two (sensory and working memory) networks. We found that a wide variety of physiological phenomena induced by selective attention arise naturally in such a system. In particular, our work demonstrates a neural circuit that instantiates the "feature-similarity gain modulation principle," according to which the attentional gain effect on sensory neuronal responses is a graded function of the difference between the attended feature and the preferred feature of the neuron, independent of the stimulus. Furthermore, our model identifies key circuit mechanisms that underlie feature-similarity gain modulation, multiplicative scaling of tuning curve, and biased competition, and provide specific testable predictions. These results offer a synthetic account of the diverse attentional effects, suggesting a canonical neural circuit for feature-based attentional processing in the cortex.