Neuroscience: Reevaluating the Role of Orbitofrontal Cortex.

A new optogenetic lesion study shows that the orbitofrontal cortex is essential for integrating information about recent rewards - which may either increase or decrease demand for more - with learned preferences to drive behavior.

Tonic exploration governs both flexibility and lapses.

In many cognitive tasks, lapses (spontaneous errors) are tacitly dismissed as the result of nuisance processes like sensorimotor noise, fatigue, or disengagement. However, some lapses could also be caused by exploratory noise: randomness in behavior that facilitates learning in changing environments. If so, then strategic processes would need only up-regulate (rather than generate) exploration to adapt to a changing environment. This view predicts that more frequent lapses should be associated with greater flexibility because these behaviors share a common cause. Here, we report that when rhesus macaques performed a set-shifting task, lapse rates were negatively correlated with perseverative error frequency across sessions, consistent with a common basis in exploration. The results could not be explained by local failures to learn. Furthermore, chronic exposure to cocaine, which is known to impair cognitive flexibility, did increase perseverative errors, but, surprisingly, also improved overall set-shifting task performance by reducing lapse rates. We reconcile these results with a state-switching model in which cocaine decreases exploration by deepening attractor basins corresponding to rule states. These results support the idea that exploratory noise contributes to lapses, affecting rule-based decision-making even when it has no strategic value, and suggest that one key mechanism for regulating exploration may be the depth of rule states.

Intense threat switches dorsal raphe serotonin neurons to a paradoxical operational mode.

Survival depends on the selection of behaviors adaptive for the current environment. For example, a mouse should run from a rapidly looming hawk but should freeze if the hawk is coasting across the sky. Although serotonin has been implicated in adaptive behavior, environmental regulation of its functional role remains poorly understood. In mice, we found that stimulation of dorsal raphe serotonin neurons suppressed movement in low- and moderate-threat environments but induced escape behavior in high-threat environments, and that movement-related dorsal raphe serotonin neural dynamics inverted in high-threat environments. Stimulation of dorsal raphe Î³-aminobutyric acid (GABA) neurons promoted movement in negative but not positive environments, and movement-related GABA neural dynamics inverted between positive and negative environments. Thus, dorsal raphe circuits switch between distinct operational modes to promote environment-specific adaptive behaviors.

Robust Encoding of Spatial Information in Orbitofrontal Cortex and Striatum.

Knowing whether core reward regions carry information about the positions of relevant objects is crucial for adjudicating between choice models. One limitation of previous studies, including our own, is that spatial positions can be consistently differentially associated with rewards, and thus position can be confounded with attention, motor plans, or target identity. We circumvented these problems by using a task in which value-and thus choices-was determined solely by a frequently changing rule, which was randomized relative to spatial position on each trial. We presented offers asynchronously, which allowed us to control for reward expectation, spatial attention, and motor plans in our analyses. We find robust encoding of the spatial position of both offers and choices in two core reward regions, orbitofrontal Area 13 and ventral striatum, as well as in dorsal striatum of macaques. The trial-by-trial correlation in noise in encoding of position was associated with variation in choice, an effect known as choice probability correlation, suggesting that the spatial encoding is associated with choice and is not incidental to it. Spatial information and reward information are not carried by separate sets of neurons, although the two forms of information are temporally dissociable. These results highlight the ubiquity of multiplexed information in association cortex and argue against the idea that these ostensible reward regions serve as part of a pure value domain.

Neuronal responses support a role for orbitofrontal cortex in cognitive set reconfiguration.

We are often faced with the need to abandon no-longer beneficial rules and adopt new ones. This process, known as cognitive set reconfiguration, is a hallmark of executive control. Although cognitive functions like reconfiguration are most often associated with dorsal prefrontal structures, recent evidence suggests that the orbitofrontal cortex (OFC) may play an important role as well. We recorded the activity of OFC neurons while rhesus macaques performed an analogue of the Wisconsin Card Sorting Task that involved a trial and error stage. The OFC neurons demonstrated two types of switch-related activity, an early (switch-away) signal and a late (switch-to) signal, when the new task set was established. We also found a pattern of match modulation: a significant change in activity for the stimulus that matched the current perceptual rule (and would therefore be selected). These results extend our understanding of the executive functions of the OFC. They also allow us to directly compare the OFC with the complementary datasets we previously collected in the ventral (VS) and dorsal (DS) striatum. Although both effects are observed in all three areas, the timing of responses aligns the OFC more closely with DS than with VS.

Rule Encoding in Orbitofrontal Cortex and Striatum Guides Selection.

Active maintenance of rules, like other executive functions, is often thought to be the domain of a discrete executive system. An alternative view is that rule maintenance is a broadly distributed function relying on widespread cortical and subcortical circuits. Tentative evidence supporting this view comes from research showing some rule selectivity in the orbitofrontal cortex and dorsal striatum. We recorded in these regions and in the ventral striatum, which has not been associated previously with rule representation, as macaques performed a Wisconsin Card Sorting Task. We found robust encoding of rule category (color vs shape) and rule identity (six possible rules) in all three regions. Rule identity modulated responses to potential choice targets, suggesting that rule information guides behavior by highlighting choice targets. The effects that we observed were not explained by differences in behavioral performance across rules and thus cannot be attributed to reward expectation. Our results suggest that rule maintenance and rule-guided selection of options are distributed processes and provide new insight into orbital and striatal contributions to executive control. SIGNIFICANCE STATEMENT: Rule maintenance, an important executive function, is generally thought to rely on dorsolateral brain regions. In this study, we examined activity of single neurons in orbitofrontal cortex and in ventral and dorsal striatum of macaques in a Wisconsin Card Sorting Task. Neurons in all three areas encoded rules and rule categories robustly. Rule identity also affected neural responses to potential choice options, suggesting that stored information is used to influence decisions. These results endorse the hypothesis that rule maintenance is a broadly distributed mental operation.

Differential Contributions of Ventral and Dorsal Striatum to Early and Late Phases of Cognitive Set Reconfiguration.

Flexible decision-making, a defining feature of human cognition, is typically thought of as a canonical pFC function. Recent work suggests that the striatum may participate as well; however, its role in this process is not well understood. We recorded activity of neurons in both the ventral (VS) and dorsal (DS) striatum while rhesus macaques performed a version of the Wisconsin Card Sorting Test, a classic test of flexibility. Our version of the task involved a trial-and-error phase before monkeys could identify the correct rule on each block. We observed changes in firing rate in both regions when monkeys switched rules. Specifically, VS neurons demonstrated switch-related activity early in the trial-and-error period when the rule needed to be updated, and a portion of these neurons signaled information about the switch context (i.e., whether the switch was intradimensional or extradimensional). Neurons in both VS and DS demonstrated switch-related activity at the end of the trial-and-error period, immediately before the rule was fully established and maintained, but these signals did not carry any information about switch context. We also observed associative learning signals (i.e., specific responses to options associated with rewards in the presentation period before choice) that followed the same pattern as switch signals (early in VS, later in DS). Taken together, these results endorse the idea that the striatum participates directly in cognitive set reconfiguration and suggest that single neurons in the striatum may contribute to a functional handoff from the VS to the DS during reconfiguration processes.

Neuronal selectivity for spatial positions of offers and choices in five reward regions.

When we evaluate an option, how is the neural representation of its value linked to information that identifies it, such as its position in space? We hypothesized that value information and identity cues are not bound together at a particular point but are represented together at the single unit level throughout the entirety of the choice process. We examined neuronal responses in two-option gambling tasks with lateralized and asynchronous presentation of offers in five reward regions: orbitofrontal cortex (OFC, area 13), ventromedial prefrontal cortex (vmPFC, area 14), ventral striatum (VS), dorsal anterior cingulate cortex (dACC), and subgenual anterior cingulate cortex (sgACC, area 25). Neuronal responses in all areas are sensitive to the positions of both offers and of choices. This selectivity is strongest in reward-sensitive neurons, indicating that it is not a property of a specialized subpopulation of cells. We did not find consistent contralateral or any other organization to these responses, indicating that they may be difficult to detect with aggregate measures like neuroimaging or studies of lesion effects. These results suggest that value coding is wed to factors that identify the object throughout the reward system and suggest a possible solution to the binding problem raised by abstract value encoding schemes.

Signatures of Value Comparison in Ventral Striatum Neurons.

The ventral striatum (VS), like its cortical afferents, is closely associated with processing of rewards, but the relative contributions of striatal and cortical reward systems remains unclear. Most theories posit distinct roles for these structures, despite their similarities. We compared responses of VS neurons to those of ventromedial prefrontal cortex (vmPFC) Area 14 neurons, recorded in a risky choice task. Five major response patterns observed in vmPFC were also observed in VS: (1) offer value encoding, (2) value difference encoding, (3) preferential encoding of chosen relative to unchosen value, (4) a correlation between residual variance in responses and choices, and (5) prominent encoding of outcomes. We did observe some differences as well; in particular, preferential encoding of the chosen option was stronger and started earlier in VS than in vmPFC. Nonetheless, the close match between vmPFC and VS suggests that cortex and its striatal targets make overlapping contributions to economic choice.

Developmental exposure to concentrated ambient particles and preference for immediate reward in mice.

BACKGROUND: Recent epidemiological studies indicate negative associations between a diverse group of air pollutants and cognitive functioning in children and adults, and aspects of attention deficit in children. Neuroinflammation and oxidative stress are two putative biological mechanisms by which air pollutants may adversely affect the brain. OBJECTIVES: We sought to determine whether exposure to concentrated ambient particulate matter (CAPS) during the first 2 weeks of life, alone or again in adulthood, could alter responding for delayed reward, a critical component of human decision making. Greater preference for immediate reward has been implicated as a component of several psychiatric disorders, addiction, obesity, and attention deficit. METHODS: C57BL/6J mice were exposed to ultrafine particles (< 100 nm in aerodynamic diameter; CAPS) using the Harvard University Concentrated Ambient Particle System (HUCAPS) or filtered air in the postnatal period (days 4-7 and 10-13) with and without adult exposure over days 56-60. In adulthood, delay behavior was assessed using a fixed-ratio waiting-for-reward (FR wait) paradigm in which 25 responses (FR25) were required to initiate the waiting-for-reward component during which mice obtained "free" sucrose pellets with the stipulation that these "free" pellets were delivered at increasing delay intervals. RESULTS: Coupled with increased FR response rates, mice exposed to postnatal CAPS displayed increased FR resets that reinstated short delays, indicating a preference for shorter delays, despite the added response cost of the FR25. No associated changes in locomotor activity were observed. CONCLUSIONS: Postnatal CAPS exposure produces an enhanced bias towards immediate rewards, a risk factor for several central nervous system (CNS) disorders. This enhancement does not appear to be the result of hyperactivity. The findings underscore the need for further evaluation of air pollution effects on the CNS and its potential contribution to CNS diseases and disorders.