The neural basis of reversal learning: An updated perspective.

Reversal learning paradigms are among the most widely used tests of cognitive flexibility and have been used as assays, across species, for altered cognitive processes in a host of neuropsychiatric conditions. Based on recent studies in humans, non-human primates, and rodents, the notion that reversal learning tasks primarily measure response inhibition, has been revised. In this review, we describe how cognitive flexibility is measured by reversal learning and discuss new definitions of the construct validity of the task that are serving as a heuristic to guide future research in this field. We also provide an update on the available evidence implicating certain cortical and subcortical brain regions in the mediation of reversal learning, and an overview of the principal neurotransmitter systems involved.

Does the medial orbitofrontal cortex have a role in social valuation?

It has been claimed that social behaviour changes after lesions of the ventromedial prefrontal cortex (vmPFC). However, lesions in humans are rarely restricted to a well defined cortical area. Although vmPFC lesions usually include medial orbitofrontal cortex (mOFC), they typically also affect subgenual and/or perigenual anterior cingulate cortex. The purpose of the current study is to investigate the role of mOFC in social valuation and decision-making. We tested four macaque monkeys prior to and after focal lesions of mOFC. Comparison of the animals' pre- and postoperative performance revealed that, unlike lesions of anterior cingulate gyrus (ACCg), lesions of mOFC did not induce alterations in social valuation. MOFC lesions did, however, induce mild impairments in a probabilistic two-choice decision task, which were not seen after ACCg lesions. In summary, the double dissociation between the patterns of impairment suggest that vmPFC involvement in both decision-making and social valuation may be mediated by distinct subregions centred on mOFC and ACCg respectively.

Impulsive choice in hippocampal but not orbitofrontal cortex-lesioned rats on a nonspatial decision-making maze task.

Orbitofrontal cortical (OFC) and hippocampal (HPC) lesions in primates and rodents have been associated with impulsive behaviour. We showed previously that OFC- or HPC-lesioned rats chose the immediate low-reward (LR) option in preference to the delayed high-reward (HR) option, where LR and HR were associated with different spatial responses in a uniform grey T-maze. We now report that on a novel nonspatial T-maze task in which the HR and LR options are associated with patterned goal arms (black-and-white stripes vs. gray), OFC-lesioned rats did not show impulsive behaviour, choosing the delayed HR option, and were indistinguishable from controls. In contrast, HPC-lesioned rats exhibited impulsive choice in the nonspatial decision-making task, although they chose the HR option on the majority of trials when there was a 10-s delay associated with both goal arms. The previously reported impairment in OFC-lesioned rats on the spatial version of the intertemporal choice task is unlikely to reflect a general problem with spatial learning, because OFC lesions were without effect on acquisition of the standard reference memory water-maze task and spatial working memory performance (nonmatching-to-place) on the T-maze. The differential effect of OFC lesions on the two versions of the intertemporal choice task may be explained instead in terms of the putative role of OFC in using associative information to represent expected outcomes and generate predictions. The impulsivity in HPC-lesioned rats may reflect impaired temporal information processing, and emphasizes a role for the hippocampus beyond the spatial domain.

The contribution of distinct subregions of the ventromedial frontal cortex to emotion, social behavior, and decision making.

Damage to the ventromedial frontal cortex (VMFC) in humans is associated with deficits in decision making. Decision making, however, often happens while people are interacting with others, where it is important to take the social consequences of a course of action into account. It is well known that VMFC lesions also lead to marked alterations in patients' emotions and ability to interact socially; however, it has not been clear which parts of the VMFC are critical for these changes. Recently, there has been considerable interest in the role of the VMFC in choice behavior during interpersonal exchanges. Here, we highlight recent research that suggests that two areas within or adjacent to the VMFC, the orbitofrontal cortex (OFC) and the anterior cingulate cortex (ACC), may play distinct but complementary roles in mediating normal patterns of emotion and social behavior. Converging lines of evidence from human, macaque, and rat studies now suggest that the OFC may be more specialized for simple emotional responses, such as fear and aggression, through its role in representing primary reinforcement or punishment. By contrast, the ACC may play a distinct role in more complex aspects of emotion, such as social interaction, by virtue of its connections with the discrete parts of the temporal lobe and subcortical structures that control autonomic responses.

Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour.

There is general acknowledgement that both the anterior cingulate and orbitofrontal cortex are implicated in reinforcement-guided decision making, and emotion and social behaviour. Despite the interest that these areas generate in both the cognitive neuroscience laboratory and the psychiatric clinic, ideas about the distinctive contributions made by each have only recently begun to emerge. This reflects an increasing understanding of the component processes that underlie reinforcement-guided decision making, such as the representation of reinforcement expectations, the exploration, updating and representation of action values, and the appreciation that choices are guided not just by the prospect of reward but also by the costs that action entails. Evidence is emerging to suggest that the anterior cingulate and orbitofrontal cortex make distinct contributions to each of these aspects of decision making.

A role for the macaque anterior cingulate gyrus in social valuation.

Complex human social interaction is disrupted when the frontal lobe is damaged in disease, and in extreme cases patients are described as having acquired sociopathy. We compared, in macaques, the effects of lesions in subdivisions of the anterior cingulate and the orbitofrontal cortices believed to be anatomically homologous to those damaged in such patients. We show that the anterior cingulate gyrus in male macaques is critical for normal patterns of social interest in other individual male or female macaques. Conversely, the orbitofrontal cortex lesion had a marked effect only on responses to mildly fear-inducing stimuli. These results suggest that damage to the anterior cingulate gyrus may be the cause of changes in social interaction seen after frontal lobe damage.