Sign-tracking behavior is sensitive to outcome devaluation in a devaluation context-dependent manner: implications for analyzing habitual behavior.

Motivationally attractive cues can draw in behavior in a phenomenon termed incentive salience. Incentive cue attraction is an important model for animal models of drug seeking and relapse. One question of interest is the extent to which the pursuit of motivationally attractive cues is related to the value of the paired outcome or can become unrelated and habitual. We studied this question using a sign-tracking (ST) paradigm in rats, in which a lever stimulus preceding food reward comes to elicit conditioned lever-interaction behavior. We asked whether reinforcer devaluation by means of conditioned taste aversion, a classic test of habitual behavior, can modify ST to incentive cues, and whether this depends upon the manner in which reinforcer devaluation takes place. In contrast to several recent reports, we conclude that ST is indeed sensitive to reinforcer devaluation. However, this effect depends critically upon the congruence between the context in which taste aversion is learned and the context in which it is tested. When the taste aversion successfully transfers to the testing context, outcome value strongly influences ST behavior, both when the outcome is withheld (in extinction) and when animals can learn from outcome feedback (reacquisition). When taste aversion does not transfer to the testing context, ST remains high. In total, the extent to which ST persists after outcome devaluation is closely related to the extent to which that outcome is truly devalued in the task context. We believe this effect of context on devaluation can reconcile contradictory findings about the flexibility/inflexibility of ST. We discuss this literature and relate our findings to the study of habits generally.

Optogenetic Inhibition of Ventral Pallidum Neurons Impairs Context-Driven Salt Seeking.

Salt appetite, in which animals can immediately seek out salt when under a novel state of sodium deprivation, is a classic example of how homeostatic systems interface with learned associations to produce an on-the-fly updating of motivated behavior. Neural activity in the ventral pallidum (VP) has been shown to encode changes in the value of salt under such conditions, both the value of salt itself (Tindell et al., 2006) and the motivational value of its predictive cues (Tindell et al., 2009; Robinson and Berridge, 2013). However, it is not known whether the VP is necessary for salt appetite in terms of seeking out salt or consuming salt following sodium depletion. Here, we used a conditioned place-preference procedure to investigate the effects of optogenetically inhibiting the VP on context-driven salt seeking and the consumption of salt following deprivation. Male rats learned to associate one context with sucrose and another context with less-desirable salt. Following sodium depletion, and in the absence of either sucrose or salt, we found that inhibiting the VP selectively reduced the elevation in time spent in the salt-paired context. VP inhibition had minimal effects on the consumption of salt once it was made available. To our knowledge, this is the first evidence that the VP or any brain region is necessary for the ability to use contextual cues to guide salt seeking. These results highlight a dissociation between deficit-driven reward seeking and reward consumption to replenish those deficits, with the former process being particularly sensitive to on-line VP activity.SIGNIFICANCE STATEMENT Salt appetite, in which rats will immediately seek out a once-undesirable concentrated salt solution after being depleted of bodily sodium despite never having tasted salt as a positive reward, is a phenomenon showing how animals can update their motivational goals without any new learning or conditioning. This salt-seeking behavior is also observed when the animal is presented with salt-paired cues. The neural circuitry necessary for context-driven salt-seeking behavior is unknown. We used a novel conditioned place preference procedure to show that optogenetic inhibition of the ventral pallidum (VP), a region known for processing reward, impairs context-driven salt seeking and has minimal effects on the consumption of salt itself following sodium depletion. These results highlight the importance of the VP in context-driven reward-seeking behavior.

Representations of Value in the Brain: An Embarrassment of Riches?

Over the past two decades, neuroscientists have increasingly turned their attention to the question of how the brain implements decisions between differently valued options. This emerging field, called neuroeconomics, has made quick progress in identifying a plethora of brain areas that track or are modulated by reward value. However, it is still unclear how and where in the brain value coding takes place. A primate study by Strait and colleagues in this issue of PLOS Biology finds overlapping signals of value coding in two brain regions central to the valuation process: the ventromedial prefrontal cortex and the ventral striatum. This finding reconciles the primate and rodent literatures, provides valuable insight into the complexity of value computation, and helps set the agenda for future work in this area.

A functional difference in information processing between orbitofrontal cortex and ventral striatum during decision-making behaviour.

Both orbitofrontal cortex (OFC) and ventral striatum (vStr) have been identified as key structures that represent information about value in decision-making tasks. However, the dynamics of how this information is processed are not yet understood. We recorded ensembles of cells from OFC and vStr in rats engaged in the spatial adjusting delay-discounting task, a decision-making task that involves a trade-off between delay to and magnitude of reward. Ventral striatal neural activity signalled information about reward before the rat's decision, whereas such reward-related signals were absent in OFC until after the animal had committed to its decision. These data support models in which vStr is directly involved in action selection, but OFC processes decision-related information afterwards that can be used to compare the predicted and actual consequences of behaviour.

Interactions between deliberation and delay-discounting in rats.

When faced with decisions, rats sometimes pause and look back and forth between possible alternatives, a phenomenon termed vicarious trial and error (VTE). When it was first observed in the 1930s, VTE was theorized to be a mechanism for exploration. Later theories suggested that VTE aided the resolution of sensory or neuroeconomic conflict. In contrast, recent neurophysiological data suggest that VTE reflects a dynamic search and evaluation process. These theories make unique predictions about the timing of VTE on behavioral tasks. We tested these theories of VTE on a T-maze with return rails, where rats were given a choice between a smaller reward available after one delay or a larger reward available after an adjustable delay. Rats showed three clear phases of behavior on this task: investigation, characterized by discovery of task parameters; titration, characterized by iterative adjustment of the delay to a preferred interval; and exploitation, characterized by alternation to hold the delay at the preferred interval. We found that VTE events occurred during adjustment laps more often than during alternation laps. Results were incompatible with theories of VTE as an exploratory behavior, as reflecting sensory conflict, or as a simple neuroeconomic valuation process. Instead, our results were most consistent with VTE as reflecting a search process during deliberative decision making. This pattern of VTE that we observed is reminiscent of current navigational theories proposing a transition from a deliberative to a habitual decision-making mechanism.

Treatment of early and late kainic acid-induced status epilepticus with the noncompetitive AMPA receptor antagonist GYKI 52466.

PURPOSE: Benzodiazepines such as diazepam may fail to effectively treat status epilepticus because benzodiazepine-sensitive GABA(A) receptors are progressively internalized with continued seizure activity. Ionotropic glutamate receptors, including AMPA receptors, are externalized, so that AMPA receptor antagonists, which are broad-spectrum anticonvulsants, could be more effective treatments for status epilepticus. We assessed the ability of the noncompetitive AMPA receptor antagonist GYKI 52466 to protect against kainic acid-induced status epilepticus in mice. METHODS: Groups of animals treated with kainic acid received GYKI 52466 (50 mg/kg followed in 15 min by 50 mg/kg) or diazepam (25 mg/kg followed in 20 min by 12.5 mg/kg) beginning at 5 min of continuous seizure activity or 25 min later. The duration of seizure activity was determined by EEG recording from epidural cortical electrodes. RESULTS: Both GYKI 52466 and diazepam rapidly terminated electrographic and behavioral seizures when administered early. However, diazepam-treated animals exhibited more seizure recurrences. With late administration, GYKI 52466 also rapidly terminated seizures and they seldom recurred, whereas diazepam was slow to produce seizure control and recurrences were common. Although both treatments caused sedation, GYKI 52466-treated animals retained neurological responsiveness whereas diazepam-treated animals did not. GYKI 52466 did not affect blood pressure whereas diazepam caused a sustained drop in mean arterial pressure. DISCUSSION: Noncompetitive AMPA receptor antagonists represent a promising approach for early treatment of status epilepticus; they may also be effective at later times when there is refractoriness to benzodiazepines.