Expectancy-Related Changes in Dopaminergic Error Signals Are Impaired by Cocaine Self-Administration.

Addiction is a disorder of behavioral control and learning. While this may reflect pre-existing propensities, drug use also clearly contributes by causing changes in outcome processing in prefrontal and striatal regions. This altered processing is associated with behavioral deficits, including changes in learning. These areas provide critical input to midbrain dopamine neurons regarding expected outcomes, suggesting that effects on learning may result from changes in dopaminergic error signaling. Here, we show that dopamine neurons recorded in rats that had self-administered cocaine failed to suppress firing on omission of an expected reward and exhibited lower amplitude and imprecisely timed increases in firing to an unexpected reward. Learning also appeared to have less of an effect on reward-evoked and cue-evoked firing in the cocaine-experienced rats. Overall, the changes are consistent with reduced fidelity of input regarding the expected outcomes, such as their size, timing, and overall value, because of cocaine use.

Suppression of Ventral Hippocampal Output Impairs Integrated Orbitofrontal Encoding of Task Structure.

The hippocampus and orbitofrontal cortex (OFC) both make important contributions to decision making and other cognitive processes. However, despite anatomical links between the two, few studies have tested the importance of hippocampal-OFC interactions. Here, we recorded OFC neurons in rats performing a decision making task while suppressing activity in a key hippocampal output region, the ventral subiculum. OFC neurons encoded information about expected outcomes and rats' responses. With hippocampal output suppressed, rats were slower to adapt to changes in reward contingency, and OFC encoding of response information was strongly attenuated. In addition, ventral subiculum inactivation prevented OFC neurons from integrating information about features of outcomes to form holistic representations of the outcomes available in specific trial blocks. These data suggest that the hippocampus contributes to OFC encoding of both concrete, low-level features of expected outcomes, and abstract, inferred properties of the structure of the world, such as task state.

Dynamic taste responses of parabrachial pontine neurons in awake rats.

The parabrachial nuclei of the pons (PbN) receive almost direct input from taste buds on the tongue and control basic taste-driven behaviors. Thus it is reasonable to hypothesize that PbN neurons might respond to tastes in a manner similar to that of peripheral receptors, i.e., that these responses might be narrow and relatively "dynamics free." On the other hand, the majority of the input to PbN descends from forebrain regions such as gustatory cortex (GC), which processes tastes with "temporal codes" in which firing reflects first the presence, then the identity, and finally the desirability of the stimulus. Therefore a reasonable alternative hypothesis is that PbN responses might be dominated by dynamics similar to those observed in GC. Here we examined simultaneously recorded single-neuron PbN (and GC) responses in awake rats receiving exposure to basic taste stimuli. We found that pontine taste responses were almost entirely confined to canonically identified taste-PbN (t-PbN). Taste-specificity was found, furthermore, to be time varying in a larger percentage of these t-PbN responses than in responses recorded from the tissue around PbN (including non-taste-PbN). Finally, these time-varying properties were a good match for those observed in simultaneously recorded GC neurons-taste-specificity appeared after an initial nonspecific burst of action potentials, and palatability emerged several hundred milliseconds later. These results suggest that the pontine taste relay is closely allied with the dynamic taste processing performed in forebrain.

Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors.

Correlative studies have strongly linked phasic changes in dopamine activity with reward prediction error signaling. But causal evidence that these brief changes in firing actually serve as error signals to drive associative learning is more tenuous. Although there is direct evidence that brief increases can substitute for positive prediction errors, there is no comparable evidence that similarly brief pauses can substitute for negative prediction errors. In the absence of such evidence, the effect of increases in firing could reflect novelty or salience, variables also correlated with dopamine activity. Here we provide evidence in support of the proposed linkage, showing in a modified Pavlovian over-expectation task that brief pauses in the firing of dopamine neurons in rat ventral tegmental area at the time of reward are sufficient to mimic the effects of endogenous negative prediction errors. These results support the proposal that brief changes in the firing of dopamine neurons serve as full-fledged bidirectional prediction error signals.