OFC neurons do not represent the negative value of a conditioned inhibitor.

The orbitofrontal cortex (OFC) is often proposed to function as a value integrator; however, alternative accounts focus on its role in representing associative structures that specify the probability and sensory identity of future outcomes. These two accounts make different predictions about how this area should respond to conditioned inhibitors of reward, since in the former, neural activity should reflect the negative value of the inhibitor, whereas in the latter, it should track the estimated probability of a future reward based on all cues present. Here, we assessed these predictions by recording from small groups of neurons in the lateral OFC of rats during training in a conditioned inhibition design. Rats showed negative summation when the inhibitor was compounded with a novel excitor, suggesting that they learned to respond to the conditioned inhibitor appropriately. Against this backdrop, we found unit and population responses that scaled with expected reward value on excitor + inhibitor compound trials. However, the responses of these neurons did not differentiate between the conditioned inhibitor and a neutral cue when both were presented in isolation. Further, when the ensemble patterns were analyzed, activity to the conditioned inhibitor did not classify according to putative negative value. Instead, it classified with a same-modality neutral cue when presented alone and as a unique item when presented in compound with a novel excitor. This pattern of results supports the notion that OFC encodes a model of the causal structure of the environment rather than either the modality or the value of cues.

Causal evidence supporting the proposal that dopamine transients function as temporal difference prediction errors.

Reward-evoked dopamine transients are well established as prediction errors. However, the central tenet of temporal difference accounts-that similar transients evoked by reward-predictive cues also function as errors-remains untested. In the present communication we addressed this by showing that optogenetically shunting dopamine activity at the start of a reward-predicting cue prevents second-order conditioning without affecting blocking. These results indicate that cue-evoked transients function as temporal-difference prediction errors rather than reward predictions.

Dissociation of Appetitive Overexpectation and Extinction in the Infralimbic Cortex.

Behavioral change is paramount to adaptive behavior. Two ways to achieve alterations in previously established behavior are extinction and overexpectation. The infralimbic (IL) portion of the medial prefrontal cortex controls the inhibition of previously established aversive behavioral responses in extinction. The role of the IL cortex in behavioral modification in appetitive Pavlovian associations remains poorly understood. Here, we seek to determine if the IL cortex modulates overexpectation and extinction of reward learning. Using overexpectation or extinction to achieve a reduction in behavior, the present findings uncover a dissociable role for the IL cortex in these paradigms. Pharmacologically inactivating the IL cortex left overexpectation intact. In contrast, pre-training manipulations in the IL cortex prior to extinction facilitated the reduction in conditioned responding but led to a disrupted extinction retrieval on test drug-free. Additional studies confirmed that this effect is restricted to the IL and not dependent on the dorsally-located prelimbic cortex. Together, these results show that the IL cortex underlies extinction but not overexpectation-driven reduction in behavior, which may be due to regulating the expression of conditioned responses influenced by stimulus-response associations rather than stimulus-stimulus associations.