Dopamine Release in the Nucleus Accumbens Core Encodes the General Excitatory Components of Learning.

Dopamine release in the nucleus accumbens core (NAcC) is generally considered to be a proxy for phasic firing of dopamine neurons in the ventral tegmental area (VTADA). Thus, dopamine release in NAcC is hypothesized to reflect a unitary role in reward prediction error signalling. However, recent studies revealed more diverse roles of dopamine neurons, which support an emerging idea that dopamine regulates learning differently in distinct circuits. To understand whether the NAcC might regulate a unique component of learning, we recorded dopamine release in NAcC while male rats performed a backward conditioning task where a reward is followed by a cue. We used this task because we can delineate different components of learning, which include sensory-specific inhibitory and general excitatory components. Further, we have shown that VTADA neurons are necessary for both the specific and general components of backward associations. Here, we found that dopamine release in NAcC increased to the reward across learning, while reducing to the cue that followed as it became more expected. This mirrors the dopamine prediction error signal seen during forward conditioning and cannot be accounted for temporal-difference reinforcement learning (TDRL). Subsequent tests allowed us to dissociate these learning components and revealed that dopamine release in NAcC reflects the general excitatory component of backward associations, but not their sensory-specific component. These results emphasize the importance of examining distinct functions of different dopamine projections in reinforcement learning.Significance Statement Dopamine regulates reinforcement learning. While it was previously believed that this system contributed to simple value assignment to reward cues, we now know dopamine plays increasingly diverse roles in reinforcement learning. How these diverse roles are achieved in distinct circuits is not fully understood. By using behavioural tasks that examine distinctive components of learning separately, we reveal that NAcC dopamine release contributes to a unique component of learning. Thus, the present study supports a distinct role of NAcC in reinforcement learning, consistent with the idea that different dopamine systems serve different learning functions. Examining the roles of different dopamine projections is an important approach to identify neuronal mechanisms underlying the reinforcement-learning deficits observed in schizophrenia and drug addiction.

Cognitive representations of intracranial self-stimulation of midbrain dopamine neurons depend on stimulation frequency.

Dopamine neurons in the ventral tegmental area support intracranial self-stimulation (ICSS), yet the cognitive representations underlying this phenomenon remain unclear. Here, 20-Hz stimulation of dopamine neurons, which approximates a physiologically relevant prediction error, was not sufficient to support ICSS beyond a continuously reinforced schedule and did not endow cues with a general or specific value. However, 50-Hz stimulation of dopamine neurons was sufficient to drive robust ICSS and was represented as a specific reward to motivate behavior. The frequency dependence of this effect is due to the rate (not the number) of action potentials produced by dopamine neurons, which differently modulates dopamine release downstream.

Dopamine errors drive excitatory and inhibitory components of backward conditioning in an outcome-specific manner.

For over two decades, phasic activity in midbrain dopamine neurons was considered synonymous with the prediction error in temporal-difference reinforcement learning.1-4 Central to this proposal is the notion that reward-predictive stimuli become endowed with the scalar value of predicted rewards. When these cues are subsequently encountered, their predictive value is compared to the value of the actual reward received, allowing for the calculation of prediction errors.5,6 Phasic firing of dopamine neurons was proposed to reflect this computation,1,2 facilitating the backpropagation of value from the predicted reward to the reward-predictive stimulus, thus reducing future prediction errors. There are two critical assumptions of this proposal: (1) that dopamine errors can only facilitate learning about scalar value and not more complex features of predicted rewards, and (2) that the dopamine signal can only be involved in anticipatory cue-reward learning in which cues or actions precede rewards. Recent work7-15 has challenged the first assumption, demonstrating that phasic dopamine signals across species are involved in learning about more complex features of the predicted outcomes, in a manner that transcends this value computation. Here, we tested the validity of the second assumption. Specifically, we examined whether phasic midbrain dopamine activity would be necessary for backward conditioning-when a neutral cue reliably follows a rewarding outcome.16-20 Using a specific Pavlovian-to-instrumental transfer (PIT) procedure,21-23 we show rats learn both excitatory and inhibitory components of a backward association, and that this association entails knowledge of the specific identity of the reward and cue. We demonstrate that brief optogenetic inhibition of VTADA neurons timed to the transition between the reward and cue reduces both of these components of backward conditioning. These findings suggest VTADA neurons are capable of facilitating associations between contiguously occurring events, regardless of the content of those events. We conclude that these data may be in line with suggestions that the VTADA error acts as a universal teaching signal. This may provide insight into why dopamine function has been implicated in myriad psychological disorders that are characterized by very distinct reinforcement-learning deficits.

Increases in compulsivity, inflammation, and neural injury in HIV transgenic rats with escalated methamphetamine self-administration under extended-access conditions.

The abuse of stimulants, such as methamphetamine (METH), is associated with treatment non-compliance, a greater risk of viral transmission, and the more rapid clinical progression of immunological and central nervous system human immunodeficiency virus (HIV) disease. The behavioral effects of METH in the setting of HIV remain largely uncharacterized. We used a state-of-the-art paradigm of the escalation of voluntary intravenous drug self-administration in HIV transgenic (Tg) and wildtype rats. The rats were first allowed to self-administer METH under short-access (ShA) conditions, which is characterized by a nondependent and more "recreational" pattern of METH use, and then allowed to self-administer METH under long-access (LgA) conditions, which leads to compulsive (dependent) METH intake. HIV Tg and wildtype rats self-administered equal amounts of METH under ShA conditions. HIV Tg rats self-administered METH under LgA conditions following a 4-week enforced abstinence period to model the intermittent pattern of stimulant abuse in humans. These HIV Tg rats developed greater motivation to self-administer METH and self-administered larger amounts of METH. Impairments in function of the medial prefrontal cortex (mPFC) contribute to compulsive drug and alcohol intake. Gene expression profiling of the mPFC in HIV Tg rats with a history of escalated METH self-administration under LgA conditions showed transcriptional evidence of increased inflammation, greater neural injury, and impaired aerobic glucose metabolism than wildtype rats that self-administered METH under LgA conditions. The detrimental effects of the interaction between neuroHIV and escalated METH intake on the mPFC are likely key factors in the greater vulnerability to excessive drug intake in the setting of HIV.

Charge Characteristics of Agouti-Related Protein Implicate Potent Involvement of Heparan Sulfate Proteoglycans in Metabolic Function.

The endogenous melanocortin peptide agouti-related protein (AgRP) plays a well-known role in foraging, but its contribution to metabolic regulation is less understood. Mature AgRP(83-132) has distinct residues for melanocortin receptor binding and heparan sulfate interactions. Here, we show that AgRP increases ad libitum feeding and operant responding for food in mice, decreases oxygen consumption, and lowers body temperature and activity, indicating lower energy expenditure. AgRP increased the respiratory exchange ratio, indicating a reduction of fat oxidation and a shift toward carbohydrates as the primary fuel source. The duration and intensity of AgRP's effects depended on the density of its positively charged amino acids, suggesting that its orexigenic and metabolic effects depend on its affinity for heparan sulfate. These findings may have major clinical implications by unveiling the critical involvement of interactions between AgRP and heparan sulfate to the central regulation of energy expenditure, fat utilization, and possibly their contribution to metabolic disease.

Probenecid Reduces Alcohol Drinking in Rodents. Is Pannexin1 a Novel Therapeutic Target for Alcohol Use Disorder?

AIMS: The development of novel and more effective medications for alcohol use disorder (AUD) is an important unmet medical need. Drug repositioning or repurposing is an appealing strategy to bring new therapies to the clinic because it greatly reduces the overall costs of drug development and expedites the availability of treatments to those who need them. Probenecid, p-(di-n-propylsulfamyl)-benzoic acid, is a drug used clinically to treat hyperuricemia and gout due to its activity as an inhibitor of the kidneys' organic anion transporter that reclaims uric acid from urine. Probenecid also inhibits pannexin1 channels that are involved in purinergic neurotransmission and inflammation, which have been implicated in alcohol's effects and motivation for alcohol. Therefore, we tested the effects of probenecid on alcohol intake in rodents. METHODS: We tested the effects of probenecid on operant oral alcohol self-administration in alcohol-dependent rats during acute withdrawal as well as in nondependent rats and in the drinking-in-the-dark (DID) paradigm of binge-like drinking in mice. RESULTS: Probenecid reduced alcohol intake in both dependent and nondependent rats and in the DID paradigm in mice without affecting water or saccharin intake, indicating that probenecid's effect was selective for alcohol and not the result of a general reduction in reward. CONCLUSIONS: These results raise the possibility that pannexin1 is a novel therapeutic target for the treatment of AUD. The clinical use of probenecid has been found to be generally safe, suggesting that it can be a candidate for drug repositioning for the treatment of AUD.