Striatopallidal adenosine A2A receptors in the nucleus accumbens confer motivational control of goal-directed behavior.

The ability to learn the reward-value and action-outcome contingencies in dynamic environment is critical for flexible adaptive behavior and development of effective pharmacological control of goal-directed behaviors represents an important challenge for improving the deficits in goal-directed behavior which may underlie seemingly disparate symptoms across psychiatric disorders. Adenosine A2A receptor (A2AR) is emerging as a novel neuromodulatory target for controlling goal-directed behavior for its unique neuromodulatory features: the ability to integrate dopamine and glutamate signaling, the "brake" constraint of various cognitive processes and the balanced control of goal-directed and habit actions. However, the contribution and circuit mechanisms of the striatopallidal A2ARs in nucleus accumbens (NAc) to control of goal-directed behavior remain to be determined. Here, we employed newly developed opto-A2AR and the focal A2AR knockdown strategies to demonstrate the causal role of NAc A2AR in control of goal-directed behavior. Furthermore, we dissected out multiple distinct behavioral mechanisms underlying which NAc A2ARs control goal-directed behavior: (i) NAc A2ARs preferentially control goal-directed behavior at the expense of habit formation. (ii) NAc A2ARs modify the animals' sensitivity to the value of the reward without affecting the action-outcome contingency. (iii) A2AR antagonist KW6002 promotes instrumental actions by invigorating motivation. (iv) NAc A2ARs facilitate Pavlovian incentive value transferring to instrumental action. (v) NAc A2ARs control goal-directed behavior probably not through NAc-VP pathway. These insights into the behavioral and circuit mechanisms for NAc A2AR control of goal-directed behavior facilitate translational potential for A2AR antagonists in reversal of deficits in goal-directed decision-making associated with multiple neuropsychiatric disorders.

Striatopallidal Pathway Distinctly Modulates Goal-Directed Valuation and Acquisition of Instrumental Behavior via Striatopallidal Output Projections.

The striatopallidal pathway is specialized for control of motor and motivational behaviors, but its causal role in striatal control of instrumental learning remains undefined (partly due to the confounding motor effects). Here, we leveraged the transient and "time-locked" optogenetic manipulations with the reward delivery to minimize motor confounding effect, to better define the striatopallidal control of instrumental behaviors. Optogenetic (Arch) silencing of the striatopallidal pathway in the dorsomedial striatum (DMS) and dorsolateral striatum (DLS) promoted goal-directed and habitual behaviors, respectively, without affecting acquisition of instrumental behaviors, indicating striatopallidal pathway suppression of instrumental behaviors under physiological condition. Conversely, striatopallidal pathway activation mainly affected the acquisition of instrumental behaviors with the acquisition suppression achieved by either optogenetic (ChR2) or chemicogenetic (hM3q) activation, by strong (10 mW, but not weak 1 mW) optogenetic activation, by the time-locked (but not random) optogenetic activation with the reward and by the DMS (but not DLS) striatopallidal pathway. Lastly, striatopallidal pathway modulated instrumental behaviors through striatopallidal output projections into the external globus pallidus (GPe) since optogenetic activation of the striatopallidal pathway in the DMS and of the striatopallidal output projections in the GPe similarly suppressed goal-directed behavior. Thus, the striatopallidal pathway confers distinctive and inhibitory controls of animal's sensitivity to goal-directed valuation and acquisition of instrumental behaviors under normal and over-activation conditions, through the output projections into GPe.

Habit Formation after Random Interval Training Is Associated with Increased Adenosine A2A Receptor and Dopamine D2 Receptor Heterodimers in the Striatum.

Striatal adenosine A2A receptors (A2ARs) modulate striatal synaptic plasticity and instrumental learning, possibly by functional interaction with the dopamine D2 receptors (D2Rs) and metabotropic glutamate receptors 5 (mGluR5) through receptor-receptor heterodimers, but in vivo evidence for these interactions is lacking. Using in situ proximity ligation assay (PLA), we studied the subregional distribution of the A2AR-D2R and A2AR-mGluR5 heterodimer complexes in the striatum and their adaptive changes over the random interval and random ratio training of instrumental learning. After confirming the specificity of the PLA detection of the A2AR-D2R heterodimers with the A2AR knockout and D2R knockout mice, we detected a heterogeneous distribution of the A2AR-D2R heterodimer complexes in the striatum, being more abundant in the dorsolateral than the dorsomedial striatum. Importantly, habit formation after the random interval training was associated with the increased formation of the A2AR-D2R heterodimer complexes, with prominant increase in the dorsomedial striatum. Conversely, goal-directed behavior after the random ratio schedule was not associated with the adaptive change in the A2AR-D2R heterodimer complexes. In contrast to the A2AR-D2R heterodimers, the A2AR-mGluR5 heterodimers showed neither subregional variation in the striatum nor adaptive changes over either the random ratio (RR) or random interval (RI) training of instrumental learning. These findings suggest that development of habit formation is associated with increased formation of the A2AR-D2R heterodimer protein complexes which may lead to reduced dependence on D2R signaling in the striatum.

Optogenetic Activation of Adenosine A2A Receptor Signaling in the Dorsomedial Striatopallidal Neurons Suppresses Goal-Directed Behavior.

The striatum has an essential role in neural control of instrumental behaviors by reinforcement learning. Adenosine A(2A) receptors (A(2A)Rs) are highly enriched in the striatopallidal neurons and are implicated in instrumental behavior control. However, the temporal importance of the A(2A)R signaling in relation to the reward and specific contributions of the striatopallidal A(2A)Rs in the dorsolateral striatum (DLS) and the dorsomedial striatum (DMS) to the control of instrumental learning are not defined. Here, we addressed temporal relationship and sufficiency of transient activation of optoA(2A)R signaling precisely at the time of the reward to the control of instrumental learning, using our newly developed rhodopsin-A2AR chimeras (optoA(2A)R). We demonstrated that transient light activation of optoA(2A)R signaling in the striatopallidal neurons in 'time-locked' manner with the reward delivery (but not random optoA(2A)R activation) was sufficient to change the animal's sensitivity to outcome devaluation without affecting the acquisition or extinction phases of instrumental learning. We further demonstrated that optogenetic activation of striatopallidal A(2A)R signaling in the DMS suppressed goal-directed behaviors, as focally genetic knockdown of striatopallidal A(2A)Rs in the DMS enhanced goal-directed behavior by the devaluation test. By contrast, optogenetic activation or focal AAV-Cre-mediated knockdown of striatopallidal A(2A)R in the DLS had relatively limited effects on instrumental learning. Thus, the striatopallidal A(2A)R signaling in the DMS exerts inhibitory and predominant control of goal-directed behavior by acting precisely at the time of reward, and may represent a therapeutic target to reverse abnormal habit formation that is associated with compulsive obsessive disorder and drug addiction.