Mitigating the impact of adolescence isolation on the development of social anxiety: A potential role for oxytocin.

Exposure to isolation can lead to the development of social anxiety disorder (SAD), which affects 13% of Americans. There are sex differences in the prevalence of anxiety disorders, as women experience higher rates of SAD relative to men. Importantly, isolation experienced during adolescence increases the likelihood of developing SAD in adulthood. Unfortunately, the current treatments for SAD are only effective in 50-65% of patients. As such, it is critical to identify therapeutic targets for the treatment and prevention of SAD, particularly in women. Here, we discuss the links between childhood isolation and adulthood SAD. Next, we examine the preclinical models used to study the impact of isolation on social anxiety-like behaviors in rodents. Increasing evidence from both clinical and pre-clinical studies suggests oxytocin signaling is a potential target to modify social anxiety-like behaviors. We present the evidence that sex hormones influence the oxytocin system. Finally, we highlight future directions for both clinical and pre-clinical studies to further evaluate the efficacy of oxytocin as a treatment for isolation-induced SAD.

Critical periods when dopamine controls behavioral responding during Pavlovian learning.

RATIONALE: Learning the association between rewards and predictive cues is critical for appetitive behavioral responding. The mesolimbic dopamine system is thought to play an integral role in establishing these cue-reward associations. The dopamine response to cues can signal differences in reward value, though this emerges only after significant training. This suggests that the dopamine system may differentially regulate behavioral responding depending on the phase of training. OBJECTIVES: The purpose of this study was to determine whether antagonizing dopamine receptors elicited different effects on behavior depending on the phase of training or the type of Pavlovian task. METHODS: Separate groups of male rats were trained on Pavlovian tasks in which distinct audio cues signaled either differences in reward size or differences in reward rate. The dopamine receptor antagonist flupenthixol was systemically administered prior to either the first ten sessions of training (acquisition phase) or the second ten sessions of training (expression phase), and we monitored the effect of these manipulations for an additional ten training sessions. RESULTS: We identified acute effects of dopamine receptor antagonism on conditioned responding, the latency to respond, and post-reward head entries in both Pavlovian tasks. Interestingly, dopamine receptor antagonism during the expression phase produced persistent deficits in behavioral responding only in rats trained on the reward size Pavlovian task. CONCLUSIONS: Together, our results illustrate that dopamine's control over behavior in Pavlovian tasks depends upon one's prior training experience and the information signaled by the cues.

Sex Differences in Behavioral Responding and Dopamine Release during Pavlovian Learning.

Learning associations between cues and rewards require the mesolimbic dopamine system. The dopamine response to cues signals differences in reward value in well trained animals. However, these value-related dopamine responses are absent during early training sessions when cues signal differences in the reward rate. These findings suggest cue-evoked dopamine release conveys differences between outcomes only after extensive training, though it is unclear whether this is unique to when cues signal differences in reward rate, or whether this is also evident when cues signal differences in other value-related parameters such as reward size. To address this, we used a Pavlovian conditioning task in which one audio cue was associated with a small reward (one pellet) and another audio cue was associated with a large reward (three pellets). We performed fast-scan cyclic voltammetry to record changes in dopamine release in the nucleus accumbens of male and female rats throughout learning. While female rats exhibited higher levels of conditioned responding, a faster latency to respond, and elevated post-reward head entries relative to male rats, there were no sex differences in the dopamine response to cues. Multiple training sessions were required before cue-evoked dopamine release signaled differences in reward size. Reward-evoked dopamine release scaled with reward size, though females displayed lower reward-evoked dopamine responses relative to males. Conditioned responding related to the decrease in the peak reward-evoked dopamine response and not to cue-evoked dopamine release. Collectively, these data illustrate sex differences in behavioral responding as well as in reward-evoked dopamine release during Pavlovian learning.

Delays to Reward Delivery Enhance the Preference for an Initially Less Desirable Option: Role for the Basolateral Amygdala and Retrosplenial Cortex.

Temporal costs influence reward-based decisions. This is commonly studied in temporal discounting tasks that involve choosing between cues signaling an imminent reward option or a delayed reward option. However, it is unclear whether the temporal delay before a reward can alter the value of that option. To address this, we identified the relative preference between different flavored rewards during a free-feeding test using male and female rats. Animals underwent training where either the initial preferred or the initial less preferred reward was delivered noncontingently. By manipulating the intertrial interval during training sessions, we could determine whether temporal delays impact reward preference in a subsequent free-feeding test. Rats maintained their initial preference if the same delays were used across all training sessions. When the initial less preferred option was delivered after short delays (high reward rate) and the initial preferred option was delivered after long delays (low reward rate), rats expectedly increased their preference for the initial less desirable option. However, rats also increased their preference for the initial less desirable option under the opposite training contingencies: delivering the initial less preferred reward after long delays and the initial preferred reward after short delays. These data suggest that sunk temporal costs enhance the preference for a less desirable reward option. Pharmacological and lesion experiments were performed to identify the neural systems responsible for this behavioral phenomenon. Our findings demonstrate the basolateral amygdala and retrosplenial cortex are required for temporal delays to enhance the preference for an initially less desirable reward.SIGNIFICANCE STATEMENT The goal of this study was to determine how temporal delays influence reward preference. We demonstrate that delivering an initially less desirable reward after long delays subsequently increases the consumption and preference for that reward. Furthermore, we identified the basolateral amygdala and the retrosplenial cortex as essential nuclei for mediating the change in reward preference elicited by sunk temporal costs.

Dopamine release and its control over early Pavlovian learning differs between the NAc core and medial NAc shell.

Dopamine neurons respond to cues to reflect the value of associated outcomes. These cue-evoked dopamine responses can encode the relative rate of reward in rats with extensive Pavlovian training. Specifically, a cue that always follows the previous reward by a short delay (high reward rate) evokes a larger dopamine response in the nucleus accumbens (NAc) core relative to a distinct cue that always follows the prior reward by a long delay (low reward rate). However, it was unclear if these reward rate dopamine signals are evident during early Pavlovian training sessions and across NAc subregions. To address this, we performed fast-scan cyclic voltammetry recordings of dopamine levels to track the pattern of cue- and reward-evoked dopamine signals in the NAc core and medial NAc shell. We identified regional differences in the progression of cue-evoked dopamine signals across training. However, the dopamine response to cues did not reflect the reward rate in either the NAc core or the medial NAc shell during early training sessions. Pharmacological experiments found that dopamine-sensitive conditioned responding emerged in the NAc core before the medial NAc shell. Together, these findings illustrate regional differences in NAc dopamine release and its control over behavior during early Pavlovian learning.

Cocaine experience abolishes the motivation suppressing effect of CRF in the ventral midbrain.

Stress affects dopamine-dependent behaviors in part through the actions of corticotropin releasing factor (CRF) in the ventral tegmental area (VTA). For example, acute stress engages CRF signaling in the VTA to suppress the motivation to work for food rewards. In contrast, acute stress promotes drug-seeking behavior through the actions of CRF in the VTA. These diverging behavioral effects in food- and drug-based tasks could indicate that CRF modulates goal-directed actions in a reinforcer-specific manner. Alternatively, prior drug experience could functionally alter how CRF in the VTA regulates dopamine-dependent behavior. To address these possibilities, we examined how intra-VTA injections of CRF influenced cocaine intake and whether prior drug experience alters how CRF modulates the motivation for food rewards. Our results demonstrate that intra-VTA injections of CRF had no effect on drug intake when self-administering cocaine under a progressive ratio reinforcement schedule. We also found that a prior history of either contingent or noncontingent cocaine infusions abolished the capacity for CRF to reduce the motivation for food rewards. Furthermore, voltammetry recordings in the nucleus accumbens illustrate that CRF in the VTA had no effect on cocaine-evoked dopamine release. These results collectively illustrate that exposure to abused substances functionally alters how neuropeptides act within the VTA to influence motivated behavior.

Acute Stress Enhances Associative Learning via Dopamine Signaling in the Ventral Lateral Striatum.

Acute stress transiently increases vigilance, enhancing the detection of salient stimuli in one's environment. This increased perceptual sensitivity is thought to promote the association of rewarding outcomes with relevant cues. The mesolimbic dopamine system is critical for learning cue-reward associations. Dopamine levels in the ventral striatum are elevated following exposure to stress. Together, this suggests that the mesolimbic dopamine system could mediate the influence of acute stress on cue-reward learning. To address this possibility, we examined how a single stressful experience influenced learning in an appetitive pavlovian conditioning task. Male rats underwent an episode of restraint prior to the first conditioning session. This acute stress treatment augmented conditioned responding in subsequent sessions. Voltammetry recordings of mesolimbic dopamine levels demonstrated that acute stress selectively increased reward-evoked dopamine release in the ventral lateral striatum (VLS), but not in the ventral medial striatum. Antagonizing dopamine receptors in the VLS blocked the stress-induced enhancement of conditioned responding. Collectively, these findings illustrate that stress engages dopamine signaling in the VLS to facilitate appetitive learning.SIGNIFICANCE STATEMENT Acute stress influences learning about aversive and rewarding outcomes. Dopamine neurons are sensitive to stress and critical for reward learning. However, it is unclear whether stress regulates reward learning via dopamine signaling. Using fast-scan cyclic voltammetry as rats underwent pavlovian conditioning, we demonstrate that a single stressful experience increases reward-evoked dopamine release in the ventral lateral striatum. This enhanced dopamine signal accompanies a long-lasting increase in conditioned behavioral responding. These findings highlight that the ventral lateral striatum is a node for mediating the effect of stress on reward processing.

Pattern of dopamine signaling during aversive events predicts active avoidance learning.

Learning to avoid aversive outcomes is an adaptive strategy to limit one's future exposure to stressful events. However, there is considerable variance in active avoidance learning across a population. The mesolimbic dopamine system contributes to behaviors elicited by aversive stimuli, although it is unclear if the heterogeneity in active avoidance learning is explained by differences in dopamine transmission. Furthermore, it is not known how dopamine signals evolve throughout active avoidance learning. To address these questions, we performed voltammetry recordings of dopamine release in the ventral medial striatum throughout training on inescapable footshock and signaled active avoidance tasks. This approach revealed differences in the pattern of dopamine signaling during the aversive cue and the safety period that corresponded to subsequent task performance. Dopamine transmission throughout the footshock bout did not predict performance but rather was modulated by the prior stress exposure. Additionally, we demonstrate that dopamine encodes a safety prediction error signal, which illustrates that ventral medial striatal dopamine release conveys a learning signal during both appetitive and aversive conditions.

Operant Costs Modulate Dopamine Release to Self-Administered Cocaine.

The costs associated with obtaining illicit drugs can fluctuate depending upon the relative drug availability. As a consequence of the changing costs, the effort that one must exert to obtain drugs is dynamic. Considerable evidence illustrates a critical role for dopamine in the ventral medial striatum in mediating drug reinforcement. However, little is known regarding how dopamine release is affected by changes in the costs associated with earning drugs. We used fast-scan cyclic voltammetry to determine how changes in the operant requirement affected dopamine release to self-administered cocaine in male rats. Dopamine release to cocaine infusions increased across trials during self-administration sessions using a fixed-ratio reinforcement schedule with a low operant requirement. However, increasing the operant requirement abolished the within-session elevation in dopamine release to drug rewards. This effect was not due to underlying changes in preinfusion dopamine levels and was not explained by cocaine levels in the brain. This within-session increase in dopamine release to cocaine infusions reemerged when the operant requirement was lowered. Under a progressive ratio reinforcement schedule, there was no increase in dopamine release to drug rewards across trials, which contrasts with prior studies demonstrating an increase in dopamine release to food rewards. Collectively, these findings illustrate that the influence of operant costs on reward-evoked dopamine release depends upon type of reward that can be earned (e.g., food or drug).SIGNIFICANCE STATEMENT The mesolimbic dopamine system is involved with mediating drug reinforcement. Although the costs associated with earning drugs are dynamic, no studies to date have examined how dopamine release to drug rewards is affected by changing costs. By performing fast-scan cyclic voltammetry recordings in rats self-administering cocaine, the present work demonstrates that changing the operant costs reversibly modulates the dopamine response to cocaine rewards. Furthermore, these findings highlight that the influence of costs on dopamine release to drug rewards differs from the established effect of costs on dopamine release to food rewards.

A Basal Ganglia Circuit Sufficient to Guide Birdsong Learning.

Learning vocal behaviors, like speech and birdsong, is thought to rely on continued performance evaluation. Whether candidate performance evaluation circuits in the brain are sufficient to guide vocal learning is not known. Here, we test the sufficiency of VTA projections to the vocal basal ganglia in singing zebra finches, a songbird species that learns to produce a complex and stereotyped multi-syllabic courtship song during development. We optogenetically manipulate VTA axon terminals in singing birds contingent on how the pitch of an individual song syllable is naturally performed. We find that optical inhibition and excitation of VTA terminals are each sufficient to reliably guide learned changes in song. Inhibition and excitation have opponent effects on future performances of targeted song syllables, consistent with positive and negative reinforcement of performance outcomes. These findings define a central role for reinforcement mechanisms in learning vocalizations and demonstrate minimal circuit elements for learning vocal behaviors. VIDEO ABSTRACT.

Dopamine Encodes Retrospective Temporal Information in a Context-Independent Manner.

The dopamine system responds to reward-predictive cues to reflect a prospective estimation of reward value, although its role in encoding retrospective reward-related information is unclear. We report that cue-evoked dopamine release in the nucleus accumbens core encodes the time elapsed since the previous reward or rather the wait time. Specifically, a cue that always follows the preceding reward with a short wait time elicits a greater dopamine response relative to a distinct cue that always follows the preceding reward with a long wait time. Differences in the dopamine response between short wait and long wait cues were evident even when these cues were never experienced together within the same context. Conditioned responding updated accordingly with a change in cue-evoked dopamine release but was unrelated to a difference in the dopamine response between cues. Collectively, these findings illustrate that the cue-evoked dopamine response conveys a subjective estimation of the relative reward rate.

Differentiation and Characterization of Dopaminergic Neurons From Baboon Induced Pluripotent Stem Cells.

UNLABELLED: : The progressive death of dopamine producing neurons in the substantia nigra pars compacta is the principal cause of symptoms of Parkinson's disease (PD). Stem cells have potential therapeutic use in replacing these cells and restoring function. To facilitate development of this approach, we sought to establish a preclinical model based on a large nonhuman primate for testing the efficacy and safety of stem cell-based transplantation. To this end, we differentiated baboon fibroblast-derived induced pluripotent stem cells (biPSCs) into dopaminergic neurons with the application of specific morphogens and growth factors. We confirmed that biPSC-derived dopaminergic neurons resemble those found in the human midbrain based on cell type-specific expression of dopamine markers TH and GIRK2. Using the reverse transcriptase quantitative polymerase chain reaction, we also showed that biPSC-derived dopaminergic neurons express PAX6, FOXA2, LMX1A, NURR1, and TH genes characteristic of this cell type in vivo. We used perforated patch-clamp electrophysiology to demonstrate that biPSC-derived dopaminergic neurons fired spontaneous rhythmic action potentials and high-frequency action potentials with spike frequency adaption upon injection of depolarizing current. Finally, we showed that biPSC-derived neurons released catecholamines in response to electrical stimulation. These results demonstrate the utility of the baboon model for testing and optimizing the efficacy and safety of stem cell-based therapeutic approaches for the treatment of PD. SIGNIFICANCE: Functional dopamine neurons were produced from baboon induced pluripotent stem cells, and their properties were compared to baboon midbrain cells in vivo. The baboon has advantages as a clinically relevant model in which to optimize the efficacy and safety of stem cell-based therapies for neurodegenerative diseases, such as Parkinson's disease. Baboons possess crucial neuroanatomical and immunological similarities to humans, and baboon pluripotent stem cells can be differentiated into functional neurons that mimic those in the human brain, thus laying the foundation for the utility of the baboon model for evaluating stem cell therapies.

Ventral Tegmental Area Afferents and Drug-Dependent Behaviors.

Drug-related behaviors in both humans and rodents are commonly thought to arise from aberrant learning processes. Preclinical studies demonstrate that the acquisition and expression of many drug-dependent behaviors involves the ventral tegmental area (VTA), a midbrain structure comprised of dopamine, GABA, and glutamate neurons. Drug experience alters the excitatory and inhibitory synaptic input onto VTA dopamine neurons, suggesting a critical role for VTA afferents in mediating the effects of drugs. In this review, we present evidence implicating the VTA in drug-related behaviors, highlight the diversity of neuronal populations in the VTA, and discuss the behavioral effects of selectively manipulating VTA afferents. Future experiments are needed to determine which VTA afferents and what neuronal populations in the VTA mediate specific drug-dependent behaviors. Further studies are also necessary for identifying the afferent-specific synaptic alterations onto dopamine and non-dopamine neurons in the VTA following drug administration. The identification of neural circuits and adaptations involved with drug-dependent behaviors can highlight potential neural targets for pharmacological and deep brain stimulation interventions to treat substance abuse disorders.

Phasic Dopamine Transmission Reflects Initiation Vigor and Exerted Effort in an Action- and Region-Specific Manner.

Initiating a reward-seeking behavior involves deciding on an action, how fast to initiate the action (initiation vigor), as well as how much effort to exert. These processes are thought to involve the mesolimbic dopamine system. Dopamine levels in the ventral striatum rise before initiating a reliably reinforced behavior. However, it is unknown whether dopamine is similarly involved with unreinforced actions (inactive lever presses, premature food port entries, insufficient number of active lever presses). Furthermore, does the dopamine response when initiating an action reflect specific aspects of motivated behavior, such as initiation vigor and exerted effort? Here, we analyzed voltammetry recordings of dopamine levels in the nucleus accumbens (NAcc) core and shell in rats working for food under a progressive ratio reinforcement schedule. We examined dopamine levels when rats initiated distinct actions (active lever presses, inactive lever presses, food port entries) that were temporally separated from cue- and reward-evoked dopamine release. Active lever pressing bouts were preceded by elevated dopamine release in the NAcc shell, as well as in the NAcc core, although only when rats exhibited high initiation vigor. Dopamine levels were transiently reduced in the NAcc core following an unreinforced food port entry and were unchanged throughout the NAcc when initiating inactive lever presses. The effort exerted and vigor to initiate a bout of active lever presses were signaled by dopamine transmission in the NAcc core, but not in the NAcc shell. These results demonstrate that the dopamine response when initiating a behavior is both region- and action-specific. SIGNIFICANCE STATEMENT: Exogenous activation of the mesolimbic dopamine system facilitates motivated behavior. However, a direct relationship has not been established between endogenous phasic dopamine transmission and measures of motivation, such as the vigor to initiate an action and the effort exerted in a bout of activity. The present work demonstrates that the dopamine response when initiating an action depends both upon where dopamine is released and what action is performed. Furthermore, dopamine reflects measures of motivated behavior selectively within the nucleus accumbens core.

Cocaine increases dopaminergic neuron and motor activity via midbrain α1 adrenergic signaling.

Cocaine reinforcement is mediated by increased extracellular dopamine levels in the forebrain. This neurochemical effect was thought to require inhibition of dopamine reuptake, but cocaine is still reinforcing even in the absence of the dopamine transporter. Here, we demonstrate that the rapid elevation in dopamine levels and motor activity elicited by cocaine involves α1 receptor activation within the ventral midbrain. Activation of α1 receptors increases dopaminergic neuron burst firing by decreasing the calcium-activated potassium channel current (SK), as well as elevates dopaminergic neuron pacemaker firing through modulation of both SK and the hyperpolarization-activated cation currents (Ih). Furthermore, we found that cocaine increases both the pacemaker and burst-firing frequency of rat ventral-midbrain dopaminergic neurons through an α1 adrenergic receptor-dependent mechanism within the ventral tegmental area and substantia nigra pars compacta. These results demonstrate the mechanism underlying the critical role of α1 adrenergic receptors in the regulation of dopamine neurotransmission and behavior by cocaine.

Phasic dopamine release in the nucleus accumbens in response to pro-social 50 kHz ultrasonic vocalizations in rats.

Rats emit ultrasonic vocalizations (USVs) that are thought to serve as situation-dependent affective signals and accomplish important communicative functions. In appetitive situations, rats produce 50 kHz USVs, whereas 22 kHz USVs occur in aversive situations. Reception of 50 kHz USVs induces social approach behavior, while 22 kHz USVs lead to freezing behavior. These opposite behavioral responses are paralleled by distinct brain activation patterns, with 50 kHz USVs, but not 22 kHz USVs, activating neurons in the nucleus accumbens (NAcc). The NAcc mediates appetitive behavior and is critically modulated by dopaminergic afferents that are known to encode the value of reward. Therefore, we hypothesized that 50 kHz USVs, but not 22 kHz USVs, elicit NAcc dopamine release. While recording dopamine signaling with fast-scan cyclic voltammetry, freely moving rats were exposed to playback of four acoustic stimuli via an ultrasonic speaker in random order: (1) 50 kHz USVs, (2) 22 kHz USVs, (3) time- and amplitude-matched white noise, and (4) background noise. Only presentation of 50 kHz USVs induced phasic dopamine release and elicited approach behavior toward the speaker. Both of these effects, neurochemical and behavioral, were most pronounced during initial playback, but then declined rapidly with subsequent presentations, indicating a close temporal relationship between the two measures. Moreover, the magnitudes of these effects during initial playback were significantly correlated. Collectively, our findings show that NAcc dopamine release encodes pro-social 50 kHz USVs, but not alarming 22 kHz USVs. Thus, our results support the hypothesis that these call types are processed in distinct neuroanatomical regions and establish a functional link between pro-social communicative signals and reward-related neurotransmission.

CRF acts in the midbrain to attenuate accumbens dopamine release to rewards but not their predictors.

Stressors affect dopamine-dependent behaviors such as motivation, although the underlying neurobiological mechanism is not well defined. We report that corticotropin-releasing factor (CRF) acts in the ventral tegmental area (VTA) to reduce the motivation to work for food rewards. CRF in the VTA regulates dopamine output in a stimulus- and pathway-specific manner, offering a mechanism by which acute stress selectively regulates information transmission via the VTA to reprioritize motivated behavior.

Lack of GPR88 enhances medium spiny neuron activity and alters motor- and cue-dependent behaviors.

The striatum regulates motor control, reward and learning. Abnormal function of striatal GABAergic medium spiny neurons (MSNs) is believed to contribute to the deficits in these processes that are observed in many neuropsychiatric diseases. The orphan G protein-coupled receptor GPR88 is robustly expressed in MSNs and is regulated by neuropharmacological drugs, but its contribution to MSN physiology and behavior is unclear. We found that, in the absence of GPR88, MSNs showed increased glutamatergic excitation and reduced GABAergic inhibition, which promoted enhanced firing rates in vivo, resulting in hyperactivity, poor motor coordination and impaired cue-based learning in mice. Targeted viral expression of GPR88 in MSNs rescued the molecular and electrophysiological properties and normalized behavior, suggesting that aberrant MSN activation in the absence of GPR88 underlies behavioral deficits and its dysfunction may contribute to behaviors observed in neuropsychiatric disease.