Ventral tegmental area dopamine projections to the hippocampus trigger long-term potentiation and contextual learning.

In most models of neuronal plasticity and memory, dopamine is thought to promote the long-term maintenance of Long-Term Potentiation (LTP) underlying memory processes, but not the initiation of plasticity or new information storage. Here, we used optogenetic manipulation of midbrain dopamine neurons in male DAT::Cre mice, and discovered that stimulating the Schaffer collaterals - the glutamatergic axons connecting CA3 and CA1 regions - of the dorsal hippocampus concomitantly with midbrain dopamine terminals within a 200 millisecond time-window triggers LTP at glutamatergic synapses. Moreover, we showed that the stimulation of this dopaminergic pathway facilitates contextual learning in awake behaving mice, while its inhibition hinders it. Thus, activation of midbrain dopamine can operate as a teaching signal that triggers NeoHebbian LTP and promotes supervised learning.

A dopamine mechanism for reward maximization.

Individual survival and evolutionary selection require biological organisms to maximize reward. Economic choice theories define the necessary and sufficient conditions, and neuronal signals of decision variables provide mechanistic explanations. Reinforcement learning (RL) formalisms use predictions, actions, and policies to maximize reward. Midbrain dopamine neurons code reward prediction errors (RPE) of subjective reward value suitable for RL. Electrical and optogenetic self-stimulation experiments demonstrate that monkeys and rodents repeat behaviors that result in dopamine excitation. Dopamine excitations reflect positive RPEs that increase reward predictions via RL; against increasing predictions, obtaining similar dopamine RPE signals again requires better rewards than before. The positive RPEs drive predictions higher again and thus advance a recursive reward-RPE-prediction iteration toward better and better rewards. Agents also avoid dopamine inhibitions that lower reward prediction via RL, which allows smaller rewards than before to elicit positive dopamine RPE signals and resume the iteration toward better rewards. In this way, dopamine RPE signals serve a causal mechanism that attracts agents via RL to the best rewards. The mechanism improves daily life and benefits evolutionary selection but may also induce restlessness and greed.

Functional diversity of dopamine axons in prefrontal cortex during classical conditioning.

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

Ventral pallidum GABA and glutamate neurons drive approach and avoidance through distinct modulation of VTA cell types.

The ventral pallidum (VP) contains GABA and glutamate neurons projecting to ventral tegmental area (VTA) whose stimulation drives approach and avoidance, respectively. Yet little is known about the mechanisms by which VP cell types shape VTA activity and drive behavior. Here, we found that both VP GABA and glutamate neurons were activated during approach to reward or by delivery of an aversive stimulus. Stimulation of VP GABA neurons inhibited VTA GABA, but activated dopamine and glutamate neurons. Remarkably, stimulation-evoked activation was behavior-contingent such that VTA recruitment was inhibited when evoked by the subject's own action. Conversely, VP glutamate neurons activated VTA GABA, as well as dopamine and glutamate neurons, despite driving aversion. However, VP glutamate neurons evoked dopamine in aversion-associated ventromedial nucleus accumbens (NAc), but reduced dopamine release in reward-associated dorsomedial NAc. These findings show how heterogeneous VP projections to VTA can be engaged to shape approach and avoidance behaviors.

Distributional coding of associative learning in discrete populations of midbrain dopamine neurons.

Midbrain dopamine neurons are thought to play key roles in learning by conveying the difference between expected and actual outcomes. Recent evidence suggests diversity in dopamine signaling, yet it remains poorly understood how heterogeneous signals might be organized to facilitate the role of downstream circuits mediating distinct aspects of behavior. Here, we investigated the organizational logic of dopaminergic signaling by recording and labeling individual midbrain dopamine neurons during associative behavior. Our findings show that reward information and behavioral parameters are not only heterogeneously encoded but also differentially distributed across populations of dopamine neurons. Retrograde tracing and fiber photometry suggest that populations of dopamine neurons projecting to different striatal regions convey distinct signals. These data, supported by computational modeling, indicate that such distributional coding can maximize dynamic range and tailor dopamine signals to facilitate specialized roles of different striatal regions.

Dopamine encoding of novelty facilitates efficient uncertainty-driven exploration.

When facing an unfamiliar environment, animals need to explore to gain new knowledge about which actions provide reward, but also put the newly acquired knowledge to use as quickly as possible. Optimal reinforcement learning strategies should therefore assess the uncertainties of these action-reward associations and utilise them to inform decision making. We propose a novel model whereby direct and indirect striatal pathways act together to estimate both the mean and variance of reward distributions, and mesolimbic dopaminergic neurons provide transient novelty signals, facilitating effective uncertainty-driven exploration. We utilised electrophysiological recording data to verify our model of the basal ganglia, and we fitted exploration strategies derived from the neural model to data from behavioural experiments. We also compared the performance of directed exploration strategies inspired by our basal ganglia model with other exploration algorithms including classic variants of upper confidence bound (UCB) strategy in simulation. The exploration strategies inspired by the basal ganglia model can achieve overall superior performance in simulation, and we found qualitatively similar results in fitting model to behavioural data compared with the fitting of more idealised normative models with less implementation level detail. Overall, our results suggest that transient dopamine levels in the basal ganglia that encode novelty could contribute to an uncertainty representation which efficiently drives exploration in reinforcement learning.

Convergence of oxytocin and dopamine signalling in neuronal circuits: Insights into the neurobiology of social interactions across species.

Social behaviour is essential for animal survival, and the hypothalamic neuropeptide oxytocin (OXT) critically impacts bonding, parenting, and decision-making. Dopamine (DA), is released by ventral tegmental area (VTA) dopaminergic neurons, regulating social cues in the mesolimbic system. Despite extensive exploration of OXT and DA roles in social behaviour independently, limited studies investigate their interplay. This narrative review integrates insights from human and animal studies, particularly rodents, emphasising recent research on pharmacological manipulations of OXT or DA systems in social behaviour. Additionally, we review studies correlating social behaviour with blood/cerebral OXT and DA levels. Behavioural facets include sociability, cooperation, pair bonding and parental care. In addition, we provide insights into OXT-DA interplay in animal models of social stress, autism, and schizophrenia. Emphasis is placed on the complex relationship between the OXT and DA systems and their collective influence on social behaviour across physiological and pathological conditions. Understanding OXT and DA imbalance is fundamental for unravelling the neurobiological underpinnings of social interaction and reward processing deficits observed in psychiatric conditions.

Role of dopamine neurons in familiarity.

Dopamine neurons signal the salience of environmental stimuli and influence learning, although it is less clear if these neurons also determine the salience of memories. Ventral tegmental area (VTA) dopamine neurons increase their firing in the presence of new objects and reduce it upon repeated, inconsequential exposures, marking the shift from novelty to familiarity. This study investigates how dopamine neuron activity during repeated familiar object exposure affects an animal's preference for new objects in a subsequent novel object recognition (NOR) test. We hypothesize that a single familiarization session will not sufficiently lower dopamine activity, such that the memory of a familiar object remains salient, leading to equal exploration of familiar and novel objects and weaker NOR discrimination. In contrast, multiple familiarization sessions likely suppress dopamine activity more effectively, reducing the salience of the familiar object and enhancing subsequent novelty discrimination. Our experiments in mice indicated that multiple familiarization sessions reduce VTA dopamine neuron activation, as measured by c-Fos expression, and enhance novelty discrimination compared with a single familiarization session. Dopamine neurons that show responsiveness to novelty were primarily located in the paranigral nucleus of the VTA and expressed vesicular glutamate transporter 2 transcripts, marking them as dopamine-glutamate neurons. Chemogenetic inhibition of dopamine neurons during a single session paralleled the effects of multiple sessions, improving NOR. These findings suggest that a critical role of dopamine neurons during the transition from novelty to familiarity is to modulate the salience of an object's memory.

Association between RMTg Neuropeptide Genes and Negative Effect during Alcohol Withdrawal in Mice.

Alcohol use disorders (AUDs) frequently co-occur with negative mood disorders, such as anxiety and depression, exacerbating relapse through dopaminergic dysfunction. Stress-related neuropeptides play a crucial role in AUD pathophysiology by modulating dopamine (DA) function. The rostromedial tegmental nucleus (RMTg), which inhibits midbrain dopamine neurons and signals aversion, has been shown to increase ethanol consumption and negative emotional states during abstinence. Despite some stress-related neuropeptides acting through the RMTg to affect addiction behaviors, their specific roles in alcohol-induced contexts remain underexplored. This study utilized an intermittent voluntary drinking model in mice to induce negative effect behavior 24 h into ethanol (EtOH) abstinence (post-EtOH). It examined changes in pro-stress (Pnoc, Oxt, Npy) and anti-stress (Crf, Pomc, Avp, Orx, Pdyn) neuropeptide-coding genes and analyzed their correlations with aversive behaviors. We observed that adult male C57BL/6J mice displayed evident anxiety, anhedonia, and depression-like symptoms at 24 h post-EtOH. The laser-capture microdissection technique, coupled with or without retrograde tracing, was used to harvest total ventral tegmental area (VTA)-projecting neurons or the intact RMTg area. The findings revealed that post-EtOH consistently reduced Pnoc and Orx levels while elevating Crf levels in these neuronal populations. Notably, RMTg Pnoc and Npy levels counteracted ethanol consumption and depression severity, while Crf levels were indicative of the mice's anxiety levels. Together, these results underscore the potential role of stress-related neuropeptides in the RMTg in regulating the negative emotions related to AUDs, offering novel insights for future research.

The dynamic state of a prefrontal-hypothalamic-midbrain circuit commands behavioral transitions.

Innate behaviors meet multiple needs adaptively and in a serial order, suggesting the existence of a hitherto elusive brain dynamics that brings together representations of upcoming behaviors during their selection. Here we show that during behavioral transitions, possible upcoming behaviors are encoded by specific signatures of neuronal populations in the lateral hypothalamus (LH) that are active near beta oscillation peaks. Optogenetic recruitment of intrahypothalamic inhibition at this phase eliminates behavioral transitions. We show that transitions are elicited by beta-rhythmic inputs from the prefrontal cortex that spontaneously synchronize with LH 'transition cells' encoding multiple behaviors. Downstream of the LH, dopamine neurons increase firing during beta oscillations and also encode behavioral transitions. Thus, a hypothalamic transition state signals alternative future behaviors, encodes the one most likely to be selected and enables rapid coordination with cognitive and reward-processing circuitries, commanding adaptive social contact and eating behaviors.

Knockdown of Lhx6 during embryonic development results in neurophysiological alterations and behavioral deficits analogous to schizophrenia in adult rats.

A decreased expression of specific interneuron subtypes, containing either the calcium binding protein parvalbumin (PV) or the neurotransmitter somatostatin (SST), are observed in the cortex and hippocampus of both patients with schizophrenia and rodent models used to study the disorder. Moreover, preclinical studies suggest that this loss of inhibitory function is a key pathological mechanism underlying the symptoms of schizophrenia. Interestingly, decreased expression of Lhx6, a key transcriptional regulator specific to the development and migration of PV and SST interneurons, is seen in human postmortem studies and following multiple developmental disruptions used to model schizophrenia preclinically. These results suggest that disruptions in interneuron development in utero may contribute to the pathology of the disorder. To recapitulate decreased Lhx6 expression during development, we used in utero electroporation to introduce an Lhx6 shRNA plasmid and knockdown Lhx6 expression in the brains of rats on gestational day 17. We then examined schizophrenia-like neurophysiological and behavioral alterations in the offspring once they reached adulthood. In utero Lhx6 knockdown resulted in increased ventral tegmental area (VTA) dopamine neuron population activity and a sex-specific increase in locomotor response to a psychotomimetic, consistent with positive symptomology of schizophrenia. However, Lhx6 knockdown had no effect on social interaction or spatial working memory, suggesting behaviors associated with negative and cognitive symptom domains were unaffected. These results suggest that knockdown of Lhx6 during development results in neurophysiological and behavioral alterations consistent with the positive symptom domain of schizophrenia in adult rats.

Ultrasound Stimulation Attenuates CRS-Induced Depressive Behavior by Modulating Dopamine Release in the Prefrontal Cortex.

Depression is one of the most serious mental disorders affecting modern human life and is often caused by chronic stress. Dopamine system dysfunction is proposed to contribute to the pathophysiology of chronic stress, especially the ventral tegmental area (VTA) which mainly consists of dopaminergic neurons. Focused ultrasound stimulation (FUS) is a promising neuromodulation modality and multiple studies have demonstrated effective ultrasonic activation of cortical, subcortical, and related networks. However, the effects of FUS on the dopamine system and the potential link to chronic stress-induced depressive behaviors are relatively unknown. Here, we measured the effects of FUS targeting VTA on the improvement of depression-like behavior and evaluated the dopamine concentration in the downstream region - medial prefrontal cortex (mPFC). We found that targeting VTA FUS treatment alleviated chronic restraint stress (CRS) -induced anhedonia and despair behavior. Using an in vivo photometry approach, we analyzed the dopamine signal of mPFC and revealed a significant increase following the FUS, positively associated with the improvement of anhedonia behavior. FUS also protected the dopaminergic neurons in VTA from the damage caused by CRS exposure. Thus, these results demonstrated that targeting VTA FUS treatment significantly rescued the depressive-like behavior and declined dopamine level of mPFC induced by CRS. These beneficial effects of FUS might be due to protection in the DA neuron of VTA. Our findings suggest that FUS treatment could serve as a new therapeutic strategy for the treatment of stress-related disorders.

Dopamine neuron activity encodes the length of upcoming contralateral movement sequences.

Dopaminergic neurons (DANs) in the substantia nigra pars compacta (SNc) have been related to movement speed, and loss of these neurons leads to bradykinesia in Parkinson's disease (PD). However, other aspects of movement vigor are also affected in PD; for example, movement sequences are typically shorter. However, the relationship between the activity of DANs and the length of movement sequences is unknown. We imaged activity of SNc DANs in mice trained in a freely moving operant task, which relies on individual forelimb sequences. We uncovered a similar proportion of SNc DANs increasing their activity before either ipsilateral or contralateral sequences. However, the magnitude of this activity was higher for contralateral actions and was related to contralateral but not ipsilateral sequence length. In contrast, the activity of reward-modulated DANs, largely distinct from those modulated by movement, was not lateralized. Finally, unilateral dopamine depletion impaired contralateral, but not ipsilateral, sequence length. These results indicate that movement-initiation DANs encode more than a general motivation signal and invigorate aspects of contralateral movements.

Local regulation of striatal dopamine: A diversity of circuit mechanisms for a diversity of behavioral functions?

Striatal dopamine governs a wide range of behavioral functions, yet local dopamine concentrations can be dissociated from somatic activity. Here, we discuss how dopamine's diverse roles in behavior may be driven by local circuit mechanisms shaping dopamine release. We first look at historical and recent work demonstrating that striatal circuits interact with dopaminergic terminals to either initiate the release of dopamine or modulate the release of dopamine initiated by spiking in midbrain dopamine neurons, with particular attention to GABAergic and cholinergic local circuit mechanisms. Then we discuss some of the first in vivo studies of acetylcholine-dopamine interactions in striatum and broadly discuss necessary future work in understanding the roles of midbrain versus striatal dopamine regulation.

Heterogeneity of mesencephalic dopaminergic neurons: From molecular classifications, electrophysiological properties to functional connectivity.

The mesencephalic dopamine (DA) system is composed of neuronal subtypes that are molecularly and functionally distinct, are responsible for specific behaviors, and are closely associated with numerous brain disorders. Existing research has made significant advances in identifying the heterogeneity of mesencephalic DA neurons, which is necessary for understanding their diverse physiological functions and disease susceptibility. Moreover, there is a conflict regarding the electrophysiological properties of the distinct subsets of midbrain DA neurons. This review aimed to elucidate recent developments in the heterogeneity of midbrain DA neurons, including subpopulation categorization, electrophysiological characteristics, and functional connectivity to provide new strategies for accurately identifying distinct subtypes of midbrain DA neurons and investigating the underlying mechanisms of these neurons in various diseases.

An ACC-VTA-ACC positive-feedback loop mediates the persistence of neuropathic pain and emotional consequences.

The central mechanisms underlying pain chronicity remain elusive. Here, we identify a reciprocal neuronal circuit in mice between the anterior cingulate cortex (ACC) and the ventral tegmental area (VTA) that mediates mutual exacerbation between hyperalgesia and allodynia and their emotional consequences and, thereby, the chronicity of neuropathic pain. ACC glutamatergic neurons (ACCGlu) projecting to the VTA indirectly inhibit dopaminergic neurons (VTADA) by activating local GABAergic interneurons (VTAGABA), and this effect is reinforced after nerve injury. VTADA neurons in turn project to the ACC and synapse to the initial ACCGlu neurons to convey feedback information from emotional changes. Thus, an ACCGlu-VTAGABA-VTADA-ACCGlu positive-feedback loop mediates the progression to and maintenance of persistent pain and comorbid anxiodepressive-like behavior. Disruption of this feedback loop relieves hyperalgesia and anxiodepressive-like behavior in a mouse model of neuropathic pain, both acutely and in the long term.

Dopamine regulates attitude toward risk.

Specific brain pathways can lower or raise the willingness of monkeys to take risks.

Sensory Cues Potentiate VTA Dopamine Mediated Reinforcement.

Sensory cues are critical for shaping decisions and invigorating actions during reward seeking. Dopamine neurons in the ventral tegmental area (VTA) are central in this process, supporting associative learning in Pavlovian and instrumental settings. Studies of intracranial self-stimulation (ICSS) behavior, which show that animals will work hard to receive stimulation of dopamine neurons, support the notion that dopamine transmits a reward or value signal to support learning. Recent studies have begun to question this, however, emphasizing dopamine's value-free functions, leaving its contribution to behavioral reinforcement somewhat muddled. Here, we investigated the role of sensory stimuli in dopamine-mediated reinforcement, using an optogenetic ICSS paradigm in tyrosine hydroxylase (TH)-Cre rats. We find that while VTA dopamine neuron activation in the absence of explicit external cues is sufficient to maintain robust self-stimulation, the presence of cues dramatically potentiates ICSS behavior. Our results support a framework where dopamine can have some base value as a reinforcer, but the impact of this signal is modulated heavily by the sensory learning context.

Combining physical & cognitive training with iPSC-derived dopaminergic neuron transplantation promotes graft integration & better functional outcome in parkinsonian marmosets.

Parkinson's disease (PD) is a relentlessly progressive and currently incurable neurodegenerative disease with significant unmet medical needs. Since PD stems from the degeneration of midbrain dopaminergic (DA) neurons in a defined brain location, PD patients are considered optimal candidates for cell replacement therapy. Clinical trials for cell transplantation in PD are beginning to re-emerge worldwide with a new focus on induced pluripotent stem cells (iPSCs) as a source of DA neurons since they can be derived from adult somatic cells and produced in large quantities under current good manufacturing practices. However, for this therapeutic strategy to be realized as a viable clinical option, fundamental translational challenges need to be addressed including the manufacturing process, purity and efficacy of the cells, the method of delivery, the extent of host reinnervation and the impact of patient-centered adjunctive interventions. In this study we report on the impact of physical and cognitive training (PCT) on functional recovery in the nonhuman primate (NHP) model of PD after cell transplantation. We observed that at 6 months post-transplant, the PCT group returned to normal baseline in their daily activity measured by actigraphy, significantly improved in their sensorimotor and cognitive tasks, and showed enhanced synapse formation between grafted cells and host cells. We also describe a robust, simple, efficient, scalable, and cost-effective manufacturing process of engraftable DA neurons derived from iPSCs. This study suggests that integrating PCT with cell transplantation therapy could promote optimal graft functional integration and better outcome for patients with PD.

Glutamate inputs send prediction error of reward, but not negative value of aversive stimuli, to dopamine neurons.

Midbrain dopamine neurons are thought to signal reward prediction errors (RPEs), but the mechanisms underlying RPE computation, particularly the contributions of different neurotransmitters, remain poorly understood. Here, we used a genetically encoded glutamate sensor to examine the pattern of glutamate inputs to dopamine neurons in mice. We found that glutamate inputs exhibit virtually all of the characteristics of RPE rather than conveying a specific component of RPE computation, such as reward or expectation. Notably, whereas glutamate inputs were transiently inhibited by reward omission, they were excited by aversive stimuli. Opioid analgesics altered dopamine negative responses to aversive stimuli into more positive responses, whereas excitatory responses of glutamate inputs remained unchanged. Our findings uncover previously unknown synaptic mechanisms underlying RPE computations; dopamine responses are shaped by both synergistic and competitive interactions between glutamatergic and GABAergic inputs to dopamine neurons depending on valences, with competitive interactions playing a role in responses to aversive stimuli.