State and rate-of-change encoding in parallel mesoaccumbal dopamine pathways.

The nervous system uses fast- and slow-adapting sensory detectors in parallel to enable neuronal representations of external states and their temporal dynamics. It is unknown whether this dichotomy also applies to internal representations that have no direct correlation in the physical world. Here we find that two distinct dopamine (DA) neuron subtypes encode either a state or its rate-of-change. In mice performing a reward-seeking task, we found that the animal's behavioral state and rate-of-change were encoded by the sustained activity of DA neurons in medial ventral tegmental area (VTA) DA neurons and transient activity in lateral VTA DA neurons, respectively. The neural activity patterns of VTA DA cell bodies matched DA release patterns within anatomically defined mesoaccumbal pathways. Based on these results, we propose a model in which the DA system uses two parallel lines for proportional-differential encoding of a state variable and its temporal dynamics.

A computational analysis of mouse behavior in the sucrose preference test.

The sucrose preference test (SPT) measures the relative preference of sucrose over water to assess hedonic behaviors in rodents. Yet, it remains uncertain to what extent the SPT reflects other behavioral components, such as learning, memory, motivation, and choice. Here, we conducted an experimental and computational decomposition of mouse behavior in the SPT and discovered previously unrecognized behavioral subcomponents associated with changes in sucrose preference. We show that acute and chronic stress have sex-dependent effects on sucrose preference, but anhedonia was observed only in response to chronic stress in male mice. Additionally, reduced sucrose preference induced by optogenetics is not always indicative of anhedonia but can also reflect learning deficits. Even small variations in experimental conditions influence behavior, task outcome and interpretation. Thus, an ostensibly simple behavioral task can entail high levels of complexity, demonstrating the need for careful dissection of behavior into its subcomponents when studying the underlying neurobiology.

An inhibitory brainstem input to dopamine neurons encodes nicotine aversion.

Nicotine stimulates the dopamine (DA) system, which is essential for its rewarding effect. Nicotine is also aversive at high doses; yet, our knowledge about nicotine's dose-dependent effects on DA circuits remains limited. Here, we demonstrate that high doses of nicotine, which induce aversion-related behavior in mice, cause biphasic inhibitory and excitatory responses in VTA DA neurons that can be dissociated by distinct projections to lateral and medial nucleus accumben subregions, respectively. Guided by computational modeling, we performed a pharmacological investigation to establish that inhibitory effects of aversive nicotine involve desensitization of α4ß2 and activation of α7 nicotinic acetylcholine receptors. We identify α7-dependent activation of upstream GABA neurons in the laterodorsal tegmentum (LDT) as a key regulator of heterogeneous DA release following aversive nicotine. Finally, inhibition of LDT GABA terminals in VTA prevents nicotine aversion. Together, our findings provide a mechanistic circuit-level understanding of nicotine's dose-dependent effects on reward and aversion.

Mesoaccumbal Dopamine Heterogeneity: What Do Dopamine Firing and Release Have to Do with It?

Ventral tegmental area (VTA) dopamine (DA) neurons are often thought to uniformly encode reward prediction errors. Conversely, DA release in the nucleus accumbens (NAc), the prominent projection target of these neurons, has been implicated in reinforcement learning, motivation, aversion, and incentive salience. This contrast between heterogeneous functions of DA release versus a homogeneous role for DA neuron activity raises numerous questions regarding how VTA DA activity translates into NAc DA release. Further complicating this issue is increasing evidence that distinct VTA DA projections into defined NAc subregions mediate diverse behavioral functions. Here, we evaluate evidence for heterogeneity within the mesoaccumbal DA system and argue that frameworks of DA function must incorporate the precise topographic organization of VTA DA neurons to clarify their contribution to health and disease.

Pain modulates dopamine neurons via a spinal-parabrachial-mesencephalic circuit.

Pain decreases the activity of many ventral tegmental area (VTA) dopamine (DA) neurons, yet the underlying neural circuitry connecting nociception and the DA system is not understood. Here we show that a subpopulation of lateral parabrachial (LPB) neurons is critical for relaying nociceptive signals from the spinal cord to the substantia nigra pars reticulata (SNR). SNR-projecting LPB neurons are activated by noxious stimuli and silencing them blocks pain responses in two different models of pain. LPB-targeted and nociception-recipient SNR neurons regulate VTA DA activity directly through feed-forward inhibition and indirectly by inhibiting a distinct subpopulation of VTA-projecting LPB neurons thereby reducing excitatory drive onto VTA DA neurons. Correspondingly, ablation of SNR-projecting LPB neurons is sufficient to reduce pain-mediated inhibition of DA release in vivo. The identification of a neural circuit conveying nociceptive input to DA neurons is critical to our understanding of how pain influences learning and behavior.

Relocation of an Extrasynaptic GABAA Receptor to Inhibitory Synapses Freezes Excitatory Synaptic Strength and Preserves Memory.

The excitatory synapse between hippocampal CA3 and CA1 pyramidal neurons exhibits long-term potentiation (LTP), a positive feedback process implicated in learning and memory in which postsynaptic depolarization strengthens synapses, promoting further depolarization. Without mechanisms for interrupting positive feedback, excitatory synapses could strengthen inexorably, corrupting memory storage. Here, we reveal a hidden form of inhibitory synaptic plasticity that prevents accumulation of excitatory LTP. We developed a knockin mouse that allows optical control of endogenous α5-subunit-containing γ-aminobutyric acid (GABA)A receptors (α5-GABARs). Induction of excitatory LTP relocates α5-GABARs, which are ordinarily extrasynaptic, to inhibitory synapses, quashing further NMDA receptor activation necessary for inducing more excitatory LTP. Blockade of α5-GABARs accelerates reversal learning, a behavioral test for cognitive flexibility dependent on repeated LTP. Hence, inhibitory synaptic plasticity occurs in parallel with excitatory synaptic plasticity, with the ensuing interruption of the positive feedback cycle of LTP serving as a possible critical early step in preserving memory.

Dopaminergic Control over the Tripartite Synapse.

In this issue of Neuron, Corkrum et al. (2020) demonstrate an unexpected role for dopamine D1 receptors on astrocytes located in the nucleus accumbens, a key structure of the brain's reward system. Activation of these receptors mediates dopamine-evoked depression of excitatory synaptic transmission, which contributes to amphetamine's psychomotor effects.

Chronic Stress Induces Activity, Synaptic, and Transcriptional Remodeling of the Lateral Habenula Associated with Deficits in Motivated Behaviors.

Chronic stress (CS) is a major risk factor for the development of depression. Here, we demonstrate that CS-induced hyperactivity in ventral tegmental area (VTA)-projecting lateral habenula (LHb) neurons is associated with increased passive coping (PC), but not anxiety or anhedonia. LHb→VTA neurons in mice with increased PC show increased burst and tonic firing as well as synaptic adaptations in excitatory inputs from the entopeduncular nucleus (EP). In vivo manipulations of EP→LHb or LHb→VTA neurons selectively alter PC and effort-related motivation. Conversely, dorsal raphe (DR)-projecting LHb neurons do not show CS-induced hyperactivity and are targeted indirectly by the EP. Using single-cell transcriptomics, we reveal a set of genes that can collectively serve as biomarkers to identify mice with increased PC and differentiate LHb→VTA from LHb→DR neurons. Together, we provide a set of biological markers at the level of genes, synapses, cells, and circuits that define a distinctive CS-induced behavioral phenotype.

Characterization of transgenic mouse models targeting neuromodulatory systems reveals organizational principles of the dorsal raphe.

The dorsal raphe (DR) is a heterogeneous nucleus containing dopamine (DA), serotonin (5HT), γ-aminobutyric acid (GABA) and glutamate neurons. Consequently, investigations of DR circuitry require Cre-driver lines that restrict transgene expression to precisely defined cell populations. Here, we present a systematic evaluation of mouse lines targeting neuromodulatory cells in the DR. We find substantial differences in specificity between lines targeting DA neurons, and in penetrance between lines targeting 5HT neurons. Using these tools to map DR circuits, we show that populations of neurochemically distinct DR neurons are arranged in a stereotyped topographical pattern, send divergent projections to amygdala subnuclei, and differ in their presynaptic inputs. Importantly, targeting DR DA neurons using different mouse lines yielded both structural and functional differences in the neural circuits accessed. These results provide a refined model of DR organization and support a comparative, case-by-case evaluation of the suitability of transgenic tools for any experimental application.

A Neural Circuit Mechanism for Encoding Aversive Stimuli in the Mesolimbic Dopamine System.

Ventral tegmental area (VTA) dopamine (DA) neurons play a central role in mediating motivated behaviors, but the circuitry through which they signal positive and negative motivational stimuli is incompletely understood. Using in vivo fiber photometry, we simultaneously recorded activity in DA terminals in different nucleus accumbens (NAc) subnuclei during an aversive and reward conditioning task. We find that DA terminals in the ventral NAc medial shell (vNAcMed) are excited by unexpected aversive outcomes and to cues that predict them, whereas DA terminals in other NAc subregions are persistently depressed. Excitation to reward-predictive cues dominated in the NAc lateral shell and was largely absent in the vNAcMed. Moreover, we demonstrate that glutamatergic (VGLUT2-expressing) neurons in the lateral hypothalamus represent a key afferent input for providing information about aversive outcomes to vNAcMed-projecting DA neurons. Collectively, we reveal the distinct functional contributions of separate mesolimbic DA subsystems and their afferent pathways underlying motivated behaviors. VIDEO ABSTRACT.

A neuronal mechanism underlying decision-making deficits during hyperdopaminergic states.

Hyperdopaminergic states in mental disorders are associated with disruptive deficits in decision making. However, the precise contribution of topographically distinct mesencephalic dopamine pathways to decision-making processes remains elusive. Here we show, using a multidisciplinary approach, how hyperactivity of ascending projections from the ventral tegmental area (VTA) contributes to impaired flexible decision making in rats. Activation of the VTA-nucleus accumbens pathway leads to insensitivity to loss and punishment due to impaired processing of negative reward prediction errors. In contrast, activation of the VTA-prefrontal cortex pathway promotes risky decision making without affecting the ability to choose the economically most beneficial option. Together, these findings show how malfunction of ascending VTA projections affects value-based decision making, suggesting a potential mechanism through which increased forebrain dopamine signaling leads to aberrant behavior, as is seen in substance abuse, mania, and after dopamine replacement therapy in Parkinson's disease.

Nucleus Accumbens Subnuclei Regulate Motivated Behavior via Direct Inhibition and Disinhibition of VTA Dopamine Subpopulations.

Mesolimbic dopamine (DA) neurons play a central role in motivation and reward processing. Although the activity of these mesolimbic DA neurons is controlled by afferent inputs, little is known about the circuits in which they are embedded. Using retrograde tracing, electrophysiology, optogenetics, and behavioral assays, we identify principles of afferent-specific control in the mesolimbic DA system. Neurons in the medial shell subdivision of the nucleus accumbens (NAc) exert direct inhibitory control over two separate populations of mesolimbic DA neurons by activating different GABA receptor subtypes. In contrast, NAc lateral shell neurons mainly synapse onto ventral tegmental area (VTA) GABA neurons, resulting in disinhibition of DA neurons that project back to the NAc lateral shell. Lastly, we establish a critical role for NAc subregion-specific input to the VTA underlying motivated behavior. Collectively, our results suggest a distinction in the incorporation of inhibitory inputs between different subtypes of mesolimbic DA neurons.

Enhancing excitability of dopamine neurons promotes motivational behaviour through increased action initiation.

Motivational deficits are a key symptom in multiple psychiatric disorders, including major depressive disorder, schizophrenia and addiction. A likely neural substrate for these motivational deficits is the brain dopamine (DA) system. In particular, DA signalling in the nucleus accumbens, which originates from DA neurons in the ventral tegmental area (VTA), has been identified as a crucial substrate for effort-related and activational aspects of motivation. Unravelling how VTA DA neuronal activity relates to motivational behaviours is required to understand how motivational deficits in psychiatry can be specifically targeted. In this study, we therefore used designer receptors exclusively activated by designer drugs (DREADD) in TH:Cre rats, in order to determine the effects of chemogenetic DA neuron activation on different aspects of motivational behaviour. We found that chemogenetic activation of DA neurons in the VTA, but not substantia nigra, significantly increased responding for sucrose under a progressive ratio schedule of reinforcement. More specifically, high effort exertion was characterized by increased initiations of reward-seeking actions. This effect was dependent on effort requirements and instrumental contingencies, but was not affected by sucrose pre-feeding. Together, these findings indicate that VTA DA neuronal activation drives motivational behaviour by facilitating action initiation. With this study, we show that enhancing excitability of VTA DA neurons is a viable strategy to improve motivational behaviour.

A novel approach to map induced activation of neuronal networks using chemogenetics and functional neuroimaging in rats: A proof-of-concept study on the mesocorticolimbic system.

Linking neural circuit activation at whole-brain level to neuronal activity at cellular level remains one of the major challenges in neuroscience research. We set up a novel functional neuroimaging approach to map global effects of locally induced activation of specific midbrain projection neurons using chemogenetics (Designer Receptors Exclusively Activated by Designer Drugs (DREADD)-technology) combined with pharmacological magnetic resonance imaging (phMRI) in the rat mesocorticolimbic system. Chemogenetic activation of DREADD-targeted mesolimbic or mesocortical pathways, i.e. projections from the ventral tegmental area (VTA) to the nucleus accumbens (NAcc) or medial prefrontal cortex (mPFC), respectively, induced significant blood oxygenation level-dependent (BOLD) responses in areas with DREADD expression, but also in remote defined neural circuitry without DREADD expression. The time-course of brain activation corresponded with the behavioral output measure, i.e. locomotor (hyper)activity, in the mesolimbic pathway-targeted group. Chemogenetic activation specifically increased neuronal activity, whereas functional connectivity assessed with resting state functional MRI (rs-fMRI) remained stable. Positive and negative BOLD responses distinctively reflected simultaneous ventral pallidum activation and substantia nigra pars reticulata deactivation, respectively, demonstrating the concept of mesocorticolimbic network activity with concurrent activation of the direct and indirect pathways following stimulation of specific midbrain projection neurons. The presented methodology provides straightforward and widely applicable opportunities to elucidate relationships between local neuronal activity and global network activity in a controllable manner, which will increase our understanding of the functioning and dysfunctioning of large-scale neuronal networks in health and disease.

Reducing Ventral Tegmental Dopamine D2 Receptor Expression Selectively Boosts Incentive Motivation.

Altered mesolimbic dopamine signaling has been widely implicated in addictive behavior. For the most part, this work has focused on dopamine within the striatum, but there is emerging evidence for a role of the auto-inhibitory, somatodendritic dopamine D2 receptor (D2R) in the ventral tegmental area (VTA) in addiction. Thus, decreased midbrain D2R expression has been implicated in addiction in humans. Moreover, knockout of the gene encoding the D2R receptor (Drd2) in dopamine neurons has been shown to enhance the locomotor response to cocaine in mice. Therefore, we here tested the hypothesis that decreasing D2R expression in the VTA of adult rats, using shRNA knockdown, promotes addiction-like behavior in rats responding for cocaine or palatable food. Rats with decreased VTA D2R expression showed markedly increased motivation for both sucrose and cocaine under a progressive ratio schedule of reinforcement, but the acquisition or maintenance of cocaine self-administration were not affected. They also displayed enhanced cocaine-induced locomotor activity, but no change in basal locomotion. This robust increase in incentive motivation was behaviorally specific, as we did not observe any differences in fixed ratio responding, extinction responding, reinstatement or conditioned suppression of cocaine, and sucrose seeking. We conclude that VTA D2R knockdown results in increased incentive motivation, but does not directly promote other aspects of addiction-like behavior.

FTO knockdown in rat ventromedial hypothalamus does not affect energy balance.

Single nucleotide polymorphisms (SNPs) clustered in the first intron of the fat mass and obesity-associated (FTO) gene has been associated with obesity. FTO expression is ubiquitous, with particularly high levels in the hypothalamic area of the brain. To investigate the region-specific role of FTO, AAV technology was applied to knockdown FTO in the ventromedial hypothalamus (VMH). No effect of FTO knockdown was observed on bodyweight or parameters of energy balance. Animals were exposed twice to an overnight fast, followed by a high-fat high-sucrose (HFHS) diet for 1 week. FTO knockdown did not result in a different response to the diets. A region-specific role for FTO in the VMH in the regulation of energy balance could not be found.

Combined use of the canine adenovirus-2 and DREADD-technology to activate specific neural pathways in vivo.

We here describe a technique to transiently activate specific neural pathways in vivo. It comprises the combined use of a CRE-recombinase expressing canine adenovirus-2 (CAV-2) and an adeno-associated virus (AAV-hSyn-DIO-hM3D(Gq)-mCherry) that contains the floxed inverted sequence of the designer receptor exclusively activated by designer drugs (DREADD) hM3D(Gq)-mCherry. CAV-2 retrogradely infects projection neurons, which allowed us to specifically express hM3D(Gq)-mCherry in neurons that project from the ventral tegmental area (VTA) to the nucleus accumbens (Acb), the majority of which were dopaminergic. Activation of hM3D(Gq)-mCherry by intraperitoneal (i.p.) injections of clozapine-N-oxide (CNO) leads to increases in neuronal activity, which enabled us to specifically activate VTA to Acb projection neurons. The VTA to Acb pathway is part of the mesolimbic dopamine system and has been implicated in behavioral activation and the exertion of effort. Injections of all doses of CNO led to increases in progressive ratio (PR) performance. The effect of the lowest dose of CNO was suppressed by administration of a DRD1-antagonist, suggesting that CNO-induced increases in PR-performance are at least in part mediated by DRD1-signaling. We hereby validate the combined use of CAV-2 and DREADD-technology to activate specific neural pathways and determine consequent changes in behaviorally relevant paradigms.

Low control over palatable food intake in rats is associated with habitual behavior and relapse vulnerability: individual differences.

The worldwide obesity epidemic poses an enormous and growing threat to public health. However, the neurobehavioral mechanisms of overeating and obesity are incompletely understood. It has been proposed that addiction-like processes may underlie certain forms of obesity, in particular those associated with binge eating disorder. To investigate the role of addiction-like processes in obesity, we adapted a model of cocaine addiction-like behavior in rats responding for highly palatable food. Here, we tested whether rats responding for highly palatable chocolate Ensure would come to show three criteria of addiction-like behavior, i.e., high motivation, continued seeking despite signaled non-availability and persistence of seeking despite aversive consequences. We also investigated whether exposure to a binge model (a diet consisting of alternating periods of limited food access and access to highly palatable food), promotes the appearance of food addiction-like behavior. Our data show substantial individual differences in control over palatable food seeking and taking, but no distinct subgroup of animals showing addiction-like behavior could be identified. Instead, we observed a wide range extending from low to very high control over palatable food intake. Exposure to the binge model did not affect control over palatable food seeking and taking, however. Animals that showed low control over palatable food intake (i.e., scored high on the three criteria for addiction-like behavior) were less sensitive to devaluation of the food reward and more prone to food-induced reinstatement of extinguished responding, indicating that control over palatable food intake is associated with habitual food intake and vulnerability to relapse. In conclusion, we present an animal model to assess control over food seeking and taking. Since diminished control over food intake is a major factor in the development of obesity, understanding its behavioral and neural underpinnings may facilitate improved management of the obesity epidemic.

Towards an animal model of food addiction.

The dramatically increasing prevalence of obesity, associated with potentially life-threatening health problems, including cardiovascular diseases and type II diabetes, poses an enormous public health problem. It has been proposed that the obesity epidemic can be explained by the concept of 'food addiction'. In this review we focus on possible similarities between binge eating disorder (BED), which is highly prevalent in the obese population, and drug addiction. Indeed, both behavioral and neural similarities between addiction and BED have been demonstrated. Behavioral similarities are reflected in the overlap in DSM-IV criteria for drug addiction with the (suggested) criteria for BED and by food addiction-like behavior in animals after prolonged intermittent access to palatable food. Neural similarities include the overlap in brain regions involved in food and drug craving. Decreased dopamine D2 receptor availability in the striatum has been found in animal models of binge eating, after cocaine self-administration in animals as well as in drug addiction and obesity in humans. To further explore the neurobiological basis of food addiction, it is essential to have an animal model to test the addictive potential of palatable food. A recently developed animal model for drug addiction involves three behavioral characteristics that are based on the DSM-IV criteria: i) extremely high motivation to obtain the drug, ii) difficulty in limiting drug seeking even in periods of explicit non-availability, iii) continuation of drug-seeking despite negative consequences. Indeed, it has been shown that a subgroup of rats, after prolonged cocaine self-administration, scores positive on these three criteria. If food possesses addictive properties, then food-addicted rats should also meet these criteria while searching for and consuming food. In this review we discuss evidence from literature regarding food addiction-like behavior. We also suggest future experiments that could further contribute to our understanding of behavioral and neural commonalities and differences between obesity and drug addiction.

Ghrelin mediates anticipation to a palatable meal in rats.

Food anticipatory activity (FAA) is displayed in rats when access to food is restricted to a specific time frame of their circadian phase, a behavior thought to reflect both hunger and the motivation to eat. Rats also display FAA in a feeding schedule with ad libitum access to normal chow, but limited availability of a palatable meal, which is thought to involve mainly motivational aspects. The orexigenic hormone ghrelin has been implicated in FAA in rodents with restricted access to chow. Because ghrelin plays an important role not only in the control of food intake, but also in reward, we sought to determine the role of ghrelin in anticipation to a palatable meal. Plasma ghrelin levels of non-restricted rats that anticipated chocolate correlated positively with FAA and were increased compared with chow-fed control rats. Furthermore, centrally injected ghrelin increased, whereas an antagonist of the ghrelin receptor decreased, the anticipation to chocolate. Therefore, we hypothesize that central ghrelin signaling is able to mediate the motivational drive to eat.