Short-Term Memory Capacity Predicts Willingness to Expend Cognitive Effort for Reward.

We must often decide whether the effort required for a task is worth the reward. Past rodent work suggests that willingness to deploy cognitive effort can be driven by individual differences in perceived reward value, depression, or chronic stress. However, many factors driving cognitive effort deployment-such as short-term memory ability-cannot easily be captured in rodents. Furthermore, we do not fully understand how individual differences in short-term memory ability, depression, chronic stress, and reward anticipation impact cognitive effort deployment for reward. Here, we examined whether these factors predict cognitive effort deployment for higher reward in an online visual short-term memory task. Undergraduate participants were grouped into high and low effort groups (n HighEffort = 348, n LowEffort = 81; n Female = 332, n Male = 92, M Age = 20.37, Range Age = 16-42) based on decisions in this task. After completing a monetary incentive task to measure reward anticipation, participants completed short-term memory task trials where they could choose to encode either fewer (low effort/reward) or more (high effort/reward) squares before reporting whether or not the color of a target square matched the square previously in that location. We found that only greater short-term memory ability predicted whether participants chose a much higher proportion of high versus low effort trials. Drift diffusion modeling showed that high effort group participants were more biased than low effort group participants toward selecting high effort trials. Our findings highlight the role of individual differences in cognitive effort ability in explaining cognitive effort deployment choices.

Dopamine activity in the nigrostriatal pathway alters cue-induced risky choice patterns in female rats.

Deficits in cost/benefit decision making is a critical risk factor for gambling disorder. Reward-paired cues may play an important role, as these stimuli can enhance risk preference in rats. Despite extensive research implicating the dorsal striatum in the compulsive aspects of addiction, the role of nigrostriatal dopaminergic activity in cue-induced risk preference remains unclear, particularly in females. Accordingly, we examined the effects of manipulating the dopaminergic nigrostriatal pathway on cue-induced risky choice in female rats. TH:Cre rats were trained on the cued version of the rat Gambling Task. This task was designed such that maximal reward is attained by avoiding the high-risk, high-reward options and instead favouring the options associated with lower per-trial gains, as they feature less frequent and shorter time-out penalties. Adding reward-paired audiovisual cues to the task leads to greater risky choice on average. To assess the role of the nigrostriatal pathway, a viral vector carrying either Cre-dependent inhibitory or excitatory DREADD was infused into the substantia nigra. Rats then received clozapine-N-oxide either during task acquisition or after a stable performance baseline was reached. Inhibition of this pathway accelerated the development of risk preference in early sessions and increased risky choice during performance, but long-term inhibition actually improved decision making. Activation of this pathway had minimal effects. These results provide evidence for the involvement of the dopaminergic nigrostriatal pathway in cue-induced risk preference in females, therefore shedding light on its role in cost/benefit decision-making deficits and expanding our knowledge of the female dopaminergic system.

Risk-promoting effects of reward-paired cues in human sign- and goal-trackers.

Animal research suggests trait-like individual variation in the degree of incentive salience attribution to reward-predictive cues, defined phenotypically as sign-tracking (high) and goal-tracking (low incentive salience attribution). While these phenotypes have been linked to addiction features in rodents, their translational validity is less clear. Here, we examined whether sign- and goal-tracking in healthy human volunteers modulates the effects of reward-paired cues on decision making. Sign-tracking was measured in a Pavlovian conditioning paradigm as the amount of eye gaze fixation on the reward-predictive cue versus the location of impending reward delivery. In Study 1 (Cherkasova et al., 2018), participants were randomly assigned to perform a binary choice task in which rewards were either accompanied (cued, n = 63) or unaccompanied (uncued, n = 68) by money images and casino jingles. In Study 2, participants (n = 58) performed cued and uncued versions of the task in a within-subjects design. Across both studies, cues promoted riskier choice. Sign-tracking was not associated with risky choice in either study. Goal-tracking rather than sign-tracking was significantly associated with greater risk-promoting effects of cues in Study 1 but not in Study 2, although the direction of findings was consistent across both studies. These findings are at odds with the notion of sign-trackers being preferentially susceptible to the influence of reward cues on behavior and point to the role of mechanisms besides incentive salience in mediating such influences.

Insight into differing decision-making strategies that underlie cognitively effort-based decision making using computational modeling in rats.

RATIONALE: The rat cognitive effort task (rCET), a rodent model of cognitive rather than physical effort, requires animals to choose between an easy or hard visuospatial discrimination, with a correct hard choice more highly rewarded. Like in humans, there is stable individual variation in choice behavior. In previous reports, animals were divided into two groups-workers and slackers-based on their mean preference for the harder option. Although these groups differed in their response to pharmacological challenges, the rationale for using this criterion for grouping was not robust. METHODS: We collated experimental data from multiple cohorts of male and female rats performing the rCET and used a model-based framework combining drift diffusion modeling with cluster analysis to identify the decision-making processes underlying variation in choice behavior. RESULTS: We verified that workers and slackers are statistically different groups but also found distinct intra-group profiles. These subgroups exhibited dissociable performance during the attentional phase, linked to distinct decision-making profiles during choice. Reanalysis of previous pharmacology data using this model-based framework showed that serotonergic drug effects were explained by changes in decision boundaries and non-decision times, while scopolamine's effects were driven by changes in decision starting points and rates of evidence accumulation. CONCLUSIONS: Modeling revealed the decision-making processes that are associated with cognitive effort costs, and how these differ across individuals. Reanalysis of drug data provided insight into the mechanisms through which different neurotransmitter systems impact cognitively effortful attention and decision-making processes, with relevance to multiple psychiatric disorders.

Win-Paired Cues Modulate the Effect of Dopamine Neuron Sensitization on Decision Making and Cocaine Self-administration: Divergent Effects Across Sex.

BACKGROUND: Both psychostimulant use and engagement with probabilistic schedules of reward sensitize the mesocorticolimbic dopamine (DA) system. Such behaviors may act synergistically to explain the high comorbidity between stimulant use and gambling disorder. The salient audiovisual stimuli of modern electronic gambling may exacerbate the situation. METHODS: To probe these interactions, we sensitized ventral tegmental area DA neurons via chronic chemogenetic stimulation while rats (n = 134) learned a rat gambling task in the presence or absence of casino-like cues. The same rats then learned to self-administer cocaine. In a separate cohort (n = 25), we confirmed that our chemogenetic methods sensitized the locomotor response to cocaine and potentiated phasic excitability of ventral tegmental area DA neurons through in vivo electrophysiological recordings. RESULTS: In the absence of cues, sensitization promoted risk taking in both sexes. When rewards were cued, sensitization expedited the development of a risk-preferring phenotype in males while attenuating cue-induced risk taking in females. CONCLUSIONS: While these results provide further confirmation that ventral tegmental area DA neurons critically modulate risky decision making, they also reveal stark sex differences in the decisional impact that dopaminergic signals exert when winning outcomes are cued. As previously observed, risky decision making on the cued rat gambling task increased as both males and females learned to self-administer cocaine. The combination of DA sensitization and win-paired cues while gambling led to significantly greater cocaine taking, but these rats did not show any increase in risky choice as a result. Therefore, cocaine and heavily cued gambles may partially substitute for each other once the DA system has been rendered labile through sensitization, thereby compounding addiction risk across modalities.

Noradrenergic regulation of cue-guided decision making and impulsivity is doubly dissociable across frontal brain regions.

RATIONALE: Win-paired stimuli can promote risk taking in experimental gambling paradigms in both rats and humans. We previously demonstrated that atomoxetine, a noradrenaline reuptake inhibitor, and guanfacine, a selective α2A adrenergic receptor agonist, reduced risk taking on the cued rat gambling task (crGT), a rodent assay of risky choice in which wins are accompanied by salient cues. Both compounds also decreased impulsive premature responding. OBJECTIVE: The key neural loci mediating these effects were unknown. The lateral orbitofrontal cortex (lOFC) and the medial prefrontal cortex (mPFC), which are highly implicated in risk assessment, action selection, and impulse control, receive dense noradrenergic innervation. We therefore infused atomoxetine and guanfacine directly into either the lOFC or prelimbic (PrL) mPFC prior to task performance. RESULTS: When infused into the lOFC, atomoxetine improved decision making score and adaptive lose-shift behaviour in males, but not in females, without altering motor impulsivity. Conversely, intra-PrL atomoxetine improved impulse control in risk preferring animals of both sexes, but did not alter decision making. Guanfacine administered into the PrL, but not lOFC, also altered motor impulsivity in all subjects, though in the opposite direction to atomoxetine. CONCLUSIONS: These data highlight a double dissociation between the behavioural effects of noradrenergic signaling across frontal regions with respect to risky choice and impulsive action. Given that the influence of noradrenergic manipulations on motor impulsivity could depend on baseline risk preference, these data also suggest that the noradrenaline system may function differently in subjects that are susceptible to the risk-promoting lure of win-associated cues.

D2/3 Agonist during Learning Potentiates Cued Risky Choice.

Impulse control and/or gambling disorders can be triggered by dopamine agonist therapies used to treat Parkinson's disease, but the cognitive and neurobiological mechanisms underlying these adverse effects are unknown. Recent data show that adding win-paired sound and light cues to the rat gambling task (rGT) potentiates risky decision-making and impulsivity via the dopamine system, and that changing dopaminergic tone has a greater influence on behavior while subjects are learning task contingencies. Dopamine agonist therapy may therefore be potentiating risk-taking by amplifying the behavioral impact of gambling-related cues on novel behavior. Here, we show that ropinirole treatment in male rats transiently increased motor impulsivity but robustly and progressively increased choice of the high-risk/high-reward options when administered during acquisition of the cued but not uncued rGT. Early in training, ropinirole increased win-stay behavior after large unlikely wins on the cued rGT, indicative of enhanced model-free learning, which mediated the drug's effect on later risk preference. Ex vivo cFos imaging showed that both chronic ropinirole and the addition of win-paired cues suppressed the activity of dopaminergic midbrain neurons. The ratio of midbrain:prefrontal cFos+ neurons was lower in animals with suboptimal choice patterns and tended to predict risk preference across all rats. Network analyses further suggested that ropinirole induced decoupling of the dopaminergic cells of the VTA and nucleus accumbens but only when win-paired cues were present. Frontostriatal activity uninformed by the endogenous dopaminergic teaching signal therefore appeared to perpetuate risky choice, and ropinirole exaggerated this disconnect in synergy with reward-paired cues.SIGNIFICANCE STATEMENT D2/3 receptor agonists, used to treat Parkinson's disease, can cause gambling disorder through an unknown mechanism. Ropinirole increased risky decision-making in rats, but only when wins were paired with casino-inspired sounds and lights. This was mediated by increased win-stay behavior after large unlikely wins early in learning, indicating enhanced model-free learning. cFos imaging showed that ropinirole suppressed activity of midbrain dopamine neurons, an effect that was mimicked by the addition of win-paired cues. The degree of risky choice rats exhibited was uniquely predicted by the ratio of midbrain dopamine:PFC activity. Depriving the PFC of the endogenous dopaminergic teaching signal may therefore drive risky decision-making on-task, and ropinirole acts synergistically with win-paired cues to amplify this.

Long-Term Outcomes of Adolescent THC Exposure on Translational Cognitive Measures in Adulthood in an Animal Model and Computational Assessment of Human Data.

Importance: Although perceived as relatively harmless and nonaddictive, adolescent cannabis use significantly increases the likelihood of developing cannabis use disorder in adulthood, especially for high-potency cannabis. Risky decision-making is associated with chronic cannabis use, but given confounds of human studies, it remains unclear whether adolescent cannabis exposure and Δ9-tetrahydrocannabinol (THC) potency specifically predicts risky decision-making or influences cognitive response to the drug later in life. Objective: To leverage a human data set of cannabis users and a rat model to evaluate the long-term outcomes of adolescent THC exposure on adult decision-making and impulse control. Design, Setting, and Participants: This translational rat study tested the link between adolescent THC exposure and adulthood decision-making. A reanalysis of a previously published dataset of human chronic cannabis users was conducted to evaluate decision-making phenotypes. Computational modeling assessed the human and animal results in a single framework. Data were collected from 2017 to 2020 and analyzed from 2020 to 2022. Main Outcomes and Measures: Decision-making was measured by the Iowa Gambling Task (IGT) and Rat Gambling Task (rGT). Impulse control was assessed in the rat model. Computational modeling was used to determine reward and punishment learning rates and learning strategy used by cannabis users and THC-exposed rats. Cell-specific molecular measures were conducted in the prefrontal cortex and amygdala. Results: Of 37 participants, 24 (65%) were male, and the mean (SD) age was 33.0 (8.3) years. Chronic cannabis users (n = 22; mean [SE] IGT score, -5.182 [1.262]) showed disadvantageous decision-making compared with controls (n = 15; mean [SE] IGT score, 7.133 [2.687]; Cohen d = 1.436). Risky choice was associated with increased reward learning (mean [SE] IGT score: cannabis user, 0.170 [0.018]; control, 0.046 [0.008]; Cohen d = 1.895) and a strategy favoring exploration vs long-term gains (mean [SE] IGT score: cannabis user, 0.088 [0.012]; control, 0.020 [0.002]; Cohen d = 2.218). Rats exposed to high-dose THC but not low-dose THC during adolescence also showed increased risky decision-making (mean [SE] rGT score: vehicle, 46.17 [7.02]; low-dose THC, 69.45 [6.01]; high-dose THC, 21.97 [11.98]; Cohen d = 0.433) and elevated reward learning rates (mean [SE] rGT score: vehicle, 0.17 [0.01]; low-dose THC, 0.10 [0.01]; high-dose THC, 0.24 [0.06]; Cohen d = 1.541) during task acquisition. These animals were also uniquely susceptible to increased cognitive impairments after reexposure to THC in adulthood, which was correlated with even greater reward learning (r = -0.525; P < .001) and a shift in strategy (r = 0.502; P < .001), similar to results seen in human cannabis users. Molecular studies revealed that adolescent THC dose differentially affected cannabinoid-1 receptor messenger RNA expression in the prelimbic cortex and basolateral amygdala in a layer- and cell-specific manner. Further, astrocyte glial fibrillary acidic protein messenger RNA expression associated with cognitive deficits apparent with adult THC reexposure. Conclusions and Relevance: In this translational study, high-dose adolescent THC exposure was associated with cognitive vulnerability in adulthood, especially with THC re-exposure. These data also suggest a link between astrocytes and cognition that altogether provides important insights regarding the neurobiological genesis of risky cannabis use that may help promote prevention and treatment efforts.

Divergent effects of oral cannabis oil extracts marketed as C. indica or C. sativa on exertion of cognitive effort in rats.

The main psychoactive compound within the cannabis plant, Δ9-tetrahydrocannabinol (THC), is thought to drive both the sensation of "high" and the cognitive impairments associated with cannabis consumption. Researchers keen to understand how cannabis impairs cognition have, therefore, studied the behavioral effects of systemic injections of THC in animal models. However, cannabis contains multiple other cannabinoids which may critically modulate the resulting cognitive effects. Users also typically eat or smoke cannabis, leading to concern over the translational validity of pure THC injections. We, therefore, tested whether acute oral administration of two different commercially available cannabis extracts, marketed as C. indica or C. sativa, decreased male Long-Evans rats' willingness to exert greater cognitive effort in order to maximize reward earned, as expected from previous experiments using injected THC. Both oils were matched for THC and cannabidiol content. While both cannabis products slowed response times at higher doses, only C. indica oil at the highest dose administered (10 mg/kg THC) decreased the number of trials on which rats chose to complete high-effort/high-reward trials. Repeated dosing with a medium dose of either cannabinoid product (3 mg/kg THC) did not influence choice. Ex vivo analyses confirmed comparable levels of brain THC after C. indica or C. sativa administration. Although controversial in the field, these results support the suggestion that products marketed as different cannabis cultivars have dissociable cognitive effects that may not resemble pure THC and emphasize the importance of the route of administration in experimental design. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Neural Mechanisms Mediating Sex Differences in Motivation for Reward: Cognitive Bias, Food, Gambling, and Drugs of Abuse.

Sex differences in motivation for food rewards, gambling, and drugs of abuse are modulated by multiple factors, including sensory stimuli, gonadal hormones, and cognitive bias. Cues, drugs of abuse, and a high-fat diet can significantly impact neural signaling in the reward system and functioning of neural systems that regulate executive functions differentially in males and females. Additionally, sex differences in risky decision-making, cognitive bias, and motivation for food and drugs of abuse are mediated by gonadal hormones in both sexes. As neuroscientists analyze data from both sexes, it is becoming apparent that these differences are not simply mediated by hormones in females, but involve sex differences in the specific neural responses to stimuli, including both external stimuli and internal hormonal signals. Understanding sex differences in the mechanisms underlying reward-seeking behaviors and the development of substance use disorders will help uncover potential therapies and treatments that will benefit both men and women. Based on these observations, it is essential that females are included in neuroscience research.

Differential effects of lipopolysaccharide on cognition, corticosterone and cytokines in socially-housed vs isolated male rats.

Social isolation is an established risk factor for mental illness and impaired immune function. Evidence suggests that neuroinflammatory processes contribute to mental illness, possibly via cytokine-induced modulation of neural activity. We examined the effects of lipopolysaccharide (LPS) administration and social home cage environment on cognitive performance in the 5-Choice Serial Reaction Time Task (5CSRTT), and their effects on corticosterone and cytokines in serum and brain tissue. Male Long-Evans rats were reared in pairs or in isolation before training on the 5CSRTT. The effects of saline and LPS (150 µg/kg i.p.) administration on sickness behaviour and task performance were then assessed. LPS-induced sickness behaviour was augmented in socially-isolated rats, translating to increased omissions and slower response times in the 5CSRTT. Both social isolation and LPS administration reduced impulsive responding, while discriminative accuracy remained unaffected. With the exception of reduced impulsivity in isolated rats, these effects were not observed following a second administration of LPS, revealing behavioural tolerance to repeated LPS injections. In a separate cohort of animals, social isolation potentiated the ability of LPS to increase serum corticosterone and IL-6, which corresponded to increased IL-6 in the orbitofrontal and medial prefrontal cortices and the nucleus accumbens. Basal IL-4 levels in the nucleus accumbens were reduced in socially-isolated rats. These findings are consistent with the adaptive response of reduced motivational drive following immune challenge, and identify social isolation as an exacerbating factor. Enhanced IL-6 signalling may play a role in mediating the potentiated behavioural response to LPS administration in isolated animals.

Serotonin 2C Antagonism in the Lateral Orbitofrontal Cortex Ameliorates Cue-Enhanced Risk Preference and Restores Sensitivity to Reinforcer Devaluation in Male Rats.

Previous research has indicated that reward-paired cues can enhance disadvantageous risky choice in both humans and rodents. Systemic administration of a serotonin 2C receptor antagonist can attenuate this cue-induced risk preference in rats. However, the neurocognitive mechanisms mediating this effect are currently unknown. We therefore assessed whether the serotonin 2C receptor antagonist RS 102221 is able to attenuate cue-enhanced risk preference via its actions in the lateral orbitofrontal cortex (lOFC) or prelimbic (PrL) area of the medial prefrontal cortex (mPFC). A total of 32 male Long-Evans rats were trained on the cued version of the rat gambling task (rGT), a rodent analog of the human Iowa gambling task, and bilateral guide cannulae were implanted into the lOFC or PrL. Intra-lOFC infusions of the 5-HT2C antagonist RS 102221 reduced risky choice in animals that showed a preference for the risky options of the rGT at baseline. This effect was not observed in optimal decision-makers, nor those that received infusions targeting the PrL. Given prior data showing that 5-HT2C antagonists also improve reversal learning through the same neural locus, we hypothesized that reward-concurrent cues may amplify risky decision-making through cognitive inflexibility. We therefore devalued the sugar pellet rewards used in the cued rGT (crGT) through satiation and observed that decision-making patterns did not shift unless animals also received intra-lOFC RS 102221. Collectively, these data suggest that the lOFC is one critical site through which reward-concurrent cues promote risky choice patterns that are insensitive to reinforcer devaluation, and that 5-HT2C antagonism may optimize choice by facilitating exploration.

Impulse Control Disorders in Parkinson's Disease: From Bench to Bedside.

Parkinson's disease (PD) is a neurodegenerative disorder that is characterized by symptoms that impact both motor and non-motor domains. Outside of motor impairments, PD patients are at risk for impulse control disorders (ICDs), which include excessively disabling impulsive and compulsive behaviors. ICD symptoms in PD (PD + ICD) can be broadly conceptualized as a synergistic interaction between dopamine agonist therapy and the many molecular and circuit-level changes intrinsic to PD. Aside from discontinuing dopamine agonist treatment, there remains a lack of consensus on how to best address ICD symptoms in PD. In this review, we explore recent advances in the molecular and neuroanatomical mechanisms underlying ICD symptoms in PD by summarizing a rapidly accumulating body of clinical and preclinical studies, with a special focus on the utility of rodent models in gaining new insights into the neurochemical basis of PD + ICD. We also discuss the relevance of these findings to the broader problem of impulsive and compulsive behaviors that impact a range of neuropsychiatric syndromes.

Noradrenergic contributions to cue-driven risk-taking and impulsivity.

RATIONALE: The flashing lights and sounds of modern casinos are alluring and may contribute to the addictive nature of gambling. Such cues can have a profound impact on the noradrenaline (NA) system, which could therefore be a viable therapeutic target for gambling disorder (GD). While there is substantial evidence to support the involvement of NA in the impulsive symptoms of GD, its function in mediating the "pro-addictive" impact of cues is less understood. OBJECTIVE: We wished to investigate the role of NA in our rodent assay of decision making and impulsivity, the cued rat gambling task (crGT). Given that sex differences are prominent in addiction disorders, and increasingly reported in the monoaminergic regulation of behaviour, we also prioritised evaluating noradrenergic drugs in both sexes. METHODS: Female and male rats were trained to stability on the crGT and then given intraperitoneal injections of the noradrenaline reuptake inhibitor atomoxetine, the α2A receptor agonist guanfacine, the beta receptor antagonist propranolol, and the α2 receptor antagonist yohimbine. RESULTS: Atomoxetine dose-dependently improved decision-making score. Guanfacine selectively enhanced decision making in risk-preferring males and optimal performing females. Propranolol and yohimbine did not influence decision making. Atomoxetine and guanfacine reduced premature responses, while yohimbine bi-phasically affected this index of motor impulsivity. CONCLUSIONS: These results support the hypothesis that NA is an important neuromodulator of the cue-induced deficits in decision making observed in laboratory-based gambling paradigms, and suggest that NAergic drugs like atomoxetine and guanfacine may be useful in treating GD.

Pharmacological evidence of a cholinergic contribution to elevated impulsivity and risky decision-making caused by adding win-paired cues to a rat gambling task.

BACKGROUND: Pairing rewards with sensory stimulation, in the form of auditory and visual cues, increases risky decision-making in both rats and humans. Understanding the neurobiological basis of this effect could help explain why electronic gambling machines are so addictive, and inform treatment development for compulsive gambling and gaming. Numerous studies implicate the dopamine system in mediating the motivational influence of reward-paired cues; recent data suggest the cholinergic system also plays a critical role. Previous work also indicates that cholinergic drugs alter decision-making under uncertainty. AIMS: We investigated whether the addition of reward-concurrent cues to the rat gambling task (crGT) altered the effects of peripherally administered cholinergic compounds. METHODS: Muscarinic and nicotinic agonists and antagonists were administered to 16 male, Long-Evans rats trained on the crGT. Measures of optimal/risky decision-making and motor impulsivity were the main dependent variables of interest. RESULTS: The muscarinic receptor antagonist scopolamine improved decision-making overall, decreasing selection of one of the risky options while increasing choice of the more advantageous options. The muscarinic agonist oxotremorine increased choice latency but did not significantly affect option preference. Neither the nicotinic antagonist mecamylamine nor the agonist nicotine affected choice patterns, but mecamylamine decreased premature responding, an index of motor impulsivity. CONCLUSIONS: These results contrast sharply from those obtained previously using the uncued rGT, and suggest that the deleterious effects of win-paired cues on decision-making and impulse control may result from elevated cholinergic tone.

Dopamine neurons gate the intersection of cocaine use, decision making, and impulsivity.

Gambling and substance use disorders are highly comorbid. Both clinical populations are impulsive and exhibit risky decision-making. Drug-associated cues have long been known to facilitate habitual drug-seeking, and the salient audiovisual cues embedded within modern gambling products may likewise encourage problem gambling. The dopamine neurons of the ventral tegmental area (VTA) are exquisitely sensitive to drugs of abuse, uncertain rewards, and reward-paired cues and may therefore be the common neural substrate mediating synergistic features of both disorders. To test this hypothesis, we first gained specific inhibitory control over VTA dopamine neurons by transducing a floxed inhibitory DREADD (AAV5-hSyn-DIO-hM4D(Gi)-mCherry) in rats expressing Cre recombinase in tyrosine hydroxylase neurons. We then trained rats in our cued rat gambling task (crGT), inhibiting dopamine neurons throughout task acquisition and performance, before allowing them to self-administer cocaine in the same diurnal period as crGT sessions. The trajectories of addiction differ in women and men, and the dopamine system may differ functionally across the sexes; therefore, we used male and female rats here. We found that inhibition of VTA dopamine neurons decreased cue-induced risky choice and reduced motor impulsivity in males, but surprisingly, enhanced risky decision making in females. Inhibiting VTA dopamine neurons also prevented cocaine-induced changes in decision making in both sexes, but nevertheless drove all animals to consume more cocaine. These findings show that chronic dampening of dopamine signalling can have both protective and deleterious effects on addiction-relevant behaviours, depending on biological sex and dependent variable of interest.

Decreased risk-taking and loss-chasing after subthalamic nucleus lesion in rats.

The subthalamic nucleus (STN) is known to play a role in the control of impulsivity of action and in impulsivity of choice under certain conditions. In order to assess its influence on decision-making under uncertainty, we have tested here the effects of bilateral STN lesions in rats performing a probability discounting task (PDT) and a "loss-chasing" task, both tasks assessing risky decision under uncertainty, but one in a positive context (probability to obtain a larger reward) and the other in a negative context (risk for a larger loss). The PDT measures the choice between a small certain and a large uncertain reward. Conversely, in the "loss-chasing" task, animals choose between accepting a small certain loss versus risking a larger but uncertain penalty. The results show that STN lesions reduce risk-taking in both the PDT and the loss-chasing task, suggesting that STN inactivation could decrease risky decision-making whatever the nature of the outcome in an ambiguous context. Interestingly, opposite results were found in a small number of animals for which the lesions extended to the area dorsal to the STN (in the zona incerta), such that these animals increased choice of the uncertain option in the PDT. These results confirm the specificity of STN involvement in these processes and may provide explanations for some side-effects reported in patients when STN manipulations extend to the Zona Incerta. They also support the choice of the STN as a target for the treatment of impulse control disorders in Parkinson's disease and in obsessive compulsive disorders.

A Monte Carlo approach for improving transient dopamine release detection sensitivity.

Current methods using a single PET scan to detect voxel-level transient dopamine release-using F-test (significance) and cluster size thresholding-have limited detection sensitivity for clusters of release small in size and/or having low release levels. Specifically, simulations show that voxels with release near the peripheries of such clusters are often rejected-becoming false negatives and ultimately distorting the F-distribution of rejected voxels. We suggest a Monte Carlo method that incorporates these two observations into a cost function, allowing erroneously rejected voxels to be accepted under specified criteria. In simulations, the proposed method improves detection sensitivity by up to 50% while preserving the cluster size threshold, or up to 180% when optimizing for sensitivity. A further parametric-based voxelwise thresholding is then suggested to better estimate the release dynamics in detected clusters. We apply the Monte Carlo method to a pilot scan from a human gambling study, where additional parametrically unique clusters are detected as compared to the current best methods-results consistent with our simulations.

Kindling of the basolateral or central nucleus of the amygdala increases suboptimal choice in a rat gambling task and increases motor impulsivity in risk-preferring animals.

Impairments in decision making under uncertainty, as measured by the Iowa Gambling Task (IGT), are observed in persons suffering from temporal lobe epilepsy (TLE), in which seizures originate in the amygdala and hippocampal formations. Gambling disorder is also more prevalent in this population. Individuals with amygdala damage show similar deficits in decision-making, as do rats with lesions restricted to the basolateral amygdala (BLA) performing an analogous rat gambling task (rGT), yet whether hyperstimulation of the BLA impacts risky decision-making has yet to be demonstrated. We therefore investigated whether kindling of the BLA affected rGT performance. In this task, sugar pellet profits are maximised through consistent selection of options associated with smaller per-trial gains but shorter punishing time-outs. Just as in the IGT, subjects must avoid the risky options, as penalties are disproportionately high despite the higher reward available. Most rats adopt the optimal strategy, but some instead make high numbers of risky, disadvantageous choices. Once stable choice preferences had been established on-task, sixteen male Long Evans rats were implanted unilaterally with a bipolar electrode targeting the BLA and stimulated twice daily until three stage five seizures had been elicited. The electrodes revealed to be nearly evenly places in the BLA and the Central Nucleus of the Amygdala (CeA). Kindling transiently increased choice of the option paired with the smallest reward but also the lowest level of punishment- a risk-averse, but suboptimal, choice. Risk-preferring rats also made more premature responses, a marker of motor impulsivity, and were faster to make a choice, whereas these variables were unaffected in optimal decision-makers. These data suggest epileptiform activity originating within the amygdala can impair choice and promote impulsivity, at least in some individuals.

GPR52 agonists attenuate ropinirole-induced preference for uncertain outcomes.

Dopamine D2/3 receptor agonists are less likely to trigger dyskinesias than L-dopa while still offering relief from the motor symptoms of Parkinson's disease (PD). However, these drugs can cause serious impulse control problems and gambling disorders. Adjunctive therapies capable of blocking these side effects without impacting the antiparkinsonian effect would be clinically useful. G-protein-coupled receptor 52 (GPR52) is an orphan Gs-protein-coupled receptor that is coexpressed with striatal D2 receptors. Activating GPR52 attenuates behaviors associated with increased striatal dopamine release without altering basal function. Iatrogenic gambling disorder may be mediated, at least partly, by striatal dopamine signaling. We therefore investigated whether 2 potent small-molecule GPR52 agonists (BD442618, BD502657) could block the increase in preference for uncertain outcomes caused by acute d-amphetamine and chronic ropinirole, without altering baseline choice patterns. In the rat betting task (rBT), subjects choose between a guaranteed reward (the "wager") versus the 50:50 chance of double the wager or nothing. Although wager size varies across trial blocks, both options are constantly matched for expected value. The effects of BD442618 on the rBT were acutely assessed alone or in combination with d-amphetamine and subsequently in combination with chronic ropinirole. The latter experiment was then repeated with BD502657. BD442618 did not alter baseline decision making but attenuated the increase in preference for uncertainty caused by both acute amphetamine and chronic ropinirole administration. Similarly, BD502657 abrogated chronic ropinirole's effects. These data provide the first evidence that GPR52 agonists may be useful in treating iatrogenic gambling disorder or other conditions hallmarked by hyperdopaminergic states. (PsycInfo Database Record (c) 2021 APA, all rights reserved).