Leveraging individual differences in cue-reward learning to investigate the psychological and neural basis of shared psychiatric symptomatology: The sign-tracker/goal-tracker model.

In our modern environment, we are bombarded with stimuli or cues that exert significant influence over our actions. The extent to which such cues attain control over or disrupt goal-directed behavior is dependent on several factors, including one's inherent tendencies. Using a rodent model, we have shown that individuals vary in the value they place on stimuli associated with reward. Some individuals, termed "goal-trackers," primarily attribute predictive value to reward cues, whereas others, termed "sign-trackers," attribute predictive and incentive value. Thus, for sign-trackers, the reward cue is transformed into an incentive stimulus that is capable of eliciting maladaptive behaviors. The sign-tracker/goal-tracker animal model has allowed us to refine our understanding of behavioral and computational theories related to reward learning and to parse the underlying neural processes. Further, the neurobehavioral profile of sign-trackers is relevant to several psychiatric disorders, including substance use disorder, impulse control disorders, obsessive-compulsive disorder, attention-deficit/hyperactivity disorder, and posttraumatic stress disorder. This model, therefore, can advance our understanding of the psychological and neurobiological mechanisms that contribute to individual differences in vulnerability to psychopathology. Notably, initial attempts at translation-capturing individual variability in the propensity to sign-track in humans-have been promising and in line with what we have learned from the animal model. In this review, we highlight the pivotal role played by the sign-tracker/goal-tracker animal model in enriching our understanding of the psychological and neural basis of motivated behavior and psychiatric symptomatology. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

The effect of corticosterone on the acquisition of Pavlovian conditioned approach behavior is dependent on sex and vendor.

Cues in the environment become predictors of biologically relevant stimuli, such as food, through associative learning. These cues can not only act as predictors but can also be attributed with incentive motivational value and gain control over behavior. When a cue is imbued with incentive salience, it attains the ability to elicit maladaptive behaviors characteristic of psychopathology. We can capture the propensity to attribute incentive salience to a reward cue in rats using a Pavlovian conditioned approach paradigm, in which the presentation of a discrete lever-cue is followed by the delivery of a food reward. Upon learning the cue-reward relationship, some rats, termed sign-trackers, develop a conditioned response directed towards the lever-cue; whereas others, termed goal-trackers, approach the food cup upon lever-cue presentation. Here, we assessed the effects of systemic corticosterone (CORT) on the acquisition and expression of sign- and goal-tracking behaviors in male and female rats, while examining the role of the vendor (Charles River or Taconic) from which the rats originated in these effects. Male and female rats from Charles River had a greater tendency to sign-track than those from Taconic. Administration of CORT enhanced the acquisition of sign-tracking behavior in males from Charles River and females from both vendors. Conversely, administration of CORT had no effect on the expression of the conditioned response. These findings demonstrate a role for CORT in cue-reward learning and suggest that inherent tendencies towards sign- or goal-tracking may interact with this physiological mediator of motivated behavior. Highlights: Male and female rats from Charles River exhibit more sign-tracking relative to those from Taconic.Corticosterone increases the acquisition of sign-tracking in male rats from Charles River.Corticosterone increases the acquisition of sign-tracking in female rats, regardless of vendor.There is no effect of corticosterone on the expression of sign-tracking behavior in either male or female rats.

Genomic Loci Influencing Cue-Reactivity in Heterogeneous Stock Rats.

Addiction vulnerability is associated with the tendency to attribute incentive salience to reward predictive cues; both addiction and the attribution of incentive salience are influenced by environmental and genetic factors. To characterize the genetic contributions to incentive salience attribution, we performed a genome-wide association study (GWAS) in a cohort of 1,645 genetically diverse heterogeneous stock (HS) rats. We tested HS rats in a Pavlovian conditioned approach task, in which we characterized the individual responses to food-associated stimuli ("cues"). Rats exhibited either cue-directed "sign-tracking" behavior or food-cup directed "goal-tracking" behavior. We then used the conditioned reinforcement procedure to determine whether rats would perform a novel operant response for unrewarded presentations of the cue. We found that these measures were moderately heritable (SNP heritability, h2 = .189-.215). GWAS identified 14 quantitative trait loci (QTLs) for 11 of the 12 traits we examined. Interval sizes of these QTLs varied widely. 7 traits shared a QTL on chromosome 1 that contained a few genes (e.g. Tenm4, Mir708) that have been associated with substance use disorders and other mental health traits in humans. Other candidate genes (e.g. Wnt11, Pak1) in this region had coding variants and expression-QTLs in mesocorticolimbic regions of the brain. We also conducted a Phenome-Wide Association Study (PheWAS) on other behavioral measures in HS rats and found that regions containing QTLs on chromosome 1 were also associated with nicotine self-administration in a separate cohort of HS rats. These results provide a starting point for the molecular genetic dissection of incentive salience and provide further support for a relationship between attribution of incentive salience and drug abuse-related traits.

Inhibition of Dopamine Neurons Prevents Incentive Value Encoding of a Reward Cue: With Revelations from Deep Phenotyping.

The survival of an organism is dependent on its ability to respond to cues in the environment. Such cues can attain control over behavior as a function of the value ascribed to them. Some individuals have an inherent tendency to attribute reward-paired cues with incentive motivational value, or incentive salience. For these individuals, termed sign-trackers, a discrete cue that precedes reward delivery becomes attractive and desirable in its own right. Prior work suggests that the behavior of sign-trackers is dopamine-dependent, and cue-elicited dopamine in the NAc is believed to encode the incentive value of reward cues. Here we exploited the temporal resolution of optogenetics to determine whether selective inhibition of ventral tegmental area (VTA) dopamine neurons during cue presentation attenuates the propensity to sign-track. Using male tyrosine hydroxylase (TH)-Cre Long Evans rats, it was found that, under baseline conditions, ∼84% of TH-Cre rats tend to sign-track. Laser-induced inhibition of VTA dopamine neurons during cue presentation prevented the development of sign-tracking behavior, without affecting goal-tracking behavior. When laser inhibition was terminated, these same rats developed a sign-tracking response. Video analysis using DeepLabCutTM revealed that, relative to rats that received laser inhibition, rats in the control group spent more time near the location of the reward cue even when it was not present and were more likely to orient toward and approach the cue during its presentation. These findings demonstrate that cue-elicited dopamine release is critical for the attribution of incentive salience to reward cues.SIGNIFICANCE STATEMENT Activity of dopamine neurons in the ventral tegmental area (VTA) during cue presentation is necessary for the development of a sign-tracking, but not a goal-tracking, conditioned response in a Pavlovian task. We capitalized on the temporal precision of optogenetics to pair cue presentation with inhibition of VTA dopamine neurons. A detailed behavioral analysis with DeepLabCutTM revealed that cue-directed behaviors do not emerge without dopamine neuron activity in the VTA. Importantly, however, when optogenetic inhibition is lifted, cue-directed behaviors increase, and a sign-tracking response develops. These findings confirm the necessity of dopamine neuron activity in the VTA during cue presentation to encode the incentive value of reward cues.

Genome-wide association studies of human and rat BMI converge on synapse, epigenome, and hormone signaling networks.

A vexing observation in genome-wide association studies (GWASs) is that parallel analyses in different species may not identify orthologous genes. Here, we demonstrate that cross-species translation of GWASs can be greatly improved by an analysis of co-localization within molecular networks. Using body mass index (BMI) as an example, we show that the genes associated with BMI in humans lack significant agreement with those identified in rats. However, the networks interconnecting these genes show substantial overlap, highlighting common mechanisms including synaptic signaling, epigenetic modification, and hormonal regulation. Genetic perturbations within these networks cause abnormal BMI phenotypes in mice, too, supporting their broad conservation across mammals. Other mechanisms appear species specific, including carbohydrate biosynthesis (humans) and glycerolipid metabolism (rodents). Finally, network co-localization also identifies cross-species convergence for height/body length. This study advances a general paradigm for determining whether and how phenotypes measured in model species recapitulate human biology.

Inhibition of dopamine neurons prevents incentive value encoding of a reward cue: With revelations from deep phenotyping.

The survival of an organism is dependent on their ability to respond to cues in the environment. Such cues can attain control over behavior as a function of the value ascribed to them. Some individuals have an inherent tendency to attribute reward-paired cues with incentive motivational value, or incentive salience. For these individuals, termed sign-trackers, a discrete cue that precedes reward delivery becomes attractive and desirable in its own right. Prior work suggests that the behavior of sign-trackers is dopamine-dependent, and cue-elicited dopamine in the nucleus accumbens is believed to encode the incentive value of reward cues. Here we exploited the temporal resolution of optogenetics to determine whether selective inhibition of ventral tegmental area (VTA) dopamine neurons during cue presentation attenuates the propensity to sign-track. Using male tyrosine hydroxylase (TH)-Cre Long Evans rats it was found that, under baseline conditions, ∼84% of TH-Cre rats tend to sign-track. Laser-induced inhibition of VTA dopamine neurons during cue presentation prevented the development of sign-tracking behavior, without affecting goal-tracking behavior. When laser inhibition was terminated, these same rats developed a sign-tracking response. Video analysis using DeepLabCut revealed that, relative to rats that received laser inhibition, rats in the control group spent more time near the location of the reward cue even when it was not present and were more likely to orient towards and approach the cue during its presentation. These findings demonstrate that cue-elicited dopamine release is critical for the attribution of incentive salience to reward cues. Significance Statement: Activity of dopamine neurons in the ventral tegmental area (VTA) during cue presentation is necessary for the development of a sign-tracking, but not a goal-tracking, conditioned response in a Pavlovian task. We capitalized on the temporal precision of optogenetics to pair cue presentation with inhibition of VTA dopamine neurons. A detailed behavioral analysis with DeepLabCut revealed that cue-directed behaviors do not emerge without VTA dopamine. Importantly, however, when optogenetic inhibition is lifted, cue-directed behaviors increase, and a sign-tracking response develops. These findings confirm the necessity of VTA dopamine during cue presentation to encode the incentive value of reward cues.

The propensity to sign-track is associated with externalizing behavior and distinct patterns of reward-related brain activation in youth.

Externalizing behaviors in childhood often predict impulse control disorders in adulthood; however, the underlying bio-behavioral risk factors are incompletely understood. In animals, the propensity to sign-track, or the degree to which incentive motivational value is attributed to reward cues, is associated with externalizing-type behaviors and deficits in executive control. Using a Pavlovian conditioned approach paradigm, we quantified sign-tracking in 40 healthy 9-12-year-olds. We also measured parent-reported externalizing behaviors and anticipatory neural activations to outcome-predicting cues using the monetary incentive delay fMRI task. Sign-tracking was associated with attentional and inhibitory control deficits and the degree of amygdala, but not cortical, activation during reward anticipation. These findings support the hypothesis that youth with a propensity to sign-track are prone to externalizing tendencies, with an over-reliance on subcortical cue-reactive brain systems. This research highlights sign-tracking as a promising experimental approach delineating the behavioral and neural circuitry of individuals at risk for externalizing disorders.

An exponential increase in QTL detection with an increased sample size.

Power analyses are often used to determine the number of animals required for a genome-wide association study (GWAS). These analyses are typically intended to estimate the sample size needed for at least 1 locus to exceed a genome-wide significance threshold. A related question that is less commonly considered is the number of significant loci that will be discovered with a given sample size. We used simulations based on a real data set that consisted of 3,173 male and female adult N/NIH heterogeneous stock rats to explore the relationship between sample size and the number of significant loci discovered. Our simulations examined the number of loci identified in subsamples of the full data set. The subsampling analysis was conducted for 4 traits with low (0.15 ± 0.03), medium (0.31 ± 0.03 and 0.36 ± 0.03), and high (0.46 ± 0.03) SNP-based heritabilities. For each trait, we subsampled the data 100 times at different sample sizes (500, 1,000, 1,500, 2,000, and 2,500). We observed an exponential increase in the number of significant loci with larger sample sizes. Our results are consistent with similar observations in human GWAS and imply that future rodent GWAS should use sample sizes that are significantly larger than those needed to obtain a single significant result.

Adolescent cocaine differentially impacts psychomotor sensitization and epigenetic profiles in adult male rats with divergent affective phenotypes.

Adolescent drug use reliably predicts increased addiction liability in adulthood, but not all individuals are equally impacted. To explore the biological bases of this differential reactivity to early life drug experience, we used a genetic rat model of temperament and evaluated the impact of adolescent cocaine exposure on adult psychomotor sensitization. Relative to adult bred low-responder (bLR) rats, bred high-responders (bHR) are more sensitive to the psychomotor-activating effects of cocaine and reinstate drug-seeking behavior more readily following prolonged cocaine exposure and/or abstinence. We found that a 7-day sensitizing cocaine regimen (15 mg/kg/day) during either adolescence or adulthood produced psychomotor sensitization in bHRs only, while a dual cocaine exposure prevented further sensitization, suggesting limits on neuroplasticity. By contrast, adolescent cocaine in bLRs shifted their resilient phenotype, rendering them more responsive to cocaine in adulthood following adolescent cocaine. To begin to explore the neural correlates of these behavioral phenotypes, we assessed two functionally opposite epigenetic chromatin modifications implicated in addiction liability, permissive acetylation (ac) and repressive tri-methylation (me3) on Histone 3 Lysine 9 (H3K9), in four striatal sub-regions. In bHRs, decreased H3K9me3 and increased acH3K9 in the nucleus accumbens (NAc) core associated with cocaine sensitization. In bLRs, the combination of cocaine exposure in adolescence and adulthood, which lead to an increased response to a cocaine challenge, also increased acH3K9 in the core. Thus, adolescent cocaine experience interacts with genetic background to elicit different behavioral profiles relevant to addiction in adulthood, with concurrent modifications in the epigenetic histone profiles in the NAc that associate with cocaine sensitization and with metaplasticity.

Genetic characterization of outbred Sprague Dawley rats and utility for genome-wide association studies.

Sprague Dawley (SD) rats are among the most widely used outbred laboratory rat populations. Despite this, the genetic characteristics of SD rats have not been clearly described, and SD rats are rarely used for experiments aimed at exploring genotype-phenotype relationships. In order to use SD rats to perform a genome-wide association study (GWAS), we collected behavioral data from 4,625 SD rats that were predominantly obtained from two commercial vendors, Charles River Laboratories and Harlan Sprague Dawley Inc. Using double-digest genotyping-by-sequencing (ddGBS), we obtained dense, high-quality genotypes at 291,438 SNPs across 4,061 rats. This genetic data allowed us to characterize the variation present in Charles River vs. Harlan SD rats. We found that the two populations are highly diverged (FST > 0.4). Furthermore, even for rats obtained from the same vendor, there was strong population structure across breeding facilities and even between rooms at the same facility. We performed multiple separate GWAS by fitting a linear mixed model that accounted for population structure and using meta-analysis to jointly analyze all cohorts. Our study examined Pavlovian conditioned approach (PavCA) behavior, which assesses the propensity for rats to attribute incentive salience to reward-associated cues. We identified 46 significant associations for the various metrics used to define PavCA. The surprising degree of population structure among SD rats from different sources has important implications for their use in both genetic and non-genetic studies.

Investigating individual differences in opioid-taking and opioid-seeking behavior in male rats.

RATIONALE: Understanding the behavioral and neurobiological factors that render some individuals more susceptible than others to opioid addiction will be critical in combatting the opioid crisis. OBJECTIVE: The purpose of the current study was to determine if behavioral traits associated with an increased likelihood to take and seek cocaine are the same traits that render one more susceptible to opioid-taking and opioid-seeking behavior. Individual differences in the acquisition of remifentanil self-administration and subsequent cue-induced reinstatement of remifentanil-seeking behavior were investigated using two animal models: the high-responder (HR)/low-responder (LR) and sign-tracker (ST)/goal-tracker (GT) models. Relative to LR rats, HR rats show increased novelty-induced locomotion or "sensation-seeking" behavior, and are more likely to acquire cocaine-taking behavior and do so at a faster rate. Relative to GT rats, ST rats attribute greater incentive motivational value to reward cues and are more likely to exhibit reinstatement of cocaine-seeking behavior. RESULTS: In contrast to previous work using cocaine, we did not observe individual differences with respect to the acquisition of remifentanil self-administration- or cue-induced reinstatement of remifentanil-seeking behavior within the context of either the HR/LR or ST/GT model. Thus, neither the sensation-seeking trait nor the propensity to attribute incentive motivational value to reward cues predicts remifentanil-taking or remifentanil-seeking behavior. CONCLUSIONS: These findings suggest that different traits may confer the initiation of opioid- vs. cocaine-taking behavior, and the propensity to relapse to opioid- vs. cocaine-seeking. Additional studies are needed to identify which neurobehavioral constructs confer liability to opioid use and relapse.

Inhibition of a cortico-thalamic circuit attenuates cue-induced reinstatement of drug-seeking behavior in "relapse prone" male rats.

RATIONALE: Relapse often occurs when individuals are exposed to stimuli or cues previously associated with the drug-taking experience. The ability of drug cues to trigger relapse is believed to be a consequence of incentive salience attribution, a process by which the incentive value of reward is transferred to the reward-paired cue. Sign-tracker (ST) rats that attribute enhanced incentive value to reward cues are more prone to relapse compared to goal-tracker (GT) rats that primarily attribute predictive value to such cues. OBJECTIVES: The neurobiological mechanisms underlying this individual variation in relapse propensity remains largely unexplored. The paraventricular nucleus of the thalamus (PVT) has been identified as a critical node in the regulation of cue-elicited behaviors in STs and GTs, including cue-induced reinstatement of drug-seeking behavior. Here we used a chemogenetic approach to assess whether "top-down" cortical input from the prelimbic cortex (PrL) to the PVT plays a role in mediating individual differences in relapse propensity. RESULTS: Chemogenetic inhibition of the PrL-PVT pathway selectively decreased cue-induced reinstatement of drug-seeking behavior in STs, without affecting behavior in GTs. In contrast, cocaine-primed drug-seeking behavior was not affected in either phenotype. Furthermore, when rats were characterized based on a different behavioral phenotype-locomotor response to novelty-inhibition of the PrL-PVT pathway had no effect on either cue- or drug-induced reinstatement. CONCLUSIONS: These results highlight an important role for the PrL-PVT pathway in vulnerability to relapse that is consequent to individual differences in the propensity to attribute incentive salience to discrete reward cues.

Genome-wide association study in a rat model of temperament identifies multiple loci for exploratory locomotion and anxiety-like traits.

Common genetic factors likely contribute to multiple psychiatric diseases including mood and substance use disorders. Certain stable, heritable traits reflecting temperament, termed externalizing or internalizing, play a large role in modulating vulnerability to these disorders. To model these heritable tendencies, we selectively bred rats for high and low exploration in a novel environment [bred High Responders (bHR) vs. Low Responders (bLR)]. To identify genes underlying the response to selection, we phenotyped and genotyped 538 rats from an F2 cross between bHR and bLR. Several behavioral traits show high heritability, including the selection trait: exploratory locomotion (EL) in a novel environment. There were significant phenotypic and genetic correlations between tests that capture facets of EL and anxiety. There were also correlations with Pavlovian conditioned approach (PavCA) behavior despite the lower heritability of that trait. Ten significant and conditionally independent loci for six behavioral traits were identified. Five of the six traits reflect different facets of EL that were captured by three behavioral tests. Distance traveled measures from the open field and the elevated plus maze map onto different loci, thus may represent different aspects of novelty-induced locomotor activity. The sixth behavioral trait, number of fecal boli, is the only anxiety-related trait mapping to a significant locus on chromosome 18 within which the Pik3c3 gene is located. There were no significant loci for PavCA. We identified a missense variant in the Plekhf1 gene on the chromosome 1:95 Mb QTL and Fancf and Gas2 as potential candidate genes that may drive the chromosome 1:107 Mb QTL for EL traits. The identification of a locomotor activity-related QTL on chromosome 7 encompassing the Pkhd1l1 and Trhr genes is consistent with our previous finding of these genes being differentially expressed in the hippocampus of bHR vs. bLR rats. The strong heritability coupled with identification of several loci associated with exploratory locomotion and emotionality provide compelling support for this selectively bred rat model in discovering relatively large effect causal variants tied to elements of internalizing and externalizing behaviors inherent to psychiatric and substance use disorders.

The Paraventricular Thalamus as a Critical Node of Motivated Behavior via the Hypothalamic-Thalamic-Striatal Circuit.

In this review, we highlight evidence that supports a role for the paraventricular nucleus of the thalamus (PVT) in motivated behavior. We include a neuroanatomical and neurochemical overview, outlining what is known of the cellular makeup of the region and its most prominent afferent and efferent connections. We discuss how these connections and distinctions across the anterior-posterior axis correspond to the perceived function of the PVT. We then focus on the hypothalamic-thalamic-striatal circuit and the neuroanatomical and functional placement of the PVT within this circuit. In this regard, the PVT is ideally positioned to integrate information regarding internal states and the external environment and translate it into motivated actions. Based on data that has emerged in recent years, including that from our laboratory, we posit that orexinergic (OX) innervation from the lateral hypothalamus (LH) to the PVT encodes the incentive motivational value of reward cues and thereby alters the signaling of the glutamatergic neurons projecting from the PVT to the shell of the nucleus accumbens (NAcSh). The PVT-NAcSh pathway then modulates dopamine activity and resultant cue-motivated behaviors. As we and others apply novel tools and approaches to studying the PVT we will continue to refine the anatomical, cellular, and functional definitions currently ascribed to this nucleus and further elucidate its role in motivated behaviors.

Effects of Pair Housing on Patency of Jugular Catheters in Rats (Rattus norvegicus).

Chronic vascular access devices are widely used in a variety of species for repeated blood sampling or substance administration. Jugular catheters are commonly used for studying addiction-related behaviors in rats. Rats with catheters have historically been individually housed for the duration of the study to prevent cage mates from damaging the catheter. The 2 goals of this study were to determine 1) the effects of pair housing on catheter patency and 2) the effects of pair housing on catheter patency of rats in a study of opioid self-administration and cue-induced reinstatement of opioid-seeking behavior. The latter study also represented an opportunity for experimental refinement as it evaluated the temporary use of a barrier that allowed for pair-housed rats to be physically separated. Male Heterogeneous Stock (HS; n = 24) and Sprague-Dawley (SD; n = 121) rats were allocated to either single- or pair-housed condition. To assess the effect of social housing on catheter patency, rats (HS, n = 24; SD, n = 36) were monitored in their assigned housing condition for one month, with scheduled evaluation of catheter patency and structural damage. To examine the effect of social housing on catheter patency during a study of opioid self-administration and cue-induced reinstatement of opioid-seeking behavior, rats (SD, n = 85) were monitored in their assigned housing condition with similar routine patency evaluations. Catheter patency rates between single- and pairhoused rats were not statistically different in the first experiment, and pair-housed animals were successfully maintained on an infusion study in the second experiment. The use of a barrier between pair-housed rats after surgery allowed continued social contact with no observed adverse effects. These results suggest that, pair housing is a viable option for rats with chronic vascular implants, and may improve their wellbeing by allowing them to display species-typical social behaviors.

Male Goal-Tracker and Sign-Tracker Rats Do Not Differ in Neuroendocrine or Behavioral Measures of Stress Reactivity.

Environmental cues attain the ability to guide behavior via learned associations. As predictors, cues can elicit adaptive behavior and lead to valuable resources (e.g., food). For some individuals, however, cues are transformed into incentive stimuli and elicit motivational states that can be maladaptive. The goal-tracker (GT)/sign-tracker (ST) animal model captures individual differences in cue-motivated behaviors, with reward-associated cues serving as predictors of reward for both phenotypes but becoming incentive stimuli to a greater degree for STs. While these distinct phenotypes are characterized based on Pavlovian conditioned approach (PavCA) behavior, they exhibit differences on a number of behaviors relevant to psychopathology. To further characterize the neurobehavioral endophenotype associated with individual differences in cue-reward learning, neuroendocrine and behavioral profiles associated with stress and anxiety were investigated in male GT, ST, and intermediate responder (IR) rats. It was revealed that baseline corticosterone (CORT) increases with Pavlovian learning, but to the same degree, regardless of phenotype. No significant differences in behavior were observed between GTs and STs during an elevated plus maze (EPM) or open field test (OFT), nor were there differences in CORT response to the OFT or physiological restraint. Upon examination of central markers associated with stress reactivity, we found that STs have greater glucocorticoid receptor (GR) mRNA expression in the ventral hippocampus, with no phenotypic differences in the dorsal hippocampus or prelimbic cortex (PrL). These findings demonstrate that GTs and STs do not differ on stress-related and anxiety-related behaviors, and suggest that differences in neuroendocrine measures between these phenotypes can be attributed to distinct cue-reward learning styles.