Delay of punishment highlights differential vulnerability to developing addiction-like behavior toward sweet food.

Resistance to punishment is commonly used to measure the difficulty in refraining from rewarding activities when negative consequences ensue, which is a hallmark of addictive behavior. We recently developed a progressive shock strength (PSS) procedure in which individual rats can titrate the amount of punishment that they are willing to tolerate to obtain food rewards. Here, we investigated the effects of a range of delays (0-12 s) on resistance to punishment measured by PSS break points. As expected from delay discounting principles, we found that delayed shock was less effective as a punisher, as revealed by higher PSS breakpoints. However, this discounting effect was not equally distributed in the population of rats, and the introduction of a delay highlighted the existence of two populations: rats that were sensitive to immediate punishment were also sensitive to delayed shock, whereas rats that were resistant to immediate punishment showed strong temporal discounting of delayed punishment. Importantly, shock-sensitive rats suppressed responding even in subsequent non-punishment sessions, and they differed from shock-resistant rats in anxiety-like behavior, but not in sensitivity to pain. These results show that manipulation of temporal contingencies of punishment in the PSS procedure provides a valuable tool to identify individuals with a double vulnerability to addiction: low sensitivity to aversion and excessive discounting of negative future consequences. Conversely, the shock-sensitive population may provide a model of humans who are vulnerable to opportunity loss due to excessive anxiety.

Lack of action monitoring as a prerequisite for habitual and chunked behavior: Behavioral and neural correlates.

We previously reported the rapid development of habitual behavior in a discrete-trials instrumental task in which lever insertion and retraction act as reward-predictive cues delineating sequence execution. Here we asked whether lever cues or performance variables reflective of skill and automaticity might account for habitual behavior in male rats. Behavior in the discrete-trials habit-promoting task was compared with two task variants lacking the sequence-delineating cues of lever extension and retraction. We find that behavior is under goal-directed control in absence of sequence-delineating cues but not in their presence, and that skilled performance does not predict goal-directed vs. habitual behavior. Neural activity recordings revealed an engagement of dorsolateral striatum and a disengagement of dorsomedial striatum during the sequence execution of the habit-promoting task, specifically. Together, these results indicate that sequence delineation cues promote habit and differential engagement of striatal subregions during instrumental responding, a pattern that may reflect cue-elicited behavioral chunking.

Large-scale brain correlates of sweet versus cocaine reward in rats.

Cocaine induces many supranormal changes in neuronal activity in the brain, notably in learning- and reward-related regions, in comparison with nondrug rewards-a difference that is thought to contribute to its relatively high addictive potential. However, when facing a choice between cocaine and a nondrug reward (e.g., water sweetened with saccharin), most rats do not choose cocaine, as one would expect from the extent and magnitude of its global activation of the brain, but instead choose the nondrug option. We recently showed that cocaine, though larger in magnitude, is also an inherently more delayed reward than sweet water, thereby explaining why it has less value during choice and why rats opt for the more immediate nondrug option. Here, we used a large-scale Fos brain mapping approach to measure brain responses to each option in saccharin-preferring rats, with the hope to identify brain regions whose activity may explain the preference for the nondrug option. In total, Fos expression was measured in 142 brain levels corresponding to 52 brain subregions and composing 5 brain macrosystems. Overall, our findings confirm in rats with a preference for saccharin that cocaine induces more global brain activation than the preferred nondrug option does. Only very few brain regions were uniquely activated by saccharin. They included regions involved in taste processing (i.e., anterior gustatory cortex) and also regions involved in processing reward delay and intertemporal choice (i.e., some components of the septohippocampal system and its connections with the lateral habenula).

Cocaine falls into oblivion during volitional initiation of choice trials.

When facing a choice, most animals quit drugs in favour of a variety of nondrug alternatives. We recently found, rather unexpectedly, that choice of the nondrug alternative is in fact inflexible and habitual. One possible contributing factor to habitual choice is the intermittency and uncontrollability of choice trials in previous studies. Here, we asked whether and to what extent volitional control over the occurrence of choice trials could change animals' preference by preventing habitual choice. To do so, rats were trained to nosepoke in a hole to trigger the presentation of two operant levers: one associated with cocaine, the other with saccharin. Rats were then free to choose among the two levers to obtain the corresponding reward, after which both levers retracted until rats self-initiated the next choice trial. Overall, we found that volitional control over choice trials did not change preference. Most rats preferred saccharin over cocaine and selected this option almost exclusively. Intriguingly, after repeated choice and consumption of saccharin, rats transiently lost interest in this option (i.e., due to sensory-specific satiety), but they did not switch to cocaine, preferring instead to pause during long periods of time before reinitiating a choice trial for saccharin. This finding suggests that during volitional initiation of a choice trial, rats fail to consider cocaine as an option. We discuss a possible associative mechanism to explain this perplexing behaviour.

From concepts to treatment: a dialog between a preclinical researcher and a clinician in addiction medicine.

The debate surrounding the brain disease model and the associated questioning of the relevance of animal models is polarizing the field of addiction, and tends to widen the gap between preclinical research and addiction medicine. Here, we aimed at bridging this gap by establishing a dialog between a preclinical researcher and a clinician in addiction medicine. Our objective was to evaluate animal models and the neuroscientific conceptualization of addiction in light of alcohol or drug dependence and treatment in patients struggling with an addiction. We sought to determine how preclinical research influenced addiction medicine over past decades, and reciprocally, what can preclinical researchers learn from addiction medicine that could lead to more effective approaches. In this dialog, we talk about the co-evolution of addiction concepts and treatments from neuroscientific and medical perspectives. This dialog illustrates the reciprocal influences and mutual enrichment between the two disciplines and reveals that, although preclinical research might not produce new pharmacotherapies, it does shape the theoretical conceptualization of addiction and could thereby contribute to the implementation of therapeutic approaches.

Choosing between cocaine and sucrose under the influence: testing the effect of cocaine tolerance.

RATIONALE: Cocaine use not only depends on the reinforcing properties of the drug, but also on its pharmacological effects on alternative nondrug activities. In animal models investigating choice between cocaine and alternative sweet rewards, the latter influence can have a dramatic impact on choice outcomes. When choosing under cocaine influence is prevented by imposing sufficiently long intervals between choice trials, animals typically prefer the sweet reward. However, when choosing under the drug influence is permitted, animals shift their preference in favor of cocaine. OBJECTIVES: We previously hypothesized that this preference shift is mainly due to a direct suppression of responding for sweet reward by cocaine pharmacological effects. Here we tested this hypothesis by making rats tolerant to this drug-induced behavioral suppression. RESULTS: Contrary to our expectation, tolerance did not prevent rats from shifting their preference to cocaine when choosing under the influence. CONCLUSION: Thus, other mechanisms must be invoked to explain the influence of cocaine intoxication on choice outcomes.

Dorsomedial Striatal Activity Tracks Completion of Behavioral Sequences in Rats.

For proper execution of goal-directed behaviors, individuals require both a general representation of the goal and an ability to monitor their own progress toward that goal. Here, we examine how dorsomedial striatum (DMS), a region pivotal for forming associations among stimuli, actions, and outcomes, encodes the execution of goal-directed action sequences that require self-monitoring of behavior. We trained rats to complete a sequence of at least five consecutive lever presses (without visiting the reward port) to obtain a reward and recorded the activity of individual cells in DMS while rats performed the task. We found that the pattern of DMS activity gradually changed during the execution of the sequence, permitting accurate decoding of sequence progress from neural activity at a population level. Moreover, this sequence-related activity was blunted on trials where rats did not complete a sufficient number of presses. Overall, these data suggest a link between DMS activity and the execution of behavioral sequences that require monitoring of ongoing behavior.

Probing the decision-making mechanisms underlying choice between drug and nondrug rewards in rats.

Delineating the decision-making mechanisms underlying choice between drug and nondrug rewards remains a challenge. This study adopts an original approach to probe these mechanisms by comparing response latencies during sampling versus choice trials. While lengthening of latencies during choice is predicted in a deliberative choice model (DCM), the race-like response competition mechanism postulated by the Sequential choice model (SCM) predicts a shortening of latencies during choice compared to sampling. Here, we tested these predictions by conducting a retrospective analysis of cocaine-versus-saccharin choice experiments conducted in our laboratory. We found that rats engage deliberative decision-making mechanisms after limited training, but adopt a SCM-like response selection mechanism after more extended training, while their behavior is presumably habitual. Thus, the DCM and SCM may not be general models of choice, as initially formulated, but could be dynamically engaged to control choice behavior across early and extended training.

Habitual Preference for the Nondrug Reward in a Drug Choice Setting.

For adaptive and efficient decision making, it must be possible to select between habitual alternative courses of action. However, research in rodents suggests that, even in the context of simple decision-making, choice behavior remains goal-directed. In contrast, we recently found that during discrete trial choice between cocaine and water, water-restricted rats preferred water and this preference was habitual and inflexible (i.e., resistant to water devaluation by satiation). Here we sought to test the reproducibility and generality of this surprising finding by assessing habitual control of preference for saccharin over cocaine in non-restricted rats. Specifically, after the acquisition of preference for saccharin, saccharin was devalued and concurrent responding for both options was measured under extinction. As expected, rats responded more for saccharin than for cocaine during extinction, but this difference was unaffected by saccharin devaluation. Together with our previous research, this result indicates that preference for nondrug alternatives over cocaine is under habitual control, even under conditions that normally support goal-directed control of choice between nondrug options. The possible reasons for this difference are discussed.

Distinct recruitment of dorsomedial and dorsolateral striatum erodes with extended training.

Hypotheses of striatal orchestration of behavior ascribe distinct functions to striatal subregions, with the dorsolateral striatum (DLS) especially implicated in habitual and skilled performance. Thus neural activity patterns recorded from the DLS, but not the dorsomedial striatum (DMS), should be correlated with habitual and automatized performance. Here, we recorded DMS and DLS neural activity in rats during training in a task promoting habitual lever pressing. Despite improving performance across sessions, clear changes in corresponding neural activity patterns were not evident in DMS or DLS during early training. Although DMS and DLS activity patterns were distinct during early training, their activity was similar following extended training. Finally, performance after extended training was not associated with DMS disengagement, as would be predicted from prior work. These results suggest that behavioral sequences may continue to engage both striatal regions long after initial acquisition, when skilled performance is consolidated.

Inflexible habitual decision-making during choice between cocaine and a nondrug alternative.

The concept of compulsive cocaine-seeking habits is difficult to reconcile with other evidence showing that humans and even rats remain able to shift their choice away from the drug and toward an alternative nondrug reward, when available. This paradox could dissolve if preference for the nondrug option reflected in fact inflexible habitual decision-making (i.e., fixed in a habitual control mode, with no return to a goal-directed control mode). Previous research in rats has shown that prior drug use can favor habit formation, but whether the resulting habits are inflexible or not is largely unknown. Here we addressed this question by manipulating the value of water in rats that chose between water and cocaine in a discrete-trials procedure. Rats preferred water when thirsty and maintained this preference despite water devaluation by satiation. Only with repeated daily testing under water satiation did they progressively reverse their preference toward cocaine. Additional evidence showed that this progressive reversal of preference reflected in fact new interoceptive discrimination learning. Overall, this study suggests that rats seem to be stuck in a habitual decision-making mode, unable to return to a goal-directed mode upon experiencing a change in options value. It also reveals that inflexible decision-making does not necessarily promote drug choice, but can also under some circumstances favor abstinence.

Attentional capacities prior to drug exposure predict motivation to self-administer nicotine.

RATIONALE: Nicotine can enhance attention and attribution of incentive salience to nicotine-associated stimuli. However, it is not clear whether inter-individual differences in attentional capacities prior to any exposure could play a role in vulnerability to nicotine self-administration. We further explored this vulnerability through pre-existing inter-individual differences in attention to a reward-predictive cue in drug-free animals. METHODS: A cued version of the Fixed Consecutive Number schedule (FCN16cue) of reinforcement task was used to assess attention. This task consists in completing a long chain of sequential lever presses to obtain a reward, and examines the rats' ability to pay attention to a cue light that signals its availability. Rats were then trained to self-administer nicotine intravenously (30 µg/kg/0.1 mL). Drug-taking and seeking behaviors were investigated. RESULTS: Our results showed important inter-individual differences in response for nicotine during the progressive ratio schedule of reinforcement. By comparing rats in the lower and upper quartiles of the mean breaking point, we showed that high-motivated rats were also more sensitive to the reinforcing properties of nicotine than low-motivated ones. We found that while both groups did not differ in premature responding in the FCN16cue task, high-motivated rats were more efficient in taking the cue light into account than low-motivated rats as shown by a higher proportion of optimal chains, indicating a higher level of attention to the reward-predictive cue. Moreover, it was positively correlated with higher motivation for nicotine, a hallmark of nicotine addiction. CONCLUSIONS: These results suggest that higher attention to reward-associated cues prior to drug taking predicts vulnerability to nicotine-reinforcing properties.

Defining the place of habit in substance use disorders.

It has long been suggested that alcohol or substance use disorders could emerge from the progressive development and dominance of drug habits. Like habits, drug-related behaviors are often triggered by drug-associated cues. Like habits, addictive behaviors are strong, rigid and "hard to break". Like habits, these behaviors are insensitive to their outcome and persist despite negative consequences. "Pathological habit" thus appears as a good candidate to explain the transition to compulsive drug use. However, drug use could also be considered as a goal-directed choice, driven by the expectation of drug outcomes. For example, drug addicts may engage in drug-seeking behaviors because they view the drug as more valuable than available alternatives. Substance use disorders therefore may not be all about habit, nor fully intentional, and could be considered as resulting from an imbalance between goal-directed and habitual control. The main objective of this review is to disentangle the relative contribution of habit formation and impairment of goal-directed behavior in this unbalanced control of addictive behaviors. Although deficits in goal-directed behavior have been demonstrated in alcohol and substance use disorders, reliable demonstration of abnormal habit formation has been curtailed by the paucity of paradigms designed to assess habit as a positive result. Refining our animal and human model of habit is therefore required to precisely define the place of habit in substance use disorders and develop appropriate and adapted neurobehavioral treatments.

Lever Insertion as a Salient Stimulus Promoting Insensitivity to Outcome Devaluation.

Flexible and efficient decision-making in complex environments can be achieved through constant interactions between the goal-directed and habitual systems. While goal-directed behavior is considered dependent upon Response-Outcome (R-O) associations, habits instead rely on Stimulus-Response (S-R) associations. However, the stimuli that support the S-R association underlying habitual responding in typical instrumental procedures are poorly defined. To resolve this issue, we designed a discrete-trials procedure, in which rats must wait for lever insertion and complete a sequence of five lever presses to obtain a reward (20% sucrose or grain-based pellets). Lever insertion thus constituted an audio-visual stimulus signaling the opportunity for reward. Using sensory-specific satiety-induced devaluation, we found that rats trained with grain-based pellets remained sensitive to outcome devaluation over the course of training with this procedure whereas rats trained with a solution of 20% sucrose rapidly developed habit, and that insensitivity to outcome devaluation in rats trained with sucrose did not result from a bias in general satiety. Importantly, although rats trained with pellets were sensitive to satiety-induced devaluation, their performance was not affected by degradation of instrumental contingency and devaluation by conditioned taste aversion (CTA), suggesting that these rats may also have developed habitual responding. To test whether the discrete-trials procedure biases subjects towards habitual responding, we compared discrete-trials to free-running instrumental responding, and found that rats trained with sucrose in a fixed-ratio 5 (FR5) procedure with continuous presentation of the lever were goal-directed. Together, these results demonstrate that discrete presentations of a stimulus predictive of reward availability promoted the formation of S-R habit in rats trained with liquid sucrose. Further research is necessary to explain inconsistencies in sensitivity to outcome devaluation when rats are trained with grain-based pellets.

Choosing Under the Influence: A Drug-Specific Mechanism by Which the Setting Controls Drug Choices in Rats.

Ample evidence shows that the setting can control drug choices in both humans and animals. Here we reveal in rats that a major mechanism of this control involves a regulation of the drug influence on other competing options at the time of choice. Briefly, rats were offered a choice between a drug dose (cocaine or heroin) and a brief access to water sweetened with saccharin in two different settings. In one setting, choosing under the influence was not possible and rats largely preferred saccharin over either cocaine or heroin. In contrast, when the same rats were shifted to a setting where choosing under the influence was possible, they chose the drug either nonexclusively or exclusively depending on whether the drug enhanced or suppressed sweet reward, respectively. Thus, when rats were under the orexigenic influence of heroin at the time of choice, they more frequently chose saccharin in alternation with heroin. In contrast, when rats were under the anorexic influence of cocaine, they stopped choosing saccharin and continued taking cocaine exclusively. These setting- and drug-specific changes in preference were rapid and reversible, and could be induced by passively administering cocaine or heroin before choice. Finally, rats behaved as if they were oblivious to the drug influence on their choices. This behavior could explain why rats are vulnerable to harm themselves, sometimes to the point of death, in settings where choices are made under the drug influence, notably if this influence excludes other important options or, conversely, enhances harmful ones.

Sugar addiction: pushing the drug-sugar analogy to the limit.

PURPOSE OF REVIEW: To review research that tests the validity of the analogy between addictive drugs, like cocaine, and hyperpalatable foods, notably those high in added sugar (i.e., sucrose). RECENT FINDINGS: Available evidence in humans shows that sugar and sweetness can induce reward and craving that are comparable in magnitude to those induced by addictive drugs. Although this evidence is limited by the inherent difficulty of comparing different types of rewards and psychological experiences in humans, it is nevertheless supported by recent experimental research on sugar and sweet reward in laboratory rats. Overall, this research has revealed that sugar and sweet reward can not only substitute to addictive drugs, like cocaine, but can even be more rewarding and attractive. At the neurobiological level, the neural substrates of sugar and sweet reward appear to be more robust than those of cocaine (i.e., more resistant to functional failures), possibly reflecting past selective evolutionary pressures for seeking and taking foods high in sugar and calories. SUMMARY: The biological robustness in the neural substrates of sugar and sweet reward may be sufficient to explain why many people can have difficultly to control the consumption of foods high in sugar when continuously exposed to them.