Computational approaches to modeling gambling behaviour: Opportunities for understanding disordered gambling.

Computational modeling has become an important tool in neuroscience and psychiatry research to provide insight into the cognitive processes underlying normal and pathological behavior. There are two modeling frameworks, reinforcement learning (RL) and drift diffusion modeling (DDM), that are well-developed in cognitive science, and have begun to be applied to Gambling Disorder. RL models focus on explaining how an agent uses reward to learn about the environment and make decisions based on outcomes. The DDM is a binary choice framework that breaks down decision making into psychologically meaningful components based on choice reaction time analyses. Both approaches have begun to yield insight into aspects of cognition that are important for, but not unique to, gambling, and thus relevant to the development of Gambling Disorder. However, these approaches also oversimplify or neglect various aspects of decision making seen in real-world gambling behavior. Gambling Disorder presents an opportunity for 'bespoke' modeling approaches to consider these neglected components. In this review, we discuss studies that have used RL and DDM frameworks to investigate some of the key cognitive components in gambling and Gambling Disorder. We also include an overview of Bayesian models, a methodology that could be useful for more tailored modeling approaches. We highlight areas in which computational modeling could enable progression in the investigation of the cognitive mechanisms relevant to gambling.

The ß-adrenoceptor blocker propranolol ameliorates compulsive-like gambling behaviour in a rodent slot machine task: implications for iatrogenic gambling disorder.

Previous work has shown that chronic administration of the dopamine D2/3 receptor agonist ropinirole invigorates performance on a rodent slot machine task (rSMT). This behavioural change appears superficially similar to the iatrogenic gambling disorder (GD) observed in a sub-set of patients with Parkinson's disease (PD), and has been associated with increased activation of the intra-cellular signalling proteins GSK3ß and CREB in the striatum. Here, we wanted to determine whether this response to ropinirole could be attenuated by targeting these signalling proteins, and if the loss of dopaminergic innervation characteristic of PD would alter ropinirole's effects on the rSMT. Male Long Evans rats were trained on the rSMT. Dopaminergic terminals innervating the dorsolateral striatum were then lesioned bilaterally using the neurotoxin 6-hydroxydopamine hydrochloride (6-OHDA). Subsequently animals were implanted with osmotic mini-pumps delivering ropinirole. Lastly, animals were given dietary lithium (Li+ ), to inhibit the activation of GSK3ß, or injections of the ß-adrenoceptor antagonist propranolol, which potently inhibits CREB as a secondary mechanism of action, and any changes in ropinirole-induced increases in compulsive-like engagement in the rSMT evaluated. Chronic ropinirole increased the number of trials animals completed, reproducing our original finding. This increase in task engagement was not altered in animals with 6-OHDA lesions, a putative model of early PD. In addition, the effects of ropinirole were not attenuated by administration of Li+ , but were ameliorated by propranolol. These data suggest that propranolol may represent a potential pharmacotherapy for the treatment of iatrogenic gambling.

Dietary influences on cognition.

Obesity is a world-wide crisis with profound healthcare and socio-economic implications and it is now clear that the central nervous system (CNS) is a target for the complications of metabolic disorders like obesity. In addition to decreases in physical activity and sedentary lifestyles, diet is proposed to be an important contributor to the etiology and progression of obesity. Unfortunately, there are gaps in our knowledge base related to how dietary choices impact the structural and functional integrity of the CNS. For example, while chronic consumption of hypercaloric diets (increased sugars and fat) contribute to increases in body weight and adiposity characteristic of metabolic disorders, the mechanistic basis for neurocognitive deficits in obesity remains to be determined. In addition, studies indicate that acute consumption of hypercaloric diets impairs performance in a wide variety of cognitive domains, even in normal non-obese control subjects. These results from the clinical and basic science literature indicate that diet can have rapid, as well as long lasting effects on cognitive function. This review summarizes our symposium at the 2017 Society for the Study of Ingestive Behavior (SSIB) meeting that discussed these effects of diet on cognition. Collectively, this review highlights the need for integrated and comprehensive approaches to more fully determine how diet impacts behavior and cognition under physiological conditions and in metabolic disorders like type 2 diabetes mellitus (T2DM) and obesity.

Inactivation of the orbitofrontal cortex reduces irrational choice on a rodent Betting Task.

Cognitive biases may play a significant role in disorders of decision making such as pathological gambling and addiction. Understanding the neurobiology of these biases could lead to more effective pharmacological and therapeutic treatments for disorders in which aberrant decision making is prominent. The rodent Betting Task (rBT) was designed to measure one commonly observed decision-making heuristic in rodents, namely "escalation of commitment" in which subjects become more risk averse as the stakes increase, even if the odds of success remain constant. In the rodent task, the animal is presented with a choice between two options of equivalent expected value, such that reward on one option is guaranteed while the other has a 50% chance of double the prize or nothing. Past work has shown that a subset of animals (termed wager sensitive) adopt an irrationally risk-averse choice preference in which they shift their choice away from the uncertain option as the bet size grows larger. In the current study, the orbitofrontal (OFC), prelimbic (PrL), and infralimbic cortex (IL) were inactivated to evaluate the contributions made by these regions to choice behavior on the rBT. Inactivation of the OFC (but not the IL or the PrL) selectively ameliorated the risk-averse choice pattern characteristic of wager-sensitive animals. This finding suggests that the OFC may have a relatively unique role in promoting this type of non-normative decision-making under uncertainty, an effect that is potentially related to its role in representing the subjective value of reinforcing outcomes.

The agranular and granular insula differentially contribute to gambling-like behavior on a rat slot machine task: effects of inactivation and local infusion of a dopamine D4 agonist on reward expectancy.

RATIONALE: Rats, like humans, are susceptible to the reinforcing effects of reward-related stimuli presented within a compound stimulus array, putatively analogous to the so-called near-miss effect. We have previously demonstrated using a rodent slot machine task (rSMT) that the reward expectancy these stimuli elicit is critically mediated by the dopamine D4 receptor. D4 receptors are principally located in prefrontal regions activated during slot machine play in humans, such as the insular cortex. The insula has recently attracted considerable interest as it appears to play a crucial role in substance and behavioral addictions. However, the insula is a heterogeneous area, and the relative contributions of subregions to addictive behaviors are unclear. METHODS: Male Long Evans rats were trained to perform the rSMT, and then bilateral cannula targeting either the granular or agranular insula were implanted. The effects of inactivation and local administration of a D4 agonist were investigated. RESULTS: Temporary inactivation of the agranular, but not the granular insula impaired performance on the rSMT. In contrast, local infusion of the D4 agonist PD168077 into the agranular insula had no effect on task performance, but when administered into the granular insula, it improved animals' ability to differentiate winning from non-winning trials. The agranular insula may therefore modulate decision making when conflicting stimuli are present, potentially due to its role in generating a cohesive emotional percept based on both externally and internally generated signals, whereas the granular insular is not critical for this process. Nevertheless, D4 receptors within the granular insula may amplify the incentive salience of aversive environmental stimuli. DISCUSSION: These data provide insight into the neurobiological mechanism underpinning maladaptive reward expectancy during gambling and provide further evidence that D4 receptors represent a potential target for developing pharmacotherapies for problem gambling.

Elucidating the role of D4 receptors in mediating attributions of salience to incentive stimuli on Pavlovian conditioned approach and conditioned reinforcement paradigms.

The power of drug-associated cues to instigate drug 'wanting' and consequently promote drug seeking is a corner stone of contemporary theories of addiction. Gambling disorder has recently been added to the pantheon of addictive disorders due to the phenomenological similarities between the diseases. However, the neurobiological mechanism that may mediate increased sensitivity towards conditioned stimuli in addictive disorders is unclear. We have previously demonstrated using a rodent analogue of a simple slot machine that the dopamine D4 receptor is critically engaged in controlling animals' attribution of salience to stimuli associated with reward in this paradigm, and consequently may represent a target for the treatment of gambling disorder. Here, we investigated the role of acute administration of a D4 receptor agonist on animals' responsivity to conditioned stimuli on both a Pavlovian conditioned approach (autoshaping) and a conditioned reinforcement paradigm. Following training on one of the two tasks, separate cohorts of rats (male and female) were administered a dose of PD168077 shown to be maximally effective at precipitating errors in reward expectancy on the rat slot machine task (10mg/kg). However, augmenting the activity of the D4 receptors in this manner did not alter behaviour on either task. These data therefore provide novel evidence that the D4 receptor does not alter incentive motivation in response to cues on simple behavioural tasks.

Activation of dopamine D4 receptors within the anterior cingulate cortex enhances the erroneous expectation of reward on a rat slot machine task.

Using a rodent slot machine task (rSMT), we have previously shown that rats, like humans, are susceptible to the reinforcing effects of winning signals presented within a compound stimulus array, even when the pattern generated predicts a negative rather than a positive outcome such as during a "near-miss". The dopamine D4 receptor critically mediates the erroneous reward expectancy generated on such trials. D4 receptors are particularly enriched within frontal and limbic areas activated during slot machine play, such as the anterior cingulate cortex (ACC). We therefore selectively inactivated the ACC to confirm involvement of this region in rSMT performance, and subsequently examined the specific contribution of local D4 receptors. ACC inactivations generally impaired animals' ability to optimally differentiate winning from losing outcomes. Local administration of the D4 agonist PD168077 had a qualitatively similar effect, but increased reward expectancy was only evident on archetypal "near-miss" trials i.e. when the first two of three stimuli in the array were concordant with a rewarding outcome, and only the last stimulus critically signalled a non-win. These data indicate that the ACC is critically involved in parsing the appropriate response when competing stimulus-outcome associations are activated, and that signalling via D4 receptors may play a particularly important role in gating the temporal and spatial summation of salient events. Such findings provide novel insights into the mechanism underlying the erroneous expectations of reward generated when playing slot machines, and suggest a mechanism by which D4 receptor antagonists may be effective in treating gambling disorder.

Irrational beliefs, biases and gambling: exploring the role of animal models in elucidating vulnerabilities for the development of pathological gambling.

Gambling is a heterogeneous and complex disorder. Multiple factors may lead to problem gambling, yet one of the most important appears to be the increased presence of cognitive biases or distortions. These biases are thought to precipitate gambling as they can lead to dysfunctional decision making under risk or ambiguity. Modelling these cognitive perturbations in animals can improve our understanding of their neurobiological bases, and potentially stimulate novel treatment options. The first aim of this review is to give a broad overview of some of the cognitive biases that are most commonly associated with gambling. Secondly, we will discuss several animal models that we have developed in which rodent decision-making appears hallmarked by the same cognitive inconsistencies as human choice. In particular, we will discuss two tasks that capture elements of risk and loss averse decision making, and another in which rats appear susceptible to the 'near-miss' effect. To date, findings from both human and non-human studies suggest that these different biases are neuropharmacologically and neurostructurally dissociable, and that dopamine plays a key role in their expression. Lastly, we will briefly discuss areas in both human and animal research where limitations within the field may be hampering a more complete understanding of pathological gambling as a disorder.

Contributions of serotonin in addiction vulnerability.

The serotonin (5-hydroxytryptamine; 5-HT) system has long been associated with mood and its dysregulation implicated in the pathophysiology of mood and anxiety disorders. While modulation of 5-HT neurotransmission by drugs of abuse is also recognized, its role in drug addiction and vulnerability to drug relapse is a more recent focus of investigation. First, we review preclinical data supporting the serotonergic raphe nuclei and their forebrain projections as targets of drugs of abuse, with emphasis on the effects of psychostimulants, opioids and ethanol. Next, we examine the role of 5-HT receptors in impulsivity, a core behavior that contributes to the vulnerability to addiction and relapse. Finally, we discuss evidence for serotonergic dysregulation in comorbid mood and addictive disorders and suggest novel serotonergic targets for the treatment of addiction and the prevention of drug relapse.