Aversive Pavlovian inhibition in adult attention-deficit/hyperactivity disorder and its restoration by mindfulness-based cognitive therapy.

Background: Control over the tendency to make or withhold responses guided by contextual Pavlovian information plays a key role in understanding impulsivity and hyperactivity. Here we set out to assess (1) the understudied relation between contextual Pavlovian inhibitory control and hyperactivity/impulsivity in adults with ADHD and (2) whether this inhibition can be enhanced by mindfulness based cognitive therapy (MBCT). Methods: Within the framework of a randomized controlled trial 50 Adult ADHD patients were assessed before and after 8 weeks of treatment as usual (TAU) with (n = 24) or without (n = 26) MBCT. We employed a well-established behavioral Pavlovian-to-instrumental transfer task that quantifies Pavlovian inhibitory control over instrumental behavior. Results: Task results revealed (1) less aversive Pavlovian inhibition in ADHD patients with clinically relevant hyperactivity/impulsivity than in those without; and (2) enhanced Pavlovian inhibition across all ADHD patients after TAU+MBCT compared with TAU. Conclusion: These findings offer new insights in the neurocognitive mechanisms of hyperactivity/impulsivity in ADHD and its treatment: We reveal a role for Pavlovian inhibitory mechanisms in understanding hyperactive/impulsive behaviors in ADHD and point toward MBCT as an intervention that might influence these mechanisms.

Effects of methylphenidate on reinforcement learning depend on working memory capacity.

RATIONALE: Brain catecholamines have long been implicated in reinforcement learning, exemplified by catecholamine drug and genetic effects on probabilistic reversal learning. However, the mechanisms underlying such effects are unclear. OBJECTIVES AND METHODS: Here we investigated effects of an acute catecholamine challenge with methylphenidate (20 mg, oral) on a novel probabilistic reversal learning paradigm in a within-subject, double-blind randomised design. The paradigm was designed to disentangle effects on punishment avoidance from effects on reward perseveration. Given the known large individual variability in methylphenidate's effects, we stratified our effects by working memory capacity and trait impulsivity, putatively modulating the effects of methylphenidate, in a large sample (n = 102) of healthy volunteers. RESULTS: Contrary to our prediction, methylphenidate did not alter performance in the reversal phase of the task. Our key finding is that methylphenidate altered learning of choice-outcome contingencies in a manner that depended on individual variability in working memory span. Specifically, methylphenidate improved performance by adaptively reducing the effective learning rate in participants with higher working memory capacity. CONCLUSIONS: This finding emphasises the important role of working memory in reinforcement learning, as reported in influential recent computational modelling and behavioural work, and highlights the dependence of this interplay on catecholaminergic function.

Methylphenidate boosts choices of mental labor over leisure depending on striatal dopamine synthesis capacity.

The cognitive enhancing effects of methylphenidate are well established, but the mechanisms remain unclear. We recently demonstrated that methylphenidate boosts cognitive motivation by enhancing the weight on the benefits of a cognitive task in a manner that depended on striatal dopamine. Here, we considered the complementary hypothesis that methylphenidate might also act by changing the weight on the opportunity cost of a cognitive task, that is, the cost of foregoing alternative opportunity. To this end, 50 healthy participants (25 women) completed a novel cognitive effort-discounting task that required choices between task and leisure. They were tested on methylphenidate, placebo, as well as the selective D2-receptor agent sulpiride, the latter to strengthen inference about dopamine receptor selectivity of methylphenidate's effects. Furthermore, they also underwent an [18F]DOPA PET scan to quantify striatal dopamine synthesis capacity. Methylphenidate boosted choices of cognitive effort over leisure across the group, and this effect was greatest in participants with more striatal dopamine synthesis capacity. The effects of sulpiride did not reach significance. This study strengthens the motivational account of methylphenidate's effects on cognition, and suggests that methylphenidate reduces the cost of mental labor by increasing striatal dopamine.

Catecholaminergic modulation of the cost of cognitive control in healthy older adults.

Catecholamines have long been associated with cognitive control and value-based decision-making. More recently, we have shown that catecholamines also modulate value-based decision-making about whether or not to engage in cognitive control. Yet it is unclear whether catecholamines influence these decisions by altering the subjective value of control. Thus, we tested whether tyrosine, a catecholamine precursor altered the subjective value of performing a demanding working memory task among healthy older adults (60-75 years). Contrary to our prediction, tyrosine administration did not significantly increase the subjective value of conducting an N-back task for reward, as a main effect. Instead, in line with our previous study, exploratory analyses indicated that drug effects varied as a function of participants' trait impulsivity scores. Specifically, tyrosine increased the subjective value of conducting an N-back task in low impulsive participants, while reducing its value in more impulsive participants. One implication of these findings is that the over-the-counter tyrosine supplements may be accompanied by an undermining effect on the motivation to perform demanding cognitive tasks, at least in certain older adults. Taken together, these findings indicate that catecholamines can alter cognitive control by modulating motivation (rather than just the ability) to exert cognitive control.

Catecholaminergic modulation of meta-learning.

The remarkable expedience of human learning is thought to be underpinned by meta-learning, whereby slow accumulative learning processes are rapidly adjusted to the current learning environment. To date, the neurobiological implementation of meta-learning remains unclear. A burgeoning literature argues for an important role for the catecholamines dopamine and noradrenaline in meta-learning. Here, we tested the hypothesis that enhancing catecholamine function modulates the ability to optimise a meta-learning parameter (learning rate) as a function of environmental volatility. 102 participants completed a task which required learning in stable phases, where the probability of reinforcement was constant, and volatile phases, where probabilities changed every 10-30 trials. The catecholamine transporter blocker methylphenidate enhanced participants' ability to adapt learning rate: Under methylphenidate, compared with placebo, participants exhibited higher learning rates in volatile relative to stable phases. Furthermore, this effect was significant only with respect to direct learning based on the participants' own experience, there was no significant effect on inferred-value learning where stimulus values had to be inferred. These data demonstrate a causal link between catecholaminergic modulation and the adjustment of the meta-learning parameter learning rate.

Catecholaminergic modulation of the avoidance of cognitive control.

The catecholamines have long been associated with cognitive control and value-based decision-making. More recently, we proposed that the catecholamines might modulate value-based decision-making about whether or not to engage in cognitive control. We test this hypothesis by assessing effects of a catecholamine challenge in a large sample of young, healthy adults (n = 100) on the avoidance of a cognitively demanding control process: task switching. Prolonging catecholamine transmission by blocking reuptake with methylphenidate altered the avoidance, but not the execution of cognitive control. Crucially, these effects could be isolated by taking into account individual differences in trait impulsivity, so that participants with higher trait impulsivity became more avoidant of cognitive control, despite faster task performance. One implication of these findings is that performance-enhancing effects of methylphenidate may be accompanied by an undermining effect on the willingness to exert cognitive control. Taken together, these findings integrate hitherto segregated literatures on catecholamines' roles in value-based learning/choice and cognitive control. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Controlling striatal function via anterior frontal cortex stimulation.

Motivational, cognitive and action goals are processed by distinct, topographically organized, corticostriatal circuits. We aimed to test whether processing in the striatum is under causal control by cortical regions in the human brain by investigating the effects of offline transcranial magnetic stimulation (TMS) over distinct frontal regions associated with motivational, cognitive and action goal processing. Using a three-session counterbalanced within-subject crossover design, continuous theta burst stimulation was applied over the anterior prefrontal cortex (aPFC), dorsolateral prefrontal cortex, or premotor cortex, immediately after which participants (N = 27) performed a paradigm assessing reward anticipation (motivation), task (cognitive) switching, and response (action) switching. Using task-related functional magnetic resonance imaging (fMRI), we assessed the effects of stimulation on processing in distinct regions of the striatum. To account for non-specific effects, each session consisted of a baseline (no-TMS) and a stimulation (post-TMS) fMRI run. Stimulation of the aPFC tended to decrease reward-related processing in the caudate nucleus, while stimulation of the other sites was unsuccessful. A follow-up analysis revealed that aPFC stimulation also decreased processing in the putamen as a function of the interaction between all factors (reward, cognition and action), suggesting stimulation modulated the transfer of motivational information to cortico-striatal circuitry associated with action control.

Catecholaminergic challenge uncovers distinct Pavlovian and instrumental mechanisms of motivated (in)action.

Catecholamines modulate the impact of motivational cues on action. Such motivational biases have been proposed to reflect cue-based, 'Pavlovian' effects. Here, we assess whether motivational biases may also arise from asymmetrical instrumental learning of active and passive responses following reward and punishment outcomes. We present a novel paradigm, allowing us to disentangle the impact of reward and punishment on instrumental learning from Pavlovian response biasing. Computational analyses showed that motivational biases reflect both Pavlovian and instrumental effects: reward and punishment cues promoted generalized (in)action in a Pavlovian manner, whereas outcomes enhanced instrumental (un)learning of chosen actions. These cue- and outcome-based biases were altered independently by the catecholamine enhancer melthylphenidate. Methylphenidate's effect varied across individuals with a putative proxy of baseline dopamine synthesis capacity, working memory span. Our study uncovers two distinct mechanisms by which motivation impacts behaviour, and helps refine current models of catecholaminergic modulation of motivated action.

Stress and Cognitive Flexibility: Cortisol Increases Are Associated with Enhanced Updating but Impaired Switching.

Acute stress has frequently been shown to impair cognitive flexibility. Most studies have examined the effect of stress on cognitive flexibility by measuring how stress changes performance in paradigms that require participants to switch between different task demands. These processes typically implicate pFC function, a region known to be impaired by stress. However, cognitive flexibility is a multifaceted construct. Another dimension of flexibility, updating to incorporate relevant information, involves the dorsal striatum. Function in this region has been shown to be enhanced by stress. Using a within-subject design, we tested whether updating flexibility in a DMS task would be enhanced by an acute stress manipulation (cold pressor task). Participants' cortisol response to stress positively correlated with a relative increase in accuracy on updating flexibility (compared with trials with no working memory interference). In contrast, in line with earlier studies, cortisol responses correlated with worse performance when switching between trials with different task demands. These results demonstrate that stress-related increases in cortisol are associated with both increases and decreases in cognitive flexibility, depending on task demands.

Converging effects of cocaine addiction and sex on neural responses to monetary rewards.

There is some evidence that cocaine addiction manifests as more severe in women than men. Here, we examined whether these sex-specific differences in the clinical setting parallel differential neurobehavioral sensitivity to rewards in the laboratory setting. Twenty-eight (14 females/14 males) cocaine-dependent and 25 (11 females/14 males) healthy individuals completed a monetary reward task during fMRI. Results showed that the effects of cocaine dependence and sex overlapped in regions traditionally considered part of the mesocorticolimbic brain circuits including the hippocampus and posterior cingulate cortex (PCC), as well as those outside of this circuit (e.g., the middle temporal gyrus). The nature of this 'overlap' was such that both illness and female sex were associated with lower activations in these regions in response to money. Diagnosis-by-sex interactions instead emerged in the frontal cortex, such that cocaine-dependent females exhibited lower precentral gyrus and greater inferior frontal gyrus (IFG) activations relative to cocaine-dependent males and healthy females. Within these regions modulated both by diagnosis and sex, lower activation in the hippocampus and PCC, and higher IFG activations, correlated with increased subjective craving during the task. Results suggest sex-specific differences in addiction extend to monetary rewards and may contribute to core symptoms linked to relapse.

Common and distinct neural correlates of inhibitory dysregulation: stroop fMRI study of cocaine addiction and intermittent explosive disorder.

Despite the high prevalence and consequences associated with externalizing psychopathologies, little is known about their underlying neurobiological mechanisms. Studying multiple externalizing disorders, each characterized by compromised inhibition, could reveal both common and distinct mechanisms of impairment. The present study therefore compared individuals with intermittent explosive disorder (IED) (N = 11), individuals with cocaine use disorder (CUD) (N = 21), and healthy controls (N = 17) on task performance and functional magnetic resonance imaging (fMRI) activity during an event-related color-word Stroop task; self-reported trait anger expression was also collected in all participants. Results revealed higher error-related activity in the two externalizing psychopathologies as compared with controls in two subregions of the dorsolateral prefrontal cortex (DLPFC) (a region known to be involved in exerting cognitive control during this task), suggesting a neural signature of inhibitory-related error processing common to these psychopathologies. Interestingly, in one DLPFC subregion, error-related activity was especially high in IED, possibly indicating a specific neural correlate of clinically high anger expression. Supporting this interpretation, error-related DLPFC activity in this same subregion positively correlated with trait anger expression across all participants. These collective results help to illuminate common and distinct neural signatures of impaired self-control, and could suggest novel therapeutic targets for increasing self-control in clinical aggression specifically and/or in various externalizing psychopathologies more generally.