Reliance on habits at the expense of goal-directed control following dopamine precursor depletion.

RATIONALE: Dopamine is well known to play an important role in learning and motivation. Recent animal studies have implicated dopamine in the reinforcement of stimulus-response habits, as well as in flexible, goal-directed action. However, the role of dopamine in human action control is still not well understood. OBJECTIVES: We present the first investigation of the effect of reducing dopamine function in healthy volunteers on the balance between habitual and goal-directed action control. METHODS: The dietary intervention of acute dietary phenylalanine and tyrosine depletion (APTD) was adopted to study the effects of reduced global dopamine function on action control. Participants were randomly assigned to either the APTD or placebo group (ns = 14) to allow for a between-subjects comparison of performance on a novel three-stage experimental paradigm. In the initial learning phase, participants learned to respond to different stimuli in order to gain rewarding outcomes. Subsequently, an outcome-devaluation test and a slips-of-action test were conducted to assess whether participants were able to flexibly adjust their behaviour to changes in the desirability of the outcomes. RESULTS: APTD did not prevent stimulus-response learning, nor did we find evidence for impaired response-outcome learning in the subsequent outcome-devaluation test. However, when goal-directed and habitual systems competed for control in the slips-of-action test, APTD tipped the balance towards habitual control. These findings were restricted to female volunteers. CONCLUSIONS: We provide direct evidence that the balance between goal-directed and habitual control in humans is dopamine dependent. The results are discussed in light of gender differences in dopamine function and psychopathologies.

Dopamine precursor depletion improves punishment prediction during reversal learning in healthy females but not males.

INTRODUCTION: The neurotransmitter dopamine has frequently been implicated in reward processing but is also, increasingly, implicated in punishment processing. We have previously shown that both patients with Parkinson's disease and healthy individuals with low dopamine (DA) synthesis are better at reversal learning based on punishment than reward. Here, we extend these prior findings by examining the effects of artificially reducing DA synthesis in healthy individuals performing this previously employed task. METHODS: In a double-blind, placebo-controlled crossover design, we applied the acute tyrosine and phenylalanine depletion (ATPD) procedure to reduce global DA synthesis in 15 female and 14 male subjects. Each subject performed the reward- and punishment-based reversal-learning paradigm. RESULTS: There was a significant three-way interaction between ATPD, the valence of the outcome signalling reversal and the gender of the participants. Examination of punishment and reward-based reversals separately revealed that this was driven by a significant improvement in punishment processing in female but not male subjects following DA depletion. CONCLUSIONS: Reducing DA synthesis in healthy individuals shifted sensitivity of performance from reward to punishment processing. Gender differences in DA synthesis might underlie the selectivity of this effect to female subjects. Such gender biases may go some way towards explaining the gender biases in certain psychiatric disorders such as depression and Parkinson's disease.

Word, thought, and deed: the role of object categories in children's inductive inferences and exploratory play.

Previous research (e.g., S. A. Gelman & E. M. Markman, 1986; A. Gopnik & D. M. Sobel, 2000) suggests that children can use category labels to make inductive inferences about nonobvious causal properties of objects. However, such inductive generalizations can fail to predict objects' causal properties when (a) the property being projected varies within the category, (b) the category is arbitrary (e.g., things smaller than a bread box), or (c) the property being projected is due to an exogenous intervention rather than intrinsic to the object kind. In 4 studies, the authors showed that preschoolers (M = 48 months; range = 42-57 months) were sensitive to these constraints on induction and selectively engaged in exploration when evidence about objects' causal properties conflicted with inductive generalizations from the objects' kind to their causal powers. This suggests that the exploratory actions children generate in free play could support causal learning.