Dopaminergic systems create reward seeking despite adverse consequences.

Resource-seeking behaviours are ordinarily constrained by physiological needs and threats of danger, and the loss of these controls is associated with pathological reward seeking1. Although dysfunction of the dopaminergic valuation system of the brain is known to contribute towards unconstrained reward seeking2,3, the underlying reasons for this behaviour are unclear. Here we describe dopaminergic neural mechanisms that produce reward seeking despite adverse consequences in Drosophila melanogaster. Odours paired with optogenetic activation of a defined subset of reward-encoding dopaminergic neurons become cues that starved flies seek while neglecting food and enduring electric shock punishment. Unconstrained seeking of reward is not observed after learning with sugar or synthetic engagement of other dopaminergic neuron populations. Antagonism between reward-encoding and punishment-encoding dopaminergic neurons accounts for the perseverance of reward seeking despite punishment, whereas synthetic engagement of the reward-encoding dopaminergic neurons also impairs the ordinary need-dependent dopaminergic valuation of available food. Connectome analyses reveal that the population of reward-encoding dopaminergic neurons receives highly heterogeneous input, consistent with parallel representation of diverse rewards, and recordings demonstrate state-specific gating and satiety-related signals. We propose that a similar dopaminergic valuation system dysfunction is likely to contribute to maladaptive seeking of rewards by mammals.

Input Connectivity Reveals Additional Heterogeneity of Dopaminergic Reinforcement in Drosophila.

Different types of Drosophila dopaminergic neurons (DANs) reinforce memories of unique valence and provide state-dependent motivational control [1]. Prior studies suggest that the compartment architecture of the mushroom body (MB) is the relevant resolution for distinct DAN functions [2, 3]. Here we used a recent electron microscope volume of the fly brain [4] to reconstruct the fine anatomy of individual DANs within three MB compartments. We find the 20 DANs of the γ5 compartment, at least some of which provide reward teaching signals, can be clustered into 5 anatomical subtypes that innervate different regions within γ5. Reconstructing 821 upstream neurons reveals input selectivity, supporting the functional relevance of DAN sub-classification. Only one PAM-γ5 DAN subtype γ5(fb) receives direct recurrent feedback from γ5ß'2a mushroom body output neurons (MBONs) and behavioral experiments distinguish a role for these DANs in memory revaluation from those reinforcing sugar memory. Other DAN subtypes receive major, and potentially reinforcing, inputs from putative gustatory interneurons or lateral horn neurons, which can also relay indirect feedback from MBONs. We similarly reconstructed the single aversively reinforcing PPL1-γ1pedc DAN. The γ1pedc DAN inputs mostly differ from those of γ5 DANs and they cluster onto distinct dendritic branches, presumably separating its established roles in aversive reinforcement and appetitive motivation [5, 6]. Tracing also identified neurons that provide broad input to γ5, ß'2a, and γ1pedc DANs, suggesting that distributed DAN populations can be coordinately regulated. These connectomic and behavioral analyses therefore reveal further complexity of dopaminergic reinforcement circuits between and within MB compartments.