Developments from Bulk Optogenetics to Single-Cell Strategies to Dissect the Neural Circuits that Underlie Aberrant Motivational States.

Motivational states are regulated by complex networks across brain regions that are composed of genetically and functionally distinct neuronal populations. Disruption within these neural circuits leads to aberrant motivational states and are thought to be the root cause of psychiatric disorders related to reward processing and addiction. Critical technological advances in the field have revolutionized the study of neural systems by allowing the use of optical strategies to precisely control and visualize neural activity within genetically identified neural populations in the brain. This review will provide a brief introduction into the history of how technological advances in single-cell strategies have been applied to elucidate the neural circuits that underlie aberrant motivational states that often lead to dysfunction in reward processing and addiction.

Prepronociceptin-Expressing Neurons in the Extended Amygdala Encode and Promote Rapid Arousal Responses to Motivationally Salient Stimuli.

Motivational states consist of cognitive, emotional, and physiological components controlled by multiple brain regions. An integral component of this neural circuitry is the bed nucleus of the stria terminalis (BNST). Here, we identify that neurons within BNST that express the gene prepronociceptin (PnocBNST) modulate rapid changes in physiological arousal that occur upon exposure to motivationally salient stimuli. Using in vivo two-photon calcium imaging, we find that PnocBNST neuronal responses directly correspond with rapid increases in pupillary size when mice are exposed to aversive and rewarding odors. Furthermore, optogenetic activation of these neurons increases pupillary size and anxiety-like behaviors but does not induce approach, avoidance, or locomotion. These findings suggest that excitatory responses in PnocBNST neurons encode rapid arousal responses that modulate anxiety states. Further histological, electrophysiological, and single-cell RNA sequencing data reveal that PnocBNST neurons are composed of genetically and anatomically identifiable subpopulations that may differentially tune rapid arousal responses to motivational stimuli.

Heterogeneous Habenular Neuronal Ensembles during Selection of Defensive Behaviors.

Optimal selection of threat-driven defensive behaviors is paramount to an animal's survival. The lateral habenula (LHb) is a key neuronal hub coordinating behavioral responses to aversive stimuli. Yet, how individual LHb neurons represent defensive behaviors in response to threats remains unknown. Here, we show that in mice, a visual threat promotes distinct defensive behaviors, namely runaway (escape) and action-locking (immobile-like). Fiber photometry of bulk LHb neuronal activity in behaving animals reveals an increase and a decrease in calcium signal time-locked with runaway and action-locking, respectively. Imaging single-cell calcium dynamics across distinct threat-driven behaviors identify independently active LHb neuronal clusters. These clusters participate during specific time epochs of defensive behaviors. Decoding analysis of this neuronal activity reveals that some LHb clusters either predict the upcoming selection of the defensive action or represent the selected action. Thus, heterogeneous neuronal clusters in LHb predict or reflect the selection of distinct threat-driven defensive behaviors.

Paraventricular Thalamus Projection Neurons Integrate Cortical and Hypothalamic Signals for Cue-Reward Processing.

The paraventricular thalamus (PVT) is an interface for brain reward circuits, with input signals arising from structures, such as prefrontal cortex and hypothalamus, that are broadcast to downstream limbic targets. However, the precise synaptic connectivity, activity, and function of PVT circuitry for reward processing are unclear. Here, using in vivo two-photon calcium imaging, we find that PVT neurons projecting to the nucleus accumbens (PVT-NAc) develop inhibitory responses to reward-predictive cues coding for both cue-reward associative information and behavior. The multiplexed activity in PVT-NAc neurons is directed by opposing activity patterns in prefrontal and lateral hypothalamic afferent axons. Further, we find that prefrontal cue encoding may maintain accurate cue-reward processing, as optogenetic disruption of this encoding induced long-lasting effects on downstream PVT-NAc cue responses and behavioral cue discrimination. Together, these data reveal that PVT-NAc neurons act as an interface for reward processing by integrating relevant inputs to accurately inform reward-seeking behavior.

Prefrontal cortex output circuits guide reward seeking through divergent cue encoding.

The prefrontal cortex is a critical neuroanatomical hub for controlling motivated behaviours across mammalian species. In addition to intra-cortical connectivity, prefrontal projection neurons innervate subcortical structures that contribute to reward-seeking behaviours, such as the ventral striatum and midline thalamus. While connectivity among these structures contributes to appetitive behaviours, how projection-specific prefrontal neurons encode reward-relevant information to guide reward seeking is unknown. Here we use in vivo two-photon calcium imaging to monitor the activity of dorsomedial prefrontal neurons in mice during an appetitive Pavlovian conditioning task. At the population level, these neurons display diverse activity patterns during the presentation of reward-predictive cues. However, recordings from prefrontal neurons with resolved projection targets reveal that individual corticostriatal neurons show response tuning to reward-predictive cues, such that excitatory cue responses are amplified across learning. By contrast, corticothalamic neurons gradually develop new, primarily inhibitory responses to reward-predictive cues across learning. Furthermore, bidirectional optogenetic manipulation of these neurons reveals that stimulation of corticostriatal neurons promotes conditioned reward-seeking behaviour after learning, while activity in corticothalamic neurons suppresses both the acquisition and expression of conditioned reward seeking. These data show how prefrontal circuitry can dynamically control reward-seeking behaviour through the opposing activities of projection-specific cell populations.

Coordination of Brain-Wide Activity Dynamics by Dopaminergic Neurons.

Several neuropsychiatric conditions, such as addiction and schizophrenia, may arise in part from dysregulated activity of ventral tegmental area dopaminergic (THVTA) neurons, as well as from more global maladaptation in neurocircuit function. However, whether THVTA activity affects large-scale brain-wide function remains unknown. Here we selectively activated THVTA neurons in transgenic rats and measured resulting changes in whole-brain activity using stimulus-evoked functional magnetic resonance imaging. Applying a standard generalized linear model analysis approach, our results indicate that selective optogenetic stimulation of THVTA neurons enhanced cerebral blood volume signals in striatal target regions in a dopamine receptor-dependent manner. However, brain-wide voxel-based principal component analysis of the same data set revealed that dopaminergic modulation activates several additional anatomically distinct regions throughout the brain, not typically associated with dopamine release events. Furthermore, explicit pairing of THVTA neuronal activation with a forepaw stimulus of a particular frequency expanded the sensory representation of that stimulus, not exclusively within the somatosensory cortices, but brain-wide. These data suggest that modulation of THVTA neurons can impact brain dynamics across many distributed anatomically distinct regions, even those that receive little to no direct THVTA input.

Memory bias in the temporal bisection point.

The ability to time intervals confers organisms, including humans, with many remarkable capabilities. A common method for studying interval timing is classification, in which a subject must indicate whether a given probe duration is nearer a previously learned short or long reference interval. This task is designed to reveal the probe duration that is equally likely to be labeled as short or long, known as the temporal bisection point. Studies have found that this bisection point is influenced by a variety of factors including the ratio of the target intervals, the spacing of the probe durations, the modalities of the stimuli, the attentional load, and the inter-trial duration. While several of these factors are thought to be mediated by memory effects, the prototypical classification task affords no opportunity to measure these memory effects directly. Here, we present a novel bisection task, termed the "Bisection by Classification and Production" (BiCaP) task, in which classification trials are interleaved with trials in which subjects must produce either the short or long referents or their midpoint. Using this method, we found a significant correlation between the means of the remembered referents and the bisection points for both classification and production trials. We then cross-validated the bisection points for production and classification trials by showing that they were not statistically differentiable. In addition to these population-level effects, we found within-subject evidence for co-variation across a session between the production bisection points and the means of the remembered referents. Finally, by using two sets of referent durations, we showed that only memory bias-corrected measures were consistent with a previously reported effect in which the ratio of the referents affects the location of the bisection point. These results suggest that memory effects should be considered in temporal tasks.

A general theory of intertemporal decision-making and the perception of time.

Animals and humans make decisions based on their expected outcomes. Since relevant outcomes are often delayed, perceiving delays and choosing between earlier vs. later rewards (intertemporal decision-making) is an essential component of animal behavior. The myriad observations made in experiments studying intertemporal decision-making and time perception have not yet been rationalized within a single theory. Here we present a theory-Training-Integrated Maximized Estimation of Reinforcement Rate (TIMERR)-that explains a wide variety of behavioral observations made in intertemporal decision-making and the perception of time. Our theory postulates that animals make intertemporal choices to optimize expected reward rates over a limited temporal window which includes a past integration interval-over which experienced reward rate is estimated-as well as the expected delay to future reward. Using this theory, we derive mathematical expressions for both the subjective value of a delayed reward and the subjective representation of the delay. A unique contribution of our work is in finding that the past integration interval directly determines the steepness of temporal discounting and the non-linearity of time perception. In so doing, our theory provides a single framework to understand both intertemporal decision-making and time perception.