Stress, associative learning, and decision-making.

Exposure to acute and chronic stress has significant effects on the basic mechanisms of associative learning and memory. Stress can both impair and enhance associative learning depending on type, intensity, and persistence of the stressor, the subject's sex, the context that the stress and behavior is experienced in, and the type of associative learning taking place. In some cases, stress can cause or exacerbate the maladaptive behavior that underlies numerous psychiatric conditions including anxiety disorders, obsessive-compulsive disorder, post-traumatic stress disorder, substance use disorder, and others. Therefore, it is critical to understand how the varied effects of stress, which may normally facilitate adaptive behavior, can also become maladaptive and even harmful. In this review, we highlight several findings of associative learning and decision-making processes that are affected by stress in both human and non-human subjects and how they are related to one another. An emerging theme from this work is that stress biases behavior towards less flexible strategies that may reflect a cautious insensitivity to changing contingencies. We consider how this inflexibility has been observed in different associative learning procedures and suggest that a goal for the field should be to clarify how factors such as sex and previous experience influence this inflexibility.

From Isolated Emotional Memories to Their Competition During Conflict.

Aversive or rewarding experiences are remembered better than those of lesser survival significance. These emotional memories, whether negative or positive, leave traces in the brain which can later be retrieved and strongly influence how we perceive, how we form associations with environmental stimuli and, ultimately, guide our decision-making. In this review aticle, we outline what constitutes an emotional memory by focusing on threat- and reward-related memories and describe how they are formed in the brain during learning and reformed during retrieval. Finally, we discuss how the field is moving from understanding emotional memory brain circuits separately, towards studying how these two opposing brain systems interact to guide choices during conflict. Here, we outline two novel tasks in rodents that model opposing binary choices (approach or avoid) guided by competing emotional memories. The prefrontal cortex (PFC) is a major integration hub of emotional information which is also known to be critical for decision-making. Consequently, brain circuits that involve this brain region may be key for understanding how the retrieval of emotional memories flexibly orchestrates adaptive choice behavior. Because several mental disorders (e.g., drug addiction and depression) are characterized by deficits in decision-making in the face of conflicting emotional memories (maladaptively giving more weight to one memory over the other), the development of choice-based animal models for emotional regulation could give rise to new approaches for the treatment of these disorders in humans.

Opposing Contributions of GABAergic and Glutamatergic Ventral Pallidal Neurons to Motivational Behaviors.

The ventral pallidum (VP) is critical for invigorating reward seeking and is also involved in punishment avoidance, but how it contributes to such opposing behavioral actions remains unclear. Here, we show that GABAergic and glutamatergic VP neurons selectively control behavior in opposing motivational contexts. In vivo recording combined with optogenetics in mice revealed that these two populations oppositely encode positive and negative motivational value, are differentially modulated by animal's internal state, and determine the behavioral response during motivational conflict. Furthermore, GABAergic VP neurons are essential for movements toward reward in a positive motivational context but suppress movements in an aversive context. In contrast, glutamatergic VP neurons are essential for movements to avoid a threat but suppress movements in an appetitive context. Our results indicate that GABAergic and glutamatergic VP neurons encode the drive for approach and avoidance, respectively, with the balance between their activities determining the type of motivational behavior.

The study of active avoidance: A platform for discussion.

Traditional active avoidance tasks have advanced the field of aversive learning and memory for decades and are useful for studying simple avoidance responses in isolation; however, these tasks have limited clinical relevance because they do not model several key features of clinical avoidance. In contrast, platform-mediated avoidance (PMA) more closely resembles clinical avoidance because the response i) is associated with an unambiguous safe location, ii) is not associated with an artificial termination of the warning signal, and iii) is associated with a decision-based appetitive cost. Recent findings on the neuronal circuits of PMA have confirmed that amygdala-striatal circuits are essential for avoidance. In PMA, however, the prelimbic cortex facilitates the avoidance response early during the warning signal, perhaps through disinhibition of the striatum. Future studies on avoidance should account for additional factors such as sex differences and social interactions that will advance our understanding of maladaptive avoidance contributing to neuropsychiatric disorders.

Prefrontal circuits signaling active avoidance retrieval and extinction.

OBJECTIVE: Neurons in PL and IL project densely to two areas implicated in active avoidance: the basolateral amygdala (BLA) and the ventral striatum (VS). We therefore combined c-Fos immunohistochemistry with retrograde tracers to characterize signaling in platform-mediated active avoidance. METHODS: Male rats  were infused with retrograde tracers (CTB, FB) into basolateral amygdala and ventral striatum and conditioned to avoid tone-signaled footshocks by stepping onto a nearby platform. In a subsequent test session, rats received either 2 unreinforced tones (avoidance retrieval) or 15 unreinforced tones (avoidance extinction) followed by analysis of c-Fos combined with fluorescent imaging of retrograde tracers. RESULTS: Retrieval of avoidance did not activate IL neurons, but did activate PL neurons projecting to BLA, and to a lesser extent VS. Extinction of avoidance activated IL neurons projecting to both BLA and VS, as well as PL neurons projecting to VS. CONCLUSIONS: Our observation that avoidance retrieval is signaled by PL projections to BLA suggests that PL may modulate VS indirectly via BLA, and agrees with other findings implicating BLA in active avoidance. Less expected was the signaling of extinction via PL inputs to VS, which may converge with IL inputs to VS to inhibit expression of avoidance.

Active avoidance requires inhibitory signaling in the rodent prelimbic prefrontal cortex.

Much is known about the neural circuits of conditioned fear and its relevance to understanding anxiety disorders, but less is known about other anxiety-related behaviors such as active avoidance. Using a tone-signaled, platform-mediated avoidance task, we observed that pharmacological inactivation of the prelimbic prefrontal cortex (PL) delayed avoidance. Surprisingly, optogenetic silencing of PL glutamatergic neurons did not delay avoidance. Consistent with this, inhibitory but not excitatory responses of rostral PL neurons were associated with avoidance training. To test the importance of these inhibitory responses, we optogenetically stimulated PL neurons to counteract the tone-elicited reduction in firing rate. Photoactivation of rostral (but not caudal) PL neurons at 4 Hz impaired avoidance. These findings suggest that inhibitory responses of rostral PL neurons signal the avoidability of a potential threat and underscore the importance of designing behavioral optogenetic studies based on neuronal firing responses.

Persistent active avoidance correlates with activity in prelimbic cortex and ventral striatum.

Persistent avoidance is a prominent symptom of anxiety disorders and is often resistant to extinction-based therapies. Little is known about the circuitry mediating persistent avoidance. Using a recently described platform-mediated active avoidance task, we assessed activity in several structures with c-Fos immuno-labeling. In Task 1, rats were conditioned to avoid a tone-signaled shock by moving to a safe platform, and then were extinguished over two days. One day later, failure to retrieve extinction correlated with increased activity in the prelimbic prefrontal cortex (PL), ventral striatum (VS), and basal amygdala (BA), and decreased activity in infralimbic prefrontal cortex (IL), consistent with pharmacological inactivation studies. In Task 2, the platform was removed during extinction training and fear (suppression of bar pressing) was extinguished to criterion over 3-5 days. The platform was then returned in a post-extinction test. Under these conditions, avoidance levels were equivalent to Experiment 1 and correlated with increased activity in PL and VS, but there was no correlation with activity in IL or BA. Thus, persistent avoidance can occur independently of deficits in fear extinction and its associated structures.

The effect of repeated exposure to ethanol on pre-existing fear memories in rats.

RATIONALE: There is a high degree of comorbidity between alcohol use disorder and post-traumatic stress disorder (PTSD), but little is known about the interactions of ethanol with traumatic memories. OBJECTIVES: Using auditory fear conditioning in rats, we asked if repeated exposure to ethanol could modify the retrieval of fear memories acquired prior to ethanol exposure. METHODS: Following auditory fear conditioning, Sprague-Dawley rats were given daily injections of ethanol (1.5 g/kg) or saline over 5 days. Two days later, they were given 20 trials of extinction training and then tested for extinction memory the following day. In a separate experiment, conditioned rats were given repeated ethanol injections and processed for c-Fos immunohistochemistry following a fear retrieval session. RESULTS: Two days following the cessation of ethanol, the magnitude of conditioned fear responses (freezing and suppression of bar pressing) was significantly increased. This increase persisted the following day. Waiting 10 days following cessation of ethanol eliminated the effect on fear retrieval. In rats conditioned with low shock levels, repeated exposure to ethanol converted a sub-threshold fear memory into a supra-threshold fear memory. It also increased c-Fos expression in the prelimbic prefrontal cortex, paraventricular thalamus, and the central and basolateral nuclei of the amygdala, areas implicated in the retrieval of fear memories. CONCLUSIONS: These results suggest that repeated exposure to ethanol may exacerbate pre-existing traumatic memories.

Long-range GABAergic neurons in the prefrontal cortex modulate behavior.

Cortical glutamatergic projections are extensively studied in behavioral neuroscience, whereas cortical GABAergic projections to downstream structures have been overlooked. A recent study by Lee and colleagues (Lee AT, Vogt D, Rubenstein JL, Sohal VS. J Neurosci 34: 11519-11525, 2014) used optogenetic and electrophysiological techniques to characterize a behavioral role for long-projecting GABAergic neurons in the medial prefrontal cortex. In this Neuro Forum, we discuss the potential implications of this study in several learning and memory models.

Neural structures mediating expression and extinction of platform-mediated avoidance.

Individuals use both passive and active defensive responses to environmental threats. Much is known about the neural circuits of passive defensive responses (e.g., freezing), but less is known about the substrates of active defensive responses (e.g., avoidance). We developed an active avoidance task in which rats learn to avoid a tone-signaled footshock by stepping onto a nearby platform. An advantage of this task is that freezing, which can interfere with avoidance, is reduced, thereby facilitating comparison of the effects of manipulations on avoidance versus freezing. After 10 d of avoidance training, rats were infused with muscimol to pharmacologically inactivate the prelimbic cortex (PL), infralimbic cortex (IL), ventral striatum (VS), or basolateral amygdala (BLA). Inactivating PL, VS, or BLA all impaired avoidance expression, but these areas differed with respect to freezing. Inactivating BLA decreased freezing consistent with loss of the tone-shock association, whereas inactivation of VS increased freezing consistent with loss of avoidance memory. Inactivation of PL had no effect on freezing. Inactivation of IL did not impair avoidance expression but did impair avoidance extinction. Our findings suggest that active avoidance is mediated by prefrontal-striatal circuits, which may be overactive in individuals suffering from trauma-related disorders.

Fear signaling in the prelimbic-amygdala circuit: a computational modeling and recording study.

The acquisition and expression of conditioned fear depends on prefrontal-amygdala circuits. Auditory fear conditioning increases the tone responses of lateral amygdala neurons, but the increase is transient, lasting only a few hundred milliseconds after tone onset. It was recently reported that that the prelimbic (PL) prefrontal cortex transforms transient lateral amygdala input into a sustained PL output, which could drive fear responses via projections to the lateral division of basal amygdala (BL). To explore the possible mechanisms involved in this transformation, we developed a large-scale biophysical model of the BL-PL network, consisting of 850 conductance-based Hodgkin-Huxley-type cells, calcium-based learning, and neuromodulator effects. The model predicts that sustained firing in PL can be derived from BL-induced release of dopamine and norepinephrine that is maintained by PL-BL interconnections. These predictions were confirmed with physiological recordings from PL neurons during fear conditioning with the selective ß-blocker propranolol and by inactivation of BL with muscimol. Our model suggests that PL has a higher bandwidth than BL, due to PL's decreased internal inhibition and lower spiking thresholds. It also suggests that variations in specific microcircuits in the PL-BL interconnection can have a significant impact on the expression of fear, possibly explaining individual variability in fear responses. The human homolog of PL could thus be an effective target for anxiety disorders.

Infralimbic D2 receptors are necessary for fear extinction and extinction-related tone responses.

BACKGROUND: Fear extinction is dependent on plasticity in the infralimbic prefrontal cortex, an area heavily innervated by midbrain dopaminergic inputs. Dopamine D2 receptors are concentrated in infralimbic output neurons that are involved in the suppression of conditioned fear after extinction. Here, we examined the specific role of infralimbic D2 receptors in mediating associative learning underlying fear extinction using the selective D2 antagonist raclopride. METHODS: Raclopride was administered systemically or infused into the infralimbic prefrontal cortex before fear extinction, and extinction retention was tested the following day. Rats were also prepared for single-unit recording in the infralimbic prefrontal cortex to assess the effect of raclopride on firing properties. RESULTS: We found that systemic injection of raclopride given before extinction impaired retrieval of extinction when rats were tested drug-free the next day but also induced catalepsy during extinction training. To determine whether impaired extinction was due to impaired motor function or disruption of extinction consolidation, we infused raclopride directly into the infralimbic prefrontal cortex. Raclopride infused immediately before extinction training did not produce motor deficits but impaired recall of extinction when tested drug-free. Furthermore, in animals that underwent extinction training, systemic raclopride reduced the tone responsiveness of infralimbic prefrontal cortex neurons in layers 5/6, with no changes in average firing rate. CONCLUSIONS: We suggest that D2 receptors facilitate extinction by increasing the signal-to-noise of infralimbic prefrontal cortex neurons that consolidate extinction.