General and Specific Aversive Modulation of Active Avoidance Require Central Amygdala.

Three studies provide evidence that the central nucleus of the amygdala, a structure with a well-established role in conditioned freezing, is also required for conditioned facilitation of instrumental avoidance in rats. First, the immediate early gene c-Fos was measured following the presentation of a previously shock-paired tone in subjects trained either on an unsignaled avoidance task or not (in addition to tone only presentations in naïve controls). Significantly elevated expression of c-Fos was found in both the avoidance trained and Pavlovian trained conditions relative to naïve controls (but with no difference between the two trained conditions). In a subsequent study, intracranial infusions of muscimol into the central amygdala significantly attenuated the facilitation of shock-avoidance by a shock-paired Pavlovian cue relative to pre-operative responding. The final study used a virogenetic approach to inhibit the central amygdala prior to testing. This treatment eliminated the transfer of motivational control over shock-avoidance by both a shock-paired Pavlovian stimulus, as well as a cue paired with a perceptually distinct aversive event (i.e., klaxon). These findings provide compelling support for a role of central amygdala in producing aversive Pavlovian-instrumental transfer.

Conditional Control of Instrumental Avoidance by Context Following Extinction.

Using rodents, three training arrangements (i.e., ABB vs. ABA, AAA vs. AAB and ABB vs. ABC) explored whether extinction influences the expression of avoidance in a manner controlled by context. Retention testing following extinction showed that more avoidance responding (i.e., renewal) was observed when extinguished cues were tested outside of the context where they had undergone extinction. In contrast, response rates were significantly lower when stimuli were tested within the context where extinction learning had occurred. These findings add to the emerging literature assessing the role of Pavlovian extinction processes in the development of instrumental avoidance responding by demonstrating conditional control over extinguished responding by context. This study was conducted using a within-subjects approach that minimized the potential for context-outcome associations to bias responding, and thus, reflects hierarchical control over behavior based on the specific associative status of each tested cue in each training context.

The lesser evil: Pavlovian-instrumental transfer & aversive motivation.

While our understanding of appetitive motivation includes accounts of rich cognitive phenomena, such as choice, sensory-specificity and outcome valuation, the same is not true in aversive processes. A highly sophisticated picture has emerged of Pavlovian fear conditioning and extinction, but progress in aversive motivation has been somewhat limited to these fundamental behaviors. Many differences between appetitive and aversive stimuli permit different kinds of analyses; a widely used procedure in appetitive studies that can expand the scope of aversive motivation is Pavlovian-instrumental transfer (PIT). Recently, this motivational transfer effect has been used to examine issues pertaining to sensory-specificity and the nature of defensive control in avoidance learning. Given enduring controversies and unresolved criticisms surrounding avoidance research, PIT offers a valuable, well-controlled procedure with which to similarly probe this form of motivation. Furthermore, while avoidance itself can be criticized as artificial, PIT can be an effective model for how skills learned through avoidance can be practically applied to encounters with threatening or fearful stimuli and stress. Despite sensory-related challenges presented by the limited aversive unconditioned stimuli typically used in research, transfer testing can nevertheless provide valuable information on the psychological nature of this historically controversial phenomenon.

Chemogenetic Inhibition Reveals That Processing Relative But Not Absolute Threat Requires Basal Amygdala.

While our understanding of appetitive motivation has benefited immensely from the use of selective outcome devaluation tools, the same cannot be said about aversive motivation. Findings from appetitive conditioning studies have shown that basal amygdala is required for behaviors that are sensitive to updates in outcome value, but similar results in aversive motivation are difficult to interpret due to a lack of outcome specificity. The studies reported here sought to develop procedures to isolate sensory-specific processes in aversive learning and behavior and to assess the possible contribution of the basal amygdala. Post-training changes to outcome value produced commensurate changes to subsequently tested conditioned responding in male rodents. Specifically, increases in shock intensity (i.e., inflation) augmented, while repeated exposure to (i.e., habituation of) an aversive sound (klaxon-horn) reduced freezing to conditioned stimuli previously paired with these outcomes. This was extended to a discriminative procedure, in which following revaluation of one event, but not the other, responding was found to be dependent on outcome value signaled by each cue. Chemogenetic inactivation of basal amygdala impaired this discrimination between stimuli signaling differently valued outcomes, but did not affect the revaluation process itself. These findings demonstrate a contribution of the basal amygdala to aversive outcome-dependent motivational processes.SIGNIFICANCE STATEMENT The specific content of pavlovian associative learning has been well studied in appetitive motivation, where the value of different foods can be easily manipulated. This has facilitated our understanding of the neural circuits that generate different forms of motivation (i.e., sensory specific vs general). Studies of aversive learning have not produced the same degree of understanding with regard to sensory specificity due to a lack of tools for evaluating sensory-specific processes. Here we use a variant of outcome devaluation procedures with aversive stimuli to study the role of basal amygdala in discriminating between aversive stimuli conveying different degrees of threat. These findings have implications for how we study generalized threat to identify dysregulation that can contribute to generalized anxiety.

Pavlovian Extinction and Recovery Effects in Aversive Pavlovian to Instrumental Transfer.

Three studies explored the sensitivity of aversive Pavlovian to instrumental transfer (PIT) to Pavlovian extinction in rodents. Rats underwent Pavlovian conditioning prior to avoidance training. The PIT test then involved assessment of the effects of the Pavlovian conditioned stimulus (CS) on the performance of the avoidance response (AR). Conducting extinction prior to avoidance training and transfer testing, allowed spontaneous recovery and shock reinstatement of extinguished motivation, whereas conducting extinction following avoidance training and just prior to PIT testing successfully reduced transfer effects. This was also the case in a design that compared responding to an extinguished CS against a non-extinguished CS rather than comparing extinguished and non-extinguished groups to one another. While extinction treatments in many appetitive PIT studies do not successfully reduce transfer, and can sometimes enhance the effect, the current findings show that an extinction treatment temporally close to transfer testing can reduce the motivational impact of the aversive Pavlovian CS on instrumental avoidance responding.

Noradrenergic Regulation of Central Amygdala in Aversive Pavlovian-to-Instrumental Transfer.

The neural mechanisms through which a Pavlovian conditioned stimulus (CS) elicits innate defense responses are well understood. But a Pavlovian CS can also invigorate ongoing instrumental responding, as shown by studies of aversive Pavlovian-to-instrumental transfer (PIT). While the neural circuitry of appetitive PIT has been studied extensively, little is known about the brain mechanisms of aversive PIT. We recently showed the central amygdala (CeA) is essential for aversive PIT. In the current studies, using pharmacology and designer receptors in rodents, we demonstrate that noradrenergic (NE) activity negatively regulates PIT via brainstem locus coeruleus (LC) activity and LC projections to CeA. Our results provide evidence for a novel pathway through which response modulation occurs between brainstem neuromodulatory systems and CeA to invigorate adaptive behavior in the face of threat.

Characterization of the amplificatory effect of norepinephrine in the acquisition of Pavlovian threat associations.

The creation of auditory threat Pavlovian memory requires an initial learning stage in which a neutral conditioned stimulus (CS), such as a tone, is paired with an aversive one (US), such as a shock. In this phase, the CS acquires the capacity of predicting the occurrence of the US and therefore elicits conditioned defense responses. Norepinephrine (NE), through ß-adrenergic receptors in the amygdala, enhances threat memory by facilitating the acquisition of the CS-US association, but the nature of this effect has not been described. Here we show that NE release, induced by the footshock of the first conditioning trial, promotes the subsequent enhancement of learning. Consequently, blocking NE transmission disrupts multitrial but not one-trial conditioning. We further found that increasing the time between the conditioning trials eliminates the amplificatory effect of NE. Similarly, an unsignaled footshock delivered in a separate context immediately before conditioning can enhance learning. These results help define the conditions under which NE should and should not be expected to alter threat processing and fill an important gap in the understanding of the neural processes relevant to the pathophysiology of stress and anxiety disorders.

The Neural Foundations of Reaction and Action in Aversive Motivation.

Much of the early research in aversive learning concerned motivation and reinforcement in avoidance conditioning and related paradigms. When the field transitioned toward the focus on Pavlovian threat conditioning in isolation, this paved the way for the clear understanding of the psychological principles and neural and molecular mechanisms responsible for this type of learning and memory that has unfolded over recent decades. Currently, avoidance conditioning is being revisited, and with what has been learned about associative aversive learning, rapid progress is being made. We review, below, the literature on the neural substrates critical for learning in instrumental active avoidance tasks and conditioned aversive motivation.

Modulation of instrumental responding by a conditioned threat stimulus requires lateral and central amygdala.

Two studies explored the role of the amygdala in response modulation by an aversive conditioned stimulus (CS) in rats. Experiment 1 investigated the role of amygdala circuitry in conditioned suppression using a paradigm in which licking for sucrose was inhibited by a tone CS that had been previously paired with footshock. Electrolytic lesions of the lateral amygdala (LA) impaired suppression relative to sham-operated animals, and produced the same pattern of results when applied to central amygdala. In addition, disconnection of the lateral and central amygdala, by unilateral lesion of each on opposite sides of the brain, also impaired suppression relative to control subjects that received lesions of both areas on the same side. In each case, lesions were placed following Pavlovian conditioning and instrumental training, but before testing. This procedure produced within-subjects measures of the effects of lesion on freezing and between-group comparisons for the effects on suppression. Experiment 2 extended this analysis to a task where an aversive CS suppressed shuttling responses that had been previously food reinforced and also found effects of bilateral lesions of the central amygdala in a pre-post design. Together, these studies demonstrate that connections between the lateral and central amygdala constitute a serial circuit involved in processing aversive Pavlovian stimuli, and add to a growing body of findings implicating central amygdala in the modulation of instrumental behavior.

Lesions of lateral or central amygdala abolish aversive Pavlovian-to-instrumental transfer in rats.

Aversive Pavlovian conditioned stimuli (CSs) elicit defensive reactions (e.g., freezing) and motivate instrumental actions like active avoidance (AA). Pavlovian reactions require connections between the lateral (LA) and central (CeA) nuclei of the amygdala, whereas AA depends on LA and basal amygdala (BA). Thus, the neural circuits mediating conditioned reactions and motivation appear to diverge in the amygdala. However, AA is not ideal for studying conditioned motivation, because Pavlovian and instrumental learning are intermixed. Pavlovian-to-instrumental transfer (PIT) allows for the study of conditioned motivation in isolation. PIT refers to the ability of a Pavlovian CS to modulate a separately-trained instrumental action. The role of the amygdala in aversive PIT is unknown. We designed an aversive PIT procedure in rats and tested the effects of LA, BA, and CeA lesions. Rats received Pavlovian tone-shock pairings followed by Sidman shock-avoidance training. PIT was assessed by comparing shuttling rates in the presence and absence of the tone. Tone presentations facilitated instrumental responding. Aversive PIT was abolished by lesions of LA or CeA, but was unaffected by lesions of BA. These results suggest that LA and CeA are essential for aversive conditioned motivation. More specifically, the results are consistent with a model of amygdala processing in which the CS is encoded in the LA and then, via connections to CeA, the motivation to perform the aversive task is enhanced. These findings have implications for understanding the contribution of amygdala circuits to aversive instrumental motivation, but also for the relation of aversive and appetitive behavioral control.

Dorsal hippocampus inactivation impairs spontaneous recovery of Pavlovian magazine approach responding in rats.

Destruction or inactivation of the dorsal hippocampus (DH) has been shown to eliminate the renewal of extinguished fear [1-4]. However, it has recently been reported that the contextual control of responding to extinguished appetitive stimuli is not disrupted when the DH is destroyed or inactivated prior to tests for renewal of Pavlovian conditioned magazine approach [5]. In the present study we extend the analysis of DH control of appetitive extinction learning to the spontaneous recovery of Pavlovian conditioned magazine approach responding. Subjects were trained to associate two separate stimuli with the delivery of food and had muscimol or vehicle infused into the DH prior to a single test-session for spontaneous recovery occurring immediately following extinction of one of these stimuli, but one week following extinction of the other. While vehicle treated subjects showed more recovery to the distally extinguished stimulus than the proximal one, muscimol treated subjects failed to show spontaneous recovery to either stimulus. This result suggests that, while the DH is not involved in the control of extinction by physical contexts [5], it may be involved when time is the gating factor controlling recovery of extinguished responding.