The birth, death and resurrection of avoidance: a reconceptualization of a troubled paradigm.

Research on avoidance conditioning began in the late 1930s as a way to use laboratory experiments to better understand uncontrollable fear and anxiety. Avoidance was initially conceived of as a two-factor learning process in which fear is first acquired through Pavlovian aversive conditioning (so-called fear conditioning), and then behaviors that reduce the fear aroused by the Pavlovian conditioned stimulus are reinforced through instrumental conditioning. Over the years, criticisms of both the avoidance paradigm and the two-factor fear theory arose. By the mid-1980s, avoidance had fallen out of favor as an experimental model relevant to fear and anxiety. However, recent progress in understanding the neural basis of Pavlovian conditioning has stimulated a new wave of research on avoidance. This new work has fostered new insights into contributions of not only Pavlovian and instrumental learning but also habit learning, to avoidance, and has suggested that the reinforcing event underlying the instrumental phase should be conceived in terms of cellular and molecular events in specific circuits rather than in terms of vague notions of fear reduction. In our approach, defensive reactions (freezing), actions (avoidance) and habits (habitual avoidance) are viewed as being controlled by unique circuits that operate nonconsciously in the control of behavior, and that are distinct from the circuits that give rise to conscious feelings of fear and anxiety. These refinements, we suggest, overcome older criticisms, justifying the value of the new wave of research on avoidance, and offering a fresh perspective on the clinical implications of this work.

External incentives and internal states guide goal-directed behavior via the differential recruitment of the nucleus accumbens and the medial prefrontal cortex.

Goal-directed behavior is governed by internal physiological states and external incentives present in the environment (e.g. hunger and food). While the role of the mesocorticolimbic dopamine (DA) system in behavior guided by environmental incentives has been well studied, the effect of relevant physiological states on the function of this system is less understood. The current study examined the role of the medial prefrontal cortex (mPFC) and the nucleus accumbens (NAcc) in the kind of food-reinforced behaviors known to be sensitive to the internal state produced by food deprivation conditions. Operant lever-press reinforced on fixed ratio 1 (FR1) and progressive ratio (PR) schedules was tested after temporary inactivation of, or DA receptor blockade in, the prelimbic mPFC or NAcc core of rats with differing levels of food deprivation (0, 12 and 36-h). Food deprivation increased PR breakpoints, as well as the number of lever-presses emitted on the FR1 schedule. Both temporary inactivation and DA blockade of NAcc reduced breakpoints across deprivation conditions, while temporary inactivation and DA blockade of mPFC reduced breakpoints only in food-deprived rats. Neither manipulation of mPFC and NAcc had any effect on behavior reinforced on the FR1 schedule. Thus, mPFC and NAcc were differentially relevant to the behaviors tested-NAcc was recruited when the behavioral cost per reinforcer was rising or high regardless of food deprivation conditions, while mPFC was recruited when food-deprived animals behaved through periods of sparse reinforcement density in order to maximize available gain.

Effects of food deprivation on goal-directed behavior, spontaneous locomotion, and c-Fos immunoreactivity in the amygdala.

Previous work in our laboratory has shown that food deprivation and food presentation produce different patterns of neuronal activity (as measured by c-Fos immunoreactivity) in the medial prefrontal cortex and nucleus accumbens of rats. Since the amygdala has been implicated in both motivational and reinforcement processes and has neuronal connections to both the prefrontal cortex and nucleus accumbens, it was of interest to assess amygdaloid c-Fos immunoreactivity during similar manipulations of food deprivation and presentation. In the current study, c-Fos counts in both basolateral and central amygdalar nuclei were observed to increase in rats 12- and 36-h food deprived (relative to 0-h controls)-an effect reversed by the presentation of either a small or large meal (2.5 or 20g of food). In another experiment, rats working on a progressive ratio schedule of reinforcement exhibited elevated break-points as a function of food deprivation, a result consistent with the view that the feeding manipulations increased the subjects' level of motivation. In contrast, food deprivation reduced the spontaneous locomotor activity of rats, presumably as a result of an inherent energy-conservation strategy when no food is readily available. These data suggest that the state of food deprivation is associated with: (a) enhanced behavioral output only when food is attainable (increased goal-directed behavior, but decreased spontaneous activity), and (b) increased synaptic engagement in neuronal circuits involved in affective valuation and related decision-making (increased c-Fos counts in the amygdala).