The clinical relevance of neuroplasticity in corticostriatal networks during operant learning.

Dopamine and glutamate serve crucial functions in neural plasticity, learning and memory, and addiction. Contemporary theories contend that these two, widely-distributed neurotransmitter systems play an integrative role in motivational and associative information processing. Combined signaling of these systems, particularly through the dopamine (DA) D1 and glutamate (Glu) N-methyl-d-aspartate receptors (NMDAR), triggers critical intracellular signaling cascades that lead to changes in chromatin structure, gene expression, synaptic plasticity, and ultimately behavior. Addictive drugs also induce long-term neuroadaptations at the molecular and genomic levels causing structural changes that alter basic connectivity. Indeed, evidence that drugs of abuse engage D1- and NMDA-mediated neuronal cascades shared with normal reward learning provides one of the most important insights from contemporary studies on the neurobiology of addiction. Such drug-induced neuroadaptations likely contribute to abnormal information processing and behavior, resulting in the poor decision-making, loss of control, and compulsivity that characterize addiction. Such features are also common to many other neuropsychiatric disorders. Behavior problems, construed as difficulties associated with operant learning and behavior, present compelling challenges and unique opportunities for their treatment that require further study. The present review highlights the integrative work of Ann E. Kelley and colleagues, demonstrating a critical role not only for NMDAR, D1 receptors (D1R), and their associated signaling cascades, but also for other Glu receptors and protein synthesis in operant learning throughout a cortico-striatal-limbic network. Recent work has extended the impact of appetitive learning to epigenetic processes. A better understanding of these processes will likely assist in discovering therapeutics to engage neural plasticity-related processes and promote functional behavioral adaptations.

Gustatory insular cortex lesions disrupt drug-induced, but not lithium chloride-induced, suppression of conditioned stimulus intake.

Rats suppress intake of a normally preferred 0.15% saccharin conditioned stimulus (CS) when it is paired with an aversive agent like lithium chloride (LiCl) or a preferred substance such as sucrose or a drug of abuse. The reward comparison hypothesis suggests that rats avoid intake of a saccharin cue following pairings with a drug of abuse because the rats are anticipating the availability of the rewarding properties of the drug. The present study used bilateral ibotenic acid lesions to examine the role of the gustatory cortex in the suppression of CS intake induced by cocaine, morphine, and LiCl. The results show that bilateral lesions of the insular gustatory cortex (1) fully prevent the suppressive effects of both a 15 and a 30 mg/kg dose of morphine, (2) attenuate the suppressive effect of a 10 mg/kg dose of cocaine, but (3) are overridden by a 20 mg/kg dose of the drug. Finally, these same cortical lesions had no impact on LiCl-induced conditioned taste aversion. The current data show that the insular taste cortex plays an integral role in drug-induced avoidance of a gustatory CS.

Heroin self-administration: I. Incubation of goal-directed behavior in rats.

This study used heroin self-administration to investigate incubation of goal-directed heroin-seeking behavior following abstinence. Male Sprague-Dawley rats self-administered heroin on a fixed ratio 10 (FR10) schedule of reinforcement with licking of an empty spout serving as the operant behavior during 14 daily 3 h sessions. After this acquisition period, all rats received a 90 min extinction session following either 1 day or 14 days of home cage abstinence. When the extinction session occurred after only 1 day of home cage abstinence, rats with a history of heroin self-administration divided their responses equally between the previously "active" and "inactive" spouts. However, when the extinction session occurred following 14 days of home cage abstinence, the rats exhibited marked goal-directed heroin-seeking behavior by licking more on the previously "active" than "inactive" spout. These findings demonstrate that heroin-seeking behavior incubates over time, resulting in goal-directed heroin-seeking behavior in rats following 14 days but not 1 day of abstinence. Moreover, this facilitatory effect occurred in response to a different training schedule, lower total drug intake, and shorter periods of daily access than previously reported with heroin.

Glutamate-mediated plasticity in corticostriatal networks: role in adaptive motor learning.

Little is known about how memories of new voluntary motor actions, also known as procedural memory, are formed at the molecular level. Our work examining acquisition of lever-pressing for food in rats has shown that activation of glutamate NMDA receptors, within broadly distributed but interconnected regions (e.g., nucleus accumbens core, prefrontal cortex, basolateral amygdala), is critical for such learning to occur. This receptor stimulation triggers intracellular cascades that involve protein phosphorylation and new protein synthesis. In support of this idea, we have found that posttrial inhibition of protein synthesis in the ventral striatum impairs learning, whereas posttrial NMDA receptor blockade does not. More recent data show extension of this network to the central amygdala, where infusions of NMDA antagonists also impair learning. We hypothesize that activity in this distributed network (including dopaminergic activity and perhaps muscarinic cholinergic activity) computes coincident events and thus enhances the probability that temporally related actions and events (e.g., lever pressing and delivery of reward) become associated. Such basic mechanisms of plasticity within this reinforcement learning network also appear to be profoundly affected in addiction.

Appetitive instrumental learning requires coincident activation of NMDA and dopamine D1 receptors within the medial prefrontal cortex.

Through its complex role in cognition, memory, and emotion, the mammalian prefrontal cortex is thought to contribute to the organization of adaptive behavioral actions. In the present studies we examined the role of dopaminergic D1 and glutamatergic NMDA receptors within the prefrontal cortex of the rat during the development of adaptive instrumental learning. Hungry rats with bilateral indwelling cannulas aimed at the medial prefrontal cortex were trained to lever-press for food. Infusion of the selective D1 antagonist SCH-23390 (0.15, 0.3, 3.0 nmol) dose-dependently impaired acquisition of this behavior. Higher doses also impaired expression of this task. Co-infusion of the lowest dose of SCH 23390 with a low dose of the NMDA antagonist AP-5 (0.5 nmol), each of which had no effect on learning when infused alone, potently reduced the ability to acquire the response. Inhibition of intracellular protein kinase A with the selective PKA inhibitor Rp-cAMPS also disrupted acquisition, suggesting that PKA is an intracellular substrate for a D1-NMDA receptor interaction. In control experiments, drug infusions that impaired learning did not affect food intake or locomotion, suggesting a specific effect on learning. We hypothesize that coincident detection of D1-NMDA receptor activation and its transcriptional consequences, within multiple sites of a distributed corticostriatal network, may represent a conserved molecular mechanism for instrumental learning.

Appetitive instrumental learning is impaired by inhibition of cAMP-dependent protein kinase within the nucleus accumbens.

The medium spiny neurons of the nucleus accumbens receive a unique convergence of dopaminergic and glutamatergic inputs from regions associated with motivational, cognitive, and sensory processes. Long-term forms of plasticity in the nucleus accumbens associated with such processes as appetitive learning and drug addiction may require coactivation of both dopamine D1 and glutamate N-methyl-D-aspartate (NMDA) receptors. This notion implies that an intracellular mechanism is likely to be involved in these long-term neuroadaptive processes. The present series of experiments examined the effects of intra-accumbens microinfusion of protein kinase inhibitors on acquisition of an instrumental task, lever-pressing for food. Male Sprague-Dawley rats were bilaterally implanted with chronic indwelling cannulae aimed at the nucleus accumbens core. Following recovery, animals were food-restricted and subsequently trained for operant responding. The broad-based serine/threonine kinase inhibitor H-7 (5 or 27 nmol per side) dose-dependently impaired learning when infused immediately after testing on days 1-4. Rp-cAMPS, a cAMP-dependent protein kinase (PKA) inhibitor, also impaired learning regardless of whether it was infused immediately before (5 or 20 nmol) or immediately after (10 nmol) testing on days 1-4. Rp-cAMPS (10 nmol) also inhibited learning when infused 1 h after testing, though to a lesser extent than when administered before or immediately after testing. The PKA stimulator Sp-cAMPS (5 or 20 nmol) also impaired learning when infused before testing, suggesting that there is an optimal level of PKA activity required for learning. None of the drugs used produced nonspecific motor or feeding effects. These results provide evidence supporting the involvement of nucleus accumbens PKA in appetitive learning and suggest that this kinase may be involved in long-term changes associated with this and other motivationally based neuroadaptive processes.

Sensitization of the tail-flick reflex following exposure to either a single prolonged test trial or behavioral testing under the analgesic influence of morphine.

Although the tail-flick response to radiant heat is widely used in nociceptive research, there are indications that this benchmark test possesses some undesirable characteristics. Of present concern is the possibility that the supra-threshold stimuli associated with behavioral testing while under the influence of an effective hypoalgesic manipulation can alter subsequent tail-flick responses. To examine the effects of supra-threshold heating of the tail, we exposed anesthetized rats to either (1) manual restraint of the tail during a single tail-flick trial to a 5- or 7-sec cut-off, or (2) testing while under the analgesic effects of morphine (5 mg/kg/ml). A single prolonged trial produced hyperalgesia which lasted for 30 min. Following naltrexone injection, hyperalgesia was also found in animals that had been tested while under morphine analgesia. In contrast, animals that received morphine but were not tested under its influence did not exhibit hyperalgesia of similar magnitude. Analyses of tail temperature data in the second experiment indicate that these results are not dependent on shifts in tail temperature. These results suggest that, in anesthetized animals, exposure to prolonged tail-flick trials can produce hyperalgesia.