Reinforcement learning links spontaneous cortical dopamine impulses to reward.

In their pioneering study on dopamine release, Romo and Schultz speculated "...that the amount of dopamine released by unmodulated spontaneous impulse activity exerts a tonic, permissive influence on neuronal processes more actively engaged in preparation of self-initiated movements...."1 Motivated by the suggestion of "spontaneous impulses," as well as by the "ramp up" of dopaminergic neuronal activity that occurs when rodents navigate to a reward,2-5 we asked two questions. First, are there spontaneous impulses of dopamine that are released in cortex? Using cell-based optical sensors of extrasynaptic dopamine, [DA]ex,6 we found that spontaneous dopamine impulses in cortex of naive mice occur at a rate of ∼0.01 per second. Next, can mice be trained to change the amplitude and/or timing of dopamine events triggered by internal brain dynamics, much as they can change the amplitude and timing of dopamine impulses based on an external cue?7-9 Using a reinforcement learning paradigm based solely on rewards that were gated by feedback from real-time measurements of [DA]ex, we found that mice can volitionally modulate their spontaneous [DA]ex. In particular, by only the second session of daily, hour-long training, mice increased the rate of impulses of [DA]ex, increased the amplitude of the impulses, and increased their tonic level of [DA]ex for a reward. Critically, mice learned to reliably elicit [DA]ex impulses prior to receiving a reward. These effects reversed when the reward was removed. We posit that spontaneous dopamine impulses may serve as a salient cognitive event in behavioral planning.

Orofacial Movements Involve Parallel Corticobulbar Projections from Motor Cortex to Trigeminal Premotor Nuclei.

How do neurons in orofacial motor cortex (MCtx) orchestrate behaviors? We show that focal activation of MCtx corticobulbar neurons evokes behaviorally relevant concurrent movements of the forelimb, jaw, nose, and vibrissae. The projections from different locations in MCtx form gradients of boutons across premotor nuclei spinal trigeminal pars oralis (SpVO) and interpolaris rostralis (SpVIr). Furthermore, retrograde viral tracing from muscles that control orofacial actions shows that these premotor nuclei segregate their outputs. In the most dramatic case, both SpVO and SpVIr are premotor to forelimb and vibrissa muscles, while only SpVO is premotor to jaw muscles. Functional confirmation of the superimposed control by MCtx was obtained through selective optogenetic activation of corticobulbar neurons on the basis of their preferential projections to SpVO versus SpVIr. We conclude that neighboring projection neurons in orofacial MCtx form parallel pathways to distinct pools of trigeminal premotor neurons that coordinate motor actions into a behavior.

Neonatal Nicotine Exposure Primes Midbrain Neurons to a Dopaminergic Phenotype and Increases Adult Drug Consumption.

BACKGROUND: Nicotine intake induces addiction through neuroplasticity of the reward circuitry, altering the activity of dopaminergic neurons of the ventral tegmental area. Prior work demonstrated that altered circuit activity can change neurotransmitter expression in the developing and adult brain. Here we investigated the effects of neonatal nicotine exposure on the dopaminergic system and nicotine consumption in adulthood. METHODS: Male and female mice were used for two-bottle-choice test, progressive ratio breakpoint test, immunohistochemistry, RNAscope, quantitative polymerase chain reaction, calcium imaging, and DREADD (designer receptor exclusively activated by designer drugs)-mediated chemogenic activation/inhibition experiments. RESULTS: Neonatal nicotine exposure potentiates drug preference in adult mice, induces alterations in calcium spike activity of midbrain neurons, and increases the number of dopamine-expressing neurons in the ventral tegmental area. Specifically, glutamatergic neurons are first primed to express transcription factor Nurr1, then acquire the dopaminergic phenotype following nicotine re-exposure in adulthood. Enhanced neuronal activity combined with Nurr1 expression is both necessary and sufficient for the nicotine-mediated neurotransmitter plasticity to occur. CONCLUSIONS: Our findings illuminate a new mechanism of neuroplasticity by which early nicotine exposure primes the reward system to display increased susceptibility to drug consumption in adulthood.

Nicotine recruits glutamate receptors to postsynaptic sites.

Cholinergic neurons project throughout the nervous system and activate nicotinic receptors to modulate synaptic function in ways that shape higher order brain function. The acute effects of nicotinic signaling on long-term synaptic plasticity have been well-characterized. Less well understood is how chronic exposure to low levels of nicotine, such as those encountered by habitual smokers, can alter neural connections to promote addiction and other lasting behavioral effects. We show here that chronic exposure of hippocampal neurons in culture to low levels of nicotine recruits AMPA and NMDA receptors to the cell surface and sequesters them at postsynaptic sites. The receptors include GluA2-containing AMPA receptors, which are responsible for most of the excitatory postsynaptic current mediated by AMPA receptors on the neurons, and include NMDA receptors containing GluN1 and GluN2B subunits. Moreover, we find that the nicotine treatment also increases expression of the presynaptic component synapsin 1 and arranges it in puncta juxtaposed to the additional AMPA and NMDA receptor puncta, suggestive of increases in synaptic contacts. Consistent with increased synaptic input, we find that the nicotine treatment leads to an increase in the excitatory postsynaptic currents mediated by AMPA and NMDA receptors. Further, the increases skew the ratio of excitatory-to-inhibitory input that the cell receives, and this holds both for pyramidal neurons and inhibitory neurons in the hippocampal CA1 region. The GluN2B-containing NMDA receptor redistribution at synapses is associated with a significant increase in GluN2B phosphorylation at Tyr1472, a site known to prevent GluN2B endocytosis. These results suggest that chronic exposure to low levels of nicotine not only alters functional connections but also is likely to change excitability levels across networks. Further, it may increase the propensity for synaptic plasticity, given the increase in synaptic NMDA receptors.

Glutamatergic synapse formation is promoted by α7-containing nicotinic acetylcholine receptors.

Glutamate is the primary excitatory transmitter in adult brain, acting through synapses on dendritic spines and shafts. Early in development, however, when glutamatergic synapses are only beginning to form, nicotinic cholinergic excitation is already widespread; it is mediated by acetylcholine activating nicotinic acetylcholine receptors (nAChRs) that generate waves of activity across brain regions. A major class of nAChRs contributing at this time is a species containing α7 subunits (α7-nAChRs). These receptors are highly permeable to calcium, influence a variety of calcium-dependent events, and are diversely distributed throughout the developing CNS. Here we show that α7-nAChRs unexpectedly promote formation of glutamatergic synapses during development. The dependence on α7-nAChRs becomes clear when comparing wild-type (WT) mice with mice constitutively lacking the α7-nAChR gene. Ultrastructural analysis, immunostaining, and patch-clamp recording all reveal synaptic deficits when α7-nAChR input is absent. Similarly, nicotinic activation of α7-nAChRs in WT organotypic culture, as well as cell culture, increases the number of glutamatergic synapses. RNA interference demonstrates that the α7-nAChRs must be expressed in the neuron being innervated for normal innervation to occur. Moreover, the deficits persist throughout the developmental period of major de novo synapse formation and are still fully apparent in the adult. GABAergic synapses, in contrast, are undiminished in number under such conditions. As a result, mice lacking α7-nAChRs have an altered balance in the excitatory/inhibitory input they receive. This ratio represents a fundamental feature of neural networks and shows for the first time that endogenous nicotinic cholinergic signaling plays a key role in network construction.

Induction of dendritic spines by ß2-containing nicotinic receptors.

Glutamatergic synapses are located mostly on dendritic spines in the adult nervous system. The spines serve as postsynaptic compartments, containing components that mediate and control the synaptic signal. Early in development, when glutamatergic synapses are initially forming, waves of excitatory activity pass through many parts of the nervous system and are driven in part by a class of heteropentameric ß2-containing nicotinic acetylcholine receptors (ß2*-nAChRs). These ß2*-nAChRs are widely distributed and, when activated, can depolarize the membrane and elevate intracellular calcium levels in neurons. We show here that ß2*-nAChRs are essential for acquisition of normal numbers of dendritic spines during development. Mice constitutively lacking the ß2-nAChR gene have fewer dendritic spines than do age-matched wild-type mice at all times examined. Activation of ß2*-nAChRs by nicotine either in vivo or in organotypic slice culture quickly elevates the number of spines. RNA interference studies both in vivo and in organotypic culture demonstrate that the ß2*-nAChRs act in a cell-autonomous manner to increase the number of spines. The increase depends on intracellular calcium and activation of calcium, calmodulin-dependent protein kinase II. Absence of ß2*-nAChRs in vivo causes a disproportionate number of glutamatergic synapses to be localized on dendritic shafts, rather than on spines as occurs in wild type. This shift in synapse location is found both in the hippocampus and cortex, indicating the breadth of the effect. Because spine synapses differ from shaft synapses in their signaling capabilities, the shift observed is likely to have significant consequences for network function.

Nicotinic control of adult-born neuron fate.

The hippocampus is one of only two regions in the adult brain where neurons are generated in significant numbers throughout the lifetime of the animal. Numerous studies have demonstrated that these adult-born neurons are essential for optimal cognitive function with unimpaired memory formation and retrieval. The extent to which adult-born neurons survive through an early "critical period" and become integrated into functional networks has been shown to depend on the richness of stimulation they receive during these formative stages. The dentate gyrus in the hippocampus - home of the adult-born neurons - receives extensive cholinergic innervation, and newly generated neurons in the adult hippocampus express substantial numbers of both major types of neuronal nicotinic acetylcholine receptors. Early studies indicated that nicotinic signaling may be important for the development of adult-born neurons: repeated exposure to nicotine impaired their long-term survival. Recent studies with mutant mice lacking either one of the two major nicotinic receptor subtypes demonstrate that receptor loss results in fewer adult-born neurons surviving the critical period and becoming integrated into neural networks. The key nicotinic receptor mediating the largest effects is one that has a high relative permeability to calcium. In view of this feature, it may not be surprising that excessive exposure to nicotine can have detrimental effects on survival and maturation of adult-born neurons in the dentate; these same receptors appear to be key. The results pose serious challenges for therapeutic strategies targeting an individual class of nicotinic receptors for global treatment in the recipient.

The Akt/GSK-3beta axis as a new signaling pathway of the histamine H(3) receptor.

Drugs targeting the histamine H(3) receptor (H(3)R) are suggested to be beneficial for the treatment of neurodegenerative diseases, such as Alzheimer's and Parkinson's disease. The H(3)R activates G(i/o)-proteins to inhibit adenylyl cyclase activity and modulates phospholipase A(2) and MAPK activity. Herein we show that, in transfected SK-N-MC cells, the H(3)R modulates the activity of the Akt/Glycogen synthase kinase 3beta (GSK-3beta) axis both in a constitutive and agonist-dependent fashion. H(3)R stimulation with the H(3)R agonist immepip induces the phosphorylation of both Ser473 and Thr308 on Akt, a serine/threonine kinase that is important for neuronal development and function. The H(3)R-mediated activation of Akt can be inhibited by the H(3)R inverse agonist thioperamide, and by Wortmannin, LY294002 and PTX, suggesting the observed Akt activation occurs via a G(i/o)-mediated activation of phosphoinositide-3-kinase. H(3)R activation also results in the phosphorylation of Ser9 on GSK-3beta, which acts downstream of Akt and has a prominent role in brain function. In addition, we show the H(3)R-mediated phosphorylation of Akt at Ser473 to occur in primary rat cortical neurons and in rat brain slices. The discovery of this signaling property of the H(3)R adds new understanding to the roles of histamine and the H(3)R in brain function and pathology.

Discovery of naturally occurring splice variants of the rat histamine H3 receptor that act as dominant-negative isoforms.

We described previously the cDNA cloning of three functional rat histamine H3 receptor (rH3R) isoforms as well as the differential brain expression patterns of their corresponding mRNAs and signaling properties of the resulting rH3A, rH3B, and rH3C receptor isoforms (Mol Pharmacol 59:1-8). In the current report, we describe the cDNA cloning, mRNA localization in the rat central nervous system, and pharmacological characterization of three additional rH3R splice variants (rH3D, rH3E, and rH3F) that differ from the previously published isoforms in that they result from an additional alternative-splicing event. These new H3R isoforms lack the seventh transmembrane (TM) helix and contain an alternative, putatively extracellular, C terminus (6TM-rH3 isoforms). After heterologous expression in COS-7 cells, radioligand binding or functional responses upon the application of various H3R ligands could not be detected for the 6TM-rH3 isoforms. In contrast to the rH3A receptor (rH3AR), detection of the rH3D isoform using hemagglutinin antibodies revealed that the rH3D isoform remains mainly intracellular. The expression of the rH3D-F splice variants, however, modulates the cell surface expression-levels and subsequent functional responses of the 7TM H3R isoforms. Coexpression of the rH3AR and the rH3D isoforms resulted in the intracellular retention of the rH3AR and reduced rH3AR functionality. Finally, we show that in rat brain, the H3R mRNA expression levels are modulated upon treatment with the convulsant pentylenetetrazole, suggesting that the rH3R isoforms described herein thus represent a novel physiological mechanism for controlling the activity of the histaminergic system.

Unilateral labyrinthectomy induced changes on GDNF receptor complex proteins in the rat medial vestibular nuclei.

In the auditory periphery, GDNF has been shown to have a trophic effect to spiral ganglion neurons, both during development and in adult animals. We have studied the effect of unilateral labyrinthectomy (UL) on protein levels and expression of GDNF multicomponent receptor complex: the ret tyrosine kinase and coreceptor GFRalpha-1 in the medial vestibular nucleus of the adult rat. GFRalpha-1 protein levels display an increasing trend in ipsilateral medial vestibular nucleus culminating at 48 h post UL. On the other hand, GFRalpha-1 mRNA expression levels in ipsi- and contralateral medial vestibular nucleus show a steadily decreasing trend that is significant at 1 week post-lesion. Protein levels for c-Ret isoforms also show an initial bilateral decreasing trend that ceases at 48 h in ipsilateral medial vestibular nucleus but persists on the contralateral side. c-Ret mRNA expression levels show a significant decrease at 4 h post UL followed by another significant decrease 1 week post UL. Our data would suggest that neurotrophins belonging to the GDNF family are involved in this model of post-lesional CNS plasticity.

Histamine-immunoreactive neurons in the mouse and rat suprachiasmatic nucleus.

Among the well-established roles of the neurotransmitter histamine (HA) is that as a regulator of the sleep-wake cycle, which early gained HA a reputation as a 'waking substance'. The tuberomammillary nucleus (TMN) of the posterior hypothalamus, which contains the sole source of neuronal HA in the brain, is reciprocally connected to the suprachiasmatic nucleus (SCN) which, in turn, is best known as the pacemaker of circadian rhythms in mammals. We report HA-immunoreactive (-ir) neurons in the mouse and rat SCN that neither display immunoreactivity (-iry) for the HA-synthesizing enzyme histidine decarboxylase (HDC) nor contain HDC mRNA. Further, HA-iry was absent in the SCN of HDC knockout mice, but present in appropriate control animals, indicating that the observed HA-iry is HDC dependent. Experiments with hypothalamic slice cultures and i.c.v. injection of HA suggest that HA in the SCN neurons originates in the TMN and is transported from the TMN along histaminergic fibres known to innervate the SCN. These results could indicate the existence of a hitherto unknown uptake mechanism for HA into neurons. Through HA uptake and, putatively, re-release of the captured HA, these neurons could participate in the HA-mediated effects on the circadian system in concert with direct histaminergic inputs from the TMN to the SCN. The innervation of the SCN by several neurotransmitter systems could provide a way for other systems to affect the HA-containing neuronal cell bodies in the SCN.

Plasticity of histamine H3 receptor expression and binding in the vestibular nuclei after labyrinthectomy in rat.

BACKGROUND: In rat, deafferentation of one labyrinth (unilateral labyrinthectomy) results in a characteristic syndrome of ocular and motor postural disorders (e.g., barrel rotation, circling behavior, and spontaneous nystagmus). Behavioral recovery (e.g., diminished symptoms), encompassing 1 week after unilateral labyrinthectomy, has been termed vestibular compensation. Evidence suggesting that the histamine H3 receptor plays a key role in vestibular compensation comes from studies indicating that betahistine, a histamine-like drug that acts as both a partial histamine H1 receptor agonist and an H3 receptor antagonist, can accelerate the process of vestibular compensation. RESULTS: Expression levels for histamine H3 receptor (total) as well as three isoforms which display variable lengths of the third intracellular loop of the receptor were analyzed using in situ hybridization on brain sections containing the rat medial vestibular nucleus after unilateral labyrinthectomy. We compared these expression levels to H3 receptor binding densities. Total H3 receptor mRNA levels (detected by oligo probe H3X) as well as mRNA levels of the three receptor isoforms studied (detected by oligo probes H3A, H3B, and H3C) showed a pattern of increase, which was bilaterally significant at 24 h post-lesion for both H3X and H3C, followed by significant bilateral decreases in medial vestibular nuclei occurring 48 h (H3X and H3B) and 1 week post-lesion (H3A, H3B, and H3C). Expression levels of H3B was an exception to the forementioned pattern with significant decreases already detected at 24 h post-lesion. Coinciding with the decreasing trends in H3 receptor mRNA levels was an observed increase in H3 receptor binding densities occurring in the ipsilateral medial vestibular nuclei 48 h post-lesion. CONCLUSION: Progressive recovery of the resting discharge of the deafferentated medial vestibular nuclei neurons results in functional restoration of the static postural and occulomotor deficits, usually occurring within a time frame of 48 hours in rats. Our data suggests that the H3 receptor may be an essential part of pre-synaptic mechanisms required for reestablishing resting activities 48 h after unilateral labyrinthectomy.

Changes in hippocampal histamine receptors across the hibernation cycle in ground squirrels.

Hibernation is a physiological state characterized by a dramatic reduction in various functions, such as body temperature, heart rate, and metabolism. The hippocampus is thought to be important for regulation of the hibernation bout because it remains electrophysiologically active throughout this extremely depressed state. The question arises as to what neuronal influences act within the hippocampus during hibernation to sustain its activity. We hypothesized that histaminergic input might be an important contributor. Brain histamine is involved in functions relevant to hibernation, such as the regulation of diurnal rhythms, body temperature, and energy metabolism. Furthermore, we have previously shown that the histaminergic system appears to be activated during the hibernating state. In this study, we used receptor binding autoradiography, in situ hybridization, and GTP-gamma-S binding autoradiography to study changes in histamine receptors across the hibernation bout. We were able to demonstrate an increase in histamine H1 and H2 receptors in the hippocampus during hibernation, whereas the mRNA expression and receptor density of the inhibitory H3 receptor decreased. Histamine H3 receptors were shown to exhibit both histamine-activated and constitutive GTP-gamma-S-binding activity in the ground squirrel hippocampus, both of which decreased during hibernation, indicating a decrease in H3 receptor G-protein activation. Taken together, our results indicate that histamine may be involved in maintaining hibernation by sustaining hippocampal activity, possibly through H1 and H2 receptor activity and decreased inhibition by H3 receptors. The involvement of brain histamine, which is generally thought of as an arousal molecule, in maintaining a depressed state of the brain suggests a more general role for the amine in controlling arousal state.

Increased brain histamine H3 receptor expression during hibernation in golden-mantled ground squirrels.

BACKGROUND: Hibernation is a state of extremely reduced physiological functions and a deep depression of CNS activity. We have previously shown that the histamine levels increase in the brain during hibernation, as does the ratio between histamine and its first metabolite, suggesting increased histamine turnover during this state. The inhibitory histamine H3 receptor has both auto- and heteroreceptor function, rendering it the most likely histamine receptor to be involved in regulating the activity of histamine as well as other neurotransmitters during hibernation. In view of accumulating evidence that there is a global depression of transcription and translation during hibernation, of all but a few proteins that are important for this physiological condition, we reasoned that an increase in histamine H3 receptor expression would clearly indicate an important hibernation-related function for the receptor. RESULTS: In this study we show, using in situ hybridization, that histamine H3 receptor mRNA increases in the cortex, caudate nucleus and putamen during hibernation, an increase that is accompanied by elevated receptor binding in the cerebral cortex, globus pallidus and substantia nigra. These results indicate that there is a hibernation-related increase in H3 receptor expression in cortical neurons and in striatopallidal and striatonigral GABAergic neurons. GTP-gamma-S binding autoradiography shows that the H3 receptors in the globus pallidus and substantia nigra can be stimulated by histamine throughout the hibernation cycle, suggesting that they are functionally active during hibernation. CONCLUSIONS: These results show that the histamine H3 receptor gene is one of the few with a transcript that increases during hibernation, indicating an important role for the receptor in regulating this state. Moreover, the receptor is functionally active in the basal ganglia, suggesting a function for it in regulating e.g. dopaminergic transmission during hibernation.

Intrahippocampal histamine delays arousal from hibernation.

Hibernation is a state of extremely reduced physiological functions and a deep depression of CNS activity, which is thought to be under hippocampal control. Our previous findings indicate increased histamine turnover during hibernation in several brain regions, including the hippocampus. In this study we showed that histamine infused into the hippocampus significantly delayed arousal from hibernation. These findings indicate that histamine may contribute to maintaining the hibernating state, suggesting a novel role for histamine in controlling arousal state.

Function of the dorsal fin in bluegill sunfish: Motor patterns during four distinct locomotor behaviors.

The median fins of fishes are key features of locomotor morphology which function as complex control surfaces during a variety of behaviors. However, very few studies have experimentally assessed median fin function, as most workers focus on axial structures. In particular, the dorsal fin of many teleost fishes possesses both spiny anterior and soft posterior portions which may function separately during locomotion. We analyzed the function of the soft region of the dorsal fin and of the dorsal inclinator (Di) muscles which are the primary muscles responsible for lateral flexion. We used electromyography to measure in vivo Di activity, as well as activity of the red myomeric muscles located at a similar longitudinal position. We quantified motor patterns during four locomotor behaviors: braking and three propulsive behaviors (steady swimming, kick and glide swimming, and C-starts). During the three propulsive swimming behaviors, the timing of Di activity was more similar to that of ipsilateral red myomeric muscle rather than to contralateral myomeric activity, whereas during braking the timing of activity of the Di muscles was similar to that of the contralateral myomeric musculature. During the three propulsive behaviors, when the Di muscles had activity, it was consistent with the function of stiffening the soft dorsal fin to oppose its tendency to bend as a result of the body being swept laterally through the water. In contrast, activity of the Di muscles during braking was consistent with the function of actively flexing the soft dorsal fin towards the side of the fish that had Di activity. Activity of the Di muscles during steady speed swimming was generally sufficient to resist lateral bending of the soft dorsal fin, whereas during high speed kick and glide swimming and C-starts, Di activity was not sufficient to resist the bending caused by resistive forces imposed by the water. Cumulative data from all four behaviors suggest that the Di muscles can be activated independently relative to the myomeric musculature rather than having a single phase relationship with the myomeric muscle common to all of the observed behaviors. © 1996 Wiley-Liss, Inc.