Norepinephrine potentiates and serotonin depresses visual cortical responses by transforming eligibility traces.

Reinforcement allows organisms to learn which stimuli predict subsequent biological relevance. Hebbian mechanisms of synaptic plasticity are insufficient to account for reinforced learning because neuromodulators signaling biological relevance are delayed with respect to the neural activity associated with the stimulus. A theoretical solution is the concept of eligibility traces (eTraces), silent synaptic processes elicited by activity which upon arrival of a neuromodulator are converted into a lasting change in synaptic strength. Previously we demonstrated in visual cortical slices the Hebbian induction of eTraces and their conversion into LTP and LTD by the retroactive action of norepinephrine and serotonin Here we show in vivo in mouse V1 that the induction of eTraces and their conversion to LTP/D by norepinephrine and serotonin respectively potentiates and depresses visual responses. We also show that the integrity of this process is crucial for ocular dominance plasticity, a canonical model of experience-dependent plasticity.

All-or-none disconnection of pyramidal inputs onto parvalbumin-positive interneurons gates ocular dominance plasticity.

Disinhibition is an obligatory initial step in the remodeling of cortical circuits by sensory experience. Our investigation on disinhibitory mechanisms in the classical model of ocular dominance plasticity uncovered an unexpected form of experience-dependent circuit plasticity. In the layer 2/3 of mouse visual cortex, monocular deprivation triggers a complete, "all-or-none," elimination of connections from pyramidal cells onto nearby parvalbumin-positive interneurons (Pyr→PV). This binary form of circuit plasticity is unique, as it is transient, local, and discrete. It lasts only 1 d, and it does not manifest as widespread changes in synaptic strength; rather, only about half of local connections are lost, and the remaining ones are not affected in strength. Mechanistically, the deprivation-induced loss of Pyr→PV is contingent on a reduction of the protein neuropentraxin2. Functionally, the loss of Pyr→PV is absolutely necessary for ocular dominance plasticity, a canonical model of deprivation-induced model of cortical remodeling. We surmise, therefore, that this all-or-none loss of local Pyr→PV circuitry gates experience-dependent cortical plasticity.

Pull-push neuromodulation of cortical plasticity enables rapid bi-directional shifts in ocular dominance.

Neuromodulatory systems are essential for remodeling glutamatergic connectivity during experience-dependent cortical plasticity. This permissive/enabling function of neuromodulators has been associated with their capacity to facilitate the induction of Hebbian forms of long-term potentiation (LTP) and depression (LTD) by affecting cellular and network excitability. In vitro studies indicate that neuromodulators also affect the expression of Hebbian plasticity in a pull-push manner: receptors coupled to the G-protein Gs promote the expression of LTP at the expense of LTD, and Gq-coupled receptors promote LTD at the expense of LTP. Here we show that pull-push mechanisms can be recruited in vivo by pairing brief monocular stimulation with pharmacological or chemogenetical activation of Gs- or Gq-coupled receptors to respectively enhance or reduce neuronal responses in primary visual cortex. These changes were stable, inducible in adults after the termination of the critical period for ocular dominance plasticity, and can rescue deficits induced by prolonged monocular deprivation.

Two distinct mechanisms for experience-dependent homeostasis.

Models of firing rate homeostasis such as synaptic scaling and the sliding synaptic plasticity modification threshold predict that decreasing neuronal activity (for example, by sensory deprivation) will enhance synaptic function. Manipulations of cortical activity during two forms of visual deprivation, dark exposure (DE) and binocular lid suture, revealed that, contrary to expectations, spontaneous firing in conjunction with loss of visual input is necessary to lower the threshold for Hebbian plasticity and increase miniature excitatory postsynaptic current (mEPSC) amplitude. Blocking activation of GluN2B receptors, which are upregulated by DE, also prevented the increase in mEPSC amplitude, suggesting that DE potentiates mEPSCs primarily through a Hebbian mechanism, not through synaptic scaling. Nevertheless, NMDA-receptor-independent changes in mEPSC amplitude consistent with synaptic scaling could be induced by extreme reductions of activity. Therefore, two distinct mechanisms operate within different ranges of neuronal activity to homeostatically regulate synaptic strength.

Distinct Eligibility Traces for LTP and LTD in Cortical Synapses.

In reward-based learning, synaptic modifications depend on a brief stimulus and a temporally delayed reward, which poses the question of how synaptic activity patterns associate with a delayed reward. A theoretical solution to this so-called distal reward problem has been the notion of activity-generated "synaptic eligibility traces," silent and transient synaptic tags that can be converted into long-term changes in synaptic strength by reward-linked neuromodulators. Here we report the first experimental demonstration of eligibility traces in cortical synapses. We demonstrate the Hebbian induction of distinct traces for LTP and LTD and their subsequent timing-dependent transformation into lasting changes by specific monoaminergic receptors anchored to postsynaptic proteins. Notably, the temporal properties of these transient traces allow stable learning in a recurrent neural network that accurately predicts the timing of the reward, further validating the induction and transformation of eligibility traces for LTP and LTD as a plausible synaptic substrate for reward-based learning.

T-type calcium channels cause bursts of spikes in motor but not sensory thalamic neurons during mimicry of natural patterns of synaptic input.

Although neurons within intact nervous systems can be classified as 'sensory' or 'motor,' it is not known whether there is any general distinction between sensory and motor neurons at the cellular or molecular levels. Here, we extend and test a theory according to which activation of certain subtypes of voltage-gated ion channel (VGC) generate patterns of spikes in neurons of motor systems, whereas VGC are proposed to counteract patterns in sensory neurons. We previously reported experimental evidence for the theory from visual thalamus, where we found that T-type calcium channels (TtCCs) did not cause bursts of spikes but instead served the function of 'predictive homeostasis' to maximize the causal and informational link between retinogeniculate excitation and spike output. Here, we have recorded neurons in brain slices from eight sensory and motor regions of rat thalamus while mimicking key features of natural excitatory and inhibitory post-synaptic potentials. As predicted by theory, TtCC did cause bursts of spikes in motor thalamus. TtCC-mediated responses in motor thalamus were activated at more hyperpolarized potentials and caused larger depolarizations with more spikes than in visual and auditory thalamus. Somatosensory thalamus is known to be more closely connected to motor regions relative to auditory and visual thalamus, and likewise the strength of its TtCC responses was intermediate between these regions and motor thalamus. We also observed lower input resistance, as well as limited evidence of stronger hyperpolarization-induced ('H-type') depolarization, in nuclei closer to motor output. These findings support our theory of a specific difference between sensory and motor neurons at the cellular level.

T-type calcium channels promote predictive homeostasis of input-output relations in thalamocortical neurons of lateral geniculate nucleus.

A general theory views the function of all neurons as prediction, and one component of this theory is that of "predictive homeostasis" or "prediction error." It is well established that sensory systems adapt so that neuronal output maintains sensitivity to sensory input, in accord with information theory. Predictive homeostasis applies the same principle at the cellular level, where the challenge is to maintain membrane excitability at the optimal homeostatic level so that spike generation is maximally sensitive to small gradations in synaptic drive. Negative feedback is a hallmark of homeostatic mechanisms, as exemplified by depolarization-activated potassium channels. In contrast, T-type calcium channels exhibit positive feedback that appears at odds with the theory. In thalamocortical neurons of lateral geniculate nucleus (LGN), T-type channels are capable of causing bursts of spikes with an all-or-none character in response to excitation from a hyperpolarized potential. This "burst mode" would partially uncouple visual input from spike output and reduce the information spikes convey about gradations in visual input. However, past observations of T-type-driven bursts may have resulted from unnaturally high membrane excitability. Here we have mimicked within rat brain slices the patterns of synaptic conductance that occur naturally during vision. In support of the theory of predictive homeostasis, we found that T-type channels restored excitability toward its homeostatic level during periods of hyperpolarization. Thus, activation of T-type channels allowed two retinal input spikes to cause one output spike on average, and we observed almost no instances in which output count exceeded input count (a "burst"). T-type calcium channels therefore help to maintain a single optimal mode of transmission rather than creating a second mode. More fundamentally our results support the general theory, which seeks to predict the properties of a neuron's ion channels and synapses given knowledge of natural patterns of synaptic input.

The meaning of spikes from the neuron's point of view: predictive homeostasis generates the appearance of randomness.

The conventional interpretation of spikes is from the perspective of an external observer with knowledge of a neuron's inputs and outputs who is ignorant of the contents of the "black box" that is the neuron. Here we consider a neuron to be an observer and we interpret spikes from the neuron's perspective. We propose both a descriptive hypothesis based on physics and logic, and a prescriptive hypothesis based on biological optimality. Our descriptive hypothesis is that a neuron's membrane excitability is "known" and the amplitude of a future excitatory postsynaptic conductance (EPSG) is "unknown". Therefore excitability is an expectation of EPSG amplitude and a spike is generated only when EPSG amplitude exceeds its expectation ("prediction error"). Our prescriptive hypothesis is that a diversity of synaptic inputs and voltage-regulated ion channels implement "predictive homeostasis", working to insure that the expectation is accurate. The homeostatic ideal and optimal expectation would be achieved when an EPSP reaches precisely to spike threshold, so that spike output is exquisitely sensitive to small variations in EPSG input. To an external observer who knows neither EPSG amplitude nor membrane excitability, spikes would appear random if the neuron is making accurate predictions. We review experimental evidence that spike probabilities are indeed maintained near an average of 0.5 under natural conditions, and we suggest that the same principles may also explain why synaptic vesicle release appears to be "stochastic". Whereas the present hypothesis accords with principles of efficient coding dating back to Barlow (1961), it contradicts decades of assertions that neural activity is substantially "random" or "noisy". The apparent randomness is by design, and like many other examples of apparent randomness, it corresponds to the ignorance of external macroscopic observers about the detailed inner workings of a microscopic system.