Agency rescues competition for credit assignment among predictive cues from adverse learning conditions.

A fundamental assumption of learning theories is that the credit assigned to predictive cues is not simply determined by their probability of reinforcement, but by their ability to compete with other cues present during learning. This assumption has guided behavioral and neural science research for decades, and tremendous empirical and theoretical advances have been made identifying the mechanisms of cue competition. However, when learning conditions are not optimal (e.g., when training is massed), cue competition is attenuated. This failure of the learning system exposes the individual's vulnerability to form spurious associations in the real world. Here, we uncover that cue competition in rats can be rescued when conditions are suboptimal provided that the individual has agency over the learning experience. Our findings reveal a new effect of agency over learning on credit assignment among predictive cues, and open new avenues of investigation into the underlying mechanisms.

A self-initiated cue-reward learning procedure for neural recording in rodents.

BACKGROUND: Single-unit recording in Pavlovian conditioning tasks requires the use of within-subject designs as well as sampling a considerable number of trials per trial type and session, which increases the total trial count. Pavlovian conditioning, on the other hand, requires a long average intertrial interval (ITI) relative to cue duration for cue-specific learning to occur. These requirements combined can make the session duration unfeasibly long. NEW METHOD: To circumvent this issue, we developed a self-initiated variant of the Pavlovian magazine-approach procedure in rodents. Unlike the standard procedure, where the animals passively receive the trials, the self-initiated procedure grants animals agency to self-administer and self-pace trials from a predetermined, pseudorandomized list. Critically, whereas in the standard procedure the typical ITI is in the order of minutes, our procedure uses a much shorter ITI (10 s). RESULTS: Despite such a short ITI, discrimination learning in the self-initiated procedure is comparable to that observed in the standard procedure with a typical ITI, and superior to that observed in the standard procedure with an equally short ITI. COMPARISON WITH EXISTING METHOD(S): The self-initiated procedure permits delivering 100 trials in a ∼1-h session, almost doubling the number of trials safely attainable over that period with the standard procedure. CONCLUSIONS: The self-initiated procedure enhances the collection of neural correlates of cue-reward learning while producing good discrimination performance. Other advantages for neural recording studies include ensuring that at the start of each trial the animal is engaged, attentive and in the same location within the conditioning chamber.

Interactions between sleep disruption, motor learning, and p70 S6 kinase 1 signaling.

Offline gains in motor performance after initial motor learning likely depend on sleep, but the molecular mechanisms by which this occurs are understudied. Regulation of mRNA translation via p70 S6 kinase 1 (S6K1) signaling represents one potential mechanism, as protein synthesis is thought to be increased during sleep compared to wake and is necessary for several forms of long-term memory. Using phosphorylation of ribosomal protein S6 (RpS6) as a readout of S6K1 activity, we demonstrate that a period of 10 h of acute sleep disruption impairs both S6K1 signaling and offline gains in motor performance on the rotarod in adult wild type C57/Bl6 mice. Rotarod motor learning results in increased abundance of RpS6 in the striatum, and inhibition of S6K1 either indirectly with rapamycin or directly with PF-4708671 diminished the offline improvement in motor performance without affecting the initial acquisition of rotarod motor learning when sleep is normal. In sum, S6K1 activity is required for sleep-dependent offline gains in motor performance and is inhibited following acute sleep disruption, while motor learning increases the abundance of striatal RpS6. Thus, S6K1 signaling represents a plausible mechanism mediating the beneficial effects of sleep on motor performance.

Semaphorin 4D promotes inhibitory synapse formation and suppresses seizures in vivo.

OBJECTIVE: We previously discovered a role for the extracellular domain of the transmembrane protein semaphorin 4D (Sema4D) as a fast-acting, selective, and positive regulator of functional γ-aminobutyric acid (GABA)ergic synapse formation in hippocampal neuronal culture. We also demonstrated that Sema4D treatment increases inhibitory tone and suppresses hyperexcitability in an organotypic hippocampal slice culture model of epilepsy. Here, we investigate the ability of Sema4D to promote GABAergic synapse formation and suppress seizure activity in vivo in adult mice. METHODS: We performed a 3-hour, intrahippocampal infusion of Sema4D or control protein into the CA1 region of adult mice. To quantify GABAergic presynaptic bouton density, we performed immunohistochemistry on hippocampal tissue sections isolated from these animals using an antibody that specifically recognizes the glutamic acid decarboxylase isoform 65 protein (GAD65), which is localized to presynaptic GABAergic boutons. To assess seizure activity, we employed 2 in vivo mouse models of epilepsy, intravenous (iv) pentylenetetrazol (PTZ) and hippocampal electrical kindling, in the presence or absence of Sema4D treatment. We monitored seizure activity by behavioral observation or electroencephalography (EEG). To assay the persistence of the Sema4D effect, we monitored seizure activity and measured the density of GAD65-positive presynaptic boutons 3 or 48 hours after Sema4D infusion. RESULTS: Sema4D-treated mice displayed an elevated density of GABAergic presynaptic boutons juxtaposed to hippocampal pyramidal neuron cell bodies, consistent with the hypothesis that Sema4D promotes the formation of new inhibitory synapses in vivo. In addition, Sema4D acutely suppressed seizures in both the PTZ and electrical kindling models. When we introduced a 48-hour gap between Sema4D treatment and the seizure stimulus, seizure activity was indistinguishable from controls. Moreover, immunohistochemistry on brain sections or hippocampal slices isolated 3 hours, but not 48 hours, after Sema4D treatment displayed an increase in GABAergic bouton density, demonstrating temporal correlation between the effects of Sema4D on seizures and GABAergic synaptic components. SIGNIFICANCE: Our findings suggest a novel approach to treating acute seizures: harnessing synaptogenic molecules to enhance connectivity in the inhibitory network.

Development of Cross-Orientation Suppression and Size Tuning and the Role of Experience.

Many sensory neural circuits exhibit response normalization, which occurs when the response of a neuron to a combination of multiple stimuli is less than the sum of the responses to the individual stimuli presented alone. In the visual cortex, normalization takes the forms of cross-orientation suppression and surround suppression. At the onset of visual experience, visual circuits are partially developed and exhibit some mature features such as orientation selectivity, but it is unknown whether cross-orientation suppression is present at the onset of visual experience or requires visual experience for its emergence. We characterized the development of normalization and its dependence on visual experience in female ferrets. Visual experience was varied across the following three conditions: typical rearing, dark rearing, and dark rearing with daily exposure to simple sinusoidal gratings (14-16 h total). Cross-orientation suppression and surround suppression were noted in the earliest observations, and did not vary considerably with experience. We also observed evidence of continued maturation of receptive field properties in the second month of visual experience: substantial length summation was observed only in the oldest animals (postnatal day 90); evoked firing rates were greatly increased in older animals; and direction selectivity required experience, but declined slightly in older animals. These results constrain the space of possible circuit implementations of these features.SIGNIFICANCE STATEMENT The development of the brain depends on both nature-factors that are independent of the experience of an individual animal-and nurture-factors that depend on experience. While orientation selectivity, one of the major response properties of neurons in visual cortex, is already present at the onset of visual experience, it is unknown whether response properties that depend on interactions among multiple stimuli develop without experience. We find that the properties of cross-orientation suppression and surround suppression are present at eye opening, and do not depend on visual experience. Our results are consistent with the idea that a majority of the basic properties of sensory neurons in primary visual cortex are derived independent of the experience of an individual animal.

Effects of acute sleep deprivation on motor and reversal learning in mice.

Sleep supports the formation of a variety of declarative and non-declarative memories, and sleep deprivation often impairs these types of memories. In human subjects, natural sleep either during a nap or overnight leads to long-lasting improvements in visuomotor and fine motor tasks, but rodent models recapitulating these findings have been scarce. Here we present evidence that 5h of acute sleep deprivation impairs mouse skilled reach learning compared to a matched period of ad libitum sleep. In sleeping mice, the duration of total sleep time during the 5h of sleep opportunity or during the first bout of sleep did not correlate with ultimate gain in motor performance. In addition, we observed that reversal learning during the skilled reaching task was also affected by sleep deprivation. Consistent with this observation, 5h of sleep deprivation also impaired reversal learning in the water-based Y-maze. In conclusion, acute sleep deprivation negatively impacts subsequent motor and reversal learning and memory.