Rapid emergence of latent knowledge in the sensory cortex drives learning.

Rapid learning confers significant advantages to animals in ecological environments. Despite the need for speed, animals appear to only slowly learn to associate rewarded actions with predictive cues1-4. This slow learning is thought to be supported by a gradual expansion of predictive cue representation in the sensory cortex2,5. However, evidence is growing that animals learn more rapidly than classical performance measures suggest6-8, challenging the prevailing model of sensory cortical plasticity. Here, we investigated the relationship between learning and sensory cortical representations. We trained mice on an auditory go/no-go task that dissociated the rapid acquisition of task contingencies (learning) from its slower expression (performance)7. Optogenetic silencing demonstrated that the auditory cortex (AC) drives both rapid learning and slower performance gains but becomes dispensable at expert. Rather than enhancement or expansion of cue representations9, two-photon calcium imaging of AC excitatory neurons throughout learning revealed two higher-order signals that were causal to learning and performance. First, a reward prediction (RP) signal emerged rapidly within tens of trials, was present after action-related errors only early in training, and faded at expert levels. Strikingly, silencing at the time of the RP signal impaired rapid learning, suggesting it serves an associative and teaching role. Second, a distinct cell ensemble encoded and controlled licking suppression that drove the slower performance improvements. These two ensembles were spatially clustered but uncoupled from underlying sensory representations, indicating a higher-order functional segregation within AC. Our results reveal that the sensory cortex manifests higher-order computations that separably drive rapid learning and slower performance improvements, reshaping our understanding of the fundamental role of the sensory cortex.

Performance errors during rodent learning reflect a dynamic choice strategy.

Humans, even as infants, use cognitive strategies, such as exploration and hypothesis testing, to learn about causal interactions in the environment. In animal learning studies, however, it is challenging to disentangle higher-order behavioral strategies from errors arising from imperfect task knowledge or inherent biases. Here, we trained head-fixed mice on a wheel-based auditory two-choice task and exploited the intra- and inter-animal variability to understand the drivers of errors during learning. During learning, performance errors are dominated by a choice bias, which, despite appearing maladaptive, reflects a dynamic strategy. Early in learning, mice develop an internal model of the task contingencies such that violating their expectation of reward on correct trials (by using short blocks of non-rewarded "probe" trials) leads to an abrupt shift in strategy. During the probe block, mice behave more accurately with less bias, thereby using their learned stimulus-action knowledge to test whether the outcome contingencies have changed. Despite having this knowledge, mice continued to exhibit a strong choice bias during reinforced trials. This choice bias operates on a timescale of tens to hundreds of trials with a dynamic structure, shifting between left, right, and unbiased epochs. Biased epochs also coincided with faster motor kinematics. Although bias decreased across learning, expert mice continued to exhibit short bouts of biased choices interspersed with longer bouts of unbiased choices and higher performance. These findings collectively suggest that during learning, rodents actively probe their environment in a structured manner to refine their decision-making and maintain long-term flexibility.

Spatially clustered neurons encode vocalization categories in the bat midbrain.

Rapid categorization of vocalizations enables adaptive behavior across species. While categorical perception is thought to arise in the neocortex, humans and other animals could benefit from functional organization of ethologically-relevant sounds at earlier stages in the auditory hierarchy. Here, we developed two-photon calcium imaging in the awake echolocating bat (Eptesicus fuscus) to study encoding of sound meaning in the Inferior Colliculus, which is as few as two synapses from the inner ear. Echolocating bats produce and interpret frequency sweep-based vocalizations for social communication and navigation. Auditory playback experiments demonstrated that individual neurons responded selectively to social or navigation calls, enabling robust population-level decoding across categories. Strikingly, category-selective neurons formed spatial clusters, independent of tonotopy within the IC. These findings support a revised view of categorical processing in which specified channels for ethologically-relevant sounds are spatially segregated early in the auditory hierarchy, enabling rapid subcortical organization of call meaning.

Revealing abrupt transitions from goal-directed to habitual behavior.

A fundamental tenet of animal behavior is that decision-making involves multiple 'controllers.' Initially, behavior is goal-directed, driven by desired outcomes, shifting later to habitual control, where cues trigger actions independent of motivational state. Clark Hull's question from 1943 still resonates today: "Is this transition abrupt, or is it gradual and progressive?"1 Despite a century-long belief in gradual transitions, this question remains unanswered2,3 as current methods cannot disambiguate goal-directed versus habitual control in real-time. Here, we introduce a novel 'volitional engagement' approach, motivating animals by palatability rather than biological need. Offering less palatable water in the home cage4,5 reduced motivation to 'work' for plain water in an auditory discrimination task when compared to water-restricted animals. Using quantitative behavior and computational modeling6, we found that palatability-driven animals learned to discriminate as quickly as water-restricted animals but exhibited state-like fluctuations when responding to the reward-predicting cue-reflecting goal-directed behavior. These fluctuations spontaneously and abruptly ceased after thousands of trials, with animals now always responding to the reward-predicting cue. In line with habitual control, post-transition behavior displayed motor automaticity, decreased error sensitivity (assessed via pupillary responses), and insensitivity to outcome devaluation. Bilateral lesions of the habit-related dorsolateral striatum7 blocked transitions to habitual behavior. Thus, 'volitional engagement' reveals spontaneous and abrupt transitions from goal-directed to habitual behavior, suggesting the involvement of a higher-level process that arbitrates between the two.

The cholinergic basal forebrain provides a parallel channel for state-dependent sensory signaling to auditory cortex.

Cholinergic basal forebrain (CBF) signaling exhibits multiple timescales of activity with classic slow signals related to brain and behavioral states and fast, phasic signals reflecting behavioral events, including movement, reinforcement and sensory-evoked responses. However, it remains unknown whether sensory cholinergic signals target the sensory cortex and how they relate to local functional topography. Here we used simultaneous two-channel, two-photon imaging of CBF axons and auditory cortical neurons to reveal that CBF axons send a robust, nonhabituating and stimulus-specific sensory signal to the auditory cortex. Individual axon segments exhibited heterogeneous but stable tuning to auditory stimuli allowing stimulus identity to be decoded from population activity. However, CBF axons displayed no tonotopy and their frequency tuning was uncoupled from that of nearby cortical neurons. Chemogenetic suppression revealed the auditory thalamus as a major source of auditory information to the CBF. Finally, slow fluctuations in cholinergic activity modulated the fast, sensory-evoked signals in the same axons, suggesting that a multiplexed combination of fast and slow signals is projected from the CBF to the auditory cortex. Taken together, our work demonstrates a noncanonical function of the CBF as a parallel channel for state-dependent sensory signaling to the sensory cortex that provides repeated representations of a broad range of sound stimuli at all points on the tonotopic map.

Slow or sudden: Re-interpreting the learning curve for modern systems neuroscience.

Learning is fundamental to animal survival. Animals must learn to link sensory cues in the environment to actions that lead to reward or avoid punishment. Rapid learning can then be highly adaptive and the difference between life or death. To explore the neural dynamics and circuits that underlie learning, however, has typically required the use of laboratory paradigms with tight control of stimuli, action sets, and outcomes. Learning curves in such reward-based tasks are reported as slow and gradual, with animals often taking hundreds to thousands of trials to reach expert performance. The slow, highly variable, and incremental learning curve remains the largely unchallenged belief in modern systems neuroscience. Here, we provide historical and contemporary evidence that instrumental forms of reward-learning can be dissociated into two parallel processes: knowledge acquisition which is rapid with step-like improvements, and behavioral expression which is slower and more variable. We further propose that this conceptual distinction may allow us to isolate the associative (knowledge-related) and non-associative (performance-related) components that influence learning. We then discuss the implications that this revised understanding of the learning curve has for systems neuroscience.

Author Correction: Dissociating task acquisition from expression during learning reveals latent knowledge.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Dissociating task acquisition from expression during learning reveals latent knowledge.

Performance on cognitive tasks during learning is used to measure knowledge, yet it remains controversial since such testing is susceptible to contextual factors. To what extent does performance during learning depend on the testing context, rather than underlying knowledge? We trained mice, rats and ferrets on a range of tasks to examine how testing context impacts the acquisition of knowledge versus its expression. We interleaved reinforced trials with probe trials in which we omitted reinforcement. Across tasks, each animal species performed remarkably better in probe trials during learning and inter-animal variability was strikingly reduced. Reinforcement feedback is thus critical for learning-related behavioral improvements but, paradoxically masks the expression of underlying knowledge. We capture these results with a network model in which learning occurs during reinforced trials while context modulates only the read-out parameters. Probing learning by omitting reinforcement thus uncovers latent knowledge and identifies context- not "smartness"- as the major source of individual variability.

Opposing Roles of apolipoprotein E in aging and neurodegeneration.

Apolipoprotein E (APOE) effects on brain function remain controversial. Removal of APOE not only impairs cognitive functions but also reduces neuritic amyloid plaques in mouse models of Alzheimer's disease (AD). Can APOE simultaneously protect and impair neural circuits? Here, we dissociated the role of APOE in AD versus aging to determine its effects on neuronal function and synaptic integrity. Using two-photon calcium imaging in awake mice to record visually evoked responses, we found that genetic removal of APOE improved neuronal responses in adult APP/PSEN1 mice (8-10 mo). These animals also exhibited fewer neuritic plaques with less surrounding synapse loss, fewer neuritic dystrophies, and reactive glia. Surprisingly, the lack of APOE in aged mice (18-20 mo), even in the absence of amyloid, disrupted visually evoked responses. These results suggest a dissociation in APOE's role in AD versus aging: APOE may be neurotoxic during early stages of amyloid deposition, although being neuroprotective in latter stages of aging.

Neural encoding of sensory and behavioral complexity in the auditory cortex.

Converging evidence now supports the idea that auditory cortex is an important step for the emergence of auditory percepts. Recent studies have extended the list of complex, nonlinear sound features coded by cortical neurons. Moreover, we are beginning to uncover general properties of cortical representations, such as invariance and discreteness, which reflect the structure of auditory perception. Complexity, however, emerges not only through nonlinear shaping of auditory information into perceptual bricks. Behavioral context and task-related information strongly influence cortical encoding of sounds via ascending neuromodulation and descending top-down frontal control. These effects appear to be mediated through local inhibitory networks. Thus, auditory cortex can be seen as a hub linking structured sensory representations with behavioral variables.

Functions and dysfunctions of neocortical inhibitory neuron subtypes.

Neocortical inhibitory neurons exhibit remarkably diverse morphology, physiological properties and connectivity. Genetic access to molecularly defined subtypes of inhibitory neurons has aided their functional characterization in recent years. These studies have established that, instead of simply balancing excitatory neuron activity, inhibitory neurons actively shape excitatory circuits in a subtype-specific manner. We review the emerging view that inhibitory neuron subtypes perform context-dependent modulation of excitatory activity, as well as regulate experience-dependent plasticity of excitatory circuits. We then review the roles of neuromodulators in regulating the subtype-specific functions of inhibitory neurons. Finally, we discuss the idea that dysfunctions of inhibitory neuron subtypes may be responsible for various aspects of neurological disorders.

Soluble oligomeric amyloid-ß induces calcium dyshomeostasis that precedes synapse loss in the living mouse brain.

BACKGROUND: Amyloid-ß oligomers (oAß) are thought to mediate neurotoxicity in Alzheimer's disease (AD), and previous studies in AD transgenic mice suggest that calcium dysregulation may contribute to these pathological effects. Even though AD mouse models remain a valuable resource to investigate amyloid neurotoxicity, the concomitant presence of soluble Aß species, fibrillar Aß, and fragments of amyloid precursor protein (APP) complicate the interpretation of the phenotypes. METHOD: To explore the specific contribution of soluble oligomeric Aß (oAß) to calcium dyshomeostasis and synaptic morphological changes, we acutely exposed the healthy mouse brain, at 3 to 6 months of age, to naturally occurring soluble oligomers and investigated their effect on calcium levels using in vivo multiphoton imaging. RESULTS: We observed a dramatic increase in the levels of neuronal resting calcium, which was dependent upon extracellular calcium influx and activation of NMDA receptors. Ryanodine receptors, previously implicated in AD models, did not appear to be primarily involved using this experimental setting. We used the high resolution cortical volumes acquired in-vivo to measure the effect on synaptic densities and observed that, while spine density remained stable within the first hour of oAß exposure, a significant decrease in the number of dendritic spines was observed 24 h post treatment, despite restoration of intraneuronal calcium levels at this time point. CONCLUSIONS: These observations demonstrate a specific effect of oAß on NMDA-mediated calcium influx, which triggers synaptic collapse in vivo. Moreover, this work leverages a method to quantitatively measure calcium concentration at the level of neuronal processes, cell bodies and single synaptic elements repeatedly and thus can be applicable to testing putative drugs and/or other intervention methodologies.

Parallel processing by cortical inhibition enables context-dependent behavior.

Physical features of sensory stimuli are fixed, but sensory perception is context dependent. The precise mechanisms that govern contextual modulation remain unknown. Here, we trained mice to switch between two contexts: passively listening to pure tones and performing a recognition task for the same stimuli. Two-photon imaging showed that many excitatory neurons in auditory cortex were suppressed during behavior, while some cells became more active. Whole-cell recordings showed that excitatory inputs were affected only modestly by context, but inhibition was more sensitive, with PV+, SOM+, and VIP+ interneurons balancing inhibition and disinhibition within the network. Cholinergic modulation was involved in context switching, with cholinergic axons increasing activity during behavior and directly depolarizing inhibitory cells. Network modeling captured these findings, but only when modulation coincidently drove all three interneuron subtypes, ruling out either inhibition or disinhibition alone as sole mechanism for active engagement. Parallel processing of cholinergic modulation by cortical interneurons therefore enables context-dependent behavior.

Excitation-Transcription Coupling in Parvalbumin-Positive Interneurons Employs a Novel CaM Kinase-Dependent Pathway Distinct from Excitatory Neurons.

Properly functional CNS circuits depend on inhibitory interneurons that in turn rely upon activity-dependent gene expression for morphological development, connectivity, and excitatory-inhibitory coordination. Despite its importance, excitation-transcription coupling in inhibitory interneurons is poorly understood. We report that PV+ interneurons employ a novel CaMK-dependent pathway to trigger CREB phosphorylation and gene expression. As in excitatory neurons, voltage-gated Ca(2+) influx through CaV1 channels triggers CaM nuclear translocation via local Ca(2+) signaling. However, PV+ interneurons are distinct in that nuclear signaling is mediated by γCaMKI, not γCaMKII. CREB phosphorylation also proceeds with slow, sigmoid kinetics, rate-limited by paucity of CaMKIV, protecting against saturation of phospho-CREB in the face of higher firing rates and bigger Ca(2+) transients. Our findings support the generality of CaM shuttling to drive nuclear CaMK activity, and they are relevant to disease pathophysiology, insofar as dysfunction of PV+ interneurons and molecules underpinning their excitation-transcription coupling both relate to neuropsychiatric disease.

Abnormal synaptic Ca(2+) homeostasis and morphology in cortical neurons of familial hemiplegic migraine type 1 mutant mice.

OBJECTIVE: Migraine is among the most common and debilitating neurological conditions. Familial hemiplegic migraine type 1 (FHM1), a monogenic migraine subtype, is caused by gain-of-function of voltage-gated CaV 2.1 calcium channels. FHM1 mice carry human pathogenic mutations in the α1A subunit of CaV 2.1 channels and are highly susceptible to cortical spreading depression (CSD), the electrophysiologic event underlying migraine aura. To date, however, the mechanism underlying increased CSD/migraine susceptibility remains unclear. METHODS: We employed in vivo multiphoton microscopy of the genetically encoded Ca(2+)-indicator yellow cameleon to investigate synaptic morphology and [Ca(2+)]i in FHM1 mice. To study CSD-induced cerebral oligemia, we used in vivo laser speckle flowmetry and multimodal imaging. With electrophysiologic recordings, we investigated the effect of the CaV 2.1 gating modifier tert-butyl dihydroquinone on CSD in vivo. RESULTS: FHM1 mutations elevate neuronal [Ca(2+)]i and alter synaptic morphology as a mechanism for enhanced CSD susceptibility that we were able to normalize with a CaV 2.1 gating modifier in hyperexcitable FHM1 mice. At the synaptic level, axonal boutons were larger, and dendritic spines were predominantly of the mushroom type, which both provide a structural correlate for enhanced neuronal excitability. Resting neuronal [Ca(2+)]i was elevated in FHM1, with loss of compartmentalization between synapses and neuronal shafts. The percentage of calcium-overloaded neurons was increased. Neuronal [Ca(2+)]i surge during CSD was faster and larger, and post-CSD oligemia and hemoglobin desaturation were more severe in FHM1 brains. INTERPRETATION: Our findings provide a mechanism for enhanced CSD susceptibility in hemiplegic migraine. Abnormal synaptic Ca(2+) homeostasis and morphology may contribute to chronic neurodegenerative changes as well as enhanced vulnerability to ischemia in migraineurs.

Tau pathology does not affect experience-driven single-neuron and network-wide Arc/Arg3.1 responses.

Intraneuronal neurofibrillary tangles (NFTs) - a characteristic pathological feature of Alzheimer's and several other neurodegenerative diseases - are considered a major target for drug development. Tangle load correlates well with the severity of cognitive symptoms and mouse models of tauopathy are behaviorally impaired. However, there is little evidence that NFTs directly impact physiological properties of host neurons. Here we used a transgenic mouse model of tauopathy to study how advanced tau pathology in different brain regions affects activity-driven expression of immediate-early gene Arc required for experience-dependent consolidation of long-term memories. We demonstrate in vivo that visual cortex neurons with tangles are as likely to express comparable amounts of Arc in response to structured visual stimulation as their neighbors without tangles. Probability of experience-dependent Arc response was not affected by tau tangles in both visual cortex and hippocampal pyramidal neurons as determined postmortem. Moreover, whole brain analysis showed that network-wide activity-driven Arc expression was not affected by tau pathology in any of the brain regions, including brain areas with the highest tangle load. Our findings suggest that intraneuronal NFTs do not affect signaling cascades leading to experience-dependent gene expression required for long-term synaptic plasticity.

Neurofibrillary tangle-bearing neurons are functionally integrated in cortical circuits in vivo.

Alzheimer's disease (AD) is pathologically characterized by the deposition of extracellular amyloid-ß plaques and intracellular aggregation of tau protein in neurofibrillary tangles (NFTs) (1, 2). Progression of NFT pathology is closely correlated with both increased neurodegeneration and cognitive decline in AD (3) and other tauopathies, such as frontotemporal dementia (4, 5). The assumption that mislocalization of tau into the somatodendritic compartment (6) and accumulation of fibrillar aggregates in NFTs mediates neurodegeneration underlies most current therapeutic strategies aimed at preventing NFT formation or disrupting existing NFTs (7, 8). Although several disease-associated mutations cause both aggregation of tau and neurodegeneration, whether NFTs per se contribute to neuronal and network dysfunction in vivo is unknown (9). Here we used awake in vivo two-photon calcium imaging to monitor neuronal function in adult rTg4510 mice that overexpress a human mutant form of tau (P301L) and develop cortical NFTs by the age of 7-8 mo (10). Unexpectedly, NFT-bearing neurons in the visual cortex appeared to be completely functionally intact, to be capable of integrating dendritic inputs and effectively encoding orientation and direction selectivity, and to have a stable baseline resting calcium level. These results suggest a reevaluation of the common assumption that insoluble tau aggregates are sufficient to disrupt neuronal function.

Cerebrovascular lesions induce transient ß-amyloid deposition.

Previous clinical studies have documented a close relationship between cerebrovascular disease and risk of Alzheimer's disease. We examined possible mechanistic interactions through use of experimental stroke models in a transgenic mouse model of ß-amyloid deposition (APPswe/PS1dE9). Following middle cerebral artery occlusion, we observed a rapid increase in amyloid plaque burden in the region surrounding the infarction. In human tissue samples, however, we were unable to detect a localized increase in amyloid burden adjacent to cerebral infarcts. To resolve this discrepancy, we generated cerebral microstrokes in amyloid precursor protein mouse models with the photosensitive dye Rose bengal, and monitored plaque formation in real time using multiphoton microscopy. We observed a striking increase in the number of new plaques and amyloid angiopathy in the area immediately surrounding the infarcted area; however, the effect was transient, potentially resolving the discord between mouse and human tissue. We did not detect changes in candidate proteins related to ß-amyloid generation or degradation such as ß-amyloid-converting enzyme, amyloid precursor protein, presenilin 1, neprylisin or insulin-degrading enzyme. Together, these results demonstrate that strokes can trigger accelerated amyloid deposition, most likely through interference with amyloid clearance pathways. Additionally, this study indicates that focal ischaemia provides an experimental paradigm in which to study the mechanisms of plaque seeding and growth.

Progressive NKCC1-dependent neuronal chloride accumulation during neonatal seizures.

Seizures induce excitatory shifts in the reversal potential for GABA(A)-receptor-mediated responses, which may contribute to the intractability of electro-encephalographic seizures and preclude the efficacy of widely used GABAergic anticonvulsants such as phenobarbital. We now report that, in intact hippocampi prepared from neonatal rats and transgenic mice expressing Clomeleon, recurrent seizures progressively increase the intracellular chloride concentration ([Cl(-)](i)) assayed by Clomeleon imaging and invert the net effect of GABA(A) receptor activation from inhibition to excitation assayed by the frequency of action potentials and intracellular Ca(2+) transients. These changes correlate with increasing frequency of seizure-like events and reduction in phenobarbital efficacy. The Na(+)-K(+)-2Cl(-) (NKCC1) cotransporter blocker bumetanide inhibited seizure-induced neuronal Cl(-) accumulation and the consequent facilitation of recurrent seizures. Our results demonstrate a novel mechanism by which seizure activity leads to [Cl(-)](i) accumulation, thereby increasing the probability of subsequent seizures. This provides a potential mechanism for the early crescendo phase of neonatal seizures.

Amyloid beta induces the morphological neurodegenerative triad of spine loss, dendritic simplification, and neuritic dystrophies through calcineurin activation.

Amyloid beta (Abeta)-containing plaques are surrounded by dystrophic neurites in the Alzheimer's disease (AD) brain, but whether and how plaques induce these neuritic abnormalities remain unknown. We tested the hypothesis that soluble oligomeric assemblies of Abeta, which surround plaques, induce calcium-mediated secondary cascades that lead to dystrophic changes in local neurites. We show that soluble Abeta oligomers lead to activation of the calcium-dependent phosphatase calcineurin (CaN) (PP2B), which in turn activates the transcriptional factor nuclear factor of activated T cells (NFAT). Activation of these signaling pathways, even in the absence of Abeta, is sufficient to produce a virtual phenocopy of Abeta-induced dystrophic neurites, dendritic simplification, and dendritic spine loss in both neurons in culture and in the adult mouse brain. Importantly, the morphological deficits in the vicinity of Abeta deposits in a mouse model of AD are ameliorated by CaN inhibition, supporting the hypothesis that CaN-NFAT are aberrantly activated by Abeta and that CaN-NFAT activation is responsible for disruption of neuronal structure near plaques. In accord with this, we also detect increased levels of an active form of CaN and NFATc4 in the nuclear fraction from the cortex of patients with AD. Thus, Abeta appears to mediate the neurodegeneration of AD, at least in part, by activation of CaN and subsequent NFAT-mediated downstream cascades.