Self-organization of songbird neural sequences during social isolation.

Behaviors emerge via a combination of experience and innate predispositions. As the brain matures, it undergoes major changes in cellular, network, and functional properties that can be due to sensory experience as well as developmental processes. In normal birdsong learning, neural sequences emerge to control song syllables learned from a tutor. Here, we disambiguate the role of tutor experience and development in neural sequence formation by delaying exposure to a tutor. Using functional calcium imaging, we observe neural sequences in the absence of tutoring, demonstrating that tutor experience is not necessary for the formation of sequences. However, after exposure to a tutor, pre-existing sequences can become tightly associated with new song syllables. Since we delayed tutoring, only half our birds learned new syllables following tutor exposure. The birds that failed to learn were the birds in which pre-tutoring neural sequences were most 'crystallized,' that is, already tightly associated with their (untutored) song.

An optical design enabling lightweight and large field-of-view head-mounted microscopes.

Here we present a fluorescence microscope light path that enables imaging, during free behavior, of thousands of neurons in mice and hundreds of neurons in juvenile songbirds. The light path eliminates traditional illumination optics, allowing for head-mounted microscopes that have both a lower weight and a larger field of view (FOV) than previously possible. Using this light path, we designed two microscopes: one optimized for FOV (~4 mm FOV; 1.4 g), and the other optimized for weight (1.0 mm FOV; 1.0 g).

SyConn2: dense synaptic connectivity inference for volume electron microscopy.

The ability to acquire ever larger datasets of brain tissue using volume electron microscopy leads to an increasing demand for the automated extraction of connectomic information. We introduce SyConn2, an open-source connectome analysis toolkit, which works with both on-site high-performance compute environments and rentable cloud computing clusters. SyConn2 was tested on connectomic datasets with more than 10 million synapses, provides a web-based visualization interface and makes these data amenable to complex anatomical and neuronal connectivity queries.

An avian cortical circuit for chunking tutor song syllables into simple vocal-motor units.

How are brain circuits constructed to achieve complex goals? The brains of young songbirds develop motor circuits that achieve the goal of imitating a specific tutor song to which they are exposed. Here, we set out to examine how song-generating circuits may be influenced early in song learning by a cortical region (NIf) at the interface between auditory and motor systems. Single-unit recordings reveal that, during juvenile babbling, NIf neurons burst at syllable onsets, with some neurons exhibiting selectivity for particular emerging syllable types. When juvenile birds listen to their tutor, NIf neurons are also activated at tutor syllable onsets, and are often selective for particular syllable types. We examine a simple computational model in which tutor exposure imprints the correct number of syllable patterns as ensembles in an interconnected NIf network. These ensembles are then reactivated during singing to train a set of syllable sequences in the motor network.

Unsupervised discovery of temporal sequences in high-dimensional datasets, with applications to neuroscience.

Identifying low-dimensional features that describe large-scale neural recordings is a major challenge in neuroscience. Repeated temporal patterns (sequences) are thought to be a salient feature of neural dynamics, but are not succinctly captured by traditional dimensionality reduction techniques. Here, we describe a software toolbox-called seqNMF-with new methods for extracting informative, non-redundant, sequences from high-dimensional neural data, testing the significance of these extracted patterns, and assessing the prevalence of sequential structure in data. We test these methods on simulated data under multiple noise conditions, and on several real neural and behavioral datas. In hippocampal data, seqNMF identifies neural sequences that match those calculated manually by reference to behavioral events. In songbird data, seqNMF discovers neural sequences in untutored birds that lack stereotyped songs. Thus, by identifying temporal structure directly from neural data, seqNMF enables dissection of complex neural circuits without relying on temporal references from stimuli or behavioral outputs.

Computational training for the next generation of neuroscientists.

Neuroscience research has become increasingly reliant upon quantitative and computational data analysis and modeling techniques. However, the vast majority of neuroscientists are still trained within the traditional biology curriculum, in which computational and quantitative approaches beyond elementary statistics may be given little emphasis. Here we provide the results of an informal poll of computational and other neuroscientists that sought to identify critical needs, areas for improvement, and educational resources for computational neuroscience training. Motivated by this survey, we suggest steps to facilitate quantitative and computational training for future neuroscientists.

Rhythmic syllable-related activity in a songbird motor thalamic nucleus necessary for learned vocalizations.

Birdsong is a complex behavior that exhibits hierarchical organization. While the representation of singing behavior and its hierarchical organization has been studied in some detail in avian cortical premotor circuits, our understanding of the role of the thalamus in adult birdsong is incomplete. Using a combination of behavioral and electrophysiological studies, we seek to expand on earlier work showing that the thalamic nucleus Uvaeformis (Uva) is necessary for the production of stereotyped, adult song in zebra finch (Taeniopygia guttata). We confirm that complete bilateral lesions of Uva abolish singing in the 'directed' social context, but find that in the 'undirected' social context, such lesions result in highly variable vocalizations similar to early babbling song in juvenile birds. Recordings of neural activity in Uva reveal strong syllable-related modulation, maximally active prior to syllable onsets and minimally active prior to syllable offsets. Furthermore, both song and Uva activity exhibit a pronounced coherent modulation at 10Hz-a pattern observed in downstream premotor areas in adult and, even more prominently, in juvenile birds. These findings are broadly consistent with the idea that Uva is critical in the sequential activation of behavioral modules in HVC.

Rhythmic Continuous-Time Coding in the Songbird Analog of Vocal Motor Cortex.

Songbirds learn and produce complex sequences of vocal gestures. Adult birdsong requires premotor nucleus HVC, in which projection neurons (PNs) burst sparsely at stereotyped times in the song. It has been hypothesized that PN bursts, as a population, form a continuous sequence, while a different model of HVC function proposes that both HVC PN and interneuron activity is tightly organized around motor gestures. Using a large dataset of PNs and interneurons recorded in singing birds, we test several predictions of these models. We find that PN bursts in adult birds are continuously and nearly uniformly distributed throughout song. However, we also find that PN and interneuron firing rates exhibit significant 10-Hz rhythmicity locked to song syllables, peaking prior to syllable onsets and suppressed prior to offsets-a pattern that predominates PN and interneuron activity in HVC during early stages of vocal learning.

Growth and splitting of neural sequences in songbird vocal development.

Neural sequences are a fundamental feature of brain dynamics underlying diverse behaviours, but the mechanisms by which they develop during learning remain unknown. Songbirds learn vocalizations composed of syllables; in adult birds, each syllable is produced by a different sequence of action potential bursts in the premotor cortical area HVC. Here we carried out recordings of large populations of HVC neurons in singing juvenile birds throughout learning to examine the emergence of neural sequences. Early in vocal development, HVC neurons begin producing rhythmic bursts, temporally locked to a 'prototype' syllable. Different neurons are active at different latencies relative to syllable onset to form a continuous sequence. Through development, as new syllables emerge from the prototype syllable, initially highly overlapping burst sequences become increasingly distinct. We propose a mechanistic model in which multiple neural sequences can emerge from the growth and splitting of a common precursor sequence.

In vivo recording of single-unit activity during singing in zebra finches.

The zebra finch is an important model for investigating the neural mechanisms that underlie vocal production and learning. Previous anatomical and gene expression studies have identified an interconnected set of brain areas in this organism that are important for singing. To advance our understanding of how these various brain areas act together to learn and produce a highly stereotyped song, it is necessary to record the activity of individual neurons during singing. Here, we present a protocol for recording single-unit activity in freely moving zebra finches during singing using a miniature, motorized microdrive. It includes procedures for both the microdrive implant surgery and the electrophysiological recordings. There are several advantages of this technique: (1) high-impedance electrodes can be used in the microdrive to obtain well-isolated single units; (2) a motorized microdrive is used to remotely control the electrode position, allowing neurons to be isolated without handling the bird, and (3) a lateral positioner is used to move electrodes into fresh tissue before each penetration, allowing recordings from well-isolated neurons over the course of several weeks. We also describe the application of the antidromic stimulation and the spike collision test to identify neurons based on the axonal projection patterns.

A role for descending auditory cortical projections in songbird vocal learning.

Many learned motor behaviors are acquired by comparing ongoing behavior with an internal representation of correct performance, rather than using an explicit external reward. For example, juvenile songbirds learn to sing by comparing their song with the memory of a tutor song. At present, the brain regions subserving song evaluation are not known. In this study, we report several findings suggesting that song evaluation involves an avian 'cortical' area previously shown to project to the dopaminergic midbrain and other downstream targets. We find that this ventral portion of the intermediate arcopallium (AIV) receives inputs from auditory cortical areas, and that lesions of AIV result in significant deficits in vocal learning. Additionally, AIV neurons exhibit fast responses to disruptive auditory feedback presented during singing, but not during nonsinging periods. Our findings suggest that auditory cortical areas may guide learning by transmitting song evaluation signals to the dopaminergic midbrain and/or other subcortical targets.

An automated procedure for evaluating song imitation.

Songbirds have emerged as an excellent model system to understand the neural basis of vocal and motor learning. Like humans, songbirds learn to imitate the vocalizations of their parents or other conspecific "tutors." Young songbirds learn by comparing their own vocalizations to the memory of their tutor song, slowly improving until over the course of several weeks they can achieve an excellent imitation of the tutor. Because of the slow progression of vocal learning, and the large amounts of singing generated, automated algorithms for quantifying vocal imitation have become increasingly important for studying the mechanisms underlying this process. However, methodologies for quantifying song imitation are complicated by the highly variable songs of either juvenile birds or those that learn poorly because of experimental manipulations. Here we present a method for the evaluation of song imitation that incorporates two innovations: First, an automated procedure for selecting pupil song segments, and, second, a new algorithm, implemented in Matlab, for computing both song acoustic and sequence similarity. We tested our procedure using zebra finch song and determined a set of acoustic features for which the algorithm optimally differentiates between similar and non-similar songs.

The role of efference copy in striatal learning.

Reinforcement learning requires the convergence of signals representing context, action, and reward. While models of basal ganglia function have well-founded hypotheses about the neural origin of signals representing context and reward, the function and origin of signals representing action are less clear. Recent findings suggest that exploratory or variable behaviors are initiated by a wide array of 'action-generating' circuits in the midbrain, brainstem, and cortex. Thus, in order to learn, the striatum must incorporate an efference copy of action decisions made in these action-generating circuits. Here we review several recent neural models of reinforcement learning that emphasize the role of efference copy signals. Also described are ideas about how these signals might be integrated with inputs signaling context and reward.

Basal ganglia output to the thalamus: still a paradox.

The basal ganglia (BG)-recipient thalamus controls motor output but it remains unclear how its activity is regulated. Several studies report that thalamic activation occurs via disinhibition during pauses in the firing of inhibitory pallidal inputs from the BG. Other studies indicate that thalamic spiking is triggered by pallidal inputs via post-inhibitory 'rebound' calcium spikes. Finally excitatory cortical inputs can drive thalamic activity, which becomes entrained, or time-locked, to pallidal spikes. We present a unifying framework where these seemingly distinct results arise from a continuum of thalamic firing 'modes' controlled by excitatory inputs. We provide a mechanistic explanation for paradoxical pallidothalamic coactivations observed during behavior that raises new questions about what information is integrated in the thalamus to control behavior.

Natural changes in brain temperature underlie variations in song tempo during a mating behavior.

The song of a male zebra finch is a stereotyped motor sequence whose tempo varies with social context--whether or not the song is directed at a female bird--as well as with the time of day. The neural mechanisms underlying these changes in tempo are unknown. Here we show that brain temperature recorded in freely behaving male finches exhibits a global increase in response to the presentation of a female bird. This increase strongly correlates with, and largely explains, the faster tempo of songs directed at a female compared to songs produced in social isolation. Furthermore, we find that the observed diurnal variations in song tempo are also explained by natural variations in brain temperature. Our findings suggest that brain temperature is an important variable that can influence the dynamics of activity in neural circuits, as well as the temporal features of behaviors that some of these circuits generate.

Oculomotor learning revisited: a model of reinforcement learning in the basal ganglia incorporating an efference copy of motor actions.

In its simplest formulation, reinforcement learning is based on the idea that if an action taken in a particular context is followed by a favorable outcome, then, in the same context, the tendency to produce that action should be strengthened, or reinforced. While reinforcement learning forms the basis of many current theories of basal ganglia (BG) function, these models do not incorporate distinct computational roles for signals that convey context, and those that convey what action an animal takes. Recent experiments in the songbird suggest that vocal-related BG circuitry receives two functionally distinct excitatory inputs. One input is from a cortical region that carries context information about the current "time" in the motor sequence. The other is an efference copy of motor commands from a separate cortical brain region that generates vocal variability during learning. Based on these findings, I propose here a general model of vertebrate BG function that combines context information with a distinct motor efference copy signal. The signals are integrated by a learning rule in which efference copy inputs gate the potentiation of context inputs (but not efference copy inputs) onto medium spiny neurons in response to a rewarded action. The hypothesis is described in terms of a circuit that implements the learning of visually guided saccades. The model makes testable predictions about the anatomical and functional properties of hypothesized context and efference copy inputs to the striatum from both thalamic and cortical sources.

Integration of cortical and pallidal inputs in the basal ganglia-recipient thalamus of singing birds.

The basal ganglia-recipient thalamus receives inhibitory inputs from the pallidum and excitatory inputs from cortex, but it is unclear how these inputs interact during behavior. We recorded simultaneously from thalamic neurons and their putative synaptically connected pallidal inputs in singing zebra finches. We find, first, that each pallidal spike produces an extremely brief (∼5 ms) pulse of inhibition that completely suppresses thalamic spiking. As a result, thalamic spikes are entrained to pallidal spikes with submillisecond precision. Second, we find that the number of thalamic spikes that discharge within a single pallidal interspike interval (ISI) depends linearly on the duration of that interval but does not depend on pallidal activity prior to the interval. In a detailed biophysical model, our results were not easily explained by the postinhibitory "rebound" mechanism previously observed in anesthetized birds and in brain slices, nor could most of our data be characterized as "gating" of excitatory transmission by inhibitory pallidal input. Instead, we propose a novel "entrainment" mechanism of pallidothalamic transmission that highlights the importance of an excitatory conductance that drives spiking, interacting with brief pulses of pallidal inhibition. Building on our recent finding that cortical inputs can drive syllable-locked rate modulations in thalamic neurons during singing, we report here that excitatory inputs affect thalamic spiking in two ways: by shortening the latency of a thalamic spike after a pallidal spike and by increasing thalamic firing rates within individual pallidal ISIs. We present a unifying biophysical model that can reproduce all known modes of pallidothalamic transmission--rebound, gating, and entrainment--depending on the amount of excitation the thalamic neuron receives.

A cortical motor nucleus drives the basal ganglia-recipient thalamus in singing birds.

The pallido-recipient thalamus transmits information from the basal ganglia to the cortex and is critical for motor initiation and learning. Thalamic activity is strongly inhibited by pallidal inputs from the basal ganglia, but the role of nonpallidal inputs, such as excitatory inputs from cortex, remains unclear. We simultaneously recorded from presynaptic pallidal axon terminals and postsynaptic thalamocortical neurons in a basal ganglia-recipient thalamic nucleus that is necessary for vocal variability and learning in zebra finches. We found that song-locked rate modulations in the thalamus could not be explained by pallidal inputs alone and persisted following pallidal lesion. Instead, thalamic activity was likely driven by inputs from a motor cortical nucleus that is also necessary for singing. These findings suggest a role for cortical inputs to the pallido-recipient thalamus in driving premotor signals that are important for exploratory behavior and learning.

Wandering neuronal migration in the postnatal vertebrate forebrain.

Most non-mammalian vertebrate species add new neurons to existing brain circuits throughout life, a process thought to be essential for tissue maintenance, repair, and learning. How these new neurons migrate through the mature brain and which cues trigger their integration within a functioning circuit is not known. To address these questions, we used two-photon microscopy to image the addition of genetically labeled newly generated neurons into the brain of juvenile zebra finches. Time-lapse in vivo imaging revealed that the majority of migratory new neurons exhibited a multipolar morphology and moved in a nonlinear manner for hundreds of micrometers. Young neurons did not use radial glia or blood vessels as a migratory scaffold; instead, cells extended several motile processes in different directions and moved by somal translocation along an existing process. Neurons were observed migrating for ∼2 weeks after labeling injection. New neurons were observed to integrate in close proximity to the soma of mature neurons, a behavior that may explain the emergence of clusters of neuronal cell bodies in the adult songbird brain. These results provide direct, in vivo evidence for a wandering form of neuronal migration involved in the addition of new neurons in the postnatal brain.

Two distinct modes of forebrain circuit dynamics underlie temporal patterning in the vocalizations of young songbirds.

Accurate timing is a critical aspect of motor control, yet the temporal structure of many mature behaviors emerges during learning from highly variable exploratory actions. How does a developing brain acquire the precise control of timing in behavioral sequences? To investigate the development of timing, we analyzed the songs of young juvenile zebra finches. These highly variable vocalizations, akin to human babbling, gradually develop into temporally stereotyped adult songs. We find that the durations of syllables and silences in juvenile singing are formed by a mixture of two distinct modes of timing: a random mode producing broadly distributed durations early in development, and a stereotyped mode underlying the gradual emergence of stereotyped durations. Using lesions, inactivations, and localized brain cooling, we investigated the roles of neural dynamics within two premotor cortical areas in the production of these temporal modes. We find that LMAN (lateral magnocellular nucleus of the nidopallium) is required specifically for the generation of the random mode of timing and that mild cooling of LMAN causes an increase in the durations produced by this mode. On the contrary, HVC (used as a proper name) is required specifically for producing the stereotyped mode of timing, and its cooling causes a slowing of all stereotyped components. These results show that two neural pathways contribute to the timing of juvenile songs and suggest an interesting organization in the forebrain, whereby different brain areas are specialized for the production of distinct forms of neural dynamics.