RoboEM: automated 3D flight tracing for synaptic-resolution connectomics.

Mapping neuronal networks from three-dimensional electron microscopy (3D-EM) data still poses substantial reconstruction challenges, in particular for thin axons. Currently available automated image segmentation methods require manual proofreading for many types of connectomic analysis. Here we introduce RoboEM, an artificial intelligence-based self-steering 3D 'flight' system trained to navigate along neurites using only 3D-EM data as input. Applied to 3D-EM data from mouse and human cortex, RoboEM substantially improves automated state-of-the-art segmentations and can replace manual proofreading for more complex connectomic analysis problems, yielding computational annotation cost for cortical connectomes about 400-fold lower than the cost of manual error correction.

High-contrast en bloc staining of mouse whole-brain and human brain samples for EM-based connectomics.

Connectomes of human cortical gray matter require high-contrast homogeneously stained samples sized at least 2 mm on a side, and a mouse whole-brain connectome requires samples sized at least 5-10 mm on a side. Here we report en bloc staining and embedding protocols for these and other applications, removing a key obstacle for connectomic analyses at the mammalian whole-brain level.

Connectomic analysis of thalamus-driven disinhibition in cortical layer 4.

Sensory signals are transmitted via the thalamus primarily to layer 4 (L4) of the primary sensory cortices. While information about average neuronal connectivity in L4 is available, its detailed higher-order circuit structure is not known. Here, we used three-dimensional electron microscopy for a connectomic analysis of the thalamus-driven inhibitory network in L4. We find that thalamic input drives a subset of interneurons with high specificity, which in turn target excitatory neurons with subtype specificity. These interneurons create a directed disinhibitory network directly driven by the thalamic input. Neuronal activity recordings show that strong synchronous sensory activation yields about 1.5-fold stronger activation of star pyramidal cells than spiny stellates, in line with differential windows of opportunity for activation of excitatory neurons in the thalamus-driven disinhibitory circuit model. With this, we have identified a high degree of specialization of the microcircuitry in L4 of the primary sensory cortex.

Connectomic comparison of mouse and human cortex.

The human cerebral cortex houses 1000 times more neurons than that of the cerebral cortex of a mouse, but the possible differences in synaptic circuits between these species are still poorly understood. We used three-dimensional electron microscopy of mouse, macaque, and human cortical samples to study their cell type composition and synaptic circuit architecture. The 2.5-fold increase in interneurons in humans compared with mice was compensated by a change in axonal connection probabilities and therefore did not yield a commensurate increase in inhibitory-versus-excitatory synaptic input balance on human pyramidal cells. Rather, increased inhibition created an expanded interneuron-to-interneuron network, driven by an expansion of interneuron-targeting interneuron types and an increase in their synaptic selectivity for interneuron innervation. These constitute key neuronal network alterations in the human cortex.

Neuropathic pain caused by miswiring and abnormal end organ targeting.

Nerve injury leads to chronic pain and exaggerated sensitivity to gentle touch (allodynia) as well as a loss of sensation in the areas in which injured and non-injured nerves come together1-3. The mechanisms that disambiguate these mixed and paradoxical symptoms are unknown. Here we longitudinally and non-invasively imaged genetically labelled populations of fibres that sense noxious stimuli (nociceptors) and gentle touch (low-threshold afferents) peripherally in the skin for longer than 10 months after nerve injury, while simultaneously tracking pain-related behaviour in the same mice. Fully denervated areas of skin initially lost sensation, gradually recovered normal sensitivity and developed marked allodynia and aversion to gentle touch several months after injury. This reinnervation-induced neuropathic pain involved nociceptors that sprouted into denervated territories precisely reproducing the initial pattern of innervation, were guided by blood vessels and showed irregular terminal connectivity in the skin and lowered activation thresholds mimicking low-threshold afferents. By contrast, low-threshold afferents-which normally mediate touch sensation as well as allodynia in intact nerve territories after injury4-7-did not reinnervate, leading to an aberrant innervation of tactile end organs such as Meissner corpuscles with nociceptors alone. Genetic ablation of nociceptors fully abrogated reinnervation allodynia. Our results thus reveal the emergence of a form of chronic neuropathic pain that is driven by structural plasticity, abnormal terminal connectivity and malfunction of nociceptors during reinnervation, and provide a mechanistic framework for the paradoxical sensory manifestations that are observed clinically and can impose a heavy burden on patients.

Cellular connectomes as arbiters of local circuit models in the cerebral cortex.

With the availability of cellular-resolution connectivity maps, connectomes, from the mammalian nervous system, it is in question how informative such massive connectomic data can be for the distinction of local circuit models in the mammalian cerebral cortex. Here, we investigated whether cellular-resolution connectomic data can in principle allow model discrimination for local circuit modules in layer 4 of mouse primary somatosensory cortex. We used approximate Bayesian model selection based on a set of simple connectome statistics to compute the posterior probability over proposed models given a to-be-measured connectome. We find that the distinction of the investigated local cortical models is faithfully possible based on purely structural connectomic data with an accuracy of more than 90%, and that such distinction is stable against substantial errors in the connectome measurement. Furthermore, mapping a fraction of only 10% of the local connectome is sufficient for connectome-based model distinction under realistic experimental constraints. Together, these results show for a concrete local circuit example that connectomic data allows model selection in the cerebral cortex and define the experimental strategy for obtaining such connectomic data.

Postnatal connectomic development of inhibition in mouse barrel cortex.

Brain circuits in the neocortex develop from diverse types of neurons that migrate and form synapses. Here we quantify the circuit patterns of synaptogenesis for inhibitory interneurons in the developing mouse somatosensory cortex. We studied synaptic innervation of cell bodies, apical dendrites, and axon initial segments using three-dimensional electron microscopy focusing on the first 4 weeks postnatally (postnatal days P5 to P28). We found that innervation of apical dendrites occurs early and specifically: Target preference is already almost at adult levels at P5. Axons innervating cell bodies, on the other hand, gradually acquire specificity from P5 to P9, likely via synaptic overabundance followed by antispecific synapse removal. Chandelier axons show first target preference by P14 but develop full target specificity almost completely by P28, which is consistent with a combination of axon outgrowth and off-target synapse removal. This connectomic developmental profile reveals how inhibitory axons in the mouse cortex establish brain circuitry during development.

The Mind of a Mouse.

Large scientific projects in genomics and astronomy are influential not because they answer any single question but because they enable investigation of continuously arising new questions from the same data-rich sources. Advances in automated mapping of the brain's synaptic connections (connectomics) suggest that the complicated circuits underlying brain function are ripe for analysis. We discuss benefits of mapping a mouse brain at the level of synapses.

A community-based transcriptomics classification and nomenclature of neocortical cell types.

To understand the function of cortical circuits, it is necessary to catalog their cellular diversity. Past attempts to do so using anatomical, physiological or molecular features of cortical cells have not resulted in a unified taxonomy of neuronal or glial cell types, partly due to limited data. Single-cell transcriptomics is enabling, for the first time, systematic high-throughput measurements of cortical cells and generation of datasets that hold the promise of being complete, accurate and permanent. Statistical analyses of these data reveal clusters that often correspond to cell types previously defined by morphological or physiological criteria and that appear conserved across cortical areas and species. To capitalize on these new methods, we propose the adoption of a transcriptome-based taxonomy of cell types for mammalian neocortex. This classification should be hierarchical and use a standardized nomenclature. It should be based on a probabilistic definition of a cell type and incorporate data from different approaches, developmental stages and species. A community-based classification and data aggregation model, such as a knowledge graph, could provide a common foundation for the study of cortical circuits. This community-based classification, nomenclature and data aggregation could serve as an example for cell type atlases in other parts of the body.

Cell-type specific innervation of cortical pyramidal cells at their apical dendrites.

We investigated the synaptic innervation of apical dendrites of cortical pyramidal cells in a region between layers (L) 1 and 2 using 3-D electron microscopy applied to four cortical regions in mouse. We found the relative inhibitory input at the apical dendrite's main bifurcation to be more than 2-fold larger for L2 than L3 and L5 thick-tufted pyramidal cells. Towards the distal tuft dendrites in upper L1, the relative inhibitory input was at least about 2-fold larger for L5 pyramidal cells than for all others. Only L3 pyramidal cells showed homogeneous inhibitory input fraction. The inhibitory-to-excitatory synaptic ratio is thus specific for the types of pyramidal cells. Inhibitory axons preferentially innervated either L2 or L3/5 apical dendrites, but not both. These findings describe connectomic principles for the control of pyramidal cells at their apical dendrites and support differential computational properties of L2, L3 and subtypes of L5 pyramidal cells in cortex.

Dense connectomic reconstruction in layer 4 of the somatosensory cortex.

The dense circuit structure of mammalian cerebral cortex is still unknown. With developments in three-dimensional electron microscopy, the imaging of sizable volumes of neuropil has become possible, but dense reconstruction of connectomes is the limiting step. We reconstructed a volume of ~500,000 cubic micrometers from layer 4 of mouse barrel cortex, ~300 times larger than previous dense reconstructions from the mammalian cerebral cortex. The connectomic data allowed the extraction of inhibitory and excitatory neuron subtypes that were not predictable from geometric information. We quantified connectomic imprints consistent with Hebbian synaptic weight adaptation, which yielded upper bounds for the fraction of the circuit consistent with saturated long-term potentiation. These data establish an approach for the locally dense connectomic phenotyping of neuronal circuitry in the mammalian cortex.

Big data in nanoscale connectomics, and the greed for training labels.

The neurosciences have developed methods that outpace most other biomedical fields in terms of acquired bytes. We review how the information content and analysis challenge of such data indicates that electron microscopy (EM)-based connectomics is an especially hard problem. Here, as in many other current machine learning applications, the need for excessive amounts of labelled data while utilizing only a small fraction of available raw image data for algorithm training illustrates the still fundamental gap between artificial and biological intelligence. Substantial improvements of label and energy efficiency in machine learning may be required to address the formidable challenge of acquiring the nanoscale connectome of a human brain.

Full reconstruction of large lobula plate tangential cells in Drosophila from a 3D EM dataset.

With the advent of neurogenetic methods, the neural basis of behavior is presently being analyzed in more and more detail. This is particularly true for visually driven behavior of Drosophila melanogaster where cell-specific driver lines exist that, depending on the combination with appropriate effector genes, allow for targeted recording, silencing and optogenetic stimulation of individual cell-types. Together with detailed connectomic data of large parts of the fly optic lobe, this has recently led to much progress in our understanding of the neural circuits underlying local motion detection. However, how such local information is combined by optic flow sensitive large-field neurons is still incompletely understood. Here, we aim to fill this gap by a dense reconstruction of lobula plate tangential cells of the fly lobula plate. These neurons collect input from many hundreds of local motion-sensing T4/T5 neurons and connect them to descending neurons or central brain areas. We confirm all basic features of HS and VS cells as published previously from light microscopy. In addition, we identified the dorsal and the ventral centrifugal horizontal, dCH and vCH cell, as well as three VSlike cells, including their distinct dendritic and axonal projection area.

FluoEM, virtual labeling of axons in three-dimensional electron microscopy data for long-range connectomics.

The labeling and identification of long-range axonal inputs from multiple sources within densely reconstructed electron microscopy (EM) datasets from mammalian brains has been notoriously difficult because of the limited color label space of EM. Here, we report FluoEM for the identification of multi-color fluorescently labeled axons in dense EM data without the need for artificial fiducial marks or chemical label conversion. The approach is based on correlated tissue imaging and computational matching of neurite reconstructions, amounting to a virtual color labeling of axons in dense EM circuit data. We show that the identification of fluorescent light- microscopically (LM) imaged axons in 3D EM data from mouse cortex is faithfully possible as soon as the EM dataset is about 40-50 µm in extent, relying on the unique trajectories of axons in dense mammalian neuropil. The method is exemplified for the identification of long-distance axonal input into layer 1 of the mouse cerebral cortex.

Axonal synapse sorting in medial entorhinal cortex.

Research on neuronal connectivity in the cerebral cortex has focused on the existence and strength of synapses between neurons, and their location on the cell bodies and dendrites of postsynaptic neurons. The synaptic architecture of individual presynaptic axonal trees, however, remains largely unknown. Here we used dense reconstructions from three-dimensional electron microscopy in rats to study the synaptic organization of local presynaptic axons in layer 2 of the medial entorhinal cortex, the site of grid-like spatial representations. We observe path-length-dependent axonal synapse sorting, such that axons of excitatory neurons sequentially target inhibitory neurons followed by excitatory neurons. Connectivity analysis revealed a cellular feedforward inhibition circuit involving wide, myelinated inhibitory axons and dendritic synapse clustering. Simulations show that this high-precision circuit can control the propagation of synchronized activity in the medial entorhinal cortex, which is known for temporally precise discharges.

SynEM, automated synapse detection for connectomics.

Nerve tissue contains a high density of chemical synapses, about 1 per µm3 in the mammalian cerebral cortex. Thus, even for small blocks of nerve tissue, dense connectomic mapping requires the identification of millions to billions of synapses. While the focus of connectomic data analysis has been on neurite reconstruction, synapse detection becomes limiting when datasets grow in size and dense mapping is required. Here, we report SynEM, a method for automated detection of synapses from conventionally en-bloc stained 3D electron microscopy image stacks. The approach is based on a segmentation of the image data and focuses on classifying borders between neuronal processes as synaptic or non-synaptic. SynEM yields 97% precision and recall in binary cortical connectomes with no user interaction. It scales to large volumes of cortical neuropil, plausibly even whole-brain datasets. SynEM removes the burden of manual synapse annotation for large densely mapped connectomes.

webKnossos: efficient online 3D data annotation for connectomics.

We report webKnossos, an in-browser annotation tool for 3D electron microscopic data. webKnossos provides flight mode, a single-view egocentric reconstruction method enabling trained annotator crowds to reconstruct at a speed of 1.5 ± 0.6 mm/h for axons and 2.1 ± 0.9 mm/h for dendrites in 3D electron microscopic data from mammalian cortex. webKnossos accelerates neurite reconstruction for connectomics by 4- to 13-fold compared with current state-of-the-art tools, thus extending the range of connectomes that can realistically be mapped in the future.