Automated segmentation and recognition of C. elegans whole-body cells.

MOTIVATION: Accurate segmentation and recognition of C.elegans cells are critical for various biological studies, including gene expression, cell lineages, and cell fates analysis at single-cell level. However, the highly dense distribution, similar shapes, and inhomogeneous intensity profiles of whole-body cells in 3D fluorescence microscopy images make automatic cell segmentation and recognition a challenging task. Existing methods either rely on additional fiducial markers or only handle a subset of cells. Given the difficulty or expense associated with generating fiducial features in many experimental settings, a marker-free approach capable of reliably segmenting and recognizing C.elegans whole-body cells is highly desirable. RESULTS: We report a new pipeline, called automated segmentation and recognition (ASR) of cells, and applied it to 3D fluorescent microscopy images of L1-stage C.elegans with 558 whole-body cells. A novel displacement vector field based deep learning model is proposed to address the problem of reliable segmentation of highly crowded cells with blurred boundary. We then realize the cell recognition by encoding and exploiting statistical priors on cell positions and structural similarities of neighboring cells. To the best of our knowledge, this is the first method successfully applied to the segmentation and recognition of C.elegans whole-body cells. The ASR-segmentation module achieves an F1-score of 0.8956 on a dataset of 116 C.elegans image stacks with 64 728 cells (accuracy 0.9880, AJI 0.7813). Based on the segmentation results, the ASR recognition module achieved an average accuracy of 0.8879. We also show ASR's applicability to other cell types, e.g. platynereis and rat kidney cells. AVAILABILITY AND IMPLEMENTATION: The code is available at https://github.com/reaneyli/ASR.

Non-homogenous axonal bouton distribution in whole-brain single-cell neuronal networks.

We examined the distribution of pre-synaptic contacts in axons of mouse neurons and constructed whole-brain single-cell neuronal networks using an extensive dataset of 1,891 fully reconstructed neurons. We found that bouton locations were not homogeneous throughout the axon and among brain regions. As our algorithm was able to generate whole-brain single-cell connectivity matrices from full morphology reconstruction datasets, we further found that non-homogeneous bouton locations have a significant impact on network wiring, including degree distribution, triad census, and community structure. By perturbing neuronal morphology, we further explored the link between anatomical details and network topology. In our in silico exploration, we found that dendritic and axonal tree span would have the greatest impact on network wiring, followed by synaptic contact deletion. Our results suggest that neuroanatomical details must be carefully addressed in studies of whole-brain networks at the single-cell level.

Mapping of individual sensory nerve axons from digits to spinal cord with the transparent embedding solvent system.

Achieving uniform optical resolution for a large tissue sample is a major challenge for deep imaging. For conventional tissue clearing methods, loss of resolution and quality in deep regions is inevitable due to limited transparency. Here we describe the Transparent Embedding Solvent System (TESOS) method, which combines tissue clearing, transparent embedding, sectioning and block-face imaging. We used TESOS to acquire volumetric images of uniform resolution for an adult mouse whole-body sample. The TESOS method is highly versatile and can be combined with different microscopy systems to achieve uniformly high resolution. With a light sheet microscope, we imaged the whole body of an adult mouse, including skin, at a uniform 0.8 × 0.8 × 3.5 µm3 voxel resolution within 120 h. With a confocal microscope and a 40×/1.3 numerical aperture objective, we achieved a uniform sub-micron resolution in the whole sample to reveal a complete projection of individual nerve axons within the central or peripheral nervous system. Furthermore, TESOS allowed the first mesoscale connectome mapping of individual sensory neuron axons spanning 5 cm from adult mouse digits to the spinal cord at a uniform sub-micron resolution.

DSM: Deep sequential model for complete neuronal morphology representation and feature extraction.

The full morphology of single neurons is indispensable for understanding cell types, the basic building blocks in brains. Projecting trajectories are critical to extracting biologically relevant information from neuron morphologies, as they provide valuable information for both connectivity and cell identity. We developed an artificial intelligence method, deep sequential model (DSM), to extract concise, cell-type-defining features from projections across brain regions. DSM achieves more than 90% accuracy in classifying 12 major neuron projection types without compromising performance when spatial noise is present. Such remarkable robustness enabled us to efficiently manage and analyze several major full-morphology data sources, showcasing how characteristic long projections can define cell identities. We also succeeded in applying our model to both discovering previously unknown neuron subtypes and analyzing exceptional co-expressed genes involved in neuron projection circuits.

Meet the authors: Hanchuan Peng, Peng Xie, and Feng Xiong.

In a recent paper at Patterns, Hanchuan Peng, Peng Xie, and Feng Xiong from Southeast University describe a deep learning method to characterize complete single-neuron morphologies, which can discover neuron projection patterns of diverse cells and learn neuronal morphology representation. In this interview, the authors shared the story behind the paper and their research experience. This interview is a companion to these authors' recent paper, "DSM: Deep sequential model for complete neuronal morphology representation and feature extraction."1.

The promise of digital healthcare technologies.

Digital health technologies have been in use for many years in a wide spectrum of healthcare scenarios. This narrative review outlines the current use and the future strategies and significance of digital health technologies in modern healthcare applications. It covers the current state of the scientific field (delineating major strengths, limitations, and applications) and envisions the future impact of relevant emerging key technologies. Furthermore, we attempt to provide recommendations for innovative approaches that would accelerate and benefit the research, translation and utilization of digital health technologies.

Whole human-brain mapping of single cortical neurons for profiling morphological diversity and stereotypy.

Quantifying neuron morphology and distribution at the whole-brain scale is essential to understand the structure and diversity of cell types. It is exceedingly challenging to reuse recent technologies of single-cell labeling and whole-brain imaging to study human brains. We propose adaptive cell tomography (ACTomography), a low-cost, high-throughput, and high-efficacy tomography approach, based on adaptive targeting of individual cells. We established a platform to inject dyes into cortical neurons in surgical tissues of 18 patients with brain tumors or other conditions and one donated fresh postmortem brain. We collected three-dimensional images of 1746 cortical neurons, of which 852 neurons were reconstructed to quantify local dendritic morphology, and mapped to standard atlases. In our data, human neurons are more diverse across brain regions than by subject age or gender. The strong stereotypy within cohorts of brain regions allows generating a statistical tensor field of neuron morphology to characterize anatomical modularity of a human brain.

Full-Spectrum Neuronal Diversity and Stereotypy through Whole Brain Morphometry.

We conducted a large-scale study of whole-brain morphometry, analyzing 3.7 peta-voxels of mouse brain images at the single-cell resolution, producing one of the largest multi-morphometry databases of mammalian brains to date. We spatially registered 205 mouse brains and associated data from six Brain Initiative Cell Census Network (BICCN) data sources covering three major imaging modalities from five collaborative projects to the Allen Common Coordinate Framework (CCF) atlas, annotated 3D locations of cell bodies of 227,581 neurons, modeled 15,441 dendritic microenvironments, characterized the full morphology of 1,891 neurons along with their axonal motifs, and detected 2.58 million putative synaptic boutons. Our analysis covers six levels of information related to neuronal populations, dendritic microenvironments, single-cell full morphology, sub-neuronal dendritic and axonal arborization, axonal boutons, and structural motifs, along with a quantitative characterization of the diversity and stereotypy of patterns at each level. We identified 16 modules consisting of highly intercorrelated brain regions in 13 functional brain areas corresponding to 314 anatomical regions in CCF. Our analysis revealed the dendritic microenvironment as a powerful method for delineating brain regions of cell types and potential subtypes. We also found that full neuronal morphologies can be categorized into four distinct classes based on spatially tuned morphological features, with substantial cross-areal diversity in apical dendrites, basal dendrites, and axonal arbors, along with quantified stereotypy within cortical, thalamic and striatal regions. The lamination of somas was found to be more effective in differentiating neuron arbors within the cortex. Further analysis of diverging and converging projections of individual neurons in 25 regions throughout the brain reveals branching preferences in the brain-wide and local distributions of axonal boutons. Overall, our study provides a comprehensive description of key anatomical structures of neurons and their types, covering a wide range of scales and features, and contributes to our understanding of neuronal diversity and its function in the mammalian brain.

Neuronal Connectivity as a Determinant of Cell Types and Subtypes.

Classifications of single neurons at brain-wide scale is a powerful way to characterize the structural and functional organization of a brain. We acquired and standardized a large morphology database of 20,158 mouse neurons, and generated a whole-brain scale potential connectivity map of single neurons based on their dendritic and axonal arbors. With such an anatomy-morphology-connectivity mapping, we defined neuron connectivity types and subtypes (both called "c-types" for simplicity) for neurons in 31 brain regions. We found that neuronal subtypes defined by connectivity in the same regions may share statistically higher correlation in their dendritic and axonal features than neurons having contrary connectivity patterns. Subtypes defined by connectivity show distinct separation with each other, which cannot be recapitulated by morphology features, population projections, transcriptomic, and electrophysiological data produced to date. Within this paradigm, we were able to characterize the diversity in secondary motor cortical neurons, and subtype connectivity patterns in thalamocortical pathways. Our finding underscores the importance of connectivity in characterizing the modularity of brain anatomy, as well as the cell types and their subtypes. These results highlight that c-types supplement conventionally recognized transcriptional cell types (t-types), electrophysiological cell types (e-types), and morphological cell types (m-types) as an important determinant of cell classes and their identities.

SNAP: a structure-based neuron morphology reconstruction automatic pruning pipeline.

Background: Neuron morphology analysis is an essential component of neuron cell-type definition. Morphology reconstruction represents a bottleneck in high-throughput morphology analysis workflow, and erroneous extra reconstruction owing to noise and entanglements in dense neuron regions restricts the usability of automated reconstruction results. We propose SNAP, a structure-based neuron morphology reconstruction pruning pipeline, to improve the usability of results by reducing erroneous extra reconstruction and splitting entangled neurons. Methods: For the four different types of erroneous extra segments in reconstruction (caused by noise in the background, entanglement with dendrites of close-by neurons, entanglement with axons of other neurons, and entanglement within the same neuron), SNAP incorporates specific statistical structure information into rules for erroneous extra segment detection and achieves pruning and multiple dendrite splitting. Results: Experimental results show that this pipeline accomplishes pruning with satisfactory precision and recall. It also demonstrates good multiple neuron-splitting performance. As an effective tool for post-processing reconstruction, SNAP can facilitate neuron morphology analysis.

A guide to the BRAIN Initiative Cell Census Network data ecosystem.

Characterizing cellular diversity at different levels of biological organization and across data modalities is a prerequisite to understanding the function of cell types in the brain. Classification of neurons is also essential to manipulate cell types in controlled ways and to understand their variation and vulnerability in brain disorders. The BRAIN Initiative Cell Census Network (BICCN) is an integrated network of data-generating centers, data archives, and data standards developers, with the goal of systematic multimodal brain cell type profiling and characterization. Emphasis of the BICCN is on the whole mouse brain with demonstration of prototype feasibility for human and nonhuman primate (NHP) brains. Here, we provide a guide to the cellular and spatial approaches employed by the BICCN, and to accessing and using these data and extensive resources, including the BRAIN Cell Data Center (BCDC), which serves to manage and integrate data across the ecosystem. We illustrate the power of the BICCN data ecosystem through vignettes highlighting several BICCN analysis and visualization tools. Finally, we present emerging standards that have been developed or adopted toward Findable, Accessible, Interoperable, and Reusable (FAIR) neuroscience. The combined BICCN ecosystem provides a comprehensive resource for the exploration and analysis of cell types in the brain.

High-throughput confocal airy beam oblique light-sheet tomography of brain-wide imaging at single-cell resolution.

Brain research is an area of research characterized by its cutting-edge nature, with brain mapping constituting a crucial aspect of this field. As sequencing tools have played a crucial role in gene sequencing, brain mapping largely depends on automated, high-throughput and high-resolution imaging techniques. Over the years, the demand for high-throughput imaging has scaled exponentially with the rapid development of microscopic brain mapping. In this paper, we introduce the novel concept of confocal Airy beam into oblique light-sheet tomography named CAB-OLST. We demonstrate that this technique enables the high throughput of brain-wide imaging of long-distance axon projection for the entire mouse brain at a resolution of 0.26 µm × 0.26 µm × 1.06 µm in 58 hours. This technique represents an innovative contribution to the field of brain research by setting a new standard for high-throughput imaging techniques.

Tracing weak neuron fibers.

MOTIVATION: Precise reconstruction of neuronal arbors is important for circuitry mapping. Many auto-tracing algorithms have been developed toward full reconstruction. However, it is still challenging to trace the weak signals of neurite fibers that often correspond to axons. RESULTS: We proposed a method, named the NeuMiner, for tracing weak fibers by combining two strategies: an online sample mining strategy and a modified gamma transformation. NeuMiner improved the recall of weak signals (voxel values <20) by a large margin, from 5.1 to 27.8%. This is prominent for axons, which increased by 6.4 times, compared to 2.0 times for dendrites. Both strategies were shown to be beneficial for weak fiber recognition, and they reduced the average axonal spatial distances to gold standards by 46 and 13%, respectively. The improvement was observed on two prevalent automatic tracing algorithms and can be applied to any other tracers and image types. AVAILABILITY AND IMPLEMENTATION: Source codes of NeuMiner are freely available on GitHub (https://github.com/crazylyf/neuronet/tree/semantic_fnm). Image visualization, preprocessing and tracing are conducted on the Vaa3D platform, which is accessible at the Vaa3D GitHub repository (https://github.com/Vaa3D). All training and testing images are cropped from high-resolution fMOST mouse brains downloaded from the Brain Image Library (https://www.brainimagelibrary.org/), and the corresponding gold standards are available at https://doi.brainimagelibrary.org/doi/10.35077/g.25. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

mBrainAligner-Web: a web server for cross-modal coherent registration of whole mouse brains.

SUMMARY: Recent whole-brain mapping projects are collecting increasingly larger sets of high-resolution brain images using a variety of imaging, labeling and sample preparation techniques. Both mining and analysis of these data require reliable and robust cross-modal registration tools. We recently developed the mBrainAligner, a pipeline for performing cross-modal registration of the whole mouse brain. However, using this tool requires scripting or command-line skills to assemble and configure the different modules of mBrainAligner for accommodating different registration requirements and platform settings. In this application note, we present mBrainAligner-Web, a web server with a user-friendly interface that allows to configure and run mBrainAligner locally or remotely across platforms. AVAILABILITY AND IMPLEMENTATION: mBrainAligner-Web is available at http://mbrainaligner.ahu.edu.cn/ with source code at https://github.com/reaneyli/mBrainAligner-web. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

Smart imaging to empower brain-wide neuroscience at single-cell levels.

A deep understanding of the neuronal connectivity and networks with detailed cell typing across brain regions is necessary to unravel the mechanisms behind the emotional and memorial functions as well as to find the treatment of brain impairment. Brain-wide imaging with single-cell resolution provides unique advantages to access morphological features of a neuron and to investigate the connectivity of neuron networks, which has led to exciting discoveries over the past years based on animal models, such as rodents. Nonetheless, high-throughput systems are in urgent demand to support studies of neural morphologies at larger scale and more detailed level, as well as to enable research on non-human primates (NHP) and human brains. The advances in artificial intelligence (AI) and computational resources bring great opportunity to 'smart' imaging systems, i.e., to automate, speed up, optimize and upgrade the imaging systems with AI and computational strategies. In this light, we review the important computational techniques that can support smart systems in brain-wide imaging at single-cell resolution.

Petabyte-Scale Multi-Morphometry of Single Neurons for Whole Brains.

Recent advances in brain imaging allow producing large amounts of 3-D volumetric data from which morphometry data is reconstructed and measured. Fine detailed structural morphometry of individual neurons, including somata, dendrites, axons, and synaptic connectivity based on digitally reconstructed neurons, is essential for cataloging neuron types and their connectivity. To produce quality morphometry at large scale, it is highly desirable but extremely challenging to efficiently handle petabyte-scale high-resolution whole brain imaging database. Here, we developed a multi-level method to produce high quality somatic, dendritic, axonal, and potential synaptic morphometry, which was made possible by utilizing necessary petabyte hardware and software platform to optimize both the data and workflow management. Our method also boosts data sharing and remote collaborative validation. We highlight a petabyte application dataset involving 62 whole mouse brains, from which we identified 50,233 somata of individual neurons, profiled the dendrites of 11,322 neurons, reconstructed the full 3-D morphology of 1,050 neurons including their dendrites and full axons, and detected 1.9 million putative synaptic sites derived from axonal boutons. Analysis and simulation of these data indicate the promise of this approach for modern large-scale morphology applications.

Image enhancement to leverage the 3D morphological reconstruction of single-cell neurons.

MOTIVATION: To digitally reconstruct the 3D neuron morphologies has long been a major bottleneck in neuroscience. One of the obstacles to automate the procedure is the low signal-background contrast (SBC) and the large dynamic range of signal and background both within and across images. RESULTS: We developed a pipeline to enhance the neurite signal and to suppress the background, with the goal of high SBC and better within- and between-image homogeneity. The performance of the image enhancement was quantitatively verified according to the different figures of merit benchmarking the image quality. In addition, the method could improve the neuron reconstruction in approximately 1/3 of the cases, with very few cases of degrading the reconstruction. This significantly outperformed three other approaches of image enhancement. Moreover, the compression rate was increased five times by average comparing the enhanced to the raw image. All results demonstrated the potential of the proposed method in leveraging the neuroscience by providing better 3D morphological reconstruction and lower cost of data storage and transfer. AVAILABILITY AND IMPLEMENTATION: The study is conducted based on the Vaa3D platform and python 3.7.9. The Vaa3D platform is available on the GitHub (https://github.com/Vaa3D). The source code of the proposed image enhancement as a Vaa3D plugin, the source code to benchmark the image quality and the example image blocks are available under the repository of vaa3d_tools/hackathon/SGuo/imPreProcess. The original fMost images of mouse brains can be found at the BICCN's Brain Image Library (BIL) (https://www.brainimagelibrary.org). SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

Cross-modal coherent registration of whole mouse brains.

Recent whole-brain mapping projects are collecting large-scale three-dimensional images using modalities such as serial two-photon tomography, fluorescence micro-optical sectioning tomography, light-sheet fluorescence microscopy, volumetric imaging with synchronous on-the-fly scan and readout or magnetic resonance imaging. Registration of these multi-dimensional whole-brain images onto a standard atlas is essential for characterizing neuron types and constructing brain wiring diagrams. However, cross-modal image registration is challenging due to intrinsic variations of brain anatomy and artifacts resulting from different sample preparation methods and imaging modalities. We introduce a cross-modal registration method, mBrainAligner, which uses coherent landmark mapping and deep neural networks to align whole mouse brain images to the standard Allen Common Coordinate Framework atlas. We build a brain atlas for the fluorescence micro-optical sectioning tomography modality to facilitate single-cell mapping, and used our method to generate a whole-brain map of three-dimensional single-neuron morphology and neuron cell types.

Multi-Scale Light-Sheet Fluorescence Microscopy for Fast Whole Brain Imaging.

Whole-brain imaging has become an increasingly important approach to investigate neural structures, such as somata distribution, dendritic morphology, and axonal projection patterns. Different structures require whole-brain imaging at different resolutions. Thus, it is highly desirable to perform whole-brain imaging at multiple scales. Imaging a complete mammalian brain at synaptic resolution is especially challenging, as it requires continuous imaging from days to weeks because of the large number of voxels to sample, and it is difficult to acquire a constant quality of imaging because of light scattering during in toto imaging. Here, we reveal that light-sheet microscopy has a unique advantage over wide-field microscopy in multi-scale imaging because of its decoupling of illumination and detection. Based on this observation, we have developed a multi-scale light-sheet microscope that combines tiling of light-sheet, automatic zooming, periodic sectioning, and tissue expansion to achieve a constant quality of brain-wide imaging from cellular (3 µm × 3 µm × 8 µm) to sub-micron (0.3 µm × 0.3 µm × 1 µm) spatial resolution rapidly (all within a few hours). We demonstrated the strength of the system by testing it using mouse brains prepared using different clearing approaches. We were able to track electrode tracks as well as axonal projections at sub-micron resolution to trace the full morphology of single medial prefrontal cortex (mPFC) neurons that have remarkable diversity in long-range projections.

Morphological diversity of single neurons in molecularly defined cell types.

Dendritic and axonal morphology reflects the input and output of neurons and is a defining feature of neuronal types1,2, yet our knowledge of its diversity remains limited. Here, to systematically examine complete single-neuron morphologies on a brain-wide scale, we established a pipeline encompassing sparse labelling, whole-brain imaging, reconstruction, registration and analysis. We fully reconstructed 1,741 neurons from cortex, claustrum, thalamus, striatum and other brain regions in mice. We identified 11 major projection neuron types with distinct morphological features and corresponding transcriptomic identities. Extensive projectional diversity was found within each of these major types, on the basis of which some types were clustered into more refined subtypes. This diversity follows a set of generalizable principles that govern long-range axonal projections at different levels, including molecular correspondence, divergent or convergent projection, axon termination pattern, regional specificity, topography, and individual cell variability. Although clear concordance with transcriptomic profiles is evident at the level of major projection type, fine-grained morphological diversity often does not readily correlate with transcriptomic subtypes derived from unsupervised clustering, highlighting the need for single-cell cross-modality studies. Overall, our study demonstrates the crucial need for quantitative description of complete single-cell anatomy in cell-type classification, as single-cell morphological diversity reveals a plethora of ways in which different cell types and their individual members may contribute to the configuration and function of their respective circuits.