ABSTRACT
Brain mapping studies often need to identify brain structures or functional circuits into a set of individual brains. To this end, multiple atlases have been published to represent such structures based on different modalities, subject sets, and techniques. The mainstream approach to exploit these atlases consists in spatially deforming each individual data onto a given atlas using dense deformation fields, which supposes the existence of a continuous mapping between atlases and individuals. However, this continuity is not always verified, and this "iconic" approach has limits. We present in this study an alternative, complementary, "structural" approach, which consists in extracting structures from the individual data, and comparing them without deformation. A "structural atlas" is thus a collection of annotated individual data with a common structure nomenclature. It may be used to characterize structure shape variability across individuals or species, or to train machine learning systems. This study exhibits Anatomist, a powerful structural 3D visualization software dedicated to building, exploring, and editing structural atlases involving a large number of subjects. It has been developed primarily to decipher the cortical folding variability; cortical sulci vary enormously in both size and shape, and some may be missing or have various topologies, which makes iconic approaches inefficient to study them. We, therefore, had to build structural atlases for cortical sulci, and use them to train sulci identification algorithms. Anatomist can display multiple subject data in multiple views, supports all kinds of neuroimaging data, including compound structural object graphs, handles arbitrary coordinate transformation chains between data, and has multiple display features. It is designed as a programming library in both C++ and Python languages, and may be extended or used to build dedicated custom applications. Its generic design makes all the display and structural aspects used to explore the variability of the cortical folding pattern work in other applications, for instance, to browse axonal fiber bundles, deep nuclei, functional activations, or other kinds of cortical parcellations. Multimodal, multi-individual, or inter-species display is supported, and adaptations to large scale screen walls have been developed. These very original features make it a unique viewer for structural atlas browsing.
ABSTRACT
The extreme variability of the folding pattern of the human cortex makes the recognition of cortical sulci, both automatic and manual, particularly challenging. Reliable identification of the human cortical sulci in its entirety, is extremely difficult and is practiced by only a few experts. Moreover, these sulci correspond to more than a hundred different structures, which makes manual labeling long and fastidious and therefore limits access to large labeled databases to train machine learning. Here, we seek to improve the current model proposed in the Morphologist toolbox, a widely used sulcus recognition toolbox included in the BrainVISA package. Two novel approaches are proposed: patch-based multi-atlas segmentation (MAS) techniques and convolutional neural network (CNN)-based approaches. Both are currently applied for anatomical segmentations because they embed much better representations of inter-subject variability than approaches based on a single template atlas. However, these methods typically focus on voxel-wise labeling, disregarding certain geometrical and topological properties of interest for sulcus morphometry. Therefore, we propose to refine these approaches with domain specific bottom-up geometric constraints provided by the Morphologist toolbox. These constraints are utilized to provide a single sulcus label to each topologically elementary fold, the building blocks of the pattern recognition problem. To eliminate the shortcomings associated with the Morphologist's pre-segmentation into elementary folds, we complement this regularization scheme using a top-down perspective which triggers an additional cleavage of the elementary folds when required. All the newly proposed models outperform the current Morphologist model, the most efficient being a CNN U-Net-based approach which carries out sulcus recognition within a few seconds.
