Inter-individual deep image reconstruction via hierarchical neural code conversion.

The sensory cortex is characterized by general organizational principles such as topography and hierarchy. However, measured brain activity given identical input exhibits substantially different patterns across individuals. Although anatomical and functional alignment methods have been proposed in functional magnetic resonance imaging (fMRI) studies, it remains unclear whether and how hierarchical and fine-grained representations can be converted between individuals while preserving the encoded perceptual content. In this study, we trained a method of functional alignment called neural code converter that predicts a target subject's brain activity pattern from a source subject given the same stimulus, and analyzed the converted patterns by decoding hierarchical visual features and reconstructing perceived images. The converters were trained on fMRI responses to identical sets of natural images presented to pairs of individuals, using the voxels on the visual cortex that covers from V1 through the ventral object areas without explicit labels of the visual areas. We decoded the converted brain activity patterns into the hierarchical visual features of a deep neural network using decoders pre-trained on the target subject and then reconstructed images via the decoded features. Without explicit information about the visual cortical hierarchy, the converters automatically learned the correspondence between visual areas of the same levels. Deep neural network feature decoding at each layer showed higher decoding accuracies from corresponding levels of visual areas, indicating that hierarchical representations were preserved after conversion. The visual images were reconstructed with recognizable silhouettes of objects even with relatively small numbers of data for converter training. The decoders trained on pooled data from multiple individuals through conversions led to a slight improvement over those trained on a single individual. These results demonstrate that the hierarchical and fine-grained representation can be converted by functional alignment, while preserving sufficient visual information to enable inter-individual visual image reconstruction.

Cortical patterning of morphometric similarity gradient reveals diverged hierarchical organization in sensory-motor cortices.

The topological organization of the cerebral cortex provides hierarchical axes, namely gradients, which reveal systematic variations of brain structure and function. However, the hierarchical organization of macroscopic brain morphology and how it constrains cortical function along the organizing axes remains unclear. We map the gradient of cortical morphometric similarity (MS) connectome, combining multiple features conceptualized as a "fingerprint" of an individual's brain. The principal MS gradient is anchored by motor and sensory cortices at two extreme ends, which are reliable and reproducible. Notably, divergences between motor and sensory hierarchies are consistent with the laminar histological thickness gradient but contrary to the canonical functional connectivity (FC) gradient. Moreover, the MS dissociates with FC gradients in the higher-order association cortices. The MS gradient recapitulates fundamental properties of cortical organization, from gene expression and cyto- and myeloarchitecture to evolutionary expansion. Collectively, our findings provide a heuristic hierarchical organization of cortical morphological neuromarkers.

Encoding schemes in somatosensation: From micro- to meta-topography.

Encoding schemes are systematic large-scale arrangements that convert incoming sensory information into a format required for further information processing. The increased spatial resolution of brain images obtained with ultra-high field magnetic resonance imaging at 7 T (7T-MRI) and above increases the granularity and precision of processing units that mediate the link between neuronal encoding and functional readouts. Here, these new developments are reviewed with a focus on human tactile encoding schemes derived from small-scale processing units (in the order of 0.5-5 mm) that are relevant for theoretical and practical concepts of somatosensory encoding and cortical plasticity. Precisely, we review recent approaches to characterize meso-scale maps, layer units, and cortical fields in the sensorimotor cortex of the living human brain and discuss their impact on theories of perception, motor control, topographic encoding, and cortical plasticity. Finally, we discuss concepts on the integration of small-scale processing units into functional networks that span multiple topographic maps and multiple cortical areas. Novel research areas are highlighted that may help to bridge the gap between cortical microstructure and meta-topographic models on brain anatomy and function.

Parallel organization of the avian sensorimotor arcopallium: Tectofugal visual pathway in the pigeon (Columba livia).

The sensory-motor division of the avian arcopallium receives parallel inputs from primary and high-order pallial areas of sensory and vocal control pathways, and sends a prominent descending projection to ascending and premotor, subpallial stages of these pathways. While this organization is well established for the auditory and trigeminal systems, the arcopallial subdivision related to the tectofugal visual system and its descending projection to the optic tectum (TeO) has been less investigated. In this study, we charted the arcopallial area displaying tectofugal visual responses and by injecting neural tracers, we traced its connectional anatomy. We found visual motion-sensitive responses in a central region of the dorsal (AD) and intermediate (AI) arcopallium, in between previously described auditory and trigeminal zones. Blocking the ascending tectofugal sensory output, canceled these visual responses in the arcopallium, verifying their tectofugal origin. Injecting PHA-L into the visual, but not into the auditory AI, revealed a massive projection to tectal layer 13 and other tectal related areas, sparing auditory, and trigeminal ones. Conversely, CTB injections restricted to TeO retrogradely labeled neurons confined to the visual AI. These results show that the AI zone receiving tectofugal inputs sends top-down modulations specifically directed to tectal targets, just like the auditory and trigeminal AI zones project back to their respective subpallial sensory and premotor areas, as found by previous studies. Therefore, the arcopallium seems to be organized in a parallel fashion, such that in spite of expected cross-modal integration, the different sensory-motor loops run through separate subdivisions of this structure.

The anatomo-functional organization of the hyperdirect cortical pathway to the subthalamic area using in vivo structural connectivity imaging in humans.

The subthalamic nucleus (STN) receives direct cortical inputs which constitute the so-called hyperdirect pathway. In monkeys, motor cortices innervate the whole extent of the STN whereas limbic cortices innervate only its anteromedial part extending more medially outside the nucleus. Tractography studies in humans have also identified motor cortical inputs to the STN, but little is known about the associative and limbic cortical projections. Therefore, the aim of this study was to investigate the anatomo-functional organization of the cortical projections to the STN and to the adjacent medial subthamic region (MSR). We used diffusion-weighted imaging-based tractography acquired from 30 subjects from the Human Connectome Project. We performed a whole-brain probabilistic tractography using MRTrix and extracted streamlines of interest between 39 cortical masks and both the STN and the MSR to provide track-density maps. Agglomerative clustering method was used to classify the voxels of the regions of interest. We found that the STN receives major inputs from the sensorimotor cortices and few inputs from the limbic cortices. On the other hand, the MSR receives mainly cortical limbic projections and few from the sensorimotor cortices. Weak connections were found between the associative cortices and both the STN and the MSR. We found a dominant motor cluster located in the posterolateral STN, a limbic cluster located medially in the MSR, and an intermediate motor-limbic cluster in between. Our findings show that the hyperdirect pathway is anatomo-functionally organized with a poor participation of associative cortices.

A Novel 2D Standard Cartesian Representation for the Human Sensorimotor Cortex.

For some experimental approaches in brain imaging, the existing normalization techniques are not always sufficient. This may be the case if the anatomical shape of the region of interest varies substantially across subjects, or if one needs to compare the left and right hemisphere in the same subject. Here we propose a new standard representation, building upon existing normalization methods: Cgrid (Cartesian geometric representation with isometric dimensions). Cgrid is based on imposing a Cartesian grid over a cortical region of interest that is bounded by anatomical (atlas-based) landmarks. We applied this new representation to the sensorimotor cortex and we evaluated its performance by studying the similarity of activation patterns for hand, foot and tongue movements between subjects, and similarity between hemispheres within subjects. The Cgrid similarities were benchmarked against the similarities of activation patterns when transformed into standard MNI space using SPM, and to similarities from FreeSurfer's surface-based normalization. For both between-subject and between-hemisphere comparisons, similarity scores in Cgrid were high, similar to those from FreeSurfer normalization and higher than similarity scores from SPM's MNI normalization. This indicates that Cgrid allows for a straightforward way of representing and comparing sensorimotor activity patterns across subjects and between hemispheres of the same subjects.

"Plis de passage" Deserve a Role in Models of the Cortical Folding Process.

Cortical folding is a hallmark of brain topography whose variability across individuals remains a puzzle. In this paper, we call for an effort to improve our understanding of the pli de passage phenomenon, namely annectant gyri buried in the depth of the main sulci. We suggest that plis de passage could become an interesting benchmark for models of the cortical folding process. As an illustration, we speculate on the link between modern biological models of cortical folding and the development of the Pli de Passage Frontal Moyen (PPFM) in the middle of the central sulcus. For this purpose, we have detected nine interrupted central sulci in the Human Connectome Project dataset, which are used to explore the organization of the hand sensorimotor areas in this rare configuration of the PPFM.

Ventral tegmental area connections to motor and sensory cortical fields in humans.

In humans, sensorimotor cortical areas receive relevant dopaminergic innervation-although an anatomic description of the underlying fiber projections is lacking so far. In general, dopaminergic projections towards the cortex originate within the ventral tegmental area (VTA) and are organized in a meso-cortico-limbic system. Using a DTI-based global tractography approach, we recently characterized the superolateral branch of the medial forebrain bundle (slMFB), a prominent pathway providing dopaminergic (and other transmitters) innervation for the pre-frontal cortex (Coenen et al., NeuroImage Clin 18:770-783, 2018). To define the connections between VTA and sensory-motor cortical fields that should contain dopaminergic fibers, we use the slMFB as a key structure to lead our fiber selection procedure: using a similar tracking-seed and tractography algorithm, we describe a dorsal extension of this slMFB that covers sensorimotor fields that are dorsally appended to pre-frontal cortical areas. This "motorMFB", that connects the VTA to sensorimotor cortical fields, can be further segregated into three sub-bundles with a seed-based fiber-selection strategy: A PFC bundle that is attendant to the pre-frontal cortex, passes the lateral VTA, runs through the border zone between the posterior and lateral ventral thalamic nucleus, and involves the pre- and postcentral gyrus. An MB bundle that is attendant to the mammillary bodies runs directly through the medial VTA, passes the lateral ventral thalamic nucleus, and involves the pre- and postcentral gyrus as well as the supplementary motor area (SMA) and the dorsal premotor cortex (dPMC). Finally, a BC bundle that is attendant to the brainstem and cerebellum runs through the lateral VTA, passes the anterior ventral thalamic nucleus, and covers the SMA, pre-SMA, and the dPMC. We, furthermore, included a fiber tracking of the well-defined dentato-rubro-thalamic tract (DRT) that is known to lie in close proximity with respect to fiber orientation and projection areas. As expected, the tract is characterized by a decussation at the ponto-mesencephal level and a projection covering the superior-frontal and precentral cortex. In addition to the physiological role of these particular bundles, the physiological and pathophysiological impact of dopaminergic signaling within sensorimotor cortical fields becomes discussed. However, some limitations have to be taken into account in consequence of the method: the transmitter content, the directionality, and the occurrence of interposed synaptic contacts cannot be specified.

Sensorimotor maps can be dynamically calibrated using an adaptive-filter model of the cerebellum.

Substantial experimental evidence suggests the cerebellum is involved in calibrating sensorimotor maps. Consistent with this involvement is the well-known, but little understood, massive cerebellar projection to maps in the superior colliculus. Map calibration would be a significant new role for the cerebellum given the ubiquity of map representations in the brain, but how it could perform such a task is unclear. Here we investigated a dynamic method for map calibration, based on electrophysiological recordings from the superior colliculus, that used a standard adaptive-filter cerebellar model. The method proved effective for complex distortions of both unimodal and bimodal maps, and also for predictive map-based tracking of moving targets. These results provide the first computational evidence for a novel role for the cerebellum in dynamic sensorimotor map calibration, of potential importance for coordinate alignment during ongoing motor control, and for map calibration in future biomimetic systems. This computational evidence also provides testable experimental predictions concerning the role of the connections between cerebellum and superior colliculus in previously observed dynamic coordinate transformations.

Adaptation of brain functional stream architecture in athletes with fast demands of sensorimotor integration.

Training-induced neuroplasticity has been described in athletes' population. However, it remains largely unknown how regular training and sports proficiency modifies neuronal circuits in the human brain. In this study, we used voxel-based morphometry and stepwise functional connectivity (SFC) analyses to uncover connectivity changes in the functional stream architecture in student-athletes at early stages of sensorimotor skill training. Thirty-two second-year student-athletes whose major was little-ball sports and thirty-four nonathlete controls were recruited for the study. We found that athletes showed greater gray matter volume in the right sensorimotor area, the limbic lobe, and the anterior lobe of the cerebellum. Furthermore, SFC analysis demonstrated that athletes displayed significantly smaller optimal connectivity distance from those seed regions to the dorsal attention network (DAN) and larger optimal connectivity distance to the default mode network (DMN) compared to controls. The Attention Network Test showed that the reaction time of the orienting attention subnetwork was positively correlated with SFC between the seeds and the DAN, while negatively correlated with SFC between the seeds and the DMN. Our findings suggest that neuroplastic adaptations on functional connectivity streams after motor skill training may enable novel information flow from specific areas of the cortex toward distributed networks such as the DAN and the DMN. This could potentially regulate the focus of external and internal attention synchronously in athletes, and consequently accelerate the reaction time of orienting attention in athletes.

A Sensorimotor Pathway via Higher-Order Thalamus.

We now know that sensory processing in cortex occurs not only via direct communication between primary to secondary areas, but also via their parallel cortico-thalamo-cortical (i.e., trans-thalamic) pathways. Both corticocortical and trans-thalamic pathways mainly signal through glutamatergic class 1 (driver) synapses, which have robust and efficient synaptic dynamics suited for the transfer of information such as receptive field properties, suggesting the importance of class 1 synapses in feedforward, hierarchical processing. However, such a parallel arrangement has only been identified in sensory cortical areas: visual, somatosensory, and auditory. To test the generality of trans-thalamic pathways, we sought to establish its presence beyond purely sensory cortices to determine whether there is a trans-thalamic pathway parallel to the established primary somatosensory (S1) to primary motor (M1) pathway. We used trans-synaptic viral tracing, optogenetics in slice preparations, and bouton size analysis in the mouse (both sexes) to document that a circuit exists from layer 5 of S1 through the posterior medial nucleus of the thalamus to M1 with glutamatergic class 1 properties. This represents a hitherto unknown, robust sensorimotor linkage and suggests that the arrangement of parallel direct and trans-thalamic corticocortical circuits may be present as a general feature of cortical functioning.SIGNIFICANCE STATEMENT During sensory processing, feedforward pathways carry information such as receptive field properties via glutamatergic class 1 synapses, which have robust and efficient synaptic dynamics. As expected, class 1 synapses subserve the feedforward projection from primary to secondary sensory cortex, but also a route through specific higher-order thalamic nuclei, creating a parallel feedforward trans-thalamic pathway. We now extend the concept of cortical areas being connected via parallel, direct, and trans-thalamic circuits from purely sensory cortices to a sensorimotor cortical circuit (i.e., primary sensory cortex to primary motor cortex). This suggests a generalized arrangement for corticocortical communication.

The neuroanatomy of speech sequencing at the syllable level.

Correctly ordering a sequence of speech sounds is a crucial aspect of speech production. Although studies have yielded a rich body of data on the neural substrates of visuomotor sequencing and sequence learning, research on brain regions and their functions involving speech sequence production hasn't attracted much attention until recently. Previous functional MRI studies manipulating the complexity of sequences at the phonemic, syllabic, and suprasyllabic levels have revealed a network of motor-related cortical and sub-cortical speech regions. In this study, we directly compared human brain activity measured with functional MRI during processing of a sequence of syllables compared with the same syllables processed individually. Among a network of regions independently identified as being part of the sensorimotor circuits for speech production, only the left posterior inferior frontal gyrus (pars opercularis, lIFG), the supplementary motor area (SMA), and the left inferior parietal lobe (lIPL) responded more during the production of syllable sequences compared to producing the same syllables articulated one at a time.

The influence of prior pronunciations on sensorimotor cortex activity patterns during vowel production.

OBJECTIVE: In recent years, brain-computer interface (BCI) systems have been investigated for their potential as a communication device to assist people with severe paralysis. Decoding speech sensorimotor cortex activity is a promising avenue for the generation of BCI control signals, but is complicated by variability in neural patterns, leading to suboptimal decoding. We investigated whether neural pattern variability associated with sound pronunciation can be explained by prior pronunciations and determined to what extent prior speech affects BCI decoding accuracy. APPROACH: Neural patterns in speech motor areas were evaluated with electrocorticography in five epilepsy patients, who performed a simple speech task that involved pronunciation of the /i/ sound, preceded by either silence, the /a/ sound or the /u/ sound. MAIN RESULTS: The neural pattern related to the /i/ sound depends on previous sounds and is therefore associated with multiple distinct sensorimotor patterns, which is likely to reflect differences in the movements towards this sound. We also show that these patterns still contain a commonality that is distinct from the other vowel sounds (/a/ and /u/). Classification accuracies for the decoding of different sounds do increase, however, when the multiple patterns for the /i/ sound are taken into account. Simply including multiple forms of the /i/ vowel in the training set for the creation of a single /i/ model performs as well as training individual models for each /i/ variation. SIGNIFICANCE: Our results are of interest for the development of BCIs that aim to decode speech sounds from the sensorimotor cortex, since they argue that a multitude of cortical activity patterns associated with speech movements can be reduced to a basis set of models which reflect meaningful language units (vowels), yet it is important to account for the variety of neural patterns associated with a single sound in the training process.

A Connectomic Atlas of the Human Cerebrum-Chapter 3: The Motor, Premotor, and Sensory Cortices.

In this supplement, we build on work previously published under the Human Connectome Project. Specifically, we show a comprehensive anatomic atlas of the human cerebrum demonstrating all 180 distinct regions comprising the cerebral cortex. The location, functional connectivity, and structural connectivity of these regions are outlined, and where possible a discussion is included of the functional significance of these areas. In part 3, we specifically address regions relevant to the sensorimotor cortices.

Mapping of fine-scale rat prefrontal cortex connections: Evidence for detailed ordering of inputs and outputs connecting the temporal cortex and sensory-motor regions.

Cerebral cortex structure is crucially important for cortical organization and function. The organization of prefrontal cortex (PFC) is controversial and here we seek to understand it more clearly through the study of fine-scale cortical connections. To determine the ordering of microscale input and output connections in the rat PFC, we injected small volumes (20-30 nl) of anterograde (Fluro-Ruby) and retrograde (Fluoro-Gold) neuroanatomical tracers into PFC. These injections revealed several connected regions of the brain but here we report findings restricted to PFC to temporal cortex and sensory-motor cortex pathways. In agreement with previous studies incorporating larger injection volumes we found that smaller injection volumes revealed a more detailed, fine-scale ordering of both prefrontal inputs and output connections to the temporal cortex and sensory-motor cortex regions. These findings are also supported by labelling observed from additional tracer injections made into corresponding regions of temporal cortex. The topography observed reflected the ordering seen at a larger level (i.e., with larger injection volumes) but there were some differences in the topography, such as in relation to the direction of ordering. In agreement with earlier work, we found that fine-scale input and output connections were not always aligned with respect to one another. These results provide evidence for topographically arranged inputs and outputs in two distinct PFC pathways, along with evidence for different connectional patterns within the same pathways. Based on theories of functional connectivity, these findings provide evidence for prefrontal cortical regions residing within networks that contribute to different cognitive functions.

Structural Connections of Functionally Defined Human Insular Subdivisions.

The organization of the human insular cortex has traditionally been considered as an anterior-posterior dichotomy, where anterior and posterior subdivisions have unique structural and functional connections. However, recent functional neuroimaging research proposes a tripartite organization where insular subdivisions have both unique and overlapping functional profiles. Studies examining unique profiles show that the dorsal anterior insula (dAI) has connections with frontal areas supporting higher-level cognitive processes, the ventral anterior insula (vAI) has connections with limbic areas supporting affective processes, and the posterior insula (PI) has connections with sensorimotor areas supporting interoceptive processes. Studies examining overlapping profiles demonstrate that all 3 subdivisions can also have similar functional profiles. The structural organization supporting a functional tripartite insula organization presenting with overlapping and unique connections is currently unknown. We used a large HARDI diffusion magnetic resonance imaging (MRI) dataset (n = 199) to demonstrate novel visualizations of insula white matter tracts supporting a tripartite structure-function insula organization. Overlapping connections of all 3 insula subdivisions consisted of association pathways (inferior fronto-occipital fasciculus, uncinate fasciculus, arcuate fasciculus) while unique connections included the corona radiata, subcortical-cortical tracts, and horizontal and u-shaped tracts. These results generally support a tripartite structure-function organization of the insular cortex, with subdivisions that exhibit both overlapping and unique connectivity profiles.

Resting-state Functional Magnetic Resonance Imaging in Presurgical Functional Mapping: Sensorimotor Localization.

This article compares resting-state functional magnetic resonance (fMR) imaging with task fMR imaging for presurgical functional mapping of the sensorimotor (SM) region. Before tumor resection, 38 patients were scanned using both methods. The SM area was anatomically defined using 2 different software tools. Overlap of anatomic regions of interest with task activation maps and resting-state networks was measured in the SM region. A paired t-test showed higher overlap between resting-state maps and anatomic references compared with task activation when using a maximal overlap criterion. Resting state-derived maps are more comprehensive than those derived from task fMR imaging.

Brain plasticity and sensorimotor deterioration as a function of 70 days head down tilt bed rest.

BACKGROUND: Adverse effects of spaceflight on sensorimotor function have been linked to altered somatosensory and vestibular inputs in the microgravity environment. Whether these spaceflight sequelae have a central nervous system component is unknown. However, experimental studies have shown spaceflight-induced brain structural changes in rodents' sensorimotor brain regions. Understanding the neural correlates of spaceflight-related motor performance changes is important to ultimately develop tailored countermeasures that ensure mission success and astronauts' health. METHOD: Head down-tilt bed rest (HDBR) can serve as a microgravity analog because it mimics body unloading and headward fluid shifts of microgravity. We conducted a 70-day 6° HDBR study with 18 right-handed males to investigate how microgravity affects focal gray matter (GM) brain volume. MRI data were collected at 7 time points before, during and post-HDBR. Standing balance and functional mobility were measured pre and post-HDBR. The same metrics were obtained at 4 time points over ~90 days from 12 control subjects, serving as reference data. RESULTS: HDBR resulted in widespread increases GM in posterior parietal regions and decreases in frontal areas; recovery was not yet complete by 12 days post-HDBR. Additionally, HDBR led to balance and locomotor performance declines. Increases in a cluster comprising the precuneus, precentral and postcentral gyrus GM correlated with less deterioration or even improvement in standing balance. This association did not survive Bonferroni correction and should therefore be interpreted with caution. No brain or behavior changes were observed in control subjects. CONCLUSIONS: Our results parallel the sensorimotor deficits that astronauts experience post-flight. The widespread GM changes could reflect fluid redistribution. Additionally, the association between focal GM increase and balance changes suggests that HDBR also may result in neuroplastic adaptation. Future studies are warranted to determine causality and underlying mechanisms.

Cyclic Vomiting Syndrome is characterized by altered functional brain connectivity of the insular cortex: A cross-comparison with migraine and healthy adults.

Cyclic Vomiting Syndrome (CVS) has been linked to episodic migraine, yet little is known about the precise brain-based mechanisms underpinning CVS, and whether these associated conditions share similar pathophysiology. We investigated the functional integrity of salience (SLN) and sensorimotor (SMN) intrinsic connectivity networks in CVS, migraine and healthy controls using brain functional Magnetic Resonance Imaging. CVS, relative to both migraine and controls, showed increased SLN connectivity to middle/posterior insula, a key brain region for nausea and viscerosensory processing. In contrast, this same region showed diminished SMN connectivity in both CVS and migraine. These results highlight both unique and potentially shared pathophysiology between these conditions, and suggest a potential target for therapeutics in future studies.