Representational Geometries Reveal Differential Effects of Response Correlations on Population Codes in Neurophysiology and Functional Magnetic Resonance Imaging.

Two sensory neurons usually display trial-by-trial spike-count correlations given the repeated representations of a stimulus. The effects of such response correlations on population-level sensory coding have been the focal contention in computational neuroscience over the past few years. In the meantime, multivariate pattern analysis (MVPA) has become the leading analysis approach in functional magnetic resonance imaging (fMRI), but the effects of response correlations among voxel populations remain underexplored. Here, instead of conventional MVPA analysis, we calculate linear Fisher information of population responses in human visual cortex (five males, one female) and hypothetically remove response correlations between voxels. We found that voxelwise response correlations generally enhance stimulus information, a result standing in stark contrast to the detrimental effects of response correlations reported in empirical neurophysiological studies. By voxel-encoding modeling, we further show that these two seemingly opposite effects actually can coexist within the primate visual system. Furthermore, we use principal component analysis to decompose stimulus information in population responses onto different principal dimensions in a high-dimensional representational space. Interestingly, response correlations simultaneously reduce and enhance information on higher- and lower-variance principal dimensions, respectively. The relative strength of the two antagonistic effects within the same computational framework produces the apparent discrepancy in the effects of response correlations in neuronal and voxel populations. Our results suggest that multivariate fMRI data contain rich statistical structures that are directly related to sensory information representation, and the general computational framework to analyze neuronal and voxel population responses can be applied in many types of neural measurements.SIGNIFICANCE STATEMENT Despite the vast research interest in the effect of spike-count noise correlations on population codes in neurophysiology, it remains unclear how the response correlations between voxels influence MVPA in human imaging. We used an information-theoretic approach and showed that unlike the detrimental effects of response correlations reported in neurophysiology, voxelwise response correlations generally improve sensory coding. We conducted a series of in-depth analyses and demonstrated that neuronal and voxel response correlations can coexist within the visual system and share some common computational mechanisms. These results shed new light on how the population codes of sensory information can be evaluated via different neural measurements.

The rapid change in mental health among college students after introduction of on-campus quarantine during the 2022 Shanghai COVID-19 lockdown.

Objectives: Among the various impacts of disasters in terms of emotions, quarantine has been proven to result in significant increases in mental health problems. Studies of psychological resilience during outbreaks of epidemics tend to focus on long-term social quarantine. In contrast, insufficient studies have been conducted examining how rapidly negative mental health outcomes occur and how these outcomes change over time. We evaluated the time course of psychological resilience (over three different phases of quarantine) among students at Shanghai Jiao Tong University to investigate the influence of unexpected changes on college students. Methods: An online survey was conducted from 5 to 7 April 2022. A structured online questionnaire was administered using a retrospective cohort trial design. Before 9 March (Period 1), individuals engaged in their usual activities without restrictions. From 9 to 23 March (Period 2), the majority of students were asked to remain in their dormitories on campus. From 24 March to early April (Period 3), restrictions were relaxed, and students were gradually allowed to participate in essential activities on campus. We quantified dynamic changes in the severity of students' depressive symptoms over the course of these three periods. The survey consisted of five sets of self-reported questions: demographic information, lifestyle/activity restrictions, a brief mental health history, COVID-19-related background, and the Beck Depression Inventory, second edition. Results: A total of 274 college students aged 18-42 years (mean = 22.34; SE = 0.24) participated in the study (58.39% undergraduate students, 41.61% graduate students; 40.51% male, 59.49% female). The proportion of students with depressive symptoms was 9.1% in Period 1, 36.1% in Period 2, and 34.67% in Period 3. Depressive symptoms increased notably with the introduction of the quarantine in Periods 2 and 3. Lower satisfaction with the food supplied and a longer duration of physical exercise per day were found to be positively associated with changes in depression severity in Periods 2 and 3. Quarantine-related psychological distress was more evident in students who were in a romantic relationship than in students who were single. Conclusion: Depressive symptoms in university students rapidly increased after 2 weeks of quarantine and no perceptible reversal was observed over time. Concerning students in a relationship, ways to take physical exercise and to relax should be provided and the food supplied should be improved when young people are quarantined.

Assessment of vibration modulated regional cerebral blood flow with MRI.

Human brain experiences vibration of certain magnitude and frequency during various physical activities such as vehicle transportation and machine operation, which may cause traumatic brain injury or other brain diseases. However, the mechanisms of brain pathogenesis due to vibration are not fully elucidated due to the lack of techniques to study brain functions while applying vibration to the brain at a specific magnitude and frequency. Here, this study reported a custom-built head-worn electromagnetic actuator that applied vibration to the brain in vivo at an accurate frequency inside a magnetic resonance imaging scanner while cerebral blood flow (CBF) was acquired. Using this technique, CBF values from 45 healthy volunteers were quantitatively measured immediately following vibration at 20, 30, 40 Hz, respectively. Results showed increasingly reduced CBF with increasing frequency at multiple regions of the brain, while the size of the regions expanded. Importantly, the vibration-induced CBF reduction regions largely fell inside the brain's default mode network (DMN), with about 58 or 46% overlap at 30 or 40 Hz, respectively. These findings demonstrate that vibration as a mechanical stimulus can change strain conditions, which may induce CBF reduction in the brain with regional differences in a frequency-dependent manner. Furthermore, the overlap between vibration-induced CBF reduction regions and DMN suggested a potential relationship between external mechanical stimuli and cognitive functions.

Ultra-high field (10.5T) diffusion-weighted MRI of the macaque brain.

Diffu0sion-weighted magnetic resonance imaging (dMRI) is a non-invasive imaging technique that provides information about the barriers to the diffusion of water molecules in tissue. In the brain, this information can be used in several important ways, including to examine tissue abnormalities associated with brain disorders and to infer anatomical connectivity and the organization of white matter bundles through the use of tractography algorithms. However, dMRI also presents certain challenges. For example, historically, the biological validation of tractography models has shown only moderate correlations with anatomical connectivity as determined through invasive tract-tracing studies. Some of the factors contributing to such issues are low spatial resolution, low signal-to-noise ratios, and long scan times required for high-quality data, along with modeling challenges like complex fiber crossing patterns. Leveraging the capabilities provided by an ultra-high field scanner combined with denoising, we have acquired whole-brain, 0.58 mm isotropic resolution dMRI with a 2D-single shot echo planar imaging sequence on a 10.5 Tesla scanner in anesthetized macaques. These data produced high-quality tractograms and maps of scalar diffusion metrics in white matter. This work demonstrates the feasibility and motivation for in-vivo dMRI studies seeking to benefit from ultra-high fields.

Atypically larger variability of resource allocation accounts for visual working memory deficits in schizophrenia.

Working memory (WM) deficits have been widely documented in schizophrenia (SZ), and almost all existing studies attributed the deficits to decreased capacity as compared to healthy control (HC) subjects. Recent developments in WM research suggest that other components, such as precision, also mediate behavioral performance. It remains unclear how different WM components jointly contribute to deficits in schizophrenia. We measured the performance of 60 SZ (31 females) and 61 HC (29 females) in a classical delay-estimation visual working memory (VWM) task and evaluated several influential computational models proposed in basic science of VWM to disentangle the effect of various memory components. We show that the model assuming variable precision (VP) across items and trials is the best model to explain the performance of both groups. According to the VP model, SZ exhibited abnormally larger variability of allocating memory resources rather than resources or capacity per se. Finally, individual differences in the resource allocation variability predicted variation of symptom severity in SZ, highlighting its functional relevance to schizophrenic pathology. This finding was further verified using distinct visual features and subject cohorts. These results provide an alternative view instead of the widely accepted decreased-capacity theory and highlight the key role of elevated resource allocation variability in generating atypical VWM behavior in schizophrenia. Our findings also shed new light on the utility of Bayesian observer models to characterize mechanisms of mental deficits in clinical neuroscience.

Action video game play facilitates "learning to learn".

Previous work has demonstrated that action video game training produces enhancements in a wide range of cognitive abilities. Here we evaluate a possible mechanism by which such breadth of enhancement could be attained: that action game training enhances learning rates in new tasks (i.e., "learning to learn"). In an initial controlled intervention study, we show that individuals who were trained on action video games subsequently exhibited faster learning in the two cognitive domains that we tested, perception and working memory, as compared to individuals who trained on non-action games. We further confirmed the causal effect of action video game play on learning ability in a pre-registered follow-up study that included a larger number of participants, blinding, and measurements of participant expectations. Together, this work highlights enhanced learning speed for novel tasks as a mechanism through which action video game interventions may broadly improve task performance in the cognitive domain.

Dissociable Neural Representations of Adversarially Perturbed Images in Convolutional Neural Networks and the Human Brain.

Despite the remarkable similarities between convolutional neural networks (CNN) and the human brain, CNNs still fall behind humans in many visual tasks, indicating that there still exist considerable differences between the two systems. Here, we leverage adversarial noise (AN) and adversarial interference (AI) images to quantify the consistency between neural representations and perceptual outcomes in the two systems. Humans can successfully recognize AI images as the same categories as their corresponding regular images but perceive AN images as meaningless noise. In contrast, CNNs can recognize AN images similar as corresponding regular images but classify AI images into wrong categories with surprisingly high confidence. We use functional magnetic resonance imaging to measure brain activity evoked by regular and adversarial images in the human brain, and compare it to the activity of artificial neurons in a prototypical CNN-AlexNet. In the human brain, we find that the representational similarity between regular and adversarial images largely echoes their perceptual similarity in all early visual areas. In AlexNet, however, the neural representations of adversarial images are inconsistent with network outputs in all intermediate processing layers, providing no neural foundations for the similarities at the perceptual level. Furthermore, we show that voxel-encoding models trained on regular images can successfully generalize to the neural responses to AI images but not AN images. These remarkable differences between the human brain and AlexNet in representation-perception association suggest that future CNNs should emulate both behavior and the internal neural presentations of the human brain.

Vigilance-Avoidance Toward Negative Faces in Social Anxiety With and Without Comorbid Depression.

Despite the growing evidence for the attentional bias toward emotional related stimuli in patients with social anxiety disorder (SAD), it remains unclear how the attentional bias manifests in normal individuals with SAD and/or depressive traits. To address this question, we recruited three groups of normal participants with different psychiatric traits-individuals with comorbid SAD and depression (SADd, N = 19), individuals with only SAD (SAD, N = 15), and healthy control individuals (HC, N = 19). In a dot-probe paradigm, participants view angry, disgusted, and sad face stimuli with durations ranging from very brief (i.e., 14ms) that renders stimuli completely intangible, to relatively long (i.e., 2000ms) that guarantees image visibility. We find significant early vigilance (i.e., on brief stimuli) and later avoidance (i.e., on long stimuli) toward angry faces in the SADd group. We also find vigilance toward angry and disgusted faces in the SAD group. To our best knowledge, this is the first study to unify both vigilance and avoidance within the same experimental paradigm, providing direct evidence for the "vigilance-avoidance" theory of comorbid SAD and depression. In sum, these results provide evidence for the potential behavioral differences induced by anxiety-depression comorbidity and a single trait in non-clinical populations, but the lack of a depression-only group cannot reveal the effects of high levels of depression on the results. The limitations are discussed.

Functional reallocation of sensory processing resources caused by long-term neural adaptation to altered optics.

The eye's optics are a major determinant of visual perception. Elucidating how long-term exposure to optical defects affects visual processing is key to understanding the capacity for, and limits of, sensory plasticity. Here, we show evidence of functional reallocation of sensory processing resources following long-term exposure to poor optical quality. Using adaptive optics to bypass all optical defects, we assessed visual processing in neurotypically-developed adults with healthy eyes and with keratoconus - a corneal disease causing severe optical aberrations. Under fully-corrected optical conditions, keratoconus patients showed altered contrast sensitivity, with impaired sensitivity for fine spatial details and better-than-typical sensitivity for coarse spatial details. Both gains and losses in sensitivity were more pronounced in patients experiencing poorer optical quality in their daily life and mediated by changes in signal enhancement mechanisms. These findings show that adult neural processing adapts to better match the changes in sensory inputs caused by long-term exposure to altered optics.

Analysis and prospect of clinical psychology based on topic models: hot research topics and scientific trends in the latest decades.

The popularity of research topics in clinical psychology has always been changing over time. In this study, we use Latent Dirichlet Allocation (LDA), a well-established statistical modeling approach in machine learning, to extract hot research topics in published review articles in clinical psychology. In Study 1, we use LDA to extract existing topics between 1981 to 2018 from the review articles published on three premium journals in clinical psychology. Results provide stable information about all topics and their proportions. In Study 2, we use a dynamic variant of LDA to identify the development of hot topics from 2007 to 2018. Results show that meta-analysis, psychotherapy, professional development, and depression constantly stay as hot topics all over the 12 years. We also find that behavior intervention has a clear rising trend since 2007. Our results provide a comprehensive summary of the popularity of research topics in clinical psychology in the last couple of years, and the results here can help clinical researchers form a structured view of past research and plan future research directions.

A temporal decomposition method for identifying venous effects in task-based fMRI.

The spatial resolution of functional magnetic resonance imaging (fMRI) is fundamentally limited by effects from large draining veins. Here we describe an analysis method that provides data-driven estimates of these effects in task-based fMRI. The method involves fitting a one-dimensional manifold that characterizes variation in response timecourses observed in a given dataset, and then using identified early and late timecourses as basis functions for decomposing responses into components related to the microvasculature (capillaries and small venules) and the macrovasculature (large veins), respectively. We show the removal of late components substantially reduces the superficial cortical depth bias of fMRI responses and helps eliminate artifacts in cortical activity maps. This method provides insight into the origins of the fMRI signal and can be used to improve the spatial accuracy of fMRI.

Understanding multivariate brain activity: Evaluating the effect of voxelwise noise correlations on population codes in functional magnetic resonance imaging.

Previous studies in neurophysiology have shown that neurons exhibit trial-by-trial correlated activity and that such noise correlations (NCs) greatly impact the accuracy of population codes. Meanwhile, multivariate pattern analysis (MVPA) has become a mainstream approach in functional magnetic resonance imaging (fMRI), but it remains unclear how NCs between voxels influence MVPA performance. Here, we tackle this issue by combining voxel-encoding modeling and MVPA. We focus on a well-established form of NC, tuning-compatible noise correlation (TCNC), whose sign and magnitude are systematically related to the tuning similarity between two units. We show that this form of voxelwise NCs can improve MVPA performance if NCs are sufficiently strong. We also confirm these results using standard information-theoretic analyses in computational neuroscience. In the same theoretical framework, we further demonstrate that the effects of noise correlations at both the neuronal level and the voxel level may manifest differently in typical fMRI data, and their effects are modulated by tuning heterogeneity. Our results provide a theoretical foundation to understand the effect of correlated activity on population codes in macroscopic fMRI data. Our results also suggest that future fMRI research could benefit from a closer examination of the correlational structure of multivariate responses, which is not directly revealed by conventional MVPA approaches.

Flexible top-down modulation in human ventral temporal cortex.

Visual neuroscientists have long characterized attention as inducing a scaling or additive effect on fixed parametric functions describing neural responses (e.g., contrast response functions). Here, we instead propose that top-down effects are more complex and manifest in ways that depend not only on attention but also other cognitive processes involved in executing a task. To substantiate this theory, we analyze fMRI responses in human ventral temporal cortex (VTC) in a study where stimulus eccentricity and cognitive task are varied. We find that as stimuli are presented farther into the periphery, bottom-up stimulus-driven responses decline but top-down attentional enhancement increases substantially. This disproportionate enhancement of weak responses cannot be easily explained by conventional models of attention. Furthermore, we find that attentional effects depend on the specific cognitive task performed by the subject, indicating the influence of additional cognitive processes other than attention (e.g., decision-making). The effects we observe replicate in an independent experiment from the same study, and also generalize to a separate study involving different stimulus manipulations (contrast and phase coherence). Our results suggest that a quantitative understanding of top-down modulation requires more nuanced characterization of the multiple cognitive factors involved in completing a perceptual task.

Ultra-high-resolution fMRI of Human Ventral Temporal Cortex Reveals Differential Representation of Categories and Domains.

Human ventral temporal cortex (VTC) is critical for visual recognition. It is thought that this ability is supported by large-scale patterns of activity across VTC that contain information about visual categories. However, it is unknown how category representations in VTC are organized at the submillimeter scale and across cortical depths. To fill this gap in knowledge, we measured BOLD responses in medial and lateral VTC to images spanning 10 categories from five domains (written characters, bodies, faces, places, and objects) at an ultra-high spatial resolution of 0.8 mm using 7 Tesla fMRI in both male and female participants. Representations in lateral VTC were organized most strongly at the general level of domains (e.g., places), whereas medial VTC was also organized at the level of specific categories (e.g., corridors and houses within the domain of places). In both lateral and medial VTC, domain-level and category-level structure decreased with cortical depth, and downsampling our data to standard resolution (2.4 mm) did not reverse differences in representations between lateral and medial VTC. The functional diversity of representations across VTC partitions may allow downstream regions to read out information in a flexible manner according to task demands. These results bridge an important gap between electrophysiological recordings in single neurons at the micron scale in nonhuman primates and standard-resolution fMRI in humans by elucidating distributed responses at the submillimeter scale with ultra-high-resolution fMRI in humans.SIGNIFICANCE STATEMENT Visual recognition is a fundamental ability supported by human ventral temporal cortex (VTC). However, the nature of fine-scale, submillimeter distributed representations in VTC is unknown. Using ultra-high-resolution fMRI of human VTC, we found differential distributed visual representations across lateral and medial VTC. Domain representations (e.g., faces, bodies, places, characters) were most salient in lateral VTC, whereas category representations (e.g., corridors/houses within the domain of places) were equally salient in medial VTC. These results bridge an important gap between electrophysiological recordings in single neurons at a micron scale and fMRI measurements at a millimeter scale.

Hormone levels are related to functional compensation in prolactinomas: A resting-state fMRI study.

Prolactinomas are tumors of the pituitary gland, which overproduces prolactin leading to dramatic fluctuations of endogenous hormone levels throughout the body. While it is not fully understood how endogenous hormone disorders affect a patient's brain, it is well known that fluctuating hormone levels can have negative neuropsychological effects. Using resting-state functional magnetic resonance imaging (rs-fMRI), we investigated whole-brain functional connectivity (FC) and its relationship with hormone levels in prolactinomas. By performing seed-based FC analyses, we compared FC metrics between 33 prolactinoma patients and 31 healthy controls matched for age, sex, and hand dominance. We then carried out a partial correlation analysis to examine the relationship between FC metrics and hormone levels. Compared to healthy controls, prolactinoma patients showed significantly increased thalamocortical and cerebellar-cerebral FC. Endogenous hormone levels were also positively correlated with increased FC metrics, and these hormone-FC relationships exhibited sex differences in prolactinoma patients. Our study is the first to reveal altered FC patterns in prolactinomas and to quantify the hormone-FC relationships. These results indicate the importance of endogenous hormones on functional compensation of the brain in patients with prolactinomas.

A visual encoding model based on deep neural networks and transfer learning for brain activity measured by functional magnetic resonance imaging.

BACKGROUND: Building visual encoding models to accurately predict visual responses is a central challenge for current vision-based brain-machine interface techniques. To achieve high prediction accuracy on neural signals, visual encoding models should include precise visual features and appropriate prediction algorithms. Most existing visual encoding models employ hand-craft visual features (e.g., Gabor wavelets or semantic labels) or data-driven features (e.g., features extracted from deep neural networks (DNN)). They also assume a linear mapping between feature representations to brain activity. However, it remains unknown whether such linear mapping is sufficient for maximizing prediction accuracy. NEW METHOD: We construct a new visual encoding framework to predict cortical responses in a benchmark functional magnetic resonance imaging (fMRI) dataset. In this framework, we employ the transfer learning technique to incorporate a pre-trained DNN (i.e., AlexNet) and train a nonlinear mapping from visual features to brain activity. This nonlinear mapping replaces the conventional linear mapping and is supposed to improve prediction accuracy on measured activity in the human visual cortex. RESULTS: The proposed framework can significantly predict responses of over 20% voxels in early visual areas (i.e., V1-lateral occipital region, LO) and achieve unprecedented prediction accuracy. COMPARISON WITH EXISTING METHODS: Comparing to two conventional visual encoding models, we find that the proposed encoding model shows consistent higher prediction accuracy in all early visual areas, especially in relatively anterior visual areas (i.e., V4 and LO). CONCLUSIONS: Our work proposes a new framework to utilize pre-trained visual features and train non-linear mappings from visual features to brain activity.