Finding structure during incremental speech comprehension.

A core aspect of human speech comprehension is the ability to incrementally integrate consecutive words into a structured and coherent interpretation, aligning with the speaker's intended meaning. This rapid process is subject to multidimensional probabilistic constraints, including both linguistic knowledge and non-linguistic information within specific contexts, and it is their interpretative coherence that drives successful comprehension. To study the neural substrates of this process, we extract word-by-word measures of sentential structure from BERT, a deep language model, which effectively approximates the coherent outcomes of the dynamic interplay among various types of constraints. Using representational similarity analysis, we tested BERT parse depths and relevant corpus-based measures against the spatiotemporally resolved brain activity recorded by electro-/magnetoencephalography when participants were listening to the same sentences. Our results provide a detailed picture of the neurobiological processes involved in the incremental construction of structured interpretations. These findings show when and where coherent interpretations emerge through the evaluation and integration of multifaceted constraints in the brain, which engages bilateral brain regions extending beyond the classical fronto-temporal language system. Furthermore, this study provides empirical evidence supporting the use of artificial neural networks as computational models for revealing the neural dynamics underpinning complex cognitive processes in the brain.

Recurrent connectivity supports higher-level visual and semantic object representations in the brain.

Visual object recognition has been traditionally conceptualised as a predominantly feedforward process through the ventral visual pathway. While feedforward artificial neural networks (ANNs) can achieve human-level classification on some image-labelling tasks, it's unclear whether computational models of vision alone can accurately capture the evolving spatiotemporal neural dynamics. Here, we probe these dynamics using a combination of representational similarity and connectivity analyses of fMRI and MEG data recorded during the recognition of familiar, unambiguous objects. Modelling the visual and semantic properties of our stimuli using an artificial neural network as well as a semantic feature model, we find that unique aspects of the neural architecture and connectivity dynamics relate to visual and semantic object properties. Critically, we show that recurrent processing between the anterior and posterior ventral temporal cortex relates to higher-level visual properties prior to semantic object properties, in addition to semantic-related feedback from the frontal lobe to the ventral temporal lobe between 250 and 500 ms after stimulus onset. These results demonstrate the distinct contributions made by semantic object properties in explaining neural activity and connectivity, highlighting it as a core part of object recognition not fully accounted for by current biologically inspired neural networks.

Cognition's dependence on functional network integrity with age is conditional on structural network integrity.

Maintaining good cognitive function is crucial for well-being across the lifespan. We proposed that the degree of cognitive maintenance is determined by the functional interactions within and between large-scale brain networks. Such connectivity can be represented by the white matter architecture of structural brain networks that shape intrinsic neuronal activity into integrated and distributed functional networks. We explored how the function-structure connectivity convergence, and the divergence of functional connectivity from structural connectivity, contribute to the maintenance of cognitive function across the adult lifespan. Multivariate analyses were used to investigate the relationship between function-structure connectivity convergence and divergence with multivariate cognitive profiles, respectively. Cognitive function was increasingly dependent on function-structure connectivity convergence as age increased. The dependency of cognitive function on connectivity was particularly strong for high-order cortical networks and subcortical networks. The results suggest that brain functional network integrity sustains cognitive functions in old age, as a function of the integrity of the brain's structural connectivity.

Distinct components of cardiovascular health are linked with age-related differences in cognitive abilities.

Cardiovascular ageing contributes to cognitive impairment. However, the unique and synergistic contributions of multiple cardiovascular factors to cognitive function remain unclear because they are often condensed into a single composite score or examined in isolation. We hypothesized that vascular risk factors, electrocardiographic features and blood pressure indices reveal multiple latent vascular factors, with independent contributions to cognition. In a population-based deep-phenotyping study (n = 708, age 18-88), path analysis revealed three latent vascular factors dissociating the autonomic nervous system response from two components of blood pressure. These three factors made unique and additive contributions to the variability in crystallized and fluid intelligence. The discrepancy in fluid relative to crystallized intelligence, indicative of cognitive decline, was associated with a latent vascular factor predominantly expressing pulse pressure. This suggests that higher pulse pressure is associated with cognitive decline from expected performance. The effect was stronger in older adults. Controlling pulse pressure may help to preserve cognition, particularly in older adults. Our findings highlight the need to better understand the multifactorial nature of vascular aging.

Cerebral blood flow predicts multiple demand network activity and fluid intelligence across the adult lifespan.

The preservation of cognitive function in old age is a public health priority. Cerebral hypoperfusion is a hallmark of dementia but its impact on maintaining cognitive ability across the lifespan is less clear. We investigated the relationship between baseline cerebral blood flow (CBF) and blood oxygenation level-dependent (BOLD) response during a fluid reasoning task in a population-based adult lifespan cohort. As age differences in CBF could lead to non-neuronal contributions to the BOLD signal, we introduced commonality analysis to neuroimaging to dissociate performance-related CBF effects from the physiological confounding effects of CBF on the BOLD response. Accounting for CBF, we confirmed that performance- and age-related differences in BOLD responses in the multiple-demand network were implicated in fluid reasoning. Age differences in CBF explained not only performance-related BOLD responses but also performance-independent BOLD responses. Our results suggest that CBF is important for maintaining cognitive function, while its non-neuronal contributions to BOLD signals reflect an age-related confound. Maintaining perfusion into old age may serve to support brain function and preserve cognitive performance.

Multimodal fusion analysis of functional, cerebrovascular and structural neuroimaging in healthy aging subjects.

Brain aging is a complex process that requires a multimodal approach. Neuroimaging can provide insights into brain morphology, functional organization, and vascular dynamics. However, most neuroimaging studies of aging have focused on each imaging modality separately, limiting the understanding of interrelations between processes identified by different modalities and their relevance to cognitive decline in aging. Here, we used a data-driven multimodal approach, linked independent component analysis (ICA), to jointly analyze magnetic resonance imaging (MRI) of grey matter volume, cerebrovascular, and functional network topographies in relation to measures of fluid intelligence. Neuroimaging and cognitive data from the Cambridge Centre for Ageing and Neuroscience study were used, with healthy participants aged 18-88 years (main dataset n = 215 and secondary dataset n = 433). Using linked ICA, functional network activities were characterized in independent components but not captured in the same component as structural and cerebrovascular patterns. Split-sample (n = 108/107) and out-of-sample (n = 433) validation analyses using linked ICA were also performed. Global grey matter volume with regional cerebrovascular changes and the right frontoparietal network activity were correlated with age-related and individual differences in fluid intelligence. This study presents the insights from linked ICA to bring together measurements from multiple imaging modalities, with independent and additive information. We propose that integrating multiple neuroimaging modalities allows better characterization of brain pattern variability and changes associated with healthy aging.

Decoding the Real-Time Neurobiological Properties of Incremental Semantic Interpretation.

Communication through spoken language is a central human capacity, involving a wide range of complex computations that incrementally interpret each word into meaningful sentences. However, surprisingly little is known about the spatiotemporal properties of the complex neurobiological systems that support these dynamic predictive and integrative computations. Here, we focus on prediction, a core incremental processing operation guiding the interpretation of each upcoming word with respect to its preceding context. To investigate the neurobiological basis of how semantic constraints change and evolve as each word in a sentence accumulates over time, in a spoken sentence comprehension study, we analyzed the multivariate patterns of neural activity recorded by source-localized electro/magnetoencephalography (EMEG), using computational models capturing semantic constraints derived from the prior context on each upcoming word. Our results provide insights into predictive operations subserved by different regions within a bi-hemispheric system, which over time generate, refine, and evaluate constraints on each word as it is heard.

The effects of age on resting-state BOLD signal variability is explained by cardiovascular and cerebrovascular factors.

Accurate identification of brain function is necessary to understand neurocognitive aging, and thereby promote health and well-being. Many studies of neurocognitive aging have investigated brain function with the blood-oxygen level-dependent (BOLD) signal measured by functional magnetic resonance imaging. However, the BOLD signal is a composite of neural and vascular signals, which are differentially affected by aging. It is, therefore, essential to distinguish the age effects on vascular versus neural function. The BOLD signal variability at rest (known as resting state fluctuation amplitude, RSFA), is a safe, scalable, and robust means to calibrate vascular responsivity, as an alternative to breath-holding and hypercapnia. However, the use of RSFA for normalization of BOLD imaging assumes that age differences in RSFA reflecting only vascular factors, rather than age-related differences in neural function (activity) or neuronal loss (atrophy). Previous studies indicate that two vascular factors, cardiovascular health (CVH) and cerebrovascular function, are insufficient when used alone to fully explain age-related differences in RSFA. It remains possible that their joint consideration is required to fully capture age differences in RSFA. We tested the hypothesis that RSFA no longer varies with age after adjusting for a combination of cardiovascular and cerebrovascular measures. We also tested the hypothesis that RSFA variation with age is not associated with atrophy. We used data from the population-based, lifespan Cam-CAN cohort. After controlling for cardiovascular and cerebrovascular estimates alone, the residual variance in RSFA across individuals was significantly associated with age. However, when controlling for both cardiovascular and cerebrovascular estimates, the variance in RSFA was no longer associated with age. Grey matter volumes did not explain age differences in RSFA, after controlling for CVH. The results were consistent between voxel-level analysis and independent component analysis. Our findings indicate that cardiovascular and cerebrovascular signals are together sufficient predictors of age differences in RSFA. We suggest that RSFA can be used to separate vascular from neuronal factors, to characterize neurocognitive aging. We discuss the implications and make recommendations for the use of RSFA in the research of aging.

Physical Activity Predicts Population-Level Age-Related Differences in Frontal White Matter.

Physical activity has positive effects on brain health and cognitive function throughout the life span. Thus far, few studies have examined the effects of physical activity on white matter microstructure and psychomotor speed within the same, population-based sample (critical if conclusions are to extend to the wider population). Here, using diffusion tensor imaging and a simple reaction time task within a relatively large population-derived sample (N = 399; 18-87 years) from the Cambridge Centre for Ageing and Neuroscience (Cam-CAN), we demonstrate that physical activity mediates the effect of age on white matter integrity, measured with fractional anisotropy. Higher self-reported daily physical activity was associated with greater preservation of white matter in several frontal tracts, including the genu of corpus callosum, uncinate fasciculus, external capsule, and anterior limb of the internal capsule. We also show that the age-related slowing is mediated by white matter integrity in the genu. Our findings contribute to a growing body of work, suggesting that a physically active lifestyle may protect against age-related structural disconnection and slowing.

Cognitive Diversity in a Healthy Aging Cohort: Cross-Domain Cognition in the Cam-CAN Project.

Objective: Studies of "healthy" cognitive aging often focus on a limited set of measures that decline with age. The current study argues that defining and supporting healthy cognition requires understanding diverse cognitive performance across the lifespan. Method: Data from the Cambridge Centre for Aging and Neuroscience (Cam-CAN) cohort was examined across a range of cognitive domains. Performance was related to lifestyle including education, social engagement, and enrichment activities. Results: Results indicate variable relationships between cognition and age (positive, negative, or no relationship). Principal components analysis indicated maintained cognitive diversity across the adult lifespan, and that cognition-lifestyle relationships differed by age and domain. Discussion: Our findings support a view of normal cognitive aging as a lifelong developmental process with diverse relationships between cognition, lifestyle, and age. This reinforces the need for large-scale studies of cognitive aging to include a wider range of both ages and cognitive tasks.

Neural dynamics of semantic composition.

Human speech comprehension is remarkable for its immediacy and rapidity. The listener interprets an incrementally delivered auditory input, millisecond by millisecond as it is heard, in terms of complex multilevel representations of relevant linguistic and nonlinguistic knowledge. Central to this process are the neural computations involved in semantic combination, whereby the meanings of words are combined into more complex representations, as in the combination of a verb and its following direct object (DO) noun (e.g., "eat the apple"). These combinatorial processes form the backbone for incremental interpretation, enabling listeners to integrate the meaning of each word as it is heard into their dynamic interpretation of the current utterance. Focusing on the verb-DO noun relationship in simple spoken sentences, we applied multivariate pattern analysis and computational semantic modeling to source-localized electro/magnetoencephalographic data to map out the specific representational constraints that are constructed as each word is heard, and to determine how these constraints guide the interpretation of subsequent words in the utterance. Comparing context-independent semantic models of the DO noun with contextually constrained noun models reflecting the semantic properties of the preceding verb, we found that only the contextually constrained model showed a significant fit to the brain data. Pattern-based measures of directed connectivity across the left hemisphere language network revealed a continuous information flow among temporal, inferior frontal, and inferior parietal regions, underpinning the verb's modification of the DO noun's activated semantics. These results provide a plausible neural substrate for seamless real-time incremental interpretation on the observed millisecond time scales.

Perceptual and conceptual processing of visual objects across the adult lifespan.

Making sense of the external world is vital for multiple domains of cognition, and so it is crucial that object recognition is maintained across the lifespan. We investigated age differences in perceptual and conceptual processing of visual objects in a population-derived sample of 85 healthy adults (24-87 years old) by relating measures of object processing to cognition across the lifespan. Magnetoencephalography (MEG) was recorded during a picture naming task to provide a direct measure of neural activity, that is not confounded by age-related vascular changes. Multiple linear regression was used to estimate neural responsivity for each individual, namely the capacity to represent visual or semantic information relating to the pictures. We find that the capacity to represent semantic information is linked to higher naming accuracy, a measure of task-specific performance. In mature adults, the capacity to represent semantic information also correlated with higher levels of fluid intelligence, reflecting domain-general performance. In contrast, the latency of visual processing did not relate to measures of cognition. These results indicate that neural responsivity measures relate to naming accuracy and fluid intelligence. We propose that maintaining neural responsivity in older age confers benefits in task-related and domain-general cognitive processes, supporting the brain maintenance view of healthy cognitive ageing.

Balancing Prediction and Sensory Input in Speech Comprehension: The Spatiotemporal Dynamics of Word Recognition in Context.

Spoken word recognition in context is remarkably fast and accurate, with recognition times of ∼200 ms, typically well before the end of the word. The neurocomputational mechanisms underlying these contextual effects are still poorly understood. This study combines source-localized electroencephalographic and magnetoencephalographic (EMEG) measures of real-time brain activity with multivariate representational similarity analysis to determine directly the timing and computational content of the processes evoked as spoken words are heard in context, and to evaluate the respective roles of bottom-up and predictive processing mechanisms in the integration of sensory and contextual constraints. Male and female human participants heard simple (modifier-noun) English phrases that varied in the degree of semantic constraint that the modifier (W1) exerted on the noun (W2), as in pairs, such as "yellow banana." We used gating tasks to generate estimates of the probabilistic predictions generated by these constraints as well as measures of their interaction with the bottom-up perceptual input for W2. Representation similarity analysis models of these measures were tested against electroencephalographic and magnetoencephalographic brain data across a bilateral fronto-temporo-parietal language network. Consistent with probabilistic predictive processing accounts, we found early activation of semantic constraints in frontal cortex (LBA45) as W1 was heard. The effects of these constraints (at 100 ms after W2 onset in left middle temporal gyrus and at 140 ms in left Heschl's gyrus) were only detectable, however, after the initial phonemes of W2 had been heard. Within an overall predictive processing framework, bottom-up sensory inputs are still required to achieve early and robust spoken word recognition in context.SIGNIFICANCE STATEMENT Human listeners recognize spoken words in natural speech contexts with remarkable speed and accuracy, often identifying a word well before all of it has been heard. In this study, we investigate the brain systems that support this important capacity, using neuroimaging techniques that can track real-time brain activity during speech comprehension. This makes it possible to locate the brain areas that generate predictions about upcoming words and to show how these expectations are integrated with the evidence provided by the speech being heard. We use the timing and localization of these effects to provide the most specific account to date of how the brain achieves an optimal balance between prediction and sensory input in the interpretation of spoken language.

Oscillatory Dynamics of Perceptual to Conceptual Transformations in the Ventral Visual Pathway.

Object recognition requires dynamic transformations of low-level visual inputs to complex semantic representations. Although this process depends on the ventral visual pathway, we lack an incremental account from low-level inputs to semantic representations and the mechanistic details of these dynamics. Here we combine computational models of vision with semantics and test the output of the incremental model against patterns of neural oscillations recorded with magnetoencephalography in humans. Representational similarity analysis showed visual information was represented in low-frequency activity throughout the ventral visual pathway, and semantic information was represented in theta activity. Furthermore, directed connectivity showed visual information travels through feedforward connections, whereas visual information is transformed into semantic representations through feedforward and feedback activity, centered on the anterior temporal lobe. Our research highlights that the complex transformations between visual and semantic information is driven by feedforward and recurrent dynamics resulting in object-specific semantics.

Integrated deep visual and semantic attractor neural networks predict fMRI pattern-information along the ventral object processing pathway.

Recognising an object involves rapid visual processing and activation of semantic knowledge about the object, but how visual processing activates and interacts with semantic representations remains unclear. Cognitive neuroscience research has shown that while visual processing involves posterior regions along the ventral stream, object meaning involves more anterior regions, especially perirhinal cortex. Here we investigate visuo-semantic processing by combining a deep neural network model of vision with an attractor network model of semantics, such that visual information maps onto object meanings represented as activation patterns across features. In the combined model, concept activation is driven by visual input and co-occurrence of semantic features, consistent with neurocognitive accounts. We tested the model's ability to explain fMRI data where participants named objects. Visual layers explained activation patterns in early visual cortex, whereas pattern-information in perirhinal cortex was best explained by later stages of the attractor network, when detailed semantic representations are activated. Posterior ventral temporal cortex was best explained by intermediate stages corresponding to initial semantic processing, when visual information has the greatest influence on the emerging semantic representation. These results provide proof of principle of how a mechanistic model of combined visuo-semantic processing can account for pattern-information in the ventral stream.

Language-related domain-specific and domain-general systems in the human brain.

While a long history of neuropsychological research places language function within a primarily left-lateralized frontotemporal system, recent neuroimaging work has extended this language network to include a number of regions traditionally thought of as 'domain-general'. These include dorsal frontal, parietal, and medial temporal lobe regions known to underpin cognitive functions such as attention and memory. In this paper, we argue that these domain-general systems are not required for language processing and are instead an artefact of the tasks typically used to study language. Recent work from our lab shows that when syntactic processing - arguably the only domain-specific language function - is measured in a task-free, naturalistic manner, only the left-lateralized frontotemporal syntax system and auditory network are activated. When syntax is measured within the context of a task, several other domain-general networks come online and are functionally connected to the frontotemporal system. While we have long argued that syntactic processing does not occur in isolation but is processed in parallel with semantics and pragmatics - functions of the wider language system - our recent work makes a strong case for the domain-specificity of the frontotemporal syntax system and its autonomy from domain-general networks.

Activity and Connectivity Differences Underlying Inhibitory Control Across the Adult Life Span.

Inhibitory control requires precise regulation of activity and connectivity within multiple brain networks. Previous studies have typically evaluated age-related changes in regional activity or changes in interregional interactions. Instead, we test the hypothesis that activity and connectivity make distinct, complementary contributions to performance across the life span and the maintenance of successful inhibitory control systems. A representative sample of healthy human adults in a large, population-based life span cohort performed an integrated Stop-Signal (SS)/No-Go task during functional magnetic resonance imaging (n = 119; age range, 18-88 years). Individual differences in inhibitory control were measured in terms of the SS reaction time (SSRT), using the blocked integration method. Linear models and independent components analysis revealed that individual differences in SSRT correlated with both activity and connectivity in a distributed inhibition network, comprising prefrontal, premotor, and motor regions. Importantly, this pattern was moderated by age, such that the association between inhibitory control and connectivity, but not activity, differed with age. Multivariate statistics and out-of-sample validation tests of multifactorial functional organization identified differential roles of activity and connectivity in determining an individual's SSRT across the life span. We propose that age-related differences in adaptive cognitive control are best characterized by the joint consideration of multifocal activity and connectivity within distributed brain networks. These insights may facilitate the development of new strategies to support cognitive ability in old age.SIGNIFICANCE STATEMENT The preservation of cognitive and motor control is crucial for maintaining well being across the life span. We show that such control is determined by both activity and connectivity within distributed brain networks. In a large, population-based cohort, we used a novel whole-brain multivariate approach to estimate the functional components of inhibitory control, in terms of their activity and connectivity. Both activity and connectivity in the inhibition network changed with age. But only the association between performance and connectivity, not activity, differed with age. The results suggest that adaptive control is best characterized by the joint consideration of multifocal activity and connectivity. These insights may facilitate the development of new strategies to maintain cognitive ability across the life span in health and disease.

Healthy minds 0-100 years: Optimising the use of European brain imaging cohorts ("Lifebrain").

The main objective of "Lifebrain" is to identify the determinants of brain, cognitive and mental (BCM) health at different stages of life. By integrating, harmonising and enriching major European neuroimaging studies across the life span, we will merge fine-grained BCM health measures of more than 5000 individuals. Longitudinal brain imaging, genetic and health data are available for a major part, as well as cognitive and mental health measures for the broader cohorts, exceeding 27,000 examinations in total. By linking these data to other databases and biobanks, including birth registries, national and regional archives, and by enriching them with a new online data collection and novel measures, we will address the risk factors and protective factors of BCM health. We will identify pathways through which risk and protective factors work and their moderators. Exploiting existing European infrastructures and initiatives, we hope to make major conceptual, methodological and analytical contributions towards large integrative cohorts and their efficient exploitation. We will thus provide novel information on BCM health maintenance, as well as the onset and course of BCM disorders. This will lay a foundation for earlier diagnosis of brain disorders, aberrant development and decline of BCM health, and translate into future preventive and therapeutic strategies. Aiming to improve clinical practice and public health we will work with stakeholders and health authorities, and thus provide the evidence base for prevention and intervention.

Preserved cognitive functions with age are determined by domain-dependent shifts in network responsivity.

Healthy ageing has disparate effects on different cognitive domains. The neural basis of these differences, however, is largely unknown. We investigated this question by using Independent Components Analysis to obtain functional brain components from 98 healthy participants aged 23-87 years from the population-based Cam-CAN cohort. Participants performed two cognitive tasks that show age-related decrease (fluid intelligence and object naming) and a syntactic comprehension task that shows age-related preservation. We report that activation of task-positive neural components predicts inter-individual differences in performance in each task across the adult lifespan. Furthermore, only the two tasks that show performance declines with age show age-related decreases in task-positive activation of neural components and decreasing default mode (DM) suppression. Our results suggest that distributed, multi-component brain responsivity supports cognition across the adult lifespan, and the maintenance of this, along with maintained DM deactivation, characterizes successful ageing and may explain differential ageing trajectories across cognitive domains.