Time-resolved coupling between connectome harmonics and subjective experience under the psychedelic DMT.

Exploring the intricate relationship between brain's structure and function, and how this affects subjective experience is a fundamental pursuit in neuroscience. Psychedelic substances offer a unique insight into the influences of specific neurotransmitter systems on perception, cognition and consciousness. Specifically, their impact on brain function propagates across the structural connectome - a network of white matter pathways linking different regions. To comprehensively grasp the effects of psychedelic compounds on brain function, we used a theoretically rigorous framework known as connectome harmonic decomposition. This framework provides a robust method to characterize how brain function intricately depends on the organized network structure of the human connectome. We show that the connectome harmonic repertoire under DMT is reshaped in line with other reported psychedelic compounds - psilocybin, LSD and ketamine. Furthermore, we show that the repertoire entropy of connectome harmonics increases under DMT, as with those other psychedelics. Importantly, we demonstrate for the first time that measures of energy spectrum difference and repertoire entropy of connectome harmonics indexes the intensity of subjective experience of the participants in a time-resolved manner reflecting close coupling between connectome harmonics and subjective experience.

The flattening of spacetime hierarchy of the N,N-dimethyltryptamine brain state is characterized by harmonic decomposition of spacetime (HADES) framework.

The human brain is a complex system, whose activity exhibits flexible and continuous reorganization across space and time. The decomposition of whole-brain recordings into harmonic modes has revealed a repertoire of gradient-like activity patterns associated with distinct brain functions. However, the way these activity patterns are expressed over time with their changes in various brain states remains unclear. Here, we investigate healthy participants taking the serotonergic psychedelic N,N-dimethyltryptamine (DMT) with the Harmonic Decomposition of Spacetime (HADES) framework that can characterize how different harmonic modes defined in space are expressed over time. HADES demonstrates significant decreases in contributions across most low-frequency harmonic modes in the DMT-induced brain state. When normalizing the contributions by condition (DMT and non-DMT), we detect a decrease specifically in the second functional harmonic, which represents the uni- to transmodal functional hierarchy of the brain, supporting the leading hypothesis that functional hierarchy is changed in psychedelics. Moreover, HADES' dynamic spacetime measures of fractional occupancy, life time and latent space provide a precise description of the significant changes of the spacetime hierarchical organization of brain activity in the psychedelic state.

Distributed harmonic patterns of structure-function dependence orchestrate human consciousness.

A central question in neuroscience is how consciousness arises from the dynamic interplay of brain structure and function. Here we decompose functional MRI signals from pathological and pharmacologically-induced perturbations of consciousness into distributed patterns of structure-function dependence across scales: the harmonic modes of the human structural connectome. We show that structure-function coupling is a generalisable indicator of consciousness that is under bi-directional neuromodulatory control. We find increased structure-function coupling across scales during loss of consciousness, whether due to anaesthesia or brain injury, capable of discriminating between behaviourally indistinguishable sub-categories of brain-injured patients, tracking the presence of covert consciousness. The opposite harmonic signature characterises the altered state induced by LSD or ketamine, reflecting psychedelic-induced decoupling of brain function from structure and correlating with physiological and subjective scores. Overall, connectome harmonic decomposition reveals how neuromodulation and the network architecture of the human connectome jointly shape consciousness and distributed functional activation across scales.

Correction: Graph neural fields: A framework for spatiotemporal dynamical models on the human connectome.

[This corrects the article DOI: 10.1371/journal.pcbi.1008310.].

Functional harmonics reveal multi-dimensional basis functions underlying cortical organization.

The human brain consists of specialized areas that flexibly interact to form a multitude of functional networks. Complementary to this notion of modular organization, brain function has been shown to vary along a smooth continuum across the whole cortex. We demonstrate a mathematical framework that accounts for both of these perspectives: harmonic modes. We calculate the harmonic modes of the brain's functional connectivity graph, called "functional harmonics," revealing a multi-dimensional, frequency-ordered set of basis functions. Functional harmonics link characteristics of cortical organization across several spatial scales, capturing aspects of intra-areal organizational features (retinotopy, somatotopy), delineating brain areas, and explaining macroscopic functional networks as well as global cortical gradients. Furthermore, we show how the activity patterns elicited by seven different tasks are reconstructed from a very small subset of functional harmonics. Our results suggest that the principle of harmonicity, ubiquitous in nature, also underlies functional cortical organization in the human brain.

Decoding brain states on the intrinsic manifold of human brain dynamics across wakefulness and sleep.

Current state-of-the-art functional magnetic resonance imaging (fMRI) offers remarkable imaging quality and resolution, yet, the intrinsic dimensionality of brain dynamics in different states (wakefulness, light and deep sleep) remains unknown. Here we present a method to reveal the low dimensional intrinsic manifold underlying human brain dynamics, which is invariant of the high dimensional spatio-temporal representation of the neuroimaging technology. By applying this intrinsic manifold framework to fMRI data acquired in wakefulness and sleep, we reveal the nonlinear differences between wakefulness and three different sleep stages, and successfully decode these different brain states with a mean accuracy across participants of 96%. Remarkably, a further group analysis shows that the intrinsic manifolds of all participants share a common topology. Overall, our results reveal the intrinsic manifold underlying the spatiotemporal dynamics of brain activity and demonstrate how this manifold enables the decoding of different brain states such as wakefulness and various sleep stages.

Increased sensitivity to strong perturbations in a whole-brain model of LSD.

Lysergic acid diethylamide (LSD) is a potent psychedelic drug, which has seen a revival in clinical and pharmacological research within recent years. Human neuroimaging studies have shown fundamental changes in brain-wide functional connectivity and an expansion of dynamical brain states, thus raising the question about a mechanistic explanation of the dynamics underlying these alterations. Here, we applied a novel perturbational approach based on a whole-brain computational model, which opens up the possibility to externally perturb different brain regions in silico and investigate differences in dynamical stability of different brain states, i.e. the dynamical response of a certain brain region to an external perturbation. After adjusting the whole-brain model parameters to reflect the dynamics of functional magnetic resonance imaging (fMRI) BOLD signals recorded under the influence of LSD or placebo, perturbations of different brain areas were simulated by either promoting or disrupting synchronization in the regarding brain region. After perturbation offset, we quantified the recovery characteristics of the brain area to its basal dynamical state with the Perturbational Integration Latency Index (PILI) and used this measure to distinguish between the two brain states. We found significant changes in dynamical complexity with consistently higher PILI values after LSD intake on a global level, which indicates a shift of the brain's global working point further away from a stable equilibrium as compared to normal conditions. On a local level, we found that the largest differences were measured within the limbic network, the visual network and the default mode network. Additionally, we found a higher variability of PILI values across different brain regions after LSD intake, indicating higher response diversity under LSD after an external perturbation. Our results provide important new insights into the brain-wide dynamical changes underlying the psychedelic state - here provoked by LSD intake - and underline possible future clinical applications of psychedelic drugs in particular psychiatric disorders.

Graph neural fields: A framework for spatiotemporal dynamical models on the human connectome.

Tools from the field of graph signal processing, in particular the graph Laplacian operator, have recently been successfully applied to the investigation of structure-function relationships in the human brain. The eigenvectors of the human connectome graph Laplacian, dubbed "connectome harmonics", have been shown to relate to the functionally relevant resting-state networks. Whole-brain modelling of brain activity combines structural connectivity with local dynamical models to provide insight into the large-scale functional organization of the human brain. In this study, we employ the graph Laplacian and its properties to define and implement a large class of neural activity models directly on the human connectome. These models, consisting of systems of stochastic integrodifferential equations on graphs, are dubbed graph neural fields, in analogy with the well-established continuous neural fields. We obtain analytic predictions for harmonic and temporal power spectra, as well as functional connectivity and coherence matrices, of graph neural fields, with a technique dubbed CHAOSS (shorthand for Connectome-Harmonic Analysis Of Spatiotemporal Spectra). Combining graph neural fields with appropriate observation models allows for estimating model parameters from experimental data as obtained from electroencephalography (EEG), magnetoencephalography (MEG), or functional magnetic resonance imaging (fMRI). As an example application, we study a stochastic Wilson-Cowan graph neural field model on a high-resolution connectome graph constructed from diffusion tensor imaging (DTI) and structural MRI data. We show that the model equilibrium fluctuations can reproduce the empirically observed harmonic power spectrum of resting-state fMRI data, and predict its functional connectivity, with a high level of detail. Graph neural fields natively allow the inclusion of important features of cortical anatomy and fast computations of observable quantities for comparison with multimodal empirical data. They thus appear particularly suitable for modelling whole-brain activity at mesoscopic scales, and opening new potential avenues for connectome-graph-based investigations of structure-function relationships.

Robustness of connectome harmonics to local gray matter and long-range white matter connectivity changes.

Recently, it has been proposed that the harmonic patterns emerging from the brain's structural connectivity underlie the resting state networks of the human brain. These harmonic patterns, termed connectome harmonics, are estimated as the Laplace eigenfunctions of the combined gray and white matters connectivity matrices and yield a connectome-specific extension of the well-known Fourier basis. However, it remains unclear how topological properties of the combined connectomes constrain the precise shape of the connectome harmonics and their relationships to the resting state networks. Here, we systematically study how alterations of the local and long-range connectivity matrices affect the spatial patterns of connectome harmonics. Specifically, the proportion of local gray matter homogeneous connectivity versus long-range white-matter heterogeneous connectivity is varied by means of weight-based matrix thresholding, distance-based matrix trimming, and several types of matrix randomizations. We demonstrate that the proportion of local gray matter connections plays a crucial role for the emergence of wide-spread, functionally meaningful, and originally published connectome harmonic patterns. This finding is robust for several different cortical surface templates, mesh resolutions, or widths of the local diffusion kernel. Finally, using the connectome harmonic framework, we also provide a proof-of-concept for how targeted structural changes such as the atrophy of inter-hemispheric callosal fibers and gray matter alterations may predict functional deficits associated with neurodegenerative conditions.

Characterizing the Dynamical Complexity Underlying Meditation.

Over the past 2,500 years, contemplative traditions have explored the nature of the mind using meditation. More recently, neuroimaging research on meditation has revealed differences in brain function and structure in meditators. Nevertheless, the underlying neural mechanisms are still unclear. In order to understand how meditation shapes global activity through the brain, we investigated the spatiotemporal dynamics across the whole-brain functional network using the Intrinsic Ignition Framework. Recent neuroimaging studies have demonstrated that different states of consciousness differ in their underlying dynamical complexity, i.e., how the broadness of communication is elicited and distributed through the brain over time and space. In this work, controls and experienced meditators were scanned using functional magnetic resonance imaging (fMRI) during resting-state and meditation (focused attention on breathing). Our results evidenced that the dynamical complexity underlying meditation shows less complexity than during resting-state in the meditator group but not in the control group. Furthermore, we report that during resting-state, the brain activity of experienced meditators showed higher metastability (i.e., a wider dynamical regime over time) than the one observed in the control group. Overall, these results indicate that the meditation state operates in a different dynamical regime compared to the resting-state.

Dynamical exploration of the repertoire of brain networks at rest is modulated by psilocybin.

Growing evidence from the dynamical analysis of functional neuroimaging data suggests that brain function can be understood as the exploration of a repertoire of metastable connectivity patterns ('functional brain networks'), which potentially underlie different mental processes. The present study characterizes how the brain's dynamical exploration of resting-state networks is rapidly modulated by intravenous infusion of psilocybin, a tryptamine psychedelic found in "magic mushrooms". We employed a data-driven approach to characterize recurrent functional connectivity patterns by focusing on the leading eigenvector of BOLD phase coherence at single-TR resolution. Recurrent BOLD phase-locking patterns (PL states) were assessed and statistically compared pre- and post-infusion of psilocybin in terms of their probability of occurrence and transition profiles. Results were validated using a placebo session. Recurrent BOLD PL states revealed high spatial overlap with canonical resting-state networks. Notably, a PL state forming a frontoparietal subsystem was strongly destabilized after psilocybin injection, with a concomitant increase in the probability of occurrence of another PL state characterized by global BOLD phase coherence. These findings provide evidence of network-specific neuromodulation by psilocybin and represent one of the first attempts at bridging molecular pharmacodynamics and whole-brain network dynamics.

Common neural signatures of psychedelics: Frequency-specific energy changes and repertoire expansion revealed using connectome-harmonic decomposition.

The search for the universal laws of human brain function is still on-going but progress is being made. Here we describe the novel concepts of connectome harmonics and connectome-harmonic decomposition, which can be used to characterize the brain activity associated with any mental state. We use this new frequency-specific language to describe the brain activity elicited by psilocybin and LSD and find remarkably similar effects in terms of increases in total energy and power, as well as frequency-specific energy changes and repertoire expansion. In addition, we find enhanced signatures of criticality suggesting that the brain dynamics tune toward criticality in both psychedelic elicited states. Overall, our findings provide new evidence for the remarkable ability of psychedelics to change the spatiotemporal dynamics of the human brain.

Harmonic Brain Modes: A Unifying Framework for Linking Space and Time in Brain Dynamics.

A fundamental characteristic of spontaneous brain activity is coherent oscillations covering a wide range of frequencies. Interestingly, these temporal oscillations are highly correlated among spatially distributed cortical areas forming structured correlation patterns known as the resting state networks, although the brain is never truly at "rest." Here, we introduce the concept of harmonic brain modes-fundamental building blocks of complex spatiotemporal patterns of neural activity. We define these elementary harmonic brain modes as harmonic modes of structural connectivity; that is, connectome harmonics, yielding fully synchronous neural activity patterns with different frequency oscillations emerging on and constrained by the particular structure of the brain. Hence, this particular definition implicitly links the hitherto poorly understood dimensions of space and time in brain dynamics and its underlying anatomy. Further we show how harmonic brain modes can explain the relationship between neurophysiological, temporal, and network-level changes in the brain across different mental states ( wakefulness, sleep, anesthesia, psychedelic). Notably, when decoded as activation of connectome harmonics, spatial and temporal characteristics of neural activity naturally emerge from the interplay between excitation and inhibition and this critical relation fits the spatial, temporal, and neurophysiological changes associated with different mental states. Thus, the introduced framework of harmonic brain modes not only establishes a relation between the spatial structure of correlation patterns and temporal oscillations (linking space and time in brain dynamics), but also enables a new dimension of tools for understanding fundamental principles underlying brain dynamics in different states of consciousness.

Connectome-harmonic decomposition of human brain activity reveals dynamical repertoire re-organization under LSD.

Recent studies have started to elucidate the effects of lysergic acid diethylamide (LSD) on the human brain but the underlying dynamics are not yet fully understood. Here we used 'connectome-harmonic decomposition', a novel method to investigate the dynamical changes in brain states. We found that LSD alters the energy and the power of individual harmonic brain states in a frequency-selective manner. Remarkably, this leads to an expansion of the repertoire of active brain states, suggestive of a general re-organization of brain dynamics given the non-random increase in co-activation across frequencies. Interestingly, the frequency distribution of the active repertoire of brain states under LSD closely follows power-laws indicating a re-organization of the dynamics at the edge of criticality. Beyond the present findings, these methods open up for a better understanding of the complex brain dynamics in health and disease.

Human brain networks function in connectome-specific harmonic waves.

A key characteristic of human brain activity is coherent, spatially distributed oscillations forming behaviour-dependent brain networks. However, a fundamental principle underlying these networks remains unknown. Here we report that functional networks of the human brain are predicted by harmonic patterns, ubiquitous throughout nature, steered by the anatomy of the human cerebral cortex, the human connectome. We introduce a new technique extending the Fourier basis to the human connectome. In this new frequency-specific representation of cortical activity, that we call 'connectome harmonics', oscillatory networks of the human brain at rest match harmonic wave patterns of certain frequencies. We demonstrate a neural mechanism behind the self-organization of connectome harmonics with a continuous neural field model of excitatory-inhibitory interactions on the connectome. Remarkably, the critical relation between the neural field patterns and the delicate excitation-inhibition balance fits the neurophysiological changes observed during the loss and recovery of consciousness.

Endoscopic video manifolds for targeted optical biopsy.

Gastro-intestinal (GI) endoscopy is a widely used clinical procedure for screening and surveillance of digestive tract diseases ranging from Barrett's Oesophagus to oesophageal cancer. Current surveillance protocol consists of periodic endoscopic examinations performed in 3-4 month intervals including expert's visual assessment and biopsies taken from suspicious tissue regions. Recent development of a new imaging technology, called probe-based confocal laser endomicroscopy (pCLE), enabled the acquisition of in vivo optical biopsies without removing any tissue sample. Besides its several advantages, i.e., noninvasiveness, real-time and in vivo feedback, optical biopsies involve a new challenge for the endoscopic expert. Due to their noninvasive nature, optical biopsies do not leave any scar on the tissue and therefore recognition of the previous optical biopsy sites in surveillance endoscopy becomes very challenging. In this work, we introduce a clustering and classification framework to facilitate retargeting previous optical biopsy sites in surveillance upper GI-endoscopies. A new representation of endoscopic videos based on manifold learning, "endoscopic video manifolds" (EVMs), is proposed. The low dimensional EVM representation is adapted to facilitate two different clustering tasks; i.e., clustering of informative frames and patient specific endoscopic segments, only by changing the similarity measure. Each step of the proposed framework is validated on three in vivo patient datasets containing 1834, 3445, and 1546 frames, corresponding to endoscopic videos of 73.36, 137.80, and 61.84 s, respectively. Improvements achieved by the introduced EVM representation are demonstrated by quantitative analysis in comparison to the original image representation and principal component analysis. Final experiments evaluating the complete framework demonstrate the feasibility of the proposed method as a promising step for assisting the endoscopic expert in retargeting the optical biopsy sites.

Targeted optical biopsies for surveillance endoscopies.

Recent introduction of probe-based confocal laser endomicroscopy (pCLE) allowed for the acquisition of in-vivo optical biopsies during the endoscopic examination without removing any tissue sample. The non-invasive nature of the optical biopsies makes the re-targeting of previous biopsy sites in surveillance examinations difficult due to the absence of scars or surface landmarks. In this work, we introduce a new method for recognition of optical biopsy scenes of the diagnosis endoscopy during serial surveillance examinations. To this end, together with our clinical partners, we propose a new workflow involving two-run surveillance endoscopies to reduce the ill-posedness of the task. In the first run, the endoscope is guided from the mouth to the z-line (junction from the oesophagus to the stomach). Our method relies on clustering the frames of the diagnosis and the first run surveillance (S1) endoscopy into several scenes and establishing cluster correspondences accross these videos. During the second run surveillance (S2), the scene recognition is performed in real-time and in-vivo based on the cluster correspondences. Detailed experimental results demonstrate the feasibility of the proposed approach with 89.75% recall and 80.91% precision on 3 patient datasets.

Endoscopic video manifolds.

Postprocedural analysis of gastrointestinal (GI) endoscopic videos is a difficult task because the videos often suffer from a large number of poor-quality frames due to the motion or out-of-focus blur, specular highlights and artefacts caused by turbid fluid inside the GI tract. Clinically, each frame of the video is examined individually by the endoscopic expert due to the lack of a suitable visualisation technique. In this work, we introduce a low dimensional representation of endoscopic videos based on a manifold learning approach. The introduced endoscopic video manifolds (EVMs) enable the clustering of poor-quality frames and grouping of different segments of the GI endoscopic video in an unsupervised manner to facilitate subsequent visual assessment. In this paper, we present two novel inter-frame similarity measures for manifold learning to create structured manifolds from complex endoscopic videos. Our experiments demonstrate that the proposed method yields high precision and recall values for uninformative frame detection (90.91% and 82.90%) and results in well-structured manifolds for scene clustering.