Data-driven multiscale model of macaque auditory thalamocortical circuits reproduces in vivo dynamics.

We developed a detailed model of macaque auditory thalamocortical circuits, including primary auditory cortex (A1), medial geniculate body (MGB), and thalamic reticular nucleus, utilizing the NEURON simulator and NetPyNE tool. The A1 model simulates a cortical column with over 12,000 neurons and 25 million synapses, incorporating data on cell-type-specific neuron densities, morphology, and connectivity across six cortical layers. It is reciprocally connected to the MGB thalamus, which includes interneurons and core and matrix-layer-specific projections to A1. The model simulates multiscale measures, including physiological firing rates, local field potentials (LFPs), current source densities (CSDs), and electroencephalography (EEG) signals. Laminar CSD patterns, during spontaneous activity and in response to broadband noise stimulus trains, mirror experimental findings. Physiological oscillations emerge spontaneously across frequency bands comparable to those recorded in vivo. We elucidate population-specific contributions to observed oscillation events and relate them to firing and presynaptic input patterns. The model offers a quantitative theoretical framework to integrate and interpret experimental data and predict its underlying cellular and circuit mechanisms.

Dissociation of Centrally and Peripherally Induced Transcranial Magnetic Stimulation Effects in Nonhuman Primates.

Transcranial magnetic stimulation (TMS) is a noninvasive brain stimulation method that is rapidly growing in popularity for studying causal brain-behavior relationships. However, its dose-dependent centrally induced neural mechanisms and peripherally induced sensory costimulation effects remain debated. Understanding how TMS stimulation parameters affect brain responses is vital for the rational design of TMS protocols. Studying these mechanisms in humans is challenging because of the limited spatiotemporal resolution of available noninvasive neuroimaging methods. Here, we leverage invasive recordings of local field potentials in a male and a female nonhuman primate (rhesus macaque) to study TMS mesoscale responses. We demonstrate that early TMS-evoked potentials show a sigmoidal dose-response curve with stimulation intensity. We further show that stimulation responses are spatially specific. We use several control conditions to dissociate centrally induced neural responses from auditory and somatosensory coactivation. These results provide crucial evidence regarding TMS neural effects at the brain circuit level. Our findings are highly relevant for interpreting human TMS studies and biomarker developments for TMS target engagement in clinical applications.SIGNIFICANCE STATEMENT Transcranial magnetic stimulation (TMS) is a widely used noninvasive brain stimulation method to stimulate the human brain. To advance its utility for clinical applications, a clear understanding of its underlying physiological mechanisms is crucial. Here, we perform invasive electrophysiological recordings in the nonhuman primate brain during TMS, achieving a spatiotemporal precision not available in human EEG experiments. We find that evoked potentials are dose dependent and spatially specific, and can be separated from peripheral stimulation effects. This means that TMS-evoked responses can indicate a direct physiological stimulation response. Our work has important implications for the interpretation of human TMS-EEG recordings and biomarker development.

Predicting the phase distribution during multi-channel transcranial alternating current stimulation in silico and in vivo.

BACKGROUND: Transcranial alternating current stimulation (tACS) is a widely used noninvasive brain stimulation (NIBS) technique to affect neural activity. TACS experiments have been coupled with computational simulations to predict the electromagnetic fields within the brain. However, existing simulations are focused on the magnitude of the field. As the possibility of inducing the phase gradient in the brain using multiple tACS electrodes arises, a simulation framework is necessary to investigate and predict the phase gradient of electric fields during multi-channel tACS. OBJECTIVE: Here, we develop such a framework for phasor simulation using phasor algebra and evaluate its accuracy using in vivo recordings in monkeys. METHODS: We extract the phase and amplitude of electric fields from intracranial recordings in two monkeys during multi-channel tACS and compare them to those calculated by phasor analysis using finite element models. RESULTS: Our findings demonstrate that simulated phases correspond well to measured phases (r = 0.9). Further, we systematically evaluated the impact of accurate electrode placement on modeling and data agreement. Finally, our framework can predict the amplitude distribution in measurements given calibrated tissues' conductivity. CONCLUSIONS: Our validated general framework for simulating multi-phase, multi-electrode tACS provides a streamlined tool for principled planning of multi-channel tACS experiments.

An open-access dataset of naturalistic viewing using simultaneous EEG-fMRI.

In this work, we present a dataset that combines functional magnetic imaging (fMRI) and electroencephalography (EEG) to use as a resource for understanding human brain function in these two imaging modalities. The dataset can also be used for optimizing preprocessing methods for simultaneously collected imaging data. The dataset includes simultaneously collected recordings from 22 individuals (ages: 23-51) across various visual and naturalistic stimuli. In addition, physiological, eye tracking, electrocardiography, and cognitive and behavioral data were collected along with this neuroimaging data. Visual tasks include a flickering checkerboard collected outside and inside the MRI scanner (EEG-only) and simultaneous EEG-fMRI recordings. Simultaneous recordings include rest, the visual paradigm Inscapes, and several short video movies representing naturalistic stimuli. Raw and preprocessed data are openly available to download. We present this dataset as part of an effort to provide open-access data to increase the opportunity for discoveries and understanding of the human brain and evaluate the correlation between electrical brain activity and blood oxygen level-dependent (BOLD) signals.

Semantic novelty modulates neural responses to visual change across the human brain.

Our continuous visual experience in daily life is dominated by change. Previous research has focused on visual change due to stimulus motion, eye movements or unfolding events, but not their combined impact across the brain, or their interactions with semantic novelty. We investigate the neural responses to these sources of novelty during film viewing. We analyzed intracranial recordings in humans across 6328 electrodes from 23 individuals. Responses associated with saccades and film cuts were dominant across the entire brain. Film cuts at semantic event boundaries were particularly effective in the temporal and medial temporal lobe. Saccades to visual targets with high visual novelty were also associated with strong neural responses. Specific locations in higher-order association areas showed selectivity to either high or low-novelty saccades. We conclude that neural activity associated with film cuts and eye movements is widespread across the brain and is modulated by semantic novelty.

Experimental validation of computational models for the prediction of phase distribution during multi-channel transcranial alternating current stimulation.

Transcranial alternating current stimulation (tACS) is a widely used noninvasive brain stimulation (NIBS) technique to affect neural activity. Neural oscillations exhibit phase-dependent associations with cognitive functions, and tools to manipulate local oscillatory phases can affect communication across remote brain regions. A recent study demonstrated that multi-channel tACS can generate electric fields with a phase gradient or traveling waves in the brain. Computational simulations using phasor algebra can predict the phase distribution inside the brain and aid in informing parameters in tACS experiments. However, experimental validation of computational models for multi-phase tACS is still lacking. Here, we develop such a framework for phasor simulation and evaluate its accuracy using in vivo recordings in nonhuman primates. We extract the phase and amplitude of electric fields from intracranial recordings in two monkeys during multi-channel tACS and compare them to those calculated by phasor analysis using finite element models. Our findings demonstrate that simulated phases correspond well to measured phases (r = 0.9). Further, we systematically evaluated the impact of accurate electrode placement on modeling and data agreement. Finally, our framework can predict the amplitude distribution in measurements given calibrated tissues’ conductivity. Our validated general framework for simulating multi-phase, multi-electrode tACS provides a streamlined tool for principled planning of multi-channel tACS experiments.

Saccadic modulation of neural excitability in auditory areas of the neocortex.

In natural "active" vision, humans and other primates use eye movements (saccades) to sample bits of information from visual scenes. In the visual cortex, non-retinal signals linked to saccades shift visual cortical neurons into a high excitability state as each saccade ends. The extent of this saccadic modulation outside of the visual system is unknown. Here, we show that during natural viewing, saccades modulate excitability in numerous auditory cortical areas with a temporal pattern complementary to that seen in visual areas. Control somatosensory cortical recordings indicate that the temporal pattern is unique to auditory areas. Bidirectional functional connectivity patterns suggest that these effects may arise from regions involved in saccade generation. We propose that by using saccadic signals to yoke excitability states in auditory areas to those in visual areas, the brain can improve information processing in complex natural settings.

A new paradigm for investigating real-world social behavior and its neural underpinnings.

Eye tracking and other behavioral measurements collected from patient-participants in their hospital rooms afford a unique opportunity to study natural behavior for basic and clinical translational research. We describe an immersive social and behavioral paradigm implemented in patients undergoing evaluation for surgical treatment of epilepsy, with electrodes implanted in the brain to determine the source of their seizures. Our studies entail collecting eye tracking with other behavioral and psychophysiological measurements from patient-participants during unscripted behavior, including social interactions with clinical staff, friends, and family in the hospital room. This approach affords a unique opportunity to study the neurobiology of natural social behavior, though it requires carefully addressing distinct logistical, technical, and ethical challenges. Collecting neurophysiological data synchronized to behavioral and psychophysiological measures helps us to study the relationship between behavior and physiology. Combining across these rich data sources while participants eat, read, converse with friends and family, etc., enables clinical-translational research aimed at understanding the participants' disorders and clinician-patient interactions, as well as basic research into natural, real-world behavior. We discuss data acquisition, quality control, annotation, and analysis pipelines that are required for our studies. We also discuss the clinical, logistical, and ethical and privacy considerations critical to working in the hospital setting.

Detecting Spontaneous Neural Oscillation Events in Primate Auditory Cortex.

Electrophysiological oscillations in the brain have been shown to occur as multicycle events, with onset and offset dependent on behavioral and cognitive state. To provide a baseline for state-related and task-related events, we quantified oscillation features in resting-state recordings. We developed an open-source wavelet-based tool to detect and characterize such oscillation events (OEvents) and exemplify the use of this tool in both simulations and two invasively-recorded electrophysiology datasets: one from human, and one from nonhuman primate (NHP) auditory system. After removing incidentally occurring event-related potentials (ERPs), we used OEvents to quantify oscillation features. We identified ∼2 million oscillation events, classified within traditional frequency bands: δ, θ, α, ß, low γ, γ, and high γ. Oscillation events of 1-44 cycles could be identified in at least one frequency band 90% of the time in human and NHP recordings. Individual oscillation events were characterized by nonconstant frequency and amplitude. This result necessarily contrasts with prior studies which assumed frequency constancy, but is consistent with evidence from event-associated oscillations. We measured oscillation event duration, frequency span, and waveform shape. Oscillations tended to exhibit multiple cycles per event, verifiable by comparing filtered to unfiltered waveforms. In addition to the clear intraevent rhythmicity, there was also evidence of interevent rhythmicity within bands, demonstrated by finding that coefficient of variation of interval distributions and Fano factor (FF) measures differed significantly from a Poisson distribution assumption. Overall, our study provides an easy-to-use tool to study oscillation events at the single-trial level or in ongoing recordings, and demonstrates that rhythmic, multicycle oscillation events dominate auditory cortical dynamics.

Anatomical and functional connectivity support the existence of a salience network node within the caudal ventrolateral prefrontal cortex.

Three large-scale networks are considered essential to cognitive flexibility: the ventral and dorsal attention (VANet and DANet) and salience (SNet) networks. The ventrolateral prefrontal cortex (vlPFC) is a known component of the VANet and DANet, but there is a gap in the current knowledge regarding its involvement in the SNet. Herein, we used a translational and multimodal approach to demonstrate the existence of a SNet node within the vlPFC. First, we used tract-tracing methods in non-human primates (NHP) to quantify the anatomical connectivity strength between different vlPFC areas and the frontal and insular cortices. The strongest connections were with the dorsal anterior cingulate cortex (dACC) and anterior insula (AI) - the main cortical SNet nodes. These inputs converged in the caudal area 47/12, an area that has strong projections to subcortical structures associated with the SNet. Second, we used resting-state functional MRI (rsfMRI) in NHP data to validate this SNet node. Third, we used rsfMRI in the human to identify a homologous caudal 47/12 region that also showed strong connections with the SNet cortical nodes. Taken together, these data confirm a SNet node in the vlPFC, demonstrating that the vlPFC contains nodes for all three cognitive networks: VANet, DANet, and SNet. Thus, the vlPFC is in a position to switch between these three networks, pointing to its key role as an attentional hub. Its additional connections to the orbitofrontal, dorsolateral, and premotor cortices, place the vlPFC at the center for switching behaviors based on environmental stimuli, computing value, and cognitive control.

Alpha and broadband high-frequency activity track task dynamics and predict performance in controlled decision-making.

Intracranial recordings in human subjects provide a unique, fine-grained temporal and spatial resolution inaccessible to conventional non-invasive methods. A prominent signal in these recordings is broadband high-frequency activity (approx. 70-150 Hz), generally considered to reflect neuronal excitation. Here we explored the use of this broadband signal to track, on a single-trial basis, the temporal and spatial distribution of task-engaged areas involved in decision-making. We additionally focused on the alpha rhythm (8-14 Hz), thought to regulate the (dis)engagement of neuronal populations based on task demands. Using these signals, we characterized activity across cortex using intracranial recordings in patients with intractable epilepsy performing the Multi-Source Interference Task, a Stroop-like decision-making paradigm. We analyzed recordings both from grid electrodes placed over cortical areas including frontotemporal and parietal cortex, and depth electrodes in prefrontal regions, including cingulate cortex. We found a widespread negative relationship between alpha power and broadband activity, substantiating the gating role of alpha in regions beyond sensory/motor cortex. Combined, these signals reflect the spatio-temporal pattern of task-engagement, with alpha decrease signifying task-involved regions and broadband increase temporally locking to specific task aspects, distributed over cortical sites. We report sites that only respond to stimulus presentation or to the decision report and, interestingly, sites that reflect the time-on-task. The latter predict the subject's reaction times on a trial-by-trial basis. A smaller subset of sites showed modulation with task condition. Taken together, alpha and broadband signals allow tracking of neuronal population dynamics across cortex on a fine temporal and spatial scale.

Ongoing neural oscillations influence behavior and sensory representations by suppressing neuronal excitability.

The ability to process and respond to external input is critical for adaptive behavior. Why, then, do neural and behavioral responses vary across repeated presentations of the same sensory input? Ongoing fluctuations of neuronal excitability are currently hypothesized to underlie the trial-by-trial variability in sensory processing. To test this, we capitalized on intracranial electrophysiology in neurosurgical patients performing an auditory discrimination task with visual cues: specifically, we examined the interaction between prestimulus alpha oscillations, excitability, task performance, and decoded neural stimulus representations. We found that strong prestimulus oscillations in the alpha+ band (i.e., alpha and neighboring frequencies), rather than the aperiodic signal, correlated with a low excitability state, indexed by reduced broadband high-frequency activity. This state was related to slower reaction times and reduced neural stimulus encoding strength. We propose that the alpha+ rhythm modulates excitability, thereby resulting in variability in behavior and sensory representations despite identical input.

Neural activity in the human anterior thalamus during natural vision.

In natural vision humans and other primates explore environment by active sensing, using saccadic eye movements to relocate the fovea and sample different bits of information multiple times per second. Saccades induce a phase reset of ongoing neuronal oscillations in primary and higher-order visual cortices and in the medial temporal lobe. As a result, neuron ensembles are shifted to a common state at the time visual input propagates through the system (i.e., just after fixation). The extent of the brain's circuitry that is modulated by saccades is not yet known. Here, we evaluate the possibility that saccadic phase reset impacts the anterior nuclei of the thalamus (ANT). Using recordings in the human thalamus of three surgical patients during natural vision, we found that saccades and visual stimulus onset both modulate neural activity, but with distinct field potential morphologies. Specifically, we found that fixation-locked field potentials had a component that preceded saccade onset. It was followed by an early negativity around 50 ms after fixation onset which is significantly faster than any response to visual stimulus presentation. The timing of these events suggests that the ANT is predictively modulated before the saccadic eye movement. We also found oscillatory phase concentration, peaking at 3-4 Hz, coincident with suppression of Broadband High-frequency Activity (BHA; 80-180 Hz), both locked to fixation onset supporting the idea that neural oscillations in these nuclei are reorganized to a low excitability state right after fixation onset. These findings show that during real-world natural visual exploration neural dynamics in the human ANT is influenced by visual and oculomotor events, which supports the idea that ANT, apart from their contribution to episodic memory, also play a role in natural vision.

Comparison of Scalp ERP to Faces in Macaques and Humans.

Face recognition is an essential activity of social living, common to many primate species. Underlying processes in the brain have been investigated using various techniques and compared between species. Functional imaging studies have shown face-selective cortical regions and their degree of correspondence across species. However, the temporal dynamics of face processing, particularly processing speed, are likely different between them. Across sensory modalities activation of primary sensory cortices in macaque monkeys occurs at about 3/5 the latency of corresponding activation in humans, though this human simian difference may diminish or disappear in higher cortical regions. We recorded scalp event-related potentials (ERPs) to presentation of faces in macaques and estimated the peak latency of ERP components. Comparisons of latencies between macaques (112 ms) and humans (192 ms) suggested that the 3:5 ratio could be preserved in higher cognitive regions of face processing between those species.

Differential contributions of synaptic and intrinsic inhibitory currents to speech segmentation via flexible phase-locking in neural oscillators.

Current hypotheses suggest that speech segmentation-the initial division and grouping of the speech stream into candidate phrases, syllables, and phonemes for further linguistic processing-is executed by a hierarchy of oscillators in auditory cortex. Theta (∼3-12 Hz) rhythms play a key role by phase-locking to recurring acoustic features marking syllable boundaries. Reliable synchronization to quasi-rhythmic inputs, whose variable frequency can dip below cortical theta frequencies (down to ∼1 Hz), requires "flexible" theta oscillators whose underlying neuronal mechanisms remain unknown. Using biophysical computational models, we found that the flexibility of phase-locking in neural oscillators depended on the types of hyperpolarizing currents that paced them. Simulated cortical theta oscillators flexibly phase-locked to slow inputs when these inputs caused both (i) spiking and (ii) the subsequent buildup of outward current sufficient to delay further spiking until the next input. The greatest flexibility in phase-locking arose from a synergistic interaction between intrinsic currents that was not replicated by synaptic currents at similar timescales. Flexibility in phase-locking enabled improved entrainment to speech input, optimal at mid-vocalic channels, which in turn supported syllabic-timescale segmentation through identification of vocalic nuclei. Our results suggest that synaptic and intrinsic inhibition contribute to frequency-restricted and -flexible phase-locking in neural oscillators, respectively. Their differential deployment may enable neural oscillators to play diverse roles, from reliable internal clocking to adaptive segmentation of quasi-regular sensory inputs like speech.

Combining brain perturbation and neuroimaging in non-human primates.

Brain perturbation studies allow detailed causal inferences of behavioral and neural processes. Because the combination of brain perturbation methods and neural measurement techniques is inherently challenging, research in humans has predominantly focused on non-invasive, indirect brain perturbations, or neurological lesion studies. Non-human primates have been indispensable as a neurobiological system that is highly similar to humans while simultaneously being more experimentally tractable, allowing visualization of the functional and structural impact of systematic brain perturbation. This review considers the state of the art in non-human primate brain perturbation with a focus on approaches that can be combined with neuroimaging. We consider both non-reversible (lesions) and reversible or temporary perturbations such as electrical, pharmacological, optical, optogenetic, chemogenetic, pathway-selective, and ultrasound based interference methods. Method-specific considerations from the research and development community are offered to facilitate research in this field and support further innovations. We conclude by identifying novel avenues for further research and innovation and by highlighting the clinical translational potential of the methods.

U-net model for brain extraction: Trained on humans for transfer to non-human primates.

Brain extraction (a.k.a. skull stripping) is a fundamental step in the neuroimaging pipeline as it can affect the accuracy of downstream preprocess such as image registration, tissue classification, etc. Most brain extraction tools have been designed for and applied to human data and are often challenged by non-human primates (NHP) data. Amongst recent attempts to improve performance on NHP data, deep learning models appear to outperform the traditional tools. However, given the minimal sample size of most NHP studies and notable variations in data quality, the deep learning models are very rarely applied to multi-site samples in NHP imaging. To overcome this challenge, we used a transfer-learning framework that leverages a large human imaging dataset to pretrain a convolutional neural network (i.e. U-Net Model), and then transferred this to NHP data using a small NHP training sample. The resulting transfer-learning model converged faster and achieved more accurate performance than a similar U-Net Model trained exclusively on NHP samples. We improved the generalizability of the model by upgrading the transfer-learned model using additional training datasets from multiple research sites in the Primate Data-Exchange (PRIME-DE) consortium. Our final model outperformed brain extraction routines from popular MRI packages (AFNI, FSL, and FreeSurfer) across a heterogeneous sample from multiple sites in the PRIME-DE with less computational cost (20 s~10 min). We also demonstrated the transfer-learning process enables the macaque model to be updated for use with scans from chimpanzees, marmosets, and other mammals (e.g. pig). Our model, code, and the skull-stripped mask repository of 136 macaque monkeys are publicly available for unrestricted use by the neuroimaging community at https://github.com/HumanBrainED/NHP-BrainExtraction.

Crossmodal Phase Reset and Evoked Responses Provide Complementary Mechanisms for the Influence of Visual Speech in Auditory Cortex.

Natural conversation is multisensory: when we can see the speaker's face, visual speech cues improve our comprehension. The neuronal mechanisms underlying this phenomenon remain unclear. The two main alternatives are visually mediated phase modulation of neuronal oscillations (excitability fluctuations) in auditory neurons and visual input-evoked responses in auditory neurons. Investigating this question using naturalistic audiovisual speech with intracranial recordings in humans of both sexes, we find evidence for both mechanisms. Remarkably, auditory cortical neurons track the temporal dynamics of purely visual speech using the phase of their slow oscillations and phase-related modulations in broadband high-frequency activity. Consistent with known perceptual enhancement effects, the visual phase reset amplifies the cortical representation of concomitant auditory speech. In contrast to this, and in line with earlier reports, visual input reduces the amplitude of evoked responses to concomitant auditory input. We interpret the combination of improved phase tracking and reduced response amplitude as evidence for more efficient and reliable stimulus processing in the presence of congruent auditory and visual speech inputs.SIGNIFICANCE STATEMENT Watching the speaker can facilitate our understanding of what is being said. The mechanisms responsible for this influence of visual cues on the processing of speech remain incompletely understood. We studied these mechanisms by recording the electrical activity of the human brain through electrodes implanted surgically inside the brain. We found that visual inputs can operate by directly activating auditory cortical areas, and also indirectly by modulating the strength of cortical responses to auditory input. Our results help to understand the mechanisms by which the brain merges auditory and visual speech into a unitary perception.

Oscillatory Bursting as a Mechanism for Temporal Coupling and Information Coding.

Even the simplest cognitive processes involve interactions between cortical regions. To study these processes, we usually rely on averaging across several repetitions of a task or across long segments of data to reach a statistically valid conclusion. Neuronal oscillations reflect synchronized excitability fluctuations in ensembles of neurons and can be observed in electrophysiological recordings in the presence or absence of an external stimulus. Oscillatory brain activity has been viewed as sustained increase in power at specific frequency bands. However, this perspective has been challenged in recent years by the notion that oscillations may occur as transient burst-like events that occur in individual trials and may only appear as sustained activity when multiple trials are averaged together. In this review, we examine the idea that oscillatory activity can manifest as a transient burst as well as a sustained increase in power. We discuss the technical challenges involved in the detection and characterization of transient events at the single trial level, the mechanisms that might generate them and the features that can be extracted from these events to study single-trial dynamics of neuronal ensemble activity.

Cross-species functional alignment reveals evolutionary hierarchy within the connectome.

Evolution provides an important window into how cortical organization shapes function and vice versa. The complex mosaic of changes in brain morphology and functional organization that have shaped the mammalian cortex during evolution, complicates attempts to chart cortical differences across species. It limits our ability to fully appreciate how evolution has shaped our brain, especially in systems associated with unique human cognitive capabilities that lack anatomical homologues in other species. Here, we develop a function-based method for cross-species alignment that enables the quantification of homologous regions between humans and rhesus macaques, even when their location is decoupled from anatomical landmarks. Critically, we find cross-species similarity in functional organization reflects a gradient of evolutionary change that decreases from unimodal systems and culminates with the most pronounced changes in posterior regions of the default mode network (angular gyrus, posterior cingulate and middle temporal cortices). Our findings suggest that the establishment of the default mode network, as the apex of a cognitive hierarchy, has changed in a complex manner during human evolution - even within subnetworks.