Combined MEG and EEG show reliable patterns of electromagnetic brain activity during natural viewing.

Naturalistic stimuli such as movies are increasingly used to engage cognitive and emotional processes during fMRI of brain hemodynamic activity. However, movies have been little utilized during magnetoencephalography (MEG) and EEG that directly measure population-level neuronal activity at a millisecond resolution. Here, subjects watched a 17-min segment from the movie Crash (Lionsgate Films, 2004) twice during simultaneous MEG/EEG recordings. Physiological noise components, including ocular and cardiac artifacts, were removed using the DRIFTER algorithm. Dynamic estimates of cortical activity were calculated using MRI-informed minimum-norm estimation. To improve the signal-to-noise ratio (SNR), principal component analyses (PCA) were employed to extract the prevailing temporal characteristics within each anatomical parcel of the Freesurfer Desikan-Killiany cortical atlas. A variety of alternative inter-subject correlation (ISC) approaches were then utilized to investigate the reliability of inter-subject synchronization during natural viewing. In the first analysis, the ISCs of the time series of each anatomical region over the full time period across all subject pairs were calculated and averaged. In the second analysis, dynamic ISC (dISC) analysis, the correlation was calculated over a sliding window of 200 ms with 3.3 ms steps. Finally, in a between-run ISC analysis, the between-run correlation was calculated over the dynamic ISCs of the two different runs after the Fisher z-transformation. Overall, the most reliable activations occurred in occipital/inferior temporal visual and superior temporal auditory cortices as well as in the posterior cingulate, precuneus, pre- and post-central gyri, and right inferior and middle frontal gyri. Significant between-run ISCs were observed in superior temporal auditory cortices and inferior temporal visual cortices. Taken together, our results show that movies can be utilized as naturalistic stimuli in MEG/EEG similarly as in fMRI studies.

Direction of magnetoencephalography sources associated with feedback and feedforward contributions in a visual object recognition task.

Identifying inter-area communication in terms of the hierarchical organization of functional brain areas is of considerable interest in human neuroimaging. Previous studies have suggested that the direction of magneto- and electroencephalography (MEG, EEG) source currents depend on the layer-specific input patterns into a cortical area. We examined the direction in MEG source currents in a visual object recognition experiment in which there were specific expectations of activation in the fusiform region being driven by either feedforward or feedback inputs. The source for the early non-specific visual evoked response, presumably corresponding to feedforward driven activity, pointed outward, i.e., away from the white matter. In contrast, the source for the later, object-recognition related signals, expected to be driven by feedback inputs, pointed inward, toward the white matter. Associating specific features of the MEG/EEG source waveforms to feedforward and feedback inputs could provide unique information about the activation patterns within hierarchically organized cortical areas.

Functional connectivity of dorsal and ventral frontoparietal seed regions during auditory orienting.

Our ability to refocus auditory attention is vital for even the most routine day-to-day activities. Shifts in auditory attention can be initiated "voluntarily," or triggered "involuntarily" by unexpected novel sound events. Here we employed psychophysiological interaction (PPI) analyses of auditory functional MRI data, to compare functional connectivity patterns of distinct frontoparietal cortex regions during cued voluntary vs. novelty-driven involuntary auditory attention shifting. Overall, our frontoparietal seed regions exhibited significant PPI increases with auditory cortex (AC) areas during both cued and novelty-driven orienting. However, significant positive PPI patterns associated with voluntary auditory attention (cue>novel task regressor), but mostly absent in analyses emphasizing involuntary orienting (novel>cue task regressor), were observed with seeds within the frontal eye fields (FEF), superior parietal lobule (SPL), and right supramarginal gyri (SMG). In contrast, significant positive PPIs associated selectively with involuntary orienting were observed between ACs and seeds within the bilateral anterior interior frontal gyri (IFG), left posterior IFG, SMG, and posterior cingulate cortices (PCC). We also found indices of lateralization of different attention networks: PPI increases selective to voluntary attention occurred primarily within right-hemispheric regions, whereas those related to involuntary orienting were more frequent with left-hemisphere seeds. In conclusion, despite certain similarities in PPI patterns across conditions, the more dorsal aspects of right frontoparietal cortex demonstrated wider connectivity during cued/voluntary attention shifting, whereas certain left ventral frontoparietal seeds were more widely connected during novelty-triggered/involuntary orienting. Our findings provide partial support for distinct attention networks for voluntary and involuntary auditory attention.

Increasing fMRI sampling rate improves Granger causality estimates.

Estimation of causal interactions between brain areas is necessary for elucidating large-scale functional brain networks underlying behavior and cognition. Granger causality analysis of time series data can quantitatively estimate directional information flow between brain regions. Here, we show that such estimates are significantly improved when the temporal sampling rate of functional magnetic resonance imaging (fMRI) is increased 20-fold. Specifically, healthy volunteers performed a simple visuomotor task during blood oxygenation level dependent (BOLD) contrast based whole-head inverse imaging (InI). Granger causality analysis based on raw InI BOLD data sampled at 100-ms resolution detected the expected causal relations, whereas when the data were downsampled to the temporal resolution of 2 s typically used in echo-planar fMRI, the causality could not be detected. An additional control analysis, in which we SINC interpolated additional data points to the downsampled time series at 0.1-s intervals, confirmed that the improvements achieved with the real InI data were not explainable by the increased time-series length alone. We therefore conclude that the high-temporal resolution of InI improves the Granger causality connectivity analysis of the human brain.

Lateralized parietotemporal oscillatory phase synchronization during auditory selective attention.

Based on the infamous left-lateralized neglect syndrome, one might hypothesize that the dominating right parietal cortex has a bilateral representation of space, whereas the left parietal cortex represents only the contralateral right hemispace. Whether this principle applies to human auditory attention is not yet fully clear. Here, we explicitly tested the differences in cross-hemispheric functional coupling between the intraparietal sulcus (IPS) and auditory cortex (AC) using combined magnetoencephalography (MEG), EEG, and functional MRI (fMRI). Inter-regional pairwise phase consistency (PPC) was analyzed from data obtained during dichotic auditory selective attention task, where subjects were in 10-s trials cued to attend to sounds presented to one ear and to ignore sounds presented in the opposite ear. Using MEG/EEG/fMRI source modeling, parietotemporal PPC patterns were (a) mapped between all AC locations vs. IPS seeds and (b) analyzed between four anatomically defined AC regions-of-interest (ROI) vs. IPS seeds. Consistent with our hypothesis, stronger cross-hemispheric PPC was observed between the right IPS and left AC for attended right-ear sounds, as compared to PPC between the left IPS and right AC for attended left-ear sounds. In the mapping analyses, these differences emerged at 7-13Hz, i.e., at the theta to alpha frequency bands, and peaked in Heschl's gyrus and lateral posterior non-primary ACs. The ROI analysis revealed similarly lateralized differences also in the beta and lower theta bands. Taken together, our results support the view that the right parietal cortex dominates auditory spatial attention.

Improving the spatial resolution of magnetic resonance inverse imaging via the blipped-CAIPI acquisition scheme.

Using simultaneous acquisition from multiple channels of a radio-frequency (RF) coil array, magnetic resonance inverse imaging (InI) achieves functional MRI acquisitions at a rate of 100ms per whole-brain volume. InI accelerates the scan by leaving out partition encoding steps and reconstructs images by solving under-determined inverse problems using RF coil sensitivity information. Hence, the correlated spatial information available in the coil array causes spatial blurring in the InI reconstruction. Here, we propose a method that employs gradient blips in the partition encoding direction during the acquisition to provide extra spatial encoding in order to better differentiate signals from different partitions. According to our simulations, this blipped-InI (bInI) method can increase the average spatial resolution by 15.1% (1.3mm) across the whole brain and from 32.6% (4.2mm) in subcortical regions, as compared to the InI method. In a visual fMRI experiment, we demonstrate that, compared to InI, the spatial distribution of bInI BOLD response is more consistent with that of a conventional echo-planar imaging (EPI) at the level of individual subjects. With the improved spatial resolution, especially in subcortical regions, bInI can be a useful fMRI tool for obtaining high spatiotemporal information for clinical and cognitive neuroscience studies.

Speech and Language Impairments in Autism: Insights from Behavior and Neuroimaging.

A failure to develop language is one of the earliest signs of autism. The ability to identify the neural signature of this deficit in very young children has become increasingly important, given that the presence of speech before five years of age is the strongest predictor for better outcomes in autism. This review consolidates what is known about verbal and preverbal precursors of language development as a framework for examining behavioral and brain anomalies related to speech and language in autism spectrum disorders. Relating the disruptions in the speech network to the social deficits observed will provide promising targets for behavioral and pharmacological interventions in ASD.

Evidence for distinct human auditory cortex regions for sound location versus identity processing.

Neurophysiological animal models suggest that anterior auditory cortex (AC) areas process sound identity information, whereas posterior ACs specialize in sound location processing. In humans, inconsistent neuroimaging results and insufficient causal evidence have challenged the existence of such parallel AC organization. Here we transiently inhibit bilateral anterior or posterior AC areas using MRI-guided paired-pulse transcranial magnetic stimulation (TMS) while subjects listen to Reference/Probe sound pairs and perform either sound location or identity discrimination tasks. The targeting of TMS pulses, delivered 55-145 ms after Probes, is confirmed with individual-level cortical electric-field estimates. Our data show that TMS to posterior AC regions delays reaction times (RT) significantly more during sound location than identity discrimination, whereas TMS to anterior AC regions delays RTs significantly more during sound identity than location discrimination. This double dissociation provides direct causal support for parallel processing of sound identity features in anterior AC and sound location in posterior AC.

Dynamic cortical activity during the perception of three-dimensional object shape from two-dimensional random-dot motion.

Recent neuroimaging studies implicate that both the dorsal and ventral visual pathways, as well as the middle temporal (MT) areas which are critical for the perception of visual motion, are involved in the perception of three-dimensional (3D) structure from two-dimensional (2D) motion (3D-SFM). However, the neural dynamics underlying the reconstruction of a 3D object from 2D optic flow is not known. Here we combined magnetoencephalography (MEG) and functional MRI (fMRI) measurements to investigate the spatiotemporal brain dynamics during 3D-SFM. We manipulated parametrically the coherence of randomly moving groups of dots to create different levels of 3D perception and to study the associated changes in brain activity. At different latencies, the posterior infero-temporal (pIT), the parieto-occipital (PO), and the intraparietal (IP) regions showed increased neural activity during highly coherent motion conditions in which subjects perceived a robust 3D object. Causality analysis between these regions indicated significant causal influence from IP to pIT and from pIT to PO only in conditions where subjects perceived a robust 3D object. Current results suggest that the perception of a 3D object from 2D motion includes integration of global motion and 3D mental image processing, as well as object recognition that are accomplished by interactions between the dorsal and ventral visual pathways.

Dynamic oscillatory processes governing cued orienting and allocation of auditory attention.

In everyday listening situations, we need to constantly switch between alternative sound sources and engage attention according to cues that match our goals and expectations. The exact neuronal bases of these processes are poorly understood. We investigated oscillatory brain networks controlling auditory attention using cortically constrained fMRI-weighted magnetoencephalography/EEG source estimates. During consecutive trials, participants were instructed to shift attention based on a cue, presented in the ear where a target was likely to follow. To promote audiospatial attention effects, the targets were embedded in streams of dichotically presented standard tones. Occasionally, an unexpected novel sound occurred opposite to the cued ear to trigger involuntary orienting. According to our cortical power correlation analyses, increased frontoparietal/temporal 30-100 Hz gamma activity at 200-1400 msec after cued orienting predicted fast and accurate discrimination of subsequent targets. This sustained correlation effect, possibly reflecting voluntary engagement of attention after the initial cue-driven orienting, spread from the TPJ, anterior insula, and inferior frontal cortices to the right FEFs. Engagement of attention to one ear resulted in a significantly stronger increase of 7.5-15 Hz alpha in the ipsilateral than contralateral parieto-occipital cortices 200-600 msec after the cue onset, possibly reflecting cross-modal modulation of the dorsal visual pathway during audiospatial attention. Comparisons of cortical power patterns also revealed significant increases of sustained right medial frontal cortex theta power, right dorsolateral pFC and anterior insula/inferior frontal cortex beta power, and medial parietal cortex and posterior cingulate cortex gamma activity after cued versus novelty-triggered orienting (600-1400 msec). Our results reveal sustained oscillatory patterns associated with voluntary engagement of auditory spatial attention, with the frontoparietal and temporal gamma increases being best predictors of subsequent behavioral performance.

Whole-head rapid fMRI acquisition using echo-shifted magnetic resonance inverse imaging.

The acquisition time of BOLD contrast functional MRI (fMRI) data with whole-brain coverage typically requires a sampling rate of one volume in 1-3s. Although the volumetric sampling time of a few seconds is adequate for measuring the sluggish hemodynamic response (HDR) to neuronal activation, faster sampling of fMRI might allow for monitoring of rapid physiological fluctuations and detection of subtle neuronal activation timing information embedded in BOLD signals. Previous studies utilizing a highly accelerated volumetric MR inverse imaging (InI) technique have provided a sampling rate of one volume per 100 ms with 5mm spatial resolution. Here, we propose a novel modification of this technique, the echo-shifted InI, which allows TE to be longer than TR, to measure BOLD fMRI at an even faster sampling rate of one volume per 25 ms with whole-brain coverage. Compared with conventional EPI, echo-shifted InI provided an 80-fold speedup with similar spatial resolution and less than 2-fold temporal SNR loss. The capability of echo-shifted InI to detect HDR timing differences was tested empirically. At the group level (n=6), echo-spaced InI was able to detect statistically significant HDR timing differences of as low as 50 ms in visual stimulus presentation. At the level of individual subjects, significant differences in HDR timing were detected for 400 ms stimulus-onset differences. Our results also show that the temporal resolution of 25 ms is necessary for maintaining the temporal detecting capability at this level. With the capabilities of being able to distinguish the timing differences in the millisecond scale, echo-shifted InI could be a useful fMRI tool for obtaining temporal information at a time scale closer to that of neuronal dynamics.

fMRI hemodynamics accurately reflects neuronal timing in the human brain measured by MEG.

Neuronal activation sequence information is essential for understanding brain functions. Extracting such timing information from blood oxygenation level dependent (BOLD) fMRI is confounded by interregional neurovascular differences and poorly understood relations between BOLD and electrophysiological response delays. Here, we recorded whole-head BOLD fMRI at 100 ms resolution and magnetoencephalography (MEG) during a visuomotor reaction-time task. Both methods detected the same activation sequence across five regions, from visual towards motor cortices, with linearly correlated interregional BOLD and MEG response delays. The smallest significant interregional BOLD delay was 100 ms; all delays ≥400 ms were significant. Switching the order of external events reversed the sequence of BOLD activations, indicating that interregional neurovascular differences did not confound the results. This may open new avenues for using fMRI to follow rapid activation sequences in the brain.

Brain networks of novelty-driven involuntary and cued voluntary auditory attention shifting.

In everyday life, we need a capacity to flexibly shift attention between alternative sound sources. However, relatively little work has been done to elucidate the mechanisms of attention shifting in the auditory domain. Here, we used a mixed event-related/sparse-sampling fMRI approach to investigate this essential cognitive function. In each 10-sec trial, subjects were instructed to wait for an auditory "cue" signaling the location where a subsequent "target" sound was likely to be presented. The target was occasionally replaced by an unexpected "novel" sound in the uncued ear, to trigger involuntary attention shifting. To maximize the attention effects, cues, targets, and novels were embedded within dichotic 800-Hz vs. 1500-Hz pure-tone "standard" trains. The sound of clustered fMRI acquisition (starting at t = 7.82 sec) served as a controlled trial-end signal. Our approach revealed notable activation differences between the conditions. Cued voluntary attention shifting activated the superior intra--parietal sulcus (IPS), whereas novelty-triggered involuntary orienting activated the inferior IPS and certain subareas of the precuneus. Clearly more widespread activations were observed during voluntary than involuntary orienting in the premotor cortex, including the frontal eye fields. Moreover, we found -evidence for a frontoinsular-cingular attentional control network, consisting of the anterior insula, inferior frontal cortex, and medial frontal cortices, which were activated during both target discrimination and voluntary attention shifting. Finally, novels and targets activated much wider areas of superior temporal auditory cortices than shifting cues.

Neuronal representations of distance in human auditory cortex.

Neuronal mechanisms of auditory distance perception are poorly understood, largely because contributions of intensity and distance processing are difficult to differentiate. Typically, the received intensity increases when sound sources approach us. However, we can also distinguish between soft-but-nearby and loud-but-distant sounds, indicating that distance processing can also be based on intensity-independent cues. Here, we combined behavioral experiments, fMRI measurements, and computational analyses to identify the neural representation of distance independent of intensity. In a virtual reverberant environment, we simulated sound sources at varying distances (15-100 cm) along the right-side interaural axis. Our acoustic analysis suggested that, of the individual intensity-independent depth cues available for these stimuli, direct-to-reverberant ratio (D/R) is more reliable and robust than interaural level difference (ILD). However, on the basis of our behavioral results, subjects' discrimination performance was more consistent with complex intensity-independent distance representations, combining both available cues, than with representations on the basis of either D/R or ILD individually. fMRI activations to sounds varying in distance (containing all cues, including intensity), compared with activations to sounds varying in intensity only, were significantly increased in the planum temporale and posterior superior temporal gyrus contralateral to the direction of stimulation. This fMRI result suggests that neurons in posterior nonprimary auditory cortices, in or near the areas processing other auditory spatial features, are sensitive to intensity-independent sound properties relevant for auditory distance perception.

Dissociable influences of auditory object vs. spatial attention on visual system oscillatory activity.

Given that both auditory and visual systems have anatomically separate object identification ("what") and spatial ("where") pathways, it is of interest whether attention-driven cross-sensory modulations occur separately within these feature domains. Here, we investigated how auditory "what" vs. "where" attention tasks modulate activity in visual pathways using cortically constrained source estimates of magnetoencephalograpic (MEG) oscillatory activity. In the absence of visual stimuli or tasks, subjects were presented with a sequence of auditory-stimulus pairs and instructed to selectively attend to phonetic ("what") vs. spatial ("where") aspects of these sounds, or to listen passively. To investigate sustained modulatory effects, oscillatory power was estimated from time periods between sound-pair presentations. In comparison to attention to sound locations, phonetic auditory attention was associated with stronger alpha (7-13 Hz) power in several visual areas (primary visual cortex; lingual, fusiform, and inferior temporal gyri, lateral occipital cortex), as well as in higher-order visual/multisensory areas including lateral/medial parietal and retrosplenial cortices. Region-of-interest (ROI) analyses of dynamic changes, from which the sustained effects had been removed, suggested further power increases during Attend Phoneme vs. Location centered at the alpha range 400-600 ms after the onset of second sound of each stimulus pair. These results suggest distinct modulations of visual system oscillatory activity during auditory attention to sound object identity ("what") vs. sound location ("where"). The alpha modulations could be interpreted to reflect enhanced crossmodal inhibition of feature-specific visual pathways and adjacent audiovisual association areas during "what" vs. "where" auditory attention.

Ultrafast inverse imaging techniques for fMRI.

Inverse imaging (InI) supercharges the sampling rate of traditional functional MRI 10-100 fold at a cost of a moderate reduction in spatial resolution. The technique is inspired by similarities between multi-sensor magnetoencephalography (MEG) and highly parallel radio-frequency (RF) MRI detector arrays. Using presently available 32-channel head coils at 3T, InI can be sampled at 10 Hz and provides about 5-mm cortical spatial resolution with whole-brain coverage. Here we discuss the present applications of InI, as well as potential future challenges and opportunities in further improving its spatiotemporal resolution and sensitivity. InI may become a helpful tool for clinicians and neuroscientists for revealing the complex dynamics of brain functions during task-related and resting states.

Reconstruction of MRI data encoded by multiple nonbijective curvilinear magnetic fields.

Parallel imaging technique using localized gradients (PatLoc) uses the combination of surface gradient coils generating nonbijective curvilinear magnetic fields for spatial encoding. PatLoc imaging using one pair of multipolar spatial encoding magnetic fields (SEMs) has two major caveats: (1) The direct inversion of the encoding matrix requires exact determination of multiple locations which are ambiguously encoded by the SEMs. (2) Reconstructed images have a prominent loss of spatial resolution at the center of field-of-view using a symmetric coil array for signal detection. This study shows that a PatLoc system actually has a higher degree of freedom in spatial encoding to mitigate the two challenges mentioned above. Specifically, a PatLoc system can generate not only multipolar but also linear SEMs, which can be used to reduce the loss of spatial resolution at the field-of-view center. Here, we present an efficient and generalized image reconstruction method for PatLoc imaging using multiple SEMs without explicitly identifying the locations where SEM encoding is not unique. Reconstructions using simulations and empirical experimental data are compared with those using conventional linear gradients to demonstrate that the general combination of SEMs can improve image reconstructions.

Physiological noise reduction using volumetric functional magnetic resonance inverse imaging.

Physiological noise arising from a variety of sources can significantly degrade the detection of task-related activity in BOLD-contrast fMRI experiments. If whole head spatial coverage is desired, effective suppression of oscillatory physiological noise from cardiac and respiratory fluctuations is quite difficult without external monitoring, since traditional EPI acquisition methods cannot sample the signal rapidly enough to satisfy the Nyquist sampling theorem, leading to temporal aliasing of noise. Using a combination of high speed magnetic resonance inverse imaging (InI) and digital filtering, we demonstrate that it is possible to suppress cardiac and respiratory noise without auxiliary monitoring, while achieving whole head spatial coverage and reasonable spatial resolution. Our systematic study of the effects of different moving average (MA) digital filters demonstrates that a MA filter with a 2 s window can effectively reduce the variance in the hemodynamic baseline signal, thereby achieving 57%-58% improvements in peak z-statistic values compared to unfiltered InI or spatially smoothed EPI data (FWHM = 8.6 mm). In conclusion, the high temporal sampling rates achievable with InI permit significant reductions in physiological noise using standard temporal filtering techniques that result in significant improvements in hemodynamic response estimation.

Short-term plasticity as a neural mechanism supporting memory and attentional functions.

Based on behavioral studies, several relatively distinct perceptual and cognitive functions have been defined in cognitive psychology such as sensory memory, short-term memory, and selective attention. Here, we review evidence suggesting that some of these functions may be supported by shared underlying neuronal mechanisms. Specifically, we present, based on an integrative review of the literature, a hypothetical model wherein short-term plasticity, in the form of transient center-excitatory and surround-inhibitory modulations, constitutes a generic processing principle that supports sensory memory, short-term memory, involuntary attention, selective attention, and perceptual learning. In our model, the size and complexity of receptive fields/level of abstraction of neural representations, as well as the length of temporal receptive windows, increases as one steps up the cortical hierarchy. Consequently, the type of input (bottom-up vs. top down) and the level of cortical hierarchy that the inputs target, determine whether short-term plasticity supports purely sensory vs. semantic short-term memory or attentional functions. Furthermore, we suggest that rather than discrete memory systems, there are continuums of memory representations from short-lived sensory ones to more abstract longer-duration representations, such as those tapped by behavioral studies of short-term memory.

Attention-driven auditory cortex short-term plasticity helps segregate relevant sounds from noise.

How can we concentrate on relevant sounds in noisy environments? A "gain model" suggests that auditory attention simply amplifies relevant and suppresses irrelevant afferent inputs. However, it is unclear whether this suffices when attended and ignored features overlap to stimulate the same neuronal receptive fields. A "tuning model" suggests that, in addition to gain, attention modulates feature selectivity of auditory neurons. We recorded magnetoencephalography, EEG, and functional MRI (fMRI) while subjects attended to tones delivered to one ear and ignored opposite-ear inputs. The attended ear was switched every 30 s to quantify how quickly the effects evolve. To produce overlapping inputs, the tones were presented alone vs. during white-noise masking notch-filtered ±1/6 octaves around the tone center frequencies. Amplitude modulation (39 vs. 41 Hz in opposite ears) was applied for "frequency tagging" of attention effects on maskers. Noise masking reduced early (50-150 ms; N1) auditory responses to unattended tones. In support of the tuning model, selective attention canceled out this attenuating effect but did not modulate the gain of 50-150 ms activity to nonmasked tones or steady-state responses to the maskers themselves. These tuning effects originated at nonprimary auditory cortices, purportedly occupied by neurons that, without attention, have wider frequency tuning than ±1/6 octaves. The attentional tuning evolved rapidly, during the first few seconds after attention switching, and correlated with behavioral discrimination performance. In conclusion, a simple gain model alone cannot explain auditory selective attention. In nonprimary auditory cortices, attention-driven short-term plasticity retunes neurons to segregate relevant sounds from noise.