Visual motion processing investigated using contrast agent-enhanced fMRI in awake behaving monkeys.

To reduce the information gap between human neuroimaging and macaque physiology and anatomy, we mapped fMRI signals produced by moving and stationary stimuli (random dots or lines) in fixating monkeys. Functional sensitivity was increased by a factor of approximately 5 relative to the BOLD technique by injecting a contrast agent (monocrystalline iron oxide nanoparticle [MION]). Areas identified as motion sensitive included V2, V3, MT/V5, vMST, FST, VIP, and FEF (with moving dots), as well as V4, TE, LIP, and PIP (with random lines). These regions sensitive for moving dots are largely in agreement with monkey single unit data and (except for V3A) with human fMRI results. Moving lines activate some regions that have not been previously implicated in motion processing. Overall, the results clarify the relationship between the motion pathway and the dorsal stream in primates.

Mechanisms of migraine aura revealed by functional MRI in human visual cortex.

Cortical spreading depression (CSD) has been suggested to underlie migraine visual aura. However, it has been challenging to test this hypothesis in human cerebral cortex. Using high-field functional MRI with near-continuous recording during visual aura in three subjects, we observed blood oxygenation level-dependent (BOLD) signal changes that demonstrated at least eight characteristics of CSD, time-locked to percept/onset of the aura. Initially, a focal increase in BOLD signal (possibly reflecting vasodilation), developed within extrastriate cortex (area V3A). This BOLD change progressed contiguously and slowly (3.5 +/- 1.1 mm/min) over occipital cortex, congruent with the retinotopy of the visual percept. Following the same retinotopic progression, the BOLD signal then diminished (possibly reflecting vasoconstriction after the initial vasodilation), as did the BOLD response to visual activation. During periods with no visual stimulation, but while the subject was experiencing scintillations, BOLD signal followed the retinotopic progression of the visual percept. These data strongly suggest that an electrophysiological event such as CSD generates the aura in human visual cortex.

Mapping visual cortex in monkeys and humans using surface-based atlases.

We have used surface-based atlases of the cerebral cortex to analyze the functional organization of visual cortex in humans and macaque monkeys. The macaque atlas contains multiple partitioning schemes for visual cortex, including a probabilistic atlas of visual areas derived from a recent architectonic study, plus summary schemes that reflect a combination of physiological and anatomical evidence. The human atlas includes a probabilistic map of eight topographically organized visual areas recently mapped using functional MRI. To facilitate comparisons between species, we used surface-based warping to bring functional and geographic landmarks on the macaque map into register with corresponding landmarks on the human map. The results suggest that extrastriate visual cortex outside the known topographically organized areas is dramatically expanded in human compared to macaque cortex, particularly in the parietal lobe.

Cortical mechanisms specific to explicit visual object recognition.

The cortical mechanisms associated with conscious object recognition were studied using functional magnetic resonance imaging (fMRI). Participants were required to recognize pictures of masked objects that were presented very briefly, randomly and repeatedly. This design yielded a gradual accomplishment of successful recognition. Cortical activity in a ventrotemporal visual region was linearly correlated with perception of object identity. Therefore, although object recognition is rapid, awareness of an object's identity is not a discrete phenomenon but rather associated with gradually increasing cortical activity. Furthermore, the focus of the activity in the temporal cortex shifted anteriorly as subjects reported an increased knowledge regarding identity. The results presented here provide new insights into the processes underlying explicit object recognition, as well as the analysis that takes place immediately before and after recognition is possible.

Where is 'dorsal V4' in human visual cortex? Retinotopic, topographic and functional evidence.

In flattened human visual cortex, we defined the topographic homologue of macaque dorsal V4 (the 'V4d topologue'), based on neighborhood relations among visual areas (i.e. anterior to V3A, posterior to MT+, and superior to ventral V4). Retinotopic functional magnetic resonance imaging (fMRI) data suggest that two visual areas ('LOC' and 'LOP') are included within this V4d topologue. Except for an overall bias for either central or peripheral stimuli (respectively), the retinotopy within LOC and LOP was crude or nonexistent. Thus the retinotopy in the human V4d topologue differed from previous reports in macaque V4d. Unlike some previous reports in macaque V4d, the human V4d topologue was not significantly color-selective. However, the V4d topologue did respond selectively to kinetic motion boundaries, consistent with previous human fMRI reports. Because striking differences were found between the retinotopy and functional properties of the human topologues of 'V4v' and 'V4d', it is unlikely that these two cortical regions are subdivisions of a singular human area 'V4'.

Local and global attention are mapped retinotopically in human occipital cortex.

Clinical evidence suggests that control mechanisms for local and global attention are lateralized in the temporal-parietal cortex. However, in the human occipital (visual) cortex, the evidence for lateralized local/global attention is controversial. To clarify this matter, we used functional MRI to map activity in the human occipital cortex, during local and global attention, with sustained visual fixation. Data were analyzed in a flattened cortical format, relative to maps of retinotopy and spatial frequency peak tuning. Neither local nor global attention was lateralized in the occipital cortex. Instead, local attention and global attention appear to be special cases of visual spatial attention, which are mapped consistently with the maps of retinotopy and spatial frequency tuning, in multiple visual cortical areas.

Attention-dependent suppression of metabolic activity in the early stages of the macaque visual system.

In this study we used a modified double-label deoxyglucose procedure to investigate attention-dependent modulations of deoxyglucose uptake at the earliest stages of the macaque visual system. Specifically, we compared activity levels evoked during two tasks with essentially identical visual stimulation requiring different attentional demands. During a featural-attention task, the subjects had to discriminate the orientation of a grating; during a control spatial-attention task, they had to localize the position of a target point. Comparison of the resulting activity maps revealed attention-dependent changes in metabolic activity in portions of the magnocellular layers of the lateral geniculate nucleus, and the magnocellular-recipient layers 4Calpha and 4B of the striate cortex. In these early stages of the visual system, attention to the orientation of the grating suppressed the metabolic activity in a retinotopically specific band peripheral to the representation of the stimulus. These results favor an early selection model of attention. After a thalamic attention-dependent gating mechanism, irrelevant visual information outside the focus of attention may be suppressed at the level of the striate cortex, which would then result in an increased signal-to-noise ratio for the processing of the attended feature in higher-tier, less retinotopically organized, extrastriate visual areas.

Projection of rods and cones within human visual cortex.

There are two basic types of photoreceptors in the retina: rods and cones. Using a single stimulus viewed at two different light levels, we tested whether input from rods and input from cones are topographically segregated at subsequent levels of human visual cortex. Here we show that rod-mediated visual input produces robust activation in area MT+, and in the peripheral representations of multiple retinotopic areas. However, such activation was selectively absent in: (1) a cortical area selectively activated by colored stimuli (V8) and (2) the foveal representations of lower tier retinotopic areas. These cortical differences reflect corresponding differences in perception between scotopic and photopic conditions.

Spatiotemporal activity of a cortical network for processing visual motion revealed by MEG and fMRI.

A sudden change in the direction of motion is a particularly salient and relevant feature of visual information. Extensive research has identified cortical areas responsive to visual motion and characterized their sensitivity to different features of motion, such as directional specificity. However, relatively little is known about responses to sudden changes in direction. Electrophysiological data from animals and functional imaging data from humans suggest a number of brain areas responsive to motion, presumably working as a network. Temporal patterns of activity allow the same network to process information in different ways. The present study in humans sought to determine which motion-sensitive areas are involved in processing changes in the direction of motion and to characterize the temporal patterns of processing within this network of brain regions. To accomplish this, we used both magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI). The fMRI data were used as supplementary information in the localization of MEG sources. The change in the direction of visual motion was found to activate a number of areas, each displaying a different temporal behavior. The fMRI revealed motion-related activity in areas MT+ (the human homologue of monkey middle temporal area and possibly also other motion sensitive areas next to MT), a region near the posterior end of the superior temporal sulcus (pSTS), V3A, and V1/V2. The MEG data suggested additional frontal sources. An equivalent dipole model for the generators of MEG signals indicated activity in MT+, starting at 130 ms and peaking at 170 ms after the reversal of the direction of motion, and then again at approximately 260 ms. Frontal activity began 0-20 ms later than in MT+, and peaked approximately 180 ms. Both pSTS and FEF+ showed long-duration activity continuing over the latency range of 200-400 ms. MEG responses in the region of V3A and V1/V2 were relatively small, and peaked at longer latencies than the initial peak in MT+. These data revealed characteristic patterns of activity in this cortical network for processing sudden changes in the direction of visual motion.

The representation of illusory and real contours in human cortical visual areas revealed by functional magnetic resonance imaging.

Illusory contours (perceived edges that exist in the absence of local stimulus borders) demonstrate that perception is an active process, creating features not present in the light patterns striking the retina. Illusory contours are thought to be processed using mechanisms that partially overlap with those of "real" contours, but questions about the neural substrate of these percepts remain. Here, we employed functional magnetic resonance imaging to obtain physiological signals from human visual cortex while subjects viewed different types of contours, both real and illusory. We sampled these signals independently from nine visual areas, each defined by retinotopic or other independent criteria. Using both within- and across-subject analysis, we found evidence for overlapping sites of processing; most areas responded to most types of contours. However, there were distinctive differences in the strength of activity across areas and contour types. Two types of illusory contours differed in the strength of activation of the retinotopic areas, but both types activated crudely retinotopic visual areas, including V3A, V4v, V7, and V8, bilaterally. The extent of activation was largely invariant across a range of stimulus sizes that produce illusory contours perceptually, but it was related to the spatial frequency of displaced-grating stimuli. Finally, there was a striking similarity in the pattern of results for the illusory contour-defined shape and a similar shape defined by stereoscopic depth. These and other results suggest a role in surface perception for this lateral occipital region that includes V3A, V4v, V7, and V8.

Functional MRI reveals spatially specific attentional modulation in human primary visual cortex.

Selective visual attention can strongly influence perceptual processing, even for apparently low-level visual stimuli. Although it is largely accepted that attention modulates neural activity in extrastriate visual cortex, the extent to which attention operates in the first cortical stage, striate visual cortex (area V1), remains controversial. Here, functional MRI was used at high field strength (3 T) to study humans during attentionally demanding visual discriminations. Similar, robust attentional modulations were observed in both striate and extrastriate cortical areas. Functional mapping of cortical retinotopy demonstrates that attentional modulations were spatially specific, enhancing responses to attended stimuli and suppressing responses when attention was directed elsewhere. The spatial pattern of modulation reveals a complex attentional window that is consistent with object-based attention but is inconsistent with a simple attentional spotlight. These data suggest that neural processing in V1 is not governed simply by sensory stimulation, but, like extrastriate regions, V1 can be strongly and specifically influenced by attention.

Location of human face-selective cortex with respect to retinotopic areas.

Functional Magnetic Resonance Imaging (fMRI) was used to identify a small area in the human posterior fusiform gyrus that responds selectively to faces (PF). In the same subjects, phase-encoded rotating and expanding checkerboards were used with fMRI to identify the retinotopic visual areas V1, V2, V3, V3A, VP and V4v. PF was found to lie anterior to area V4v, with a small gap present between them. Further recordings in some of the same subjects used moving low-contrast rings to identify the visual motion area MT. PF was found to lie ventral to MT. In addition, preliminary evidence was found using fMRI for a small area that responded to inanimate objects but not to faces in the collateral sulcus medial to PF. The retinotopic visual areas and MT responded equally to faces, control randomized stimuli, and objects. Weakly face-selective responses were also found in ventrolateral occipitotemporal cortex anterior to V4v, as well as in the middle temporal gyrus anterior to MT. We conclude that the fusiform face area in humans lies in non-retinotopic visual association cortex of the ventral form-processing stream, in an area that may be roughly homologous in location to area TF or CITv in monkeys.

High-resolution intersubject averaging and a coordinate system for the cortical surface.

The neurons of the human cerebral cortex are arranged in a highly folded sheet, with the majority of the cortical surface area buried in folds. Cortical maps are typically arranged with a topography oriented parallel to the cortical surface. Despite this unambiguous sheetlike geometry, the most commonly used coordinate systems for localizing cortical features are based on 3-D stereotaxic coordinates rather than on position relative to the 2-D cortical sheet. In order to address the need for a more natural surface-based coordinate system for the cortex, we have developed a means for generating an average folding pattern across a large number of individual subjects as a function on the unit sphere and of nonrigidly aligning each individual with the average. This establishes a spherical surface-based coordinate system that is adapted to the folding pattern of each individual subject, allowing for much higher localization accuracy of structural and functional features of the human brain.

Cortical fMRI activation produced by attentive tracking of moving targets.

Attention can be used to keep track of moving items, particularly when there are multiple targets of interest that cannot all be followed with eye movements. Functional magnetic resonance imaging (fMRI) was used to investigate cortical regions involved in attentive tracking. Cortical flattening techniques facilitated within-subject comparisons of activation produced by attentive tracking, visual motion, discrete attention shifts, and eye movements. In the main task, subjects viewed a display of nine green "bouncing balls" and used attention to mentally track a subset of them while fixating. At the start of each attentive-tracking condition, several target balls (e.g., 3/9) turned red for 2 s and then reverted to green. Subjects then used attention to keep track of the previously indicated targets, which were otherwise indistinguishable from the nontargets. Attentive-tracking conditions alternated with passive viewing of the same display when no targets had been indicated. Subjects were pretested with an eye-movement monitor to ensure they could perform the task accurately while fixating. For seven subjects, functional activation was superimposed on each individual's cortically unfolded surface. Comparisons between attentive tracking and passive viewing revealed bilateral activation in parietal cortex (intraparietal sulcus, postcentral sulcus, superior parietal lobule, and precuneus), frontal cortex (frontal eye fields and precentral sulcus), and the MT complex (including motion-selective areas MT and MST). Attentional enhancement was absent in early visual areas and weak in the MT complex. However, in parietal and frontal areas, the signal change produced by the moving stimuli was more than doubled when items were tracked attentively. Comparisons between attentive tracking and attention shifting revealed essentially identical activation patterns that differed only in the magnitude of activation. This suggests that parietal cortex is involved not only in discrete shifts of attention between objects at different spatial locations but also in continuous "attentional pursuit" of moving objects. Attentive-tracking activation patterns were also similar, though not identical, to those produced by eye movements. Taken together, these results suggest that attentive tracking is mediated by a network of areas that includes parietal and frontal regions responsible for attention shifts and eye movements and the MT complex, thought to be responsible for motion perception. These results are consistent with theoretical models of attentive tracking as an attentional process that assigns spatial tags to targets and registers changes in their position, generating a high-level percept of apparent motion.

Functional analysis of primary visual cortex (V1) in humans.

Human area V1 offers an excellent opportunity to study, using functional MRI, a range of properties in a specific cortical visual area, whose borders are defined objectively and convergently by retinotopic criteria. The retinotopy in V1 (also known as primary visual cortex, striate cortex, or Brodmann's area 17) was defined in each subject by using both stationary and phase-encoded polar coordinate stimuli. Data from V1 and neighboring retinotopic areas were displayed on flattened cortical maps. In additional tests we revealed the paired cortical representations of the monocular "blind spot." We also activated area V1 preferentially (relative to other extrastriate areas) by presenting radial gratings alternating between 6% and 100% contrast. Finally, we showed evidence for orientation selectivity in V1 by measuring transient functional MRI increases produced at the change in response to gratings of differing orientations. By systematically varying the orientations presented, we were able to measure the bandwidth of the orientation "transients" (45 degrees).

The representation of the ipsilateral visual field in human cerebral cortex.

Previous studies of cortical retinotopy focused on influences from the contralateral visual field, because ascending inputs to cortex are known to be crossed. Here, functional magnetic resonance imaging was used to demonstrate and analyze an ipsilateral representation in human visual cortex. Moving stimuli, in a range of ipsilateral visual field locations, revealed activity: (i) along the vertical meridian in retinotopic (presumably lower-tier) areas; and (ii) in two large branches anterior to that, in presumptive higher-tier areas. One branch shares the anterior vertical meridian representation in human V3A, extending superiorly toward parietal cortex. The second branch runs antero-posteriorly along lateral visual cortex, overlying motion-selective area MT. Ipsilateral stimuli sparing the region around the vertical meridian representation also produced signal reductions (perhaps reflecting neural inhibition) in areas showing contralaterally driven retinotopy. Systematic sampling across a range of ipsilateral visual field extents revealed significant increases in ipsilateral activation in V3A and V4v, compared with immediately posterior areas V3 and VP. Finally, comparisons between ipsilateral stimuli of different types but equal retinotopic extent showed clear stimulus specificity, consistent with earlier suggestions of a functional segregation of motion vs. form processing in parietal vs. temporal cortex, respectively.

Retinotopy and color sensitivity in human visual cortical area V8.

Prior studies suggest the presence of a color-selective area in the inferior occipital-temporal region of human visual cortex. It has been proposed that this human area is homologous to macaque area V4, which is arguably color selective, but this has never been tested directly. To test this model, we compared the location of the human color-selective region to the retinotopic area boundaries in the same subjects, using functional magnetic resonance imaging (fMRI), cortical flattening and retinotopic mapping techniques. The human color-selective region did not match the location of area V4 (neither its dorsal nor ventral subdivisions), as extrapolated from macaque maps. Instead this region coincides with a new retinotopic area that we call 'V8', which includes a distinct representation of the fovea and both upper and lower visual fields. We also tested the response to stimuli that produce color afterimages and found that these stimuli, like real colors, caused preferential activation of V8 but not V4.

The retinotopy of visual spatial attention.

We used high-field (3T) functional magnetic resonance imaging (fMRI) to label cortical activity due to visual spatial attention, relative to flattened cortical maps of the retinotopy and visual areas from the same human subjects. In the main task, the visual stimulus remained constant, but covert visual spatial attention was varied in both location and load. In each of the extrastriate retinotopic areas, we found MR increases at the representations of the attended target. Similar but smaller increases were found in V1. Decreased MR levels were found in the same cortical locations when attention was directed at retinotopically different locations. In and surrounding area MT+, MR increases were lateralized but not otherwise retinotopic. At the representation of eccentricities central to that of the attended targets, prominent MR decreases occurred during spatial attention.

From retinotopy to recognition: fMRI in human visual cortex.

Recent advances in functional magnetic resonance imaging (fMRI) have furnished increasingly informative and accurate maps of the retinotopy and functional organization in human visual cortex. Here we review how information in those sensory-based maps is topographically related to, and influenced by, more cognitive visuo-spatial dimensions, such as mental imagery, spatial attention, repetition effects and size perception.