Fast and slow spindle involvement in the consolidation of a new motor sequence.

This study aimed to determine the distinct contribution of slow (11-13 Hz) and fast (13-15 Hz) spindles in the consolidation process of a motor sequence learning task (MSL). Young subjects (n = 12) were trained on both a finger MSL task and a control (CTRL) condition, which were administered one week apart in a counterbalanced order. Subjects were asked to practice the MSL or CTRL task in the evening (approximately 9:00 p.m.) and their performance was retested on the same task 12h later (approximately 9:00 a.m.). Polysomnographic (PSG) recordings were performed during the night following training on either task, and an automatic algorithm was used to detect fast and slow spindles and to quantify their characteristics (i.e., density, amplitude, and duration). Statistical analyses revealed higher fast (but not slow) spindle density after training on the MSL than after practice of the CTRL task. The increase in fast spindle density on the MSL task correlated positively with overnight performance gains on the MSL task and with difference in performance gain between the MSL and CTRL tasks. Together, these results suggest that fast sleep spindles help activate the cerebral network involved in overnight MSL consolidation, while slow spindles do not appear to play a role in this mnemonic process.

Involvement of human left dorsolateral prefrontal cortex in perceptual decision making is independent of response modality.

Perceptual decision making typically entails the processing of sensory signals, the formation of a decision, and the planning and execution of a motor response. Although recent studies in monkeys and humans have revealed possible neural mechanisms for perceptual decision making, much less is known about how the decision is subsequently transformed into a motor action and whether or not the decision is represented at an abstract level, i.e., independently of the specific motor response. To address this issue, we used functional MRI to monitor changes in brain activity while human subjects discriminated the direction of motion in random-dot visual stimuli that varied in coherence and responded with either button presses or saccadic eye movements. We hypothesized that areas representing decision variables should respond more to high- than to low-coherence stimuli independent of the motor system used to express a decision. Four areas were found that fulfilled this condition: left posterior dorsolateral prefrontal cortex (DLPFC), left posterior cingulate cortex, left inferior parietal lobule, and left fusifom/parahippocampal gyrus. We previously found that, when subjects made categorical decisions about degraded face and house stimuli, left posterior DLPFC showed a greater response to high- relative to low-coherence stimuli. Furthermore, the left posterior DLPFC appears to perform a comparison of signals from sensory processing areas during perceptual decision making. These data suggest that the involvement of left posterior DLPFC in perceptual decision making transcends both task and response specificity, thereby enabling a flexible link among sensory evidence, decision, and action.

A general mechanism for perceptual decision-making in the human brain.

Findings from single-cell recording studies suggest that a comparison of the outputs of different pools of selectively tuned lower-level sensory neurons may be a general mechanism by which higher-level brain regions compute perceptual decisions. For example, when monkeys must decide whether a noisy field of dots is moving upward or downward, a decision can be formed by computing the difference in responses between lower-level neurons sensitive to upward motion and those sensitive to downward motion. Here we use functional magnetic resonance imaging and a categorization task in which subjects decide whether an image presented is a face or a house to test whether a similar mechanism is also at work for more complex decisions in the human brain and, if so, where in the brain this computation might be performed. Activity within the left dorsolateral prefrontal cortex is greater during easy decisions than during difficult decisions, covaries with the difference signal between face- and house-selective regions in the ventral temporal cortex, and predicts behavioural performance in the categorization task. These findings show that even for complex object categories, the comparison of the outputs of different pools of selectively tuned neurons could be a general mechanism by which the human brain computes perceptual decisions.

Neural processing of emotional faces requires attention.

Attention gates the processing of stimuli relatively early in visual cortex. Yet, existing data suggest that emotional stimuli activate brain regions automatically, largely immune from attentional control. To resolve this puzzle, we used functional magnetic resonance imaging to first measure activation in regions that responded differentially to faces with emotional expressions (fearful and happy) compared with neutral faces. We then measured the modulation of these responses by attention, using a competing task with a high attentional load. Contrary to the prevailing view, all brain regions responding differentially to emotional faces, including the amygdala, did so only when sufficient attentional resources were available to process the faces. Thus, the processing of facial expression appears to be under top-down control.

Modulation of sensory suppression: implications for receptive field sizes in the human visual cortex.

Neurophysiological studies in monkeys show that when multiple visual stimuli appear simultaneously in the visual field, they are not processed independently, but rather interact in a mutually suppressive way. This suggests that multiple stimuli compete for neural representation. Consistent with this notion, we have previously found in humans that functional magnetic resonance imaging (fMRI) signals in V1 and ventral extrastriate areas V2, V4, and TEO are smaller for simultaneously presented (i.e., competing) stimuli than for the same stimuli presented sequentially (i.e., not competing). Here we report that suppressive interactions between stimuli are also present in dorsal extrastriate areas V3A and MT, and we compare these interactions to those in areas V1 through TEO. To exclude the possibility that the differences in responses to simultaneously and sequentially presented stimuli were due to differences in the number of transient onsets, we tested for suppressive interactions in area V4, in an experiment that held constant the number of transient onsets. We found that the fMRI response to a stimulus in the upper visual field was suppressed by the presence of nearby stimuli in the lower visual field. Further, we excluded the possibility that the greater fMRI responses to sequential compared with simultaneous presentations were due to exogeneous attentional cueing by having our subjects count T's or L's at fixation, an attentionally demanding task. Behavioral testing demonstrated that neither condition interfered with performance of the T/L task. Our previous findings suggested that suppressive interactions among nearby stimuli in areas V1 through TEO were scaled to the receptive field (RF) sizes of neurons in those areas. Here we tested this idea by parametrically varying the spatial separation among stimuli in the display. Display sizes ranged from 2 x 2 degrees to 7 x 7 degrees and were centered at 5.5 degrees eccentricity. Based on the effects of display size on the magnitude of suppressive interactions, we estimated that RF sizes at an eccentricity of 5.5 degrees were <2 degrees in V1, 2-4 degrees in V2, 4-6 degrees in V4, larger than 7 degrees (but still confined to a quadrant) in TEO, and larger than 6 degrees (confined to a quadrant) in V3A. These estimates of RF sizes in human visual cortex are strikingly similar to those measured in physiological mapping studies in the homologous visual areas in monkeys.

The neural basis of biased competition in human visual cortex.

A typical scene contains many different objects that compete for neural representation due to the limited processing capacity of the visual system. At the neural level, competition among multiple stimuli is evidenced by the mutual suppression of their visually evoked responses and occurs most strongly at the level of the receptive field. The competition among multiple objects can be biased by both bottom-up sensory-driven mechanisms and top-down influences, such as selective attention. Functional brain imaging studies reveal that biasing signals due to selective attention can modulate neural activity in visual cortex not only in the presence, but also in the absence of visual stimulation. Although the competition among stimuli for representation is ultimately resolved within visual cortex, the source of top-down biasing signals likely derives from a distributed network of areas in frontal and parietal cortex. Attention-related activity in frontal and parietal areas does not reflect attentional modulation of visually evoked responses, but rather the attentional operations themselves.

Contextual modulation in primary visual cortex of macaques.

Recent studies have suggested that V1 neurons extract figures from their backgrounds, in that they respond better to interior features of figures than to equivalent features of background stimuli. This is reportedly true even when the figure boundaries are distant from the borders of the classical receptive field (RF). To test the role of V1 neurons in figure-ground segregation, we recorded their responses to texture figures on texture backgrounds, centered on the RF. The texture elements of the figures remained identical across trials, and figure boundaries were defined by orientation differences between the elements in the background texture relative to elements in the figure. For nearly all neurons (98/102), responses to a large texture figure did not differ from the responses to a uniform-texture background. Although many neurons gave enhanced responses to texture boundaries, this occurred only when the boundaries were within or close to the RF borders. Similar effects were found in V2. For neurons in V1, the limited spatial extent of the contextual modulation was not increased either at low stimulus contrast or when the animal was rewarded for detecting an orientation-defined figure. Thus, V1 neurons appear to signal texture boundaries rather than figures per se. Unexpectedly, many V1 neurons gave significant long-latency responses to texture stimuli located entirely outside the classical RF, up to 5 degrees from the RF border in some cases. However, these responses did not depend on the stimulus forming a figure that contained the RF. Although V1 neurons are influenced by stimuli outside the classical RF, they do not appear to segregate figures from ground.

Mechanisms of visual attention in the human cortex.

A typical scene contains many different objects that, because of the limited processing capacity of the visual system, compete for neural representation. The competition among multiple objects in visual cortex can be biased by both bottom-up sensory-driven mechanisms and top-down influences, such as selective attention. Functional brain imaging studies reveal that, both in the absence and in the presence of visual stimulation, biasing signals due to selective attention can modulate neural activity in visual cortex in several ways. Although the competition among stimuli for representation is ultimately resolved within visual cortex, the source of top-down biasing signals derives from a network of areas in frontal and parietal cortex.

Distinguishing the functional roles of multiple regions in distributed neural systems for visual working memory.

We have investigated the human neural systems for visual working memory using functional magnetic resonance imaging to distinguish sustained activity during memory delays from transient responses related to perceptual and motor operations. These studies have identified six distinct frontal regions that demonstrate sustained activity during memory delays. These regions could be distinguished from brain regions in extrastriate cortex that participate more in perception and from brain regions in medial and lateral frontal cortex that participate more in motor control. Moreover, the working memory regions could be distinguished from each other based on the relative strength of their participation in spatial and face working memory and on the relative strength of sustained activity during memory delays versus transient activity related to stimulus presentation. These results demonstrate that visual working memory performance involves the concerted activity of multiple regions in a widely distributed system. Distinctions between functions, such as perception versus memory maintenance, or spatial versus face working memory, are a matter of the degree of participation of different regions, not the discrete parcellation of different functions to different modules.

Texture segregation in the human visual cortex: A functional MRI study.

The segregation of visual scenes based on contour information is a fundamental process of early vision. Contours can be defined by simple cues, such as luminance, as well as by more complex cues, such as texture. Single-cell recording studies in monkeys suggest that the neural processing of complex contours starts as early as primary visual cortex. Additionally, lesion studies in monkeys indicate an important contribution of higher order areas to these processes. Using functional MRI, we have investigated the level at which neural correlates of texture segregation can be found in the human visual cortex. Activity evoked by line textures, with and without texture-defined boundaries, was compared in five healthy subjects. Areas V1, V2/VP, V4, TEO, and V3A were activated by both kinds of line textures as compared with blank presentations. Textures with boundaries forming a checkerboard pattern, relative to uniform textures, evoked significantly more activity in areas V4, TEO, less reliably in V3A, but not in V1 or V2/VP. These results provide evidence that higher order areas with large receptive fields play an important role in the segregation of visual scenes based on texture-defined boundaries.

Visual cortical projections and chemoarchitecture of macaque monkey pulvinar.

We investigated the patterns of projections from the pulvinar to visual areas V1, V2, V4, and MT, and their relationships to pulvinar subdivisions based on patterns of calbindin (CB) immunostaining and estimates of visual field maps (P(1), P(2) and P(3)). Multiple retrograde tracers were placed into V1, V2, V4, and/or MT in 11 adult macaque monkeys. The inferior pulvinar (PI) was subdivided into medial (PI(M)), posterior (PI(P)), central medial (PI(CM)), and central lateral (PI(CL)) regions, confirming earlier CB studies. The P(1) map includes PI(CL) and the ventromedial portion of the lateral pulvinar (PL), P(2) is found in ventrolateral PL, and P(3) includes PI(P), PI(M), and PI(CM). Projections to areas V1 and V2 were found to be overlapping in P(1) and P(2), but those from P(2) to V2 were denser than those to V1. V2 also received light projections from PI(CM) and, less reliably, from PI(M). Neurons projecting to V4 and MT were more abundant than those projecting to V1 and V2. Those projecting to V4 were observed in P(1), densely in P(2), and also in PI(CM) and PI(P) of P(3). Those projecting to MT were found in P(1)- P(3), with the heaviest projection from P(3). Projections from P(3) to MT and V4 were mainly interdigitated, with the densest to MT arising from PI(M) and the densest to V4 arising from PI(P) and PI(CM). Because the calbindin-rich and -poor regions of P(3) corresponded to differential patterns of cortical connectivity, the results suggest that CB may further delineate functional subdivisions in the pulvinar.

Distinguishing the functional roles of multiple regions in distributed neural systems for visual working memory.

We have investigated the human neural systems for visual working memory using functional magnetic resonance imaging to distinguish sustained activity during memory delays from transient responses related to perceptual and motor operations. These studies have identified six distinct frontal regions that demonstrate sustained activity during memory delays. These regions could be distinguished from brain regions in extrastriate cortex that participate more in perception and from brain regions in medial and lateral frontal cortex that participate more in motor control. Moreover, the working memory regions could be distinguished from each other based on the relative strength of their participation in spatial and face working memory and on the relative strength of sustained activity during memory delays versus transient activity related to stimulus presentation. These results demonstrate that visual working memory performance involves the concerted activity of multiple regions in a widely distributed system. Distinctions between functions, such as perception versus memory maintenance, or spatial versus face working memory, are a matter of the degree of participation of different regions, not the discrete parcellation of different functions to different modules.

Complementary neural mechanisms for tracking items in human working memory.

Recognition of a specific visual target among equally familiar distracters requires neural mechanisms for tracking items in working memory. Event-related functional magnetic resonance imaging revealed evidence for two such mechanisms: (i) Enhanced neural responses, primarily in the frontal cortex, were associated with the target and were maintained across repetitions of the target. (ii) Reduced responses, primarily in the extrastriate visual cortex, were associated with stimulus repetition, regardless of whether the stimulus was a target or a distracter. These complementary neural mechanisms track the status of familiar items in working memory, allowing for the efficient recognition of a currently relevant object and rejection of irrelevant distracters.

Distributed neural systems for the generation of visual images.

Visual perception of houses, faces, and chairs evoke differential responses in ventral temporal cortex. Using fMRI, we compared activations evoked by perception and imagery of these object categories. We found content-related activation during imagery in extrastriate cortex, but this activity was restricted to small subsets of the regions that showed category-related activation during perception. Within ventral temporal cortex, activation during imagery evoked stronger responses on the left whereas perception evoked stronger responses on the right. Additionally, visual imagery evoked activity in parietal and frontal cortex, but this activity was not content related. These results suggest that content-related activation during imagery in visual extrastriate cortex may be implemented by "top-down" mechanisms in parietal and frontal cortex that mediate the retrieval of face and object representations from long-term memory and their maintenance through visual imagery.

The representation of objects in the human occipital and temporal cortex.

Recently, we identified, using fMRI, three bilateral regions in the ventral temporal cortex that responded preferentially to faces, houses, and chairs [Ishai, A., Ungerleider, L. G., Martin, A., Schouten, J. L., & Haxby, J. V. (1999). Distributed representation of objects in the human ventral visual pathway. Proceedings of the National Academy of Sciences, U.S.A., 96, 9379--9384]. Here, we report differential patterns of activation, similar to those seen in the ventral temporal cortex, in bilateral regions of the ventral occipital cortex. We also found category-related responses in the dorsal occipital cortex and in the superior temporal sulcus. Moreover, rather than activating discrete, segregated areas, each category was associated with its own differential pattern of response across a broad expanse of cortex. The distributed patterns of response were similar across tasks (passive viewing, delayed matching) and presentation formats (photographs, line drawings). We propose that the representation of objects in the ventral visual pathway, including both occipital and temporal regions, is not restricted to small, highly selective patches of cortex but, instead, is a distributed representation of information about object form. Within this distributed system, the representation of faces appears to be less extensive as compared to the representations of nonface objects.

Distributed representation of objects in the human ventral visual pathway.

Brain imaging and electrophysiological recording studies in humans have reported discrete cortical regions in posterior ventral temporal cortex that respond preferentially to faces, buildings, and letters. These findings suggest a category-specific anatomically segregated modular organization of the object vision pathway. Here we present data from a functional MRI study in which we found three distinct regions of ventral temporal cortex that responded preferentially to faces and two categories of other objects, namely houses and chairs, and had a highly consistent topological arrangement. Although the data could be interpreted as evidence for separate modules, we found that each category also evoked significant responses in the regions that responded maximally to other stimuli. Moreover, each category was associated with its own differential pattern of response across ventral temporal cortex. These results indicate that the representation of an object is not restricted to a region that responds maximally to that object, but rather is distributed across a broader expanse of cortex. We propose that the functional architecture of the ventral visual pathway is not a mosaic of category-specific modules but instead is a continuous representation of information about object form that has a highly consistent and orderly topological arrangement.

Loss of attentional stimulus selection after extrastriate cortical lesions in macaques.

Many objects in natural visual scenes compete for attention. To identify the neural mechanisms necessary for visual attention, we made restricted lesions, affecting different quadrants of the visual field but leaving one quadrant intact, in extrastriate cortical areas V4 and TEO of two monkeys. Monkeys were trained to discriminate the orientation of a target grating surrounded by distracters. As distracter contrast increased, performance deteriorated in quadrants affected by V4 and TEO lesions, but not in the normal quadrant. Performance in affected quadrants was restored by increasing the contrast of the target relative to distracters. Thus, without V4 and TEO, visual attention is 'captured' by strong stimuli, regardless of their behavioral relevance.

Increased activity in human visual cortex during directed attention in the absence of visual stimulation.

When subjects direct attention to a particular location in a visual scene, responses in the visual cortex to stimuli presented at that location are enhanced, and the suppressive influences of nearby distractors are reduced. What is the top-down signal that modulates the response to an attended versus an unattended stimulus? Here, we demonstrate increased activity related to attention in the absence of visual stimulation in extrastriate cortex when subjects covertly directed attention to a peripheral location expecting the onset of visual stimuli. Frontal and parietal areas showed a stronger signal increase during this expectation than did visual areas. The increased activity in visual cortex in the absence of visual stimulation may reflect a top-down bias of neural signals in favor of the attended location, which derives from a fronto-parietal network.

The effect of face inversion on activity in human neural systems for face and object perception.

The differential effect of stimulus inversion on face and object recognition suggests that inverted faces are processed by mechanisms for the perception of other objects rather than by face perception mechanisms. We investigated the face inversion using functional magnetic resonance imaging (fMRI). The principal effect of face inversion on was an increased response in ventral extrastriate regions that respond preferentially to another class of objects (houses). In contrast, house inversion did not produce a similar change in face-selective regions. Moreover, stimulus inversion had equivalent, minimal effects for faces in in face-selective regions and for houses in house-selective regions. The results suggest that the failure of face perception systems with inverted faces leads to the recruitment of processing resources in object perception systems, but this failure is not reflected by altered activity in face perception systems.