A binocular rivalry study of motion perception in the human brain.

The relationship between brain activity and conscious visual experience is central to our understanding of the neural mechanisms underlying perception. Binocular rivalry, where monocular stimuli compete for perceptual dominance, has been previously used to dissociate the constant stimulus from the varying percept. We report here fMRI results from humans experiencing binocular rivalry under a dichoptic stimulation paradigm that consisted of two drifting random dot patterns with different motion coherence. Each pattern had also a different color, which both enhanced rivalry and was used for reporting which of the two patterns was visible at each time. As the perception of the subjects alternated between coherent motion and motion noise, we examined the effect that these alternations had on the strength of the MR signal throughout the brain. Our results demonstrate that motion perception is able to modulate the activity of several of the visual areas which are known to be involved in motion processing. More specifically, in addition to area V5 which showed the strongest modulation, a higher activity during the perception of motion than during the perception of noise was also clearly observed in areas V3A and LOC, and less so in area V3. In previous studies, these areas had been selectively activated by motion stimuli but whether their activity reflects motion perception or not remained unclear; here we show that they are involved in motion perception as well. The present findings therefore suggest a lack of a clear distinction between 'processing' versus 'perceptual' areas in the brain, but rather that the areas involved in the processing of a specific visual attribute are also part of the neuronal network that is collectively responsible for its perceptual representation.

The relationship between cortical activation and perception investigated with invisible stimuli.

The aim of this work was to study the relationship between cortical activity and visual perception. To do so, we developed a psychophysical technique that is able to dissociate the visual percept from the visual stimulus and thus distinguish brain activity reflecting the perceptual state from that reflecting other stages of stimulus processing. We used dichoptic color fusion to make identical monocular stimuli of opposite color contrast "disappear" at the binocular level and thus become "invisible" as far as conscious visual perception is concerned. By imaging brain activity in subjects during a discrimination task between face and house stimuli presented in this way, we found that house-specific and face-specific brain areas are always activated in a stimulus-specific way regardless of whether the stimuli are perceived. Absolute levels of cortical activation, however, were lower with invisible stimulation compared with visible stimulation. We conclude that there is no terminal "perceptual" area in the visual brain, but that the brain regions involved in processing a visual stimulus are also involved in its perception, the difference between the two being dictated by a higher level of activity in the specific brain region when the stimulus is perceived.

Responses of spectrally selective cells in macaque area V2 to wavelengths and colors.

We have recorded from wavelength-selective cells in macaque monkey visual area V2, interposed between areas V1 and V4 of the color-specialized pathway, to learn whether their responses correlate with perceived colors or are determined by the wavelength composition of light reflected from their receptive fields. All the cells we recorded from were unselective for the orientation and direction of motion of the stimulus, and all were histologically identified to be in the thin cytochrome oxidase stripes. Using multi-colored "Mondrian" scenes of the appropriate spatial configuration, areas of different color were placed in the receptive field of each cell and the entire scene illuminated by three projectors, passing long-, middle-, and short-wave light, respectively, in various combinations. Our results show that wavelength-selective cells in V2 respond to an area of any color depending on whether or not it reflects a sufficient amount of light of their preferred wavelength. In addition, the responses of a third of the cells tested were also influenced by the wavelength composition of their immediate surrounds, thus signaling the result of a local spatial comparison with respect to the amount of their preferred wavelength present. The responses of all also depended on the sequence with which their receptive fields were illuminated with light of the three different wavebands: cells were activated when there was an increase (and inhibited when there was a decrease) in the amount of their preferred wavelength with respect to the other two; the temporal route taken was therefore a determining factor, and, depending on it, cells would either respond or not to a particular combination of wavelengths. We conclude that although spatiotemporal wavelength comparisons are taking place in the color-specialized subdivisions of area V2, the determination of complete color-constant behavior at the neuronal level requires further processing, in other areas.

A psychophysical dissection of the brain sites involved in color-generating comparisons.

We have used simple psychophysical methods to determine the sites of color-generating mechanisms in the brain. In our first experiment, subjects viewed an abstract multicolored "Mondrian" display through one eye and an isolated patch from the display through the other. With normal binocular/monocular viewing, the patch has a different color when viewed on its own (void mode) or as part of the Mondrian display (natural mode) [Land, E. H. (1974) Proc. R. Inst. G. B. 49, 23-58]. When the two stimuli were viewed dichoptically, with the patch occupying the position that it would occupy in the Mondrian complex under normal viewing, the patch always appeared in its void color. In a second experiment, when subjects viewed multicolored displays through a different narrow-band filter placed over each eye, the information from the two eyes was combined to result in new colors, which were not seen through either of the two eyes alone. Taken together, these results dissect color-generating mechanisms into two stages, located at different sites of the brain: The first occurs before the appearance of binocular neurons in the cortex and compares wavelength information across space, whereas the second occurs after the convergence of the input from the two eyes and synthetically combines the results of the first.

Functional segregation and temporal hierarchy of the visual perceptive systems.

In extending our previous work, we addressed the question of whether different visual attributes are perceived separately when they belong to different objects, rather than the same one. Using our earlier psychophysical method, but separating the attributes to be paired in two different halves of the screen, we found that human subjects misbind the colour and the direction of motion, or the colour and the orientation of lines, because colour, form, and motion are perceived separately and at different times. The results therefore show that there is a perceptual temporal hierarchy in vision.

Temporal hierarchy of the visual perceptive systems in the Mondrian world.

Our earlier psychophysical work has shown that colour and motion are not perceived at the same time, with colour leading motion by about 50-100 ms. In pursuing this work, we thought it would be interesting to use a more complex colour stimulus, one in which the wavelength composition of the light reflected or emitted from surfaces changes continually, without entailing a change in the perceived colour (colour constancy). We therefore used a Mondrian figure--an abstract multi-coloured scene with no recognizable objects--against which squares (either red or green) moved up and down, changing colour from red to green in various phase differences with the change in direction of motion. The red and green squares changed continually in their spectral characteristics, as did every other patch on the Mondrian. The results showed that colour is still perceived before motion, by about 80 ms.

A direct demonstration of perceptual asynchrony in vision.

We have addressed the question of whether, in addition to being processed separately, colour and motion are also perceived separately. We varied continuously the colour and direction of motion of an abstract pattern of squares on a computer screen, and asked subjects to pair the colour of the pattern to its direction of motion. The results showed that subjects misbind the colour and the direction of motion because colour and motion are perceived separately and at different times, colour being perceived first. Hence the brain binds visual attributes that are perceived together, rather than ones that occur together in real time.