Spatio-temporal prediction and inference by V1 neurons.

In normal vision, visual scenes are predictable, as they are both spatially and temporally redundant. Evidence suggests that the visual system may use the spatio-temporal regularities of the external world, available in the retinal signal, to extract information from the visual environment and better reconstruct current and future stimuli. We studied this by recording neuronal responses of primary visual cortex (area V1) in anaesthetized and paralysed macaques during the presentation of dynamic sequences of bars, in which spatio-temporal regularities and local information were independently manipulated. Most V1 neurons were significantly modulated by events prior to and distant from stimulation of their classical receptive fields (CRFs); many were more strongly tuned to prior and distant events than they were to CRFs bars; and several showed tuning to prior information without any CRF stimulation. Hence, V1 neurons do not simply analyse local contours, but impute local features to the visual world, on the basis of prior knowledge of a visual world in which useful information can be distributed widely in space and time.

Longer fixation duration while viewing face images.

The spatio-temporal properties of saccadic eye movements can be influenced by the cognitive demand and the characteristics of the observed scene. Probably due to its crucial role in social communication, it is argued that face perception may involve different cognitive processes compared with non-face object or scene perception. In this study, we investigated whether and how face and natural scene images can influence the patterns of visuomotor activity. We recorded monkeys' saccadic eye movements as they freely viewed monkey face and natural scene images. The face and natural scene images attracted similar number of fixations, but viewing of faces was accompanied by longer fixations compared with natural scenes. These longer fixations were dependent on the context of facial features. The duration of fixations directed at facial contours decreased when the face images were scrambled, and increased at the later stage of normal face viewing. The results suggest that face and natural scene images can generate different patterns of visuomotor activity. The extra fixation duration on faces may be correlated with the detailed analysis of facial features.

Centre-surround interactions in response to natural scene stimulation in the primary visual cortex.

Centre-surround interaction in the primary visual cortex (area V1) has been studied extensively using artificial, abstract stimulus patterns, such as bars, gratings and simple texture patterns. In this experiment, we extend the study of centre-surround interaction by using natural scene images. We systematically varied the contrast of natural image surrounds presented outside the classical receptive field (CRF), and recorded neuronal response to a natural image patch presented within the CRF in area V1 of awake, fixating macaques. For the majority of neurons (67 out of 111), the natural image surrounds profoundly modulated, mainly by suppressing, neuronal responses to CRF images. These modulatory effects started at the earliest stage of neuronal responses, and often depended on the contrast and higher-order structures of the surrounds. For 47 out of 67 neurons, randomising the phases of the Fourier spectrum of the natural image surround diminished the centre-surround interaction. Our results suggest that the centre-surround interaction in area V1 can be extended to natural vision, and is sensitive to the higher-order structures of natural scene images, such as image contours.

Effects on orientation perception of manipulating the spatio-temporal prior probability of stimuli.

Spatial and temporal regularities commonly exist in natural visual scenes. The knowledge of the probability structure of these regularities is likely to be informative for an efficient visual system. Here we explored how manipulating the spatio-temporal prior probability of stimuli affects human orientation perception. Stimulus sequences comprised four collinear bars (predictors) which appeared successively towards the foveal region, followed by a target bar with the same or different orientation. Subjects' orientation perception of the foveal target was biased towards the orientation of the predictors when presented in a highly ordered and predictable sequence. The discrimination thresholds were significantly elevated in proportion to increasing prior probabilities of the predictors. Breaking this sequence, by randomising presentation order or presentation duration, decreased the thresholds. These psychophysical observations are consistent with a Bayesian model, suggesting that a predictable spatio-temporal stimulus structure and an increased probability of collinear trials are associated with the increasing prior expectation of collinear events. Our results suggest that statistical spatio-temporal stimulus regularities are effectively integrated by human visual cortex over a range of spatial and temporal positions, thereby systematically affecting perception.

How do monkeys view faces?--A study of eye movements.

Face perception plays a crucial role in primate social communication. We have investigated the pattern of eye movements produced by rhesus monkeys (Macaca mulatta) as they viewed images of faces. Eye positions were recorded accurately using implanted eye coils, while neutral upright, inverted and scrambled images of monkey and human faces were presented on a computer screen. The monkeys exhibited a similar eye scan pattern while viewing familiar and unfamiliar monkey face images, or while viewing monkey and human face images. No differences were observed in the distribution of viewing times, number of fixations, time into the trial of first saccade to local facial features, and the temporal and spatial characteristics of viewing patterns across the facial images. However, there was a greater probability of re-fixation of the eye region of unfamiliar faces during the first few seconds of the trial suggesting that the eyes are important for the initial encoding of identity. Indeed, the highest fixation density was found in the eye region of all the face images. The viewing duration and the number of fixations per image decreased when inverted or scrambled faces were presented. The eye region in these modified images remained the primary area of fixation. However, the number of fixations directed to the eyes decreased monotonically from the upright images through the inverted versions to the scrambled face images. Nonetheless, the eyes remain the most salient facial substructure regardless of the arrangement of other features, although the extent of salience which they attain may depend both on the low level properties of the eyes and on the global arrangement of facial features.