Stability of the color-opponent signals under changes of illuminant in natural scenes.

Illumination varies greatly both across parts of a natural scene and as a function of time, whereas the spectral reflectance function of surfaces remains more stable and is of much greater relevance when searching for specific targets. This study investigates the functional properties of postreceptoral opponent-channel responses, in particular regarding their stability against spatial and temporal variation in illumination. We studied images of natural scenes obtained in UK and Uganda with digital cameras calibrated to produce estimated L-, M-, and S-cone responses of trichromatic primates (human) and birds (starling). For both primates and birds we calculated luminance and red-green opponent (RG) responses. We also calculated a primate blue-yellow-opponent (BY) response. The BY response varies with changes in illumination, both across time and across the image, rendering this factor less invariant. The RG response is much more stable than the BY response across such changes in illumination for primates, less so for birds. These differences between species are due to the greater separation of bird L and M cones in wavelength and the narrower bandwidth of the cone action spectra. This greater separation also produces a larger chromatic signal for a given change in spectral reflectance. Thus bird vision seems to suffer a greater degree of spatiotemporal "clutter" than primate vision, but also enhances differences between targets and background. Therefore, there may be a trade-off between the degree of chromatic clutter in a visual system versus the degree of chromatic difference between a target and its background. Primate and bird visual systems have found different solutions to this trade-off.

The effects of amplitude-spectrum statistics on foveal and peripheral discrimination of changes in natural images, and a multi-resolution model.

Psychophysical thresholds were measured for discriminating small changes in spatial features of naturalistic scenes (morph sequences), for foveal and peripheral vision, and under M-scaling. Sensitivity was greatest for scenes with near natural Fourier amplitude slope, perhaps implying that human vision is optimised for natural scene statistics. A low-level model calculated differences in local contrast between pairs of images within a few spatial frequency channels with bandwidth like neurons in V1. The model was "customised" to each observer's contrast sensitivity function for sinusoidal gratings, and it could replicate the "U-shaped" relationships between discrimination threshold and spectral slope, and many differences between picture sets and observers. A single-channel model and an ideal-observer analysis both failed to capture the U-shape.

Spatiochromatic properties of natural images and human vision.

The human visual system shows a relatively greater response to low spatial frequencies of chromatic spatial modulation than to luminance spatial modulation. However, previous work has shown that this differential sensitivity to low spatial frequencies is not reflected in any differential luminance and chromatic content of general natural scenes. This is contrary to the prevailing assumption that the spatial properties of human vision ought to reflect the structure of natural scenes. Now, colorimetric measures of scenes suggest that red-green (and perhaps blue-yellow) color discrimination in primates is particularly suited to the encoding of specific scenes: reddish or yellowish objects on a background of leaves. We therefore ask whether the spatial, as well as chromatic, properties of such scenes are matched to the different spatial-encoding properties of color and luminance modulation in human vision. We show that the spatiochromatic properties of a wide class of scenes, which contain reddish objects (e.g., fruit) on a background of leaves, correspond well to the properties of the red-green (but not blue-yellow) systems in human vision, at viewing distances commensurate with typical grasping distance. This implies that the red-green system is particularly suited to encoding both the spatial and the chromatic structure of such scenes.

The human visual system is optimised for processing the spatial information in natural visual images.

A fundamental tenet of visual science is that the detailed properties of visual systems are not capricious accidents, but are closely matched by evolution and neonatal experience to the environments and lifestyles in which those visual systems must work. This has been shown most convincingly for fish and insects. For mammalian vision, however, this tenet is based more upon theoretical arguments than upon direct observations. Here, we describe experiments that require human observers to discriminate between pictures of slightly different faces or objects. These are produced by a morphing technique that allows small, quantifiable changes to be made in the stimulus images. The independent variable is designed to give increasing deviation from natural visual scenes, and is a measure of the Fourier composition of the image (its second-order statistics). Performance in these tests was best when the pictures had natural second-order spatial statistics, and degraded when the images were made less natural. Furthermore, performance can be explained with a simple model of contrast coding, based upon the properties of simple cells in the mammalian visual cortex. The findings thus provide direct empirical support for the notion that human spatial vision is optimised to the second-order statistics of the optical environment.

The effect of contrast randomisation on the discrimination of changes in the slopes of the amplitude spectra of natural scenes.

It has been suggested (Tadmor and Tolhurst, 1994 Vision Research 34 541-554) that the psychophysical task of discriminating changes in the slope of the amplitude spectrum of a complex image may be similar to detecting differences in the degree of blur. It has also been suggested that human observers may perform this discrimination by detecting changes in the effective contrast within single narrow spatial-frequency bands, rather than by detecting changes in the slope per se which would involve the use of contrast information across many different frequency bands. To distinguish between these two possibilities, we have developed an experiment where observers were asked to discriminate changes in the spectral slope while different amounts of random contrast variation were introduced, with the purpose of disrupting their performance. This disruptive effect was designed to be particularly manifest if the observer really was performing a single-frequency-band contrast discrimination but to be unnoticeable if the observer was discriminating the change of slope per se. Our results imply that the observers do not usually detect changes in contrast in just one narrow spatial-frequency band when they discriminate changes in the slope of the amplitude spectrum. Rather, they must compare contrast between bands or, at least, they use contrast information from more than one band. However, for edge-enhanced (whitened) pictures, there is some evidence to suggest that observers rely on contrast changes in only a limited low-spatial-frequency band.

Color and luminance information in natural scenes.

The spatial filtering applied by the human visual system appears to be low pass for chromatic stimuli and band pass for luminance stimuli. Here we explore whether this observed difference in contrast sensitivity reflects a real difference in the components of chrominance and luminance in natural scenes. For this purpose a digital set of 29 hyperspectral images of natural scenes was acquired and its spatial frequency content analyzed in terms of chrominance and luminance defined according to existing models of the human cone responses and visual signal processing. The statistical 1/f amplitude spatial-frequency distribution is confirmed for a variety of chromatic conditions across the visible spectrum. Our analysis suggests that natural scenes are relatively rich in high-spatial-frequency chrominance information that does not appear to be transmitted by the human visual system. This result is unlikely to have arisen from errors in the original measurements. Several reasons may combine to explain a failure to transmit high-spatial-frequency chrominance: (a) its minor importance for primate visual tasks, (b) its removal by filtering applied to compensate for chromatic aberration of the eye's optics, and (c) a biological bottleneck blocking its transmission. In addition, we graphically compare the ratios of luminance to chrominance measured by our hyperspectral camera and those measured psychophysically over an equivalent spatial-frequency range.