Visual perception of texture regularity: Conjoint measurements and a wavelet response-distribution model.

Texture regularity, such as the repeating pattern in a carpet, brickwork or tree bark, is a ubiquitous feature of the visual world. The perception of regularity has generally been studied using multi-element textures in which the degree of regularity has been manipulated by adding random jitter to the elements' positions. Here we used three-factor Maximum Likelihood Conjoint Measurement (MLCM) for the first time to investigate the encoding of regularity information under more complex conditions in which element spacing and size, in addition to positional jitter, were manipulated. Human observers were presented with large numbers of pairs of multi-element stimuli with varying levels of the three factors, and indicated on each trial which stimulus appeared more regular. All three factors contributed to regularity perception. Jitter, as expected, strongly affected regularity perception. This effect of jitter on regularity perception is strongest at small element spacing and large texture element size, suggesting that the visual system utilizes the edge-to-edge distance between elements as the basis for regularity judgments. We then examined how the responses of a bank of Gabor wavelet spatial filters might account for our results. Our analysis indicates that the peakedness of the spatial frequency (SF) distribution, a previously favored proposal, is insufficient for regularity encoding since it varied more with element spacing and size than with jitter. Instead, our results support the idea that the visual system may extract texture regularity information from the moments of the SF-distribution across orientation. In our best-performing model, the variance of SF-distribution skew across orientations can explain 70% of the variance of estimated texture regularity from our data, suggesting that it could provide a candidate read-out for perceived regularity.

Perceived regularity of a texture is influenced by the regularity of a surrounding texture.

Previous studies have shown that texture regularity is adaptable, and have suggested that texture regularity might be coded by the peakedness of the underlying spatial frequency distribution. Here we demonstrate the related phenomenon of simultaneous regularity contrast (SRC), in which the perceived regularity of a central texture is influenced by the regularity of a surrounding texture. We presented center-surround arrangements of textures and measured the perceived regularity of the centre, using a centre-only comparison stimulus and a 2AFC procedure. From the resulting psychometric functions the SRC was measured as the difference between test and comparison regularity at the PSE (point of subjective equality). Observers generally exhibited asymmetric bidirectional SRC, in that more regular surrounds decreased the perceived regularity of the centre by between 20-40%, while less regular surrounds increased the perceived regularity of the centre by about 10%. Consistent with previous studies, a wavelet spatial frequency (SF) analysis of the stimuli revealed that their SF distributions became sharper with increased regularity, and therefore that distribution statistics such as kurtosis and SF bandwidth might be used to code regularity.

Simultaneous density contrast and binocular integration.

Most research on texture density has utilized textures rendered as two-dimensional (2D) planar surfaces, consistent with the conventional definition of density as the number of texture elements per unit area. How the brain represents texture density information in the three-dimensional (3D) world is not yet clear. Here we tested whether binocular information affects density processing using simultaneous density contrast (SDC), in which the perceived density of a texture region is changed by a surround of different density. We considered the effect on SDC of two types of binocular information: the stereoscopic depth relationships and the interocular relationships between the center and surround textures. Observers compared the perceived density of two random dot patterns, one with a surround (test stimulus) and one without (match), using a 2AFC staircase procedure. In Experiment 1 we manipulated the stereo-depth of the surround plane systematically from near to far, relative to the center plane. SDC was reduced when the difference in stereo-depth between test center and surround increased. In Experiment 2 we spread the surround dots randomly across a stereo-depth volume from small to large volume sizes, and found that SDC was slightly reduced with volume size. The decrease of SDC in both experiments was observed with dense surrounds only, but not with sparse surrounds. In the last experiment we presented center and surround in the same depth plane but dichopticly, monopticly, and binocularly. A strong interocular transfer of SDC was found in the dichoptic condition. Together these results show that texture density processing is sensitive to binocularity.

Texture density adaptation can be bidirectional.

Texture density has previously been thought of as a scalar attribute on the assumption that texture density adaptation only reduces, not enhances, perceived density (Durgin & Huk, 1997). This "unidirectional" property of density adaptation is in contradistinction to the finding that simultaneous density contrast (SDC) is "bidirectional"; that is, not only do denser surrounds reduce the perceived density of a lower density region, but sparser surrounds enhance it (Sun, Baker, & Kingdom, 2016). Here we reexamine the directionality of density adaptation using random dot patterns and a two-alternative forced choice task in which observers compare the perceived density of adapted test patches with unadapted match stimuli. In the first experiment, we observed a unidirectional density aftereffect when test and match were presented simultaneously as in previous studies. However, when they were presented sequentially, bidirectionality was obtained. This bidirectional aftereffect remained when the presentation order of test and match was reversed (second experiment). In the third experiment, we used sequential presentation to measure the density aftereffect for a wide range of adaptor densities (0-73 dots/deg2) and test densities (1.6, 6.4, and 25.6 dots/deg2). We found bidirectionality for all combinations of adaptor and test densities, consistent with our previous SDC results. This evidence supports the idea that there are multiple channels selective to texture density in human vision.

Simultaneous density contrast is bidirectional.

Simultaneous density contrast, or SDC, is the phenomenon in which the perceived density of a textured region is altered by a surround of different density (Mackay, 1973). SDC provides an experimental tool to investigate mechanisms of density coding, yet has not been systematically examined. We measured SDC with a 2AFC staircase procedure in which human observers judged which of two patterns, one with and one without a surround, appeared more dense. We used a range of surround densities varying from very sparse to very dense (0-76.8 dots/deg2), and two center test densities (6.4 and 12.8 dots/deg2). Psychometric functions were used to estimate both the points of subjective equality (PSE) and their precision. Unexpectedly we find a bidirectional SDC effect across the five observers: Not only does a denser surround reduce perceived density of the center, but a sparser surround enhances its perceived density. We also show that SDC is not mediated by either contrast-contrast or spatial-frequency contrast. Our results suggest the presence of multiple channels selective for texture density, with lateral inhibitory interactions between them.

Differential processing of binocular and monocular gloss cues in human visual cortex.

The visual impression of an object's surface reflectance ("gloss") relies on a range of visual cues, both monocular and binocular. Whereas previous imaging work has identified processing within ventral visual areas as important for monocular cues, little is known about cortical areas involved in processing binocular cues. Here, we used human functional MRI (fMRI) to test for brain areas selectively involved in the processing of binocular cues. We manipulated stereoscopic information to create four conditions that differed in their disparity structure and in the impression of surface gloss that they evoked. We performed multivoxel pattern analysis to find areas whose fMRI responses allow classes of stimuli to be distinguished based on their depth structure vs. material appearance. We show that higher dorsal areas play a role in processing binocular gloss information, in addition to known ventral areas involved in material processing, with ventral area lateral occipital responding to both object shape and surface material properties. Moreover, we tested for similarities between the representation of gloss from binocular cues and monocular cues. Specifically, we tested for transfer in the decoding performance of an algorithm trained on glossy vs. matte objects defined by either binocular or by monocular cues. We found transfer effects from monocular to binocular cues in dorsal visual area V3B/kinetic occipital (KO), suggesting a shared representation of the two cues in this area. These results indicate the involvement of mid- to high-level visual circuitry in the estimation of surface material properties, with V3B/KO potentially playing a role in integrating monocular and binocular cues.

Look but don't touch: Visual cues to surface structure drive somatosensory cortex.

When planning interactions with nearby objects, our brain uses visual information to estimate shape, material composition, and surface structure before we come into contact with them. Here we analyse brain activations elicited by different types of visual appearance, measuring fMRI responses to objects that are glossy, matte, rough, or textured. In addition to activation in visual areas, we found that fMRI responses are evoked in the secondary somatosensory area (S2) when looking at glossy and rough surfaces. This activity could be reliably discriminated on the basis of tactile-related visual properties (gloss, rough, and matte), but importantly, other visual properties (i.e., coloured texture) did not substantially change fMRI activity. The activity could not be solely due to tactile imagination, as asking explicitly to imagine such surface properties did not lead to the same results. These findings suggest that visual cues to an object's surface properties evoke activity in neural circuits associated with tactile stimulation. This activation may reflect the a-priori probability of the physics of the interaction (i.e., the expectation of upcoming friction) that can be used to plan finger placement and grasp force.

fMRI evidence for areas that process surface gloss in the human visual cortex.

Surface gloss is an important cue to the material properties of objects. Recent progress in the study of macaque's brain has increased our understating of the areas involved in processing information about gloss, however the homologies with the human brain are not yet fully understood. Here we used human functional magnetic resonance imaging (fMRI) measurements to localize brain areas preferentially responding to glossy objects. We measured cortical activity for thirty-two rendered three-dimensional objects that had either Lambertian or specular surface properties. To control for differences in image structure, we overlaid a grid on the images and scrambled its cells. We found activations related to gloss in the posterior fusiform sulcus (pFs) and in area V3B/KO. Subsequent analysis with Granger causality mapping indicated that V3B/KO processes gloss information differently than pFs. Our results identify a small network of mid-level visual areas whose activity may be important in supporting the perception of surface gloss.