Attention-memory interactions in scene perception.

The perception of natural scenes relies on the integration of pre-existing knowledge with the immediate results of attentional processing, and what can be remembered from a scene depends in turn on how that scene is perceived and understood. However, there are conflicting results in the literature as to whether people are more likely to remember those objects that are consistent with the scene or those that are not. Moreover, whether any discrepancy between the likelihood of remembering schema-consistent or schema-inconsistent objects should be attributed to the schematic effects on attention or on memory remains unclear. To address this issue, the current study attempted to directly manipulate attention allocation by requiring participants to look at (i) schema-consistent objects, (ii) schema-inconsistent objects, or (iii) to share attention equally across both. Regardless of the differential allocation of attention or object fixation, schema-consistent objects were better recalled whereas recognition was independent of schema-consistency, but depended on task instruction. These results suggest that attention is important both for remembering low-level object properties, and information whose retrieval is not supported by the currently active schema. Specific knowledge of the scenes being viewed can result in the recall of non-fixated objects, but without such knowledge attention is required to encode sufficient detail for subsequent recognition. Our results demonstrate therefore that attention is not critical for the retrieval of objects that are consistent with a scene's schematic content.

Reflexive shifts of covert attention operate in an egocentric coordinate frame.

Covert shifts of attention have been shown to improve detection and discrimination thresholds for a range of visual stimuli. Although there is some evidence to suggest that the allocation of attention to a particular region of interest occurs in a retinotopic frame of reference, the importance of an allocentric, or object-based, framework has gained widespread empirical support. The current experiment investigates the nature of the spatial representation in which covert shifts of attention occur in response to a reflexive prime. Primes and targets were presented in four conditions designed to vary systematically the validity of the spatial relationship between the prime and target in egocentric or allocentric coordinate frameworks. A significant advantage, in terms of reaction time and correct identification, was found for targets located in positions previously primed in an egocentric (but not allocentric) framework whereas there was no advantage for locations primed in an allocentric (but not egocentric) framework. These results suggest that the allocation of covert spatial attention within an egocentric framework may be more important than previously thought.

The task-dependent use of binocular disparity and motion parallax information.

Binocular disparity and motion parallax are powerful cues to the relative depth between objects. However to recover absolute depth, either additional scaling parameters are required to calibrate the information provided by each cue, or it can be recovered through the combination of information from both cues (Richards, W. (1985). Structure from stereo and motion. Journal of the Optical Society of America, 2, 343-349). However, not all tasks necessarily require a full specification of the absolute depth structure of a scene and so psychophysical performance may vary depending on the amount of information available, and the degree to which absolute depth structure is required. The experiments reported here used three different tasks that varied in the type of geometric information required in order for them to be completed successfully. These included a depth nulling task, a depth-matching task, and an absolute depth judgement (shape) task. Real world stimuli were viewed (i) monocularly with head movements, (ii) binocularly and static, or (iii) binocularly with head movements. No effect of viewing condition was found whereas there was a large effect of task. Performance was accurate on the matching and nulling tasks and much less accurate on the shape task. The fact that the same perceptual distortions were not evident in all tasks suggests that the visual system can switch strategy according to the demands of the particular task. No evidence was found to suggest that the visual system could exploit the simultaneous presence of disparity and motion parallax.

Cue combination in the motion correspondence problem.

Image motion is a primary source of visual information about the world. However, before this information can be used the visual system must determine the spatio-temporal displacements of the features in the dynamic retinal image, which originate from objects moving in space. This is known as the motion correspondence problem. We investigated whether cross-cue matching constraints contribute to the solution of this problem, which would be consistent with physiological reports that many directionally selective cells in the visual cortex also respond to additional visual cues. We measured the maximum displacement limit (Dmax) for two-frame apparent motion sequences. Dmax increases as the number of elements in such sequences decreases. However, in our displays the total number of elements was kept constant while the number of a subset of elements, defined by a difference in contrast polarity, binocular disparity or colour, was varied. Dmax increased as the number of elements distinguished by a particular cue was decreased. Dmax was affected by contrast polarity for all observers, but only some observers were influenced by binocular disparity and others by colour information. These results demonstrate that the human visual system exploits local, cross-cue matching constraints in the solution of the motion correspondence problem.

Spatial frequency tuning for 3-D corrugations from motion parallax.

We provide evidence for the existence of multiple channels tuned to the spatial frequency of depth modulations defined by motion parallax. By linking the distortion of a random dot pattern to the horizontal position of an observer's head horizontally oriented 3-D corrugations were simulated in which the depth function consisted of a range of frequencies. In a baseline experiment thresholds were obtained for detecting depth modulations of single sinewaves for a range of spatial frequencies. In a masking experiment threshold signal strength was determined for detecting a signal frequency in the presence of noise with frequencies restricted to two bands around the signal component ('notched noise'). Threshold elevation was found to decrease with an increase in the spectral difference between signal and noise. By determining thresholds at various noise levels it was further established that the channel responded linearly in the tested range. Estimates of the bandwidth for spatial frequencies of 0.33 and 0.87 cycles/deg were both found to be 1.4 octaves. The results show that motion parallax processing is mediated by a series of narrowly tuned channels with bandwidths similar to those found for processing depth modulations defined by binocular disparity.

Binocular cues are important in controlling the grasp but not the reach in natural prehension movements.

Binocular cues are typically considered to be pre-eminent in the control of reaching and grasping behaviour. However, in the absence of such information prehension movements can still be accurate and reliable. The present study therefore was designed to assess further the contribution of binocular information in the control of human reaching and grasping movements. Participants reached for and picked up objects under binocular and monocular viewing, both in the absence of a visible scene around the target objects (complete darkness with 'self-illuminated' objects and hand), and under normal (fully illuminated) viewing. Analysis of kinematic parameters indicated that the removal of binocular information did not significantly affect the major indices of the transport component, although it did affect the grasp component. In contrast, the kinematic parameters in the unlit conditions revealed that both the transport component and the grasp component of the reach were severely disrupted whether binocular cues were available or not. Our results suggest that binocular information may be more important for the control of grasp formation than for the control of the transport component. Elimination of the surrounding scene and normal visual feedback affects both the transport and the grasp. It is concluded that in normal viewing conditions, reaching and grasping movements are less dependent on binocular information than has previously been thought.

Field of view affects reaching, not grasping.

It has been observed that wearing goggles that restrict the field of view (FOV) causes familiar objects to appear both smaller and nearer. To investigate this further, we examined the effect of a range of field sizes (4 degrees, 8 degrees, 16 degrees, 32 degrees and 64 degrees) on estimates of object distance and object size used to control reaching and grasping movements of binocular observers. No visual or haptic feedback was available during the experiment. It was found that, as the FOV was decreased, the distance reached by subjects also decreased, whereas the size of their grasp was unaffected. In a second experiment, we compared reaching and grasping responses under binocular and monocular conditions for 8 degrees and 64 degrees field sizes and show that the effects of FOV do not result from the progressive loss of binocular information. We conclude that reducing the FOV produces substantial and dissociable effects on reaching and grasping behaviour and that field size must be taken into account in any context where visuo-motor performance is important.

Global motion processing is not tuned for binocular disparity.

An important goal of the visual system is the segmentation of image features into objects and their backgrounds. A primary cue for this is motion: when a region shares the same pattern of motion it is segregated from its surround. Three experiments were carried out to investigate whether the segmentation of image features on the basis of motion information is facilitated by the addition of binocular disparity. Coherence thresholds were measured for the discrimination of the global direction of motion of random dot kinematograms (RDKs) in which the relative disparity of the signal and noise dots was manipulated. When the signal dots were embedded in a three dimensional cloud of noise dots, coherence thresholds were similar to those measured when signal and noise dots were both presented with zero disparity. However, when the signal dots were separated from the noise dots in depth, global motion processing was strongly facilitated. These results were considered in terms of two models, one in which global motion is processed by disparity tuned mechanisms, the other in which the discrimination of the direction of motion is mediated by an attention-based system. It was concluded that global motion processing is not tuned for binocular disparity and that the facilitation of the discrimination of direction provided by binocular disparity in certain circumstances reflects the rôle of an attention-based system.

Disparity minimisation, cyclovergence, and the validity of nonius lines as a technique for measuring torsional alignment.

Frisby et al (1993 Perception 22 Supplement, 115) proposed that the visual system might make cyclovergent eye movements in order to minimise the overall pattern of both vertical and horizontal disparities when an observer views an inclined stereoscopic surface. Their measurements of cyclovergence, which used vertically oriented nonius lines, were found to be consistent with that proposal. In our experiment 1, we measured torsional eye movements objectively, using scleral coils, and found no evidence of a cyclovergent response to either a real inclined surface or to a simulated inclined surface in which the two stereoscopic images were related by a horizontal shear transformation. These results are inconsistent with the disparity minimisation hypothesis. In order to account for the discrepant findings of the two studies, we propose that vertically oriented nonius lines may not be a valid method for assessing cyclovergence because the lines can be seen as lying 'within' the inclined surface. In experiment 2, we tested the predictions of the cyclovergence hypothesis of Frisby et al against our own 'within surface' explanation, using both horizontally and vertically oriented nonius lines and dichoptic images related by either a horizontal or a vertical shear. If cyclovergence were the cause of the misalignment, both horizontal and vertical nonius lines should appear misaligned to the same extent. This was not found to be the case. We conclude that vertical nonius lines may not be a valid technique for measuring cyclovergence when the lines are seen against a background of an inclined surface.

Does binocular disparity facilitate the detection of transparent motion?

Recent physiological studies have established that cortical cells that are tuned for the direction of motion may also exhibit tuning for binocular disparity. This tuning does not appear to provide any advantage in discriminating the direction of global motion in random-dot kinematograms. Here we investigated the possibility that this tuning may be important in the perception of transparent motion. Random-dot kinematograms were presented which contained coherent motion in a single direction or in two opposing directions. A greater proportion of signal dots was required for the detection of transparent motion than of motion in a single direction. This difference vanished when the two opposite directions of motion were presented with different disparities. These results suggest that the direction of global motion can be computed separately for surfaces which are clearly segregated in depth.

Visual processing and dyslexia.

Magnocellular-pathway deficits have been hypothesized to be responsible for the problems experienced by dyslexic individuals in reading. However, research has yet to provide a detailed account of the consequences of these deficits or to identify the behavioural link between them and reading disabilities. The aim of the present study was to determine the potential consequences of the magnocellular-pathway deficits for dyslexics in a comprehensive range of visual tasks. Dyslexics and nondyslexics were compared on their ability to (i) perform vernier-acuity and orientation-acuity tasks; (ii) perceive motion by using a range of measures common in the psychophysical literature (Dmin, Dmax, and global coherence); and (iii) perceive shapes presented in random-dot stereograms at a range of disparity pedestals, thereby dissociating stereopsis from vergence control. The results indicated no significant differences in performance between the dyslexic and nondyslexic subjects in terms of the visual-acuity measures. In general, dyslexics performed relatively poorly on measures of motion perception and stereopsis, although when considered individually some of the dyslexics performed better than some of the controls. The poor performance of the dyslexics in the stereo-gram tasks was attributable to a subgroup of dyslexics who also appeared to have severe difficulty with the motion-coherence task. These data are consistent with previous evidence that some dyslexics may have deficits within the magnocellular visual pathway.

Sensitivity to horizontal and vertical corrugations defined by binocular disparity.

Sensitivity to corrugations defined by binocular disparity differs as a function of the modulation frequency. Such functions have proved to be useful descriptive and analytical tools in the study of the mechanisms involved in disparity processing. Indeed, given certain assumptions, these sensitivity functions can be used to predict certain perceptual outcomes. Given their importance, it is surprising that there is no comprehensive data set of disparity sensitivity functions (DSF) for a range of observers over a broad range of spatial frequencies and orientations. Here we report DSFs for six observers over an eight octave range of sinusoidal corrugations in disparity (0.0125-3.2 cpd). Multi-cycle, low frequency surfaces were used to assess the degree to which the fall-off in sensitivity at low corrugation frequencies is attributable to the decreasing number of cycles displayed. The data was found to form a continuous function despite the different number of cycles displayed. We conclude that the fall off in sensitivity is due to the spatial interactions in disparity processing. We also determined DSFs for the same observers to both vertically and horizontally oriented sinusoidal disparity corrugations in order to characterise the extent of the stereoscopic anisotropy. In general, the best thresholds for detecting vertically oriented disparity corrugations were higher (approximately 4 arc sec) than for horizontally oriented corrugations (approximately 2 arc sec). Moreover, the functions were shifted toward the high spatial frequency end of the spectrum.

The design of telepresence systems: the task-dependent use of binocular disparity and motion parallax.

The effect of different visual depth cues presented through a head-mounted display in a dark (no pictorial cue) environment was investigated. The relative effects of binocular disparity, motion parallax, and a combination of the 2, were assessed for 3 tasks at 2 viewing distances. These tasks (which varied in the minimum amount of information they required) were a nulling task, setting a triangle to be equilateral and matching the base-to-apex magnitude of 2 triangles at different distances. Performance within the tasks varied considerably but was most accurate for the nulling task. Differences between viewing conditions may be due to a failure in the assessment of absolute viewing distance. It is argued that these results are task specific. Although there was some variation between different cue types, they appear to be largely interchangeable within the tasks. These results have implications for system designers selecting an appropriate display device for a telepresence system.

The interaction of binocular disparity and motion parallax in determining perceived depth and perceived size.

Although binocular disparity and motion parallax are powerful cues for depth, neither, in isolation, can specify information about both object size and depth. It has been shown that information from both cues can be combined to specify the size, depth, and distance of an object in a scene (Richards, 1985 Journal of the Optical Society of America A 2 343-349). Experiments are reported in which natural viewing and physical stimuli have been used to investigate the nature of size and depth perception on the basis of disparity and parallax presented separately and together at a range of viewing distances. Observers adjusted the relative position of three bright LEDs, which were constrained to form a triangle in plan view with the apex pointing toward the observer, so its dimensions matched that of a standard held by the subject. With static monocular viewing, depth settings were inaccurate and erratic. When both cues were present together accuracy increased and the perceptual outcome was consistent with an averaging of the information provided by both cues. When an apparent bias evident in the observers' responses (the tendency to under-estimate the size of the standard) was taken into account, accuracy was high and size and depth constancy were close to 100%. In addition, given this assumption, the same estimate of viewing distance was used to scale size and depth estimates.

Cues to viewing distance for stereoscopic depth constancy.

A veridical estimate of viewing distance is required in order to determine the metric structure of objects from binocular stereopsis. One example of a judgment of metric structure, which we used in our experiment, is the apparently circular cylinder task (E B Johnston, 1991 Vision Research 31 1351-1360). Most studies report underconstancy in this task when the stimulus is defined purely by binocular disparities. We examined the effect of two factors on performance: (i) the richness of the cues to viewing distance (using either a naturalistic setting with many cues to viewing distance or a condition in which the room and the monitors were obscured from view), and (ii) the range of stimulus disparities (cylinder depths) presented during an experimental run. We tested both experienced subjects (who had performed the task many times before under full-cue conditions) and naïve subjects. Depth constancy was reduced for the naïve subjects (from 62% to 46%) when the position of the monitors was obscured. Under similar conditions, the experienced subjects showed no reduction in constancy. In a second experiment, using a forced-choice method of constant stimuli, we found that depth constancy was reduced from 64% to 23% in naïve subjects and from 77% to 55% in experienced subjects when the same set of images was presented at all viewing distances rather than using a set of stimulus disparities proportional to the correct setting. One possible explanation of these results is that, under reduced-cue conditions, the range of disparities presented is used by the visual system as a cue to viewing distance.

The effect of pre-movement delays on pointing accuracy in middle childhood.

In adults, the introduction of a pre-response delay has been shown to affect accuracy in pointing tasks while leaving accuracy in perceptual matching tasks unaffected. Here, we report on the effect of pre-movement delays on pointing accuracy in 6-10-year-old children. Children of this age group are of particular interest as their reliance on visual cues to monitor and correct their reaches appears to change during this period of development. Nineteen children were asked to point to the location of a target light after a delay of 0, 1, 2, or 4 s following target extinction. Performance was measured in two conditions: (i) open-loop, where the child reproduced the target locations in complete darkness, and (ii) with visual feedback, where information about hand position was available. Errors in the direction and in the amplitude of each reaching movement were recorded separately. The results show that temporal delay significantly affects the pointing movements of these children. Accuracy (mean) deteriorated after only 1 s whereas the precision (standard deviation) of the responses deteriorated after 4 s. Errors in amplitude, but not errors in direction, were reduced by the provision of visual feedback. Taken together, the findings suggest that amplitude and directional components of pointing in childhood utilise different sources of information, which differ in the extent to which temporal constraints operate.

The direction of retinal motion facilitates binocular stereopsis.

Visual information from binocular disparity and from relative motion provide information about three-dimensional structure and layout of the world. Although the mechanisms that process these cues have typically been studied independently, there is now a substantial body of evidence that suggests that they interact in the visual pathway. This paper investigates one advantage of such an interaction: whether retinal motion can be used as a matching constraint in the binocular correspondence process. Stimuli that contained identical disparity and motion signals but which differed in their fine-scale correlation were created to establish whether the direction, or the speed, of motion could enhance performance in a psychophysical task in which binocular matching is a limiting factor. The results of these experiments provide clear evidence that different directions of motion, but not different speeds, are processed separately in stereopsis. The results fit well with properties of neurons early in the cortical visual pathway which are thought to be involved in determining local matches between features in the two eyes' images.

Stereoscopic depth constancy depends on the subject's task.

Under identical viewing conditions, observers made two types of judgement about the shape of stereoscopically defined surfaces: one required an estimate of viewing distance for correct performance (e.g. setting the depth of a hemi-cylinder to equal its half-height or a dihedral angle to 90 deg), the other did not (matching the depth of, for example, sinusoidal corrugations or hemi-cylinders presented at two distances). Depth constancy for the two types of task was about 75% and 100%, respectively. We argue that observers may use a simple "direct" strategy to perform the depth matching task rather than constructing and comparing a metric representation of each surface.

The interaction of binocular disparity and motion parallax in the computation of depth.

Depth from binocular disparity and motion parallax has traditionally been assumed to be the product of separate and independent processes. We report two experiments which used classical psychophysical paradigms to test this assumption. The first tested whether there was an elevation in the thresholds for detecting the 3D structure of corrugated surfaces defined by either binocular disparity or motion parallax following prolonged viewing (adaptation) of supra-threshold surfaces defined by either the same or different cue (threshold elevation). The second experiment tested whether the depth detection thresholds for a compound stimulus, containing both binocular disparity and motion parallax, were lower than the thresholds determined for each of the components separately (sub-threshold summation). Experiment 1 showed a substantial amount of within- and between-cue threshold elevation and experiment 2 revealed the presence of sub-threshold summation. Together, these results support the view that the combination of binocular disparity and motion parallax information is not limited to a linear, weighted addition of their individual depth estimates but that the cues can interact non-linearly in the computation of depth.