Processing temporal events simultaneously in healthy human adults and in hemi-neglect patients.

Many theories have been advanced to explain how the brain incorporates time into its computations, in particular for the purpose of estimating the duration of an event. In the present study we examine with a new paradigm the ability to compare the duration of two visual stimuli in the parafoveal visual field, presented either sequentially or overlapping in time. We found that judging the duration of a pair of objects is more difficult when they overlap in time. Furthermore, all healthy participants presented a bias to over-estimate the duration of the second event (a negative time-order-error). We then presented the same task to eight left neglect patients with extinction (N-patients). Relative to the healthy participants, the patients displayed similar loss of sensitivity and increased bias in the time overlap condition. However, N-patients were particularly impaired when the first object was presented in their right visual field and the second one appeared on their left before the first one vanished. Rather than a simple engage/disengage disorder, these results highlight a specific problem with shifting attention to the impaired visual field. We discuss these findings in the light of contemporary models of time estimation.

The vertical-horizontal illusion in hemi-spatial neglect.

The vertical-horizontal illusion is a robust phenomenon of length mis-estimation between two orthogonal lines. This illusion involves an anisotropy component that makes the vertical line appear longer than the horizontal one and a bisection component that makes the bisected line shorter than the bisecting one. Six patients presenting a moderate left hemi-neglect (N-patients) were compared to four right brain damaged patients without neglect (RH-patients) and with control participants in the perception of various spatial configurations of the vertical-horizontal illusion. Relative to controls, we found that both components of the illusion increased in patients: the anisotropy component rose from 5 to 11% and 10% (for N- and RH-patients, respectively) and the bisection component from 17 to 22% and 20% (for N- and RH-patients, respectively). In addition, we found that an horizontal-'T' figure oriented to the left produced much less bias than the same figure oriented to the right. These results are discussed in light of explanations based on attentional disengagement from an image junction and strength of the representation of objects extending over the neglected side.

"Where is the sun" for hemi-neglect patients?

Human observers use prior constraints to disambiguate a scene; in particular, light is preferentially seen as coming from above but also slightly from the left. One explanation of this lateral bias could be a cerebral hemispheric difference. The aim of the present study was to determine the preferred light source position for neglect patients. For this purpose, we used the ambiguous shaded "Polo Mint" stimulus, a ring divided into eight equal sectors. All sectors but one were the same shape, convex or concave, as determined by the light source position. Participants had to report the side (left or right) of the odd sector or, in a separate experiment, to report its shape (convex or concave). Eight patients with spatial neglect (left neglect N=7, right neglect N=1) after a right or left temporo-parietal or thalamic lesion and 14 control participants ran the experiment. Left neglect patients showed a significantly different light bias from the bias observed for controls and for the right neglect patient (i.e., a reduction of the left bias or a right bias rather than a left bias). We conclude that some disabilities presented by patients with spatial neglect may be due to difficulties processing information that is not present in the visual field or imagined in the representational scene.

Relationship between eye preference and binocular rivalry, and between eye-hand preference and reading ability in children.

One goal of the experiment presented here was to check, in children, the relationship between eye preference when sighting at different angles and eye dominance in binocular rivalry. In addition, since it is sometimes argued that a crossed pattern of eye-hand preference might put children at risk of difficulties in learning to read, we evaluated the relationship between this pattern and reading achievement in first and sixth graders. Results showed that a majority of children are right-eyed for monosighting, and that intrinsic preference and spatial factor influence the choice of eye. As many children were right- or left-eye dominant, and eye dominance was not related to eye preference. We found no relationship between eye-hand preference and reading proficiency, thus not confirming that a crossed pattern of eye-hand preference might put children at risk of difficulties in learning to read. Consistent handers were more advanced in reading than inconsistent handers.

Prior knowledge on the illumination position.

Visual perception is fundamentally ambiguous because an infinite number of three-dimensional scenes are consistent with our retinal images. To circumvent these ambiguities, the visual system uses prior knowledge such as the assumption that light is coming from above our head. The use of such assumptions is rational when these assumptions are related to statistical regularities of our environment. In confirmation of previous visual search experiments, we demonstrate here that the assumption on the illumination position is in fact biased to the above-left rather than directly above. This bias to the left reaches 26 degrees on average in a more direct shape discrimination task. Both right-handed and left-handed observers have a similar leftward bias. We discuss the possible origins of this singular bias on the illumination position.

Interaction of visual prior constraints.

The visual system relies on two types of information to interpret a visual scene: the cues that can be extracted from the retinal images and prior constraints that are used to disambiguate the scene. Many studies have looked at how multiple visual cues are combined. We examined the interaction of multiple prior constraints. The particular constraints studied here are assumptions the observer makes concerning the location of the light source (for the shading cue to depth) and the orientation of a surface (for depth based on image contours). The reliability of each of the two cues was manipulated by changing the contrast of different parts of the stimuli. We developed a model based on elements of Bayesian decision theory that permitted us to track the weights applied to each of the prior constraints as a function of the cue reliabilities. The results provided evidence that prior constraints behave just like visual cues to depth: cues with more reliable information have higher weight attributed to their corresponding prior constraint.

Observer biases in the 3D interpretation of line drawings.

Line drawings produced by contours traced on a surface can produce a vivid impression of the surface shape. The stability of this perception is notable considering that the information provided by the surface contours is quite ambiguous. We have studied the stability of line drawing perception from psychophysical and computational standpoints. For a given family of simple line drawings, human observers could perceive the drawings as depicting either an elliptic (egg-shaped) or hyperbolic (saddle-shaped) smooth surface patch. Rotation of the image along the line of sight and change in aspect ratio of the line drawing could bias the observer toward either interpretation. The results were modeled by a simple Bayesian observer that computes the probability to choose either interpretation given the information in the image and prior preferences. The model's decision rule is noncommitting: for a given input image its responses are still probabilistic, reflecting variability in the modeled observers' judgements. A good fit to the data was obtained when three observer assumptions were introduced: a preference for convex surfaces, a preference for surface contours aligned with the principal lines of curvature, and a preference for a surface orientation consistent with an object viewed from above. We discuss how these assumptions might reflect regularities of the visual world.

The perception of cast shadows.

When an object casts its shadow on a background surface, the shadow can be informative about the shape of the object, the shape of the background surface and the spatial arrangement of the object relative to the background. Among all these roles, we found that cast shadows were perceptually most relevant for the recovery of spatial arrangement, especially when the shadow is in motion. This finding is intriguing when one considers the ambiguities in the possible ways that shadow motion can be interpreted. We reasoned that the visual system must use a priori constraints to disambiguate the cast shadow motion. One of these constraints is that the light source is stationary. Though simple, the stationary-light-source constraint supports rich, reliable inferences about the qualitative motions of objects in three dimensions.

Geometry of shadows.

Shadows provide a strong source of information about the shapes of surfaces. We analyze the local geometric structure of shadow contours on piecewise smooth surfaces. Particular attention is paid to intrinsic shadows on a surface: that is, shadows created on a surface by the surface's own shape and placement relative to a light source. Intrinsic shadow contours provide useful information about the direction of the light source and the qualitative shape of the underlying surface. We analyze the invariants relating surface shape and light-source direction to the shapes and singularities of intrinsic shadow contours. The results suggest that intrinsic shadows can be used to directly infer illuminant tilt, qualitative global surface structure, and, at intersections with surface creases, the concavity/convexity of a surface. We show that the results obtained for point sources of light generalize in a straightforward way to extended light sources, under the assumption that light sources are convex.

Prehension of objects oriented in three-dimensional space.

When reaching for an object, the proximity of the object, its orientation, and shape should all be correctly estimated well before the hand arrives in contact with it. We were interested in the effects of the object's orientation on manual prehension. Subjects were asked to reach for an object at one of several possible orientations. We found that the trajectory of the hand and its rotation and opening were significantly affected by the object's orientation within the first half of the movement. We also detected a slight delay of the wrist relative to the forearm and a small bias of the orientation of the fingers' tips toward the orientation of the table on which the object lay. Finally, the aperture of the hand was proportional to the physical size of the object, which shows that size constancy was achieved from the variation of the object's orientation. Taken together, these results indicate that the three components of the movement - the transport, rotation, and opening of the hand - have access to a common visual representation of the object's orientation.

Moving cast shadows induce apparent motion in depth.

Phenomenally strong visual illusions are described in which the motion of an object's cast shadow determines the perceived 3-D trajectory of the object. Simply adjusting the motion of a shadow is sufficient to induce dramatically different apparent trajectories of the object casting the shadow. Psychophysical results obtained with the use of 3-D graphics are reported which show that: (i) the information provided by the motion of an object's shadow overrides other strong sources of information and perceptual biases, such as the assumption of constant object size and a general viewpoint; (ii) the natural constraint of shadow darkness plays a role in the interpretation of a moving image patch as a shadow, but under some conditions even unnatural light shadows can induce apparent motion in depth of an object; (iii) when shadow motion is caused by a moving light source, the visual system incorrectly interprets the shadow motion as consistent with a moving object, rather than a moving light source. The results support the hypothesis that the human visual system incorporates a stationary light-source constraint in the perceptual processing of spatial layout of scenes.

Illumination, shading and the perception of local orientation.

We investigated the perception of local surface orientation on a simple smooth object, under several different illumination conditions. The perceived local orientation was determined for several points on the surface and quantified as slant and tilt of the local tangent plane. We found an underestimation of the perceived slant and a larger variance for the perceived tilt than for the perceived slant. We found also that subjects were less biased at estimating the surface orientation when the shape was locally egg-shaped rather than saddle-shaped or cylindrical. In order to investigate the relationship between perceived shape and light source direction, we developed a method to compute the light source direction most consistent with an observer's settings. Also we compared human errors with those of an "ideal observer" which makes explicit assumptions about the illuminations, shapes and materials in its world. From converging evidence based on (i) the light direction most consistent with the observer's settings; (ii) a supplementary experiment where the object is displayed as a silhouette, and (iii) the computer simulations of the ideal observer, we conclude that the observers used the occluding contour of the object rather than shading to estimate the local surface orientation.

Categorical local-shape perception.

How well do observers perceive the local shape of an object from its shaded image? This problem was addressed by first deriving a potential representation of local solid shape. The descriptor of local shape, called shape characteristic, provides a viewpoint-independent continuum between hyperbolic (saddle-shaped) and elliptic (egg-shaped) points. The ability of human observers to make categorical judgments of local solid shape was then studied. This question was investigated by using a smooth 'croissant', a simple object made of two connected regions of elliptic and hyperbolic points. Observers decided whether the surface was locally elliptic or hyperbolic at various points on the object. The task was natural, and the observers could reliably partition the shaded image of the object into two regions, one elliptic and one hyperbolic. The ability of observers to perform this partition shows that they can, at least implicitly, localize the parabolic curves on a surface. This ability to locate the parabolic curve could in turn be exploited for other purposes, for instance to segment an object into its parts.