A stratified process for the perception of objects: From optical transformations to 3D relief structure to 3D similarity structure to slant or aspect ratio.

Previously, we developed a stratified process for slant perception. First, optical transformations in structure-from-motion (SFM) and stereo were used to derive 3D relief structure (where depth scaling remains arbitrary). Second, with sufficient continuous perspective change (≥45°), a bootstrap process derived 3D similarity structure. Third, the perceived slant was derived. As predicted by theoretical work on SFM, small visual angle (<5°) viewing requires non-coplanar points. Slanted surfaces with small 3D cuboids or tetrahedrons yielded accurate judgment while planar surfaces did not. Normally, object perception entails non-coplanar points. Now, we apply the stratified process to object perception where, after deriving similarity structure, alternative metric properties of the object can be derived (e.g. slant of the top surface or width-to-depth aspect ratio). First, we tested slant judgments of the smooth planar tops of three different polyhedral objects. We tested rectangular, hexagonal, and asymmetric pentagonal surfaces, finding that symmetry was required to determine the direction of slant (AP&P, 2019, https://doi.org/10.3758/s13414-019-01859-5). Our current results replicated the previous findings. Second, we tested judgments of aspect ratios, finding accurate performance only for symmetric objects. Results from this study suggest that, first, trackable non-coplanar points can be attained in the form of 3D objects. Second, symmetry is necessary to constrain slant and aspect ratio perception. Finally, deriving 3D similarity structure precedes estimating object properties, such as slant or aspect ratio. Together, evidence presented here supports the stratified bootstrap process for 3D object perception. STATEMENT OF SIGNIFICANCE: Planning interactions with objects in the surrounding environment entails the perception of 3D shape and slant. Studying ways through which 3D metric shape and slant can be perceived accurately by moving observers not only sheds light on how the visual system works, but also provides understanding that can be applied to other fields, like machine vision or remote sensing. The current study is a logical extension of previous studies by the same authors and explores the roles of large continuous perspective changes, relief structure, and symmetry in a stratified process for object perception.

Bootstrapping a better slant: A stratified process for recovering 3D metric slant.

Lind et al. (Journal of Experimental Psychology: Human Perception and Performance, 40 (1), 83, 2014) proposed a bootstrap process that used right angles on 3D relief structure, viewed over sufficiently large continuous perspective change, to recover the scaling factor for metric shape. Wang, Lind, and Bingham (Journal of Experimental Psychology: Human Perception and Performance, 44(10), 1508-1522, 2018) replicated these results in the case of 3D slant perception. However, subsequent work by the same authors (Wang et al., 2019) suggested that the original solution could be ineffective for 3D slant and presented an alternative that used two equidistant points (a portion of the original right angle). We now describe a three-step stratified process to recover 3D slant using this new solution. Starting with 2D inputs, we (1) used an existing structure-from-motion (SFM) algorithm to derive the object's 3D relief structure and (2) applied the bootstrap process to it to recover the unknown scaling factor, which (3) was then used to produce a slant estimate. We presented simulations of results from four previous experiments (Wang et al., 2018, 2019) to compare model and human performance. We showed that the stratified process has great predictive power, reproducing a surprising number of phenomena found in human experiments. The modeling results also confirmed arguments made in Wang et al. (2019) that an axis of mirror symmetry in an object allows observers to use the recovered scaling factor to produce an accurate slant estimate. Thus, poor estimates in the context of a lack of symmetry do not mean that the scaling factor has not been recovered, but merely that the direction of slant was ambiguous.

Symmetry mediates the bootstrapping of 3-D relief slant to metric slant.

Empirical studies have always shown 3-D slant and shape perception to be inaccurate as a result of relief scaling (an unknown scaling along the depth direction). Wang, Lind, and Bingham (Journal of Experimental Psychology: Human Perception and Performance, 44(10), 1508-1522, 2018) discovered that sufficient relative motion between the observer and 3-D objects in the form of continuous perspective change (≥45°) could enable accurate 3-D slant perception. They attributed this to a bootstrap process (Lind, Lee, Mazanowski, Kountouriotis, & Bingham in Journal of Experimental Psychology: Human Perception and Performance, 40(1), 83, 2014) where the perceiver identifies right angles formed by texture elements and tracks them in the 3-D relief structure through rotation to extrapolate the unknown scaling factor, then used to convert 3-D relief structure to 3-D Euclidean structure. This study examined the nature of the bootstrap process in slant perception. In a series of four experiments, we demonstrated that (1) features of 3-D relief structure, instead of 2-D texture elements, were tracked (Experiment 1); (2) identifying right angles was not necessary, and a different implementation of the bootstrap process is more suitable for 3-D slant perception (Experiment 2); and (3) mirror symmetry is necessary to produce accurate slant estimation using the bootstrapped scaling factor (Experiments 3 and 4). Together, the results support the hypothesis that a symmetry axis is used to determine the direction of slant and that 3-D relief structure is tracked over sufficiently large perspective change to produce metric depth. Altogether, the results supported the bootstrap process.

Large continuous perspective change with noncoplanar points enables accurate slant perception.

Perceived slant has often been characterized as a component of 3D shape perception for polyhedral objects. Like 3D shape, slant is often perceived inaccurately. Lind, Lee, Mazanowski, Kountouriotis, and Bingham (2014) found that 3D shape was perceived accurately with perspective changes ≥ 45°. We now similarly tested perception of 3D slant. To account for their results, Lind et al. (2014) developed a bootstrap model based on the assumption that optical information yields perception of 3D relief structure then used with large perspective changes to bootstrap to perception of 3D Euclidean structure. However, slant perception usually entails planar surfaces and structure-from-motion fails in the absence of noncoplanar points. Nevertheless, the displays in Lind et al. (2014) included stereomotion in addition to monocular optical flow. Because stereomotion is higher order, the bootstrap model might apply in the case of strictly planar surfaces. We investigated whether stereomotion, monocular structure-from-motion (SFM), or the combination of the two would yield accurate 3D slant perception with large continuous perspective change. In Experiment 1, we found that judgments of slant were inaccurate in all information conditions. In Experiment 2, we added noncoplanar structure to the surfaces. We found that judgments in the monocular SFM and combined conditions now became correct once perspective changes were ≥ 45°, replicating the results of Lind et al. (2014) and supporting the bootstrap model. In short, we found that noncoplanar structure was required to enable accurate perception of 3D slant with sufficiently large perspective changes. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Perception of time to contact of slow- and fast-moving objects using monocular and binocular motion information.

The role of the monocular-flow-based optical variable τ in the perception of the time to contact of approaching objects has been well-studied. There are additional contributions from binocular sources of information, such as changes in disparity over time (CDOT), but these are less understood. We conducted an experiment to determine whether an object's velocity affects which source is most effective for perceiving time to contact. We presented participants with stimuli that simulated two approaching squares. During approach the squares disappeared, and participants indicated which square would have contacted them first. Approach was specified by (a) only disparity-based information, (b) only monocular flow, or (c) all sources of information in normal viewing conditions. As expected, participants were more accurate at judging fast objects when only monocular flow was available than when only CDOT was. In contrast, participants were more accurate judging slow objects with only CDOT than with only monocular flow. For both ranges of velocity, the condition with both information sources yielded performance equivalent to the better of the single-source conditions. These results show that different sources of motion information are used to perceive time to contact and play different roles in allowing for stable perception across a variety of conditions.

Affine operations plus symmetry yield perception of metric shape with large perspective changes (≥45°): data and model.

G. P. Bingham and M. Lind (2008, Large continuous perspective transformations are necessary and sufficient for accurate perception of metric shape, Perception & Psychophysics, Vol. 70, pp. 524-540) showed that observers could perceive metric shape, given perspective changes ≥ 45° relative to a principal axis of elliptical cylinders. In this article, we tested (a) arbitrary perspective changes of 45°, (b) whether perception gradually improves with more perspective change, (c) speed of rotation, (d) whether this works with other shapes (asymmetric polyhedrons), (e) different slants, and (f) perspective changes >45°. Experiment 1 compared 45° perspective change away from, versus centered on, a principal axis. Observers adjusted an ellipse to match the cross-section of an elliptical cylinder viewed in a stereo-motion display. Experiment 2 tested whether performance would improve gradually with increases in perspective change, or suddenly with a 45° change. We also tested speed of rotation. Experiment 3 tested (a) asymmetric polyhedrons, (b) perspective change beyond 45°, and (c) the effect of slant. The results showed (a) a particular perspective was not required, (b) judgments only improved with ≥ 45° change, (c) speed was not relevant, (d) it worked with asymmetric polyhedrons, (e) slant was not relevant, and (f) judgments remained accurate beyond 45° of change. A model shows how affine operations, together with a symmetry yielded by 45° perspective change, bootstrap perception of metric shape.

Perceived 3D metric (or Euclidean) shape is merely ambiguous, not systematically distorted.

Many studies have reported that perceived shape is systematically distorted, but Lind et al. (Inf Vis 2:51-57, 2003) and Todd and Norman (Percept Psychophys 65:31-47, 2003) both found that distortions varied with tasks and observers. We now investigated the hypothesis that perception of 3D metric (or Euclidean) shape is ambiguous rather than systematically distorted by testing whether variations in context would systematically alter apparent distortions. The task was to adjust the aspect ratio of an ellipse on a computer screen to match the cross-section of a target elliptical cylinder object viewed in either frontoparallel elliptical cross-section (2D) or elliptical cross-section in depth (3D). Three different groups were tested using two tasks and two different ranges of aspect ratio: Group 1) 2D(Small) → 3D(Large), Group 2) 2D(Large) → 3D(Small), Group 3a) 2D(Small) → 3D(Small), and Group 3b) 2D(Large) → 3D(Large). Observers performed the 2D task accurately. This provided the context. The results showed the expected order of slopes when judged aspect ratios were regressed on actual aspect ratios: Group 1 (SL) < Group 3 (SS and LL) < Group 2 (LS). The ambiguity of perceived 3D aspect ratios allowed the range of aspect ratios experienced in the 2D task to affect the 3D judgments systematically. Nevertheless, when the 2D and 3D ranges of aspect ratios were the same (LL and SS) and the 2D were judged accurately, this did not yield accurate 3D judgments. The results supported the hypothesis that perceived 3D metric shape is merely ambiguous rather than systematically distorted.

Object recognition using metric shape.

Most previous studies of 3D shape perception have shown a general inability to visually perceive metric shape. In line with this, studies of object recognition have shown that only qualitative differences, not quantitative or metric ones can be used effectively for object recognition. Recently, Bingham and Lind (2008) found that large perspective changes (≥ 45°) allow perception of metric shape and Lee and Bingham (2010) found that this, in turn, allowed accurate feedforward reaches-to-grasp objects varying in metric shape. We now investigated whether this information would allow accurate and effective recognition of objects that vary in respect to metric shape. Both judgment accuracies (d') and reaction times confirmed that, with the availability of visual information in large perspective changes, recognition of objects using quantitative as compared to qualitative properties was equivalent in accuracy and speed of judgments. The ability to recognize objects based on their metric shape is, therefore, a function of the availability or unavailability of requisite visual information. These issues and results are discussed in the context of the Two Visual System hypothesis of Milner and Goodale (1995, 2006).

Combining usability testing with eye-tracking technology: evaluation of a visualization support for antibiotic use in intensive care.

This research work is an explorative study to measure efficiency, effectiveness and user satisfaction of a prototype called Infobiotika aiming to support antibiotic use in intensive care. The evaluation was performed by combining traditional usability testing with eye-tracking technology. The test was conducted with eight intensive care physicians whereof four specialists and four residents. During three test phases participants were asked to perform three types of tasks, namely navigational, clinical and tasks to measure the learning effect after 3-5 minutes free exploring time. A post-test questionnaire was used to explore user satisfaction. Based on the results and overall observations, Infobiotika seems to be effective and efficient in terms of supporting navigation and also a learnable product for intensive care physicians fulfilling their need to get an accurate overview of a patient status quickly. Applying eye-tracking technology during usability testing has shown to be a valuable complement to traditional methods that revealed many unexpected issues in terms of navigation and contributed a supplementary understanding about design problems and user performance.

Large continuous perspective transformations are necessary and sufficient for accurate perception of metric shape.

We investigated the ability to perceive the metric shape of elliptical cylinders. A large number of previous studies have shown that small perspective variations (< or =10 degrees) afforded by stereovision and by head movements fail to allow accurate perception of metric shape. If space perception is affine (Koenderink & van Doom, 1991), observers are unable to compare or relate lengths in depth to frontoparallel lengths (i.e., widths). Frontoparallel lengths can be perceived correctly, whereas lengths in depth generally are not. We measured reaches to evaluate shape perception and investigated whether larger perspective variations would allow accurate perception of shape. In Experiment 1, we replicated previous results showing poor perception with small perspective variations. In Experiment 2, we found that a 90 degrees continuous change in perspective, which swapped depth and width, allowed accurate perception of the depth/width aspect ratio. In Experiment 3, we found that discrete views differing by 90 degrees were insufficient to allow accurate perception of metric shape and that perception of a continuous perspective change was required. In Experiment 4, we investigated continuous perspective changes of 30 degrees, 45 degrees, 60 degrees, and 90 degrees and discovered that a 45 degrees change or greater allowed accurate perception of the aspect ratio and that less than this did not. In conclusion, we found that perception of metric shape is possible with continuous perspective transformations somewhat larger than those investigated in the substantial number of previous studies.