A role of rectangularity in perceiving a 3D shape of an object.

Rectangularity and perpendicularity of contours are important properties of 3D shape for the visual system and the visual system can use them asa prioriconstraints for perceivingshape veridically. The presentarticle provides a comprehensive review ofpriorstudiesofthe perception of rectangularity and perpendicularity anditdiscussestheir effects on3D shape perception from both theoretical and empiricalapproaches. It has been shown that the visual system is biased to perceive a rectangular 3D shape from a 2D image. We thought that this bias might be attributable to the likelihood of a rectangular interpretation but this hypothesis is not supported by the results of our psychophysical experiment. Note that the perception ofa rectangular shape cannot be explained solely on the basis of geometry. A rectangular shape is perceived from an image that is inconsistent with a rectangular interpretation. To address thisissue, we developed a computational model that can recover a rectangular shape from an image of a parallelopiped. The model allows the recovered shape to be slightly inconsistent so that the recovered shape satisfies the a priori constraints of maximum compactness and minimal surface area. This model captures someof thephenomenaassociated withthe perception of the rectangular shape that were reported inpriorstudies. This finding suggests that rectangularity works for shape perception by incorporatingitwith someadditionalconstraints.

The efficacy of augmented reality exposure therapy in the treatment of spider phobia-a randomized controlled trial.

The evidence for the use of Augmented Reality (AR) in treating specific phobias has been growing. However, issues of accessibility persist, especially in developing countries. The current study examined a novel, but relatively simple therapist guided smartphone-based AR Exposure Treatment (ARET) of spider phobia. Participants who reported symptoms of Arachnophobia were randomized into one of three comparison groups: ARET (n = 20), traditional in vivo exposure therapy (IVET; n = 18) and a waitlist control group (n = 17). Behavioral approach, subjective symptom measures, and galvanic skin response were assessed pre- and post-treatment. The study was concluded with a one-month follow up assessment. Results indicated that both treatment groups showed statistically significant and clinically meaningful improvements in behavioral approach at post-test that were maintained at 1 month follow- up, compared to the wait-listed group. Moreover, the treatment groups demonstrated significant improvements in subjective symptom report at 1-month follow up. Given its utility and potential accessibility, our findings suggest that future AR evaluation research could be conducted in therapy settings with minimal resources.

Testing a formal theory of perception is not easy: Comments on Yu, Todd & Petrov (2021) and Yu, Petrov & Todd (2021).

Yu, Todd, and Petrov (2021, Journal of Vision) and their follow-up study (Yu, Petrov, & Todd, 2021, i-Perception) aimed at evaluating the role of three-dimensional (3D) symmetry in binocular shape perception by comparing their experimental data to predictions they derived from our computational models. We point out in this note that their predictions were incorrect, so their studies can neither reject nor support our models of 3D shape perception. We explain (1) the role of the data and the constraints in solving ill-posed inverse problems, (2) the role of binocular depth-order, as opposed to binocular depth-intervals in shape perception, (3) the nature and the effect of 3D compactness as an a priori constraint, and (4) the implications of the separation of binocular disparity and stereoacuity in the two functional streams in the visual cortex.

Navigation in Contour-Drawn Scenes Using Augmented Reality.

The visual system can recover 3D information from many different types of visual information, e.g., contour-drawings. How well can people navigate in a real dynamic environment with contour-drawings? This question was addressed by developing an AR-device that could show a contour-drawing of a real scene in an immersive manner and by conducting an observational field study in which the two authors navigated in real environments wearing this AR-device. The navigation with contour-drawings was difficult in natural scenes but easy in urban scenes. This suggests that the visual information from natural and urban environments is sufficiently different and our visual system can accommodate to this difference of the visual information in different environments.

Visual sensitivity to parallel configurations of contours compared with sensitivity to other configurations.

People can perceive 3D information from contour drawings and some types of configurations of contours in such drawings are important for 3D perception. We know that our visual system is sensitive to these configurations. Koshmanova & Sawada (2019, Vision Research, 154, 97-104) showed that the sensitivity is higher to a parallel configuration of contours than to a perpendicular configuration of contours. In this study, two psychophysical experiments were conducted that compared the sensitivity to a parallel configuration to two different configurations. In Experiment 1, orientation thresholds were measured with parallel and converging configurations composed of three contours. In Experiment 2, orientation thresholds of configurations composed of two contours were measured with parallel, collinear, and perpendicular configurations. The results of Experiment 1 showed that the visual system is more sensitive to parallel configurations than to converging configurations. The results of Experiment 2 showed that the sensitivity to the parallel configuration is analogous to the sensitivity to the collinear configuration, and it is higher than the sensitivity to the perpendicular configuration. The role that the parallel configuration plays in the 3D perception of contour-drawings is discussed.

Theoretical Treatment of Limitations Inherent in Simple 3D Stimuli: Triangles and the P3P Problem.

Understanding the visual stimulus in a psychophysical experiment, theoretically, is critical for controlling the experiment, for interpreting the empirical results of the experiment, and for discussing the mechanisms the visual system used to get these results. This fact encourages visual scientists to use "simple" visual stimuli in their experiments. A triangle is one of the simplest stimuli that has been used by psychophysicists to study 3D perception. It has also been used to compose the polygonal meshes that represent complex 3D surfaces in computer graphics. The relationship between the shape, orientation, and retinal image of a triangle has also been studied as the Perspective-3-Point problem (P3P). In this study, the statistical properties of this relationship between the 2D retinal image of a triangle and its recovered 3D orientation were tested in a simulation experiment whose results showed that a triangle is qualitatively different from more complex shapes that have been used to recover 3D information from their retinal images. This raises an important question, namely, how many, if any, inferences about our visual system can be generalized to our perceptions in everyday life when they are based on psychophysical experiments that used very simple visual stimuli such as triangles.

Seeing our 3D world while only viewing contour-drawings.

Artists can represent a 3D object by using only contours in a 2D drawing. Prior studies have shown that people can use such drawings to perceive 3D shapes reliably, but it is not clear how useful this kind of contour information actually is in a real dynamical scene in which people interact with objects. To address this issue, we developed an Augmented Reality (AR) device that can show a participant a contour-drawing or a grayscale-image of a real dynamical scene in an immersive manner. We compared the performance of people in a variety of run-of-the-mill tasks with both contour-drawings and grayscale-images under natural viewing conditions in three behavioral experiments. The results of these experiments showed that the people could perform almost equally well with both types of images. This contour information may be sufficient to provide the basis for our visual system to obtain much of the 3D information needed for successful visuomotor interactions in our everyday life.

Examining the Role of Familiarity in the Perception of Depth.

Bishop Berkeley suggested that the distance of an object can be estimated if the object's size is familiar to the observer. It has been suggested that humans can perceive the distance of the object by using such "familiarity" information, but most or many of the prior experiments that found an effect of familiarity were not designed to minimize or eliminate potential influences of: higher cognitive factors on the observers' responses, or the influences of low-level image features in the visual stimuli used. We looked for the familiarity effect in two experiments conducted both in Russia and Japan. The visual stimuli used were images of three coins used in Russia and Japan. The participants' depth perception was measured with a multiple-choice task testing the perceived depth-order of the coins. Our expectation was that any effect of "familiarity" on depth perception would only be observed with the coins of the participant's country. We expected a substantial familiarity effect based on our meta-analysis of the "familiarity" effects observed in prior experiments. But, our results in both experiments showed that the familiarity effect was virtually zero. These findings suggest that the importance of a familiarity effect in depth perception should be reconsidered.

Two Rediscoveries of the Autostereogram in the 1960s.

The autostereogram (ASG) was discovered in the 1840s and again in the 1960s. It is acknowledged that Pete Stephens rediscovered the ASG serendipitously when he constructed an image with a repetitive pattern manually in the late 1960s. But, the principle and application of the ASG were described by Lev Mogilev from Irkutsk State University earlier in the 1960s.

Perceiving perpendicular and parallel contours in the frontoparallel plane.

The perception of a pair of contours in a retinal image cannot be understood simply by adding up the perceptions of the individual contours, especially when they form a perpendicular junction, or are parallel to one another. It is the relationship among the contours that determines what is perceived. Note that it is hard to actually compare the perception of such configurations quantitatively. We managed to do this by testing the perception of such configurations in three psychophysical experiments in which the perception was characterized by measuring the orientation threshold of a single contour. This threshold was estimated by using a modified Method of Constant Stimuli based on the assumption that contours forming a configuration are perceived individually, and that they are integrated linearly. This assumption made the quantitative comparison of the perceived configurations possible. We found that changes of the estimated threshold depended on the type of the configuration, specifically thresholds estimated from a perpendicular junction were substantially lower than thresholds estimated from a single contour or from a non-perpendicular junction. The lowest thresholds were observed when the threshold was estimated from a pair of parallel contours. These results suggest that the visual system is sensitive to perpendicular junctions and parallel contours in a retinal image.

Rotational-symmetry in a 3D scene and its 2D image.

A 3D shape of an object is N-fold rotational-symmetric if the shape is invariant for 360/N degree rotations about an axis. Human observers are sensitive to the 2D rotational-symmetry of a retinal image, but they are less sensitive than they are to 2D mirror-symmetry, which involves invariance to reflection across an axis. Note that perception of the mirror-symmetry of a 2D image and a 3D shape has been well studied, where it has been shown that observers are sensitive to the mirror-symmetry of a 3D shape, and that 3D mirror-symmetry plays a critical role in the veridical perception of a 3D shape from its 2D image. On the other hand, the perception of rotational-symmetry, especially 3D rotational-symmetry, has received very little study. In this paper, we derive the geometrical properties of 2D and 3D rotational-symmetry and compare them to the geometrical properties of mirror-symmetry. Then, we discuss perceptual differences between mirror- and rotational symmetry based on this comparison. We found that rotational-symmetry has many geometrical properties that are similar to the geometrical properties of mirror-symmetry, but note that the 2D projection of a 3D rotational-symmetrical shape is more complex computationally than the 2D projection of a 3D mirror-symmetrical shape. This computational difficulty could make the human visual system less sensitive to the rotational-symmetry of a 3D shape than its mirror-symmetry.

The divisive normalization model of V1 neurons: a comprehensive comparison of physiological data and model predictions.

The physiological responses of simple and complex cells in the primary visual cortex (V1) have been studied extensively and modeled at different levels. At the functional level, the divisive normalization model (DNM; Heeger DJ. Vis Neurosci 9: 181-197, 1992) has accounted for a wide range of single-cell recordings in terms of a combination of linear filtering, nonlinear rectification, and divisive normalization. We propose standardizing the formulation of the DNM and implementing it in software that takes static grayscale images as inputs and produces firing rate responses as outputs. We also review a comprehensive suite of 30 empirical phenomena and report a series of simulation experiments that qualitatively replicate dozens of key experiments with a standard parameter set consistent with physiological measurements. This systematic approach identifies novel falsifiable predictions of the DNM. We show how the model simultaneously satisfies the conflicting desiderata of flexibility and falsifiability. Our key idea is that, while adjustable parameters are needed to accommodate the diversity across neurons, they must be fixed for a given individual neuron. This requirement introduces falsifiable constraints when this single neuron is probed with multiple stimuli. We also present mathematical analyses and simulation experiments that explicate some of these constraints.

Gestalt-like constraints produce veridical (Euclidean) percepts of 3D indoor scenes.

This study, which was influenced a lot by Gestalt ideas, extends our prior work on the role of a priori constraints in the veridical perception of 3D shapes to the perception of 3D scenes. Our experiments tested how human subjects perceive the layout of a naturally-illuminated indoor scene that contains common symmetrical 3D objects standing on a horizontal floor. In one task, the subject was asked to draw a top view of a scene that was viewed either monocularly or binocularly. The top views the subjects reconstructed were configured accurately except for their overall size. These size errors varied from trial to trial, and were shown most-likely to result from the presence of a response bias. There was little, if any, evidence of systematic distortions of the subjects' perceived visual space, the kind of distortions that have been reported in numerous experiments run under very unnatural conditions. This shown, we proceeded to use Foley's (Vision Research 12 (1972) 323-332) isosceles right triangle experiment to test the intrinsic geometry of visual space directly. This was done with natural viewing, with the impoverished viewing conditions Foley had used, as well as with a number of intermediate viewing conditions. Our subjects produced very accurate triangles when the viewing conditions were natural, but their performance deteriorated systematically as the viewing conditions were progressively impoverished. Their perception of visual space became more compressed as their natural visual environment was degraded. Once this was shown, we developed a computational model that emulated the most salient features of our psychophysical results. We concluded that human observers see 3D scenes veridically when they view natural 3D objects within natural 3D environments.

A Bayesian model of binocular perception of 3D mirror symmetrical polyhedra.

In our previous studies, we showed that monocular perception of 3D shapes is based on a priori constraints, such as 3D symmetry and 3D compactness. The present study addresses the nature of perceptual mechanisms underlying binocular perception of 3D shapes. First, we demonstrate that binocular performance is systematically better than monocular performance, and it is close to perfect in the case of three out of four subjects. Veridical shape perception cannot be explained by conventional binocular models, in which shape was derived from depth intervals. In our new model, we use ordinal depth of points in a 3D shape provided by stereoacuity and combine it with monocular shape constraints by means of Bayesian inference. The stereoacuity threshold used by the model was estimated for each subject. This model can account for binocular shape performance of all four subjects. It can also explain the fact that when viewing distance increases, the binocular percept gradually reduces to the monocular one, which implies that monocular percept of a 3D shape is a special case of the binocular percept.

The development of the ability of infants to utilize static cues to create and access representations of object shape.

A "transfer-across-depth-cues" method was used to explore the development of the ability to generate and use spatial representations of an object as specified by static pictorial depth cues. Infants were habituated to an object with depth specified by one cue and then presented with the same shape with depth specified by a different cue. Only if an abstract representation of that object had been formed could transfer across cues occur. Shading and line junctions uniquely determined the 3D shapes in these displays so that they appeared to be either a slice of cake with a flat top or a rocket. Without these cues, both line drawings were identical. Infants aged 6 to 7 months showed significant evidence of transfer, while infants aged 4 to 5 months did not. A control experiment demonstrated that the younger infants could discriminate between the objects when a single depth cue specified the shapes. These results are similar to our previous findings, which indicated that 6- to 7-month-old infants show transfer across shading and surface-contour cues, specifying convex and concave surfaces (A. Tsuruhara, T. Sawada, S. Kanazawa, M. K. Yamaguchi, & A. Yonas, 2009). This work supports the hypothesis that the ability to form 3D spatial representations from pictorial depth cues develops at about 6 months of age.

Visual detection of symmetry of 3D shapes.

This study tested perception of symmetry of 3D shapes from single 2D images. In Experiment 1, performance in discrimination between symmetric and asymmetric 3D shapes from single 2D line drawings was tested. In Experiment 2, performance in discrimination between different degrees of asymmetry of 3D shapes from single 2D line drawings was tested. The results showed that human performance in the discrimination was reliable. Based on these results, a computational model that performs the discrimination from single 2D images is presented. The model first recovers the 3D shape using a priori constraints: 3D symmetry, maximal 3D compactness, minimum surface area, and maximal planarity of contours. Then the model evaluates the degree of symmetry of the 3D shape. The model provided good fit to the subjects' data.

New approach to the perception of 3D shape based on veridicality, complexity, symmetry and volume.

This paper reviews recent progress towards understanding 3D shape perception made possible by appreciating the significant role that veridicality and complexity play in the natural visual environment. The ability to see objects as they really are "out there" is derived from the complexity inherent in the 3D object's shape. The importance of both veridicality and complexity was ignored in most prior research. Appreciating their importance made it possible to devise a computational model that recovers the 3D shape of an object from only one of its 2D images. This model uses a simplicity principle consisting of only four a priori constraints representing properties of 3D shapes, primarily their symmetry and volume. The model recovers 3D shapes from a single 2D image as well, and sometimes even better, than a human being. In the rare recoveries in which errors are observed, the errors made by the model and human subjects are very similar. The model makes no use of depth, surfaces or learning. Recent elaborations of this model include: (i) the recovery of the shapes of natural objects, including human and animal bodies with limbs in varying positions (ii) providing the model with two input images that allowed it to achieve virtually perfect shape constancy from almost all viewing directions. The review concludes with a comparison of some of the highlights of our novel, successful approach to the recovery of 3D shape from a 2D image with prior, less successful approaches.