Ray tracing 3D spectral scenes through human optics models.

Scientists and engineers have created computations and made measurements that characterize the first steps of seeing. ISETBio software integrates such computations and data into an open-source software package. The initial ISETBio implementations modeled image formation (physiological optics) for planar or distant scenes. The ISET3d software described here extends that implementation, simulating image formation for three-dimensional scenes. The software system relies on a quantitative computer graphics program that ray traces the scene radiance through the physiological optics to the retinal irradiance. We describe and validate the implementation for several model eyes. Then, we use the software to quantify the impact of several physiological optics parameters on three-dimensional image formation. ISET3d is integrated with ISETBio, making it straightforward to convert the retinal irradiance into cone excitations. These methods help the user compute the predictions of optics models for a wide range of spatially rich three-dimensional scenes. They can also be used to evaluate the impact of nearby visual occlusion, the information available to binocular vision, or the retinal images expected from near-field and augmented reality displays.

Disparity configuration influences depth discrimination in naïve adults, but not in children.

We report a series of experiments in which we assess depth discrimination performance in adults and children using a disparity-balanced target configuration to avoid the effects of anticipatory vergence eye movements. In our first study we found that children outperformed adults by a substantial margin, and the adults were consistently near chance. This was surprising given that we initially tested naïve adults to provide a benchmark for the children's data, and all observers met the criterion for stereoacuity. In subsequent experiments we recruited groups of inexperienced adult observers and assessed the role of a wide range of spatial and temporal factors in this apparent deficit. We found that the adult performance remained poor in spite of changes to the stimulus layout, exposure duration, and spatial scale. The only manipulations that improved performance were those that limited the binocular disparity to a single sign. We conclude that these data reflect a form of involuntary disparity pooling that makes it difficult for naïve observers to judge depth from disparity from multiple targets. The absence of this effect in children likely reflects the late maturation of global processes and depth cue integration.

Accommodation to multiple-focal-plane displays: Implications for improving stereoscopic displays and for accommodation control.

Most stereoscopic displays present images at a single focal plane, resulting in "conflicts" between the stimuli to vergence and accommodation. Minimizing these conflicts is beneficial because they can cause distorted depth percepts, visual fatigue, and reduced stereoscopic performance. One proposed solution is to present a sum of images at multiple focal planes and to vary focal depth continuously by distributing image intensity across planes-a technique referred to as depth filtering. We evaluated this digital approximation to real-world variations in focal depth by measuring accommodation responses to depth-filtered stimuli at various simulated distances. Specifically, we determined the maximum image-plane separation that supported accurate and reliable accommodation. We used an analysis of retinal-image formation to predict when responses might be inaccurate. Accommodation to depth-filtered images was accurate and precise for image-plane separations up to ∼1 diopter, suggesting that depth filtering can be used to precisely match accommodation and vergence demands in a practical display. At larger plane separations, responses broke down in a manner consistent with our analysis. We develop this approach to consider how different spatial frequencies contribute to accommodation control. The results suggest that higher spatial frequencies contribute less to the accommodation response than has previously been thought.

The intrinsic constraint approach to cue combination: an empirical and theoretical evaluation.

We elucidate two properties of the intrinsic constraint (IC) model of depth cue combination (F. Domini, C. Caudek, & H. Tassinari, 2006). First, we show that IC combines depth cues in a weighted sum that maximizes the signal-to-noise ratio of the combined estimate. Second, we show that IC predicts that any two depth-matched pairs of stimuli are separated by equal numbers of just noticeable differences (JNDs) in depth. That is, IC posits a strong link between perceived depth and depth discrimination, much like some Fechnerian theories of sensory scaling. We test this prediction, and we find that it does not hold. We also find that depth discrimination performance approximately follows Weber's law, whereas IC assumes that depth discrimination thresholds are independent of baseline stimulus depth.