Seeing mountains in mole hills: geographical-slant perception.

When observers face directly toward the incline of a hill, their awareness of the slant of the hill is greatly overestimated, but motoric estimates are much more accurate. The present study examined whether similar results would be found when observers were allowed to view the side of a hill. Observers viewed the cross-sections of hills in real (Experiment 1) and virtual (Experiment 2) environments and estimated the inclines with verbal estimates, by adjusting the cross-section of a disk, and by adjusting a board with their unseen hand to match the inclines. We found that the results for cross-section viewing replicated those found when observers directly face the incline. Even though the angles of hills are directly evident when viewed from the side, slant perceptions are still grossly overestimated.

Imagining physically impossible self-rotations: geometry is more important than gravity.

Previous studies found that it is easier for observers to spatially update displays during imagined self-rotation versus array rotation. The present study examined whether either the physics of gravity or the geometric relationship between the viewer and array guided this self-rotation advantage. Experiments 1-3 preserved a real or imagined orthogonal relationship between the viewer and the array, requiring a rotation in the observer's transverse plane. Despite imagined self-rotations that defied gravity, a viewer advantage remained. Without this orthogonal relationship (Experiment 4), the viewer advantage was lost. We suggest that efficient transformation of the egocentric reference frame relies on the representation of body-environment relations that allow rotation around the observer's principal axis. This efficiency persists across different and conflicting physical and imagined postures.

Defining the cortical visual systems: "what", "where", and "how".

The visual system historically has been defined as consisting of at least two broad subsystems subserving object and spatial vision. These visual processing streams have been organized both structurally as two distinct pathways in the brain, and functionally for the types of tasks that they mediate. The classic definition by Ungerleider and Mishkin labeled a ventral "what" stream to process object information and a dorsal "where" stream to process spatial information. More recently, Goodale and Milner redefined the two visual systems with a focus on the different ways in which visual information is transformed for different goals. They relabeled the dorsal stream as a "how" system for transforming visual information using an egocentric frame of reference in preparation for direct action. This paper reviews recent research from psychophysics, neurophysiology, neuropsychology and neuroimaging to define the roles of the ventral and dorsal visual processing streams. We discuss a possible solution that allows for both "where" and "how" systems that are functionally and structurally organized within the posterior parietal lobe.

Comparing viewer and array mental rotations in different planes.

Participants imagined rotating either themselves or an array of objects that surrounded them. Their task was to report on the egocentric position of an item in the array following the imagined rotation. The dependent measures were response latency and number of errors committed. Past research has shown that self-rotation is easier than array rotation. However, we found that imagined egocentric rotations were as difficult to imagine as rotations of the environment when people performed imagined rotations in the midsagittal or coronal plane. The advantages of imagined self-rotations are specific to mental rotations performed in the transverse plane.

Grasping objects by their handles: a necessary interaction between cognition and action.

Research has illustrated dissociations between "cognitive" and "action" systems, suggesting that different representations may underlie phenomenal experience and visuomotor behavior. However, these systems also interact. The present studies show a necessary interaction when semantic processing of an object is required for an appropriate action. Experiment 1 demonstrated that a semantic task interfered with grasping objects appropriately by their handles, but a visuospatial task did not. Experiment 2 assessed performance on a visuomotor task that had no semantic component and showed a reversal of the effects of the concurrent tasks. In Experiment 3, variations on concurrent word tasks suggested that retrieval of semantic information was necessary for appropriate grasping. In all, without semantic processing, the visuomotor system can direct the effective grasp of an object, but not in a manner that is appropriate for its use.

An fMRI study of imagined self-rotation.

In the present study, functional magnetic resonance imaging was used to examine the neural mechanisms involved in the imagined spatial transformation of one's body. The task required subjects to update the position of one of four external objects from memory after they had performed an imagined self-rotation to a new position. Activation in the rotation condition was compared with that in a control condition in which subjects located the positions of objects without imagining a change in self-position. The results indicated similar networks of activation to other egocentric transformation tasks involving decisions about body parts. The most significant area of activation was in the left posterior parietal cortex. Other regions of activation common among several of the subjects were secondary visual, premotor, and frontal lobe regions. These results are discussed relative to motor and visual imagery processes as well as to the distinctions between the present task and other imagined egocentric transformation tasks.

Hierarchical motion organization in random dot configurations.

Motion organization has 2 aspects: the extraction of a (moving) frame of reference and the hierarchical organization of moving elements within the reference frame. Using a discrimination of relative motions task, the authors found large differences between different types of motion (translation, divergence, and rotation) in the degree to which each can serve as a moving frame of reference. Translation and divergence are superior to rotation. There are, however, situations in which rotation can serve as a reference frame. This is due to the presence of a second factor, structural invariants (SIs). SIs are spatial relationships persisting among the elements within a configuration such as a collinearity among points or one point coinciding with the center of rotation for another (invariant radius). The combined effect of these 2 factors--motion type and SIs-influences perceptual motion organization.

Eye height scaling of absolute size in immersive and nonimmersive displays.

Eye-height (EH) scaling of absolute height was investigated in three experiments. In Experiment 1, standing observers viewed cubes in an immersive virtual environment. Observers' center of projection was placed at actual EH and at 0.7 times actual EH. Observers' size judgments revealed that the EH manipulation was 76.8% effective. In Experiment 2, seated observers viewed the same cubes on an interactive desktop display; however, no effect of EH was found in response to the simulated EH manipulation. Experiment 3 tested standing observers in the immersive environment with the field of view reduced to match that of the desktop. Comparable to Experiment 1, the effect of EH was 77%. These results suggest that EH scaling is not generally used when people view an interactive desktop display because the altitude of the center of projection is indeterminate. EH scaling is spontaneously evoked, however, in immersive environments.

Updating displays after imagined object and viewer rotations.

Six experiments compared spatial updating of an array after imagined rotations of the array versus viewer. Participants responded faster and made fewer errors in viewer tasks than in array tasks while positioned outside (Experiment 1) or inside (Experiment 2) the array. An apparent array advantage for updating objects rather than locations was attributable to participants imagining translations of single objects rather than rotations of the array (Experiment 3). Superior viewer performance persisted when the array was reduced to 1 object (Experiment 4); however, an object with a familiar configuration improved object performance somewhat (Experiment 5). Object performance reached near-viewer levels when rotations included haptic information for the turning object. The researchers discuss these findings in terms of the relative differences in which the human cognitive system transforms the spatial reference frames corresponding to each imagined rotation.

Perception-action dissociations of a walkable Müller-Lyer configuration.

These studies examined the role of spatial encoding in inducing perception-action dissociations in visual illusions. Participants were shown a large-scale Müller-Lyer configuration with hoops as its tails. In Experiment 1, participants either made verbal estimates of the extent of the Müller-Lyer shaft (verbal task) or walked the extent without vision, in an offset path (blind-walking task). For both tasks, participants stood a small distance away from the configuration, to elicit object-relative encoding of the shaft with respect to its hoops. A similar illusion bias was found in the verbal and motoric tasks. In Experiment 2, participants stood at one endpoint of the shaft in order to elicit egocentric encoding of extent. Verbal judgments continued to exhibit the illusion bias, whereas blind-walking judgments did not. These findings underscore the importance of egocentric encoding in motor tasks for producing perception-action dissociations.

Mapping the zone of eye-height utility for seated and standing observers.

In a series of experiments, we delimited a region within the vertical axis of space in which eye height (EH) information is used maximally to scale object heights, referred to as the "zone of eye height utility" (Wraga, 1999b Journal of Experimental Psychology, Human Perception and Performance 25 518-530). To test the lower limit of the zone, linear perspective (on the floor) was varied via introduction of a false perspective (FP) gradient while all sources of EH information except linear perspective were held constant. For seated (experiment 1a) observers, the FP gradient produced overestimations of height for rectangular objects up to 0.15 EH tall. This value was taken to be just outside the lower limit of the zone. This finding was replicated in a virtual environment, for both seated (experiment 1b) and standing (experiment 2) observers. For the upper limit of the zone, EH information itself was manipulated by lowering observers' center of projection in a virtual scene. Lowering the effective EH of standing (experiment 3) and seated (experiment 4) observers produced corresponding overestimations of height for objects up to about 2.5 EH. This zone of approximately 0.20-2.5 EH suggests that the human visual system weights size information differentially, depending on its efficacy.

The influence of spatial reference frames on imagined object- and viewer rotations.

The human visual system can represent an object's spatial structure with respect to multiple frames of reference. It can also utilize multiple reference frames to mentally transform such representations. Recent studies have shown that performance on some mental transformations is not equivalent: Imagined object rotations tend to be more difficult than imagined viewer rotations. We reviewed several related research domains to understand this discrepancy in terms of the different reference frames associated with each imagined movement. An examination of the mental rotation literature revealed that observers' difficulties in predicting an object's rotational outcome may stem from a general deficit with imagining the cohesive rotation of the object's intrinsic frame. Such judgments are thus more reliant on supplementary information provided by other frames, such as the environmental frame. In contrast, as assessed in motor imagery and other studies, imagined rotations of the viewer's relative frame are performed cohesively and are thus mostly immune to effects of other frames.

Visual-motor recalibration in geographical slant perception.

In 4 experiments, it was shown that hills appear steeper to people who are encumbered by wearing a heavy backpack (Experiment 1), are fatigued (Experiment 2), are of low physical fitness (Experiment 3), or are elderly and/or in declining health (Experiment 4). Visually guided actions are unaffected by these manipulations of physiological potential. Although dissociable, the awareness and action systems were also shown to be interconnected. Recalibration of the transformation relating awareness and actions was found to occur over long-term changes in physiological potential (fitness level, age, and health) but not with transitory changes (fatigue and load). Findings are discussed in terms of a time-dependent coordination between the separate systems that control explicit visual awareness and visually guided action.

Seeing big things: overestimation of heights is greater for real objects than for objects in pictures.

In six experiments we demonstrate that the vertical-horizontal illusion that is evoked when viewing photographs and line drawings is relatively small, whereas the magnitude of this illusion when large objects are viewed is at least twice as great. Furthermore, we show that the illusion is due more to vertical overestimation than horizontal underestimation. The lack of a difference in vertical overestimation between pictures and line drawings suggests that vertical overestimation in pictures depends solely on the perceived physical size of the projection on the picture surface, rather than on what is apparent about an object's represented size. The vertical-horizontal illusion is influenced by perceived physical size. It is greater when viewing large objects than small pictures of these same objects, even when visual angles are equated.

Relative size perception at a distance is best at eye level.

Relative size judgments were collected for two objects at 30.5 m and 23.8 from the observer in order to assess how performance depends on the relationship between the size of the objects and the eye level of the observer. In three experiments in an indoor hallway and in one experiment outdoors, accuracy was higher for objects in the neighborhood of eye level. We consider these results in the light of two hypotheses. One proposes that observers localize the horizon as a reference for judging relative size, and the other proposes that observers perceive the general neighborhood of the horizon and then employ a height-in-visual-field heuristic. The finding that relative size judgments are best around the horizon implies that information that is independent of distance perception is used in perceiving size.

Two memories for geographical slant: separation and interdependence of action and awareness.

The present study extended previous findings of geographical slant perception, in which verbal judgments of the incline of hills were greatly overestimated but motoric (haptic) adjustments were much more accurate. In judging slant from memory following a brief or extended time delay, subjects' verbal judgments were greater than those given when viewing hills. Motoric estimates differed depending on the length of the delay and place of response. With a short delay, motoric adjustments made in the proximity of the hill did not differ from those evoked during perception. When given a longer delay or when taken away from the hill, subjects' motoric responses increased along with the increase in verbal reports. These results suggest two different memorial influences on action. With a short delay at the hill, memory for visual guidance is separate from the explicit memory informing the conscious response. With short or long delays away from the hill, short-term visual guidance memory no longer persists, and both motor and verbal responses are driven by an explicit representation. These results support recent research involving visual guidance from memory, where actions become influenced by conscious awareness, and provide evidence for communication between the "what" and "how" visual processing systems.

Misperceptions of angular velocities influence the perception of rigidity in the kinetic depth effect.

Accuracy in discriminating rigid from nonrigid motion was investigated for orthographic projections of three-dimension rotating objects. In 3 experiments the hypothesis that magnitudes of angular velocity are misperceived in the kinetic depth effect was tested, and in 4 other experiments the hypothesis that misperceiving angular velocities leads to misperceiving rigidity was tested. The principal findings were (a) the magnitude of perceived angular velocity is derived heuristically as a function of a property of the first-order optic flow called deformation and (b) perceptual performance in discriminating rigid from nonrigid motion is accurate in cases when the variability of the deformations of the individual triplets of points of the stimulus displays favors this interpretation and not accurate in other cases.

The props-based interface for neurosurgical visualization.

We describe a three-dimensional human-computer interface for neurosurgical visualization. The interface is based on the two-handed physical manipulation of hand-held tools, or "props", in free space. These user interface "props" facilitate transfer of the user's skills for manipulating tools with two hands to the operation of a user interface for visualizing 3D medical images, without need for training. The interface allows neurosurgeons to explore a 3D MRI scan of a patient's brain during presurgical planning. From the surgeon's perspective, the interface is analogous to holding a miniature head in one hand which can be "sliced open" or "pointed to" using a cross-sectioning plane or a stylus tool, respectively, held in the other hand. Cross-sectioning a 3D volume, for example, simply requires the surgeon to hold a plastic plate (held in the preferred hand) up to the miniature head (held in the nonpreferred hand) to demonstrate the desired cross-section.

Semantic versus perceptual influences of color in object recognition.

The influence of color as a surface feature versus its influence as stored knowledge in object recognition was assessed. Participants decided whether a briefly presented and masked picture matched a test name. For pictures and words referring to similarly shaped objects, semantic color similarity (SCS) was present when picture and word shared the same prototypical color (e.g., purple apple followed by cherry). Perceptual color similarity (PCS) was present when the surface color of the picture matched the prototypical color of the named object (e.g., purple apple followed by blueberry). Response interference was primarily due to SCS, despite the fact that participants based similarity ratings on PCS. When uncolored objects were used, SCS interference still occurred, implying that the influence of SCS did not depend on the presence of surface color. The results indicate that, relative to surface color, stored color knowledge was more influential in object recognition.

Visual learning in the perception of texture: simple and contingent aftereffects of texture density.

Novel results elucidating the magnitude, binocularity and retinotopicity of aftereffects of visual texture density adaptation are reported as is a new contingent aftereffect of texture density which suggests that the perception of visual texture density is quite malleable. Texture aftereffects contingent upon orientation, color and temporal sequence are discussed. A fourth effect is demonstrated in which auditory contingencies are shown to produce a different kind of visual distortion. The merits and limitations of error-correction and classical conditioning theories of contingent adaptation are reviewed. It is argued that a third kind of theory which emphasizes coding efficiency and informational considerations merits close attention. It is proposed that malleability in the registration of texture information can be understood as part of the functional adaptability of perception.