Brain representations of motion and position in the double-drift illusion.

In the 'double-drift' illusion, local motion within a window moving in the periphery of the visual field alters the window's perceived path. The illusion is strong even when the eyes track a target whose motion matches the window so that the stimulus remains stable on the retina. This implies that the illusion involves the integration of retinal signals with non-retinal eye-movement signals. To identify where in the brain this integration occurs, we measured BOLD fMRI responses in visual cortex while subjects experienced the double-drift illusion. We then used a combination of univariate and multivariate decoding analyses to identify (1) which brain areas were sensitive to the illusion and (2) whether these brain areas contained information about the illusory stimulus trajectory. We identified a number of cortical areas that responded more strongly during the illusion than a control condition that was matched for low-level stimulus properties. Only in area hMT+ was it possible to decode the illusory trajectory. We additionally performed a number of important controls that rule out possible low-level confounds. Concurrent eye tracking confirmed that subjects accurately tracked the moving target; we were unable to decode the illusion trajectory using eye position measurements recorded during fMRI scanning, ruling out explanations based on differences in oculomotor behavior. Our results provide evidence for a perceptual representation in human visual cortex that incorporates extraretinal information.

Spatiotopic and retinotopic memory in the context of natural images.

Neural responses throughout the visual cortex encode stimulus location in a retinotopic (i.e., eye-centered) reference frame, and memory for stimulus position is most precise in retinal coordinates. Yet visual perception is spatiotopic: objects are perceived as stationary, even though eye movements cause frequent displacement of their location on the retina. Previous studies found that, after a single saccade, memory of retinotopic locations is more accurate than memory of spatiotopic locations. However, it is not known whether various aspects of natural viewing affect the retinotopic reference frame advantage. We found that the retinotopic advantage may in part depend on a retinal afterimage, which can be effectively nullified through backwards masking. Moreover, in the presence of natural scenes, spatiotopic memory is more accurate than retinotopic memory, but only when subjects are provided sufficient time to process the scene before the eye movement. Our results demonstrate that retinotopic memory is not always more accurate than spatiotopic memory and that the fidelity of memory traces in both reference frames are sensitive to the presence of contextual cues.

Target capture strategy selection in a simulated marksmanship task.

This paper examines how individuals track targets that move in relatively unpredictable trajectories. Gaze and behavioural data were captured as twenty two participants learned a simulated competitive marksmanship task known colloquially as the Death Star over six training days. Participants spontaneously selected one of two consistent target-tracking strategies with approximately equal probability. Participants employed either chasing behaviour, in which gaze follows a target's trajectory before a shot, or ambushing behaviour, wherein gaze anticipates the trajectory and the participant intercepts a moving target predictively. All participants improved in task performance measures (completion time and number of shots), but did so at the expense of accuracy in missed shot attempts. Surprisingly, neither behavioural strategy offered a significant advantage in task performance measures, indicating that either may be equally effective in tackling a hand-eye coordination task with complex target motion such as the Death Star.