Spatial-numerical associations in the presence of an avatar.

When we interact with other people or avatars, they often provide an alternative spatial frame of reference compared to our own. Previous studies introduced avatars into stimulus-response compatibility tasks and demonstrated compatibility effects as if the participant was viewing the task from the avatar's point of view. However, the origin of this effect of perspective taking remained unclear. To distinguish changes in stimulus coding from changes in response coding, caused by the avatar, two experiments were conducted that combined a SNARC task and a spontaneous visual perspective taking task to specify the role of response coding. We observed compatibility effects that were based on the avatar's perspective rather than the participants' own. Because number magnitude was independent of the avatar's perspective, the observed changes in compatibility caused by different perspectives indicate changes in response coding. These changes in response coding are only significant when they are accompanied by visual action effects.

No evidence for automatic response activation with target onset in the avatar-compatibility task.

When people take the perspective of an avatar and perform a stimulus-response compatibility task, they generally show the same compatibility effects that are expected from the avatar's position instead of their own. In this study, we investigated if these effects are caused by automatic response activation, a concept featured in dual-route models of stimulus-response compatibility. In two experiments we asked 24 participants each to perform a compatibility task from an avatar's point of view. We introduced a delay between the presentation of the target and the avatar in half of the trials so that the participants had to wait until the avatar appeared to select the correct response. Because the automatic response activation is known to decay quickly, its influence is eliminated in this condition. In contrast to the prediction by the automatic response activation account, we observed a larger compatibility effect in the delayed condition with orthogonal (Experiment 1) and parallel (Experiment 2) stimulus-response pairings. Additionally, distributional analyses of the compatibility effects did not support the automaticity predictions. We conclude that these results call into question the role of automatic response activation for spatial compatibility in general and perspective-based compatibility effects in particular.

Time course of the blindness to response-compatible stimuli.

This article examines the time course of a deficit in identifying a stimulus sharing a compatible feature with a response that is executed in parallel ("blindness to response-compatible stimuli," J. Müsseler & B. Hommel, 1997a). In 5 experiments, participants performed a timed response, and the presentation point of time of a to-be-identified stimulus was varied in respect to response execution. A blindness effect was observed when the stimulus was presented between response cue offset and response execution. In contrast, the identification of a stimulus presented before the response cue or after response execution was not affected by stimulus-response compatibility--a finding that rules out a retention-based explanation. These results support an explanation that states that the perceptual processing of a stimulus feature is impaired as long as the shared perception-action feature code is integrated into the representation of a to-be-executed response.

The role of perception in the mislocalization of the final position of a moving target.

The judged final position of a moving stimulus has been suggested to be shifted in the direction of motion because of mental extrapolation (representational momentum). However, a perceptual explanation is possible: The eyes overshoot the final position of the target, and because of a foveal bias, the judged position is shifted in the direction of motion. To test this hypothesis, the authors replicated previous studies, but instead of having participants indicate where the target vanished, the authors probed participants' perceptual focus by presenting probe stimuli close to the vanishing point. Identification of probes in the direction of target motion was more accurate immediately after target offset than it was with a delay. Another experiment demonstrated that judgments of the final position of a moving target are affected by whether the eyes maintain fixation or follow the target. The results are more consistent with a perceptual explanation than with a memory account.

Can actions affect perceptual processing?

Previous studies reported impairments in a perceptual task performed during the selection and execution of an action. These findings, however, always raise the question of whether the impairment actually reflects a reduction in perceptual sensitivity or whether it results only from an unspecific reduction in attentiveness given the perceptual task. Recent studies by the authors indicate that actions can also have a specific impact on perception in a dual-task situation. The identification of a left or right arrow is impaired when it appears during the execution of a compatible left or right keypress. In three experiments Signal Detection Theory is applied to test whether this impairment is also found in the sensitivity measure d' or whether it originates only from a response tendency. The results revealed a general lower d' for the identification of arrows that were compatible to simultaneously executed keypresses than for arrows that were incompatible. The bias measure c was small and/or did not differ between conditions. Additional analyses revealed that the impairment is due to a higher mean perceptual degradation of stimuli in the compatible condition and that it is restricted to the point in time when the central movement command is generated. Thus, actions actually seem able to affect perceptual processing.

The Theory of Event Coding (TEC): a framework for perception and action planning.

Traditional approaches to human information processing tend to deal with perception and action planning in isolation, so that an adequate account of the perception-action interface is still missing. On the perceptual side, the dominant cognitive view largely underestimates, and thus fails to account for, the impact of action-related processes on both the processing of perceptual information and on perceptual learning. On the action side, most approaches conceive of action planning as a mere continuation of stimulus processing, thus failing to account for the goal-directedness of even the simplest reaction in an experimental task. We propose a new framework for a more adequate theoretical treatment of perception and action planning, in which perceptual contents and action plans are coded in a common representational medium by feature codes with distal reference. Perceived events (perceptions) and to-be-produced events (actions) are equally represented by integrated, task-tuned networks of feature codes--cognitive structures we call event codes. We give an overview of evidence from a wide variety of empirical domains, such as spatial stimulus-response compatibility, sensorimotor synchronization, and ideomotor action, showing that our main assumptions are well supported by the data.

Letter-detection patterns in German: a window to the early extraction of sentential structure during reading.

Letters are more difficult to detect in function words than in content words, presumably because function words serve to cue sentential structure but recede to the background as meaning unfolds. This function disadvantage was found for the definite article in German for all three genders and all four cases, but it was more pronounced when the article appeared in a nominative noun phrase than in an object noun phrase. It was also more pronounced for the typical subject-predicate-object sentential format than for the object-predicate-subject sentential format and also when the definite article unequivocally specified the case of a phrase than when it was ambiguous. The results suggest that the structural frames established on line in reading are finely tuned to both phrase-level and sentence-level organization.

Relative mislocalization of briefly presented stimuli in the retinal periphery.

We studied the ability to localize flashed stimuli, using a relative judgment task. When observers are asked to localize the peripheral position of a probe with respect to the midposition of a spatially extended comparison stimulus, they tend to judge the probe as being more toward the periphery than is the midposition of the comparison stimulus. We report seven experiments in which this novel phenomenon was explored. They reveal that the mislocalization occurs only when the probe and the comparison stimulus are presented in succession, independent of whether the probe or the comparison stimulus comes first (Experiment 1). The size of the mislocalization is dependent on the stimulus onset asynchrony (Experiment 2) and on the eccentricity of presentation (Experiment 3). In addition, the illusion also occurs in an absolute judgment task, which links mislocalization with the general tendency to judge peripherally presented stimuli as being more foveal than they actually are (Experiment 4). The last three experiments reveal that relative mislocalization is affected by the amount of spatial extension of the comparison stimulus (Experiment 5) and by its structure (Experiments 6 and 7). This pattern of results allows us to evaluate possible explanations of the illusion and to relate it to comparable tendencies observed in eye movement behavior. It is concluded that the system in charge of the guidance of saccadic eye movements is also the system that provides the metric in perceived visual space.

Sources of position-perception error for small isolated targets.

It has often been reported that, in the presence of static reference stimuli, briefly presented visual targets are perceived as being closer to the fixation point than they actually are. The first purpose of the present study was to investigate whether the same phenomenon can be demonstrated in a situation without static reference stimuli. Experiment 1, with position naming as the task, showed that such a central shift is also observed under these conditions. This finding is of importance because it completes an explanation for central near-location errors in the partial-report bar-probe task. The second purpose of the present study was to provide an explanation for these central shifts. For this explanation information about the exact size of the central shift is required. In Exps. 2, 3, and 4, with cursor setting as the task, it was attempted to assess more precisely the size of the central shifts. These experiments revealed that two different factors determine the results in cursor setting tasks; a factor "target position" and a factor "cursor position." Experiment 5 showed that it is the point of fixation, not the fixation point, that serves, at least in part, as the reference point in this type of task. All the findings together allow us to conclude that the target positions are underestimated by about 10%. From vision research it is known that saccadic eye movements, performed for bringing a target in the fovea, also show an undershoot of about 10%. It is therefore concluded that the system in charge of saccadic eye movements also provides the metric in visual space within a single eye fixation.

Localizing the first position of a moving stimulus: the Fröhlich effect and an attention-shifting explanation.

When subjects are asked to determine where a fast-moving stimulus enters a window, they typically do not localize the stimulus at the edge, but at some later position within that window (Fröhlich effect). We report five experiments that explored this illusion. An attentional account is tested, assuming that the entrance of the stimulus in the window initiates a focus shift toward it. While this shift is under way, the stimulus moves into the window. Because the first phenomenal (i.e., explicitly reportable) representation of the stimulus will not be available before the end of the focus shift, the stimulus is perceived at some later position. In Experiment 1, we established the Fröhlich effect and showed that it size depends on stimulus parameters such as movement speed and movement direction. In Experiments 2 and 3, we examined the influence of eye movements and tested whether the effect changed when the stimuli were presented within a structural background or when they started from different eccentricities. In Experiments 4 and 5, specific predictions from the attentional model were tested: In Experiment 4 we showed that the processing of the moving stimulus benefits from a preceding peripheral cue indicating the starting position of the subsequent movement, which induces a preliminary focus shift to the position where the moving stimulus would appear. As a consequence the Fröhlich effect was reduced. Using a detection task in Experiment 5, we showed that feature information about the moving stimulus is lost when it falls into the critical interval of the attention shift. In conclusion, the present attentional account shows that selection mechanisms are not exclusively space based; rather, they can establish a spatial representation that is also used for perceptual judgement--that is, selection mechanisms can be space establishing as well.

Blindness to response-compatible stimuli.

This contribution is devoted to the question of whether action-control processes may be demonstrated to influence perception. This influence is predicted from a framework in which stimulus processing and action control are assumed to share common codes, thus possibly interfering with each other. In 5 experiments, a paradigm was used that required a motor action during the presentation of a stimulus. The participants were presented with masked right- or left-pointing arrows shortly before executing an already prepared left or right keypress response. We found that the identification probability of the arrow was reduced when the to-be-executed reaction was compatible with the presented arrow. For example, the perception of a right-pointing arrow was impaired when presented during the execution of a right response as compared with that of a left response. The theoretical implications of this finding as well as its relation to other, seemingly similar phenomena (repetition blindness, inhibition of return, psychological refractory period) are discussed.

Action planning during the presentation of stimulus sequences: effects of compatible and incompatible stimuli.

Experimental designs that require the simultaneous perception and reproduction of a stimulus sequence could help to clarify the relationship between perception and action. This contribution examines a specific stimulus-response compatibility with the reproduction of simple stimulus sequences. In the procedure a response just prepared or one to be prepared is confronted with a new incoming stimulus that is compatible or incompatible with the response. Interference is predicted from a framework in which stimulus perception and action control are assumed to share common codes. Five arrows were successively presented at 1-s intervals. The arrows pointed either to the left or to the right with equal probability. One of the five arrows was accompanied by a randomly presented go signal. Subjects then had to reproduce the sequence by pressing corresponding left or right keys while the stimulus presentation continued. Reaction-time latencies and reaction intervals within a sequence were analyzed in six experiments. Results showed increasing reaction-time latencies the later the go signal was presented--that is, the longer the sequence to be reproduced was. In contrast to previous findings, this effect interacted with the compatibility between the arrow displayed together with the go signal and the first reaction. It is argued that the go signal initiates a transfer of a cognitive action plan to a peripheral motor program and that this process is subject to interference the more the current stimulus is at odds with one of the first parameter specification.

Position-dependent and position-independent attention shifts: evidence against the spotlight and premotor assumption of visual focussing.

One implication of the spotlight metaphor of visual-attention shifts is that attention moves from position to position, from one object in the visual field to another. According to this view, attention shifts start at the last-focussed position, their spatiotemporal course therefore being position dependent. A different, yet also position-dependent, formulation is implied in the so-called "premotor hypothesis of attention" (Rizzolatti et al., 1987; Umiltà et al., 1991). In this paper these two accounts are tested against an alternative, position-independent conception. It is maintained that in the case of onset-triggered processes, the course of the attentional shifts is independent of the last-focussed position. On the basis of these considerations, three experiments measure choice-reaction times of stimuli at different spatial positions after peripheral cuing of the same or another position within the visual field. Results show no evidence for the position-dependent conception of the spotlight metaphor or the premotor hypothesis with a long SOA (stimulus-onset asynchrony) between cue and stimulus. Only with a short SOA is the premotor hypothesis supported by the data. As an alternative interpretation, a position-independent thesis is favored, in which it is assumed that attention shifts can be adjusted during an early stage of processing.

Apparent distance reduction with moving stimuli (Tandem Effect): evidence for an attention-shifting model.

When two vertical rods move through a horizontal window in close succession, the Tandem Effect can be observed. It consists of a spatial illusion (distance between the rods looking smaller than it actually is) and a temporal illusion (under certain conditions both rods are seen simultaneously in the window, though the first rod has left the window before the second rod enters it). We report six experiments that explored the distance-reduction illusion and tested an attentional model of the effect. It assumes that attention is initially focused on the first rod and then shifted to the second, when it enters the window. The percept of the pair of rods is integrated from the first rod's position at the beginning, and the second rod's position at the end, of the focus shift. Consequently their subjective distance will be smaller than their physical distance by the distance that they travel during the focus shift. Experiments 1 and 2 established the Tandem Effect as an empirical phenomenon and showed that its size depends on stimulus parameters such as window size and movement speed. Experiments 3-5 tested specific predictions from the attentional model. Experiment 6 examined a further illusion, the Fröhlich Effect, and showed that it can be subsumed under the model. The experiments produced some unexpected effects and some predictions from the model were only partly confirmed. It is shown that the main findings can be combined into two quantitative functions that describe the course of focusing. One implication is that visual attention does not "move" from one object to another; rather all attention shifts originate in the fovea. We discuss several alternative interpretations of our data and show that they are less satisfactory than the attentional model.