What determines location specificity or generalization of transsaccadic learning?

Humans incorporate knowledge of transsaccadic associations into peripheral object perception. Several studies have shown that learning of new manipulated transsaccadic associations leads to a presaccadic perceptual bias. However, there was still disagreement whether this learning effect was location specific (Herwig, Weiß, & Schneider, 2018) or generalizes to new locations (Valsecchi & Gegenfurtner, 2016). The current study investigated under what conditions location generalization of transsaccadic learning occurs. In all experiments, there were acquisition phases in which the spatial frequency (Experiment 1) or the size (Experiment 2 and 3) of objects was changed transsaccadically. In the test phases, participants judged the respective feature of peripheral objects. These could appear either at the location where learning had taken place or at new locations. All experiments replicated the perceptual bias effect at the old learning locations. In two experiments, transsaccadic learning remained location specific even when learning occurred at multiple locations (Experiment 1) or with the feature of size (Experiment 2) for which a transfer had previously been shown. Only in Experiment 3 was a transfer of the learning effect to new locations observable. Here, learning only took place for one object and not for several objects that had to be discriminated. Therefore, one can conclude that, when specific associations are learned for multiple objects, transsaccadic learning stays location specific and when a transsaccadic association is learned for only one object it allows a generalization to other locations.

A conceptual framework on body representations and their relevance for mental disorders.

Many mental disorders are accompanied by distortions in the way the own body is perceived and represented (e.g., eating disorders, body dysmorphic disorder including muscle dysmorphia, or body integrity dysphoria). We are interested in the way these distortions develop and aim at better understanding their role in mental health across the lifespan. For this purpose, we first propose a conceptual framework of body representation that defines this construct and integrates different perspectives (e.g., cognitive neuroscience, clinical psychology) on body representations. The framework consists of a structural and a process model of body representation emphasizing different goals: the structural model aims to support researchers from different disciplines to structure results from studies and help collectively accumulate knowledge about body representations and their role in mental disorders. The process model is reflecting the dynamics during the information processing of body-related stimuli. It aims to serve as a motor for (experimental) study development on how distorted body representations emerge and might be changed. Second, we use this framework to review the normative development of body representations as well as the development of mental disorders that relate to body representations with the aim to further clarify the potential transdiagnostic role of body representations.

Transsaccadic object associations shape peripheral perception: The role of reliability.

Faced with inhomogeneous representations, the visual system has to rely on pre- and postsaccadic processing mechanisms to assure perceptual continuity across eye movements. While postsaccadically, memorized peripheral and postsaccadic foveal information are integrated according to their reliabilities, here we investigated whether this also holds true for the presaccadic combination of peripheral input and internal associated foveal images. In three experiments, participants learned associations between objects changing transsaccadically in one feature dimension (spatial frequency in Experiment 1 and color in Experiments 2 and 3). Subsequently, participants judged the respective feature of only peripherally presented objects. Importantly, the reliability of this peripheral input was manipulated by lowering the contrast (Experiment 1) or adding color noise (Experiment 3). We hypothesized that participants' presaccadic peripheral percepts would be biased toward the internal associated foveal image and that the biasing effect would be stronger the lower the peripheral reliability. In all experiments, perception was biased in the direction of the associated foveal image. However, the strength of the bias did not differ between reliability conditions. The presaccadic perceptual bias effect had previously not been tested with the feature color. By showing that yet another feature incorporates prior transsaccadic knowledge, our results highlight the scope of the effect. Furthermore, they point to important differences between pre- and postsaccadic processing mechanisms. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Prediction of complex stimuli across saccades.

The visual system can predict visual features across saccades based on learned transsaccadic associations between peripheral and foveal input. This has been shown for simple visual features such as shape, size, and spatial frequency. The present study investigated whether transsaccadic predictions are also made for more complex visual stimuli. In an acquisition phase, new transsaccadic associations were established. In the first experiment, pictures of real-world objects changed category during the saccade (fruits were changed into balls or vice versa). In the second experiment, the gender of faces was manipulated during the saccade (faces changed from male to female or vice versa). In the following test phase, the stimuli were briefly presented in the periphery, and participants had to indicate which object or face, respectively, they had perceived. In both experiments, peripheral perception was biased toward the acquired associated foveal input. These results demonstrate that transsaccadic predictions are not limited to a small set of simple visual features but can also be made for more complex and realistic stimuli. Multiple new associations can be learned within a short time frame, and the resulting predictions appear to be object specific.

Differentiating Progressive Supranuclear Palsy and Parkinson's Disease With Head-Mounted Displays.

Background: Progressive supranuclear palsy (PSP) is a neurodegenerative disorder that, especially in the early stages of the disease, is clinically difficult to distinguish from Parkinson's disease (PD). Objective: This study aimed at assessing the use of eye-tracking in head-mounted displays (HMDs) for differentiating PSP and PD. Methods: Saccadic eye movements of 13 patients with PSP, 15 patients with PD, and a group of 16 healthy controls (HCs) were measured. To improve applicability in an inpatient setting and standardize the diagnosis, all the tests were conducted in a HMD. In addition, patients underwent atlas-based volumetric analysis of various brain regions based on high-resolution MRI. Results: Patients with PSP displayed unique abnormalities in vertical saccade velocity and saccade gain, while horizontal saccades were less affected. A novel diagnostic index was derived, multiplying the ratios of vertical to horizontal gain and velocity, allowing segregation of PSP from PD with high sensitivity (10/13, 77%) and specificity (14/15, 93%). As expected, patients with PSP as compared with patients with PD showed regional atrophy in midbrain volume, the midbrain plane, and the midbrain tegmentum plane. In addition, we found for the first time that oculomotor measures (vertical gain, velocity, and the diagnostic index) were correlated significantly to midbrain volume in the PSP group. Conclusions: Assessing eye movements in a HMD provides an easy to apply and highly standardized tool to differentiate PSP of patients from PD and HCs, which will aid in the diagnosis of PSP.

A comparison of the temporal and spatial properties of trans-saccadic perceptual recalibration and saccadic adaptation.

Repeated exposure to a consistent trans-saccadic step in the position of the saccadic target reliably produces a change of saccadic gain, a well-established trans-saccadic motor learning phenomenon known as saccadic adaptation. Trans-saccadic changes can also produce perceptual effects. Specifically, a systematic increase or decrease in the size of the object that is being foveated changes the perceptually equivalent size between fovea and periphery. Previous studies have shown that this recalibration of perceived size can be established within a few dozen trials, persists overnight, and generalizes across hemifields. In the current study, we use a novel adjustment paradigm to characterize both temporally and spatially the learning process that subtends this form of recalibration, and directly compare its properties to those of saccadic adaptation. We observed that sinusoidal oscillations in the amplitude of the trans-saccadic change produce sinusoidal oscillations in the reported peripheral size, with a lag of under 10 trials. This is qualitatively similar to what has been observed in the case of saccadic adaptation. We also tested whether learning is generalized to the mirror location on the opposite hemifield for both size recalibration and saccade adaptation. Here the results were markedly different, showing almost complete generalization for recalibration and no generalization for saccadic adaptation. We conclude that perceptual and visuomotor consequences of trans-saccadic changes rely on learning mechanisms that are distinct but develop on similar time scales.

Object discrepancy modulates feature prediction across eye movements.

Object perception across saccadic eye movements is assumed to result from integrating two information sources: incoming peripheral object information and information from a foveal prediction (Herwig and Schneider, J Exp Psychol Gen 143(5):1903-1922, 2014, Herwig, J Vis 15(16), 7, 2015). Predictions are supposed to be based on transsaccadic associations of peripheral and foveal object information. The main function of these predictions may be to conceal discrepancies in resolution and locations across saccades. Here we ask how predictions are affected by discrepancies between peripheral and foveal objects. Participants learned unfamiliar transsaccadic associations by making saccades to objects whose shape systematically changed during the saccade. Importantly, we manipulated the size of this change between participants to induce different magnitudes of object discrepancy. In a subsequent test, we found that judgment shifts of peripheral shape perception toward the predicted foveal input depended on change size during acquisition. Specifically, the contribution of prediction decreased for large changes but did not reach zero, showing that even for large changes (i.e., square to circle or vice versa) the prediction was not ignored completely. These findings indicate that object discrepancy during learning determines how much the resulting foveal prediction contributes to perception in the periphery.

Feature prediction across eye movements is location specific and based on retinotopic coordinates.

With each saccadic eye movement, internal object representations change their retinal position and spatial resolution. Recently, we suggested that the visual system deals with these saccade-induced changes by predicting visual features across saccades based on transsaccadic associations of peripheral and foveal input (Herwig & Schneider, 2014). Here we tested the specificity of feature prediction by asking (a) whether it is spatially restricted to the previous learning location or the saccade target location, and (b) whether it is based on retinotopic (eye-centered) or spatiotopic (world-centered) coordinates. In a preceding acquisition phase, objects systematically changed their spatial frequency during saccades. In the following test phases of two experiments, participants had to judge the frequency of briefly presented peripheral objects. These objects were presented either at the previous learning location or at new locations and were either the target of a saccadic eye movement or not (Experiment 1). Moreover, objects were presented either in the same or different retinotopic and spatiotopic coordinates (Experiment 2). Spatial frequency perception was biased toward previously associated foveal input indicating transsaccadic learning and feature prediction. Importantly, while this pattern was not bound to the saccade target location, it was seen only at the previous learning location in retinotopic coordinates, suggesting that feature prediction probably affects low- or mid-level perception.

Calibration of peripheral perception of shape with and without saccadic eye movements.

The cortical representations of a visual object differ radically across saccades. Several studies claim that the visual system adapts the peripheral percept to better match the subsequent foveal view. Recently, Herwig, Weiß, and Schneider (2015, Annals of the New York Academy of Sciences, 1339(1), 97-105) found that the perception of shape demonstrates a saccade-dependent learning effect. Here, we ask whether this learning actually requires saccades. We replicated Herwig et al.'s (2015) study and introduced a fixation condition. In a learning phase, participants were exposed to objects whose shape systematically changed during a saccade, or during a displacement from peripheral to foveal vision (without a saccade). In a subsequent test, objects were perceived as less (more) curved if they previously changed from more circular (triangular) in the periphery to more triangular (circular) in the fovea. Importantly, this pattern was seen both with and without saccades. We then tested whether a variable delay between the presentations of the peripheral and foveal objects would affect their association-hypothetically weakening it at longer delays. Again, we found that shape judgments depended on the changes experienced during the learning phase and that they were similar in both the saccade and fixation conditions. Surprisingly, they were not affected by the delay between the peripheral and foveal presentations over the range we tested. These results suggest that a general associative process, independent of saccade execution, contributes to the perception of shape across viewpoints.

Spatio-temporal dynamics of action-effect associations in oculomotor control.

While there is ample evidence that actions are guided by anticipating their effects (ideomotor control) in the manual domain, much less is known about the underlying characteristics and dynamics of effect-based oculomotor control. Here, we address three open issues. 1) Is action-effect anticipation in oculomotor control reflected in corresponding spatial saccade characteristics in inanimate environments? 2) Does the previously reported dependency of action latency on the temporal effect delay (action-effect interval) also occur in the oculomotor domain? 3) Which temporal effect delay is optimally suited to develop strong action-effect associations over time in the oculomotor domain? Participants executed left or right free-choice saccades to peripheral traffic lights, causing an (immediate or delayed) action-contingent light switch in the upper vs. lower part of the traffic light. Results indicated that saccades were spatially shifted toward the location of the upcoming change, indicating anticipation of the effect (location). Saccade latency was affected by effect delay, suggesting that corresponding time information is integrated into event representations. Finally, delayed (vs. immediate) effects were more effective in strengthening action-effect associations over the course of the experiment, likely due to greater saliency of perceptual changes occurring during target fixation as opposed to changes during saccades (saccadic suppression). Overall, basic principles underlying ideomotor control appear to generalize to the oculomotor domain.

Distractor Dwelling, Skipping, and Revisiting Determine Target Absent Performance in Difficult Visual Search.

Some targets in visual search are more difficult to find than others. In particular, a target that is similar to the distractors is more difficult to find than a target that is dissimilar to the distractors. Efficiency differences between easy and difficult searches are manifest not only in target-present trials but also in target-absent trials. In fact, even physically identical displays are searched through with different efficiency depending on the searched-for target. Here, we monitored eye movements in search for a target similar to the distractors (difficult search) versus a target dissimilar to the distractors (easy search). We aimed to examine three hypotheses concerning the causes of differential search efficiencies in target-absent trials: (a) distractor dwelling (b) distractor skipping, and (c) distractor revisiting. Reaction times increased with target similarity which is consistent with existing theories and replicates earlier results. Eye movement data indicated guidance in target trials, even though search was very slow. Dwelling, skipping, and revisiting contributed to low search efficiency in difficult search, with dwelling being the strongest factor. It is argued that differences in dwell time account for a large amount of total search time differences.

Novelty biases attention and gaze in a surprise trial.

While the classical distinction between task-driven and stimulus-driven biasing of attention appears to be a dichotomy at first sight, there seems to be a third category that depends on the contrast or discrepancy between active representations and the upcoming stimulus, and may be termed novelty, surprise, or prediction failure. For previous demonstrations of the discrepancy-attention link, stimulus-driven components (saliency) may have played a decisive role. The present study was conducted to evaluate the discrepancy-attention link in a display where novel and familiar stimuli are equated for saliency. Eye tracking was used to determine fixations on novel and familiar stimuli as a proxy for attention. Results show a prioritization of attention by the novel color, and a de-prioritization of the familiar color, which is clearly present at the second fixation, and spans over the next couple of fixations. Saliency, on the other hand, did not prioritize items in the display. The results thus reinforce the notion that novelty captures and binds attention.

Transsaccadic integration and perceptual continuity.

Our perception of the visual world seems continuous despite the fact that visual information is sampled in discrete fixations interrupted by saccadic eye movements. Two new behavioral studies show that perceptual continuity may be partly achieved by combining feature information of saccade target objects across saccades in a close-to-statistically optimal fashion.

A "blanking effect" for surface features: Transsaccadic spatial-frequency discrimination is improved by postsaccadic blanking.

Although saccadic eye movements occur frequently­about three or four times a second­humans are astonishingly blind to transsaccadic changes. Locational displacements of the saccade target of up to 2 deg of visual angle, and even large changes of a visual scene, can go unnoticed. For a long time, this insensitivity was ascribed to deficits in transsaccadic memory: Only a coarse, (spatially) imprecise representation would be retained across a saccade. This assumption was contradicted by Deubel's and Schneider's (Behavioral and Brain Sciences 17:259-260, 1994) striking finding that locational discrimination performance across a saccade is greatly improved by inserting a short postsaccadic blank. Surprisingly, the question of whether blanking effects occur also for other forms of transsaccadic changes (i.e., surface-feature changes) has been widely ignored. We tested this question by means of a transsaccadic change in spatial frequency. Postsaccadic blanking facilitated spatial-frequency discrimination, but to a smaller amount than the usual blanking effects obtained with locational displacements. This finding bears important implications for models of visual stability and transsaccadic memory.

Linking perception and action by structure or process? Toward an integrative perspective.

Over the past decades cognitive neuroscience's renewed interest in action has intensified the search of principles explaining how the cognitive system links perception to action and vice versa. To date, at least two seemingly alternative approaches can be distinguished. Perception and action might be linked either by common representational structures, as assumed by the ideomotor approach, or by common attentional processes, as assumed by the attention approach. This article first reviews the evidence from different paradigms supporting each approach. It becomes clear that most studies selectively focus either on actions directed at goals outside the actors' perceptual range (supporting the ideomotor approach) or on actions directed at targets within the actors' perceptual range (supporting the attention approach). In a second step, I will try to reconcile both approaches by reviewing recent eye movement studies that abolish the classical combination of approach and goals under study. Demonstrating that both approaches cover target- as well as goal-directed actions, it is proposed that operations addressed in both conceptual frameworks interact with each other.

When circles become triangular: how transsaccadic predictions shape the perception of shape.

Human vision is characterized by a consistent pattern of saccadic eye movements. With each saccade, internal object representations change their retinal position and spatial resolution. This raises the question as to how peripheral perception is affected by imminent saccadic eye movements. Here, we suggest that saccades are accompanied by a prediction of their perceptual consequences (i.e., the foveation of the target object). Accordingly, peripheral perception should be biased toward previously associated foveal input. In this study, we first exposed participants to an altered visual stimulation where one object systematically changed its shape during saccades. Subsequently, participants had to judge the shape of briefly presented peripheral saccade targets. The results showed that targets were perceived as less curved for objects that previously changed from more circular in the periphery to more triangular in the fovea. Similarly, shapes were perceived as more curved for objects that previously changed from triangular to circular. Thus, peripheral perception seems to depend not solely on the current input but also on memorized experiences, enabling predictions about the perceptual consequences of saccadic eye movements.

Surprise attracts the eyes and binds the gaze.

In recent years, researchers have become increasingly interested in the effects that deviations from expectations have on cognitive processing and, in particular, on the deployment of attention. Previous evidence for a surprise-attention link had been based on indirect measures of attention allocation. Here we used eyetracking to directly observe the impact of a novel color on its unannounced first presentation, which we regarded as a surprise condition. The results show that the novel color was quickly responded to with an eye movement, and that gaze was not turned away for a considerable amount of time. These results are direct evidence that deviations from expectations bias attentional priorities and lead to enhanced processing of the deviating stimulus.

Breaking Object Correspondence Across Saccadic Eye Movements Deteriorates Object Recognition.

Visual perception is based on information processing during periods of eye fixations that are interrupted by fast saccadic eye movements. The ability to sample and relate information on task-relevant objects across fixations implies that correspondence between presaccadic and postsaccadic objects is established. Postsaccadic object information usually updates and overwrites information on the corresponding presaccadic object. The presaccadic object representation is then lost. In contrast, the presaccadic object is conserved when object correspondence is broken. This helps transsaccadic memory but it may impose attentional costs on object recognition. Therefore, we investigated how breaking object correspondence across the saccade affects postsaccadic object recognition. In Experiment 1, object correspondence was broken by a brief postsaccadic blank screen. Observers made a saccade to a peripheral object which was displaced during the saccade. This object reappeared either immediately after the saccade or after the blank screen. Within the postsaccadic object, a letter was briefly presented (terminated by a mask). Observers reported displacement direction and letter identity in different blocks. Breaking object correspondence by blanking improved displacement identification but deteriorated postsaccadic letter recognition. In Experiment 2, object correspondence was broken by changing the object's contrast-polarity. There were no object displacements and observers only reported letter identity. Again, breaking object correspondence deteriorated postsaccadic letter recognition. These findings identify transsaccadic object correspondence as a key determinant of object recognition across the saccade. This is in line with the recent hypothesis that breaking object correspondence results in separate representations of presaccadic and postsaccadic objects which then compete for limited attentional processing resources (Schneider, 2013). Postsaccadic object recognition is then deteriorated because less resources are available for processing postsaccadic objects.

Associating peripheral and foveal visual input across saccades: a default mode of the human visual system?

Spatial processing resolution of a particular object in the visual field can differ considerably due to eye movements. The same object will be represented with high acuity in the fovea but only coarsely in periphery. Herwig and Schneider (in press) proposed that the visual system counteracts such resolution differences by predicting, based on previous experience, how foveal objects will look in the periphery and vice versa. They demonstrated that previously learned transsaccadic associations between peripheral and foveal object information facilitate performance in visual search, irrespective of the correctness of these associations. False associations were learned by replacing the presaccadic object with a slightly different object during the saccade. Importantly, participants usually did not notice this object change. This raises the question of whether perception of object continuity is a critical factor in building transsaccadic associations. We disturbed object continuity during learning with a postsaccadic blank or a task-irrelevant shape change. Interestingly, visual search performance revealed that neither disruption of temporal object continuity (blank) nor disruption of spatial object continuity (shape change) impaired transsaccadic learning. Thus, transsaccadic learning seems to be a very robust default mechanism of the visual system that is probably related to the more general concept of action-effect learning.