Visuo-motor updating in individuals with heightened autistic traits.

Autism spectrum disorder (ASD) presents a range of challenges, including heightened sensory sensitivities. Here, we examine the idea that sensory overload in ASD may be linked to issues with efference copy mechanisms, which predict the sensory outcomes of self-generated actions, such as eye movements. Efference copies play a vital role in maintaining visual and motor stability. Disrupted efference copies hinder precise predictions, leading to increased reliance on actual feedback and potential distortions in perceptions across eye movements. In our first experiment, we tested how well healthy individuals with varying levels of autistic traits updated their mental map after making eye movements. We found that those with more autistic traits had difficulty using information from their eye movements to update the spatial representation of their mental map, resulting in significant errors in object localization. In the second experiment, we looked at how participants perceived an object displacement after making eye movements. Using a trans-saccadic spatial updating task, we found that those with higher autism scores exhibited a greater bias, indicating under-compensation of eye movements and a failure to maintain spatial stability during saccades. Overall, our study underscores efference copy's vital role in visuo-motor stability, aligning with Bayesian theories of autism, potentially informing interventions for improved action-perception integration in autism.

Prediction of sensorimotor contingencies generates saccadic omission.

With every movement of our eyes, the visual receptors in the retina are swiped across the visual scene. Saccades are the fastest and most frequent movements we perform, yet we remain unaware of the self-produced visual motion. Previous research has tried to identify a dedicated suppression mechanism that either actively or passively cancels vision at the time of saccades.1 Here, we investigated a novel theory, which states that saccadic omission results from habituation to the predicted sensory consequences of our own actions. We experimentally induced novel, i.e., artificial visual consequences of saccade performance by presenting gratings that were drifting faster than the flicker fusion frequency and that became visible only when participants performed saccades. We asked participants to perform more than 100 saccades in each session across these gratings to make the novel contingencies predictable for the sensorimotor system. We found that contrast sensitivity for intra-saccadic motion declined drastically after repeated exposure of such motion. The reduction in sensitivity was even specific to the saccade vector performed in habituation trials. Moreover, when subjects performed the same task in fixation, no reduction in sensitivity was observed. In a motion speed comparison task, we found that the reduction in contrast sensitivity is the consequence of silencing-predicted intra-saccadic visual motion. Our data demonstrate that the sensorimotor system selectively habituates to recurring intra-saccadic visual motion, suggesting an efficient prediction mechanism of visual stability.

Compression of time in double-step saccades.

Temporal intervals appear compressed at the time of saccades. Here, I asked if saccadic compression of time is related to motor planning or to saccade execution. To dissociate saccade motor planning from its execution, I used the double-step paradigm, in which subjects have to perform two horizontal saccades successively. At various times around the saccade sequence, I presented two large horizontal bars, which marked an interval lasting 100 ms. After 700 ms, a second temporal interval was presented, varying in duration across trials. Subjects were required to judge which interval appeared shorter. I found that during the first saccades in the double-step paradigm, temporal intervals were compressed. Maximum temporal compression coincided with saccade onset. Around the time of the second saccade, I found temporal compression as well, however, the time of maximum compression preceded saccade onset by about 70 ms. I compared the magnitude and time of temporal compression between double-step saccades and amplitude-matched single saccades, which I measured separately. Although I found no difference in time compression magnitude, the time when maximum compression occurred differed significantly. I conclude that the temporal shift of time compression in double-step saccades demonstrates the influence of saccade motor planning on time perception.NEW & NOTEWORTHY Visually defined temporal intervals appear compressed at the time of saccades. Here, I tested time perception during double-step saccades dissociating saccade planning from execution. Although around the time of the first saccade, peak compression was found at saccade onset, compression around the time of the second saccade peaked 70 ms before saccade onset. The results suggest that saccade motor planning influences time perception.

Intentional binding - Is it just causal binding? A replication study of Suzuki et al. (2019).

Intentional actions produce a temporal compression between the action and its outcome, known as intentional binding. However, Suzuki et al. (2019) recently showed that temporal compression can be observed without intentional actions. However, their results show a clear regression to the mean, which might have confounded the estimates of temporal intervals. To control these effects, we presented temporal intervals block-wise. Indeed, we found systematically greater compression for active than passive trials, in contrast to Suzuki et al. (2019). In our second experiment, our goal was to conceptually replicate the previous study. However, we were unable to reproduce their results and instead found more pronounced temporal compression in active trials compared to passive ones. In a subsequent attempt at a direct replication, we did not observe the same findings as the original study. Our findings reinforce the theory that intentions rather than causality cause temporal binding. During the preparation of this work, the authors used ChatGPT in order to improve the readability of the paper. After using this tool/service, the authors reviewed and edited the content as needed and take full responsibility for the content of the publication.

Active production and passive observation of hand movements shift visual hand location.

Which factors influence the perception of our hand location is a matter of current debate. Here, we test if sensorimotor processing contributes to the perception of hand location. We developed a novel visuomotor adaptation procedure to measure whether actively performing hand movements or passively observing them, influences visual perception of hand location. Participants had to point with a handheld controller to a briefly presented visual target. When they reached the remembered position of the target, the controller presented a tactile buzz. In adaptation trials, the tactile buzz was presented when the hand had not yet reached the target. Over the course of trials, participants adapted to the manipulation and pointed to a location between the visual target and the tactile buzz. We measured the perceived location of the hand by flashing a virtual pair of left and right hands before and after adaptation. Participants had to judge which hand they perceived closer to their body on the fronto-parallel plane. After adaptation, they judged the right hand, that corresponded to the hand used during adaptation, to be located further away from the body. We conclude that sensorimotor prediction of the consequences of hand movements shape sensory processing of hand location.

Repulsive Aftereffects of Visual Space.

Prolonged exposure to a sensory stimulus induces perceptual adaptation aftereffects. Traditionally, aftereffects are known to change the appearance of stimulus features, like contrast, color, or shape. However, shifts in the spatial position of objects have also been observed to follow adaptation. Here, I demonstrate that visual adaptation produced by different adapter stimuli generates a bi-directional spatial repulsion. Observers had to judge the distance between a probe dot pair presented in the adapted region and compare them to a reference dot pair presented in a region not affected by adaptation. If the probe dot pair was present inside the adapted area, observers underestimated the distance. If, however, the dot pair straddled the adapted area, the distance was perceived as larger with a stronger distance expansion than compression. Bi-directional spatial repulsion was found with a similar magnitude for size and density adapters. Localization estimates with mouse pointing revealed that adaptation also affected absolute position judgments. Bi-directional spatial repulsion is most likely produced by the lines of adapter stimuli since single bars used as adapters were sufficient to induce spatial repulsion. Spatial repulsion was stronger for stimuli presented in the periphery. This finding explains why distance expansion is stronger than distance compression.

Temporal adaptation of sensory attenuation for self-touch.

The sensory consequences of our actions appear attenuated to us. This effect has been reported for external sensations that are evoked by auditory or visual events and for body-related sensations which are produced by self-touch. In the present study, we investigated the effects of prolonged exposure to a delay between an action and the generated sensation on sensory attenuation for self-touch. Previously, it has been shown that after being presented to a systematic exposure delay, artificially delayed touch can feel more intense and non-delayed touches can appear less intense. Here, we investigated the temporal spread of the temporal recalibration effect. Specifically, we wondered whether this temporal recalibration effect would affect only the delay that was used during exposure trials or if it would also modulate longer test delays. In the first two experiments, we tested three test delays (0, 100 and 400 ms) either in randomized or in blocked order. We found sensory attenuation in all three test intervals but no effect of the exposure delay. In Experiment 3, we replicated the experiment by Kilteni et al. (ELife 8:e42888, 2019. https://doi.org/10.7554/eLife.42888 ) and found evidence for temporal recalibration by exposure delay. Our data show that the temporal selectivity of sensory attenuation of self-touch depends on presenting a singular test delay only. Presenting multiple test delays leads to a temporally broad spread of sensory attenuation.

Altered oculomotor flexibility is linked to high autistic traits.

Autism is a multifaced disorder comprising sensory abnormalities and a general inflexibility in the motor domain. The sensorimotor system is continuously challenged to answer whether motion-contingent errors result from own movements or whether they are due to external motion. Disturbances in this decision could lead to the perception of motion when there is none and to an inflexibility with regard to motor learning. Here, we test the hypothesis that altered processing of gaze-contingent sensations are responsible for both the motor inflexibility and the sensory overload in autism. We measured motor flexibility by testing how strong participants adapted in a classical saccade adaptation task. We asked healthy participants, scored for autistic traits, to make saccades to a target that was displaced either in inward or in outward direction during saccade execution. The amount of saccade adaptation, that requires to shift the internal target representation, varied with the autistic symptom severity. The higher participants scored for autistic traits, the less they adapted. In order to test for visual stability, we asked participants to localize the position of the saccade target after they completed their saccade. We found the often-reported saccade-induced mis-localization in low Autistic Quotient (AQ) participants. However, we also found mislocalization in high AQ participants despite the absence of saccade adaptation. Our data suggest that high autistic traits are associated with an oculomotor inflexibility that might produce altered processing of trans-saccadic vision which might increase the perceptual overstimulation that is experienced in autism spectrum disorders (ASD).

Motor variability modulates calibration of precisely timed movements.

Interacting with the environment often requires precisely timed movements, challenging the brain to minimize the detrimental impact of neural noise. Recent research demonstrates that the brain exploits the variability of its temporal estimates and recalibrates perception accordingly. Time-critical movements, however, contain a sensory measurement and a motor stage. The brain must have knowledge of both in order to avoid maladapted behavior. By manipulating sensory and motor variability, we show that the sensorimotor system recalibrates sensory and motor uncertainty separately. Serial dependencies between observed interval durations in the previous and motor reproductions in the current trial were weighted by the variability of movements. These serial dependencies generalized across different effectors, but not to a visual discrimination task. Our results suggest that the brain has accurate knowledge about contributions of motor uncertainty to errors in temporal movements. This knowledge about motor uncertainty seems to be processed separately from knowledge about sensory uncertainty.

Serial dependencies in visual stability during self-motion.

Every time we move our head, the brain must decide whether the displacement of the visual scene is the result of external or self-produced motion. Gaze shifts generate the biggest and most frequent disturbance of vision. Visual stability during gaze shifts is necessary for both, dissociating self-produced from external motion and retaining bodily balance. Here, we asked participants to perform an eye-head gaze shift to a target that was briefly presented in a head-mounted display. We manipulated the velocity of the scene displacement across trials such that the background moved either too fast or too slow in relation to the head movement speed. Participants were required to report whether they perceived the gaze-contingent visual motion as faster or slower than what they would expect from their head movement velocity. We found that the point of visual stability was attracted to the velocity presented in the previous trial. Our data reveal that serial dependencies in visual stability calibrate the mapping between motor-related signals coding head movement velocity and visual motion velocity. This process is likely to aid in visual stability as the accuracy of this mapping is crucial to maintain visual stability during self-motion.NEW & NOTEWORTHY We report that visual stability during self-motion is maintained by serial dependencies between the current and the previous gaze-contingent visual velocity that was experienced during a head movement. The gaze-contingent scene displacement velocity that appears normal to us thus depends on what we have registered in the recent history of gaze shifts. Serial dependencies provide an efficient means to maintain visual stability during self-motion.

The full-body illusion changes visual depth perception.

Knowing where objects are relative to us implies knowing where we are relative to the external world. Here, we investigated whether space perception can be influenced by an experimentally induced change in perceived self-location. To dissociate real and apparent body positions, we used the full-body illusion. In this illusion, participants see a distant avatar being stroked in virtual reality while their own physical back is simultaneously stroked. After experiencing the discrepancy between the seen and the felt location of the stroking, participants report a forward drift in self-location toward the avatar. We wondered whether this illusion-induced forward drift in self-location would affect where we perceive objects in depth. We applied a psychometric measurement in which participants compared the position of a probe against a reference sphere in a two-alternative forced choice task. We found a significant improvement in task performance for the right visual field, indicated by lower just-noticeable differences, i.e., participants were better at judging the differences of the two spheres in depth. Our results suggest that the full-body illusion is able to facilitate depth perception at least unilaterally, implying that depth perception is influenced by perceived self-location.

Motor recalibration of visual and saccadic maps.

How does the brain maintain an accurate visual representation of external space? Movement errors following saccade execution provide sufficient information to recalibrate motor and visual space. Here, we asked whether spatial information for vision and saccades is processed in shared or in separate resources. We used saccade adaptation to modify both, saccade amplitudes and visual mislocalization. After saccade adaptation was induced, we compared participants' saccadic and perceptual localization before and after we inserted 'no error' trials. In these trials, we clamped the post-saccadic error online to the predicted endpoints of saccades. In separate experiments, we either annulled the retinal or the prediction error. We also varied the number of 'no error' trials across conditions. In all conditions, we found that saccade adaptation remained undisturbed by the insertion of 'no error' trials. However, mislocalization decreased as a function of the number of trials in which zero retinal error was displayed. When the prediction error was clamped to zero, no mislocalization was observed at all. The results demonstrate the post-saccadic error is used separately to recalibrate visual and saccadic space.

Serial dependencies between locomotion and visual space.

How do we know the spatial distance of objects around us? Only by physical interaction within an environment can we measure true physical distances. Here, we investigated the possibility that travel distances, measured during walking, could be used to calibrate visual spatial perception. The sensorimotor contingencies that arise during walking were carefully altered using virtual reality and motion tracking. Participants were asked to walk to a briefly highlighted location. During walking, we systematically changed the optic flow, i.e., the ratio between the visual and physical motion speed. Although participants remained unaware of this manipulation, they walked a shorter or longer distance as a function of the optic flow speed. Following walking, participants were required to estimate the perceived distance of visual objects. We found that visual estimates were serially dependent on the experience of the manipulated flow in the previous trial. Additional experiments confirmed that to affect visual perception, both visual and physical motion are required. We conclude that the brain constantly uses movements to measure space for both, actions, and perception.

Increased scene complexity during free visual exploration reveals residual unilateral neglect in recovered stroke patients.

Unilateral neglect is a common cognitive syndrome after stroke, which is defined as a spatially specific unawareness of the contralesional space. The syndrome is caused by disruptions of attentional networks in the brain, which impair the patients' ability to direct attention towards the contralesional space. During recovery, patients often learn to compensate by voluntarily directing their attention to the neglected side at the expense of cognitive resources. In this study, we examined the impact of the complexity of visual input on free visual exploration behavior of unilateral neglect and apparently recovered patients. We asked whether increasing scene complexity would allow the detection of residual unilateral neglect in recovered patients by increasing the amount of cognitive resources needed for visual processing and limiting capacities for compensation. Using virtual reality, we analyzed the spatial distribution of gaze of unilateral neglect patients, patients who had, according to conventional diagnostics, recovered from the syndrome, stroke patients with no history of unilateral neglect, and age-matched healthy controls. We manipulated the complexity of an immersive virtual scene presented on head mounted displays. We identified the orientation bias towards the ipsilesional side as a sensitive and specific marker of unilateral neglect, which was present in unilateral neglect and recovered patients but absent in stroke patients with no history of unilateral neglect and controls. Increasing scene complexity exacerbated the orientation shift in unilateral neglect patients and revealed that three out of nine (33%) recovered patients had a high probability of suffering from residual unilateral neglect as estimated by a generalized linear model using the median horizontal gaze position as a predictor.

Saccade suppression of displacements, but not of contrast, depends on context.

Saccades let the visual scene sweep with high speed across the retina, thus producing a massive motion stimulus. Yet, in natural vision, we never perceive motion that is produced by saccades. The absence of perisaccadic motion perception might be caused by a transient reduction of visual sensitivity at the time of saccade initiation, so-called saccadic suppression. Saccade suppression occurs for contrast, displacement, and motion stimuli. Saccade suppression of displacements has been shown to be context sensitive. After performing saccades in sessions without perisaccadic stimulation, saccade suppression magnitude is drastically decreased (Zimmermann, 2020). Here, we aimed to test whether saccade suppression of contrast is similarly modulated by context. To this end, we projected stimuli on a homogeneously white wall such that we could establish a ganzfeld-like environment that, depending on the experimental session, did or did not contain any visible contrast stimuli. We first successfully replicated the context sensitivity of saccade suppression of displacements. Then, we tested context sensitivity of contrast suppression by asking subjects to perform several saccades either across the uniform white wall or across a background consisting of a sinusoidal grating. In contrast to perisaccadic context sensitivity for displacement suppression, we did not find context sensitivity for suppression of contrast.

Temporal context modulates sensory attenuation magnitude.

In studies with self-produced sensory events, sensitivity for these events has been found to be reduced. This phenomenon is called sensory attenuation, and it has been assumed that the crucial factor is the self-production of the event. However, this factor may be confounded with the temporal predictability of the event, as well as with attentional focus on the event. In this study, we wondered about the influence of temporal stimulus predictably on sensory attenuation. We asked observers to discriminate the orientation of Gabor patches that were presented randomly at various times around a button press. Despite the unpredictability of stimulus occurrence, attenuation for these stimuli was tuned to the time of the button press. However, temporal expectations determined attenuation magnitude. Sensory attenuation was stronger when stimuli were expected to occur more often before the button press. When stimuli were expected to occur more often after the button press, no sensory attenuation was found. Our results show first that sensory attenuation occurs mandatorily even if stimulus occurrence cannot be predicted temporally. Second, temporal attention, guided by temporal stimulus probabilities, modulates sensory attenuation magnitude.

Tactile motor attention induces sensory attenuation for sounds.

Sensory events appear reduced in intensity when we actively produce them. Here, we investigated sensory attenuation in a virtual reality setup that allowed us to manipulate the time of tactile feedback when pressing a virtual button. We asked whether tactile motor attention might shift to the tactile location that makes contact with the button. In experiment one, we found that a tactile impulse was perceived as more intense when button pressing. In a second experiment, participants pushed a button and estimated the intensity of sounds. We found sensory attenuation for sounds only when tactile feedback was provided at the time the movement goal was reached. These data indicate that attentional prioritization for the tactile modality during a goal-directed hand movement might lead to a transient reduction in sensitivity in other modalities, resulting in sensory attenuation for sounds.

Mislocalization in saccadic suppression of displacement.

Visual stability across saccades requires us to discriminate self-generated motion by eye movements from motion occurring in the external world. In the laboratory visual stability is often studied by asking observers to discriminate the direction of trans-saccadic target displacements. It is a well established finding that in this paradigm performance is usually very poor. If observers are insensitive to the intra-saccadic motion and see the pre- and the post-saccadic target in one location, one of both targets should be reported as shifted when observers would localize them. Here, I asked participants to perform a saccade to a target. During saccade execution the target was displaced either in backward or forward direction. After finishing the saccade, subjects had to report the position of either the pre-or the post-saccadic target. I found that subjects mislocalized the pre-saccadic target to the physical position of the post-saccadic target. This mislocalization occurred only after backward but not after forward displacements.

Temporal perturbations cause movement-context independent but modality specific sensorimotor adaptation.

Complex, goal-directed and time-critical movements require the processing of temporal features in sensory information as well as the fine-tuned temporal interplay of several effectors. Temporal estimates used to produce such behavior may thus be obtained through perceptual or motor processes. To disentangle the two options, we tested whether adaptation to a temporal perturbation in an interval reproduction task transfers to interval reproduction tasks with varying sensory information (visual appearance of targets, modality, and virtual reality [VR] environment or real-world) or varying movement types (continuous arm movements or brief clicking movements). Halfway through the experiments we introduced a temporal perturbation, such that continuous pointing movements were artificially slowed down in VR, causing participants to adapt their behavior to sustain performance. In four experiments, we found that sensorimotor adaptation to temporal perturbations is independent of environment context and movement type, but modality specific. Our findings suggest that motor errors induced by temporal sensorimotor adaptation affect the modality specific perceptual processing of temporal estimates.

Sensorimotor serial dependencies in head movements.

On average, we redirect our gaze with a frequency at about 3 Hz. In real life, gaze shifts consist of eye and head movements. Much research has focused on how the accuracy of eye movements is monitored and calibrated. By contrast, little is known about how head movements remain accurate. I wondered whether serial dependencies between artificially induced errors in head movement targeting and the immediately following head movement might recalibrate movement accuracy. I also asked whether head movement targeting errors would influence visual localization. To this end, participants wore a head-mounted display and performed head movements to targets, which were displaced as soon as the start of the head movement was detected. I found that target displacements influenced head movement amplitudes in the same trial, indicating that participants could adjust their movement online to reach the new target location. However, I also found serial dependencies between the target displacement in trial n-1 and head movements amplitudes in the following trial n. I did not find serial dependencies between target displacements and visuomotor localization. The results reveal that serial dependencies recalibrate head-movement accuracy. NEW & NOTEWORTHY Head movements are recalibrated by serial dependencies by errors between consecutive trials. Head movements are subject to a regression of the average target location.