Four-Stroke Apparent Motion Can Effectively Induce Visual Self-Motion Perception: an Examination Using Expanding, Rotating, and Translating Motion.

The current investigation examined whether visual motion without continuous visual displacement could effectively induce self-motion perception (vection). Four-stroke apparent motions (4SAM) were employed in the experiments as visual inducers. The 4SAM pattern contained luminance-defined motion energy equivalent to the real motion pattern, and the participants perceived unidirectional motion according to the motion energy but without displacements (the visual elements flickered on the spot). The experiments revealed that the 4SAM stimulus could effectively induce vection in the horizontal, expanding, or rotational directions, although its strength was significantly weaker than that induced by the real-motion stimulus. This result suggests that visual displacement is not essential, and the luminance-defined motion energy and/or the resulting perceived motion of the visual inducer would be sufficient for inducing visual self-motion perception. Conversely, when the 4SAM and real-motion patterns were presented simultaneously, self-motion perception was mainly determined in accordance with real motion, suggesting that the real-motion stimulus is a predominant determinant of vection. These research outcomes may be worthy of considering the perceptual and neurological mechanisms underlying self-motion perception.

Visual Tracking in Amblyopia: A Continuous Psychophysical Approach.

Purpose: This study aimed to explore the underlying mechanisms of the observed visuomotor deficit in amblyopia. Methods: Twenty-four amblyopic (25.8 ± 3.8 years; 15 males) and 22 normal participants (25.8 ± 2.1 years; 8 males) took part in the study. The participants were instructed to continuously track a randomly moving Gaussian target on a computer screen using a mouse. In experiment 1, the participants performed the tracking task at six different target sizes. In experiments 2 and 3, they were asked to track a target with the contrast adjusted to individual's threshold. The tracking performance was represented by the kernel function calculated as the cross-correlation between the target and mouse displacements. The peak, latency, and width of the kernel were extracted and compared between the two groups. Results: In experiment 1, target size had a significant effect on the kernel peak (F(1.649, 46.170) = 200.958, P = 4.420 × 10-22). At the smallest target size, the peak in the amblyopic group was significantly lower than that in the normal group (0.089 ± 0.023 vs. 0.107 ± 0.020, t(28) = -2.390, P = 0.024) and correlated with the contrast sensitivity function (r = 0.739, P = 0.002) in the amblyopic eyes. In experiments 2 and 3, with equally visible stimuli, there were still differences in the kernel between the two groups (all Ps < 0.05). Conclusions: When stimulus visibility was compensated, amblyopic participants still showed significantly poorer tracking performance.

Temporal dynamics of ocular torsion and vertical vergence during visual, vestibular, and visuovestibular rotations.

Ocular torsion and vertical divergence reflect the brain's sensorimotor integration of motion through the vestibulo-ocular reflex (VOR) and the optokinetic reflex (OKR) to roll rotations. Torsion and vergence however express different response patterns depending on several motion variables, but research on their temporal dynamics remains limited. This study investigated the onset times of ocular torsion (OT) and vertical vergence (VV) during visual, vestibular, and visuovestibular motion, as well as their relative decay rates following prolonged optokinetic stimulations. Temporal characteristics were retrieved from three separate investigations where the level of visual clutter and acceleration were controlled. Video eye-tracking was used to retrieve the eye-movement parameters from a total of 41 healthy participants across all trials. Ocular torsion consistently initiated earlier than vertical vergence, particularly evident under intensified visual information density, and higher clutter levels were associated with more balanced decay rates. Additionally, stimulation modality and accelerations affected the onsets of both eye movements, with visuovestibular motion triggering earlier responses compared to vestibular motion, and increased accelerations leading to earlier onsets for both movements. The present study showed that joint visuovestibular responses produced more rapid onsets, indicating a synergetic sensorimotor process. It also showed that visual content acted as a fusional force during the decay period, and imposed greater influence over the torsional onset compared to vergence. Acceleration, by contrast, did not affect the temporal relationship between the two eye movements. Altogether, these findings provide insights into the sensorimotor integration of the vestibulo-ocular and optokinetic reflex arcs.

Continuous psychophysics shows millisecond-scale visual processing delays are faithfully preserved in movement dynamics.

Image differences between the eyes can cause interocular discrepancies in the speed of visual processing. Millisecond-scale differences in visual processing speed can cause dramatic misperceptions of the depth and three-dimensional direction of moving objects. Here, we develop a monocular and binocular continuous target-tracking psychophysics paradigm that can quantify such tiny differences in visual processing speed. Human observers continuously tracked a target undergoing Brownian motion with a range of luminance levels in each eye. Suitable analyses recover the time course of the visuomotor response in each condition, the dependence of visual processing speed on luminance level, and the temporal evolution of processing differences between the eyes. Importantly, using a direct within-observer comparison, we show that continuous target-tracking and traditional forced-choice psychophysical methods provide estimates of interocular delays that agree on average to within a fraction of a millisecond. Thus, visual processing delays are preserved in the movement dynamics of the hand. Finally, we show analytically, and partially confirm experimentally, that differences between the temporal impulse response functions in the two eyes predict how lateral target motion causes misperceptions of motion in depth and associated tracking responses. Because continuous target tracking can accurately recover millisecond-scale differences in visual processing speed and has multiple advantages over traditional psychophysics, it should facilitate the study of temporal processing in the future.

Cerebellar Purkinje cells in male macaques combine sensory and motor information to predict the sensory consequences of active self-motion.

Accurate perception and behavior rely on distinguishing sensory signals arising from unexpected events from those originating from our own voluntary actions. In the vestibular system, sensory input that is the consequence of active self-motion is canceled early at the first central stage of processing to ensure postural and perceptual stability. However, the source of the required cancellation signal was unknown. Here, we show that the cerebellum combines sensory and motor-related information to predict the sensory consequences of active self-motion. Recordings during attempted but unrealized head movements in two male rhesus monkeys, revealed that the motor-related signals encoded by anterior vermis Purkinje cells explain their altered sensitivity to active versus passive self-motion. Further, a model combining responses from ~40 Purkinje cells accounted for the cancellation observed in early vestibular pathways. These findings establish how cerebellar Purkinje cells predict sensory outcomes of self-movements, resolving a long-standing issue of sensory signal suppression during self-motion.

Faster bi-stable visual switching in psychosis.

Bi-stable stimuli evoke two distinct perceptual interpretations that alternate and compete for dominance. Bi-stable perception is thought to be driven at least in part by mutual suppression between distinct neural populations that represent each percept. Abnormal visual perception has been observed among people with psychotic psychopathology (PwPP), and there is evidence to suggest that these visual deficits may depend on impaired neural suppression in the visual cortex. However, it is not yet clear whether bi-stable visual perception is abnormal among PwPP. Here, we examined bi-stable perception in a visual structure-from-motion task using a rotating cylinder illusion in a group of 65 PwPP, 44 first-degree biological relatives, and 43 healthy controls. Data from a 'real switch' task, in which physical depth cues signaled real switches in rotation direction were used to exclude individuals who did not show adequate task performance. In addition, we measured concentrations of neurochemicals, including glutamate, glutamine, and γ-amino butyric acid (GABA), involved in excitatory and inhibitory neurotransmission. These neurochemicals were measured non-invasively in the visual cortex using 7 tesla MR spectroscopy. We found that PwPP and their relatives showed faster bi-stable switch rates than healthy controls. Faster switch rates also correlated with significantly higher psychiatric symptom levels, specifically disorganization, across all participants. However, we did not observe any significant relationships across individuals between neurochemical concentrations and SFM switch rates. Our results are consistent with a reduction in suppressive neural processes during structure-from-motion perception in PwPP, and suggest that genetic liability for psychosis is associated with disrupted bi-stable perception.

Modality-specific effects of threat on self-motion perception.

BACKGROUND: Threat and individual differences in threat-processing bias perception of stimuli in the environment. Yet, their effect on perception of one's own (body-based) self-motion in space is unknown. Here, we tested the effects of threat on self-motion perception using a multisensory motion simulator with concurrent threatening or neutral auditory stimuli. RESULTS: Strikingly, threat had opposite effects on vestibular and visual self-motion perception, leading to overestimation of vestibular, but underestimation of visual self-motions. Trait anxiety tended to be associated with an enhanced effect of threat on estimates of self-motion for both modalities. CONCLUSIONS: Enhanced vestibular perception under threat might stem from shared neural substrates with emotional processing, whereas diminished visual self-motion perception may indicate that a threatening stimulus diverts attention away from optic flow integration. Thus, threat induces modality-specific biases in everyday experiences of self-motion.

Visual training after central retinal loss limits structural white matter degradation: an MRI study.

BACKGROUND: Macular degeneration of the eye is a common cause of blindness and affects 8% of the worldwide human population. In adult cats with bilateral lesions of the central retina, we explored the possibility that motion perception training can limit the associated degradation of the visual system. We evaluated how visual training affects behavioral performance and white matter structure. Recently, we proposed (Kozak et al. in Transl Vis Sci Technol 10:9, 2021) a new motion-acuity test for low vision patients, enabling full visual field functional assessment through simultaneous perception of shape and motion. Here, we integrated this test as the last step of a 10-week motion-perception training. RESULTS: Cats were divided into three groups: retinal-lesioned only and two trained groups, retinal-lesioned trained and control trained. The behavioral data revealed that trained cats with retinal lesions were superior in motion tasks, even when the difficulty relied only on acuity. 7 T-MRI scanning was done before and after lesioning at 5 different timepoints, followed by Fixel-Based and Fractional Anisotropy Analysis. In cats with retinal lesions, training resulted in a more localized and reduced percentage decrease in Fixel-Based Analysis metrics in the dLGN, caudate nucleus and hippocampus compared to untrained cats. In motion-sensitive area V5/PMLS, the significant decreases in fiber density were equally strong in retinal-lesioned untrained and trained cats, up to 40% in both groups. The only cortical area with Fractional Anisotropy values not affected by central retinal loss was area V5/PMLS. In other visual ROIs, the Fractional Anisotropy values increased over time in the untrained retinal lesioned group, whereas they decreased in the retinal lesioned trained group and remained at a similar level as in trained controls. CONCLUSIONS: Overall, our MRI results showed a stabilizing effect of motion training applied soon after central retinal loss induction on white matter structure. We propose that introducing early motion-acuity training for low vision patients, aimed at the intact and active retinal peripheries, may facilitate brain plasticity processes toward better vision.

Effect of spatial context on perceived walking direction.

Contextual modulation occurs for many aspects of high-level vision but is relatively unexplored for the perception of walking direction. In a recent study, we observed an effect of the temporal context on perceived walking direction. Here, we examined the spatial contextual modulation by measuring the perceived direction of a target point-light walker in the presence of two flanker walkers, one on each side. Experiment 1 followed a within-subjects design. Participants (n = 30) completed a spatial context task by judging the walking direction of the target in 13 different conditions: a walker alone in the center or with two flanking walkers either intact or scrambled at a flanker deviation of ±15°, ±30°, or ±45°. For comparison, participants completed an adaptation task where they reported the walking direction of a target after adaptation to ±30° walking direction. We found the expected repulsive effects in the adaptation task but attractive effects in the spatial context task. In Experiment 2 (n = 40), we measured the tuning of spatial contextual modulation across a wide range of flanker deviation magnitudes ranging from 15° to 165° in 15° intervals. Our results showed significant attractive effects across a wide range of flanker walking directions with the peak effect at around 30°. The assimilative versus repulsive effects of spatial contextual modulation and temporal adaptation suggest dissociable neural mechanisms, but they may operate on the same population of sensory channels coding for walking direction, as evidenced by similarity in the peak tuning across the walking direction of the inducers.

Multiple object tracking in the presence of a goal: Attentional anticipation and suppression.

In previous studies, we found that tracking multiple objects involves anticipatory attention, especially in the linear direction, even when a target bounced against a wall. We also showed that active involvement, in which the wall was replaced by a controllable paddle, resulted in increased allocation of attention to the bounce direction. In the current experiments, we wanted to further investigate the potential influence of the valence of the heading of an object. In Experiments 1 and 2, participants were instructed to catch targets with a movable goal. In Experiment 3, participants were instructed to manipulate the permeability of a static wall in order to let targets either approach goals (i.e., green goals) or avoid goals (i.e., red goals). The results of Experiment 1 showed that probe detection ahead of a target that moved in the direction of the goal was higher as compared to probe detection in the direction of a no-goal area. Experiment 2 provided further evidence that the attentional highlighting found in the first experiment depends on the movement direction toward the goal. In Experiment 3, we found that not so much the positive (or neutral) valence (here, the green and no-goal areas) led to increased allocation of attention but rather a negative valence (here the red goals) led to a decreased allocation of attention.

Distinct neural markers of evidence accumulation index metacognitive processing before and after simple visual decisions.

Perceptual decision-making is affected by uncertainty arising from the reliability of incoming sensory evidence (perceptual uncertainty) and the categorization of that evidence relative to a choice boundary (categorical uncertainty). Here, we investigated how these factors impact the temporal dynamics of evidence processing during decision-making and subsequent metacognitive judgments. Participants performed a motion discrimination task while electroencephalography was recorded. We manipulated perceptual uncertainty by varying motion coherence, and categorical uncertainty by varying the angular offset of motion signals relative to a criterion. After each trial, participants rated their desire to change their mind. High uncertainty impaired perceptual and metacognitive judgments and reduced the amplitude of the centro-parietal positivity, a neural marker of evidence accumulation. Coherence and offset affected the centro-parietal positivity at different time points, suggesting that perceptual and categorical uncertainty affect decision-making in sequential stages. Moreover, the centro-parietal positivity predicted participants' metacognitive judgments: larger predecisional centro-parietal positivity amplitude was associated with less desire to change one's mind, whereas larger postdecisional centro-parietal positivity amplitude was associated with greater desire to change one's mind, but only following errors. These findings reveal a dissociation between predecisional and postdecisional evidence processing, suggesting that the CPP tracks potentially distinct cognitive processes before and after a decision.

Tactile shape discrimination for moving stimuli.

In this study, we explored spatial-temporal dependencies and their impact on the tactile perception of moving objects. Building on previous research linking visual perception and human movement, we examined if an imputed motion mechanism operates within the tactile modality. We focused on how biological coherence between space and time, characteristic of human movement, influences tactile perception. An experiment was designed wherein participants were stimulated on their right palm with tactile patterns, either ambiguous (incongruent conditions) or non-ambiguous (congruent conditions) relative to a biological motion law (two-thirds power law) and asked to report perceived shape and associated confidence. Our findings reveal that introducing ambiguous tactile patterns (1) significantly diminishes tactile discrimination performance, implying motor features of shape recognition in vision are also observed in the tactile modality, and (2) undermines participants' response confidence, uncovering the accessibility degree of information determining the tactile percept's conscious representation. Analysis based on the Hierarchical Drift Diffusion Model unveiled the sensitivity of the evidence accumulation process to the stimulus's informational ambiguity and provides insight into tactile perception as predictive dynamics for reducing uncertainty. These discoveries deepen our understanding of tactile perception mechanisms and underscore the criticality of predictions in sensory information processing.

Psychometrics of inertial heading perception.

BACKGROUND: Inertial self-motion perception is thought to depend primarily on otolith cues. Recent evidence demonstrated that vestibular perceptual thresholds (including inertial heading) are adaptable, suggesting novel clinical approaches for treating perceptual impairments resulting from vestibular disease. OBJECTIVE: Little is known about the psychometric properties of perceptual estimates of inertial heading like test-retest reliability. Here we investigate the psychometric properties of a passive inertial heading perceptual test. METHODS: Forty-seven healthy subjects participated across two visits, performing in an inertial heading discrimination task. The point of subjective equality (PSE) and thresholds for heading discrimination were identified for the same day and across day tests. Paired t-tests determined if the PSE or thresholds significantly changed and a mixed interclass correlation coefficient (ICC) model examined test-retest reliability. Minimum detectable change (MDC) was calculated for PSE and threshold for heading discrimination. RESULTS: Within a testing session, the heading discrimination PSE score test-retest reliability was good (ICC = 0. 80) and did not change (t(1,36) = -1.23, p = 0.23). Heading discrimination thresholds were moderately reliable (ICC = 0.67) and also stable (t(1,36) = 0.10, p = 0.92). Across testing sessions, heading direction PSE scores were moderately correlated (ICC = 0.59) and stable (t(1,46) = -0.44, p = 0.66). Heading direction thresholds had poor reliability (ICC = 0.03) and were significantly smaller at the second visit (t(1,46) = 2.8, p = 0.008). MDC for heading direction PSE ranged from 6-9 degrees across tests. CONCLUSION: The current results indicate moderate reliability for heading perception PSE and provide clinical context for interpreting change in inertial vestibular self-motion perception over time or after an intervention.

Transformation of Motion Pattern Selectivity from Retina to Superior Colliculus.

The superior colliculus (SC) is a prominent and conserved visual center in all vertebrates. In mice, the most superficial lamina of the SC is enriched with neurons that are selective for the moving direction of visual stimuli. Here, we study how these direction selective neurons respond to complex motion patterns known as plaids, using two-photon calcium imaging in awake male and female mice. The plaid pattern consists of two superimposed sinusoidal gratings moving in different directions, giving an apparent pattern direction that lies between the directions of the two component gratings. Most direction selective neurons in the mouse SC respond robustly to the plaids and show a high selectivity for the moving direction of the plaid pattern but not of its components. Pattern motion selectivity is seen in both excitatory and inhibitory SC neurons and is especially prevalent in response to plaids with large cross angles between the two component gratings. However, retinal inputs to the SC are ambiguous in their selectivity to pattern versus component motion. Modeling suggests that pattern motion selectivity in the SC can arise from a nonlinear transformation of converging retinal inputs. In contrast, the prevalence of pattern motion selective neurons is not seen in the primary visual cortex (V1). These results demonstrate an interesting difference between the SC and V1 in motion processing and reveal the SC as an important site for encoding pattern motion.

Illusory Directional Sensation Induced by Asymmetric Vibrations Influences Sense of Agency and Velocity in Wrist Motions.

Illusory directional sensations are generated through asymmetric vibrations applied to the fingertips and have been utilized to induce upper-limb motions in the rehabilitation and training of patients with visual impairment. However, its effects on motor control remain unclear. This study aimed to verify the effects of illusory directional sensations on wrist motion. We conducted objective and subjective evaluations of wrist motion during a motor task, while inducing an illusory directional sensation that was congruent or incongruent with wrist motion. We found that, when motion and illusory directional sensations were congruent, the sense of agency for motion decreased. This indicates an induction sensation of the hand being moved by the illusion. Interestingly, although no physical force was applied to the hand, the angular velocity of the wrist was higher in the congruent condition than that in the no-stimulation condition. The angular velocity of the wrist and electromyography signals of the agonist muscles were weakly positively correlated, suggesting that the participants may have increased their wrist velocity. In other words, the congruence between the direction of motion and illusory directional sensation induced the sensation of the hand being moved, even though the participants' wrist-motion velocity increased. This phenomenon can be explained by the discrepancy between the sensation of active motion predicted by the efferent copy, and that of actual motion caused by the addition of the illusion. The findings of this study can guide the design of novel rehabilitation methods.

Perception of visual and audiovisual trajectories toward and away from the body in the first postnatal year.

Perceiving motion in depth is important in everyday life, especially motion in relation to the body. Visual and auditory cues inform us about motion in space when presented in isolation from each other, but the most comprehensive information is obtained through the combination of both of these cues. We traced the development of infants' ability to discriminate between visual motion trajectories across peripersonal space and to match these with auditory cues specifying the same peripersonal motion. We measured 5-month-old (n = 20) and 9-month-old (n = 20) infants' visual preferences for visual motion toward or away from their body (presented simultaneously and side by side) across three conditions: (a) visual displays presented alone, (b) paired with a sound increasing in intensity, and (c) paired with a sound decreasing in intensity. Both groups preferred approaching motion in the visual-only condition. When the visual displays were paired with a sound increasing in intensity, neither group showed a visual preference. When a sound decreasing in intensity was played instead, the 5-month-olds preferred the receding (spatiotemporally congruent) visual stimulus, whereas the 9-month-olds preferred the approaching (spatiotemporally incongruent) visual stimulus. We speculate that in the approaching sound condition, the behavioral salience of the sound could have led infants to focus on the auditory information alone, in order to prepare a motor response, and to neglect the visual stimuli. In the receding sound condition, instead, the difference in response patterns in the two groups may have been driven by infants' emerging motor abilities and their developing predictive processing mechanisms supporting and influencing each other.

Temporal windows of unconscious processing cannot easily be disrupted.

Conscious perception is preceded by long periods of unconscious processing. These periods are crucial for analyzing temporal information and for solving the many ill-posed problems of vision. An important question is what starts and ends these windows and how they may be interrupted. Most experimental paradigms do not offer the methodology required for such investigation. Here, we used the sequential metacontrast paradigm, in which two streams of lines, expanding from the center to the periphery, are presented, and participants are asked to attend to one of the motion streams. If several lines in the attended motion stream are offset, the offsets are known to integrate mandatorily and unconsciously, even if separated by up to 450 ms. Using this paradigm, we here found that external visual objects, such as an annulus, presented during the motion stream, do not disrupt mandatory temporal integration. Thus, if a window is started once, it appears to remain open even in the presence of disruptions that are known to interrupt visual processes normally. Further, we found that interrupting the motion stream with a gap disrupts temporal integration but does not terminate the overall unconscious processing window. Thus, while temporal integration is key to unconscious processing, not all stimuli in the same processing window are integrated together. These results strengthen the case for unconscious processing taking place in windows of sensemaking, during which temporal integration occurs in a flexible and perceptually meaningful manner.

Intra-individual consistency of vestibular perceptual thresholds.

Vestibular perceptual thresholds quantify sensory noise associated with reliable perception of small self-motions. Previous studies have identified substantial variation between even healthy individuals' thresholds. However, it remains unclear if or how an individual's vestibular threshold varies over repeated measures across various time scales (repeated measurements on the same day, across days, weeks, or months). Here, we assessed yaw rotation and roll tilt thresholds in four individuals and compared this intra-individual variability to inter-individual variability of thresholds measured across a large age-matched cohort each measured only once. For analysis, we performed simulations of threshold measurements where there was no underlying variability (or it was manipulated) to compare to that observed empirically. We found remarkable consistency in vestibular thresholds within individuals, for both yaw rotation and roll tilt; this contrasts with substantial inter-individual differences. Thus, we conclude that vestibular perceptual thresholds are an innate characteristic, which validates pooling measures across sessions and potentially serves as a stable clinical diagnostic and/or biomarker.

The Motion-Silencing Illusion Depends on Object-Centered Representation.

Motion silencing is a striking and unexplained visual illusion wherein changes that are otherwise salient become difficult to perceive when the changing elements also move. We develop a new method for quantifying illusion strength (Experiments 1a and 1b), and we demonstrate a privileged role for rotational motion on illusion strength compared with highly controlled stimuli that lack rotation (Experiments 2a to 3b). These contrasts make it difficult to explain the illusion in terms of lower-level detection limits. Instead, we explain the illusion as a failure to attribute changes to locations. Rotation exacerbates the illusion because its perception relies upon structured object representations. This aggravates the difficulty of attributing changes by demanding that locations are referenced relative to both an object-internal frame and an external frame. Two final experiments (4a and 4b) add support to this account by employing a synchronously rotating external frame of reference that diminishes otherwise strong motion silencing. All participants were Johns Hopkins University undergraduates.

Similarity in motion binds and bends judgments of aspect ratio.

It is well known that objects become grouped in perceptual organization when they share some visual feature, like a common direction of motion. Less well known is that grouping can change how people perceive a set of objects. For example, when a pair of shapes consistently share a common region of space, their aspect ratios tend to be perceived as more similar (are attracted toward each other). Conversely, when shapes are assigned to different regions in space their aspect ratios repel from each other. Here we examine whether the visual system produce both attractive and repulsive distortions when the state of grouping between a pair of shapes changes on a moment-to-moment basis. Observers viewed a pair of ellipses that differed in terms of how flat or tall they were and reported the aspect ratio of one ellipse from the pair. Each ellipse was defined by a cloud of coherently-moving dots, and the dots within the two ellipses had either the same or different directions of motion, varying from trial-to-trial. We found that the cued ellipse's aspect ratio was reported to be repelled from the aspect ratio of the uncued ellipse when the shapes had different directions of motion compared to when they had the same direction of motion. These results suggest that the visual system can adaptively alter visual experience based on grouping, in particular, repelling the appearance of objects when they do not appear to go together, and it can do so quickly and flexibly.