The role of neural oscillations in visuo-motor communication at the time of saccades.

Saccadic eye-movements are fundamental for active vision, allowing observers to purposefully scan the environment with the high-resolution fovea. In this brief perspective we outline a series of experiments from our laboratories investigating the role of eye-movements and their consequences to active perception. We show that saccades lead to suppression of visual sensitivity at saccadic onset, and that this suppression is accompanied by endogenous neural oscillations in the delta range. Similar oscillations are initiated by purposeful hand movements, which lead to measurable changes in responsivity in area V1, and in the connectivity with motor area M1. Saccades also lead to clear distortions in apparent position, but only for verbal reports, not when participants respond with rapid pointing, consistent with the action of two separate visual systems in neurotypical adults. At the time of saccades, serial dependence, the positive influence on perception of previous stimulus attributes (such as orientation) is particularly strong. Again, these processes are accompanied by neural oscillations, in the alpha and low beta range. In general, oscillations seem to be tightly linked to serial dependence in perception, both in auditory judgments (around 10 Hz), and for visual judgements of face gender (14 Hz for female, 17 Hz for male). Taken together, the studies show that neural oscillations play a fundamental role in dynamic, active vision.

The role of non-numerical information in the perception of temporal numerosity.

Numerosity perception refers to the ability to make rapid but approximate estimates of the quantity of elements in a set (spatial numerosity) or presented sequentially (temporal numerosity). Whether numerosity is directly perceived or indirectly recomputed from non-numerical features is a highly debated issue. In the spatial domain, area and density have been suggested as the main parameters through which numerosity would be recomputed. In the temporal domain, stimuli duration and temporal frequency could be similarly exploited to retrieve numerosity. By adapting a psychophysical technique previously exploited in the spatial domain, we investigated whether temporal visual numerosity is directly perceived. Adult participants observed sequences of visual impulses sampled from a stimulus space spanning several levels of temporal frequency and duration (and hence numerosity), and then reproduced the sequence as accurately as possible via a series of keypresses. Crucially, participants were not asked to reproduce any particular property (such as number of impulses) but were free to choose any available cue (such as total duration, or temporal frequency). The results indicate that while the overall sequence duration was barely considered, numerosity and temporal frequency were both spontaneously used as the main cues to reproduce the sequences, with a slight but significant dominance of numerosity. Overall, the results are in line with previous literature suggesting that numerosity is directly encoded, even for temporal sequences, but a non-numerical feature (temporal frequency) is also used in reproducing sequences.

Serial dependence in orientation judgments at the time of saccades.

We actively seek information from the environment through saccadic eye movements, necessitating continual integration of presaccadic and postsaccadic signals, which are displaced on the retina by each saccade. We tested whether trans-saccadic integration may be related to serial dependence (a measure of how perceptual history influences current perception) by measuring how viewing a presaccadic stimulus affects the perceived orientation of a subsequent test stimulus presented around the time of a saccade. Participants reproduced the position, and orientation of a test stimulus presented around a 16° saccade. The reproduced position was mislocalized toward the saccadic target, agreeing with previous work. The reproduced orientation was attracted toward the prior stimulus and regressed to the mean orientation. These results suggest that both short- and long-term past information affects trans-saccadic perception, most strongly when the test stimulus is presented perisaccadically. This study unites the fields of serial dependence and trans-saccadic perception, leading to potential new insights of how information is transferred and accumulated across saccades.

Serial dependence improves performance and biases confidence-based decisions.

Perception depends on both the current sensory input and on the preceding stimuli history, a mechanism referred to as serial dependence (SD). One interesting, and somewhat controversial, question is whether serial dependence originates at the perceptual stage, which should lead to a sensory improvement, or at a subsequent decisional stage, causing solely a bias. Here, we studied the effects of SD in a novel manner by leveraging on the human capacity to spontaneously assess the quality of sensory information. Two noisy-oriented Gabor stimuli were simultaneously presented along with two bars of the same orientation as the Gabor stimuli. Participants were asked to choose which Gabor stimulus to judge and then make a forced-choice judgment of its orientation by selecting the appropriate response bar. On all trials, one of the Gabor stimuli had the same orientation as the Gabor in the same position on the previous trial. We explored whether continuity in orientation and position affected choice and accuracy. Results show that continuity of orientation leads to a persistent (up to four back) accuracy advantage and a higher preference in the selection of stimuli with the same orientation, and this advantage accumulates over trials. In contrast, analysis of the continuity of the selected position indicated that participants had a strong tendency to choose stimuli in the same position, but this behavior did not lead to an improvement in accuracy.

Evidence of Serial Dependence from Decoding of Visual Evoked Potentials.

It is well known that recent sensory experience influences perception, recently demonstrated by a phenomenon termed "serial dependence." However, its underlying neural mechanisms are poorly understood. We measured ERP responses to pairs of stimuli presented randomly to the left or right hemifield. Seventeen male and female adults judged whether the upper or lower half of the grating had higher spatial frequency, independent of the horizontal position of the grating. This design allowed us to trace the memory signal modulating task performance and also the implicit memory signal associated with hemispheric position. Using classification techniques, we decoded the position of the current and previous stimuli and the response from voltage scalp distributions of the current trial. Classification of previous responses reached full significance only 700 ms after presentation of the current stimulus, consistent with retrieval of an activity-silent memory trace. Cross-condition classification accuracy of past responses (trained on current responses) correlated with the strength of serial dependence effects of individual participants. Overall, our data provide evidence for a silent memory signal that can be decoded from the EEG potential, which interacts with the neural processing of the current stimulus. This silent memory signal could be the physiological substrate subserving at least one type of serial dependence.SIGNIFICANCE STATEMENT The neurophysiological underpinnings of how past perceptual experience affects current perception are poorly understood. Here, we show that recent experience is reactivated when a new stimulus is presented and that the strength of this reactivation correlates with serial biases in individual participants, suggesting that serial dependence is established on the basis of a silent memory signal.

Visual priming and serial dependence are mediated by separate mechanisms.

Perceptual history influences current perception, readily revealed by visual priming (the facilitation of responses on repeated presentations of similar stimuli) and by serial dependence (systematic biases toward the previous stimuli). We asked whether the two phenomena shared perceptual mechanisms. We modified the standard "priming of pop-out" paradigm to measure both priming and serial dependence concurrently. The stimulus comprised three grating patches, one or two red, and the other green. Participants identified the color singleton (either red or green), and reproduced its orientation. Trial sequences were designed to maximize serial dependence, and long runs of priming color and position. The results showed strong effects of priming, both on reaction times and accuracy, which accumulated steadily over time, as generally reported in the literature. The serial dependence effects were also strong, but did not depend on previous color, nor on the run length. Reaction times measured under various conditions of repetition or change of priming color or position were reliably correlated with imprecision in orientation reproduction, but reliably uncorrelated with magnitude of serial dependence. The results suggest that visual priming and serial dependence are mediated by different neural mechanisms. We propose that priming affects sensitivity, possibly via attention-like mechanisms, whereas serial dependence affects criteria, two orthogonal dimensions in the signal detection theory.

Symmetry as a grouping cue for numerosity perception.

To estimate the number of objects in an image, each element needs to be segregated as a single unit. Several principles guide the process of element identification, one of the strongest being symmetry. In the current study, we investigated how symmetry affects the ability to rapidly estimate the number of objects (numerosity). Participants judged the numerosity of asymmetric or symmetric arrays of various numerosities. The results show that the numerosity of symmetrical arrays was significantly underestimated at low numerosities, but the effect was greatly reduced at higher numerosities. Adding an additional axis of symmetry (double symmetry) further reduced perceived numerosity. The magnitude of the symmetry-driven underestimation was inversely correlated with autistic personality traits, consistent with previous work associating autistic traits with perceptual grouping. Overall, these results support the idea that perceived numerosity relies on object segmentation and grouping cues, with symmetry playing a key role.

Contextual Information Modulates Pupil Size in Autistic Children.

Recent Bayesian models suggest that perception is more "data-driven" and less dependent on contextual information in autistic individuals than others. However, experimental tests of this hypothesis have given mixed results, possibly due to the lack of objectivity of the self-report methods typically employed. Here we introduce an objective no-report paradigm based on pupillometry to assess the processing of contextual information in autistic children, together with a comparison clinical group. After validating in neurotypical adults a child-friendly pupillometric paradigm, in which we embedded test images within an animation movie that participants watched passively, we compared pupillary response to images of the sun and meaningless control images in children with autism vs. age- and IQ-matched children presenting developmental disorders unrelated to the autistic spectrum. Both clinical groups showed stronger pupillary constriction for the sun images compared with control images, like the neurotypical adults. However, there was no detectable difference between autistic children and the comparison group, despite a significant difference in pupillary light responses, which were enhanced in the autistic group. Our report introduces an objective technique for studying perception in clinical samples and children. The lack of statistically significant group differences in our tests suggests that autistic children and the comparison group do not show large differences in perception of these stimuli. This opens the way to further studies testing contextual processing at other levels of perception.

Propagation and update of auditory perceptual priors through alpha and theta rhythms.

To maintain a continuous and coherent percept over time, the brain makes use of past sensory information to anticipate forthcoming stimuli. We recently showed that auditory experience of the immediate past is propagated through ear-specific reverberations, manifested as rhythmic fluctuations of decision bias at alpha frequencies. Here, we apply the same time-resolved behavioural method to investigate how perceptual performance changes over time under conditions of stimulus expectation and to examine the effect of unexpected events on behaviour. As in our previous study, participants were required to discriminate the ear-of-origin of a brief monaural pure tone embedded in uncorrelated dichotic white noise. We manipulated stimulus expectation by increasing the target probability in one ear to 80%. Consistent with our earlier findings, performance did not remain constant across trials, but varied rhythmically with delay from noise onset. Specifically, decision bias showed a similar oscillation at ~9 Hz, which depended on ear congruency between successive targets. This suggests rhythmic communication of auditory perceptual history occurs early and is not readily influenced by top-down expectations. In addition, we report a novel observation specific to infrequent, unexpected stimuli that gave rise to oscillations in accuracy at ~7.6 Hz one trial after the target occurred in the non-anticipated ear. This new behavioural oscillation may reflect a mechanism for updating the sensory representation once a prediction error has been detected.

Groupitizing modifies neural coding of numerosity.

Numerical estimation of arrays of objects is faster and more accurate when items can be clustered into groups, a phenomenon termed "groupitizing." Grouping can facilitate segregation into subitizable "chunks," each easily estimated, then summed. The current study investigates whether spatial grouping of arrays drives specific neural responses during numerical estimation, reflecting strategies such as exact calculation and fact retrieval. Fourteen adults were scanned with fMRI while estimating either the numerosity or shape of arrays of items, either randomly distributed or spatially grouped. Numerosity estimation of both classes of stimuli elicited common activation of a right lateralized frontoparietal network. Grouped stimuli additionally recruited regions in the left hemisphere and bilaterally in the angular gyrus. Multivariate pattern analysis showed that classifiers trained with the pattern of neural activations read out from parietal regions, but not from the primary visual areas, can decode different numerosities both within and across spatial arrangements. The behavioral numerical acuity correlated with the decoding performance of the parietal but not with occipital regions. Overall, this experiment suggests that the estimation of grouped stimuli relies on the approximate number system for numerosity estimation, but additionally recruits regions involved in calculation.

Uncertainty and Prior Assumptions, Rather Than Innate Logarithmic Encoding, Explain Nonlinear Number-to-Space Mapping.

Mapping number to space is natural and spontaneous but often nonveridical, showing a clear compressive nonlinearity that is thought to reflect intrinsic logarithmic encoding of numerical values. We asked 78 adult participants to map dot arrays onto a number line across nine trials. Combining participant data, we confirmed that on the first trial, mapping was heavily compressed along the number line, but it became more linear across trials. Responses were well described by logarithmic compression but also by a parameter-free Bayesian model of central tendency, which quantitatively predicted the relationship between nonlinearity and number acuity. To experimentally test the Bayesian hypothesis, we asked 90 new participants to complete a color-line task in which they mapped noise-perturbed color patches to a "color line." When there was more noise at the high end of the color line, the mapping was logarithmic, but it became exponential with noise at the low end. We conclude that the nonlinearity of both number and color mapping reflects contextual Bayesian inference processes rather than intrinsic logarithmic encoding.

Numbers in action.

To understand the number sense, we need to understand its function. We argue that numerosity estimation is fundamental not only for perception, but also preparation and control of action. We outline experiments that link numerosity estimation with action, pointing to a generalized numerosity system that serves both perception and action preparation.

The Grouping-Induced Numerosity Illusion Is Attention-Dependent.

Perceptual grouping and visual attention are two mechanisms that help to segregate visual input into meaningful objects. Here we report how perceptual grouping, which affects perceived numerosity, is reduced when visual attention is engaged in a concurrent visual task. We asked participants to judge the numerosity of clouds of dot-pairs connected by thin lines, known to cause underestimation of numerosity, while simultaneously performing a color conjunction task. Diverting attention to the concomitant visual distractor significantly reduced the grouping-induced numerosity biases. Moreover, while the magnitude of the illusion under free viewing covaried strongly with AQ-defined autistic traits, under conditions of divided attention the relationship was much reduced. These results suggest that divided attention modulates the perceptual grouping of elements by connectedness and that it is independent of the perceptual style of participants.

Perceptual History Acts in World-Centred Coordinates.

Serial dependence effects have been observed using a variety of stimuli and tasks, revealing that the recent past can bias current percepts, leading to increased similarity between two. The aim of this study is to determine whether this temporal integration occurs in egocentric or allocentric coordinates. We asked participants to perform an orientation reproduction task using grating stimuli while the head was kept at a fixed position, or after a 40° yaw rotation between trials, from left (-20°) to right (+20°), putting the egocentric and allocentric cues in conflict. Under these conditions, allocentric cues prevailed.

Perception of geometric sequences and numerosity both predict formal geometric competence in primary school children.

While most animals have a sense of number, only humans have developed symbolic systems to describe and organize mathematical knowledge. Some studies suggest that human arithmetical knowledge may be rooted in an ancient mechanism dedicated to perceiving numerosity, but it is not known if formal geometry also relies on basic, non-symbolic mechanisms. Here we show that primary-school children who spontaneously detect and predict geometrical sequences (non-symbolic geometry) perform better in school-based geometry tests indexing formal geometric knowledge. Interestingly, numerosity discrimination thresholds also predicted and explained a specific portion of variance of formal geometrical scores. The relation between these two non-symbolic systems and formal geometry was not explained by age or verbal reasoning skills. Overall, the results are in line with the hypothesis that some human-specific, symbolic systems are rooted in non-symbolic mechanisms.

Perceptual history propagates down to early levels of sensory analysis.

One function of perceptual systems is to construct and maintain a reliable representation of the environment. A useful strategy intrinsic to modern "Bayesian" theories of perception1-6 is to take advantage of the relative stability of the input and use perceptual history (priors) to predict current perception. This strategy is efficient1-7 but can lead to stimuli being biased toward perceptual history, clearly revealed in a phenomenon known as serial dependence.8-14 However, it is still unclear whether serial dependence biases sensory encoding or only perceptual decisions.15,16 We leveraged on the "surround tilt illusion"-where tilted flanking stimuli strongly bias perceived orientation-to measure its influence on the pattern of serial dependence, which is typically maximal for similar orientations of past and present stimuli.7,10 Maximal serial dependence for a neutral stimulus preceded by an illusory one occurred when the perceived, not the physical, orientations of the two stimuli matched, suggesting that the priors biasing current perception incorporate the effect of the illusion. However, maximal serial dependence of illusory stimuli induced by neutral stimuli occurred when their physical (not perceived) orientations were matched, suggesting that priors interact with incoming sensory signals before they are biased by flanking stimuli. The evidence suggests that priors are high-level constructs incorporating contextual information, which interact directly with early sensory signals, not with highly processed perceptual representations.

A Sensorimotor Numerosity System.

Incoming sensory input provides information for the planning and execution of actions, which yield motor outcomes that are themselves sensory inputs. One dimension where action and perception strongly interact is numerosity perception. Many non-human animals can estimate approximately the number of external elements as well as their own actions, and neurons have been identified that respond to both. Recent psychophysical adaptation studies on humans also provide evidence for neural mechanisms responding to both the number of externally generated events and self-produced actions. Here we advance the idea that these strong connections may arise from dedicated sensorimotor mechanisms in the brain, part of a more generalized system interfacing action with the processing of other quantitative magnitudes such as space and time.

Pupillary Responses Obey Emmert's Law and Co-vary with Autistic Traits.

We measured the pupil response to a light stimulus subject to a size illusion and found that stimuli perceived as larger evoke a stronger pupillary response. The size illusion depends on combining retinal signals with contextual 3D information; contextual processing is thought to vary across individuals, being weaker in individuals with stronger autistic traits. Consistent with this theory, autistic traits correlated negatively with the magnitude of pupil modulations in our sample of neurotypical adults; however, psychophysical measurements of the illusion did not correlate with autistic traits, or with the pupil modulations. This shows that pupillometry provides an accurate objective index of complex perceptual processes, particularly useful for quantifying interindividual differences, and potentially more informative than standard psychophysical measures.

Perceptual Oscillations in Gender Classification of Faces, Contingent on Stimulus History.

Perception is a proactive ''predictive'' process, in which the brain takes advantage of past experience to make informed guesses about the world to test against sensory data. Here we demonstrate that in the judgment of the gender of faces, beta rhythms play an important role in communicating perceptual experience. Observers classified in forced choice as male or female, a sequence of face stimuli, which were physically constructed to be male or female or androgynous (equal morph). Classification of the androgynous stimuli oscillated rhythmically between male and female, following a complex waveform comprising 13.5 and 17 Hz. Parsing the trials based on the preceding stimulus showed that responses to androgynous stimuli preceded by male stimuli oscillated reliably at 17 Hz, whereas those preceded by female stimuli oscillated at 13.5 Hz. These results suggest that perceptual priors for face perception from recent perceptual memory are communicated through frequency-coded beta rhythms.

Grouping strategies in number estimation extend the subitizing range.

When asked to estimate the number of items in a visual array, educated adults and children are more precise and rapid if the items are clustered into small subgroups rather than randomly distributed. This phenomenon, termed "groupitizing", is thought to rely on the recruitment of the subitizing system (dedicated to the perception of very small numbers), with the aid of simple arithmetical calculations. The aim of current study is to verify whether the advantage for clustered stimuli does rely on subitizing, by manipulating attention, known to strongly affect attention. Participants estimated the numerosity of grouped or ungrouped arrays in condition of full attention or while attention was diverted with a dual-task. Depriving visual attention strongly decreased estimation precision of grouped but not of ungrouped arrays, as well as increasing the tendency for numerosity estimation to regress towards the mean. Additional explorative analyses suggested that calculation skills correlated with the estimation precision of grouped, but not of ungrouped, arrays. The results suggest that groupitizing is an attention-based process that leverages on the subitizing system. They also suggest that measuring numerosity estimation thresholds with grouped stimuli may be a sensitive correlate of math abilities.