Dual Input Stream Transformer for Vertical Drift Correction in Eye-tracking Reading Data.

We introduce a novel Dual Input Stream Transformer (DIST) for the challenging problem of assigning fixation points from eye-tracking data collected during passage reading to the line of text that the reader was actually focused on. This post-processing step is crucial for analysis of the reading data due to the presence of noise in the form of vertical drift. We evaluate DIST against eleven classical approaches on a comprehensive suite of nine diverse datasets. We demonstrate that combining multiple instances of the DIST model in an ensemble achieves high accuracy across all datasets. Further combining the DIST ensemble with the best classical approach yields an average accuracy of 98.17 %. Our approach presents a significant step towards addressing the bottleneck of manual line assignment in reading research. Through extensive analysis and ablation studies, we identify key factors that contribute to DIST's success, including the incorporation of line overlap features and the use of a second input stream. Via rigorous evaluation, we demonstrate that DIST is robust to various experimental setups, making it a safe first choice for practitioners in the field.

Unexpected sounds inhibit the movement of the eyes during reading and letter scanning.

Novel sounds that unexpectedly deviate from a repetitive sound sequence are well known to cause distraction. Such unexpected sounds have also been shown to cause global motor inhibition, suggesting that they trigger a neurophysiological response aimed at stopping ongoing actions. Recently, evidence from eye movements has suggested that unexpected sounds also temporarily pause the movements of the eyes during reading, though it is unclear if this effect is due to inhibition of oculomotor planning or inhibition of language processes. Here, we sought to distinguish between these two possibilities by comparing a natural reading task to a letter scanning task that involves similar oculomotor demands to reading, but no higher level lexical processing. Participants either read sentences for comprehension or scanned letter strings of these sentences for the letter 'o' in three auditory conditions: silence, standard, and novel sounds. The results showed that novel sounds were equally distracting in both tasks, suggesting that they generally inhibit ongoing oculomotor processes independent of lexical processing. These results suggest that novel sounds may have a global suppressive effect on eye-movement control.

Return-sweep saccades in oral reading.

Recent research on return-sweep saccades has improved our understanding of eye movements when reading paragraphs. However, these saccades, which take our gaze from the end of one line to the start of the next line, have been studied only within the context of silent reading. Articulatory demands and the coordination of the eye-voice span (EVS) at line boundaries suggest that the execution of this saccade may be different in oral reading. We compared launch and landing positions of return-sweeps, corrective saccade probability and fixations adjacent to return-sweeps in skilled adult readers while reading paragraphs aloud and silently. Compared to silent reading, return-sweeps were launched from closer to the end of the line and landed closer to the start of the next line when reading aloud. The probability of making a corrective saccade was higher for oral reading than silent reading. These indicate that oral reading may compel readers to rely more on foveal processing at the expense of parafoveal processing. We found an interaction between reading modality and fixation type on fixation durations. The reading modality effect (i.e., increased fixation durations in oral compared to silent reading) was greater for accurate line-initial fixations and marginally greater for line-final fixations compared to intra-line fixations. This suggests that readers may use the fixations adjacent to return-sweeps as natural pause locations to modulate the EVS.

Measurement of Sexual Interests with Pupillary Responses: A Meta-Analysis.

Objective measures of sexual interest are important for research on human sexuality. There has been a resurgence in research examining pupil dilation as a potential index of sexual orientation. We carried out a meta-analytic review of studies published between 1965 and 2020 (Mdn year = 2016) measuring pupil responses to visual stimuli of adult men and women to assess sexual interest. Separate meta-analyses were performed for six sexual orientation categories. In the final analysis, 15 studies were included for heterosexual men (N = 550), 5 studies for gay men (N = 65), 4 studies for bisexual men (N = 124), 13 studies for heterosexual women (N = 403), and 3 studies for lesbian women (N = 132). Only heterosexual and gay men demonstrated discrimination in pupillary responses that was clearly in line with their sexual orientation, with greater pupil dilation to female and male stimuli, respectively. Bisexual men showed greater pupil dilation to male stimuli. Although heterosexual women exhibited larger pupils to male stimuli compared to female stimuli, the magnitude of the effect was small and non-significant. Finally, lesbian women displayed greater pupil dilation to male stimuli. Three methodological moderators were identified-the sexual explicitness of stimulus materials, the measurement technique of pupillary response, and inclusion of self-report measures of sexual interest. These meta-analyses are based on a limited number of studies and are therefore preliminary. However, the results suggest that pupillary measurement of sexual interest is promising for men and that standardization is essential to gain a better understanding of the validity of this measurement technique for sexual interest.

Sensory gating is related to positive and disorganised schizotypy in contrast to smooth pursuit eye movements and latent inhibition.

Since the characteristics and symptoms of both schizophrenia and schizotypy are manifested heterogeneously, it is possible that different endophenotypes and neurophysiological measures (sensory gating and smooth pursuit eye movement errors) represent different clusters of symptoms. Participants (N = 205) underwent a standard conditioned-pairing paradigm to establish their sensory gating ratio, a smooth-pursuit eye-movement task, a latent inhibition task, and completed the Schizotypal Personality Questionnaire. A Multidimensional Scaling analysis revealed that sensory gating was related to positive and disorganised dimensions of schizotypy. Latent inhibition and prepulse inhibition were not related to any dimension of schizotypy. Smooth pursuit eye movement error was unrelated to sensory gating and latent inhibition, but was related to negative dimensions of schizotypy. Our findings suggest that the symptom clusters associated with two main endophenotypes are largely independent. To fully understand symptomology and outcomes of schizotypal traits, the different subtypes of schizotypy (and potentially, schizophrenia) ought to be considered separately rather than together.

Do readers use character information when programming return-sweep saccades?

Reading saccades that occur within a single line of text are guided by the size of letters. However, readers occasionally need to make longer saccades (known as return-sweeps) that take their eyes from the end of one line of text to the beginning of the next. In this study, we tested whether return-sweep saccades are also guided by font size information and whether this guidance depends on visual acuity of the return-sweep target area. To do this, we manipulated the font size of letters (0.29 vs 0.39° per character) and the length of the first line of text (16 vs 26°). The larger font resulted in return-sweeps that landed further to the right of the line start and in a reduction of under-sweeps compared to the smaller font. This suggests that font size information is used when programming return-sweeps. Return-sweeps in the longer line condition landed further to the right of the line start and the proportion of under-sweeps increased compared to the short line condition. This likely reflects an increase in saccadic undershoot error with the increase in intended saccade size. Critically, there was no interaction between font size and line length. This suggests that when programming return-sweeps, the use of font size information does not depend on visual acuity at the saccade target. Instead, it appears that readers rely on global typographic properties of the text in order to maintain an optimal number of characters to the left of their first fixation on a new line.

Distraction by auditory novelty during reading: Evidence for disruption in saccade planning, but not saccade execution.

Novel or unexpected sounds that deviate from an otherwise repetitive sequence of the same sound cause behavioural distraction. Recent work has suggested that distraction also occurs during reading as fixation durations increased when a deviant sound was presented at the fixation onset of words. The present study tested the hypothesis that this increase in fixation durations occurs due to saccadic inhibition. This was done by manipulating the temporal onset of sounds relative to the fixation onset of words in the text. If novel sounds cause saccadic inhibition, they should be more distracting when presented during the second half of fixations when saccade programming usually takes place. Participants read single sentences and heard a 120 ms sound when they fixated five target words in the sentence. On most occasions (p = .9), the same sine wave tone was presented ("standard"), while on the remaining occasions (p = .1) a new sound was presented ("novel"). Critically, sounds were played, on average, either during the first half of the fixation (0 ms delay) or during the second half of the fixation (120 ms delay). Consistent with the saccadic inhibition hypothesis (SIH), novel sounds led to longer fixation durations in the 120 ms compared to the 0 ms delay condition. However, novel sounds did not generally influence the execution of the subsequent saccade. These results suggest that unexpected sounds have a rapid influence on saccade planning, but not saccade execution.

Parafoveal degradation during reading reduces preview costs only when it is not perceptually distinct.

There is a growing understanding that the parafoveal preview effect during reading may represent a combination of preview benefits and preview costs due to interference from parafoveal masks. It has been suggested that visually degrading the parafoveal masks may reduce their costs, but adult readers were later shown to be highly sensitive to degraded display changes. Four experiments examined how preview benefits and preview costs are influenced by the perception of distinct parafoveal degradation at the target word location. Participants read sentences with four preview types (identity, orthographic, phonological, and letter-mask preview) and two levels of visual degradation (0% vs. 20%). The distinctiveness of the target word degradation was either eliminated by degrading all words in the sentence (Experiments 1a-2a) or remained present, as in previous research (Experiments 1b-2b). Degrading the letter masks resulted in a reduction in preview costs, but only when all words in the sentence were degraded. When degradation at the target word location was perceptually distinct, it induced costs of its own, even for orthographically and phonologically related previews. These results confirm previous reports that traditional parafoveal masks introduce preview costs that overestimate the size of the true benefit. However, they also show that parafoveal degradation has the unintended consequence of introducing additional costs when participants are aware of distinct degradation on the target word. Parafoveal degradation appears to be easily perceived and may temporarily orient attention away from the reading task, thus delaying word processing.

Do Readers Integrate Phonological Codes Across Saccades? A Bayesian Meta-Analysis and a Survey of the Unpublished Literature.

It is commonly accepted that phonological codes can be activated parafoveally during reading and later used to aid foveal word recognition- a finding known as the phonological preview benefit. However, a closer look at the literature shows that this effect may be less consistent than what is sometimes believed. To determine the extent to which phonology is processed parafoveally, a Bayesian meta-analysis of 27 experiments and a survey of the unpublished literature were conducted. While the results were generally consistent with the phonological preview benefit (>90% probability of a true effect in gaze durations), the size of the effect was small. Readers of alphabetical orthographies obtained a modest benefit of only 4 ms in gaze durations. Interestingly, Chinese readers showed a larger effect (6-14 ms in size). There was no difference in the magnitude of the phonological preview benefit between homophone and pseudo-homophone previews, thus suggesting that the modest processing advantage is indeed related to the activation of phonological codes from the parafoveal word. Simulations revealed that the results are relatively robust to missing studies, although the effects may be 19-22% smaller if all missing studies found a null effect. The results suggest that while phonology can be processed parafoveally, this happens only to a limited extent. Because phonological priming effects in single-word recognition are small (10-13 ms; Rastle & Brysbaert, 2006) and there is a loss of visual acuity in the parafovea, it is argued that large phonological preview benefit effects may be unlikely.

Reading is disrupted by intelligible background speech: Evidence from eye-tracking.

It is not well understood whether background speech affects the initial processing of words during reading or only the later processes of sentence integration. Additionally, it is not clear how eye movements support text comprehension in the face of distraction by background speech and noise. In the present research, participants read single sentences (Experiment 1) and short paragraphs (Experiments 2-3) in 4 sound conditions: silence, speech-spectrum Gaussian noise, English speech (intelligible to participants), and Mandarin speech (unintelligible to participants). Intelligible speech did not affect the lexical access of words and had a limited effect on the first-pass fixations of words. However, it led to more regressions and more rereading fixations compared with both unintelligible speech and silence. The results suggested that the distraction is mostly semantic in nature, and there was only limited evidence for a contribution of phonology. Finally, intelligible speech disrupted comprehension only when participants were prevented from rereading previous words. These findings suggest that the semantic properties of irrelevant speech can disrupt the ongoing reading process, but that this disruption occurs in the postlexical stages of reading when participants need to integrate words to form the sentence context and to construct a coherent discourse of the text. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

An eye-movement exploration into return-sweep targeting during reading.

Return-sweeps are an essential eye-movement that takes the readers' eyes from the end of one line of text to the start of the next. While return-sweeps are common during normal reading, the eye-movement literature is dominated by single-line reading studies where no return-sweeps are needed. The present experiment was designed to explore what readers are targeting with their return-sweeps. Participants read two short stories by Frank L. Baum while their eye-movements were being recorded. In one story, every line-initial word was highlighted by formatting it in bold, while the other story was presented normally (i.e., without any bolding). The bolding manipulation significantly reduced oculomotor error associated with return-sweeps, as these saccades landed closer to the left margin and were less likely to require corrective saccades compared to the control condition. However, despite this reduction in oculomotor error, the bolding had no influence on local fixation durations or global reading-time measures. Moreover, return-sweep landing sites were not impacted by line-initial word length nor did the effect of bolding interact with the length of the line-initial word, suggesting that readers were not targeting the centre of line-initial words. We discuss the implication of these findings for return-sweep targeting and eye-movement control during reading.

Distraction by deviant sounds during reading: An eye-movement study.

Oddball studies have shown that sounds unexpectedly deviating from an otherwise repeated sequence capture attention away from the task at hand. While such distraction is typically regarded as potentially important in everyday life, previous work has so far not examined how deviant sounds affect performance on more complex daily tasks. In this study, we developed a new method to examine whether deviant sounds can disrupt reading performance by recording participants' eye movements. Participants read single sentences in silence and while listening to task-irrelevant sounds. In the latter condition, a 50-ms sound was played contingent on the fixation of five target words in the sentence. On most occasions, the same tone was presented (standard sound), whereas on rare and unexpected occasions it was replaced by white noise (deviant sound). The deviant sound resulted in significantly longer fixation durations on the target words relative to the standard sound. A time-course analysis showed that the deviant sound began to affect fixation durations around 180 ms after fixation onset. Furthermore, deviance distraction was not modulated by the lexical frequency of target words. In summary, fixation durations on the target words were longer immediately after the presentation of the deviant sound, but there was no evidence that it interfered with the lexical processing of these words. The present results are in line with the recent proposition that deviant sounds yield a temporary motor suppression and suggest that deviant sounds likely inhibit the programming of the next saccade.

Surprise as an explanation to auditory novelty distraction and post-error slowing.

Performance in sustained attention tasks is known to be slowed by the occurrence of unexpected task-irrelevant distractors (novelty distraction) and the detection of errors (posterror slowing), 2 well-established phenomena studied separately and regarded as reflecting distinct underpinning mechanisms. We measured novelty distraction and posterror slowing in an auditory-visual oddball task to test the hypothesis that they both involve an orienting response. Our results confirm that the 2 effects exhibit a positive interaction. We show that a trial-by-trial measure of surprise credibly accounts for our empirical data. We suggest that novelty distraction and posterror slowing both reflect an orienting response to unexpected events and a reappraisal of action plans. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Auditory Distraction During Reading: A Bayesian Meta-Analysis of a Continuing Controversy.

Everyday reading occurs in different settings, such as on the train to work, in a busy cafeteria, or at home while listening to music. In these situations, readers are exposed to external auditory stimulation from nearby noise, speech, or music that may distract them from their task and reduce their comprehension. Although many studies have investigated auditory-distraction effects during reading, the results have proved to be inconsistent and sometimes even contradictory. In addition, the broader theoretical implications of the findings have not always been explicitly considered. We report a Bayesian meta-analysis of 65 studies on auditory-distraction effects during reading and use metaregression models to test predictions derived from existing theories. The results showed that background noise, speech, and music all have a small but reliably detrimental effect on reading performance. The degree of disruption in reading comprehension did not generally differ between adults and children. Intelligible speech and lyrical music resulted in the biggest distraction. Although this last result is consistent with theories of semantic distraction, there was also reliable distraction by noise. It is argued that new theoretical models are needed that can account for distraction by both background speech and noise.

What are the costs of degraded parafoveal previews during silent reading?

It has been suggested that the preview benefit effect is actually a combination of preview benefit and preview costs. Marx et al. (2015) proposed that visually degrading the parafoveal preview reduces the costs associated with traditional parafoveal letter masks used in the boundary paradigm (Rayner, 1975), thus leading to a more neutral baseline. We report 2 experiments of skilled adults reading silently. In Experiment 1, we found no compelling evidence that degraded previews reduced processing costs associated with traditional letter masks. Moreover, participants were highly sensitive to detecting degraded display changes. Experiment 2 used the boundary detection paradigm (Slattery, Angele, & Rayner, 2011) to explore whether participants were capable of detecting actual letter changes or if they were responding purely to changes in degradation. Half of the participants were instructed to respond to any noticed display changes; the other half were instructed to respond only to changes in letter identities. Participants were highly sensitive to degraded changes. In fact, these changes were so apparent that they reduced the sensitivity to letter masks. In the context of the model proposed by Angele, Slattery, and Rayner (2016), we suggest that degraded previews interfere with the attentional stage, as evidenced by the general lack of foveal load effects. In summary, we found that increasingly degrading parafoveal letter masks does not reduce their processing costs in adults, but that both degraded valid and invalid previews introduce additional costs in terms of greater display change awareness. (PsycINFO Database Record

Parafoveal preview effects from word N + 1 and word N + 2 during reading: A critical review and Bayesian meta-analysis.

The use of gaze-contingent display techniques to study reading has shown that readers attend not only the currently fixated word, but also the word to the right of the current fixation. However, a critical look at the literature shows that a number of questions cannot be readily answered from the available literature reviews on the topic. First, there is no consensus as to whether readers also attend the second word to the right of fixation. Second, it is not clear whether parafoveal processing is more efficient in languages such as Chinese. Third, it is not well understood whether the measured effects are confounded by the properties of the parafoveal mask. In the present study, we addressed these issues by performing a Bayesian meta-analysis of 93 experiments that used the boundary paradigm (Rayner, Cognitive Psychology, 7, 65-81. doi: 10.1016/0010-028590005-5 , 1975). We describe three main findings: (1) The advantage of previewing the second word to the right is modest in size and likely is not centered on zero; (2) Chinese readers do seem to make more efficient use of parafoveal processing, but this is mostly evident in gaze durations; and (3) there are interference effects associated with using different parafoveal masks that roughly increase when the mask is less word-like.