The function/content word distinction and eye movements in reading.

A substantial quantity of research has explored whether readers' eye movements are sensitive to the distinction between function and content words. No clear answer has emerged, in part due to the difficulty of accounting for differences in length, frequency, and predictability between the words in the two classes. Based on evidence that readers differentially overlook function word errors, we hypothesized that function words may be more frequently skipped or may receive shorter fixations. We present two very large-scale eyetracking experiments using selected sentences from a corpus of natural text, with each sentence containing a target function or content word. The target words in the two classes were carefully matched on length, frequency, and predictability, with the latter variable operationalized in terms of next-word probability obtained from the large language model GPT-2. While the experiments replicated a range of expected effects, word class did not have any clear influence on target word skipping probability, and there was some evidence for a content word advantage in fixation duration measures. These results indicate that readers' tendency to overlook function word errors is not due to reduced time spent encoding these words. The results also broadly support the implicit assumption in prominent models of eye movement control in reading that a word's syntactic category does not play an important role in decisions about when and where to move the eyes. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The transposed-word effect does not require parallel word processing: Failure to notice transpositions with serial presentation of words.

Readers sometimes fail to notice word transposition errors, reporting a sentence with two transposed words to be grammatical (the transposed-word effect). It has been suggested that this effect implicates parallel word processing during sentence reading. The current study directly assessed the role of parallel word processing in failure to notice word transposition errors, by comparing error detection under normal sentence presentation conditions and when words are presented serially at 250 ms/word. Extending recent results obtained with serial presentation of Chinese sentences (Liu, Li, Cutter, Paterson, & Wang, Cognition 218: 104922, 2022), in Experiment 1 we found a transposed-word effect with serial presentation of English sentences. In Experiment 2, we replicated this finding with task instructions that allowed responding at any time during the presentation of the sentence; this result indicates that the transposed-word effect that appears with serial word presentation is not due to a late process of reconstruction of short-term memory. Thus, parallel word processing is not necessary for a transposed-word effect in English. Like Liu et al. (2022), we did find that the transposed-word effect was statistically larger with parallel presentation than with serial presentation; we consider several explanations as to why this is so.

A 'compensatory selection' effect with standardized tests: Lack of correlation between test scores and success is evidence that test scores are predictive of success.

We introduce the statistical concept of 'compensatory selection', which arises when selecting a subset of applicants based on multiple predictors, such as when standardized test scores are used in combination with other predictors required in a school application (e.g., previous grades, references letters, and personal statements). Post-hoc analyses often fail to find a positive correlation between test scores and subsequent success, and this failure is sometimes taken as evidence against the predictive validity of the standardized test. The present analysis reveals that the failure to find a negative correlation indicates that the standardized test is in fact a valid predictor of success. This is due to compensation between predictors during selection: Some students are admitted despite a low test score because their application is exceptional in other respects, while other students are admitted primarily based on a high test score despite weakness in the rest of their application. This compensatory selection process introduces a negative correlation between test scores and other predictors among those admitted (a 'collider bias' or 'Berkson's paradox' effect). If test scores are valid predictors of success, this negative correlation between the predictors counteracts the positive correlation between test scores and success that would have been observed if all applicants were admitted. If test scores are not predictive of success, but were nevertheless used in a compensatory selection process, there would be a spurious negative correlation between test scores and success (i.e., an admitted student with a weak application except for a high test score would be unlikely to succeed). The selection effect that is described here is fundamentally different from the well-known 'restricted range' problem and can powerfully alter results even in situations that accept most applicants.

Person-based prominence guides incremental interpretation: Evidence from obviation in Ojibwe.

Distinctions related to person and animacy have long been known to impact both the grammar and incremental processing in a way that can be described through "prominence" scales. We put the generalizability of these scales to the test by examining the processing effects of a typologically uncommon distinction known as obviation, which is found in Ojibwe, an Indigenous language of North America. Obviation contrasts the single most discourse-salient animate third person (proximate) with other non-salient third persons (obviative). Using a visual world paradigm, we show that obviation influences parsing and interpretation commitments under incremental ambiguity: Proximate nouns are assumed to be the agent of an action, while obviative nouns do not lead to strong incremental commitments. This result parallels previous findings in other languages with distinctions related to animacy and person, supporting a theory where the effect of prominence information in processing is the result of a common set of constraints derived from the alignment of scales related to person, syntactic position, and thematic role.

Predictability eliminates neighborhood effects during Chinese sentence reading.

Previous research has demonstrated effects of both orthographic neighborhood size and neighbor frequency in word recognition in Chinese. A large neighborhood-where neighborhood size is defined by the number of words that differ from a target word by a single character-appears to facilitate word recognition, while the presence of a higher-frequency neighbor has an inhibitory effect. The present study investigated modulation of these effects by a word's predictability in context. In two eye-movement experiments, the predictability of a target word in each sentence was manipulated. Target words differed in their neighborhood size (Experiment 1) and in whether they had a higher-frequency neighbor (Experiment 2). The study replicated the previously observed effects of neighborhood size and neighbor frequency when the target word was unpredictable, but in both experiments neighborhood effects were absent when the target was predictable. These results suggest that when a word is preactivated by context, the activation of its neighbors may be diminished to such an extent that these neighbors do not effectively compete for selection.

Maintenance cost in the processing of subject-verb dependencies.

Although research in sentence comprehension has suggested that processing long-distance dependencies involves maintenance between the elements that form the dependency, studies on maintenance of long-distance subject-verb (SV) dependencies are scarce. The few relevant studies have delivered mixed results using self-paced reading or phoneme-monitoring tasks. In the current study, we used eye tracking during reading to test whether maintaining a long-distance SV dependency results in a processing cost on an intervening adverbial clause. In Experiment 1, we studied this question in Spanish and found that both go-past reading times and regressions out of an adverbial clause to the previous regions were significantly increased when the clause interrupts a SV dependency compared to when the same clause doesn't interrupt this dependency. We then replicated these findings in English (Experiment 2), observing significantly increased go-past reading times on a clause interrupting a SV dependency. The current study provides the first eye-tracking data showing a maintenance cost in the processing of SV dependencies cross-linguistically. Sentence comprehension models should account for the maintenance cost generated by SV dependency processing, and future research should focus on the nature of the maintained representation. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Using eye tracking to investigate failure to notice word transpositions in reading.

Previous research (Mirault, Snell, & Grainger, 2018) has demonstrated that subjects sometimes incorrectly judge an ungrammatical sentence as grammatical when it is created by the transposition of two words in a grammatical sentence (e.g., The white was cat big). Here we present two eye-tracking experiments designed to assess the prevalence of this phenomenon in a more natural reading task, and to explore theoretical explanations. Readers failed to notice transpositions at about the same rate as in Mirault et al. (2018). Failure to notice the transposition was more common when both words were short, and when readers' eyes skipped, rather than directly fixated, one of the two words. The status of the transposed words as open- or closed-class did not have a reliable effect. The transposed words caused disruption in the eye movement record only on trials when participants ultimately judged the sentence to be ungrammatical, not when they judged the sentence to be grammatical. We argue that the results are not entirely consistent with the account offered by Mirault et al. (2018), which attributes failure to notice transpositions to parallel processing of adjacent words, or with a late, post-perceptual rational inference account (Gibson, Bergen, & Piantadosi, 2013). We propose that word recognition is serial, but post-lexical integration of each word into its context may not be perfectly incremental.

Do effects of visual contrast and font difficulty on readers' eye movements interact with effects of word frequency or predictability?

The time a reader's eyes spend on a word is influenced by visual (e.g., contrast) as well as lexical (e.g., word frequency) and contextual (e.g., predictability) factors. Well-known visual word recognition models predict that visual and higher-level manipulations may have interactive effects on early eye movement measures, because of cascaded processing between levels. Previous eye movement studies provide conflicting evidence as to whether they do, possibly because of inconsistent manipulations or limited statistical power. In the present study, 2 highly powered experiments used sentences in which a target word's frequency and predictability were factorially manipulated. Experiment 1 also manipulated visual contrast, and Experiment 2 also manipulated font difficulty. Robust main effects of all manipulations were evident in both experiments. In Experiment 1, interactions between the effect of contrast and the effects of frequency and predictability were numerically small and statistically unreliable in both early (word skipping, first fixation duration) and later (gaze duration, go-past time) measures. In Experiment 2, frequency and predictability did demonstrate convincing interactions with font difficulty, but only in the later measures, possibly implicating a checking mechanism. We conclude that although the predicted interactions in early eye movement measures may exist, they are sufficiently weak that they are difficult to detect even in large eye movement experiments. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

The puzzle of number agreement with disjunction.

In English, when two nouns in a disjunctive subject differ in number (e.g., the dogs or the cat), the verb tends to agree with the number of the nearer noun. This is exceptional, as a noun's linear proximity to the verb does not generally play a role in agreement. In the present study, we investigate a further puzzle about agreement with disjunction, namely, the existence of a pattern in which two singular disjuncts trigger plural agreement (e.g., The lawyer or the accountant are…). Two eyetracking studies in English show that plural agreement with a disjunction of singulars does not reliably disrupt readers' eye movements, in contrast to the immediate disruptive effect of other agreement violations. Three off-line rating studies in English show that plural agreement results in only a small decrement in acceptability, compared to other agreement violations, and that in some structural configurations there is no decrement at all. On the whole, the data do not support the hypothesis that plural agreement is licensed only when or has an inclusive reading; even when it has an exclusive reading, there is only a small penalty for plural agreement. Finally, we explored this issue in Italian, which has a richer system of inflectional morphology. Italian speakers showed a plural preference in a completion experiment, and singular and plural agreement did not differ in acceptability in a rating experiment. We conclude that agreement with disjunction is a grammatical lacuna or gap, in the sense that speakers' grammar simply does not prescribe a verb number following a disjunctive subject.

The grammaticality asymmetry in agreement attraction reflects response bias: Experimental and modeling evidence.

Memory access mechanisms such as cue-based retrieval have come to dominate theories of the processing of linguistic dependencies such as subject-verb agreement. One phenomenon that has been regarded as demonstrating the role of such mechanisms is the grammaticality asymmetry in agreement attraction, which is the observation that nouns other than the grammatical controller of agreement can influence the computation of subject-verb agreement in ungrammatical, but not grammatical, sentences. This asymmetry is most often accounted for via the dynamics of retrieval interference. We challenge this interpretation, arguing that the asymmetry largely reflects response bias. Three forced-choice judgment experiments show that neutralizing response bias results in a decrease in the size of the grammaticality asymmetry, or its elimination altogether. Together with the response time patterns in these experiments, this result favors an account that attributes attraction effects to a continuous and equivocal representation of number, rather than to the dynamics of retrieval interference. We implement a model of grammaticality judgments that links a continuous representation of number to the rate of evidence accumulation in a diffusion process. This model accounts for the presence or absence of the grammaticality asymmetry through shifts in the decisional starting point (i.e. response bias), and highlights the importance of monitoring for response bias effects in judgment tasks.

Failure to detect function word repetitions and omissions in reading: Are eye movements to blame?

We tested whether failure to notice repetitions of function words during reading (e.g., Amanda jumped off the the swing and landed on her feet.) is due to the eyes' tendency to skip one of the instances of the word. Eye movements were recorded during reading of sentences with repetitions of the word the or repetitions of a noun, after which readers were asked whether an error was present. A repeated the was detected on 46% of trials overall. On trials on which both instances of the were fixated, detection was still only 66%. A repeated noun was detected on 90% of trials, with no significant effect of eye movement patterns. Detecting an omitted the also proved difficult, with eye movement patterns having only a small effect. Readers frequently overlook function word errors even when their eye movements provide maximal opportunity for noticing such errors, but they notice content word repetitions regardless of eye movement patterns. We propose that readers overlook function word errors because they attribute the apparent error to noise in the eye movement control system.

The role of preview validity in predictability and frequency effects on eye movements in reading.

A word's predictability, as measured by its cloze probability, has a robust influence on the time a reader's eyes spend on the word, with more predictable words receiving shorter fixations. However, several previous studies using the boundary paradigm have found no apparent effect of predictability on early reading time measures when the reader does not have valid parafoveal preview of the target word. The present study directly assesses this pattern in two experiments, demonstrating evidence for a null effect of predictability on first fixation and gaze duration with invalid preview, supported by Bayes factor analyses. While the effect of context independent word frequency is shown to survive with invalid preview, consistent with previous studies, the effect of predictability is eliminated with both unrelated word previews and random letter string previews. These results suggest that a word's predictability influences early stages of orthographic processing, and does so only when perceptual evidence is equivocal, as is the case when the word is initially viewed in parafoveal vision. Word frequency may influence not only early orthographic processing, but also later processing stages. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Processing of Norwegian complex verbs: Evidence for early decomposition.

We examined the processing of Norwegian complex verbs-compounds consisting of a prepositional prefix and a verbal root-to investigate the lexical decomposition of such morphologically complex compounds. In an eyetracking-while-reading study, we tested whether reading time measures were significantly predicted by a compound verb's whole-word frequency, its root family frequency, or some combination thereof. The results suggest that whole-word and root family frequencies make independent contributions to first-fixation durations. Subsequent reading time measures were better predicted by either whole-word frequency, root family frequency, or both in tandem. We interpret these results as providing support for hybrid models of lexical representation, in which complex verbs are associated with an atomic (whole-word) representation linked to the lexical entries for the compound's constituent morphemes.

Comprehension demands modulate re-reading, but not first pass reading behavior.

Several studies have examined effects of explicit task demands on eye movements in reading. However, there is relatively little prior research investigating the influence of implicit processing demands. In the present study, processing demands were manipulated by means of a between-subject manipulation of comprehension question difficulty. Consistent with previous results from Wotschack and Kliegl (2013), the question difficulty manipulation influenced the probability of regressing from late in sentences and re-reading earlier regions; readers who expected difficult comprehension questions were more likely to re-read. However, this manipulation had no reliable influence on eye movements during first pass reading of earlier sentence regions. Moreover, for the subset of sentences that contained a plausibility manipulation, the disruption induced by implausibility was not modulated by the question manipulation. We interpret these results as suggesting that comprehension demands influence reading behavior primarily by modulating a criterion for comprehension that readers apply after completing first-pass processing.

Beliefs and Bayesian reasoning.

We examine whether judgments of posterior probabilities in Bayesian reasoning problems are affected by reasoners' beliefs about corresponding real-world probabilities. In an internet-based task, participants were asked to determine the probability that a hypothesis is true (posterior probability, e.g., a person has a disease, given a positive medical test) based on relevant probabilities (e.g., that any person has the disease and the true and false positive rates of the test). We varied whether the correct posterior probability was close to, or far from, independent intuitive estimates of the corresponding 'real-world' probability. Responses were substantially closer to the correct posterior when this value was close to the intuitive estimate. A model in which the response is a weighted sum of the intuitive estimate and an additive combination of the probabilities provides an excellent account of the results.

The Matrix Verb as a Source of Comprehension Difficulty in Object Relative Sentences.

Two experiments used eyetracking during reading to examine the processing of the matrix verb following object and subject relative clauses. The experiments show that the processing of the matrix verb following an object relative is indeed slowed compared to the processing of the same verb following a subject relative. However, this difficulty is entirely eliminated if additional material intervenes between the object gap and the matrix verb. An explanation in terms of spillover processing is ruled out, suggesting that it is the gap-matrix verb sequence that is itself responsible for the difficulty. We consider two accounts of this difficulty, one emphasizing the potential difficulty of rapidly switching between the sentential subject's thematic or syntactic role in the embedded clause and its role in the matrix clause, and one emphasizing the potential difficulty of performing two demanding memory retrievals in rapid succession. The present experiments also closely replicate the previous findings from eyetracking that the noun phrase and the verb within an object relative are both loci of processing difficulty, but that the former induces substantially greater difficulty.

The word frequency effect during sentence reading: A linear or nonlinear effect of log frequency?

The effect of word frequency on eye movement behaviour during reading has been reported in many experimental studies. However, the vast majority of these studies compared only two levels of word frequency (high and low). Here we assess whether the effect of log word frequency on eye movement measures is linear, in an experiment in which a critical target word in each sentence was at one of three approximately equally spaced log frequency levels. Separate analyses treated log frequency as a categorical or a continuous predictor. Both analyses showed only a linear effect of log frequency on the likelihood of skipping a word, and on first fixation duration. Ex-Gaussian analyses of first fixation duration showed similar effects on distributional parameters in comparing high- and medium-frequency words, and medium- and low-frequency words. Analyses of gaze duration and the probability of a refixation suggested a nonlinear pattern, with a larger effect at the lower end of the log frequency scale. However, the nonlinear effects were small, and Bayes Factor analyses favoured the simpler linear models for all measures. The possible roles of lexical and post-lexical factors in producing nonlinear effects of log word frequency during sentence reading are discussed.

Eye movement evidence for an immediate Ganong effect.

Listeners tend to categorize an ambiguous speech sound so that it forms a word with its context (Ganong, 1980). This effect could reflect feedback from the lexicon to phonemic activation (McClelland & Elman, 1986), or the operation of a task-specific phonemic decision system (Norris, McQueen, & Cutler, 2000). Because the former account involves feedback between lexical and phonemic levels, it predicts that the lexicon's influence on phonemic decisions should be delayed and should gradually increase in strength. Previous response time experiments have not delivered a clear verdict as to whether this is the case, however. In 2 experiments, listeners' eye movements were tracked as they categorized phonemes using visually displayed response options. Lexically relevant information in the signal, the timing of which was confirmed by separate gating experiments, immediately increased eye movements toward the lexically supported response. This effect on eye movements then diminished over the course of the trial rather than continuing to increase. These results challenge the lexical feedback account. The present work also introduces a novel method for analyzing data from 'visual-world' type tasks, designed to assess when an experimental manipulation influences the probability of an eye movement toward the target. (PsycINFO Database Record

Within-subject consistency and between-subject variability in Bayesian reasoning strategies.

It is well known that people tend to perform poorly when asked to determine a posterior probability on the basis of a base rate, true positive rate, and false positive rate. The present experiments assessed the extent to which individual participants nevertheless adopt consistent strategies in these Bayesian reasoning problems, and investigated the nature of these strategies. In two experiments, one laboratory-based and one internet-based, each participant completed 36 problems with factorially manipulated probabilities. Many participants applied consistent strategies involving use of only one of the three probabilities provided in the problem, or additive combination of two of the probabilities. There was, however, substantial variability across participants in which probabilities were taken into account. In the laboratory experiment, participants' eye movements were tracked as they read the problems. There was evidence of a relationship between information use and attention to a source of information. Participants' self-assessments of their performance, however, revealed little confidence that the strategies they applied were actually correct. These results suggest that the hypothesis of base rate neglect actually underestimates people's difficulty with Bayesian reasoning, but also suggest that participants are aware of their ignorance.

Dissociating word frequency and predictability effects in reading: Evidence from coregistration of eye movements and EEG.

Two very reliable influences on eye fixation durations in reading are word frequency, as measured by corpus counts, and word predictability, as measured by cloze norming. Several studies have reported strictly additive effects of these 2 variables. Predictability also reliably influences the amplitude of the N400 component in event-related potential studies. However, previous research suggests that while frequency affects the N400 in single-word tasks, it may have little or no effect on the N400 when a word is presented with a preceding sentence context. The present study assessed this apparent dissociation between the results from the 2 methods using a coregistration paradigm in which the frequency and predictability of a target word were manipulated while readers' eye movements and electroencephalograms were simultaneously recorded. We replicated the pattern of significant, and additive, effects of the 2 manipulations on eye fixation durations. We also replicated the predictability effect on the N400, time-locked to the onset of the reader's first fixation on the target word. However, there was no indication of a frequency effect in the electroencephalogram record. We suggest that this pattern has implications both for the interpretation of the N400 and for the interpretation of frequency and predictability effects in language comprehension.