The Importance of Linguistic Factors: He Likes Subject Referents.

We report the results of one visual-world eye-tracking experiment and two referent selection tasks in which we investigated the effects of information structure in the form of prosody and word order manipulation on the processing of subject pronouns er and der in German. Factors such as subjecthood, focus, and topicality, as well as order of mention have been linked to an increased probability of certain referents being selected as the pronoun's antecedent and described as increasing this referent's prominence, salience, or accessibility. The goal of this study was to find out whether pronoun processing is primarily guided by linguistic factors (e.g., grammatical role) or nonlinguistic factors (e.g., first-mention), and whether pronoun interpretation can be described in terms of referents' "prominence" / "accessibility" / "salience." The results showed an overall subject preference for er, whereas der was affected by the object role and focus marking. While focus increases the attentional load and enhances memory representation for the focused referent making the focused referent more available, ultimately it did not affect the final interpretation of er, suggesting that "prominence" or the related concepts do not explain referent selection preferences. Overall, the results suggest a primacy of linguistic factors in determining pronoun resolution.

COVIDisgust: Language processing through the lens of partisanship.

Disgust is an aversive reaction protecting an organism from disease. People differ in how prone they are to experiencing it, and this fluctuates depending on how safe the environment is. Previous research has shown that the recognition and processing of disgusting words depends not on the word's disgust per se but rather on individual sensitivity to disgust. However, the influence of dynamically changing disgust on language comprehension has not yet been researched. In a series of studies, we investigated whether the media's portrayal of COVID-19 will affect subsequent language processing via changes in disgust. The participants were exposed to news headlines either depicting COVID-19 as a threat or downplaying it, and then rated single words for disgust and valence (Experiment 1; N = 83) or made a lexical decision (Experiment 2; N = 86). The headline type affected only word ratings and not lexical decisions, but political ideology and disgust proneness affected both. More liberal participants assigned higher disgust ratings after the headlines discounted the threat of COVID-19, whereas more conservative participants did so after the headlines emphasized it. We explain the results through the politicization and polarization of the pandemic. Further, political ideology was more predictive of reaction times in Experiment 2 than disgust proneness. High conservatism correlated with longer reaction times for disgusting and negative words, and the opposite was true for low conservatism. The results suggest that disgust proneness and political ideology dynamically interact with perceived environmental safety and have a measurable effect on language processing. Importantly, they also suggest that the media's stance on the pandemic and the political framing of the issue may affect the public response by increasing or decreasing our disgust.

The influence of prominence cues in 7- to 10-year-olds' pronoun resolution: Disentangling order of mention, grammatical role, and semantic role.

In two visual world experiments we disentangled the influence of order of mention (first vs. second mention), grammatical role (subject vs object), and semantic role (proto-agent vs proto-patient) on 7- to 10-year-olds' real-time interpretation of German pronouns. Children listened to SVO or OVS sentences containing active accusative verbs (küssen "to kiss") in Experiment 1 (N = 72), or dative object-experiencer verbs (gefallen "to like") in Experiment 2 (N = 64). This was followed by the personal pronoun er or the demonstrative pronoun der. Interpretive preferences for er were most robust when high prominence cues (first mention, subject, proto-agent) were aligned onto the same entity; and the same applied to der for low prominence cues (second mention, object, proto-patient). These preferences were reduced in conditions where cues were misaligned, and there was evidence that each cue independently influenced performance. Crucially, individual variation in age predicted adult-like weighting preferences for semantic cues (Schumacher, Roberts & Järvikivi, ).

I was being sarcastic!: The effect of foreign accent and political ideology on irony (mis)understanding.

Misunderstood ironic intents may injure the conversation and impede connecting with others. Prior research suggests that ironic compliments, a rarer type of irony, are considered less ironic when spoken with a foreign accent. Using more ecologically-valid stimuli with natural prosodic cues, we found that this effect also applied to ironic criticisms, not just to ironic compliments. English native speakers (N = 96) listened to dialogs between Canadian English speakers and their foreign-accented peers, rating targets on multiple scales (irony, certainty in the speaker's intent, appropriateness, and offensiveness). Generalized additive mixed modelling showed that 1) ironic comments were rated lower for irony when foreign-accented, whereas literal comments were unaffected by accent; 2) the listener's political orientation, but not empathy or need for cognitive closure, modulated irony detection accuracy. The results are discussed in terms of linguistic expectations, social distance, cultural stereotypes, and personality differences.

Individual Differences in Political Ideology and Disgust Sensitivity Affect Real-Time Spoken Language Comprehension.

Individuals' moral views have been shown to affect their event-related potentials (ERP) response to spoken statements, and people's political ideology has been shown to guide their sentence completion behavior. Using pupillometry, we asked whether political ideology and disgust sensitivity affect online spoken language comprehension. 60 native speakers of English listened to spoken utterances while their pupil size was tracked. Some of those utterances contained grammatical errors, semantic anomalies, or socio-cultural violations, statements incongruent with existing gender stereotypes and perceived speaker identity, such as "I sometimes buy my bras at Hudson's Bay," spoken by a male speaker. An individual's disgust sensitivity is associated with the Behavioral Immune System, and may be correlated with socio-political attitudes, for example regarding out-group stigmatization. We found that more disgust-sensitive individuals showed greater pupil dilation with semantic anomalies and socio-cultural violations. However, political views differently affected the processing of the two types of violations: whereas more conservative listeners showed a greater pupil response to socio-cultural violations, more progressive listeners engaged more with semantic anomalies, but this effect appeared much later in the pupil record.

The Influence of Focus Marking on Pronoun Resolution in Dialogue Context.

Using visual world eye-tracking, we examined whether adults (N = 58) and children (N = 37; 3;1-6;3) use linguistic focussing devices to help resolve ambiguous pronouns. Participants listened to English dialogues about potential referents of an ambiguous pronoun he. Four conditions provided prosodic focus marking to the grammatical subject or to the object, which were either additionally it-clefted or not. A reference condition focussed neither the subject nor object. Adult online data revealed that linguistic focussing via prosodic marking enhanced subject preference, and overrode it in the case of object focus, regardless of the presence of clefts. Children's processing was also influenced by prosodic marking; however, their performance across conditions showed some differences from adults, as well as a complex interaction with both their memory and language skills. Offline interpretations showed no effects of focus in either group, suggesting that while multiple cues are processed, subjecthood and first mention dominate the final interpretation in cases of conflict.

Listener's personality traits predict changes in pupil size during auditory language comprehension.

Research suggests that listeners' comprehension of spoken language is concurrently affected by linguistic and non-linguistic factors, including individual difference factors. However, there is no systematic research on whether general personality traits affect language processing. We correlated 88 native English-speaking participants' Big-5 traits with their pupillary responses to spoken sentences that included grammatical errors, "He frequently have burgers for dinner"; semantic anomalies, "Dogs sometimes chase teas"; and statements incongruent with gender stereotyped expectations, such as "I sometimes buy my bras at Hudson's Bay", spoken by a male speaker. Generalized additive mixed models showed that the listener's Openness, Extraversion, Agreeableness, and Neuroticism traits modulated resource allocation to the three different types of unexpected stimuli. No personality trait affected changes in pupil size across the board: less open participants showed greater pupil dilation when processing sentences with grammatical errors; and more introverted listeners showed greater pupil dilation in response to both semantic anomalies and socio-cultural clashes. Our study is the first one demonstrating that personality traits systematically modulate listeners' online language processing. Our results suggest that individuals with different personality profiles exhibit different patterns of the allocation of cognitive resources during real-time language comprehension.

(Mis) understanding your native language: Regional accent impedes processing of information status.

Native-speaker listeners constantly predict upcoming units of speech as part of language processing, using various cues. However, this process is impeded in second-language listeners, as well as when the speaker has an unfamiliar accent. Whereas previous research has largely concentrated on the pronunciation of individual segments in foreign-accented speech, we show that regional accent impedes higher levels of language processing, making native listeners' processing resemble that of second-language listeners.In Experiment 1, 42 native speakers of Canadian English followed instructions spoken in British English to move objects on a screen while their eye movements were tracked. Native listeners use prosodic cues to information status to disambiguate between two possible referents, a new and a previously mentioned one, before they have heard the complete word. By contrast, the Canadian participants, similarly to second-language speakers, were not able to make full use of prosodic cues in the way native British listeners do.In Experiment 2, 19 native speakers of Canadian English rated the British English instructions used in Experiment 1, as well as the same instructions spoken by a Canadian imitating the British English prosody. While information status had no effect for the Canadian imitations, the original stimuli received higher ratings when prosodic realization and information status of the referent matched than for mismatches, suggesting a native-like competence in these offline ratings.These findings underline the importance of expanding psycholinguistic models of second language/dialect processing and representation to include both prosody and regional variation.

When processing costs impact predictive processing: The case of foreign-accented speech and accent experience.

Listeners use linguistic information and real-world knowledge to predict upcoming spoken words. However, studies of predictive processing have focused on prediction under optimal listening conditions. We examined the effect of foreign-accented speech on predictive processing. Furthermore, we investigated whether accent-specific experience facilitates predictive processing. Using the visual world paradigm, we demonstrated that although the presence of an accent impedes predictive processing, it does not preclude it. We further showed that as listener experience increases, predictive processing for accented speech increases and begins to approximate the pattern seen for native speech. These results speak to the limitation of the processing resources that must be allocated, leading to a trade-off when listeners are faced with increased uncertainty and more effortful recognition due to a foreign accent.

Whole-word frequency and inflectional paradigm size facilitate Estonian case-inflected noun processing.

Estonian is a morphologically rich Finno-Ugric language with nominal paradigms that have at least 28 different inflected forms but sometimes more than 40. For languages with rich inflection, it has been argued that whole-word frequency, as a diagnostic of whole-word representations, should not be predictive for lexical processing. We report a lexical decision experiment, showing that response latencies decrease both with frequency of the inflected form and its inflectional paradigm size. Inflectional paradigm size was also predictive of semantic categorization, indicating it is a semantic effect, similar to the morphological family size effect. These findings fit well with the evidence for frequency effects of word n-grams in languages with little inflectional morphology, such as English. Apparently, the amount of information on word use in the mental lexicon is substantially larger than was previously thought.

The Interplay of Implicit Causality, Structural Heuristics, and Anaphor Type in Ambiguous Pronoun Resolution.

Two visual-world eye-tracking experiments investigating pronoun resolution in Finnish examined the time course of implicit causality information relative to both grammatical role and order-of-mention information. Experiment 1 showed an effect of implicit causality that appeared at the same time as the first-mention preference. Furthermore, when we counterbalanced the semantic roles of the verbs, we found no effect of grammatical role, suggesting the standard observed subject preference has a large semantic component. Experiment 2 showed that both the personal pronoun hän and the demonstrative tämä preferred the antecedent consistent with the implicit causality bias; tämä was not interpreted as referring to the semantically non-prominent entity. In contrast, structural prominence affected hän and tämä differently: we found a first-mention preference for hän, but a second-mention preference for tämä. The results suggest that semantic implicit causality information has an immediate effect on pronoun resolution and its use is not delayed relative to order-of-mention information. Furthermore, they show that order-of-mention differentially affects different types of anaphoric expressions, but semantic information has the same effect.

Acquiring Complex Focus-Marking: Finnish 4- to 5-Year-Olds Use Prosody and Word Order in Interaction.

Using a language game to elicit short sentences in various information structural conditions, we found that Finnish 4- to 5-year-olds already exhibit a characteristic interaction between prosody and word order in marking information structure. Providing insights into the acquisition of this complex system of interactions, the production data showed interesting parallels to adult speakers of Finnish on the one hand and to children acquiring other languages on the other hand. Analyzing a total of 571 sentences produced by 16 children, we found that children rarely adjusted input word order, but did systematically avoid marked OVS order in contrastive object focus condition. Focus condition also significantly affected four prosodic parameters, f0, duration, pauses and voice quality. Differing slightly from effects displayed in adult Finnish speech, the children produced larger f0 ranges for words in contrastive focus and smaller ones for unfocused words, varied only the duration of object constituents to be longer in focus and shorter in unfocused condition, inserted more pauses before and after focused constituents and systematically modified their use of non-modal voice quality only in utterances with narrow focus. Crucially, these effects were modulated by word order. In contrast to comparable data from children acquiring Germanic languages, the present findings reflect the more central role of word order and of interactions between word order and prosody in marking information structure in Finnish. Thus, the study highlights the role of the target language in determining linguistic development.

Orthographic Activation in L2 Spoken Word Recognition Depends on Proficiency: Evidence from Eye-Tracking.

The use of orthographic and phonological information in spoken word recognition was studied in a visual world task where L1 Finnish learners of L2 French (n = 64) and L1 French native speakers (n = 24) were asked to match spoken word forms with printed words while their eye movements were recorded. In Experiment 1, French target words were contrasted with competitors having a longer ( vs. ) or a shorter word initial phonological overlap ( vs. ) and an identical orthographic overlap. In Experiment 2, target words were contrasted with competitors of either longer ( vs. ) or shorter word initial orthographic overlap ( vs. ) and of an identical phonological overlap. A general phonological effect was observed in the L2 listener group but not in the L1 control group. No general orthographic effects were observed in the L2 or L1 groups, but a significant effect of proficiency was observed for orthographic overlap over time: higher proficiency L2 listeners used also orthographic information in the matching task in a time-window from 400 to 700 ms, whereas no such effect was observed for lower proficiency listeners. These results suggest that the activation of orthographic information in L2 spoken word recognition depends on proficiency in L2.

Phonetic correlates of phonological vowel quantity in Yakut read and spontaneous speech.

The quantity language Yakut (Sakha) has a binary distinction between short and long vowels. Disyllabic words with short and long vowels in one or both syllables were extracted from spontaneous speech of native Yakut speakers. In addition, a controlled production by a native speaker of disyllabic words with different short and long vowel combinations along with contrastive minimal pairs was recorded in a phonetics laboratory. Acoustic measurements of the vowels' fundamental frequency, duration, and intensity showed a significant consistent lengthening of phonologically long vowels compared to their short counterparts. However, in addition to evident durational differences between long and short quantities, fundamental frequency and intensity also showed effects of quantity. These results allow the interpretation that similarly to other non-tonal quantity languages like Finnish or Estonian, the Yakut vowel quantity opposition is not based exclusively on durational differences. The data furthermore revealed differences in F0 contours between spontaneous and read speech, providing some first indications of utterance-level prosody in Yakut.

The perception of prosody and associated auditory cues in early-implanted children: the role of auditory working memory and musical activities.

OBJECTIVE: To study prosodic perception in early-implanted children in relation to auditory discrimination, auditory working memory, and exposure to music. DESIGN: Word and sentence stress perception, discrimination of fundamental frequency (F0), intensity and duration, and forward digit span were measured twice over approximately 16 months. Musical activities were assessed by questionnaire. STUDY SAMPLE: Twenty-one early-implanted and age-matched normal-hearing (NH) children (4-13 years). RESULTS: Children with cochlear implants (CIs) exposed to music performed better than others in stress perception and F0 discrimination. Only this subgroup of implanted children improved with age in word stress perception, intensity discrimination, and improved over time in digit span. Prosodic perception, F0 discrimination and forward digit span in implanted children exposed to music was equivalent to the NH group, but other implanted children performed more poorly. For children with CIs, word stress perception was linked to digit span and intensity discrimination: sentence stress perception was additionally linked to F0 discrimination. CONCLUSIONS: Prosodic perception in children with CIs is linked to auditory working memory and aspects of auditory discrimination. Engagement in music was linked to better performance across a range of measures, suggesting that music is a valuable tool in the rehabilitation of implanted children.

Children and situation models of multiple events.

The present study demonstrates that children experience difficulties reaching the correct situation model of multiple events described in temporal sentences if the sentences encode language-external events in reverse chronological order. Importantly, the timing of the cue of how to organize these events is crucial: When temporal subordinate conjunctions (before/after) or converb constructions that carry information of how to organize the events were given sentence-medially, children experienced severe difficulties in arriving at the correct interpretation of event order. When this information was provided sentence-initially, children were better able to arrive at the correct situation model, even if it required them to decode the linguistic information reversely with respect to the actual language external events. This indicates that children even aged 8-12 still experience difficulties in arriving at the correct interpretation of the event structure, if the cue of how to order the events is not given immediately when they start building the representation of the situation. This suggests that children's difficulties in comprehending sequential temporal events are caused by their inability to revise the representation of the current event structure at the level of the situation model.

Sub- and supralexical information in early phases of lexical access.

The present study investigated sub- and supralexical effects in morphological processing for inflected and pseudo complex words and pseudo words in lexical decision with masked and cross-modal priming. The results showed that the early stage of morphological processing is not only sensitive to whether the orthographic string can be segmented into an existing stem and affix, but also whether the full form is an existing word the meaning of which differs from the meaning of the segmented stem. It is thus likely that from early on morphological processing is probably not governed by morpho-orthographic processes alone, but is most likely sensitive to top-down information, perhaps originating from supralexical semantic connections between the words morphological family members. In addition, whereas semantic interpretability has a clear advantage later in processing, this stage seems to be sensitive to bottom-up form information as well. In a detailed theoretical discussion we show how these findings, along with earlier findings, are explained by a model that assumes that morphological information is represented at two interactive levels, corresponding to sublexical form (orthographic) and supralexical (semantic) information mediated by a lexical level. This allows supralexical (semantic) effects to feed top-down, predicting differences between regular inflected and pseudo complex words at the lexical level, affecting the early phases of processing for these words.

Real-time correlates of phonological quantity reveal unity of tonal and non-tonal languages.

Discrete phonological phenomena form our conscious experience of language: continuous changes in pitch appear as distinct tones to the speakers of tone languages, whereas the speakers of quantity languages experience duration categorically. The categorical nature of our linguistic experience is directly reflected in the traditionally clear-cut linguistic classification of languages into tonal or non-tonal. However, some evidence suggests that duration and pitch are fundamentally interconnected and co-vary in signaling word meaning in non-tonal languages as well. We show that pitch information affects real-time language processing in a (non-tonal) quantity language. The results suggest that there is no unidirectional causal link from a genetically-based perceptual sensitivity towards pitch information to the appearance of a tone language. They further suggest that the contrastive categories tone and quantity may be based on simultaneously co-varying properties of the speech signal and the processing system, even though the conscious experience of the speakers may highlight only one discrete variable at a time.

Phonetic tone signals phonological quantity and word structure.

Many languages exploit suprasegmental devices in signaling word meaning. Tone languages exploit fundamental frequency whereas quantity languages rely on segmental durations to distinguish otherwise similar words. Traditionally, duration and tone have been taken as mutually exclusive. However, some evidence suggests that, in addition to durational cues, phonological quantity is associated with and co-signaled by changes in fundamental frequency in quantity languages such as Finnish, Estonian, and Serbo-Croat. The results from the present experiment show that the structure of disyllabic word stems in Finnish are indeed signaled tonally and that the phonological length of the stressed syllable is further tonally distinguished within the disyllabic sequence. The results further indicate that the observed association of tone and duration in perception is systematically exploited in speech production in Finnish.

Activation and persistence of implicit causality information in spoken language comprehension.

A visual world eye-tracking study investigated the activation and persistence of implicit causality information in spoken language comprehension. We showed that people infer the implicit causality of verbs as soon as they encounter such verbs in discourse, as is predicted by proponents of the immediate focusing account (Greene & McKoon, 1995; Koornneef & Van Berkum, 2006; Van Berkum, Koornneef, Otten, & Nieuwland, 2007). Interestingly, we observed activation of implicit causality information even before people encountered the causal conjunction. However, while implicit causality information was persistent as the discourse unfolded, it did not have a privileged role as a focusing cue immediately at the ambiguous pronoun when people were resolving its antecedent. Instead, our study indicated that implicit causality does not affect all referents to the same extent, rather it interacts with other cues in the discourse, especially when one of the referents is already prominently in focus.