Animacy interactions with individual variability in sentence production and comprehension reveal similar lexically driven competitive processes.

Sentence production and comprehension both draw on linguistic knowledge, but current research is unclear on whether these fundamental language tasks involve similar or distinct competitive processes. Previous studies suggest that production and comprehension may involve similar conflict resolution processes, but that production may additionally recruit motor-related conflict not necessarily present in comprehension. To examine these possibilities, we combined an experimental animacy-driven manipulation eliciting difficulty in separate production and comprehension tasks with an examination of how this manipulation interacted with individual variability in motor-related and lexicosemantic conflict resolution performance beyond vocabulary measures. We reasoned that a different pattern of interactions for production and comprehension would point to distinct processes across these tasks, whereas interactions with the same individual performance task would indicate similar conflict-related processes. We found that beyond a significant role of vocabulary, only a measure of context-dependent lexical ambiguity resolution interacted with the animacy manipulation in the production and the comprehension task. These findings suggest a role for linguistic knowledge and similar lexically driven competitive processes in both sentence production and comprehension. Alongside current computational models, these results raise the possibility that despite different task demands, some production and comprehension competitive processes are not entirely distinct from one another nor separable from lexical knowledge. Implications for current views on the relationship between sentence production and comprehension are discussed. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Animacy-induced conflict in sentence production and comprehension from late childhood to adolescence.

Some animacy configurations elicit parallel semantic interference in adult production and comprehension; for example, phrases with similar animate nouns like the man that the girl is hugging are more difficult than phrases like the doll that the girl is hugging. Yet little is known about how this interference manifests in development, particularly, beyond early childhood. Because frontal brain maturation and cognitive control improvements are known to occur across late childhood and adolescence, we investigated (a) how animacy-induced difficulty in production and comprehension vary with age throughout this period and (b) whether control processes reflected in the backward digit span (BDS) test uniquely explained these differences besides other language measures. In separate tasks, participants (8- to 15-year-old children; N = 91) heard auditory descriptions of depicted characters, produced characters' descriptions, and completed BDS, vocabulary, and reading experience tests. Results indicated that, as in adults, animacy modulated performance in production and comprehension across all ages. The animacy modulation interacted with age in production but not in comprehension, suggesting age-related animacy differences in production but relatively stable differences in comprehension despite processing speed improvements. Importantly, these age-related production differences were also modulated by the BDS scores; only participants with higher BDS scores displayed age-related animacy differences. Together, these results indicate that comprehension and production develop at different rates and that the development of BDS performance interacts with age-dependent changes in sentence planning from late childhood to adolescence. More generally, the study highlights tasks' disparities to be explained by cognitive and developmental models of language.

How language and event recall can shape memory for time.

How do we represent the duration of past events that we have conceptualized through language? Prior research suggests that memory for duration depends on the segmental structure perceived at encoding. However, it remains unclear why duration memory displays characteristic distortions and whether language-mediated encoding can further distort duration memory. Here we examine these questions and specifically ask whether the amount of event information recalled relative to the stimulus duration explains temporal distortions. In several studies, participants first studied animated stimuli described by phrases implying either fast or slow motion (e.g., a mule vs car going up a road). They then mentally reproduced the stimuli from memory (as if replaying them in their minds) and verbally recalled them. We manipulated the amount of stimulus study and the type of recall cue (visual vs linguistic) to assess the role of language and information recalled on the length of mental reproductions. Results indicated that the density of the information recalled (number of details recalled per second) explained temporal distortions: higher density events were lengthened and lower density events were shortened. Moreover, language additionally lengthened or shortened duration reproductions when phrases cued the task, suggesting that episodic details and verbal conceptual features were combined during recollection rather than encoding. These results suggest that the density of the details recalled and language-mediated recollection shape memory for event duration. We argue that temporal memory distortions stem from event encoding and retrieval mechanisms. Implications of these findings for theories of time, memory and language are discussed.

Anterior paracingulate and cingulate cortex mediates the effects of cognitive load on speech sound discrimination.

Perceiving speech while performing another task is a common challenge in everyday life. How the brain controls resource allocation during speech perception remains poorly understood. Using functional magnetic resonance imaging (fMRI), we investigated the effect of cognitive load on speech perception by examining brain responses of participants performing a phoneme discrimination task and a visual working memory task simultaneously. The visual task involved holding either a single meaningless image in working memory (low cognitive load) or four different images (high cognitive load). Performing the speech task under high load, compared to low load, resulted in decreased activity in pSTG/pMTG and increased activity in visual occipital cortex and two regions known to contribute to visual attention regulation-the superior parietal lobule (SPL) and the paracingulate and anterior cingulate gyrus (PaCG, ACG). Critically, activity in PaCG/ACG was correlated with performance in the visual task and with activity in pSTG/pMTG: Increased activity in PaCG/ACG was observed for individuals with poorer visual performance and with decreased activity in pSTG/pMTG. Moreover, activity in a pSTG/pMTG seed region showed psychophysiological interactions with areas of the PaCG/ACG, with stronger interaction in the high-load than the low-load condition. These findings show that the acoustic analysis of speech is affected by the demands of a concurrent visual task and that the PaCG/ACG plays a role in allocating cognitive resources to concurrent auditory and visual information.

Context-dependent lexical ambiguity resolution: MEG evidence for the time-course of activity in left inferior frontal gyrus and posterior middle temporal gyrus.

An MEG study investigated the role of context in semantic interpretation by examining the comprehension of ambiguous words in contexts leading to different interpretations. We compared high-ambiguity words in minimally different contexts (to bowl, the bowl) to low-ambiguity counterparts (the tray, to flog). Whole brain beamforming revealed the engagement of left inferior frontal gyrus (LIFG) and posterior middle temporal gyrus (LPMTG). Points of interest analyses showed that both these sites showed a stronger response to verb-contexts by 200 ms post-stimulus and displayed overlapping ambiguity effects that were sustained from 300 ms onwards. The effect of context was stronger for high-ambiguity words than for low-ambiguity words at several different time points, including within the first 100 ms post-stimulus. Unlike LIFG, LPMTG also showed stronger responses to verb than noun contexts in low-ambiguity trials. We argue that different functional roles previously attributed to LIFG and LPMTG are in fact played out at different periods during processing.

Effects of learned episodic event structure on prospective duration judgments.

The field of psychology of time has typically distinguished between prospective timing and retrospective duration estimation: in prospective timing, participants attend to and encode time, whereas in retrospective estimation, estimates are based on the memory of what happened. Prior research on prospective timing has primarily focused on attentional mechanisms to explain timing behavior, but it remains unclear the extent to which memory processes may also play a role. The present studies investigate this issue, and specifically, the role of newly learned encoded event structure. Two structural properties of dynamic event sequences were examined, which are known to modulate retrospective duration estimates: the perceived number of segments and the similarity between them. We found that when duration and episodic event content are both attended to and encoded, more segments and less similarity between them led to longer attributed durations, despite clock duration remaining constant. In contrast, when only duration is attended to, only the number of segments influenced estimated durations. These findings indicate that incidentally or intentionally encoded episodic event structure modulates prospective duration judgments. Based on these and previous findings, implications for the role of memory mechanisms on prospective paradigms are discussed. (PsycINFO Database Record

In search of lost time: Reconstructing the unfolding of events from memory.

When remembering an event, not only do we recollect what happened, when and where it happened, but also how it unfolded over time. What aspects of events are encoded in memory to support this recollection? This question is central for understanding the nature of event memories and our reconstruction of the time passed. In this article, we investigate how the spontaneous encoding of unfamiliar animations during learning influences the recollection of how these animations unfold. Specifically, we examine two structural properties of dynamic event sequences known to modulate the amount of information encoded in memory: the perceived number of sub-events and their perceived similarity. We found that despite clock duration remaining constant, more sub-events and less similar ones led to longer recognition memory latencies, duration judgments and mental event replaying. In particular, across stimulus animations, both the perceived number of sub-events and their degree of similarity contributed to the prediction of duration judgments and the length of mental event reproductions. Results indicate that the number and nature of sub-events in a sequence modulate how we reconstruct its duration and temporal unfolding, thus suggesting that these event properties, which mediate the amount of information encoded for an event, modulate the subsequent recollection of its temporal unfolding.

Representing time in language and memory: the role of similarity structure.

Every day we read about or watch events in the world and can easily understand or remember how long they last. What aspects of an event are retained in memory? And how do we extract temporal information from our memory representations? These issues are central to human cognition, as they underlie a fundamental aspect of our mental life, namely our representation of time. This paper reviews previous language studies and reports a visual learning study indicating that properties of the events encoded in memory shape the representation of their duration. The evidence indicates that for a given event, the extent to which its associated properties or sub-components differ from one another modulates our representation of its duration. These properties include the similarity between sub-events and the similarity between the situational contexts in which an event occurs. We suggest that the diversity of representations that we associate with events in memory plays an important role in remembering and estimating the duration of experienced or described events.

Hand specific representations in language comprehension.

Theories of embodied cognition argue that language comprehension involves sensory-motor re-enactments of the actions described. However, the degree of specificity of these re-enactments as well as the relationship between action and language remains a matter of debate. Here we investigate these issues by examining how hand-specific information (left or right hand) is recruited in language comprehension and action execution. An fMRI study tested self-reported right-handed participants in two separate tasks that were designed to be as similar as possible to increase sensitivity of the comparison across task: an action execution go/no-go task where participants performed right or left hand actions, and a language task where participants read sentences describing the same left or right handed actions as in the execution task. We found that language-induced activity did not match the hand-specific patterns of activity found for action execution in primary somatosensory and motor cortex, but it overlapped with pre-motor and parietal regions associated with action planning. Within these pre-motor regions, both right hand actions and sentences elicited stronger activity than left hand actions and sentences-a dominant hand effect. Importantly, both dorsal and ventral sections of the left pre-central gyrus were recruited by both tasks, suggesting different action features being recruited. These results suggest that (a) language comprehension elicits motor representations that are hand-specific and akin to multimodal action plans, rather than full action re-enactments; and (b) language comprehension and action execution share schematic hand-specific representations that are richer for the dominant hand, and thus linked to previous motor experience.

Competitive mechanisms in sentence processing: common and distinct production and reading comprehension networks linked to the prefrontal cortex.

Despite much interest in language production and comprehension mechanisms, little is known about the relationship between the two. Previous research suggests that linguistic knowledge is shared across these tasks and that the left inferior frontal gyrus (LIFG) may be commonly recruited. However, it remains unclear the extent to which production and comprehension share competition mechanisms. Here we investigate this issue and specifically examine competition in determining the event roles in a sentence (agent or affected participant). We used both behavioral and fMRI methods and compared the reading and production of high- and low-competition sentences, specifically targeting LIFG. We found that activity in pars opercularis (PO), independently identified by a competition-driven localizer, was modulated by competition in both tasks. Psychophysiological interaction analyses seeded in PO revealed task-specific networks: In comprehension, PO only interacted with the posterior temporal lobe, whereas in production, it interacted with a large network including hippocampal, posterior temporal, medial frontal and subcortical structures. Production and comprehension therefore recruit partially distinct functional networks but share competitive processes within fronto-temporal regions. We argue that these common regions store long-term linguistic associations and compute their higher-order contingencies, but competition in production ignites a larger neural network implementing planning, as required by task demands.

Motion and actions in language: semantic representations in occipito-temporal cortex.

Understanding verbs typically activates posterior temporal regions and, in some circumstances, motion perception area V5. However, the nature and role of this activation remains unclear: does language alone indeed activate V5? And are posterior temporal representations modality-specific motion representations, or supra-modal motion-independent event representations? Here, we address these issues by investigating human and object motion sentences compared to corresponding state descriptions. We adopted the blank screen paradigm, which is known to encourage visual imagery, and used a localizer to identify V5 and temporal structures responding to motion. Analyses in each individual brain suggested that language modulated activity in the posterior temporal lobe but not within V5 in most participants. Moreover, posterior temporal structures strongly responded to both motion sentences and human static sentences. These results suggest that descriptive language alone need not recruit V5 and instead engages more schematic event representations in temporal cortex encoding animacy and motion.

Counterfactuals in action: an fMRI study of counterfactual sentences describing physical effort.

Counterfactual statements such as if Mary had cleaned the room, she would have moved the sofa convey both actual and hypothetical actions, namely, that Mary did not clean the room or move the sofa, but she would have done so in some possible past situation. Such statements are ubiquitous in daily life and are involved in critical cognitive activities like decision-making and evaluation of alternative outcomes. Here, we investigate the brain mechanisms and the nature of the semantic representations involved in understanding the complex meaning of counterfactual statements. We used fMRI to examine brain responses to counterfactual statements describing actions of high and low physical effort and compared them to similar factual statements describing the same actions. Results indicated that the inferior parietal lobule, known to support planning of object-directed actions, responded more strongly to high-effort than low-effort statements. Moreover, counterfactual statements, compared to factual ones, recruited a distinctive neural network partially overlapping with action execution networks. This network included medial pre-motor and pre-frontal structures, which underpin selection and inhibition of alternative action representations, and parahippocampal and temporal regions, involved in retrieving episodic memories. We argue that counterfactual comprehension recruit action-related networks encoding and managing alternative representations of behaviors.

Animacy and competition in relative clause production: a cross-linguistic investigation.

This work investigates production preferences in different languages. Specifically, it examines how animacy, competition processes, and language-specific constraints shape speakers' choices of structure. English, Spanish and Serbian speakers were presented with depicted events in which either an animate or inanimate entity was acted upon by an agent. Questions about the affected participant in these events prompted the production of relative clauses identifying these entities (e.g., the bag the woman is punching). Results indicated that in English, animacy plays a strong role in determining the choice of passive structures. In contrast, it plays a less prominent role in Spanish and Serbian structure choices, where more active structures were produced to varying degrees. Critically, the semantic similarity between the agent and the patient of the event correlated with the omission of the agent in all languages, indicating that competition resulted in the agent's inhibition. Similarity also correlated with different functional choices in Spanish. The results suggest that similarity-based competition may influence various stages of production planning but its manifestations are constrained by language-specific grammatical options. Implications for models of sentence production and the relationship between production and comprehension are discussed.

Neural correlates of abstract verb processing.

The present study investigated the neural correlates of the processing of abstract (low imageability) verbs. An extensive body of literature has investigated concrete versus abstract nouns but little is known about how abstract verbs are processed. Spanish abstract verbs including emotion verbs (e.g., amar, "to love"; molestar, "to annoy") were compared to concrete verbs (e.g., llevar, "to carry"; arrastrar, "to drag"). Results indicated that abstract verbs elicited stronger activity in regions previously associated with semantic retrieval such as inferior frontal, anterior temporal, and posterior temporal regions, and that concrete and abstract activation networks (compared to that of pseudoverbs) were partially distinct, with concrete verbs eliciting more posterior activity in these regions. In contrast to previous studies investigating nouns, verbs strongly engage both left and right inferior frontal gyri, suggesting, as previously found, that right prefrontal cortex aids difficult semantic retrieval. Together with previous evidence demonstrating nonverbal conceptual roles for the active regions as well as experiential content for abstract word meanings, our results suggest that abstract verbs impose greater demands on semantic retrieval or property integration, and are less consistent with the view that abstract words recruit left-lateralized regions because they activate verbal codes or context, as claimed by proponents of the dual-code theory. Moreover, our results are consistent with distributed accounts of semantic memory because distributed networks may coexist with varying retrieval demands.

Time in language: event duration in language comprehension.

This work investigates how we process and represent event duration in on-line language comprehension. Specifically, it examines how events of different duration are processed and what type of knowledge underlies their representations. Studies 1-4 examined verbs and phrases in different contexts. They showed that durative events took longer to process than non-durative events and that the duration attributed to the stimulus events correlated with on-line processing times. Studies 5 and 6 indicated that durative events occur in semantically more diverse contexts and elicit semantically more diverse associations than non-durative events. Semantic and contextual diversity also correlated with attributed durations and processing times. Results indicate that (a) event-specific durations are computed on-line from multiple unfolding cues, (b) processing cost and duration representations emerge from semantic and contextual diversity reflecting our experience, and (c) key components of duration representations may be situation-specific knowledge of causal and contingency relations between events.

Effects of implied physical effort in sensory-motor and pre-frontal cortex during language comprehension.

Embodied theories of conceptual knowledge suggest that sensory-motor representations of actions similar to those involved in the performance of the action described are recruited during language comprehension. The extent of this recruitment, however, and the brain mechanisms supporting this process remain unknown. Using fMRI, we investigated these issues by examining how people understand sentences that convey three different degrees of physical effort and by comparing this process to action execution. To understand the effort implied by the stimulus sentences, object and action properties associated with nouns and verbs respectively needed to be integrated: pushing the piano implies more physical effort than pushing the chair. Results indicated that a pre-motor region, which was also active in action execution, was sensitive to the degree of effort implied by the language. Interestingly, the anterior inferior frontal gyrus, a region typically associated with semantic processing, was not active in action execution but was nevertheless modulated by the effort implied. Inter-region correlations also suggested that this region was strongly correlated with pre-motor and posterior temporal regions. Overall, results suggest that (a) language understanding elicits action representations retaining a degree of specificity that was previously unsuspected, including unique properties of interactions with objects, and (b) these representations, which result from integrating the words' semantic information, may be computed within a collaborative neural network that includes the anterior inferior frontal gyrus.

Linking production and comprehension processes: the case of relative clauses.

Six studies investigated the relationship between production and comprehension by examining how relative clause production mechanisms influence the probabilistic information used by comprehenders to understand these structures. Two production experiments show that accessibility-based mechanisms that are influenced by noun animacy and verb type shape relative clause production. Two corpus studies confirm these production mechanisms in naturally occurring productions. Two comprehension studies found that nouns and verb types occurring in structures that speakers do not produce are difficult to comprehend. Specifically, the probability of producing a passive structure for a verb type in a given animacy configuration, as measured in the production and corpus studies, predicts comprehension difficulty in active structures. Results suggest that the way in which the verb roles are typically mapped onto syntactic arguments in production plays a role in comprehension. Implications for the relationship between production, comprehension and language learning are discussed.

Semantic indeterminacy in object relative clauses.

This article examined whether semantic indeterminacy plays a role in comprehension of complex structures such as object relative clauses. Study 1 used a gated sentence completion task to assess which alternative interpretations are dominant as the relative clause unfolds; Study 2 compared reading times in object relative clauses containing different animacy configurations to unambiguous passive controls; and Study 3 related completion data and reading data. The results showed that comprehension difficulty was modulated by animacy configuration and voice (active vs. passive). These differences were well correlated with the availability of alternative interpretations as the relative clause unfolds, as revealed by the completion data. In contrast to approaches arguing that comprehension difficulty stems from syntactic complexity, these results suggest that semantic indeterminacy is a major source of comprehension difficulty in object relative clauses. Results are consistent with constraint-based approaches to ambiguity resolution and bring new insights into previously identified sources of difficulty.

Context-dependent interpretation of words: evidence for interactive neural processes.

The meaning of a word usually depends on the context in which it occurs. This study investigated the neural mechanisms involved in computing word meanings that change as a function of syntactic context. Current semantic processing theories suggest that word meanings are retrieved from diverse cortical regions storing sensory-motor and other types of semantic information and are further integrated with context in left inferior frontal gyrus (LIFG). Our fMRI data indicate that brain activity in an area sensitive to motion and action semantics--the posterior middle temporal gyrus (PMTG)--is modulated by a word's syntactic context. Ambiguous words such as bowl were presented in minimal disambiguating contexts indicating object (the bowl) or action (to bowl) meanings and were compared to low-ambiguity controls. Ambiguous words elicited more activity than low-ambiguity controls in LIFG and various meaning-related areas such as PMTG. Critically, ambiguous words also elicited more activity in to--contexts than the--contexts in PMTG and LIFG, suggesting that contextual integration strengthened the action meaning in both areas. The pattern of results suggests that the activation of lexical information in PMTG was sensitive to contextual disambiguating information and that processing context-dependent meanings may involve interactions between frontal and posterior areas.