Spontaneous Generation of Unconventional Language and Its Link with Grammatical Performance in Chinese Adults With and Without ASD.

This study investigated the generation of unconventional language in the spontaneous speech of Chinese adults with autism spectrum disorder (ASD), and how it was related to their grammatical performance, when compared to neurotypical (NT) controls. Twenty Cantonese-speaking adults with ASD and 20 NT controls completed three interview tasks in the Autism Diagnostic Observation Schedule, Second Edition (ADOS-2), and their spontaneous speech was recorded and transcribed. Utterances containing unconventional language (neologisms, idiosyncratic phrases, and pedantic language), morphosyntactic errors, mean length of utterance (MLU), and mazes were computed. The ASD group produced more neologisms, idiosyncratic phrases, and pedantic language than the NT group and their grammatical difficulties were shown in shorter MLU but not morphosyntactic errors. Mazes were more frequent in the ASD than the NT group. While the use of unconventional language increased with MLU in the NT group, it correlated positively with mazes in the ASD group. Generation of unconventional language, particularly pedantic language, in Cantonese-speaking NT adults is linked to more advanced grammar, while it appears to be a common speech characteristic among autistic speakers regardless of individual grammatical performance.

A low-activity cortical network selectively encodes syntax.

Syntax, the abstract structure of language, is a hallmark of human cognition. Despite its importance, its neural underpinnings remain obscured by inherent limitations of non-invasive brain measures and a near total focus on comprehension paradigms. Here, we address these limitations with high-resolution neurosurgical recordings (electrocorticography) and a controlled sentence production experiment. We uncover three syntactic networks that are broadly distributed across traditional language regions, but with focal concentrations in middle and inferior frontal gyri. In contrast to previous findings from comprehension studies, these networks process syntax mostly to the exclusion of words and meaning, supporting a cognitive architecture with a distinct syntactic system. Most strikingly, our data reveal an unexpected property of syntax: it is encoded independent of neural activity levels. We propose that this "low-activity coding" scheme represents a novel mechanism for encoding information, reserved for higher-order cognition more broadly.

The role of input vs. output phonological working memory in narrative production: Evidence from case series and case study approaches.

Separable input and output phonological working memory (WM) capacities have been proposed, with the input capacity supporting speech recognition and the output capacity supporting production. We examined the role of input vs. output phonological WM in narrative production, examining speech rate and pronoun ratio - two measures with prior evidence of a relation to phonological WM. For speech rate, a case series approach with individuals with aphasia found no significant independent contribution of input or output phonological WM capacity after controlling for single-word production. For pronoun ratio, there was some suggestion of a role for input phonological WM. Thus, neither finding supported a specific role for an output phonological buffer in speech production. In contrast, two cases demonstrating dissociations between input and output phonological WM capacities provided suggestive evidence of predicted differences in narrative production, though follow-up research is needed. Implications for case series vs. case study approaches are discussed.

Atypical lateralization of visuospatial attention can be associated with better or worse performance on line bisection.

The causal and statistical hypotheses diverge in determining whether the lateralization of language function in one cerebral hemisphere entails the lateralization of visuospatial function in the opposite hemisphere. Additionally, it remains unclear if the atypical segregation of these functions could influence cognitive performance. This study addresses these questions by examining the hemispheric lateralization of visuospatial attention during a line bisection judgement (landmark) task in three groups of healthy non-right-handed individuals with different language production segregations: left (typical), ambilateral (atypical), and right (atypical). Consistent with the causal hypothesis, results indicate that the groups with left and right language lateralization primarily utilize the opposite hemisphere for visuospatial attention. The ambilateral group, however, displays a pattern compatible with an independent segregation, supporting the statistical hypothesis. Behavioral analyses reveal that atypical lateralization of visuospatial attention (non-right) can lead to either better or worse performance during the landmark task, depending on the specific pattern. Bilateral organization is associated with reduced overall accuracy, whereas the left segregation results in improved performance during the most challenging trials. These findings suggest the existence of diverse pathways to lateralization, akin to either the causal or statistical hypothesis, which can result in cognitive advantages or disadvantages.

Four dimensions of naturalistic language production in aphasia after stroke.

There is a rich tradition of research on the neuroanatomical correlates of spoken language production in aphasia using constrained tasks (e.g., picture naming), which offer controlled insights into the distinct processes that govern speech and language (i.e., lexical-semantic access, morphosyntactic construction, phonological encoding, speech motor programming/execution). Yet these tasks do not necessarily reflect everyday language use. In contrast, naturalistic language production (also referred to as connected speech or discourse) more closely approximates typical processing demands, requiring the dynamic integration of all aspects of speech and language. The brain bases of naturalistic language production remain relatively unknown, however, in part because of the difficulty in deriving features that are salient, quantifiable, and interpretable relative to both speech-language processes and the extant literature. The present cross-sectional observational study seeks to address these challenges by leveraging a validated and comprehensive auditory-perceptual measurement system that yields four explanatory dimensions of performance-Paraphasia (misselection of words and sounds), Logopenia (paucity of words), Agrammatism (grammatical omissions), and Motor speech (impaired speech motor programming/execution). We used this system to characterize naturalistic language production in a large and representative sample of individuals with acute post-stroke aphasia (n = 118). Scores on each of the four dimensions were correlated with lesion metrics, and multivariate associations among the dimensions and brain regions were then explored. Our findings revealed distinct yet overlapping neuroanatomical correlates throughout the left-hemisphere language network. Paraphasia and Logopenia were associated primarily with posterior regions, spanning both dorsal and ventral streams, which are critical for lexical-semantic access and phonological encoding. In contrast, Agrammatism and Motor speech were associated primarily with anterior regions of the dorsal stream that are involved in morphosyntactic construction and speech motor planning/execution respectively. Collectively, we view these results as constituting a brain-behavior model of naturalistic language production in aphasia, aligning with both historical and contemporary accounts of the neurobiology of spoken language production.

Predictive language processing: integrating comprehension and production, and what atypical populations can tell us.

Predictive processing, a crucial aspect of human cognition, is also relevant for language comprehension. In everyday situations, we exploit various sources of information to anticipate and therefore facilitate processing of upcoming linguistic input. In the literature, there are a variety of models that aim at accounting for such ability. One group of models propose a strict relationship between prediction and language production mechanisms. In this review, we first introduce very briefly the concept of predictive processing during language comprehension. Secondly, we focus on models that attribute a prominent role to language production and sensorimotor processing in language prediction ("prediction-by-production" models). Contextually, we provide a summary of studies that investigated the role of speech production and auditory perception on language comprehension/prediction tasks in healthy, typical participants. Then, we provide an overview of the limited existing literature on specific atypical/clinical populations that may represent suitable testing ground for such models-i.e., populations with impaired speech production and auditory perception mechanisms. Ultimately, we suggest a more widely and in-depth testing of prediction-by-production accounts, and the involvement of atypical populations both for model testing and as targets for possible novel speech/language treatment approaches.

Perceptual Clauses as Units of Production in Visual Descriptions.

Describing our visual environments is challenging because although an enormous amount of information is simultaneously available to the visual system, the language channel must impose a linear order on that information. Moreover, the production system is at least moderately incremental, meaning that it interleaves planning and speaking processes. Here, we address how the operations of these two cognitive systems are coordinated given their different characteristics. We propose the concept of a perceptual clause, defined as an interface representation that allows the visual and linguistic systems to exchange information. The perceptual clause serves as the input to the language formulator, which translates the representation into a linguistic sequence. Perceptual clauses capture speakers' ability to describe visual scenes coherently while at the same time taking advantage of the incremental abilities of the language production system.

Developmental cascades of vocal turn-taking connect prelinguistic vocalizing with early language.

Conversational turn-taking is ubiquitously found in caregiver-infant interactions, and robustly predictive of infant communicative development. Over the first year, infants take quick adult-like vocal turns with caregivers. Many studies have documented the consistency of caregiver responsiveness and its influence on infant rapid language growth. However, few have examined how caregiver responsiveness facilitates extended vocal turn-taking in real-time with infants over the first year. The influence of prelinguistic vocal turn-taking on the emergence of language has also been under-investigated. We analyzed free-play sessions of 30 caregivers and their infants at both 5 and 10 months, and obtained infant language outcomes at 18 months. We examined the developmental consistency (group-level continuity and dyad-order stability) and change of infant volubility, caregiver responses to babbling in vocal, non-vocal and multimodal modalities, and the influence of modality on caregiver-infant vocal turn-taking. Caregiver contingent responsiveness to infant babbling at 5 months predicted vocal turn-taking at 10 months. Developmental increases in prelinguistic vocalizing and vocal turn-taking from 5 to 10 months predicted infant language outcomes at 18 months. At both 5 and 10 months, caregiver vocal responses were more effective in extending turn-taking than non-vocal or multimodal responses. In summary, prelinguistic vocal turn-taking, facilitated by caregiver vocal responsiveness, is positively related to the emergence of early language.

Predictability and Variation in Language Are Differentially Affected by Learning and Production.

General principles of human cognition can help to explain why languages are more likely to have certain characteristics than others: structures that are difficult to process or produce will tend to be lost over time. One aspect of cognition that is implicated in language use is working memory-the component of short-term memory used for temporary storage and manipulation of information. In this study, we consider the relationship between working memory and regularization of linguistic variation. Regularization is a well-documented process whereby languages become less variable (on some dimension) over time. This process has been argued to be driven by the behavior of individual language users, but the specific mechanism is not agreed upon. Here, we use an artificial language learning experiment to investigate whether limitations in working memory during either language learning or language production drive regularization behavior. We find that taxing working memory during production results in the loss of all types of variation, but the process by which random variation becomes more predictable is better explained by learning biases. A computational model offers a potential explanation for the production effect using a simple self-priming mechanism.

Multilingualism at the Market: A Pre-registered Immersive Virtual Reality Study of Bilingual Language Switching.

Bilinguals, by definition, are capable of expressing themselves in more than one language. But which cognitive mechanisms allow them to switch from one language to another? Previous experimental research using the cued language-switching paradigm supports theoretical models that assume that both transient, reactive and sustained, proactive inhibitory mechanisms underlie bilinguals' capacity to flexibly and efficiently control which language they use. Here we used immersive virtual reality to test the extent to which these inhibitory mechanisms may be active when unbalanced Dutch-English bilinguals i) produce full sentences rather than individual words, ii) to a life-size addressee rather than only into a microphone, iii) using a message that is relevant to that addressee rather than communicatively irrelevant, iv) in a rich visual environment rather than in front of a computer screen. We observed a reversed language dominance paired with switch costs for the L2 but not for the L1 when participants were stand owners in a virtual marketplace and informed their monolingual customers in full sentences about the price of their fruits and vegetables. These findings strongly suggest that the subtle balance between the application of reactive and proactive inhibitory mechanisms that support bilingual language control may be different in the everyday life of a bilingual compared to in the (traditional) psycholinguistic laboratory.

Impact of theta transcranial alternating current stimulation on language production in adult classic galactosemia patients.

Patients with classic galactosemia (CG), an inborn error of galactose metabolism, suffer from impairments in cognition, including language processing. Potential causes are atypical brain oscillations. Recent electroencephalogram (EEG) showed differences in the P300 event-related-potential (ERP) and alterations in the alpha/theta-range during speech planning. This study investigated whether transcranial alternating current stimulation (tACS) at theta-frequency compared to sham can cause a normalization of the ERP post stimulation and improves language performance. Eleven CG patients and fourteen healthy controls participated in two tACS-sessions (theta 6.5 Hz/sham). They were engaged in an active language task, describing animated scenes at three moments, that is, pre/during/post stimulation. Pre and post stimulation, behavior (naming accuracy, voice-onset-times; VOT) and mean-amplitudes of ERP were compared, by means of a P300 time-window analysis and cluster-based-permutation testing during speech planning. The results showed that theta stimulation, not sham, significantly reduced naming error-percentage in patients, not in controls. Theta did not systematically speed up naming beyond a general learning effect, which was larger for the patients. The EEG analysis revealed a significant pre-post stimulation effect (P300/late positivity), in patients and during theta stimulation only. In conclusion, theta-tACS improved accuracy in language performance in CG patients compared to controls and altered the P300 and late positive ERP-amplitude, suggesting a lasting effect on neural oscillation and behavior.

First Language Lexical Attrition in a First Language Setting: A Multi-Measure Approach Testing Teachers of English.

Research on first language (L1) attrition typically focuses on immigrant populations in their second language (L2) environment, yet we know comparably little about L1 attrition in the L1 setting. This study used two lexical tasks to test L1 attrition, a time-sensitive word decision task and a video retelling. Chinese teachers of English vs. Chinese teachers of other subjects (N = 25/group) were recruited at a secondary school in China. The aim was to provide an exploratory basis of the L2 influence on L1 lexical attrition in the L1 environment, both on the level of lexical comprehension and production. Mixed-effects models were used to analyse multiple measures including response accuracy and reaction times in comprehension, and lexical diversity, density, sophistication, and accuracy in production. The results showed Chinese teachers' L1 lexical attrition in the form of longer response times to high-frequency Chinese words compared to non-English Chinese teachers, and the use of significantly fewer sophisticated words in their retellings. Also, teachers of English were faster and more accurate in decisions about Chinese borrowings from English, suggesting L2-driven influence on their mental lexicon. Considering participants' background information, analyses showed that increased L2 exposure and frequency of use can predict L1 lexical attrition.

Timed picture naming norms for 800 photographs of 200 objects in English.

The present study presents picture-naming norms for a large set of 800 high-quality photographs of 200 natural objects and artefacts spanning a range of categories, with four unique images per object. Participants were asked to provide a single, most appropriate name for each image seen. We report recognition latencies for each image, and several normed variables for the provided names: agreement, H-statistic (i.e. level of naming uncertainty), Zipf word frequency and word length. Rather than simply focusing on a single name per image (i.e. the modal or most common name), analysis of recognition latencies showed that it is important to consider the diversity of labels that participants may ascribe to each pictured object. The norms therefore provide a list of candidate labels per image with weighted measures of word length and frequency per image that incorporate all provided names, as well as modal measures based on the most common name only.

Using a translanguaging framework to examine language production in a trilingual person with aphasia.

When language abilities in aphasia are assessed in clinical and research settings, the standard practice is to examine each language of a multilingual person separately. But many multilingual individuals, with and without aphasia, mix their languages regularly when they communicate with other speakers who share their languages. We applied a novel approach to scoring language production of a multilingual person with aphasia. Our aim was to discover whether the assessment outcome would differ meaningfully when we count accurate responses in only the target language of the assessment session versus when we apply a translanguaging framework, that is, count all accurate responses, regardless of the language in which they were produced. The participant is a Farsi-German-English speaking woman with chronic moderate aphasia. We examined the participant's performance on two picture-naming tasks, an answering wh-question task, and an elicited narrative task. The results demonstrated that scores in English, the participant's third-learned and least-impaired language did not differ between the two scoring methods. Performance in German, the participant's moderately impaired second language benefited from translanguaging-based scoring across the board. In Farsi, her weakest language post-CVA, the participant's scores were higher under the translanguaging-based scoring approach in some but not all of the tasks. Our findings suggest that whether a translanguaging-based scoring makes a difference in the results obtained depends on relative language abilities and on pragmatic constraints, with additional influence of the linguistic distances between the languages in question.

Synthetic Corpus Generation for Deep Learning-Based Translation of Spanish Sign Language.

Sign language serves as the primary mode of communication for the deaf community. With technological advancements, it is crucial to develop systems capable of enhancing communication between deaf and hearing individuals. This paper reviews recent state-of-the-art methods in sign language recognition, translation, and production. Additionally, we introduce a rule-based system, called ruLSE, for generating synthetic datasets in Spanish Sign Language. To check the usefulness of these datasets, we conduct experiments with two state-of-the-art models based on Transformers, MarianMT and Transformer-STMC. In general, we observe that the former achieves better results (+3.7 points in the BLEU-4 metric) although the latter is up to four times faster. Furthermore, the use of pre-trained word embeddings in Spanish enhances results. The rule-based system demonstrates superior performance and efficiency compared to Transformer models in Sign Language Production tasks. Lastly, we contribute to the state of the art by releasing the generated synthetic dataset in Spanish named synLSE.

The Emotional Content of Children's Writing: A Data-Driven Approach.

Emotion is closely associated with language, but we know very little about how children express emotion in their own writing. We used a large-scale, cross-sectional, and data-driven approach to investigate emotional expression via writing in children of different ages, and whether it varies for boys and girls. We first used a lexicon-based bag-of-words approach to identify emotional content in a large corpus of stories (N>100,000) written by 7- to 13-year-old children. Generalized Additive Models were then used to model changes in sentiment across age and gender. Two other machine learning approaches (BERT and TextBlob) validated and extended these analyses, converging on the finding that positive sentiments in children's writing decrease with age. These findings echo reports from previous studies showing a decrease in mood and an increased use of negative emotion words with age. We also found that stories by girls contained more positive sentiments than stories by boys. Our study shows the utility of large-scale data-driven approaches to reveal the content and nature of children's writing. Future experimental work should build on these observations to understand the likely complex relationships between written language and emotion, and how these change over development.

Diverging neural dynamics for syntactic structure building in naturalistic speaking and listening.

The neural correlates of sentence production are typically studied using task paradigms that differ considerably from the experience of speaking outside of an experimental setting. In this fMRI study, we aimed to gain a better understanding of syntactic processing in spontaneous production versus naturalistic comprehension in three regions of interest (BA44, BA45, and left posterior middle temporal gyrus). A group of participants (n = 16) was asked to speak about the events of an episode of a TV series in the scanner. Another group of participants (n = 36) listened to the spoken recall of a participant from the first group. To model syntactic processing, we extracted word-by-word metrics of phrase-structure building with a top-down and a bottom-up parser that make different hypotheses about the timing of structure building. While the top-down parser anticipates syntactic structure, sometimes before it is obvious to the listener, the bottom-up parser builds syntactic structure in an integratory way after all of the evidence has been presented. In comprehension, neural activity was found to be better modeled by the bottom-up parser, while in production, it was better modeled by the top-down parser. We additionally modeled structure building in production with two strategies that were developed here to make different predictions about the incrementality of structure building during speaking. We found evidence for highly incremental and anticipatory structure building in production, which was confirmed by a converging analysis of the pausing patterns in speech. Overall, this study shows the feasibility of studying the neural dynamics of spontaneous language production.

Simon Fraser University Speech Error Database (SFUSED) Cantonese: Methods, design, and usage.

The Simon Fraser University Speech Error Database (SFUSED) is a multi-purpose database of speech errors based in audio recordings. The motivation for SFUSED Cantonese, a component of this database, is to create a linguistically rich data set for exploring language production processes in Cantonese, an under-studied language. We describe in detail the methods used to collect, analyze, and explore the database, including details of team workflows, time budgets, data quality, and explicit linguistic and processing assumptions. In addition to showing how to use the database, this account supports future research with a template for investigating additional under-studied languages, and it gives fresh perspective on the benefits and drawbacks of collecting speech error data from spontaneous speech. All of the data and supporting materials are available as open access data sets.

Sustained pacifier use is associated with smaller vocabulary sizes at 1 and 2 years of age: A cross-sectional study.

Pacifier use during childhood has been hypothesized to interfere with language processing, but, to date, there is limited evidence revealing detrimental effects of prolonged pacifier use on infant vocabulary learning. In the present study, parents of 12- and 24-month-old infants were recruited in Oslo (Norway). The sample included 1187 monolingual full-term born (without visual, auditory, or cognitive impairments) infants: 452 (230 girls; 222 boys) 12-month-olds and 735 (345 girls; 390 boys) 24-month-olds. Parents filled out an online Norwegian Communicative Development Inventory (CDI), which assesses the vocabulary in comprehension and production for 12-month-old infants and in production only for 24-month-old infants. CDI scores were transformed into age- and sex-adjusted percentiles using Norwegian norms. Additionally, parents retrospectively reported their child's daytime pacifier use, in hours, at 2-month intervals, from birth to the assessment date. Maternal education was used to control, in the analyses, for the socio-economic status. We found that greater pacifier use in an infant's lifespan was associated with lower vocabulary size. Pacifier use later in life was more negatively associated with vocabulary size than precocious use, and increased the odds of being a low language scorer. In sum, our study moves beyond the findings of momentary effects of experimentally induced "impairment" in articulators' movement on speech perception and suggests that, from 12 months of age, constraints on the infant's speech articulators (pacifier use) may be negatively associated with word comprehension and production. RESEARCH HIGHLIGHT: We examined the relationship between pacifier use and vocabulary sizes in production at 24 months of age and comprehension and production at 12 months of age. Lifespan Pacifier Use (LPU) was negatively correlated with vocabulary sizes in comprehension and production among 12-month-old infants and negatively correlated with production for 24-month-olds. Later pacifier use was found to be more negatively correlated with vocabulary size in infants, as compared to more precocious use. The amount of pacifier use in the 2 months prior to a child's second birthday was predictive of a higher prevalence of low vocabulary scores in 24-month-olds.

Predictive Brain Activity Shows Congruent Semantic Specificity in Language Comprehension and Production.

Sentence fragments strongly predicting a specific subsequent meaningful word elicit larger preword slow waves, prediction potentials (PPs), than unpredictive contexts. To test the current predictive processing models, 128-channel EEG data were collected from both sexes to examine whether (1) different semantic PPs are elicited in language comprehension and production and (2) whether these PPs originate from the same specific "prediction area(s)" or rather from widely distributed category-specific neuronal circuits reflecting the meaning of the predicted item. Slow waves larger after predictable than unpredictable contexts were present both before subjects heard the sentence-final word in the comprehension experiment and before they pronounced the sentence-final word in the production experiment. Crucially, cortical sources underlying the semantic PP were distributed across several cortical areas and differed between the semantic categories of the expected words. In both production and comprehension, the anticipation of animal words was reflected by sources in posterior visual areas, whereas predictable tool words were preceded by sources in the frontocentral sensorimotor cortex. For both modalities, PP size increased with higher cloze probability, thus further confirming that it reflects semantic prediction, and with shorter latencies with which participants completed sentence fragments. These results sit well with theories viewing distributed semantic category-specific circuits as the mechanistic basis of semantic prediction in the two modalities.