A Comparison of White Matter Brain Differences in Monolingual and Highly Proficient Multilingual Speakers.

Language processing relies on the communication between brain regions that is achieved through several white matter tracts, part of the dorsal, ventral, and medial pathways involved in language processing and control (Coggins et al., 2004; Friederici & Gierhan, 2013; Hickok & Poeppel, 2007; Luk et al., 2011). While changes in white matter tract morphology have been reported as a function of second language learning in bilinguals, little is known about changes that may be present in multilanguage users. Here we investigate white matter morphometry in a group of highly proficient multilinguals, (individuals with proficiency in four or more languages), compared to a group of monolinguals. White matter morphometry was quantified using a fixel-based analysis (Raffelt et al., 2015; Raffelt et al., 2017; Tournier et al., 2007). Higher fiber cross-section and lower fiber density values were observed for the multilinguals, in the dorsal pathways (superior longitudinal fasciculus and arcuate fasciculus) and the ventral pathway, including the inferior fronto-occipital fasciculus, inferior longitudinal fasciculus, and the uncinate fasciculus. Segments of the corpus callosum, the fornix, and the cortico-spinal tract showed decreases in all three morphometry measures for multilinguals. The findings suggest differential efficiencies in neural communication between domain-specific language regions and domain-general cognitive processes underlying multilingual language use. We discuss the results in relation to the bilingual Anterior to Posterior and Subcortical Shift (BAPSS) hypothesis (Grundy et al., 2017) and the Dynamic Restructuring Model (Pliatsikas, 2020).

Electrophysiological study of visual processing in children with cochlear implants.

Electrophysiological studies of congenitally deaf children and adults have reported atypical visual evoked potentials (VEPs) which have been associated with both behavioral enhancements of visual attention as well as poorer performance and outcomes in tests of spoken language speech processing. This pattern has often been interpreted as a maladaptive consequence of early auditory deprivation, whereby a remapping of auditory cortex by the visual system ultimately reduces resources necessary for optimal rehabilitative outcomes of spoken language acquisition and use. Making use of a novel electrophysiological paradigm, we compare VEPs in children with severe to profound congenital deafness who received a cochlear implant(s) prior to 31 months (n = 28) and typically developing age matched controls (n = 28). We observe amplitude enhancements and in some cases latency differences in occipitally expressed P1 and N1 VEP components in CI-using children as well as an early frontal negativity, N1a. We relate these findings to developmental factors such as chronological age and spoken language understanding. We further evaluate whether VEPs are additionally modulated by auditory stimulation. Collectively, these data provide a means to examine the extent to which atypical VEPs are consistent with prior accounts of maladaptive cross-modal plasticity. Our results support a view that VEP changes reflect alterations to visual-sensory attention and saliency mechanisms rather than a re-mapping of auditory cortex. The present data suggests that early auditory deprivation may have temporally prolonged effects on visual system processing even after activation and use of cochlear implant.

Visual attention for linguistic and non-linguistic body actions in non-signing and native signing children.

Evidence from adult studies of deaf signers supports the dissociation between neural systems involved in processing visual linguistic and non-linguistic body actions. The question of how and when this specialization arises is poorly understood. Visual attention to these forms is likely to change with age and be affected by prior language experience. The present study used eye-tracking methodology with infants and children as they freely viewed alternating video sequences of lexical American sign language (ASL) signs and non-linguistic body actions (self-directed grooming action and object-directed pantomime). In Experiment 1, we quantified fixation patterns using an area of interest (AOI) approach and calculated face preference index (FPI) values to assess the developmental differences between 6 and 11-month-old hearing infants. Both groups were from monolingual English-speaking homes with no prior exposure to sign language. Six-month-olds attended the signer's face for grooming; but for mimes and signs, they were drawn to attend to the "articulatory space" where the hands and arms primarily fall. Eleven-month-olds, on the other hand, showed a similar attention to the face for all body action types. We interpret this to reflect an early visual language sensitivity that diminishes with age, just before the child's first birthday. In Experiment 2, we contrasted 18 hearing monolingual English-speaking children (mean age of 4.8 years) vs. 13 hearing children of deaf adults (CODAs; mean age of 5.7 years) whose primary language at home was ASL. Native signing children had a significantly greater face attentional bias than non-signing children for ASL signs, but not for grooming and mimes. The differences in the visual attention patterns that are contingent on age (in infants) and language experience (in children) may be related to both linguistic specialization over time and the emerging awareness of communicative gestural acts.

Electrophysiological Examination of Ambient Speech Processing in Children With Cochlear Implants.

PURPOSE: This research examined the expression of cortical auditory evoked potentials in a cohort of children who received cochlear implants (CIs) for treatment of congenital deafness (n = 28) and typically hearing controls (n = 28). METHOD: We make use of a novel electroencephalography paradigm that permits the assessment of auditory responses to ambiently presented speech and evaluates the contributions of concurrent visual stimulation on this activity. RESULTS: Our findings show group differences in the expression of auditory sensory and perceptual event-related potential components occurring in 80- to 200-ms and 200- to 300-ms time windows, with reductions in amplitude and a greater latency difference for CI-using children. Relative to typically hearing children, current source density analysis showed muted responses to concurrent visual stimulation in CI-using children, suggesting less cortical specialization and/or reduced responsiveness to auditory information that limits the detection of the interaction between sensory systems. CONCLUSION: These findings indicate that even in the face of early interventions, CI-using children may exhibit disruptions in the development of auditory and multisensory processing.

Semantic word integration in children with cochlear implants: Electrophysiological evidence.

Differential auditory experiences of children with hearing-loss who receive cochlear implants (CIs) may influence the integration of lexical and conceptual information. Here we measured event-related potentials during a word-picture priming task in CI-using children (n = 29, mean age = 81 months) and typically-hearing children (n = 19, mean age = 75 months) while they viewed audiovisual-word primes and picture targets that were semantically congruent or incongruent. In both groups, semantic relatedness modulated ERP amplitude 300-500ms after picture onset, signifying an N400 semantic effect. Critically, the CI-using children's responses to unrelated pairs were significantly more negative than hearing children's responses. Group differences were mirrored in an earlier 150-275ms time window associated with a P2 response. The present findings suggest attentional and/or strategic differences impact semantic processing and contribute to the N400 differences observed between groups.

Cortical Encoding of Manual Articulatory and Linguistic Features in American Sign Language.

The fluent production of a signed language requires exquisite coordination of sensory, motor, and cognitive processes. Similar to speech production, language produced with the hands by fluent signers appears effortless but reflects the precise coordination of both large-scale and local cortical networks. The organization and representational structure of sensorimotor features underlying sign language phonology in these networks remains unknown. Here, we present a unique case study of high-density electrocorticography (ECoG) recordings from the cortical surface of profoundly deaf signer during awake craniotomy. While neural activity was recorded from sensorimotor cortex, the participant produced a large variety of movements in linguistic and transitional movement contexts. We found that at both single electrode and neural population levels, high-gamma activity reflected tuning for particular hand, arm, and face movements, which were organized along dimensions that are relevant for phonology in sign language. Decoding of manual articulatory features revealed a clear functional organization and population dynamics for these highly practiced movements. Furthermore, neural activity clearly differentiated linguistic and transitional movements, demonstrating encoding of language-relevant articulatory features. These results provide a novel and unique view of the fine-scale dynamics of complex and meaningful sensorimotor actions.

Effects of age on American Sign Language sentence repetition.

The study of deaf users of signed languages, who often experience delays in primary language (L1) acquisition, permits a unique opportunity to examine the effects of aging on the processing of an L1 acquired under delayed or protracted development. A cohort of 107 congenitally deaf adult signers ages 45-85 years who were exposed to American Sign Language (ASL) either in infancy, early childhood, or late childhood were tested using an ASL sentence repetition test. Participants repeated 20 sentences that gradually increased in length and complexity. Logistic mixed-effects regression with the variables of chronological age (CA) and age of acquisition (AoA) was used to assess sentence repetition accuracy. Results showed that CA was a significant predictor, with increased age being associated with decreased likelihood to reproduce a sentence correctly (odds ratio [OR] = 0.56, p = .010). In addition, effects of AoA were observed. Relative to native deaf signers, those who acquired ASL in early childhood were less likely to successfully reproduce a sentence (OR = 0.42, p = .003), as were subjects who learned ASL in late childhood (OR = 0.27, p < .001). These data show that aging affects verbatim recall in deaf users of ASL and that the age of sign language acquisition has a significant and lasting effect on repetition ability, even after decades of sign language use. These data show evidence for life-span continuity of early life effects. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

A novel EEG paradigm to simultaneously and rapidly assess the functioning of auditory and visual pathways.

Objective assessment of the sensory pathways is crucial for understanding their development across the life span and how they may be affected by neurodevelopmental disorders (e.g., autism spectrum) and neurological pathologies (e.g., stroke, multiple sclerosis, etc.). Quick and passive measurements, for example, using electroencephalography (EEG), are especially important when working with infants and young children and with patient populations having communication deficits (e.g., aphasia). However, many EEG paradigms are limited to measuring activity from one sensory domain at a time, may be time consuming, and target only a subset of possible responses from that particular sensory domain (e.g., only auditory brainstem responses or only auditory P1-N1-P2 evoked potentials). Thus we developed a new multisensory paradigm that enables simultaneous, robust, and rapid (6-12 min) measurements of both auditory and visual EEG activity, including auditory brainstem responses, auditory and visual evoked potentials, as well as auditory and visual steady-state responses. This novel method allows us to examine neural activity at various stations along the auditory and visual hierarchies with an ecologically valid continuous speech stimulus, while an unrelated video is playing. Both the speech stimulus and the video can be customized for any population of interest. Furthermore, by using two simultaneous visual steady-state stimulation rates, we demonstrate the ability of this paradigm to track both parafoveal and peripheral visual processing concurrently. We report results from 25 healthy young adults, which validate this new paradigm.NEW & NOTEWORTHY A novel electroencephalography paradigm enables the rapid, reliable, and noninvasive assessment of neural activity along both auditory and visual pathways concurrently. The paradigm uses an ecologically valid continuous speech stimulus for auditory evaluation and can simultaneously track visual activity to both parafoveal and peripheral visual space. This new methodology may be particularly appealing to researchers and clinicians working with infants and young children and with patient populations with limited communication abilities.

Putting underspecification in context: ERP evidence for sparse representations in morphophonological alternations.

Numerous studies have shown evidence for a sparse lexicon in speech perception, often in the guise of underspecification, where certain information is omitted in the specification of phonological forms. While previous work has made a good case for underspecifying certain features of single speech sounds, the role of phonological context in underspecification has been overlooked. Contextually-mediated underspecification is particularly relevant to conceptualizations of the lexicon, as it is couched in item-specific (as opposed to phoneme-specific) patterning. In this study, we present behavioral and ERP evidence that surrounding phonological context may trigger underspecified lexical forms, using regular morphophonological alternations in English.

Auditory and Visual Electrophysiology of Deaf Children with Cochlear Implants: Implications for Cross-modal Plasticity.

Deaf children who receive a cochlear implant early in life and engage in intensive oral/aural therapy often make great strides in spoken language acquisition. However, despite clinicians' best efforts, there is a great deal of variability in language outcomes. One concern is that cortical regions which normally support auditory processing may become reorganized for visual function, leaving fewer available resources for auditory language acquisition. The conditions under which these changes occur are not well understood, but we may begin investigating this phenomenon by looking for interactions between auditory and visual evoked cortical potentials in deaf children. If children with abnormal auditory responses show increased sensitivity to visual stimuli, this may indicate the presence of maladaptive cortical plasticity. We recorded evoked potentials, using both auditory and visual paradigms, from 25 typical hearing children and 26 deaf children (ages 2-8 years) with cochlear implants. An auditory oddball paradigm was used (85% /ba/ syllables vs. 15% frequency modulated tone sweeps) to elicit an auditory P1 component. Visual evoked potentials (VEPs) were recorded during presentation of an intermittent peripheral radial checkerboard while children watched a silent cartoon, eliciting a P1-N1 response. We observed reduced auditory P1 amplitudes and a lack of latency shift associated with normative aging in our deaf sample. We also observed shorter latencies in N1 VEPs to visual stimulus offset in deaf participants. While these data demonstrate cortical changes associated with auditory deprivation, we did not find evidence for a relationship between cortical auditory evoked potentials and the VEPs. This is consistent with descriptions of intra-modal plasticity within visual systems of deaf children, but do not provide evidence for cross-modal plasticity. In addition, we note that sign language experience had no effect on deaf children's early auditory and visual ERP responses.

Distinguishing underlying and surface variation patterns in speech perception.

This study examines the relationship between patterns of variation and speech perception using two English prefixes: 'in-'/'im-' and 'un-'. In natural speech, 'in-' varies due to an underlying process of phonological assimilation, while 'un-' shows a pattern of surface variation, assimilating before labial stems. In a go/no-go lexical decision experiment, subjects were presented a set of 'mispronounced' stimuli in which the prefix nasal was altered (replacing [n] with [m], or vice versa), in addition to real words with unaltered prefixes. No significant differences between prefixes were found in responses to unaltered words. In mispronounced items, responses to 'un-' forms were faster and more accurate than to 'in-' forms, although a significant interaction mitigated this effect in labial contexts. These results suggest the regularity of variation patterns has consequences for the lexical specification of words, and argues against radical under-specification accounts which argue for a maximally sparse lexicon.

Phonological awareness for american sign language.

This paper examines the concept of phonological awareness (PA) as it relates to the processing of American Sign Language (ASL). We present data from a recently developed test of PA for ASL and examine whether sign language experience impacts the use of metalinguistic routines necessary for completion of our task. Our data show that deaf signers exposed to ASL from infancy perform better than deaf signers exposed to ASL later in life and that this relationship remains even after controlling for the number of years of experience with a signed language. For a subset of participants, we examine the relationship between PA for ASL and performance on a PA test of English and report a positive correlation between ASL PA and English PA in native signers. We discuss the implications of these findings in relation to the development of reading skills in deaf children.

Deaf readers' response to syntactic complexity: evidence from self-paced reading.

This study was designed to determine the feasibility of using self-paced reading methods to study deaf readers and to assess how deaf readers respond to two syntactic manipulations. Three groups of participants read the test sentences: deaf readers, hearing monolingual English readers, and hearing bilingual readers whose second language was English. In Experiment 1, the participants read sentences containing subject-relative or object-relative clauses. The test sentences contained semantic information that would influence online processing outcomes (Traxler, Morris, & Seely Journal of Memory and Language 47: 69-90, 2002; Traxler, Williams, Blozis, & Morris Journal of Memory and Language 53: 204-224, 2005). All of the participant groups had greater difficulty processing sentences containing object-relative clauses. This difficulty was reduced when helpful semantic cues were present. In Experiment 2, participants read active-voice and passive-voice sentences. The sentences were processed similarly by all three groups. Comprehension accuracy was higher in hearing readers than in deaf readers. Within deaf readers, native signers read the sentences faster and comprehended them to a higher degree than did nonnative signers. These results indicate that self-paced reading is a useful method for studying sentence interpretation among deaf readers.

Lexical processing in deaf readers: an FMRI investigation of reading proficiency.

Individuals with significant hearing loss often fail to attain competency in reading orthographic scripts which encode the sound properties of spoken language. Nevertheless, some profoundly deaf individuals do learn to read at age-appropriate levels. The question of what differentiates proficient deaf readers from less-proficient readers is poorly understood but topical, as efforts to develop appropriate and effective interventions are needed. This study uses functional magnetic resonance imaging (fMRI) to examine brain activation in deaf readers (N = 21), comparing proficient (N = 11) and less proficient (N = 10) readers' performance in a widely used test of implicit reading. Proficient deaf readers activated left inferior frontal gyrus and left middle and superior temporal gyrus in a pattern that is consistent with regions reported in hearing readers. In contrast, the less-proficient readers exhibited a pattern of response characterized by inferior and middle frontal lobe activation (right>left) which bears some similarity to areas reported in studies of logographic reading, raising the possibility that these individuals are using a qualitatively different mode of orthographic processing than is traditionally observed in hearing individuals reading sound-based scripts. The evaluation of proficient and less-proficient readers points to different modes of processing printed English words. Importantly, these preliminary findings allow us to begin to establish the impact of linguistic and educational factors on the neural systems that underlie reading achievement in profoundly deaf individuals.

Cross-linguistic differences in the neural representation of human language: evidence from users of signed languages.

Studies of deaf individuals who are users of signed languages have provided profound insight into the neural representation of human language. Case studies of deaf signers who have incurred left- and right-hemisphere damage have shown that left-hemisphere resources are a necessary component of sign language processing. These data suggest that, despite frank differences in the input and output modality of language, core left perisylvian regions universally serve linguistic function. Neuroimaging studies of deaf signers have generally provided support for this claim. However, more fine-tuned studies of linguistic processing in deaf signers are beginning to show evidence of important differences in the representation of signed and spoken languages. In this paper, we provide a critical review of this literature and present compelling evidence for language-specific cortical representations in deaf signers. These data lend support to the claim that the neural representation of language may show substantive cross-linguistic differences. We discuss the theoretical implications of these findings with respect to an emerging understanding of the neurobiology of language.

Exploring perceptual processing of ASL and human actions: effects of inversion and repetition priming.

In this paper, we compare responses of deaf signers and hearing non-signers engaged in a categorization task of signs and non-linguistic human actions. We examine the time it takes to make such categorizations under conditions of 180° stimulus inversion and as a function of repetition priming, in an effort to understand whether the processing of sign language forms draws upon special processing mechanisms or makes use of mechanisms used in recognition of non-linguistic human actions. Our data show that deaf signers were much faster in the categorization of both linguistic and non-linguistic actions, and relative to hearing non-signers, show evidence that they were more sensitive to the configural properties of signs. Our study suggests that sign expertise may lead to modifications of a general-purpose human action recognition system rather than evoking a qualitatively different mode of processing, and supports the contention that signed languages make use of perceptual systems through which humans understand or parse human actions and gestures more generally.

Analysis of naming errors during cortical stimulation mapping: implications for models of language representation.

This study reports on the characteristics and distribution of naming errors of patients undergoing cortical stimulation mapping (CSM). During the procedure, electrical stimulation is used to induce temporary functional lesions and locate 'essential' language areas for preservation. Under stimulation, patients are shown slides of common objects and asked to name them. Cortical stimulation can lead to a variety of naming errors. In the present study, we aggregate errors across patients to examine the neuroanatomical correlates and linguistic characteristics of six common errors: semantic paraphasias, circumlocutions, phonological paraphasias, neologisms, performance errors, and no-response errors. Aiding analysis, we relied on a suite of web-based querying and imaging tools that enabled the summative mapping of normalized stimulation sites. Errors were visualized and analyzed by type and location. We provide descriptive statistics to characterize the commonality of errors across patients and location. The errors observed suggest a widely distributed and heterogeneous cortical network that gives rise to differential patterning of paraphasic errors. Data are discussed in relation to emerging models of language representation that honor distinctions between frontal, parietal, and posterior temporal dorsal implementation systems and ventral-temporal lexical semantic and phonological storage and assembly regions; the latter of which may participate both in language comprehension and production.

A human mirror neuron system for language: Perspectives from signed languages of the deaf.

Language is proposed to have developed atop the human analog of the macaque mirror neuron system for action perception and production [Arbib M.A. 2005. From monkey-like action recognition to human language: An evolutionary framework for neurolinguistics (with commentaries and author's response). Behavioral and Brain Sciences, 28, 105-167; Arbib M.A. (2008). From grasp to language: Embodied concepts and the challenge of abstraction. Journal de Physiologie Paris 102, 4-20]. Signed languages of the deaf are fully-expressive, natural human languages that are perceived visually and produced manually. We suggest that if a unitary mirror neuron system mediates the observation and production of both language and non-linguistic action, three prediction can be made: (1) damage to the human mirror neuron system should non-selectively disrupt both sign language and non-linguistic action processing; (2) within the domain of sign language, a given mirror neuron locus should mediate both perception and production; and (3) the action-based tuning curves of individual mirror neurons should support the highly circumscribed set of motions that form the "vocabulary of action" for signed languages. In this review we evaluate data from the sign language and mirror neuron literatures and find that these predictions are only partially upheld.

Neuronal correlates of functional magnetic resonance imaging in human temporal cortex.

The relationship between changes in functional magnetic resonance imaging and neuronal activity remains controversial. Data collected during awake neurosurgical procedures for the treatment of epilepsy provided a rare opportunity to examine this relationship in human temporal association cortex. We obtained functional magnetic resonance imaging blood oxygen dependent signals, single neuronal activity and local field potentials from 8 to 300 Hz at 13 temporal cortical sites, from nine subjects, during paired associate learning and control measures. The relation between the functional magnetic resonance imaging signal and the electrophysiologic parameters was assessed in two ways: colocalization between significant changes in these signals on the same paired associate-control comparisons and multiple linear regressions of the electrophysiologic measures on the functional magnetic resonance imaging signal, across all tasks. Significant colocalization was present between increased functional magnetic resonance imaging signals and increased local field potentials power in the 50-250 Hz range. Local field potentials power greater than 100 Hz was also a significant regressor for the functional magnetic resonance imaging signal, establishing this local field potentials frequency range as a neuronal correlate of the functional magnetic resonance imaging signal. There was a trend for a relation between power in some low frequency local field potentials frequencies and the functional magnetic resonance imaging signal, for 8-15 Hz increases in the colocalization analysis and 16-23 Hz in the multiple linear regression analysis. Neither analysis provided evidence for an independent relation to frequency of single neuron activity.