Second language acquisition of American Sign Language influences co-speech gesture production.

Previous work indicates that 1) adults with native sign language experience produce more manual co-speech gestures than monolingual non-signers, and 2) one year of ASL instruction increases gesture production in adults, but not enough to differentiate them from non-signers. To elucidate these effects, we asked early ASL-English bilinguals, fluent late second language (L2) signers (≥ 10 years of experience signing), and monolingual non-signers to retell a story depicted in cartoon clips to a monolingual partner. Early and L2 signers produced manual gestures at higher rates compared to non-signers, particularly iconic gestures, and used a greater variety of handshapes. These results indicate susceptibility of the co-speech gesture system to modification by extensive sign language experience, regardless of the age of acquisition. L2 signers produced more ASL signs and more handshape varieties than early signers, suggesting less separation between the ASL lexicon and the co-speech gesture system for L2 signers.

Orthographic and phonological selectivity across the reading system in deaf skilled readers.

People who are born deaf often have difficulty learning to read. Recently, several studies have examined the neural substrates involved in reading in deaf people and found a left lateralized reading system similar to hearing people involving temporo-parietal, inferior frontal, and ventral occipito-temporal cortices. Previous studies in typical hearing readers show that within this reading network there are separate regions that specialize in processing orthography and phonology. We used fMRI rapid adaptation in deaf adults who were skilled readers to examine neural selectivity in three functional ROIs in the left hemisphere: temporoparietal cortex (TPC), inferior frontal gyrus (IFG), and the visual word form area (VWFA). Results show that in deaf skilled readers, the left VWFA showed selectivity for orthography similar to what has been reported for hearing readers, the TPC showed less sensitivity to phonology than previously reported for hearing readers using the same paradigm, and the IFG showed selectivity to orthography, but not phonology (similar to what has been reported previously for hearing readers). These results provide evidence that while skilled deaf readers demonstrate coarsely tuned phonological representations in the TPC, they develop finely tuned representations for the orthography of written words in the VWFA and IFG. This result suggests that phonological tuning in the TPC may have little impact on the neural network associated with skilled reading for deaf adults.

Preschool- and School-Age Irritability Predict Reward-Related Brain Function.

OBJECTIVE: Although chronic irritability in childhood is prevalent, impairing, and predictive of later maladjustment, its pathophysiology is largely unknown. Deficits in reward processing are hypothesized to play a role in irritability. The current study aimed to identify how the developmental timing of irritability during preschool- and school-age relates to reward-related brain function during school-age. METHOD: Children's irritability was assessed during the preschool period (wave 1; ages 3.0-5.9 years) and 3 years later (wave 2; ages 5.9-9.6 years) using a clinical interview. At wave 2, children (N = 46; 28 female and 18 male) performed a monetary incentive delay task in which they received rewards, if they successfully hit a target, or no reward regardless of performance, during functional magnetic resonance imaging. RESULTS: Children with more versus less severe preschool irritability, controlling for concurrent irritability, exhibited altered reward-related connectivity: right amygdala with insula and inferior parietal lobe as well as left ventral striatum with lingual gyrus, postcentral gyrus, superior parietal lobe, and culmen. Children with more versus less severe concurrent irritability, controlling for preschool irritability, exhibited a similar pattern of altered connectivity between left and right amygdalae and superior frontal gyrus and between left ventral striatum and precuneus and culmen. Neural differences associated with irritability were most evident between reward and no-reward conditions when participants missed the target. CONCLUSION: Preschool-age irritability and concurrent irritability were uniquely associated with aberrant patterns of reward-related connectivity, highlighting the importance of developmental timing of irritability for brain function.

Multimodal integration of spontaneously produced representational co-speech gestures: an fMRI study.

To examine whether more ecologically valid co-speech gesture stimuli elicit brain responses consistent with those found by studies that relied on scripted stimuli, we presented participants with spontaneously produced, meaningful co-speech gesture during fMRI scanning (n = 28). Speech presented with gesture (versus either presented alone) elicited heightened activity in bilateral posterior superior temporal, premotor, and inferior frontal regions. Within left temporal and premotor, but not inferior frontal regions, we identified small clusters with superadditive responses, suggesting that these discrete regions support both sensory and semantic integration. In contrast, surrounding areas and the inferior frontal gyrus may support either sensory or semantic integration. Reduced activation for speech with gesture in language-related regions indicates allocation of fewer neural resources when meaningful gestures accompany speech. Sign language experience did not affect co-speech gesture activation. Overall, our results indicate that scripted stimuli have minimal confounding influences; however, they may miss subtle superadditive effects.

The neural underpinnings of reading skill in deaf adults.

We investigated word-level reading circuits in skilled deaf readers (N=14; mean reading age=19.5years) and less skilled deaf readers (N=14; mean reading age=12years) who were all highly proficient users of American Sign Language. During fMRI scanning, participants performed a semantic decision (concrete concept?), a phonological decision (two syllables?), and a false-font control task (string underlined?). No significant group differences were observed with the full participant set. However, an analysis with the 10 most and 10 least skilled readers revealed that for the semantic task (vs. control task), proficient deaf readers exhibited greater activation in left inferior frontal and middle temporal gyri than less proficient readers. No group differences were observed for the phonological task. Whole-brain correlation analyses (all participants) revealed that for the semantic task, reading ability correlated positively with neural activity in the right inferior frontal gyrus and in a region associated with the orthography-semantics interface, located anterior to the visual word form area. Reading ability did not correlate with neural activity during the phonological task. Accuracy on the semantic task correlated positively with neural activity in left anterior temporal lobe (a region linked to conceptual processing), while accuracy on the phonological task correlated positively with neural activity in left posterior inferior frontal gyrus (a region linked to syllabification processes during speech production). Finally, reading comprehension scores correlated positively with vocabulary and print exposure measures, but not with phonological awareness scores.

Simultaneous perception of a spoken and a signed language: The brain basis of ASL-English code-blends.

Code-blends (simultaneous words and signs) are a unique characteristic of bimodal bilingual communication. Using fMRI, we investigated code-blend comprehension in hearing native ASL-English bilinguals who made a semantic decision (edible?) about signs, audiovisual words, and semantically equivalent code-blends. English and ASL recruited a similar fronto-temporal network with expected modality differences: stronger activation for English in auditory regions of bilateral superior temporal cortex, and stronger activation for ASL in bilateral occipitotemporal visual regions and left parietal cortex. Code-blend comprehension elicited activity in a combination of these regions, and no cognitive control regions were additionally recruited. Furthermore, code-blends elicited reduced activation relative to ASL presented alone in bilateral prefrontal and visual extrastriate cortices, and relative to English alone in auditory association cortex. Consistent with behavioral facilitation observed during semantic decisions, the findings suggest that redundant semantic content induces more efficient neural processing in language and sensory regions during bimodal language integration.

Social perception in autism spectrum disorders: impaired category selectivity for dynamic but not static images in ventral temporal cortex.

Studies of autism spectrum disorders (ASDs) reveal dysfunction in the neural systems mediating object processing (particularly faces) and social cognition, but few investigations have systematically assessed the specificity of the dysfunction. We compared cortical responses in typically developing adolescents and those with ASD to stimuli from distinct conceptual domains known to elicit category-related activity in separate neural systems. In Experiment 1, subjects made category decisions to photographs, videos, and point-light displays of people and tools. In Experiment 2, subjects interpreted displays of simple, geometric shapes in motion depicting social or mechanical interactions. In both experiments, we found a selective deficit in the ASD subjects for dynamic social stimuli (videos and point-light displays of people, moving geometric shapes), but not static images, in the functionally localized lateral region of the right fusiform gyrus, including the fusiform face area. In contrast, no group differences were found in response to either static images or dynamic stimuli in other brain regions associated with face and social processing (e.g. posterior superior temporal sulcus, amygdala), suggesting disordered connectivity between these regions and the fusiform gyrus in ASD. This possibility was confirmed by functional connectivity analysis.

Mapping the reading circuitry for skilled deaf readers: an fMRI study of semantic and phonological processing.

We examined word-level reading circuits in skilled deaf readers whose primary language is American Sign Language, and hearing readers matched for reading ability (college level). During fMRI scanning, participants performed a semantic decision (concrete concept?), a phonological decision (two syllables?), and a false-font control task (string underlined?). The groups performed equally well on the semantic task, but hearing readers performed better on the phonological task. Semantic processing engaged similar left frontotemporal language circuits in deaf and hearing readers. However, phonological processing elicited increased neural activity in deaf, relative to hearing readers, in the left precentral gyrus, suggesting greater reliance on articulatory phonological codes, and in bilateral parietal cortex, suggesting increased phonological processing effort. Deaf readers also showed stronger anterior-posterior functional segregation between semantic and phonological processes in left inferior prefrontal cortex. Finally, weaker phonological decoding ability did not alter activation in the visual word form area for deaf readers.

Cortical plasticity for visuospatial processing and object recognition in deaf and hearing signers.

Experience-dependent plasticity in deaf participants has been shown in a variety of studies focused on either the dorsal or ventral aspects of the visual system, but both systems have never been investigated in concert. Using functional magnetic resonance imaging (fMRI), we investigated functional plasticity for spatial processing (a dorsal visual pathway function) and for object processing (a ventral visual pathway function) concurrently, in the context of differing sensory (auditory deprivation) and language (use of a signed language) experience. During scanning, deaf native users of American Sign Language (ASL), hearing native ASL users, and hearing participants without ASL experience attended to either the spatial arrangement of frames containing objects or the identity of the objects themselves. These two tasks revealed the expected dorsal/ventral dichotomy for spatial versus object processing in all groups. In addition, the object identity matching task contained both face and house stimuli, allowing us to examine category-selectivity in the ventral pathway in all three participant groups. When contrasting the groups we found that deaf signers differed from the two hearing groups in dorsal pathway parietal regions involved in spatial cognition, suggesting sensory experience-driven plasticity. Group differences in the object processing system indicated that responses in the face-selective right lateral fusiform gyrus and anterior superior temporal cortex were sensitive to a combination of altered sensory and language experience, whereas responses in the amygdala were more closely tied to sensory experience. By selectively engaging the dorsal and ventral visual pathways within participants in groups with different sensory and language experiences, we have demonstrated that these experiences affect the function of both of these systems, and that certain changes are more closely tied to sensory experience, while others are driven by the combination of sensory and language experience.

A neural system for learning about object function.

Does our ability to visually identify everyday objects rely solely on access to information about their appearance or on a more distributed representation incorporating other object properties? Using functional magnetic resonance imaging, we addressed this question by having subjects visually match pictures of novel objects before and after extensive training to use these objects to perform specific tool-like tasks. After training, neural activity emerged in regions associated with the motion (left middle temporal gyrus) and manipulation (left intraparietal sulcus and premotor cortex) of common tools, whereas activity became more focal and selective in regions representing their visual appearance (fusiform gyrus). These findings indicate that this distributed network is automatically engaged in support of object identification. Moreover, the regions included in this network mirror those active when subjects retrieve information about tools and their properties, suggesting that, as a result of training, these previously novel objects have attained the conceptual status of "tools."

Repetition priming across the adult lifespan--the long and short of it.

Previous reports suggest that repetition priming (i.e., enhanced processing of a stimulus after experience with that stimulus) is long lasting and impervious to the effects of age, in contrast to the pattern found with explicit memory. However, the nature of repetition priming in aged individuals remains unclear, as conflicting findings have also been reported. We used a longitudinal design to examine how repetition priming is affected by multiple stimulus repetitions (three presentations) and different delay intervals (no delay, 1 day, 1 week, and 1 month) in young adults, as well as in two groups of aging adults (young-elderly and old-elderly). Our findings extend previous reports that priming is long lasting, even when 1 month intervenes between the initial experience with an item and the subsequent priming test of that item (Cave, 1997), and is relatively impervious to the effects of age (Mitchell, et al., 1990). In addition, a more detailed characterization of priming and the effects of aging was revealed. Although priming is long lasting, remaining significant even at the month delay for all groups, it did decline over time and the rate of that decline differed with age. Both young-elderly and old-elderly groups showed a marked drop-off at 1 day, whereas young adults did not show a decline until 1 week. All groups benefited from multiple repetitions; however, this benefit disappeared at the month delay (in contrast to recognition memory, where the benefit remained significant). These findings support the assertion that repetition priming and explicit memory reflect the operation of distinct systems, and that these systems may undergo different rates of change in aging.

Automatic priming of semantically related words reduces activity in the fusiform gyrus.

We used rapid, event-related fMRI to identify the neural systems underlying object semantics. During scanning, subjects silently read rapidly presented word pairs (150 msec, SOA = 250 msec) that were either unrelated in meaning (ankle-carrot), semantically related (fork-cup), or identical (crow-crow). Activity in the left posterior region of the fusiform gyrus and left inferior frontal cortex was modulated by word-pair relationship. Semantically related pairs yielded less activity than unrelated pairs, but greater activity than identical pairs, mirroring the pattern of behavioral facilitation as measured by word reading times. These findings provide strong support for the involvement of these areas in the automatic processing of object meaning. In addition, words referring to animate objects produced greater activity in the lateral region of the fusiform gyri, right superior temporal sulcus, and medial region of the occipital lobe relative to manmade, manipulable objects, whereas words referring to manmade, manipulable objects produced greater activity in the left ventral premotor, left anterior cingulate, and bilateral parietal cortices relative to animate objects. These findings are consistent with the dissociation between these areas based on sensory- and motor-related object properties, providing further evidence that conceptual object knowledge is housed, in part, in the same neural systems that subserve perception and action.

Neural foundations for understanding social and mechanical concepts.

Motivated by neuropsychological investigations of category-specific impairments, many functional brain imaging studies have found distinct patterns of neural activity associated with different object categories. However, the extent to which these category-related activation patterns reflect differences in conceptual representation remains controversial. To investigate this issue, functional magnetic resonance imaging (fMRI) was used to record changes in neural activity while subjects interpreted animated vignettes composed of simple geometric shapes in motion. Vignettes interpreted as conveying social interactions elicited a distinct and distributed pattern of neural activity, relative to vignettes interpreted as mechanical actions. This neural system included regions in posterior temporal cortex associated with identifying human faces and other biological objects. In contrast, vignettes interpreted as conveying mechanical actions resulted in activity in posterior temporal lobe sites associated with identifying manipulable objects such as tools. Moreover, social, but not mechanical, interpretations elicited activity in regions implicated in the perception and modulation of emotion (right amygdala and ventromedial prefrontal cortex). Perceiving and understanding social and mechanical concepts depends, in part, on activity in distinct neural networks. Within the social domain, the network includes regions involved in processing and storing information about the form and motion of biological objects, and in perceiving, expressing, and regulating affective responses.

Experience-dependent modulation of category-related cortical activity.

Naming pictures of objects from different categories (e.g. animals or tools) evokes maximal responses in different brain regions. However, these 'category-specific' regions typically respond to other object categories as well. Here we used stimulus familiarity to further investigate category representation. Naming pictures of animals and tools elicited category-related activity in a number of previously identified regions. This activity was reduced for familiar relative to novel stimuli. Reduced activation occurred in all object responsive areas in the ventral occipito-temporal cortex, regardless of which category initially produced the maximal response. This suggests that object representations in the ventral occipito-temporal cortex are not limited to a discrete area, but rather are widespread and overlapping. In other regions (e.g. the lateral temporal and left premotor cortices), experience-dependent reductions were category specific. Together, these findings suggest that category-related activations reflect the retrieval of information about category-specific features and attributes.