An Event-Related Potential (ERP) Examination of the Neural Responses to Emotional and Movement-Related Images.

Previous research has suggested that the perception of emotional images may also activate brain regions related to the preparation of motoric plans. However, little research has investigated whether these emotion-movement interactions occur at early or later stages of visual perception. In the current research, event-related potentials (ERPs) were used to examine the time course of the independent - and combined - effects of perceiving emotions and implied movement. Twenty-five participants viewed images from four categories: 1) emotional with implied movement, 2) emotional with no implied movement, 3) neutral with implied movement, and 4) neutral with no implied movement. Both emotional stimuli and movement-related stimuli led to larger N200 (200-300 ms) waveforms. Furthermore, at frontal sites, there was a marginal interaction between emotion and implied movement, such that negative stimuli showed greater N200 amplitudes vs. neutral stimuli, but only for images with implied movement. At posterior sites, a similar effect was observed for images without implied movement. The late positive potential (LPP; 500-1000 ms) was significant for emotion (at frontal sites) and movement (at frontal, central, and posterior sites), as well as for their interaction (at parietal sites), with larger LPPs for negative vs. neutral images with movement only. Together, these results suggest that the perception of emotion and movement interact at later stages of visual perception.

Neural Correlates of Visual Attention and Short-Term Memory in Children with Reading Difficulty.

Visual attention and memory of 20 children with reading difficulty (Mage = 134 months), 24 chronological (Mage = 138 months) and 19 reading-age controls (Mage = 92 months) were examined using object substitution masking; mask offset delay increases visual attention and visual short-term memory demands. ERP amplitude differences in the N1 (alerting), N2pc (N2-posterior-contralateral; selective attention), and SPCN (sustained posterior contralateral negativity; memory load) were expected between groups. Chronological controls performed best, but ERP results were mixed. No group differences were found for N1 or N2pc. SPCN showed enhanced negativity in reading difficulty, indicating greater memory load and anomalous inhibition.

An electroencephalographic examination of the autonomous sensory meridian response (ASMR).

Autonomous sensory meridian response (ASMR) is a perceptual phenomenon characterized by pleasurable tingling sensations in the head and neck, as well as pleasurable feelings of relaxation, that reliably arise while attending to a specific triggering stimulus (e.g., whispering or tapping sounds). Currently, little is known about the neutral substrates underlying these experiences. In this study, 14 participants who experience ASMR, along with 14 control participants, were presented with four video stimuli and four auditory stimuli. Half of these stimuli were designed to elicit ASMR and half were non-ASMR control stimuli. Brain activity was measured using a 32-channel EEG system. The results indicated that ASMR stimuli-particularly auditory stimuli-elicited increased alpha wave activity in participants with self-reported ASMR, but not in matched control participants. Similar increases were also observed in frequency bands associated with movement (gamma waves and sensorimotor rhythm). These results are consistent with the reported phenomenology of ASMR, which involves both attentional and sensorimotor characteristics.

The dynamic nature of assimilation and accommodation procedures in the brains of Chinese-English and English-Chinese bilinguals.

The framework of assimilation and accommodation has been proposed to explain the brain mechanisms supporting second language reading acquisition (Perfetti et al. [2007]: Bilingual Lang Cogn 10:131). Assimilation refers to using the procedures of the native language network in the acquisition of a new writing system, whereas accommodation refers to using second language procedures for reading the newly acquired writing system. We investigated assimilation and accommodation patterns in the brains of bilingual individuals by recruiting a group of Chinese-English bilinguals and a group of English-Chinese bilinguals to perform lexical decision tasks in both English and Chinese. The key question was whether the assimilation/accommodation procedures supporting second language reading in the brains of Chinese-English and English-Chinese bilinguals were dynamic, i.e., modulated by proficiency in the second language and perceptual features of the second language's script. Perceptual features of the scripts were manipulated through orthographic degradation by inserting spaces between the radicals of a Chinese character or between the syllables of an English word. This manipulation disrupts the visual configuration of the orthography but does not change its more fundamental design principles. We found that for English-Chinese bilinguals, higher proficiency was associated with greater accommodation, suggesting that the accommodation procedure in a bilingual individual's brain is modulated by second language proficiency. Most interestingly, we found that the assimilation/accommodation effects vanished or diminished when orthographically degraded scripts were processed by both Chinese-English and English-Chinese bilinguals, suggesting that the assimilation/accommodation procedures in a bilingual individual's brain are modulated by perceptual features of orthography. This work therefore offers a new, dynamic perspective for our understanding of the assimilation/accommodation framework for second language acquisition.

Developmental differences in the influence of phonological similarity on spoken word processing in Mandarin Chinese.

The developmental trajectory of spoken word recognition has been well established in Indo-European languages, but to date remains poorly characterized in Mandarin Chinese. In this study, typically developing children (N=17; mean age 10; 5) and adults (N=17; mean age 24) performed a picture-word matching task in Mandarin while we recorded ERPs. Mismatches diverged from expectations in different components of the Mandarin syllable; namely, word-initial phonemes, word-final phonemes, and tone. By comparing responses to different mismatch types, we uncovered evidence suggesting that both children and adults process words incrementally. However, we also observed key developmental differences in how subjects treated onset and rime mismatches. This was taken as evidence for a stronger influence of top-down processing on spoken word recognition in adults compared to children. This work therefore offers an important developmental component to theories of Mandarin spoken word recognition.

Theta-gamma coupling reflects the interaction of bottom-up and top-down processes in speech perception in children.

This study investigates how the interaction of different brain oscillations (particularly theta-gamma coupling) modulates the bottom-up and top-down processes during speech perception. We employed a speech perception paradigm that manipulated the congruency between a visually presented picture and an auditory stimulus and asked participants to judge whether they matched or mismatched. A group of children (mean age 10 years, 5 months) participated in this study and their electroencephalographic (EEG) data were recorded while performing the experimental task. It was found that in comparison with mismatch condition, match condition facilitated speech perception by eliciting greater theta-gamma coupling in the frontal area and smaller theta-gamma coupling in the left temporal area. These findings suggested that a top-down facilitation effect from congruent visual pictures engaged different mechanisms in low-level sensory (temporal) regions and high-level linguistic and decision (frontal) regions. Interestingly, hemispheric asymmetry is with higher theta-gamma coupling in the match condition in the right hemisphere and higher theta-gamma coupling in the mismatch condition in the left hemisphere. This indicates that a fast global processing strategy and a slow detailed processing strategy were differentially adopted in the match and mismatch conditions. This study provides new insight into the mechanisms of speech perception from the interaction of different oscillatory activities and provides neural evidence for theories of speech perception allowing for top-down feedback connections. Furthermore, it sheds light on children's speech perception development by showing a similar pattern of integration of bottom-up and top-down information during speech perception as previous studies have revealed in adults.

Multimodal lexical processing in auditory cortex is literacy skill dependent.

Literacy is a uniquely human cross-modal cognitive process wherein visual orthographic representations become associated with auditory phonological representations through experience. Developmental studies provide insight into how experience-dependent changes in brain organization influence phonological processing as a function of literacy. Previous investigations show a synchrony-dependent influence of letter presentation on individual phoneme processing in superior temporal sulcus; others demonstrate recruitment of primary and associative auditory cortex during cross-modal processing. We sought to determine whether brain regions supporting phonological processing of larger lexical units (monosyllabic words) over larger time windows is sensitive to cross-modal information, and whether such effects are literacy dependent. Twenty-two children (age 8-14 years) made rhyming judgments for sequentially presented word and pseudoword pairs presented either unimodally (auditory- or visual-only) or cross-modally (audiovisual). Regression analyses examined the relationship between literacy and congruency effects (overlapping orthography and phonology vs. overlapping phonology-only). We extend previous findings by showing that higher literacy is correlated with greater congruency effects in auditory cortex (i.e., planum temporale) only for cross-modal processing. These skill effects were specific to known words and occurred over a large time window, suggesting that multimodal integration in posterior auditory cortex is critical for fluent reading.

ERPs reveal the temporal dynamics of auditory word recognition in specific language impairment.

We used event-related potentials (ERPs) to compare auditory word recognition in children with specific language impairment (SLI group; N=14) to a group of typically developing children (TD group; N=14). Subjects were presented with pictures of items and heard auditory words that either matched or mismatched the pictures. Mismatches overlapped expected words in word-onset (cohort mismatches; see: DOLL, hear: dog), rhyme (CONE -bone), or were unrelated (SHELL -mug). In match trials, the SLI group showed a different pattern of N100 responses to auditory stimuli compared to the TD group, indicative of early auditory processing differences in SLI. However, the phonological mapping negativity (PMN) response to mismatching items was comparable across groups, suggesting that just like TD children, children with SLI are capable of establishing phonological expectations and detecting violations of these expectations in an online fashion. Perhaps most importantly, we observed a lack of attenuation of the N400 for rhyming words in the SLI group, which suggests that either these children were not as sensitive to rhyme similarity as their typically developing peers, or did not suppress lexical alternatives to the same extent. These findings help shed light on the underlying deficits responsible for SLI.

Past-tense morphology and phonological deficits in children with dyslexia and children with language impairment.

The authors investigated past-tense morphology problems in children with dyslexia compared to those classically observed in children with oral language impairment (LI). Children were tested on a past-tense elicitation task involving regulars (look-looked), irregulars (take-took), and nonwords (murn-murned). Phonological skills were also assessed, using tests of nonsense word reading and phoneme elision. Analyses focused on whether children with dyslexia and LI showed overlapping patterns of morphological and phonological difficulties compared to controls with typical reading and language levels. Both the groups with LI and dyslexia had difficulty generating past tenses overall, although the deficit was less pronounced in dyslexia. Both groups also showed similar problems with phonological processing. The results have important implications for the theory that both language and reading problems involve oral language processing deficits. Specifically, our data support the theory that the phonological deficits observed in both dyslexia and LI are related to deficits in morphological processing. However, some important differences between dyslexia and LI are also discussed.

Electrophysiological indices of phonological impairments in dyslexia.

PURPOSE: A range of studies have shown difficulties in perceiving acoustic and phonetic information in dyslexia; however, much less is known about how such difficulties relate to the perception of individual words. The authors present data from event-related potentials (ERPs) examining the hypothesis that children with dyslexia have difficulties with processing phonemic information within spoken words compared to age-matched readers with typical development. METHOD: The authors monitored ERPs to auditory words during a simple picture-word matching task. The key manipulation was the inclusion of both matching stimuli and three types of mismatches (cohort, CONE-comb; rhyme, CONE-bone; and unrelated, CONE-fox). RESULTS: Children with dyslexia showed atypical N400 ERP waveforms to both types of phonological mismatches, but not to phonologically unrelated mismatches, reflecting a relative insensitivity to phonological overlap among auditory words. CONCLUSION: The data suggest that children with dyslexia have impairments in integrating phonological information into word-level representations. The results suggest that speech perception difficulties in dyslexia might have consequences for processing auditory words.

Orthographic facilitation in Chinese spoken word recognition: an ERP study.

Orthographic influences in spoken word recognition have been previously examined in alphabetic languages. However, it is unknown whether orthographic information affects spoken word recognition in Chinese, which has a clean dissociation between orthography (O) and phonology (P). The present study investigated orthographic effects using event related potentials (ERPs) and an auditory lexical decision task. We manipulated the relationship between the phonology and orthography of the first syllable in each prime-target pair using the following four conditions: P+O+, P+O-, P-O+, P-O-. Importantly, we found significantly reduced N400 amplitudes when an item was preceded by an orthographically similar prime. In addition, these reduced N400 amplitudes were positively correlated with participants' reading skill. The findings indicate that orthographic information is activated automatically during Chinese spoken word recognition, supporting the theory that there is a reciprocal connection between speech and print.

The role of the ventral and dorsal pathways in reading Chinese characters and English words.

Previous literature in alphabetic languages suggests that the occipital-temporal region (the ventral pathway) is specialized for automatic parallel word recognition, whereas the parietal region (the dorsal pathway) is specialized for serial letter-by-letter reading (Cohen et al., 2008; Ho et al., 2002). However, few studies have directly examined the role of the ventral and dorsal pathways in Chinese reading compared to English reading. To investigate this issue, we adopted the degraded word processing paradigm used by Cohen et al. (2008) and compared brain regions involved in the processing of degraded Chinese characters and English words during lexical decision, using functional magnetic resonance imaging (fMRI). The degraded characters/words were created by inserting blank spaces between radicals of Chinese characters or syllables of English polysyllabic words. Generally, the current study replicated the effects of Cohen et al. (2008), showing that in Chinese - like in alphabetic languages - character spacing modulates both ventral (bilateral cuneus, left middle occipital gyrus) and dorsal (left superior parietal lobule and middle frontal gyrus) pathways. In addition, the current study showed greater activation in bilateral cuneus and right lingual gyrus for Chinese versus English when comparing spaced to normal stimuli, suggesting that Chinese character recognition relies more on ventral visual-spatial processing than English word recognition. Interestingly, bilateral cuneus showed monotonic patterns in response to increasing spacing, while the rest of the regions of interest showed non-monotonic patterns, indicating different profiles for these regions in visual-spatial processing.

Distinct representations of subtraction and multiplication in the neural systems for numerosity and language.

It has been proposed that recent cultural inventions such as symbolic arithmetic recycle evolutionary older neural mechanisms. A central assumption of this hypothesis is that the degree to which a preexisting mechanism is recycled depends on the degree of similarity between its initial function and the novel task. To test this assumption, we investigated whether the brain region involved in magnitude comparison in the intraparietal sulcus (IPS), localized by a numerosity comparison task, is recruited to a greater degree by arithmetic problems that involve number comparison (single-digit subtractions) than by problems that involve retrieving number facts from memory (single-digit multiplications). Our results confirmed that subtractions are associated with greater activity in the IPS than multiplications, whereas multiplications elicit greater activity than subtractions in regions involved in verbal processing including the middle temporal gyrus (MTG) and inferior frontal gyrus (IFG) that were localized by a phonological processing task. Pattern analyses further indicated that the neural mechanisms more active for subtraction than multiplication in the IPS overlap with those involved in numerosity comparison and that the strength of this overlap predicts interindividual performance in the subtraction task. These findings provide novel evidence that elementary arithmetic relies on the cooption of evolutionary older neural circuits.

Children with reading difficulties show differences in brain regions associated with orthographic processing during spoken language processing.

We explored the neural basis of spoken language deficits in children with reading difficulty, specifically focusing on the role of orthography during spoken language processing. We used functional magnetic resonance imaging (fMRI) to examine differences in brain activation between children with reading difficulties (aged 9-to-15 years) and age-matched children with typical achievement during an auditory rhyming task. Both groups showed activation in bilateral superior temporal gyri (BA 42 and 22), a region associated with phonological processing, with no significant between-group differences. Interestingly, typically achieving children, but not children with reading difficulties, showed activation of left fusiform cortex (BA 37), a region implicated in orthographic processing. Furthermore, this activation was significantly greater for typically achieving children compared to those with reading difficulties. These findings suggest that typical children automatically activate orthographic representations during spoken language processing, while those with reading difficulties do not. Follow-up analyses revealed that the intensity of the activation in the fusiform gyrus was associated with significantly stronger behavioral conflict effects in typically achieving children only (i.e., longer latencies to rhyming pairs with orthographically dissimilar endings than to those with identical orthographic endings; jazz-has vs. cat-hat). Finally, for reading disabled children, a positive correlation between left fusiform activation and nonword reading was observed, such that greater access to orthography was related to decoding ability. Taken together, the results suggest that the integration of orthographic and phonological processing is directly related to reading ability.

Categorical speech perception deficits distinguish language and reading impairments in children.

We examined categorical speech perception in school-age children with developmental dyslexia or Specific Language Impairment (SLI), compared to age-matched and younger controls. Stimuli consisted of synthetic speech tokens in which place of articulation varied from 'b' to 'd'. Children were tested on categorization, categorization in noise, and discrimination. Phonological awareness skills were also assessed to examine whether these correlated with speech perception measures. We observed similarly good baseline categorization rates across all groups; however, when noise was added, the SLI group showed impaired categorization relative to controls, whereas dyslexic children showed an intact profile. The SLI group showed poorer than expected between-category discrimination rates, whereas this pattern was only marginal in the dyslexic group. Impaired phonological awareness profiles were observed in both the SLI and dyslexic groups; however, correlations between phonological awareness and speech perception scores were not significant. The results of the study suggest that in children with language and reading impairments, there is a significant relationship between receptive language and speech perception, there is at best a weak relationship between reading and speech perception, and indeed the relationship between phonological and speech perception deficits is highly complex.

Investigating the time course of spoken word recognition: electrophysiological evidence for the influences of phonological similarity.

Behavioral and modeling evidence suggests that words compete for recognition during auditory word identification, and that phonological similarity is a driving factor in this competition. The present study used event-related potentials (ERPs) to examine the temporal dynamics of different types of phonological competition (i.e., cohort and rhyme). ERPs were recorded during a novel picture-word matching task, where a target picture was followed by an auditory word that either matched the target (CONE-cone), or mismatched in one of three ways: rhyme (CONE-bone), cohort (CONE-comb), and unrelated (CONE-fox). Rhymes and cohorts differentially modulated two distinct ERP components, the phonological mismatch negativity and the N400, revealing the influences of prelexical and lexical processing components in speech recognition. Cohort mismatches resulted in late increased negativity in the N400, reflecting disambiguation of the later point of miscue and the combined influences of top-down expectations and misleading bottom-up phonological information on processing. In contrast, we observed a reduction in the N400 for rhyme mismatches, reflecting lexical activation of rhyme competitors. Moreover, the observed rhyme effects suggest that there is an interaction between phoneme-level and lexical-level information in the recognition of spoken words. The results support the theory that both levels of information are engaged in parallel during auditory word recognition in a way that permits both bottom-up and top-down competition effects.

Learning rule-described and non-rule-described categories: a comparison of children and adults.

Three experiments investigated the ability of 3-, 5-, and 8-year-old children as well as adults to learn sets of perceptual categories. Adults and children performed comparably on categories that could be learned by either a single-dimensional rule or by associative learning mechanisms. However, children showed poorer performance relative to adults in learning categories defined by a disjunctive rule and categories that were nonlinearly separable. Increasing the task demands for adults resulted in child-like performance on the disjunctive categories. Decreasing the task demands for children resulted in more adult-like performance on the disjunctive categories. The authors interpret these results within a multiple-systems approach to category learning and suggest that children have not fully developed the same explicit category learning system as adults.

Specific phonological impairments in dyslexia revealed by eyetracking.

Phonological deficits in dyslexia are typically assessed using metalinguistic tasks vulnerable to extraneous factors such as attention and memory. The present work takes the novel approach of measuring phonology using eyetracking. Eye movements of dyslexic children were monitored during an auditory word recognition task in which target items in a display (e.g., candle) were accompanied by distractors sharing a cohort (candy) or rhyme (sandal). Like controls, dyslexics showed slower recognition times when a cohort distractor was present than in a baseline condition with only phonologically unrelated distractors. However, unlike controls, dyslexic children did not show slowed recognition of targets with a rhyme distractor, suggesting they had not encoded rhyme relationships. This was further explored in an overt phonological awareness test of cohort and rhyme. Surprisingly, dyslexics showed normal rhyme performance but poorer judgment of initial sounds on these overt tests. The results implicate impaired knowledge of rhyme information in dyslexia; however they also indicate that testing methodology plays a critical role in how such problems are identified.