Generalization of multisensory perceptual learning.

Life in a multisensory world requires the rapid and accurate integration of stimuli across the different senses. In this process, the temporal relationship between stimuli is critical in determining which stimuli share a common origin. Numerous studies have described a multisensory temporal binding window-the time window within which audiovisual stimuli are likely to be perceptually bound. In addition to characterizing this window's size, recent work has shown it to be malleable, with the capacity for substantial narrowing following perceptual training. However, the generalization of these effects to other measures of perception is not known. This question was examined by characterizing the ability of training on a simultaneity judgment task to influence perception of the temporally-dependent sound-induced flash illusion (SIFI). Results do not demonstrate a change in performance on the SIFI itself following training. However, data do show an improved ability to discriminate rapidly-presented two-flash control conditions following training. Effects were specific to training and scaled with the degree of temporal window narrowing exhibited. Results do not support generalization of multisensory perceptual learning to other multisensory tasks. However, results do show that training results in improvements in visual temporal acuity, suggesting a generalization effect of multisensory training on unisensory abilities.

The temporal binding window for audiovisual speech: Children are like little adults.

During a typical communication exchange, both auditory and visual cues contribute to speech comprehension. The influence of vision on speech perception can be measured behaviorally using a task where incongruent auditory and visual speech stimuli are paired to induce perception of a novel token reflective of multisensory integration (i.e., the McGurk effect). This effect is temporally constrained in adults, with illusion perception decreasing as the temporal offset between the auditory and visual stimuli increases. Here, we used the McGurk effect to investigate the development of the temporal characteristics of audiovisual speech binding in 7-24 year-olds. Surprisingly, results indicated that although older participants perceived the McGurk illusion more frequently, no age-dependent change in the temporal boundaries of audiovisual speech binding was observed.

Assessing speech perception in children with hearing loss: what conventional clinical tools may miss.

OBJECTIVES: This study tested the hypothesis that word recognition in a complex, two-talker masker is more closely related to real-world speech perception for children with hearing loss than testing performed in quiet or steady-state noise. DESIGN: Sixteen school-age hearing aid users were tested on aided word recognition in noise or two-talker speech. Unaided estimates of speech perception in quiet were retrospectively obtained from the clinical record. Ten parents completed a questionnaire regarding their children's ease of communication and understanding in background noise. RESULTS: Unaided performance in quiet was correlated with aided performance in competing noise, but not in two-talker speech. Only results in the two-talker masker were correlated with parental reports of their children's functional hearing abilities. CONCLUSIONS: Speech perception testing in a complex background such as two-talker speech may provide a more accurate predictor of the communication challenges of children with hearing loss than testing in steady noise or quiet.

Effects of nonlinear frequency compression on speech identification in children with hearing loss.

OBJECTIVES: This study evaluated effects of nonlinear frequency compression (NLFC) processing in children with hearing loss for consonant identification in quiet and for spondee identification in competing noise or speech. It was predicted that participants would benefit from NLFC for consonant identification in quiet when access to high-frequency information was critical, but that NLFC would be less beneficial, or even detrimental, when identification relied on mid-frequency cues. Further, it was hypothesized that NLFC could result in greater susceptibility to masking in the spondee task. The rationale for these predictions is that improved access to high-frequency information comes at the cost of decreased spectral resolution. DESIGN: A repeated-measures design compared speech-perception outcomes in 17 pediatric hearing aid users (9 to 17 years of age) wearing Naida V SP "laboratory" hearing aids with NLFC on and off. Data were also collected in an initial baseline session in which children wore their personal hearing aids. Children with a wide range of audiometric configurations were included, but all participants were full-time users of hearing aids with active NLFC. For each hearing aid condition, speech perception was assessed in the sound field by using a closed-set 12-alternative consonant-vowel identification measure in quiet, and a closed-set four-alternative spondee-identification measure in a speech-shaped noise or in a two-talker speech masker. RESULTS: No significant differences in performance were observed between laboratory hearing aid conditions with NLFC activated or deactivated for either speech-perception measure. An unexpected finding was that the majority of participants had no difficulty identifying the high-frequency consonant /s/ even when NLFC was deactivated. Investigation into individual differences revealed that subjects with a greater difference in audible bandwidth with NLFC on versus NLFC off were less likely to demonstrate improvements in high-frequency consonant identification in quiet, but were more likely to demonstrate improvements in spondee identification in speech-shaped noise. Group results observed in the initial baseline assessment using personal aids fitted with more aggressive NLFC settings than used in laboratory aids indicated better consonant identification accuracy in quiet. However, spondee identification in the two-talker masker was poorer with personal compared with laboratory hearing aids. Comparisons across personal and laboratory hearing aids are tempered, however, by the potential of an order effect. CONCLUSIONS: The observation of comparable performance with NLFC on and NLFC off in the laboratory aids provides evidence that NLFC is neither detrimental nor advantageous when modest in strength. Results with personal hearing aids fitted with stronger compression settings than laboratory aids (NLFC on) highlight the critical need for further research to determine the impact of NLFC processing on speech perception for a wider range of speech-perception measures and compression settings.

Influence of hearing loss on children's identification of spondee words in a speech-shaped noise or a two-talker masker.

OBJECTIVE: This study evaluated the influence of hearing loss on children's speech-perception abilities in a speech-shaped noise or a two-talker masker. For both masker conditions, it was predicted that children with hearing loss would require a more advantageous signal to noise ratio (SNR) than children with normal hearing to achieve the same criterion level of performance. However, it was hypothesized that the performance gap between children with hearing loss and children with normal hearing would be larger in the two-talker than in the speech-shaped noise masker. DESIGN: A repeated-measures design compared the spondee identification performance of two age groups of children with hearing loss (9-11 and 13-17 years of age) and a group of children with normal hearing (9-11 years of age) in continuous speech-shaped noise or a two-talker masker. Estimates of the SNR required for 70.7% correct spondee identification were obtained using an adaptive, four-alternative, forced-choice procedure. Children were tested in the sound field. Children with hearing loss wore their personal hearing aids at their regular settings during testing. RESULTS: Both groups of children with hearing loss performed more poorly than children with normal hearing in the speech-shaped noise masker. Younger children required an additional 2.7 dB SNR and older children required an additional 4.7 dB SNR to achieve the same level of performance as children with normal hearing. This disadvantage decreased to 8.1 dB for both age groups of children with hearing loss in the two-talker masker. For children with hearing loss, degree of hearing loss was significantly correlated with performance in the speech-shaped noise masker, but not in the two-talker masker. CONCLUSIONS: A larger performance gap was observed between children with hearing loss and children with normal hearing in competing speech than in steady state noise. These results are consistent with the hypothesis that hearing loss influenced children's perceptual processing abilities.

Developmental changes in the multisensory temporal binding window persist into adolescence.

We live in a world rich in sensory information, and consequently the brain is challenged with deciphering which cues from the various sensory modalities belong together. Determinations regarding the relatedness of sensory information appear to be based, at least in part, on the spatial and temporal relationships between the stimuli. Stimuli that are presented in close spatial and temporal correspondence are more likely to be associated with one another and thus 'bound' into a single perceptual entity. While there is a robust literature delineating behavioral changes in perception induced by multisensory stimuli, maturational changes in multisensory processing, particularly in the temporal realm, are poorly understood. The current study examines the developmental progression of multisensory temporal function by analyzing responses on an audiovisual simultaneity judgment task in 6- to 23-year-old participants. The overarching hypothesis for the study was that multisensory temporal function will mature with increasing age, with the developmental trajectory for this change being the primary point of inquiry. Results indeed reveal an age-dependent decrease in the size of the 'multisensory temporal binding window', the temporal interval within which multisensory stimuli are likely to be perceptually bound, with changes occurring over a surprisingly protracted time course that extends into adolescence.