No evidence for a benefit from masker harmonicity in the perception of speech in noise.

When assessing the intelligibility of speech embedded in background noise, maskers with a harmonic spectral structure have been found to be much less detrimental to performance than noise-based interferers. While spectral "glimpsing" in between the resolved masker harmonics and reduced envelope modulations of harmonic maskers have been shown to contribute, this effect has primarily been attributed to the proposed ability of the auditory system to cancel harmonic maskers from the signal mixture. Here, speech intelligibility in the presence of harmonic and inharmonic maskers with similar spectral glimpsing opportunities and envelope modulation spectra was assessed to test the theory of harmonic cancellation. Speech reception thresholds obtained from normal-hearing listeners revealed no effect of masker harmonicity, neither for maskers with static nor dynamic pitch contours. The results show that harmonicity, or time-domain periodicity, as such, does not aid the segregation of speech and masker. Contrary to what might be assumed, this also implies that the saliency of the masker pitch did not affect auditory grouping. Instead, the current data suggest that the reduced masking effectiveness of harmonic sounds is due to the regular spacing of their spectral components.

Aging Makes the Heart Grow Fonder: Age Influences Hearing Ability and Interactions between Psychological Phenomena in Patients with Chronic Tinnitus.

(1) Background: Risk factors for chronic tinnitus comprise interactions of individuals' hearing difficulties and psychological distress-including anxiety, depression, and perceived stress levels. Both groups of factors likely become more pronounced with age, although mixed literature has also suggested increases in psychological resilience over time. To this end, only a few studies have delineated direct and indirect effects of age on audiological and psychological variables that might influence tinnitus-related distress in patients with chronic tinnitus. (2) Methods: N = 678 patients with chronic tinnitus completed audiological assessments alongside self-report measures of psychological and tinnitus-related distress. Path analyses investigated the effect of age on patients' tinnitus-related distress via both audiological and psychological variables. (3) Results: Age was significantly associated with both hearing ability and psychological distress indices, with perceived stress and anxiety decreasing with aging. Different mediation models revealed that the association between age and tinnitus-related distress was mediated completely by hearing ability and partly by perceived stress and anxiety. (4) Conclusions: Whilst interactions of individuals' hearing ability and psychological distress levels maintain tinnitus-related distress across the age span, the weighting of these factors may shift with age. Treatment approaches should consider hearing ability across the lifespan. Psychological factors should be individually conceptualized, considering both distress-related and potential resilience factors in old age.

A direct comparison of voice pitch processing in acoustic and electric hearing.

In single-sided deafness patients fitted with a cochlear implant (CI) in the affected ear and preserved normal hearing in the other ear, acoustic and electric hearing can be directly compared without the need for an external control group. Although poor pitch perception is a crucial limitation when listening through CIs, it remains unclear how exactly the cortical processing of pitch information differs between acoustic and electric hearing. Hence, we separately presented both ears of 20 of these patients with vowel sequences in which the pitch contours were either repetitive or variable, while simultaneously recording functional near-infrared spectroscopy (fNIRS) and EEG data. Overall, the results showed smaller and delayed auditory cortex activity in electric hearing, particularly for the P2 event-related potential component, which appears to reflect the processing of voice pitch information. Both the fNIRS data and EEG source reconstructions furthermore showed that vowel sequences with variable pitch contours evoked additional activity in posterior right auditory cortex in electric but not acoustic hearing. This surprising discrepancy demonstrates, firstly, that the acoustic detail transmitted by CIs is sufficient to distinguish between speech sounds that only vary regarding their pitch information. Secondly, the absence of a condition difference when stimulating the normal-hearing ears suggests a saturation of cortical activity levels following unilateral deafness. Taken together, these results provide strong evidence in favour of using CIs in this patient group.

Cortical activity evoked by voice pitch changes: A combined fNIRS and EEG study.

Functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) data were simultaneously obtained from normal-hearing listeners presented with continuous natural vowel sequences to study the interrelation of the haemodynamic and electrophysiological cortical responses evoked by voice pitch changes. fNIRS topographies and distributed ERP source reconstructions both indicated additional activity in the right superior temporal cortex if the prosodic contours varied between successive vowels, rather than being the same throughout the sequences. The source-level ERPs furthermore revealed two temporally and spatially separable adaptation processes in superior temporal cortex: Firstly, the early P1 component was bilaterally attenuated when vowels with the same prosodic contours were presented repeatedly, reflecting sensory adaptation. Secondly, the later P2 and sustained potential components were smaller in the right hemisphere during sequences without prosodic changes, which is taken to represent an attention-based adaptation effect. The present results demonstrate the convergence of both methods and demonstrate which ERPs underlie the right-lateralised activity in superior temporal cortex evoked in response to pitch changes that has been observed in many neuroimaging studies.

Auditory cortex activity measured using functional near-infrared spectroscopy (fNIRS) appears to be susceptible to masking by cortical blood stealing.

To validate the use of functional near-infrared spectroscopy (fNIRS) in auditory perception experiments, combined fNIRS and electroencephalography (EEG) data were obtained from normal-hearing subjects passively listening to speech-like stimuli without linguistic content. The fNIRS oxy-haemoglobin (HbO) results were found to be inconsistent with the deoxy-haemoglobin (HbR) and EEG data, as they were dominated by increasingly more negative responses along a diagonal axis running in posterior-superior to anterior-inferior direction. This large-scale bilateral gradient in the HbO data masked the right-lateralised neural activity in the auditory cortex that was clearly evident in the HbR data and EEG source reconstructions and is most likely due to cerebral blood stealing. When the subjects were subsequently split into subgroups with more positive or more negative HbO responses in the right auditory cortex, the former group surprisingly showed smaller event-related potentials and increased EEG alpha power, indicating reduced attention and vigilance. These findings thus suggest that positive HbO responses in the auditory cortex may not necessarily be a favourable result when investigating auditory perception using fNIRS. More generally, the results show that the interpretation of fNIRS HbO signals can be misleading and demonstrate the benefits of combined fNIRS-EEG analyses.

Predicting the effects of periodicity on the intelligibility of masked speech: An evaluation of different modelling approaches and their limitations.

Four existing speech intelligibility models with different theoretical assumptions were used to predict previously published behavioural data. Those data showed that complex tones with pitch-related periodicity are far less effective maskers of speech than aperiodic noise. This so-called masker-periodicity benefit (MPB) far exceeded the fluctuating-masker benefit (FMB) obtained from slow masker envelope fluctuations. In contrast, the normal-hearing listeners hardly benefitted from periodicity in the target speech. All tested models consistently underestimated MPB and FMB, while most of them also overestimated the intelligibility of vocoded speech. To understand these shortcomings, the internal signal representations of the models were analysed in detail. The best-performing model, the correlation-based version of the speech-based envelope power spectrum model (sEPSMcorr), combined an auditory processing front end with a modulation filterbank and a correlation-based back end. This model was then modified to further improve the predictions. The resulting second version of the sEPSMcorr outperformed the original model with all tested maskers and accounted for about half the MPB, which can be attributed to reduced modulation masking caused by the periodic maskers. However, as the sEPSMcorr2 failed to account for the other half of the MPB, the results also indicate that future models should consider the contribution of pitch-related effects, such as enhanced stream segregation, to further improve their predictive power.

The role of envelope periodicity in the perception of masked speech with simulated and real cochlear implants.

In normal hearing, complex tones with pitch-related periodic envelope modulations are far less effective maskers of speech than aperiodic noise. Here, it is shown that this masker-periodicity benefit is diminished in noise-vocoder simulations of cochlear implants (CIs) and further reduced with real CIs. Nevertheless, both listener groups still benefitted significantly from masker periodicity, despite the lack of salient spectral pitch cues. The main reason for the smaller effect observed in CI users is thought to be an even stronger channel interaction than in the CI simulations, which smears out the random envelope modulations that are characteristic for aperiodic sounds. In contrast, neither interferers that were amplitude-modulated at a rate of 10 Hz nor maskers with envelopes specifically designed to reveal the target speech enabled a masking release in CI users. Hence, even at the high signal-to-noise ratios at which they were tested, CI users can still exploit pitch cues transmitted by the temporal envelope of a non-speech masker, whereas slow amplitude modulations of the masker envelope are no longer helpful.

Effects of acoustic periodicity, intelligibility, and pre-stimulus alpha power on the event-related potentials in response to speech.

Magneto- and electroencephalographic (M/EEG) signals in response to acoustically degraded speech have been examined by several recent studies. Unambiguously interpreting the results is complicated by the fact that speech signal manipulations affect acoustics and intelligibility alike. In the current EEG study, the acoustic properties of the stimuli were altered and the trials were sorted according to the correctness of the listeners' spoken responses to separate out these two factors. Firstly, more periodicity (i.e. voicing) rendered the event-related potentials (ERPs) more negative during the first second after sentence onset, indicating a greater cortical sensitivity to auditory input with a pitch. Secondly, we observed a larger contingent negative variation (CNV) during sentence presentation when the subjects could subsequently repeat more words correctly. Additionally, slow alpha power (7-10Hz) before sentences with the least correctly repeated words was increased, which may indicate that subjects have not been focussed on the upcoming task.

Are the literacy difficulties that characterize developmental dyslexia associated with a failure to integrate letters and speech sounds?

The 'automatic letter-sound integration hypothesis' (Blomert, ) proposes that dyslexia results from a failure to fully integrate letters and speech sounds into automated audio-visual objects. We tested this hypothesis in a sample of English-speaking children with dyslexic difficulties (N = 13) and samples of chronological-age-matched (CA; N = 17) and reading-age-matched controls (RA; N = 17) aged 7-13 years. Each child took part in two priming experiments in which speech sounds were preceded by congruent visual letters (congruent condition) or Greek letters (baseline). In a behavioural experiment, responses to speech sounds in the two conditions were compared using reaction times. These data revealed faster reaction times in the congruent condition in all three groups. In a second electrophysiological experiment, responses to speech sounds in the two conditions were compared using event-related potentials (ERPs). These data revealed a significant effect of congruency on (1) the P1 ERP over left frontal electrodes in the CA group and over fronto-central electrodes in the dyslexic group and (2) the P2 ERP in the dyslexic and RA control groups. These findings suggest that our sample of English-speaking children with dyslexic difficulties demonstrate a degree of letter-sound integration that is appropriate for their reading level, which challenges the letter-sound integration hypothesis.

Effects of acoustic periodicity and intelligibility on the neural oscillations in response to speech.

Although several studies have investigated neural oscillations in response to acoustically degraded speech, it is still a matter of debate which neural frequencies reflect speech intelligibility. Part of the problem is that effects of acoustics and intelligibility have so far not been considered independently. In the current electroencephalography (EEG) study the amount of acoustic periodicity (i.e. the amount of time the stimulus sentences were voiced) was manipulated, while using the listeners' spoken responses to control for differences in intelligibility. Firstly, the total EEG power changes in response to completely aperiodic (noise-vocoded) speech and speech with a natural mix of periodicity and aperiodicity were almost identical, while an increase in theta power (5-6.3Hz) and a trend for less beta power (11-18Hz) were observed in response to completely periodic speech. These two effects are taken to indicate an information processing conflict caused by the unnatural acoustic properties of the stimuli, and that the subjects may have internally rehearsed the sentences as a result of this. Secondly, we separately investigated effects of intelligibility by sorting the trials in the periodic condition according to the listeners' spoken responses. The comparison of intelligible and largely unintelligible trials revealed that the total EEG power in the delta band (1.7-2.7Hz) was markedly increased during the second half of the intelligible trials, which suggests that delta oscillations are an indicator of successful speech understanding.

Auditory event-related responses to diphthongs in different attention conditions.

The modulation of auditory event-related potentials (ERP) by attention generally results in larger amplitudes when stimuli are attended. We measured the P1-N1-P2 acoustic change complex elicited with synthetic overt (second formant, F2Δ=1000Hz) and subtle (F2Δ=100Hz) diphthongs, while subjects (i) attended to the auditory stimuli, (ii) ignored the auditory stimuli and watched a film, and (iii) diverted their attention to a visual discrimination task. Responses elicited by diphthongs where F2 values rose and fell were found to be different and this precluded their combined analysis. Multivariate analysis of ERP components from the rising F2 changes showed main effects of attention on P2 amplitude and latency, and N1-P2 amplitude. P2 amplitude decreased by 40% between the attend and ignore conditions, and by 60% between the attend and divert conditions. The effect of diphthong magnitude was significant for components from a broader temporal window which included P1 latency and N1 amplitude. N1 latency did not vary between attention conditions, a finding that may be related to stimulation with a continuous vowel. These data show that a discernible P1-N1-P2 response can be observed to subtle vowel quality transitions, even when the attention of a subject is diverted to an unrelated visual task.

The role of periodicity in perceiving speech in quiet and in background noise.

The ability of normal-hearing listeners to perceive sentences in quiet and in background noise was investigated in a variety of conditions mixing the presence and absence of periodicity (i.e., voicing) in both target and masker. Experiment 1 showed that in quiet, aperiodic noise-vocoded speech and speech with a natural amount of periodicity were equally intelligible, while fully periodic speech was much harder to understand. In Experiments 2 and 3, speech reception thresholds for these targets were measured in the presence of four different maskers: speech-shaped noise, harmonic complexes with a dynamically varying F0 contour, and 10 Hz amplitude-modulated versions of both. For experiment 2, results of experiment 1 were used to identify conditions with equal intelligibility in quiet, while in experiment 3 target intelligibility in quiet was near ceiling. In the presence of a masker, periodicity in the target speech mattered little, but listeners strongly benefited from periodicity in the masker. Substantial fluctuating-masker benefits required the target speech to be almost perfectly intelligible in quiet. In summary, results suggest that the ability to exploit periodicity cues may be an even more important factor when attempting to understand speech embedded in noise than the ability to benefit from masker fluctuations.