Auditory detection learning is accompanied by plasticity in the auditory evoked potential.

Auditory detection can improve with practice. These improvements are often assumed to arise from selective attention processes, but longer-term plasticity as a result of training may also play a role. Here, listeners were trained to detect either an 861-Hz or 1058-Hz tone (counterbalanced across participants) presented in noise at SNRs varying from -10 to -24 dB. On the following day, they were tasked with detecting 861-Hz and 1058-Hz tones at an SNR of -21 dB. In between blocks of this active task, EEG was recorded during passive presentation of trained and untrained frequency tones in quiet. Detection accuracy and confidence ratings were higher for trials at listeners' trained, than untrained-frequency (i.e., learning occurred). During passive exposure to sounds, the P2 component of the auditory evoked potential (∼150 - 200 ms post tone onset) was larger in amplitude for the trained compared to the untrained frequency. An analysis of global field power similarly yielded a stronger response for trained tones in the P2 time window. These effects were obtained during passive exposure, suggesting that training induced improvements in detection are not solely related to changes in selective attention. Rather, there may be an important role for changes in the long-term neural representations of sounds.

Sustained frontal midline theta enhancements during effortful listening track working memory demands.

Recent studies demonstrate that frontal midline theta power (4-8 Hz) enhancements in the electroencephalogram (EEG) relate to effortful listening. It has been proposed that these enhancements reflect working memory demands. Here, the need to retain auditory information in working memory was manipulated in a 2-interval 2-alternative forced-choice delayed pitch discrimination task ("Which interval contained the higher pitch?"). On each trial, two square wave stimuli differing in pitch at an individual's ∼70.7% correct threshold were separated by a 3-second ISI. In a 'Roving' condition, the lowest pitch stimulus was randomly selected on each trial (uniform distribution from 840 to 1160 Hz). In a 'Fixed' condition, the lowest pitch was always 979 Hz. Critically, the 'Fixed' condition allowed one to know the correct response immediately following the first stimulus (e.g., if the first stimulus is 979 Hz, the second must be higher). In contrast, the 'Roving' condition required retention of the first tone for comparison to the second. Frontal midline theta enhancements during the ISI were only observed for the 'Roving' condition. Alpha (8-13 Hz) enhancements were apparent during the ISI, but did not differ significantly between conditions. Since conditions were matched for accuracy at threshold, results suggest that frontal midline theta enhancements will not always accompany difficult listening. Mixed results in the literature regarding frontal midline theta enhancements may be related to differences between tasks in regards to working memory demands. Alpha enhancements may reflect task general effortful listening processes.

Theta- and alpha-power enhancements in the electroencephalogram as an auditory delayed match-to-sample task becomes impossibly difficult.

Recent studies have related enhancements of theta- (∼4-8 Hz) and alpha-power (∼8-13 Hz) to listening effort based on parallels between enhancement and task difficulty. In contrast, nonauditory works demonstrate that, although increases in difficulty are initially accompanied by increases in effort, effort decreases when a task becomes so difficult as to exceed one's ability. Given the latter, we examined whether theta- and alpha-power enhancements thought to reflect effortful listening show a quadratic trend across levels of listening difficulty from impossible to easy. Listeners (n = 14) performed an auditory delayed match-to-sample task with frequency-modulated tonal sweeps under impossible, difficult (at ∼70.7% correct threshold), and easy (well above threshold) conditions. Frontal midline theta-power and posterior alpha-power enhancements were observed during the retention interval, with greatest enhancement in the difficult condition. Independent component-based analyses of data suggest that theta-power enhancements stemmed from medial frontal sources at or near the anterior cingulate cortex, whereas alpha-power effects stemmed from occipital cortices. Results support the notion that theta- and alpha-power enhancements reflect effortful cognitive processes during listening, related to auditory working memory and the inhibition of task-irrelevant cortical processing regions, respectively. Theta- and alpha-power dynamics can be used to characterize the cognitive processes that make up effortful listening, including qualitatively different types of listening effort.

Modeling Two-Channel Speech Processing With the EPIC Cognitive Architecture.

An important application of cognitive architectures is to provide human performance models that capture psychological mechanisms in a form that can be "programmed" to predict task performance of human-machine system designs. Although many aspects of human performance have been successfully modeled in this approach, accounting for multitalker speech task performance is a novel problem. This article presents a model for performance in a two-talker task that incorporates concepts from psychoacoustics, in particular, masking effects and stream formation.

Enhanced auditory spatial performance using individualized head-related transfer functions: An event-related potential study.

This study examined event-related potential (ERP) correlates of auditory spatial benefits gained from rendering sounds with individualized head-related transfer functions (HRTFs). Noise bursts with identical virtual elevations (0°-90°) were presented back-to-back in 5-10 burst "runs" in a roving oddball paradigm. Detection of a run's start (i.e., elevation change detection) was enhanced when bursts were rendered with an individualized compared to a non-individualized HRTF. ERPs showed increased P3 amplitudes to first bursts of a run in the individualized HRTF condition. Condition differences in P3 amplitudes and behavior were positively correlated. Data suggests that part of the individualization benefit reflects post-sensory processes.

Enhancing listener strategies using a payoff matrix in speech-on-speech masking experiments.

Speech recognition was measured as a function of the target-to-masker ratio (TMR) with syntactically similar speech maskers. In the first experiment, listeners were instructed to report keywords from the target sentence. Data averaged across listeners showed a plateau in performance below 0 dB TMR when masker and target sentences were from the same talker. In this experiment, some listeners tended to report the target words at all TMRs in accordance with the instructions, while others reported keywords from the louder of the sentences, contrary to the instructions. In the second experiment, stimuli were the same as in the first experiment, but listeners were also instructed to avoid reporting the masker keywords, and a payoff matrix penalizing masker keywords and rewarding target keywords was used. In this experiment, listeners reduced the number of reported masker keywords, and increased the number of reported target keywords overall, and the average data showed a local minimum at 0 dB TMR with same-talker maskers. The best overall performance with a same-talker masker was obtained with a level difference of 9 dB, where listeners achieved near perfect performance when the target was louder, and at least 80% correct performance when the target was the quieter of the two sentences.

Frontal midline θ power as an index of listening effort.

Attempts to identify physiological correlates of listening effort have mainly focused on peripheral measures (e.g. pupillometry) and auditory-evoked/event-related potentials. Although nonauditory studies have suggested that sustained time-frequency electroencephalographic (EEG) features in the θ-band (4-7 Hz) are correlated with domain-general mental effort, little work has characterized such features during effortful listening. Here, high-density EEG data was collected while listeners performed a sentence-recognition task in noise, the signal-to-noise ratio (SNR) of which varied across blocks. Frontal midline θ (Fmθ), largely driven by sources localized in or near the medial frontal cortex, showed greater power with decreasing SNR and was positively correlated with self-reports of effort. Increased Fmθ was present before speech onset and during speech presentation. Fmθ power also differed across SNRs when including only trials in which all words were recognized, suggesting that the effects were unrelated to performance differences. Results suggest that frontal cortical networks play a larger role in listening as acoustic signals are increasingly masked. Further, sustained time-frequency EEG features may usefully supplement previously used peripheral and event-related potential measures in psychophysiological investigations of effortful listening.

Perceiving sequential dependencies in auditory streams.

This study examined the ability of human listeners to detect the presence and judge the strength of a statistical dependency among the elements comprising sequences of sounds. The statistical dependency was imposed by specifying transition matrices that determined the likelihood of occurrence of the sound elements. Markov chains were constructed from these transition matrices having states that were pure tones/noise bursts that varied along the stimulus dimensions of frequency and/or interaural time difference. Listeners reliably detected the presence of a statistical dependency in sequences of sounds varying along these stimulus dimensions. Furthermore, listeners were able to discriminate the relative strength of the dependency in pairs of successive sound sequences. Random variation along an irrelevant stimulus dimension had small but significant adverse effects on performance. A much greater decrement in performance was found when the sound sequences were concurrent. Likelihood ratios were computed based on the transition matrices to specify Ideal Observer performance for the experimental conditions. Preliminary modeling efforts were made based on degradations of Ideal Observer performance intended to represent human observer limitations. This experimental approach appears to be useful for examining auditory "stream" formation and maintenance over time based on the predictability of the constituent sound elements.

Spatial release from masking as a function of the spectral overlap of competing talkers.

This study tested the hypothesis that the reduced spatial release from speech-on-speech masking typically observed in listeners with sensorineural hearing loss results from increased energetic masking. Target sentences were presented simultaneously with a speech masker, and the spectral overlap between the pair (and hence the energetic masking) was systematically varied. The results are consistent with increased energetic masking in listeners with hearing loss that limits performance when listening in speech mixtures. However, listeners with hearing loss did not exhibit reduced spatial release from masking when stimuli were filtered into narrow bands.

An energetic limit on spatial release from masking.

This study tested the hypothesis that energetic masking limits the benefits obtained from spatial separation in multiple-talker listening situations, particularly for listeners with sensorineural hearing loss. A speech target was presented simultaneously with two or four speech maskers. The target was always presented diotically, and the maskers were either presented diotically or dichotically. In dichotic configurations, the maskers were symmetrically placed by introducing interaural time differences (ITDs) or infinitely large interaural level differences (ILDs; monaural presentation). Target-to-masker ratios for 50 % correct were estimated. Thresholds in all separated conditions were poorer in listeners with hearing loss than listeners with normal hearing. Moreover, for a given listener, thresholds were similar for conditions with the same number of talkers per ear (e.g., ILD with four talkers equivalent to ITD with two talkers) and hence the same energetic masking. The results are consistent with the idea that increased energetic masking, rather than a specific spatial deficit, may limit performance for hearing-impaired listeners in spatialized speech mixtures.

Suitable reverberation times for halls for rock and pop music.

The existing body of literature regarding the acoustic design of concert halls has focused almost exclusively on classical music, although there are many more performances of popular music, including rock and pop. Objective measurements were made of the acoustics of 20 rock music venues in Denmark and a questionnaire was used in a subjective assessment of those venues with professional rock musicians and sound engineers as expert listeners. Correlations between the measurements show that clarity, including bass frequencies down to 63 Hz, is important for the general impression of the acoustics of the hall. The best-rated halls in the study have reverberation times that are approximately frequency independent from 0.6 to 1.2 s for hall volumes from 1000 to 6000 m(3). The worst rated halls in the study had significantly higher reverberation times in the 63 and 125 Hz bands. Since most audiences at rock concerts are standing, absorption coefficients were measured with a standing audience from 63 Hz to 4 kHz. These measurements showed that a standing audience absorbs about five times as much energy in mid-/high-frequency bands as in low-frequency bands.

Binaural processing of modulated interaural level differences.

Two experiments are presented that measure the acuity of binaural processing of modulated interaural level differences (ILDs) using psychoacoustic methods. In both experiments, dynamic ILDs were created by imposing an interaurally antiphasic sinusoidal amplitude modulation (AM) signal on high-frequency carriers, which were presented over headphones. In the first experiment, the sensitivity to dynamic ILDs was measured as a function of the modulation frequency using puretone, and interaurally correlated and uncorrelated narrow-band noise carriers. The intrinsic interaural level fluctuations of the uncorrelated noise carriers raised the ILD modulation detection thresholds with respect to the pure-tone carriers. The diotic fluctuations of the correlated noise carriers also caused a small increase in the thresholds over the pure-tone carriers, particularly with low ILD modulation frequencies. The second experiment investigated the modulation frequency selectivity in dynamic ILD processing by imposing an interaurally uncorrelated bandpass noise AM masker in series with the interaurally antiphasic AM signal on a pure-tone carrier. By varying the masker center frequencies relative to the signal modulation frequency, broadly tuned, bandpass-shaped patterns were obtained. Simulations with an existing binaural model show that a low-pass filter to limit the binaural temporal resolution is not sufficient to predict the results of the experiments.