Molecular analysis of individual differences in talker search at the cocktail-party.

A molecular (trial-by-trial) analysis of data from a cocktail-party, target-talker search task was used to test two general classes of explanations accounting for individual differences in listener performance: cue weighting models for which errors are tied to the speech features talkers have in common with the target and internal noise models for which errors are largely independent of these features. The speech of eight different talkers was played simultaneously over eight different loudspeakers surrounding the listener. The locations of the eight talkers varied at random from trial to trial. The listener's task was to identify the location of a target talker with which they had previously been familiarized. An analysis of the response counts to individual talkers showed predominant confusion with one talker sharing the same fundamental frequency and timbre as the target and, secondarily, other talkers sharing the same timbre. The confusions occurred for a roughly constant 31% of all of the trials for all of the listeners. The remaining errors were uniformly distributed across the remaining talkers and responsible for the large individual differences in performances observed. The results are consistent with a model in which largely stimulus-independent factors (internal noise) are responsible for the wide variation in performance across listeners.

The Listener Effect in Multitalker Speech Segregation and Talker Identification.

Over six decades ago, Cherry (1953) drew attention to what he called the "cocktail-party problem"; the challenge of segregating the speech of one talker from others speaking at the same time. The problem has been actively researched ever since but for all this time one observation has eluded explanation. It is the wide variation in performance of individual listeners. That variation was replicated here for four major experimental factors known to impact performance: differences in task (talker segregation vs. identification), differences in the voice features of talkers (pitch vs. location), differences in the voice similarity and uncertainty of talkers (informational masking), and the presence or absence of linguistic cues. The effect of these factors on the segregation of naturally spoken sentences and synthesized vowels was largely eliminated in psychometric functions relating the performance of individual listeners to that of an ideal observer, d'ideal. The effect of listeners remained as differences in the slopes of the functions (fixed effect) with little within-listener variability in the estimates of slope (random effect). The results make a case for considering the listener a factor in multitalker segregation and identification equal in status to any major experimental variable.

Additivity of segregation cues in simulated cocktail-party listening.

An approach is borrowed from Measurement Theory [Krantz et al. (1971). Foundations of Measurement (Academic, New York), Vol. 1] to evaluate the interaction of voice fundamental frequency and spatial cues in the segregation of talkers in simulated cocktail-party listening. The goal is to find a mathematical expression whereby the combined effect of cues can be simply related to their individual effects. On each trial, the listener judged whether an interleaved sequence of four vowel triplets (heard over headphones) were spoken by the same (MMM) or different (FMF) talkers. The talkers had nominally different fundamental frequencies and spoke from nominally different locations (simulated using head-related transfer functions). Natural variation in these cues was simulated by adding a small, random perturbation to the nominal values independently for each vowel on each trial. Psychometric functions (PFs) relating d' performance to the difference in nominal values were obtained for the cues presented individually and in combination. The results revealed a synergistic interaction of cues wherein the PFs for cues presented in combination exceeded the simple vector sum of the PFs for the cues presented individually. The results are discussed in terms of their implications for possible emergent properties of cues affecting performance in simulated cocktail-party listening.

A test of model classes accounting for individual differences in the cocktail-party effect.

Listeners differ widely in the ability to follow the speech of a single talker in a noisy crowd-what is called the cocktail-party effect. Differences may arise for any one or a combination of factors associated with auditory sensitivity, selective attention, working memory, and decision making required for effective listening. The present study attempts to narrow the possibilities by grouping explanations into model classes based on model predictions for the types of errors that distinguish better from poorer performing listeners in a vowel segregation and talker identification task. Two model classes are considered: those for which the errors are predictably tied to the voice variation of talkers (decision weight models) and those for which the errors occur largely independently of this variation (internal noise models). Regression analyses of trial-by-trial responses, for different tasks and task demands, show overwhelmingly that the latter type of error is responsible for the performance differences among listeners. The results are inconsistent with models that attribute the performance differences to differences in the reliance listeners place on relevant voice features in this decision. The results are consistent instead with models for which largely stimulus-independent, stochastic processes cause information loss at different stages of auditory processing.

Auditory preference of children with autism spectrum disorders.

Research on children with autism spectrum disorders suggests differences from neurotypical children in the preference for 'social' versus 'nonsocial' sounds. Conclusions have been based largely on the use of head-turn methodology which has various limitations as a means of establishing auditory preference. In the present study, preference was assessed by measuring the frequency with which children pressed a button to hear different sounds using an interactive toy. Contrary to prior results, both groups displayed a strong preference for the highly social sounds. These findings have implications for approaches to language intervention and for theoretical debates regarding social motivation.

A Detection-Theoretic Analysis of Auditory Streaming and Its Relation to Auditory Masking.

Research on hearing has long been challenged with understanding our exceptional ability to hear out individual sounds in a mixture (the so-called cocktail party problem). Two general approaches to the problem have been taken using sequences of tones as stimuli. The first has focused on our tendency to hear sequences, sufficiently separated in frequency, split into separate cohesive streams (auditory streaming). The second has focused on our ability to detect a change in one sequence, ignoring all others (auditory masking). The two phenomena are clearly related, but that relation has never been evaluated analytically. This article offers a detection-theoretic analysis of the relation between multitone streaming and masking that underscores the expected similarities and differences between these phenomena and the predicted outcome of experiments in each case. The key to establishing this relation is the function linking performance to the information divergence of the tone sequences, DKL (a measure of the statistical separation of their parameters). A strong prediction is that streaming and masking of tones will be a common function of DKL provided that the statistical properties of sequences are symmetric. Results of experiments are reported supporting this prediction.

Individual Differences in Behavioural Decision Weights Related to Irregularities in Cochlear Mechanics.

An unexpected finding of previous psychophysical studies is that listeners show highly replicable, individualistic patterns of decision weights on frequencies affecting their performance in spectral discrimination tasks--what has been referred to as individual listening styles. We, like many other researchers, have attributed these listening styles to peculiarities in how listeners attend to sounds, but we now believe they partially reflect irregularities in cochlear micromechanics modifying what listeners hear. The most striking evidence for cochlear irregularities is the presence of low-level spontaneous otoacoustic emissions (SOAEs) measured in the ear canal and the systematic variation in stimulus frequency otoacoustic emissions (SFOAEs), both of which result from back-propagation of waves in the cochlea. SOAEs and SFOAEs vary greatly across individual ears and have been shown to affect behavioural thresholds, behavioural frequency selectivity and judged loudness for tones. The present paper reports pilot data providing evidence that SOAEs and SFOAEs are also predictive of the relative decision weight listeners give to a pair of tones in a level discrimination task. In one condition the frequency of one tone was selected to be near that of an SOAE and the frequency of the other was selected to be in a frequency region for which there was no detectable SOAE. In a second condition the frequency of one tone was selected to correspond to an SFOAE maximum, the frequency of the other tone, an SFOAE minimum. In both conditions a statistically significant correlation was found between the average relative decision weight on the two tones and the difference in OAE levels.

Estimates of decision weights and internal noise in the masked discrimination of vowels by young and elderly adults.

Gilbertson and Lutfi [(2014). Hear. Res. 317, 9-14] report that older adults perform similarly to younger adults on a masked vowel discrimination task when the fundamental frequency (F0) of target and masker vowel differ but that the older adults perform more poorly when the F0 is the same. This paper presents an alternative analysis of those data to support the conclusion that the poorer performance of older adults is due to an increase in the decision weight on masker reflecting poorer selective attention in noise of older adults.

Auditory streaming of tones of uncertain frequency, level, and duration.

Stimulus uncertainty is known to critically affect auditory masking, but its influence on auditory streaming has been largely ignored. Standard ABA-ABA tone sequences were made increasingly uncertain by increasing the sigma of normal distributions from which the frequency, level, or duration of tones were randomly drawn. Consistent with predictions based on a model of masking by Lutfi, Gilbertson, Chang, and Stamas [J. Acoust. Soc. Am. 134, 2160-2170 (2013)], the frequency difference for which A and B tones formed separate streams increased as a linear function of sigma in tone frequency but was much less affected by sigma in tone level or duration.

Correlations of decision weights and cognitive function for the masked discrimination of vowels by young and old adults.

Older adults are often reported in the literature to have greater difficulty than younger adults understanding speech in noise [Helfer and Wilber (1988). J. Acoust. Soc. Am, 859-893]. The poorer performance of older adults has been attributed to a general deterioration of cognitive processing, deterioration of cochlear anatomy, and/or greater difficulty segregating speech from noise. The current work used perturbation analysis [Berg (1990). J. Acoust. Soc. Am., 149-158] to provide a more specific assessment of the effect of cognitive factors on speech perception in noise. Sixteen older (age 56-79 years) and seventeen younger (age 19-30 years) adults discriminated a target vowel masked by randomly selected masker vowels immediately preceding and following the target. Relative decision weights on target and maskers resulting from the analysis revealed large individual differences across participants despite similar performance scores in many cases. On the most difficult vowel discriminations, the older adult decision weights were significantly correlated with inhibitory control (Color Word Interference test) and pure-tone threshold averages (PTA). Young adult decision weights were not correlated with any measures of peripheral (PTA) or central function (inhibition or working memory).

The information-divergence hypothesis of informational masking.

In recent years there has been growing interest in masking that cannot be attributed to interactions in the cochlea-so--called informational masking (IM). Similarity in the acoustic properties of target and masker and uncertainty regarding the masker are the two major factors identified with IM. These factors involve quite different manipulations of signals and are believed to entail fundamentally different processes resulting in IM. Here, however, evidence is presented that these factors affect IM through their mutual influence on a single factor-the information divergence of target and masker given by Simpson-Fitter's da [Lutfi et al. (2012). J. Acoust. Soc. Am. 132, EL109-113]. Four experiments are described involving multitone pattern discrimination, multi-talker word recognition, sound-source identification, and sound localization. In each case standard manipulations of masker uncertainty and target-masker similarity (including the covariation of target-masker frequencies) are found to have the same effect on performance provided they produce the same change in da. The function relating d(') performance to da, moreover, appears to be linear with constant slope across listeners. The overriding dependence of IM on da is taken to reflect a general principle of perception that exploits differences in the statistical structure of signals to separate figure from ground.

A new approach to sound source segregation.

We rely critically on our ability to 'hear out' (segregate) individual sound sources in a mixture. Yet, despite its importance, little is known regarding this -ability. Perturbation analysis is a psychophysical method that has been successfully applied to related problems in vision [Murray, R.F. 2011. J. of Vision 11, 1-25]. Here the approach is adapted to audition. The application proceeds in three stages: First, simple speech and environmental sounds are synthesized according to a generative model of the sound--producing source. Second, listener decision strategy in segregating target from non--target (noise) sources is determined from decision weights (regression coefficients) relating listener judgments regarding the target to lawful perturbations in acoustic parameters, as dictated by the generative model. Third, factors limiting segregation are identified by comparing the obtained weights and residuals to those of a maximum-likelihood (ML) observer that optimizes segregation based on the equations of motion of the generating source. Here, the approach is applied to test between the two major models of sound source segregation; target enhancement versus noise cancellation. The results indicate a tendency of noise segregation to preempt target enhancement when the noise source is unchanging. However, the results also show individual differences in segregation strategy that are not evident in the measures of performance accuracy alone.

A detection-theoretic framework for modeling informational masking.

There has been growing interest in recent years in masking that appears to have its origin at a central level of the auditory nervous system--so-called informational masking (IM). Masker uncertainty and target-masker similarity have been identified as the two major factors affecting IM; however, no theoretical framework currently exists that would give precise meaning to these terms necessary to evaluate their relative importance or model their effects. The present paper offers a first attempt at such a framework constructed within the doctrines of the theory of signal detection.

Automated detection of alarm sounds.

Two approaches to the automated detection of alarm sounds are compared, one based on a change in overall sound level (RMS), the other a change in periodicity, as given by the power of the normalized autocorrelation function (PNA). Receiver operating characteristics in each case were obtained for different exemplars of four classes of alarm sounds (bells/chimes, buzzers/beepers, horns/whistles, and sirens) embedded in four noise backgrounds (cafeteria, park, traffic, and music). The results suggest that PNA combined with RMS may be used to improve current alarm-sound alerting technologies for the hard-of-hearing.

Spectral integration versus multiple looks in the sample discrimination of intensity.

A fundamental property of hearing is that signals become more detectable as their bandwidth is increased. Two models have been proposed to account for this result. The integration model assumes that detection is mediated by the output of a single frequency channel matched in bandwidth to the signal. The multiple-looks model assumes that detection is based on the combination of outputs from multiple channels matched to the individual frequencies of the signal. Results are reported supporting the integration model.

Discrimination of the spectral density of multitone complexes.

Spectral density (D), defined as the number of partials comprising a sound divided by its bandwidth, has been suggested as cue for the identification of the size and shape of sound sources. Few data are available, however, on the ability of listeners to discriminate differences in spectral density. In a cue-comparison, forced-choice procedure with feedback, three highly practiced listeners discriminated differences in the spectral density of multitone complexes varying in bandwidth (W = 500-1500 Hz), center frequency (f(c) = 500-2000 Hz), and number of tones (N = 6-31). To reduce extraneous cues for discrimination, the overall level of the complexes was roved, and the frequencies were drawn at random uniformly over a fixed bandwidth and center frequency for each presentation. Psychometric functions were obtained relating percent correct discrimination to ΔD in each condition. For D < 0.02 Hz(-1), the steepness of the functions remained constant across conditions, but for D > 0.02 Hz(-1), they increased with D. The increase, moreover, was accompanied by a reduction in the upper asymptote of the functions. The data were well fit by a model in which spectral density discrimination is determined by the frequency separation of components on an equivalent rectangular bandwidth scale, yielding a roughly constant Weber fraction of ΔD/D = 0.3.

Effect of decision weights and internal noise on the growth of d' with N.

A general finding of psychoacoustic studies is that detectability d' of a noisy signal grows less than optimally with the number N of independent observations of the signal. Competing accounts implicate internal noise common to all observations or nonoptimal decision weights given to observations. A discriminant analysis of listeners' trial-by-trial responses in a multitone level-discrimination task favored the latter account.

Modeling manner of contact in the synthesis of impact sounds for perceptual research.

Impact sounds synthesized according to a physical model have increasingly become the stimulus of choice in studies of sound source perception. Few studies, however, have incorporated manner of contact in their models because of the complexity of the mechanics involved. Here a simplified model of contact is described suitable for application to perceptual research. The results of the simplified model are shown to be in good agreement with those of more comprehensive numerical methods receiving prior acoustic validation [Chaigne and Lambourg, J. Acoust. Soc. Am. 109, 1422-1432 (2001)]. The advantages of the model for applications to perceptual research are discussed.

Auditory discrimination of force of impact.

The auditory discrimination of force of impact was measured for three groups of listeners using sounds synthesized according to first-order equations of motion for the homogenous, isotropic bar [Morse and Ingard (1968). Theoretical Acoustics pp. 175-191]. The three groups were professional percussionists, nonmusicians, and individuals recruited from the general population without regard to musical background. In the two-interval, forced-choice procedure, listeners chose the sound corresponding to the greater force of impact as the length of the bar varied from one presentation to the next. From the equations of motion, a maximum-likelihood test for the task was determined to be of the form Δlog A + αΔ log f > 0, where A and f are the amplitude and frequency of any one partial and α = 0.5. Relative decision weights on Δ log f were obtained from the trial-by-trial responses of listeners and compared to α. Percussionists generally outperformed the other groups; however, the obtained decision weights of all listeners deviated significantly from α and showed variability within groups far in excess of the variability associated with replication. Providing correct feedback after each trial had little effect on the decision weights. The variability in these measures was comparable to that seen in studies involving the auditory discrimination of other source attributes.

Target enhancement and noise cancellation in the identification of a rudimentary sound source in noise.

Perturbation analysis was used to determine the relative contribution of target enhancement and noise cancellation in the identification of rudimentary sound source in noise. In a two-interval, forced-choice procedure, listeners identified the impact sound produced by the larger of two stretched membranes as target. The noise on each presentation was the impact sound of a variable-sized plate. For four of five listeners, the relative weights on the noise were positive indicating enhancement, and for the remaining listeners, they were negative indicating cancellation. The results underscore the difficulty with evaluating models of masking solely in terms of measures of performance accuracy.