Evoked cortical activity and speech recognition as a function of the number of simulated cochlear implant channels.

OBJECTIVES: (1) To determine if consonant-vowel-consonant (CVC) syllables [Hillenbrand J, Getty L, Clark M, Wheeler K. Acoustic characteristics of American English vowels. J Acoust Soc Am 1995;97:3099-3111] could be used to evoke cortical far field response patterns in humans, (2) to characterize the effects of cochlear implant-simulated channel number on the perception and physiological detection of these same CVC stimuli, and (3) to define the relationship between perception and the morphology of the physiological responses evoked by these speech stimuli. METHODS: Ten normal hearing monolingual English speaking adults were tested. Unprocessed CVC naturally spoken syllables, containing medial vowels, as well as processed versions (2, 4, 8, 12, and 16 spectral channels) were used for behavioral and physiological testing. RESULTS: (1) CVC stimuli evoked a series of overlapping P1-N1-P2 cortical responses. (2) Amplitude of P1-N1-P2 responses increased as neural conduction time (latency) decreased with increases in the number of spectral channels. Perception of the CVC stimuli improved with increasing number of spectral channels. (3) Coinciding changes in P1-N1-P2 morphology did not significantly correlate with changes in perception. CONCLUSIONS: P1-N1-P2 responses can be recorded using CVC syllables and there is an effect of channel number on the latency and amplitude of these responses, as well as on vowel identification. However, the physiological detection of the acoustic changes does not fully account for the perceptual performance of these same syllables. SIGNIFICANCE: These results provide evidence that it is possible to use vocoded CVC stimuli to learn more about the physiological detection of acoustic changes contained within speech syllables, as well as to explore brain-behavior relationships.

Sending sound to the brain.

The cochlear implant, a microelectrode array that directly stimulates the auditory nerve, has greatly benefited many individuals with profound deafness. Deaf patients without an intact auditory nerve may be helped by the next generation of auditory prostheses: surface or penetrating auditory brainstem implants that bypass the auditory nerve and directly stimulate auditory processing centers in the brainstem.

Speech recognition in noise as a function of the number of spectral channels: comparison of acoustic hearing and cochlear implants.

Speech recognition was measured as a function of spectral resolution (number of spectral channels) and speech-to-noise ratio in normal-hearing (NH) and cochlear-implant (CI) listeners. Vowel, consonant, word, and sentence recognition were measured in five normal-hearing listeners, ten listeners with the Nucleus-22 cochlear implant, and nine listeners with the Advanced Bionics Clarion cochlear implant. Recognition was measured as a function of the number of spectral channels (noise bands or electrodes) at signal-to-noise ratios of + 15, + 10, +5, 0 dB, and in quiet. Performance with three different speech processing strategies (SPEAK, CIS, and SAS) was similar across all conditions, and improved as the number of electrodes increased (up to seven or eight) for all conditions. For all noise levels, vowel and consonant recognition with the SPEAK speech processor did not improve with more than seven electrodes, while for normal-hearing listeners, performance continued to increase up to at least 20 channels. Speech recognition on more difficult speech materials (word and sentence recognition) showed a marginally significant increase in Nucleus-22 listeners from seven to ten electrodes. The average implant score on all processing strategies was poorer than scores of NH listeners with similar processing. However, the best CI scores were similar to the normal-hearing scores for that condition (up to seven channels). CI listeners with the highest performance level increased in performance as the number of electrodes increased up to seven, while CI listeners with low levels of speech recognition did not increase in performance as the number of electrodes was increased beyond four. These results quantify the effect of number of spectral channels on speech recognition in noise and demonstrate that most CI subjects are not able to fully utilize the spectral information provided by the number of electrodes used in their implant.

Brainstem electronic implants for bilateral anacusis following surgical removal of cerebello pontine angle lesions.

The multichannel auditory brainstem implant (ABI) has been used successfully to treat deafness in individuals with neurofibromatosis type II. The device has been implanted in nearly 150 recipients worldwide, and clinical trials with the device are approaching completion. The implantation and fitting of the multichannel ABI differ significantly from cochlear implantation, and the processes are illustrated in a series of case studies. Performance data also are included from recipients with up to 7 years experience.

Effects of electrode location on speech recognition with the Nucleus-22 cochlear implant.

Speech recognition performance was measured as a function of electrode in two experiments with the Nucleus-22 cochlear implant using 4-electrode SPEAK speech processors. In experiment 1, the four stimulated electrode pairs were shifted in 0.75-mm steps over 3 mm in the apical-basal direction. In experiment 2, the four electrodes were closely spaced and positioned apically, medially, or basally. An additional condition spaced the four electrodes as widely as possible. In experiment 1, City University of New York sentence scores showed a significant decrease in performance as the electrodes were shifted basally; no other speech measures showed a significant change with electrode location. For experiment 2, all scores were the best with the processor that had the electrodes spaced as widely as possible. In both experiments, all 4-electrode SPEAK processors produced significantly poorer speech recognition than the subject's own 20-electrode processor. These results indicate that the location of electrodes is an important factor in implant performance.

Effects of dynamic range and amplitude mapping on phoneme recognition in Nucleus-22 cochlear implant users.

OBJECTIVE: To determine the consequences for phoneme recognition of errors in setting threshold and loudness levels in cochlear implant listeners using a 4-channel continuous interleaved sampling (CIS) speech processor. DESIGN: Three Nucleus-22 cochlear implant listeners, who normally used the SPEAK speech processing strategy participated in this study. An experimental 4-channel CIS speech processor was implemented in each listener as follows. Speech signals were band-pass filtered into four broad frequency bands and the temporal envelope of the signal in each band was extracted by half-wave rectification and low-pass filtering. A power function was used to convert the extracted acoustic amplitudes to electric currents. The electric currents were dependent on the exponent of the mapping power function and the electrode dynamic range, which was determined by the minimum and maximum stimulation levels. In the baseline condition, the minimum and maximum stimulation levels were defined as the psychophysically measured threshold level (T-level) and maximum comfortable level (C-level). In the experimental conditions, the maximum stimulation levels were fixed at the C-level and the dynamic range (in dB) was changed by varying the minimum stimulation levels on all electrodes. This manipulation simulates the effect of an erroneous measurement of the T-level. Phoneme recognition was obtained as the dynamic range of electrodes was changed from 1 dB to 20 dB and as the exponent of the power-law amplitude mapping function was changed from 0.1 to 0.4. RESULTS: For each mapping condition, the electric dynamic range had a significant, but weak effect on vowel and consonant recognition. For a strong compression (p = 0.1), best vowel and consonant scores were obtained with a large dynamic range (12 dB). When the exponent of the mapping function was changed to 0.2 and 0.4, the dynamic range producing the highest scores decreased to 6 dB and 3 dB, respectively. CONCLUSIONS: Phoneme recognition with a 4-channel CIS strategy was only mildly affected by large changes in both electric threshold and loudness mapping. Errors in threshold by a factor of 2 (6 dB) and in the loudness mapping exponent by a factor of 2 were required to produce a significant decrease in performance. In these extreme conditions, the effect of the electric dynamic range on phoneme recognition could be due to two independent factors: abnormal loudness growth and a reduction in the number of discriminable intensity steps. The decrease in performance caused by a reduced electric dynamic range can be compensated by a more expansive power-law mapping function, as long as the number of discriminable intensity steps is moderately large (e.g., >8).

Speech recognition with reduced spectral cues as a function of age.

Adult listeners are able to recognize speech even under conditions of severe spectral degradation. To assess the developmental time course of this robust pattern recognition, speech recognition was measured in two groups of children (5-7 and 10-12 years of age) as a function of the degree of spectral resolution. Results were compared to recognition performance of adults listening to the same materials and conditions. The spectral detail was systematically manipulated using a noise-band vocoder in which filtered noise bands were modulated by the amplitude envelope from the same spectral bands in speech. Performance scores between adults and older children did not differ statistically, whereas scores by younger children were significantly lower; they required more spectral resolution to perform at the same level as adults and older children. Part of the deficit in younger children was due to their inability to utilize fully the sensory information, and part was due to their incomplete linguistic/cognitive development. The fact that young children cannot recognize spectrally degraded speech as well as adults suggests that a long learning period is required for robust acoustic pattern recognition. These findings have implications for the application of auditory sensory devices for young children with early-onset hearing loss.

Effects of phase duration and electrode separation on loudness growth in cochlear implant listeners.

Loudness estimates were obtained in a group of four adult subjects implanted with the Nucleus-22 multielectrode cochlear implant device, for a range of pulse amplitudes and different fixed phase durations and electrode separations. The stimulus was a 200-ms long train of biphasic pulses presented at 500 pulses/s. Subjects estimated loudness as a number from 0 ("don't hear it") to 100 ("uncomfortably loud"). Loudness was found to grow exponentially with pulse amplitude, at a rate that was dependent upon the phase duration as well as the electrode separation. An equation of the form L = e(lambda + gamma M)(D theta)I, where L is the estimated loudness, M is the separation between electrodes of a stimulating pair, D is the phase duration, I is current amplitude, and lambda, gamma, and theta are constants, appears to describe the observed data adequately. The findings are remarkably consistent across subjects.

Effect of stimulation rate on phoneme recognition by nucleus-22 cochlear implant listeners.

This study investigated the effect of pulsatile stimulation rate on medial vowel and consonant recognition in cochlear implant listeners. Experiment 1 measured phoneme recognition as a function of stimulation rate in six Nucleus-22 cochlear implant listeners using an experimental four-channel continuous interleaved sampler (CIS) speech processing strategy. Results showed that all stimulation rates from 150 to 500 pulses/s/electrode produced equally good performance, while stimulation rates lower than 150 pulses/s/electrode produced significantly poorer performance. Experiment 2 measured phoneme recognition by implant listeners and normal-hearing listeners as a function of the low-pass cutoff frequency for envelope information. Results from both acoustic and electric hearing showed no significant difference in performance for all cutoff frequencies higher than 20 Hz. Both vowel and consonant scores dropped significantly when the cutoff frequency was reduced from 20 Hz to 2 Hz. The results of these two experiments suggest that temporal envelope information can be conveyed by relatively low stimulation rates. The pattern of results for both electrical and acoustic hearing is consistent with a simple model of temporal integration with an equivalent rectangular duration (ERD) of the temporal integrator of about 7 ms.

The effect of frequency allocation on phoneme recognition with the nucleus 22 cochlear implant.

HYPOTHESIS: Phoneme recognition performance in patients implanted with the Nucleus 22 cochlear implant is affected by the frequency-to-electrode assignment. BACKGROUND: Multiple electrodes in modern cochlear implants are intended to deliver frequency-specific information to different tonotopic locations along the cochlea. However, the relation between the electrode locations, distribution of frequency information, and performance has not been explored thoroughly. METHODS: Ten listeners were tested on vowel and consonant identification tasks immediately after receiving each of the 15 speech processors. Experimental processors were created with 4, 7, and 20 activated electrodes. Five different frequency allocations were tested with all electrode conditions. RESULTS: For 7- and 20-electrode maps, best vowel recognition performance was obtained with frequency tables 7 and 9, with subjects showing best performance with the table with which they were most familiar. With 4-electrode maps, no change in vowel recognition performance was observed as a function of the frequency allocation. Consonant scores showed only a small effect of frequency allocation across all processors. Results were similar across listeners with different electrode insertion depths. CONCLUSION: The allocation of frequency ranges to electrodes in the Nucleus-22 cochlear implant can affect vowel recognition, when more than four electrodes are used, but is less important for consonant recognition. The allocation of frequency ranges to electrodes is an important factor in multichannel implants with more than four electrodes. The similarity of results across implant listeners with different electrode insertion depths implies that the optimal frequency allocation is one that best matches the allocation to which they've become accustomed, rather than one that matches the original tonotopic location of the electrodes.

Psychophysical laws revealed by electric hearing.

Psychophysical laws relate the intensity of a physical stimulus to its perceived magnitude. G.T. Fechner hypothesized 150 years ago that the psychophysical law can be derived by measuring intensity discrimination, but modern scientists favor a direct magnitude estimation approach and are still divided on whether and how intensity discrimination is related to sensation magnitude. This controversy is partially due to the uncertainty of the role of the sensory organ in the psychophysical law. Here we bypass the auditory sensory organ with electric stimulation of the human auditory nerve and find a close coupling between intensity discrimination and loudness functions in electric hearing. Our results support Fechner's hypothesis in principle but not the exact relationship from which he derived his logarithmic law.

Effects of electrode location and spacing on phoneme recognition with the Nucleus-22 cochlear implant.

OBJECTIVE: The objective of this paper was to determine how phoneme identification was affected by the cochlear location and spacing of the electrodes in cochlear implant listeners. DESIGN: Subjects were initially programmed with the full complement of 20 active electrodes, in which each electrode was assigned to represent the output of one filter in the normal SPEAK processor. In the present study several four-electrode processors were constructed by assigning the output of more than one filter to a single electrode. In all conditions speech sounds were still analyzed into 20 frequency bands and processed according to the usual SPEAK processing strategy, but the location and spacing of the four stimulated electrode pairs were varied systematically. In Experiment I, the spacing between stimulated electrodes was fixed at 3.75 mm and the cochlear location of the four electrode pairs was shifted from the most-apical position up to 3.0 mm toward the base in 0.75 mm steps. In Experiment II, the spatial separation between the four electrode pairs (each bipolar-plus-one) was systematically changed from 1.5 mm to 4.5 mm while holding the most apical active electrode fixed. In Experiment III, the spacing of active electrodes was varied to represent equal tonotopic spacing to equal linear frequency intervals between pairs. Recognition of medial vowels and consonants was measured in three subjects with these custom four-electrode speech processors. RESULTS: In Experiment I, results showed that both vowel and consonant recognition were best when the electrodes were in the most apical locations. In Experiment II, best speech recognition occurred when electrode pairs were separated by 3 to 3.75 mm. In Experiment III, both vowel and consonant recognition scores decreased when the spacing of electrode pairs was changed from equal tonotopic spacing to equal linear frequency intervals. Overall, vowel and consonant recognition were best at the most apical electrode locations and when the spacing of electrodes matched the frequency intervals of the analysis filters. Consonant recognition was relatively robust to alterations in electrode location and spacing. The best vowel scores with four-electrode speech processors were about 10 percentage lower than scores obtained with the full 20-electrode speech processors. However, the best consonant scores with four-electrode speech processors were similar to those obtained with the full 20-electrode speech processors. Information transmission analysis revealed that temporal envelope cues (voicing and manner) were not strongly affected by changes in electrode location and spacing, whereas spectral cues, as represented by vowel recognition and consonantal place of articulation, were strongly affected. Both spectral and temporal phoneme cues were strongly affected by the degree of tonotopic warping, created by altering both the location and spacing of the activated electrodes. CONCLUSION: The cochlear location and spacing of the activated electrodes had a clear effect on phoneme recognition. Temporal cues were less affected by tonotopic shifts or linear tonotopic stretching or shrinking, but were susceptible to nonlinear tonotopic warping. Spectral cues were sensitive to all tonotopic manipulations: shifting, linear stretching, and nonlinear warping. However, the present experiments could not differentiate whether the optimal mapping between analysis frequency bands and stimulation electrodes was determined by the normal acoustic tonotopic pattern or by the pattern learned from experience with the 20-electrode implant.

Effects of electrode configuration and frequency allocation on vowel recognition with the Nucleus-22 cochlear implant.

OBJECTIVE: This study was conducted to understand vowel recognition in cochlear implants as a function of the cochlear location and separation of the stimulated electrode pairs and as a function of the matching between speech spectral information and the location of the stimulated electrodes. DESIGN: Four-electrode speech processors with a continuous interleaved sampling speech processing strategy were implemented through a custom interface in five subjects implanted with the Nucleus-22 cochlear implant. The temporal envelopes from four broad frequency bands were used to modulate 500 pps, 100 microsec/phase interleaved pulse trains delivered to four electrode pairs. Ten different frequency allocations and five sets of four-electrode configurations were tested. Each frequency allocation represented the same cochlear extent but different cochlear locations based on Greenwood's frequency-to-place formula. Recognition of multi-talker medial vowels was measured for each combination of parameters with no period of practice or adjustment. RESULTS: Results showed that recognition of multi-talker vowels was highly dependent on frequency allocation for all electrode configurations. For a given electrode configuration maximum vowel recognition was observed with a specific frequency allocation. When the stimulated electrodes were shifted basally by 3 mm, the frequency allocation that produced the best performance also shifted basally by 3 mm. A similar pattern of vowel recognition was observed as a function of frequency allocation for electrode configurations that had the same apical-most electrode in each pair, regardless of location of the basal-most electrode in the pair. Subjects with different electrode insertion depths had similar trends in vowel recognition for each frequency allocation. CONCLUSIONS: For a given electrode configuration, the best performance was obtained with processors with a specific frequency allocation. In addition, the apical-most member of each electrode pair had a much stronger influence on vowel recognition in electric hearing. Finally, results from this study also suggest that over time, patients with implants can partially adapt to a basal shift in place of stimulation.

Recognition of spectrally degraded and frequency-shifted vowels in acoustic and electric hearing.

The present study measured the recognition of spectrally degraded and frequency-shifted vowels in both acoustic and electric hearing. Vowel stimuli were passed through 4, 8, or 16 bandpass filters and the temporal envelopes from each filter band were extracted by half-wave rectification and low-pass filtering. The temporal envelopes were used to modulate noise bands which were shifted in frequency relative to the corresponding analysis filters. This manipulation not only degraded the spectral information by discarding within-band spectral detail, but also shifted the tonotopic representation of spectral envelope information. Results from five normal-hearing subjects showed that vowel recognition was sensitive to both spectral resolution and frequency shifting. The effect of a frequency shift did not interact with spectral resolution, suggesting that spectral resolution and spectral shifting are orthogonal in terms of intelligibility. High vowel recognition scores were observed for as few as four bands. Regardless of the number of bands, no significant performance drop was observed for tonotopic shifts equivalent to 3 mm along the basilar membrane, that is, for frequency shifts of 40%-60%. Similar results were obtained from five cochlear implant listeners, when electrode locations were fixed and the spectral location of the analysis filters was shifted. Changes in recognition performance in electrical and acoustic hearing were similar in terms of the relative location of electrodes rather than the absolute location of electrodes, indicating that cochlear implant users may at least partly accommodate to the new patterns of speech sounds after long-time exposure to their normal speech processor.

Effects of noise and spectral resolution on vowel and consonant recognition: acoustic and electric hearing.

Current multichannel cochlear implant devices provide high levels of speech performance in quiet. However, performance deteriorates rapidly with increasing levels of background noise. The goal of this study was to investigate whether the noise susceptibility of cochlear implant users is primarily due to the loss of fine spectral information. Recognition of vowels and consonants was measured as a function of signal-to-noise ratio in four normal-hearing listeners in conditions simulating cochlear implants with both CIS and SPEAK-like strategies. Six conditions were evaluated: 3-, 4-, 8-, and 16-band processors (CIS-like), a 6/20 band processor (SPEAK-like), and unprocessed speech. Recognition scores for vowels and consonants decreased as the S/N level worsened in all conditions, as expected. Phoneme recognition threshold (PRT) was defined as the S/N at which the recognition score fell to 50% of its level in quiet. The unprocessed speech had the best PRT, which worsened as the number of bands decreased. Recognition of vowels and consonants was further measured in three Nucleus-22 cochlear implant users using either their normal SPEAK speech processor or a custom processor with a four-channel CIS strategy. The best cochlear implant user showed similar performance with the CIS strategy in quiet and in noise to that of normal-hearing listeners when listening to correspondingly spectrally degraded speech. These findings suggest that the noise susceptibility of cochlear implant users is at least partly due to the loss of spectral resolution. Efforts to improve the effective number of spectral information channels should improve implant performance in noise.

Accessing the tonotopic organization of the ventral cochlear nucleus by intranuclear microstimulation.

This study is part of a program to develop an auditory prosthesis for the profoundly deaf, based on multichannel microstimulation in the cochlear nucleus. The functionality of such a device is dependent on its ability to access the tonotopic axis of the human ventral cochlear nucleus in an orderly fashion. In these studies, we utilized the homologies between the human and feline ventral cochlear nuclei and the known tonotopic organization of the central nucleus of the inferior colliculus (IC). In anesthetized cats, stimuli were delivered to three or four locations along the dorsal-to-ventral axis of the posteroventral cochlear nucleus (PVCN), and for each stimulus location, we recorded the multiunit neuronal activity and the field potentials at 20 or more locations along the dorsolateral-ventromedial (tonotopic) axis of the IC. The current source-sink density (CSD), which delimits regions of neuronal activity, was computed from the sequence of field potentials recorded along this axis. The multiunit activity and the CSD analysis both showed that the tonotopic organization of the PVCN can be accessed in an orderly manner by intranuclear microstimulation in several regions of the PVCN, using the range of stimulus pulse amplitudes that have been shown in previous studies to be noninjurious during prolonged intranuclear microstimulation via chronically implanted microelectrodes. We discuss the applicability of these findings to the design of clinical auditory prostheses for implantation into the human cochlear nucleus.

Effects of amplitude nonlinearity on phoneme recognition by cochlear implant users and normal-hearing listeners.

It is widely assumed that the proper transformation of acoustic amplitude to electric amplitude is a critical factor affecting speech recognition in cochlear implant users and normal-hearing listeners. A four-channel noise-band speech processor was implemented, reducing spectral information to four bands. A power-law transformation was applied to the amplitude mapping stage in the speech processor design, and the exponent of the power function varied from a strongly compressive (p = 0.05) to a weakly compressive (p = 0.75) for implant listeners and from 0.3 to 3.0 for acoustic listeners. Results for implants showed that the best performance was achieved with an exponent of about 0.2, and performance gradually deteriorated when either more compressive or less compressive exponents were applied. The loudness growth functions of the four activated electrodes in each subject were measured and those data were well fit by a power function with a mean exponent of 2.72. The results indicated that the best performance was achieved when the normal loudness growth was restored. For acoustic listeners, results were similar to those observed with cochlear implant listeners, except that best performance was achieved with no amplitude nonlinearity (p = 1.0). The similarity of results in both acoustic and electric stimulation indicated that the performance deterioration observed for extreme nonlinearity was due to similar perceptual effects. The function relating amplitude mapping exponent and performance was relatively flat, indicating that phoneme recognition was only mildly affected by amplitude nonlinearity.