The effects of changes in hearing status in cochlear implant users on the acoustic vowel space and CV coarticulation.

In order to examine the role of hearing status in controlling coarticulation, eight English vowels in /bVt/ and /dVt/ syllables, embedded in a carrier phrase, were elicited from 7 postlingually deafened adults and 2 speakers with normal hearing. The deaf adults served in repeated recording sessions both before and up to a year after they received cochlear implants and their speech processors were turned on. Each of the two hearing control speakers served in two recording sessions, separated by about 3 months. Measures were made of second formant frequency at obstruent release and at 25 ms intervals until the final obstruent. An index of coarticulation, based on the ratio of F2 at vowel onset to F2 at midvowel target, was computed. Changes in the amount of coarticulation after the change in hearing status were small and nonsystematic for the /bVt/ syllables; those for the /dVt/ syllables averaged a 3% increase--within the range of reliability measures for the 2 hearing control speakers. Locus equations (F2 at vowel onset vs. F2 at vowel midpoint) and ratios of F2 onsets in point vowels were also calculated. Like the index of coarticulation, these measures tended to confirm that hearing status had little if any effect on coarticulation in the deaf speakers, consistent with the hypothesis that hearing does not play a direct role in regulating anticipatory coarticulation in adulthood. With the restoration of some hearing, 2 implant users significantly increased the average spacing between vowels in the formant plane, whereas the remaining 5 decreased that measure. All speakers but one also reduced vowel duration significantly. Four of the speakers reduced dispersion of vowel formant values around vowel midpoint means, but the other 3 did not show this effect.

Variation in anticipatory coarticulation with changes in clarity and rate.

This study tests the hypothesis that the relative timing, or coarticulation, of articulatory movements at VC and CV boundaries is influenced by both the listener's requirement for clarity and the speaker's strategy to economize effort. Movement and acoustic data were collected from 7 subjects who spoke in three conditions: normal, clear, and fast. It was predicted that fast speech would show more coarticulation and clear speech would show less coarticulation than normal speech. The speech materials were designed to investigate coarticulation in the movements of the upper lip and tongue. They consisted of repetitions of [iC(n)u] utterances embedded in carrier phrases, where the number of consonants, n, ranged from 1 to 3. Analyses focused on kinematic measures and the amount of coarticulation (overlap) of the /i-u/ transition movement with the acoustic interval of the /i/. The consonant-string duration was longest in the clear speaking condition and shortest in the fast condition. Compared to the normal condition, peak velocities were higher in the fast and clear speaking conditions, indicating increased effort. The influences of speaking condition on coarticulation and on the formants of the /i/ were small. Thus, even though there was evidence of increased effort in the clear and fast conditions, the hypothesized effects of a trade-off between clarity and economy of effort were minimally evident in formant values for /i/ and measures of coarticulation.

Covariation of cochlear implant users' perception and production of vowel contrasts and their identification by listeners with normal hearing.

This study investigates covariation of perception and production of vowel contrasts in speakers who use cochlear implants and identification of those contrasts by listeners with normal hearing. Formant measures were made of seven vowel pairs whose members are neighboring in acoustic space. The vowels were produced in carrier phrases by 8 postlingually deafened adults, before and after they received their cochlear implants (CI). Improvements in a speaker's production and perception of a given vowel contrast and normally hearing listeners' identification of that contrast in masking noise tended to occur together. Specifically, speakers who produced vowel pairs with reduced contrast in the pre-CI condition (measured by separation in the acoustic vowel space) and who showed improvement in their perception of these contrasts post-CI (measured with a phoneme identification test) were found to have enhanced production contrasts post-CI in many cases. These enhanced production contrasts were associated, in turn, with enhanced masked word recognition, as measured from responses of a group of 10 normally hearing listeners. The results support the view that restoring self-hearing allows a speaker to adjust articulatory routines to ensure sufficient perceptual contrast for listeners.

Language-specific, hearing-related changes in vowel spaces: a preliminary study of English- and Spanish-speaking cochlear implant users.

OBJECTIVE: This study investigates the role of hearing in vowel productions of postlingually deafened cochlear implant users. Two hypotheses are tested that derive from the view that vowel production is influenced by competing demands of intelligibility for the listener and least effort in the speaker: 1) Hearing enables a cochlear implant user to produce vowels distinctly from one another; without hearing, the speaker may give more weight to economy of effort, leading to reduced vowel separation. 2) Speakers may need to produce vowels more distinctly from one another in a language with a relatively "crowded" vowel space, such as American English, than in a language with relatively few vowels, such as Spanish. Thus, when switching between hearing and non-hearing states, English speakers may show a tradeoff between vowel distinctiveness and least effort, whereas Spanish speakers may not. DESIGN: To test the prediction that there will be a reduction of average vowel spacing (AVS) (average intervowel distance in the F1-F2 plane) with interrupted hearing for English-speaking cochlear implant users, but no systematic change in AVS for Spanish cochlear implant users, vowel productions of seven English-speaking and seven Spanish-speaking cochlear implant users, who had been using their implants for at least 1 yr, were recorded when their implant speech processors were turned off and on several times in two sessions. RESULTS: AVS was consistently larger for the English speakers with hearing than without hearing. The magnitude and direction of AVS change was more variable for the Spanish speakers, both within and between subjects. CONCLUSION: Vowel distinctiveness was enhanced with the provision of some hearing in the language group with a more crowded vowel space but not in the language group with fewer vowels. The view that speakers seek to minimize effort while maintaining the distinctiveness of acoustic goals receives some support.

Changes in speech intelligibility of postlingually deaf adults after cochlear implantation.

OBJECTIVE: This study examines changes in the intelligibility of CVC words spoken by postlingually deafened adults after they have had 6 to 12 mo of experience with a cochlear implant. The hypothesis guiding the research is that the intelligibility of these speakers will improve after extended use of a cochlear implant. The paper also describes changes in CVC word intelligibility analyzed by phoneme class and by features. DESIGN: The speech of eight postlingually deaf adults was recorded before activation of the speech processors of their cochlear implants and at 6 mo and 1 yr after activation. Seventeen listeners with no known impairment of hearing completed a word identification task while listening to each implant user's speech in noise. The percent information transmitted by the speakers in their pre- and postactivation recordings was measured for 11 English consonants and eight vowels separately. RESULTS: An overall improvement in word intelligibility was observed: seven of the eight speakers showed improvement in vowel intelligibility and six speakers showed improvement in consonant intelligibility. However, the intelligibility of specific consonant and vowel features varied greatly across speakers. CONCLUSIONS: Extended use of a cochlear implant by postlingually deafened adults tends to enhance their intelligibility.

Articulatory tradeoffs reduce acoustic variability during American English /r/ production.

The American English phoneme /r/ has long been associated with large amounts of articulatory variability during production. This paper investigates the hypothesis that the articulatory variations used by a speaker to produce /r/ in different contexts exhibit systematic tradeoffs, or articulatory trading relations, that act to maintain a relatively stable acoustic signal despite the large variations in vocal tract shape. Acoustic and articulatory recordings were collected from seven speakers producing /r/ in five phonetic contexts. For every speaker, the different articulator configurations used to produce /r/ in the different phonetic contexts showed systematic tradeoffs, as evidenced by significant correlations between the positions of transducers mounted on the tongue. Analysis of acoustic and articulatory variabilities revealed that these tradeoffs act to reduce acoustic variability, thus allowing relatively large contextual variations in vocal tract shape for /r/ without seriously degrading the primary acoustic cue. Furthermore, some subjects appeared to use completely different articulatory gestures to produce /r/ in different phonetic contexts. When viewed in light of current models of speech movement control, these results appear to favor models that utilize an acoustic or auditory target for each phoneme over models that utilize a vocal tract shape target for each phoneme.

The effect of changes in hearing status on speech sound level and speech breathing: a study conducted with cochlear implant users and NF-2 patients.

According to a dual-process theory of the role of hearing in speech production, hearing helps maintain an internal model used by the speech control mechanism to achieve phonemic goals. It also monitors the acoustic environment and guides relatively rapid adjustments in postural parameters, such as those underlying average speech sound level and rate, in order to achieve suprasegmental goals that are a compromise between intelligibility and economy of effort. In order to obtain evidence bearing on this theory, acoustic and aerodynamic measures were collected from seven adventitiously deaf speakers who received cochlear implants, three speakers who had severe reduction in hearing following surgery for Neurofibromatosis-2, and one hard of hearing speaker. These speakers made recordings of the Rainbow Passage and an English vowel inventory before and after intervention. All but one of the postlingually deaf speakers who received prosthetic hearing reduced speech sound level, SPL. Three of these significantly increased a measure of inferred glottal aperture, H1-H2, and their session means for these two parameters were inversely correlated longitudinally. All but one of the speakers terminated respiratory limbs closer to functional residual capacity (FRC) once prosthetic hearing was supplied. Finally, the implant users' average values of air expenditure moved toward normative values with prosthetic hearing. These results are attributed to the mediation of changes in respiratory and glottal posture aimed at reducing speech sound level and economizing effort.

Tongue surface displacement during bilabial stops.

The goals of this study were to characterize tongue surface displacement during production of bilabial stops and to refine current estimates of vocal-tract wall impedance using direct measurements of displacement in the vocal tract during closure. In addition, evidence was obtained to test the competing claims of passive and active enlargement of the vocal tract during voicing. Tongue displacement was measured and tongue compliance was estimated in four subjects during production of /aba/ and /apa/. All subjects showed more tongue displacement during /aba/ than during /apa/, even though peak intraoral pressure is lower for /aba/. In consequence, compliance estimates were much higher for /aba/, ranging from 5.1 to 8.5 x 10(-5) cm3/dyn. Compliance values for /apa/ ranged from 0.8 to 2.3 x 10(-5) cm3/dyn for the tongue body, and 0.52 x 10(-5) for the single tongue tip point that was measured. From combined analyses of tongue displacement and intraoral pressure waveforms for one subject, it was concluded that smaller tongue displacements for /p/ than for /b/ may be due to active stiffening of the tongue during /p/, or to intentional relaxation of tongue muscles during /b/ (in conjunction with active tongue displacement during /b/).

Changes in sound pressure and fundamental frequency contours following changes in hearing status.

Sound-pressure level (SPL) and fundamental frequency (F0) contours were obtained from four postlingually deafened adults who received cochlear implants and from a subject with Neurofibromatosis-2 (NF2) who had her hearing severely reduced following surgery to remove an auditory-nerve tumor and to implant an auditory brainstem implant. SPL and F0 contours for each phrase in passages read before and after changes in hearing were averaged over repeated readings and then normalized with respect to the highest SPL or F0 value in the contour. The regularity of each average contour was measured by calculating differences between successive syllable means and averaging the absolute values of these differences. With auditory feedback made available, the cochlear implant user with the least contour variation preimplant showed no change but all of the remaining speakers produced less variable F0 contours and three also produced less variable SPL contours. In complementary fashion, when the NF2 speaker had her auditory feedback severely reduced, she produced more variable F0 and SPL contours. The results are interpreted as supporting a dual-process theory of the role of auditory feedback in speech production, according to which one role of self-hearing is to monitor transmission conditions, leading the speaker to make changes in speech postures aimed at maintaining intelligibility.

Acoustic and articulatory measures of sibilant production with and without auditory feedback from a cochlear implant.

The articulator positions of a subject with a cochlear implant were measured with an electromagnetic midsagittal articulometer (EMMA) system with and without auditory feedback available to the subject via his implant. Acoustic analysis of sibilant productions included specific measures of their spectral properties as well as the F3 formant amplitude. More general postural characteristics of the utterances, such as speech rate and sound level, were measured as well. Because of the mechanical and aerodynamic interdependence of the articulators, the postural variables must be considered before attributing speech improvement to the selective correction of a phonemic target with the use of auditory feedback. The tongue blade position was related to the shape and central tendency of the /integral of/ spectra; however, changes in the spectral contrast between /s/ and /integral of/ were not related to changes in the more general postural variables of rate and sound level. These findings suggest that the cochlear implant is providing this subject with important auditory cues that he can use to monitor his speech and maintain the phonemic contrast between /s/ and /integral of/.

Comparisons among aerodynamic, electroglottographic, and acoustic spectral measures of female voice.

This study examines measures of the glottal airflow waveform, the electroglottographic signal (EGG), amplitude differences between peaks in the acoustic spectrum, and observations of the spectral energy content of the third formant (F3), in terms of how they relate to one another. Twenty females with normal voices served as subjects. Both group and individual data were studied. Measurements were made for the vowel in two speech tasks: strings of the syllable /pae/and sustained phonation of /ae/, which were produced at two levels of vocal effort: comfortable and loud voice. The main results were: 1. Significant differences in parameter values between /pae/and/ae/were related to significant differences in the sound pressure level (SPL). 2. An "adduction quotient," measured from the glottal waveform at a 30% criterion, was sensitive enough to differentiate between waveforms reflecting abrupt versus gradual vocal fold closing movements. 3. DC flow showed weak or nonsignificant relationships with acoustic measures. 4. The spectral content in the third formant (F3) in comfortable loudness typically consisted of a mix of noise and harmonic energy. In loud voice, the F3 spectral content typically consisted of harmonic energy. 5. Significant differences were found in all measures between tokens with F3 harmonic energy and tokens with F3 noise, independent of loudness condition. 6. Strong relationships between flow- and EGG-adduction quotients suggested that these signals can be used to complement each other. 7. The amplitude difference between spectral peaks of the first and third formant (F1-F3) was found to add information about abruptness of airflow decrease (flow declination) that may be lost in the glottal waveform signal due to low-pass filtering. The results are discussed in terms of how an integrated use of these measures can contribute to a better understanding of the normal vocal mechanism and help to improve methods for evaluating vocal function.

Phonemic resetting versus postural adjustments in the speech of cochlear implant users: an exploration of voice-onset time.

Voice-onset time (VOT) was measured in plosive-initial syllables uttered by five cochlear implant users prior to and repeatedly at intervals after activation of their speech processors. In "short-term" experiments, the elicitation set was read after the subject's processor has been off for 24 h, then turned on them off again. Four out of five implant users increased voiceless and/or voiced VOTc (VOT corrected for changes in syllable duration) from preimplant baselines to final recordings made 1-3 years later. Measured acoustic correlates of speech "posture" (average SPL, F0, and low-frequency spectral slope) changed concurrently. Results in the short-term study were largely consistent with the long term. Significant multiple regressions relating changes in VOTc to accompanying changes in postural correlates were found in both studies. This outcome is consistent with hypotheses that predict changes in both VOTc and in postural correlates with the restoration of some hearing and that allow for linkages between the two. Some of the reliable VOTc increases obtained over the long term that were not correlated with postural changes may have been caused directly by auditory validation of articulatory/acoustic relations that underlie synergisms for phoneme production.

A preliminary study of the effects of cochlear implants on the production of sibilants.

The potential influence of auditory information in the production of /s/ and /integral of/ was explored for postlingually deafened adults with four-channel Ineraid cochlear implants. Analyses of the spectra of the sibilant sounds were compared for speech obtained prior to implant activation, after early implant use and after 6 months of use. In addition, the output of the Ineraid device (measured at each of the four electrodes) was analyzed with pre- and postactivation speech samples to explore whether the speech production changes were potentially audible to the cochlear-implant user. Results indicated that subjects who showed abnormally low or incorrect contrast between /s/ and /integral of/ preactivation, and who received significant auditory benefit from their implants were able to increase the distinctiveness of their productions of the two speech sounds.

Group differences in measures of voice production and revised values of maximum airflow declination rate.

In previous reports, aerodynamic and acoustic measures of voice production were presented for groups of normal male and female speakers [Holmberg et al., J. Acoust. Soc. Am. 84, 511-529 (1988); J. Voice 3, 294-305 (1989)] that were used as norms in studies of voice disorders [Hillman et al., J. Speech Hear. Res. 32, 373-392 (1989); J. Voice 4, 52-63 (1990)]. Several of the measures were extracted from glottal airflow waveforms that were derived by inverse filtering a high-time-resolution oral airflow signal. Recently, the methods have been updated and a new study of additional subjects has been conducted. This report presents previous (1988) and current (1993) group mean values of sound pressure level, fundamental frequency, maximum airflow declination rate, ac flow, peak flow, minimum flow, ac-dc ratio, inferred subglottal air pressure, average flow, and glottal resistance. Statistical tests indicate overall group differences and differences for values of several individual parameters between the 1988 and 1993 studies. Some inter-study differences in parameter values may be due to sampling effects and minor methodological differences; however, a comparative test of 1988 and 1993 inverse filtering algorithms shows that some lower 1988 values of maximum flow declination rate were due at least in part to excessive low-pass filtering in the 1988 algorithm. The observed differences should have had a negligible influence on the conclusions of our studies of voice disorders.

Changes in voice-onset time in speakers with cochlear implants.

Voice-onset time (VOT) and syllable duration were measured for the English plosives in /Cad/(C = consonant) context spoken by four postlingually deafened recipients of multichannel (Ineraid) cochlear implants. Recordings were made of their speech before, and at intervals following, activation of the speech processors of their implants. Three patients reduced mean syllable duration following activation. Using measures of VOT and syllable duration from speakers with normal hearing [Volaitis and Miller, J. Acoust. Soc. Am. 92, 723-735 (1992)] and from the subjects of this study, VOT is shown to vary approximately linearly with syllable duration over the ranges produced here. Therefore, the VOT of each token was adjusted for the change in syllable duration of that token relative to the mean syllable duration in the first baseline session. This variable, labeled VOTc, was used to evaluate the effects on voicing of the speakers' renewed access to the voicing contrast provided by their implants. Preimplant, all four speakers characteristically uttered voiced plosives with too-short VOT, compared to the measures for hearing speakers. Voiceless plosive mean VOT was also abnormally short for two of the speakers, and close to normal for the remaining two. With some hearing restored, subjects made relatively few errors with respect to voicing when identifying plosives in listening tests, and three of the four speakers lengthened VOTc. The findings are interpreted as supporting the hypothesis that speakers use their hearing to calibrate mechanisms of speech production by monitoring the relations between their articulations and their acoustic output.

Relationships between intra-speaker variation in aerodynamic measures of voice production and variation in SPL across repeated recordings.

Intra-speaker variation in aerodynamic and acoustic measures of voice production across repeated recordings was studied in relation to cross-recording variation in SPL for three normal female and three normal male speakers. Group data for 15 females and 15 males served as the statistical reference. The speech material consisted of syllable strings in soft, normal, and loud voice. Measures were made of (a) parameters characterizing the inverse filtered oral airflow waveform, (b) the inferred average transglottal air pressure and glottal airflow, and (c) SPL. The results showed that intra-speaker parameter variation across recordings was generally less than 2 standard deviations relative to group mean values. In terms of relation to variation in SPL, the measures could be divided into two main groups: (a) For air pressure, AC flow, and maximum flow declination rate, both intra-speaker variation across recordings and inter-speaker (group) variation was related systematically to variation of SPL. For these measures, it is suggested that variation across recordings was due in part to SPL differences, which can be adjusted for statistically, thus facilitating comparisons between absolute values. (b) For other measures, neither intra-speaker variation across recordings nor inter-speaker group variation was systematically related to SPL. However, some of these latter measures changed with SPL in an orderly fashion across soft, normal, and loud voice for individual speakers. The results are discussed in terms of the clinical use of these measures in studies of voice disorders.

Individual variation in measures of voice.

Measures of inferred subglottal air pressure, glottal airflow waveform characteristics, sound pressure level (SPL) and the acoustic spectral slope were studied for individual speakers with normal voices. Combinations of different levels of subglottal air pressure and varying glottal configurations could result in the same SPL. Relatively high air pressure levels were associated with a steep spectral slope, reflecting a more sinusoidal glottal waveform and a relatively abducted membranous glottis, which would result in damping of F1. Data suggested that the interarytenoid glottal opening could vary without systematically affecting SPL or voice quality. The results indicate that the principles of production-related economy of effort and physiological, acoustic and perceptual constraints may apply to voice production.

Trading relations between tongue-body raising and lip rounding in production of the vowel /u/: a pilot "motor equivalence" study.

Articulatory and acoustic data were used to explore the following hypothesis for the vowel /u/: The objective of articulatory movements is an acoustic goal; varying and reciprocal contributions of different articulators may help to constrain acoustic variation in achieving the goal. Previous articulatory studies of similar hypotheses, expressed entirely in articulatory terms, have been confounded by interdependencies of the variables being studied (e.g., lip and mandible displacements). One case in which this problem may be minimized is that of lip rounding and tongue-body raising (formation of a velo-palatal constriction) for the vowel /u/. Lip rounding and tongue-body raising should have similar acoustic effects for /u/, mainly to lower F2. In multiple repetitions, reciprocal contributions of lip rounding and tongue-body raising could help limit F2 variability for /u/; thus this experiment looked for complementary covariation (negative correlations) in measures of these two parameters. An electro-magnetic midsagittal articulometer (EMMA) was used to track movements of midsagittal points on the tongue body, upper and lower lips, and mandible for large numbers of repetitions of utterances containing /u/. (Interpretation of the data was aided by results from area-function-to-formant modeling.) Three of four subjects showed weak negative correlations, tentatively supporting the hypothesis; a fourth showed the opposite pattern: positive correlations of lip rounding and tongue raising. The results are discussed with respect to ideas about motor equivalence, the nature of speech motor programming, and potential improvements to the paradigm.

Electromagnetic midsagittal articulometer systems for transducing speech articulatory movements.

This paper describes two electromagnetic midsagittal articulometer (EMMA) systems that were developed for transducing articulatory movements during speech production. Alternating magnetic fields are generated by transmitter coils that are mounted in an assembly that fits on the head of a speaker. The fields induce alternating voltages in a number of small transducer coils that are attached to articulators in the midline plane, inside and outside the vocal tract. The transducers are connected by fine lead wires to receiver electronics whose output voltages are processed to yield measures of transducer locations as a function of time. Measurement error can arise with this method, because as the articulators move and change shape, the transducers can undergo a varying amount of rotational misalignment with respect to the transmitter axes; both systems are designed to correct for transducer misalignment. For this purpose, one system uses two transmitters and biaxial transducers; the other uses three transmitters and single-axis transducers. The systems have been compared with one another in terms of their performance, human subjects compatibility, and ease of use. Both systems can produce useful midsagittal-plane data on articular movement, and each one has a specific set of advantages and limitations. (Two commercially available systems are also described briefly for comparison purposes). If appropriate experimental controls are used, the three-transmitter system is preferable for practical reasons.

Effects of short-term auditory deprivation on speech production in adult cochlear implant users.

Speech production parameters of three postlingually deafened adults who use cochlear implants were measured: after 24 h of auditory deprivation (which was achieved by turning the subject's speech processor off); after turning the speech processor back on; and after turning the speech processor off again. The measured parameters included vowel acoustics [F1, F2, F0, sound-pressure level (SPL), duration and H1-H2, the amplitude difference between the first two spectral harmonics, a correlate of breathiness] while reading word lists, and average airflow during the reading of passages. Changes in speech processor state (on-to-off or vice versa) were accompanied by numerous changes in speech production parameters. Many changes were in the direction of normalcy, and most were consistent with long-term speech production changes in the same subjects following activation of the processors of their cochlear implants [Perkell et al., J. Acoust. Soc. Am. 91, 2961-2978 (1992)]. Changes in mean airflow were always accompanied by H1-H2 (breathiness) changes in the same direction, probably due to underlying changes in laryngeal posture. Some parameters (different combinations of SPL, F0, H1-H2 and formants for different subjects) showed very rapid changes when turning the speech processor on or off. Parameter changes were faster and more pronounced, however, when the speech processor was turned on than when it was turned off. The picture that emerges from the present study is consistent with a dual role for auditory feedback in speech production: long-term calibration of articulatory parameters as well as feedback mechanisms with relatively short time constants.