Auditory-Tactile integration: Effects of Phase of Sinusoidal Stimulation at 50 and 250 Hz.

The perceptual integration of 50- and 250-Hz, 500-ms vibrotactile and auditory tones was studied in detection experiments as a function of the relative phase (0°, 72°, 144°, 216°, and 288°) of the tone pulses. Vibrotactile stimuli were delivered through a single-channel vibrator to the left middle fingertip and auditory stimuli were presented diotically through headphones in a background of 50 dB SPL broadband noise. The observers were four adults with normal hearing. The vibrotactile and auditory stimulus levels used each yielded 63-77%-Correct unimodal detection performance in a two-interval two-alternative forced-choice task. Scores for the auditory-alone and tactile-alone conditions averaged roughly 70%-Correct. Mean scores for the auditory plus tactile conditions averaged across different phases were 77.1%-Correct at 50 Hz and 79.6%-Correct at 250 Hz. At 50 Hz, no differences in performance were observed as a function of the relative phase at which the combined auditory and tactile signals were presented. At 250 Hz, significantly higher scores were observed for one phase combination (72°) compared to two of the other four relative phases. Performance on the auditory plus tactile conditions resulted in significant integrative effects and was generally more consistent with a "Pythagorean Sum" model than with either an "Algebraic Sum" or an "Optimum Single Cannel" model of perceptual integration.

Effects of sounds of locomotion on speech perception.

Human locomotion typically creates noise, a possible consequence of which is the masking of sound signals originating in the surroundings. When walking side by side, people often subconsciously synchronize their steps. The neurophysiological and evolutionary background of this behavior is unclear. The present study investigated the potential of sound created by walking to mask perception of speech and compared the masking produced by walking in step with that produced by unsynchronized walking. The masking sound (footsteps on gravel) and the target sound (speech) were presented through the same speaker to 15 normal-hearing subjects. The original recorded walking sound was modified to mimic the sound of two individuals walking in pace or walking out of synchrony. The participants were instructed to adjust the sound level of the target sound until they could just comprehend the speech signal ("just follow conversation" or JFC level) when presented simultaneously with synchronized or unsynchronized walking sound at 40 dBA, 50 dBA, 60 dBA, or 70 dBA. Synchronized walking sounds produced slightly less masking of speech than did unsynchronized sound. The median JFC threshold in the synchronized condition was 38.5 dBA, while the corresponding value for the unsynchronized condition was 41.2 dBA. Combined results at all sound pressure levels showed an improvement in the signal-to-noise ratio (SNR) for synchronized footsteps; the median difference was 2.7 dB and the mean difference was 1.2 dB [P < 0.001, repeated-measures analysis of variance (RM-ANOVA)]. The difference was significant for masker levels of 50 dBA and 60 dBA, but not for 40 dBA or 70 dBA. This study provides evidence that synchronized walking may reduce the masking potential of footsteps.

Monitor, a vibrotactile aid for environmental perception: a field evaluation by four people with severe hearing and vision impairment.

Monitor is a portable vibrotactile aid to improve the ability of people with severe hearing impairment or deafblindness to detect, identify, and recognize the direction of sound-producing events. It transforms and adapts sounds to the frequency sensitivity range of the skin. The aid was evaluated in the field. Four females (44-54 years) with Usher Syndrome I (three with tunnel vision and one with only light perception) tested the aid at home and in traffic in three different field studies: without Monitor, with Monitor with an omnidirectional microphone, and with Monitor with a directional microphone. The tests were video-documented, and the two field studies with Monitor were initiated after five weeks of training. The detection scores with omnidirectional and directional microphones were 100% for three participants and above 57% for one, both in their home and traffic environments. In the home environment the identification scores with the omnidirectional microphone were 70%-97% and 58%-95% with the directional microphone. The corresponding values in traffic were 29%-100% and 65%-100%, respectively. Their direction perception was improved to some extent by both microphones. Monitor improved the ability of people with deafblindness to detect, identify, and recognize the direction of events producing sounds.

Vibrotactile identification of signal-processed sounds from environmental events.

This study compared three different signal-processing principles (eight basic algorithms)-transposing, modulating, and filtering-to find the principle(s)/algorithm(s) that resulted in the best tactile identification of environmental sounds. The subjects were 19 volunteers (9 female/10 male) who were between 18 and 50 years old and profoundly hearing impaired. We processed sounds produced by 45 representative environmental events with the different algorithms and presented them to subjects as tactile stimuli using a wide-band stationary vibrator. We compared eight algorithms based on the three principles (one unprocessed, as reference). The subjects identified the stimuli by choosing among 10 alternatives drawn from the 45 events. We found that algorithm and subject were significant factors affecting the results (repeated measures analysis of variance, p < 0.001). We also found large differences between individuals regarding which algorithm was best. The test-retest variability was small (mean +/- 95% confidence interval = 8 +/- 3 percentage units), and no correlation was noted between identification score and individual vibratory thresholds. One transposing algorithm and two modulating algorithms led to significantly better results than did the unprocessed signals (p < 0.05). Thus, the two principles of transposing and modulating were appropriate, whereas filtering was unsuccessful. In future work, the two transposing algorithms and the modulating algorithm will be used in tests with a portable vibrator for people with dual sensory impairment (hearing and vision).

Auditive identification of signal-processed environmental sounds: monitoring the environment.

The goal of the present study was to compare six transposing signal-processing algorithms based on different principles (Fourier-based and modulation based), and to choose the algorithm that best enables identification of environmental sounds, i.e. improves the ability to monitor events in the surroundings. Ten children (12-15 years) and 10 adults (21-33 years) with normal hearing listened to 45 representative environmental (events) sounds processed using the six algorithms, and identified them in three different listening experiments involving an increasing degree of experience. The sounds were selected based on their importance for normal hearing and deaf-blind subjects. Results showed that the algorithm based on transposition of 1/3 octaves (fixed frequencies) with large bandwidth was better (p<0.015) than algorithms based on modulation. There was also a significant effect of experience (p<0.001). Adults were significantly (p<0.05) better than children for two algorithms. No clear gender difference was observed. It is concluded that the algorithm based on transposition with large bandwidth and fixed frequencies is the most promising for development of hearing aids to monitor environmental sounds.