Synchrony capture filterbank: auditory-inspired signal processing for tracking individual frequency components in speech.

A processing scheme for speech signals is proposed that emulates synchrony capture in the auditory nerve. The role of stimulus-locked spike timing is important for representation of stimulus periodicity, low frequency spectrum, and spatial location. In synchrony capture, dominant single frequency components in each frequency region impress their time structures on temporal firing patterns of auditory nerve fibers with nearby characteristic frequencies (CFs). At low frequencies, for voiced sounds, synchrony capture divides the nerve into discrete CF territories associated with individual harmonics. An adaptive, synchrony capture filterbank (SCFB) consisting of a fixed array of traditional, passive linear (gammatone) filters cascaded with a bank of adaptively tunable, bandpass filter triplets is proposed. Differences in triplet output envelopes steer triplet center frequencies via voltage controlled oscillators (VCOs). The SCFB exhibits some cochlea-like responses, such as two-tone suppression and distortion products, and possesses many desirable properties for processing speech, music, and natural sounds. Strong signal components dominate relatively greater numbers of filter channels, thereby yielding robust encodings of relative component intensities. The VCOs precisely lock onto harmonics most important for formant tracking, pitch perception, and sound separation.

Real time decomposition of speech into modulated components.

Motivated by the active process of the outer hair cell (OHC) in the mammalian inner ear, a real time decomposition of speech into modulated components is presented. A generalized phase lock loop (GPLL) was applied to decompose the speech signal into its envelope and positive instantaneous frequency (PIF) parts, which can be further processed and represented by timing information alone. A log-derivative operator is applied to the bandpass signal. Analytic and antianalytic components occupying non overlapping frequency bands are separated by filtering. The proposed algorithms are used to represent speech signals processed through a bandpass filter bank.