Restraining vocal fold vertical motion reduces source-filter interaction in a two-mass model.

Previous experimental studies suggested that restraining the vocal fold vertical motion may reduce the coupling strength between the voice source and vocal tract. In this study, the effects of vocal fold vertical motion on source-filter interaction were systematically examined in a two-dimensional two-mass model coupled to a compressible flow simulation. The results showed that when allowed to move vertically, the vocal folds exhibited subharmonic vibration due to entrainment to the first vocal tract acoustic resonance. Restraining the vertical motion suppressed this entrainment. This indicates that the vertical mobility of the vocal folds may play a role in regulating source-filter interaction.

Comparison of one-dimensional and three-dimensional glottal flow models in left-right asymmetric vocal fold conditions.

While the glottal flow is often simplified as one-dimensional (1D) in computational models of phonation to reduce computational costs, the 1D flow model has not been validated in left-right asymmetric vocal fold conditions, as often occur in both normal and pathological voice production. In this study, we performed three-dimensional (3D) and 1D flow simulations coupled to a two-mass model of adult male vocal folds and compared voice production at different degrees of left-right stiffness asymmetry. The flow and acoustic fields in 3D were obtained by solving the compressible Navier-Stokes equations using the volume penalization method with the moving vocal fold wall as an immersed boundary. Despite differences in the predicted flow pressure on vocal fold surface between the 1D and 3D flow models, the results showed reasonable agreement in vocal fold vibration patterns and selected voice outcome measures between the 1D and 3D models for the range of left-right asymmetric conditions investigated. This indicates that vocal fold properties play a larger role than the glottal flow in determining the overall pattern of vocal fold vibration and the produced voice, and the 1D flow simplification is sufficient in modeling phonation, at least for the simplified glottal geometry of this study.

Numerical investigation of effects of tongue articulation and velopharyngeal closure on the production of sibilant [s].

A numerical simulation of sibilant /s/ production with the realistically moving vocal tract was conducted to investigate the flow and acoustic characteristics during the articulation process of velopharyngeal closure and tongue movement. The articulation process was simulated from the end of /u/ to the middle of /s/ in the Japanese word /usui/, including the tongue elevation and the velopharyngeal valve closure. The time-dependent vocal tract geometry was reconstructed from the computed tomography scan. The moving immersed boundary method with the hierarchical structure grid was adopted to approach the complex geometry of the human speech organs. The acoustic characteristics during the co-articulation process were observed and consistent with the acoustic measurement for the subject of the scan. The further simulations with the different closing speeds of the velopharyngeal closure showed that the far-field sound during the co-articulation process was amplified with the slower closing case, and the velum closure speed was inverse proportional to the sound amplitude with the slope value of - 35.3 dB s/m. This indicates possible phonation of indistinguishable aeroacoustics sound between /u/ and /s/ with slower velopharyngeal closure.

Estimation of sibilant groove formation and sound generation from early hominin jawbones.

The speech production capability of sibilant fricatives of early hominin was assessed by interpolating the modern human vocal tract to an Australopithecine specimen based on the jawbone landmarks, and then simulating the airflow and sound generation. The landmark interpolation demonstrates the possibility to form the sibilant groove in the anterior part of the oral tract, and results of the aeroacoustic simulation indicate that the early hominins had the potential to produce the fricative broadband noise with a constant supply of airflow to the oral cavity, although the ancestor's tongue deformation ability is still uncertain, and the results are highly speculative.

Numerical investigation of effects of incisor angle on production of sibilant /s/.

The effects of the inclination angle of the incisor on the speech production of the fricative consonant /s/ was investigated using an implicit compressible flow solver. The hierarchical structure grid was applied to reduce the grid generation time for the vocal tract geometry. The airflow and sound during the pronunciation of /s/ were simulated using the adaptively switched time stepping scheme, and the angle of the incisor in the vocal tract was changed from normal position up to 30°. The results showed that increasing the incisor angle affected the flow configuration and moved the location of the high turbulence intensity region thereby decreased the amplitudes of the sound in the frequency range from 8 to 12 kHz. Performing the Fourier transform on the velocity fluctuation, we found that the position of large magnitudes of the velocity at 10 kHz shifted toward the lip outlet when the incisor angle was increased. In addition, separate acoustic simulations showed that the shift in the potential sound source position decreased the far-field sound amplitudes above 8 kHz. These results provide the underlying insights necessary to design dental prostheses for the production of sibilant fricatives.

Aeroacoustic differences between the Japanese fricatives [ɕ] and [ç].

To elucidate the linguistic similarity between the alveolo-palatal sibilant [ɕ] and palatal non-sibilant [ç] in Japanese, the aeroacoustic differences between the two consonants were explored via experimentation with participants and analysis using simplified vocal tract models. The real-time magnetic resonance imaging (rtMRI) observations of articulatory movements demonstrated that some speakers use a nearly identical place of articulation for /si/ [ɕi] and /hi/ [çi]. Simplified vocal tract models were then constructed based on the data captured by static MRI, and the model-generated synthetic sounds were compared with speaker data producing [ɕ] and [ç]. Speaker data demonstrated that the amplitude of the broadband noise of [ç] was weaker than that of [ɕ]; the characteristic peak amplitude at approximately 4 kHz was greater in [ç] than in [ɕ], although the mid-sagittal vocal tract profiles were nearly identical for three of ten subjects in the rtMRI observation. These acoustic differences were reproduced by the proposed models, with differences in the width of the coronal plane constriction and the flow rate. The results suggest the need to include constriction width and flow rate as parameters for articulatory phonetic descriptions of speech sounds.

Global numerical simulation of fluid-structure-acoustic interaction in a single-reed instrument.

A numerical simulation of a single-reed instrument with a pressure chamber is conducted to examine the interaction among the flow, reed oscillation, and acoustic propagation. The flow and acoustic fields are predicted using the three-dimensional compressible Navier-Stokes equations, whereas the one-dimensional dynamic beam equation is solved for reed oscillation. The deforming geometry in the aeroacoustic field is expressed by the volume penalization method as an immersed boundary technique. The results showed that the waveforms of the tip opening and far-field acoustic spectra agreed well with those measured experimentally. The three-dimensional flow configuration near the tip opening was visualized, and the measurement of the instantaneous volume flow rate at the tip opening revealed that 30%-40% of the total flow rate passed through the side opening. The spectral tendencies of the time derivatives of the flow rate for different tip openings were consistent with that of the far-field sound, indicating that the slope of the flow rate waveform significantly affects the generated sound's harmonics.

A simplified vocal tract model for articulation of [s]: The effect of tongue tip elevation on [s].

Fricative consonants are known to be pronounced by controlling turbulent flow inside a vocal tract. In this study, a simplified vocal tract model was proposed to investigate the characteristics of flow and sound during production of the fricative [s] in a word context. By controlling the inlet flow rate and tongue speed, the acoustic characteristics of [s] were reproduced by the model. The measurements with a microphone and a hot-wire anemometer showed that the flow velocity at the teeth gap and far-field sound pressure started oscillating before the tongue reached the /s/ position, and continued during tongue descent. This behaviour was not affected by the changes of the tongue speed. These results indicate that there is a time shift between source generation and tongue movement. This time shift can be a physical constraint in the articulation of words which include /s/. With the proposed model, we could investigate the effects of tongue speed on the flow and sound generation in a parametric way. The proposed methodology is applicable for other phonemes to further explore the aeroacoustics of phonation.

Aeroacoustic analysis on individual characteristics in sibilant fricative production.

The cause of individual acoustic characteristics of sibilant fricatives /s/ and /ʃ/ was analyzed by extracting vocal tract geometries and conducting aeroacoustic experiments and simulations on each geometry. The vocal tract geometries of five Japanese subjects while sustaining /s/ and /ʃ/ were collected by magnetic resonance imaging. Flow and sound generation in the vocal tracts was predicted by large eddy simulations of compressible flow. The characteristic dimensions of the vocal tracts were extracted and simplified vocal tract models were constructed to clarify the relationship between the geometries and the acoustic characteristics. The acoustic characteristics of sounds generated by the simplified models agreed well with the sounds predicted by the simulation, indicating that the proposed model is able to express the individual characteristics in the production of sibilant fricatives. A comparison of the models showed that the volume and length of a space downstream from the constriction are key factors controlling the acoustic characteristics of each subject.

Attraction of posture and motion-trajectory elements of conspecific biological motion in medaka fish.

Visual recognition of conspecifics is necessary for a wide range of social behaviours in many animals. Medaka (Japanese rice fish), a commonly used model organism, are known to be attracted by the biological motion of conspecifics. However, biological motion is a composite of both body-shape motion and entire-field motion trajectory (i.e., posture or motion-trajectory elements, respectively), and it has not been revealed which element mediates the attractiveness. Here, we show that either posture or motion-trajectory elements alone can attract medaka. We decomposed biological motion of the medaka into the two elements and synthesized visual stimuli that contain both, either, or none of the two elements. We found that medaka were attracted by visual stimuli that contain at least one of the two elements. In the context of other known static visual information regarding the medaka, the potential multiplicity of information regarding conspecific recognition has further accumulated. Our strategy of decomposing biological motion into these partial elements is applicable to other animals, and further studies using this technique will enhance the basic understanding of visual recognition of conspecifics.

Model-based inverse estimation for active contraction stresses of tongue muscles using 3D surface shape in speech production.

This paper presents a novel inverse estimation approach for the active contraction stresses of tongue muscles during speech. The proposed method is based on variational data assimilation using a mechanical tongue model and 3D tongue surface shapes for speech production. The mechanical tongue model considers nonlinear hyperelasticity, finite deformation, actual geometry from computed tomography (CT) images, and anisotropic active contraction by muscle fibers, the orientations of which are ideally determined using anatomical drawings. The tongue deformation is obtained by solving a stationary force-equilibrium equation using a finite element method. An inverse problem is established to find the combination of muscle contraction stresses that minimizes the Euclidean distance of the tongue surfaces between the mechanical analysis and CT results of speech production, where a signed-distance function represents the tongue surface. Our approach is validated through an ideal numerical example and extended to the real-world case of two Japanese vowels, /ʉ/ and /ɯ/. The results capture the target shape completely and provide an excellent estimation of the active contraction stresses in the ideal case, and exhibit similar tendencies as in previous observations and simulations for the actual vowel cases. The present approach can reveal the relative relationship among the muscle contraction stresses in similar utterances with different tongue shapes, and enables the investigation of the coordination of tongue muscles during speech using only the deformed tongue shape obtained from medical images. This will enhance our understanding of speech motor control.

Effects of tongue position in the simplified vocal tract model of Japanese sibilant fricatives /s/ and /ʃ/.

The effects of tongue position on sound properties were investigated by using simplified models of sibilant fricatives /s/ and /ʃ/. These were constructed from medical images of a native Japanese-speaking subject who pronounced both fricative sounds. The sounds generated by the models were experimentally measured and compared with the subjects /s/ and /ʃ/. The position of tongue models altered the main peak frequency and spectral mean of the generated sound, which resulted in the reproduction of frequency characteristics of /s/ or /ʃ/ with the subjects tongue position.