[Virtual audiovisual talking heads: articulatory data and models--applications]. / Têtes parlantes audiovisuelles virtuelles: données et modèles articulatoires--applications.

In the framework of experimental phonetics, our approach to the study of speech production is based on the measurement, the analysis and the modeling of orofacial articulators such as the jaw, the face and the lips, the tongue or the velum. Therefore, we present in this article experimental techniques that allow characterising the shape and movement of speech articulators (static and dynamic MRI, computed tomodensitometry, electromagnetic articulography, video recording). We then describe the linear models of the various organs that we can elaborate from speaker-specific articulatory data. We show that these models, that exhibit a good geometrical resolution, can be controlled from articulatory data with a good temporal resolution and can thus permit the reconstruction of high quality animation of the articulators. These models, that we have integrated in a virtual talking head, can produce augmented audiovisual speech. In this framework, we have assessed the natural tongue reading capabilities of human subjects by means of audiovisual perception tests. We conclude by suggesting a number of other applications of talking heads.

[Functional evaluation of intraoral reconstructive surgery. A valuable tool: articulatory evaluation of the acoustic signal]. / Evaluation fonctionnelle des reconstructions endobuccales. Un outil intéressant: l'interprétation articulatoire du signal acoustique.

Functional tests are needed to assess the quality of reconstructive surgery after treatment of intraoral cancers. Quality of Life tests are subjective and Cinefluoroscopy is a demanding and non-comparative procedure. We develop here a method to test the capacity of patients to maximize use of their articulatory space. We recorded a corpus of sounds. These sounds were analyzed with classical signal processing procedures. By comparison with a non-distorded sound database, it was possible to evaluate speech disorders, localize the defect, and provide a guide for rehabilitation. This method is an objective, reproductible, and comparative measurement tool.

Compensation strategies for the perturbation of French [u] using a lip tube. II. Perceptual analysis.

A perceptual analysis of the French vowel [u] produced by 10 speakers under normal and perturbed conditions (Savariaux et al., 1995) is presented which aims at characterizing in the perceptual domain the task of a speaker for this vowel, and, then, at understanding the strategies developed by the speakers to deal with the lip perturbation. Identification and rating tests showed that the French [u] is perceptually fairly well described in the [F1, (F2-F0)] plane, and that the parameter (((F2-F0) + F1)/2) (all frequencies in bark) provides a good overall correlate of the "grave" feature classically used to describe the vowel [u] in all languages. This permitted reanalysis of the behavior of the speakers during the perturbation experiment. Three of them succeed in producing a good [u] in spite of the lip tube, thanks to a combination of limited changes on F1 and (F2-F0), but without producing the strong backward movement of the tongue, which would be necessary to keep the [F1,F2] pattern close to the one measured in normal speech. The only speaker who strongly moved his tongue back and maintained F1 and F2 at low values did not produce a perceptually well-rated [u], but additional tests demonstrate that this gesture allowed him to preserve the most important phonetic features of the French [u], which is primarily a back and rounded vowel. It is concluded that speech production is clearly guided by perceptual requirements, and that the speakers have a good representation of them, even if they are not all able to meet them in perturbed conditions.