Comprehension and engagement in survey interviews with virtual agents.

This study investigates how an onscreen virtual agent's dialog capability and facial animation affect survey respondents' comprehension and engagement in "face-to-face" interviews, using questions from US government surveys whose results have far-reaching impact on national policies. In the study, 73 laboratory participants were randomly assigned to respond in one of four interviewing conditions, in which the virtual agent had either high or low dialog capability (implemented through Wizard of Oz) and high or low facial animation, based on motion capture from a human interviewer. Respondents, whose faces were visible to the Wizard (and videorecorded) during the interviews, answered 12 questions about housing, employment, and purchases on the basis of fictional scenarios designed to allow measurement of comprehension accuracy, defined as the fit between responses and US government definitions. Respondents answered more accurately with the high-dialog-capability agents, requesting clarification more often particularly for ambiguous scenarios; and they generally treated the high-dialog-capability interviewers more socially, looking at the interviewer more and judging high-dialog-capability agents as more personal and less distant. Greater interviewer facial animation did not affect response accuracy, but it led to more displays of engagement-acknowledgments (verbal and visual) and smiles-and to the virtual interviewer's being rated as less natural. The pattern of results suggests that a virtual agent's dialog capability and facial animation differently affect survey respondents' experience of interviews, behavioral displays, and comprehension, and thus the accuracy of their responses. The pattern of results also suggests design considerations for building survey interviewing agents, which may differ depending on the kinds of survey questions (sensitive or not) that are asked.

Positive affect predicts improved lip movement in facial movement disorder.

OBJECTIVES: Positive affect in individuals with a facial movement disorder may promote lip corner movement (zygomaticus major) during smiling. We investigated whether a positive affect marker (orbicularis oculi activity) observed in an initial clinic visit of individuals with facial movement disorder (N = 28) predicted increased lip corner movement at a subsequent visit. STUDY DESIGN AND SETTING: In this clinical outcomes study, lip corner movement was assessed with the use of automated facial analysis. Asymmetry of movement was compared in individuals who smiled with or without the positive affect marker at an initial clinic visit. RESULTS: The positive affect marker at the initial visit was associated with a reduction in the asymmetry of the lip corner movement at the second visit. CONCLUSION: Positive affect predicts improved facial movement outcomes in patients with facial movement disorders. SIGNIFICANCE: Positive emotion in facial movement patients may be an important factor in recovery of facial movement during therapy.

Long-term stability of frontal electroencephalographic asymmetry in adults with a history of depression and controls.

We investigated the stability in resting EEG across a 1- to 3-year interval in 49 adults (33 female and 16 male) with a history of unipolar depression (first onset prior to the age of 14) and 50 controls (33 female and 17 male) with no history of major psychopathology. Current depressive symptoms were quantified by self-report at both assessments. For the entire sample, EEG asymmetry in the alpha range was moderately stable (intraclass correlations between 0.39 and 0.61). Sex, history of depression, depressive symptom severity at Time 2, and change in symptom severity between Time 1 and Time 2 were unrelated to stability of EEG asymmetry. These findings support the view that resting frontal EEG asymmetry reflects a moderately stable individual difference in adults, irrespective of sex and history of depression.

Speed, amplitude, and asymmetry of lip movement in voluntary puckering and blowing expressions: implications for facial assessment.

The context of voluntary movement during facial assessment has significant effects on the activity of facial muscles. Using automated facial analysis, we found that healthy subjects instructed to blow produced lip movements that were longer in duration and larger in amplitude than when subjects were instructed to pucker. We also determined that lip movement for puckering expressions was more asymmetric than lip movement in blowing. Differences in characteristics of lip movement were noted using facial movement analysis and were associated with the context of the movement. The impact of the instructions given for voluntary movement on the characteristics of facial movement might have important implications for assessing the capabilities and deficits of movement control in individuals with facial movement disorders. If results generalize to the clinical context, assessment of generally focused voluntary facial expressions might inadequately demonstrate the full range of facial movement capability of an individual patient.