arrow
Return

Audio-Driven Laughter Behavior Controller

delete2017-10-01
delete6
delete
OA
AI
Y
Yu Ding *
J
Jing Huang
C
Catherine Pélachaud
DOI:10.1109/TAFFC.2017.2754365delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
It has been well documented that laughter is an important communicative and expressive signal in face-to-face conversations. Our work aims at building a laughter behavior controller for a virtual character which is able to generate upper body animations from laughter audio given as input. This controller relies on the tight correlations between laughter audio and body behaviors. A unified continuous-state statistical framework, inspired by Kalman filter, is proposed to learn the correlations between laughter audio and head/torso behavior from a recorded laughter human dataset. Due to the lack of shoulder behavior data in the recorded human dataset, a rule-based method is defined to model the correlation between laughter audio and shoulder behavior. In the synthesis step, these characterized correlations are rendered in the animation of a virtual character. To validate our controller, a subjective evaluation is conducted where participants viewed the videos of a laughing virtual character. It compares the animations of a virtual character using our controller and a state of the art method. The evaluation results show that the laughter animations computed with our controller are perceived as more natural, expressing amusement more freely and appearing more authentic than with the state of the art method.
Keywords:
Laughter
audio-driven
data-driven
animation synthesis
continuous-state
Kalman filter
prosody
nonverbal behaviors
virtual character
statistical framework
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Affective Computing cover
IEEE Transactions on Affective Computing
IF:
9.8
Papers:
1.3K
Citations:
9.1K

Organization

Z
Zhejiang Gongshang University
Scholars:
6.6K
Papers: 4.9K
Citations: 8.1K
U
university of houston system
Scholars:
1.4W
Papers: 1.4W
Citations: 16
U
university of houston
Scholars:
9.7K
Papers: 7.9K
Citations: 11
researcher View more organizations