arrow
返回

Audio-Driven Robot Upper-Body Motion Synthesis

delete2021-11-01
delete0
delete
OA
AI
J
Jan Ondras
O
Oya Çeliktutan *
P
Paul Bremner
H
Hatice Güneş
DOI:10.1109/TCYB.2020.2966730delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Body language is an important aspect of human communication, which an effective human-robot interaction interface should mimic well. Human beings exchange information and convey their thoughts and feelings through gaze, facial expressions, body language, and tone of voice along with spoken words, and infer 65% of the meaning of the communicated messages from these nonverbal cues. Modern robotic platforms are, however, limited in their ability to automatically generate behaviors that align with their speech. In this article, we develop a neural-network-based system that takes audio from a user as an input and generates upper-body gestures, including head, hand, and torso movements of the user on a humanoid robot, namely, Softbank Robotics' Pepper. Our system was evaluated quantitatively as well as qualitatively using Web surveys when driven by natural speech and synthetic speech. We compare the impact of generic and person-specific neural-network models on the quality of synthesized movements. We further investigate the relationships between quantitative and qualitative evaluations and examine how the speaker's personality traits affect the synthesized movements.
Keyword:
Feature extraction
Hidden Markov models
Magnetic heads
Humanoid robots
Torso
Real-time systems
Audio-based motion generation
human-robot interaction
personality perception
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Cybernetics 封面图
IEEE Transactions on Cybernetics
IF:
10.5
论文数:
1.1W
被引数:
5.0W

机构

U
University of Cambridge
学者数:
7.7W
论文数: 7.1W
被引数: 13.7W
U
University of Bristol
学者数:
3.1W
论文数: 3.0W
被引数: 5.3W
引用论文

引用论文

Recessive oncogenes
err1993-02-01
err0
PREAI
errRobert Bookstein; D. Craig Allred
err分享
err收藏
err分享
err收藏
Low expression of long noncoding RNA GAS6-AS1 predicts a poor prognosis in patients with NSCLC
err2013-08-24
err0
PREAI
errLiang Han; Rong Kong; Dan-Dan Yin; Er-Bao Zhang; Tong-Peng Xu; Wei De; Yong-Qian Shu
err分享
err收藏
Gesture Controllers
err2010-07-26
err71
PREAI
errLevine, Sergey; Kraehenbuehl, Philipp; Thrun, Sebastian; Koltun, Vladlen
err分享
err收藏
err分享
err收藏
Hypertrophy of the Normal Human Kidney Following Contralateral Nephrectomy
err1972-01-01
err0
PREAI
errG. Boner; J. Sherry; R.E. Rieselbach
err分享
err收藏
学者 查看更多内容