arrow
返回

Human-robot facial coexpression

delete2024-03-27
delete3
delete
OA
AI
Y
Yuhang Hu
B
Boyuan Chen
J
Jiong Lin
Y
Yunzhe Wang
Y
Yingke Wang
C
Cameron Mehlman
H
Hod Lipson *
DOI:10.1126/scirobotics.adi4724delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Large language models are enabling rapid progress in robotic verbal communication, but nonverbal communication is not keeping pace. Physical humanoid robots struggle to express and communicate using facial movement, relying primarily on voice. The challenge is twofold: First, the actuation of an expressively versatile robotic face is mechanically challenging. A second challenge is knowing what expression to generate so that the robot appears natural, timely, and genuine. Here, we propose that both barriers can be alleviated by training a robot to anticipate future facial expressions and execute them simultaneously with a human. Whereas delayed facial mimicry looks disingenuous, facial coexpression feels more genuine because it requires correct inference of the human's emotional state for timely execution. We found that a robot can learn to predict a forthcoming smile about 839 milliseconds before the human smiles and, using a learned inverse kinematic facial self-model, coexpress the smile simultaneously with the human. We demonstrated this ability using a robot face comprising 26 degrees of freedom. We believe that the ability to coexpress simultaneous facial expressions could improve human-robot interaction.
Keyword:
EMOTION RECOGNITION
EXPRESSIONS
MIMICRY
AUTISM
SMILES
PERCEPTION
DEFICITS
EMPATHY
YOUNG

期刊

Science Robotics 封面图
Science Robotics
IF:
27.5
论文数:
933
被引数:
1.4W

机构

C
Columbia University
学者数:
7.1W
论文数: 6.4W
被引数: 263
D
Duke University
学者数:
6.3W
论文数: 5.7W
被引数: 6.5W
引用论文

引用论文

The neural basis of mentalizing
errNEURON
IF15
err2006-05-01
err1.4K
errOAAI
errFrith, Chris D.; Frith, Uta
err分享
err收藏
Single-Neuron Responses in Humans during Execution and Observation of Actions
err2010-04-01
err878
errOAAI
errMukamel, Roy; Ekstrom, Arne D.; Kaplan, Jonas; Iacoboni, Marco; Fried, Itzhak
err分享
err收藏
Facial expressions of emotion are not culturally universal
err2012-04-16
err591
errOAAI
errJack, Rachael E.; Garrod, Oliver G. B.; Yu, Hui; Caldara, Roberto; Schyns, Philippe G.
err分享
err收藏
Emotional Mimicry as Social Regulation
err2013-01-24
err421
PREAI
errHess, Ursula; Fischer, Agneta
err分享
err收藏
Robotics and Neuroscience机器人和神经科学
err2014-09-01
err62
errOAAI
errFloreano, Dario; Ijspeert, Auke Jan; Schaal, Stefan
err分享
err收藏
The early development of autistic children
err1977-09-01
err0
PREAI
errEdward M. Ornitz; Donald Guthrie; Arthur H. Farley
err分享
err收藏
Cilofungin (LY121019) shows nonlinear plasma pharmacokinetics and tissue penetration in rabbits
err1990-11-01
err0
errOAAI
errJ W Lee; P Kelly; J Lecciones; D Coleman; R Gordee; P A Pizzo; T J Walsh
err分享
err收藏
学者 查看更多内容