.png){kind=icon}
返回
Interaction Transformer for Human Reaction Generation
.png){kind=icon}
OA
AI
DOI：10.1109/TMM.2023.3242152.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We address the challenging task of human reaction generation, which aims to generate a corresponding reaction based on an input action. Most of the existing works do not focus on generating and predicting the reaction and cannot generate the motion when only the action is given as input. To address this limitation, we propose a novel interaction Transformer (InterFormer) consisting of a Transformer network with both temporal and spatial attention. Specifically, temporal attention captures the temporal dependencies of the motion of both characters and of their interaction, while spatial attention learns the dependencies between the different body parts of each character and those which are part of the interaction. Moreover, we propose using graphs to increase the performance of spatial attention via an interaction distance module that helps focus on nearby joints from both characters. Extensive experiments on the SBU interaction, K3HI, and DuetDance datasets demonstrate the effectiveness of InterFormer. Our method is general and can be used to generate more complex and long-term interactions.
Keyword:
Skeleton
Transformers
Task analysis
Three-dimensional displays
Decoding
Encoding
Computational modeling
Human reaction generation
interaction
transformer
期刊
IF:
9.7
论文数:
4.5K
被引数:
2.4W
机构
引用论文
The Efficacy of Acamprosate and Naltrexone in the Treatment of Alcohol Dependence: A Relative Benefits Analysis of Randomized Controlled Trials阿坎酸和纳曲酮治疗酒精依赖的疗效: 随机对照试验的相对益处分析
PREAI
分享收藏Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study II.png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏Pheromonotropic activity of naturally occurring pyrokinin insect neuropeptides (FXPRLamide) in Helicoverpa zeaPeptides
PeptidesIF0
PREAI
分享收藏
查看更多内容