.png){kind=icon}
返回
Conditional Temporal Variational AutoEncoder for Action Video Prediction
.png){kind=icon}
PRE
AI
DOI：10.1007/s11263-023-01832-8.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
To synthesize a realistic action sequence based on a single human image, it is crucial to model both motion patterns and diversity in the action video. This paper proposes an Action Conditional Temporal Variational AutoEncoder (ACT-VAE) to improve motion prediction accuracy and capture movement diversity. ACT-VAE predicts pose sequences for an action clip from a single input image. It is implemented as a deep generative model that maintains temporal coherence according to the action category with a novel temporal modeling on latent space. Further, ACT-VAE is a general action sequence prediction framework. When connected with a plug-and-play Pose-to-Image network, ACT-VAE can synthesize image sequences. Extensive experiments bear out our approach can predict accurate pose and synthesize realistic image sequences, surpassing state-of-the-art approaches. Compared to existing methods, ACT-VAE improves model accuracy and preserves diversity.
Keyword:
Variational AutoEncoder
Action modeling
Temporal coherence
Adversarial learning
期刊
IF:
9.3
论文数:
3.9K
被引数:
2.8W
机构
引用论文
分享收藏Grain orientation dependence of nanoindentation and deformation-induced martensitic phase transformation in neutron irradiated AISI 304L stainless steel.png)
Materialia
OAAI
MaterialiaIF0
OAAI分享收藏
分享收藏
查看更多内容