arrow
返回

Interactive Character Control with Auto-Regressive Motion Diffusion Models

delete2024-07-19
delete0
delete
OA
AI
Y
Yi Shi *
J
Jingbo Wang
B
Bingkun Lin
B
Bo Dai
X
Xue Bin Peng
DOI:10.1145/3658140delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Real-time character control is an essential component for interactive experiences, with a broad range of applications, including physics simulations, video games, and virtual reality. The success of diffusion models for image synthesis has led to the use of these models for motion synthesis. However, the majority of these motion diffusion models are primarily designed for offline applications, where space-time models are used to synthesize an entire sequence of frames simultaneously with a pre-specified length. To enable real-time motion synthesis with diffusion model that allows time-varying controls, we propose A-MDM (Auto-regressive Motion Diffusion Model). Our conditional diffusion model takes an initial pose as input, and auto-regressively generates successive motion frames conditioned on the previous frame. Despite its streamlined network architecture, which uses simple MLPs, our framework is capable of generating diverse, long-horizon, and high-fidelity motion sequences. Furthermore, we introduce a suite of techniques for incorporating interactive controls into A-MDM, such as task-oriented sampling, in-painting, and hierarchical reinforcement learning (See Figure 1). These techniques enable a pre-trained A-MDM to be efficiently adapted for a variety of new downstream tasks. We conduct a comprehensive suite of experiments to demonstrate the effectiveness of A-MDM, and compare its performance against state-of-the-art auto-regressive methods.
Keyword:
Motion Synthesis
Diffusion Model
Reinforcement Learning

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.7K
被引数:
3.6W

机构

S
Simon Fraser University
学者数:
1.0W
论文数: 1.0W
被引数: 1.4W
S
Shanghai Artificial Intelligence Laboratory
学者数:
475
论文数: 261
被引数: 765
引用论文

引用论文

Factors influencing Local Communities Relational Values to Forest Protected Areas in Jordan
err2020-12-01
err0
PREAI
errSalsabeel Shishany; Amani A. Al-Assaf; Mohammad Majdalawi; Mohammad Tabieh; Maher Tadros
err分享
err收藏
DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills
err2018-07-30
err322
errOAAI
errPeng, Xue Bin; Abbeel, Pieter; Levine, Sergey; van de Panne, Michiel
err分享
err收藏
Phase-Functioned Neural Networks for Character Control
err2017-07-20
err407
errOAAI
errHolden, Daniel; Komura, Taku; Saito, Jun
err分享
err收藏
err分享
err收藏
ASE: Large-Scale Reusable Adversarial Skill Embeddings for Physically Simulated Characters
err2022-07-22
err72
errOAAI
errBin Peng, Xue; Guo, Yunrong; Halper, Lina; Levine, Sergey; Fidler, Sanja
err分享
err收藏
Abnormal Cortical Development after Premature Birth Shown by Altered Allometric Scaling of Brain Growth
err2006-08-01
err0
errOAAI
errOlga Kapellou; Serena J Counsell; Nigel Kennea; Leigh Dyet; Nadeem Saeed; Jaroslav Stark; Elia Maalouf; Philip Duggan; Morenike Ajayi-Obe; Jo Hajnal; Joanna M Allsop; James Boardman; Mary A Rutherford; Frances Cowan; A. David Edwards
err分享
err收藏
学者 查看更多内容