arrow
Return

Example-based Motion Synthesis via Generative Motion Matching

delete2023-07-26
delete9
delete
OA
AI
W
Weiyu Li *
X
Xuelin Chen
P
Peizhuo Li
O
Olga Sorkine‐Hornung
陈
陈宝权 (Baoquan Chen)
DOI:10.1145/3592395delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We present GenMM, a generative model that mines as many diverse motions as possible from a single or few example sequences. In stark contrast to existing data-driven methods, which typically require long offline training time, are prone to visual artifacts, and tend to fail on large and complex skeletons, GenMM inherits the training-free nature and the superior quality of the well-known Motion Matching method. GenMM can synthesize a high-quality motion within a fraction of a second, even with highly complex and large skeletal structures. At the heart of our generative framework lies the generative motion matching module, which utilizes the bidirectional visual similarity as a generative cost function to motion matching, and operates in a multi-stage framework to progressively refine a random guess using exemplar motion matches. In addition to diverse motion generation, we show the versatility of our generative framework by extending it to a number of scenarios that are not possible with motion matching alone, including motion completion, key frame-guided generation, infinite looping, and motion reassembly.
Keywords:
motion synthesis
generative model
motion matching

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

E
ETH Zurich
Scholars:
3.0W
Papers: 2.4W
Citations: 8.4W
S
swiss federal institutes of technology domain
Scholars:
9.0W
Papers: 8.0W
Citations: 163
T
Tencent
Scholars:
1.1K
Papers: 898
Citations: 5
S
shandong university
Scholars:
9.5W
Papers: 6.4W
Citations: 94
researcher View more organizations
Cited Papers

Cited Papers

Recurrent Conjunctival Melanoma with Neuroidal Spindle Cell Features
err1987-01-01
err0
PREAI
errDonald A. Morris; Frederick A. Jakobiec; Paul Henkind; Robert Della Rocca; Takeo Iwamoto
errShare
errSave
MotioNet: 3D Human Motion Reconstruction from Monocular Video with Skeleton Consistency
err2020-09-04
err68
errOAAI
errShi, Mingyi; Aberman, Kfir; Aristidou, Andreas; Komura, Taku; Lischinski, Dani; Cohen-Or, Daniel; Chen, Baoquan
errShare
errSave
errShare
errSave
DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills
err2018-07-30
err322
errOAAI
errPeng, Xue Bin; Abbeel, Pieter; Levine, Sergey; van de Panne, Michiel
errShare
errSave
Continuous Character Control with Low-Dimensional Embeddings
err2012-07-01
err143
PREAI
errLevine, Sergey; Wang, Jack M.; Haraux, Alexis; Popovic, Zoran; Koltun, Vladlen
errShare
errSave
Phase-Functioned Neural Networks for Character Control
err2017-07-20
err407
errOAAI
errHolden, Daniel; Komura, Taku; Saito, Jun
errShare
errSave
Neuromyelitis Optica Mimicking Intramedullary Tumor
err2013-01-01
err0
errOAAI
errSi-Hyuck Oh; Kyeong-wook Yoon; Young-Jin Kim; Sang-koo Lee
errShare
errSave
researcher View more