arrow
Return

MotionFlow: Efficient Motion Generation With Latent Flow Matching

delete2026-01-06
delete0
PRE
AI
K
Kun Dong
J
Jian Xue
X
Xing Lan
Q
Qingyuan Liu
K
Ke Lü
DOI:10.1109/TMM.2026.3651041delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In the field of human centric multimedia, text-driven human motion generation is a significant pursuit with wide-ranging applications across diverse scenarios. Despite substantial advancements, existing methods often suffer from a trade-off between inference latency and high-quality generation. To overcome this gap, we propose the Motion Latent Flow Matching model (MotionFlow), a novel and powerful framework for motion generation. It introduces flow matching algorithm in the latent space, which can achieve superior performance with just one-step inference. In addition to the text-driven task, we further extend our method to controllable motion generation. Specifically, we integrate a control encoder into the latent space and further decode the predicted latent code into motion space to support explicit supervision, ensuring the synthesized motion can tightly align with the input signals. Extensive experiments demonstrate that our MotionFlow not only outperforms current leading approaches for the text-driven task, but also delivers remarkable capabilities in controllable motion generation.
Keywords:
Human motion generation
flow matching
latent diffusion model

Journal

IEEE Transactions on Multimedia cover
IEEE Transactions on Multimedia
IF:
9.7
Papers:
4.6K
Citations:
2.4W

Organization

U
university of chinese academy of sciences
Scholars:
976
Papers: 395
Citations: 0
Cited Papers

Cited Papers

MoMask: Generative Masked Modeling of 3D Human Motions
err
IF0
err2024-06-16
err0
PREAI
errChuan Guo; Yuxuan Mu; Muhammad Gohar Javed; Sen Wang; Li Cheng
errShare
errSave
WaveDM: Wavelet-Based Diffusion Models for Image Restoration
err2024-01-01
err0
errOAAI
errYi Huang; Jiancheng Huang; Jianzhuang Liu; Mingfu Yan; Yu Dong; Jiaxi Lv; Chaoqi Chen; Shifeng Chen
errShare
errSave
FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesis
err2024-06-16
err0
PREAI
errFeng Liang; Bichen Wu; Jialiang Wang; Licheng Yu; Kunpeng Li; Yinan Zhao; Ishan Misra; Jia-Bin Huang; Peizhao Zhang; Peter Vajda; Diana Marculescu
errShare
errSave
Generating Diverse and Natural 3D Human Motions from Text
err2022-06-01
err0
PREAI
errChuan Guo; Shihao Zou; Xinxin Zuo; Sen Wang; Wei Ji; Xingyu Li; Li Cheng
errShare
errSave
HMD-Poser: On-Device Real-time Human Motion Tracking from Scalable Sparse Observations
err2024-06-16
err0
PREAI
errPeng Dai; Yang Zhang; Tao Liu; Zhen Fan; Tianyuan Du; Zhuo Su; Xiaozheng Zheng; Zeming Li
errShare
errSave
errShare
errSave
The KIT Motion-Language Dataset
err2016-12-01
err0
errOAAI
errMatthias Plappert; Christian Mandery; Tamim Asfour
errShare
errSave
researcher View more