1
Return

Spatial-Temporal Relation Guided Motion Transfer via Diffusion Model

delete2026-06-23
delete0
PRE
AI
Y
Yuan Li
J
Junjie Wu
R
Runze Fan
S
Sio Kei Im
L
Lili Wang
DOI:10.1109/tvcg.2026.3706364delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Transferring existing Human-Object Interaction (HOI) motion to novel objects is essential for robotics, virtual reality. Traditional approaches only model spatial surface correspondences between humans and source objects or between source and target objects, ignoring the internal topological structures of humans, the internal topology of objects, the non-surface spatial topological relationships, and temporal motion relations. In this paper, we propose a spatial-temporal relation guided motion transfer framework. Firstly, we define a spatial-temporal relation interaction graph representation(STRIG) to model the human internal topology, object internal topology and human-object global topology together with the temporal motion relation. We propose a STRIGs-guided motion transfer diffusion model for generating spatially, semantically and temporally consistent HOI motions that are adapted to novel objects. To tackle the absence of ground-truth motions after transfer, we introduce a spatial-temporal relation optimization strategy. Extensive experiments demonstrate that our method consistently outperforms other approaches in terms of motion transfer quality, performance, and sequence stability, with particularly robustness under large variations in target object topology.
Keywords:
Human-object interaction
motion transfer
diffusion model

Journal

IEEE Transactions on Visualization and Computer Graphics cover
IEEE Transactions on Visualization and Computer Graphics
IF:
6.5
Papers:
294
Citations:
2.2W

Organization

B
Beihang University
Scholars:
5.0W
Papers: 4.0W
Citations: 37
M
Macao Polytechnic University
Scholars:
1.5K
Papers: 1.4K
Citations: 805
Cited Papers

Cited Papers

Citing Papers

Citing Papers