.png){kind=icon}
Return
Gradient-Guided Motion Transfer with Motion Optimization
.png){kind=icon}
PRE
AI
DOI：10.1007/978-981-95-4384-7_30.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Image animation brings static objects in source images to life based on driving video. Recent studies commonly employ unsupervised methods for transferring motion to arbitrary objects. However, these approaches encounter challenges due to the absence of prior knowledge about the objects structure, which critically impacts the preservation of structural integrity during the motion transfer, ultimately influencing the quality of the results. To address this issue, we introduce an additional gradient branch that generates a warped gradient map, providing valuable structural priors for the motion transfer process. Furthermore, we incorporate a gradient loss to encourage the generator to focus more on preserving the geometric structure. Additionally, existing prior-based motion model methods typically predict low-resolution, single-scale motion flows, making it challenging to learn precise motion and adapt to multi-scale feature fusion. To address this, we propose a motion flow optimization module to generate higher-accuracy multi-scale motion flows. Experimental results demonstrate that our method exhibits high scalability and can be applied to various unsupervised motion models. It outperforms state-of-the-art methods across most benchmarks, leading to significant improvements in motion-related metrics.
Keywords:
Image animation
Unsupervised learning
Gradient guided
Journal
N
IF:
0
Papers:
26
Citations:
0
Organization
Cited Papers
.png){kind=icon}
ShareSaveShareSave
View more