1
Return

AniFeats: Animate 3D Feature Meshes for Character Video Generation

delete2026-06-09
delete0
PRE
AI
B
Beijia Lu
Z
Zekai Gu
Z
Zhiyang Dou
H
Haotian Yuan
P
Peng Li
C
Chenyang Si
Y
Yukang Cao
Y
Yuming Jiang
Y
Yuan Liu
W
Wenping Wang
Z
Ziwei Liu
DOI:10.1109/tvcg.2026.3701833delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Generating high-quality character animation videos is a fascinating yet challenging task. Existing methods use geometry guidance signals like skeletons, normal maps, or depth maps in a diffusion model to generate character videos from a single reference image. Although these approaches have shown encouraging results, they solely rely on cross attention layers to extract geometry guidance which inevitably leads to temporal inconsistencies and reduced quality. In this paper, we present a novel framework <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">AniFeats</b> to generate high-quality character animation videos. In contrast to existing methods, our key insight is to incorporate explicit features on 3D character meshes during the video generation to achieve significantly improved temporal consistency. Specifically, AniFeats extracts detailed features from the reference image, projects them onto 3D feature meshes based on SMPL-X, and utilizes rendered feature maps from the animated 3D feature meshes as guidance throughout the generation process. This approach directly links local patterns in the input image to those in the output video, effectively strengthening temporal coherence. Extensive experiments demonstrate that AniFeats generates high-quality, temporally consistent character animations with remarkably enhanced realism.
Keywords:
Video generation
character animation
human video generation

Journal

IEEE Transactions on Visualization and Computer Graphics cover
IEEE Transactions on Visualization and Computer Graphics
IF:
6.5
Papers:
294
Citations:
2.2W

Organization

H
hong kong university of science and technology
Scholars:
802
Papers: 450
Citations: 1
T
tsinghua university
Scholars:
11.5W
Papers: 9.9W
Citations: 137
T
The University of Hong Kong
Scholars:
5.7K
Papers: 2.8K
Citations: 7
N
Nanyang Technological University
Scholars:
4.8W
Papers: 4.7W
Citations: 8.1W
A
alibaba damo academy
Scholars:
3
Papers: 3
Citations: 0
T
texas a&m university
Scholars:
2.4K
Papers: 951
Citations: 0
N
nanjing university
Scholars:
7.6W
Papers: 5.5W
Citations: 87
C
carnegie mellon university
Scholars:
1.8K
Papers: 864
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers