1
Return

Hierarchical Mesh Representation Learning With Spectral Dictionary Embedding

delete2026-05-04
delete0
PRE
AI
Z
Zhongpai Gao
J
Junchi Yan
T
Tianyu Luan
G
Guangtao Zhai
X
Xiaokang Yang
DOI:10.1109/tpami.2026.3690051delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Learning mesh representation is important for many 3D tasks. Conventional convolution for regular data (i.e., images) cannot directly be applied to meshes since each vertex’s neighbors are unordered. Previous methods use isotropic filters or predefined local coordinate systems or learning weighting matrices for each template vertex to overcome the irregularity. Learning weighting matrices to resample the vertex’s neighbors into an implicit canonical order is the most effective way to capture the local structure of each vertex. However, learning weighting matrices for each vertex increases the model size linearly with the vertex number. Thus, large parameters are required for high-resolution 3D shapes, which is not favorable for many applications. In this paper, we learn spectral dictionary (i.e., bases) for the weighting matrices such that the model size is independent of the resolution of 3D shapes. The coefficients of the weighting matrix bases are learned from the spectral features of the template and its hierarchical levels in a weight-sharing manner. Furthermore, we introduce an adaptive sampling method that learns the hierarchical mapping matrices directly to improve the performance without increasing the model size at the inference stage. Comprehensive experiments demonstrate that our model produces state-of-the-art results with a much smaller model size.
Keywords:
Graph convolutional network
representation learning
3D mesh
3D morphable model

Journal

IEEE Transactions on Pattern Analysis and Machine Intelligence cover
IEEE Transactions on Pattern Analysis and Machine Intelligence
IF:
18.6
Papers:
831
Citations:
9.8W

Organization

S
shanghai jiao tong university
Scholars:
15.1W
Papers: 11.5W
Citations: 159
S
state university of new york at buffalo
Scholars:
182
Papers: 47
Citations: 0
U
united imaging intelligence
Scholars:
26
Papers: 14
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers