arrow
Return

Subdivision-based Mesh Convolution Networks

delete2022-03-07
delete64
delete
OA
AI
胡
胡事民 (Shi‐Min Hu) *
M
Meng-Hao Guo
J
Jun-Xiong Cai
J
Jiahui Huang
穆
穆太江 (Tai‐Jiang Mu)
R
Ralph R. Martin
DOI:10.1145/3506694delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Convolutionalneural networks (CNNs) have made great breakthroughs in two-dimensional (2D) computer vision. However, their irregular structure makes it hard to harness the potential of CNNs directly on meshes. A subdivision surface provides a hierarchical multi-resolution structure in which each face in a closed 2-manifold triangle mesh is exactly adjacent to three faces. Motivated by these two observations, this article presents SubdivNet, an innovative and versatile CNN framework for three-dimensional (3D) triangle meshes with Loop subdivision sequence connectivity. Making an analogy between mesh faces and pixels in a 2D image allows us to present a mesh convolution operator to aggregate local features from nearby faces. By exploiting face neighborhoods, this convolution can support standard 2D convolutional network concepts, e.g., variable kernel size, stride, and dilation. Based on the multi-resolution hierarchy, we make use of pooling layers that uniformly merge four faces into one and an upsampling method that splits one face into four. Thereby, many popular 2D CNN architectures can be easily adapted to process 3D meshes. Meshes with arbitrary connectivity can be remeshed to have Loop subdivision sequence connectivity via self-parameterization, making SubdivNet a general approach. Extensive evaluation and various applications demonstrate SubdivNet's effectiveness and efficiency.
Keywords:
Geometric deep learning
convolutional neural network
subdivision surfaces
mesh processing

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
C
Cardiff University
Scholars:
2.7W
Papers: 2.5W
Citations: 3.5W
Cited Papers

Cited Papers

errShare
errSave
PCT: Point cloud transformer
err2021-06-01
err1.0K
errOAAI
errGuo, Meng-Hao; Cai, Jun-Xiong; Liu, Zheng-Ning; Mu, Tai-Jiang; Martin, Ralph R.; Hu, Shi-Min
errShare
errSave
Geometric modeling with conical meshes and developable surfaces
err2006-07-01
err314
PREAI
errLiu, Yang; Pottmann, Helmut; Wallner, Johannes; Yang, Yong-Liang; Wang, Wenping
errShare
errSave
The Development of a NOx Reduction System during the Fuel Cut Period for Gasoline Vehicles
err2019-04-02
err0
PREAI
errMuyoung Choi; Jinwoo Song; Eunsang Lee; Sangjin Ma; Sangmin Lee; Jungmin Seo; Seungbeom Yoo; Jun Lee
errShare
errSave
Jittor: a novel deep learning framework with meta-operators and unified graph execution
err2020-11-13
err108
PREAI
errHu, Shi-Min; Liang, Dun; Yang, Guo-Ye; Yang, Guo-Wei; Zhou, Wen-Yang
errShare
errSave
DeepPano: Deep Panoramic Representation for 3-D Shape Recognition
err2015-12-01
err329
PREAI
errShi, Baoguang; Bai, Song; Zhou, Zhichao; Bai, Xiang
errShare
errSave
Deep Geometric Texture Synthesis
err2020-08-12
err39
errOAAI
errHertz, Amir; Hanocka, Rana; Giryes, Raja; Cohen-Or, Daniel
errShare
errSave
errShare
errSave
researcher View more