arrow
Return

Flexible Isosurface Extraction for Gradient-Based Mesh Optimization

delete2023-07-26
delete24
delete
OA
AI
T
Tianchang Shen *
J
Jacob Munkberg
J
Jon Hasselgren
Z
Zian Wang
W
Wenzheng Chen
Ž
Žan Gojčič
S
Sanja Fidler
N
Nicholas Sharp
J
Jun Gao
DOI:10.1145/3592430delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This work considers gradient-based mesh optimization, where we iteratively optimize for a 3D surface mesh by representing it as the isosurface of a scalar field, an increasingly common paradigm in applications including photogrammetry, generative modeling, and inverse physics. Existing implementations adapt classic isosurface extraction algorithms like Marching Cubes or Dual Contouring; these techniques were designed to extract meshes from fixed, known fields, and in the optimization setting they lack the degrees of freedom to represent high-quality feature-preserving meshes, or suffer from numerical instabilities. We introduce FlexiCubes, an isosurface representation specifically designed for optimizing an unknown mesh with respect to geometric, visual, or even physical objectives. Our main insight is to introduce additional carefully-chosen parameters into the representation, which allow local flexible adjustments to the extracted mesh geometry and connectivity. These parameters are updated along with the underlying scalar field via automatic differentiation when optimizing for a downstream task. We base our extraction scheme on Dual Marching Cubes for improved topological properties, and present extensions to optionally generate tetrahedral and hierarchically-adaptive meshes. Extensive experiments validate FlexiCubes on both synthetic benchmarks and real-world applications, showing that it offers significant improvements in mesh quality and geometric fidelity.
Keywords:
isosurface extraction
gradient-based mesh optimization
photogrammetry
generative models

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

U
university of toronto
Scholars:
14.8W
Papers: 12.0W
Citations: 165
Cited Papers

Cited Papers

Point2Mesh: A Self-Prior for Deformable Meshes
err2020-08-12
err115
errOAAI
errHanocka, Rana; Metzer, Gal; Giryes, Raja; Cohen-Or, Daniel
errShare
errSave
SCORES: Shape Composition with Recursive Substructure Priors
err2018-12-04
err38
PREAI
errZhu, Chenyang; Xu, Kai; Chaudhuri, Siddhartha; Yi, Renjiao; Zhang, Hao
errShare
errSave
Spectroscopic and Computational Studies of (μ-Oxo)(μ-1,2-peroxo)diiron(III) Complexes of Relevance to Nonheme Diiron Oxygenase Intermediates
err2008-09-24
err0
errOAAI
errAdam T. Fiedler; Xiaopeng Shan; Mark P. Mehn; József Kaizer; Stéphane Torelli; Jonathan R. Frisch; Masahito Kodera; Lawrence Que, Jr.
errShare
errSave
Tanks and Temples: Benchmarking Large-Scale Scene Reconstruction
err2017-07-20
err636
PREAI
errKnapitsch, Arno; Park, Jaesik; Zhou, Qian-Yi; Koltun, Vladlen
errShare
errSave
Cumulative hypertension burden and risk of end-stage renal disease
err2021-08-19
err0
PREAI
errChang Seong Kim; Bongseong Kim; Hong Sang Choi; Eun Hui Bae; Seong Kwon Ma; Kyung-Do Han; Soo Wan Kim
errShare
errSave
researcher View more