arrow
返回

DreamUDF: Generating Unsigned Distance Fields from A Single Image

delete2024-11-19
delete0
delete
OA
AI
刘玉涛 封面图
刘玉涛 (Yutao Liu)
W
Weikai Chen
J
Jie Yang
X
Xiaoxu Meng
B
Bo Yang
L
Lin Gao *
DOI:10.1145/3687769delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recent advances in diffusion models and neural implicit surfaces have shown promising progress in generating 3D models. However, existing generative frameworks are limited to closed surfaces, failing to cope with a wide range of commonly seen shapes that have open boundaries. In this work, we present DreamUDF, a novel framework for generating high-quality 3D objects with arbitrary topologies from a single image. To address the challenge of generating proper topology given sparse and ambiguous observations, we propose to incorporate both the data priors from a multi-view diffusion model and the geometry priors brought by an unsigned distance field (UDF) reconstructor. In particular, we leverage a joint framework that consists of 1) a generation module that produces a neural radiance field for photo realistic renderings from arbitrary views; and 2) a reconstruction module that distills the learnable radiance field into surfaces with arbitrary topologies. We further introduce a field coupler that bridges the radiance field and UDF under a novel optimization scheme. This allows the two modules to mutually boost each other during training. Extensive experiments and evaluations demonstrate that DreamUDF achieves high-quality reconstruction and robust 3D generation on both closed and open surfaces with arbitrary topologies, compared to the previous works.
Keyword:
Unsigned distance field
single-view 3D generation
diffusion model
neural radiance field

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.7K
被引数:
3.6W

机构

U
university of chinese academy of sciences, cas
学者数:
4.1W
论文数: 3.8W
被引数: 75
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Interleukin10 -592 Promoter Polymorphism Associated with Gastric Cancer Among Asians: A Meta-Analysis of Epidemiologic Studies
err2009-08-11
err0
PREAI
errWen Zhuang; Xiao-Ting Wu; Yong Zhou; Liu Liu; Guan-Jian Liu; Tai-Xiang Wu; Xun Yao; Liang Du; Mao-Ling Wei
err分享
err收藏
Combined Brønsted Base-Promoted CO2 Fixation into Benzylic C–H Bonds of Alkylarenes
err2022-06-28
err0
PREAI
errMasanori Shigeno; Itsuki Tohara; Keita Sasaki; Kanako Nozawa-Kumada; Yoshinori Kondo
err分享
err收藏
CD133-targeted delivery of self-assembled PEGylated carboxymethylcellulose-SN38 nanoparticles to colorectal cancer
err2018-03-08
err0
errOAAI
errMona Alibolandi; Khalil Abnous; Sajjad Anvari; Marzieh Mohammadi; Mohammad Ramezani; Seyed Mohammad Taghdisi
err分享
err收藏
A new Jurassic theropod from China documents a transitional step in the macrostructure of feathers
err2017-08-22
err0
PREAI
errUlysse Lefèvre; Andrea Cau; Aude Cincotta; Dongyu Hu; Anusuya Chinsamy; François Escuillié; Pascal Godefroit
err分享
err收藏
Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Covering
err2023-12-05
err7
errOAAI
errHou, Fei; Chen, Xuhui; Wang, Wencheng; Qin, Hong; He, Ying
err分享
err收藏
Neural Dual Contouring
err2022-07-22
err43
errOAAI
errChen, Zhiqin; Tagliasacchi, Andrea; Funkhouser, Thomas; Zhang, Hao
err分享
err收藏
学者 查看更多内容