arrow
返回

TEXGen: a Generative Diffusion Model for Mesh Textures

delete2024-11-19
delete0
PRE
AI
喻
喻歆 (Xin Yu)
Z
Ze Yuan
Y
Yuan-Chen Guo
Y
Ying-Tian Liu
L
Liu, Jian hui
Y
Yangguang Li
Y
Yan‐Pei Cao
D
Ding Liang
X
Xiaojuan Qi *
DOI:10.1145/3687909delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
While high-quality texture maps are essential for realistic 3D asset rendering, few studies have explored learning directly in the texture space, especially on large-scale datasets. In this work, we depart from the conventional approach of relying on pre-trained 2D diffusion models for test- time optimization of 3D textures. Instead, we focus on the fundamental problem of learning in the UV texture space itself. For the first time, we train a large diffusion model capable of directly generating high-resolution texture maps in a feed-forward manner. To facilitate efficient learning in high-resolution UV spaces, we propose a scalable network architecture that interleaves convolutions on UV maps with attention layers on point clouds. Leveraging this architectural design, we train a 700 million parameter diffusion model that can generate UV texture maps guided by text prompts and single-view images. Once trained, our model naturally supports various extended applications, including text-guided texture inpainting, sparse-view texture completion, and text-driven texture synthesis. The code is available at https://github.com/CVMI-Lab/TEXGen.
Keyword:
Generative model
texture generation

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.8K
被引数:
3.6W

机构

U
University of Hong Kong
学者数:
4.1W
论文数: 3.9W
被引数: 10.1W
T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
B
Beihang University
学者数:
5.2W
论文数: 4.1W
被引数: 37
学者 查看更多机构
引用论文

引用论文

High-resolution genetic mapping of QTL governing resistance to corn leaf aphid, Rhopalosiphum maidis (Fitch) in barley
err2022-10-17
err0
PREAI
errBeant Singh; Dharminder Bhatia; Deepika Narang; Rajwinder Kaur; Parveen Chhuneja
err分享
err收藏
Quantitative DNA Methylation Analysis at Single-Nucleotide Resolution by Pyrosequencing®
err2017-12-10
err0
PREAI
errFlorence Busato; Emelyne Dejeux; Hafida El abdalaoui; Ivo Glynne Gut; Jörg Tost
err分享
err收藏
Amortizing Samples in Physics-Based Inverse Rendering using ReSTIR
err2023-12-05
err6
errOAAI
errWang, Yu-Chen; Wyman, Chris; Wu, Lifan; Zhao, Shuang
err分享
err收藏
Cross-Lingual Cross-Modal Retrieval with Noise-Robust Learning
err2022-10-10
err0
errOAAI
errYabing Wang; Jianfeng Dong; Tianxiang Liang; Minsong Zhang; Rui Cai; Xun Wang
err分享
err收藏
Generative Adversarial Networks生成对抗网络
err2020-10-22
err1.0W
errOAAI
errGoodfellow, Ian; Pouget-Abadie, Jean; Mirza, Mehdi; Xu, Bing; Warde-Farley, David; Ozair, Sherjil; Courville, Aaron; Bengio, Yoshua
err分享
err收藏
Controlled incandescence
err2011-10-12
err0
PREAI
errJean-Jacques Greffet
err分享
err收藏
Singlet Oxygen Generation by Metallotexaphyrins
err2008-01-02
err0
PREAI
errLeonard I. Grossweiner; Mehmet D. Bilgin; Peter Berdusis; Tarak D. Mody
err分享
err收藏
学者 查看更多内容