arrow
返回

ControlMat: A Controlled Generative Approach to Material Capture

delete2024-09-11
delete1
delete
OA
AI
G
Giuseppe Vecchio *
A
Arthur Roullier
A
Adrien Kaiser
R
Romain Rouffet
V
Valentin Deschaintre
T
Tamy Boubekeur
DOI:10.1145/3688830delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Material reconstruction from a photograph is a key component of 3D content creation democratization. We propose to formulate this ill-posed problem as a controlled synthesis one, leveraging the recent progress in generative deep networks. We present ControlMat, a method which, given a single photograph with uncontrolled illumination as input, conditions a diffusion model to generate plausible, tileable, high-resolution physically-based digital materials. We carefully analyze the behavior of diffusion models for multi-channel outputs, adapt the sampling process to fuse multi-scale information and introduce rolled diffusion to enable both tileability and patched diffusion for high-resolution outputs. Our generative approach further permits exploration of a variety of materials that could correspond to the input image, mitigating the unknown lighting conditions. We show that our approach outperforms recent inference and latent-space optimization methods, and we carefully validate our diffusion process design choices.
Keyword:
Computing methodologies
Appearance and texture representations

期刊

ACM Transactions on Graphics 封面图
ACM Transactions on Graphics
IF:
9.5
论文数:
4.7K
被引数:
3.6W

机构

U
University of Catania
学者数:
1.9W
论文数: 1.4W
被引数: 20
引用论文

引用论文

err分享
err收藏
An Inverse Procedural Modeling Pipeline for SVBRDF MapsSVBRDF映射的逆过程建模流水线
err2022-01-04
err31
errOAAI
errHu, Yiwei; He, Chengan; Deschaintre, Valentin; Dorsey, Julie; Rushmeier, Holly
err分享
err收藏
MaterialGAN: Reflectance Capture using a Generative SVBRDF Model
err2020-11-27
err65
errOAAI
errGuo, Yu; Smith, Cameron; Hasan, Milos; Sunkavalli, Kalyan; Zhao, Shuang
err分享
err收藏
Teaching for transfer in ELT
err2006-04-01
err0
PREAI
errM. A James
err分享
err收藏
Two-Shot SVBRDF Capture for Stationary Materials
err2015-07-27
err125
errOAAI
errAittala, Miika; Weyrich, Tim; Lehtinen, Jaakko
err分享
err收藏
学者 查看更多内容