arrow
Return

Joint UV Optimization and Texture Baking

delete2023-09-28
delete2
PRE
AI
J
Julian Knodt *
Z
Zherong Pan
K
Kui Wu
X
Xifeng Gao
DOI:10.1145/3617683delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Level of detail has been widely used in interactive computer graphics. In current industrial 3D modeling pipelines, artists rely on commercial software to generate highly detailed models with UV maps and then bake textures for low-poly counterparts. In these pipelines, each step is performed separately, leading to unsatisfactory visual appearances for low polygon count models. Moreover, existing texture baking techniques assume the low-poly mesh has a small geometric difference from the high-poly, which is often not true in practice, especially with extremely low poly count models. To alleviate the visual discrepancy of the low-poly mesh, we propose to jointly optimize UV mappings during texture baking, allowing for low-poly models to faithfully replicate the appearance of the high-poly even with large geometric differences. We formulate the optimization within a differentiable rendering framework, allowing the automatic adjustment of texture regions to encode appearance information. To compensate for view parallaxwhen two meshes have large geometric differences, we introduce a spherical harmonic parallaxmapping, which uses spherical harmonic functions to modulate per-texel UV coordinates based on the view direction. We evaluate the effectiveness and robustness of our approach on a dataset composed of online downloaded models, with varying complexities and geometric discrepancies. Our method achieves superior quality over state-of-the-art techniques and commercial solutions.
Keywords:
Texture baking
differentiable rendering
UV optimization

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

No organization information available
Cited Papers

Cited Papers

Deviations from the O 3 –NO–NO 2 photo-stationary state in Delhi, India
err2014-10-01
err0
PREAI
errDilip M. Chate; Sachin D. Ghude; Gurfan Beig; Anoop S. Mahajan; Chinmay Jena; Reka Srinivas; Anita Dahiya; Nandini Kumar
errShare
errSave
A study of subtropical park thermal comfort and its influential factors during summer
err2022-10-01
err0
PREAI
errWei Guo; Lin Jiang; Bin Cheng; Yanfeng Yao; Chunlu Wang; Yining Kou; Sheng Xu; Deqing Xian
errShare
errSave
Tessellation-Free Displacement Mapping for Ray Tracing
err2021-12-10
err14
errOAAI
errThonat, Theo; Beaune, Francois; Sun, Xin; Carr, Nathan; Boubekeur, Tamy
errShare
errSave
errShare
errSave
errShare
errSave
Treatment of Hepatitis C Virus With Interferon In Hemodialysis Patients Awaiting Kidney Transplant
err2005-04-01
err0
PREAI
errM. Rivera; M.A. Gentil; M. Sayago; F. González Roncero; C. Trigo; G. Algarra; P. Pereira; M.A. Valdivia; J. Aguilar
errShare
errSave
Large Steps in Inverse Rendering of Geometry
err2021-12-10
err60
PREAI
errNicolet, Baptiste; Jacobson, Alec; Jakob, Wenzel
errShare
errSave
researcher View more