arrow
Return

Scratch-based Reflection Art via Differentiable Rendering

delete2023-07-26
delete3
PRE
AI
P
Pengfei Shen
R
Rui‐Zeng Li
B
Beibei Wang
刘利刚 cover
刘利刚 (Ligang Liu) *
DOI:10.1145/3592142delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The 3D visual optical arts create fascinating special effects by carefully designing interactions between objects and light sources. One of the essential types is 3D reflection art, which aims to create reflectors that can display different images when viewed from different directions. Existing works produce impressive visual effects. Unfortunately, previous works discretize the reflector surface with regular grids/facets, leading to a large parameter space and a high optimization time cost. In this paper, we introduce a new type of 3D reflection art - scratch-based reflection art, which allows for a more compact parameter space, easier fabrication, and computationally efficient optimization. To design a 3D reflection art with scratches, we formulate it as a multi-view optimization problem and introduce differentiable rendering to enable efficient gradient-based optimizers. For that, we propose an analytical scratch rendering approach, together with a high-performance rendering pipeline, allowing efficient differentiable rendering. As a consequence, we could display multiple images on a single metallic board with only several minutes for optimization. We demonstrate our work by showing virtual objects and manufacturing our designed reflectors with a carving machine.
Keywords:
Scratch Rendering
differentiable rendering
3D reflection art

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

U
university of science & technology of china, cas
Scholars:
3.2W
Papers: 2.7W
Citations: 74
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
Cited Papers

Cited Papers

Dr.Jit: A Just-In-Time Compiler for Differentiable Rendering
err2022-07-22
err61
errOAAI
errJakob, Wenzel; Speierer, Sebastien; Roussel, Nicolas; Vicini, Delio
errShare
errSave
A Reflectance Display
err2014-07-27
err15
PREAI
errGlasner, Daniel; Zickler, Todd; Levin, Anat
errShare
errSave
Printing Spatially-Varying Reflectance
err2009-12-01
err67
PREAI
errMatusik, Wojciech; Ajdin, Boris; Gu, Jinwei; Lawrence, Jason; Lensch, Hendrik P. A.; Pellacini, Fabio; Rusinkiewicz, Szymon
errShare
errSave
Perceptual Error Optimization for Monte Carlo Rendering
err2022-03-07
err6
errOAAI
errChizhov, Vassillen; Georgiev, Iliyan; Myszkowski, Karol; Singh, Gurprit
errShare
errSave
Constant-Cost Spatio-Angular Prefiltering of Glinty Appearance Using Tensor Decomposition
err2022-01-22
err8
errOAAI
errDeng, Hong; Liu, Yang; Wang, Beibei; Yang, Jian; Ma, Lei; Holzschuch, Nicolas; Yan, Ling-Qi
errShare
errSave
Computational Mirror Cup and Saucer Art
err2022-07-22
err6
errOAAI
errWu, Kang; Chen, Renjie; Fu, Xiao-Ming; Liu, Ligang
errShare
errSave
Learning Generative Models for Rendering Specular Microgeometry
err2019-11-08
err30
errOAAI
errKuznetsov, Alexandr; Hasan, Milos; Xu, Zexiang; Yan, Ling-Qi; Walter, Bruce; Kalantari, Nima Khademi; Marschner, Steve; Ramamoorthi, Ravi
errShare
errSave
Scratch iridescence: Wave-optical rendering of diffractive surface structure
err2017-11-20
err61
PREAI
errWerner, Sebastian; Velinov, Zdravko; Jakob, Wenzel; Hullin, Matthias B.
errShare
errSave
Survey on computational 3D visual optical art design
err2022-12-19
err5
errOAAI
errWu, Kang; Fu, Xiao-Ming; Chen, Renjie; Liu, Ligang
errShare
errSave
Fabricating Reflectors for Displaying Multiple Images
err2018-07-30
err13
errOAAI
errSakurai, Kaisei; Dobashi, Yoshinori; Iwasaki, Kei; Nishita, Tomoyuki
errShare
errSave
researcher View more