arrow
Return

Projector Compensation Framework Using Differentiable Rendering

delete2022-01-01
delete3
delete
OA
AI
J
Jino Park
D
Donghyuk Jung
B
Bochang Moon *
DOI:10.1109/ACCESS.2022.3169861delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Projection mapping is a widely adopted technique in various applications. A typically projector-camera system consists of a projector and camera pair where a projector emits an application-specific input image onto a surface, and the camera captures the projected output image. Given an ideal projection surface with white-colored planar geometries, the camera (or a viewer) can observe the projected output image without any visual distortion. The surface, however, can have arbitrary shapes and textured colors in practice, and it often introduces visually distracting artifacts to the output image. It results in lowering the viewing experience drastically. We propose a projector compensation framework that adjusts the projector input image so that the camera can see the projected output image with a much-reduced distortion. Our key contribution is to model the real projection mapping process with a virtual but controllable light simulation and optimize the projector input using differentiable rendering. We demonstrate that our new framework produces a more accurate output than state-of-the-art methods given complex projection surfaces.
Keywords:
Rendering (computer graphics)
Cameras
Image color analysis
Calibration
Estimation
Surface treatment
Neural networks
Projector compensation
geometric calibration
photometric compensation
differentiable rendering

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

No organization information available
Cited Papers

Cited Papers

Entrance of Bacteria into the Female Urinary Bladder
err1972-03-23
err0
PREAI
errJose L. Bran; Matthew E. Levison; Donald Kaye
errShare
errSave
Review of the development of lake wetlands eco-hydrology and case studies
err2019-01-01
err0
errOAAI
errLigang XU; Xijun LAI; Rongrong WAN; Xiaolong WANG; Xianghu LI
errShare
errSave
Real-Time Pixel Luminance Optimization for Dynamic Multi-Projection Mapping
err2015-11-02
err70
PREAI
errSiegl, Christian; Colaianni, Matteo; Thies, Lucas; Thies, Justus; Zollhoefer, Michael; Izadi, Shahram; Stamminger, Marc; Bauer, Frank
errShare
errSave
Hypoarousal in patients with the neglect syndrome and emotional indifference
err1978-03-01
err0
PREAI
errKENNETH M. HEILMAN; HARVEY D. SCHWARTZ; ROBERT T. WATSON
errShare
errSave
errShare
errSave
MRSI-based molecular imaging of therapy response to temozolomide in preclinical glioblastoma using source analysis
err2016-04-08
err0
errOAAI
errT. Delgado-Goñi; S. Ortega-Martorell; M. Ciezka; I. Olier; A. P. Candiota; M. Julià-Sapé; F. Fernández; M. Pumarola; P. J. Lisboa; C. Arús
errShare
errSave
Real-time navigation system for sentinel lymph node biopsy in breast cancer patients using projection mapping with indocyanine green fluorescence
err2018-05-09
err22
PREAI
errTakada, Masahiro; Takeuchi, Megumi; Suzuki, Eiji; Sato, Fumiaki; Matsumoto, Yoshiaki; Torii, Masae; Kawaguchi-Sakita, Nobuko; Nishino, Hiroto; Seo, Satoru; Hatano, Etsuro; Toi, Masakazu
errShare
errSave
High-temperature magnetic properties of SmCo6.7−xCu0.6Tix magnets
err2002-08-01
err0
PREAI
errI.A Al-Omari; J Shobaki; R Skomski; D Leslie-Pelecky; J Zhou; D.J Sellmyer
errShare
errSave
researcher View more