Projector Compensation Framework Using Differentiable Rendering

doi:10.1109/ACCESS.2022.3169861

Projector Compensation Framework Using Differentiable Rendering

2022-01-01

3

OA

AI

DOI：10.1109/ACCESS.2022.3169861

Original

Original request for help

Save

Abstract

En 中文

Projection mapping is a widely adopted technique in various applications. A typically projector-camera system consists of a projector and camera pair where a projector emits an application-specific input image onto a surface, and the camera captures the projected output image. Given an ideal projection surface with white-colored planar geometries, the camera (or a viewer) can observe the projected output image without any visual distortion. The surface, however, can have arbitrary shapes and textured colors in practice, and it often introduces visually distracting artifacts to the output image. It results in lowering the viewing experience drastically. We propose a projector compensation framework that adjusts the projector input image so that the camera can see the projected output image with a much-reduced distortion. Our key contribution is to model the real projection mapping process with a virtual but controllable light simulation and optimize the projector input using differentiable rendering. We demonstrate that our new framework produces a more accurate output than state-of-the-art methods given complex projection surfaces.

Keywords:

Rendering (computer graphics)

Cameras

Image color analysis

Calibration

Estimation

Surface treatment

Neural networks

Projector compensation

geometric calibration

photometric compensation

differentiable rendering

Projector Compensation Framework Using Differentiable Rendering

Abstract

Journal

Organization