arrow
Return

Contrastive learning for deep tone mapping operator

delete2024-08-01
delete1
PRE
AI
D
Di Li
M
Mou Wang
S
Susanto Rahardja *
DOI:10.1016/j.image.2024.117130delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Most existing tone mapping operators (TMOs) are developed based on prior assumptions of human visual system, and they are known to be sensitive to hyperparameters. In this paper, we proposed a straightforward yet efficient framework to automatically learn the priors and perform tone mapping in an end -to -end manner. The proposed algorithm utilizes a contrastive learning framework to enforce the content consistency between high dynamic range (HDR) inputs and low dynamic range (LDR) outputs. Since contrastive learning aims at maximizing the mutual information across different domains, no paired images or labels are required in our algorithm. Equipped with an attention-based U -Net to alleviate the aliasing and halo artifacts, our algorithm can produce sharp and visually appealing images over various complex real -world scenes, indicating that the proposed algorithm can be used as a strong baseline for future HDR image tone mapping task. Extensive experiments as well as subjective evaluations demonstrated that the proposed algorithm outperforms the existing state -of -the -art algorithms qualitatively and quantitatively. The code is available at https://github. com/xslidi/CATMO.
Keywords:
Generative adversarial net
Tone mapping
High dynamic range images
Deep learning
Contrastive learning

Journal

S
Signal Processing and Image Communication
IF:
2.7
Papers:
2.8K
Citations:
4.2K

Organization

N
Northwestern Polytechnical University
Scholars:
4.6W
Papers: 3.7W
Citations: 5.3W
C
chinese academy of sciences
Scholars:
56.3W
Papers: 44.8W
Citations: 704