High dynamic range imaging via gradient-aware context aggregation network

Qingsen Yan

doi:10.1016/j.patcog.2021.108342

Return

High dynamic range imaging via gradient-aware context aggregation network

2022-02-01

PRE

DOI：10.1016/j.patcog.2021.108342

Original

Original request for help

Save

Abstract

En 中文

Obtaining a high dynamic range (HDR) image from multiple low dynamic range images with different ex-posures is an important step in various computer vision tasks. One of the ongoing challenges in the field is to generate HDR images without ghosting artifacts. Motivated by an observation that such artifacts are particularly noticeable in the gradient domain, in this paper, we propose an HDR imaging approach that aggregates the information from multiple LDR images with guidance from image gradient domain. The proposed method generates artifact-free images by integrating the image gradient information and the image context information in the pixel domain. The context information in a large area helps to re-construct the contents contaminated by saturation and misalignments. Specifically, an additional gradient stream and the supervision in the gradient domain are applied to incorporate the gradient information in HDR imaging. To use the context information captured from a large area while preserving spatial resolu-tion, we adopt dilated convolutions to extract multi-scale features with rich context information. More -over, we build a new dataset containing 40 groups of real-world images from diverse scenes with ground truth to validate the proposed model. The samples in the proposed dataset include more challenging moving objects inducing misalignments. Extensive experimental results demonstrate that our proposed model outperforms previous methods on different datasets in terms of both quantitative measure and visual perception quality. (c) 2021 Elsevier Ltd. All rights reserved.

Keywords:

High dynamic range imaging

Deep learning

Exposure fusion

Ghosting artifacts

Image gradients