arrow
Return

A Two-Stage Density-Aware Single Image Deraining Method

delete2021-01-01
delete12
PRE
AI
M
Min Cao
Z
Zhi Gao *
B
Bharath Ramesh
T
Tiancan Mei
J
Jinqiang Cui
DOI:10.1109/TIP.2021.3099396delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Although advanced single image deraining methods have been proposed, one main challenge remains: the available methods usually perform well on specific rain patterns but can hardly deal with scenarios with dramatically different rain densities, especially when the impacts of rain streaks and the veiling effect caused by rain accumulation are heavily coupled. To tackle this challenge, we propose a two-stage density-aware single image deraining method with gated multi-scale feature fusion. In the first stage, a realistic physics model closer to real rain scenes is leveraged for initial deraining, and a network branch is also trained for rain density estimation to guide the subsequent refinement. The second stage of model-independent refinement is realized using conditional Generative Adversarial Network (cGAN), aiming to eliminate artifacts and improve the restoration quality. In particular, dilated convolutions are applied to extract rain features at multiple scales and gated feature fusion is exploited to better aggregate multi-level contextual information in both stages. Extensive experiments have been conducted on representative synthetic rain datasets and real rain scenes. Quantitative and qualitative results demonstrate the superiority of our method in terms of effectiveness and generalization ability, which outperforms the state-of-the-art.
Keywords:
Rain
Physics
Logic gates
Image restoration
Feature extraction
Task analysis
Learning systems
Single image deraining
cGAN
physics model
rain density classification
gated fusion
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

P
Peng Cheng Laboratory
Scholars:
1.7K
Papers: 1.7K
Citations: 2.0K
N
National University of Singapore
Scholars:
7.5W
Papers: 6.5W
Citations: 11.4W
W
wuhan university
Scholars:
8.0W
Papers: 5.8W
Citations: 70
researcher View more organizations