.png){kind=icon}
返回
Memory-Guided Image De-Raining Using Time-Lapse Data
.png){kind=icon}
OA
AI
DOI：10.1109/TIP.2022.3180561.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This paper addresses the problem of single image de-raining, that is, the task of recovering clean and rain-free background scenes from a single image obscured by a rainy artifact. Although recent advances adopt real-world time-lapse data to overcome the need for paired rain-clean images, they are limited to fully exploit the time-lapse data. The main cause is that, in terms of network architectures, they could not capture long-term rain streak information in the time-lapse data during training owing to the lack of memory components. To address this problem, we propose a novel network architecture combining the time-lapse data and, the memory network that explicitly helps to capture long-term rain streak information. Our network comprises the encoder-decoder networks and a memory network. The features extracted from the encoder are read and updated in the memory network that contains several memory items to store rain streak-aware feature representations. With the read/update operation, the memory network retrieves relevant memory items in terms of the queries, enabling the memory items to represent the various rain streaks included in the time-lapse data. To boost the discriminative power of memory features, we also present a novel background selective whitening (BSW) loss for capturing only rain streak information in the memory network by erasing the background information. Experimental results on standard benchmarks demonstrate the effectiveness and superiority of our approach.
Keyword:
Rain
Training
Network architecture
Feature extraction
Neural networks
Shape
Task analysis
Convolutional neural networks (CNNs)
image de-raining
memory network
time-lapse data
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
The influence of stacking fault energy and adhesion on the wear of copper and aluminum bronze.png)
Wear
WearIF0
PREAI
分享收藏分享收藏分享收藏分享收藏
查看更多内容