arrow
Return

Rain Streaks Removal for Single Image via Kernel-Guided Convolutional Neural Network

delete2021-08-01
delete40
delete
OA
AI
Y
Ye-Tao Wang
X
Xi-Le Zhao *
蒋太翔 cover
蒋太翔 (Tai-Xiang Jiang)
L
Liang-Jian Deng
Y
Yi Chang
T
Ting‐Zhu Huang
DOI:10.1109/TNNLS.2020.3015897delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Recently emerged deep learning methods have achieved great success in single image rain streaks removal. However, existing methods ignore an essential factor in the rain streaks generation mechanism, i.e., the motion blur leading to the line pattern appearances. Thus, they generally produce overderaining or underderaining results. In this article, inspired by the generation mechanism, we propose a novel rain streaks removal framework using a kernel-guided convolutional neural network (KGCNN), achieving state-of-the-art performance with a simple network architecture. More precisely, our framework consists of three steps. First, we learn the motion blur kernel by a plain neural network, termed parameter network, from the detail layer of a rainy patch. Then, we stretch the learned motion blur kernel into a degradation map with the same spatial size as the rainy patch. Finally, we use the stretched degradation map together with the detail patches to train a deraining network with a typical ResNet architecture, which produces the rain streaks with the guidance of the learned motion blur kernel. Experiments conducted on extensive synthetic and real data demonstrate the effectiveness of the proposed KGCNN, in terms of rain streaks removal and image detail preservation.
Keywords:
Rain
Kernel
Degradation
Videos
Deep learning
Task analysis
Hafnium
Convolutional neural network (CNN)
motion blur kernel
rain streaks generation mechanism
rain streaks removal
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

S
southwestern university of finance & economics - china
Scholars:
3.0K
Papers: 3.4K
Citations: 4