arrow
Return

Dynamic frequency window transformer for single image deraining

delete2025-04-01
delete0
PRE
AI
王朋成 cover
王朋成 (Pengcheng Wang)
Y
Yuli Fu *
Y
Youjun Xiang
Y
Yufeng Tan
DOI:10.1016/j.patrec.2025.02.009delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Outdoor visual systems often encounter rain streaks leading to the degradation of images that affects later high-level tasks. In contrast to methods that currently perform feature extraction in the spatial domain, this paper proposes a Dynamic Frequency Window Transformer Network(DFWT-Net) by integrating the frequency and spatial domain information of images. Firstly, the Space Frequency Module (SFM) is utilized to extract local features and preliminary frequency characteristics of the image, including amplitude and phase. Subsequently, the residuals of the rain streaks are obtained by a hierarchical encoder-decoder network consisting of dynamic frequency window transformers (DFWTs). The Dynamic Frequency Window Transformer (DFWT) employs learnable masks for dynamic frequency filtering before self-attention computation to emphasize the frequency of rain streaks. To obtain rain-free images that resemble real scenes, this paper propose the Cosine Phase Loss (CPL) function to measure the phase similarity between the recovered image and the ground truth image. The experimental results thoroughly validate the effectiveness and robustness of the proposed network.
Keywords:
Image Deraining
Space Frequency Characteristics
Cosine Phase Loss
Dynamic frequency weight

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
8.0K
Citations:
1.6W

Organization

S
south china university of technology
Scholars:
6.8W
Papers: 5.1W
Citations: 85
Cited Papers

Cited Papers

Deformation systems of ?-zirconium
err1958-05-01
err0
PREAI
errIu. N. Sokurskii; L. N. Protsenko
errShare
errSave
Efficiency in Evolutionary Trade-Offs
err2012-06-01
err0
PREAI
errElad Noor; Ron Milo
errShare
errSave
Neurobiology of Peripheral Nerve Regeneration
err
IF0
err2009-12-03
err0
PREAI
errDouglas W. Zochodne
errShare
errSave
errShare
errSave
Diagnostic and prognostic significance of squamous cell carcinoma antigen in non-small cell lung cancer
err2001-05-01
err0
PREAI
errTheodoros Vassilakopoulos; Theodoros Troupis; Christina Sotiropoulou; Panagiotis Zacharatos; Paraskevi Katsaounou; Dimitrios Parthenis; Olga Noussia; George Troupis; Spyros Papiris; Christos Kittas; Charis Roussos; Spyros Zakynthinos; Vassilios Gorgoulis
errShare
errSave
Edge-preserving image restoration based on a weighted anisotropic diffusion model
err2024-08-01
err2
PREAI
errQi, Huiqing; Li, Fang; Chen, Peng; Tan, Shengli; Luo, Xiaoliu; Xie, Ting
errShare
errSave
researcher View more