arrow
Return

Spatial Frequency Modulation Network for Efficient Image Dehazing

delete2025-01-01
delete0
PRE
AI
H
Hao Shen
H
Henghui Ding
Y
Yulun Zhang
Z
Zhong‐Qiu Zhao
蒋旭东 cover
蒋旭东 (Xudong Jiang)
DOI:10.1109/TIP.2025.3579148delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Currently, two main research lines in efficient context modeling for image dehazing are tailoring effective feature modulation mechanisms and utilizing the Fourier transform more precisely. The former is usually based on self-scale features that ignore complementary cross-scale/level features, and the latter tends to overlook regions with pronounced haze degradation and intricate structures. This paper introduces a novel spatial and frequency modulation perspective to synergistically investigate contextual feature modeling for efficient image dehazing. Specifically, we delicately develop a Spatial Frequency Modulator (SFM) equipped with a Cross-Scale Modulator (CSM) and Frequency Modulator (FM) to implement intra-block feature modulation. The CSM progressively aggregates hierarchical features across different scales, employing them for spatial self-modulation, and the FM subsequently adopts a dual-branch design to focus more on the crucial areas with severe haze and complex structures for reconstruction. Further, we propose a Cross-Level Modulator (CLM) to facilitate inter-block feature mutual modulation, enhancing seamless interaction between features at different depths and layers. Integrating the above-developed modules into the U-Net architecture, we construct a two-stage spatial frequency modulation network (SFMN). Extensive quantitative and qualitative evaluations showcase the superior performance and efficiency of the proposed SFMN over recent state-of-the-art image dehazing methods. The source code can be found in <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/it-hao/SFMN.</uri>
Keywords:
Image dehazing
spatial frequency modulation
cross-scale
cross-level

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

H
hefei university of technology
Scholars:
2.5W
Papers: 1.7W
Citations: 35
S
shanghai jiao tong university
Scholars:
15.3W
Papers: 11.5W
Citations: 159
F
fudan university
Scholars:
11.4W
Papers: 7.6W
Citations: 121
A
Anhui University of Science and Technology
Scholars:
2.1K
Papers: 706
Citations: 6.3K
N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.7W
Citations: 8.1W
researcher View more organizations