1
Return

Degradation-Aware Prompt Learning With Cross-Modal Compensation for Adverse Weather Removal

delete2026-07-28
delete0
PRE
AI
W
Wanshu Fan
Y
Yunzhe Zhang
Y
Yue Shen
L
Liyan Wang
J
Jing Qin
K
Kin‐Man Lam
王聪 cover
王聪 (Cong Wang)
J
Jinshan Pan
DOI:10.1109/tip.2026.3715751delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Adverse weather causes diverse and complex image degradations, severely compromising the reliability of computer vision systems. Existing all-in-one restoration models attempt to address multiple degradation types within a unified framework, but often lack explicit spatial and semantic modeling of degradation characteristics, limiting their adaptability to diverse weather conditions. To address this limitation, we propose a Degradation-Aware Cross-Modal Prompt Compensation Network (DCMPC-Net) that leverages cross-modal degradation cues from a pre-trained vision-language model to condition restoration features within a unified backbone. Specifically, our DCMPC-Net mainly consists of the Cross-Modal Prompt Generator (CMPG), Prompt-Guided Attention Alignment Module (PGAAM), and Dual Feature Compensation Module (DFCM). The CMPG integrates textual embeddings with visual features to produce degradation-aware prompts that encode degradation-related semantic and contextual cues. These prompts are injected into the decoder via a PGAAM, which adaptively aligns semantic information with degraded regions to facilitate context-aware restoration. To further enhance structural fidelity, DFCM is introduced that disentangles degradation artifacts from scene structures, thereby improving the reconstruction of fine textures and detailed content. By integrating cross-modal semantic guidance with spatial alignment and structural enhancement, DCMPC-Net achieves robust and perceptually consistent restoration across diverse weather conditions. Extensive experiments show that DCMPC-Net outperforms state-of-the-art methods in both task-specific and unified settings, achieving superior accuracy and visual fidelity. The code is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/fanamber831/DCMPC-Net</uri>
Keywords:
Adverse weather removal
vision-language model
degradation-aware cross-modal prompt

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

U
university of california san francisco
Scholars:
5.2W
Papers: 4.0W
Citations: 66
T
the hong kong polytechnic university
Scholars:
3.9K
Papers: 2.3K
Citations: 0
D
dalian university
Scholars:
774
Papers: 255
Citations: 0
N
nanjing university of science and technology
Scholars:
2.9K
Papers: 983
Citations: 0
D
Dalian University of Technology
Scholars:
5.7W
Papers: 4.3W
Citations: 5.5W
Cited Papers

Cited Papers

Citing Papers

Citing Papers