.png){kind=icon}
返回
Multi-Task Image Restoration Algorithm Under Different Weather Influence Factors
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2024.3520484.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Bad weather, such as rain, snow, and fog, will reduce the quality of the image acquired, and it will affect the performance of many related visual fields. The existing researches on image restoration under severe weather either focus on the restoration under a certain kind of weather, which cannot be generalized under different weather, or need to introduce additional model structures, which increases the burden of practical applications. Therefore, we explores an integrated image restoration framework, which can restore images under different adverse weather effects. Specifically, the model is trained in two stages. In the pre-training stage, a basic general network that can deal with multiple weather is trained by supervised learning. In the fine-tuning stage, soft prompts are introduced to stimulate the model's ability to cope with different weather, so as to enhance the generalization ability. Specifically, the hidden information of the prompts is explored by low-rank decomposition, and the contras loss is added to prompt the prompts to converge on similar tasks. Furthermore, we address the distribution shift problem by aligning out-of-distribution (OOD) test sample statistics with those of the source data using test-time prompt tuning. Finally, we use the evaluation metrics, PSNR and SSIM, to evaluate the proposed method under four tasks: rain removal, snow removal, fog removal, and raindrop removal. The results demonstrate that the proposed method achieves superior performance compared to the existing state-of-the-art.
Keyword:
Transformer architecture
pretrain-finetuning
soft prompts
contrast learning
distribution alignment strategy
Transformer architecture
pretrain-finetuning
soft prompts
contrast learning
distribution alignment strategy
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏Emerging Adults’ Psychopathology in Seven Countries: The Impact of Identity-Related Risk Factors
PREAI
分享收藏Comparison of Trends in US Health-Related Quality of Life Over the 2000s Using the SF-6D, HALex, EQ-5D, and EQ-5D Visual Analog Scale Versus a Broader Set of Symptoms and Impairments.png)
Medical Care
OAAI
Medical CareIF0
OAAI分享收藏Is SA shared or distributed in team work? An exploratory study in an intelligence analysis task
PREAI
分享收藏
查看更多内容