返回
Residual Attention-Based Image Fusion Method with Multi-Level Feature Encoding
DOI:10.3390/s25030717.png)
摘要
En 中文
This paper presents a novel image fusion method designed to enhance the integration of infrared and visible images through the use of a residual attention mechanism. The primary objective is to generate a fused image that effectively combines the thermal radiation information from infrared images with the detailed texture and background information from visible images. To achieve this, we propose a multi-level feature extraction and fusion framework that encodes both shallow and deep image features. In this framework, deep features are utilized as queries, while shallow features function as keys and values within a residual cross-attention module. This architecture enables a more refined fusion process by selectively attending to and integrating relevant information from different feature levels. Additionally, we introduce a dynamic feature preservation loss function to optimize the fusion process, ensuring the retention of critical details from both source images. Experimental results demonstrate that the proposed method outperforms existing fusion techniques across various quantitative metrics and delivers superior visual quality.
Keyword:
image fusion
transformer
cross attention
deep learning
feature encoding
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.5
论文数:
7.2W
被引数:
20.9W
机构
引用论文
SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin TransformerSwinFusion: 通过Swin变压器进行通用图像融合的跨域远程学习
PIAFusion: A progressive infrared and visible image fusion network based on illumination awarePIAFusion: 一种基于光照感知的渐进式红外与可见光图像融合网络
INFORMATION FUSION
IF15.5
Infrared and visible image fusion based on variational auto-encoder and infrared feature compensation基于变分自动编码器和红外特征补偿的红外与可见光图像融合
Automated ultrasonic-based diagnosis of concrete compressive damage amidst temperature variations utilizing deep learning利用深度学习对温度变化中的混凝土压缩损伤进行自动超声诊断

