arrow
返回

Cross-Modality Interaction Network for Pan-Sharpening

delete2024-01-01
delete5
PRE
AI
Y
Yingying Wang
X
Xuanhua He
Y
Yunlong Lin
Y
Yue Huang
X
Xinghao Ding *
DOI:10.1109/TGRS.2024.3412683delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Pan-sharpening seeks to generate a high-resolution multispectral (HRMS) image by merging the high-resolution panchromatic (PAN) image and its low-resolution multispectral (LRMS) counterpart. The main challenge lies in enhancing modality-aware features and efficiently integrating complementary information between PAN and MS pairs. To achieve desired fusion results, it is crucial to fully utilize both intramodality characteristics and intermodality relationships. Current research often overlooks the exploration of cross-modality relationships and neglects the enhancement of modality-aware features in pan-sharpening. In this work, we introduce an innovative pan-sharpening framework, named cross-modality interaction network (CMINet), which comprises three core designs: a modality-aware feature enhancement (MAFE) module to enhance the feature representation of both modalities, a cross-modality attention (CMA) module that effectively extracts the intramodality features and fully leverages the intermodality complementary information, and a modality alignment (MA) module to address modality-aware misalignment issue during fusion. Extensive experiments are conducted to verify the effectiveness of our proposed network and showcase its superior performance in comparison to other state-of-the-art approaches.
Keyword:
Merging
Geoscience and remote sensing
Feature extraction
Data mining
Cross-modality interaction
feature enhancement
pan-sharpening

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.2W
被引数:
10.7W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
X
xiamen university
学者数:
5.9W
论文数: 3.8W
被引数: 67
引用论文

引用论文

Increased susceptibility to SV40 transformation with development and in vitro aging
err1990-08-01
err0
PREAI
errTakahiro Kunisada; David B. Danner; Varda Friedman; Edward L. Schneider
err分享
err收藏
A Critical Comparison Among Pansharpening Algorithms泛锐化算法之间的关键比较
err2015-05-01
err1.1K
PREAI
errVivone, Gemine; Alparone, Luciano; Chanussot, Jocelyn; Dalla Mura, Mauro; Garzelli, Andrea; Licciardi, Giorgio A.; Restaino, Rocco; Wald, Lucien
err分享
err收藏
Multiscale Dual-Domain Guidance Network for Pan-Sharpening
err2023-01-01
err18
PREAI
errHe, Xuanhua; Yan, Keyu; Zhang, Jie; Li, Rui; Xie, Chengjun; Zhou, Man; Hong, Danfeng
err分享
err收藏
A variational model for P+XS image fusionPxs图像融合的变分模型
err2006-04-01
err383
errOAAI
errBallester, Coloma; Caselles, Vicent; Igual, Laura; Verdera, Joan; Rougé, Bernard
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
学者 查看更多内容