arrow
返回

CMNet: Classification-oriented multi-task network for hyperspectral pansharpening

delete2022-11-01
delete4
PRE
AI
X
Xiande Wu
J
Jie Feng *
R
Ronghua Shang
X
Xiangrong Zhang
焦李成 封面图
焦李成 (Licheng Jiao)
DOI:10.1016/j.knosys.2022.109878delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Hyperspectral pansharpening (HP) can fuse different kinds of remote sensing images for the down-stream classification or detection task. Deep learning methods have made rapid development in HP. However, most deep learning-based HP methods design the network architecture without considering the specific downstream task. When the pansharpening image is transferred to the downstream tasks, it may lead to poor performance on the downstream tasks. To solve this problem, a novel classification -oriented multi-task network (CMNet) is proposed for HP. CMNet combines the classification and HP networks in a multi-task learning way. In the classification network, class-specific and spatial -difference contrastive constraints are defined to enforce the extraction module to extract discriminative features for classification. In the HP network, a fusion module with an identical structure to the extraction module is constructed to extract fused features for reconstruction. Then, multi-gradient learning is designed to optimize the HP network under the guidance of the classification network. It adopts gradient mapping to consider the conflicting or collaborative situations between these different tasks. In this way, the fusion module in the HP network learns discriminative feature extraction ability from the classification network, which makes the HP network realize classification-oriented HP. Experimental results demonstrate that the proposed method markedly improves the pansharpening performance and the pansharpening is also able to elevate the classification performance.(c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Hyperspectral pansharpening
Hyperspectral classification
Deep learning
Multi -task learning
Contrastive learning

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

Investigation on the genotoxicity of different sizes of gold nanoparticles administered to the lungs of rats不同粒径纳米金对大鼠肺的遗传毒性研究
err2012-06-01
err0
PREAI
errMarkus Schulz; Lan Ma-Hock; Sandra Brill; Volker Strauss; Silke Treumann; Sibylle Gröters; Bennard van Ravenzwaay; Robert Landsiedel
err分享
err收藏
A Critical Comparison Among Pansharpening Algorithms泛锐化算法之间的关键比较
err2015-05-01
err1.1K
PREAI
errVivone, Gemine; Alparone, Luciano; Chanussot, Jocelyn; Dalla Mura, Mauro; Garzelli, Andrea; Licciardi, Giorgio A.; Restaino, Rocco; Wald, Lucien
err分享
err收藏
Evolution of ungulate mating systems: Integrating social and environmental factors
err2020-04-15
err0
errOAAI
errR. Terry Bowyer; Dale R. McCullough; Janet L. Rachlow; Simone Ciuti; Jericho C. Whiting
err分享
err收藏
Multimodal Deep Autoencoder for Human Pose Recovery
err2015-12-01
err520
PREAI
errHong, Chaoqun; Yu, Jun; Wan, Jian; Tao, Dacheng; Wang, Meng
err分享
err收藏
CSR, social ties and firm performance
err2019-12-02
err0
PREAI
errSoojeen Sarah Jang; Hyesoo Ko; Yanghon Chung; Chungwon Woo
err分享
err收藏
err分享
err收藏
Hyperspectral Pansharpening Using Deep Prior and Dual Attention Residual Network
err2020-11-01
err109
PREAI
errZheng, Yuxuan; Li, Jiaojiao; Li, Yunsong; Guo, Jie; Wu, Xianyun; Chanussot, Jocelyn
err分享
err收藏
学者 查看更多内容