返回
CMNet: Classification-oriented multi-task network for hyperspectral pansharpening
DOI:10.1016/j.knosys.2022.109878.png)
摘要
En 中文
Hyperspectral pansharpening (HP) can fuse different kinds of remote sensing images for the down-stream classification or detection task. Deep learning methods have made rapid development in HP. However, most deep learning-based HP methods design the network architecture without considering the specific downstream task. When the pansharpening image is transferred to the downstream tasks, it may lead to poor performance on the downstream tasks. To solve this problem, a novel classification -oriented multi-task network (CMNet) is proposed for HP. CMNet combines the classification and HP networks in a multi-task learning way. In the classification network, class-specific and spatial -difference contrastive constraints are defined to enforce the extraction module to extract discriminative features for classification. In the HP network, a fusion module with an identical structure to the extraction module is constructed to extract fused features for reconstruction. Then, multi-gradient learning is designed to optimize the HP network under the guidance of the classification network. It adopts gradient mapping to consider the conflicting or collaborative situations between these different tasks. In this way, the fusion module in the HP network learns discriminative feature extraction ability from the classification network, which makes the HP network realize classification-oriented HP. Experimental results demonstrate that the proposed method markedly improves the pansharpening performance and the pansharpening is also able to elevate the classification performance.(c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Hyperspectral pansharpening
Hyperspectral classification
Deep learning
Multi -task learning
Contrastive learning
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Investigation on the genotoxicity of different sizes of gold nanoparticles administered to the lungs of rats不同粒径纳米金对大鼠肺的遗传毒性研究
Chromium steel from chromite ore processing residue — A valuable construction material from a waste铬铁矿加工残渣中的铬钢-废物中的有价值的建筑材料
Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis基于过采样多分辨率分析的上下文驱动高空间与光谱分辨率影像融合

