arrow
Return

Text-Driven Adaptive Semantic Alignment Network for Cross-Scene Hyperspectral Image Classification

delete2025-01-01
delete0
PRE
AI
W
Wenzhen Wang
刘芳 (Fang Liu)
H
Hongyuan Zhu
肖亮 (Liang Xiao) *
DOI:10.1109/TGRS.2025.3548607delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Land cover in different scenes generally exhibits scene-invariant category semantic, typically represented and described consistently in a textual modality. Traditional cross-scene classification methods often treat categories as discrete class labels, neglecting their semantic information, or use category names merely as auxiliary textual modalities to enhance the discriminative representations of land cover. However, the cross-scene consistency of category semantic for land cover remains underexplored and underutilized. To address this issue, the text-driven adaptive semantic alignment network (TASA-Net) is proposed in this article for cross-scene hyperspectral image classification (HSIC). TASA-Net employs hand-crafted template prompts for stable category descriptions and vision-guided fine semantic prompts (VG-FSPs) for dynamic scene adaptation. Through a dual-gated adaptive mechanism, TASA-Net optimally weights coarse- and fine-grained semantics in a shared space, ensuring stable yet discriminative semantic representation. Additionally, cross-modal semantic alignment projects visual features into the shared semantic space, while a soft alignment strategy dynamically adjusts category correlations to enhance intraclass consistency and mitigate domain shifts. Ultimately, by leveraging text-driven semantic consistency representation, TASA-Net achieves zero-shot cross-scene transfer for unsupervised classification. Experiments demonstrate superior performance across multiple hyperspectral datasets, validating the critical role of textual modality in enhancing model robustness and cross-scene generalization ability.
Keywords:
Semantics
Hyperspectral imaging
Visualization
Land surface
Adaptation models
Buildings
Electronic mail
Training
Robustness
Decoding
Cross-modal semantic alignment
cross-scene classification
semantic descriptions
textual modality

Journal

IEEE Transactions on Geoscience and Remote Sensing cover
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
Papers:
2.1W
Citations:
10.7W

Organization

A
a*star - institute for infocomm research (i2r)
Scholars:
869
Papers: 880
Citations: 1