返回
Cross-Modality Contrastive Learning for Hyperspectral Image Classification
DOI:10.1109/TGRS.2022.3188529.png)
摘要
En 中文
Deep learning has attracted much attention in the field of hyperspectral image classification recently, due to its powerful representation and generalization abilities. Most of the current deep learning models are trained in a supervised manner, which requires large amounts of labeled samples to achieve the state-of-the-art performance. Unfortunately, pixel-level labeling in hyperspectral imageries is difficult, time-consuming, and human-dependent. To address this issue, we propose an unsupervised feature learning model using multimodal data, hyperspectral, and light detection and ranging (LiDAR) in particular. It takes advantage of the relationship between hyperspectral and LiDAR data to extract features, without using any label information. After that, we design a dual fine-tuning strategy to transfer the extracted features for hyperspectral image classification with small numbers of training samples. Such a strategy is able to explore not only the semantic information but also the intrinsic structure information of training samples. In order to test the performance of our proposed model, we conduct comprehensive experiments on three hyperspectral and LiDAR datasets. Experimental results show that our proposed model can achieve better performance than several state-of-the-art deep learning models.
Keyword:
Hyperspectral imaging
Feature extraction
Training
Laser radar
Representation learning
Principal component analysis
Data models
Fine-tuning strategy
hyperspectral image classification
multimodal data
unsupervised deep learning
期刊
IF:
8.6
论文数:
2.1W
被引数:
10.7W
机构
暂无机构信息
引用论文
Effects of Fluorogypsum and Flue-Gas Desulfurization Gypsum on the Hydration and Hardened Properties of Alkali Slag Cement氟石膏和烟气脱硫石膏对碱矿渣水泥水化硬化性能的影响
Crystals
IF0
Classification of Hyperspectral Images via Multitask Generative Adversarial Networks基于多任务生成对抗网络的高光谱图像分类
Exploring Hierarchical Convolutional Features for Hyperspectral Image Classification面向高光谱图像分类的层次卷积特征研究

