arrow
Return

Robust Hyperspectral Object Tracking by Exploiting Background-Aware Spectral Information With Band Selection Network

delete2022-01-01
delete6
PRE
AI
Y
Yiming Tang
刘宇飞 cover
刘宇飞 (Yufei Liu)
L
Ling Ji
H
Hong Huang *
DOI:10.1109/LGRS.2022.3202039delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep color trackers mainly use pretrained convolutional neural networks (CNNs) for classification and regression, but it is difficult to discriminate targets in complex backgrounds for its limited spectral information. Compared with color video, hyperspectral videos provide better discriminative ability due to the abundant material-based information. However, it is hard to train a robust deep model for hyperspectral videos. The key issues are that there exists much redundant information in hyperspectral videos and the training samples are inadequate. In this letter, a new background-aware hyperspectral tracking (BAHT) method is designed for hyperspectral tracking task. Our method first designs a background-aware band selection module to preserve bands that can better recognize a target from backgrounds. Then the selected bands are input to the backbone networks, which are pretrained on color videos, to describe the appearances of targets with deep semantic features. Experiments on the hyperspectral video tracking dataset illustrate the good performance of BAHT tracker compared with popular color and hyperspectral trackers.
Keywords:
Hyperspectral sensors
Feature extraction
Target tracking
Training
Color
Semantics
Object tracking
Band selection
deep learning
hyperspectral videos
Siamese network
visual tracking

Journal

IEEE Geoscience and Remote Sensing Magazine cover
IEEE Geoscience and Remote Sensing Magazine
IF:
16.4
Papers:
1.0W
Citations:
5.1K

Organization

C
Chongqing University
Scholars:
5.1W
Papers: 4.1W
Citations: 6.0W
C
china electronics technology group
Scholars:
1.8K
Papers: 1.4K
Citations: 0