arrow
返回

A Transformer-Based Network for Hyperspectral Object Tracking

delete2023-01-01
delete10
PRE
AI
L
Long Gao
L
Langkun Chen
P
Pan Liu
姜燕 封面图
姜燕 (Yan Jiang)
W
Weiying Xie *
李云松 封面图
李云松 (Yunsong Li)
DOI:10.1109/TGRS.2023.3325049delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
With the abundant spectral information, the hyperspectral images could be benefit for tracking the target in various application scenarios. Most of the predominant hyperspectral object tracking methods were based on transferred red-green-blue (RGB) object tracking networks, since the lack of training data. Different strategies of processing the hyperspectral images to adapt the transferred RGB object tracking networks have been exploited. However, the existing strategies led to lose the spectral information or the interaction information between bands and have shown limited performances. In this article, a novel transformer-based hyperspectral object tracking algorithm (Trans-HST) is proposed to make advantages of the spectral information with transformer modules. In Trans-HST, the cross-band groups of feature enhancement (CBFE) is introduced to reduce the negative effects of the interaction information loss. To address the problem of spectral information loss, the transformer-based deep features' fusion (TDFF) fuses the deep features corresponding to different groups of bands in the hyperspectral images and integrates the deep feature corresponding to the original hyperspectral images into the fused features. Experiments on the commonly used hyperspectral object tracking dataset have been applied to verify the effectiveness of the two proposed modules, and they indicate the superior performance of the Trans-HST comparing with other RGB and hyperspectral trackers.
Keyword:
Target tracking
Feature extraction
Object tracking
Transformers
Hyperspectral imaging
Fuses
Deep learning
Feature enhancement
feature fusion
hyperspectral object tracking
transformer

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.1W
被引数:
10.7W

机构

U
University of Sheffield
学者数:
3.0W
论文数: 2.9W
被引数: 3.9W
X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Acoustic Leak Detection Technology for Water/Steam Small Leaks and Microleaks into Sodium to Protect an SFR Steam Generator
err2017-04-10
err0
PREAI
errTae-Joon Kim; Valeriy S. Yugay; Ji-Young Jeong; Jong-Man Kim; Byeung-Ho Kim; Tae-Ho Lee; Yong-Bum Lee; Yeong-Il Kim; Dohee Hahn
err分享
err收藏
Trust in Virtual Teams: A Multidisciplinary Review and Integration
err2019-01-21
err0
errOAAI
errJanine Viol Hacker; Michael Johnson; Carol Saunders; Amanda L. Thayer
err分享
err收藏
err分享
err收藏
学者 查看更多内容