arrow
返回

Learning Multi-Layer Attention Aggregation Siamese Network for Robust RGBT Tracking

delete2024-01-01
delete16
PRE
AI
M
Mingzheng Feng
J
Jianbo Su *
DOI:10.1109/TMM.2023.3310295delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recent years have witnessed the popularity of integrating Siamese network into RGBT tracking for fast-tracking. However, these trackers mostly utilize the feature information of the last output layer and ignore the benefits of multi-layer information. In addition, they often adopt feature-level fusion for different modalities but fail to explore the strength of decision-level fusion, which may easily decrease their flexibility and independence. In this article, a novel multi-layer attention aggregation Siamese network on the decision level is proposed for robust RGBT tracking. To be specific, a hierarchical channel attention Siamese network is built to recalibrate the extracted multi-layer features from RGB and thermal infrared images. This can focus on more discriminative features to learn robust feature representation. Then, a depth-wise correlation operation is performed to produce RGB and thermal response maps, respectively. To better exploit and utilize the complementary RGB and thermal information, a contribution-aware aggregation network is designed to adaptively aggregate them. Lastly, a classification and regression network is adopted to complete the bounding box prediction. Extensive experiments on four large-scale RGBT benchmarks demonstrate outstanding tracking ability over other state-of-the-art trackers.
Keyword:
RGBT tracking
hierarchical attention network
contribution-aware aggregation network

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
引用论文

引用论文

Epstein-Barr Virus as a Trigger of Autoimmune Liver Diseases
err2012-01-01
err0
errOAAI
errEirini I. Rigopoulou; Daniel S. Smyk; Claire E. Matthews; Charalambos Billinis; Andrew K. Burroughs; Marco Lenzi; Dimitrios P. Bogdanos
err分享
err收藏
ECONOMIC RESTRUCTURING AND SUBURBANIZATION IN CHINA
err2013-05-16
err0
PREAI
errYixing Zhou; Laurence J. C. Ma
err分享
err收藏
Dual Siamese network for RGBT tracking via fusing predicted position maps
err2021-05-02
err26
PREAI
errGuo, Chang; Yang, Dedong; Li, Chang; Song, Peng
err分享
err收藏
Jointly Modeling Motion and Appearance Cues for Robust RGB-T Tracking
err2021-01-01
err103
errOAAI
errZhang, Pengyu; Zhao, Jie; Bo, Chunjuan; Wang, Dong; Lu, Huchuan; Yang, Xiaoyun
err分享
err收藏
Siamese Tracking Network With Informative Enhanced Loss
err2021-01-01
err21
PREAI
errTian, Shengjing; Liu, Xiuping; Liu, Meng; Li, Shuhua; Yin, Baocai
err分享
err收藏
Dnmt3b promotes tumorigenesis in vivo by gene-specific de novo methylation and transcriptional silencing
err2007-12-03
err0
errOAAI
errHeinz G. Linhart; Haijiang Lin; Yasuhiro Yamada; Eva Moran; Eveline J. Steine; Sumita Gokhale; Grace Lo; Erika Cantu; Mathias Ehrich; Timothy He; Alex Meissner; Rudolf Jaenisch
err分享
err收藏
学者 查看更多内容