arrow
返回

A Transformer-based visual object tracker via learning immediate appearance change

delete2024-11-01
delete2
PRE
AI
李
李艺帆 (Yifan Li)
X
Xiaotao Liu *
J
Jiaoying Wang
P
Peng Wu
刘
刘静 (Jing Liu)
DOI:10.1016/j.patcog.2024.110705delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Transformer has shown its great strength in visual object tracking due to its effective attention mechanism, but most prevailing transformer-based trackers only explore temporal information frame by frame, thus overlooking the rich context information inherent in videos. To alleviate this problem, we propose a transformer-based tracker via learning immediate appearance change information in videos, called IAC-tracker. The proposed tracker enhances the perception of the immediate motion state to improve the performance of single target tracking. IAC-tracker contains three key components: a spatial information extractor (SIE) with a superior attention mechanism to progressively extract spatial information, a temporal information extractor (TIE) with designed temporal attention mechanism to progressively learn target immediate appearance change, and novel spatial-temporal context enhanced fusion module integrating the information from SIE and TIE to prepare for the final prediction head. Comparison experiments with state-of-the-art trackers on six challenging datasets demonstrate the superior performance of IAC-tracker with real-time running speed.
Keyword:
Transformer
Attention mechanism
Visual object tracking
Appearance change

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

Trust in Virtual Teams: A Multidisciplinary Review and Integration
err2019-01-21
err0
errOAAI
errJanine Viol Hacker; Michael Johnson; Carol Saunders; Amanda L. Thayer
err分享
err收藏
Definitions of primary-progressive multiple sclerosis trajectories by rate of clinical disability progression
err2021-05-01
err0
PREAI
errAnat Achiron; Sapir Dreyer-Alster; Michael Gurevich; Shay Menascu; David Magalashvili; Mark Dolev; Yael Stern; Tomer Ziv-Baran
err分享
err收藏
学者 查看更多内容