.png){kind=icon}
返回
Transformer Sub-Patch Matching for High-Performance Visual Object Tracking
.png){kind=icon}
PRE
AI
DOI：10.1109/TITS.2023.3264664.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Visual tracking is a core component of intelligent transportation systems, especially for unmanned driving and road surveillance. Numerous convolutional neural network (CNN) trackers have achieved unprecedented performance. However, CNN features with regular spatial context relationships experience difficulty matching the rigid target templates when dramatic deformation and occlusion occur. In this paper, we propose a novel full Transformer Sub-patch Matching network for tracking (TSMtrack), which decomposes the tracked object into sub-patches, and interlaced matches the extracted sub-patches by leveraging the attention mechanism born with the Transformer. Roots in Transformer architecture, TSMtrack consists of image patch decomposition, sub-patch matching, and position prediction. Specifically, TSMtrack converts the whole frame into sub-patches and extracts the sub-patch features independently. By sub-patch matching and FFN-like prediction, TSMtrack enables independent similarity measurement between sub-patch features in an interlaced and iterative fashion. With a full Transformer pipeline implemented, we achieve a high-quality trade-off between tracking speed performance. Experiments on nine benchmarks demonstrate the effectiveness of our Transformer sub-patch matching framework. In particular, it realizes an AO of 75.6 on GOT-10K and SR of 57.9 on WebUAV-3M with 48 FPS on GPU RTX-2060s.
Keyword:
Transformers
Target tracking
Feature extraction
Visualization
Tracking
Deformation
Convolutional neural networks
Visual tracking
sub-patch matching
full transformer
siamese network
期刊
IF:
8.4
论文数:
9.7K
被引数:
6.3W
机构
引用论文
Sustaining the efficiency of the Fe(0)/H2O system for Cr(VI) removal by MnO2 amendment.png)
Chemosphere
ChemosphereIF0
PREAI
分享收藏Optimal design of a manufacturing-remanufacturing-transport system within a reverse logistics chain
PREAI
分享收藏
Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏
A novel flake-ball-like magnetic Fe3O4/γ-MnO2 meso-porous nano-composite: Adsorption of fluorinion and effect of water chemistryChemosphere
ChemosphereIF0
PREAI
分享收藏Siamese Implicit Region Proposal Network With Compound Attention for Visual Tracking用于视觉跟踪的具有复合注意的Siamese隐式区域建议网络
PREAI
分享收藏
查看更多内容