.png){kind=icon}
返回
Exploring the complementarity between convolution and transformer matching for visual tracking
.png){kind=icon}
PRE
AI
DOI：10.1016/j.knosys.2024.112184.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The essence of Siamese trackers is the similarity matching between a target template deep feature and a search region deep feature. With the successful application of the Transformer in the vision community, the similarity matching manner is moving from convolution matching to Transformer matching. While this transition achieves a performance boost, we explore that there exists an intuitive complementarity between convolution matching and Transformer matching. Therefore, employing only one of the two matchings is suboptimal for the trackers, and exploiting their complementarity holds great potential. To this end, we present a Matching Knowledge Fusion (MKF) module that efficiently integrates a convolution matching and an enhanced Transformer matching to exploit the explored matching complementarity. Furthermore, aiming at the issue that the noisy and ambiguous attention weights of Transformer matching lead to the degradation of matching results, a novel mechanism of utilizing complementary matching knowledge to correct the attention weights is proposed. Based on the Matching Knowledge Fusion module, we build a simple but effective tracker, dubbed MKFTrack. Extensive experiments demonstrate the favorable performance of our tracker against state-of-the-art ones.
Keyword:
Visual object tracking
Convolution matching
Transformer matching
Matching knowledge fusion
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Sustaining the efficiency of the Fe(0)/H2O system for Cr(VI) removal by MnO2 amendment.png)
Chemosphere
ChemosphereIF0
PREAI
分享收藏Ultrasound evaluation of hand, wrist and foot joint synovitis in systemic lupus erythematosusRheumatology
OAAI
RheumatologyIF0
OAAI分享收藏Molecular and Pharmacological Characterization of GABAA Receptors in the Rat Pituitary大鼠垂体中GABAA 受体的分子和药理学特征
PREAI
分享收藏Optimal design of a manufacturing-remanufacturing-transport system within a reverse logistics chain
PREAI
分享收藏Inflexibility of mental planning: A characteristic disorder with prefrontal lobe lesions?心理计划的僵化: 前额叶病变的特征性障碍？
PREAI
分享收藏A novel flake-ball-like magnetic Fe3O4/γ-MnO2 meso-porous nano-composite: Adsorption of fluorinion and effect of water chemistryChemosphere
ChemosphereIF0
PREAI
分享收藏
查看更多内容