.png){kind=icon}
Return
Exploring the complementarity between convolution and transformer matching for visual tracking
.png){kind=icon}
PRE
AI
DOI：10.1016/j.knosys.2024.112184.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The essence of Siamese trackers is the similarity matching between a target template deep feature and a search region deep feature. With the successful application of the Transformer in the vision community, the similarity matching manner is moving from convolution matching to Transformer matching. While this transition achieves a performance boost, we explore that there exists an intuitive complementarity between convolution matching and Transformer matching. Therefore, employing only one of the two matchings is suboptimal for the trackers, and exploiting their complementarity holds great potential. To this end, we present a Matching Knowledge Fusion (MKF) module that efficiently integrates a convolution matching and an enhanced Transformer matching to exploit the explored matching complementarity. Furthermore, aiming at the issue that the noisy and ambiguous attention weights of Transformer matching lead to the degradation of matching results, a novel mechanism of utilizing complementary matching knowledge to correct the attention weights is proposed. Based on the Matching Knowledge Fusion module, we build a simple but effective tracker, dubbed MKFTrack. Extensive experiments demonstrate the favorable performance of our tracker against state-of-the-art ones.
Keywords:
Visual object tracking
Convolution matching
Transformer matching
Matching knowledge fusion
Journal
K
IF:
7.6
Papers:
1.3W
Citations:
4.5W
Organization
Cited Papers
Sustaining the efficiency of the Fe(0)/H2O system for Cr(VI) removal by MnO2 amendment.png)
Chemosphere
ChemosphereIF0
PREAI
ShareSaveUltrasound evaluation of hand, wrist and foot joint synovitis in systemic lupus erythematosusRheumatology
OAAI
RheumatologyIF0
OAAIShareSaveShareSaveOptimal design of a manufacturing-remanufacturing-transport system within a reverse logistics chain
PREAI
ShareSaveShareSaveA novel flake-ball-like magnetic Fe3O4/γ-MnO2 meso-porous nano-composite: Adsorption of fluorinion and effect of water chemistryChemosphere
ChemosphereIF0
PREAI
ShareSave
View more