返回
RCFT: re-parameterization convolution and feature filter for object tracking
DOI:10.1007/s40747-023-01223-z.png)
摘要
En 中文
Siamese-based trackers have been widely studied for their high accuracy and speed. Both the feature extraction and feature fusion are two important components in Siamese-based trackers. Siamese-based trackers obtain fine local features by traditional convolution. However, some important channel information and global information are lost when enhancing local features. In the feature fusion process, cross-correlation-based feature fusion between the template and search region feature ignores the global spatial context information and does not make the best of the spatial information. In this paper, to solve the above problem, we design a novel feature extraction sub-network based on batch-free normalization re-parameterization convolution, which scales the features in the channel dimension and increases the receptive field. Richer channel information is obtained and powerful target features are extracted for the feature fusion. Furthermore, we learn a feature fusion network (FFN) based on feature filter. The FFN fuses the template and search region features in a global spatial context to obtain high-quality fused features by enhancing important features and filtering redundant features. By jointly learning the proposed feature extraction sub-network and FFN, the local and global information are fully exploited. Then, we propose a novel tracking algorithm based on the designed feature extraction sub-network and FFN with re-parameterization convolution and feature filter, referred to as RCFT. We evaluate the proposed RCFT tracker and some recent state-of-the-art (SOTA) trackers on OTB100, VOT2018, LaSOT, GOT-10k, UAV123 and the visual-thermal dataset VOT-RGBT2019 datasets, which achieves superior tracking performance with 45 FPS tracking speed.
Keyword:
Object tracking
Feature extraction
Re-parameterization convolution
Feature filter
Feature fusion
期刊
IF:
4.6
论文数:
2.1K
被引数:
6.6K
机构
引用论文
Sustaining the efficiency of the Fe(0)/H2O system for Cr(VI) removal by MnO2 amendment
Chemosphere
IF0
Cobalt oxides nanoparticles supported on nitrogen-doped carbon nanotubes as high-efficiency cathode catalysts for microbial fuel cells负载在氮掺杂碳纳米管上的钴氧化物纳米颗粒作为微生物燃料电池的高效阴极催化剂
A novel flake-ball-like magnetic Fe3O4/γ-MnO2 meso-porous nano-composite: Adsorption of fluorinion and effect of water chemistry
Chemosphere
IF0

