.png){kind=icon}
返回
Negative-Driven Training Pipeline for Siamese Visual Tracking
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2023.3323134.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Although Siamese trackers have recently been gradually replaced by complicated and computationally expensive Transformer trackers, they are simpler and more applicable to real-world deployment. We believe that room for improvement still exists in the Siamese tracking framework and attribute the performance limitation to inadequate annotation, insufficient augmentation and suboptimal assignment, which heavily weakens the discriminative power. As Siamese methods directly inherit the assignment manner from object detection, they both face the imbalance between sparse annotated objects and dense background examples and between easy and hard negative examples. Moreover, existing augmentations and negative pairs are insufficient to simulate practical tracking ambiguity and failure cases. Nevertheless, work in the training vein is still overlooked. Therefore, we strive to yield a negative-driven training pipeline to unleash the potential of the Siamese framework without any extra inference cost. Specifically, 1) We devise strong negative augmentations based on random copy-paste to take full advantage of available annotations and generate more challenging tracking scenarios, especially negative examples. 2) We propose a semisupervised two-phase assignment that jointly utilizes existing annotations and model outputs to mine more appropriate and challenging negative examples. 3) We formulate a complementary reweighting loss by modifying the loss weight matrix to bridge subtasks and highlight the contributions of hard negative examples more smoothly. We choose several classic Siamese trackers to validate the pipeline effectiveness. After training, these trackers can gain, at most, a nearly 14% relative increase in performance, which is comparable to advanced Siamese trackers and even Transformer trackers. The experimental results indicate that the tracking-specific training pipeline is an efficient method for strengthening trackers and requires further development.
Keyword:
Negative example mining
Siamese network
training pipeline
visual tracking
期刊
IF:
9.7
论文数:
4.5K
被引数:
2.4W
机构
引用论文
Ultrasound evaluation of hand, wrist and foot joint synovitis in systemic lupus erythematosus.png)
Rheumatology
OAAI
RheumatologyIF0
OAAI分享收藏A closed expression for the Stress Intensity Factor of concave fatigue cracks in rotating shafts
PREAI
分享收藏
分享收藏Cobalt oxides nanoparticles supported on nitrogen-doped carbon nanotubes as high-efficiency cathode catalysts for microbial fuel cells负载在氮掺杂碳纳米管上的钴氧化物纳米颗粒作为微生物燃料电池的高效阴极催化剂OAAI
OAAI分享收藏A novel flake-ball-like magnetic Fe3O4/γ-MnO2 meso-porous nano-composite: Adsorption of fluorinion and effect of water chemistryChemosphere
ChemosphereIF0
PREAI
分享收藏
查看更多内容