arrow
返回

Pseudo loss active learning for deep visual tracking

delete2022-10-01
delete5
PRE
AI
Z
Zhiyan Cui
N
Na Lü *
W
Weifeng Wang
DOI:10.1016/j.patcog.2022.108773delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In visual tracking tasks, the training data are commonly composed of a large number of video sequences and each frame in the sequences needs to be labeled manually, which is labor-intensive and time-consuming. In addition, considering the similarity among the consecutive frames in the same sequence, there is significant redundancy in the training data. To address these problems, a novel pseudo loss active learning (PLAL) method is developed in this paper. PLAL aims to select the most informative and least redundant data for training to reduce the cost of labeling and maintain competitive tracking results simultaneously. Firstly, the Gaussian distribution based pseudo label is generated for the unlabeled candidates based on the tracking model which is initially trained on a small amount of training data. Then, the pseudo loss based on cross entropy is designed to compute the difference between the pseudo label and the target response map. The pseudo loss measures the uncertainty of the target spatial context which is used as the informativeness criterion of the image frame for selection. Meanwhile, a sampling interval threshold and a temporal penalty are employed for frame selection to avoid drastic variation in target appearance and reduce the redundancy within the consecutive candidate frames. Only the selected frames are labeled by the oracle (human expert) and then added to the training data. Extensive experiments on public benchmarks (OTB2013, OTB2015, VOT2018, UAV123, GOT-10K, TrackingNet, LaSOT, OxUvA and TLP) demonstrate that PLAL method outperforms the baseline and other recent active learning approaches. With only 3% of labeled data from the training dataset, PLAL reaches competitive performance (98-100%) compared to the model trained on the entire training dataset. (C) 2022 Elsevier Ltd. All rights reserved.
Keyword:
Active learning
Visual tracking
Pseudo loss
Pseudo label

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

X
xi'an jiaotong university
学者数:
9.3W
论文数: 6.7W
被引数: 75
引用论文

引用论文

err分享
err收藏
Targeted mutation of zebrafish fga models human congenital afibrinogenemia
err2014-04-03
err0
errOAAI
errRichard J. Fish; Corinne Di Sanza; Marguerite Neerman-Arbez
err分享
err收藏
err分享
err收藏
SRC Family Kinase Inhibition Targets YES1 and YAP1 as Primary Drivers of Lung Cancer and as Mediators of Acquired Resistance to ALK and Epidermal Growth Factor Receptor Inhibitors
err2022-08-01
err0
errOAAI
errHiroki Sato; Daisuke Kubota; Huan Qiao; Achim Jungbluth; Natasha Rekhtman; Adam J. Schoenfeld; Helena A. Yu; Gregory J. Riely; Shinichi Toyooka; Christine M. Lovly; Paul Paik; Marc Ladanyi; Pang-Dian Fan
err分享
err收藏
MeMu: Metric correlation Siamese network and multi-class negative sampling for visual tracking
err2020-04-01
err15
PREAI
errXiao, Yafu; Li, Jing; Du, Bo; Wu, Jia; Chang, Jun; Zhang, Wenfan
err分享
err收藏
Joint temporal context exploitation and active learning for video segmentation联合时域上下文开发和主动学习的视频分割
err2020-04-01
err31
PREAI
errTian, Yan; Cheng, Guohua; Gelernter, Judith; Yu, Shihao; Song, Chao; Yang, Bailin
err分享
err收藏
Siamese networks with distractor-reduction method for long-term visual object tracking
err2021-04-01
err27
errOAAI
errXuan, Shiyu; Li, Shengyang; Zhao, Zifei; Kou, Longxuan; Zhou, Zhuang; Xia, Gui-Song
err分享
err收藏
没有更多内容