arrow
返回

Robust Deep Object Tracking against Adversarial Attacks

delete2024-09-26
delete0
PRE
AI
J
Jia, Shuai
C
Chao Ma *
Y
Yibing Song
X
Xiaokang Yang
M
Ming–Hsuan Yang
DOI:10.1007/s11263-024-02226-0delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Addressing the vulnerability of deep neural networks (DNNs) has attracted significant attention in recent years. While recent studies on adversarial attack and defense mainly reside in a single image, few efforts have been made to perform temporal attacks against video sequences. As the temporal consistency between frames is not considered, existing adversarial attack approaches designed for static images do not perform well for deep object tracking. In this work, we generate adversarial examples on top of video sequences to improve the tracking robustness against adversarial attacks under white-box and black-box settings. To this end, we consider motion signals when generating lightweight perturbations over the estimated tracking results frame-by-frame. For the white-box attack, we generate temporal perturbations via known trackers to degrade significantly the tracking performance. We transfer the generated perturbations into unknown targeted trackers for the black-box attack to achieve transferring attacks. Furthermore, we train universal adversarial perturbations and directly add them into all frames of videos, improving the attack effectiveness with minor computational costs. On the other hand, we sequentially learn to estimate and remove the perturbations from input sequences to restore the tracking performance. We apply the proposed adversarial attack and defense approaches to state-of-the-art tracking algorithms. Extensive evaluations on large-scale benchmark datasets, including OTB, VOT, UAV123, and LaSOT, demonstrate that our attack method degrades the tracking performance significantly with favorable transferability to other backbones and trackers. Notably, the proposed defense method restores the original tracking performance to some extent and achieves additional performance gains when not under adversarial attacks.
Keyword:
Visual tracking
Adversarial attack
Adversarial defense
Universal perturbations
Transferability

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
U
University of California Merced
学者数:
2.3K
论文数: 1.9K
被引数: 2
University of California System 封面图
University of California System
学者数:
37.7W
论文数: 33.8W
被引数: 6.6K
学者 查看更多机构
引用论文

引用论文

Active Therapy for Chronic Low Back Pain
err2001-04-01
err0
PREAI
errAnne F. Mannion; Simo Taimela; Markus Müntener; Jiri Dvorak
err分享
err收藏
Ultrasound evaluation of hand, wrist and foot joint synovitis in systemic lupus erythematosus
err2013-11-14
err0
errOAAI
errA. Iagnocco; F. Ceccarelli; C. Rizzo; S. Truglia; L. Massaro; F. R. Spinelli; C. Vavala; G. Valesini; F. Conti
err分享
err收藏
Transcriptome analysis of growth heterosis in pearl oyster Pinctada fucata martensii
err2018-10-12
err0
errOAAI
errJingmiao Yang; Shaojie Luo; Junhui Li; Zhe Zheng; Xiaodong Du; Yuewen Deng
err分享
err收藏
err分享
err收藏
学者 查看更多内容