arrow
返回

Backdoor Online Tracing With Evolving Graphs

delete2024-01-01
delete0
PRE
AI
C
Chengyu Jia
陈晋音 (Jinyin Chen) *
纪守领 (Shouling Ji)
H
Haibin Zheng
Q
Qi Xuan
DOI:10.1109/TIFS.2024.3488517delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The backdoor attacks have posed a severe threat to deep neural networks (DNNs). Online training platforms and third-party model training providers are more vulnerable to backdoor attacks due to uncontrollable data sources, untrusted developers or unmonitorable training processes. Researchers have proposed to detect the backdoor in the well-trained models, and then remove them by some mitigation techniques, e.g., retraining and pruning. However, they are still limited from two aspects: (i) real-time - they cannot detect in time at the beginning of training due to their reliance on well-trained models; (ii) mitigation effect - the later discovery of backdoors usually leads to 1) deeper backdoors, 2) less effective mitigation, and 3) greater costs. To address these challenges, we rethink the evolution of the backdoor, and intend to cope with backdoors along with the online training process, that is to detect the backdoors sooner rather than later. We propose BackdoorTracer, a novel framework that detects the backdoor in the training phase. BackdoorTracer constructs the model into an equivalent graph based on the activated neural path during training, thereby detecting the backdoor through multiple graph metrics. BackdoorTracer can incorporate any existing backdoor mitigation approaches that require accessing training to stop the impact of backdoors as soon as possible. It differs from previous works in several key aspects: (i) lightweight - BackdoorTracer is independent of the training process, and thus it has little negative impact on the training efficiency and testing accuracy; (ii) generalizable - it works different modalities of data, models and different backdoor attacks. BackdoorTracer outperforms the state-of-the-art (SOTA) detection approaches in experiments on 5 modes, 10 models and 9 backdoor attack scenarios. Compared with the existing 5 backdoor detection methods, our method can detect backdoors earlier (similar to 1.5 epochs) and higher detection rate (similar to +10%), effectively improving the effectiveness of backdoor defense (ASR. similar to -78%, ACC. similar to +47%). Finally, we make BackdoorTracer a plug-and-play backdoor detector, which enables real-time backdoor tracing in the training phase.
Keyword:
Deep neural network
backdoor
backdoor detection
backdoor mitigation
graph
online

期刊

IEEE Transactions on Information Forensics and Security 封面图
IEEE Transactions on Information Forensics and Security
IF:
8
论文数:
5.2K
被引数:
2.3W

机构

Z
zhejiang university of technology
学者数:
3.3W
论文数: 2.0W
被引数: 22
A
agency for science technology & research (a*star)
学者数:
2.2W
论文数: 1.9W
被引数: 57
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
学者 查看更多机构
引用论文

引用论文

A Versatile One-pot Synthesis of Symmetrical N-Tosylazamacrocycles
err1985-01-01
err0
errOAAI
errSebastiano Pappalardo; Francesco Bottino; Michele Di Grazia; Paolo Finocchiaro; Antonino Mamo
err分享
err收藏
Glycan shield and fusion activation of a deltacoronavirus spike glycoprotein fine-tuned for enteric infections
err
IF0
err2017-11-22
err0
PREAI
errX. Xiong; M.A. Tortorici; S. Snijder; C. Yoshioka; A.C. Walls; W. Li; A.T. McGuire; F.A. Rey; B.J. Bosch; D. Veesler
err分享
err收藏
err分享
err收藏
err分享
err收藏
Monitoring of Water Transportation in Plant Stem With Microneedle Sap Flow Sensor
err2018-06-01
err0
PREAI
errSangwoong Baek; Eunyong Jeon; Kyoung Sub Park; Kyung-Hwan Yeo; Junghoon Lee
err分享
err收藏
err分享
err收藏
err
IF0
err
err0
errOAAI
err
err分享
err收藏
Advancing Science and Policy Through a Coordinated International Study of Physical Activity and Built Environments: IPEN Adult Methods
err2013-05-01
err0
errOAAI
errJacqueline Kerr; James F. Sallis; Neville Owen; Ilse De Bourdeaudhuij; Ester Cerin; Takemi Sugiyama; Rodrigo Reis; Olga Sarmiento; Karel Frömel; Josef Mitáš; Jens Troelsen; Lars Breum Christiansen; Duncan Macfarlane; Deborah Salvo; Grant Schofield; Hannah Badland; Francisco Guillen-Grima; Ines Aguinaga-Ontoso; Rachel Davey; Adrian Bauman; Brian Saelens; Chris Riddoch; Barbara Ainsworth; Michael Pratt; Tom Schmidt; Lawrence Frank; Marc Adams; Terry Conway; Kelli Cain; Delfien Van Dyck; Nicole Bracy
err分享
err收藏
学者 查看更多内容