.png){kind=icon}
.png){kind=icon}
Return
Incremental Learning, Incremental Backdoor Threats
.png){kind=icon}
PRE
AI
DOI：10.1109/TDSC.2022.3201234.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Class incremental learning from a pre-trained DNN model is gaining lots of popularity. Unfortunately, the pre-trained model also introduces a new attack vector, which enables an adversary to inject a backdoor into it and further compromise the downstream models learned from it. Prior works proposed backdoor attacks against the pre-trained models in the transfer learning scenario. However, they become less effective when the adversary does not have the knowledge of the downstream tasks or new data, which is more practical and considered in this paper. To this end, we design the first latent backdoor attacks against incremental learning. We propose two novel techniques, which can effectively and stealthily embed a backdoor into the pre-trained model. Such backdoor can only be activated when the pre-trained model is extended to a downstream model with incremental learning. It has a very high attack success rate, and is able to bypass existing backdoor detection approaches. Extensive experiments confirm the effectiveness of our attacks over different datasets and incremental learning methods, as well as strong robustness against state-of-the-art backdoor defense mechanisms including Neural Cleanse, Fine-Pruning and STRIP.
Keywords:
Data models
Task analysis
Computational modeling
Training
Adaptation models
Predictive models
Transfer learning
Backdoor attack
class incremental learning
deep learning
Journal
IF:
7.5
Papers:
2.4K
Citations:
9.6K