arrow
Return

Common knowledge learning for generating transferable adversarial examples

delete2025-01-28
delete0
PRE
AI
R
Ruijie Yang
Y
Yuanfang Guo *
J
Junfu Wang
J
Jiantao Zhou
Y
Yunhong Wang
DOI:10.1007/s11704-024-40533-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper focuses on an important type of black-box attacks, i.e., transfer-based adversarial attacks, where the adversary generates adversarial examples using a substitute (source) model and utilizes them to attack an unseen target model, without knowing its information. Existing methods tend to give unsatisfactory adversarial transferability when the source and target models are from different types of DNN architectures (e.g., ResNet-18 and Swin Transformer). In this paper, we observe that the above phenomenon is induced by the output inconsistency problem. To alleviate this problem while effectively utilizing the existing DNN models, we propose a common knowledge learning (CKL) framework to learn better network weights to generate adversarial examples with better transferability, under fixed network architectures. Specifically, to reduce the model-specific features and obtain better output distributions, we construct a multi-teacher framework, where the knowledge is distilled from different teacher architectures into one student network. By considering that the gradient of input is usually utilized to generate adversarial examples, we impose constraints on the gradients between the student and teacher models, to further alleviate the output inconsistency problem and enhance the adversarial transferability. Extensive experiments demonstrate that our proposed work can significantly improve the adversarial transferability.
Keywords:
black-box attack
adversarial transferability
deep neural networks

Journal

Frontiers of Computer Science cover
Frontiers of Computer Science
IF:
4.6
Papers:
1.6K
Citations:
2.8K

Organization

B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
U
University of Macau
Scholars:
1.1W
Papers: 1.3W
Citations: 2.0W
Cited Papers

Cited Papers

Knowledge Distillation: A Survey
err2021-03-22
err1.5K
PREAI
errGou, Jianping; Yu, Baosheng; Maybank, Stephen J.; Tao, Dacheng
errShare
errSave
errShare
errSave
A prompt-based approach to adversarial example generation and robustness enhancement
err2023-12-18
err7
PREAI
errYang, Yuting; Huang, Pei; Cao, Juan; Li, Jintao; Lin, Yun; Ma, Feifei
errShare
errSave
A data representation method using distance correlation
err2024-11-11
err2
PREAI
errLiang, Xinyan; Qian, Yuhua; Guo, Qian; Zheng, Keyin
errShare
errSave
Adversarial example generation with adabelief optimizer and crop invariance
err2022-05-07
err18
errOAAI
errYang, Bo; Zhang, Hengwei; Li, Zheming; Zhang, Yuchen; Xu, Kaiyong; Wang, Jindong
errShare
errSave
AutoMA: Towards Automatic Model Augmentation for Transferable Adversarial Attacks
err2023-01-01
err7
PREAI
errYuan, Haojie; Chu, Qi; Zhu, Feng; Zhao, Rui; Liu, Bin; Yu, Nenghai
errShare
errSave
researcher View more