arrow
返回

Lagrangian objective function leads to improved unforeseen attack generalization

delete2023-06-20
delete1
PRE
AI
M
Mohammad Azizmalayeri
M
Mohammad Hossein Rohban *
DOI:10.1007/s10994-023-06348-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recent improvements in deep learning models and their practical applications have raised concerns about the robustness of these models against adversarial examples. Adversarial training (AT) has been shown effective in reaching a robust model against the attack that is used during training. However, it usually fails against other attacks, i.e., the model over fits to the training attack scheme. In this paper, we propose a new method for generating adversarial perturbations during training that mitigates the mentioned issue. More specifically, we minimize the perturbation l(p) norm while maximizing the classification loss in the Lagrangian form to craft adversarial examples. We argue that crafting adversarial examples based on this scheme results in enhanced attack generalization in the learned model. We compare our final model robust accuracy with the closely related state-of-the-art AT methods against attacks that were not used during training. This comparison demonstrates that our average robust accuracy against unseen attacks is 5.9% higher in the CIFAR-10 dataset and 3.2% higher in the ImageNet-100 dataset than corresponding state-of-the-art methods. We also demonstrate that our attack is faster than other attack schemes that are designed for unseen attack generalization and conclude that the proposed method is feasible for large datasets. Our code is available at https://github.com/rohban-lab/Lagrangian_Unseen.
Keyword:
Adversarial training
Defense
Lagrange multiplier
Unforeseen attacks

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

S
Sharif University of Technology
学者数:
1.1W
论文数: 1.1W
被引数: 9.5K
引用论文

引用论文

err分享
err收藏
Taxonomy of Machine Learning Safety: A Survey and Primer机器学习安全分类: 综述与入门
err2022-12-23
err10
errOAAI
errMohseni, Sina; Wang, Haotao; Xiao, Chaowei; Yu, Zhiding; Wang, Zhangyang; Yadawa, Jay
err分享
err收藏
Envelope theorems for arbitrary choice sets
err2002-03-01
err692
errOAAI
errMilgrom, P; Segal, I
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
The Yellow Excitonic Series of Cu2O Revisited by Lyman Spectroscopy
err2005-05-15
err0
errOAAI
errTakeshi Tayagaki; Andre Mysyrowicz; Makoto Kuwata-Gonokami
err分享
err收藏
学者 查看更多内容