arrow
返回

AROID: Improving Adversarial Robustness Through Online Instance-Wise Data Augmentation

delete2024-08-24
delete1
delete
OA
AI
L
Lin Li *
J
Jianing Qiu
M
Michael Spratling
DOI:10.1007/s11263-024-02206-4delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep neural networks are vulnerable to adversarial examples. Adversarial training (AT) is an effective defense against adversarial examples. However, AT is prone to overfitting which degrades robustness substantially. Recently, data augmentation (DA) was shown to be effective in mitigating robust overfitting if appropriately designed and optimized for AT. This work proposes a new method to automatically learn online, instance-wise, DA policies to improve robust generalization for AT. This is the first automated DA method specific for robustness. A novel policy learning objective, consisting of Vulnerability, Affinity and Diversity, is proposed and shown to be sufficiently effective and efficient to be practical for automatic DA generation during AT. Importantly, our method dramatically reduces the cost of policy search from the 5000 h of AutoAugment and the 412 h of IDBH to 9 h, making automated DA more practical to use for adversarial robustness. This allows our method to efficiently explore a large search space for a more effective DA policy and evolve the policy as training progresses. Empirically, our method is shown to outperform all competitive DA methods across various model architectures and datasets. Our DA policy reinforced vanilla AT to surpass several state-of-the-art AT methods regarding both accuracy and robustness. It can also be combined with those advanced AT methods to further boost robustness. Code and pre-trained models are available at: https://github.com/TreeLLi/AROID.
Keyword:
Adversarial robustness
Adversarial training
Data augmentation
Automated data augmentation

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

I
Imperial College London
学者数:
8.3W
论文数: 7.3W
被引数: 11.1W
U
university of luxembourg
学者数:
5.2K
论文数: 4.8K
被引数: 4
引用论文

引用论文

Stability of adaptive behaviors in middle-school children with autism spectrum disorders
err2007-10-01
err0
PREAI
errRobin L. Gabriels; Bonnie Jean Ivers; Dina E. Hill; John A. Agnew; John McNeill
err分享
err收藏
The Early Cambrian Mianyang-Changning Intracratonic Sag and Its Control on Petroleum Accumulation in the Sichuan Basin, China
err2017-01-01
err0
errOAAI
errShugen Liu; Bin Deng; Luba Jansa; Yong Zhong; Wei Sun; Jinmin Song; Guozhi Wang; Juan Wu; Zhiwu Li; Yanhong Tian
err分享
err收藏
The role of natural killer T cells in a mouse model with spontaneous bile duct inflammation
err2017-02-20
err0
errOAAI
errElisabeth Schrumpf; Xiaojun Jiang; Sebastian Zeissig; Marion J. Pollheimer; Jarl Andreas Anmarkrud; Corey Tan; Mark A. Exley; Tom H. Karlsen; Richard S. Blumberg; Espen Melum
err分享
err收藏
学者 查看更多内容