arrow
返回

Adversarial self-training for robustness and generalization

delete2024-09-01
delete2
PRE
AI
Z
Zhuorong Li *
吴明晖 封面图
吴明晖 (Minghui Wu)
C
Canghong Jin
D
Daiwei Yu
H
Hongchuan Yu
DOI:10.1016/j.patrec.2024.07.020delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Adversarial training is currently one of the most promising ways to achieve adversarial robustness of deep models. However, even the most sophisticated training methods is far from satisfactory, as improvement in robustness requires either heuristic strategies or more annotated data, which might be problematic in real- world applications. To alleviate these issues, we propose an effective training scheme that avoids prohibitively high cost of additional labeled data by adapting self-training scheme to adversarial training. In particular, we first use the confident prediction for a randomly-augmented image as the pseudo-label for self-training. Then we enforce the consistency regularization by targeting the adversarially-perturbed version of the same image at the pseudo-label, which implicitly suppresses the distortion of representation in latent space. Despite its simplicity, extensive experiments show that our regularization could bring significant advancement in adversarial robustness of a wide range of adversarial training methods and helps the model to generalize its robustness to larger perturbations or even against unseen adversaries.
Keyword:
Adversarial defense
Adversarial attack
Robustness
Generalization
Self-training

期刊

Pattern Recognition Letters 封面图
Pattern Recognition Letters
IF:
3.3
论文数:
8.0K
被引数:
1.6W

机构

B
Bournemouth University
学者数:
2.7K
论文数: 3.1K
被引数: 3.5K
H
Hangzhou City University
学者数:
2.2K
论文数: 2.0K
被引数: 1.0K
引用论文

引用论文

A theory of learning from different domains从不同领域学习的理论
err2009-10-23
err2.1K
errOAAI
errBen-David, Shai; Blitzer, John; Crammer, Koby; Kulesza, Alex; Pereira, Fernando; Vaughan, Jennifer Wortman
err分享
err收藏
Adversarial Detection by Latent Style Transformations
err2022-01-01
err11
errOAAI
errWang, Shuo; Nepal, Surya; Abuadbba, Alsharif; Rudolph, Carsten; Grobler, Marthie
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
没有更多内容