arrow
返回

Parameter Interpolation Adversarial Training for Robust Image Classification

delete2025-01-01
delete0
PRE
AI
L
Liu, Xin
Y
Yichen Yang
何琨 (Kun He) *
J
JohnHopcroft (John E. Hopcroft)
DOI:10.1109/TIFS.2025.3533925delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Though deep neural networks exhibit superior performance on various tasks, they are still plagued by adversarial examples. Adversarial training has been demonstrated to be the most effective method to defend against adversarial attacks. However, existing adversarial training methods show that the model robustness has apparent oscillations and overfitting issues in the training process, degrading the defense efficacy. To address these issues, we propose a novel framework called Parameter Interpolation Adversarial Training (PIAT). PIAT tunes the model parameters between each epoch by interpolating the parameters of the previous and current epochs. It makes the decision boundary of model change more moderate and alleviates the overfitting issue, helping the model converge better and achieving higher model robustness. In addition, we suggest using the Normalized Mean Square Error (NMSE) to further improve the robustness by aligning the relative magnitude of logits between clean and adversarial examples rather than the absolute magnitude. Extensive experiments conducted on several benchmark datasets demonstrate that our framework could prominently improve the robustness of both Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs).
Keyword:
Training
Robustness
Overfitting
Computational modeling
Oscillators
Interpolation
Accuracy
Perturbation methods
Mean square error methods
Optimization
Adversarial examples
adversarial training
parameter interpolation
normalized mean square error

期刊

IEEE Transactions on Information Forensics and Security 封面图
IEEE Transactions on Information Forensics and Security
IF:
8
论文数:
5.2K
被引数:
2.3W

机构

C
Cornell University
学者数:
6.3W
论文数: 5.4W
被引数: 10.9W
引用论文

引用论文

err分享
err收藏
Subsoil carbonate dissolution rates and their determining factors in a karst drainage basin, SW China
err2020-11-03
err0
PREAI
errZeyan Wu; Cheng Zhang; Zhongcheng Jiang; Weiqun Luo; Qiong Xiao; Zhaoxin Hu; Huaying Wu
err分享
err收藏
Protecting Sensitive Attributes by Adversarial Training Through Class-Overlapping Techniques
err2023-01-01
err4
PREAI
errLin, Tsung-Hsien; Lee, Ying-Shuo; Chang, Fu-Chieh; Chang, J. Morris; Wu, Pei-Yuan
err分享
err收藏
Where do winds come from? A new theory on how water vapor condensation influences atmospheric pressure and dynamics
err
IF0
err2010-10-15
err0
errOAAI
errA. M. Makarieva; V. G. Gorshkov; D. Sheil; A. D. Nobre; B.-L. Li
err分享
err收藏
学者 查看更多内容