arrow
返回

Adversarial Attacks and Batch Normalization: A Batch Statistics Perspective

delete2023-01-01
delete3
delete
OA
AI
A
Awais Muhammad
F
Fahad Shamshad
S
Sung‐Ho Bae *
DOI:10.1109/ACCESS.2023.3250661delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Batch Normalization (BatchNorm) is an effective architectural component in deep learning models that helps to improve model performance and speed up training. However, it has also been found to increase the vulnerability of models to adversarial attacks. In this study, we investigate the mechanism behind this vulnerability and took first steps towards a solution called RobustNorm. We observed that adversarial inputs tend to shift the distributions of the output of the BatchNorm layer, leading to inaccurate train-time statistics and increased vulnerability. Through a series of experiments on various architectures and datasets, we confirm our hypothesis. We also demonstrate the effectiveness of RobustNorm in improving the robustness of models under adversarial perturbation while maintaining the benefits of BatchNorm.
Keyword:
Batch production systems
Robustness
Feature extraction
Statistics
Adversarial machine learning
Neural networks
Transfer learning
Batch normalization
adversarial robustness
transfer learning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

K
kyung hee university
学者数:
2.3W
论文数: 2.2W
被引数: 234
引用论文

引用论文

Role of interferon-γ in Vα14+ natural killer T cell-mediated host defense against Streptococcus pneumoniae infection in murine lungs
err2007-03-01
err0
PREAI
errMasashi Nakamatsu; Natsuo Yamamoto; Masumitsu Hatta; Chikara Nakasone; Takeshi Kinjo; Kazuya Miyagi; Kaori Uezu; Kiwamu Nakamura; Toshinori Nakayama; Masaru Taniguchi; Yoichiro Iwakura; Mitsuo Kaku; Jiro Fujita; Kazuyoshi Kawakami
err分享
err收藏
High prevalence of malaria in a non-endemic setting among febrile episodes in travellers and migrants coming from endemic areas: a retrospective analysis of a 2013–2018 cohort
err2021-11-27
err0
errOAAI
errAlejandro Garcia-Ruiz de Morales; Covadonga Morcate; Elena Isaba-Ares; Ramon Perez-Tanoira; Jose A. Perez-Molina
err分享
err收藏
Recent advances in convolutional neural networks卷积神经网络的最新进展
err2018-05-01
err3.8K
errOAAI
errGu, Jiuxiang; Wang, Zhenhua; Kuen, Jason; Ma, Lianyang; Shahroudy, Amir; Shuai, Bing; Liu, Ting; Wang, Xingxing; Wang, Gang; Cai, Jianfei; Chen, Tsuhan
err分享
err收藏
Role of simple descriptors and applicability domain in predicting change in protein thermostability
err2018-09-07
err0
errOAAI
errKenneth N. McGuinness; Weilan Pan; Robert P. Sheridan; Grant Murphy; Alejandro Crespo
err分享
err收藏
学者 查看更多内容