arrow
Return

Adversarial Attacks and Batch Normalization: A Batch Statistics Perspective

delete2023-01-01
delete3
delete
OA
AI
A
Awais Muhammad
F
Fahad Shamshad
S
Sung‐Ho Bae *
DOI:10.1109/ACCESS.2023.3250661delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Batch Normalization (BatchNorm) is an effective architectural component in deep learning models that helps to improve model performance and speed up training. However, it has also been found to increase the vulnerability of models to adversarial attacks. In this study, we investigate the mechanism behind this vulnerability and took first steps towards a solution called RobustNorm. We observed that adversarial inputs tend to shift the distributions of the output of the BatchNorm layer, leading to inaccurate train-time statistics and increased vulnerability. Through a series of experiments on various architectures and datasets, we confirm our hypothesis. We also demonstrate the effectiveness of RobustNorm in improving the robustness of models under adversarial perturbation while maintaining the benefits of BatchNorm.
Keywords:
Batch production systems
Robustness
Feature extraction
Statistics
Adversarial machine learning
Neural networks
Transfer learning
Batch normalization
adversarial robustness
transfer learning

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

K
kyung hee university
Scholars:
2.3W
Papers: 2.2W
Citations: 234
Cited Papers

Cited Papers

Role of interferon-γ in Vα14+ natural killer T cell-mediated host defense against Streptococcus pneumoniae infection in murine lungs
err2007-03-01
err0
PREAI
errMasashi Nakamatsu; Natsuo Yamamoto; Masumitsu Hatta; Chikara Nakasone; Takeshi Kinjo; Kazuya Miyagi; Kaori Uezu; Kiwamu Nakamura; Toshinori Nakayama; Masaru Taniguchi; Yoichiro Iwakura; Mitsuo Kaku; Jiro Fujita; Kazuyoshi Kawakami
errShare
errSave
High prevalence of malaria in a non-endemic setting among febrile episodes in travellers and migrants coming from endemic areas: a retrospective analysis of a 2013–2018 cohort
err2021-11-27
err0
errOAAI
errAlejandro Garcia-Ruiz de Morales; Covadonga Morcate; Elena Isaba-Ares; Ramon Perez-Tanoira; Jose A. Perez-Molina
errShare
errSave
Recent advances in convolutional neural networks
err2018-05-01
err3.8K
errOAAI
errGu, Jiuxiang; Wang, Zhenhua; Kuen, Jason; Ma, Lianyang; Shahroudy, Amir; Shuai, Bing; Liu, Ting; Wang, Xingxing; Wang, Gang; Cai, Jianfei; Chen, Tsuhan
errShare
errSave
Role of simple descriptors and applicability domain in predicting change in protein thermostability
err2018-09-07
err0
errOAAI
errKenneth N. McGuinness; Weilan Pan; Robert P. Sheridan; Grant Murphy; Alejandro Crespo
errShare
errSave
researcher View more