返回
Strengthening Robustness Under Adversarial Attacks Using Brain Visual Codes
DOI:10.1109/ACCESS.2022.3204995.png)
摘要
En 中文
The vulnerability of computational models to adversarial examples highlights the differences in the ways humans and machines process visual information. Motivated by human perception invariance in object recognition, we aim to incorporate human brain representations for training a neural network. We propose a multi-modal approach that integrates visual input and the corresponding encoded brain signals to improve the adversarial robustness of the model. We investigate the effects of visual attacks of various strengths on an image classification task. Our experiments show that the proposed multi-modal framework achieves more robust performance against the increasing amount of adversarial perturbation than the baseline methods. Remarkably, in a black-box setting, our framework achieves a performance improvement of at least 7.54% and 5.97% on the MNIST and CIFAR-10 datasets, respectively. Finally, we conduct an ablation study to justify the necessity and significance of incorporating visual brain representations.
Keyword:
Visualization
Functional magnetic resonance imaging
Brain modeling
Robustness
Perturbation methods
Training data
Decoding
Neural networks
Computational modeling
Adversarial defense
brain decoding
deep neural network
fMRI
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects多模态数据融合: 方法、挑战与展望综述
PROCEEDINGS OF THE IEEE
IF25.9
Tiny noise, big mistakes: adversarial perturbations induce errors in brain-computer interface spellers
NATIONAL SCIENCE REVIEW
IF17.1
Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系?

