arrow
返回

Strengthening Robustness Under Adversarial Attacks Using Brain Visual Codes

delete2022-01-01
delete1
delete
OA
AI
Z
Zarina Rakhimberdina *
X
Xin Liu
T
Tsuyoshi Murata
DOI:10.1109/ACCESS.2022.3204995delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The vulnerability of computational models to adversarial examples highlights the differences in the ways humans and machines process visual information. Motivated by human perception invariance in object recognition, we aim to incorporate human brain representations for training a neural network. We propose a multi-modal approach that integrates visual input and the corresponding encoded brain signals to improve the adversarial robustness of the model. We investigate the effects of visual attacks of various strengths on an image classification task. Our experiments show that the proposed multi-modal framework achieves more robust performance against the increasing amount of adversarial perturbation than the baseline methods. Remarkably, in a black-box setting, our framework achieves a performance improvement of at least 7.54% and 5.97% on the MNIST and CIFAR-10 datasets, respectively. Finally, we conduct an ablation study to justify the necessity and significance of incorporating visual brain representations.
Keyword:
Visualization
Functional magnetic resonance imaging
Brain modeling
Robustness
Perturbation methods
Training data
Decoding
Neural networks
Computational modeling
Adversarial defense
brain decoding
deep neural network
fMRI

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

I
Institute of Science Tokyo
学者数:
3.2W
论文数: 2.7W
被引数: 117
T
Tokyo Institute of Technology
学者数:
1.1W
论文数: 9.0K
被引数: 1.9W
引用论文

引用论文

Interventricular Electrical Delay Is Predictive of Response to Cardiac Resynchronization Therapy
err2016-08-01
err0
PREAI
errMichael R. Gold; Jagmeet P. Singh; Kenneth A. Ellenbogen; Yinghong Yu; Nicholas Wold; Timothy E. Meyer; Ulrika Birgersdotter-Green
err分享
err收藏
err分享
err收藏
err分享
err收藏
Tiny noise, big mistakes: adversarial perturbations induce errors in brain-computer interface spellers
err2020-09-10
err40
errOAAI
errZhang, Xiao; Wu, Dongrui; Ding, Lieyun; Luo, Hanbin; Lin, Chin-Teng; Jung, Tzyy-Ping; Chavarriaga, Ricardo
err分享
err收藏
Mind Reading and Writing: The Future of Neurotechnology
err2018-07-01
err56
errOAAI
errRoelfsema, Pieter R.; Denys, Damiaan; Klink, P. Christiaan
err分享
err收藏
err分享
err收藏
学者 查看更多内容