arrow
Return

Uncertainty estimation based adversarial attack in multi-class classification

delete2022-06-03
delete4
delete
OA
AI
I
Ismail Alarab *
S
Simant Prakoonwit
DOI:10.1007/s11042-022-13269-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Model uncertainty has gained popularity in machine learning due to the overconfident predictions derived from standard neural networks which are not trustworthy. Recently, Monte-Carlo based adversarial attack (MC-AA) has been proposed as a simple uncertainty estimation method which is powerful in capturing data points that lie in the overlapping distribution of the decision boundary. MC-AA produces uncertainties by performing back-and-forth perturbations of a given data point towards the decision boundary using the idea of adversarial attacks. Despite its efficacy against other uncertainty estimation methods, this method has been only examined on binary classification problems. Thus, we present and examine MC-AA with multi-class classification tasks. We point out the limitation of this method with multiple classes which we tackle by converting multiclass problem into 'one-versus-all' classification. We compare MC-AA against other recent model uncertainty methods on Cora - a graph structured dataset - and MNIST - an image dataset. Thus, the conducted experiments are performed using a variety of deep learning algorithms to perform the classification. Consequently, we discuss the best results of model uncertainty with Cora data using LEConv model of AUC-score 0.889 and MNIST data using CNN of AUC-score 0.98 against other uncertainty estimation methods.
Keywords:
Uncertainty estimation
Adversarial attack
Deep neural network

Journal

Multimedia Tools and Applications cover
Multimedia Tools and Applications
IF:
3
Papers:
2.0W
Citations:
3.2W

Organization

B
Bournemouth University
Scholars:
2.7K
Papers: 3.1K
Citations: 3.5K
Cited Papers

Cited Papers

Chronic Pain and the Emotional Brain: Specific Brain Activity Associated with Spontaneous Fluctuations of Intensity of Chronic Back Pain
err2006-11-22
err0
errOAAI
errMarwan N. Baliki; Dante R. Chialvo; Paul Y. Geha; Robert M. Levy; R. Norman Harden; Todd B. Parrish; A. Vania Apkarian
errShare
errSave
Uncertainty estimation for stereo matching based on evidential deep learning
err2022-04-01
err120
errOAAI
errWang, Chen; Wang, Xiang; Zhang, Jiawei; Zhang, Liang; Bai, Xiao; Ning, Xin; Zhou, Jun; Hancock, Edwin
errShare
errSave
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
err2021-12-01
err1.2K
errOAAI
errAbdar, Moloud; Pourpanah, Farhad; Hussain, Sadiq; Rezazadegan, Dana; Liu, Li; Ghavamzadeh, Mohammad; Fieguth, Paul; Cao, Xiaochun; Khosravi, Abbas; Acharya, U. Rajendra; Makarenkov, Vladimir; Nahavandi, Saeid
errShare
errSave
Expression and purification of the C-terminal fragments of TRPV5/6 channels
err2011-11-01
err0
PREAI
errNadezda V. Kovalevskaya; Nathalie Schilderink; Geerten W. Vuister
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
researcher View more