arrow
Return

AdvChar: Attacking Interpretable NLP Systems

delete2025-01-01
delete0
PRE
AI
E
Eldor Abdukhamidov
T
Tamer Abuhmed *
J
Joanna C. S. Santos
M
Mohammed Abuhamad
DOI:10.1109/TIFS.2025.3622073delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Studies have shown that machine learning systems are vulnerable to adversarial examples in theory and practice. Where previous attacks have focused mainly on visual models that exploit the difference between human and machine perception, text-based models have also fallen victim to these attacks. However, these attacks often fail to maintain the semantic meaning of the text and similarity. This paper introduces AdvChar, a black-box attack on Interpretable Natural Language Processing Systems, designed to mislead the classifier while keeping the interpretation similar to benign inputs, thus exploiting trust in system transparency. AdvChar achieves this by making less noticeable modifications to text input, forcing the deep learning classifier to make incorrect predictions and preserve the original interpretation. We use an interpretation-focused scoring approach to determine the most critical tokens that, when changed, can cause the classifier to misclassify the input. We apply simple character-level modifications to measure the importance of tokens, minimizing the difference between the original and new text while generating adversarial interpretations similar to benign ones. We thoroughly evaluated AdvChar by testing it against seven NLP models and three interpretation models using benchmark datasets for the classification task. Our experiments show that AdvChar can significantly reduce the prediction accuracy of current deep learning models by altering just two characters on average in input samples.
Keywords:
Deep learning
Perturbation methods
Natural language processing
Text categorization
Closed box
Robustness
Predictive models
Decision making
Computer science
Vectors
Adversarial machine learning
interpretable deep learning
black-box attacks
NLP

Journal

IEEE Transactions on Information Forensics and Security cover
IEEE Transactions on Information Forensics and Security
IF:
8
Papers:
5.3K
Citations:
2.3W

Organization

S
sungkyunkwan university (skku)
Scholars:
3.7W
Papers: 3.6W
Citations: 49
U
University of Notre Dame
Scholars:
1.2W
Papers: 1.1W
Citations: 1.7W
L
loyola university chicago
Scholars:
1.2K
Papers: 497
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answering
err2024-03-24
err0
errOAAI
errZhenyu Li; Sunqi Fan; Yu Gu; Xiuxing Li; Zhichao Duan; Bowen Dong; Ning Liu; Jianyong Wang
errShare
errSave
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
err2013-01-01
err0
PREAI
errRichard Socher; Alex Perelygin; Jean Wu; Jason Chuang; Christopher D. Manning; Andrew Ng; Christopher Potts
errShare
errSave
Financial Sentiment Analysis: Techniques and Applications
err2024-04-24
err12
errOAAI
errDu, Kelvin; Xing, Frank; Mao, Rui; Cambria, Erik
errShare
errSave
Hardening Interpretable Deep Learning Systems: Investigating Adversarial Threats and Defenses
err2024-07-01
err2
PREAI
errAbdukhamidov, Eldor; Abuhamad, Mohammed; Woo, Simon S.; Chan-Tin, Eric; Abuhmed, Tamer
errShare
errSave
Recent advances in deep learning based dialogue systems: a systematic survey
err2022-08-20
err99
PREAI
errNi, Jinjie; Young, Tom; Pandelea, Vlad; Xue, Fuzhao; Cambria, Erik
errShare
errSave
FastTextDodger: Decision-Based Adversarial Attack Against Black-Box NLP Models With Extremely High Efficiency
err2024-01-01
err2
PREAI
errHu, Xiaoxue; Liu, Geling; Zheng, Baolin; Zhao, Lingchen; Wang, Qian; Zhang, Yufei; Du, Minxin
errShare
errSave
researcher View more