arrow
Return

RootES: A Method for Generating Text Adversarial Examples Using Root Embedding Space

delete2026-01-01
delete0
PRE
AI
C
Changguang Wang
C
Cong Wang
Q
Qingru Li
F
Fangwei Wang *
DOI:10.1007/978-3-031-94445-1_13delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The pervasive deployment of deep learning in NLP (Natural Language Processing) has prompted researchers to acknowledge the vulnerability of existing models to adversarial examples. The current methods for generating text adversarial examples frequently exhibit high perturbation rates, limited perturbation methods, and poor similarity. To address these issues, this article proposes a process named RootES for generating text adversarial examples using the root embedding space. First, an enhanced BERT(Bidirectional Encoder Representations from Transformers) model with a multi-head self-attention mechanism is employed to identify keywords that significantly affect classification accurately. Second, the root embedding space model finds root words most similar to the keywords for character-level perturbations, generating candidate examples with different perturbation types. Finally, the candidate examples are treated as different clusters, and one is selected as the final mixed-type adversarial example with varying types of substitution. The experimental results show that adversarial examples generated on the IMDB Review, Yelp Reviews, and AG's News datasets have lower perturbation rates (PR) and improved attack success rates (SR) and similarity (Sim) compared to existing methods. Further experiments confirm that adversarial examples generated by RootES exhibit good transferability and that adversarial training enhances model robustness.
Keywords:
Text Adversarial Examples
Attention Mechanism
Deep Learning
Adversarial Training
Natural Language Processing

Journal

S
SECURITY AND PRIVACY IN COMMUNICATION NETWORKS, SECURECOMM 2024, PT I
IF:
0
Papers:
16
Citations:
0

Organization

H
Hebei Normal University
Scholars:
6.4K
Papers: 3.5K
Citations: 9
Cited Papers

Cited Papers

Robust convolutional neural networks against adversarial attacks on medical images
err2022-12-01
err16
errOAAI
errShi, Xiaoshuang; Peng, Yifan; Chen, Qingyu; Keenan, Tiarnan; Thavikulwat, Alisa T.; Lee, Sungwon; Tang, Yuxing; Chew, Emily Y.; Summers, Ronald M.; Lu, Zhiyong
errShare
errSave
Adversarial examples for extreme multilabel text classification
err2022-11-04
err3
errOAAI
errQaraei, Mohammadreza; Babbar, Rohit
errShare
errSave
WordChange: Adversarial Examples Generation Approach for Chinese Text Classification
err2020-01-01
err21
errOAAI
errNuo, Cheng; Chang, Guo-Qin; Gao, Haichang; Pei, Ge; Zhang, Yang
errShare
errSave
Integrated deep learning paradigm for document-based sentiment analysis
err2023-07-01
err0
errOAAI
errPeter Atandoh; Fengli Zhang; Daniel Adu-Gyamfi; Paul H. Atandoh; Raphael Elimeli Nuhoho
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
errShare
errSave
Effective text classification using BERT, MTM LSTM, and DT
err2024-05-01
err0
PREAI
errSaman Jamshidi; Mahin Mohammadi; Saeed Bagheri; Hamid Esmaeili Najafabadi; Alireza Rezvanian; Mehdi Gheisari; Mustafa Ghaderzadeh; Amir Shahab Shahabi; Zongda Wu
errShare
errSave
researcher View more