arrow
返回

Data augmentation using virtual word insertion techniques in text classification tasks

delete2023-12-12
delete1
PRE
AI
Z
Z.H. Long *
李
李红 (Hong Li)
J
Jiawen Shi
X
Xin Ma
DOI:10.1111/exsy.13519delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Labelling multiple training examples for text classification models is usually time-consuming and complex. Data augmentation can be used to automatically expand the dataset by transforming the original data. However, it may cause semantic changes without modifying the labels, which reduces the effectiveness of the classifiers. In this paper, we propose a data-augmentation method called the virtual word insertion technique, which generates new sentences by randomly inserting virtual words into existing sentences. Two methods are used to achieve virtual word embedding: unweighted average and weighted average. Furthermore, a new concept of weight is proposed: the class deviation factor, which demonstrates the correlation between words and classes. Based on this new concept, different weights are assigned to words of different classes. Experiments are conducted on five different classification tasks. Ablation experiments are also performed to explore the effects of random operation and number of augmented sentences for classification results. The results of these experiments show that our method improves the classification performance and outperforms two other contrasting data-augmentation methods in automatically augmenting the dataset. Compared to raw datasets, the average accuracy improvement of our method is 3.5% for a small-scale dataset and 1% for a large-scale dataset.
Keyword:
class deviation factor
data augmentation
text classification
virtual word insertion techniques

期刊

Expert Systems 封面图
Expert Systems
IF:
2.3
论文数:
2.6K
被引数:
3.8K

机构

C
Central South University
学者数:
10.0W
论文数: 7.2W
被引数: 10.9W
引用论文

引用论文

Measurement of Motor Vehicle Operation Pertinent to Fuel Economy
err1975-02-01
err0
PREAI
errT. M. Johnson; D. L. Formenti; R. F. Gray; W. C. Peterson
err分享
err收藏
err分享
err收藏
The Randolph Glacier Inventory: a globally complete inventory of glaciers伦道夫冰川清单: 全球完整的冰川清单
err2017-07-10
err0
errOAAI
errW. Tad Pfeffer; Anthony A. Arendt; Andrew Bliss; Tobias Bolch; J. Graham Cogley; Alex S. Gardner; Jon-Ove Hagen; Regine Hock; Georg Kaser; Christian Kienholz; Evan S. Miles; Geir Moholdt; Nico Mölg; Frank Paul; Valentina Radić; Philipp Rastner; Bruce H. Raup; Justin Rich; Martin J. Sharp
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容