1
Return

Automatic Noise Generation and Reduction for Text Classification

delete2024-01-01
delete0
PRE
AI
H
Huiyao Chen
Y
Yueheng Sun
张梅山 (Meishan Zhang) *
张民 (Min Zhang)
DOI:10.1109/TASLP.2023.3325135delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Label noise is an important issue in machine learning, which might lead to negative influences on various tasks. Given that real benchmarks for evaluation of noise reduction methods are limited, plenty of studies construct pseudo noisy data to verify their proposed methods. However, very few works have realized the rationality of the noise generation strategies. If the generated pseudo datasets are biased, their final conclusions might also be problematic. In this work, we focus on text classification of natural language processing (NLP) to investigate various pseudo noise generation methods, which is the first work of this line for NLP. In particular, we compare the noise generated with crowdsourcing noise, a kind of real noise as gold-standard, to evaluate these noise generation methods. After then, we measure and compare the performance of representative noise reduction methods respectively based on the data of crowdsourcing and our top-ranked pseudo noisy generation strategies. We conduct experiments on five text classification datasets, offering detailed comparison results as well as discussions.
Keywords:
Noise generation
noise reduction
pseudo noise
crowdsourcing

Journal

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
Papers:
2.6K
Citations:
1.1W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66
T
tianjin university
Scholars:
7.7W
Papers: 5.6W
Citations: 88
Cited Papers

Cited Papers

Citing Papers

Citing Papers