arrow
返回

Automatic Noise Generation and Reduction for Text Classification

delete2024-01-01
delete0
PRE
AI
H
Huiyao Chen
Y
Yueheng Sun
张
张梅山 (Meishan Zhang) *
张
张民 (Min Zhang)
DOI:10.1109/TASLP.2023.3325135delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Label noise is an important issue in machine learning, which might lead to negative influences on various tasks. Given that real benchmarks for evaluation of noise reduction methods are limited, plenty of studies construct pseudo noisy data to verify their proposed methods. However, very few works have realized the rationality of the noise generation strategies. If the generated pseudo datasets are biased, their final conclusions might also be problematic. In this work, we focus on text classification of natural language processing (NLP) to investigate various pseudo noise generation methods, which is the first work of this line for NLP. In particular, we compare the noise generated with crowdsourcing noise, a kind of real noise as gold-standard, to evaluate these noise generation methods. After then, we measure and compare the performance of representative noise reduction methods respectively based on the data of crowdsourcing and our top-ranked pseudo noisy generation strategies. We conduct experiments on five text classification datasets, offering detailed comparison results as well as discussions.
Keyword:
Noise generation
noise reduction
pseudo noise
crowdsourcing

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

H
harbin institute of technology
学者数:
8.0W
论文数: 6.6W
被引数: 66
T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
引用论文

引用论文

A THEORY OF THE LEARNABLE
err1984-11-05
err2.4K
errOAAI
errVALIANT, LG
err分享
err收藏
Firm life cycle and earnings management: The moderating role of state ownership
err2022-06-12
err0
errOAAI
errNguyen Vinh Khuong; Le Huu Tuan Anh; Nguyen Thi Hong Van
err分享
err收藏
Eras: Improving the quality control in the annotation process for Natural Language Processing tasks
err2020-11-01
err21
PREAI
errGrosman, Jonatas S.; Furtado, Pedro H. T.; Rodrigues, Ariane M. B.; Schardong, Guilherme G.; Barbosa, Simone D. J.; Lopes, Helio C., V
err分享
err收藏
学者 查看更多内容