arrow
Return

Weakly supervised text classification framework for noisy-labeled imbalanced

delete2024-12-01
delete0
PRE
AI
W
Wenxin Zhang
Y
Yaya Zhou
S
Shuhui Liu
Y
Yupei Zhang *
X
Xuequn Shang
DOI:10.1016/j.neucom.2024.128617delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The goal of this study is to solve the combined issue of noise labels and imbalanced samples for text classification. Current studies generally adopt data sampling or cleaning in model learning, leading to a part of information loss. To this end, this paper introduces a weakly supervised text classification framework, dubbed WeStcoin, which aims to learn a clear hierarchical attention network directly from the given noisy-labeled imbalanced samples. Specifically, WeStcoin first vectorizes the given texts to generate a contextualized corpus on which the pseudo-label vector is calculated by extracting seed words from each class and the predicted label vector is obtained by a hierarchical attention network. Based on the pseudo and predicted label vectors, we learn a cost-sensitive matrix to project the concatenated label vectors into the given label space. WeStcoin is trained iteratively to reduce the difference between the output labels and the given noisy labels by updating the network parameters, the set of seed words, and the cost-sensitive matrix, respectively. Finally, extended experiments on short-text classification shows that WeStcoin achieves a significant improvement than the stateof-the-art models in imbalanced samples with noisy labels. Besides, WeStcoin acts more robustly than compared methods and provides potential explanations for noisy labels.
Keywords:
Imbalanced data
Noisy label
Short-text classification
Weak supervision
Deep learning
Neural networks
Cost-sensitive matrix

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
N
Northwestern Polytechnical University
Scholars:
4.6W
Papers: 3.7W
Citations: 5.3W
Cited Papers

Cited Papers

Matrix Effects in the Detection of Pb and Ba in Soils Using Laser-Induced Breakdown Spectroscopy
err1996-09-01
err0
PREAI
errAaron S. Eppler; David A. Cremers; Donald D. Hickmott; Monty J. Ferris; Aaron C. Koskelo
errShare
errSave
A systematic study of the class imbalance problem in convolutional neural networks
err2018-10-01
err1.7K
errOAAI
errBuda, Mateusz; Maki, Atsuto; Mazurowski, Maciej A.
errShare
errSave
Multi-needle Localization with Attention U-Net in US-guided HDR Prostate Brachytherapy
err2020-04-03
err44
errOAAI
errZhang, Yupei; Lei, Yang; Qiu, Richard L. J.; Wang, Tonghe; Wang, Hesheng; Jani, Ashesh B.; Curran, Walter J.; Patel, Pretesh; Liu, Tian; Yang, Xiaofeng
errShare
errSave
Hybrid Classifier Ensemble for Imbalanced Data
err2020-04-01
err87
PREAI
errYang, Kaixiang; Yu, Zhiwen; Wen, Xin; Cao, Wenming; Chen, C. L. Philip; Wong, Hau-San; You, Jane
errShare
errSave
Hyperthermic Intravesical Chemotherapy for BCG Unresponsive Non-Muscle Invasive Bladder Cancer Patients
err2018-09-11
err0
errOAAI
errJoep J. de Jong; Kees Hendricksen; Marloes Rosier; Hugh Mostafid; Joost L. Boormans
errShare
errSave
Deep Learning-based Text Classification: A Comprehensive Review
err2021-04-17
err587
PREAI
errMinaee, Shervin; Kalchbrenner, Nal; Cambria, Erik; Nikzad, Narjes; Chenaghlu, Meysam; Gao, Jianfeng
errShare
errSave
Enhancement of pyramid solar distiller performance using reflectors, cooling cycle, and dangled cords of wicks
err2021-06-01
err0
PREAI
errF.A. Essa; Wissam H. Alawee; Suha A. Mohammed; A.S. Abdullah; Z.M. Omara
errShare
errSave
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
errShare
errSave
A noisy label and negative sample robust loss function for DNN-based distant supervised relation extraction
err2021-07-01
err13
PREAI
errDeng, Lihui; Yang, Bo; Kang, Zhongfeng; Yang, Shantian; Wu, Shihu
errShare
errSave
researcher View more