arrow
Return

Improving text classification via computing category correlation matrix from text graph

delete2025-01-01
delete0
PRE
AI
张
张珍 (Zhen Zhang)
M
Mengqiu Liu
X
Xiyuan Jia *
G
Gongxun Miao
X
Xin Wang
H
Hao Ni
G
Guohua Wu
DOI:10.1016/j.csl.2024.101688delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In text classification task, models have shown remarkable accuracy across various datasets. However, confusion often arises when certain categories within the dataset are too similar, causing misclassification of certain samples. This paper proposes an improved method for this problem, through the creation of a three-layer text graph for the corpus, which is used to calculate the Category Correlation Matrix (CCM). Additionally, this paper introduces categoryadaptive contrastive learning for text embedding from the encoder, enhancing the model's ability to distinguish between samples in confusable categories that are easily confused. Soft labels are generated using this matrix to guide the classifier, preventing the model from becoming overconfident with one-hot vectors. The efficacy of this approach was demonstrated through experimental evaluations on three text encoders and six different datasets.
Keywords:
Natural language processing
Text classification
Contrastive learning
Soft label learning

Journal

C
Computer Speech and Language
IF:
3.4
Papers:
1.5K
Citations:
2.6K

Organization

H
Hangzhou Dianzi University
Scholars:
1.3W
Papers: 9.6K
Citations: 7.5K
Cited Papers

Cited Papers

Co-attention network with label embedding for text classification
err2022-01-01
err42
PREAI
errLiu, Minqian; Liu, Lizhao; Cao, Junyi; Du, Qing
errShare
errSave
Crystallization behavior of PBT/ABS polymer blends
err1999-01-18
err0
PREAI
errE. Hage; L. A. S. Ferreira; S. Manrich; L. A. Pessan
errShare
errSave
Machine learning for email spam filtering: review, approaches and open research problems
errHELIYON
IF3.6
err2019-06-01
err228
errOAAI
errDada, Emmanuel Gbenga; Bassi, Joseph Stephen; Chiroma, Haruna; Abdulhamid, Shafi'i Muhammad; Adetunmbi, Adebayo Olusola; Ajibuwa, Opeyemi Emmanuel
errShare
errSave
A dynamic programming approach to missing data estimation using neural networks
err2013-07-01
err0
PREAI
errFulufhelo V. Nelwamondo; Dan Golding; Tshilidzi Marwala
errShare
errSave
errShare
errSave
Automatic text summarization: A comprehensive survey
err2021-03-01
err296
PREAI
errEl-Kassas, Wafaa S.; Salama, Cherif R.; Rafea, Ahmed A.; Mohamed, Hoda K.
errShare
errSave
researcher View more