.png){kind=icon}
返回
Description-Enhanced Label Embedding Contrastive Learning for Text Classification
.png){kind=icon}
OA
AI
DOI：10.1109/TNNLS.2023.3282020.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Text Classification is one of the fundamental tasks in natural language processing, which requires an agent to determine the most appropriate category for input sentences. Recently, deep neural networks have achieved impressive performance in this area, especially Pre-trained Language Models (PLMs). Usually, these methods concentrate on input sentences and corresponding semantic embedding generation. However, for another essential component: labels, most existing works either treat them as meaningless one-hot vectors or use vanilla embedding methods to learn label representations along with model training, underestimating the semantic information and guidance that these labels reveal. To alleviate this problem and better exploit label information, in this paper, we employ Self-Supervised Learning (SSL) in model learning process and design a novel self-supervised Relation of Relation (R2) classification task for label utilization from a one-hot manner perspective. Then, we propose a novel Relation of Relation Learning Network (R2-Net) for text classification, in which text classification and R2 classification are treated as optimization targets. Meanwhile, triplet loss is employed to enhance the analysis of differences and connections among labels. Moreover, considering that one-hot usage is still short of exploiting label information, we incorporate external knowledge from WordNet to obtain multi-aspect descriptions for label semantic learning and extend R2-Net to a novel Description-Enhanced Label Embedding network (DELE) from a label embedding perspective. ...
Keyword:
Contrastive learning (CL)
label embedding
representation learning
text classification
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Spectrophotometric Determination of Carbon Disulfide Using Bis(4-(4 -Nitrophenyl)azo-2-Nitrophenyl) Disulfide双 (4-硝基苯基) azo-2-Nitrophenyl) 二硫化物分光光度法测定二硫化碳
.png){kind=icon}
PREAI
分享收藏
SentiVec: Learning Sentiment-Context Vector via Kernel Optimization Function for Sentiment Analysis
PREAI
分享收藏分享收藏
查看更多内容