.png){kind=icon}
返回
Prompt-Learning for Short Text Classification
.png){kind=icon}
OA
AI
DOI：10.1109/TKDE.2023.3332787.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In the short text, the extremely short length, feature sparsity, and high ambiguity pose huge challenges to classification tasks. Recently, as an effective method for tuning Pre-trained Language Models for specific downstream tasks, prompt-learning has attracted a vast amount of attention and research. The main intuition behind the prompt-learning is to insert the template into the input and convert the tasks into equivalent cloze-style tasks. However, most prompt-learning methods only consider the class name and monotonous strategy for knowledge incorporating in cloze-style prediction, which will inevitably incur omissions and bias in short text classification tasks. In this paper, we propose a short text classification method with prompt-learning. Specifically, the top $M$M concepts related to the entity in the short text are retrieved from the open Knowledge Graph like Probase, these concepts are first selected by the distance with class labels, which takes both the short text itself and the class name into consideration during expanding label word space. Then, we conducted four additional strategies for the integration of the expanded concepts, and the union of these concepts are adopted finally in the verbalizer of prompt-learning. Experimental results show that the obvious improvement is obtained compared with other state-of-the-art methods on five well-known datasets.
Keyword:
Task analysis
Business
Sports
Semantics
Blogs
Companies
Tuning
Prompt-Learning
short text classification
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
引用论文
Fibrillin‐rich microfibrils: Structural determinants of morphogenetic and homeostatic events富含原纤维的微纤丝: 形态发生和稳态事件的结构决定因素
OAAI
OAAI分享收藏分享收藏Canine peripheral blood mononuclear cell-derived B lymphocytes pretreated with lipopolysaccharide enhance the immunomodulatory effect through macrophage polarization脂多糖预处理的犬外周血单个核细胞源性B淋巴细胞通过巨噬细胞极化增强免疫调节作用.png)
PLOS ONEOAAI
PLOS ONEIF0
OAAI分享收藏分享收藏SACPC: A framework based on probabilistic linguistic terms for short text sentiment analysisSACPC: 基于概率语言术语的短文本情感分析框架
PREAI
分享收藏
查看更多内容