返回
Label prompt for multi-label text classification
DOI:10.1007/s10489-022-03896-4.png)
摘要
En 中文
Multi-label text classification has been widely concerned by scholars due to its contribution to practical applications. One of the key challenges in multi-label text classification is how to extract and leverage the correlation among labels. However, it is quite challenging to directly model the correlations among labels in a complex and unknown label space. In this paper, we propose a Label Prompt Multi-label Text Classification model (LP-MTC), which is inspired by the idea of prompt learning of pre-trained language model. Specifically, we design a set of templates for multi-label text classification, integrate labels into the input of the pre-trained language model, and jointly optimize by Masked Language Models (MLM). In this way, the correlations among labels as well as semantic information between labels and text with the help of self-attention can be captured, and thus the model performance is effectively improved. Extensive empirical experiments on multiple datasets demonstrate the effectiveness of our method. Compared with BERT, LP-MTC improved 3.4% micro-F1 on average over the four public datasets.
Keyword:
Multi-label text classification
BERT
Pormpt learning
Masked language model
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
Reduced cortical excitatory synapse number in APOE4 mice is associated with increased calcineurin activity
NeuroReport
IF0
Capturing Joint Label Distribution for Multi-Label Classification Through Adversarial Learning通过对抗学习捕获联合标签分布用于多标签分类
Morphology and properties of melt-spun polycarbonate fibers containing single- and multi-wall carbon nanotubes
Polymer
IF0
Definitive evidence that a single N-glycan among three glycans on inducible costimulator is required for proper protein trafficking and ligand binding明确的证据表明,在可诱导的共刺激物上的三个聚糖中,单个N-聚糖对于适当的蛋白质运输和配体结合是必需的

