.png){kind=icon}
返回
Multi-Task Multi-Attention Transformer for Generative Named Entity Recognition
.png){kind=icon}
PRE
AI
DOI：10.1109/TASLP.2024.3458796.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Most previous sequential labeling models are task-specific, while recent years have witnessed the rise of generative models due to the advantage of unifying all named entity recognition (NER) tasks into the encoder-decoder framework. Although achieving promising performance, our pilot studies demonstrate that existing generative models are ineffective at detecting entity boundaries and estimating entity types. In this paper, we propose a multi-task Transformer, which incorporates an entity boundary detection task into the named entity recognition task. More concretely, we achieve entity boundary detection by classifying the relations between tokens within the sentence. To improve the accuracy of entity-type mapping during decoding, we adopt an external knowledge base to calculate the prior entity-type distributions and then incorporate the information into the model via the self- and cross-attention mechanisms. We perform experiments on extensive NER benchmarks, including flat, nested, and discontinuous NER datasets involving long entities. It substantially increases nearly +0.3 similar to +1.5 F-1 scores across a broad spectrum or performs closely to the best generative NER model. Experimental results show that our approach improves the performance of the generative NER model considerably.
Keyword:
Named entity recognition
transformer
attention
期刊
I
IF:
5.1
论文数:
2.6K
被引数:
1.1W
机构
引用论文
.png){kind=icon}
CPT: a pre-trained unbalanced transformer for both Chinese language understanding and generation
PREAI
分享收藏分享收藏
查看更多内容