.png){kind=icon}
.png){kind=icon}
Return
Mitigating prototype shift: Few-shot nested named entity recognition with prototype-attention contrastive learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.eswa.2024.126293.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Nested entities are prone to obtain similar representations in pre-trained language models, posing challenges for Named Entity Recognition (NER), especially in the few-shot setting where prototype shifts often occur due to distribution differences between the support and query sets. In this paper, we regard entity representation as the combination of prototype and non-prototype representations. With a hypothesis that using the prototype representation specifically can help mitigate potential prototype shifts, we propose a Prototype-Attention mechanism in the Contrastive Learning framework (PACL) for the few-shot nested NER. PACL first generates prototype-enhanced span representations to mitigate the prototype shift by applying a prototype attention mechanism. It then adopts a novel prototype-span contrastive loss to reduce prototype differences further and overcome the O-type's non-unique prototype limitation by comparing prototype-enhanced span representations with prototypes and original semantic representations. Our experiments show that the PACL outperformed baseline models on the 1-shot and 5-shot tasks in terms of F 1 score. Further analyses indicate that our Prototype-Attention mechanism is a simple but effective method and exhibits good generalizability.
Keywords:
Few-shot
Nested named entity recognition
Prototype shift
Journal
IF:
7.5
Papers:
2.9W
Citations:
10.2W