.png){kind=icon}
返回
Prompt-Based Prototypical Framework for Continual Relation Extraction
.png){kind=icon}
PRE
AI
DOI：10.1109/TASLP.2022.3199655.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Continual relation extraction (CRE) is an important task of continual learning, which aims to learn incessantly emerging new relations between entities from texts. To avoid catastrophically forgetting old relations, some existing research efforts have focused on exploring memory replayed methods by storing typical historical learned instances or embedding all observed relations as prototypes in the episodic memory and replaying them in the subsequent training process. However, they generally fail to exploit the relation knowledge contained in the pre-trained language model (PLM), which could provide enlightening information to the representations of new relations from the known ones. To this end, we investigate the CRE from a novel perspective by generating knowledge-infused relation prototypes to leverage the relational knowledge from PLM with prompt tuning. Specifically, based on the typical samples collected from the historical learned instances with K-means algorithm, we devise novel relational knowledge-infused prompts to elicit relational knowledge from PLM for generating knowledge-infused relation prototypes. Then the prototypes are used to refine the typical examples embedding and calculate the stability-plasticity balance score for adjusting the memory replayed progress. The experimental results show that our method outperforms the state-of-the-art baseline models in CRE. The further extensive analysis presents that the proposed method is robust to memory size, task order, length of the task sequence, and the number of training instances.
Keyword:
Task analysis
Prototypes
Stability analysis
Feature extraction
Training
Speech processing
Security
Continual learning
relation extraction
catastrophic forgetting
prompt method
prototype
期刊
I
IF:
5.1
论文数:
2.6K
被引数:
1.1W
机构
引用论文
.png){kind=icon}
An Improved Version of the Extended Velocity-Azimuth Display Analysis of Single-Doppler Radar Data
OAAI
OAAI分享收藏Aluminum effects on growth and P, Ca, and Mg uptake efficiency in red clover cult1vars铝对红三叶草品种生长及P、Ca和Mg吸收效率的影响
PREAI
分享收藏Satellite remote sensing of primary production: an improved production efficiency modeling approach
PREAI
分享收藏分享收藏
查看更多内容