.png){kind=icon}
返回
Multi-task learning for few-shot biomedical relation extraction
.png){kind=icon}
OA
AI
DOI：10.1007/s10462-023-10484-6.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Artificial intelligence (AI) has advanced rapidly, but it has limited impact on biomedical text understanding due to a lack of annotated datasets (a.k.a. few-shot learning). Multi-task learning, which uses data from multiple datasets and tasks with related syntax and semantics, has potential to address this issue. However, the effectiveness of this approach heavily relies on the quality of the available data and its transferability between tasks. In this paper, we propose a framework, built upon a state-of-the-art multi-task method (i.e. MT-DNN), that leverages different publicly available biomedical datasets to enhance relation extraction performance. Our model employs a transformer-based architecture with shared encoding layers across multiple tasks, and task-specific classification layers to generate task-specific representations. To further improve performance, we utilize a knowledge distillation technique. In our experiments, we assess the impact of incorporating biomedical datasets in a multi-task learning setting and demonstrate that it consistently outperforms state-of-the-art few-shot learning methods in cases of limited data. This results in significant improvement across most datasets and few-shot scenarios, particularly in terms of recall scores.
Keyword:
Biomedical NLP
Data-centric AI
Deep learning
Low-resource learning
Transformers
期刊
IF:
13.9
论文数:
6.1K
被引数:
1.9W
机构
引用论文
Determining the three-dimensional geometry of a dike swarm and its impact on later rift geometry using seismic reflection data.png)
Geology
OAAI
GeologyIF0
OAAI分享收藏分享收藏
查看更多内容