arrow
返回

Graph-Based Cross-Granularity Message Passing on Knowledge-Intensive Text

delete2024-01-01
delete0
PRE
AI
C
Chenwei Yan
X
Xiangling Fu *
J
Ji Wu
X
Xien Liu *
DOI:10.1109/TASLP.2024.3473308delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In knowledge-intensive fields such as medicine, the text often contains numerous professional terms, specific text fragments, and multidimensional information. However, most existing text representation methods ignore this specialized knowledge and instead adopt methods similar to those used in the general domain. In this paper, we focus on developing a learning module to enhance the representation ability of knowledge-intensive text by leveraging a graph-based cross-granularity message passing mechanism. To this end, we propose a novel learning framework, the Multi-Granularity Graph Neural Network (MG-GNN), to integrate fine-grained and coarse-grained knowledge at the character, word, and phase levels. The MG-GNN performs learning in two stages: 1) inter-granularity learning and 2) intra-granularity learning. During inter-granularity learning, semantic knowledge is extracted from character, word, and phrase granularity graphs, whereas intra-granularity learning focuses on fusing knowledge across different granularity graphs to achieve comprehensive message integration. To enhance the fusion performance, we propose a context-based gating mechanism to guide cross-graph propagation learning. Furthermore, we apply MG-GNN to address two important medical applications. Experimental results demonstrate that our proposed MG-GNN model significantly enhances the performance in both diagnosis prediction and medical named entity recognition tasks.
Keyword:
Multi-granularity
graph neural network
electronic medical record
medical NER
diagnosis prediction
Multi-granularity
graph neural network
electronic medical record
medical NER
diagnosis prediction

期刊

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
论文数:
2.6K
被引数:
1.1W

机构

B
beijing university of posts & telecommunications
学者数:
1.4W
论文数: 1.2W
被引数: 9
T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
引用论文

引用论文

Large-Scale Hierarchical Text Classification with Recursively Regularized Deep Graph-CNN
err2018-01-01
err0
errOAAI
errHao Peng; Jianxin Li; Yu He; Yaopeng Liu; Mengjiao Bao; Lihong Wang; Yangqiu Song; Qiang Yang
err分享
err收藏
AI in health and medicineAI在健康和医学
err2022-01-20
err859
PREAI
errRajpurkar, Pranav; Chen, Emma; Banerjee, Oishi; Topol, Eric J.
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容