arrow
Return

Graph-Based Cross-Granularity Message Passing on Knowledge-Intensive Text

delete2024-01-01
delete0
PRE
AI
C
Chenwei Yan
X
Xiangling Fu *
J
Ji Wu
X
Xien Liu *
DOI:10.1109/TASLP.2024.3473308delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In knowledge-intensive fields such as medicine, the text often contains numerous professional terms, specific text fragments, and multidimensional information. However, most existing text representation methods ignore this specialized knowledge and instead adopt methods similar to those used in the general domain. In this paper, we focus on developing a learning module to enhance the representation ability of knowledge-intensive text by leveraging a graph-based cross-granularity message passing mechanism. To this end, we propose a novel learning framework, the Multi-Granularity Graph Neural Network (MG-GNN), to integrate fine-grained and coarse-grained knowledge at the character, word, and phase levels. The MG-GNN performs learning in two stages: 1) inter-granularity learning and 2) intra-granularity learning. During inter-granularity learning, semantic knowledge is extracted from character, word, and phrase granularity graphs, whereas intra-granularity learning focuses on fusing knowledge across different granularity graphs to achieve comprehensive message integration. To enhance the fusion performance, we propose a context-based gating mechanism to guide cross-graph propagation learning. Furthermore, we apply MG-GNN to address two important medical applications. Experimental results demonstrate that our proposed MG-GNN model significantly enhances the performance in both diagnosis prediction and medical named entity recognition tasks.
Keywords:
Multi-granularity
graph neural network
electronic medical record
medical NER
diagnosis prediction
Multi-granularity
graph neural network
electronic medical record
medical NER
diagnosis prediction

Journal

I
IEEE-ACM Transactions on Audio Speech and Language Processing
IF:
5.1
Papers:
2.6K
Citations:
1.1W

Organization

B
beijing university of posts & telecommunications
Scholars:
1.4W
Papers: 1.2W
Citations: 9
T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
Cited Papers

Cited Papers

Large-Scale Hierarchical Text Classification with Recursively Regularized Deep Graph-CNN
err2018-01-01
err0
errOAAI
errHao Peng; Jianxin Li; Yu He; Yaopeng Liu; Mengjiao Bao; Lihong Wang; Yangqiu Song; Qiang Yang
errShare
errSave
AI in health and medicine
err2022-01-20
err859
PREAI
errRajpurkar, Pranav; Chen, Emma; Banerjee, Oishi; Topol, Eric J.
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more