arrow
返回

Polymorphic graph attention network for Chinese NER

delete2022-10-01
delete18
PRE
AI
Y
Yuke Wang
L
Ling Lü *
W
Wu, Yang
Y
Yinong Chen
DOI:10.1016/j.eswa.20zz.117467delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Fusing lexicon information into Chinese characters, which has normally a number of meanings, has been proven to be effective for Chinese Named Entity Recognition (NER). However, the existing approaches to incorporating a matched Chinese word into its composition characters only take the word as a whole (no subdivision or part), which failed to capture fine-grained correlation in word-character space and failed to make full use of lexicon information. Moreover, existing approaches use the fixed (static) weights between words and characters. This limits the performance of NER. Considering the fact that the same word-character pairs have different interactions in different contexts, the weights of matched word-character pairs should be dynamic rather than fixed. In this paper, we propose a Polymorphic Graph Attention Network (PGAT), aiming at capturing dynamic correlation between characters and matched words from multiple dimensions, to enhance the character representation. By obtaining matched words of characters from lexicon, we carefully map the word-character in four positions, which are B (begin), M (middle), E (end) and S (single word). The proposed semantic fusion unit based on Graph Attention Network (GAT) can dynamically modulate attention of matched words and characters in the four dimensions B, M, E, and S. Thus, it can explicitly capture fine-grained correlation between characters and matched words across each dimension. Experiments on four Chinese NER datasets show that PGAT outperforms the baseline models. It demonstrates the significance of the attention capture and fusion capabilities of the proposed polymorphic graph. Furthermore, PGAT is used in character representation layer, which makes it easier to be combined with pre-trained models like BERT and other sequence encoding models like CNN and Transformer.
Keyword:
Named entity recognition
Chinese
Polymorphic Graph Attention Network
Conditional random field
Lexicon information

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

A
Arizona State University
学者数:
2.7W
论文数: 2.5W
被引数: 4.2W
C
Chongqing University of Technology
学者数:
5.8K
论文数: 3.5K
被引数: 3
引用论文

引用论文

暂无论文信息