arrow
返回

A text classification method based on LSTM and graph attention network

delete2022-10-06
delete13
delete
OA
AI
H
Haitao Wang *
F
Fangbing Li
DOI:10.1080/09540091.2022.2128047delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Text classification is a popular research topic in the natural language processing. Recently solving text classification problems with graph neural network (GNN) has received increasing attention. However, current graph-based studies ignore the hidden information in text syntax and sequence structure, and it is difficult to use the model directly for processing new documents because the text graph is built based on the whole corpus including the test set. To address the above problems, we propose a text classification model based on long short-term memory network (LSTM) and graph attention network (GAT). The model builds a separate graph based on the syntactic structure of each document, generates word embeddings with contextual information using LSTM, then learns the inductive representation of words by GAT, and finally fuses all the nodes in the graph together into the document embedding. Experimental results on four datasets show that our model outperforms existing text classification methods with faster convergence and less memory consumption than other graph-based methods. In addition, our model shows a more notable improvement when using less training data. Our model proves the importance of text syntax and sequence information for classification results.
Keyword:
Text classification
LSTM
graph attention network
dependency syntax
deep learning

期刊

Connection Science 封面图
Connection Science
IF:
3.4
论文数:
854
被引数:
1.5K

机构

H
henan polytechnic university
学者数:
1.2W
论文数: 7.2K
被引数: 5
引用论文

引用论文

Management of giant ovarian teratoma: A case series and review of the literature
err2012-07-09
err0
errOAAI
errLONG-YUN YE; JING-JING WANG; DA-REN LIU; GUO-PING DING; LI-PING CAO
err分享
err收藏
Marsarchaeota are an aerobic archaeal lineage abundant in geothermal iron oxide microbial mats
err2018-05-14
err0
PREAI
errZackary J. Jay; Jacob P. Beam; Mensur Dlakić; Douglas B. Rusch; Mark A. Kozubal; William P. Inskeep
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容