返回
A text classification method based on LSTM and graph attention network
DOI:10.1080/09540091.2022.2128047.png)
摘要
En 中文
Text classification is a popular research topic in the natural language processing. Recently solving text classification problems with graph neural network (GNN) has received increasing attention. However, current graph-based studies ignore the hidden information in text syntax and sequence structure, and it is difficult to use the model directly for processing new documents because the text graph is built based on the whole corpus including the test set. To address the above problems, we propose a text classification model based on long short-term memory network (LSTM) and graph attention network (GAT). The model builds a separate graph based on the syntactic structure of each document, generates word embeddings with contextual information using LSTM, then learns the inductive representation of words by GAT, and finally fuses all the nodes in the graph together into the document embedding. Experimental results on four datasets show that our model outperforms existing text classification methods with faster convergence and less memory consumption than other graph-based methods. In addition, our model shows a more notable improvement when using less training data. Our model proves the importance of text syntax and sequence information for classification results.
Keyword:
Text classification
LSTM
graph attention network
dependency syntax
deep learning
期刊
IF:
3.4
论文数:
854
被引数:
1.5K
机构
引用论文
Prevalence and factors affecting use of long acting and permanent contraceptive methods in Jinka town, Southern Ethiopia: a cross sectional study埃塞俄比亚南部金卡镇长效和永久性避孕方法的患病率和影响因素: 一项横断面研究

