arrow
返回

Graph transformer networks based text representation

delete2021-11-01
delete11
PRE
AI
X
Xin Mei
X
Xiaoyan Cai
L
Libin Yang *
DOI:10.1016/j.neucom.2021.08.032delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Graph Neural Networks (GNN) has been used to exploit global features in text representation learning for natural language processing (NLP) tasks, including text classification, sequence tagging, neural machine translation and relational reasoning. However, GNN based models usually build a graph for the entire cor-pus, they have high memory consumption, ignoring the order of words and containing test documents in the training graph. Thus, these models are inherently transductive and have difficulties in inductive learning. In order to solve the above problems, we propose a Graph Transformer Networks based Text representation (GTNT) model. It first constructs a degree-centric text graph, which generates a text graph for each document in the corpus. Then it adopts a graph transformer network to model the graph to obtain node embeddings. When we apply our proposed GTNT model to citation recommendation and text classification tasks, the experimental results show that our model outperforms other state-of-the-art models. (c) 2021 Elsevier B.V. All rights reserved.
Keyword:
Graph Neural Networks
Graph Transformer Networks
Text representation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
Museums in a Digital Age
err
IF0
err2013-01-11
err0
PREAI
err
err分享
err收藏
Large-Scale Question Tagging via Joint Question-Topic Embedding Learning
err2020-02-28
err54
PREAI
errNie, Liqiang; Li, Yongqi; Feng, Fuli; Song, Xuemeng; Wang, Meng; Wang, Yinglong
err分享
err收藏
没有更多内容