返回
Graph transformer networks based text representation
DOI:10.1016/j.neucom.2021.08.032.png)
摘要
En 中文
Graph Neural Networks (GNN) has been used to exploit global features in text representation learning for natural language processing (NLP) tasks, including text classification, sequence tagging, neural machine translation and relational reasoning. However, GNN based models usually build a graph for the entire cor-pus, they have high memory consumption, ignoring the order of words and containing test documents in the training graph. Thus, these models are inherently transductive and have difficulties in inductive learning. In order to solve the above problems, we propose a Graph Transformer Networks based Text representation (GTNT) model. It first constructs a degree-centric text graph, which generates a text graph for each document in the corpus. Then it adopts a graph transformer network to model the graph to obtain node embeddings. When we apply our proposed GTNT model to citation recommendation and text classification tasks, the experimental results show that our model outperforms other state-of-the-art models. (c) 2021 Elsevier B.V. All rights reserved.
Keyword:
Graph Neural Networks
Graph Transformer Networks
Text representation
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Power spectrum of directly modulated single-mode semiconductor lasers: Chirp-induced fine structure直接调制单模半导体激光器的功率谱:啁啾诱导的精细结构
Denitrification Activity of a Remarkably Diverse Fen Denitrifier Community in Finnish Lapland Is N-Oxide Limited
PLOS ONE
IF0
没有更多内容

