arrow
Return

Node Embedding and Classification with Adaptive Structural Fingerprint

delete2022-09-01
delete1
PRE
AI
Y
Yaokang Zhu
王俊 cover
王俊 (Jun Wang)
J
Jie Zhang
张凯 (Kai Zhang) *
DOI:10.1016/j.neucom.2022.05.073delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graph attention network (GAT) is a promising framework for message passing on graphs, but how to exploit rich, high-order structural information in the attention mechanism is still an open challenge. Furthermore, increasing the attention range to more than one-hop neighbors can negatively affect the performance of GAT, reflecting the over-smoothing risk of graph neural networks in general. In this paper, we propose an adaptive structural fingerprint model to fully exploit complex graph topology in graph attention networks. The key idea is to contextualize each node with its structural fingerprint that can automatically adjust to the local graph topology and edge connections in the neighborhood of the node. By doing this, structural interactions between the nodes can be evaluated more accurately and better confined to relevant neighbors, thus contributing to an improved attention mechanism and clearer cluster boundary. Furthermore, our approach provides a useful platform for different subspace of node features and various spatial scale of graph structures to cross-talk with each other through multi-head attention, which is more flexible than existing attention mechanism using a fixed, minimal spatial attention scale. Encouraging results are observed on a number of benchmark data sets including citation and social networks. (C) 2022 Published by Elsevier B.V.
Keywords:
Graph convolutional networks
Graph attention networks
Node classification
High-order structural attention

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

F
fudan university
Scholars:
11.7W
Papers: 7.7W
Citations: 121