arrow
Return

Hierarchical Representation Learning in Graph Neural Networks With Node Decimation Pooling

delete2022-05-01
delete24
delete
OA
AI
F
Filippo Maria Bianchi *
D
Daniele Grattarola
L
Lorenzo Livi
C
Cesare Alippi
DOI:10.1109/TNNLS.2020.3044146delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In graph neural networks (GNNs), pooling operators compute local summaries of input graphs to capture their global properties, and they are fundamental for building deep GNNs that learn hierarchical representations. In this work, we propose the Node Decimation Pooling (NDP), a pooling operator for GNNs that generates coarser graphs while preserving the overall graph topology. During training, the GNN learns new node representations and fits them to a pyramid of coarsened graphs, which is computed offline in a preprocessing stage. NDP consists of three steps. First, a node decimation procedure selects the nodes belonging to one side of the partition identified by a spectral algorithm that approximates the MAXCUT solution. Afterward, the selected nodes are connected with Kron reduction to form the coarsened graph. Finally, since the resulting graph is very dense, we apply a sparsification procedure that prunes the adjacency matrix of the coarsened graph to reduce the computational cost in the GNN. Notably, we show that it is possible to remove many edges without significantly altering the graph structure. Experimental results show that NDP is more efficient compared to state-of-the-art graph pooling operators while reaching, at the same time, competitive performance on a significant variety of graph classification tasks.
Keywords:
Laplace equations
Partitioning algorithms
Symmetric matrices
Clustering algorithms
Training
Topology
Task analysis
Graph classification
graph neural networks (GNNs)
graph pooling
Kron reduction
Maxcut optimization
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Neural Networks and Learning Systems cover
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
Papers:
7.5K
Citations:
7.2W

Organization

U
Universita della Svizzera Italiana
Scholars:
3.3K
Papers: 2.8K
Citations: 3
U
University of Manitoba
Scholars:
1.9W
Papers: 1.7W
Citations: 18
U
uit the arctic university of tromso
Scholars:
9.8K
Papers: 8.6K
Citations: 10
researcher View more organizations