arrow
Return

Discrete-time dynamic graph echo state networks

delete2022-07-01
delete10
PRE
AI
A
Alessio Micheli
D
Domenico Tortorella *
DOI:10.1016/j.neucom.2022.05.001delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Relations between entities evolving through discrete time-steps can be represented by discrete-time dynamic graphs. Examples include hourly interactions between social network users or daily infection spreading. In this paper, we present Dynamic Graph Echo State Network (DynGESN), a reservoir computing model for the efficient processing of discrete-time dynamic temporal graphs. We prove a sufficient condition for the echo state property, which ensures that graph embeddings are independent of initial conditions, and we briefly analyze reservoir dynamics. DynGESN is compared against temporal graph kernels (TGKs) on twelve graph classification tasks, and against ten different end-to-end trained temporal graph convolutional networks (TGNs) on four vertex regression tasks, since TGKs are limited to graph-level tasks. Compared to TGKs that need to hold the entire history of vertex interactions, our model provides a vector encoding for the dynamic graph that is updated at each time-step without requiring training. Experiments show that our model achieves accuracy in line with TGKs that have comparable computational complexity, while still offering space and time requirements better suited to scale to large-size data. Moreover, DynGESN overall achieves superior or on par accuracy with respect to TGNs, while improving efficiency by up ten times on inference and training time. (C) 2022 Elsevier B.V. All rights reserved.
Keywords:
Dynamic graphs
Reservoir computing
Graph neural networks
Deep echo state networks
Graph echo state networks

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

U
University of Pisa
Scholars:
3.1W
Papers: 2.4W
Citations: 2.4W
Cited Papers

Cited Papers

Alcohol Intake and Reduced Mortality in Patients with Traumatic Brain Injury
err2016-04-21
err0
PREAI
errJin Seong Cho; Sang Do Shin; Eui Jun Lee; Kyoung Jun Song; Hyun Noh; Yu Jin Kim; Seung Chul Lee; Ju Ok Park; Seong Chun Kim; Seung‐sik Hwang
errShare
errSave
Dynamics of information diffusion and its applications on complex networks
err2016-09-01
err357
errOAAI
errZhang, Zi-Ke; Liu, Chuang; Zhan, Xiu-Xiu; Lu, Xin; Zhang, Chu-Xu; Zhang, Yi-Cheng
errShare
errSave
An experimental unification of reservoir computing methods
err2007-04-01
err835
PREAI
errVerstraeten, D.; Schrauwen, B.; D'Haene, M.; Stroobandt, D.
errShare
errSave
TRAPP Complexes in Secretion and Autophagy
err2016-03-30
err0
errOAAI
errJane J. Kim; Zhanna Lipatova; Nava Segev
errShare
errSave
Deep reservoir computing: A critical experimental analysis
err2017-12-01
err327
errOAAI
errGallicchio, Claudio; Micheli, Alessio; Pedrelli, Luca
errShare
errSave
Analysis and Control of Epidemics A SURVEY OF SPREADING PROCESSES ON COMPLEX NETWORKS
err2016-02-01
err534
errOAAI
errNowzari, Cameron; Preciado, Victor M.; Pappas, George J.
errShare
errSave
T-GCN: A Temporal Graph Convolutional Network for Traffic Prediction
err2020-09-01
err1.8K
PREAI
errZhao, Ling; Song, Yujiao; Zhang, Chao; Liu, Yu; Wang, Pu; Lin, Tao; Deng, Min; Li, Haifeng
errShare
errSave
Recent advances in physical reservoir computing: A review
err2019-07-01
err1.2K
errOAAI
errTanaka, Gouhei; Yamane, Toshiyuki; Heroux, Jean Benoit; Nakane, Ryosho; Kanazawa, Naoki; Takeda, Seiji; Numata, Hidetoshi; Nakano, Daiju; Hirose, Akira
errShare
errSave
researcher View more