arrow
返回

Efficient Spectral Graph Convolutional Network Deployment on Memristive Crossbars

delete2023-04-01
delete16
PRE
AI
B
Bo Lyu
M
Maher Hamdi
Y
Yin Yang
Y
Yuting Cao
Z
Zheng Yan
李珂 封面图
李珂 (Ke Li)
S
Shiping Wen *
T
Tingwen Huang
DOI:10.1109/TETCI.2022.3210998delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Graph Neural Networks (GNNs) have attracted increasing research interest for their remarkable capability to model graph-structured knowledge. However, GNNs suffer from intensive data exchange and poor data locality, which will cause critical performance and energy bottlenecks under conventional complementary metal oxide semiconductor (CMOS)-based von-Neumann computing architectures (graphics processing unit (GPU), central processing unit (CPU)) for the Memory Wall issue. Fortunately, memristive crossbar-based computation has emerged as one of the most promising neuromorphic computing architectures, which has been widely studied as the computing platform for convolutional neural network (CNNs), recurrent neural network (RNNs), spiking neural network (SNNs), etc. This paper proposes the deployment of spectral graph convolutional networks (GCNs) on memristive crossbars. Further, based on the structure of GCNs (extremely high sparsity and unbalanced non-zero data distribution) and the neuromorphic characteristics of memristive crossbar circuit, we propose the acceleration method that consists of Sparse Laplace Matrix Reordering and Diagonal Block Matrix Multiplication. The simulated experiment on memristor crossbars achieves 90.3% overall accuracy on the supervised learning graph dataset (QM7), and compared with the original computation, the proposed acceleration computing framework (with half-size diagonal blocks) achieves a 27.3% reduction of memristor number. Additionally, on the unsupervised learning dataset (Karate club), our method shows no loss of accuracy with half-size diagonal block mapping and reaches a 32.2% reduction of memristor number.
Keyword:
Memristors
Computer architecture
Sparse matrices
Matrix converters
System-on-chip
Hardware
Computational modeling
Memristor
neural network
graph convolutional network
sparse matrix
neurocomputing

期刊

I
IEEE Transactions on Emerging Topics in Computational Intelligence
IF:
6.5
论文数:
1.4K
被引数:
4.5K

机构

G
George Washington University
学者数:
1.6W
论文数: 1.4W
被引数: 1.7W
U
university of technology sydney
学者数:
1.6W
论文数: 2.0W
被引数: 25
H
Hamad Bin Khalifa University-Qatar
学者数:
2.2K
论文数: 2.0K
被引数: 33
Q
qatar foundation (qf)
学者数:
6.3K
论文数: 7.0K
被引数: 8
学者 查看更多机构
引用论文

引用论文

GoogleWorkloads for Consumer Devices: Mitigating Data Movement Bottlenecks
err2018-03-19
err189
PREAI
errBoroumand, Amirali; Ghose, Saugata; Kim, Youngsok; Ausavarungnirun, Rachata; Shiu, Eric; Thakur, Rahul; Kim, Daehyun; Kuusela, Aki; Knies, Allan; Ranganathan, Parthasarathy; Mutlu, Onur
err分享
err收藏
Memristive LSTM Network for Sentiment Analysis用于情感分析的忆阻LSTM网络
err2019-01-01
err110
PREAI
errWen, Shiping; Wei, Huaqiang; Yang, Yin; Guo, Zhenyuan; Zeng, Zhigang; Huang, Tingwen; Chen, Yiran
err分享
err收藏
Sumatriptan for the treatment of undifferentiated primary headaches in the ED
err2007-01-01
err0
PREAI
errJames R. Miner; Stephen W. Smith; Johanna Moore; Michelle Biros
err分享
err收藏
THE HEAT OF COMBUSTION OF TETRAMETHYLTETRAZENE AND 1,1-DIMETHYLHYDRAZINE
err2002-05-01
err0
PREAI
errTerence M. Donovan; C. Howard Shomate; William R. McBride
err分享
err收藏
OBSERVATIONS ON THE MULTIPLICATION OF PHAGES AFFECTING STREPTOMYCES GRISEUS
err1950-07-01
err0
errOAAI
errWalter L. Koerber; George Greenspan; A. F. Langlykke
err分享
err收藏
Adverse drug reactions associated with six commonly used antiepileptic drugs in southern China from 2003 to 2015
err2019-01-14
err0
errOAAI
errYanru Du; Jiahe Lin; Jingzan Shen; Siqi Ding; Mengqian Ye; Li Wang; Yi Wang; Xinshi Wang; Niange Xia; Rongyuan Zheng; Hong Chen; Huiqin Xu
err分享
err收藏
学者 查看更多内容