.png){kind=icon}
返回
ENLARGE: An Efficient SNN Simulation Framework on GPU Clusters
.png){kind=icon}
PRE
AI
DOI：10.1109/TPDS.2023.3291825.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Spiking Neural Networks (SNNs) are currently the most widely used computing model for neuroscience communities. There is also an increasing research interest in exploring the potential of SNN in brain-inspired computing, artificial intelligence, and other areas. As SNNs possess distinguished characteristics that originate from biological authenticity, they require dedicated simulation frameworks to achieve usability and efficiency. However, there is no widely-used, easily accessible, high performance SNN simulation framework for GPU clusters. In this paper, we propose ENLARGE, an efficient SNN simulation framework on GPU clusters. ENLARGE provides a multi-level architecture that deals with computation, communication, and synchronization hierarchically. We also propose an efficient communication method with an all-to all communication pattern. To deal with the delay of spike delivery, which is the most distinguished SNN characteristic, several delay aware optimization methods are also proposed. We further propose a multilevel workload management method. Various experiments are carried out to demonstrate the performance and scalability of the framework, as well as the effects of the optimization methods. Test results show that ENLARGE can achieve 3.17x similar to 28.12x speedup compared with the most widely used NEST simulator and 3.26 x similar to 13.57x speedup compared with the widely used NEST GPU simulator for GPU clusters.
Keyword:
Spiking neural network
computing framework
GPU cluster
brain-inspired computing
high performance computing
期刊
IF:
6
论文数:
5.2K
被引数:
1.1W
机构
引用论文
Organized Resting-state Functional Dysconnectivity of the Prefrontal Cortex in Patients with Schizophrenia.png)
Neuroscience
NeuroscienceIF0
PREAI
分享收藏
Contributions of evacuation proctography and anorectal manometry to evaluation of adults with constipation and defecatory difficulty排空直肠造影和肛门直肠测压对成人便秘和排便困难的评估的贡献
PREAI
分享收藏HRLSim: A High Performance Spiking Neural Network Simulator for GPGPU ClustersHRLSim: 用于GPGPU集群的高性能脉冲神经网络模拟器
PREAI
分享收藏
查看更多内容