.png){kind=icon}
返回
BIDL: a brain-inspired deep learning framework for spatiotemporal processing
.png){kind=icon}
OA
AI
DOI：10.3389/fnins.2023.1213720.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Brain-inspired deep spiking neural network (DSNN) which emulates the function of the biological brain provides an effective approach for event-stream spatiotemporal perception (STP), especially for dynamic vision sensor (DVS) signals. However, there is a lack of generalized learning frameworks that can handle various spatiotemporal modalities beyond event-stream, such as video clips and 3D imaging data. To provide a unified design flow for generalized spatiotemporal processing (STP) and to investigate the capability of lightweight STP processing via brain-inspired neural dynamics, this study introduces a training platform called brain-inspired deep learning (BIDL). This framework constructs deep neural networks, which leverage neural dynamics for processing temporal information and ensures high-accuracy spatial processing via artificial neural network layers. We conducted experiments involving various types of data, including video information processing, DVS information processing, 3D medical imaging classification, and natural language processing. These experiments demonstrate the efficiency of the proposed method. Moreover, as a research framework for researchers in the fields of neuroscience and machine learning, BIDL facilitates the exploration of different neural models and enables global-local co-learning. For easily fitting to neuromorphic chips and GPUs, the framework incorporates several optimizations, including iteration representation, state-aware computational graph, and built-in neural functions. This study presents a user-friendly and efficient DSNN builder for lightweight STP applications and has the potential to drive future advancements in bio-inspired research.
Keyword:
spatiotemporal processing framework
spiking neural network
global-local co-learning
synaptic plasticity
video recognition
brain-inspired computing
leaky integrate and fire
reward-modulated STDP
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.2
论文数:
1.6W
被引数:
5.3W
机构
引用论文
Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge计算机断层扫描图像中自动检测肺结节的算法的验证，比较和组合: LUNA16挑战.png)
MEDICAL IMAGE ANALYSISOAAI
MEDICAL IMAGE ANALYSISIF11.8
OAAI分享收藏Backpropagation with biologically plausible spatiotemporal adjustment for training deep spiking neural networksPATTERNSOAAI
PATTERNSIF7.4
OAAI分享收藏A data-based large-scale model for primary visual cortex enables brain- like robust and versatile visual processingSCIENCE ADVANCESOAAI
SCIENCE ADVANCESIF12.5
OAAI分享收藏
查看更多内容