arrow
返回

Event stream learning using spatio-temporal event surface

delete2022-10-01
delete8
PRE
AI
J
Junfei Dong
R
Runhao Jiang
R
Rong Xiao
R
Rui Yan
H
Huajin Tang *
DOI:10.1016/j.neunet.2022.07.010delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Event cameras sense changes in light intensity and record them as an asynchronous event stream. Efficiently encoding and learning spatiotemporal information of the event streams remain challenging. In this paper, we propose a novel event descriptor to encode the spatio-temporal features for event streams and a local-search based multi-spike learning algorithm for spiking neural networks to classify encoded features. The spatio-temporal event surface (STES) descriptor explicitly captures both spatial and temporal correlations among events, and thus can characterize spatiotemporal features more accurately than existing feature descriptors that focus only on temporal or spatial information. In classification with multi-spike learning, we introduce a local search and gradient clipping mechanism to ensure the efficiency and stability of learning, which avoids other multi-spike learning rules' time-consuming global search and the gradient explosion problem. Experimental results demonstrate the superior classification performance of our proposed model, especially for event streams with rich spatiotemporal dynamics. (C) 2022 Elsevier Ltd. All rights reserved.
Keyword:
Spatiotemporal feature descriptor
Spike -based learning
Event streams classification
Spiking neural network

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.3K
被引数:
3.0W

机构

Z
zhejiang university of technology
学者数:
3.3W
论文数: 2.0W
被引数: 22
S
sichuan university
学者数:
12.1W
论文数: 7.8W
被引数: 100
Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
学者 查看更多机构
引用论文

引用论文

Optimal Composite Nonlinear Feedback Controller for an Active Front Steering System
err2014-06-01
err0
PREAI
errLiyana Ramli; Yahya M. Sam; Zaharuddin Mohamed; Muhamad Khairi Aripin; Muhamad Fahezal Ismail
err分享
err收藏
Clinical Outcomes after Arthroscopic Treatment of Synovial Chondromatosis in the Hip
err2020-03-20
err0
errOAAI
errXin Zhang; Guanying Gao; Jianquan Wang; Yan Xu
err分享
err收藏
err分享
err收藏
err分享
err收藏
SOT-MRAM 300MM Integration for Low Power and Ultrafast Embedded Memories
err2018-06-01
err0
errOAAI
errK. Garello; F. Yasin; S. Couet; L. Souriau; J. Swerts; S. Rao; S. Van Beek; W. Kim; E. Liu; S. Kundu; D. Tsvetanova; K. Croes; N. Jossart; E. Grimaldi; M. Baumgartner; D. Crotti; A. Fumemont; P. Gambardella; G.S. Kar
err分享
err收藏
学者 查看更多内容