arrow
Return

Event stream learning using spatio-temporal event surface

delete2022-10-01
delete8
PRE
AI
J
Junfei Dong
R
Runhao Jiang
R
Rong Xiao
R
Rui Yan
H
Huajin Tang *
DOI:10.1016/j.neunet.2022.07.010delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Event cameras sense changes in light intensity and record them as an asynchronous event stream. Efficiently encoding and learning spatiotemporal information of the event streams remain challenging. In this paper, we propose a novel event descriptor to encode the spatio-temporal features for event streams and a local-search based multi-spike learning algorithm for spiking neural networks to classify encoded features. The spatio-temporal event surface (STES) descriptor explicitly captures both spatial and temporal correlations among events, and thus can characterize spatiotemporal features more accurately than existing feature descriptors that focus only on temporal or spatial information. In classification with multi-spike learning, we introduce a local search and gradient clipping mechanism to ensure the efficiency and stability of learning, which avoids other multi-spike learning rules' time-consuming global search and the gradient explosion problem. Experimental results demonstrate the superior classification performance of our proposed model, especially for event streams with rich spatiotemporal dynamics. (C) 2022 Elsevier Ltd. All rights reserved.
Keywords:
Spatiotemporal feature descriptor
Spike -based learning
Event streams classification
Spiking neural network

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
8.3K
Citations:
3.0W

Organization

Z
zhejiang university of technology
Scholars:
3.3W
Papers: 2.0W
Citations: 22
S
sichuan university
Scholars:
12.1W
Papers: 7.8W
Citations: 100
Z
zhejiang university
Scholars:
17.7W
Papers: 12.1W
Citations: 152
researcher View more organizations
Cited Papers

Cited Papers

Optimal Composite Nonlinear Feedback Controller for an Active Front Steering System
err2014-06-01
err0
PREAI
errLiyana Ramli; Yahya M. Sam; Zaharuddin Mohamed; Muhamad Khairi Aripin; Muhamad Fahezal Ismail
errShare
errSave
Clinical Outcomes after Arthroscopic Treatment of Synovial Chondromatosis in the Hip
err2020-03-20
err0
errOAAI
errXin Zhang; Guanying Gao; Jianquan Wang; Yan Xu
errShare
errSave
errShare
errSave
errShare
errSave
SOT-MRAM 300MM Integration for Low Power and Ultrafast Embedded Memories
err2018-06-01
err0
errOAAI
errK. Garello; F. Yasin; S. Couet; L. Souriau; J. Swerts; S. Rao; S. Van Beek; W. Kim; E. Liu; S. Kundu; D. Tsvetanova; K. Croes; N. Jossart; E. Grimaldi; M. Baumgartner; D. Crotti; A. Fumemont; P. Gambardella; G.S. Kar
errShare
errSave
researcher View more