arrow
Return

Event-Based Feature Extraction Using Adaptive Selection Thresholds

delete2020-03-13
delete23
delete
OA
AI
S
Saeed Afshar *
N
Nicholas Ralph
徐颖 cover
徐颖 (Ying Xu)
J
Jonathan Tapson
A
André van Schaik
G
Gregory Cohen
DOI:10.3390/s20061600delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Unsupervised feature extraction algorithms form one of the most important building blocks in machine learning systems. These algorithms are often adapted to the event-based domain to perform online learning in neuromorphic hardware. However, not designed for the purpose, such algorithms typically require significant simplification during implementation to meet hardware constraints, creating trade offs with performance. Furthermore, conventional feature extraction algorithms are not designed to generate useful intermediary signals which are valuable only in the context of neuromorphic hardware limitations. In this work a novel event-based feature extraction method is proposed that focuses on these issues. The algorithm operates via simple adaptive selection thresholds which allow a simpler implementation of network homeostasis than previous works by trading off a small amount of information loss in the form of missed events that fall outside the selection thresholds. The behavior of the selection thresholds and the output of the network as a whole are shown to provide uniquely useful signals indicating network weight convergence without the need to access network weights. A novel heuristic method for network size selection is proposed which makes use of noise events and their feature representations. The use of selection thresholds is shown to produce network activation patterns that predict classification accuracy allowing rapid evaluation and optimization of system parameters without the need to run back-end classifiers. The feature extraction method is tested on both the N-MNIST (Neuromorphic-MNIST) benchmarking dataset and a dataset of airplanes passing through the field of view. Multiple configurations with different classifiers are tested with the results quantifying the resultant performance gains at each processing stage.
Keywords:
feature extraction
event-based processing
neuromorphic
event-based vision
FEAST

Journal

Sensors cover
Sensors
IF:
3.5
Papers:
7.2W
Citations:
20.9W

Organization

W
western sydney university
Scholars:
1.0W
Papers: 1.1W
Citations: 16
Cited Papers

Cited Papers

Choices, Values, and Frames
err
IF0
err2019-02-01
err0
PREAI
err
errShare
errSave
Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking Output
err2014-10-01
err325
errOAAI
errPosch, Christoph; Serrano-Gotarredona, Teresa; Linares-Barranco, Bernabe; Delbruck, Tobi
errShare
errSave
DVS Benchmark Datasets for Object Tracking, Action Recognition, and Object Recognition
err2016-08-31
err89
errOAAI
errHu, Yuhuang; Liu, Hongjie; Pfeiffer, Michael; Delbruck, Tobi
errShare
errSave
Left precentral gyrus and Broca's aphasia
err1989-01-01
err0
PREAI
errEtsuro Mori; Atsushi Yamadori; Masaru Furumoto
errShare
errSave
errShare
errSave
Experimentation and Innovation in Advance Mitigation
err2015-01-01
err0
errOAAI
errGian-Claudia Sciara; Jacquelyn Bjorkman; Jaimee Lederman; Melanie Schlotterbeck; James H. Thorne; Martin Wachs; Stuart Kirkham
errShare
errSave
Spatial and Temporal Downsampling in Event-Based Visual Classification
err2018-10-01
err22
PREAI
errCohen, Gregory; Afshar, Saeed; Orchard, Garrick; Tapson, Jonathan; Benosman, Ryad; van Schaik, Andre
errShare
errSave
Event-Based Visual Flow
err2014-02-01
err292
PREAI
errBenosman, Ryad; Clercq, Charles; Lagorce, Xavier; Ieng, Sio-Hoi; Bartolozzi, Chiara
errShare
errSave
researcher View more