arrow
返回

Unsupervised Spiking Instance Segmentation on Event Data Using STDP Features

delete2022-11-01
delete5
delete
OA
AI
P
Paul Kirkland *
D
Davide L. Manna
Á
Álex Vicente
G
Gaetano Di Caterina
DOI:10.1109/TC.2022.3191968delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Spiking Neural Networks (SNN) and the field of Neuromorphic Engineering has brought about a paradigm shift in how to approach Machine Learning (ML) and Computer Vision (CV) problem. This paradigm shift comes from the adaption of event-based sensing and processing. An event-based vision sensor allows for sparse and asynchronous events to be produced that are dynamically related to the scene. Allowing not only the spatial information but a high-fidelity of temporal information to be captured. Meanwhile avoiding the extra overhead and redundancy of conventional high frame rate approaches. However, with this change in paradigm, many techniques from traditional CV and ML are not applicable to these event-based spatial-temporal visual streams. As such a limited number of recognition, detection and segmentation approaches exist. In this paper, we present a novel approach that can perform instance segmentation using just the weights of a Spike Time Dependent Plasticity trained Spiking Convolutional Neural Network that was trained for object recognition. This exploits the spatial and temporal aspects of the SpikeSEG network's internal feature representations adding this new discriminative capability. We highlight the new capability by successfully transforming a single class unsupervised network for face detection into a multi-person face recognition and instance segmentation network.
Keyword:
Image segmentation
Semantics
Feature extraction
Object detection
Decoding
Task analysis
Face recognition
Neuromorphic engineering
neuromorphic algorithms
SNN
STDP
computer vision
unsuperivsed learning
instance segmenation

期刊

IEEE Transactions on Computers 封面图
IEEE Transactions on Computers
IF:
3.8
论文数:
5.4K
被引数:
9.8K

机构

U
university of strathclyde
学者数:
1.1W
论文数: 1.1W
被引数: 12
引用论文

引用论文

A novel endoesophageal magnetic device to prevent gastroesophageal reflux
err2008-12-31
err0
PREAI
errMauro Bortolotti; Annamaria Grandis; Giosuè Mazzero
err分享
err收藏
Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
err分享
err收藏
Particle size, morphology and phase transitions in hydrothermally produced VO2(D)
err2017-01-01
err0
errOAAI
errDiana Teixeira; Raul Quesada-Cabrera; Michael J. Powell; G. K. L. Goh; G. Sankar; I. P. Parkin; R. G. Palgrave
err分享
err收藏
Artefactual Nanoparticle Activation of the Inflammasome Platform: in Vitro Evidence with a Nano-Formed Calcium Phosphate
err2014-07-03
err0
errOAAI
errLaetitia Pele; Carolin T Haas; Rachel Hewitt; Nuno Faria; Andy Brown; Jonathan Powell
err分享
err收藏
学者 查看更多内容