arrow
Return

Unsupervised Spiking Instance Segmentation on Event Data Using STDP Features

delete2022-11-01
delete5
delete
OA
AI
P
Paul Kirkland *
D
Davide L. Manna
Á
Álex Vicente
G
Gaetano Di Caterina
DOI:10.1109/TC.2022.3191968delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Spiking Neural Networks (SNN) and the field of Neuromorphic Engineering has brought about a paradigm shift in how to approach Machine Learning (ML) and Computer Vision (CV) problem. This paradigm shift comes from the adaption of event-based sensing and processing. An event-based vision sensor allows for sparse and asynchronous events to be produced that are dynamically related to the scene. Allowing not only the spatial information but a high-fidelity of temporal information to be captured. Meanwhile avoiding the extra overhead and redundancy of conventional high frame rate approaches. However, with this change in paradigm, many techniques from traditional CV and ML are not applicable to these event-based spatial-temporal visual streams. As such a limited number of recognition, detection and segmentation approaches exist. In this paper, we present a novel approach that can perform instance segmentation using just the weights of a Spike Time Dependent Plasticity trained Spiking Convolutional Neural Network that was trained for object recognition. This exploits the spatial and temporal aspects of the SpikeSEG network's internal feature representations adding this new discriminative capability. We highlight the new capability by successfully transforming a single class unsupervised network for face detection into a multi-person face recognition and instance segmentation network.
Keywords:
Image segmentation
Semantics
Feature extraction
Object detection
Decoding
Task analysis
Face recognition
Neuromorphic engineering
neuromorphic algorithms
SNN
STDP
computer vision
unsuperivsed learning
instance segmenation

Journal

IEEE Transactions on Computers cover
IEEE Transactions on Computers
IF:
3.8
Papers:
5.4K
Citations:
9.8K

Organization

U
university of strathclyde
Scholars:
1.1W
Papers: 1.1W
Citations: 12
Cited Papers

Cited Papers

A novel endoesophageal magnetic device to prevent gastroesophageal reflux
err2008-12-31
err0
PREAI
errMauro Bortolotti; Annamaria Grandis; Giosuè Mazzero
errShare
errSave
Crystalline‐State Reaction with Allosteric Effect in Spin‐Crossover, Interpenetrated Networks with Magnetic and Optical Bistability
err2003-08-13
err0
PREAI
errVirginie Niel; Amber L. Thompson; M. Carmen Muñoz; Ana Galet; Andrés E. Goeta; José A. Real
errShare
errSave
Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
errShare
errSave
Particle size, morphology and phase transitions in hydrothermally produced VO2(D)
err2017-01-01
err0
errOAAI
errDiana Teixeira; Raul Quesada-Cabrera; Michael J. Powell; G. K. L. Goh; G. Sankar; I. P. Parkin; R. G. Palgrave
errShare
errSave
Artefactual Nanoparticle Activation of the Inflammasome Platform: in Vitro Evidence with a Nano-Formed Calcium Phosphate
err2014-07-03
err0
errOAAI
errLaetitia Pele; Carolin T Haas; Rachel Hewitt; Nuno Faria; Andy Brown; Jonathan Powell
errShare
errSave
researcher View more