.png){kind=icon}
返回
Spike-Based Motion Estimation for Object Tracking Through Bio-Inspired Unsupervised Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2022.3228168.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Neuromorphic vision sensors, whose pixels output events/spikes asynchronously with a high temporal resolution according to the scene radiance change, are naturally appropriate for capturing high-speed motion in the scenes. However, how to utilize the events/spikes to smoothly track high-speed moving objects is still a challenging problem. Existing approaches either employ time-consuming iterative optimization, or require large amounts of labeled data to train the object detector. To this end, we propose a bio-inspired unsupervised learning framework, which takes advantage of the spatiotemporal information of events/spikes generated by neuromorphic vision sensors to capture the intrinsic motion patterns. Without off-line training, our models can filter the redundant signals with dynamic adaption module based on short-term plasticity, and extract the motion patterns with motion estimation module based on the spike-timing-dependent plasticity. Combined with the spatiotemporal and motion information of the filtered spike stream, the traditional DBSCAN clustering algorithm and Kalman filter can effectively track multiple targets in extreme scenes. We evaluate the proposed unsupervised framework for object detection and tracking tasks on synthetic data, publicly available event-based datasets, and spiking camera datasets. The experiment results show that the proposed model can robustly detect and smoothly track the moving targets on various challenging scenarios and outperforms state-of-the-art approaches.
Keyword:
Neuromorphic vision sensor
bio-inspired
unsu-pervised learning
short-term plasticity
spike-timing-dependent plasticity
motion estimation
spiking camera
high-speed object tracking
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Disruption of integrin-dependent adhesion and survival of endothelial cells by recombinant adenovirus expressing isolated β integrin cytoplasmic domains.png)
Gene Therapy
Gene TherapyIF0
PREAI
分享收藏分享收藏Generated datasets from dynamic reproduction of projectiles in ballistic environments for advanced research (DROPBEAR) testbedIOP SciNotes
OAAI
IOP SciNotesIF0
OAAI分享收藏
查看更多内容