arrow
Return

High-efficiency sparse convolution operator for event-based cameras

delete2025-03-12
delete0
delete
OA
AI
S
Sen Zhang
F
Fusheng Zha *
X
Xiangji Wang
M
Mantian Li *
魏
魏国 (Wei Guo)
P
Pengfei Wang
X
Xiaolin Li
S
Sun, Lining
DOI:10.3389/fnbot.2025.1537673delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Event-based cameras are bio-inspired vision sensors that mimic the sparse and asynchronous activation of the animal retina, offering advantages such as low latency and low computational load in various robotic applications. However, despite their inherent sparsity, most existing visual processing algorithms are optimized for conventional standard cameras and dense images captured from them, resulting in computational redundancy and high latency when applied to event-based cameras. To address this gap, we propose a sparse convolution operator tailored for event-based cameras. By selectively skipping invalid sub-convolutions and efficiently reorganizing valid computations, our operator reduces computational workload by nearly 90% and achieves almost 2x acceleration in processing speed, while maintaining the same accuracy as dense convolution operators. This innovation unlocks the potential of event-based cameras in applications such as autonomous navigation, real-time object tracking, and industrial inspection, enabling low-latency and high-efficiency perception in resource-constrained robotic systems.
Keywords:
event-based camera
sparse convolution
convolution operator
high-efficiency
low-latency

Journal

Frontiers in Neurorobotics cover
Frontiers in Neurorobotics
IF:
2.8
Papers:
178
Citations:
4.1K

Organization

H
harbin inst technol
Scholars:
5.3K
Papers: 2.3K
Citations: 898
S
Shenzhen Polytechnic University
Scholars:
2.9K
Papers: 2.6K
Citations: 68
Cited Papers

Cited Papers

Event-Based Target Tracking Control for a Snake Robot Using a Dynamic Vision Sensor
err2017-10-26
err0
PREAI
errZhuangyi Jiang; Zhenshan Bing; Kai Huang; Guang Chen; Long Cheng; Alois Knoll
errShare
errSave
A2G: Leveraging Intuitive Physics for Force-Efficient Robotic Grasping
err2024-07-01
err0
PREAI
errYaofeng Cheng; Shengkai Liu; Fusheng Zha; Wei Guo; Haoyu Du; Pengfei Wang; Zhenshan Bing
errShare
errSave
DeltaCNN: End-to-End CNN Inference of Sparse Frame Differences in Videos
err2022-06-01
err0
errOAAI
errMathias Parger; Chengcheng Tang; Christopher D. Twigg; Cem Keskin; Robert Wang; Markus Steinberger
errShare
errSave
Neuromorphic Vision Datasets for Pedestrian Detection, Action Recognition, and Fall Detection
err2019-06-18
err0
errOAAI
errShu Miao; Guang Chen; Xiangyu Ning; Yang Zi; Kejia Ren; Zhenshan Bing; Alois Knoll
errShare
errSave
SECOND: Sparsely Embedded Convolutional Detection
errSENSORS
IF3.5
err2018-10-06
err1.9K
errOAAI
errYan, Yan; Mao, Yuxing; Li, Bo
errShare
errSave
Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccades
err2015-11-16
err0
errOAAI
errGarrick Orchard; Ajinkya Jayawant; Gregory K. Cohen; Nitish Thakor
errShare
errSave
Event-Based Visual Flow
err2014-02-01
err292
PREAI
errBenosman, Ryad; Clercq, Charles; Lagorce, Xavier; Ieng, Sio-Hoi; Bartolozzi, Chiara
errShare
errSave
Efficient Visual Recognition: A Survey on Recent Advances and Brain-inspired Methodologies
err2022-08-18
err11
errOAAI
errWu, Yang; Wang, Ding-Heng; Lu, Xiao-Tong; Yang, Fan; Yao, Man; Dong, Wei-Sheng; Shi, Jian-Bo; Li, Guo-Qi
errShare
errSave
Event-Based Asynchronous Sparse Convolutional Networks
err2020-11-07
err0
errOAAI
errNico Messikommer; Daniel Gehrig; Antonio Loquercio; Davide Scaramuzza
errShare
errSave
End to End Learning of Spiking Neural Network Based on R-STDP for a Lane Keeping Vehicle
err2018-05-01
err0
errOAAI
errZhenshan Bing; Claus Meschede; Kai Huang; Guang Chen; Florian Rohrbein; Mahmoud Akl; Alois Knoll
errShare
errSave
researcher View more