arrow
返回

High-efficiency sparse convolution operator for event-based cameras

delete2025-03-12
delete0
delete
OA
AI
S
Sen Zhang
F
Fusheng Zha *
X
Xiangji Wang
M
Mantian Li *
魏
魏国 (Wei Guo)
P
Pengfei Wang
X
Xiaolin Li
S
Sun, Lining
DOI:10.3389/fnbot.2025.1537673delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
事件相机是仿生视觉传感器,它们模拟动物视网膜的稀疏和非同步激活,在各种机器人应用中具有低延迟和低计算负载等优势。然而,尽管事件相机具有固有的稀疏性,大多数现有的视觉处理算法都是针对传统标准相机及其捕获的密集图像进行优化的,因此当应用于事件相机时会导致计算冗余和高延迟。为解决这一差距,我们提出了一种专为事件相机设计的稀疏卷积算子。通过选择性跳过无效的子卷积并高效重组有效计算,我们的算子将计算工作量减少了近90%,并将处理速度提升了近2倍,同时保持了与密集卷积算子相同的精度。这一创新解锁了事件相机在自主导航、实时目标跟踪和工业检测等应用中的潜力,使资源受限的机器人系统能够实现低延迟和高效率的感知。
Keyword:
event-based camera
sparse convolution
convolution operator
high-efficiency
low-latency

期刊

Frontiers in Neurorobotics 封面图
Frontiers in Neurorobotics
IF:
2.8
论文数:
178
被引数:
4.1K

机构

H
harbin inst technol
学者数:
5.3K
论文数: 2.3K
被引数: 898
S
Shenzhen Polytechnic University
学者数:
2.9K
论文数: 2.6K
被引数: 68
引用论文

引用论文

A2G: Leveraging Intuitive Physics for Force-Efficient Robotic GraspingA2G:利用直观物理实现高效能机器人抓取
err2024-07-01
err0
PREAI
errYaofeng Cheng; Shengkai Liu; Fusheng Zha; Wei Guo; Haoyu Du; Pengfei Wang; Zhenshan Bing
err分享
err收藏
DeltaCNN: End-to-End CNN Inference of Sparse Frame Differences in Videos
err2022-06-01
err0
errOAAI
errMathias Parger; Chengcheng Tang; Christopher D. Twigg; Cem Keskin; Robert Wang; Markus Steinberger
err分享
err收藏
Neuromorphic Vision Datasets for Pedestrian Detection, Action Recognition, and Fall Detection
err2019-06-18
err0
errOAAI
errShu Miao; Guang Chen; Xiangyu Ning; Yang Zi; Kejia Ren; Zhenshan Bing; Alois Knoll
err分享
err收藏
err分享
err收藏
Event-Based Visual Flow
err2014-02-01
err292
PREAI
errBenosman, Ryad; Clercq, Charles; Lagorce, Xavier; Ieng, Sio-Hoi; Bartolozzi, Chiara
err分享
err收藏
Efficient Visual Recognition: A Survey on Recent Advances and Brain-inspired Methodologies
err2022-08-18
err11
errOAAI
errWu, Yang; Wang, Ding-Heng; Lu, Xiao-Tong; Yang, Fan; Yao, Man; Dong, Wei-Sheng; Shi, Jian-Bo; Li, Guo-Qi
err分享
err收藏
Event-Based Asynchronous Sparse Convolutional Networks
err2020-11-07
err0
errOAAI
errNico Messikommer; Daniel Gehrig; Antonio Loquercio; Davide Scaramuzza
err分享
err收藏
End to End Learning of Spiking Neural Network Based on R-STDP for a Lane Keeping Vehicle
err2018-05-01
err0
errOAAI
errZhenshan Bing; Claus Meschede; Kai Huang; Guang Chen; Florian Rohrbein; Mahmoud Akl; Alois Knoll
err分享
err收藏
学者 查看更多内容