arrow
返回

SpikeCV: open a continuous computer vision era

delete2026-01-14
delete0
PRE
AI
Y
Yajing Zheng
J
Jiyuan Zhang
R
Rui Zhao
J
Jianhao Ding
S
Shiyan Chen
W
Weijian Wu
R
Ruiqin Xiong
Z
Zhaofei Yu
T
Tiejun Huang *
DOI:10.1007/s11432-023-4565-6delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
SpikeCV is a new open-source computer vision platform designed for the spike camera, a neuromorphic visual sensor that has seen rapid development in recent years. Unlike traditional cameras, the spike camera operates without a global shutter; instead, each pixel accumulates light intensity and asynchronously fires spikes when a preset threshold is reached. These binary spikes can be generated at frequencies up to 40000 Hz, offering a new mode of visual representation with high spatiotemporal resolution, capturing continuous visual information from the environment. Taking advantage of the spike camera’s low latency and high dynamic range, many spike-based algorithms have made significant progress, such as high-quality imaging and ultra-high-speed target detection. To foster a collaborative ecosystem for spike vision, SpikeCV provides ultra-high-speed scene datasets, hardware interfaces, and a comprehensive module library. It emphasizes data encapsulation, standardization of dataset interfaces, modularity for vision tasks, and support for real-time applications in challenging scenarios. Unlike existing vision frameworks, SpikeCV is specifically optimized for spike data and real-time processing, addressing the unique requirements of spike-based systems. With the advent of the open-source Python ecosystem, modules of SpikeCV can be used as a Python library to fulfill most of the numerical analysis needs of researchers. We demonstrate the efficiency of the SpikeCV on offline inference and real-time applications. The project repository address and website are https://openi.pcl.ac.cn/Cordium/SpikeCV and https://spikecv.github.io .
Keyword:
spike camera
datasets
spike-based algorithms
spike vision
open-source Python ecosystem

期刊

Science China Information Sciences 封面图
Science China Information Sciences
IF:
7.6
论文数:
4.9K
被引数:
8.9K

机构

S
School of Computer Science
学者数:
894
论文数: 427
被引数: 0
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Hybrid High Dynamic Range Imaging fusing Neuromorphic and Conventional Images
err2023-07-01
err0
PREAI
errJin Han; Yixin Yang; Peiqi Duan; Chu Zhou; Lei Ma; Chao Xu; Tiejun Huang; Imari Sato; Boxin Shi
err分享
err收藏
Support vector machines支持向量机
err1998-07-01
err0
PREAI
errM.A. Hearst; S.T. Dumais; E. Osuna; J. Platt; B. Scholkopf
err分享
err收藏
学者 查看更多内容