返回
SpikeCV: open a continuous computer vision era
DOI:10.1007/s11432-023-4565-6.png)
摘要
En 中文
SpikeCV is a new open-source computer vision platform designed for the spike camera, a neuromorphic visual sensor that has seen rapid development in recent years. Unlike traditional cameras, the spike camera operates without a global shutter; instead, each pixel accumulates light intensity and asynchronously fires spikes when a preset threshold is reached. These binary spikes can be generated at frequencies up to 40000 Hz, offering a new mode of visual representation with high spatiotemporal resolution, capturing continuous visual information from the environment. Taking advantage of the spike camera’s low latency and high dynamic range, many spike-based algorithms have made significant progress, such as high-quality imaging and ultra-high-speed target detection. To foster a collaborative ecosystem for spike vision, SpikeCV provides ultra-high-speed scene datasets, hardware interfaces, and a comprehensive module library. It emphasizes data encapsulation, standardization of dataset interfaces, modularity for vision tasks, and support for real-time applications in challenging scenarios. Unlike existing vision frameworks, SpikeCV is specifically optimized for spike data and real-time processing, addressing the unique requirements of spike-based systems. With the advent of the open-source Python ecosystem, modules of SpikeCV can be used as a Python library to fulfill most of the numerical analysis needs of researchers. We demonstrate the efficiency of the SpikeCV on offline inference and real-time applications. The project repository address and website are https://openi.pcl.ac.cn/Cordium/SpikeCV and https://spikecv.github.io .
Keyword:
spike camera
datasets
spike-based algorithms
spike vision
open-source Python ecosystem
期刊
IF:
7.6
论文数:
4.9K
被引数:
8.9K
机构
引用论文
Event-based backpropagation can compute exact gradients for spiking neural networks基于事件的反向传播可以为尖峰神经网络计算精确的梯度
SCIENTIFIC REPORTS
IF3.9
Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type培养海马神经元中的突触修饰:对锋电位时间、突触强度和突触后细胞类型的依赖性
The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability新皮质锥体神经元之间的神经代码取决于神经递质释放概率
Networks of spiking neurons: The third generation of neural network models尖峰神经元网络: 第三代神经网络模型
NEURAL NETWORKS
IF6.3

