arrow
返回

Flow-Based Visual Stream Compression for Event Cameras

delete2024-12-15
delete1
delete
OA
AI
D
Daniel C. Stumpp *
H
Himanshu Akolkar
A
Alan D. George
R
Ryad Benosman
DOI:10.1109/JIOT.2024.3450428delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
As the use of neuromorphic, event-based vision sensors expands, the need for compression of their output streams has increased. While their operational principle ensures event streams are spatially sparse, the high-temporal resolution of the sensors can result in high-data rates from the sensor depending on scene dynamics. For systems operating in communication-bandwidth-constrained and power-constrained environments, it is essential to compress these streams before transmitting them to a remote receiver. Therefore, we introduce a flow-based method for the real-time asynchronous compression of event streams as they are generated. This method leverages real-time optical flow estimates to predict future events without needing to transmit them, therefore, drastically reducing the amount of data transmitted. The flow-based compression introduced is evaluated using a variety of methods, including spatiotemporal distance between event streams. The introduced method itself is shown to achieve an average compression ratio (CR) of 2.70 on a variety of event-camera data sets with the evaluation configuration used. That compression is achieved with a median temporal error of 0.31 ms and an average spatiotemporal event-stream distance of 4.72. When combined with Lempel-Ziv-Markov chain algorithm compression for non-real-time applications, our method can achieve state-of-the-art average CRs ranging from 9.29 to 13.01. Additionally, we demonstrate that the proposed prediction algorithm is capable of performing real time, low-latency event prediction.
Keyword:
Optical flow
Encoding
Vision sensors
Image coding
Real-time systems
Optical losses
Streaming media
Compression
event-based
low power
neuromorphic
optical flow

期刊

IEEE Internet of Things Journal 封面图
IEEE Internet of Things Journal
IF:
8.9
论文数:
1.4W
被引数:
7.8W

机构

U
University of Pittsburgh
学者数:
4.5W
论文数: 3.6W
被引数: 7.1W
P
pennsylvania commonwealth system of higher education (pcshe)
学者数:
12.9W
论文数: 11.7W
被引数: 177
引用论文

引用论文

Event-Based Visual Flow
err2014-02-01
err292
PREAI
errBenosman, Ryad; Clercq, Charles; Lagorce, Xavier; Ieng, Sio-Hoi; Bartolozzi, Chiara
err分享
err收藏
Inhibition of glyoxalase I by S-substituted glutathiones
err2002-05-01
err0
PREAI
errRobert Vince; Susan Daluge; Wallace B. Wadd
err分享
err收藏
A review of the WHO malaria rapid diagnostic test product testing programme (2008–2018): performance, procurement and policy
err2019-12-02
err0
errOAAI
errJane Cunningham; Sophie Jones; Michelle L. Gatton; John W. Barnwell; Qin Cheng; Peter L. Chiodini; Jeffrey Glenn; Sandra Incardona; Cara Kosack; Jennifer Luchavez; Didier Menard; Sina Nhem; Wellington Oyibo; Roxanne R. Rees-Channer; Iveth Gonzalez; David Bell
err分享
err收藏
学者 查看更多内容