arrow
返回

E-MLB: Multilevel Benchmark for Event-Based Camera Denoising

delete2024-01-01
delete10
delete
OA
AI
王
王洋 (Yang Wang) *
Y
Yu Kang
W
Weiguo Song
J
Jie Cheng
曹
曹洋 (Yang Cao)
DOI:10.1109/TMM.2023.3260638delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Event cameras, such as dynamic vision sensors (DVS), are biologically inspired vision sensors that have advanced over conventional cameras in high dynamic range, low latency and low power consumption, showing great application potential in many fields. Event cameras are more sensitive to junction leakage current and photocurrent as they output differential signals, losing the smoothing function of the integral imaging process in the RGB camera. The logarithmic conversion further amplifies noise, especially in low-contrast conditions. Recently, researchers proposed a series of datasets and evaluation metrics but limitations remain: 1) the existing datasets are small in scale and insufficient in noise diversity, which cannot reflect the authentic working environments of event cameras; and 2) the existing denoising evaluation metrics are mostly referenced evaluation metrics, relying on APS information or manual annotation. To address the above issues, we construct a large-scale event denoising dataset (multilevel benchmark for event denoising, E-MLB) for the first time, which consists of 100 scenes, each with four noise levels, that is 12 times larger than the largest existing denoising dataset. We also propose the first nonreference event denoising metric, the event structural ratio (ESR), which measures the structural intensity of given events. ESR is inspired by the contrast metric, but is independent of the number of events and projection direction. Based on the proposed benchmark and ESR, we evaluate the most representative denoising algorithms, including classic and SOTA, and provide denoising baselines under various scenes and noise levels. The corresponding results and codes are available at https://github.com/KugaMaxx/cuke-emlb.
Keyword:
Event camera
event denoising
nonreference denoising metric

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

U
university of science & technology of china, cas
学者数:
3.2W
论文数: 2.7W
被引数: 74
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
Crack and flip phacoemulsification technique
err1993-11-01
err0
PREAI
errHoward I. Fine; William F. Maloney; David M. Dillman
err分享
err收藏
Front and Back Illuminated Dynamic and Active Pixel Vision Sensors Comparison
err2018-05-01
err93
errOAAI
errTaverni, Gemma; Moeys, Diederik Paul; Li, Chenghan; Cavaco, Celso; Motsnyi, Vasyl; Bello, David San Segundo; Delbruck, Tobi
err分享
err收藏
Nano-LED driven phase change evolution of layered chalcogenides for Raman spectroscopy investigations
err2022-11-01
err0
errOAAI
errMartin Mikulics; Roman Adam; Roman Sobolewski; Sarah Heidtfeld; Derang Cao; Daniel E. Bürgler; Claus M. Schneider; Joachim Mayer; Hilde Helen Hardtdegen
err分享
err收藏
学者 查看更多内容