.png){kind=icon}
返回
EventTracer: Fast Path Tracing-Based Event Stream Rendering
.png){kind=icon}
PRE
AI
DOI：10.1109/tvcg.2026.3701141.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Simulating event streams from 3D scenes has become a common practice in event-based vision research, as it meets the demand for large-scale, high temporal frequency data without setting up expensive hardware devices or undertaking extensive data collections. Yet existing methods in this direction typically work with noiseless RGB frames that are costly to render, and therefore their simulations are often unrealistically low in temporal resolution. In this work, we propose EventTracer, a path tracing-based rendering pipeline that simulates high-fidelity event sequences from complex 3D scenes in an efficient and physics-aware manner. Specifically, we speed up the rendering process via low sample-per-pixel (SPP) path tracing, and train a lightweight event spiking network to denoise the resulting RGB videos into realistic event sequences. Our EventTracerpipeline runs at a speed of $\sim$1 minutes per second of 360p video, and it inherits the merit of accurate spatiotemporal modeling from its path tracing backbone. We show through the Real2Sim and Sim2Real tests that EventTracercaptures higher-fidelity scene details and demonstrates a greater similarity to real-world event data than alternative event simulators, which establishes it as a potential tool for creating large-scale event-RGB datasets, narrowing the sim-to-real gap in event-based vision, and boosting various downstream applications.
Keyword:
Event camera
event simulation
path tracing
spiking neural network
期刊
IF:
6.5
论文数:
353
被引数:
2.2W
机构
引用论文
The Multivehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perception多车辆立体事件相机数据集：用于3D感知的事件相机数据集
OAAI
OAAI分享收藏分享收藏Fine-Tuning Surrogate Gradient Learning for Optimal Hardware Performance in Spiking Neural Networks
PREAI
分享收藏Embodied neuromorphic synergy for lighting-robust machine vision to see in extreme bright具身神经形态协同用于照明鲁棒机器视觉，以在极端明亮环境下实现视觉感知.png)
NATURE COMMUNICATIONS
OAAI
NATURE COMMUNICATIONSIF15.7
OAAI分享收藏分享收藏分享收藏
查看更多内容