arrow
Return

EventTracer: Fast Path Tracing-Based Event Stream Rendering

delete2026-06-08
delete0
PRE
AI
Z
Zhenyang Li
X
Xiaoyang Bai
J
Jinfan Lu
P
Pengfei Shen
E
Edmund Y. Lam
Y
Yifan Peng
DOI:10.1109/tvcg.2026.3701141delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Simulating event streams from 3D scenes has become a common practice in event-based vision research, as it meets the demand for large-scale, high temporal frequency data without setting up expensive hardware devices or undertaking extensive data collections. Yet existing methods in this direction typically work with noiseless RGB frames that are costly to render, and therefore their simulations are often unrealistically low in temporal resolution. In this work, we propose EventTracer, a path tracing-based rendering pipeline that simulates high-fidelity event sequences from complex 3D scenes in an efficient and physics-aware manner. Specifically, we speed up the rendering process via low sample-per-pixel (SPP) path tracing, and train a lightweight event spiking network to denoise the resulting RGB videos into realistic event sequences. Our EventTracerpipeline runs at a speed of $\sim$1 minutes per second of 360p video, and it inherits the merit of accurate spatiotemporal modeling from its path tracing backbone. We show through the Real2Sim and Sim2Real tests that EventTracercaptures higher-fidelity scene details and demonstrates a greater similarity to real-world event data than alternative event simulators, which establishes it as a potential tool for creating large-scale event-RGB datasets, narrowing the sim-to-real gap in event-based vision, and boosting various downstream applications.
Keywords:
Event camera
event simulation
path tracing
spiking neural network

Journal

IEEE Transactions on Visualization and Computer Graphics cover
IEEE Transactions on Visualization and Computer Graphics
IF:
6.5
Papers:
353
Citations:
2.2W

Organization

T
The University of Hong Kong
Scholars:
6.6K
Papers: 3.2K
Citations: 7
Cited Papers

Cited Papers

The Multivehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perception
err2018-07-01
err0
errOAAI
errAlex Zihao Zhu; Dinesh Thakur; Tolga Ozaslan; Bernd Pfrommer; Vijay Kumar; Kostas Daniilidis
errShare
errSave
Focusing techniques
err1993-01-01
err0
PREAI
errMurali Subbarao
errShare
errSave
Event-Based Vision: A Survey
err2022-01-01
err0
errOAAI
errGuillermo Gallego; Tobi Delbruck; Garrick Orchard; Chiara Bartolozzi; Brian Taba; Andrea Censi; Stefan Leutenegger; Andrew J. Davison; Jorg Conradt; Kostas Daniilidis; Davide Scaramuzza
errShare
errSave
Embodied neuromorphic synergy for lighting-robust machine vision to see in extreme bright
err2024-12-30
err0
errOAAI
errZheng, Guangze; Wang, Ziwei; Han, Ruihua; Xing, Wanli; Zhang, Zeqing; Pan, Jia
errShare
errSave
errShare
errSave
CED: Color Event Camera Dataset
err2019-06-01
err0
errOAAI
errCedric Scheerlinck; Henri Rebecq; Timo Stoffregen; Nick Barnes; Robert Mahony; Davide Scaramuzza
errShare
errSave
Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation
err2018-06-01
err0
errOAAI
errHuaizu Jiang; Deqing Sun; Varan Jampani; Ming-Hsuan Yang; Erik Learned-Miller; Jan Kautz
errShare
errSave
researcher View more