arrow
Return

Coded Event Focal Stack for Continuous Refocusing in Dynamic Scene

delete2026-02-12
delete0
PRE
AI
M
Minggui Teng
S
Suhang Xuan
Z
Zhiang Yan
H
Hanyue Lou
B
Boyu Li
B
Bin Fan
B
Boxin Shi
DOI:10.1109/TPAMI.2026.3664082delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Traditional cameras face limitations in maintaining focus across dynamic scenes, especially during rapid motion, due to the constraints of their lenses. Post-capture refocusing techniques, including deep learning-based methods and light field cameras, have been explored to mitigate these challenges. However, these approaches frequently struggle with temporal consistency or experience a trade-off in spatial resolution. In this paper, we introduce the coded event focal stack, a novel approach that captures both motion and depth information through event streams recorded during a modulated focal sweep. Our coded event focal stack enables the generation of full-time intermediate frames refocused at arbitrary focal distances. Extensive experiments on both synthetic and real-world datasets demonstrate the superior refocusing capability of our method over state-of-the-art techniques, particularly in dynamic scenes with complex motion and depth variations.
Keywords:
Computational photography
event camera
image refocusing

Journal

IEEE Transactions on Pattern Analysis and Machine Intelligence cover
IEEE Transactions on Pattern Analysis and Machine Intelligence
IF:
18.6
Papers:
1.1K
Citations:
9.8W

Organization

N
northwestern polytechnical university
Scholars:
1.3W
Papers: 4.6K
Citations: 0
P
peking university
Scholars:
11.9W
Papers: 8.7W
Citations: 146
Cited Papers

Cited Papers

Extended depth of field through wave-front coding
err1995-04-10
err0
PREAI
errEdward R. Dowski; W. Thomas Cathey
errShare
errSave
Bringing a Blurry Frame Alive at High Frame-Rate With an Event Camera
err2019-06-01
err0
errOAAI
errLiyuan Pan; Cedric Scheerlinck; Xin Yu; Richard Hartley; Miaomiao Liu; Yuchao Dai
errShare
errSave
Learning to Reduce Defocus Blur by Realistically Modeling Dual-Pixel Data
err2021-10-01
err0
errOAAI
errAbdullah Abuolaim; Mauricio Delbracio; Damien Kelly; Michael S. Brown; Peyman Milanfar
errShare
errSave
DC2: Dual-Camera Defocus Control by Learning to Refocus
err2023-06-01
err0
PREAI
errHadi Alzayer; Abdullah Abuolaim; Leung Chun Chan; Yang Yang; Ying Chen Lou; Jia-Bin Huang; Abhishek Kar
errShare
errSave
errShare
errSave
Real-Time Intermediate Flow Estimation for Video Frame Interpolation
err2022-10-23
err0
PREAI
errZhewei Huang; Tianyuan Zhang; Wen Heng; Boxin Shi; Shuchang Zhou
errShare
errSave
researcher View more