arrow
返回

Learning Depth From Focus With Event Focal Stack

delete2025-01-01
delete0
PRE
AI
C
Chenxu Jiang
M
Mingyuan Lin
C
Chi Zhang
Z
Zhenghai Wang
L
Lei Yu *
DOI:10.1109/JSEN.2024.3495816delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Depth from focus (DfF) estimates depth by determining the moment of maximum focus from multiple shots at different focal distances, that is, the focal stack. However, the limited sampling rate of conventional optical cameras makes it difficult to obtain sufficient focus cues during the focal sweep, leading to the lack of details in depth estimation. Inspired by biological vision, the event camera records intensity changes over time in extremely low latency, which provides more temporal information for focus time acquisition. In this study, we propose the event-based depth from focus (EDFF) network to estimate depth from the event focal stack (EFS). Specifically, we utilize the event voxel grid to encode intensity change information and project event time surface into the depth domain to preserve per-pixel focal distance information. A focal-distance-guided cross-modal (FDCM) attention module is presented to fuse the information mentioned above. In addition, we propose a multilevel depth fusion block (MDFB) designed to integrate results from each level of a U-Net-like architecture and produce the final output. Furthermore, two EFS datasets for depth estimation are built for training and evaluating our network. Extensive experiments validate that our method outperforms existing state-of-the-art approaches.
Keyword:
Cameras
Noise
Event detection
Robustness
Estimation
Computer architecture
Training
Optical imaging
Tensors
Neurons
Cross-modal attention
depth from focus (DfF)
event cameras
monocular sensor estimation

期刊

IEEE Sensors Journal 封面图
IEEE Sensors Journal
IF:
4.5
论文数:
2.1W
被引数:
7.3W

机构

N
Nanchang University
学者数:
3.7W
论文数: 2.1W
被引数: 3.7W
W
wuhan university
学者数:
8.1W
论文数: 5.8W
被引数: 70
引用论文

引用论文

Event Camera Point Cloud Feature Analysis and Shadow Removal for Road Traffic Sensing
err2022-02-15
err11
PREAI
errLu, Xiao; Mao, Xuning; Liu, Haiqing; Meng, Xiaolin; Rai, Laxmisha
err分享
err收藏
Cyber Attack Protection for a Resilient Electric Vehicle Infrastructure
err2015-12-01
err0
PREAI
errSeyedamirabbas Mousavian; Melike Erol-Kantarci; Thomas Ortmeyer
err分享
err收藏
err分享
err收藏
学者 查看更多内容