arrow
返回

Event-Based Camera Tracker by deltNeRF

delete2023-01-01
delete1
delete
OA
AI
M
Mana Masuda *
Y
Yusuke Sekikawa
H
Hideo Saitô
DOI:10.1109/ACCESS.2023.3283919delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
When a camera travels across a 3D world, only a fraction of pixel value changes; an event-based camera observes the change as sparse events. How can we utilize sparse events for efficient recovery of the camera pose? We show that we can recover the camera pose by minimizing the error between sparse events and the temporal gradient of the scene represented as a neural radiance field (NeRF). To enable the computation of the temporal gradient of the scene, we augment NeRF's camera pose as a time function. When the input pose to the NeRF coincides with the actual pose, the output of the temporal gradient of NeRF equals the observed intensity changes on the event's points. Using this principle, we propose an event-based camera pose tracking framework called TeGRA which realizes the pose update by using the sparse event's observation. To the best of our knowledge, this is the first camera pose estimation algorithm using the scene's implicit representation and the sparse intensity change from events.
Keyword:
Event-based camera
motion tracking
NeRF

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

K
Keio University
学者数:
2.2W
论文数: 1.6W
被引数: 13
D
denso
学者数:
348
论文数: 265
被引数: 0
引用论文

引用论文

Vestibular and Balance Rehabilitation Therapy
err1993-03-01
err0
PREAI
errNeil T. Shepard; Michael Smith-Wheelock; Steven A. Telian; Anil Raj
err分享
err收藏
Single crystals of hydrogenase from Desulfovibrio vulgaris Miyazaki F.
err1987-02-01
err0
errOAAI
errY. Higuchi; N. Yasuoka; M. Kakudo; Y. Katsube; T. Yagi; H. Inokuchi
err分享
err收藏
Palladium catalyzed Suzuki coupling reactions using cobalt-containing bulky phosphine ligands
err2004-03-01
err0
PREAI
errFung-E Hong; Yi-Jung Ho; Yu-Chang Chang; Yi-Chun Lai
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines局部光场融合: 具有规定采样指南的实用视图合成
err2019-07-12
err612
errOAAI
errMildenhall, Ben; Srinivasan, Pratul P.; Ortiz-Cayon, Rodrigo; Kalantari, Nima Khademi; Ramamoorthi, Ravi; Ng, Ren; Kar, Abhishek
err分享
err收藏
学者 查看更多内容