arrow
Return

Neuromorphic Event-Based 3D Pose Estimation

delete2016-01-22
delete30
delete
OA
AI
D
David Reverter Valeiras
G
Garrick Orchard
S
Sio-Hoï Ieng
R
Ryad Benosman *
DOI:10.3389/fnins.2015.00522delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Pose estimation is a fundamental step in many artificial vision tasks. It consists of estimating the 3D pose of an object with respect to a camera from the object's 2D projection. Current state of the art implementations operate on images. These implementations are computationally expensive, especially for real-time applications. Scenes with fast dynamics exceeding 30-60 Hz can rarely be processed in real-time using conventional hardware. This paper presents a new method for event-based 3D object pose estimation, making full use of the high temporal resolution (1 Its) of asynchronous visual events output from a single neuromorphic camera. Given an initial estimate of the pose, each incoming event is used to update the pose by combining both 3D and 2D criteria. We show that the asynchronous high temporal resolution of the neuromorphic camera allows us to solve the problem in an incremental manner, achieving real-time performance at an update rate of several hundreds kHz on a conventional laptop. We show that the high temporal resolution of neuromorphic cameras is a key feature for performing accurate pose estimation. Experiments are provided showing the performance of the algorithm on real data, including fast moving objects, occlusions, and cases where the neuromorphic camera and the object are both in motion.
Keywords:
neuromorphic vision
event-based imaging
3D pose estimation
event-based computation
tracking
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Frontiers in Neuroscience cover
Frontiers in Neuroscience
IF:
3.2
Papers:
1.6W
Citations:
5.3W

Organization

S
Sorbonne Universite
Scholars:
6.2W
Papers: 4.5W
Citations: 605