arrow
Return

Fast Event-Based Optical Flow Estimation by Triplet Matching

delete2022-01-01
delete11
delete
OA
AI
S
Shintaro Shiba *
Y
Yoshimitsu Aoki
G
Guillermo Gallego
DOI:10.1109/LSP.2023.3234800delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Event cameras are novel bio-inspired sensors that offer advantages over traditional cameras (low latency, high dynamic range, low power, etc.). Optical flow estimation methods that work on packets of events trade off speed for accuracy, while event-by-event (incremental) methods have strong assumptions and have not been tested on common benchmarks that quantify progress in the field. Towards applications on resource-constrained devices, it is important to develop optical flow algorithms that are fast, light-weight and accurate. This work leverages insights from neuroscience, and proposes a novel optical flow estimation scheme based on triplet matching. The experiments on publicly available benchmarks demonstrate its capability to handle complex scenes with comparable results as prior packet-based algorithms. In addition, the proposed method achieves the fastest execution time (> 10 kHz) on standard CPUs as it requires only three events in estimation. We hope that our research opens the door to real-time, incremental motion estimation methods and applications in real-world scenarios.
Keywords:
Estimation
Optical flow
Signal processing algorithms
Cameras
Benchmark testing
Indexes
Neuroscience
Event cameras
optical flow
low latency
asynchronous sensor
neuroscience
robotics

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

K
Keio University
Scholars:
2.2W
Papers: 1.6W
Citations: 13
T
Technical University of Berlin
Scholars:
1.3W
Papers: 1.1W
Citations: 18