arrow
返回

Event-Based Motion Segmentation With Spatio-Temporal Graph Cuts

delete2023-08-01
delete32
delete
OA
AI
Y
Yi Zhou *
G
Guillermo Gallego
X
Xiuyuan Lu
S
Siqi Liu
S
Shaojie Shen
DOI:10.1109/TNNLS.2021.3124580delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Identifying independently moving objects is an essential task for dynamic scene understanding. However, traditional cameras used in dynamic scenes may suffer from motion blur or exposure artifacts due to their sampling principle. By contrast, event-based cameras are novel bio-inspired sensors that offer advantages to overcome such limitations. They report pixel-wise intensity changes asynchronously, which enables them to acquire visual information at exactly the same rate as the scene dynamics. We develop a method to identify independently moving objects acquired with an event-based camera, that is, to solve the event-based motion segmentation problem. We cast the problem as an energy minimization one involving the fitting of multiple motion models. We jointly solve two sub-problems, namely event-cluster assignment (labeling) and motion model fitting, in an iterative manner by exploiting the structure of the input event data in the form of a spatio-temporal graph. Experiments on available datasets demonstrate the versatility of the method in scenes with different motion patterns and number of moving objects. The evaluation shows state-of-the-art results without having to predetermine the number of expected moving objects. We release the software and dataset under an open source license to foster research in the emerging topic of event-based motion segmentation.
Keyword:
Cameras
Motion segmentation
Computer vision
Data models
Dynamics
Tracking
Visualization
Event-based vision
graph cut
motion compensation
motion segmentation

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

T
Technical University of Berlin
学者数:
1.3W
论文数: 1.1W
被引数: 18
H
hunan university
学者数:
4.5W
论文数: 3.3W
被引数: 70
引用论文

引用论文

err分享
err收藏
Thermal Expansion and Viscosity of Confined Liquids
err2011-02-01
err0
PREAI
errShuangyan Xu; Gregory C. Simmons; George W. Scherer
err分享
err收藏
Asynchronous Event-Based Binocular Stereo Matching
err2012-02-01
err121
PREAI
errRogister, Paul; Benosman, Ryad; Ieng, Sio-Hoi; Lichtsteiner, Patrick; Delbruck, Tobi
err分享
err收藏
Nano-LED driven phase change evolution of layered chalcogenides for Raman spectroscopy investigations
err2022-11-01
err0
errOAAI
errMartin Mikulics; Roman Adam; Roman Sobolewski; Sarah Heidtfeld; Derang Cao; Daniel E. Bürgler; Claus M. Schneider; Joachim Mayer; Hilde Helen Hardtdegen
err分享
err收藏
学者 查看更多内容