arrow
返回

Multi-Object Tracking and Segmentation Via Neural Message Passing

delete2022-09-26
delete15
delete
OA
AI
G
Guillem Brasó
O
Orcun Cetintas *
L
Laura Leal-Taixé
DOI:10.1007/s11263-022-01678-6delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Graphs offer a natural way to formulate Multiple Object Tracking (MOT) and Multiple Object Tracking and Segmentation (MOTS) within the tracking-by-detection paradigm. However, they also introduce a major challenge for learning methods, as defining a model that can operate on such structured domain is not trivial. In this work, we exploit the classical network flow formulation of MOT to define a fully differentiable framework based on Message Passing Networks. By operating directly on the graph domain, our method can reason globally over an entire set of detections and exploit contextual features. It then jointly predicts both final solutions for the data association problem and segmentation masks for all objects in the scene while exploiting synergies between the two tasks. We achieve state-of-the-art results for both tracking and segmentation in several publicly available datasets. Our code is available at https://github.com/ocetintas/MPNTrackSeg
Keyword:
Multi-object tracking
Segmentation
Neural message passing
Graph neural networks

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

T
Technical University of Munich
学者数:
5.2W
论文数: 3.9W
被引数: 6.2W
引用论文

引用论文

Identification of a Biomarker Panel for Early Detection of Lung Cancer Patients
err2019-08-13
err0
errOAAI
errBethany Geary; Michael J. Walker; Joseph T. Snow; David C. H. Lee; Maria Pernemalm; Saeedeh Maleki-Dizaji; Narges Azadbakht; Sophia Apostolidou; Julie Barnes; Piotr Krysiak; Rajesh Shah; Richard Booton; Caroline Dive; Philip A. Crosbie; Anthony D. Whetton
err分享
err收藏
RBS/Channeling and TEM Study of Damage Buildup in Ion Bombarded GaN
err2011-07-01
err0
errOAAI
errK. Pągowska; R. Ratajczak; A. Stonert; A. Turos; L. Nowicki; N. Sathish; P. Jóźwik; A. Muecklich
err分享
err收藏
err分享
err收藏
学者 查看更多内容