arrow
返回

Recurrent Graph Neural Networks for Video Instance Segmentation

delete2022-11-18
delete6
delete
OA
AI
E
Emil Brissman
J
Joakim Johnander *
M
Martin Danelljan
M
Michael Felsberg
DOI:10.1007/s11263-022-01703-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Video instance segmentation is one of the core problems in computer vision. Formulating a purely learning-based method, which models the generic track management required to solve the video instance segmentation task, is a highly challenging problem. In this work, we propose a novel learning framework where the entire video instance segmentation problem is modeled jointly. To this end, we design a graph neural network that in each frame jointly processes all detections and a memory of previously seen tracks. Past information is considered and processed via a recurrent connection. We demonstrate the effectiveness of the proposed approach in comprehensive experiments. Our approach operates online at over 25 FPS and obtains 16.3 AP on the challenging OVIS benchmark, setting a new state-of-the-art. We further conduct detailed ablative experiments that validate the different aspects of our approach. Code is available at https://github.com/emibr948/RGNNVIS-PlusPlus.
Keyword:
Detection
Tracking
Segmentation
Video

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

L
Linkoping University
学者数:
1.6W
论文数: 1.5W
被引数: 184
S
swiss federal institutes of technology domain
学者数:
9.0W
论文数: 8.0W
被引数: 163
引用论文

引用论文

err分享
err收藏
Diagnosis of Coeliac Disease in Children Younger Than 2 Years
err2013-02-01
err0
errOAAI
errZrinjka Mišak; Iva Hojsak; Oleg Jadrešin; Alemka Jaklin Kekez; Slaven Abdović; Sanja Kolaček
err分享
err收藏
Rasmussen encephalitis: Epilepsia partialis continua secondary to chronic encephalitis
err1990-11-01
err0
PREAI
errMary L. Zupanc; Eric G. Handler; Ross L. Levine; Timothy W. Jahn; Gabriele M. ZuRhein; Jack M. Rozental; Robert J. Nickles; Curtis R. Partington
err分享
err收藏
err分享
err收藏
A Procedure for Scaling Perceptions of Lodging Quality
err2018-04-24
err0
PREAI
errJuliet M. Getty; Kenneth N. Thompson
err分享
err收藏
err分享
err收藏
学者 查看更多内容