arrow
返回

Occluded Video Instance Segmentation: A Benchmark

delete2022-06-18
delete47
delete
OA
AI
J
Jiyang Qi
Y
Yan Gao
Y
Yao Hu
X
Xinggang Wang
X
Xiaoyu Liu
白
白翔 (Xiang Bai)
S
Serge Belongie
A
Alan Yuille
P
Philip H. S. Torr
S
Song Bai *
DOI:10.1007/s11263-022-01629-1delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Can our video understanding systems perceive objects when a heavy occlusion exists in a scene? To answer this question, we collect a large-scale dataset called OVIS for occluded video instance segmentation, that is, to simultaneously detect, segment, and track instances in occluded scenes. OVIS consists of 296k high-quality instance masks from 25 semantic categories, where object occlusions usually occur. While our human vision systems can understand those occluded instances by contextual reasoning and association, our experiments suggest that current video understanding systems cannot. On the OVIS dataset, the highest AP achieved by state-of-the-art algorithms is only 16.3, which reveals that we are still at a nascent stage for understanding objects, instances, and videos in a real-world scenario. We also present a simple plug-and-play module that performs temporal feature calibration to complement missing object cues caused by occlusion. Built upon MaskTrack R-CNN and SipMask, we obtain a remarkable AP improvement on the OVIS dataset. The OVIS dataset and project code are available at http://songbai.site/ovis.
Keyword:
Video instance segmentation
Occlusion reasoning
Dataset
Video understanding
Benchmark

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

A
alibaba group
学者数:
1.1K
论文数: 789
被引数: 0
U
University of Copenhagen
学者数:
7.6W
论文数: 6.6W
被引数: 86
J
Johns Hopkins University
学者数:
10.2W
论文数: 8.8W
被引数: 13.0W
U
university of oxford
学者数:
9.8W
论文数: 8.6W
被引数: 137
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Predictors of unsustained measurable residual disease negativity in transplant-eligible patients with multiple myeloma符合移植条件的多发性骨髓瘤患者中持续的可测量残留疾病阴性的预测因素
err2024-02-15
err0
PREAI
errCamila Guerrero; Noemi Puig; María-Teresa Cedena; María-José Calasanz; Norma C. Gutierrez; Manuela Fernandez; Albert Oriol; Rafael Ríos-Tamayo; Miguel-Teodoro Hernandez; Rafael Martínez-Martínez; Joan Bargay; Felipe de Arriba; Luis Palomera; Ana Pilar Gonzalez-Rodriguez; Marta-Sonia Gonzalez Perez; Alberto Orfao; María-Victoria Mateos; Joaquin Martinez-Lopez; Laura Rosiñol; Joan Bladé; Juan-Jose Lahuerta; Jesus F. San-Miguel; Bruno Paiva
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容