arrow
Return

Mask encoding: A general instance mask representation for object segmentation

delete2022-04-01
delete4
PRE
AI
R
Rufeng Zhang
T
Tao Kong
王
王新龙 (Xinlong Wang)
M
Mingyu You *
DOI:10.1016/j.patcog.2021.108505delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Instance segmentation is one of the most challenging tasks in computer vision, which requires separating each instance in pixels. To date, a low-resolution binary mask is the dominant paradigm for representation of instance mask. For example, the size of the predicted mask in Mask R-CNN is usually 28 x 28 . Generally, a low-resolution mask can not capture the object details well, while a high-resolution mask dramatically increases the training complexity. In this work, we propose a flexible and effective approach to encode the high-resolution structured mask to the compact representation which shares the advantages of high-quality and low-complexity. The proposed mask representation can be easily integrated into two-stage pipelines such as Mask R-CNN, improving mask AP by 0.9% on the COCO dataset, 1.4% on the LVIS dataset, and 2.1% on the Cityscapes dataset. Moreover, a novel single shot instance segmentation framework can be constructed by extending the existing one-stage detector with a mask branch for this instance representation. Our model shows its superiority over the explicit contour-based pipelines in accuracy with similar computational complexity. We also evaluate our method for video instance segmentation, achieving promising results on YouTube-VIS dataset. Code is available at: https://git.io/AdelaiDet (c) 2021 Elsevier Ltd. All rights reserved.
Keywords:
Mask encoding
Instance segmentation
Video instance segmentation

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

U
University of Adelaide
Scholars:
2.3W
Papers: 2.4W
Citations: 4.2W
T
tongji university
Scholars:
7.9W
Papers: 6.0W
Citations: 98
Cited Papers

Cited Papers

Single annotated pixel based weakly supervised semantic segmentation under driving scenes
err2021-08-01
err8
PREAI
errLi, Xi; Ma, Huimin; Yi, Sheng; Chen, Yanxian; Ma, Hongbing
errShare
errSave
Weakly Supervised Segmentation of COVID19 Infection with Scribble Annotation on CT Images
err2022-02-01
err95
errOAAI
errLiu, Xiaoming; Yuan, Quan; Gao, Yaozong; He, Kelei; Wang, Shuo; Tang, Xiao; Tang, Jinshan; Shen, Dinggang
errShare
errSave
Dual-force convolutional neural networks for accurate brain tumor segmentation
err2019-04-01
err130
PREAI
errChen, Shengcong; Ding, Changxing; Liu, Minfeng
errShare
errSave
Effect of Atorvastatin on the Pharmacokinetics and Pharmacodynamics of Prasugrel and Clopidogrel in Healthy Subjects
err2012-01-12
err0
PREAI
errNagy A. Farid; David S. Small; Christopher D. Payne; Joseph A. Jakubowski; John T. Brandt; Ying G. Li; C. Steven Ernest; Daniel E. Salazar; Christopher S. Konkoy; Kenneth J. Winters
errShare
errSave
SEMEDA: Enhancing segmentation precision with semantic edge aware loss
err2020-12-01
err18
errOAAI
errChen, Yifu; Dapogny, Arnaud; Cord, Matthieu
errShare
errSave
JSPNet: Learning joint semantic & instance segmentation of point clouds via feature self-similarity and cross-task probability
err2022-02-01
err24
PREAI
errChen, Feng; Wu, Fei; Gao, Guangwei; Ji, Yimu; Xu, Jing; Jiang, Guo-Ping; Jing, Xiao-Yuan
errShare
errSave
no more