arrow
返回

Scribble-Supervised Video Object Segmentation

delete2022-02-01
delete64
PRE
AI
P
Peiliang Huang
J
Junwei Han
刘念 封面图
刘念 (Nian Liu)
任军 封面图
任军 (Jun Ren)
D
Dingwen Zhang *
DOI:10.1109/JAS.2021.1004210delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recently, video object segmentation has received great attention in the computer vision community. Most of the existing methods heavily rely on the pixel-wise human annotations, which are expensive and time-consuming to obtain. To tackle this problem, we make an early attempt to achieve video object segmentation with scribble-level supervision, which can alleviate large amounts of human labor for collecting the manual annotation. However, using conventional network architectures and learning objective functions under this scenario cannot work well as the supervision information is highly sparse and incomplete. To address this issue, this paper introduces two novel elements to learn the video object segmentation model. The first one is the scribble attention module, which captures more accurate context information and learns an effective attention map to enhance the contrast between foreground and background. The other one is the scribble-supervised loss, which can optimize the unlabeled pixels and dynamically correct inaccurate segmented areas during the training stage. To evaluate the proposed method, we implement experiments on two video object segmentation benchmark datasets, YouTube-video object segmentation (VOS), and densely annotated video segmentation (DAVIS)-2017. We first generate the scribble annotations from the original per-pixel annotations. Then, we train our model and compare its test performance with the baseline models and other existing works. Extensive experiments demonstrate that the proposed method can work effectively and approach to the methods requiring the dense per-pixel annotations.
Keyword:
Convolutional neural networks (CNNs)
scribble
self-attention
video object segmentation
weakly supervised

期刊

I
IEEE-CAA Journal of Automatica Sinica
IF:
19.2
论文数:
1.4K
被引数:
1.1W

机构

N
Northwestern Polytechnical University
学者数:
4.6W
论文数: 3.7W
被引数: 5.3W
引用论文

引用论文

Gorlin syndrome and desmoplastic medulloblastoma: Report of 3 cases with unfavorable clinical course and novel mutations
err2015-05-04
err0
errOAAI
errSridharan Gururangan; Giles Robinson; David W. Ellison; Gang Wu; Xuelian He; Q. Richard Lu; Roger McLendon; Gerald Grant; Timothy Driscoll; Ronnie Neuberg
err分享
err收藏
WNT5A promotes stemness characteristics in nasopharyngeal carcinoma cells leading to metastasis and tumorigenesis
err2015-03-10
err0
errOAAI
errLi Qin; Yan-Tao Yin; Fang-Jing Zheng; Li-Xia Peng; Chang-Fu Yang; Ying-Na Bao; Ying-Ying Liang; Xin-Jian Li; Yan-Qun Xiang; Rui Sun; An-Hua Li; Ru-Hai Zou; Xiao-Qing Pei; Bi-Jun Huang; Tie-Bang Kang; Duan-Fang Liao; Yi-Xin Zeng; Bart O. Williams; Chao-Nan Qian
err分享
err收藏
A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
Immuno-PET Imaging of HER3 in a Model in which HER3 Signaling Plays a Critical Role
err2015-11-16
err0
errOAAI
errQinghua Yuan; Takako Furukawa; Takahiro Tashiro; Kouki Okita; Zhao-Hui Jin; Winn Aung; Aya Sugyo; Kotaro Nagatsu; Hiroko Endo; Atsushi B. Tsuji; Ming-Rong Zhang; Takashi Masuko; Masahiro Inoue; Yasuhisa Fujibayashi; Tsuneo Saga
err分享
err收藏
学者 查看更多内容