arrow
返回

Learning disentangled representation for self-supervised video object segmentation

delete2022-04-01
delete7
PRE
AI
W
Wenjie Hou
Z
Zheyun Qin
X
Xiaoming Xi
X
Xiankai Lu
尹义龙 封面图
尹义龙 (Yilong Yin) *
DOI:10.1016/j.neucom.2022.01.066delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper proposes a novel self-supervised method for one-shot video object segmentation where the object annotations are only provided in the first frame. The current self-supervised video object segmentation approaches are implemented by modeling the pairwise correspondence between the target and reference frames. The pairwise correspondence only maintains spatio-temporal consistency. However, the VOS tasks not only require a spatio-temporal relationship between the two frames but also require the salient object information for each frame. In order to achieve this goal, we propose a disentangled representation strategy to disentangle the temporal correspondence into the pairwise term and unary term. The pairwise and unary terms capture inter-frame spatio-temporal and intra-frame salient object information, respectively. To demonstrate the importance of the disentangled representation, we apply the proposed approach to DAVIS-2017 and YouTube-VOS datasets. Experimental results confirm the effectiveness of the proposed solution. (c) 2022 Elsevier B.V. All rights reserved.
Keyword:
Self-supervised video object segmentation
Disentangled representation
Pair-wise term
Unary term

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

S
shandong jianzhu university
学者数:
4.3K
论文数: 3.1K
被引数: 3
S
shandong university
学者数:
9.5W
论文数: 6.4W
被引数: 94
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
MATNet: Motion-Attentive Transition Network for Zero-Shot Video Object Segmentation
err2020-01-01
err152
errOAAI
errZhou, Tianfei; Li, Jianwu; Wang, Shunzhou; Tao, Ran; Shen, Jianbing
err分享
err收藏
Deep learning for visual understanding: A review视觉理解的深度学习: 综述
err2016-04-01
err1.6K
PREAI
errGuo, Yanming; Liu, Yu; Oerlemans, Ard; Lao, Songyang; Wu, Song; Lew, Michael S.
err分享
err收藏
Enzyme Immobilization in Nanoparticles Produced by Inverse Microemulsion Polymerization
err1994-11-01
err0
PREAI
errCatherine Daubresse; Christian Grandfils; Robert Jerome; Philippe Teyssie
err分享
err收藏
Selective Video Object Cutout
err2017-12-01
err32
errOAAI
errWang, Wenguan; Shen, Jianbing; Porikli, Fatih
err分享
err收藏
Generative Adversarial Networks An overview生成对抗网络综述
err2018-01-01
err2.4K
errOAAI
errCreswell, Antonia; White, Tom; Dumoulin, Vincent; Arulkumaran, Kai; Sengupta, Biswa; Bharath, Anil A.
err分享
err收藏
学者 查看更多内容