arrow
返回

Adaptive ROI generation for video object segmentation using reinforcement learning

delete2020-10-01
delete30
delete
OA
AI
孙铭杰 封面图
孙铭杰 (Mingjie Sun)
J
Jimin Xiao *
E
Eng Gee Lim
Y
Yanchun Xie
J
Jiashi Feng
DOI:10.1016/j.patcog.2020.107465delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The task of the proposed method is semi-supervised video object segmentation where only the ground-truth segmentation of the first frame is provided. The existing approaches rely on selecting the region of interest for model update; however it is rough and inflexible, leading to performance degradation. To overcome this limitation, a novel approach is proposed which utilizes reinforcement learning to select optimal adaptation areas for each frame, based on the historical segmentation information. The RL model learns to take optimal actions to adjust the region of interest inferred from the previous frame for online model updating. To speed up the model adaption, a novel multi-branch tree based exploration method is designed to quickly select the best state action pairs. The proposed method is evaluated on three common video object segmentation datasets including DAVIS 2016, SegTrack V2 and Youtube-Object. The results show that the proposed work improves the state-of-the-art of the mean region similarity to 87.1% on the DAVIS 2016 dataset, and to 79.5% on the Youtube-Object dataset. Meanwhile, competitive performance is obtained on the SegTrack V2 dataset. Code is at https://github.com/insomnia94/ARG. (C) 2020 Elsevier Ltd. All rights reserved.
Keyword:
Model adaptation
Video object segmentation
Reinforcement learning
Training accelerate
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

N
National University of Singapore
学者数:
7.6W
论文数: 6.5W
被引数: 11.4W
引用论文

引用论文

err分享
err收藏
CRF learning with CNN features for image segmentation
err2015-10-01
err177
errOAAI
errLiu, Fayao; Lin, Guosheng; Shen, Chunhua
err分享
err收藏
err分享
err收藏
The PASCAL Visual Object Classes Challenge: A RetrospectivePASCAL视觉对象课程挑战: 回顾性
err2014-06-25
err5.0K
PREAI
errEveringham, Mark; Eslami, S. M. Ali; Van Gool, Luc; Williams, Christopher K. I.; Winn, John; Zisserman, Andrew
err分享
err收藏
Multi-level context-adaptive correlation tracking
err2019-03-01
err16
PREAI
errLiu, Peng; Liu, Chang; Zhao, Wei; Tang, Xianglong
err分享
err收藏
A labeled random finite set online multi-object tracker for video data
err2019-06-01
err55
PREAI
errKim, Du Yong; Ba-Ngu Vo; Ba-Tuong Vo; Jeon, Moongu
err分享
err收藏
Hierarchically Supervised Deconvolutional Network for Semantic Video Segmentation
err2017-04-01
err31
PREAI
errWang, Yuhang; Liu, Jing; Li, Yong; Fu, Jun; Xu, Min; Lu, Hanqing
err分享
err收藏
Late Fusion via Subspace Search With Consistency Preservation
err2019-01-01
err33
PREAI
errDong, Xuanyi; Yan, Yan; Tan, Mingkui; Yang, Yi; Tsang, Ivor W.
err分享
err收藏
没有更多内容