arrow
返回

Fast pixel-matching for video object segmentation

delete2021-10-01
delete9
delete
OA
AI
S
Siyue Yu
J
Jimin Xiao *
张冰峰 封面图
张冰峰 (Bingfeng Zhang)
E
Eng Gee Lim
赵
赵耀 (Yao Zhao)
DOI:10.1016/j.image.2021.116373delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Video object segmentation, aiming to segment the foreground objects given the annotation of the first frame, has been attracting increasing attentions. Many state-of-the-art approaches have achieved great performance by relying on online model updating or mask-propagation techniques. However, most online models require high computational cost due to model fine-tuning during inference. Most mask-propagation based models are faster but with relatively low performance due to failure to adapt to object appearance variation. In this paper, we are aiming to design a new model to make a good balance between speed and performance. We propose a model, called NPMCA-net, which directly localizes foreground objects based on mask-propagation and non-local technique by matching pixels in reference and target frames. Since we bring in information of both first and previous frames, our network is robust to large object appearance variation, and can better adapt to occlusions. Extensive experiments show that our approach can achieve a new state-of-the-art performance with a fast speed at the same time (86.5% IoU on DAVIS-2016 and 72.2% IoU on DAVIS-2017, with speed of 0.11s per frame) under the same level comparison. Source code is available at https://github.com/siyueyu/NPMCA-net.
Keyword:
Non-local pixel matching
Mask-propagation
Encoder-decoder
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

S
Signal Processing and Image Communication
IF:
2.7
论文数:
2.8K
被引数:
4.2K

机构

B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
引用论文

引用论文

err分享
err收藏
A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
err分享
err收藏
The Influence of the Evolutionary Past on the Mind: An Analysis of the Preference for Landscapes in the Human Species
err2018-12-07
err0
errOAAI
errJoelson M. B. Moura; Washington S. Ferreira Júnior; Taline C. Silva; Ulysses P. Albuquerque
err分享
err收藏
Prognostic Value of 18F-FDG PET/CT Metabolic Parameters in Splenic Marginal Zone Lymphoma
err2020-11-01
err0
PREAI
errDomenico Albano; Luca Camoni; Raffaele Giubbini; Francesco Bertagna
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容