arrow
返回

Coarse Mask Guided Interactive Object Segmentation

delete2023-01-01
delete2
PRE
AI
J
J. Li
J
Junsong Fan
Y
Yuxi Wang
Y
Yuran Yang
张
张兆翔 (Zhaoxiang Zhang) *
DOI:10.1109/TIP.2023.3322564delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Interactive object segmentation aims to produce object masks with user interactions, such as clicks, bounding boxes, and scribbles. Click point is the most popular interactive cue for its efficiency, and related deep learning methods have attracted lots of interest in recent years. Most works encode click points as gaussian maps and concatenate them with images as the model's input. However, the spatial and semantic information of gaussian maps would be noised through multiple convolution layers and won't be fully exploited by top layers for mask prediction. To pass click information to top layers exactly and efficiently, we propose a coarse mask guided model (CMG) which predicts coarse masks with a coarse module to guide the object mask prediction. Specifically, the coarse module encodes user clicks as query features and enriches their semantic information with backbone features through transformer layers, coarse masks are generated based on the enriched query feature and fed into CMG's decoder. Benefiting from the efficiency of transformer, CMG's coarse module and decoder module are lightweight and computationally efficient, making the interaction process more smooth. Experiments on several segmentation benchmarks demonstrate the effectiveness of our method, and we get new state-of-the-art results compared with previous works.
Keyword:
Segmentation
interactive
transformer
annotation tool

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

I
institute of automation, cas
学者数:
2.2K
论文数: 2.1K
被引数: 2
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err分享
err收藏
Nature-based solutions: lessons from around the world
err2016-03-01
err0
PREAI
errNigel Pontee; Siddharth Narayan; Michael W. Beck; Adam H. Hosking
err分享
err收藏
Crystallographic transformations of rapidly quenched Sm10Fe90−xTix and magnetic properties of their nitrides
err1997-12-15
err0
PREAI
errQ. F. Xiao; Z. D. Zhang; T. Zhao; W. Liu; Y. C. Sui; X. G. Zhao; D. Y. Geng
err分享
err收藏
学者 查看更多内容