arrow
返回

Part-Based Semantic Transform for Few-Shot Semantic Segmentation

delete2022-12-01
delete25
PRE
AI
B
Boyu Yang
F
Fang Wan *
刘畅 封面图
刘畅 (Chang Liu)
B
Bohao Li
季
季向阳 (Xiangyang Ji)
Qixiang Ye 封面图
Qixiang Ye (Qixiang Ye)
DOI:10.1109/TNNLS.2021.3084252delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Few-shot semantic segmentation remains an open problem for the lack of an effective method to handle the semantic misalignment between objects. In this article, we propose part-based semantic transform (PST) and target at aligning object semantics in support images with those in query images by semantic decomposition-and-match. The semantic decomposition process is implemented with prototype mixture models (PMMs), which use an expectation-maximization (EM) algorithm to decompose object semantics into multiple prototypes corresponding to object parts. The semantic match between prototypes is performed with a min-cost flow module, which encourages correct correspondence while depressing mismatches between object parts. With semantic decomposition-and-match, PST enforces the network's tolerance to objects' appearance and/or pose variation and facilities channelwise and spatial semantic activation of objects in query images. Extensive experiments on Pascal VOC and MS-COCO datasets show that PST significantly improves upon state-of-the-arts. In particular, on MS-COCO, it improves the performance of five-shot semantic segmentation by up to 7.79% with a moderate cost of inference speed and model size. Code for PST is released at https://github.com/Yang-Bob/PST.
Keyword:
Semantics
Image segmentation
Prototypes
Training
Measurement
Transforms
Feature extraction
Few-shot segmentation
prototype mixture models (PMMs)
semantic match
semantic transform
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
引用论文

引用论文

Diagnostic delay and colectomy risk in pediatric ulcerative colitis
err2020-03-01
err0
PREAI
errMahesh Krishna; Savini Britto; Justin Qian; Faith Ihekweazu; Jose Ruben Rodriguez; Richard Kellermayer
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Quantitative Evaluation of Collagen Crosslinks and Corresponding Tensile Mechanical Properties in Mouse Cervical Tissue during Normal Pregnancy
err2014-11-14
err0
errOAAI
errKyoko Yoshida; Hongfeng Jiang; MiJung Kim; Joy Vink; Serge Cremers; David Paik; Ronald Wapner; Mala Mahendroo; Kristin Myers
err分享
err收藏
学者 查看更多内容