返回
Part-Based Semantic Transform for Few-Shot Semantic Segmentation
DOI:10.1109/TNNLS.2021.3084252.png)
摘要
En 中文
Few-shot semantic segmentation remains an open problem for the lack of an effective method to handle the semantic misalignment between objects. In this article, we propose part-based semantic transform (PST) and target at aligning object semantics in support images with those in query images by semantic decomposition-and-match. The semantic decomposition process is implemented with prototype mixture models (PMMs), which use an expectation-maximization (EM) algorithm to decompose object semantics into multiple prototypes corresponding to object parts. The semantic match between prototypes is performed with a min-cost flow module, which encourages correct correspondence while depressing mismatches between object parts. With semantic decomposition-and-match, PST enforces the network's tolerance to objects' appearance and/or pose variation and facilities channelwise and spatial semantic activation of objects in query images. Extensive experiments on Pascal VOC and MS-COCO datasets show that PST significantly improves upon state-of-the-arts. In particular, on MS-COCO, it improves the performance of five-shot semantic segmentation by up to 7.79% with a moderate cost of inference speed and model size. Code for PST is released at https://github.com/Yang-Bob/PST.
Keyword:
Semantics
Image segmentation
Prototypes
Training
Measurement
Transforms
Feature extraction
Few-shot segmentation
prototype mixture models (PMMs)
semantic match
semantic transform
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Evaluating environmental liability through risk premiums charged on loans to agribusiness borrowers
Agribusiness
IF0
In vitro and in vivo binding of neuroactive steroids to the sigma‐1 receptor as measured with the positron emission tomography radioligand [18F]FPS
Synapse
IF0
Distant regulatory elements in a Sox10‐βGEO BAC transgene are required for expression of Sox10 in the enteric nervous system and other neural crest‐derived tissuesSox10-βgeo BAC转基因中的远距离调控元件是肠神经系统和其他神经源性组织中 Sox10 表达所必需的
Quantitative Evaluation of Collagen Crosslinks and Corresponding Tensile Mechanical Properties in Mouse Cervical Tissue during Normal Pregnancy
PLoS ONE
IF0

