Learning self-target knowledge for few-shot segmentation

Yadang Chen

doi:10.1016/j.patcog.2024.110266

Learning self-target knowledge for few-shot segmentation

2024-05-01

4

PRE

AI

DOI：10.1016/j.patcog.2024.110266

Original

Original request for help

Save

Abstract

En 中文

Few-shot semantic segmentation uses a few annotated data of a specific class in the support set to segment the target of the same class in the query set. Most existing approaches fail to perform well when there are significant intra-class variances. This paper alleviates the problem by concentrating on mining the query image and using the support set as supplementary information. First, it proposes a Query Prototype Generation Module to generate a query foreground prototype from the query features. Specifically, we use both prototypelevel and pixel-level similarity matching to generate two complementary initial prototypes, which we then integrate to create a discriminative query foreground prototype. Second, we propose a Support Auxiliary Refinement Module to further guide the final precise prediction of the query image by leveraging the target category information of the support set through step -by-step mining. Specifically, we generate a query-support mixture prototype based on the support prototype representation obtained using the attention mechanism. Then we generate a support supplement prototype to complement the missing information by encoding over the foreground regions that the query-support mixture prototype fails to segment out. Extensive experiments on PASCAL-5 ' and COCO-20(iota). demonstrate that our model outperforms the prior works of few-shot segmentation.

Keywords:

Few-shot segmentation

Two-level similarity matching

Step-by-step mining

Attention mechanism

Learning self-target knowledge for few-shot segmentation

Abstract

Journal

Organization