.png){kind=icon}
返回
Dual-Guided Frequency Prototype Network for Few-Shot Semantic Segmentation
.png){kind=icon}
PRE
AI
DOI：10.1109/TMM.2024.3383276.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Few-shot semantic segmentation is a challenging task that aims to segment novel classes in the query images given only a few annotated support samples. Most existing prototype-based approaches extract global or local prototypes by global average pooling (GAP) or clustering to represent all object information. Subsequently, the prototype information is employed as guidance for query image segmentation. However, these frameworks fail to fully mine the object details and ignore information from query images. Consequently, we propose a Dual-Guided Frequency Prototype Network (DGFPNet) to solve these issues. Specifically, to mine the global and local object information, a Frequency Prototype Generation Module (FPGM) is first proposed to extract more comprehensive frequency prototypes by multi-frequency pooling (MFP) in the DCT domain. Then, with the guidance of support and query information, a Dual-Guided Selection Module (DGSM) is presented to produce the query attention mask and select more effective prototypes. Based on the query attention mask and support information, the generalized object information is integrated into the feature with the proposed Feature Generalization Module (FGM). Finally, we propose a Multi-Dimension Feature Enrichment Decoder Module (MDFEDM) to capture multi-dimension object information and tackle hard pixels for refining the final segmentation results. Extensive experiments on PASCAL- 5(i) and COCO- 20(i) show that our model achieves new state-of-the-art performances.
Keyword:
Prototypes
Feature extraction
Frequency-domain analysis
Semantic segmentation
Task analysis
Predictive models
Training
Few-shot segmentation
few-shot learning
prototype learning
frequency domain learning
dual-guidance
期刊
IF:
9.7
论文数:
4.7K
被引数:
2.4W
机构
引用论文
Evaluating environmental liability through risk premiums charged on loans to agribusiness borrowers.png)
Agribusiness
AgribusinessIF0
PREAI
分享收藏Modeling Wood Fibre Length in Black Spruce (Picea mariana (Mill.) BSP) Based on Ecological Land ClassificationForests
OAAI
ForestsIF0
OAAI分享收藏Mechanical and corrosion behavior of Cu, Cr, Ni and Zn electroplating on corten A588 steel for scope for betterment in ambient construction applications在corten A588钢上电镀Cu，Cr，Ni和Zn的机械和腐蚀行为，以改善环境中的应用OAAI
OAAI分享收藏Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THVRSC Advances
RSC AdvancesIF0
PREAI
分享收藏
查看更多内容