arrow
返回

Query-Guided Prototype Evolution Network for Few-Shot Segmentation

delete2024-01-01
delete6
delete
OA
AI
R
Runmin Cong
J
J.R. Chen *
W
Wei Zhang
Q
Qingming Huang
赵
赵耀 (Yao Zhao)
DOI:10.1109/TMM.2024.3352921delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Previous Few-Shot Segmentation (FSS) approaches exclusively utilize support features for prototype generation, neglecting the specific requirements of the query. To address this, we present the Query-guided Prototype Evolution Network (QPENet), a new method that integrates query features into the generation process of foreground and background prototypes, thereby yielding customized prototypes attuned to specific queries. The evolution of the foreground prototype is accomplished through a support-query-support iterative process involving two new modules: Pseudo-prototype Generation (PPG) and Dual Prototype Evolution (DPE). The PPG module employs support features to create an initial prototype for the preliminary segmentation of the query image, resulting in a pseudo-prototype reflecting the unique needs of the current query. Subsequently, the DPE module performs reverse segmentation on support images using this pseudo-prototype, leading to the generation of evolved prototypes, which can be considered as custom solutions. As for the background prototype, the evolution begins with a global background prototype that represents the generalized features of all training images. We also design a Global Background Cleansing (GBC) module to eliminate potential adverse components mirroring the characteristics of the current foreground class. Experimental results on the PASCAL-5(i) and COCO-20(i) datasets attest to the substantial enhancements achieved by QPENet over prevailing state-of-the-art techniques, underscoring the validity of our ideas.
Keyword:
Few-shot segmentation
few-shot learning
semantic segmentation
prototype generation

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.5K
被引数:
2.4W

机构

B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
引用论文

引用论文

Electrical conductivity of quasi-two-dimensional foams
err2015-04-02
err0
errOAAI
errPavel Yazhgur; Clément Honorez; Wiebke Drenckhan; Dominique Langevin; Anniina Salonen
err分享
err收藏
Modeling Wood Fibre Length in Black Spruce (Picea mariana (Mill.) BSP) Based on Ecological Land Classification
err2015-09-24
err0
errOAAI
errElisha Townshend; Bharat Pokharel; Art Groot; Doug Pitt; Jeffery Dech
err分享
err收藏
Abnormal event detection by a weakly supervised temporal attention network
err2021-12-01
err17
errOAAI
errZheng, Xiangtao; Zhang, Yichao; Zheng, Yunpeng; Luo, Fulin; Lu, Xiaoqiang
err分享
err收藏
A Pilot Study of the Efficacy of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Treating Posttraumatic Psychopathology: A Randomized Controlled Trial
err2021-01-16
err0
errOAAI
errMeaghan L. O'Donnell; Winnie Lau; Katherine Chisholm; James Agathos; Jonathon Little; Sonia Terhaag; Rachel Brand; Andrea Putica; Alexander C. N. Holmes; Lynda Katona; Kim L. Felmingham; Kim Murray; Fardous Hosseiny; Matthew W. Gallagher
err分享
err收藏
Developmental brain changes during puberty and associations with mental health problems
err2023-04-01
err0
errOAAI
errNiousha Dehestani; Sarah Whittle; Nandita Vijayakumar; Timothy J. Silk
err分享
err收藏
Unmanned Aircraft System Aided Adaptive Video Streaming: A Joint Optimization Approach
err2020-03-01
err32
PREAI
errZhan, Cheng; Hu, Han; Wang, Zhi; Fan, Rongfei; Niyato, Dusit
err分享
err收藏
err分享
err收藏
学者 查看更多内容