arrow
返回

Multi-query and multi-level enhanced network for semantic segmentation

delete2024-12-01
delete2
PRE
AI
B
Bin Xie
J
Jiale Cao *
R
Rao Muhammad Anwer
J
Jin Xie
J
Jing Nie
杨爱萍 封面图
杨爱萍 (Aiping Yang)
Y
Yanwei Pang
DOI:10.1016/j.patcog.2024.110777delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Plain transformer-based methods have achieved promising performance on semantic segmentation recently. These methods adopt a single set of class queries to predict masks of different semantic categories based on multi-level feature maps. We argue that this single-query design cannot fully exploit diverse information of different levels for improved semantic segmentation. To address this issue, we propose a multi-query and multi-level enhanced network for semantic segmentation (named QLSeg). Our QLSeg first performs multilevel feature enhancement on plain transformer to improve feature discriminability. Afterwards, we introduce multi-query decoder to respectively extract feature embeddings and predict mask logits at different levels, where feature embeddings are adaptively merged for classification and mask logits are summed for output masks. In addition, we introduce masked attention-to-mask to focus on local regions with the same class. We perform the experiments on three widely-used semantic segmentation datasets: ADE20K, COCO-Stuff-10K, and PASCAL-Context. Our proposed QLSeg achieves competitive results on all these three datasets.
Keyword:
Semantic segmentation
Transformer
Multi-query
Multi-level

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
C
Chongqing University
学者数:
5.1W
论文数: 4.1W
被引数: 6.0W
学者 查看更多机构
引用论文

引用论文

Organochlorine Contaminants in Duck Populations of Walpole Island
err1990-01-01
err0
PREAI
errCraig E. Hebert; G. Douglas Haffner; I. Michael Weis; Rodica Lazar; Laurie Montour
err分享
err收藏
Semantic Understanding of Scenes Through the ADE20K Dataset通过ADE20K数据集对场景进行语义理解
err2018-12-07
err934
PREAI
errZhou, Bolei; Zhao, Hang; Puig, Xavier; Xiao, Tete; Fidler, Sanja; Barriuso, Adela; Torralba, Antonio
err分享
err收藏
err分享
err收藏
Using SEPIC Topology for Improving Power Factor in Distributed Power Supply Systems
err2015-09-22
err0
PREAI
errJ. Sebastián; J. Uceda; J.A. Cobos; J. Arau
err分享
err收藏
Oxidative damage to fibronectin
err1991-02-01
err0
PREAI
errMargret C.M. Vissers; Christine C. Winterbourn
err分享
err收藏
学者 查看更多内容