arrow
Return

Superpixel-informed transformer for multi-label image classification

delete2026-05-16
delete0
PRE
AI
H
Haixiang Li
M
Min Fang *
B
Bo Chen
X
Xiao Li
王
王桂芝 (Guizhi Wang)
DOI:10.1016/j.neucom.2026.133995delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multi-label image classification aims to assign a set of relevant semantic labels to an image. However, current methods often suffer from region evidence confusion, where cues from small objects are diluted by dominant regions. In addition to this visual ambiguity, decoupled modeling remains a common hurdle, as it separates visual feature extraction from label relationship learning. To address these limitations, we propose the Superpixel-informed Transformer (SPiT), a novel end-to-end framework. SPiT adaptively decomposes an image into semantically coherent quasi-object regions using a differentiable superpixel network. Upon these regions, a class-query-based Transformer then performs unified evidence aggregation and label dependency modeling. Experimental results on PASCAL VOC 2007, MS-COCO 2014, and ISIC 2018 demonstrate the superiority of the proposed method, achieving mAP scores of 93.06%, 81.73%, and 56.72%, respectively, outperforming state-of-the-art techniques on all three benchmarks.
Keywords:
multi-label image classification
superpixel
Transformer
visual ambiguity
label dependency modeling

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

X
xidian university
Scholars:
6.6K
Papers: 2.2K
Citations: 0
P
pla general hospital
Scholars:
264
Papers: 108
Citations: 0
Cited Papers

Cited Papers

errShare
errSave
Hierarchical multi-granular multi-label contrastive learning
err2025-04-09
err0
PREAI
errLi, Haixiang; Fang, Min; Li, Xiao; Chen, Bo; Wang, Guizhi
errShare
errSave
Superpixels: An evaluation of the state-of-the-art
err2018-01-01
err0
errOAAI
errDavid Stutz; Alexander Hermans; Bastian Leibe
errShare
errSave
Semantic-Guided Representation Enhancement for Multi-Label Image Classification
err
IF0
err2024-10-01
err0
PREAI
errXuelin Zhu; Jianshu Li; Jiuxin Cao; Dongqi Tang; Jian Liu; Bo Liu
errShare
errSave
A review of methods for imbalance d multi-lab el classification
err2021-10-01
err199
PREAI
errTarekegn, Adane Nega; Giacobini, Mario; Michalak, Krzysztof
errShare
errSave
Efficient graph-based image segmentation
err2004-09-01
err4.9K
PREAI
errFelzenszwalb, PF; Huttenlocher, DP
errShare
errSave
SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
err2012-11-01
err0
errOAAI
errR. Achanta; A. Shaji; K. Smith; A. Lucchi; P. Fua; Sabine Süsstrunk
errShare
errSave
The Pascal Visual Object Classes (VOC) Challenge
err2009-09-09
err9.0K
PREAI
errEveringham, Mark; Van Gool, Luc; Williams, Christopher K. I.; Winn, John; Zisserman, Andrew
errShare
errSave
Beyond Word Embeddings: Heterogeneous Prior Knowledge Driven Multi-Label Image Classification
err2023-01-01
err6
PREAI
errDeng, Xiang; Feng, Songhe; Lyu, Gengyu; Wang, Tao; Lang, Congyan
errShare
errSave
researcher View more